-- Logs begin at Tue 2022-08-23 17:06:35 UTC, end at Tue 2022-08-23 19:47:07 UTC. -- Aug 23 17:40:16.621516 n-d-850468-16 systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 17:40:16.629031 n-d-850468-16 devstack@n-api.service[112828]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 17:40:16.632256 n-d-850468-16 devstack@n-api.service[112828]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 17:40:16 2022] *** Aug 23 17:40:16.632256 n-d-850468-16 devstack@n-api.service[112828]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 17:40:16.632256 n-d-850468-16 devstack@n-api.service[112828]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 17:40:16.632256 n-d-850468-16 devstack@n-api.service[112828]: nodename: n-d-850468-16 Aug 23 17:40:16.632256 n-d-850468-16 devstack@n-api.service[112828]: machine: x86_64 Aug 23 17:40:16.632256 n-d-850468-16 devstack@n-api.service[112828]: clock source: unix Aug 23 17:40:16.632256 n-d-850468-16 devstack@n-api.service[112828]: pcre jit disabled Aug 23 17:40:16.632256 n-d-850468-16 devstack@n-api.service[112828]: detected number of CPU cores: 4 Aug 23 17:40:16.632256 n-d-850468-16 devstack@n-api.service[112828]: current working directory: / Aug 23 17:40:16.632256 n-d-850468-16 devstack@n-api.service[112828]: detected binary path: /usr/bin/uwsgi-core Aug 23 17:40:16.632853 n-d-850468-16 devstack@n-api.service[112828]: your processes number limit is 47680 Aug 23 17:40:16.632853 n-d-850468-16 devstack@n-api.service[112828]: your memory page size is 4096 bytes Aug 23 17:40:16.632853 n-d-850468-16 devstack@n-api.service[112828]: detected max file descriptor number: 2048 Aug 23 17:40:16.632853 n-d-850468-16 devstack@n-api.service[112828]: lock engine: pthread robust mutexes Aug 23 17:40:16.632853 n-d-850468-16 devstack@n-api.service[112828]: thunder lock: enabled Aug 23 17:40:16.632853 n-d-850468-16 devstack@n-api.service[112828]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 17:40:16.632853 n-d-850468-16 devstack@n-api.service[112828]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 17:40:16.672675 n-d-850468-16 devstack@n-api.service[112828]: Python main interpreter initialized at 0x55d73b4bb9c0 Aug 23 17:40:16.672675 n-d-850468-16 devstack@n-api.service[112828]: python threads support enabled Aug 23 17:40:16.672675 n-d-850468-16 devstack@n-api.service[112828]: your server socket listen backlog is limited to 100 connections Aug 23 17:40:16.672675 n-d-850468-16 devstack@n-api.service[112828]: your mercy for graceful operations on workers is 90 seconds Aug 23 17:40:16.673074 n-d-850468-16 devstack@n-api.service[112828]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 17:40:16.673074 n-d-850468-16 devstack@n-api.service[112828]: *** Operational MODE: preforking *** Aug 23 17:40:16.673340 n-d-850468-16 devstack@n-api.service[112828]: *** uWSGI is running in multiple interpreter mode *** Aug 23 17:40:16.673340 n-d-850468-16 devstack@n-api.service[112828]: spawned uWSGI master process (pid: 112828) Aug 23 17:40:16.673538 n-d-850468-16 systemd[1]: Started Devstack devstack@n-api.service. Aug 23 17:40:16.674102 n-d-850468-16 devstack@n-api.service[112828]: spawned uWSGI worker 1 (pid: 112829, cores: 1) Aug 23 17:40:16.674433 n-d-850468-16 devstack@n-api.service[112828]: spawned uWSGI worker 2 (pid: 112830, cores: 1) Aug 23 17:40:16.674616 n-d-850468-16 devstack@n-api.service[112828]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 17:40:17.338005 n-d-850468-16 devstack@n-api.service[112829]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 17:40:17.339765 n-d-850468-16 devstack@n-api.service[112830]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 17:40:18.429892 n-d-850468-16 devstack@n-api.service[112829]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 17:40:18.429892 n-d-850468-16 devstack@n-api.service[112829]: from cryptography.utils import int_from_bytes Aug 23 17:40:18.430514 n-d-850468-16 devstack@n-api.service[112829]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 17:40:18.430514 n-d-850468-16 devstack@n-api.service[112829]: from cryptography.utils import int_from_bytes Aug 23 17:40:18.434153 n-d-850468-16 devstack@n-api.service[112830]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 17:40:18.434153 n-d-850468-16 devstack@n-api.service[112830]: from cryptography.utils import int_from_bytes Aug 23 17:40:18.434657 n-d-850468-16 devstack@n-api.service[112830]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 17:40:18.434657 n-d-850468-16 devstack@n-api.service[112830]: from cryptography.utils import int_from_bytes Aug 23 17:40:20.927829 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 17:40:20.928402 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 17:40:20.928492 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 17:40:20.928842 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 17:40:20.929094 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 17:40:20.929477 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.929795 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.930112 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.930223 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 17:40:20.930648 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.930744 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 17:40:20.930830 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.930974 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 17:40:20.931078 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.931336 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 17:40:20.931428 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.931595 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 17:40:20.931687 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.931952 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.932067 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.932212 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.932311 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.932521 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.932616 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.932837 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-16 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.932931 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.933149 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.933248 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.934019 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.934191 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.934350 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.934489 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.934639 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.934793 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.934945 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.935121 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.935255 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.935386 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.935510 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.935686 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.936001 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.936170 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-16 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.936319 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.936429 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.936632 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.936754 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.936937 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.937069 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.937253 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.937395 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.937556 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.937697 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.937877 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.937976 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.938179 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.938278 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.938509 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.938711 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.938902 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.939024 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.939120 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.939330 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.939496 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-16 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.939658 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.939799 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.939977 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.940098 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.940288 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.940404 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.940595 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.940805 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.940898 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.941110 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.941212 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.941411 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.941503 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.941722 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.941813 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.942047 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.942190 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-16 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.942346 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.942502 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.942695 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.942838 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.942995 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.943149 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.943304 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.943553 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.943651 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.943866 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.943953 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.944175 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.944273 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.944471 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.944561 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.944777 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.944887 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.945075 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.945185 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.945370 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.945468 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.945612 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.945698 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.945910 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.946005 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.946222 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.946318 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.946532 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.946643 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.946865 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.946957 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.947110 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.947212 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.947368 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.947496 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.947661 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.947798 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.947969 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.948098 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.948271 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.948556 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.948660 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.948797 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.949534 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.949950 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.950253 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.950390 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.950631 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.950741 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.950959 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.951054 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.951227 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.951314 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.951484 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.951578 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.951807 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.951900 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.952128 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.952214 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.952440 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.952530 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.952749 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.952891 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.953057 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.953184 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.953365 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.953493 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.953664 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.953798 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.953970 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.954094 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.954277 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.954411 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.954596 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.954738 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.954908 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.955036 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.955250 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.955377 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.955499 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.955632 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.955802 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.955937 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.956102 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.956236 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.956412 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.956549 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.956740 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.956873 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.957037 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.957165 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.957296 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.957419 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.957548 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.957678 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.957845 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.957983 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.958153 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.958282 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.958452 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.958609 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.958799 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.958932 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.959069 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.959192 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.959343 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.959470 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.959642 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.959776 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.959988 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.960125 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.960255 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.960379 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.960511 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.960641 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.960777 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.960903 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.961073 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.961201 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.961369 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.961506 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.961666 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.961794 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.961962 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.962089 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.962270 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.962419 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.962586 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.962714 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.962890 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.963025 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.963438 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.963579 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.963739 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.963876 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.964037 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.964164 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.964345 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.964572 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.964743 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.964949 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.965167 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.965414 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.965553 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.965691 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.965815 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.965938 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.966067 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.966191 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.966321 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.966457 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.966605 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.966741 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.966873 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.966997 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.967132 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.967269 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.967393 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.967532 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.967655 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.967778 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.967899 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.968034 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.968158 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.968288 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.968418 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.968566 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.968701 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.968873 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.968996 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.969175 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.969287 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.969490 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.969599 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.969795 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.969892 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.970100 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.970204 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.970392 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.970499 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.970714 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.970809 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.971024 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.971121 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.971337 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.971435 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.971634 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.971727 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.971930 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.972017 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.972229 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.972316 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.972539 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.972638 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.972833 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.972979 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.973132 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.973221 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.973435 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.973523 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.973734 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.973828 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.974028 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.974116 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.974342 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.974435 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.974692 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.974796 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.975000 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.975088 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.975304 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.975390 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.975610 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.975716 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.975912 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.976005 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:40:20.976216 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.976313 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.976531 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.976628 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.976843 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.976930 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.977165 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.977252 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.977473 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.977573 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.977781 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.977874 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.978092 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.978184 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.978397 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.978485 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.978733 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.978852 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.979055 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.979144 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.979367 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.979465 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.979731 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.979829 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.980066 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.980170 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.980431 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.980558 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.980737 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.980825 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.981069 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.981154 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.981386 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.981475 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.981701 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.981801 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.982022 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.982108 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.982326 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.982420 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.982664 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.982770 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.983004 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.983098 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.983300 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.983393 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.983609 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.983704 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.983914 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.984009 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.984223 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.984312 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.984527 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.984614 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.984831 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.984928 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.985140 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.985235 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.985473 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.985603 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.985781 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.985947 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.986089 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.986176 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.986394 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.986487 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.986727 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.986833 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.987035 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.987123 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.987343 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.987430 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.987649 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.987748 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.987946 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.988033 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.988244 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.988384 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.988541 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.988630 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.988844 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.988939 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.989140 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.989234 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.989452 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.989548 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.989773 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.989860 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.990074 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.990160 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.990387 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.990478 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.990728 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.990869 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.991017 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.991106 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.991322 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.991418 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.991624 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.991709 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.991923 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.992022 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.992223 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.992309 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.992528 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.992615 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.992827 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.992921 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.993142 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.993227 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.993448 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.993534 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.993747 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.993842 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.994065 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.994163 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.994366 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.994523 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.994690 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.994792 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.995001 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.995088 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.995316 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.995438 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.995619 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.996285 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.996465 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.996738 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.996894 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.997128 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.997223 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.997355 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.997489 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.997682 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.997801 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.997999 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.998132 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.998310 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.998459 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.998785 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.998887 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.999106 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.999204 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.999427 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.999514 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.999738 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:20.999824 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.000037 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.000125 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.000342 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.000428 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.000647 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.000733 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.000948 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.001036 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.001248 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.001354 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.001552 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.001646 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.001852 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.001940 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.002152 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.002238 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.002449 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.002535 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.002772 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.002862 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.003071 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.003157 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.003386 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.003487 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.003691 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.003778 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.003993 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.004087 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.004291 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.004390 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.004589 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.004675 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.004927 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.005023 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.005228 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.005323 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.005539 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.005625 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.005841 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.005934 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.006146 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.006248 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.006449 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.006567 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.006779 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.006866 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.007083 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.007172 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.007390 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.007475 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.007699 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.007791 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.008005 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.008092 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.008307 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.008394 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.008612 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.008697 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.008915 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.009008 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.009231 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.009317 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.009538 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.009637 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.009856 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.009944 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.010163 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.010257 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.010478 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.010642 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.010805 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.010952 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.011111 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.011273 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.011506 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.012304 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.012399 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.012618 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.012806 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.012933 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.013132 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.013233 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.013443 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.013556 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.013755 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.013869 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.014061 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.014189 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.014371 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.014499 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.014704 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.014851 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.015015 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.015165 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.015334 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.015487 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.015642 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.015794 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.015998 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.016111 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.016250 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.016449 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.016565 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.016783 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.016878 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.017102 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.017188 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.017426 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.017526 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.017738 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.017834 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.018053 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.018140 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.018363 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.018449 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.018697 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.018802 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.019006 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.019101 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.019317 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.019403 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.019621 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.019714 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.019923 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.020011 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.020228 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.020322 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.020530 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.020619 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.020828 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.020914 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.021131 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.021218 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.021439 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.021540 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.021740 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.021833 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.022040 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.022126 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.022337 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.022432 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.022678 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.022768 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.022984 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.023071 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.023282 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.023422 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.023579 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.023668 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.023885 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.023980 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.024198 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.024291 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.024502 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.024590 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.024806 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.024906 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.025109 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.025202 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.025410 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.025503 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.025706 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.025805 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.026017 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.026115 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.026319 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.026411 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.026642 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.026754 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.026941 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.027027 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.027361 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.027446 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.027667 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.027905 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.027999 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.028216 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.028303 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.028518 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.028617 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.028826 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.028974 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.029141 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.029228 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.029447 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.029546 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.029756 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.029843 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.030056 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.030149 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.030357 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.030455 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.030694 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.030781 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.031001 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.031087 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.031301 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.031389 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.031605 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.031691 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.031910 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.031996 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.032217 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.032305 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.032523 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.032609 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.032835 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.032921 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.033137 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.033272 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.033444 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.033531 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.033749 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.033837 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.034048 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.034135 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.034351 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.034436 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.034691 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.034797 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.035005 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.035255 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.035348 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.035585 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.035672 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.035898 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.035985 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.036205 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.036290 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.036515 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.036600 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.036826 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.036913 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.037132 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.037263 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.037444 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.037535 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.037754 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.037842 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.038057 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.038153 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.038359 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.038445 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.038687 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.038791 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.038989 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.039250 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.039336 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.039582 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.039707 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.039879 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.039974 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.040179 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.040265 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.040482 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.040578 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.040780 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.040873 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.041080 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.041167 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.041377 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.041472 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.041675 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.041762 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.041984 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.042196 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.042306 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.042505 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.043145 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.043508 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.043607 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.043827 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.043949 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.044134 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.044271 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.044434 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.044585 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.044734 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.044901 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.045036 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.045210 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.045372 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.045523 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.045672 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.045831 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.046003 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.046138 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.046329 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.046444 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.046686 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.046777 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.046989 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.047085 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.047286 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.047373 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.047602 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.047688 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.047901 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.047991 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.048199 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.048286 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.048495 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.048631 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.048871 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.049030 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.049183 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.049330 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.049467 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.049628 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.049771 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.049902 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.050082 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.050245 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.050415 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.050515 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.050756 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.050880 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.051055 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.051143 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.051361 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.051463 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.051660 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.051747 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.051999 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.052166 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.052318 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.052489 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.052630 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.052746 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.052871 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.053005 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.053179 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.053308 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.053489 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.053633 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.053792 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.053894 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.054102 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.054192 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.054413 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.054507 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.054753 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.054879 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.055071 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.055238 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.055388 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.055539 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.055679 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.055820 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.055981 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.056141 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.056293 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.056444 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.056622 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.056794 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.056944 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.057099 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.057249 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.057399 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.057544 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.057703 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.057832 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.057919 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.058138 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.058953 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.059148 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.059335 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.059488 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.059633 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.059815 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.060069 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.060226 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.060394 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.060545 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.060707 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.060870 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.061101 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.061283 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.061443 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.061588 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.061727 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.061879 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.062033 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.062033 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.062301 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.062388 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.062468 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.062468 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.062650 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.062807 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.062956 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.063115 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.063255 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.063419 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.063556 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.063728 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.063853 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.064038 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.064169 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.064382 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.064487 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.064704 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.064793 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.065007 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.065281 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.065375 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.065579 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.065668 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.065895 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.065982 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.066197 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.066284 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.066505 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.066641 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.066831 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.066919 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.067132 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.067226 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.067434 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.067523 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.067735 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.067824 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.068037 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.068133 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.068343 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.068428 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.068638 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.068725 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.068944 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.069039 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.069245 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.069330 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.069545 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.069630 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.069839 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.070009 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.070134 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.070225 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.070445 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.070531 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.070774 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.070875 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.071081 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.071168 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.071396 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.071482 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.071711 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.071806 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.072028 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.072122 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.072429 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.072629 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.072710 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.072784 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.072919 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.073060 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.073222 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.073373 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.073525 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.073689 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.073830 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.074165 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.074308 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.074475 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.074623 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.074825 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.074921 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.075142 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.075229 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.075455 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.075555 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.075759 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.075845 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.076064 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.076159 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.076367 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.076457 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.076667 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.076758 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.076982 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.077070 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.077290 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.077378 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.077590 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.077676 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.077892 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.077979 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.078191 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.078281 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.078496 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.078605 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.078900 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.079000 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.079147 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.079235 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.079460 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.079547 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.079772 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.079868 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.080079 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.080168 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.080391 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.080478 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.080693 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.080792 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.080995 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.081088 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.081319 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.081414 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.082267 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.083043 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.083136 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.083219 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.083306 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.083387 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.083473 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.083563 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.083651 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.083732 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.083920 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.084018 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.084018 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.084183 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.084264 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.084343 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.084423 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.084501 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.084594 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.084676 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.084755 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.084834 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.084947 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.085044 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.085260 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.085356 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.085557 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.085644 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.085868 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.085960 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.086277 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.086366 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.086601 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.086706 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.087385 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.087616 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.087616 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.087881 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.088008 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.088392 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.088517 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.088654 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.088776 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.088901 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.089036 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.089157 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.089157 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.089406 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.089550 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.089853 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.089853 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.090441 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.090610 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.090754 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.090935 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.091060 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.091185 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.091310 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.091455 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.091582 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.091707 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.091841 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.091975 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.092197 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.092197 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.092438 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.092584 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.092706 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.092831 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.092956 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.093080 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.093212 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.093432 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.093556 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.093680 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.093802 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.093982 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.094157 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.094290 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.094414 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.094573 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.094709 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.094829 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.094970 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.095109 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.095231 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.095355 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.095480 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.095626 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.095763 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.095925 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.096048 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.096240 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.096378 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.096538 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.096675 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.096846 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.096990 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.097148 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.097273 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.097459 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.097619 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.097742 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.097940 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.098067 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.098252 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.098388 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.098599 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.098725 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.098927 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.099051 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.099232 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.099374 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.099537 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.099661 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.099848 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.099971 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.100143 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.100278 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.100446 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.100583 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.100745 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.100870 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.101043 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.101187 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.101341 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.101539 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.101661 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.101790 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.101947 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.102083 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.102242 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.102366 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.102565 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.102695 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.102884 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.103008 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.103187 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.103325 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.103493 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.103616 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.103806 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.103977 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.104126 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.104325 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.104461 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.104590 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.104736 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.104960 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.105085 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.106331 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.106417 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.106506 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.106624 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.106708 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.106792 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.106861 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.107034 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.107130 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.107344 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.107430 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.107687 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.107773 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.108006 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.108102 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.108296 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.108391 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.108594 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.108680 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.108909 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.109008 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.109208 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.109301 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.109521 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.109607 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.109825 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.109928 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.110127 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.110220 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.110426 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.110513 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.110753 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.110849 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.111091 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.111177 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.111392 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.111476 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.111701 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.111786 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.112008 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.112095 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.112313 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.112398 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.112618 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.112705 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.112927 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.113011 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.113227 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.113324 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.113530 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.113617 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.113831 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.113924 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.114137 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.114236 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.114440 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.114527 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.114765 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.114852 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.115076 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.115171 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.115381 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.115464 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.115685 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.115771 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.115994 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.116237 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.116324 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.116562 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.116654 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.116873 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.117007 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.117187 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.117274 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.117496 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.117593 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.117806 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.117901 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.118114 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.118199 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.118419 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.118512 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.118750 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.118849 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.119055 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.119141 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.119358 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.119451 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.119681 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.119774 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.119992 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.120077 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.120306 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.120397 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.120619 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.120705 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.122012 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.122231 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.122409 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.122409 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.122641 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.122734 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.122815 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.122893 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.122975 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.123165 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.123260 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.123468 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.123555 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.123777 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.123862 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.124087 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.124220 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.124397 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.124484 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.124702 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.124788 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.125008 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.125140 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.125314 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.125400 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.125621 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.125714 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.125926 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.126011 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.126230 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.126315 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.126553 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.126655 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.126863 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.126949 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.127186 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.127271 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.127512 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.127611 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.127829 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.127914 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.128137 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.128223 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.128443 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.128531 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.128754 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.128839 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.129101 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.129265 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.129417 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.129577 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.129733 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.129904 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.130065 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.130210 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.130361 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.130527 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.130701 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.130928 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.131013 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.131241 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.131329 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.131560 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.131645 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.131858 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.131950 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.132157 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.132244 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.132461 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.132553 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.132765 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.132851 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.133062 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.133156 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.133376 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.133461 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.133679 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.133778 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.133977 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.134063 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.134293 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.134551 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.134639 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.134882 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.135138 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.135278 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.135482 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.135576 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.135791 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.135887 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.136110 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.136202 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.136450 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.136922 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.137018 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.137110 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.137110 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.137237 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.137418 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.137539 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.137732 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.137820 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.138030 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.138114 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.138332 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.138415 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.138660 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.138751 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.138959 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.139048 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.139258 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.139351 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.139562 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.139652 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.139868 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.139955 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.140168 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.140399 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.140494 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.140747 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.140832 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.141064 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.141156 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.141363 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.141448 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.141662 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.141756 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.141958 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.142044 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.142266 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.142353 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.142579 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.142666 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.142881 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.142966 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.143179 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.143267 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.143475 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.143560 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.143778 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.143865 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.144076 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.144168 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.144379 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.144472 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.144674 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.144769 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.144978 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.145063 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.145278 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.145369 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.145582 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.145681 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.145880 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.145965 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.146193 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.146285 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.146490 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.146622 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.146817 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.146902 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.147119 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.147205 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.147432 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.147530 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.147738 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.147823 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.148040 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.148125 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.148343 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.148430 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.148644 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.148731 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.148953 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.149045 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.149255 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.149498 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.149585 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.149833 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.149919 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.150149 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.150241 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.150454 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.150558 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.150788 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.150885 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.151092 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.151190 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.151393 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.151478 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.151696 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.151790 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.152034 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.152525 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.152624 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.152706 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.152706 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.152903 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.152997 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.153084 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.153283 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.153377 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.153595 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.153680 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.153938 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.154033 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.154248 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.154335 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.154593 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.154810 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.154907 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.155149 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.155235 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.155469 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.155562 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.155772 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.155858 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.156078 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.156163 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.156384 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.156476 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.156700 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.156785 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.157007 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.157092 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.157331 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.157418 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.157641 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.157727 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.157953 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.158046 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.158262 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.158355 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.158589 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.158678 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.158897 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.158983 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.159202 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.159298 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.159505 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.159590 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.159814 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.159897 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.160124 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.160219 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.160432 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.160524 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.160731 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.160815 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.161038 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.161130 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.161345 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.161432 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.161655 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.161746 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.161968 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.162055 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.162307 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.162392 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.162648 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.162738 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.162968 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.163056 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.163275 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.163359 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.163591 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.163686 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.163897 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.163981 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.164205 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.164296 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.164512 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.164606 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.164819 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.164904 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.165141 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.165225 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.165445 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.165595 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.165748 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.165835 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.166045 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.166138 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.166351 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.166466 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.166708 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.166794 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.167014 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.167109 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.167315 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.167426 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.168128 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.168601 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.168702 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.168791 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.168945 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.169027 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.169106 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.169191 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.169293 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.169504 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.169599 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.169818 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.169903 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.170147 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.170239 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.170457 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.170580 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.170780 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.170868 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.171078 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.171163 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.171377 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.171472 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.171674 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.171761 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.171976 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.172061 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.172275 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.172368 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.172574 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.172711 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.172874 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.172968 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.173170 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.173264 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.173466 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.173551 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.173778 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.173871 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.174085 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.174171 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.174390 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.174477 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.174719 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.174823 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.175025 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.175111 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.175336 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.175421 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.175642 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.175739 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.175943 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.176027 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.176248 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.176332 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.176552 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.176639 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.176855 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.176998 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.177159 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.177245 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.177467 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.177561 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.177771 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.177899 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.178073 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.178160 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.178377 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.178469 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.178701 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.178789 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.179005 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.179090 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.179328 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.179415 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.179648 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.179734 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.179949 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.180043 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.180265 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.180350 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.180575 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.180670 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.180889 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.180987 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.181197 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.181291 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.181502 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.181586 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.181822 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.181916 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.182127 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.182214 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.182436 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.182519 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.182798 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.182898 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.183112 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.183211 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.184069 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.184460 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.184541 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.184674 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.184758 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.184845 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.184965 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.185089 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.185277 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.185365 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.185610 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.185731 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.185932 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.186027 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.186239 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.186333 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.186580 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.186681 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.186897 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.186997 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.187214 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.187298 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.187534 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.187619 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.187849 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.187944 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.188177 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.188264 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.188490 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.188575 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.188796 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.188889 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.189105 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.189191 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.189405 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.189498 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.189643 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112829) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 17:40:21.189737 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.190020 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.190332 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.190670 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.190990 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.191307 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.191633 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.191959 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.192269 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.192596 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.192922 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.193266 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.193580 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.193923 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.194251 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.194583 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.194901 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.195212 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:40:21.195456 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112830) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 17:40:21.344837 n-d-850468-16 devstack@n-api.service[112829]: INFO dbcounter [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Registered counter for database nova_api Aug 23 17:40:21.350025 n-d-850468-16 devstack@n-api.service[112830]: INFO dbcounter [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Registered counter for database nova_api Aug 23 17:40:21.365780 n-d-850468-16 devstack@n-api.service[112829]: DEBUG oslo_db.sqlalchemy.engines [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:40:21.371984 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_db.sqlalchemy.engines [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:40:21.373274 n-d-850468-16 devstack@n-api.service[112829]: DEBUG dbcounter [-] [112829] Writer thread running {{(pid=112829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:40:21.378698 n-d-850468-16 devstack@n-api.service[112830]: DEBUG dbcounter [-] [112830] Writer thread running {{(pid=112830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:40:21.433492 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.context [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) {{(pid=112829) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 17:40:21.436100 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.context [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) {{(pid=112830) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 17:40:21.437496 n-d-850468-16 devstack@n-api.service[112829]: DEBUG oslo_concurrency.lockutils [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:40:21.437974 n-d-850468-16 devstack@n-api.service[112829]: DEBUG oslo_concurrency.lockutils [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:40:21.439594 n-d-850468-16 devstack@n-api.service[112829]: DEBUG oslo_concurrency.lockutils [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:40:21.439975 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:40:21.440324 n-d-850468-16 devstack@n-api.service[112829]: DEBUG oslo_concurrency.lockutils [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:40:21.440451 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:40:21.440765 n-d-850468-16 devstack@n-api.service[112829]: DEBUG oslo_concurrency.lockutils [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:40:21.442021 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:40:21.442752 n-d-850468-16 devstack@n-api.service[112829]: DEBUG oslo_concurrency.lockutils [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112829) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:40:21.442845 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:40:21.443227 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:40:21.444693 n-d-850468-16 devstack@n-api.service[112829]: INFO dbcounter [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Registered counter for database nova_cell0 Aug 23 17:40:21.445242 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:40:21.447194 n-d-850468-16 devstack@n-api.service[112830]: INFO dbcounter [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Registered counter for database nova_cell0 Aug 23 17:40:21.450167 n-d-850468-16 devstack@n-api.service[112829]: INFO dbcounter [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Registered counter for database nova_cell1 Aug 23 17:40:21.452875 n-d-850468-16 devstack@n-api.service[112830]: INFO dbcounter [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Registered counter for database nova_cell1 Aug 23 17:40:21.459398 n-d-850468-16 devstack@n-api.service[112829]: DEBUG oslo_db.sqlalchemy.engines [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:40:21.460567 n-d-850468-16 devstack@n-api.service[112829]: DEBUG oslo_db.sqlalchemy.engines [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:40:21.460983 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_db.sqlalchemy.engines [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:40:21.463856 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_db.sqlalchemy.engines [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:40:21.467360 n-d-850468-16 devstack@n-api.service[112829]: DEBUG dbcounter [-] [112829] Writer thread running {{(pid=112829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:40:21.468627 n-d-850468-16 devstack@n-api.service[112830]: DEBUG dbcounter [-] [112830] Writer thread running {{(pid=112830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:40:21.603965 n-d-850468-16 devstack@n-api.service[112829]: DEBUG dbcounter [-] [112829] Writer thread running {{(pid=112829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:40:21.606628 n-d-850468-16 devstack@n-api.service[112830]: DEBUG dbcounter [-] [112830] Writer thread running {{(pid=112830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:40:21.614044 n-d-850468-16 devstack@n-api.service[112829]: INFO dbcounter [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Registered counter for database nova_cell0 Aug 23 17:40:21.619740 n-d-850468-16 devstack@n-api.service[112830]: INFO dbcounter [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Registered counter for database nova_cell0 Aug 23 17:40:21.623747 n-d-850468-16 devstack@n-api.service[112829]: DEBUG oslo_db.sqlalchemy.engines [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112829) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:40:21.628223 n-d-850468-16 devstack@n-api.service[112829]: DEBUG dbcounter [-] [112829] Writer thread running {{(pid=112829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:40:21.629905 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_db.sqlalchemy.engines [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112830) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:40:21.634639 n-d-850468-16 devstack@n-api.service[112830]: DEBUG dbcounter [-] [112830] Writer thread running {{(pid=112830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:40:21.971540 n-d-850468-16 devstack@n-api.service[112829]: WARNING keystonemiddleware.auth_token [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 17:40:21.972122 n-d-850468-16 devstack@n-api.service[112830]: WARNING keystonemiddleware.auth_token [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 17:40:21.978854 n-d-850468-16 devstack@n-api.service[112829]: WARNING keystonemiddleware.auth_token [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 17:40:21.978960 n-d-850468-16 devstack@n-api.service[112830]: WARNING keystonemiddleware.auth_token [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 17:40:22.326627 n-d-850468-16 devstack@n-api.service[112829]: WARNING keystonemiddleware.auth_token [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 17:40:22.327458 n-d-850468-16 devstack@n-api.service[112830]: WARNING keystonemiddleware.auth_token [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 17:40:22.332528 n-d-850468-16 devstack@n-api.service[112829]: WARNING keystonemiddleware.auth_token [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 17:40:22.333352 n-d-850468-16 devstack@n-api.service[112830]: WARNING keystonemiddleware.auth_token [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 17:40:22.337751 n-d-850468-16 devstack@n-api.service[112829]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d73b4bb9c0 pid: 112829 (default app) Aug 23 17:40:22.338837 n-d-850468-16 devstack@n-api.service[112830]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d73b4bb9c0 pid: 112830 (default app) Aug 23 17:40:22.340652 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:40:22.341837 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-f3551392-9b24-4a5e-adbd-0ede5c9953c4 None None] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002266 Aug 23 17:40:22.342249 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 1/1] 10.222.0.61 () {50 vars in 788 bytes} [Tue Aug 23 17:40:22 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:41:41.224046 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:41:41.225256 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001942 Aug 23 17:41:41.225834 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 1/2] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:41:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:41:41.237821 n-d-850468-16 devstack@n-api.service[112829]: DEBUG dbcounter [-] [112829] Writing DB stats nova_api:SELECT=3 {{(pid=112829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:41:41.239007 n-d-850468-16 devstack@n-api.service[112829]: DEBUG dbcounter [-] [112829] Writing DB stats nova_cell0:SELECT=3 {{(pid=112829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:41:41.241205 n-d-850468-16 devstack@n-api.service[112829]: DEBUG dbcounter [-] [112829] Writing DB stats nova_cell1:SELECT=3 {{(pid=112829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:41:41.242190 n-d-850468-16 devstack@n-api.service[112829]: DEBUG dbcounter [-] [112829] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:41:42.117959 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-ec666708-aec2-4a52-81e1-70a2564c0cc5 admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:41:42.151984 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-ec666708-aec2-4a52-81e1-70a2564c0cc5 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.919567 Aug 23 17:41:42.152903 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 2/3] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Aug 23 17:41:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:41:44.523630 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:41:44.524766 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-7adfa242-c685-4ed0-b7d0-45d2ce90453f None None] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 23 17:41:44.525115 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 2/4] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:41:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:41:44.977344 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-018a996b-0ab9-49b6-9772-039fda562ba9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1, "swap": 0, "id": "c1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 256, "vcpus": 1}} {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:41:45.000132 n-d-850468-16 devstack@n-api.service[112829]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:41:45.000132 n-d-850468-16 devstack@n-api.service[112829]: warnings.warn(msg) Aug 23 17:41:45.029484 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-018a996b-0ab9-49b6-9772-039fda562ba9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497803 Aug 23 17:41:45.030033 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 3/5] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Aug 23 17:41:44 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:41:45.044091 n-d-850468-16 devstack@n-api.service[112830]: DEBUG dbcounter [-] [112830] Writing DB stats nova_api:SELECT=3 {{(pid=112830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:41:45.044949 n-d-850468-16 devstack@n-api.service[112830]: DEBUG dbcounter [-] [112830] Writing DB stats nova_cell0:SELECT=3 {{(pid=112830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:41:45.045896 n-d-850468-16 devstack@n-api.service[112830]: DEBUG dbcounter [-] [112830] Writing DB stats nova_cell1:SELECT=3 {{(pid=112830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:41:45.047164 n-d-850468-16 devstack@n-api.service[112830]: DEBUG dbcounter [-] [112830] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:41:45.253361 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-f7cf5e2f-4b2b-427b-9a25-3588f540e003 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:41:45.258176 n-d-850468-16 devstack@n-api.service[112830]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:41:45.258176 n-d-850468-16 devstack@n-api.service[112830]: warnings.warn(msg) Aug 23 17:41:45.329124 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-f7cf5e2f-4b2b-427b-9a25-3588f540e003 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290746 Aug 23 17:41:45.334718 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 3/6] 10.222.0.61 () {64 vars in 1336 bytes} [Tue Aug 23 17:41:45 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:41:47.804257 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-018a996b-0ab9-49b6-9772-039fda562ba9 admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:41:47.806851 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-018a996b-0ab9-49b6-9772-039fda562ba9 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003033 Aug 23 17:41:47.810244 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 4/7] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:41:47 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:41:48.652532 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-e86980e4-d622-4975-8d1e-f9b40729268c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "vcpus": 1, "disk": 5, "rxtx_factor": 1.0}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:41:48.671474 n-d-850468-16 devstack@n-api.service[112830]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:41:48.671474 n-d-850468-16 devstack@n-api.service[112830]: warnings.warn(msg) Aug 23 17:41:48.700938 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-e86980e4-d622-4975-8d1e-f9b40729268c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.885396 Aug 23 17:41:48.701161 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 4/8] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Aug 23 17:41:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 17:41:48.716946 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-351db9a1-ea88-4625-ba85-3104713b0c9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:41:48.722050 n-d-850468-16 devstack@n-api.service[112829]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:41:48.722050 n-d-850468-16 devstack@n-api.service[112829]: warnings.warn(msg) Aug 23 17:41:48.764083 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-351db9a1-ea88-4625-ba85-3104713b0c9d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.053688 Aug 23 17:41:48.765522 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 5/9] 10.222.0.61 () {64 vars in 1336 bytes} [Tue Aug 23 17:41:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:41:51.434461 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-e86980e4-d622-4975-8d1e-f9b40729268c admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:41:51.435585 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-e86980e4-d622-4975-8d1e-f9b40729268c admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Aug 23 17:41:51.436342 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 5/10] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:41:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:41:51.937313 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-4253a259-00fc-40fa-932f-100d18ffae9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "ram": 1024, "vcpus": 1, "id": "d2", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds1G"}} {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:41:51.964783 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-4253a259-00fc-40fa-932f-100d18ffae9a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519569 Aug 23 17:41:51.966054 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 6/11] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Aug 23 17:41:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:41:51.977466 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-4f86c645-7fa6-442e-988c-23e6790ec9f3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:41:52.002632 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-4f86c645-7fa6-442e-988c-23e6790ec9f3 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028799 Aug 23 17:41:52.027330 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 6/12] 10.222.0.61 () {64 vars in 1336 bytes} [Tue Aug 23 17:41:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:41:54.596295 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-4253a259-00fc-40fa-932f-100d18ffae9a admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:41:54.597310 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-4253a259-00fc-40fa-932f-100d18ffae9a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 23 17:41:54.597974 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 7/13] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:41:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:41:55.132157 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-792a28b0-8be5-4254-aa75-daf4fafafc2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "swap": 0, "vcpus": 2, "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:41:55.153681 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-792a28b0-8be5-4254-aa75-daf4fafafc2f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.549309 Aug 23 17:41:55.154322 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 7/14] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Aug 23 17:41:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:41:55.167091 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-712a388a-3c55-4fb4-8ac6-028cd71bddaf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:41:55.191177 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-712a388a-3c55-4fb4-8ac6-028cd71bddaf admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028646 Aug 23 17:41:55.191867 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 8/15] 10.222.0.61 () {64 vars in 1336 bytes} [Tue Aug 23 17:41:55 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:41:57.601406 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-792a28b0-8be5-4254-aa75-daf4fafafc2f admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:41:57.602387 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-792a28b0-8be5-4254-aa75-daf4fafafc2f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 23 17:41:57.602908 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 8/16] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:41:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:41:58.159013 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-0b59ea5d-8b5b-402d-b9f0-52f848190c58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "ram": 4096, "disk": 20, "rxtx_factor": 1.0}} {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:41:58.183187 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-0b59ea5d-8b5b-402d-b9f0-52f848190c58 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.572763 Aug 23 17:41:58.184284 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 9/17] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Aug 23 17:41:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:41:58.195751 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-ef1f62c5-4933-417a-960e-90a10492f11b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:41:58.223883 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-ef1f62c5-4933-417a-960e-90a10492f11b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031549 Aug 23 17:41:58.235072 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 9/18] 10.222.0.61 () {64 vars in 1336 bytes} [Tue Aug 23 17:41:58 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:42:00.767066 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-0b59ea5d-8b5b-402d-b9f0-52f848190c58 admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:00.769489 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-0b59ea5d-8b5b-402d-b9f0-52f848190c58 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003026 Aug 23 17:42:00.782607 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 10/19] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:42:00 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:01.273150 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-701ff0cb-5100-4cb7-ae59-87e1d8368710 admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:01.299147 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-701ff0cb-5100-4cb7-ae59-87e1d8368710 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.520649 Aug 23 17:42:01.299724 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 10/20] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Aug 23 17:42:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:42:03.707599 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-0b59ea5d-8b5b-402d-b9f0-52f848190c58 admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:03.708600 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-0b59ea5d-8b5b-402d-b9f0-52f848190c58 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 23 17:42:03.709003 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 11/21] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:42:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:04.155319 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-25188f5a-8f40-4469-a925-2533b55176da admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:04.174817 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-25188f5a-8f40-4469-a925-2533b55176da admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.458197 Aug 23 17:42:04.175380 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 11/22] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Aug 23 17:42:03 2022] POST /compute/v2.1/flavors => generated 402 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:42:04.189252 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-de6feb38-1a82-4082-b47f-6552c7da876d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:04.219230 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-de6feb38-1a82-4082-b47f-6552c7da876d admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034579 Aug 23 17:42:04.219955 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 12/23] 10.222.0.61 () {64 vars in 1333 bytes} [Tue Aug 23 17:42:04 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:42:07.155182 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-25188f5a-8f40-4469-a925-2533b55176da admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:07.156200 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-25188f5a-8f40-4469-a925-2533b55176da admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 23 17:42:07.156613 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 12/24] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:42:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:07.574783 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-0fc50b7c-9b09-43af-9678-645c413a7b5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 20, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:07.599183 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-0fc50b7c-9b09-43af-9678-645c413a7b5b admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.434619 Aug 23 17:42:07.599963 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 13/25] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Aug 23 17:42:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:42:07.615106 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-6017d331-e745-474f-8d99-02cb36780ad0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:07.645415 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-6017d331-e745-474f-8d99-02cb36780ad0 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034955 Aug 23 17:42:07.646125 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 13/26] 10.222.0.61 () {64 vars in 1333 bytes} [Tue Aug 23 17:42:07 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:42:10.075258 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-0fc50b7c-9b09-43af-9678-645c413a7b5b admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:10.076201 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-0fc50b7c-9b09-43af-9678-645c413a7b5b admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 23 17:42:10.076613 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 14/27] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:42:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:10.450868 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-3c13d93f-f825-4c74-8697-6dd0756415b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "id": "3", "swap": 0, "rxtx_factor": 1.0, "disk": 40, "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:10.469708 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-3c13d93f-f825-4c74-8697-6dd0756415b2 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.386809 Aug 23 17:42:10.470517 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 14/28] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Aug 23 17:42:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:42:10.482731 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-b15488ea-2a0a-4e4f-b548-80f1608c478c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:10.507401 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-b15488ea-2a0a-4e4f-b548-80f1608c478c admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028225 Aug 23 17:42:10.508731 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 15/29] 10.222.0.61 () {64 vars in 1333 bytes} [Tue Aug 23 17:42:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:42:12.927705 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-3c13d93f-f825-4c74-8697-6dd0756415b2 admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:12.929332 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-3c13d93f-f825-4c74-8697-6dd0756415b2 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Aug 23 17:42:12.929740 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 15/30] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:42:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:13.392221 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-77bb1315-f599-4da7-a815-1486f63bd4c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.large", "id": "4", "ram": 8192}} {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:13.398340 n-d-850468-16 devstack@n-api.service[112829]: DEBUG dbcounter [-] [112829] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=112829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:42:13.416490 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-77bb1315-f599-4da7-a815-1486f63bd4c4 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.480259 Aug 23 17:42:13.417319 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 16/31] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Aug 23 17:42:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:42:13.429081 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-9e70d490-58ab-4e13-a417-108b4a6f3753 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:13.454086 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-9e70d490-58ab-4e13-a417-108b4a6f3753 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028565 Aug 23 17:42:13.454683 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 16/32] 10.222.0.61 () {64 vars in 1333 bytes} [Tue Aug 23 17:42:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:42:15.872037 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-77bb1315-f599-4da7-a815-1486f63bd4c4 admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:15.873396 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-77bb1315-f599-4da7-a815-1486f63bd4c4 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 23 17:42:15.874113 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 17/33] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:42:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:16.344482 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-5482e2e3-c7ba-4b5b-a6b5-31347458e82a admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "name": "m1.xlarge", "disk": 160}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:16.353836 n-d-850468-16 devstack@n-api.service[112830]: DEBUG dbcounter [-] [112830] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:42:16.366483 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-5482e2e3-c7ba-4b5b-a6b5-31347458e82a admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.486092 Aug 23 17:42:16.367876 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 17/34] 10.222.0.61 () {64 vars in 1283 bytes} [Tue Aug 23 17:42:15 2022] POST /compute/v2.1/flavors => generated 408 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 17:42:16.380583 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-a6fdb803-ca1a-4a11-b33d-fad7971ab8c1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:16.408219 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-a6fdb803-ca1a-4a11-b33d-fad7971ab8c1 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031542 Aug 23 17:42:16.408864 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 18/35] 10.222.0.61 () {64 vars in 1333 bytes} [Tue Aug 23 17:42:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:42:38.736568 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-5482e2e3-c7ba-4b5b-a6b5-31347458e82a admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:38.737625 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-5482e2e3-c7ba-4b5b-a6b5-31347458e82a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 23 17:42:38.738012 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 18/36] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:42:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:38.749213 n-d-850468-16 devstack@n-api.service[112829]: DEBUG dbcounter [-] [112829] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=112829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:42:39.124062 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-e73d1c06-b548-4e69-86f2-d1512e92e12b admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:39.142753 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-e73d1c06-b548-4e69-86f2-d1512e92e12b admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397930 Aug 23 17:42:39.143296 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 19/37] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Aug 23 17:42:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:42:40.213702 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-5482e2e3-c7ba-4b5b-a6b5-31347458e82a admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:40.214726 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-5482e2e3-c7ba-4b5b-a6b5-31347458e82a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Aug 23 17:42:40.215125 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 19/38] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Aug 23 17:42:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:40.755311 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-ea6b75a6-b26f-4e6e-a558-dee307fe85f0 admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:40.761614 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.wsgi [None req-ea6b75a6-b26f-4e6e-a558-dee307fe85f0 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-ea6b75a6-b26f-4e6e-a558-dee307fe85f0 admin admin] Request method failure captured: Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: Accept: application/json Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: Accept-Encoding: gzip, deflate Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: Connection: keep-alive Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: Content-Length: 0 Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: Host: 10.222.0.61 Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: Openstack-Api-Version: compute 2.90 Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: Openstack-System-Scope: None Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: User-Agent: python-novaclient Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: X-Auth-Token: gAAAAABjBRGQBxsLGdkrRup0bNx9heUIA9zoqf4vQFO5ZXJxdeDHm1qKjFOywZ_ms7h8jnNzhCqJyCr_QPc5nMV-BCZpoNqTEY1zbFyuhOL-P7v1rffa2aFUDS0076cWBDLvS9jfEY8AonY9b9shWQ7ruTbY99ZV6r24MOflOBoN2qX8eaMijF8 Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: X-Domain-Id: None Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: X-Domain-Name: None Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: X-Identity-Status: Confirmed Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: X-Is-Admin-Project: True Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: X-Project-Domain-Id: default Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: X-Project-Domain-Name: Default Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: X-Project-Id: fe28e3af01d94abf87ebdd04e7b71491 Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: X-Project-Name: admin Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: X-Role: reader,member,admin Aug 23 17:42:40.764903 n-d-850468-16 devstack@n-api.service[112829]: X-Roles: reader,member,admin Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe28e3af01d94abf87ebdd04e7b71491"}]}] Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: X-Tenant: admin Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: X-Tenant-Id: fe28e3af01d94abf87ebdd04e7b71491 Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: X-Tenant-Name: admin Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: X-User: admin Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: X-User-Domain-Id: default Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: X-User-Domain-Name: Default Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: X-User-Id: 1484d2dcd5d9433ca8384c5e3b92888b Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: X-User-Name: admin Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: method: > Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: exception: Flavor 42 could not be found. Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: action_args: {'id': '42'} Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:42:40.766349 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:42:40.767586 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:40.769017 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-ea6b75a6-b26f-4e6e-a558-dee307fe85f0 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:42:40.770310 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-ea6b75a6-b26f-4e6e-a558-dee307fe85f0 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.399703 Aug 23 17:42:40.770310 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 20/39] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Aug 23 17:42:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:42:40.776921 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-542d9b17-064b-43c3-919d-046b9e95e6d2 admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:40.799291 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-542d9b17-064b-43c3-919d-046b9e95e6d2 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026818 Aug 23 17:42:40.799825 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 20/40] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Aug 23 17:42:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:42:40.812986 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-7a225a1c-53a0-4491-a8b6-a17a08dc058f admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:40.837867 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-7a225a1c-53a0-4491-a8b6-a17a08dc058f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028378 Aug 23 17:42:40.838684 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 21/41] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Aug 23 17:42:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:42:40.848153 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-5164a792-82aa-4a77-8647-5e22c32a523a admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:40.855505 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.wsgi [None req-5164a792-82aa-4a77-8647-5e22c32a523a admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-5164a792-82aa-4a77-8647-5e22c32a523a admin admin] Request method failure captured: Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: Accept: application/json Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: Accept-Encoding: gzip, deflate Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: Connection: keep-alive Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: Content-Length: 0 Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: Host: 10.222.0.61 Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: Openstack-Api-Version: compute 2.90 Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: Openstack-System-Scope: None Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: User-Agent: python-novaclient Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: X-Auth-Token: gAAAAABjBRGQBxsLGdkrRup0bNx9heUIA9zoqf4vQFO5ZXJxdeDHm1qKjFOywZ_ms7h8jnNzhCqJyCr_QPc5nMV-BCZpoNqTEY1zbFyuhOL-P7v1rffa2aFUDS0076cWBDLvS9jfEY8AonY9b9shWQ7ruTbY99ZV6r24MOflOBoN2qX8eaMijF8 Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: X-Domain-Id: None Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: X-Domain-Name: None Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: X-Identity-Status: Confirmed Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: X-Is-Admin-Project: True Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: X-Project-Domain-Id: default Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: X-Project-Domain-Name: Default Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: X-Project-Id: fe28e3af01d94abf87ebdd04e7b71491 Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: X-Project-Name: admin Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: X-Role: reader,member,admin Aug 23 17:42:40.858829 n-d-850468-16 devstack@n-api.service[112830]: X-Roles: reader,member,admin Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe28e3af01d94abf87ebdd04e7b71491"}]}] Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: X-Tenant: admin Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: X-Tenant-Id: fe28e3af01d94abf87ebdd04e7b71491 Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: X-Tenant-Name: admin Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: X-User: admin Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: X-User-Domain-Id: default Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: X-User-Domain-Name: Default Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: X-User-Id: 1484d2dcd5d9433ca8384c5e3b92888b Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: X-User-Name: admin Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: method: > Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: exception: Flavor 42 could not be found. Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: action_args: {'id': '42'} Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:42:40.860359 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:42:40.861280 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:40.862527 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-5164a792-82aa-4a77-8647-5e22c32a523a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:42:40.863550 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-5164a792-82aa-4a77-8647-5e22c32a523a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015689 Aug 23 17:42:40.863550 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 21/42] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Aug 23 17:42:40 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:42:41.826629 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-7a225a1c-53a0-4491-a8b6-a17a08dc058f admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:41.827646 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-7a225a1c-53a0-4491-a8b6-a17a08dc058f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Aug 23 17:42:41.828076 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 22/43] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Aug 23 17:42:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:42.355094 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-9bc27562-5b79-4f58-b643-56e812e02b89 admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:42.360515 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.wsgi [None req-9bc27562-5b79-4f58-b643-56e812e02b89 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-9bc27562-5b79-4f58-b643-56e812e02b89 admin admin] Request method failure captured: Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: Accept: application/json Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: Accept-Encoding: gzip, deflate Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: Connection: keep-alive Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: Content-Length: 0 Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: Host: 10.222.0.61 Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: Openstack-Api-Version: compute 2.90 Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: Openstack-System-Scope: None Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: User-Agent: python-novaclient Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: X-Auth-Token: gAAAAABjBRGRSHhjitucKke7OmmC0Drnyrzd14BQ-qr9HI5DQ-qDPqQme10vBzuyRpGnbYQqhWDbPoSEcdCOcF13oGz_YJMDqFMPpl8dE-bGCRRTGJhz48rLY5VEwFBOnpfZCYB3fR4QNy2erjFndRru2hmUdmVHJ2oOZMt-kyOyIbN8FI51dUs Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: X-Domain-Id: None Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: X-Domain-Name: None Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: X-Identity-Status: Confirmed Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: X-Is-Admin-Project: True Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: X-Project-Domain-Id: default Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: X-Project-Domain-Name: Default Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: X-Project-Id: fe28e3af01d94abf87ebdd04e7b71491 Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: X-Project-Name: admin Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: X-Role: reader,member,admin Aug 23 17:42:42.362014 n-d-850468-16 devstack@n-api.service[112830]: X-Roles: reader,member,admin Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe28e3af01d94abf87ebdd04e7b71491"}]}] Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: X-Tenant: admin Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: X-Tenant-Id: fe28e3af01d94abf87ebdd04e7b71491 Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: X-Tenant-Name: admin Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: X-User: admin Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: X-User-Domain-Id: default Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: X-User-Domain-Name: Default Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: X-User-Id: 1484d2dcd5d9433ca8384c5e3b92888b Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: X-User-Name: admin Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: method: > Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: exception: Flavor 84 could not be found. Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: action_args: {'id': '84'} Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:42:42.363424 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:42:42.364420 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:42.365917 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-9bc27562-5b79-4f58-b643-56e812e02b89 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:42:42.367855 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-9bc27562-5b79-4f58-b643-56e812e02b89 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.398406 Aug 23 17:42:42.367855 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 22/44] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Aug 23 17:42:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:42:42.373759 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-00e0b73b-d1f3-4c60-9aec-d004ab420af3 admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:42.388986 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-00e0b73b-d1f3-4c60-9aec-d004ab420af3 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018750 Aug 23 17:42:42.389742 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 23/45] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Aug 23 17:42:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:42:42.399381 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-5a48814d-fe0d-4eb3-933d-3982e8daa85a admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:42.415022 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-5a48814d-fe0d-4eb3-933d-3982e8daa85a admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019734 Aug 23 17:42:42.415565 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 23/46] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Aug 23 17:42:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:42:42.424702 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-2f245ba1-ffdb-4125-a757-80f6b1ed1238 admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:42.430183 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.wsgi [None req-2f245ba1-ffdb-4125-a757-80f6b1ed1238 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-2f245ba1-ffdb-4125-a757-80f6b1ed1238 admin admin] Request method failure captured: Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: Accept: application/json Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: Accept-Encoding: gzip, deflate Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: Connection: keep-alive Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: Content-Length: 0 Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: Host: 10.222.0.61 Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: Openstack-Api-Version: compute 2.90 Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: Openstack-System-Scope: None Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: User-Agent: python-novaclient Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: X-Auth-Token: gAAAAABjBRGRSHhjitucKke7OmmC0Drnyrzd14BQ-qr9HI5DQ-qDPqQme10vBzuyRpGnbYQqhWDbPoSEcdCOcF13oGz_YJMDqFMPpl8dE-bGCRRTGJhz48rLY5VEwFBOnpfZCYB3fR4QNy2erjFndRru2hmUdmVHJ2oOZMt-kyOyIbN8FI51dUs Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: X-Domain-Id: None Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: X-Domain-Name: None Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: X-Identity-Status: Confirmed Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: X-Is-Admin-Project: True Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: X-Project-Domain-Id: default Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: X-Project-Domain-Name: Default Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: X-Project-Id: fe28e3af01d94abf87ebdd04e7b71491 Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: X-Project-Name: admin Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: X-Role: reader,member,admin Aug 23 17:42:42.431715 n-d-850468-16 devstack@n-api.service[112829]: X-Roles: reader,member,admin Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe28e3af01d94abf87ebdd04e7b71491"}]}] Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: X-Tenant: admin Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: X-Tenant-Id: fe28e3af01d94abf87ebdd04e7b71491 Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: X-Tenant-Name: admin Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: X-User: admin Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: X-User-Domain-Id: default Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: X-User-Domain-Name: Default Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: X-User-Id: 1484d2dcd5d9433ca8384c5e3b92888b Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: X-User-Name: admin Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: method: > Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: exception: Flavor 84 could not be found. Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: action_args: {'id': '84'} Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:42:42.433241 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:42:42.434110 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:42.435207 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-2f245ba1-ffdb-4125-a757-80f6b1ed1238 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:42:42.436208 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-2f245ba1-ffdb-4125-a757-80f6b1ed1238 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011904 Aug 23 17:42:42.436208 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 24/47] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Aug 23 17:42:42 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 23 17:42:43.403952 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-5a48814d-fe0d-4eb3-933d-3982e8daa85a admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:43.404955 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-5a48814d-fe0d-4eb3-933d-3982e8daa85a admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 23 17:42:43.405374 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 24/48] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Aug 23 17:42:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:43.932124 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-965c2c3f-454a-475d-b204-32db570ba31b admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:43.937849 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.wsgi [None req-965c2c3f-454a-475d-b204-32db570ba31b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-965c2c3f-454a-475d-b204-32db570ba31b admin admin] Request method failure captured: Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: Accept: application/json Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: Accept-Encoding: gzip, deflate Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: Connection: keep-alive Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: Content-Length: 0 Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: Host: 10.222.0.61 Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: Openstack-Api-Version: compute 2.90 Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: Openstack-System-Scope: None Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: User-Agent: python-novaclient Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: X-Auth-Token: gAAAAABjBRGToh6tmhs1DsMcUeQxsVtzFx04RvED7KFNrTMHQxtR5qwsluTna5NhXRWfhHNULgJOcMQRMmz3wYGT_Bfm1DB3L3Eohyb-7z0YqmufVsx5b2F5eYP98N2HlcdTddwo_pAfZEkT3xKY8t-jEEPwBjQ39mUxW_6Aa_ERdQ8betmnEHs Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: X-Domain-Id: None Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: X-Domain-Name: None Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: X-Identity-Status: Confirmed Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: X-Is-Admin-Project: True Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: X-Project-Domain-Id: default Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: X-Project-Domain-Name: Default Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: X-Project-Id: fe28e3af01d94abf87ebdd04e7b71491 Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: X-Project-Name: admin Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: X-Role: reader,member,admin Aug 23 17:42:43.939392 n-d-850468-16 devstack@n-api.service[112829]: X-Roles: reader,member,admin Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe28e3af01d94abf87ebdd04e7b71491"}]}] Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: X-Tenant: admin Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: X-Tenant-Id: fe28e3af01d94abf87ebdd04e7b71491 Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: X-Tenant-Name: admin Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: X-User: admin Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: X-User-Domain-Id: default Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: X-User-Domain-Name: Default Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: X-User-Id: 1484d2dcd5d9433ca8384c5e3b92888b Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: X-User-Name: admin Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: method: > Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: exception: Flavor 451 could not be found. Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: action_args: {'id': '451'} Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:42:43.940706 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:42:43.941476 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: ERROR nova.api.openstack.wsgi Aug 23 17:42:43.942520 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-965c2c3f-454a-475d-b204-32db570ba31b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112829) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:42:43.943743 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-965c2c3f-454a-475d-b204-32db570ba31b admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.398415 Aug 23 17:42:43.943743 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 25/49] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Aug 23 17:42:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:42:43.951380 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-6a056eb4-852c-4546-80cf-59f450df8462 admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:43.966511 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-6a056eb4-852c-4546-80cf-59f450df8462 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018773 Aug 23 17:42:43.967063 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 25/50] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Aug 23 17:42:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:42:43.976388 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:43.991034 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018237 Aug 23 17:42:43.991553 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 26/51] 10.222.0.61 () {60 vars in 1210 bytes} [Tue Aug 23 17:42:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:42:44.001142 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-1d8b10b7-879a-400e-91b7-4aaacfe99cd1 admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:44.006791 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.wsgi [None req-1d8b10b7-879a-400e-91b7-4aaacfe99cd1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-1d8b10b7-879a-400e-91b7-4aaacfe99cd1 admin admin] Request method failure captured: Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: Accept: application/json Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: Accept-Encoding: gzip, deflate Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: Connection: keep-alive Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: Content-Length: 0 Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: Host: 10.222.0.61 Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: Openstack-Api-Version: compute 2.90 Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: Openstack-System-Scope: None Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: User-Agent: python-novaclient Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: X-Auth-Token: gAAAAABjBRGToh6tmhs1DsMcUeQxsVtzFx04RvED7KFNrTMHQxtR5qwsluTna5NhXRWfhHNULgJOcMQRMmz3wYGT_Bfm1DB3L3Eohyb-7z0YqmufVsx5b2F5eYP98N2HlcdTddwo_pAfZEkT3xKY8t-jEEPwBjQ39mUxW_6Aa_ERdQ8betmnEHs Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: X-Domain-Id: None Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: X-Domain-Name: None Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: X-Identity-Status: Confirmed Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: X-Is-Admin-Project: True Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: X-Openstack-Nova-Api-Version: 2.90 Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: X-Project-Domain-Id: default Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: X-Project-Domain-Name: Default Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: X-Project-Id: fe28e3af01d94abf87ebdd04e7b71491 Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: X-Project-Name: admin Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: X-Role: reader,member,admin Aug 23 17:42:44.008959 n-d-850468-16 devstack@n-api.service[112830]: X-Roles: reader,member,admin Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fe28e3af01d94abf87ebdd04e7b71491"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe28e3af01d94abf87ebdd04e7b71491"}]}] Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: X-Tenant: admin Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: X-Tenant-Id: fe28e3af01d94abf87ebdd04e7b71491 Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: X-Tenant-Name: admin Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: X-User: admin Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: X-User-Domain-Id: default Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: X-User-Domain-Name: Default Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: X-User-Id: 1484d2dcd5d9433ca8384c5e3b92888b Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: X-User-Name: admin Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: method: > Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: exception: Flavor 451 could not be found. Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: action_args: {'id': '451'} Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:42:44.010421 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:42:44.011444 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: ERROR nova.api.openstack.wsgi Aug 23 17:42:44.012693 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-1d8b10b7-879a-400e-91b7-4aaacfe99cd1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112830) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:42:44.013900 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-1d8b10b7-879a-400e-91b7-4aaacfe99cd1 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012670 Aug 23 17:42:44.013900 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 26/52] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Aug 23 17:42:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:42:44.979725 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:44.980787 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 23 17:42:44.981183 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 27/53] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Aug 23 17:42:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:45.504728 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-5b363a71-188a-477d-b192-2369fb626b0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:45.524485 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-5b363a71-188a-477d-b192-2369fb626b0f admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.403608 Aug 23 17:42:45.525107 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 27/54] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Aug 23 17:42:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:42:46.499235 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:46.500241 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Aug 23 17:42:46.500639 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 28/55] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Aug 23 17:42:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:47.032447 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-e75b6786-a478-41ab-b612-514a9aac4ee6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:47.051253 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-e75b6786-a478-41ab-b612-514a9aac4ee6 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.411935 Aug 23 17:42:47.051798 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 28/56] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Aug 23 17:42:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:42:48.035935 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:48.036935 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Aug 23 17:42:48.037339 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 29/57] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Aug 23 17:42:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:48.570142 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-4a9fd2be-6397-4259-bb1f-e946497577c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:48.590427 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-4a9fd2be-6397-4259-bb1f-e946497577c9 admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.414737 Aug 23 17:42:48.591023 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 29/58] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Aug 23 17:42:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:42:49.579042 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:49.580059 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 23 17:42:49.580462 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 30/59] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Aug 23 17:42:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:50.112292 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-e89be8c9-6f48-4bf6-83c8-68c61bc392bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:42:50.131342 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-e89be8c9-6f48-4bf6-83c8-68c61bc392bd admin admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.408477 Aug 23 17:42:50.131882 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 30/60] 10.222.0.61 () {64 vars in 1235 bytes} [Tue Aug 23 17:42:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:42:51.100302 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:51.101858 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Aug 23 17:42:51.102271 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 31/61] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Aug 23 17:42:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:42:51.630518 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-c6877cee-24c9-48f5-96b3-abfc408191da admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:42:51.651868 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-c6877cee-24c9-48f5-96b3-abfc408191da admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.413154 Aug 23 17:42:51.652416 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 31/62] 10.222.0.61 () {60 vars in 1202 bytes} [Tue Aug 23 17:42:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:43:46.222482 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:43:46.223531 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-20e252c6-9167-4d05-8dfc-98b1a4310b0f admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 23 17:43:46.223935 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 32/63] 10.222.0.61 () {54 vars in 931 bytes} [Tue Aug 23 17:43:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:43:46.235164 n-d-850468-16 devstack@n-api.service[112830]: DEBUG dbcounter [-] [112830] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:43:46.624640 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-bbf2ee7e-6233-49b2-a8d2-ebbd80ce47b4 admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:43:46.645618 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-bbf2ee7e-6233-49b2-a8d2-ebbd80ce47b4 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.415266 Aug 23 17:43:46.646158 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 32/64] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Aug 23 17:43:46 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:43:46.668708 n-d-850468-16 devstack@n-api.service[112829]: DEBUG dbcounter [-] [112829] Writing DB stats nova_api:SELECT=14 {{(pid=112829) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:43:46.672468 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-ca9df682-2d6c-4646-8d3d-b69498a89b7d admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:43:46.680317 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-ca9df682-2d6c-4646-8d3d-b69498a89b7d admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012988 Aug 23 17:43:46.680838 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 33/65] 10.222.0.61 () {60 vars in 1283 bytes} [Tue Aug 23 17:43:46 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:43:46.692563 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-087132ad-a109-4eca-b86a-240ae0cee5c9 admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:43:46.700734 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-087132ad-a109-4eca-b86a-240ae0cee5c9 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011771 Aug 23 17:43:46.701246 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 33/66] 10.222.0.61 () {60 vars in 1286 bytes} [Tue Aug 23 17:43:46 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:43:46.712985 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-465fb1e4-c1b0-4296-9ad1-68b76e8a1f94 admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:43:46.720820 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-465fb1e4-c1b0-4296-9ad1-68b76e8a1f94 admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011918 Aug 23 17:43:46.721349 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 34/67] 10.222.0.61 () {60 vars in 1286 bytes} [Tue Aug 23 17:43:46 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:43:46.734030 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-c88eb0d3-c009-43bf-a1af-e6c698f4b83f admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:43:46.743453 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-c88eb0d3-c009-43bf-a1af-e6c698f4b83f admin admin] 10.222.0.61 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013014 Aug 23 17:43:46.744006 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 34/68] 10.222.0.61 () {60 vars in 1283 bytes} [Tue Aug 23 17:43:46 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:49:25.944556 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-465fb1e4-c1b0-4296-9ad1-68b76e8a1f94 admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:49:25.945571 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-465fb1e4-c1b0-4296-9ad1-68b76e8a1f94 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 23 17:49:25.945965 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 35/69] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Aug 23 17:49:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:49:26.093058 n-d-850468-16 devstack@n-api.service[112830]: DEBUG dbcounter [-] [112830] Writing DB stats nova_api:SELECT=6 {{(pid=112830) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:49:26.233926 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-a3bd3dc3-8770-4fd3-b539-e12de96e0bce admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:49:26.236250 n-d-850468-16 devstack@n-api.service[112830]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:49:26.236250 n-d-850468-16 devstack@n-api.service[112830]: warnings.warn(msg) Aug 23 17:49:26.238124 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-a3bd3dc3-8770-4fd3-b539-e12de96e0bce admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:49:26.238625 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-a3bd3dc3-8770-4fd3-b539-e12de96e0bce admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:49:26.239058 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-a3bd3dc3-8770-4fd3-b539-e12de96e0bce admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:49:26.239777 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-a3bd3dc3-8770-4fd3-b539-e12de96e0bce admin admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:49:26.240221 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-a3bd3dc3-8770-4fd3-b539-e12de96e0bce admin admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:49:26.240637 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-a3bd3dc3-8770-4fd3-b539-e12de96e0bce admin admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:49:26.280696 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-a3bd3dc3-8770-4fd3-b539-e12de96e0bce admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.189102 Aug 23 17:49:26.281253 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 35/70] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Aug 23 17:49:26 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:49:27.116254 n-d-850468-16 devstack@n-api.service[112829]: DEBUG nova.api.openstack.wsgi [None req-465fb1e4-c1b0-4296-9ad1-68b76e8a1f94 admin admin] Calling method '>' {{(pid=112829) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:49:27.117292 n-d-850468-16 devstack@n-api.service[112829]: INFO nova.api.openstack.requestlog [None req-465fb1e4-c1b0-4296-9ad1-68b76e8a1f94 admin admin] 10.222.0.61 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Aug 23 17:49:27.117704 n-d-850468-16 devstack@n-api.service[112829]: [pid: 112829|app: 0|req: 36/71] 10.222.0.61 () {56 vars in 1074 bytes} [Tue Aug 23 17:49:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:49:27.310707 n-d-850468-16 devstack@n-api.service[112830]: DEBUG nova.api.openstack.wsgi [None req-42127bd5-9d6f-45ec-ba9a-fe67fb911b81 admin admin] Calling method '>' {{(pid=112830) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:49:27.313132 n-d-850468-16 devstack@n-api.service[112830]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:49:27.313132 n-d-850468-16 devstack@n-api.service[112830]: warnings.warn(msg) Aug 23 17:49:27.314235 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-42127bd5-9d6f-45ec-ba9a-fe67fb911b81 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:49:27.315335 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-42127bd5-9d6f-45ec-ba9a-fe67fb911b81 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:49:27.315816 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-42127bd5-9d6f-45ec-ba9a-fe67fb911b81 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:49:27.316537 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-42127bd5-9d6f-45ec-ba9a-fe67fb911b81 admin admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:49:27.316978 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-42127bd5-9d6f-45ec-ba9a-fe67fb911b81 admin admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:49:27.317392 n-d-850468-16 devstack@n-api.service[112830]: DEBUG oslo_concurrency.lockutils [None req-42127bd5-9d6f-45ec-ba9a-fe67fb911b81 admin admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112830) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:49:27.340312 n-d-850468-16 devstack@n-api.service[112830]: INFO nova.api.openstack.requestlog [None req-42127bd5-9d6f-45ec-ba9a-fe67fb911b81 admin admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.90 time: 0.081333 Aug 23 17:49:27.340810 n-d-850468-16 devstack@n-api.service[112830]: [pid: 112830|app: 0|req: 36/72] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Aug 23 17:49:27 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:50:12.789068 n-d-850468-16 devstack@n-api.service[112828]: Tue Aug 23 17:50:12 2022 - graceful shutdown triggered... Aug 23 17:50:12.789204 n-d-850468-16 systemd[1]: Stopping Devstack devstack@n-api.service... Aug 23 17:50:12.790053 n-d-850468-16 devstack@n-api.service[112829]: Gracefully killing worker 1 (pid: 112829)... Aug 23 17:50:12.790416 n-d-850468-16 devstack@n-api.service[112830]: Gracefully killing worker 2 (pid: 112830)... Aug 23 17:50:13.790277 n-d-850468-16 devstack@n-api.service[112828]: worker 1 buried after 1 seconds Aug 23 17:50:13.790277 n-d-850468-16 devstack@n-api.service[112828]: worker 2 buried after 1 seconds Aug 23 17:50:13.790277 n-d-850468-16 devstack@n-api.service[112828]: goodbye to uWSGI. Aug 23 17:50:13.791883 n-d-850468-16 systemd[1]: devstack@n-api.service: Succeeded. Aug 23 17:50:13.792475 n-d-850468-16 systemd[1]: Stopped Devstack devstack@n-api.service. Aug 23 17:50:13.795232 n-d-850468-16 systemd[1]: Starting Devstack devstack@n-api.service... Aug 23 17:50:13.815498 n-d-850468-16 devstack@n-api.service[128796]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 23 17:50:13 2022] *** Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: nodename: n-d-850468-16 Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: machine: x86_64 Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: clock source: unix Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: pcre jit disabled Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: detected number of CPU cores: 4 Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: current working directory: / Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: detected binary path: /usr/bin/uwsgi-core Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: your processes number limit is 47680 Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: your memory page size is 4096 bytes Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: detected max file descriptor number: 2048 Aug 23 17:50:13.839072 n-d-850468-16 devstack@n-api.service[128796]: lock engine: pthread robust mutexes Aug 23 17:50:13.840506 n-d-850468-16 devstack@n-api.service[128796]: thunder lock: enabled Aug 23 17:50:13.840506 n-d-850468-16 devstack@n-api.service[128796]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 23 17:50:13.840506 n-d-850468-16 devstack@n-api.service[128796]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 23 17:50:13.879130 n-d-850468-16 devstack@n-api.service[128796]: Python main interpreter initialized at 0x561cad7c79c0 Aug 23 17:50:13.879130 n-d-850468-16 devstack@n-api.service[128796]: python threads support enabled Aug 23 17:50:13.879130 n-d-850468-16 devstack@n-api.service[128796]: your server socket listen backlog is limited to 100 connections Aug 23 17:50:13.879130 n-d-850468-16 devstack@n-api.service[128796]: your mercy for graceful operations on workers is 90 seconds Aug 23 17:50:13.879525 n-d-850468-16 devstack@n-api.service[128796]: mapped 403077 bytes (393 KB) for 2 cores Aug 23 17:50:13.879617 n-d-850468-16 devstack@n-api.service[128796]: *** Operational MODE: preforking *** Aug 23 17:50:13.879819 n-d-850468-16 devstack@n-api.service[128796]: *** uWSGI is running in multiple interpreter mode *** Aug 23 17:50:13.879819 n-d-850468-16 devstack@n-api.service[128796]: spawned uWSGI master process (pid: 128796) Aug 23 17:50:13.880028 n-d-850468-16 systemd[1]: Started Devstack devstack@n-api.service. Aug 23 17:50:13.883424 n-d-850468-16 devstack@n-api.service[128796]: spawned uWSGI worker 1 (pid: 128807, cores: 1) Aug 23 17:50:13.883424 n-d-850468-16 devstack@n-api.service[128796]: spawned uWSGI worker 2 (pid: 128808, cores: 1) Aug 23 17:50:13.883424 n-d-850468-16 devstack@n-api.service[128796]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 23 17:50:14.555588 n-d-850468-16 devstack@n-api.service[128807]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 17:50:14.556119 n-d-850468-16 devstack@n-api.service[128808]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 23 17:50:15.751857 n-d-850468-16 devstack@n-api.service[128807]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 17:50:15.751857 n-d-850468-16 devstack@n-api.service[128807]: from cryptography.utils import int_from_bytes Aug 23 17:50:15.752862 n-d-850468-16 devstack@n-api.service[128807]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 17:50:15.752862 n-d-850468-16 devstack@n-api.service[128807]: from cryptography.utils import int_from_bytes Aug 23 17:50:15.755386 n-d-850468-16 devstack@n-api.service[128808]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 17:50:15.755386 n-d-850468-16 devstack@n-api.service[128808]: from cryptography.utils import int_from_bytes Aug 23 17:50:15.755880 n-d-850468-16 devstack@n-api.service[128808]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 23 17:50:15.755880 n-d-850468-16 devstack@n-api.service[128808]: from cryptography.utils import int_from_bytes Aug 23 17:50:18.212716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 17:50:18.213516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 17:50:18.213516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 17:50:18.213879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 17:50:18.214137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 17:50:18.214530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.214884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.215481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.215805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.216299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.216622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.216953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.217280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.217617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.217882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.218206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.218564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-16 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.218888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.219210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.219527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.219851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.220157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.220483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.220793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.221299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.221757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.222070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.222383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.222755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.223070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.223384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.223710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.224025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.224346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.224656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.225072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-16 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.226056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.226419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.226793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.227208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.227526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.227838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.228173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.228500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.228811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.229160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.229484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.229815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.230139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.230446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.230800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.231114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.231435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.231744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.232050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.232302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.232612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.232938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.233264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.233591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.233844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.234095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.234418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.234769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.235084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.235395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.235705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.236020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.236328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.236637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.236944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.237253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.237573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.237891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.238221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.238530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.238875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.239291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.239545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.239856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.240203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.240527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.241116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.241477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.241477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.241792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.242096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.242404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.242756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.243095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.243402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.243657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.243962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.244273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.244594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.244902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.245209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.245518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.245820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.246135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.246469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.246795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.247105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.247414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.247720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.248026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.248339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.248646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.248970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.249296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.249601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.249910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.250226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.250531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.250876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.251186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.251495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.251817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.252123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.252426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.252746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.253055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.253363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.253682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.253985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.254294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.254629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.254942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.255247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.255552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.255857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.256161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.256606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.256950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.257263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.257563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.257884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.258213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.258523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.258855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.259201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.259529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.259874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.260211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.260560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.260881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.261217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.261553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.261877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.262194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.262512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.262866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.263181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.263495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.263809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.264130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.264453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.264842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.265109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.265427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.265746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.266060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.266370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 23 17:50:18.266933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.267082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 23 17:50:18.267225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.267225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.267517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 23 17:50:18.267675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.267828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 23 17:50:18.267983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.268135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 23 17:50:18.268294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.268439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.268591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.268743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.268885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.269036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.269178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.269320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.269475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.269621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.269772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.269915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.270064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.270221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.270363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.270589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.270751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.270931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.271081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.271336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.271495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.271675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.271823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.272514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-850468-16 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.272744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.272950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.273104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.273104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.273450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.273591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.273733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.273887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.274029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.274186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.274330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.274483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.274680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.274845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.274998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.275141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.275281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.275430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.275604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.275748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.275896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.276047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.276198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.276361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.276503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.276646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.276787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.276930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.277081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.277238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.277381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.277523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.277663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.277812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.277955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.278111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.278263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.278406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.278590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.278740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-850468-16 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.278900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.279045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.279197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.279350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.279500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.279643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.279792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.279934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.280124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.280277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.280427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.280583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.280726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.280874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.281046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.281200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.281353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.281518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.281662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.281817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.281988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.282150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.282302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.282461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.282643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.282802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.282953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.283103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.283257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.283411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.283567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.283709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.283851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.284000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.284163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.284307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.284449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.284590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.284733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.284893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.285050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.285193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.285343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.285485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.285627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.285768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.285938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.286082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.286223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.286377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.286521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.286702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.286854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.286996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.287147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.287298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.287450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.287707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.288444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.288595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.288795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.288979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.289146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.289291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.289432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.289603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.289754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.289904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.290056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.290207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.290350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.290502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.290701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.290856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.291012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.291173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.291323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.291489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.291647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.291797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.291940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.292095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.292246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.292398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.292547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.292739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.292890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.61 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.293042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.61 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.293192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.293343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.293485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.293641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.293870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.294028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.294172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.294323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.294481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.294673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.294829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.294983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.295136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.295279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.295428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.295572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.295727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.295872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.296021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.296171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.296314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.296466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.296621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.296771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.296923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.297074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.297217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.297359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.297514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.297657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.297799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.297950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.298092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.298317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.298317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.298654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.298870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.299020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.299162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.299318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.299462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.299603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.299752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.299894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.300043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.300194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.300338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.300505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.300648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.300797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.300946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.301103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.301246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.301395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.301546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.301688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.301837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.301988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.302139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.302298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.302447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.302617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.302776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.302931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.303081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.303251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.303401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.303553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.303706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.303938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.304096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.304250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.304411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.304555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.304705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.304854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.305015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.305173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.305325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.305475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.305616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.305758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.305908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.306065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.306215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.306377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.306521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.306701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.306854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.307006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.307160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.307302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.307444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.307593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.307744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.307887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.308036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.308178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.308329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.308471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.308627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.308770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.308912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.309053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.309195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.309337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.309500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.309654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.309796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.309947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.310107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.310257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.310414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.310601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.310762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.310913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.311063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.311214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.311358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.311507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.311658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.311800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.311942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.312102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.312245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.312394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 23 17:50:18.312580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.312736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.312894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.313051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.313202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.313353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.313495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.313688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.313859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.314020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.314175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.314326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.314475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.314652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.314857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.315013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.315158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.315300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.315442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.315592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.315746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.315889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.316041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.316183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.316323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.316464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.316619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.316763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.316914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.317056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.317205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.317361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.317585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.317744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.317911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.318080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.318224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.318380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.318531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.318729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.319448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.319670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.319827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.320014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.320181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.320353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.320513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.320670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.321441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.321592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.321736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.321887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.322032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.322185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.322382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.322607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.322773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.322773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.323045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.323198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.323360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.323512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.323663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.323807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.323948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.324105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.324249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.324408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.324552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.324704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.324853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.325018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.325177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.325329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.325471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.325614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.325764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.325764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.326051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.326193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.326689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.326845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.327165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.327319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.327473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.327817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.327967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.328117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.328117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.328400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.328550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.328700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.328854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.328995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.329154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.329298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.329449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.329591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.329748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.329899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.330062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.330213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.330363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.330514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.330682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.330847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.331005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.331148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.331289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.331430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.331579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.331736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.331886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.332028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.332178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.332328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.332471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.332627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.332780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.332935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.333087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.333239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.333389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.333541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.333693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.333842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.333984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.334134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.334285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.334566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.335251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.335424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.335570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.335714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.335866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.335866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.336146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.336287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.336429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.336570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.336722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.336866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.337016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.337170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.337312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.337462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.337614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.337758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.337909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.338053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.338203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.338354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.338507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.338707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.338858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.339014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.339166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.339325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.339477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.339627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.339768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.339922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.340326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.340486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.340645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.340788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.340930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.341080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.341238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.341405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.341549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.341698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.341840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.341983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.342133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.342294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.342489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.342736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.342841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.342931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.343064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.343162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.343372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.343466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.343686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.343855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.344010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.344156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.344307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.344449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.344598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.344741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.344896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.345039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.345192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.345334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.345483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.345636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.345811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.346070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.346234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.346376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.346525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.346726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.346871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.347021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.347173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.347328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.347469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.347625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.347768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.347909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.348058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.348201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.348344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.348527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.348688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.348831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.348973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.349152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.349312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.349465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.349609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.349758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.349909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.350062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.350377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.350630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.350786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.350982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.351145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.351292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.351445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.351606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.351764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.351907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.352072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.352273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.352434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.352578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.352728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.352902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.353056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.353209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.353361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.353520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.353663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.353812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.353964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.354118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.354261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.354404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.354606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.354768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.354919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.355076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.355225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.355381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.355548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.355698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.355852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.356014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.356176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.356337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.356487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.356645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.356801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.356963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.357122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.357279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.357428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.357594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.357760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.357917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.358066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.358213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.358360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.358509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.358773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.358937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.359088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.359245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.359394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.359550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.359720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.359883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.360033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.360187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.360344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.360501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.360663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.360813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.360962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.361110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.361258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.361415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.361576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.361743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.361895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.362050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.362199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.362360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.362510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.362708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.362870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.363020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.363176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.363335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.363486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.363643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.363799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.363957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.364108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.364266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.364423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.364572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.364727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.364875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.365033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.365192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.365341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.365489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.365647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.365851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.366120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.366282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.366432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.366611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.366777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.366935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.366935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.367249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.367399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.367547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.367702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.367870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.368035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.368186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.368186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.368475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.368633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.368792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.368942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.369096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.369247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.369394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.369542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.369698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.369858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.370006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.370163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.370325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.370517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.370717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.370879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.371035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.371035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.371327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.371475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.371636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.371794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.371955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.372103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.372251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.372409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.372566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.372715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.372869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.373019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.373166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.373324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.373481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.373630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.373805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.373957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.374105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.374263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.374420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.374589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.374757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.374914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.375063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.375220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.375370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.375520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.375681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.375846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.376003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.376163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.376313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.376471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.376620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.376769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.376926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.377084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.377241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.377391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.377546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.377696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.377863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.378021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.378170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.378319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.378473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.378648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.378812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.378962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.379117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.379274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.379428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.379587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.379755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.379912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.380061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.380210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.380358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.380520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.380677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.380827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.380981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.381138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.381288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.382015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.382206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.382446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.382749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.382912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.383069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.383218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.383367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.383514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.383676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.383827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.383976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.384132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.384322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.384435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.384543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.384640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.384826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.384979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.385131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.385227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.385438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.385541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.385744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.385847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.386048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.386157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.386356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.386456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.386693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.386788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.387000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.387107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.387316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.387427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.387629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.387741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.387951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.388061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.388256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.388369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.388561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.388658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.388870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.388976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.389176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.389289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.389514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.389700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.389870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.390020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.390170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.390327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.390487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.390700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.390868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.391019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.391167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.391317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.391473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.391634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.391797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.391947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.392095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.392243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.392399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.392558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.392716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.392874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.393023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.393171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.393328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.393490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.393660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.393892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.394055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.394206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.394386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.394670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.394841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.394993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.395149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.395299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.395449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.395610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.395761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.395909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.396071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.396236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.396386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.396550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.396713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.396861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.397114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.397852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.398024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.398185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.398343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.398524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.398524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.398862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.399022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.399179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.399334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.399503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.399661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.399830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.399991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.400150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.400298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.400446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.400593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.400750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.400908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.401066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.401223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.401379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.401545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.401705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.401855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.402012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.402161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.402318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.402474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.402672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.402672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.402966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.403123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.403280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.403445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.403608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.403767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.403917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.404065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.404065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.404345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.404507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.404664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.404812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.404960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.405122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.405282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.405441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.405599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.405763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.405914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.406076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.406227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.406382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.406531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.406724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.406883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.407042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.407198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.407355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.407513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.407661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.407827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.407979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.408128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.408276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.408476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.408638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.408801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.408951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.409100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.409256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.409423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.409619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.409788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.409949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.410105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.410258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.410414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.410626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.410782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.410939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.411088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.411246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.411413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.411575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.411776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.411933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.412083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.412240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.412397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.412585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.412746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.412906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.413057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.413215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.413375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.413536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.413684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.413684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.413995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.414146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.414309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.414459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.414670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.414824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.414973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.415121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.415283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.415444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.415601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.415757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.415913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.416071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.416228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.416228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.416519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.416677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.416826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.417057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.417209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.417366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.417527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.417677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.417824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.417985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.418148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.418306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.418463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.418647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.418800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.419522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.419703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.419869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.420028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.420198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.420362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.420512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.420662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.420819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.420967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.421116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.421277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.421436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.421592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.421742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.421890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.422049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.422212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.422370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.422526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.422722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.422722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.423024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.423189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.423341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.423497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.423654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.423811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.423975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.424136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.424292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.424441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.424605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.424755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.424914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.425064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.425212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.425367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.425526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.425676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.425839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.425997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.426164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.426314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.426462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.426633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.426803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.426961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.427112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.427267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.427417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.427575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.427732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.427881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.428038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.428256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.428417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.428577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.428801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.428964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.429121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.429286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.429445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.429610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.429773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.429932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.430083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.430083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.430401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.430599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.430772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.430931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.431082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.431237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.431400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.431549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.431698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.431853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.431853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.432153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.432323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.432474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.432630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.432787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.432936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.433092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.433255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.433413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.433570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.433727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.433882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.434039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.434198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.434366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.434530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.434741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.434892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.435058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.435210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.435367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.435516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.435664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.435812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.435812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.436113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.436269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.436430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.436586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.436736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.436898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.437048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.437048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.437330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.437488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.437640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.437797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.437947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.438102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.438269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.438419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.438637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.438796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.438945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.439101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.439258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.439407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.439566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.439732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.439888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.440046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.440204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.440373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.440534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.440685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.440841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.440991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.441140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.441298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.441455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.441613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.441768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.441918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.442075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.442247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.442399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.442579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.442738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.442899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.443049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.443207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.443357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.443514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.443665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.444341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.444559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.444834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.445073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.445236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.445386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.445535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.445700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.445860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.446009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.446238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.446395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.446395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.446745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.446900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.447049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.447208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.447366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.447523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.447752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.447912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.448075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.448225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.448375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.448531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.448690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.448839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.448991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.449158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.449308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.449465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.449624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.449624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.449928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.449928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.450224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.450384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.450534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.450730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.450882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.451041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.451208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.451371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.451522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.451670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.451819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.451974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.452135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.452284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.452440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.452440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.452741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.481110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.481570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.481769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.481974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.482166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.482341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.482500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.482688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.482843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.483026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.483202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.483377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.483549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.483729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.483729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.484065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.484253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.484520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.484698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.484869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.485021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.486512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.486690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.486827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.486977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.486977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.487765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.487916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.488048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.488180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.488310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.488475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.488475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.488779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.488925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.488925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.489162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.489275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.489372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.489487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.489584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.489678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.489772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.489874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.489969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.490063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.490063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.490273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.490377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.490474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.490608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.490768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.490937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.493544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.494019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.494420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.494420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.494853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.495184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.495380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.495819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.495819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.496291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.496832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.497005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.497236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.497236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.498176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.498345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.498345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.500964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.501130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.501259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.501379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.501496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.501611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.501726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.501851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.501968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.502081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.502195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.502292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.502387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.502387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.502580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.503056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.503224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.503363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.503363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.503363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.503363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.504052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.505009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.505207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.505354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.505354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.505620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.505758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.505901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.506035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.506168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.506337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.508249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.508410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.508548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.508684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.508818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.508965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.509100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.509235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.509368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.509518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.509518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.509780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.509926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.510058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.510188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.510326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.510445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.510445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.510701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.510820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.510943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.511055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.511168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.511291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.511408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.511504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.511616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.511753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.511869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.511996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.512113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.512218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.512341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.512455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.512559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.512681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.512798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.512913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.513027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.513141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.513255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.513377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.513494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.513608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.513742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.513850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.513850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.514076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.514190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128807) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 17:50:18.514304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.514304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.514304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.514304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.514304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.514304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.514304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.514304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.515250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.515250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.515250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.515250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.515250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.515250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.515250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.515250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.516898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.518011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.518011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.518011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.518011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.518011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.518011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.518011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.518011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.519985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.520805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.520805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.520805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.520805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.520805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.520805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.520805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.520805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.521615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.521615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.521615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.521615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.521615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.521615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.521615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.521615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.523293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.523293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.523293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.523293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.523293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.523293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.523293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.523293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.524123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.524123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.524123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.524123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.524123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.524123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.524123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.524842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.524842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.525097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.525420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.525741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.526058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.526371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.526710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.527029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.527347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.527686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.528010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.528321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.528750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.529065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.529387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.529730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.530062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.530362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.530716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.531047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.531373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.531689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.532022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.532363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.532693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.533019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.533328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.533636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.533943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.534257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.534737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.535014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.535320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.535625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.535938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.536243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.536592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.536871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.537177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.537526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.537815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.538128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.538434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.538924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.539230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.539689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.539999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.540309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.540620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.540925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.541382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.541660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.542200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.542416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.542702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.543034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.543351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.543678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.544032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.544338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.544680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.545021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.546556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.546556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.546556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.546556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.547001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.547001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.547677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.548722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.549090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.549604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.550019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.550187 n-d-850468-16 devstack@n-api.service[128807]: INFO dbcounter [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Registered counter for database nova_api Aug 23 17:50:18.550379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.550756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.551087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.551408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.551725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.552059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.552378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.552684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.553141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.553479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.553764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.554090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.554570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.554771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.555067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.555392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.555737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.556057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.556371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.556709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.557030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.557386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.557703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.558228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.558376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.558745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.559206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.559355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 23 17:50:18.559919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=128808) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 23 17:50:18.571433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_db.sqlalchemy.engines [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128807) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:50:18.580406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writer thread running {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:50:18.625337 n-d-850468-16 devstack@n-api.service[128808]: INFO dbcounter [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Registered counter for database nova_api Aug 23 17:50:18.640109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.context [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) {{(pid=128807) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 17:50:18.644683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:50:18.645169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:50:18.646632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_db.sqlalchemy.engines [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:50:18.646872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:50:18.648459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:50:18.648916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:50:18.651652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:50:18.653713 n-d-850468-16 devstack@n-api.service[128807]: INFO dbcounter [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Registered counter for database nova_cell0 Aug 23 17:50:18.655639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writer thread running {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:50:18.657977 n-d-850468-16 devstack@n-api.service[128807]: INFO dbcounter [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Registered counter for database nova_cell1 Aug 23 17:50:18.667996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_db.sqlalchemy.engines [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128807) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:50:18.670518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_db.sqlalchemy.engines [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128807) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:50:18.678170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writer thread running {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:50:18.678759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writer thread running {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:50:18.719203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.context [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) {{(pid=128808) load_cells /opt/stack/nova/nova/context.py:464}} Aug 23 17:50:18.723222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:50:18.723701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:50:18.725491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:50:18.726265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:50:18.726745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:50:18.728849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:50:18.730914 n-d-850468-16 devstack@n-api.service[128808]: INFO dbcounter [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Registered counter for database nova_cell0 Aug 23 17:50:18.735276 n-d-850468-16 devstack@n-api.service[128808]: INFO dbcounter [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Registered counter for database nova_cell1 Aug 23 17:50:18.743049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_db.sqlalchemy.engines [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:50:18.747284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_db.sqlalchemy.engines [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:50:18.748792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writer thread running {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:50:18.842560 n-d-850468-16 devstack@n-api.service[128807]: INFO dbcounter [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Registered counter for database nova_cell0 Aug 23 17:50:18.849881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_db.sqlalchemy.engines [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128807) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:50:18.855952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writer thread running {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:50:18.893818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writer thread running {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:50:18.903602 n-d-850468-16 devstack@n-api.service[128808]: INFO dbcounter [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Registered counter for database nova_cell0 Aug 23 17:50:18.912474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_db.sqlalchemy.engines [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=128808) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 23 17:50:18.918072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writer thread running {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 23 17:50:19.180977 n-d-850468-16 devstack@n-api.service[128807]: WARNING keystonemiddleware.auth_token [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 17:50:19.188367 n-d-850468-16 devstack@n-api.service[128807]: WARNING keystonemiddleware.auth_token [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 17:50:19.248195 n-d-850468-16 devstack@n-api.service[128808]: WARNING keystonemiddleware.auth_token [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 17:50:19.255661 n-d-850468-16 devstack@n-api.service[128808]: WARNING keystonemiddleware.auth_token [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 17:50:19.541646 n-d-850468-16 devstack@n-api.service[128807]: WARNING keystonemiddleware.auth_token [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 17:50:19.547778 n-d-850468-16 devstack@n-api.service[128807]: WARNING keystonemiddleware.auth_token [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 17:50:19.553101 n-d-850468-16 devstack@n-api.service[128807]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561cad7c79c0 pid: 128807 (default app) Aug 23 17:50:19.607735 n-d-850468-16 devstack@n-api.service[128808]: WARNING keystonemiddleware.auth_token [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 23 17:50:19.613730 n-d-850468-16 devstack@n-api.service[128808]: WARNING keystonemiddleware.auth_token [None req-a8202523-4f62-4209-86f8-5e9f464b2a48 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 23 17:50:19.619160 n-d-850468-16 devstack@n-api.service[128808]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561cad7c79c0 pid: 128808 (default app) Aug 23 17:50:59.056987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:50:59.058706 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9308d57b-e628-43ca-9e46-384a42b6e0e6 None None] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.002315 Aug 23 17:50:59.063154 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1/1] 10.222.0.61 () {56 vars in 886 bytes} [Tue Aug 23 17:50:59 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 23 17:50:59.361747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:50:59.363218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:50:59.363724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:50:59.364164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:50:59.365367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:50:59.365795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:50:59.366600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:50:59.368153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:00.622353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c068f81-1634-44e5-b44a-e0d651606e18 tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-571809876", "id": 538274134, "os-flavor-access:is_public": "False"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:00.642773 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:00.642773 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:00.685110 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c068f81-1634-44e5-b44a-e0d651606e18 tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 1.328341 Aug 23 17:51:00.686083 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2/2] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:50:59 2022] POST /compute/v2.1/flavors => generated 427 bytes in 1331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:00.695225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-86914cf3-db18-4985-bcd6-00b1fb59dab1 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Calling method '.version_select at 0x7f27ef3a5700>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:00.699497 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:00.699497 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:00.705723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-86914cf3-db18-4985-bcd6-00b1fb59dab1 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) {{(pid=128808) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 23 17:51:00.706454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86914cf3-db18-4985-bcd6-00b1fb59dab1 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:00.706943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86914cf3-db18-4985-bcd6-00b1fb59dab1 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:00.707537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86914cf3-db18-4985-bcd6-00b1fb59dab1 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:00.737780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86914cf3-db18-4985-bcd6-00b1fb59dab1 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:00.738513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86914cf3-db18-4985-bcd6-00b1fb59dab1 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:00.738973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86914cf3-db18-4985-bcd6-00b1fb59dab1 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:00.752955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86914cf3-db18-4985-bcd6-00b1fb59dab1 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:00.753438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86914cf3-db18-4985-bcd6-00b1fb59dab1 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:00.753942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86914cf3-db18-4985-bcd6-00b1fb59dab1 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:00.761956 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-86914cf3-db18-4985-bcd6-00b1fb59dab1 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1427 microversion: 2.41 time: 1.415758 Aug 23 17:51:00.762526 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1/3] 10.222.0.61 () {60 vars in 1208 bytes} [Tue Aug 23 17:50:59 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1427 bytes in 1418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:51:01.037318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d738dcbf-b85a-4b36-ac65-c6adc41dc748 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '.version_select at 0x7f27ef314160>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:01.038564 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:01.038564 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:01.044704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d738dcbf-b85a-4b36-ac65-c6adc41dc748 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) {{(pid=128807) load_cells /opt/stack/nova/nova/compute/api.py:306}} Aug 23 17:51:01.045663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d738dcbf-b85a-4b36-ac65-c6adc41dc748 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:01.046333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d738dcbf-b85a-4b36-ac65-c6adc41dc748 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:01.046981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d738dcbf-b85a-4b36-ac65-c6adc41dc748 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:01.075370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d738dcbf-b85a-4b36-ac65-c6adc41dc748 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:01.075861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d738dcbf-b85a-4b36-ac65-c6adc41dc748 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:01.076417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d738dcbf-b85a-4b36-ac65-c6adc41dc748 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:01.091326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d738dcbf-b85a-4b36-ac65-c6adc41dc748 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:01.092314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d738dcbf-b85a-4b36-ac65-c6adc41dc748 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:01.092893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d738dcbf-b85a-4b36-ac65-c6adc41dc748 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:01.100937 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d738dcbf-b85a-4b36-ac65-c6adc41dc748 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1507 microversion: 2.1 time: 0.413018 Aug 23 17:51:01.100937 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3/4] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Aug 23 17:51:00 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:01.107028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd755182-d6e1-49fa-8358-65defe21addc tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:01.107452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cb5bb482-3cd2-4666-9f4d-e5d9d77098a0 tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "696d3da467a442f3bf3bb60ed1b33e8c"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:01.109512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd755182-d6e1-49fa-8358-65defe21addc tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:01.110356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd755182-d6e1-49fa-8358-65defe21addc tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:01.110912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd755182-d6e1-49fa-8358-65defe21addc tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:01.111038 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:01.111038 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:01.112237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd755182-d6e1-49fa-8358-65defe21addc tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:01.113060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd755182-d6e1-49fa-8358-65defe21addc tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:01.113722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd755182-d6e1-49fa-8358-65defe21addc tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:01.164512 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd755182-d6e1-49fa-8358-65defe21addc tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] 10.222.0.61 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.400670 Aug 23 17:51:01.165168 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2/5] 10.222.0.61 () {58 vars in 1164 bytes} [Tue Aug 23 17:51:00 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:51:01.173057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c8f3e2ea-9576-4c8f-886d-8dd0318dc2cb tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1934053571"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:01.190339 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:01.190339 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:01.191383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.aggregate [None req-c8f3e2ea-9576-4c8f-886d-8dd0318dc2cb tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Generated uuid 54ea165c-1445-4667-946c-1fa2ad494d95 for aggregate {{(pid=128808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:51:01.287123 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c8f3e2ea-9576-4c8f-886d-8dd0318dc2cb tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 246 microversion: 2.41 time: 0.120906 Aug 23 17:51:01.288544 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3/6] 10.222.0.61 () {62 vars in 1205 bytes} [Tue Aug 23 17:51:01 2022] POST /compute/v2.1/os-aggregates => generated 246 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:01.485883 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cb5bb482-3cd2-4666-9f4d-e5d9d77098a0 tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/538274134/action" status: 200 len: 96 microversion: 2.1 time: 0.382596 Aug 23 17:51:01.487102 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4/7] 10.222.0.61 () {60 vars in 1197 bytes} [Tue Aug 23 17:51:01 2022] POST /compute/v2.1/flavors/538274134/action => generated 96 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:51:01.492710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c0f6016d-c3c3-4756-bd0c-c4194a21bea8 tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:01.494034 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:01.494034 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:01.496182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0f6016d-c3c3-4756-bd0c-c4194a21bea8 tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:01.496991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0f6016d-c3c3-4756-bd0c-c4194a21bea8 tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:01.497725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0f6016d-c3c3-4756-bd0c-c4194a21bea8 tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:01.498691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0f6016d-c3c3-4756-bd0c-c4194a21bea8 tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:01.499373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0f6016d-c3c3-4756-bd0c-c4194a21bea8 tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:01.500224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0f6016d-c3c3-4756-bd0c-c4194a21bea8 tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:01.550241 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c0f6016d-c3c3-4756-bd0c-c4194a21bea8 tempest-AZAdminV2TestJSON-529344928 tempest-AZAdminV2TestJSON-529344928-project-admin] 10.222.0.61 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.061801 Aug 23 17:51:01.551309 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 5/8] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Aug 23 17:51:01 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:01.581626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41f68680-0d29-427e-bccd-3a82abb71b12 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-9882612"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:01.604971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-2059454359", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:01.669485 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:01.669485 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:01.757758 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-41f68680-0d29-427e-bccd-3a82abb71b12 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 296 microversion: 2.41 time: 0.204524 Aug 23 17:51:01.758441 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 6/9] 10.222.0.61 () {62 vars in 1210 bytes} [Tue Aug 23 17:51:01 2022] PUT /compute/v2.1/os-aggregates/1 => generated 296 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:02.068488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cd449ece-8463-4b21-9d1f-3dd2bd48ac70 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-123064761", "id": 1817652733, "os-flavor-access:is_public": "False"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:02.071361 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:02.071361 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:02.092933 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cd449ece-8463-4b21-9d1f-3dd2bd48ac70 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.333117 Aug 23 17:51:02.093886 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 7/10] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:01 2022] POST /compute/v2.1/flavors => generated 438 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:02.367632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:51:02.438344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8168f13a-27f4-43c0-9be6-1b115c3f646e tempest-FlavorsAccessTestJSON-110041479 tempest-FlavorsAccessTestJSON-110041479-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:02.506833 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8168f13a-27f4-43c0-9be6-1b115c3f646e tempest-FlavorsAccessTestJSON-110041479 tempest-FlavorsAccessTestJSON-110041479-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5408 microversion: 2.1 time: 0.411530 Aug 23 17:51:02.511443 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 8/11] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:02 2022] GET /compute/v2.1/flavors/detail => generated 5408 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:02.517320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-608ccf98-19c4-432b-b403-a8ad6c675e2a tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:02.519936 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:02.519936 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:02.536287 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-608ccf98-19c4-432b-b403-a8ad6c675e2a tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 296 microversion: 2.41 time: 0.023066 Aug 23 17:51:02.537477 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 9/12] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Aug 23 17:51:02 2022] GET /compute/v2.1/os-aggregates/1 => generated 296 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:02.544866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6897039b-2a12-436f-912f-a00ca1c51a7f tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "032bdcd874b34f42bdc6e043a8b66334"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:02.550719 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:02.550719 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:02.665687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:51:02.666300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:51:02.666949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:51:02.667624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:51:02.668184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:51:02.683223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:02.683718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:02.684162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:02.684884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:02.685525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:02.685970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:02.730689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Getting quotas for project 1204921b96d94a2ab750e504f819dcbe. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:51:02.737898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Getting quotas for user 969ea18ca5584a20bb82706514cf8a30 and project 1204921b96d94a2ab750e504f819dcbe. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:51:02.750606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:51:02.753438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:51:02.812419 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0efda5d7-815e-4ecd-8b35-d283909d9254 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.522654 Aug 23 17:51:02.813547 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4/13] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1524 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:51:02.819149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-caafe322-b554-4e8c-a5f0-5cef33c6a5cb tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "696d3da467a442f3bf3bb60ed1b33e8c"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:02.822302 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:02.822302 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:03.106323 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6897039b-2a12-436f-912f-a00ca1c51a7f tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1817652733/action" status: 200 len: 97 microversion: 2.1 time: 0.566269 Aug 23 17:51:03.107197 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 10/14] 10.222.0.61 () {60 vars in 1200 bytes} [Tue Aug 23 17:51:02 2022] POST /compute/v2.1/flavors/1817652733/action => generated 97 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:51:03.116357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-39bc91d1-a80a-400b-b81a-3abd0f257464 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-16"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:03.119436 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:03.119436 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:03.129483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39bc91d1-a80a-400b-b81a-3abd0f257464 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:03.130175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39bc91d1-a80a-400b-b81a-3abd0f257464 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:03.130667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39bc91d1-a80a-400b-b81a-3abd0f257464 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:03.668335 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-caafe322-b554-4e8c-a5f0-5cef33c6a5cb tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/538274134/action" status: 200 len: 21 microversion: 2.1 time: 0.853539 Aug 23 17:51:03.675646 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 5/15] 10.222.0.61 () {60 vars in 1197 bytes} [Tue Aug 23 17:51:02 2022] POST /compute/v2.1/flavors/538274134/action => generated 21 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:51:03.682748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e84efdb0-9871-4537-a587-a71b8d93b654 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:03.683664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e84efdb0-9871-4537-a587-a71b8d93b654 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:03.796758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e84efdb0-9871-4537-a587-a71b8d93b654 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:03.814026 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e84efdb0-9871-4537-a587-a71b8d93b654 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1220 microversion: 2.1 time: 0.136720 Aug 23 17:51:03.817068 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 6/16] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:03 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1220 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:03.823280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-61da55bb-47c6-438a-ad73-2f04a40084f4 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "032bdcd874b34f42bdc6e043a8b66334"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:03.825995 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:03.825995 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:04.202733 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-39bc91d1-a80a-400b-b81a-3abd0f257464 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 312 microversion: 2.41 time: 1.093972 Aug 23 17:51:04.203517 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 11/17] 10.222.0.61 () {62 vars in 1232 bytes} [Tue Aug 23 17:51:03 2022] POST /compute/v2.1/os-aggregates/1/action => generated 312 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:04.218770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1d485fa8-3a15-45bd-a7cc-83e76ecb3dac tempest-FlavorsAccessTestJSON-110041479 tempest-FlavorsAccessTestJSON-110041479-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:04.242806 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1d485fa8-3a15-45bd-a7cc-83e76ecb3dac tempest-FlavorsAccessTestJSON-110041479 tempest-FlavorsAccessTestJSON-110041479-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030069 Aug 23 17:51:04.243716 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 12/18] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:04.248256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6fe9841-c705-4f37-9480-b033a12a3906 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-16"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:04.250733 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:04.250733 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:04.260929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6fe9841-c705-4f37-9480-b033a12a3906 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:04.261505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6fe9841-c705-4f37-9480-b033a12a3906 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:04.261951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6fe9841-c705-4f37-9480-b033a12a3906 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:04.407237 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6fe9841-c705-4f37-9480-b033a12a3906 tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 296 microversion: 2.41 time: 0.162401 Aug 23 17:51:04.415793 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 13/19] 10.222.0.61 () {62 vars in 1232 bytes} [Tue Aug 23 17:51:04 2022] POST /compute/v2.1/os-aggregates/1/action => generated 296 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:04.420766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fd282a42-be80-4b4e-9ebe-c97818ee67f9 tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:04.421539 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:04.421539 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:04.452772 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-61da55bb-47c6-438a-ad73-2f04a40084f4 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] HTTP exception thrown: Flavor access already exists for flavor 16 and project 032bdcd874b34f42bdc6e043a8b66334 combination. Aug 23 17:51:04.454902 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fd282a42-be80-4b4e-9ebe-c97818ee67f9 tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/538274134" status: 202 len: 0 microversion: 2.1 time: 0.037903 Aug 23 17:51:04.455849 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 14/20] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Aug 23 17:51:04 2022] DELETE /compute/v2.1/flavors/538274134 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:51:04.469405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8dfb435d-a119-4e9d-91e5-ae372541270b tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:04.470636 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:04.470636 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-61da55bb-47c6-438a-ad73-2f04a40084f4 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Request method failure captured: Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/flavors/1817652733/action HTTP/1.1 Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 67 Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRODMDLT_XRoAr84sjAtBpi09aDCduhALoZ-CNbBd9aHGElt392Ybfj63B3FpDbL9nLx5pAA7DXgWOqfUzYfHyceDttNzAXcsB94kPNXUGl_dJbNyBU-MlUkCtAL2-yReHYPJn9JbEojZEZeA5SishW1wLCJwTBtaWUi-xxhWB1uS8E Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: b2ff6d90d1364e1ebb730f3091f3eda3 Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-903217463 Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:51:04.489282 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:51:04.491262 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b2ff6d90d1364e1ebb730f3091f3eda3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b2ff6d90d1364e1ebb730f3091f3eda3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b2ff6d90d1364e1ebb730f3091f3eda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b2ff6d90d1364e1ebb730f3091f3eda3"}]}] Aug 23 17:51:04.491262 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-903217463 Aug 23 17:51:04.491262 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: b2ff6d90d1364e1ebb730f3091f3eda3 Aug 23 17:51:04.491262 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-903217463 Aug 23 17:51:04.491262 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin Aug 23 17:51:04.491262 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:04.491262 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:04.491262 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 33b509c7e1be4648b8612a05aae59caf Aug 23 17:51:04.491262 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin Aug 23 17:51:04.491262 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:51:04.491262 n-d-850468-16 devstack@n-api.service[128808]: {"addTenantAccess": {"tenant": "032bdcd874b34f42bdc6e043a8b66334"}} Aug 23 17:51:04.491262 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: exception: Flavor access already exists for flavor 16 and project 032bdcd874b34f42bdc6e043a8b66334 combination. Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '1817652733', 'body': {'addTenantAccess': {'tenant': '032bdcd874b34f42bdc6e043a8b66334'}}} Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result.read() Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 17:51:04.491865 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '16-032bdcd874b34f42bdc6e043a8b66334' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi project.save(context.session) Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi session.flush() Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 17:51:04.492742 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 17:51:04.493660 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 17:51:04.495738 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result.read() Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '16-032bdcd874b34f42bdc6e043a8b66334' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 23, 17, 51, 4, 434291), 'updated_at': None, 'flavor_id': 16, 'project_id': '032bdcd874b34f42bdc6e043a8b66334'}] Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:04.499026 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 16 and project 032bdcd874b34f42bdc6e043a8b66334 combination. Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:04.500990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 16 and project 032bdcd874b34f42bdc6e043a8b66334 combination. Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:04.503715 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:04.507282 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 16 and project 032bdcd874b34f42bdc6e043a8b66334 combination. Aug 23 17:51:04.507282 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:04.507282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-61da55bb-47c6-438a-ad73-2f04a40084f4 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Returning 409 to user: Flavor access already exists for flavor 16 and project 032bdcd874b34f42bdc6e043a8b66334 combination. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:04.507282 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-61da55bb-47c6-438a-ad73-2f04a40084f4 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1817652733/action" status: 409 len: 152 microversion: 2.1 time: 0.673271 Aug 23 17:51:04.507282 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 7/21] 10.222.0.61 () {60 vars in 1200 bytes} [Tue Aug 23 17:51:03 2022] POST /compute/v2.1/flavors/1817652733/action => generated 152 bytes in 682 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:51:04.516184 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8dfb435d-a119-4e9d-91e5-ae372541270b tempest-AggregatesAdminTestV241-539742425 tempest-AggregatesAdminTestV241-539742425-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.059110 Aug 23 17:51:04.517026 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 15/22] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Aug 23 17:51:04 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:04.523753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e213302-bff5-4638-95d9-b531280bc39f tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:04.556775 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e213302-bff5-4638-95d9-b531280bc39f tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.038395 Aug 23 17:51:04.557540 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 16/23] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:04.569112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-375ed584-9f0a-4e9c-a450-47139c83f9a0 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "032bdcd874b34f42bdc6e043a8b66334"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:04.572425 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:04.572425 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:04.615629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-88199bda-2d5b-485c-880a-578d724a140e tempest-FlavorMetadataValidation-323924093 tempest-FlavorMetadataValidation-323924093-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-206428631", "id": 2113459964, "os-flavor-access:is_public": "True"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:04.621845 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:04.621845 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:04.674560 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-88199bda-2d5b-485c-880a-578d724a140e tempest-FlavorMetadataValidation-323924093 tempest-FlavorMetadataValidation-323924093-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 470 microversion: 2.86 time: 0.172748 Aug 23 17:51:04.676878 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 8/24] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 17:51:04 2022] POST /compute/v2.1/flavors => generated 470 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:04.681446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-deb58a10-a2ba-47d1-9ea6-ce9244a25426 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-2126921520", "name": "tempest-test_aggregate-348634563"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:04.704209 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:04.704209 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:04.706707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.aggregate [None req-deb58a10-a2ba-47d1-9ea6-ce9244a25426 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Generated uuid 668c43a4-4d10-48f9-a2b9-ade2e262a998 for aggregate {{(pid=128808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:51:04.747433 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-deb58a10-a2ba-47d1-9ea6-ce9244a25426 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.069346 Aug 23 17:51:04.754283 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 9/25] 10.222.0.61 () {60 vars in 1165 bytes} [Tue Aug 23 17:51:04 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:04.754283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f65b67d1-9930-433a-9bd8-8e3a0261ea1d tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1263818268", "id": 1811126644, "os-flavor-access:is_public": "False"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:04.755932 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:04.755932 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:04.779708 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f65b67d1-9930-433a-9bd8-8e3a0261ea1d tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.028937 Aug 23 17:51:04.783171 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 10/26] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:04 2022] POST /compute/v2.1/flavors => generated 431 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:04.790532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a611235-2038-4946-9a9f-20fb90de3330 tempest-FlavorMetadataValidation-323924093 tempest-FlavorMetadataValidation-323924093-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:04.793364 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:04.793364 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:04.988033 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a611235-2038-4946-9a9f-20fb90de3330 tempest-FlavorMetadataValidation-323924093 tempest-FlavorMetadataValidation-323924093-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/2113459964/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.203545 Aug 23 17:51:04.995016 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 11/27] 10.222.0.61 () {62 vars in 1265 bytes} [Tue Aug 23 17:51:04 2022] POST /compute/v2.1/flavors/2113459964/os-extra_specs => generated 62 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:04.995878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-003cf20d-05ef-4fdb-8a05-4f193f4a4efe tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:04.996714 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:04.996714 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:05.014081 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-003cf20d-05ef-4fdb-8a05-4f193f4a4efe tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.020433 Aug 23 17:51:05.014081 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 12/28] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 17:51:04 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:05.017396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7473e873-edc3-48f0-96ea-926954e9065a tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:05.018156 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:05.018156 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:05.032320 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7473e873-edc3-48f0-96ea-926954e9065a tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/1811126644/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.018532 Aug 23 17:51:05.032901 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 13/29] 10.222.0.61 () {58 vars in 1209 bytes} [Tue Aug 23 17:51:05 2022] GET /compute/v2.1/flavors/1811126644/os-flavor-access => generated 21 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:51:05.038032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d499647f-7927-48d8-86f3-07c576b5f930 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:05.038918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d499647f-7927-48d8-86f3-07c576b5f930 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:05.045359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d499647f-7927-48d8-86f3-07c576b5f930 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:05.045907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d499647f-7927-48d8-86f3-07c576b5f930 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:05.046365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d499647f-7927-48d8-86f3-07c576b5f930 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:05.047138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d499647f-7927-48d8-86f3-07c576b5f930 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:05.047604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d499647f-7927-48d8-86f3-07c576b5f930 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:05.048039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d499647f-7927-48d8-86f3-07c576b5f930 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:05.218188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d499647f-7927-48d8-86f3-07c576b5f930 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:05.231416 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d499647f-7927-48d8-86f3-07c576b5f930 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1280 microversion: 2.1 time: 0.197455 Aug 23 17:51:05.232275 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 14/30] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:05 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1280 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:05.237304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4dc6f8db-e57f-4588-9738-1b4c30524bc0 tempest-FlavorMetadataValidation-323924093 tempest-FlavorMetadataValidation-323924093-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:05.238364 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:05.238364 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:05.253641 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-375ed584-9f0a-4e9c-a450-47139c83f9a0 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1817652733/action" status: 200 len: 21 microversion: 2.1 time: 0.694956 Aug 23 17:51:05.259223 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 17/31] 10.222.0.61 () {60 vars in 1200 bytes} [Tue Aug 23 17:51:04 2022] POST /compute/v2.1/flavors/1817652733/action => generated 21 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:51:05.269654 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4dc6f8db-e57f-4588-9738-1b4c30524bc0 tempest-FlavorMetadataValidation-323924093 tempest-FlavorMetadataValidation-323924093-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/2113459964" status: 202 len: 0 microversion: 2.86 time: 0.036004 Aug 23 17:51:05.270220 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 15/32] 10.222.0.61 () {60 vars in 1202 bytes} [Tue Aug 23 17:51:05 2022] DELETE /compute/v2.1/flavors/2113459964 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:51:05.273225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9bd2938f-1d80-48a4-b862-08e9a981ef6f tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-16"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:05.276570 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:05.276570 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:05.287115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bd2938f-1d80-48a4-b862-08e9a981ef6f tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:05.287899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e944566c-687d-4e19-aed3-7a4679f68328 tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:05.288353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bd2938f-1d80-48a4-b862-08e9a981ef6f tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:05.289106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bd2938f-1d80-48a4-b862-08e9a981ef6f tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:05.331349 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e944566c-687d-4e19-aed3-7a4679f68328 tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1811126644" status: 202 len: 0 microversion: 2.1 time: 0.058444 Aug 23 17:51:05.335557 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 16/33] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:51:05 2022] DELETE /compute/v2.1/flavors/1811126644 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:51:05.342516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-169f67a1-cb7c-411a-ab6c-ca45f6b26706 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:05.362278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=11,nova_api:DELETE=9,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:05.379084 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-169f67a1-cb7c-411a-ab6c-ca45f6b26706 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1817652733" status: 202 len: 0 microversion: 2.1 time: 0.043627 Aug 23 17:51:05.383265 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 17/34] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:51:05 2022] DELETE /compute/v2.1/flavors/1817652733 => generated 0 bytes in 50 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:51:05.388793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b85968e7-7135-4cb5-b472-5a7d8dafa34f tempest-FlavorMetadataValidation-323924093 tempest-FlavorMetadataValidation-323924093-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:05.434601 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b85968e7-7135-4cb5-b472-5a7d8dafa34f tempest-FlavorMetadataValidation-323924093 tempest-FlavorMetadataValidation-323924093-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.86 time: 0.049845 Aug 23 17:51:05.435334 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 18/35] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Aug 23 17:51:05 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:51:05.440777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-11abc8e3-7650-4650-8b9f-7f00691887a0 tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:05.466037 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-11abc8e3-7650-4650-8b9f-7f00691887a0 tempest-FlavorsAccessTestJSON-1767330105 tempest-FlavorsAccessTestJSON-1767330105-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.029476 Aug 23 17:51:05.466861 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 19/36] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:05.484055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-40d430d1-120e-4c9d-9871-d6da8c61ea7b tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:05.511170 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9bd2938f-1d80-48a4-b862-08e9a981ef6f tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 315 microversion: 2.1 time: 0.248462 Aug 23 17:51:05.512373 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 18/37] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Aug 23 17:51:05 2022] POST /compute/v2.1/os-aggregates/2/action => generated 315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:05.549437 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-40d430d1-120e-4c9d-9871-d6da8c61ea7b tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.079081 Aug 23 17:51:05.550066 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 20/38] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:05.570689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3e485c63-740e-4338-af03-5c6e14237729 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-716912889", "id": 1000312722, "os-flavor-access:is_public": "True"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:05.590781 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:05.590781 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:05.620926 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3e485c63-740e-4338-af03-5c6e14237729 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.054445 Aug 23 17:51:05.630507 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 21/39] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:05 2022] POST /compute/v2.1/flavors => generated 437 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:05.639536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-645c95f3-cdd9-4fb9-a1d4-9a354c3ab247 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:05.642000 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:05.642000 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:05.655265 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-645c95f3-cdd9-4fb9-a1d4-9a354c3ab247 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] HTTP exception thrown: Access list not available for public flavors. Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-645c95f3-cdd9-4fb9-a1d4-9a354c3ab247 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Request method failure captured: Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/flavors/1000312722/os-flavor-access HTTP/1.1 Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRODMDLT_XRoAr84sjAtBpi09aDCduhALoZ-CNbBd9aHGElt392Ybfj63B3FpDbL9nLx5pAA7DXgWOqfUzYfHyceDttNzAXcsB94kPNXUGl_dJbNyBU-MlUkCtAL2-yReHYPJn9JbEojZEZeA5SishW1wLCJwTBtaWUi-xxhWB1uS8E Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: b2ff6d90d1364e1ebb730f3091f3eda3 Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-903217463 Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:51:05.659208 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:51:05.660494 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b2ff6d90d1364e1ebb730f3091f3eda3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b2ff6d90d1364e1ebb730f3091f3eda3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b2ff6d90d1364e1ebb730f3091f3eda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b2ff6d90d1364e1ebb730f3091f3eda3"}]}] Aug 23 17:51:05.660494 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-903217463 Aug 23 17:51:05.660494 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: b2ff6d90d1364e1ebb730f3091f3eda3 Aug 23 17:51:05.660494 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-903217463 Aug 23 17:51:05.660494 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin Aug 23 17:51:05.660494 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:05.660494 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:05.660494 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 33b509c7e1be4648b8612a05aae59caf Aug 23 17:51:05.660494 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin Aug 23 17:51:05.660494 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:05.660494 n-d-850468-16 devstack@n-api.service[128808]: exception: Access list not available for public flavors. Aug 23 17:51:05.660494 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'flavor_id': '1000312722'} Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Aug 23 17:51:05.661790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:05.667015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-645c95f3-cdd9-4fb9-a1d4-9a354c3ab247 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:05.668004 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-645c95f3-cdd9-4fb9-a1d4-9a354c3ab247 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/1000312722/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.034032 Aug 23 17:51:05.673353 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 22/40] 10.222.0.61 () {58 vars in 1209 bytes} [Tue Aug 23 17:51:05 2022] GET /compute/v2.1/flavors/1000312722/os-flavor-access => generated 91 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:51:05.679852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-121302e8-341e-45a3-916f-e075ad975c27 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:05.699369 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-121302e8-341e-45a3-916f-e075ad975c27 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1000312722" status: 202 len: 0 microversion: 2.1 time: 0.024466 Aug 23 17:51:05.704450 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 23/41] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:51:05 2022] DELETE /compute/v2.1/flavors/1000312722 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:51:05.711688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5fd9618d-1fe6-4179-b2fb-da6fbeeec34a tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:05.757059 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5fd9618d-1fe6-4179-b2fb-da6fbeeec34a tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051402 Aug 23 17:51:05.760027 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 24/42] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:05 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:05.777317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a9208266-ae0d-41e2-abcb-87c201e16fc3 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-650273499", "id": 755041606, "os-flavor-access:is_public": "False"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:05.811375 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a9208266-ae0d-41e2-abcb-87c201e16fc3 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.038695 Aug 23 17:51:05.812498 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 25/43] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:05 2022] POST /compute/v2.1/flavors => generated 435 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:06.288281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3592dd68-c5dd-499d-9636-628fc7416f21 tempest-FlavorsAccessNegativeTestJSON-830208972 tempest-FlavorsAccessNegativeTestJSON-830208972-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "032bdcd874b34f42bdc6e043a8b66334"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:06.290707 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:06.290707 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:06.291583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3592dd68-c5dd-499d-9636-628fc7416f21 tempest-FlavorsAccessNegativeTestJSON-830208972 tempest-FlavorsAccessNegativeTestJSON-830208972-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': '72719ddb7a4040b393c29089fafa48d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032bdcd874b34f42bdc6e043a8b66334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3592dd68-c5dd-499d-9636-628fc7416f21 tempest-FlavorsAccessNegativeTestJSON-830208972 tempest-FlavorsAccessNegativeTestJSON-830208972-project] Request method failure captured: Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/flavors/755041606/action HTTP/1.1 Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 67 Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROBPppwTmj9sR8w5mFHLQ4X52xD8Za5eF1Qw0N01oz_mRgn7pQijfHvu_E_Z5lri-CCNtft7yC0mQYR7hYzpJJScheLJ5US0X2UXz2dhmQB5pBb4MbXRWFLFPiBY8ciitb9KKjnXEG_0u4LrOO1jxG84KLiCZn9fg5tSjpUyNiQO4A Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 032bdcd874b34f42bdc6e043a8b66334 Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-830208972 Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:51:06.296142 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:51:06.297424 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_032bdcd874b34f42bdc6e043a8b66334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/032bdcd874b34f42bdc6e043a8b66334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/032bdcd874b34f42bdc6e043a8b66334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/032bdcd874b34f42bdc6e043a8b66334"}]}] Aug 23 17:51:06.297424 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-830208972 Aug 23 17:51:06.297424 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 032bdcd874b34f42bdc6e043a8b66334 Aug 23 17:51:06.297424 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-830208972 Aug 23 17:51:06.297424 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FlavorsAccessNegativeTestJSON-830208972-project Aug 23 17:51:06.297424 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:06.297424 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:06.297424 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 72719ddb7a4040b393c29089fafa48d0 Aug 23 17:51:06.297424 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-830208972-project Aug 23 17:51:06.297424 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:51:06.297424 n-d-850468-16 devstack@n-api.service[128808]: {"addTenantAccess": {"tenant": "032bdcd874b34f42bdc6e043a8b66334"}} Aug 23 17:51:06.297424 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '755041606', 'body': {'addTenantAccess': {'tenant': '032bdcd874b34f42bdc6e043a8b66334'}}} Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:51:06.298072 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Aug 23 17:51:06.299021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:06.301350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-43294d09-dfa5-4b14-b04c-89f84ffd7582 tempest-NetworksTest-631023553 tempest-NetworksTest-631023553-project-admin] Calling method '.version_select at 0x7f27ed934d30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:06.304223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3592dd68-c5dd-499d-9636-628fc7416f21 tempest-FlavorsAccessNegativeTestJSON-830208972 tempest-FlavorsAccessNegativeTestJSON-830208972-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:06.305407 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3592dd68-c5dd-499d-9636-628fc7416f21 tempest-FlavorsAccessNegativeTestJSON-830208972 tempest-FlavorsAccessNegativeTestJSON-830208972-project] 10.222.0.61 "POST /compute/v2.1/flavors/755041606/action" status: 403 len: 130 microversion: 2.1 time: 0.480389 Aug 23 17:51:06.306201 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 26/44] 10.222.0.61 () {60 vars in 1197 bytes} [Tue Aug 23 17:51:05 2022] POST /compute/v2.1/flavors/755041606/action => generated 130 bytes in 485 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:06.963091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1622491635", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "availability_zone": "tempest-test_az-2126921520"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:06.997899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:06.998978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:07.000689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:07.003751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:07.004241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:07.004686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:07.211111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:51:07.917670 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-43294d09-dfa5-4b14-b04c-89f84ffd7582 tempest-NetworksTest-631023553 tempest-NetworksTest-631023553-project-admin] 10.222.0.61 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 2.371194 Aug 23 17:51:07.920221 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 19/45] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:51:05 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 2377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:51:07.924221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:51:07.924678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:51:07.925215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:51:07.925634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:51:07.926049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:51:07.935147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-715f0a57-ff8e-4a7a-8a30-6bbdffd9718c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:07.935883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-715f0a57-ff8e-4a7a-8a30-6bbdffd9718c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:07.958552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:07.959059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:07.964041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:07.965977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:07.968313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:07.971397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:08.021638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-715f0a57-ff8e-4a7a-8a30-6bbdffd9718c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:08.028164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-715f0a57-ff8e-4a7a-8a30-6bbdffd9718c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:08.030228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-715f0a57-ff8e-4a7a-8a30-6bbdffd9718c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:08.030447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Getting quotas for project e4bfa5ee9a774b419208f692b2faa8a8. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:51:08.034344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-715f0a57-ff8e-4a7a-8a30-6bbdffd9718c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:08.039684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-715f0a57-ff8e-4a7a-8a30-6bbdffd9718c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:08.040476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-715f0a57-ff8e-4a7a-8a30-6bbdffd9718c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:08.041695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Getting quotas for user 5b6558f47031454cbfec53c0f5d1ca23 and project e4bfa5ee9a774b419208f692b2faa8a8. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:51:08.070021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:51:08.072875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:51:08.227707 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-69ecfb41-8632-45a0-9623-42d7b8068044 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.920096 Aug 23 17:51:08.228977 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 27/46] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:51:08.240023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd8d29e1-57d9-4ff3-b322-f5265bc3db09 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:08.242225 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:08.242225 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:08.282322 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd8d29e1-57d9-4ff3-b322-f5265bc3db09 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/755041606" status: 202 len: 0 microversion: 2.1 time: 0.051886 Aug 23 17:51:08.283131 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 28/47] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Aug 23 17:51:08 2022] DELETE /compute/v2.1/flavors/755041606 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:51:08.299995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-830ab883-3f50-46d9-9f93-048e2d5c297e tempest-NetworksTest-631023553 tempest-NetworksTest-631023553-project-admin] Calling method '.version_select at 0x7f27ed503310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:09.001171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-715f0a57-ff8e-4a7a-8a30-6bbdffd9718c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:09.029208 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-715f0a57-ff8e-4a7a-8a30-6bbdffd9718c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 1.093892 Aug 23 17:51:09.033810 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 20/48] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:07 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:09.049061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-059a48d1-3537-4281-9741-ec48fe6e3d4c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:09.052530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-059a48d1-3537-4281-9741-ec48fe6e3d4c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:09.235098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-059a48d1-3537-4281-9741-ec48fe6e3d4c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:09.255409 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-059a48d1-3537-4281-9741-ec48fe6e3d4c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1243 microversion: 2.1 time: 0.219318 Aug 23 17:51:09.256584 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 21/49] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:09 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1243 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:09.267642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-67d1ed55-0e4b-4ec3-bea5-5088f436f417 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:09.319397 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-67d1ed55-0e4b-4ec3-bea5-5088f436f417 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.058280 Aug 23 17:51:09.320363 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 22/50] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:10.083218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3541d4bf-53ee-44a0-9ac8-a53952853cb6 tempest-AZAdminNegativeTestJSON-361429369 tempest-AZAdminNegativeTestJSON-361429369-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:10.084937 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:10.084937 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:10.093630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3541d4bf-53ee-44a0-9ac8-a53952853cb6 tempest-AZAdminNegativeTestJSON-361429369 tempest-AZAdminNegativeTestJSON-361429369-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': 'b23bd9a0504e462abd964661e4d22b38', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e412cfc8cbf6423d88b1d1fd1dac595f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3541d4bf-53ee-44a0-9ac8-a53952853cb6 tempest-AZAdminNegativeTestJSON-361429369 tempest-AZAdminNegativeTestJSON-361429369-project] Request method failure captured: Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBROKRdPdaLasF_2TrcE75hVpeLWL7l_wC1qR4ZG1qr4EGFHzp__xhHlyk_ssq90QyW2xJ7BM1Oq_HMCVwAf7YGg7r4yd7CUDIFHisg0qxWSG_d6y-7ZH2oGw2OopWuyoE-2zjlO8WX_QbECuzYMWp1tkK4zTv96E1AvE_7eQ_fFAZbI Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: e412cfc8cbf6423d88b1d1fd1dac595f Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AZAdminNegativeTestJSON-361429369 Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:51:10.109280 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:51:10.110947 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e412cfc8cbf6423d88b1d1fd1dac595f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e412cfc8cbf6423d88b1d1fd1dac595f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e412cfc8cbf6423d88b1d1fd1dac595f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e412cfc8cbf6423d88b1d1fd1dac595f"}]}] Aug 23 17:51:10.110947 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AZAdminNegativeTestJSON-361429369 Aug 23 17:51:10.110947 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: e412cfc8cbf6423d88b1d1fd1dac595f Aug 23 17:51:10.110947 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-361429369 Aug 23 17:51:10.110947 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AZAdminNegativeTestJSON-361429369-project Aug 23 17:51:10.110947 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:51:10.110947 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:51:10.110947 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: b23bd9a0504e462abd964661e4d22b38 Aug 23 17:51:10.110947 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AZAdminNegativeTestJSON-361429369-project Aug 23 17:51:10.110947 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:51:10.110947 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 23 17:51:10.110947 n-d-850468-16 devstack@n-api.service[128807]: action_args: {} Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:51:10.111747 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Aug 23 17:51:10.112942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:10.118581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3541d4bf-53ee-44a0-9ac8-a53952853cb6 tempest-AZAdminNegativeTestJSON-361429369 tempest-AZAdminNegativeTestJSON-361429369-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:10.136186 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3541d4bf-53ee-44a0-9ac8-a53952853cb6 tempest-AZAdminNegativeTestJSON-361429369 tempest-AZAdminNegativeTestJSON-361429369-project] 10.222.0.61 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.795548 Aug 23 17:51:10.137480 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 23/51] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Aug 23 17:51:09 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 805 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:10.142689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-175bb828-b2e7-46ba-a8d7-f1139bcb905e tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1557869355", "id": 1796172917, "os-flavor-access:is_public": "False"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:10.158202 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-830ab883-3f50-46d9-9f93-048e2d5c297e tempest-NetworksTest-631023553 tempest-NetworksTest-631023553-project-admin] 10.222.0.61 "GET /compute/v2.1/os-networks/e726cca6-c66d-49c0-9b80-481af41866c3" status: 200 len: 652 microversion: 2.1 time: 1.873698 Aug 23 17:51:10.159052 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 29/52] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 17:51:08 2022] GET /compute/v2.1/os-networks/e726cca6-c66d-49c0-9b80-481af41866c3 => generated 652 bytes in 1875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:10.165499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6444a584-c1f8-4e5d-9109-9ef6d9f78b95 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:10.166192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6444a584-c1f8-4e5d-9109-9ef6d9f78b95 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:10.173127 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:10.173127 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:10.184714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6444a584-c1f8-4e5d-9109-9ef6d9f78b95 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:10.191662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6444a584-c1f8-4e5d-9109-9ef6d9f78b95 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:10.195743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6444a584-c1f8-4e5d-9109-9ef6d9f78b95 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:10.200587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6444a584-c1f8-4e5d-9109-9ef6d9f78b95 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:10.207014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6444a584-c1f8-4e5d-9109-9ef6d9f78b95 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:10.208817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6444a584-c1f8-4e5d-9109-9ef6d9f78b95 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:10.243174 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-175bb828-b2e7-46ba-a8d7-f1139bcb905e tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.102058 Aug 23 17:51:10.251647 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 24/53] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:10 2022] POST /compute/v2.1/flavors => generated 439 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:10.282056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-15dbee0b-dd1e-4adb-8c3b-e3a1d5db952c tempest-NetworksTest-631023553 tempest-NetworksTest-631023553-project-admin] Calling method '.version_select at 0x7f27ed81ab80>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:10.664828 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-15dbee0b-dd1e-4adb-8c3b-e3a1d5db952c tempest-NetworksTest-631023553 tempest-NetworksTest-631023553-project-admin] 10.222.0.61 "GET /compute/v2.1/os-networks" status: 200 len: 1938 microversion: 2.1 time: 0.411827 Aug 23 17:51:10.668415 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 25/54] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:51:10 2022] GET /compute/v2.1/os-networks => generated 1938 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:10.674454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cef79205-5758-4938-9a93-100a343663e2 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "032bdcd874b34f42bdc6e043a8b66334"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:10.680582 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:add_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:10.680582 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:11.016192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6444a584-c1f8-4e5d-9109-9ef6d9f78b95 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:11.028564 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6444a584-c1f8-4e5d-9109-9ef6d9f78b95 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.868443 Aug 23 17:51:11.029345 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 30/55] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:10 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:11.035909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-448e767a-7ba4-487b-a491-531583560375 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:11.039039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-448e767a-7ba4-487b-a491-531583560375 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:11.055546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-448e767a-7ba4-487b-a491-531583560375 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:11.058388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-448e767a-7ba4-487b-a491-531583560375 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:11.059092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-448e767a-7ba4-487b-a491-531583560375 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:11.061783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-448e767a-7ba4-487b-a491-531583560375 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:11.062567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-448e767a-7ba4-487b-a491-531583560375 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:11.063230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-448e767a-7ba4-487b-a491-531583560375 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:11.179325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-448e767a-7ba4-487b-a491-531583560375 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:11.198160 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-448e767a-7ba4-487b-a491-531583560375 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1291 microversion: 2.1 time: 0.167280 Aug 23 17:51:11.201130 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 31/56] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:11 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1291 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:11.468317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=7,nova_api:UPDATE=1,nova_api:DELETE=7 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:11.534795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:11.543464 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cef79205-5758-4938-9a93-100a343663e2 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1796172917/action" status: 200 len: 97 microversion: 2.1 time: 0.873753 Aug 23 17:51:11.549294 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 26/57] 10.222.0.61 () {60 vars in 1200 bytes} [Tue Aug 23 17:51:10 2022] POST /compute/v2.1/flavors/1796172917/action => generated 97 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:51:11.558730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-12c10c31-4d43-4817-878a-8617097e45f6 tempest-FlavorsAccessNegativeTestJSON-830208972 tempest-FlavorsAccessNegativeTestJSON-830208972-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "032bdcd874b34f42bdc6e043a8b66334"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:11.570795 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:11.570795 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:11.575221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-12c10c31-4d43-4817-878a-8617097e45f6 tempest-FlavorsAccessNegativeTestJSON-830208972 tempest-FlavorsAccessNegativeTestJSON-830208972-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': '72719ddb7a4040b393c29089fafa48d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '032bdcd874b34f42bdc6e043a8b66334', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-12c10c31-4d43-4817-878a-8617097e45f6 tempest-FlavorsAccessNegativeTestJSON-830208972 tempest-FlavorsAccessNegativeTestJSON-830208972-project] Request method failure captured: Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/flavors/1796172917/action HTTP/1.1 Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 70 Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROBPppwTmj9sR8w5mFHLQ4X52xD8Za5eF1Qw0N01oz_mRgn7pQijfHvu_E_Z5lri-CCNtft7yC0mQYR7hYzpJJScheLJ5US0X2UXz2dhmQB5pBb4MbXRWFLFPiBY8ciitb9KKjnXEG_0u4LrOO1jxG84KLiCZn9fg5tSjpUyNiQO4A Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 032bdcd874b34f42bdc6e043a8b66334 Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-830208972 Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:51:11.583990 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:51:11.588262 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_032bdcd874b34f42bdc6e043a8b66334"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/032bdcd874b34f42bdc6e043a8b66334"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/032bdcd874b34f42bdc6e043a8b66334"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/032bdcd874b34f42bdc6e043a8b66334"}]}] Aug 23 17:51:11.588262 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-830208972 Aug 23 17:51:11.588262 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 032bdcd874b34f42bdc6e043a8b66334 Aug 23 17:51:11.588262 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-830208972 Aug 23 17:51:11.588262 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FlavorsAccessNegativeTestJSON-830208972-project Aug 23 17:51:11.588262 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:11.588262 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:11.588262 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 72719ddb7a4040b393c29089fafa48d0 Aug 23 17:51:11.588262 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-830208972-project Aug 23 17:51:11.588262 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:51:11.588262 n-d-850468-16 devstack@n-api.service[128808]: {"removeTenantAccess": {"tenant": "032bdcd874b34f42bdc6e043a8b66334"}} Aug 23 17:51:11.588262 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '1796172917', 'body': {'removeTenantAccess': {'tenant': '032bdcd874b34f42bdc6e043a8b66334'}}} Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can( Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:51:11.589064 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Aug 23 17:51:11.590745 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:11.592207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-12c10c31-4d43-4817-878a-8617097e45f6 tempest-FlavorsAccessNegativeTestJSON-830208972 tempest-FlavorsAccessNegativeTestJSON-830208972-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:11.592207 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-12c10c31-4d43-4817-878a-8617097e45f6 tempest-FlavorsAccessNegativeTestJSON-830208972 tempest-FlavorsAccessNegativeTestJSON-830208972-project] 10.222.0.61 "POST /compute/v2.1/flavors/1796172917/action" status: 403 len: 133 microversion: 2.1 time: 0.031333 Aug 23 17:51:11.603555 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 32/58] 10.222.0.61 () {60 vars in 1200 bytes} [Tue Aug 23 17:51:11 2022] POST /compute/v2.1/flavors/1796172917/action => generated 133 bytes in 49 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:11.603761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6c40a7ab-8434-4952-b7a2-2247678786b7 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "032bdcd874b34f42bdc6e043a8b66334"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:11.612215 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:11.612215 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:12.726856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-ee84a5a2-a017-4b65-9a6a-9647a19f1636 req-7db1a318-5f01-4e3b-a89c-ac2a57987d2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f249c89c-eb04-4198-a3a4-ee5ff7c2ec03", "tag": "bb3cba66-cdf3-4ded-8ab8-a9e188ca9076"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:12.788828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ee84a5a2-a017-4b65-9a6a-9647a19f1636 req-7db1a318-5f01-4e3b-a89c-ac2a57987d2a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:12.790246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ee84a5a2-a017-4b65-9a6a-9647a19f1636 req-7db1a318-5f01-4e3b-a89c-ac2a57987d2a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:12.792528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ee84a5a2-a017-4b65-9a6a-9647a19f1636 req-7db1a318-5f01-4e3b-a89c-ac2a57987d2a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:12.861002 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-ee84a5a2-a017-4b65-9a6a-9647a19f1636 req-7db1a318-5f01-4e3b-a89c-ac2a57987d2a service nova] Creating event network-changed:bb3cba66-cdf3-4ded-8ab8-a9e188ca9076 for instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 on n-h2-850468-16 Aug 23 17:51:12.862278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ee84a5a2-a017-4b65-9a6a-9647a19f1636 req-7db1a318-5f01-4e3b-a89c-ac2a57987d2a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 17:51:12.865066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ee84a5a2-a017-4b65-9a6a-9647a19f1636 req-7db1a318-5f01-4e3b-a89c-ac2a57987d2a service nova] Acquired lock "compute-rpcapi-router" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 17:51:12.866664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8621b8c3-5cda-4923-9bb4-520e85691a56 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:12.868135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8621b8c3-5cda-4923-9bb4-520e85691a56 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:12.870288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8621b8c3-5cda-4923-9bb4-520e85691a56 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:12.872998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8621b8c3-5cda-4923-9bb4-520e85691a56 None None] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:12.875343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8621b8c3-5cda-4923-9bb4-520e85691a56 None None] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:12.876530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8621b8c3-5cda-4923-9bb4-520e85691a56 None None] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:12.912272 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.compute.rpcapi [None req-8621b8c3-5cda-4923-9bb4-520e85691a56 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 17:51:12.913938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8621b8c3-5cda-4923-9bb4-520e85691a56 None None] Releasing lock "compute-rpcapi-router" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 17:51:12.984084 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8621b8c3-5cda-4923-9bb4-520e85691a56 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.049917 Aug 23 17:51:12.985362 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 33/59] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:51:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:12.997827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a6814220-4d49-4361-a884-c118aca4d5c0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:13.000080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a6814220-4d49-4361-a884-c118aca4d5c0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:13.023873 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6c40a7ab-8434-4952-b7a2-2247678786b7 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1796172917/action" status: 200 len: 21 microversion: 2.1 time: 1.430272 Aug 23 17:51:13.025402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6814220-4d49-4361-a884-c118aca4d5c0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:13.028112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6814220-4d49-4361-a884-c118aca4d5c0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:13.028638 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 27/60] 10.222.0.61 () {60 vars in 1200 bytes} [Tue Aug 23 17:51:11 2022] POST /compute/v2.1/flavors/1796172917/action => generated 21 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:51:13.029301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6814220-4d49-4361-a884-c118aca4d5c0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:13.030999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6814220-4d49-4361-a884-c118aca4d5c0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:13.040299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a95ac3da-339a-448c-9cda-f66ebde9ffa6 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:13.040944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a95ac3da-339a-448c-9cda-f66ebde9ffa6 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:13.041272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6814220-4d49-4361-a884-c118aca4d5c0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:13.042052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6814220-4d49-4361-a884-c118aca4d5c0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:13.066381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a95ac3da-339a-448c-9cda-f66ebde9ffa6 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:13.069556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a95ac3da-339a-448c-9cda-f66ebde9ffa6 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:13.070998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a95ac3da-339a-448c-9cda-f66ebde9ffa6 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:13.072574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a95ac3da-339a-448c-9cda-f66ebde9ffa6 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:13.073061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a95ac3da-339a-448c-9cda-f66ebde9ffa6 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:13.077465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a95ac3da-339a-448c-9cda-f66ebde9ffa6 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:13.350428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a95ac3da-339a-448c-9cda-f66ebde9ffa6 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:13.363711 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a95ac3da-339a-448c-9cda-f66ebde9ffa6 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1297 microversion: 2.1 time: 0.333216 Aug 23 17:51:13.370929 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 28/61] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:13 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1297 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:13.385766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ebc69097-a2ec-4d43-86d3-a585659d68c2 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:13.390637 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:13.390637 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:13.452052 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ebc69097-a2ec-4d43-86d3-a585659d68c2 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1796172917" status: 202 len: 0 microversion: 2.1 time: 0.078601 Aug 23 17:51:13.456857 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 29/62] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:51:13 2022] DELETE /compute/v2.1/flavors/1796172917 => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:51:13.476991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4324c6b2-973a-4017-9e34-14783c4335bb tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:13.549940 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4324c6b2-973a-4017-9e34-14783c4335bb tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.085510 Aug 23 17:51:13.554027 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 30/63] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:13 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:13.576801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b9b3b18a-471e-4100-acca-3b0783539bb0 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1713249997", "id": 1565173677, "os-flavor-access:is_public": "False"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:13.580947 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:13.580947 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:13.599756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a6814220-4d49-4361-a884-c118aca4d5c0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:13.617916 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a6814220-4d49-4361-a884-c118aca4d5c0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.631052 Aug 23 17:51:13.622113 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 34/64] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:12 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:13.639177 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b9b3b18a-471e-4100-acca-3b0783539bb0 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.066364 Aug 23 17:51:13.640281 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 31/65] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:13 2022] POST /compute/v2.1/flavors => generated 439 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:13.654413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adf09345-e5e7-4bdc-9d16-8fbab8639028 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "bc8d64d615b5440894e828f0431510a1"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:13.657464 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-access:remove_tenant_access": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:13.657464 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:14.390951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c49e1692-1b51-4093-a43d-dab84be5f09c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:14.392337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c49e1692-1b51-4093-a43d-dab84be5f09c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:14.415203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c49e1692-1b51-4093-a43d-dab84be5f09c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:14.417945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c49e1692-1b51-4093-a43d-dab84be5f09c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:14.420234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c49e1692-1b51-4093-a43d-dab84be5f09c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:14.421559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c49e1692-1b51-4093-a43d-dab84be5f09c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:14.424843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c49e1692-1b51-4093-a43d-dab84be5f09c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:14.426475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c49e1692-1b51-4093-a43d-dab84be5f09c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:14.908835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c49e1692-1b51-4093-a43d-dab84be5f09c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:14.923541 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c49e1692-1b51-4093-a43d-dab84be5f09c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.541496 Aug 23 17:51:14.934846 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 32/66] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:14 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:14.944260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd6b5500-d17d-48ba-8872-38a5042f5fdb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:14.945189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd6b5500-d17d-48ba-8872-38a5042f5fdb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:14.952312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd6b5500-d17d-48ba-8872-38a5042f5fdb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:14.953163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd6b5500-d17d-48ba-8872-38a5042f5fdb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:14.953879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd6b5500-d17d-48ba-8872-38a5042f5fdb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:14.954813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd6b5500-d17d-48ba-8872-38a5042f5fdb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:14.955420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd6b5500-d17d-48ba-8872-38a5042f5fdb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:14.955996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd6b5500-d17d-48ba-8872-38a5042f5fdb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:15.285812 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-adf09345-e5e7-4bdc-9d16-8fbab8639028 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] HTTP exception thrown: Flavor access not found for 22 / bc8d64d615b5440894e828f0431510a1 combination. Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adf09345-e5e7-4bdc-9d16-8fbab8639028 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Request method failure captured: Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/flavors/1565173677/action HTTP/1.1 Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 70 Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRODMDLT_XRoAr84sjAtBpi09aDCduhALoZ-CNbBd9aHGElt392Ybfj63B3FpDbL9nLx5pAA7DXgWOqfUzYfHyceDttNzAXcsB94kPNXUGl_dJbNyBU-MlUkCtAL2-yReHYPJn9JbEojZEZeA5SishW1wLCJwTBtaWUi-xxhWB1uS8E Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: b2ff6d90d1364e1ebb730f3091f3eda3 Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-903217463 Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:51:15.288186 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:51:15.289378 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_b2ff6d90d1364e1ebb730f3091f3eda3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b2ff6d90d1364e1ebb730f3091f3eda3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/b2ff6d90d1364e1ebb730f3091f3eda3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/b2ff6d90d1364e1ebb730f3091f3eda3"}]}] Aug 23 17:51:15.289378 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-903217463 Aug 23 17:51:15.289378 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: b2ff6d90d1364e1ebb730f3091f3eda3 Aug 23 17:51:15.289378 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-903217463 Aug 23 17:51:15.289378 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin Aug 23 17:51:15.289378 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:15.289378 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:15.289378 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 33b509c7e1be4648b8612a05aae59caf Aug 23 17:51:15.289378 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin Aug 23 17:51:15.289378 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:51:15.289378 n-d-850468-16 devstack@n-api.service[128808]: {"removeTenantAccess": {"tenant": "bc8d64d615b5440894e828f0431510a1"}} Aug 23 17:51:15.289378 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: exception: Flavor access not found for 22 / bc8d64d615b5440894e828f0431510a1 combination. Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '1565173677', 'body': {'removeTenantAccess': {'tenant': 'bc8d64d615b5440894e828f0431510a1'}}} Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Aug 23 17:51:15.290239 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 22 / bc8d64d615b5440894e828f0431510a1 combination. Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 22 / bc8d64d615b5440894e828f0431510a1 combination. Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:15.291344 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:15.292559 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:15.292559 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:15.292559 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:15.292559 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:15.292559 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 22 / bc8d64d615b5440894e828f0431510a1 combination. Aug 23 17:51:15.292559 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:15.292559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adf09345-e5e7-4bdc-9d16-8fbab8639028 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Returning 404 to user: Flavor access not found for 22 / bc8d64d615b5440894e828f0431510a1 combination. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:15.292559 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-adf09345-e5e7-4bdc-9d16-8fbab8639028 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1565173677/action" status: 404 len: 124 microversion: 2.1 time: 1.640389 Aug 23 17:51:15.292559 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 35/67] 10.222.0.61 () {60 vars in 1200 bytes} [Tue Aug 23 17:51:13 2022] POST /compute/v2.1/flavors/1565173677/action => generated 124 bytes in 1642 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:15.329028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6c470b4b-f920-4293-96a0-a784e6a35f94 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:15.329914 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:15.329914 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:15.383498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bd6b5500-d17d-48ba-8872-38a5042f5fdb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:15.396717 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6c470b4b-f920-4293-96a0-a784e6a35f94 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1565173677" status: 202 len: 0 microversion: 2.1 time: 0.087095 Aug 23 17:51:15.398747 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 36/68] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:51:15 2022] DELETE /compute/v2.1/flavors/1565173677 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:51:15.404224 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd6b5500-d17d-48ba-8872-38a5042f5fdb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.466100 Aug 23 17:51:15.406907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2bfdf34a-6af2-463d-ba4f-0c09088a5e70 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:15.423797 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 33/69] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:14 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:15.451130 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2bfdf34a-6af2-463d-ba4f-0c09088a5e70 tempest-FlavorsAccessNegativeTestJSON-903217463 tempest-FlavorsAccessNegativeTestJSON-903217463-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.048370 Aug 23 17:51:15.455748 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 37/70] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:15 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:51:15.955898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-48e26ae9-d606-4bab-b393-b542ae45180c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:15.959855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-48e26ae9-d606-4bab-b393-b542ae45180c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:15.982913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48e26ae9-d606-4bab-b393-b542ae45180c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:15.984417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48e26ae9-d606-4bab-b393-b542ae45180c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:15.986190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48e26ae9-d606-4bab-b393-b542ae45180c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:15.993952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48e26ae9-d606-4bab-b393-b542ae45180c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:15.994798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48e26ae9-d606-4bab-b393-b542ae45180c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:15.996265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48e26ae9-d606-4bab-b393-b542ae45180c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:16.341245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-48e26ae9-d606-4bab-b393-b542ae45180c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:16.362174 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-48e26ae9-d606-4bab-b393-b542ae45180c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.417512 Aug 23 17:51:16.382984 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 34/71] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:15 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:16.428482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d16bd32-ea0c-487d-a426-9d9f4668ec06 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:16.429255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8d16bd32-ea0c-487d-a426-9d9f4668ec06 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:16.475367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d16bd32-ea0c-487d-a426-9d9f4668ec06 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:16.479327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d16bd32-ea0c-487d-a426-9d9f4668ec06 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:16.485316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d16bd32-ea0c-487d-a426-9d9f4668ec06 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:16.488241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d16bd32-ea0c-487d-a426-9d9f4668ec06 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:16.488947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d16bd32-ea0c-487d-a426-9d9f4668ec06 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:16.490244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d16bd32-ea0c-487d-a426-9d9f4668ec06 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:17.022951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8d16bd32-ea0c-487d-a426-9d9f4668ec06 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:17.047370 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8d16bd32-ea0c-487d-a426-9d9f4668ec06 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.622173 Aug 23 17:51:17.048942 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 38/72] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:16 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:17.389633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6672578d-7016-405e-afd9-f8bf68ed0af9 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:17.390376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6672578d-7016-405e-afd9-f8bf68ed0af9 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:17.405132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6672578d-7016-405e-afd9-f8bf68ed0af9 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:17.406046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6672578d-7016-405e-afd9-f8bf68ed0af9 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:17.407594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6672578d-7016-405e-afd9-f8bf68ed0af9 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:17.410261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6672578d-7016-405e-afd9-f8bf68ed0af9 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:17.411570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6672578d-7016-405e-afd9-f8bf68ed0af9 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:17.413054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6672578d-7016-405e-afd9-f8bf68ed0af9 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:18.070208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae7a9eb2-400a-4636-8f00-ac1d2510bbbd tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:18.070919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae7a9eb2-400a-4636-8f00-ac1d2510bbbd tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:18.086215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=14 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:18.094882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae7a9eb2-400a-4636-8f00-ac1d2510bbbd tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:18.095388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae7a9eb2-400a-4636-8f00-ac1d2510bbbd tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:18.102799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae7a9eb2-400a-4636-8f00-ac1d2510bbbd tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:18.103702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae7a9eb2-400a-4636-8f00-ac1d2510bbbd tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:18.104186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae7a9eb2-400a-4636-8f00-ac1d2510bbbd tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:18.110795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae7a9eb2-400a-4636-8f00-ac1d2510bbbd tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:18.562045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6672578d-7016-405e-afd9-f8bf68ed0af9 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:18.599024 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6672578d-7016-405e-afd9-f8bf68ed0af9 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 1.203577 Aug 23 17:51:18.607215 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 35/73] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:17 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:19.255148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:19.357272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-345fd98c-e180-408d-b2b1-e79d860c2da5 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Calling method '.version_select at 0x7f27ed9029d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:19.360776 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:19.360776 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:19.366392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-345fd98c-e180-408d-b2b1-e79d860c2da5 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:19.369173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-345fd98c-e180-408d-b2b1-e79d860c2da5 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:19.371246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-345fd98c-e180-408d-b2b1-e79d860c2da5 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:19.381912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ae7a9eb2-400a-4636-8f00-ac1d2510bbbd tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:19.397291 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae7a9eb2-400a-4636-8f00-ac1d2510bbbd tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 1.331852 Aug 23 17:51:19.400695 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 39/74] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:18 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:19.436227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-345fd98c-e180-408d-b2b1-e79d860c2da5 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:19.437122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-345fd98c-e180-408d-b2b1-e79d860c2da5 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:19.437810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-345fd98c-e180-408d-b2b1-e79d860c2da5 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:19.503065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-345fd98c-e180-408d-b2b1-e79d860c2da5 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:19.505722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-345fd98c-e180-408d-b2b1-e79d860c2da5 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:19.506580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-345fd98c-e180-408d-b2b1-e79d860c2da5 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:19.525115 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-345fd98c-e180-408d-b2b1-e79d860c2da5 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.28 time: 0.714210 Aug 23 17:51:19.528703 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 36/75] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Aug 23 17:51:18 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:19.540804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a5b1f2d1-a634-4d76-aba2-99b6ff686fa4 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Calling method '.version_select at 0x7f27ed5030d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:19.542207 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:19.542207 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:19.544305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5b1f2d1-a634-4d76-aba2-99b6ff686fa4 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:19.544857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5b1f2d1-a634-4d76-aba2-99b6ff686fa4 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:19.545459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5b1f2d1-a634-4d76-aba2-99b6ff686fa4 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:19.603171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5b1f2d1-a634-4d76-aba2-99b6ff686fa4 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:19.603675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5b1f2d1-a634-4d76-aba2-99b6ff686fa4 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:19.604121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5b1f2d1-a634-4d76-aba2-99b6ff686fa4 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:19.637434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-521700ad-acf0-49df-b5a8-8f3892d2f1ba tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:19.638559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-521700ad-acf0-49df-b5a8-8f3892d2f1ba tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:19.651310 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a5b1f2d1-a634-4d76-aba2-99b6ff686fa4 tempest-HypervisorAdminV228Test-1374509773 tempest-HypervisorAdminV228Test-1374509773-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 720 microversion: 2.28 time: 0.111822 Aug 23 17:51:19.654562 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 40/76] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Aug 23 17:51:19 2022] GET /compute/v2.1/os-hypervisors/1 => generated 720 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:19.658373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-521700ad-acf0-49df-b5a8-8f3892d2f1ba tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:19.659681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-521700ad-acf0-49df-b5a8-8f3892d2f1ba tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:19.662643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-521700ad-acf0-49df-b5a8-8f3892d2f1ba tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:19.665628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-521700ad-acf0-49df-b5a8-8f3892d2f1ba tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:19.673205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-521700ad-acf0-49df-b5a8-8f3892d2f1ba tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:19.675837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-521700ad-acf0-49df-b5a8-8f3892d2f1ba tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:20.463843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-521700ad-acf0-49df-b5a8-8f3892d2f1ba tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:20.478188 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-521700ad-acf0-49df-b5a8-8f3892d2f1ba tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.840801 Aug 23 17:51:20.494291 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 37/77] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:19 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:20.502232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-84697711-ad04-445f-b606-bd01f629cfba tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:20.506605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-84697711-ad04-445f-b606-bd01f629cfba tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:20.523377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84697711-ad04-445f-b606-bd01f629cfba tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:20.526608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84697711-ad04-445f-b606-bd01f629cfba tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:20.529818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84697711-ad04-445f-b606-bd01f629cfba tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:20.530896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84697711-ad04-445f-b606-bd01f629cfba tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:20.531627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84697711-ad04-445f-b606-bd01f629cfba tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:20.532202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84697711-ad04-445f-b606-bd01f629cfba tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:20.944355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-80087290-fa70-4f4b-863b-e4c4be729c40 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Calling method '.version_select at 0x7f27ed503670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:20.946603 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:20.946603 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:20.948259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80087290-fa70-4f4b-863b-e4c4be729c40 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:20.948903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80087290-fa70-4f4b-863b-e4c4be729c40 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:20.949512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80087290-fa70-4f4b-863b-e4c4be729c40 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.000910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80087290-fa70-4f4b-863b-e4c4be729c40 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.002219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80087290-fa70-4f4b-863b-e4c4be729c40 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.004074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80087290-fa70-4f4b-863b-e4c4be729c40 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.039159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80087290-fa70-4f4b-863b-e4c4be729c40 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.042109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80087290-fa70-4f4b-863b-e4c4be729c40 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.042864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80087290-fa70-4f4b-863b-e4c4be729c40 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.062520 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-80087290-fa70-4f4b-863b-e4c4be729c40 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.917505 Aug 23 17:51:21.068806 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 41/78] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:20 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:21.081939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7251f37-3eba-4c26-90aa-99996f07ae67 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Calling method '.version_select at 0x7f27ed503790>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:21.083300 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:21.083300 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:21.086289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7251f37-3eba-4c26-90aa-99996f07ae67 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.087046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7251f37-3eba-4c26-90aa-99996f07ae67 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.088896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7251f37-3eba-4c26-90aa-99996f07ae67 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.127800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7251f37-3eba-4c26-90aa-99996f07ae67 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.130938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7251f37-3eba-4c26-90aa-99996f07ae67 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.131788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7251f37-3eba-4c26-90aa-99996f07ae67 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.158417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7251f37-3eba-4c26-90aa-99996f07ae67 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.162027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7251f37-3eba-4c26-90aa-99996f07ae67 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.163938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7251f37-3eba-4c26-90aa-99996f07ae67 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.181226 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7251f37-3eba-4c26-90aa-99996f07ae67 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1509 microversion: 2.1 time: 0.102039 Aug 23 17:51:21.184841 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 42/79] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Aug 23 17:51:21 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1509 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:21.188198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-84697711-ad04-445f-b606-bd01f629cfba tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:21.203828 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-84697711-ad04-445f-b606-bd01f629cfba tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.708295 Aug 23 17:51:21.210854 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 38/80] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:20 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:21.215770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ff7e048c-5f9f-41aa-99f6-86ad866f99b9 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Calling method '.version_select at 0x7f27ed565550>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:21.220073 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:21.220073 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:21.232808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7e048c-5f9f-41aa-99f6-86ad866f99b9 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.234192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7e048c-5f9f-41aa-99f6-86ad866f99b9 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.239977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7e048c-5f9f-41aa-99f6-86ad866f99b9 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.321656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7e048c-5f9f-41aa-99f6-86ad866f99b9 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.327432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7e048c-5f9f-41aa-99f6-86ad866f99b9 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.331683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7e048c-5f9f-41aa-99f6-86ad866f99b9 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.398979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7e048c-5f9f-41aa-99f6-86ad866f99b9 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.399898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7e048c-5f9f-41aa-99f6-86ad866f99b9 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.408434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7e048c-5f9f-41aa-99f6-86ad866f99b9 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.420645 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ff7e048c-5f9f-41aa-99f6-86ad866f99b9 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.223048 Aug 23 17:51:21.426120 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 43/81] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:21 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:21.438725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bfc7cfed-56b1-4ed5-b2a7-f68ba3aee3bc tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Calling method '.version_select at 0x7f27ed565700>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:21.441659 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:21.441659 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:21.444133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfc7cfed-56b1-4ed5-b2a7-f68ba3aee3bc tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.446125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfc7cfed-56b1-4ed5-b2a7-f68ba3aee3bc tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.447951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfc7cfed-56b1-4ed5-b2a7-f68ba3aee3bc tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.484754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfc7cfed-56b1-4ed5-b2a7-f68ba3aee3bc tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.486264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfc7cfed-56b1-4ed5-b2a7-f68ba3aee3bc tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.488432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfc7cfed-56b1-4ed5-b2a7-f68ba3aee3bc tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.520752 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bfc7cfed-56b1-4ed5-b2a7-f68ba3aee3bc tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.087495 Aug 23 17:51:21.524886 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 44/82] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:21 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:21.537848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f64995b-583f-4c6e-a749-dbd91637dc76 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:21.538793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0f64995b-583f-4c6e-a749-dbd91637dc76 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:21.553731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f64995b-583f-4c6e-a749-dbd91637dc76 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.556105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f64995b-583f-4c6e-a749-dbd91637dc76 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.556747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f64995b-583f-4c6e-a749-dbd91637dc76 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.559692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f64995b-583f-4c6e-a749-dbd91637dc76 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.560392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f64995b-583f-4c6e-a749-dbd91637dc76 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.562043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f64995b-583f-4c6e-a749-dbd91637dc76 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.912672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0f64995b-583f-4c6e-a749-dbd91637dc76 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:21.927771 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0f64995b-583f-4c6e-a749-dbd91637dc76 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.397759 Aug 23 17:51:21.929183 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 45/83] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:21 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:21.936688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7113b348-d2cc-4671-82bf-276516a67e36 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Calling method '.version_select at 0x7f27ed4bcca0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:21.938445 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:21.938445 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:21.939816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7113b348-d2cc-4671-82bf-276516a67e36 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:21.940521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7113b348-d2cc-4671-82bf-276516a67e36 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:21.941158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7113b348-d2cc-4671-82bf-276516a67e36 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:21.968366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-cd9cf61d-67a7-4ff8-b0cb-628010a4551e req-6587ce19-dd4d-41d3-90c7-91c6dc259733 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bc9c68a-9939-4cc7-ac2a-cf726ba91792", "tag": "ae4fccf8-4faf-4179-aa86-d5825bb5f3e9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:22.008256 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7113b348-d2cc-4671-82bf-276516a67e36 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.077755 Aug 23 17:51:22.025093 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 46/84] 10.222.0.61 () {58 vars in 1179 bytes} [Tue Aug 23 17:51:21 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:22.045858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cd9cf61d-67a7-4ff8-b0cb-628010a4551e req-6587ce19-dd4d-41d3-90c7-91c6dc259733 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.055955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cd9cf61d-67a7-4ff8-b0cb-628010a4551e req-6587ce19-dd4d-41d3-90c7-91c6dc259733 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.059516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cd9cf61d-67a7-4ff8-b0cb-628010a4551e req-6587ce19-dd4d-41d3-90c7-91c6dc259733 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.060158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-12c2fb9a-4764-4cc5-aa91-b6c3a1d03863 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Calling method '.version_select at 0x7f27ed4bc8b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:22.065018 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:22.065018 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:22.084215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2fb9a-4764-4cc5-aa91-b6c3a1d03863 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.086283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2fb9a-4764-4cc5-aa91-b6c3a1d03863 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.089313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2fb9a-4764-4cc5-aa91-b6c3a1d03863 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.148514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2fb9a-4764-4cc5-aa91-b6c3a1d03863 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.150557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2fb9a-4764-4cc5-aa91-b6c3a1d03863 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.154828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2fb9a-4764-4cc5-aa91-b6c3a1d03863 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.166797 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-cd9cf61d-67a7-4ff8-b0cb-628010a4551e req-6587ce19-dd4d-41d3-90c7-91c6dc259733 service nova] Creating event network-changed:ae4fccf8-4faf-4179-aa86-d5825bb5f3e9 for instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 on n-h1-850468-16 Aug 23 17:51:22.167516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cd9cf61d-67a7-4ff8-b0cb-628010a4551e req-6587ce19-dd4d-41d3-90c7-91c6dc259733 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 17:51:22.171552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cd9cf61d-67a7-4ff8-b0cb-628010a4551e req-6587ce19-dd4d-41d3-90c7-91c6dc259733 service nova] Acquired lock "compute-rpcapi-router" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 17:51:22.172748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f446753-3435-4323-9030-1c3970bc7f87 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.173532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f446753-3435-4323-9030-1c3970bc7f87 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.173974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f446753-3435-4323-9030-1c3970bc7f87 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.180421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=11,nova_api:INSERT=5 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:22.181266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f446753-3435-4323-9030-1c3970bc7f87 None None] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.182134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f446753-3435-4323-9030-1c3970bc7f87 None None] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.182819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f446753-3435-4323-9030-1c3970bc7f87 None None] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.201062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2fb9a-4764-4cc5-aa91-b6c3a1d03863 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.204976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2fb9a-4764-4cc5-aa91-b6c3a1d03863 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.205688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2fb9a-4764-4cc5-aa91-b6c3a1d03863 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.219132 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.compute.rpcapi [None req-3f446753-3435-4323-9030-1c3970bc7f87 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 23 17:51:22.230417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f446753-3435-4323-9030-1c3970bc7f87 None None] Releasing lock "compute-rpcapi-router" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 17:51:22.246274 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-12c2fb9a-4764-4cc5-aa91-b6c3a1d03863 tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.217289 Aug 23 17:51:22.248519 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 47/85] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:22 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:22.263810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ced72e7b-91c2-4f2b-82ac-e94bec2aaaeb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:22.268308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ced72e7b-91c2-4f2b-82ac-e94bec2aaaeb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:22.289198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ced72e7b-91c2-4f2b-82ac-e94bec2aaaeb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.292396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ced72e7b-91c2-4f2b-82ac-e94bec2aaaeb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.301018 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3f446753-3435-4323-9030-1c3970bc7f87 None None] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.009904 Aug 23 17:51:22.301858 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 39/86] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:51:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:22.303577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ced72e7b-91c2-4f2b-82ac-e94bec2aaaeb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.306041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ced72e7b-91c2-4f2b-82ac-e94bec2aaaeb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.307206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ced72e7b-91c2-4f2b-82ac-e94bec2aaaeb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.307830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ced72e7b-91c2-4f2b-82ac-e94bec2aaaeb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.329398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cd5e55ca-179b-499d-a741-76d29e61a2de tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Calling method '.version_select at 0x7f27ed77bb80>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:22.330441 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:22.330441 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:22.331695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd5e55ca-179b-499d-a741-76d29e61a2de tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.332181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd5e55ca-179b-499d-a741-76d29e61a2de tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.333236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd5e55ca-179b-499d-a741-76d29e61a2de tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.409431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd5e55ca-179b-499d-a741-76d29e61a2de tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.410615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd5e55ca-179b-499d-a741-76d29e61a2de tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.417822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd5e55ca-179b-499d-a741-76d29e61a2de tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.449462 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cd5e55ca-179b-499d-a741-76d29e61a2de tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 760 microversion: 2.1 time: 0.145988 Aug 23 17:51:22.450137 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 40/87] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:22 2022] GET /compute/v2.1/os-hypervisors/1 => generated 760 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:22.470182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8847b951-c75c-4cb7-b710-5cd56f37939d tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Calling method '.version_select at 0x7f27ed769f70>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:22.472578 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:22.472578 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:22.475536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8847b951-c75c-4cb7-b710-5cd56f37939d tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.476840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8847b951-c75c-4cb7-b710-5cd56f37939d tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.478108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8847b951-c75c-4cb7-b710-5cd56f37939d tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.515290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8847b951-c75c-4cb7-b710-5cd56f37939d tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.516267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8847b951-c75c-4cb7-b710-5cd56f37939d tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.516910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8847b951-c75c-4cb7-b710-5cd56f37939d tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.527186 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8847b951-c75c-4cb7-b710-5cd56f37939d tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 760 microversion: 2.1 time: 0.062710 Aug 23 17:51:22.529863 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 41/88] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:22 2022] GET /compute/v2.1/os-hypervisors/2 => generated 760 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:22.571982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ef9d9d7c-398f-42d8-ae6f-113183d56b1a tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Calling method '.version_select at 0x7f27ed769310>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:22.579233 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:22.579233 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:22.582498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef9d9d7c-398f-42d8-ae6f-113183d56b1a tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.587505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef9d9d7c-398f-42d8-ae6f-113183d56b1a tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.592391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef9d9d7c-398f-42d8-ae6f-113183d56b1a tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.657825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef9d9d7c-398f-42d8-ae6f-113183d56b1a tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.660066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef9d9d7c-398f-42d8-ae6f-113183d56b1a tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.662013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef9d9d7c-398f-42d8-ae6f-113183d56b1a tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.698895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef9d9d7c-398f-42d8-ae6f-113183d56b1a tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:22.700602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef9d9d7c-398f-42d8-ae6f-113183d56b1a tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:22.702828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef9d9d7c-398f-42d8-ae6f-113183d56b1a tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:22.897611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=10 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:23.105077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ced72e7b-91c2-4f2b-82ac-e94bec2aaaeb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:23.108658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:23.117762 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ced72e7b-91c2-4f2b-82ac-e94bec2aaaeb tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.864087 Aug 23 17:51:23.118349 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 48/89] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:22 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:23.129276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-10b6445e-a5fe-416b-81ac-b09f73ede696 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:23.150295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-10b6445e-a5fe-416b-81ac-b09f73ede696 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:23.173964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10b6445e-a5fe-416b-81ac-b09f73ede696 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:23.181738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10b6445e-a5fe-416b-81ac-b09f73ede696 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:23.182214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10b6445e-a5fe-416b-81ac-b09f73ede696 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:23.183031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10b6445e-a5fe-416b-81ac-b09f73ede696 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:23.183378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10b6445e-a5fe-416b-81ac-b09f73ede696 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:23.183820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10b6445e-a5fe-416b-81ac-b09f73ede696 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:23.255207 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ef9d9d7c-398f-42d8-ae6f-113183d56b1a tempest-HypervisorAdminTestJSON-1901579339 tempest-HypervisorAdminTestJSON-1901579339-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 176 microversion: 2.1 time: 0.708186 Aug 23 17:51:23.256812 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 42/90] 10.222.0.61 () {58 vars in 1173 bytes} [Tue Aug 23 17:51:22 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 176 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:24.089991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-10b6445e-a5fe-416b-81ac-b09f73ede696 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:24.098416 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-10b6445e-a5fe-416b-81ac-b09f73ede696 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.972809 Aug 23 17:51:24.104640 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 49/91] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:23 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:24.144350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f239b7ad-42ff-4c0c-a55e-4c414cf48593 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:24.146411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f239b7ad-42ff-4c0c-a55e-4c414cf48593 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:24.166886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f239b7ad-42ff-4c0c-a55e-4c414cf48593 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:24.167461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f239b7ad-42ff-4c0c-a55e-4c414cf48593 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:24.167916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f239b7ad-42ff-4c0c-a55e-4c414cf48593 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:24.173424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f239b7ad-42ff-4c0c-a55e-4c414cf48593 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:24.177307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f239b7ad-42ff-4c0c-a55e-4c414cf48593 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:24.177927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f239b7ad-42ff-4c0c-a55e-4c414cf48593 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:25.126307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fa9e8ad7-235d-4ec1-a941-d244dab6fa44 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:25.126957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fa9e8ad7-235d-4ec1-a941-d244dab6fa44 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:25.138486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa9e8ad7-235d-4ec1-a941-d244dab6fa44 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:25.139054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa9e8ad7-235d-4ec1-a941-d244dab6fa44 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:25.139512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa9e8ad7-235d-4ec1-a941-d244dab6fa44 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:25.140229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa9e8ad7-235d-4ec1-a941-d244dab6fa44 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:25.140688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa9e8ad7-235d-4ec1-a941-d244dab6fa44 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:25.141108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa9e8ad7-235d-4ec1-a941-d244dab6fa44 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:25.409462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f239b7ad-42ff-4c0c-a55e-4c414cf48593 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:25.431850 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f239b7ad-42ff-4c0c-a55e-4c414cf48593 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 1.296454 Aug 23 17:51:25.445508 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 43/92] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:24 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:25.858731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3eeb378b-cb92-4bf3-8822-f3cf0316928c tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Calling method '.version_select at 0x7f27ed77c8b0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:25.861648 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:25.861648 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:25.867318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3eeb378b-cb92-4bf3-8822-f3cf0316928c tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:25.868113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3eeb378b-cb92-4bf3-8822-f3cf0316928c tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:25.868744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3eeb378b-cb92-4bf3-8822-f3cf0316928c tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:25.870049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3eeb378b-cb92-4bf3-8822-f3cf0316928c tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:25.874157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3eeb378b-cb92-4bf3-8822-f3cf0316928c tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:25.874713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3eeb378b-cb92-4bf3-8822-f3cf0316928c tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:25.900240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:25.960010 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3eeb378b-cb92-4bf3-8822-f3cf0316928c tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 200 len: 403 microversion: 2.1 time: 0.511196 Aug 23 17:51:25.966478 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 44/93] 10.222.0.61 () {58 vars in 1128 bytes} [Tue Aug 23 17:51:25 2022] GET /compute/v2.1/os-hosts => generated 403 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:25.986273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-99fe43da-99a6-474c-8640-1f703d772eb5 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Calling method '.version_select at 0x7f27ed81ab80>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:25.994029 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:25.994029 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:25.996460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99fe43da-99a6-474c-8640-1f703d772eb5 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:26.002408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99fe43da-99a6-474c-8640-1f703d772eb5 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:26.004833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99fe43da-99a6-474c-8640-1f703d772eb5 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:26.006226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99fe43da-99a6-474c-8640-1f703d772eb5 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:26.007009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99fe43da-99a6-474c-8640-1f703d772eb5 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:26.007723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99fe43da-99a6-474c-8640-1f703d772eb5 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:26.059353 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-99fe43da-99a6-474c-8640-1f703d772eb5 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 403 microversion: 2.1 time: 0.087904 Aug 23 17:51:26.063378 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 45/94] 10.222.0.61 () {58 vars in 1139 bytes} [Tue Aug 23 17:51:25 2022] GET /compute/v2.1/os-hosts?zone= => generated 403 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:26.075850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fe72a882-7bd8-46c1-ab2e-5ae3cf78ca69 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Calling method '.version_select at 0x7f27ed760d30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:26.086672 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:26.086672 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:26.090525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe72a882-7bd8-46c1-ab2e-5ae3cf78ca69 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:26.102815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe72a882-7bd8-46c1-ab2e-5ae3cf78ca69 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:26.103891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe72a882-7bd8-46c1-ab2e-5ae3cf78ca69 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:26.105159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe72a882-7bd8-46c1-ab2e-5ae3cf78ca69 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:26.105847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe72a882-7bd8-46c1-ab2e-5ae3cf78ca69 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:26.106528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe72a882-7bd8-46c1-ab2e-5ae3cf78ca69 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:26.163994 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fe72a882-7bd8-46c1-ab2e-5ae3cf78ca69 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.092567 Aug 23 17:51:26.164773 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 46/95] 10.222.0.61 () {58 vars in 1145 bytes} [Tue Aug 23 17:51:26 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 17:51:26.235698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fa9e8ad7-235d-4ec1-a941-d244dab6fa44 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:26.248226 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fa9e8ad7-235d-4ec1-a941-d244dab6fa44 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 1.126613 Aug 23 17:51:26.249446 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 50/96] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:25 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 1128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:26.463451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7b0e2b50-2943-4203-a24f-52479a5ab8e4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:26.464485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7b0e2b50-2943-4203-a24f-52479a5ab8e4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:26.478218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b0e2b50-2943-4203-a24f-52479a5ab8e4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:26.478750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b0e2b50-2943-4203-a24f-52479a5ab8e4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:26.479224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b0e2b50-2943-4203-a24f-52479a5ab8e4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:26.480115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b0e2b50-2943-4203-a24f-52479a5ab8e4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:26.480559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b0e2b50-2943-4203-a24f-52479a5ab8e4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:26.480984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b0e2b50-2943-4203-a24f-52479a5ab8e4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:26.674019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-99167249", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:26.717891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7b0e2b50-2943-4203-a24f-52479a5ab8e4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:26.731397 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7b0e2b50-2943-4203-a24f-52479a5ab8e4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.272671 Aug 23 17:51:26.732612 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 51/97] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:26 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:51:26.766513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:51:27.273493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5940a41f-928c-4365-9376-716332c87733 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:27.274112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5940a41f-928c-4365-9376-716332c87733 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:27.284384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5940a41f-928c-4365-9376-716332c87733 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:27.284880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5940a41f-928c-4365-9376-716332c87733 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:27.285380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5940a41f-928c-4365-9376-716332c87733 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:27.286917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5940a41f-928c-4365-9376-716332c87733 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:27.287733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5940a41f-928c-4365-9376-716332c87733 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:27.288439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5940a41f-928c-4365-9376-716332c87733 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:27.303332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:51:27.303950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:51:27.304712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:51:27.305171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:51:27.305603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:51:27.344521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:27.347059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:27.347584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:27.349459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:27.352030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:27.354002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:27.479402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Getting quotas for project 14bb3c54fe3c4157a7808f4c6a62034f. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:51:27.502797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Getting quotas for user b1646f2e71ee4df08628bedd5eb729b2 and project 14bb3c54fe3c4157a7808f4c6a62034f. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:51:27.557248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:51:27.559738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:51:27.576415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5940a41f-928c-4365-9376-716332c87733 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:27.595133 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5940a41f-928c-4365-9376-716332c87733 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.326173 Aug 23 17:51:27.614806 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 52/98] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:27 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:27.691209 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-066070ce-a201-4d4d-80b7-06c2992b79e3 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.290486 Aug 23 17:51:27.694741 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 47/99] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1294 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:51:27.704300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-54da7aa6-9fce-40a5-8e31-671d064b37c5 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:27.705226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-54da7aa6-9fce-40a5-8e31-671d064b37c5 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:27.763718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-342189f9-5d12-4fcb-a9bd-1560e2fae1a4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:27.764518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-342189f9-5d12-4fcb-a9bd-1560e2fae1a4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:27.771331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-342189f9-5d12-4fcb-a9bd-1560e2fae1a4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:27.772118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-342189f9-5d12-4fcb-a9bd-1560e2fae1a4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:27.773094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-342189f9-5d12-4fcb-a9bd-1560e2fae1a4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:27.774024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-342189f9-5d12-4fcb-a9bd-1560e2fae1a4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:27.774720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-342189f9-5d12-4fcb-a9bd-1560e2fae1a4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:27.775365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-342189f9-5d12-4fcb-a9bd-1560e2fae1a4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:27.870146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-54da7aa6-9fce-40a5-8e31-671d064b37c5 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:27.878050 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-54da7aa6-9fce-40a5-8e31-671d064b37c5 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1221 microversion: 2.1 time: 0.177988 Aug 23 17:51:27.878675 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 53/100] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:27 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1221 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:28.258479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-342189f9-5d12-4fcb-a9bd-1560e2fae1a4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:28.279723 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-342189f9-5d12-4fcb-a9bd-1560e2fae1a4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.530041 Aug 23 17:51:28.281354 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 48/101] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:27 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:51:28.621972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-683e1ebf-7115-4b96-978c-d0bb7d8c2104 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:28.624961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-683e1ebf-7115-4b96-978c-d0bb7d8c2104 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:28.644205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-683e1ebf-7115-4b96-978c-d0bb7d8c2104 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:28.649158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-683e1ebf-7115-4b96-978c-d0bb7d8c2104 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:28.649634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-683e1ebf-7115-4b96-978c-d0bb7d8c2104 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:28.654071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-683e1ebf-7115-4b96-978c-d0bb7d8c2104 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:28.656038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-683e1ebf-7115-4b96-978c-d0bb7d8c2104 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:28.658415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-683e1ebf-7115-4b96-978c-d0bb7d8c2104 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:29.034952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0df904d1-6f87-445b-a71c-6d296fe65464 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:29.062309 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0df904d1-6f87-445b-a71c-6d296fe65464 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.535847 Aug 23 17:51:29.064221 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 54/102] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:51:28 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:29.072444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0a180d75-6562-4f61-b07f-02d27db2b3dc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:29.073659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0a180d75-6562-4f61-b07f-02d27db2b3dc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:29.087730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a180d75-6562-4f61-b07f-02d27db2b3dc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:29.088641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a180d75-6562-4f61-b07f-02d27db2b3dc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:29.089682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a180d75-6562-4f61-b07f-02d27db2b3dc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:29.091772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a180d75-6562-4f61-b07f-02d27db2b3dc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:29.094852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a180d75-6562-4f61-b07f-02d27db2b3dc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:29.094852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a180d75-6562-4f61-b07f-02d27db2b3dc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:29.175438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-683e1ebf-7115-4b96-978c-d0bb7d8c2104 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:29.209695 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-683e1ebf-7115-4b96-978c-d0bb7d8c2104 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.589183 Aug 23 17:51:29.211248 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 49/103] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:28 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:29.225918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ad2e59f1-68f1-4cb1-95c0-c3f22ecff38f tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:29.319093 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ad2e59f1-68f1-4cb1-95c0-c3f22ecff38f tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.100860 Aug 23 17:51:29.321714 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 50/104] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 17:51:29 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:29.324844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0a180d75-6562-4f61-b07f-02d27db2b3dc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:29.333687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6ab84c59-8883-49b9-b8a5-d00556f93ad3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:29.334316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6ab84c59-8883-49b9-b8a5-d00556f93ad3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:29.339370 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0a180d75-6562-4f61-b07f-02d27db2b3dc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1273 microversion: 2.1 time: 0.272833 Aug 23 17:51:29.342630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ab84c59-8883-49b9-b8a5-d00556f93ad3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:29.344012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ab84c59-8883-49b9-b8a5-d00556f93ad3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:29.344694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ab84c59-8883-49b9-b8a5-d00556f93ad3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:29.345644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ab84c59-8883-49b9-b8a5-d00556f93ad3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:29.346245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ab84c59-8883-49b9-b8a5-d00556f93ad3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:29.346851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ab84c59-8883-49b9-b8a5-d00556f93ad3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:29.355629 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 55/105] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:29 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1273 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:29.367118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c9af414-6dbf-4b63-b230-9a2da049d33a tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:29.382249 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c9af414-6dbf-4b63-b230-9a2da049d33a tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.023445 Aug 23 17:51:29.396214 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 56/106] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:51:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:29.408990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-df549394-c1d1-4665-b874-bb455dc800a2 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:29.434033 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-df549394-c1d1-4665-b874-bb455dc800a2 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.036582 Aug 23 17:51:29.438293 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 57/107] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:51:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:29.452617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-868785fc-db9f-481b-a917-4f23ea66bd71 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:29.507631 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-868785fc-db9f-481b-a917-4f23ea66bd71 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.059251 Aug 23 17:51:29.508539 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 58/108] 10.222.0.61 () {58 vars in 1165 bytes} [Tue Aug 23 17:51:29 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:29.527587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51b437e9-0620-4e8c-ae9b-3daa29d807d3 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:29.539838 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51b437e9-0620-4e8c-ae9b-3daa29d807d3 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016610 Aug 23 17:51:29.540943 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 59/109] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:51:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:29.556057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-989d2570-1022-40b7-9c3a-02a61d9b5a50 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:29.647464 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-989d2570-1022-40b7-9c3a-02a61d9b5a50 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.096204 Aug 23 17:51:29.649488 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 60/110] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Aug 23 17:51:29 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:29.671981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fd94c29f-bd14-4854-b183-960f479884fb tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:29.698347 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fd94c29f-bd14-4854-b183-960f479884fb tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.038252 Aug 23 17:51:29.699314 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 61/111] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:51:29 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:29.911649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8b45d87-9024-44a2-a181-80e836023a79 tempest-FlavorsV261TestJSON-2020628452 tempest-FlavorsV261TestJSON-2020628452-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-1717853614", "id": 1244098788, "os-flavor-access:is_public": "True"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:29.915041 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:29.915041 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:29.957291 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8b45d87-9024-44a2-a181-80e836023a79 tempest-FlavorsV261TestJSON-2020628452 tempest-FlavorsV261TestJSON-2020628452-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 468 microversion: 2.61 time: 0.256791 Aug 23 17:51:29.961230 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 62/112] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 17:51:29 2022] POST /compute/v2.1/flavors => generated 468 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:29.990464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9aebd9f2-689e-4799-af1c-783f9492e77a tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.009788 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9aebd9f2-689e-4799-af1c-783f9492e77a tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.039898 Aug 23 17:51:30.010772 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 63/113] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:51:29 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:30.235318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6ab84c59-8883-49b9-b8a5-d00556f93ad3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:30.245416 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6ab84c59-8883-49b9-b8a5-d00556f93ad3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.920807 Aug 23 17:51:30.255377 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 51/114] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:29 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:30.255377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a0e3e4b8-e4f6-449d-bae4-7146441b9a24 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.297242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7ffc8f4-b36b-48b5-a267-7ab5325ef6cd tempest-FlavorsV261TestJSON-1942218349 tempest-FlavorsV261TestJSON-1942218349-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.316231 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f7ffc8f4-b36b-48b5-a267-7ab5325ef6cd tempest-FlavorsV261TestJSON-1942218349 tempest-FlavorsV261TestJSON-1942218349-project] 10.222.0.61 "GET /compute/v2.1/flavors/1244098788" status: 200 len: 468 microversion: 2.61 time: 0.304255 Aug 23 17:51:30.319134 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 64/115] 10.222.0.61 () {60 vars in 1199 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors/1244098788 => generated 468 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:30.321054 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a0e3e4b8-e4f6-449d-bae4-7146441b9a24 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.071195 Aug 23 17:51:30.321678 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 52/116] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:30.334112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8395bf9-1800-46ed-95e7-1eb4bb429f3c tempest-FlavorsV261TestJSON-2020628452 tempest-FlavorsV261TestJSON-2020628452-project-admin] Action: 'update', calling method: .version_select at 0x7f27ef7e2d30>, body: {"flavor": {"description": "new"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:30.344870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-216c113c-9c73-481e-acb2-dbe15d6d2bda tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.345595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-216c113c-9c73-481e-acb2-dbe15d6d2bda tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:30.349865 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:30.349865 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:30.361531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-216c113c-9c73-481e-acb2-dbe15d6d2bda tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:30.362058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-216c113c-9c73-481e-acb2-dbe15d6d2bda tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:30.363133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-216c113c-9c73-481e-acb2-dbe15d6d2bda tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:30.364427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-216c113c-9c73-481e-acb2-dbe15d6d2bda tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:30.364882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-216c113c-9c73-481e-acb2-dbe15d6d2bda tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:30.365404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-216c113c-9c73-481e-acb2-dbe15d6d2bda tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:30.381451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=5,nova_api:DELETE=4,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:30.391217 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c8395bf9-1800-46ed-95e7-1eb4bb429f3c tempest-FlavorsV261TestJSON-2020628452 tempest-FlavorsV261TestJSON-2020628452-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/1244098788" status: 200 len: 469 microversion: 2.61 time: 0.062884 Aug 23 17:51:30.392464 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 53/117] 10.222.0.61 () {62 vars in 1219 bytes} [Tue Aug 23 17:51:30 2022] PUT /compute/v2.1/flavors/1244098788 => generated 469 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:30.399917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7bcd371d-ef97-4a7a-a2c3-976f91126752 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.412505 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7bcd371d-ef97-4a7a-a2c3-976f91126752 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018446 Aug 23 17:51:30.413866 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 54/118] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:30.419939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e7b0e01-ebe0-4f95-803f-316ef6bab3db tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.420928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e7b0e01-ebe0-4f95-803f-316ef6bab3db tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:30.430203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e7b0e01-ebe0-4f95-803f-316ef6bab3db tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:30.430910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e7b0e01-ebe0-4f95-803f-316ef6bab3db tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:30.431589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e7b0e01-ebe0-4f95-803f-316ef6bab3db tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:30.432499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e7b0e01-ebe0-4f95-803f-316ef6bab3db tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:30.433103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e7b0e01-ebe0-4f95-803f-316ef6bab3db tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:30.433679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e7b0e01-ebe0-4f95-803f-316ef6bab3db tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:30.516419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e7b0e01-ebe0-4f95-803f-316ef6bab3db tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:30.527855 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e7b0e01-ebe0-4f95-803f-316ef6bab3db tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1279 microversion: 2.1 time: 0.112620 Aug 23 17:51:30.529114 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 55/119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1279 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:30.534664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ccd46a7d-4407-40d8-9ed7-92ed9d4950f8 tempest-FlavorsV261TestJSON-1942218349 tempest-FlavorsV261TestJSON-1942218349-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.567631 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ccd46a7d-4407-40d8-9ed7-92ed9d4950f8 tempest-FlavorsV261TestJSON-1942218349 tempest-FlavorsV261TestJSON-1942218349-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6250 microversion: 2.61 time: 0.037038 Aug 23 17:51:30.568555 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 56/120] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors/detail => generated 6250 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:51:30.580750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e01ca046-9af3-43fe-96de-59f4bbc53bcc tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.611516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-216c113c-9c73-481e-acb2-dbe15d6d2bda tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:30.622159 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-216c113c-9c73-481e-acb2-dbe15d6d2bda tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.301789 Aug 23 17:51:30.625698 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 65/121] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:30.637834 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e01ca046-9af3-43fe-96de-59f4bbc53bcc tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1910 microversion: 2.1 time: 0.068091 Aug 23 17:51:30.638616 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 57/122] 10.222.0.61 () {58 vars in 1144 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1910 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:30.639554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1b790e12-41d6-481a-a2b6-10c45503cee7 tempest-FlavorsV261TestJSON-1942218349 tempest-FlavorsV261TestJSON-1942218349-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.655491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d0445df-4aa2-40d7-9393-4ebae4a5ac4c tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.671562 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d0445df-4aa2-40d7-9393-4ebae4a5ac4c tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.020724 Aug 23 17:51:30.672979 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 58/123] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:30.685618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a07abb54-c661-46bd-9f39-74c1842ac984 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.688836 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1b790e12-41d6-481a-a2b6-10c45503cee7 tempest-FlavorsV261TestJSON-1942218349 tempest-FlavorsV261TestJSON-1942218349-project] 10.222.0.61 "GET /compute/v2.1/flavors" status: 200 len: 3157 microversion: 2.61 time: 0.059900 Aug 23 17:51:30.693120 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 66/124] 10.222.0.61 () {60 vars in 1166 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors => generated 3157 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:51:30.709315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae009277-bd6d-492c-a655-370588479c70 tempest-FlavorsV261TestJSON-2020628452 tempest-FlavorsV261TestJSON-2020628452-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.711666 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:30.711666 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:30.745675 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a07abb54-c661-46bd-9f39-74c1842ac984 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.062738 Aug 23 17:51:30.747079 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 59/125] 10.222.0.61 () {58 vars in 1148 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:30.750815 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae009277-bd6d-492c-a655-370588479c70 tempest-FlavorsV261TestJSON-2020628452 tempest-FlavorsV261TestJSON-2020628452-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1244098788" status: 202 len: 0 microversion: 2.61 time: 0.045497 Aug 23 17:51:30.751923 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 67/126] 10.222.0.61 () {60 vars in 1202 bytes} [Tue Aug 23 17:51:30 2022] DELETE /compute/v2.1/flavors/1244098788 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:51:30.762523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0ea5e237-f61e-42b6-aea6-6655391efc15 tempest-FlavorsV261TestJSON-2020628452 tempest-FlavorsV261TestJSON-2020628452-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.763609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-062ef9c0-a63a-4b21-9d2a-6cd0a7752436 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.798776 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-062ef9c0-a63a-4b21-9d2a-6cd0a7752436 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.039392 Aug 23 17:51:30.802943 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 68/127] 10.222.0.61 () {58 vars in 1140 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:30.816401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-566ed131-743b-48bf-a453-62484f9fbde5 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.816885 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0ea5e237-f61e-42b6-aea6-6655391efc15 tempest-FlavorsV261TestJSON-2020628452 tempest-FlavorsV261TestJSON-2020628452-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.060369 Aug 23 17:51:30.823138 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 60/128] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:51:30.842804 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-566ed131-743b-48bf-a453-62484f9fbde5 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.026010 Aug 23 17:51:30.855325 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 69/129] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:30.860544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-12617acd-093f-48d8-bae6-c38fba7a0820 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.925553 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-12617acd-093f-48d8-bae6-c38fba7a0820 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.068853 Aug 23 17:51:30.926439 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 61/130] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:30.949289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e89f0da4-fdb6-4661-bc66-2edf0d6c8982 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:30.992920 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e89f0da4-fdb6-4661-bc66-2edf0d6c8982 tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.051835 Aug 23 17:51:30.995430 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 62/131] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:31.012875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a1ba1fd-2a6f-4aca-aece-e1be5383f57a tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:31.033281 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a1ba1fd-2a6f-4aca-aece-e1be5383f57a tempest-FlavorsV2TestJSON-1804660445 tempest-FlavorsV2TestJSON-1804660445-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.025319 Aug 23 17:51:31.034577 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 63/132] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:51:31 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:31.196008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Calling method '.version_select at 0x7f27ed4bca60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:31.200143 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:31.200143 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:31.203758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.205264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.206065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.282184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.282701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.285352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.289009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81ce7a87-b250-4605-b0d7-05860bcf514b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:31.289622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-81ce7a87-b250-4605-b0d7-05860bcf514b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:31.310841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81ce7a87-b250-4605-b0d7-05860bcf514b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.318420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81ce7a87-b250-4605-b0d7-05860bcf514b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.319039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81ce7a87-b250-4605-b0d7-05860bcf514b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.324052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81ce7a87-b250-4605-b0d7-05860bcf514b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.327194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81ce7a87-b250-4605-b0d7-05860bcf514b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.327656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81ce7a87-b250-4605-b0d7-05860bcf514b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.376427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.378111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.379681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.412736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.413249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.413692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.456523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.457064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.459153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.466829 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-820d0541-ad56-4e02-ab7f-457981b9fddb tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1840 microversion: 2.53 time: 0.594324 Aug 23 17:51:31.471977 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 70/133] 10.222.0.61 () {60 vars in 1243 bytes} [Tue Aug 23 17:51:30 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1840 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:51:31.505817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Calling method '.version_select at 0x7f27ed596ee0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:31.512281 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:31.512281 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:31.516332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.517880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.518952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.552449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.564114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.564114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.616623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.617764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.618832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.647269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.653507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.654104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.707242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.708421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.708944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.730642 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7900a1c-4330-4222-8866-13e17bc41645 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 530 microversion: 2.53 time: 0.245466 Aug 23 17:51:31.731237 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 71/134] 10.222.0.61 () {60 vars in 1222 bytes} [Tue Aug 23 17:51:31 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 530 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:31.739264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d115c32c-47d8-4391-bfee-f4c62f83620e tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:31.739893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d115c32c-47d8-4391-bfee-f4c62f83620e tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:31.745627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81ce7a87-b250-4605-b0d7-05860bcf514b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:31.747250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d115c32c-47d8-4391-bfee-f4c62f83620e tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.748076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d115c32c-47d8-4391-bfee-f4c62f83620e tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.748674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d115c32c-47d8-4391-bfee-f4c62f83620e tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.750265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d115c32c-47d8-4391-bfee-f4c62f83620e tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.750932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d115c32c-47d8-4391-bfee-f4c62f83620e tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.751513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d115c32c-47d8-4391-bfee-f4c62f83620e tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.759264 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81ce7a87-b250-4605-b0d7-05860bcf514b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.489545 Aug 23 17:51:31.773846 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 64/135] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:31 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:31.779513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a2a6e87f-cf2c-48a5-80b7-40362a43706a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:31.781143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a2a6e87f-cf2c-48a5-80b7-40362a43706a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:31.794108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2a6e87f-cf2c-48a5-80b7-40362a43706a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.794743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2a6e87f-cf2c-48a5-80b7-40362a43706a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.796871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2a6e87f-cf2c-48a5-80b7-40362a43706a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.797672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2a6e87f-cf2c-48a5-80b7-40362a43706a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:31.799646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2a6e87f-cf2c-48a5-80b7-40362a43706a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:31.800161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2a6e87f-cf2c-48a5-80b7-40362a43706a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:31.968790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d115c32c-47d8-4391-bfee-f4c62f83620e tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:31.979925 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d115c32c-47d8-4391-bfee-f4c62f83620e tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1321 microversion: 2.1 time: 0.245310 Aug 23 17:51:31.985826 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 72/136] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:31 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:31.997494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-490fda8c-bf9d-483f-9e7d-8ad3ea1cd570 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Calling method '.version_select at 0x7f27ed503820>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:32.000405 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:32.000405 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:32.006082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-490fda8c-bf9d-483f-9e7d-8ad3ea1cd570 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:32.006767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-490fda8c-bf9d-483f-9e7d-8ad3ea1cd570 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:32.007214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-490fda8c-bf9d-483f-9e7d-8ad3ea1cd570 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:32.039025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-490fda8c-bf9d-483f-9e7d-8ad3ea1cd570 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:32.039535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-490fda8c-bf9d-483f-9e7d-8ad3ea1cd570 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:32.039986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-490fda8c-bf9d-483f-9e7d-8ad3ea1cd570 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:32.047021 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-490fda8c-bf9d-483f-9e7d-8ad3ea1cd570 tempest-HypervisorAdminV253TestBase-1535277048 tempest-HypervisorAdminV253TestBase-1535277048-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/a16d32c1-6548-487f-8b0b-47d29a5634a5" status: 200 len: 794 microversion: 2.53 time: 0.059294 Aug 23 17:51:32.058337 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 73/137] 10.222.0.61 () {60 vars in 1298 bytes} [Tue Aug 23 17:51:31 2022] GET /compute/v2.1/os-hypervisors/a16d32c1-6548-487f-8b0b-47d29a5634a5 => generated 794 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:32.119894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a2a6e87f-cf2c-48a5-80b7-40362a43706a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:32.128592 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a2a6e87f-cf2c-48a5-80b7-40362a43706a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.366979 Aug 23 17:51:32.136940 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 65/138] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:31 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:32.640970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-07c0efda-64d7-4e3a-b841-1d299e9e5016 req-6222f326-1329-4c32-a961-11808ecc8ffa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f249c89c-eb04-4198-a3a4-ee5ff7c2ec03", "name": "network-vif-plugged", "status": "completed", "tag": "bb3cba66-cdf3-4ded-8ab8-a9e188ca9076"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:32.662491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-07c0efda-64d7-4e3a-b841-1d299e9e5016 req-6222f326-1329-4c32-a961-11808ecc8ffa service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:32.663575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-07c0efda-64d7-4e3a-b841-1d299e9e5016 req-6222f326-1329-4c32-a961-11808ecc8ffa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:32.667216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-07c0efda-64d7-4e3a-b841-1d299e9e5016 req-6222f326-1329-4c32-a961-11808ecc8ffa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:32.695789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1b2b2261-178b-414e-86af-43c9a8209c2e req-48d75dbf-b9d0-4055-9fbf-82f97c254443 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9", "tag": "7ce3b50f-9f8f-4b64-8d95-b2b9f2973584"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:32.720640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1b2b2261-178b-414e-86af-43c9a8209c2e req-48d75dbf-b9d0-4055-9fbf-82f97c254443 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:32.721242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1b2b2261-178b-414e-86af-43c9a8209c2e req-48d75dbf-b9d0-4055-9fbf-82f97c254443 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:32.721953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1b2b2261-178b-414e-86af-43c9a8209c2e req-48d75dbf-b9d0-4055-9fbf-82f97c254443 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:32.739304 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1b2b2261-178b-414e-86af-43c9a8209c2e req-48d75dbf-b9d0-4055-9fbf-82f97c254443 service nova] Creating event network-changed:7ce3b50f-9f8f-4b64-8d95-b2b9f2973584 for instance f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 on n-h2-850468-16 Aug 23 17:51:32.744105 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-07c0efda-64d7-4e3a-b841-1d299e9e5016 req-6222f326-1329-4c32-a961-11808ecc8ffa service nova] Creating event network-vif-plugged:bb3cba66-cdf3-4ded-8ab8-a9e188ca9076 for instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 on n-h2-850468-16 Aug 23 17:51:32.760936 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-07c0efda-64d7-4e3a-b841-1d299e9e5016 req-6222f326-1329-4c32-a961-11808ecc8ffa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.397792 Aug 23 17:51:32.761621 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 74/139] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:32.763346 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1b2b2261-178b-414e-86af-43c9a8209c2e req-48d75dbf-b9d0-4055-9fbf-82f97c254443 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070527 Aug 23 17:51:32.764533 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 66/140] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:51:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:32.794092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d6839084-1713-4fd5-b334-859c196d406e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:32.796200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d6839084-1713-4fd5-b334-859c196d406e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:32.827786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6839084-1713-4fd5-b334-859c196d406e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:32.829799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6839084-1713-4fd5-b334-859c196d406e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:32.831136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6839084-1713-4fd5-b334-859c196d406e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:32.837188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6839084-1713-4fd5-b334-859c196d406e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:32.837953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6839084-1713-4fd5-b334-859c196d406e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:32.838567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6839084-1713-4fd5-b334-859c196d406e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:33.017818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-06098b48-3c95-45d1-a7eb-fb15abbdfa6d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:33.018624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-06098b48-3c95-45d1-a7eb-fb15abbdfa6d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:33.040464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06098b48-3c95-45d1-a7eb-fb15abbdfa6d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:33.040965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06098b48-3c95-45d1-a7eb-fb15abbdfa6d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:33.051363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06098b48-3c95-45d1-a7eb-fb15abbdfa6d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:33.052177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06098b48-3c95-45d1-a7eb-fb15abbdfa6d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:33.052661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06098b48-3c95-45d1-a7eb-fb15abbdfa6d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:33.054162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06098b48-3c95-45d1-a7eb-fb15abbdfa6d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:33.508966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d6839084-1713-4fd5-b334-859c196d406e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:33.524264 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d6839084-1713-4fd5-b334-859c196d406e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.746481 Aug 23 17:51:33.539108 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 67/141] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:32 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:33.554476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-33064b79-3cf3-458d-9aa5-a08d385eb767 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:33.555370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-33064b79-3cf3-458d-9aa5-a08d385eb767 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:33.579312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33064b79-3cf3-458d-9aa5-a08d385eb767 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:33.580512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33064b79-3cf3-458d-9aa5-a08d385eb767 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:33.581179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33064b79-3cf3-458d-9aa5-a08d385eb767 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:33.582693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-06098b48-3c95-45d1-a7eb-fb15abbdfa6d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:33.583639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33064b79-3cf3-458d-9aa5-a08d385eb767 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:33.584417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33064b79-3cf3-458d-9aa5-a08d385eb767 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:33.585253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33064b79-3cf3-458d-9aa5-a08d385eb767 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:33.596371 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-06098b48-3c95-45d1-a7eb-fb15abbdfa6d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1321 microversion: 2.1 time: 0.590496 Aug 23 17:51:33.596983 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 75/142] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:32 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1321 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:33.961728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-33064b79-3cf3-458d-9aa5-a08d385eb767 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:33.972133 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-33064b79-3cf3-458d-9aa5-a08d385eb767 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.431446 Aug 23 17:51:33.974163 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 68/143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:33 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:34.560910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b99bc8a2-56d9-4d3b-880e-36a793f2cf6b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:34.561539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b99bc8a2-56d9-4d3b-880e-36a793f2cf6b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:34.582833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b99bc8a2-56d9-4d3b-880e-36a793f2cf6b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:34.583346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b99bc8a2-56d9-4d3b-880e-36a793f2cf6b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:34.587106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b99bc8a2-56d9-4d3b-880e-36a793f2cf6b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:34.588312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b99bc8a2-56d9-4d3b-880e-36a793f2cf6b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:34.588956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b99bc8a2-56d9-4d3b-880e-36a793f2cf6b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:34.589601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b99bc8a2-56d9-4d3b-880e-36a793f2cf6b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:34.628683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b7136ae-10f6-47f0-86e7-7e899529cdae tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:34.630467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4b7136ae-10f6-47f0-86e7-7e899529cdae tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:34.641357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b7136ae-10f6-47f0-86e7-7e899529cdae tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:34.642059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b7136ae-10f6-47f0-86e7-7e899529cdae tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:34.647221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b7136ae-10f6-47f0-86e7-7e899529cdae tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:34.650086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b7136ae-10f6-47f0-86e7-7e899529cdae tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:34.650812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b7136ae-10f6-47f0-86e7-7e899529cdae tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:34.652085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b7136ae-10f6-47f0-86e7-7e899529cdae tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:35.040116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4b7136ae-10f6-47f0-86e7-7e899529cdae tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:35.059442 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b7136ae-10f6-47f0-86e7-7e899529cdae tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1321 microversion: 2.1 time: 0.444687 Aug 23 17:51:35.064373 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 69/144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:34 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1321 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:35.081075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8e1fa8b0-68f6-488c-ba9e-73096784bf91 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:35.081917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8e1fa8b0-68f6-488c-ba9e-73096784bf91 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:35.096343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e1fa8b0-68f6-488c-ba9e-73096784bf91 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:35.097066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e1fa8b0-68f6-488c-ba9e-73096784bf91 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:35.109392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e1fa8b0-68f6-488c-ba9e-73096784bf91 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:35.115780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e1fa8b0-68f6-488c-ba9e-73096784bf91 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:35.120019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e1fa8b0-68f6-488c-ba9e-73096784bf91 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:35.125695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e1fa8b0-68f6-488c-ba9e-73096784bf91 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:35.289815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b99bc8a2-56d9-4d3b-880e-36a793f2cf6b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:35.314339 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b99bc8a2-56d9-4d3b-880e-36a793f2cf6b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.761414 Aug 23 17:51:35.317523 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 76/145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:34 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:35.433118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8e1fa8b0-68f6-488c-ba9e-73096784bf91 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:35.443505 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8e1fa8b0-68f6-488c-ba9e-73096784bf91 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.377763 Aug 23 17:51:35.456823 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 70/146] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:35 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:36.088081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6cf93dae-7920-425a-a56c-8682483be141 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:36.089404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6cf93dae-7920-425a-a56c-8682483be141 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:36.107008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6cf93dae-7920-425a-a56c-8682483be141 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:36.107941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6cf93dae-7920-425a-a56c-8682483be141 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:36.110114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6cf93dae-7920-425a-a56c-8682483be141 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:36.111190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6cf93dae-7920-425a-a56c-8682483be141 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:36.116362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6cf93dae-7920-425a-a56c-8682483be141 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:36.119019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6cf93dae-7920-425a-a56c-8682483be141 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:36.357603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a4340b5c-1a2b-4da3-9c5f-f30477fec103 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:36.359544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a4340b5c-1a2b-4da3-9c5f-f30477fec103 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:36.389156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4340b5c-1a2b-4da3-9c5f-f30477fec103 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:36.391563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4340b5c-1a2b-4da3-9c5f-f30477fec103 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:36.394380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4340b5c-1a2b-4da3-9c5f-f30477fec103 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:36.398316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4340b5c-1a2b-4da3-9c5f-f30477fec103 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:36.399129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4340b5c-1a2b-4da3-9c5f-f30477fec103 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:36.404564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4340b5c-1a2b-4da3-9c5f-f30477fec103 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:36.663231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6cf93dae-7920-425a-a56c-8682483be141 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:36.689095 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6cf93dae-7920-425a-a56c-8682483be141 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1321 microversion: 2.1 time: 0.606269 Aug 23 17:51:36.704713 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 77/147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:36 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1321 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:36.716310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-856818a9-3e21-413a-a180-044eb6c19523 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:36.718336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-856818a9-3e21-413a-a180-044eb6c19523 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:36.739593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-856818a9-3e21-413a-a180-044eb6c19523 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:36.740298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-856818a9-3e21-413a-a180-044eb6c19523 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:36.740904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-856818a9-3e21-413a-a180-044eb6c19523 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:36.741817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-856818a9-3e21-413a-a180-044eb6c19523 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:36.743712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-856818a9-3e21-413a-a180-044eb6c19523 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:36.744315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-856818a9-3e21-413a-a180-044eb6c19523 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:36.866768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a4340b5c-1a2b-4da3-9c5f-f30477fec103 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:36.888617 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a4340b5c-1a2b-4da3-9c5f-f30477fec103 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.549308 Aug 23 17:51:36.891650 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 71/148] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:36 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:36.996324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-856818a9-3e21-413a-a180-044eb6c19523 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:37.001126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:37.009691 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-856818a9-3e21-413a-a180-044eb6c19523 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.304042 Aug 23 17:51:37.015265 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 78/149] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:36 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:37.405634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=10 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:37.537676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:37.717689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-076b4726-bd9b-4069-a475-c3f9878336d1 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:37.718220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-076b4726-bd9b-4069-a475-c3f9878336d1 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:37.731175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-076b4726-bd9b-4069-a475-c3f9878336d1 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:37.731673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-076b4726-bd9b-4069-a475-c3f9878336d1 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:37.732104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-076b4726-bd9b-4069-a475-c3f9878336d1 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:37.734959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-076b4726-bd9b-4069-a475-c3f9878336d1 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:37.736779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-076b4726-bd9b-4069-a475-c3f9878336d1 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:37.739516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-076b4726-bd9b-4069-a475-c3f9878336d1 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:37.785196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8e517650-d416-44fd-96d3-ad8dc2d0610c tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Calling method '.version_select at 0x7f27ed5ad670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:37.787873 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:37.787873 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:37.788936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e517650-d416-44fd-96d3-ad8dc2d0610c tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:37.789682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e517650-d416-44fd-96d3-ad8dc2d0610c tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:37.790188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e517650-d416-44fd-96d3-ad8dc2d0610c tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:37.823295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e517650-d416-44fd-96d3-ad8dc2d0610c tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:37.824234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e517650-d416-44fd-96d3-ad8dc2d0610c tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:37.824680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e517650-d416-44fd-96d3-ad8dc2d0610c tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:37.837039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e517650-d416-44fd-96d3-ad8dc2d0610c tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:37.838038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e517650-d416-44fd-96d3-ad8dc2d0610c tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:37.838675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e517650-d416-44fd-96d3-ad8dc2d0610c tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:37.845559 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8e517650-d416-44fd-96d3-ad8dc2d0610c tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.463267 Aug 23 17:51:37.846692 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 72/150] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:37 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:37.858789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd18429c-65ca-40b9-b9b5-d11812e255b6 tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Calling method '.version_select at 0x7f27ed696940>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:37.859945 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:37.859945 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:37.861366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd18429c-65ca-40b9-b9b5-d11812e255b6 tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:37.862284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd18429c-65ca-40b9-b9b5-d11812e255b6 tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:37.863069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd18429c-65ca-40b9-b9b5-d11812e255b6 tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:37.877355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:37.893218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd18429c-65ca-40b9-b9b5-d11812e255b6 tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:37.894401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd18429c-65ca-40b9-b9b5-d11812e255b6 tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:37.896328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd18429c-65ca-40b9-b9b5-d11812e255b6 tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:37.944401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd18429c-65ca-40b9-b9b5-d11812e255b6 tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:37.945042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd18429c-65ca-40b9-b9b5-d11812e255b6 tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:37.945681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd18429c-65ca-40b9-b9b5-d11812e255b6 tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:37.955215 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd18429c-65ca-40b9-b9b5-d11812e255b6 tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/n-h1-850468-16/servers" status: 200 len: 197 microversion: 2.1 time: 0.100890 Aug 23 17:51:37.963072 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 73/151] 10.222.0.61 () {58 vars in 1215 bytes} [Tue Aug 23 17:51:37 2022] GET /compute/v2.1/os-hypervisors/n-h1-850468-16/servers => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:37.970174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6144f988-5030-4a7f-abdd-71992a4ee5ae tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:37.970826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6144f988-5030-4a7f-abdd-71992a4ee5ae tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:37.986614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6144f988-5030-4a7f-abdd-71992a4ee5ae tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:37.987126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6144f988-5030-4a7f-abdd-71992a4ee5ae tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:37.987574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6144f988-5030-4a7f-abdd-71992a4ee5ae tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:37.988374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6144f988-5030-4a7f-abdd-71992a4ee5ae tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:37.991740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6144f988-5030-4a7f-abdd-71992a4ee5ae tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:37.992212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6144f988-5030-4a7f-abdd-71992a4ee5ae tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:38.364680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6144f988-5030-4a7f-abdd-71992a4ee5ae tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:38.378940 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6144f988-5030-4a7f-abdd-71992a4ee5ae tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1320 microversion: 2.1 time: 0.414311 Aug 23 17:51:38.379555 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 74/152] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:37 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1320 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:38.397903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7058b586-ddd6-457f-83df-3339eb4ff16e tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Calling method '.version_select at 0x7f27ed696ee0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:38.401866 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:38.401866 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:38.406244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7058b586-ddd6-457f-83df-3339eb4ff16e tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:38.407613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7058b586-ddd6-457f-83df-3339eb4ff16e tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:38.408302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7058b586-ddd6-457f-83df-3339eb4ff16e tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:38.434095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7058b586-ddd6-457f-83df-3339eb4ff16e tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:38.434824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7058b586-ddd6-457f-83df-3339eb4ff16e tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:38.435418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7058b586-ddd6-457f-83df-3339eb4ff16e tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:38.452270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7058b586-ddd6-457f-83df-3339eb4ff16e tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:38.453002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7058b586-ddd6-457f-83df-3339eb4ff16e tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:38.455047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7058b586-ddd6-457f-83df-3339eb4ff16e tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:38.460378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:38.465628 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7058b586-ddd6-457f-83df-3339eb4ff16e tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.077807 Aug 23 17:51:38.466989 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 75/153] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:38 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:38.474039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f68d9526-a8c9-4673-a309-0ce3d736470a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:38.475977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f68d9526-a8c9-4673-a309-0ce3d736470a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:38.485985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f68d9526-a8c9-4673-a309-0ce3d736470a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:38.486841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f68d9526-a8c9-4673-a309-0ce3d736470a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:38.487430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f68d9526-a8c9-4673-a309-0ce3d736470a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:38.490398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f68d9526-a8c9-4673-a309-0ce3d736470a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:38.491638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f68d9526-a8c9-4673-a309-0ce3d736470a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:38.492933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f68d9526-a8c9-4673-a309-0ce3d736470a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:38.620310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-076b4726-bd9b-4069-a475-c3f9878336d1 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:38.632708 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-076b4726-bd9b-4069-a475-c3f9878336d1 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1321 microversion: 2.1 time: 0.918005 Aug 23 17:51:38.635043 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 79/154] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:37 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1321 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:51:38.837172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cb2cd86b-c3d1-4348-912a-281a3f2bb15b tempest-InstanceUsageAuditLogTestJSON-903704808 tempest-InstanceUsageAuditLogTestJSON-903704808-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:38.838041 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:38.838041 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:38.867585 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cb2cd86b-c3d1-4348-912a-281a3f2bb15b tempest-InstanceUsageAuditLogTestJSON-903704808 tempest-InstanceUsageAuditLogTestJSON-903704808-project-admin] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-23 17:51:38" status: 200 len: 318 microversion: 2.1 time: 0.230490 Aug 23 17:51:38.868138 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 80/155] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Aug 23 17:51:38 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-23%2017%3A51%3A38 => generated 318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:38.883164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1557ec32-1f1f-4c43-a616-9e7f90146b7f tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Calling method '.version_select at 0x7f27ed470d30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:38.884208 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:38.884208 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:38.885468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1557ec32-1f1f-4c43-a616-9e7f90146b7f tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:38.886135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1557ec32-1f1f-4c43-a616-9e7f90146b7f tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:38.887218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1557ec32-1f1f-4c43-a616-9e7f90146b7f tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:38.906493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1557ec32-1f1f-4c43-a616-9e7f90146b7f tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:38.907224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1557ec32-1f1f-4c43-a616-9e7f90146b7f tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:38.908209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1557ec32-1f1f-4c43-a616-9e7f90146b7f tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:38.915745 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1557ec32-1f1f-4c43-a616-9e7f90146b7f tempest-HypervisorAdminUnderV252Test-824823180 tempest-HypervisorAdminUnderV252Test-824823180-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/n-h1-850468-16/search" status: 200 len: 105 microversion: 2.1 time: 0.037467 Aug 23 17:51:38.916601 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 81/156] 10.222.0.61 () {58 vars in 1212 bytes} [Tue Aug 23 17:51:38 2022] GET /compute/v2.1/os-hypervisors/n-h1-850468-16/search => generated 105 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:38.921577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4f775aad-0956-4dd2-b21b-935bf04f543b req-6478f53a-19f8-442a-adc5-00e080c30dfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc9c68a-9939-4cc7-ac2a-cf726ba91792", "name": "network-vif-plugged", "status": "completed", "tag": "ae4fccf8-4faf-4179-aa86-d5825bb5f3e9"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:38.962354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4f775aad-0956-4dd2-b21b-935bf04f543b req-6478f53a-19f8-442a-adc5-00e080c30dfd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:38.967190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4f775aad-0956-4dd2-b21b-935bf04f543b req-6478f53a-19f8-442a-adc5-00e080c30dfd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:38.967798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4f775aad-0956-4dd2-b21b-935bf04f543b req-6478f53a-19f8-442a-adc5-00e080c30dfd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:38.998163 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4f775aad-0956-4dd2-b21b-935bf04f543b req-6478f53a-19f8-442a-adc5-00e080c30dfd service nova] Creating event network-vif-plugged:ae4fccf8-4faf-4179-aa86-d5825bb5f3e9 for instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 on n-h1-850468-16 Aug 23 17:51:39.001518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f68d9526-a8c9-4673-a309-0ce3d736470a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:39.009457 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4f775aad-0956-4dd2-b21b-935bf04f543b req-6478f53a-19f8-442a-adc5-00e080c30dfd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091188 Aug 23 17:51:39.014732 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 82/157] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:51:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:39.031192 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f68d9526-a8c9-4673-a309-0ce3d736470a tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.543493 Aug 23 17:51:39.031914 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 76/158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:38 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:39.044237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1eb7ebd9-5657-4828-9adb-e747677125da tempest-InstanceUsageAuditLogTestJSON-903704808 tempest-InstanceUsageAuditLogTestJSON-903704808-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:39.045155 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:39.045155 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:39.097446 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1eb7ebd9-5657-4828-9adb-e747677125da tempest-InstanceUsageAuditLogTestJSON-903704808 tempest-InstanceUsageAuditLogTestJSON-903704808-project-admin] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.062389 Aug 23 17:51:39.098762 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 83/159] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Aug 23 17:51:39 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:39.401702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6dce5747-0822-4f8f-88d4-068ab8b15bd2 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:39.402752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6dce5747-0822-4f8f-88d4-068ab8b15bd2 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:39.416435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dce5747-0822-4f8f-88d4-068ab8b15bd2 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:39.417051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dce5747-0822-4f8f-88d4-068ab8b15bd2 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:39.419204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dce5747-0822-4f8f-88d4-068ab8b15bd2 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:39.424395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dce5747-0822-4f8f-88d4-068ab8b15bd2 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:39.430075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dce5747-0822-4f8f-88d4-068ab8b15bd2 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:39.434740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dce5747-0822-4f8f-88d4-068ab8b15bd2 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:39.659135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5c5c6b1-041e-417f-89a4-1289897a7578 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:39.659928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e5c5c6b1-041e-417f-89a4-1289897a7578 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:39.668992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c5c6b1-041e-417f-89a4-1289897a7578 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:39.669489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c5c6b1-041e-417f-89a4-1289897a7578 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:39.669930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c5c6b1-041e-417f-89a4-1289897a7578 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:39.670672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c5c6b1-041e-417f-89a4-1289897a7578 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:39.671129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c5c6b1-041e-417f-89a4-1289897a7578 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:39.671558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c5c6b1-041e-417f-89a4-1289897a7578 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:39.956832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6dce5747-0822-4f8f-88d4-068ab8b15bd2 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:39.971401 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6dce5747-0822-4f8f-88d4-068ab8b15bd2 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1470 microversion: 2.1 time: 0.575098 Aug 23 17:51:39.986954 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 77/160] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:39 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1470 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:40.246247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e5c5c6b1-041e-417f-89a4-1289897a7578 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:40.279087 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e5c5c6b1-041e-417f-89a4-1289897a7578 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1321 microversion: 2.1 time: 0.612883 Aug 23 17:51:40.282932 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 84/161] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:39 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1321 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:40.302615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f29c1734-bf11-441b-9a75-b6069d032dfc tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:40.310769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f29c1734-bf11-441b-9a75-b6069d032dfc tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:40.346891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f29c1734-bf11-441b-9a75-b6069d032dfc tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:40.348948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f29c1734-bf11-441b-9a75-b6069d032dfc tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:40.359990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f29c1734-bf11-441b-9a75-b6069d032dfc tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:40.362191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f29c1734-bf11-441b-9a75-b6069d032dfc tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:40.367507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f29c1734-bf11-441b-9a75-b6069d032dfc tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:40.368120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f29c1734-bf11-441b-9a75-b6069d032dfc tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:40.421479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b435e132-daa6-4948-a1d8-de3399601d39 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:40.422057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b435e132-daa6-4948-a1d8-de3399601d39 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:40.429990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b435e132-daa6-4948-a1d8-de3399601d39 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:40.430493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b435e132-daa6-4948-a1d8-de3399601d39 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:40.430967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b435e132-daa6-4948-a1d8-de3399601d39 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:40.432409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b435e132-daa6-4948-a1d8-de3399601d39 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:40.432889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b435e132-daa6-4948-a1d8-de3399601d39 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:40.433329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b435e132-daa6-4948-a1d8-de3399601d39 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:40.550084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b435e132-daa6-4948-a1d8-de3399601d39 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:51:40.745477 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b435e132-daa6-4948-a1d8-de3399601d39 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] 10.222.0.61 "DELETE /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 204 len: 0 microversion: 2.1 time: 0.752064 Aug 23 17:51:40.750102 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 78/162] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:51:39 2022] DELETE /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 0 bytes in 755 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 17:51:40.755678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f29c1734-bf11-441b-9a75-b6069d032dfc tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:40.762770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-36a938af-a32e-4cbb-a21a-9133b1654400 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:40.765240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-36a938af-a32e-4cbb-a21a-9133b1654400 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:40.774668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f29c1734-bf11-441b-9a75-b6069d032dfc tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1339 microversion: 2.1 time: 0.489269 Aug 23 17:51:40.787505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36a938af-a32e-4cbb-a21a-9133b1654400 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:40.789294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36a938af-a32e-4cbb-a21a-9133b1654400 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:40.790224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36a938af-a32e-4cbb-a21a-9133b1654400 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:40.791310 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 85/163] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:40 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1339 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:40.792408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36a938af-a32e-4cbb-a21a-9133b1654400 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:40.793024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36a938af-a32e-4cbb-a21a-9133b1654400 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:40.793675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36a938af-a32e-4cbb-a21a-9133b1654400 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:41.227044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-36a938af-a32e-4cbb-a21a-9133b1654400 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:41.246242 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-36a938af-a32e-4cbb-a21a-9133b1654400 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1476 microversion: 2.1 time: 0.486745 Aug 23 17:51:41.265206 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 79/164] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:40 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1476 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:41.309939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4585e3f3-79e7-462d-a7ba-584deae807e0 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:41.311426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4585e3f3-79e7-462d-a7ba-584deae807e0 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:41.318601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4585e3f3-79e7-462d-a7ba-584deae807e0 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:41.319440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4585e3f3-79e7-462d-a7ba-584deae807e0 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:41.320109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4585e3f3-79e7-462d-a7ba-584deae807e0 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:41.321082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4585e3f3-79e7-462d-a7ba-584deae807e0 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:41.321771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4585e3f3-79e7-462d-a7ba-584deae807e0 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:41.322414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4585e3f3-79e7-462d-a7ba-584deae807e0 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:41.814350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-62c19009-4281-4325-a983-667d5dd15380 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:41.815868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-62c19009-4281-4325-a983-667d5dd15380 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:41.829920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62c19009-4281-4325-a983-667d5dd15380 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:41.830807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62c19009-4281-4325-a983-667d5dd15380 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:41.831017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4585e3f3-79e7-462d-a7ba-584deae807e0 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:41.831737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62c19009-4281-4325-a983-667d5dd15380 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:41.834167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62c19009-4281-4325-a983-667d5dd15380 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:41.834919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62c19009-4281-4325-a983-667d5dd15380 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:41.835561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62c19009-4281-4325-a983-667d5dd15380 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:41.853944 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4585e3f3-79e7-462d-a7ba-584deae807e0 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1321 microversion: 2.1 time: 0.552144 Aug 23 17:51:41.854825 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 86/165] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:41 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1321 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:42.287654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b3b6f874-d98b-4c4f-adf0-8c4fe60a7dd3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:42.288266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b3b6f874-d98b-4c4f-adf0-8c4fe60a7dd3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:42.313616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3b6f874-d98b-4c4f-adf0-8c4fe60a7dd3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:42.314194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3b6f874-d98b-4c4f-adf0-8c4fe60a7dd3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:42.316496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3b6f874-d98b-4c4f-adf0-8c4fe60a7dd3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:42.318454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3b6f874-d98b-4c4f-adf0-8c4fe60a7dd3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:42.319107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3b6f874-d98b-4c4f-adf0-8c4fe60a7dd3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:42.323039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3b6f874-d98b-4c4f-adf0-8c4fe60a7dd3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:42.351899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-62c19009-4281-4325-a983-667d5dd15380 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:42.360289 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-62c19009-4281-4325-a983-667d5dd15380 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1489 microversion: 2.1 time: 0.550744 Aug 23 17:51:42.379547 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 80/166] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:41 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1489 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:42.385602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b0adc883-8935-4392-abeb-064f5e906ce7 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:42.387311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b0adc883-8935-4392-abeb-064f5e906ce7 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:42.395140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0adc883-8935-4392-abeb-064f5e906ce7 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:42.395827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0adc883-8935-4392-abeb-064f5e906ce7 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:42.396445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0adc883-8935-4392-abeb-064f5e906ce7 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:42.397472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0adc883-8935-4392-abeb-064f5e906ce7 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:42.398082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0adc883-8935-4392-abeb-064f5e906ce7 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:42.398822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0adc883-8935-4392-abeb-064f5e906ce7 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:43.109983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b3b6f874-d98b-4c4f-adf0-8c4fe60a7dd3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:43.134652 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b3b6f874-d98b-4c4f-adf0-8c4fe60a7dd3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1476 microversion: 2.1 time: 0.853683 Aug 23 17:51:43.135523 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 87/167] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:42 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1476 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:43.161059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1cd459a5-175a-4739-9423-15f4dcaed508 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:43.169855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1cd459a5-175a-4739-9423-15f4dcaed508 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:43.183954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:43.187114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cd459a5-175a-4739-9423-15f4dcaed508 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:43.188966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cd459a5-175a-4739-9423-15f4dcaed508 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:43.190210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cd459a5-175a-4739-9423-15f4dcaed508 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:43.192791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cd459a5-175a-4739-9423-15f4dcaed508 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:43.194766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cd459a5-175a-4739-9423-15f4dcaed508 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:43.196911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cd459a5-175a-4739-9423-15f4dcaed508 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:43.608147 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b0adc883-8935-4392-abeb-064f5e906ce7 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1642 microversion: 2.1 time: 1.226140 Aug 23 17:51:43.619453 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 81/168] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:42 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1642 bytes in 1239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:43.639620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-39615530-7202-4f94-9d6b-3c8f4e402685 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:43.640392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-39615530-7202-4f94-9d6b-3c8f4e402685 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:43.657732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39615530-7202-4f94-9d6b-3c8f4e402685 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:43.658651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39615530-7202-4f94-9d6b-3c8f4e402685 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:43.659399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39615530-7202-4f94-9d6b-3c8f4e402685 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:43.662342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39615530-7202-4f94-9d6b-3c8f4e402685 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:43.663206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39615530-7202-4f94-9d6b-3c8f4e402685 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:43.663875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39615530-7202-4f94-9d6b-3c8f4e402685 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:43.696282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1cd459a5-175a-4739-9423-15f4dcaed508 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:43.709622 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1cd459a5-175a-4739-9423-15f4dcaed508 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1321 microversion: 2.1 time: 0.559288 Aug 23 17:51:43.715378 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 88/169] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:43 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1321 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:43.738741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-39615530-7202-4f94-9d6b-3c8f4e402685 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:51:44.090892 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-39615530-7202-4f94-9d6b-3c8f4e402685 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 204 len: 0 microversion: 2.1 time: 0.457349 Aug 23 17:51:44.091488 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 82/170] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:51:43 2022] DELETE /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:51:44.104062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49e52b7f-bf24-4a16-aaf5-2f93fdb50b6c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:44.105498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49e52b7f-bf24-4a16-aaf5-2f93fdb50b6c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:44.133155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e52b7f-bf24-4a16-aaf5-2f93fdb50b6c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:44.136437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e52b7f-bf24-4a16-aaf5-2f93fdb50b6c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:44.136914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e52b7f-bf24-4a16-aaf5-2f93fdb50b6c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:44.141364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e52b7f-bf24-4a16-aaf5-2f93fdb50b6c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:44.143525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e52b7f-bf24-4a16-aaf5-2f93fdb50b6c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:44.145462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e52b7f-bf24-4a16-aaf5-2f93fdb50b6c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:44.371330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0ec8fab8-c384-45d6-861f-7ebe4a5666e6 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:44.384596 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0ec8fab8-c384-45d6-861f-7ebe4a5666e6 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.482437 Aug 23 17:51:44.385195 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 89/171] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:51:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:44.400055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f3eb984b-96f0-42a0-9233-afabb71b7ad1 req-0d5467e9-ee5c-41a3-9fe6-ac95445b5f01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f249c89c-eb04-4198-a3a4-ee5ff7c2ec03", "name": "network-vif-deleted", "tag": "bb3cba66-cdf3-4ded-8ab8-a9e188ca9076"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:44.451639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-49e52b7f-bf24-4a16-aaf5-2f93fdb50b6c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:44.452593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f3eb984b-96f0-42a0-9233-afabb71b7ad1 req-0d5467e9-ee5c-41a3-9fe6-ac95445b5f01 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:44.464112 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49e52b7f-bf24-4a16-aaf5-2f93fdb50b6c tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1495 microversion: 2.1 time: 0.367328 Aug 23 17:51:44.467280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f3eb984b-96f0-42a0-9233-afabb71b7ad1 req-0d5467e9-ee5c-41a3-9fe6-ac95445b5f01 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:44.469767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f3eb984b-96f0-42a0-9233-afabb71b7ad1 req-0d5467e9-ee5c-41a3-9fe6-ac95445b5f01 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:44.492860 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 83/172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:44 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1495 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:44.497759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:44.498394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:44.520005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:44.520625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:44.523191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:44.523329 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f3eb984b-96f0-42a0-9233-afabb71b7ad1 req-0d5467e9-ee5c-41a3-9fe6-ac95445b5f01 service nova] Creating event network-vif-deleted:bb3cba66-cdf3-4ded-8ab8-a9e188ca9076 for instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 on n-h2-850468-16 Aug 23 17:51:44.524122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:44.524639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:44.527093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:44.546933 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f3eb984b-96f0-42a0-9233-afabb71b7ad1 req-0d5467e9-ee5c-41a3-9fe6-ac95445b5f01 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155549 Aug 23 17:51:44.555889 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 90/173] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:44.661902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:44.663438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:44.665610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:44.668022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lazy-loading 'fault' on Instance uuid f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:51:44.768654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:44.781085 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1b19672e-b62c-43d6-9ff5-e006f523d02e tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 200 len: 1310 microversion: 2.1 time: 0.283123 Aug 23 17:51:44.781730 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 84/174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:44 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 1310 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:44.792220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-98255b48-730d-46db-86d9-dd9648ed9dfa tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:44.796176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-98255b48-730d-46db-86d9-dd9648ed9dfa tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:44.824820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98255b48-730d-46db-86d9-dd9648ed9dfa tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:44.825388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98255b48-730d-46db-86d9-dd9648ed9dfa tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:44.830580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98255b48-730d-46db-86d9-dd9648ed9dfa tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:44.834302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98255b48-730d-46db-86d9-dd9648ed9dfa tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:44.836595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98255b48-730d-46db-86d9-dd9648ed9dfa tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:44.838910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98255b48-730d-46db-86d9-dd9648ed9dfa tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:45.144142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-98255b48-730d-46db-86d9-dd9648ed9dfa tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:45.157698 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-98255b48-730d-46db-86d9-dd9648ed9dfa tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1321 microversion: 2.1 time: 0.374230 Aug 23 17:51:45.159772 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 85/175] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:44 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1321 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:45.176724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-6518d9e2-4118-4516-893f-3404b7e01e6b req-94a6974b-c122-4d7d-b67d-0232f1c97643 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9", "name": "network-vif-plugged", "status": "completed", "tag": "7ce3b50f-9f8f-4b64-8d95-b2b9f2973584"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:45.199517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6518d9e2-4118-4516-893f-3404b7e01e6b req-94a6974b-c122-4d7d-b67d-0232f1c97643 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:45.200758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6518d9e2-4118-4516-893f-3404b7e01e6b req-94a6974b-c122-4d7d-b67d-0232f1c97643 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:45.203579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6518d9e2-4118-4516-893f-3404b7e01e6b req-94a6974b-c122-4d7d-b67d-0232f1c97643 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:45.221663 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-6518d9e2-4118-4516-893f-3404b7e01e6b req-94a6974b-c122-4d7d-b67d-0232f1c97643 service nova] Creating event network-vif-plugged:7ce3b50f-9f8f-4b64-8d95-b2b9f2973584 for instance f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 on n-h2-850468-16 Aug 23 17:51:45.228617 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-6518d9e2-4118-4516-893f-3404b7e01e6b req-94a6974b-c122-4d7d-b67d-0232f1c97643 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065026 Aug 23 17:51:45.229268 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 86/176] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:45.319549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f6c4e520-36bf-43ca-9062-8151e9e71a96 tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-1364960504", "id": 1839114851, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:45.322587 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:45.322587 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:45.369393 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f6c4e520-36bf-43ca-9062-8151e9e71a96 tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.803767 Aug 23 17:51:45.370068 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 91/177] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:44 2022] POST /compute/v2.1/flavors => generated 425 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:45.389120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-30fd88c3-25db-41e4-9140-11a1701395d0 tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:45.411743 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-30fd88c3-25db-41e4-9140-11a1701395d0 tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.031442 Aug 23 17:51:45.414501 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 87/178] 10.222.0.61 () {58 vars in 1182 bytes} [Tue Aug 23 17:51:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:51:45.423445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93fdb991-fad7-4f26-a51e-fc354f4dfb00 tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-31611871", "id": 714181290, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:45.460824 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93fdb991-fad7-4f26-a51e-fc354f4dfb00 tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 420 microversion: 2.1 time: 0.040274 Aug 23 17:51:45.463683 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 92/179] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:45 2022] POST /compute/v2.1/flavors => generated 420 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:45.475970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-70410c99-a7ff-4ec8-8d0b-c3fb253a8c6b tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:45.489895 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-70410c99-a7ff-4ec8-8d0b-c3fb253a8c6b tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.018332 Aug 23 17:51:45.502449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f63ec8f3-1191-45d1-a96d-98699dd5db71 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:45.503467 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 88/180] 10.222.0.61 () {58 vars in 1182 bytes} [Tue Aug 23 17:51:45 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:51:45.508043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f63ec8f3-1191-45d1-a96d-98699dd5db71 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:45.515796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-26604351-bfd3-4488-b1c4-fc11b0ebb310 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Action: 'create', calling method: .version_select at 0x7f27ed74baf0>, body: {"keypair": {"name": "tempest-keypair-2110049289", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmgdf/WNktnJ0jpq3yPjqtOqCIHWRbkHwTMrANvk61RfsNyGWbnR9lmfVEl4y6WpCZrYfx+c4x5E968h/99IsirRO9K8z8sxqSY7ZGN7fpCZBudL2tZB/YzmvRjD7GUww=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:45.536498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f63ec8f3-1191-45d1-a96d-98699dd5db71 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:45.537567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f63ec8f3-1191-45d1-a96d-98699dd5db71 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:45.538529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f63ec8f3-1191-45d1-a96d-98699dd5db71 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:45.540769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f63ec8f3-1191-45d1-a96d-98699dd5db71 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:45.544035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f63ec8f3-1191-45d1-a96d-98699dd5db71 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:45.547747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f63ec8f3-1191-45d1-a96d-98699dd5db71 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:45.618371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-26604351-bfd3-4488-b1c4-fc11b0ebb310 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Getting quotas for project 1d19cb17d3014429a4eda825eb937161. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:51:45.647562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-26604351-bfd3-4488-b1c4-fc11b0ebb310 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Getting quotas for user df1d56f4fa244d49829c18545cde4308 and project 1d19cb17d3014429a4eda825eb937161. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:51:45.678402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:45.716394 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-26604351-bfd3-4488-b1c4-fc11b0ebb310 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.208769 Aug 23 17:51:45.723467 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 89/181] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:51:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:45.803879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c1891fb-0057-49d1-9a44-acd6500e2d0a tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:45.804874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c1891fb-0057-49d1-9a44-acd6500e2d0a tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:45.816818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c1891fb-0057-49d1-9a44-acd6500e2d0a tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:45.820280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c1891fb-0057-49d1-9a44-acd6500e2d0a tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:45.820910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c1891fb-0057-49d1-9a44-acd6500e2d0a tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:45.821994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c1891fb-0057-49d1-9a44-acd6500e2d0a tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:45.823654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c1891fb-0057-49d1-9a44-acd6500e2d0a tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:45.824270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c1891fb-0057-49d1-9a44-acd6500e2d0a tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:45.878181 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-4c1891fb-0057-49d1-9a44-acd6500e2d0a tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] HTTP exception thrown: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c1891fb-0057-49d1-9a44-acd6500e2d0a tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Request method failure captured: Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 HTTP/1.1 Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBROBugJULgAJMLuUwPUgsoJKORWn6AAhmdTLExsxSm7HyBl5xXtxXRzFsmx--M1t7JcIYXi2lQ-yAAJ-OzItGQusrUdSfP0g-U2wsh_kWSQuO0UxNR-I5OBLf5tfSm_vZwCGIW3b98TGQv6QqA62qPgTiWKkE_t9b1XFDTvxwnr2GVQ Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 1204921b96d94a2ab750e504f819dcbe Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:51:45.891784 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:51:45.893231 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1204921b96d94a2ab750e504f819dcbe"}]}] Aug 23 17:51:45.893231 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:51:45.893231 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 1204921b96d94a2ab750e504f819dcbe Aug 23 17:51:45.893231 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:51:45.893231 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersAdminTestJSON-1525128900-project Aug 23 17:51:45.893231 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:51:45.893231 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:51:45.893231 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 969ea18ca5584a20bb82706514cf8a30 Aug 23 17:51:45.893231 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersAdminTestJSON-1525128900-project Aug 23 17:51:45.893231 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:51:45.893231 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:51:45.893231 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f249c89c-eb04-4198-a3a4-ee5ff7c2ec03'} Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:45.894012 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:51:45.895637 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:45.901152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c1891fb-0057-49d1-9a44-acd6500e2d0a tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Returning 404 to user: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:45.902174 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c1891fb-0057-49d1-9a44-acd6500e2d0a tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 404 len: 111 microversion: 2.1 time: 0.103329 Aug 23 17:51:45.906383 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 90/182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:45 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 17:51:46.038491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f63ec8f3-1191-45d1-a96d-98699dd5db71 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:46.050229 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f63ec8f3-1191-45d1-a96d-98699dd5db71 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1495 microversion: 2.1 time: 0.567076 Aug 23 17:51:46.050963 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 93/183] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:45 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1495 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:46.135793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-1543170158", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:46.184945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adff89f1-6d0d-443e-90b1-fbadcd0a5b7c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:46.185940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-adff89f1-6d0d-443e-90b1-fbadcd0a5b7c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:46.206200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adff89f1-6d0d-443e-90b1-fbadcd0a5b7c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:46.206864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adff89f1-6d0d-443e-90b1-fbadcd0a5b7c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:46.207903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adff89f1-6d0d-443e-90b1-fbadcd0a5b7c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:46.208653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adff89f1-6d0d-443e-90b1-fbadcd0a5b7c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:46.209109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adff89f1-6d0d-443e-90b1-fbadcd0a5b7c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:46.209534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adff89f1-6d0d-443e-90b1-fbadcd0a5b7c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:46.311305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:51:46.891664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-adff89f1-6d0d-443e-90b1-fbadcd0a5b7c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:46.917774 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-adff89f1-6d0d-443e-90b1-fbadcd0a5b7c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1321 microversion: 2.1 time: 0.730782 Aug 23 17:51:46.922987 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 94/184] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:46 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1321 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:47.137485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:51:47.137958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:51:47.138380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:51:47.138847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:51:47.139265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:51:47.156277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:47.163496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:47.164355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:47.166821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:47.168311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:47.169700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:47.235806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Getting quotas for project 1204921b96d94a2ab750e504f819dcbe. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:51:47.248471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Getting quotas for user 969ea18ca5584a20bb82706514cf8a30 and project 1204921b96d94a2ab750e504f819dcbe. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:51:47.280311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:51:47.289394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:51:47.476834 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-33240dd9-9abf-4ae9-83e9-037b0e517311 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.341467 Aug 23 17:51:47.480419 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 91/185] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:51:47.520811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8dd0df47-b89f-44aa-9362-22a8bfc464c5 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:47.521614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8dd0df47-b89f-44aa-9362-22a8bfc464c5 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:47.554904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dd0df47-b89f-44aa-9362-22a8bfc464c5 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:47.555338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dd0df47-b89f-44aa-9362-22a8bfc464c5 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:47.555783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dd0df47-b89f-44aa-9362-22a8bfc464c5 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:47.556507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dd0df47-b89f-44aa-9362-22a8bfc464c5 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:47.556966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dd0df47-b89f-44aa-9362-22a8bfc464c5 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:47.557391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dd0df47-b89f-44aa-9362-22a8bfc464c5 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:47.780334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-edbfb65c-b3aa-45a6-aded-24fafd690731 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Calling method '.version_select at 0x7f27ed37e310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:47.781638 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list-detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:47.781638 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:47.783481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-edbfb65c-b3aa-45a6-aded-24fafd690731 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '0d8dbf24d5c24a05a01b49782889a47a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebf3f5128814fe7abce1af6b49c2fe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-edbfb65c-b3aa-45a6-aded-24fafd690731 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Request method failure captured: Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROxDfwvYSATd2NpD5cf91FHLQvxianjRYs0owdXv--gLQ5RSMPbtryst04E0CRKUywNWu5RI6_1XBy7cyyL4klJge3W7pQ88zHmrxn_rXkZDlKXtSjQWrGk-ZOgCL9kgbscA1_DPVvsyezNCORMFOntl9S0N24WvEtE50HJccskFfc Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 5ebf3f5128814fe7abce1af6b49c2fe1 Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:51:47.787082 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ebf3f5128814fe7abce1af6b49c2fe1"}]}] Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 5ebf3f5128814fe7abce1af6b49c2fe1 Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-HypervisorAdminNegativeTestJSON-763858967-project Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 0d8dbf24d5c24a05a01b49782889a47a Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-763858967-project Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: action_args: {} Aug 23 17:51:47.788510 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._detail(req) Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:51:47.789447 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Aug 23 17:51:47.790723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:47.805143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-edbfb65c-b3aa-45a6-aded-24fafd690731 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:47.806227 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-edbfb65c-b3aa-45a6-aded-24fafd690731 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.861868 Aug 23 17:51:47.809188 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 95/186] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Aug 23 17:51:46 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 865 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:47.834242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-177dc517-85d8-4fb1-a6ed-8adca76d75f0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:47.837580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-177dc517-85d8-4fb1-a6ed-8adca76d75f0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:47.959487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8dd0df47-b89f-44aa-9362-22a8bfc464c5 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b6558f47031454cbfec53c0f5d1ca23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e4bfa5ee9a774b419208f692b2faa8a8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:47.981666 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8dd0df47-b89f-44aa-9362-22a8bfc464c5 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 200 len: 1453 microversion: 2.1 time: 0.495177 Aug 23 17:51:47.982288 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 92/187] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:47 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 1453 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:47.997995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e857092e-8717-4069-88b2-80a4cf5b31a9 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Calling method '.version_select at 0x7f27ed3dcd30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:47.998946 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:47.998946 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:48.000091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e857092e-8717-4069-88b2-80a4cf5b31a9 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '0d8dbf24d5c24a05a01b49782889a47a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebf3f5128814fe7abce1af6b49c2fe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:48.000369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-177dc517-85d8-4fb1-a6ed-8adca76d75f0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e857092e-8717-4069-88b2-80a4cf5b31a9 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Request method failure captured: Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBROxDfwvYSATd2NpD5cf91FHLQvxianjRYs0owdXv--gLQ5RSMPbtryst04E0CRKUywNWu5RI6_1XBy7cyyL4klJge3W7pQ88zHmrxn_rXkZDlKXtSjQWrGk-ZOgCL9kgbscA1_DPVvsyezNCORMFOntl9S0N24WvEtE50HJccskFfc Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 5ebf3f5128814fe7abce1af6b49c2fe1 Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:51:48.013801 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ebf3f5128814fe7abce1af6b49c2fe1"}]}] Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 5ebf3f5128814fe7abce1af6b49c2fe1 Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HypervisorAdminNegativeTestJSON-763858967-project Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 0d8dbf24d5c24a05a01b49782889a47a Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-763858967-project Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: action_args: {} Aug 23 17:51:48.015169 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:51:48.015879 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Aug 23 17:51:48.016936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:48.020511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e857092e-8717-4069-88b2-80a4cf5b31a9 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:48.020511 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e857092e-8717-4069-88b2-80a4cf5b31a9 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.034630 Aug 23 17:51:48.024683 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 93/188] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:47 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 40 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:48.026980 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-177dc517-85d8-4fb1-a6ed-8adca76d75f0 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1220 microversion: 2.1 time: 0.211089 Aug 23 17:51:48.039967 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 96/189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:47 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1220 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:48.039967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3d1f85d5-1b32-4fdb-bb6b-22bdc23d971d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:48.039967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3d1f85d5-1b32-4fdb-bb6b-22bdc23d971d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:48.080906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d1f85d5-1b32-4fdb-bb6b-22bdc23d971d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:48.081412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d1f85d5-1b32-4fdb-bb6b-22bdc23d971d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:48.081965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d1f85d5-1b32-4fdb-bb6b-22bdc23d971d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:48.083781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d1f85d5-1b32-4fdb-bb6b-22bdc23d971d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:48.084316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d1f85d5-1b32-4fdb-bb6b-22bdc23d971d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:48.087086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d1f85d5-1b32-4fdb-bb6b-22bdc23d971d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:48.268298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d7edda0-08ab-4d2a-b016-cb2c2b5a4da9 tempest-QuotaClassesAdmin257Test-1165290186 tempest-QuotaClassesAdmin257Test-1165290186-project-admin] Calling method '.version_select at 0x7f27ed3e0b80>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:48.271862 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:48.271862 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:48.314259 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d7edda0-08ab-4d2a-b016-cb2c2b5a4da9 tempest-QuotaClassesAdmin257Test-1165290186 tempest-QuotaClassesAdmin257Test-1165290186-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.288538 Aug 23 17:51:48.317416 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 94/190] 10.222.0.61 () {60 vars in 1226 bytes} [Tue Aug 23 17:51:48 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:48.321146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-984c8d48-d5e9-4004-8f1c-daa403dd8a81 req-8faa299b-9f85-4cf9-bfdf-69d0f035063c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bc9c68a-9939-4cc7-ac2a-cf726ba91792", "name": "network-vif-deleted", "tag": "ae4fccf8-4faf-4179-aa86-d5825bb5f3e9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:48.333394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-984c8d48-d5e9-4004-8f1c-daa403dd8a81 req-8faa299b-9f85-4cf9-bfdf-69d0f035063c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:48.333861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-984c8d48-d5e9-4004-8f1c-daa403dd8a81 req-8faa299b-9f85-4cf9-bfdf-69d0f035063c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:48.334451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-984c8d48-d5e9-4004-8f1c-daa403dd8a81 req-8faa299b-9f85-4cf9-bfdf-69d0f035063c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:48.360028 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-984c8d48-d5e9-4004-8f1c-daa403dd8a81 req-8faa299b-9f85-4cf9-bfdf-69d0f035063c service nova] Creating event network-vif-deleted:ae4fccf8-4faf-4179-aa86-d5825bb5f3e9 for instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 on n-h1-850468-16 Aug 23 17:51:48.374458 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-984c8d48-d5e9-4004-8f1c-daa403dd8a81 req-8faa299b-9f85-4cf9-bfdf-69d0f035063c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055693 Aug 23 17:51:48.375474 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 95/191] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:48.381540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93b6a4e3-bea2-464b-bd7b-240b5adc3fcb tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Calling method '.version_select at 0x7f27ed3e0550>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:48.382417 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:statistics": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:48.382417 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:48.383840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-93b6a4e3-bea2-464b-bd7b-240b5adc3fcb tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '0d8dbf24d5c24a05a01b49782889a47a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebf3f5128814fe7abce1af6b49c2fe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93b6a4e3-bea2-464b-bd7b-240b5adc3fcb tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Request method failure captured: Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBROxDfwvYSATd2NpD5cf91FHLQvxianjRYs0owdXv--gLQ5RSMPbtryst04E0CRKUywNWu5RI6_1XBy7cyyL4klJge3W7pQ88zHmrxn_rXkZDlKXtSjQWrGk-ZOgCL9kgbscA1_DPVvsyezNCORMFOntl9S0N24WvEtE50HJccskFfc Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 5ebf3f5128814fe7abce1af6b49c2fe1 Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:51:48.385858 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ebf3f5128814fe7abce1af6b49c2fe1"}]}] Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 5ebf3f5128814fe7abce1af6b49c2fe1 Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HypervisorAdminNegativeTestJSON-763858967-project Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 0d8dbf24d5c24a05a01b49782889a47a Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-763858967-project Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: action_args: {} Aug 23 17:51:48.387225 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:51:48.387917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Aug 23 17:51:48.389199 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:48.391882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93b6a4e3-bea2-464b-bd7b-240b5adc3fcb tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:48.392942 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93b6a4e3-bea2-464b-bd7b-240b5adc3fcb tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.016074 Aug 23 17:51:48.393851 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 96/192] 10.222.0.61 () {58 vars in 1179 bytes} [Tue Aug 23 17:51:48 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:48.416982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3d1f85d5-1b32-4fdb-bb6b-22bdc23d971d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:48.427467 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3d1f85d5-1b32-4fdb-bb6b-22bdc23d971d tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1471 microversion: 2.1 time: 0.398015 Aug 23 17:51:48.428399 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 97/193] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:48 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1471 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:48.434797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-44df67e2-a388-4065-a1cb-764c49f91672 tempest-QuotaClassesAdmin257Test-1165290186 tempest-QuotaClassesAdmin257Test-1165290186-project-admin] Action: 'update', calling method: .version_select at 0x7f27ed40b670>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:48.438081 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:48.438081 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:48.497666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-930997979", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "58d40799-9801-421b-928f-d0b0563fafbd"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:48.603320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] validate_networks() for [('58d40799-9801-421b-928f-d0b0563fafbd', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:51:48.898990 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-44df67e2-a388-4065-a1cb-764c49f91672 tempest-QuotaClassesAdmin257Test-1165290186 tempest-QuotaClassesAdmin257Test-1165290186-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.468364 Aug 23 17:51:48.900581 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 98/194] 10.222.0.61 () {62 vars in 1247 bytes} [Tue Aug 23 17:51:48 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:49.063616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9ef78db5-b7b3-4165-8644-704b69373ce7 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Calling method '.version_select at 0x7f27ed582c10>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:49.064360 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:49.064360 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:49.075156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ef78db5-b7b3-4165-8644-704b69373ce7 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:49.075831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ef78db5-b7b3-4165-8644-704b69373ce7 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:49.075831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ef78db5-b7b3-4165-8644-704b69373ce7 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:49.139420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ef78db5-b7b3-4165-8644-704b69373ce7 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:49.140056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ef78db5-b7b3-4165-8644-704b69373ce7 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:49.140581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ef78db5-b7b3-4165-8644-704b69373ce7 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:49.182809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ef78db5-b7b3-4165-8644-704b69373ce7 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:49.188532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ef78db5-b7b3-4165-8644-704b69373ce7 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:49.190026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ef78db5-b7b3-4165-8644-704b69373ce7 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:49.208852 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9ef78db5-b7b3-4165-8644-704b69373ce7 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.306901 Aug 23 17:51:49.209818 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 99/195] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:48 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:49.217286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2d5c0b41-79c5-4f35-90fb-9e06fbcd8651 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:49.218167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2d5c0b41-79c5-4f35-90fb-9e06fbcd8651 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:49.228498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d5c0b41-79c5-4f35-90fb-9e06fbcd8651 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:49.229159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d5c0b41-79c5-4f35-90fb-9e06fbcd8651 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:49.229602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d5c0b41-79c5-4f35-90fb-9e06fbcd8651 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:49.230317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d5c0b41-79c5-4f35-90fb-9e06fbcd8651 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:49.230796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d5c0b41-79c5-4f35-90fb-9e06fbcd8651 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:49.231406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d5c0b41-79c5-4f35-90fb-9e06fbcd8651 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:49.304149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2d5c0b41-79c5-4f35-90fb-9e06fbcd8651 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2d5c0b41-79c5-4f35-90fb-9e06fbcd8651 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Request method failure captured: Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9/diagnostics HTTP/1.1 Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROa_6utOzrjwzZ4D1Hwmt3qm1YqOztbLb1JjR6-3las0Y9z8mQxd-KNUgjL7ErZMxrfzmj78n4aToShbGI3oHcid48gJkqRonyymxxW5pCSOS0DFw23gyMrFkTSBYhX3M36ig_yU_tmEhEaQGCV5kqFcuhglAWdVscdTRnMlELwM6c Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 14bb3c54fe3c4157a7808f4c6a62034f Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-514533588 Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:51:49.307020 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:51:49.308464 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_14bb3c54fe3c4157a7808f4c6a62034f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/14bb3c54fe3c4157a7808f4c6a62034f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/14bb3c54fe3c4157a7808f4c6a62034f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/14bb3c54fe3c4157a7808f4c6a62034f"}]}] Aug 23 17:51:49.308464 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-514533588 Aug 23 17:51:49.308464 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 14bb3c54fe3c4157a7808f4c6a62034f Aug 23 17:51:49.308464 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-514533588 Aug 23 17:51:49.308464 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerDiagnosticsNegativeTest-514533588-project Aug 23 17:51:49.308464 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:49.308464 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:49.308464 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b1646f2e71ee4df08628bedd5eb729b2 Aug 23 17:51:49.308464 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-514533588-project Aug 23 17:51:49.308464 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:49.308464 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'server_id': 'f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9'} Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:51:49.309188 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Aug 23 17:51:49.310303 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:49.312114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2d5c0b41-79c5-4f35-90fb-9e06fbcd8651 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:49.313280 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2d5c0b41-79c5-4f35-90fb-9e06fbcd8651 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.101742 Aug 23 17:51:49.314003 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 100/196] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 17:51:49 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9/diagnostics => generated 117 bytes in 104 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:49.322013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-29c05b46-7ff3-4bbd-bcf9-d924dc09ce5b tempest-QuotaClassesAdmin257Test-1165290186 tempest-QuotaClassesAdmin257Test-1165290186-project-admin] Calling method '.version_select at 0x7f27ed447ca0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:49.323194 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:49.323194 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:49.337719 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-29c05b46-7ff3-4bbd-bcf9-d924dc09ce5b tempest-QuotaClassesAdmin257Test-1165290186 tempest-QuotaClassesAdmin257Test-1165290186-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.022436 Aug 23 17:51:49.338310 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 101/197] 10.222.0.61 () {60 vars in 1226 bytes} [Tue Aug 23 17:51:49 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:49.343821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83fd0a1e-4cc6-4503-95d2-2b3b51fc8ffb tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:49.344447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-83fd0a1e-4cc6-4503-95d2-2b3b51fc8ffb tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:49.351908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83fd0a1e-4cc6-4503-95d2-2b3b51fc8ffb tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:49.352405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83fd0a1e-4cc6-4503-95d2-2b3b51fc8ffb tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:49.353020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83fd0a1e-4cc6-4503-95d2-2b3b51fc8ffb tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:49.353747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83fd0a1e-4cc6-4503-95d2-2b3b51fc8ffb tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:49.354203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83fd0a1e-4cc6-4503-95d2-2b3b51fc8ffb tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:49.354653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83fd0a1e-4cc6-4503-95d2-2b3b51fc8ffb tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:49.370804 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-83fd0a1e-4cc6-4503-95d2-2b3b51fc8ffb tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] HTTP exception thrown: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83fd0a1e-4cc6-4503-95d2-2b3b51fc8ffb tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Request method failure captured: Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 HTTP/1.1 Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROB3Xbzlh-aKx-U4YrIPzJLJw_vVla51-oM1cnRraqrLBL87nYZ8tYx-pozRtzLrWmDDOLXcn1OOgB_ukdD2UMmvird0DfEN3ci6RkW2dBfI1OP3gSWnMf4yWLo1lVkt8deLCPPxrjHONHxWkOE13RVvdVaj_jcN-mJYnXEt_4ct1I Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: e4bfa5ee9a774b419208f692b2faa8a8 Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminTestJSON-2022773389 Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:51:49.376690 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:51:49.377961 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e4bfa5ee9a774b419208f692b2faa8a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e4bfa5ee9a774b419208f692b2faa8a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e4bfa5ee9a774b419208f692b2faa8a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e4bfa5ee9a774b419208f692b2faa8a8"}]}] Aug 23 17:51:49.377961 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminTestJSON-2022773389 Aug 23 17:51:49.377961 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: e4bfa5ee9a774b419208f692b2faa8a8 Aug 23 17:51:49.377961 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2022773389 Aug 23 17:51:49.377961 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminTestJSON-2022773389-project Aug 23 17:51:49.377961 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:49.377961 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:49.377961 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 5b6558f47031454cbfec53c0f5d1ca23 Aug 23 17:51:49.377961 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminTestJSON-2022773389-project Aug 23 17:51:49.377961 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:49.377961 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:49.377961 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '9bc9c68a-9939-4cc7-ac2a-cf726ba91792'} Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:49.378956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:49.380202 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:49.381339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83fd0a1e-4cc6-4503-95d2-2b3b51fc8ffb tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Returning 404 to user: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:49.381339 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-83fd0a1e-4cc6-4503-95d2-2b3b51fc8ffb tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 404 len: 111 microversion: 2.1 time: 0.039247 Aug 23 17:51:49.381339 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 102/198] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:49 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:49.388596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-623dce8b-e32e-4d1d-970e-a56d12a3db41 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:49.389222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-623dce8b-e32e-4d1d-970e-a56d12a3db41 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:49.396721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-623dce8b-e32e-4d1d-970e-a56d12a3db41 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:49.397208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-623dce8b-e32e-4d1d-970e-a56d12a3db41 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:49.397650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-623dce8b-e32e-4d1d-970e-a56d12a3db41 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:49.398417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-623dce8b-e32e-4d1d-970e-a56d12a3db41 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:49.398909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-623dce8b-e32e-4d1d-970e-a56d12a3db41 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:49.399335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-623dce8b-e32e-4d1d-970e-a56d12a3db41 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:49.547905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-623dce8b-e32e-4d1d-970e-a56d12a3db41 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:49.563328 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-623dce8b-e32e-4d1d-970e-a56d12a3db41 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1272 microversion: 2.1 time: 0.182483 Aug 23 17:51:49.575461 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 103/199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:49 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1272 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:49.581580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f9b81c3f-1b27-4175-98c9-2f5cd820c5a3 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Calling method '.version_select at 0x7f27ed1e9e50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:49.583476 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:49.583476 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:49.584701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f9b81c3f-1b27-4175-98c9-2f5cd820c5a3 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '0d8dbf24d5c24a05a01b49782889a47a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebf3f5128814fe7abce1af6b49c2fe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f9b81c3f-1b27-4175-98c9-2f5cd820c5a3 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Request method failure captured: Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROxDfwvYSATd2NpD5cf91FHLQvxianjRYs0owdXv--gLQ5RSMPbtryst04E0CRKUywNWu5RI6_1XBy7cyyL4klJge3W7pQ88zHmrxn_rXkZDlKXtSjQWrGk-ZOgCL9kgbscA1_DPVvsyezNCORMFOntl9S0N24WvEtE50HJccskFfc Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 5ebf3f5128814fe7abce1af6b49c2fe1 Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:51:49.586285 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ebf3f5128814fe7abce1af6b49c2fe1"}]}] Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 5ebf3f5128814fe7abce1af6b49c2fe1 Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-HypervisorAdminNegativeTestJSON-763858967-project Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 0d8dbf24d5c24a05a01b49782889a47a Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-763858967-project Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '1'} Aug 23 17:51:49.587466 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:51:49.588136 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Aug 23 17:51:49.589078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:49.596502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f9b81c3f-1b27-4175-98c9-2f5cd820c5a3 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:49.601591 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f9b81c3f-1b27-4175-98c9-2f5cd820c5a3 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.024766 Aug 23 17:51:49.602793 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 104/200] 10.222.0.61 () {58 vars in 1173 bytes} [Tue Aug 23 17:51:49 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 30 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:49.610882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6d3391f-8c31-4114-bdc7-937950c0bb0c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:49.611624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6d3391f-8c31-4114-bdc7-937950c0bb0c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:49.813133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6d3391f-8c31-4114-bdc7-937950c0bb0c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:49.813634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6d3391f-8c31-4114-bdc7-937950c0bb0c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:49.814072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6d3391f-8c31-4114-bdc7-937950c0bb0c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:49.814806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6d3391f-8c31-4114-bdc7-937950c0bb0c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:49.815408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6d3391f-8c31-4114-bdc7-937950c0bb0c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:49.815941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6d3391f-8c31-4114-bdc7-937950c0bb0c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:49.843778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6d3391f-8c31-4114-bdc7-937950c0bb0c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:51:49.942693 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6d3391f-8c31-4114-bdc7-937950c0bb0c tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 204 len: 0 microversion: 2.1 time: 0.338426 Aug 23 17:51:49.943436 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 105/201] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:51:49 2022] DELETE /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:51:49.949449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3400add2-0a59-4e75-a2d2-14d0a6f57204 tempest-QuotaClassesAdmin257Test-1165290186 tempest-QuotaClassesAdmin257Test-1165290186-project-admin] Action: 'update', calling method: .version_select at 0x7f27ed33b3a0>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:49.951993 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:49.951993 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:50.058501 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3400add2-0a59-4e75-a2d2-14d0a6f57204 tempest-QuotaClassesAdmin257Test-1165290186 tempest-QuotaClassesAdmin257Test-1165290186-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.113487 Aug 23 17:51:50.089301 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 106/202] 10.222.0.61 () {62 vars in 1247 bytes} [Tue Aug 23 17:51:49 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:51:50.105599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-964bb49f-e8e8-497a-a484-c717dadc3a9c tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-16"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:50.116057 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:50.116057 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:50.141870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-964bb49f-e8e8-497a-a484-c717dadc3a9c tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:50.144100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-964bb49f-e8e8-497a-a484-c717dadc3a9c tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:50.147249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-964bb49f-e8e8-497a-a484-c717dadc3a9c tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:50.230864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:51:50.231729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:51:50.232508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:51:50.233227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:51:50.234875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:51:50.235258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:50.261172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:50.264005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:50.267482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:50.268673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:50.269431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:50.270251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:50.295682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Getting quotas for project 2b51b697a6084440bf7a8080098925b7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:51:50.307651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Getting quotas for user 4110417440054128862efa0408fe93f7 and project 2b51b697a6084440bf7a8080098925b7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:51:50.325095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:51:50.327669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:51:50.397651 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ea0c8b89-b5b0-45c4-b12b-065081678ea4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.002391 Aug 23 17:51:50.398464 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 97/203] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 2004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:51:50.411724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eaecf814-6234-4736-a483-6af8281fd6f0 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Calling method '.version_select at 0x7f27ed377d30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:50.413162 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:uptime": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:50.413162 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:50.414040 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-eaecf814-6234-4736-a483-6af8281fd6f0 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] HTTP exception thrown: Hypervisor with ID '71fb52e2-ae3f-497b-8c05-120dc35c06e0' could not be found. Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eaecf814-6234-4736-a483-6af8281fd6f0 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Request method failure captured: Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-hypervisors/71fb52e2-ae3f-497b-8c05-120dc35c06e0/uptime HTTP/1.1 Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBROyI8m92SY1lqwibO5df1FBV_G3DtXk0JqGhizrcEGIqFrtorbJVwdzxGlVRIM2DoCRYjfvTGru_EA3y4AV3FZ69r5sDjNzAB_OW98E35e-rBidpuLA9lggvE09Z70bbejgi9clgI_bs6FD1ZkxXMFFvkHa61thiudw1PMietzDR-8 Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 0f23d263343f4d3980ae53cf216aeb9b Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1087111727 Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:51:50.432111 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:51:50.433287 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0f23d263343f4d3980ae53cf216aeb9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0f23d263343f4d3980ae53cf216aeb9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0f23d263343f4d3980ae53cf216aeb9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0f23d263343f4d3980ae53cf216aeb9b"}]}] Aug 23 17:51:50.433287 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1087111727 Aug 23 17:51:50.433287 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 0f23d263343f4d3980ae53cf216aeb9b Aug 23 17:51:50.433287 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1087111727 Aug 23 17:51:50.433287 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin Aug 23 17:51:50.433287 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:51:50.433287 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:51:50.433287 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 82285d3ed8ef4033b08db2e601597750 Aug 23 17:51:50.433287 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin Aug 23 17:51:50.433287 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:51:50.433287 n-d-850468-16 devstack@n-api.service[128807]: exception: Hypervisor with ID '71fb52e2-ae3f-497b-8c05-120dc35c06e0' could not be found. Aug 23 17:51:50.433287 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '71fb52e2-ae3f-497b-8c05-120dc35c06e0'} Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '71fb52e2-ae3f-497b-8c05-120dc35c06e0' Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 23 17:51:50.433955 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '71fb52e2-ae3f-497b-8c05-120dc35c06e0' could not be found. Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:50.435412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:50.437255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:50.437255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:50.437255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:50.437255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:50.437255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:50.437255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '71fb52e2-ae3f-497b-8c05-120dc35c06e0' could not be found. Aug 23 17:51:50.437255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:50.437255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eaecf814-6234-4736-a483-6af8281fd6f0 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Returning 404 to user: Hypervisor with ID '71fb52e2-ae3f-497b-8c05-120dc35c06e0' could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:50.437255 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eaecf814-6234-4736-a483-6af8281fd6f0 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/71fb52e2-ae3f-497b-8c05-120dc35c06e0/uptime" status: 404 len: 123 microversion: 2.1 time: 0.027594 Aug 23 17:51:50.437255 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 98/204] 10.222.0.61 () {58 vars in 1278 bytes} [Tue Aug 23 17:51:50 2022] GET /compute/v2.1/os-hypervisors/71fb52e2-ae3f-497b-8c05-120dc35c06e0/uptime => generated 123 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:50.448889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-22279a5c-f0c9-4955-bcd0-e67bee097a10 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:50.449523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-22279a5c-f0c9-4955-bcd0-e67bee097a10 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:50.458455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22279a5c-f0c9-4955-bcd0-e67bee097a10 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:50.458976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22279a5c-f0c9-4955-bcd0-e67bee097a10 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:50.459415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22279a5c-f0c9-4955-bcd0-e67bee097a10 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:50.460892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22279a5c-f0c9-4955-bcd0-e67bee097a10 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:50.461353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22279a5c-f0c9-4955-bcd0-e67bee097a10 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:50.461781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22279a5c-f0c9-4955-bcd0-e67bee097a10 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:50.468791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:50.698313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22279a5c-f0c9-4955-bcd0-e67bee097a10 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:50.708968 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-22279a5c-f0c9-4955-bcd0-e67bee097a10 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1477 microversion: 2.1 time: 0.267308 Aug 23 17:51:50.709882 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 99/205] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:50 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1477 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:50.717122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1059548857", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "714181290", "adminPass": "***", "networks": [{"uuid": "9b52ecc3-3b67-475a-959e-4fa93e805f56"}], "security_groups": [{"name": "tempest-securitygroup--315050541"}], "key_name": "tempest-keypair-2110049289", "user_data": "}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:50.920046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] validate_networks() for [('9b52ecc3-3b67-475a-959e-4fa93e805f56', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:51:50.933003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=9,nova_api:UPDATE=15 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:51.026034 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-964bb49f-e8e8-497a-a484-c717dadc3a9c tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.935874 Aug 23 17:51:51.026820 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 107/206] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Aug 23 17:51:50 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:51.032967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a1f6f560-78e3-418c-97e0-e657a98b70b8 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:51.033776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a1f6f560-78e3-418c-97e0-e657a98b70b8 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:51.197820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a1f6f560-78e3-418c-97e0-e657a98b70b8 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:51.209192 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a1f6f560-78e3-418c-97e0-e657a98b70b8 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1231 microversion: 2.1 time: 0.180858 Aug 23 17:51:51.211275 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 108/207] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:51 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1231 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:51.227562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db41ad00-2a28-469d-951e-b6813463d13c tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Calling method '.version_select at 0x7f27ed1e9790>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:51.228627 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:51.228627 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:51.230110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db41ad00-2a28-469d-951e-b6813463d13c tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:51.230961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db41ad00-2a28-469d-951e-b6813463d13c tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:51.231621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db41ad00-2a28-469d-951e-b6813463d13c tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:51.298259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db41ad00-2a28-469d-951e-b6813463d13c tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:51.300900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db41ad00-2a28-469d-951e-b6813463d13c tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:51.303313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db41ad00-2a28-469d-951e-b6813463d13c tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:51.320691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db41ad00-2a28-469d-951e-b6813463d13c tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:51.321750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db41ad00-2a28-469d-951e-b6813463d13c tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:51.322938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db41ad00-2a28-469d-951e-b6813463d13c tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:51.333101 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-db41ad00-2a28-469d-951e-b6813463d13c tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.119197 Aug 23 17:51:51.346341 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 109/208] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:51:51 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:51.357192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-71720684-3fb0-4691-a72f-91719bb415d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:51.357606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-71720684-3fb0-4691-a72f-91719bb415d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:51.391820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71720684-3fb0-4691-a72f-91719bb415d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:51.392542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71720684-3fb0-4691-a72f-91719bb415d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:51.393682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71720684-3fb0-4691-a72f-91719bb415d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:51.394926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71720684-3fb0-4691-a72f-91719bb415d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:51.395713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71720684-3fb0-4691-a72f-91719bb415d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:51.398880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71720684-3fb0-4691-a72f-91719bb415d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:51.612435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:51:51.619310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:51:51.619911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:51:51.620324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:51:51.620741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:51:51.643777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:51.644324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:51.645121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:51.646706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:51.647319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:51.647896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:51.704690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Getting quotas for project 1d19cb17d3014429a4eda825eb937161. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:51:51.725923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Getting quotas for user df1d56f4fa244d49829c18545cde4308 and project 1d19cb17d3014429a4eda825eb937161. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:51:51.746434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:51:51.749358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:51:51.777483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-71720684-3fb0-4691-a72f-91719bb415d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:51.787976 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-71720684-3fb0-4691-a72f-91719bb415d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1320 microversion: 2.1 time: 0.439906 Aug 23 17:51:51.792577 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 110/209] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:51 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1320 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:51.813087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-787c4407-196a-4577-a9f8-64d88907f2ab tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:51.817268 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:51.817268 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:51.829356 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3edfe9f5-1c5a-4eb6-a606-5610ada6af36 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.118290 Aug 23 17:51:51.837099 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 100/210] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:51:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 1126 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:51:51.843683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fd26ff3d-7dcf-4d2f-bc2f-dfea211f02a8 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Calling method '.version_select at 0x7f27ed4aae50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:51.844841 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:51.844841 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:51.846554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fd26ff3d-7dcf-4d2f-bc2f-dfea211f02a8 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '0d8dbf24d5c24a05a01b49782889a47a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ebf3f5128814fe7abce1af6b49c2fe1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fd26ff3d-7dcf-4d2f-bc2f-dfea211f02a8 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Request method failure captured: Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBROxDfwvYSATd2NpD5cf91FHLQvxianjRYs0owdXv--gLQ5RSMPbtryst04E0CRKUywNWu5RI6_1XBy7cyyL4klJge3W7pQ88zHmrxn_rXkZDlKXtSjQWrGk-ZOgCL9kgbscA1_DPVvsyezNCORMFOntl9S0N24WvEtE50HJccskFfc Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 5ebf3f5128814fe7abce1af6b49c2fe1 Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:51:51.849151 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5ebf3f5128814fe7abce1af6b49c2fe1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5ebf3f5128814fe7abce1af6b49c2fe1"}]}] Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 5ebf3f5128814fe7abce1af6b49c2fe1 Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-763858967 Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HypervisorAdminNegativeTestJSON-763858967-project Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 0d8dbf24d5c24a05a01b49782889a47a Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-763858967-project Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '1'} Aug 23 17:51:51.850636 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:51:51.851494 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Aug 23 17:51:51.852765 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:51.854066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fd26ff3d-7dcf-4d2f-bc2f-dfea211f02a8 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:51.854066 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fd26ff3d-7dcf-4d2f-bc2f-dfea211f02a8 tempest-HypervisorAdminNegativeTestJSON-763858967 tempest-HypervisorAdminNegativeTestJSON-763858967-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.012116 Aug 23 17:51:51.854066 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 101/211] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:51 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 13 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:51.855676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-74bb9376-caaa-4927-9524-3c2e44927d71 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:51.856432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-74bb9376-caaa-4927-9524-3c2e44927d71 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:51.865028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74bb9376-caaa-4927-9524-3c2e44927d71 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:51.865792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74bb9376-caaa-4927-9524-3c2e44927d71 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:51.866521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74bb9376-caaa-4927-9524-3c2e44927d71 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:51.867633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74bb9376-caaa-4927-9524-3c2e44927d71 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:51.868094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74bb9376-caaa-4927-9524-3c2e44927d71 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:51.868523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74bb9376-caaa-4927-9524-3c2e44927d71 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:51.902741 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-787c4407-196a-4577-a9f8-64d88907f2ab tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.095948 Aug 23 17:51:51.904532 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 111/212] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:51 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:51:51.914679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-76275936-3a4a-4e5f-bda5-c15b362a8ffb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:51.919202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-76275936-3a4a-4e5f-bda5-c15b362a8ffb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:52.117725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-74bb9376-caaa-4927-9524-3c2e44927d71 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:52.128304 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-74bb9376-caaa-4927-9524-3c2e44927d71 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1477 microversion: 2.1 time: 0.276229 Aug 23 17:51:52.140673 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 102/213] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:51 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1477 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:52.161699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1b8f239a-d886-4739-9ff5-ab1db43b5357 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Calling method '.version_select at 0x7f27ed377820>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:52.164353 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:52.164353 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:52.167056 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-1b8f239a-d886-4739-9ff5-ab1db43b5357 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] HTTP exception thrown: Hypervisor with ID '021b9a52-faa8-4469-b65c-7c8d0bacdd7f' could not be found. Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1b8f239a-d886-4739-9ff5-ab1db43b5357 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Request method failure captured: Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-hypervisors/021b9a52-faa8-4469-b65c-7c8d0bacdd7f HTTP/1.1 Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBROyI8m92SY1lqwibO5df1FBV_G3DtXk0JqGhizrcEGIqFrtorbJVwdzxGlVRIM2DoCRYjfvTGru_EA3y4AV3FZ69r5sDjNzAB_OW98E35e-rBidpuLA9lggvE09Z70bbejgi9clgI_bs6FD1ZkxXMFFvkHa61thiudw1PMietzDR-8 Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 0f23d263343f4d3980ae53cf216aeb9b Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-1087111727 Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:51:52.168393 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:51:52.169868 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0f23d263343f4d3980ae53cf216aeb9b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0f23d263343f4d3980ae53cf216aeb9b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0f23d263343f4d3980ae53cf216aeb9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0f23d263343f4d3980ae53cf216aeb9b"}]}] Aug 23 17:51:52.169868 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-1087111727 Aug 23 17:51:52.169868 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 0f23d263343f4d3980ae53cf216aeb9b Aug 23 17:51:52.169868 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-1087111727 Aug 23 17:51:52.169868 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin Aug 23 17:51:52.169868 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:51:52.169868 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:51:52.169868 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 82285d3ed8ef4033b08db2e601597750 Aug 23 17:51:52.169868 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin Aug 23 17:51:52.169868 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:51:52.169868 n-d-850468-16 devstack@n-api.service[128807]: exception: Hypervisor with ID '021b9a52-faa8-4469-b65c-7c8d0bacdd7f' could not be found. Aug 23 17:51:52.169868 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '021b9a52-faa8-4469-b65c-7c8d0bacdd7f'} Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi value = int(str(value)) Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '021b9a52-faa8-4469-b65c-7c8d0bacdd7f' Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Aug 23 17:51:52.170673 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 17:51:52.172116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '021b9a52-faa8-4469-b65c-7c8d0bacdd7f' could not be found. Aug 23 17:51:52.173982 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:52.173982 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:52.173982 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:52.173982 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:52.173982 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:52.173982 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:52.173982 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:52.173982 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:52.173982 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '021b9a52-faa8-4469-b65c-7c8d0bacdd7f' could not be found. Aug 23 17:51:52.173982 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:51:52.177341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1b8f239a-d886-4739-9ff5-ab1db43b5357 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] Returning 404 to user: Hypervisor with ID '021b9a52-faa8-4469-b65c-7c8d0bacdd7f' could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:52.178915 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1b8f239a-d886-4739-9ff5-ab1db43b5357 tempest-HypervisorAdminNegativeTestJSON-1087111727 tempest-HypervisorAdminNegativeTestJSON-1087111727-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/021b9a52-faa8-4469-b65c-7c8d0bacdd7f" status: 404 len: 123 microversion: 2.1 time: 0.031488 Aug 23 17:51:52.184238 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 103/214] 10.222.0.61 () {58 vars in 1257 bytes} [Tue Aug 23 17:51:52 2022] GET /compute/v2.1/os-hypervisors/021b9a52-faa8-4469-b65c-7c8d0bacdd7f => generated 123 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:52.209052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e9d12458-4256-48ad-925a-f863b941cba9 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1321590175"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:52.217911 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:52.217911 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:52.219010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.aggregate [None req-e9d12458-4256-48ad-925a-f863b941cba9 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Generated uuid e788ae39-e725-4ddc-afed-4b4325f1f0b1 for aggregate {{(pid=128807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:51:52.294345 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e9d12458-4256-48ad-925a-f863b941cba9 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.106550 Aug 23 17:51:52.301536 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 104/215] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:51:52 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:52.307902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b4a71ec5-68e9-46fd-8c25-51e4e40289e2 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:52.308744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b4a71ec5-68e9-46fd-8c25-51e4e40289e2 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:52.317121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4a71ec5-68e9-46fd-8c25-51e4e40289e2 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:52.318312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4a71ec5-68e9-46fd-8c25-51e4e40289e2 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:52.318973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4a71ec5-68e9-46fd-8c25-51e4e40289e2 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:52.320059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4a71ec5-68e9-46fd-8c25-51e4e40289e2 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:52.320906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4a71ec5-68e9-46fd-8c25-51e4e40289e2 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:52.321376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4a71ec5-68e9-46fd-8c25-51e4e40289e2 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:52.414669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b4a71ec5-68e9-46fd-8c25-51e4e40289e2 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:52.430130 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b4a71ec5-68e9-46fd-8c25-51e4e40289e2 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1227 microversion: 2.1 time: 0.126889 Aug 23 17:51:52.444402 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 105/216] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:52 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1227 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:52.456603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fec2fa3e-541e-4d75-924d-0470a90d778e tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-16"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:52.467874 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:52.467874 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:52.481653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fec2fa3e-541e-4d75-924d-0470a90d778e tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:52.483488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fec2fa3e-541e-4d75-924d-0470a90d778e tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:52.484146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fec2fa3e-541e-4d75-924d-0470a90d778e tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:52.499484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-76275936-3a4a-4e5f-bda5-c15b362a8ffb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:52.515668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-76275936-3a4a-4e5f-bda5-c15b362a8ffb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1263 microversion: 2.1 time: 0.607023 Aug 23 17:51:52.517128 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 112/217] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:51 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1263 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:52.777662 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fec2fa3e-541e-4d75-924d-0470a90d778e tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 243 microversion: 2.1 time: 0.331649 Aug 23 17:51:52.779112 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 106/218] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Aug 23 17:51:52 2022] POST /compute/v2.1/os-aggregates/3/action => generated 243 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:52.792378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cadbf110-2fe0-43dc-b9cc-3cf768595628 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:52.794003 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:52.794003 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:52.817078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-afe19d86-9fd2-461a-8c10-1254ce82c324 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:52.818290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-afe19d86-9fd2-461a-8c10-1254ce82c324 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:52.822203 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cadbf110-2fe0-43dc-b9cc-3cf768595628 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 243 microversion: 2.1 time: 0.021086 Aug 23 17:51:52.830771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afe19d86-9fd2-461a-8c10-1254ce82c324 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:52.831451 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 113/219] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Aug 23 17:51:52 2022] GET /compute/v2.1/os-aggregates/3 => generated 243 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:52.832426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afe19d86-9fd2-461a-8c10-1254ce82c324 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:52.833266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afe19d86-9fd2-461a-8c10-1254ce82c324 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:52.834135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afe19d86-9fd2-461a-8c10-1254ce82c324 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:52.834758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afe19d86-9fd2-461a-8c10-1254ce82c324 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:52.835467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afe19d86-9fd2-461a-8c10-1254ce82c324 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:52.843359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ec9e67f8-c073-445c-a867-acb49390c8ee tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-16"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:52.850225 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:52.850225 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:52.875220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9e67f8-c073-445c-a867-acb49390c8ee tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:52.875220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9e67f8-c073-445c-a867-acb49390c8ee tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:52.878060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9e67f8-c073-445c-a867-acb49390c8ee tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:53.132143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-afe19d86-9fd2-461a-8c10-1254ce82c324 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:53.151492 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-afe19d86-9fd2-461a-8c10-1254ce82c324 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1320 microversion: 2.1 time: 0.333120 Aug 23 17:51:53.152653 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 107/220] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:52 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1320 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:53.155363 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ec9e67f8-c073-445c-a867-acb49390c8ee tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.316995 Aug 23 17:51:53.159595 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 114/221] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Aug 23 17:51:52 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:53.163713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8b213251-94c4-4f2d-b41c-1d2a6e8e4595 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:53.172403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8b213251-94c4-4f2d-b41c-1d2a6e8e4595 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:53.181429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a7dac7ff-0454-484c-8c52-9e27a2f61ccc tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:53.182270 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:53.182270 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:53.190035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b213251-94c4-4f2d-b41c-1d2a6e8e4595 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:53.193568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b213251-94c4-4f2d-b41c-1d2a6e8e4595 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:53.195497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b213251-94c4-4f2d-b41c-1d2a6e8e4595 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:53.197363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b213251-94c4-4f2d-b41c-1d2a6e8e4595 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:53.202442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b213251-94c4-4f2d-b41c-1d2a6e8e4595 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:53.203178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b213251-94c4-4f2d-b41c-1d2a6e8e4595 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:53.270848 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a7dac7ff-0454-484c-8c52-9e27a2f61ccc tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.100659 Aug 23 17:51:53.271471 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 115/222] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:53 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:51:53.292220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b747485c-680a-4ef5-a7f5-3400eb70bd89 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-157643091"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:53.314072 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:53.314072 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:53.318283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.aggregate [None req-b747485c-680a-4ef5-a7f5-3400eb70bd89 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Generated uuid 708ad7fd-a8ec-4fc0-9070-867f9090fd8a for aggregate {{(pid=128808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:51:53.377802 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b747485c-680a-4ef5-a7f5-3400eb70bd89 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.099478 Aug 23 17:51:53.380565 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 116/223] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:51:53 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:53.393177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-37b613a7-ce1a-4562-957e-518a05e45ddf tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-16"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:53.398103 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:53.398103 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:53.415386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37b613a7-ce1a-4562-957e-518a05e45ddf tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:53.416450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37b613a7-ce1a-4562-957e-518a05e45ddf tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:53.417041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37b613a7-ce1a-4562-957e-518a05e45ddf tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:53.634190 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-37b613a7-ce1a-4562-957e-518a05e45ddf tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.246275 Aug 23 17:51:53.635925 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 117/224] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Aug 23 17:51:53 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:53.640866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1d6bacce-0853-4787-9066-3953441195d9 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:53.641485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1d6bacce-0853-4787-9066-3953441195d9 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:53.643331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8b213251-94c4-4f2d-b41c-1d2a6e8e4595 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:53.649587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d6bacce-0853-4787-9066-3953441195d9 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:53.649587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d6bacce-0853-4787-9066-3953441195d9 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:53.650015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d6bacce-0853-4787-9066-3953441195d9 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:53.651518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d6bacce-0853-4787-9066-3953441195d9 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:53.651988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d6bacce-0853-4787-9066-3953441195d9 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:53.652418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d6bacce-0853-4787-9066-3953441195d9 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:53.660856 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8b213251-94c4-4f2d-b41c-1d2a6e8e4595 tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1477 microversion: 2.1 time: 0.501240 Aug 23 17:51:53.665583 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 108/225] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:53 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1477 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:51:53.682210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1f4f24a0-898a-4135-a2c1-58024010fb53 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:53.683432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1f4f24a0-898a-4135-a2c1-58024010fb53 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:53.696971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f4f24a0-898a-4135-a2c1-58024010fb53 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:53.697758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f4f24a0-898a-4135-a2c1-58024010fb53 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:53.698436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f4f24a0-898a-4135-a2c1-58024010fb53 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:53.699489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f4f24a0-898a-4135-a2c1-58024010fb53 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:53.700586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f4f24a0-898a-4135-a2c1-58024010fb53 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:53.701228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f4f24a0-898a-4135-a2c1-58024010fb53 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:53.814646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d6bacce-0853-4787-9066-3953441195d9 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:53.824885 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1d6bacce-0853-4787-9066-3953441195d9 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1289 microversion: 2.1 time: 0.187882 Aug 23 17:51:53.825449 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 118/226] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:53 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1289 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:53.830821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-824f65b6-4c11-4a2b-84fd-674005eca60c tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:53.831598 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:53.831598 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:53.837402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1f4f24a0-898a-4135-a2c1-58024010fb53 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:53.839114 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-824f65b6-4c11-4a2b-84fd-674005eca60c tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.012629 Aug 23 17:51:53.846970 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 119/227] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 17:51:53 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:53.848703 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1f4f24a0-898a-4135-a2c1-58024010fb53 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1315 microversion: 2.1 time: 0.173280 Aug 23 17:51:53.852832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3ed615c3-0225-4057-9c34-be7bd241b094 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-16"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:53.855090 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 109/228] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:53 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:53.857718 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:53.857718 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:53.871257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ed615c3-0225-4057-9c34-be7bd241b094 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:53.871934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ed615c3-0225-4057-9c34-be7bd241b094 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:53.872788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ed615c3-0225-4057-9c34-be7bd241b094 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:54.078898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4e62a8fb-40e4-4a45-ae7a-183169fba9bd req-924a11ed-1a85-4d62-9305-4758ab27a42a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "304e504b-7767-46b3-8785-5010fac97f7a", "tag": "ec85963d-5c39-4e97-98c6-16cfd848ed74"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:54.100882 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3ed615c3-0225-4057-9c34-be7bd241b094 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 226 microversion: 2.1 time: 0.251807 Aug 23 17:51:54.103370 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 120/229] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Aug 23 17:51:53 2022] POST /compute/v2.1/os-aggregates/4/action => generated 226 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:54.107745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4e62a8fb-40e4-4a45-ae7a-183169fba9bd req-924a11ed-1a85-4d62-9305-4758ab27a42a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:54.112305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4e62a8fb-40e4-4a45-ae7a-183169fba9bd req-924a11ed-1a85-4d62-9305-4758ab27a42a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:54.115371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4e62a8fb-40e4-4a45-ae7a-183169fba9bd req-924a11ed-1a85-4d62-9305-4758ab27a42a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:54.117075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-24f92fba-60f4-42bf-8ada-477496874abd tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:54.122053 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:54.122053 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:54.140659 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4e62a8fb-40e4-4a45-ae7a-183169fba9bd req-924a11ed-1a85-4d62-9305-4758ab27a42a service nova] Creating event network-changed:ec85963d-5c39-4e97-98c6-16cfd848ed74 for instance 304e504b-7767-46b3-8785-5010fac97f7a on n-h2-850468-16 Aug 23 17:51:54.152446 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4e62a8fb-40e4-4a45-ae7a-183169fba9bd req-924a11ed-1a85-4d62-9305-4758ab27a42a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078504 Aug 23 17:51:54.153063 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 110/230] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:51:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:54.163849 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-24f92fba-60f4-42bf-8ada-477496874abd tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.052041 Aug 23 17:51:54.173097 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 121/231] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:54 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:51:54.178357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b79e93c-dfcb-4c25-aa77-70e56fc90dff tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2067667053"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:54.181223 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:54.181223 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:54.182124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.aggregate [None req-7b79e93c-dfcb-4c25-aa77-70e56fc90dff tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Generated uuid fc0cb599-adfb-421a-83ce-ebbb61f00b4d for aggregate {{(pid=128807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:51:54.183002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5e8114e6-7ccd-42bd-ad97-c786605d4c52 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:54.183957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5e8114e6-7ccd-42bd-ad97-c786605d4c52 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:54.198371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e8114e6-7ccd-42bd-ad97-c786605d4c52 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:54.206155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e8114e6-7ccd-42bd-ad97-c786605d4c52 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:54.207736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e8114e6-7ccd-42bd-ad97-c786605d4c52 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:54.209176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e8114e6-7ccd-42bd-ad97-c786605d4c52 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:54.209789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e8114e6-7ccd-42bd-ad97-c786605d4c52 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:54.211015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e8114e6-7ccd-42bd-ad97-c786605d4c52 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:54.236604 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7b79e93c-dfcb-4c25-aa77-70e56fc90dff tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.063096 Aug 23 17:51:54.239820 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 111/232] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:51:54 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:54.258853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dfac3160-6a82-46d0-9227-0ed59c404fcd tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-16"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:54.264292 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:54.264292 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:54.282742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfac3160-6a82-46d0-9227-0ed59c404fcd tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:54.284139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfac3160-6a82-46d0-9227-0ed59c404fcd tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:54.288469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfac3160-6a82-46d0-9227-0ed59c404fcd tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:54.470249 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dfac3160-6a82-46d0-9227-0ed59c404fcd tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 243 microversion: 2.1 time: 0.223599 Aug 23 17:51:54.477777 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 112/233] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Aug 23 17:51:54 2022] POST /compute/v2.1/os-aggregates/5/action => generated 243 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:54.484119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-67d67aad-7947-4ae4-b334-26604ff13ce6 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-16"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:54.489442 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:54.489442 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:54.494221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=14 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:54.505649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67d67aad-7947-4ae4-b334-26604ff13ce6 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:54.506637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67d67aad-7947-4ae4-b334-26604ff13ce6 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:54.507336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67d67aad-7947-4ae4-b334-26604ff13ce6 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:54.704810 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-67d67aad-7947-4ae4-b334-26604ff13ce6 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.225012 Aug 23 17:51:54.707662 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 113/234] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Aug 23 17:51:54 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:54.714251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-58febda9-8541-47d8-a528-df3ce9c3b1fc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:54.715890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-58febda9-8541-47d8-a528-df3ce9c3b1fc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:54.741125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58febda9-8541-47d8-a528-df3ce9c3b1fc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:54.744844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58febda9-8541-47d8-a528-df3ce9c3b1fc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:54.745362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58febda9-8541-47d8-a528-df3ce9c3b1fc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:54.748995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58febda9-8541-47d8-a528-df3ce9c3b1fc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:54.750423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58febda9-8541-47d8-a528-df3ce9c3b1fc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:54.752944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58febda9-8541-47d8-a528-df3ce9c3b1fc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:54.979353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5e8114e6-7ccd-42bd-ad97-c786605d4c52 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:55.015624 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5e8114e6-7ccd-42bd-ad97-c786605d4c52 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1320 microversion: 2.1 time: 0.838153 Aug 23 17:51:55.019888 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 122/235] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:54 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1320 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:55.041966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-54da4c8b-ec9b-474b-9c35-d3e7b3648f70 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.044261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-58febda9-8541-47d8-a528-df3ce9c3b1fc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1646f2e71ee4df08628bedd5eb729b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14bb3c54fe3c4157a7808f4c6a62034f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:55.045190 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.045190 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:55.053166 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-58febda9-8541-47d8-a528-df3ce9c3b1fc tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 200 len: 1435 microversion: 2.1 time: 0.344038 Aug 23 17:51:55.057001 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 114/236] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:54 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 1435 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:55.074379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a703bbe3-81ff-4665-99fe-38cd3ed14d2b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.080727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a703bbe3-81ff-4665-99fe-38cd3ed14d2b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:55.104355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a703bbe3-81ff-4665-99fe-38cd3ed14d2b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.107606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a703bbe3-81ff-4665-99fe-38cd3ed14d2b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.107940 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-54da4c8b-ec9b-474b-9c35-d3e7b3648f70 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.086430 Aug 23 17:51:55.109755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a703bbe3-81ff-4665-99fe-38cd3ed14d2b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.110792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a703bbe3-81ff-4665-99fe-38cd3ed14d2b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.111542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a703bbe3-81ff-4665-99fe-38cd3ed14d2b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.112602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a703bbe3-81ff-4665-99fe-38cd3ed14d2b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.115900 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 123/237] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:55 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:51:55.124673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-855bbf41-439a-4286-98ef-f98784e747b9 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.127528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-855bbf41-439a-4286-98ef-f98784e747b9 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:55.139007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-855bbf41-439a-4286-98ef-f98784e747b9 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.140383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-855bbf41-439a-4286-98ef-f98784e747b9 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.140996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-855bbf41-439a-4286-98ef-f98784e747b9 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.141874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-855bbf41-439a-4286-98ef-f98784e747b9 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.142481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-855bbf41-439a-4286-98ef-f98784e747b9 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.143127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-855bbf41-439a-4286-98ef-f98784e747b9 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.260811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a703bbe3-81ff-4665-99fe-38cd3ed14d2b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:55.270019 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a703bbe3-81ff-4665-99fe-38cd3ed14d2b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1289 microversion: 2.1 time: 0.211107 Aug 23 17:51:55.275562 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 115/238] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:55 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1289 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:55.290884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cc0ef4f1-7500-47de-a753-6d593054e0f2 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1591690664"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:55.294084 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.294084 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:55.295408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.aggregate [None req-cc0ef4f1-7500-47de-a753-6d593054e0f2 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Generated uuid 08462b7a-cc7a-4eb7-b57d-b45019884477 for aggregate {{(pid=128807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:51:55.352712 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cc0ef4f1-7500-47de-a753-6d593054e0f2 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.075650 Aug 23 17:51:55.353311 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 116/239] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:51:55 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:55.362383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e1ea11ee-69b8-49b3-ab15-9baa9763ebd1 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Calling method '.version_select at 0x7f27ed339280>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.373866 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.373866 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:55.375582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1ea11ee-69b8-49b3-ab15-9baa9763ebd1 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.383281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1ea11ee-69b8-49b3-ab15-9baa9763ebd1 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.383899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1ea11ee-69b8-49b3-ab15-9baa9763ebd1 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.384956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1ea11ee-69b8-49b3-ab15-9baa9763ebd1 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.386410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1ea11ee-69b8-49b3-ab15-9baa9763ebd1 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.389840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1ea11ee-69b8-49b3-ab15-9baa9763ebd1 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.407182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-855bbf41-439a-4286-98ef-f98784e747b9 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:55.422216 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-855bbf41-439a-4286-98ef-f98784e747b9 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1321 microversion: 2.1 time: 0.304575 Aug 23 17:51:55.426679 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 124/240] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:55 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:55.433370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-53802e7d-bd96-4305-a82f-e1e93b425a94 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.433792 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e1ea11ee-69b8-49b3-ab15-9baa9763ebd1 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.078506 Aug 23 17:51:55.434833 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.434833 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:55.443013 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 117/241] 10.222.0.61 () {58 vars in 1128 bytes} [Tue Aug 23 17:51:55 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:55.448071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ab4010ba-4ddd-44c9-954a-ac5b08679324 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Calling method '.version_select at 0x7f27ed352ca0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.460008 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.460008 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:55.467526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab4010ba-4ddd-44c9-954a-ac5b08679324 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.470524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab4010ba-4ddd-44c9-954a-ac5b08679324 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.476649 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-53802e7d-bd96-4305-a82f-e1e93b425a94 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.048260 Aug 23 17:51:55.479232 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 125/242] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:55 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:51:55.486919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab4010ba-4ddd-44c9-954a-ac5b08679324 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.489485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab4010ba-4ddd-44c9-954a-ac5b08679324 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.490754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab4010ba-4ddd-44c9-954a-ac5b08679324 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.492117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab4010ba-4ddd-44c9-954a-ac5b08679324 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.496430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eaa1fcfe-a2e9-49c8-a165-1876e717f449 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.500906 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.500906 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:55.516814 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-eaa1fcfe-a2e9-49c8-a165-1876e717f449 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eaa1fcfe-a2e9-49c8-a165-1876e717f449 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Request method failure captured: Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRODYd2iRJXmlGWTe_OBOHpwo1Qr-Dm_IYi8SCKWOrJdKqeArkVBqs2L5fGnW_A2c4HP_prSEWOcMhLdYpru33sUmuricKkQSW31Ttow5tVVsY5EB_flIvcMZNih8QSH-PZ8W_xjC9ntmqdiT23ehGgtLiGYgXISAnKPWBqGmxMtzVo Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 5019dc727595447788a8bc35e65f73f4 Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminTestJSON-2124938621 Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:51:55.526354 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5019dc727595447788a8bc35e65f73f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5019dc727595447788a8bc35e65f73f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5019dc727595447788a8bc35e65f73f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5019dc727595447788a8bc35e65f73f4"}]}] Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminTestJSON-2124938621 Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 5019dc727595447788a8bc35e65f73f4 Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2124938621 Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminTestJSON-2124938621-project-admin Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 8d632987b71c43a48ce8a00e3eaa7c08 Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminTestJSON-2124938621-project-admin Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: exception: Aggregate 6 could not be found. Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '6'} Aug 23 17:51:55.528152 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:55.528887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 23 17:51:55.529869 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.538680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eaa1fcfe-a2e9-49c8-a165-1876e717f449 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:55.540553 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eaa1fcfe-a2e9-49c8-a165-1876e717f449 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.057704 Aug 23 17:51:55.542466 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 126/243] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Aug 23 17:51:55 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:51:55.560376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef10d4f0-ce3a-4b91-954e-533204d4cea2 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.561237 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.561237 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:55.615007 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-ef10d4f0-ce3a-4b91-954e-533204d4cea2 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef10d4f0-ce3a-4b91-954e-533204d4cea2 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Request method failure captured: Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRODYd2iRJXmlGWTe_OBOHpwo1Qr-Dm_IYi8SCKWOrJdKqeArkVBqs2L5fGnW_A2c4HP_prSEWOcMhLdYpru33sUmuricKkQSW31Ttow5tVVsY5EB_flIvcMZNih8QSH-PZ8W_xjC9ntmqdiT23ehGgtLiGYgXISAnKPWBqGmxMtzVo Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 5019dc727595447788a8bc35e65f73f4 Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminTestJSON-2124938621 Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:51:55.622741 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5019dc727595447788a8bc35e65f73f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5019dc727595447788a8bc35e65f73f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5019dc727595447788a8bc35e65f73f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5019dc727595447788a8bc35e65f73f4"}]}] Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminTestJSON-2124938621 Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 5019dc727595447788a8bc35e65f73f4 Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2124938621 Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminTestJSON-2124938621-project-admin Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 8d632987b71c43a48ce8a00e3eaa7c08 Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminTestJSON-2124938621-project-admin Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: exception: Aggregate 6 could not be found. Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '6'} Aug 23 17:51:55.624166 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:51:55.624842 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:55.625827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:55.627469 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:55.627469 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:55.627469 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:55.627469 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Aug 23 17:51:55.627469 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.631464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef10d4f0-ce3a-4b91-954e-533204d4cea2 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:55.632814 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef10d4f0-ce3a-4b91-954e-533204d4cea2 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.085621 Aug 23 17:51:55.633577 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 127/244] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:55 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:51:55.643238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5234631b-bddb-4322-99e9-5858507a4467 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1167850356", "name": "tempest-test_aggregate-791793864"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:55.648873 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ab4010ba-4ddd-44c9-954a-ac5b08679324 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 239 microversion: 2.1 time: 0.204304 Aug 23 17:51:55.653897 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 118/245] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:51:55 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 239 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:55.671578 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.671578 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:55.673114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.aggregate [None req-5234631b-bddb-4322-99e9-5858507a4467 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Generated uuid e383044f-467f-40b8-b017-3f3a917c18e7 for aggregate {{(pid=128808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:51:55.676986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2b5f2378-fb38-4329-86b8-f38570821051 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Calling method '.version_select at 0x7f27ed352e50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.695052 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.695052 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:55.698221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b5f2378-fb38-4329-86b8-f38570821051 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.698741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b5f2378-fb38-4329-86b8-f38570821051 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.700816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b5f2378-fb38-4329-86b8-f38570821051 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.704621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b5f2378-fb38-4329-86b8-f38570821051 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.707518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b5f2378-fb38-4329-86b8-f38570821051 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.708211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b5f2378-fb38-4329-86b8-f38570821051 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.747146 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5234631b-bddb-4322-99e9-5858507a4467 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.107499 Aug 23 17:51:55.756802 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 128/246] 10.222.0.61 () {60 vars in 1165 bytes} [Tue Aug 23 17:51:55 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:55.763922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2659dbe4-19b5-4fad-b7f9-d5db772e5553 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.764906 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.764906 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:55.790848 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2b5f2378-fb38-4329-86b8-f38570821051 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.121268 Aug 23 17:51:55.794759 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 119/247] 10.222.0.61 () {58 vars in 1128 bytes} [Tue Aug 23 17:51:55 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:55.813081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3c949ea8-af32-4173-9639-789b9a71f951 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Calling method '.version_select at 0x7f27ed3dc700>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.814289 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.814289 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:55.822810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c949ea8-af32-4173-9639-789b9a71f951 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.827053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c949ea8-af32-4173-9639-789b9a71f951 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.831448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c949ea8-af32-4173-9639-789b9a71f951 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.842863 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2659dbe4-19b5-4fad-b7f9-d5db772e5553 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.084175 Aug 23 17:51:55.844360 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 129/248] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:55 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:51:55.870386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c949ea8-af32-4173-9639-789b9a71f951 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.870938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c949ea8-af32-4173-9639-789b9a71f951 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.871369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c949ea8-af32-4173-9639-789b9a71f951 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.888009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9b3370ca-9158-4e57-853f-4b621ab88d98 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.892802 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3c949ea8-af32-4173-9639-789b9a71f951 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-h1-850468-16" status: 200 len: 603 microversion: 2.1 time: 0.094066 Aug 23 17:51:55.893796 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 120/249] 10.222.0.61 () {58 vars in 1173 bytes} [Tue Aug 23 17:51:55 2022] GET /compute/v2.1/os-hosts/n-h1-850468-16 => generated 603 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:55.906128 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.906128 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:55.916773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-522c30f9-bfbc-42cf-ba3c-3922d2c91116 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Calling method '.version_select at 0x7f27ed3dc040>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.919074 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.919074 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:55.927842 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-9b3370ca-9158-4e57-853f-4b621ab88d98 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 23 17:51:55.930196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-522c30f9-bfbc-42cf-ba3c-3922d2c91116 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9b3370ca-9158-4e57-853f-4b621ab88d98 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Request method failure captured: Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRODYd2iRJXmlGWTe_OBOHpwo1Qr-Dm_IYi8SCKWOrJdKqeArkVBqs2L5fGnW_A2c4HP_prSEWOcMhLdYpru33sUmuricKkQSW31Ttow5tVVsY5EB_flIvcMZNih8QSH-PZ8W_xjC9ntmqdiT23ehGgtLiGYgXISAnKPWBqGmxMtzVo Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 5019dc727595447788a8bc35e65f73f4 Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminTestJSON-2124938621 Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:51:55.930715 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5019dc727595447788a8bc35e65f73f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5019dc727595447788a8bc35e65f73f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5019dc727595447788a8bc35e65f73f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5019dc727595447788a8bc35e65f73f4"}]}] Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminTestJSON-2124938621 Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 5019dc727595447788a8bc35e65f73f4 Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2124938621 Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminTestJSON-2124938621-project-admin Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 8d632987b71c43a48ce8a00e3eaa7c08 Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminTestJSON-2124938621-project-admin Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: exception: Aggregate 7 could not be found. Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '7'} Aug 23 17:51:55.931853 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:55.932556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 23 17:51:55.937532 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.938969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9b3370ca-9158-4e57-853f-4b621ab88d98 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:55.938969 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9b3370ca-9158-4e57-853f-4b621ab88d98 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.080134 Aug 23 17:51:55.938969 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 130/250] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Aug 23 17:51:55 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:51:55.939931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-522c30f9-bfbc-42cf-ba3c-3922d2c91116 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.939931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-522c30f9-bfbc-42cf-ba3c-3922d2c91116 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.947883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a9152b1f-1336-4700-8e52-09e4cb63fa94 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:55.948647 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:55.948647 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:55.961612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=81,nova_api:DELETE=15,nova_api:INSERT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:55.975529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-522c30f9-bfbc-42cf-ba3c-3922d2c91116 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:55.978136 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-a9152b1f-1336-4700-8e52-09e4cb63fa94 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Aug 23 17:51:55.978763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-522c30f9-bfbc-42cf-ba3c-3922d2c91116 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:55.979348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-522c30f9-bfbc-42cf-ba3c-3922d2c91116 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a9152b1f-1336-4700-8e52-09e4cb63fa94 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Request method failure captured: Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRODYd2iRJXmlGWTe_OBOHpwo1Qr-Dm_IYi8SCKWOrJdKqeArkVBqs2L5fGnW_A2c4HP_prSEWOcMhLdYpru33sUmuricKkQSW31Ttow5tVVsY5EB_flIvcMZNih8QSH-PZ8W_xjC9ntmqdiT23ehGgtLiGYgXISAnKPWBqGmxMtzVo Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 5019dc727595447788a8bc35e65f73f4 Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminTestJSON-2124938621 Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:51:55.982822 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5019dc727595447788a8bc35e65f73f4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5019dc727595447788a8bc35e65f73f4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5019dc727595447788a8bc35e65f73f4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5019dc727595447788a8bc35e65f73f4"}]}] Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminTestJSON-2124938621 Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 5019dc727595447788a8bc35e65f73f4 Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2124938621 Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminTestJSON-2124938621-project-admin Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 8d632987b71c43a48ce8a00e3eaa7c08 Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminTestJSON-2124938621-project-admin Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: exception: Aggregate 7 could not be found. Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '7'} Aug 23 17:51:55.984265 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:51:55.984946 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:55.985980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:55.987737 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:55.987737 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:55.987737 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:55.987737 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Aug 23 17:51:55.987737 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:55.987737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a9152b1f-1336-4700-8e52-09e4cb63fa94 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:55.987737 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a9152b1f-1336-4700-8e52-09e4cb63fa94 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.048112 Aug 23 17:51:55.994347 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 131/251] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:55 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:51:56.005864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d81066ac-5397-4e55-8817-b324d9c54034 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-431290400"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:56.008440 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:56.008440 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:56.009350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.aggregate [None req-d81066ac-5397-4e55-8817-b324d9c54034 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Generated uuid d46703aa-5561-4808-be91-44284e0569db for aggregate {{(pid=128808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:51:56.017433 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-522c30f9-bfbc-42cf-ba3c-3922d2c91116 tempest-HostsAdminTestJSON-193764708 tempest-HostsAdminTestJSON-193764708-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-h2-850468-16" status: 200 len: 471 microversion: 2.1 time: 0.116995 Aug 23 17:51:56.018006 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 121/252] 10.222.0.61 () {58 vars in 1173 bytes} [Tue Aug 23 17:51:55 2022] GET /compute/v2.1/os-hosts/n-h2-850468-16 => generated 471 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:51:56.041865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-01faf57c-015c-4e50-8506-06bfdb83e18b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:56.042733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-01faf57c-015c-4e50-8506-06bfdb83e18b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:56.054159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01faf57c-015c-4e50-8506-06bfdb83e18b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:56.055574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01faf57c-015c-4e50-8506-06bfdb83e18b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:56.061091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01faf57c-015c-4e50-8506-06bfdb83e18b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:56.063961 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d81066ac-5397-4e55-8817-b324d9c54034 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.068330 Aug 23 17:51:56.064977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01faf57c-015c-4e50-8506-06bfdb83e18b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:56.065630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01faf57c-015c-4e50-8506-06bfdb83e18b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:56.066183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01faf57c-015c-4e50-8506-06bfdb83e18b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:56.072915 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 132/253] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:51:55 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:56.086620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-90680096-81fb-401b-8b27-a2a38d2c8f6b tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:56.088698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-90680096-81fb-401b-8b27-a2a38d2c8f6b tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] [instance: f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:56.106648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90680096-81fb-401b-8b27-a2a38d2c8f6b tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:56.108755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90680096-81fb-401b-8b27-a2a38d2c8f6b tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:56.110301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90680096-81fb-401b-8b27-a2a38d2c8f6b tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:56.113504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90680096-81fb-401b-8b27-a2a38d2c8f6b tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:56.114448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90680096-81fb-401b-8b27-a2a38d2c8f6b tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:56.114904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90680096-81fb-401b-8b27-a2a38d2c8f6b tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:56.130089 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-90680096-81fb-401b-8b27-a2a38d2c8f6b tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] HTTP exception thrown: Instance f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 could not be found. Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-90680096-81fb-401b-8b27-a2a38d2c8f6b tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Request method failure captured: Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 HTTP/1.1 Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROa_6utOzrjwzZ4D1Hwmt3qm1YqOztbLb1JjR6-3las0Y9z8mQxd-KNUgjL7ErZMxrfzmj78n4aToShbGI3oHcid48gJkqRonyymxxW5pCSOS0DFw23gyMrFkTSBYhX3M36ig_yU_tmEhEaQGCV5kqFcuhglAWdVscdTRnMlELwM6c Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 14bb3c54fe3c4157a7808f4c6a62034f Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-514533588 Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:51:56.131968 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:51:56.133107 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_14bb3c54fe3c4157a7808f4c6a62034f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/14bb3c54fe3c4157a7808f4c6a62034f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/14bb3c54fe3c4157a7808f4c6a62034f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/14bb3c54fe3c4157a7808f4c6a62034f"}]}] Aug 23 17:51:56.133107 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-514533588 Aug 23 17:51:56.133107 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 14bb3c54fe3c4157a7808f4c6a62034f Aug 23 17:51:56.133107 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-514533588 Aug 23 17:51:56.133107 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerDiagnosticsNegativeTest-514533588-project Aug 23 17:51:56.133107 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:56.133107 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:56.133107 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b1646f2e71ee4df08628bedd5eb729b2 Aug 23 17:51:56.133107 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-514533588-project Aug 23 17:51:56.133107 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:56.133107 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 could not be found. Aug 23 17:51:56.133107 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9'} Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 could not be found. Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:56.133767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 could not be found. Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 could not be found. Aug 23 17:51:56.135461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:56.136500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-90680096-81fb-401b-8b27-a2a38d2c8f6b tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] Returning 404 to user: Instance f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:56.136500 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-90680096-81fb-401b-8b27-a2a38d2c8f6b tempest-ServerDiagnosticsNegativeTest-514533588 tempest-ServerDiagnosticsNegativeTest-514533588-project] 10.222.0.61 "GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9" status: 404 len: 111 microversion: 2.1 time: 0.057517 Aug 23 17:51:56.137721 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 133/254] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:56 2022] GET /compute/v2.1/servers/f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:56.143977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-891ea085-707e-4039-a7a9-b04eb784aeec tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:56.145084 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:56.145084 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:56.152766 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-891ea085-707e-4039-a7a9-b04eb784aeec tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.013957 Aug 23 17:51:56.161158 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 134/255] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Aug 23 17:51:56 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:56.167023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c08e8170-86d5-42cb-8f18-56df3751c4a7 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:56.170862 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:56.170862 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:56.209526 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c08e8170-86d5-42cb-8f18-56df3751c4a7 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.046479 Aug 23 17:51:56.210372 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 135/256] 10.222.0.61 () {60 vars in 1191 bytes} [Tue Aug 23 17:51:56 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:56.224262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-60569e20-f617-498f-bbe4-cdcbae01147b tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:56.229270 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:56.229270 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:56.239445 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-60569e20-f617-498f-bbe4-cdcbae01147b tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.020621 Aug 23 17:51:56.240948 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 136/257] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Aug 23 17:51:56 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:56.248167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-51863869-599a-49bd-b4a7-6465965648ff req-fec46e7f-7746-4ef9-a1ce-a02aa2266d3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9", "name": "network-vif-deleted", "tag": "7ce3b50f-9f8f-4b64-8d95-b2b9f2973584"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:56.260166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-51863869-599a-49bd-b4a7-6465965648ff req-fec46e7f-7746-4ef9-a1ce-a02aa2266d3d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:56.260954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-51863869-599a-49bd-b4a7-6465965648ff req-fec46e7f-7746-4ef9-a1ce-a02aa2266d3d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:56.261699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-51863869-599a-49bd-b4a7-6465965648ff req-fec46e7f-7746-4ef9-a1ce-a02aa2266d3d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:56.275773 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-51863869-599a-49bd-b4a7-6465965648ff req-fec46e7f-7746-4ef9-a1ce-a02aa2266d3d service nova] Creating event network-vif-deleted:7ce3b50f-9f8f-4b64-8d95-b2b9f2973584 for instance f2ca0d9c-7097-49b3-8b4d-d9b1f56526a9 on n-h2-850468-16 Aug 23 17:51:56.282679 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-51863869-599a-49bd-b4a7-6465965648ff req-fec46e7f-7746-4ef9-a1ce-a02aa2266d3d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040208 Aug 23 17:51:56.284127 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 137/258] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:51:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:56.293170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e56999db-a817-4af1-9f54-44ec506bb83e tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:56.294701 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:56.294701 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:56.330700 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e56999db-a817-4af1-9f54-44ec506bb83e tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.042738 Aug 23 17:51:56.332091 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 138/259] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:56 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:51:56.351568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7358e639-e9ec-4308-8c18-3f3cf1c5b1da tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:56.352716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7358e639-e9ec-4308-8c18-3f3cf1c5b1da tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:56.368440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7358e639-e9ec-4308-8c18-3f3cf1c5b1da tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:56.369650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7358e639-e9ec-4308-8c18-3f3cf1c5b1da tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:56.371123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7358e639-e9ec-4308-8c18-3f3cf1c5b1da tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:56.372074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7358e639-e9ec-4308-8c18-3f3cf1c5b1da tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:56.373416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7358e639-e9ec-4308-8c18-3f3cf1c5b1da tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:56.374188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7358e639-e9ec-4308-8c18-3f3cf1c5b1da tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:56.488602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-01faf57c-015c-4e50-8506-06bfdb83e18b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:56.505699 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-01faf57c-015c-4e50-8506-06bfdb83e18b tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1320 microversion: 2.1 time: 0.465986 Aug 23 17:51:56.506818 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 122/260] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:56 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1320 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:51:56.517781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7ed23cea-3ce6-434f-8697-9a3dd885d1c2 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1613088861", "availability_zone": "tempest-test_az-1017412078"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:56.568042 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:56.568042 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:51:56.569509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.aggregate [None req-7ed23cea-3ce6-434f-8697-9a3dd885d1c2 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Generated uuid 7ca2f9fb-206b-4915-a824-6bbd4f71c95a for aggregate {{(pid=128807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:51:56.631139 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7ed23cea-3ce6-434f-8697-9a3dd885d1c2 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 222 microversion: 2.1 time: 0.119816 Aug 23 17:51:56.632738 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 123/261] 10.222.0.61 () {60 vars in 1165 bytes} [Tue Aug 23 17:51:56 2022] POST /compute/v2.1/os-aggregates => generated 222 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:56.650571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-34fc1411-6276-4bc7-80c3-a88fbb984262 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:56.654649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-34fc1411-6276-4bc7-80c3-a88fbb984262 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:56.664443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7358e639-e9ec-4308-8c18-3f3cf1c5b1da tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:56.673695 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7358e639-e9ec-4308-8c18-3f3cf1c5b1da tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1331 microversion: 2.1 time: 0.338726 Aug 23 17:51:56.674295 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 139/262] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:56 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1331 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:56.678117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34fc1411-6276-4bc7-80c3-a88fbb984262 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:56.680598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34fc1411-6276-4bc7-80c3-a88fbb984262 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:56.683819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34fc1411-6276-4bc7-80c3-a88fbb984262 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:56.685202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34fc1411-6276-4bc7-80c3-a88fbb984262 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:56.686769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34fc1411-6276-4bc7-80c3-a88fbb984262 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:56.687380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34fc1411-6276-4bc7-80c3-a88fbb984262 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:56.700639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fef27e2e-a208-44ee-931b-765a305c1b5f tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1613088861_new", "availability_zone": "tempest-test_az-1017412078_new"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:56.799181 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:56.799181 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:56.854475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fef27e2e-a208-44ee-931b-765a305c1b5f tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:56.855969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fef27e2e-a208-44ee-931b-765a305c1b5f tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:56.856688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fef27e2e-a208-44ee-931b-765a305c1b5f tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:56.929542 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fef27e2e-a208-44ee-931b-765a305c1b5f tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 336 microversion: 2.1 time: 0.240157 Aug 23 17:51:56.930162 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 140/263] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Aug 23 17:51:56 2022] PUT /compute/v2.1/os-aggregates/9 => generated 336 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:56.946960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e65a272-49c4-4ab9-9b1e-b57268971c96 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:56.952899 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:56.952899 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:56.971463 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e65a272-49c4-4ab9-9b1e-b57268971c96 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 339 microversion: 2.1 time: 0.028937 Aug 23 17:51:56.979023 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 141/264] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 17:51:56 2022] GET /compute/v2.1/os-aggregates => generated 339 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:56.994915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-da5c2a96-24bc-46f0-b7d7-9b8267f59e29 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:56.995791 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:56.995791 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:57.062647 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-da5c2a96-24bc-46f0-b7d7-9b8267f59e29 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.078834 Aug 23 17:51:57.063278 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 142/265] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:51:56 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:51:57.073555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-522a450c-8dcb-4530-b880-9fe5456cf8d4 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1594823267"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:57.077691 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:57.077691 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:57.079541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.aggregate [None req-522a450c-8dcb-4530-b880-9fe5456cf8d4 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Generated uuid a6d1210e-425b-4f54-bc36-4b7c1f765171 for aggregate {{(pid=128808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:51:57.112279 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-522a450c-8dcb-4530-b880-9fe5456cf8d4 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.042978 Aug 23 17:51:57.123250 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 143/266] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:51:57 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:57.131780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a10c8a58-f776-4691-9f5f-d9b0a1bac047 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:57.132648 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:57.132648 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:57.151674 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a10c8a58-f776-4691-9f5f-d9b0a1bac047 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.027232 Aug 23 17:51:57.152251 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 144/267] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 17:51:57 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:57.164379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-372867cb-ced2-46a1-a554-eec7f20f58c6 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:57.165754 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:51:57.165754 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:51:57.243092 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-372867cb-ced2-46a1-a554-eec7f20f58c6 tempest-AggregatesAdminTestJSON-2124938621 tempest-AggregatesAdminTestJSON-2124938621-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.080500 Aug 23 17:51:57.247607 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 145/268] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:51:57 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 23 17:51:57.256118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4d164726-7ed8-45c7-8233-4c05fe8587ae tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:57.256641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4d164726-7ed8-45c7-8233-4c05fe8587ae tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:57.278238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d164726-7ed8-45c7-8233-4c05fe8587ae tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:57.278942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d164726-7ed8-45c7-8233-4c05fe8587ae tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:57.279600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d164726-7ed8-45c7-8233-4c05fe8587ae tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:57.280295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d164726-7ed8-45c7-8233-4c05fe8587ae tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:57.280809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d164726-7ed8-45c7-8233-4c05fe8587ae tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:57.281272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d164726-7ed8-45c7-8233-4c05fe8587ae tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:57.322720 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-4d164726-7ed8-45c7-8233-4c05fe8587ae tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] HTTP exception thrown: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4d164726-7ed8-45c7-8233-4c05fe8587ae tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Request method failure captured: Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 HTTP/1.1 Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROB3Xbzlh-aKx-U4YrIPzJLJw_vVla51-oM1cnRraqrLBL87nYZ8tYx-pozRtzLrWmDDOLXcn1OOgB_ukdD2UMmvird0DfEN3ci6RkW2dBfI1OP3gSWnMf4yWLo1lVkt8deLCPPxrjHONHxWkOE13RVvdVaj_jcN-mJYnXEt_4ct1I Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: e4bfa5ee9a774b419208f692b2faa8a8 Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminTestJSON-2022773389 Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:51:57.333808 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:51:57.336167 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e4bfa5ee9a774b419208f692b2faa8a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e4bfa5ee9a774b419208f692b2faa8a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e4bfa5ee9a774b419208f692b2faa8a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e4bfa5ee9a774b419208f692b2faa8a8"}]}] Aug 23 17:51:57.336167 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminTestJSON-2022773389 Aug 23 17:51:57.336167 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: e4bfa5ee9a774b419208f692b2faa8a8 Aug 23 17:51:57.336167 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2022773389 Aug 23 17:51:57.336167 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminTestJSON-2022773389-project Aug 23 17:51:57.336167 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:57.336167 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:57.336167 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 5b6558f47031454cbfec53c0f5d1ca23 Aug 23 17:51:57.336167 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminTestJSON-2022773389-project Aug 23 17:51:57.336167 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:57.336167 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:57.336167 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '9bc9c68a-9939-4cc7-ac2a-cf726ba91792'} Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:57.337610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:57.340487 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:57.349998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4d164726-7ed8-45c7-8233-4c05fe8587ae tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Returning 404 to user: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:57.349998 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4d164726-7ed8-45c7-8233-4c05fe8587ae tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 404 len: 111 microversion: 2.1 time: 0.100333 Aug 23 17:51:57.351642 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 146/269] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:51:57 2022] DELETE /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:57.361534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9e2fef94-6b14-4b7f-8ab7-de89a2fc71e8 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:57.364758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9e2fef94-6b14-4b7f-8ab7-de89a2fc71e8 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] [instance: 9bc9c68a-9939-4cc7-ac2a-cf726ba91792] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:57.392027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e2fef94-6b14-4b7f-8ab7-de89a2fc71e8 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:57.400247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e2fef94-6b14-4b7f-8ab7-de89a2fc71e8 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:57.402613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e2fef94-6b14-4b7f-8ab7-de89a2fc71e8 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:57.403618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e2fef94-6b14-4b7f-8ab7-de89a2fc71e8 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:57.404517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e2fef94-6b14-4b7f-8ab7-de89a2fc71e8 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:57.405207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e2fef94-6b14-4b7f-8ab7-de89a2fc71e8 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:57.435972 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-9e2fef94-6b14-4b7f-8ab7-de89a2fc71e8 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] HTTP exception thrown: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9e2fef94-6b14-4b7f-8ab7-de89a2fc71e8 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Request method failure captured: Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 HTTP/1.1 Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROB3Xbzlh-aKx-U4YrIPzJLJw_vVla51-oM1cnRraqrLBL87nYZ8tYx-pozRtzLrWmDDOLXcn1OOgB_ukdD2UMmvird0DfEN3ci6RkW2dBfI1OP3gSWnMf4yWLo1lVkt8deLCPPxrjHONHxWkOE13RVvdVaj_jcN-mJYnXEt_4ct1I Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: e4bfa5ee9a774b419208f692b2faa8a8 Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminTestJSON-2022773389 Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:51:57.437820 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:51:57.439013 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e4bfa5ee9a774b419208f692b2faa8a8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e4bfa5ee9a774b419208f692b2faa8a8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e4bfa5ee9a774b419208f692b2faa8a8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e4bfa5ee9a774b419208f692b2faa8a8"}]}] Aug 23 17:51:57.439013 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminTestJSON-2022773389 Aug 23 17:51:57.439013 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: e4bfa5ee9a774b419208f692b2faa8a8 Aug 23 17:51:57.439013 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-2022773389 Aug 23 17:51:57.439013 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminTestJSON-2022773389-project Aug 23 17:51:57.439013 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:51:57.439013 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:51:57.439013 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 5b6558f47031454cbfec53c0f5d1ca23 Aug 23 17:51:57.439013 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminTestJSON-2022773389-project Aug 23 17:51:57.439013 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:51:57.439013 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:57.439013 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '9bc9c68a-9939-4cc7-ac2a-cf726ba91792'} Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:51:57.439655 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. Aug 23 17:51:57.440826 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:51:57.444000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9e2fef94-6b14-4b7f-8ab7-de89a2fc71e8 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] Returning 404 to user: Instance 9bc9c68a-9939-4cc7-ac2a-cf726ba91792 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:51:57.445075 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9e2fef94-6b14-4b7f-8ab7-de89a2fc71e8 tempest-AggregatesAdminTestJSON-2022773389 tempest-AggregatesAdminTestJSON-2022773389-project] 10.222.0.61 "GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792" status: 404 len: 111 microversion: 2.1 time: 0.087637 Aug 23 17:51:57.446096 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 147/270] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:57 2022] GET /compute/v2.1/servers/9bc9c68a-9939-4cc7-ac2a-cf726ba91792 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:51:57.534520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d750fad8-6aa0-419d-a903-76860340d7d3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:57.535374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d750fad8-6aa0-419d-a903-76860340d7d3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:57.550569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d750fad8-6aa0-419d-a903-76860340d7d3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:57.551281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d750fad8-6aa0-419d-a903-76860340d7d3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:57.553525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d750fad8-6aa0-419d-a903-76860340d7d3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:57.555558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d750fad8-6aa0-419d-a903-76860340d7d3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:57.557178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d750fad8-6aa0-419d-a903-76860340d7d3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:57.558837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d750fad8-6aa0-419d-a903-76860340d7d3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:57.660397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-34fc1411-6276-4bc7-80c3-a88fbb984262 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:57.668644 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-34fc1411-6276-4bc7-80c3-a88fbb984262 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1388 microversion: 2.1 time: 1.034448 Aug 23 17:51:57.671321 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 124/271] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:56 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1388 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:57.876051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d750fad8-6aa0-419d-a903-76860340d7d3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:57.893832 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d750fad8-6aa0-419d-a903-76860340d7d3 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1320 microversion: 2.1 time: 0.360959 Aug 23 17:51:57.893832 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 148/272] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:57 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1320 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:57.906383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d824f178-b7d7-4854-ae6a-7a183da9e6c6 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:57.911348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d824f178-b7d7-4854-ae6a-7a183da9e6c6 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:57.920324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d824f178-b7d7-4854-ae6a-7a183da9e6c6 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:57.921000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d824f178-b7d7-4854-ae6a-7a183da9e6c6 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:57.921547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d824f178-b7d7-4854-ae6a-7a183da9e6c6 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:57.922401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d824f178-b7d7-4854-ae6a-7a183da9e6c6 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:57.923003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d824f178-b7d7-4854-ae6a-7a183da9e6c6 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:57.923555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d824f178-b7d7-4854-ae6a-7a183da9e6c6 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:58.108099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d824f178-b7d7-4854-ae6a-7a183da9e6c6 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:58.120301 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d824f178-b7d7-4854-ae6a-7a183da9e6c6 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1331 microversion: 2.1 time: 0.226306 Aug 23 17:51:58.121685 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 149/273] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:57 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1331 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:58.140278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-27d077a4-92ac-4b00-a682-100c76ef126e req-84672909-c1db-4eec-97ee-0e01847ab52a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384a38ca-06b1-4f61-a6f1-fd316e2d373a", "tag": "126444e3-4ac6-4d94-b3f6-dfeee1a150a5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:58.154160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-27d077a4-92ac-4b00-a682-100c76ef126e req-84672909-c1db-4eec-97ee-0e01847ab52a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:58.154835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-27d077a4-92ac-4b00-a682-100c76ef126e req-84672909-c1db-4eec-97ee-0e01847ab52a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:58.156357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-27d077a4-92ac-4b00-a682-100c76ef126e req-84672909-c1db-4eec-97ee-0e01847ab52a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:58.169942 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-27d077a4-92ac-4b00-a682-100c76ef126e req-84672909-c1db-4eec-97ee-0e01847ab52a service nova] Creating event network-changed:126444e3-4ac6-4d94-b3f6-dfeee1a150a5 for instance 384a38ca-06b1-4f61-a6f1-fd316e2d373a on n-h1-850468-16 Aug 23 17:51:58.177453 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-27d077a4-92ac-4b00-a682-100c76ef126e req-84672909-c1db-4eec-97ee-0e01847ab52a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040613 Aug 23 17:51:58.179075 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 150/274] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:51:58.260493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-1037157484", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": "none"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:58.328603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:51:58.329246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:51:58.330056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:51:58.330796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:51:58.331422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:51:58.342860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:58.343774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:58.344374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:58.345404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:58.346174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:58.346832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:58.369668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Getting quotas for project cb3d7bb9771d4263987873b4f635d778. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:51:58.375352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Getting quotas for user bc39304646834dac8c1dd65311536535 and project cb3d7bb9771d4263987873b4f635d778. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:51:58.389838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:51:58.392430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:51:58.507887 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d0d1d8d-7a5f-47a1-b5d0-214faf11b5dc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.830110 Aug 23 17:51:58.511279 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 125/275] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 17:51:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 839 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 17:51:58.527499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7e28694b-ea21-44d1-a9ec-0f42ee70c49d tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:51:58.555696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7e28694b-ea21-44d1-a9ec-0f42ee70c49d tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:58.691248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d784f78a-e91a-46ec-ba6d-cfee108be16a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:58.693479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d784f78a-e91a-46ec-ba6d-cfee108be16a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:58.704624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d784f78a-e91a-46ec-ba6d-cfee108be16a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:58.708894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d784f78a-e91a-46ec-ba6d-cfee108be16a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:58.709882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d784f78a-e91a-46ec-ba6d-cfee108be16a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:58.713900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d784f78a-e91a-46ec-ba6d-cfee108be16a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:58.714976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d784f78a-e91a-46ec-ba6d-cfee108be16a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:58.719421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d784f78a-e91a-46ec-ba6d-cfee108be16a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:58.857239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7e28694b-ea21-44d1-a9ec-0f42ee70c49d tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:58.869766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7e28694b-ea21-44d1-a9ec-0f42ee70c49d tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:58.871303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7e28694b-ea21-44d1-a9ec-0f42ee70c49d tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:58.887990 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7e28694b-ea21-44d1-a9ec-0f42ee70c49d tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "PUT /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1359 microversion: 2.75 time: 0.368705 Aug 23 17:51:58.891232 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 151/276] 10.222.0.61 () {62 vars in 1297 bytes} [Tue Aug 23 17:51:58 2022] PUT /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1359 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:51:58.913563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1843e345-ca0b-4034-96ef-dc1d4cb8d41c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:58.914400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1843e345-ca0b-4034-96ef-dc1d4cb8d41c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:58.923899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1843e345-ca0b-4034-96ef-dc1d4cb8d41c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:58.928762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1843e345-ca0b-4034-96ef-dc1d4cb8d41c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:58.931567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1843e345-ca0b-4034-96ef-dc1d4cb8d41c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:58.932575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1843e345-ca0b-4034-96ef-dc1d4cb8d41c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:58.933381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1843e345-ca0b-4034-96ef-dc1d4cb8d41c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:58.933937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1843e345-ca0b-4034-96ef-dc1d4cb8d41c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:59.248709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d784f78a-e91a-46ec-ba6d-cfee108be16a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:59.252540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:51:59.264165 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d784f78a-e91a-46ec-ba6d-cfee108be16a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1388 microversion: 2.1 time: 0.571933 Aug 23 17:51:59.265436 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 126/277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:58 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1388 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:51:59.285943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2642644c-9f31-467a-a9ff-d36d5f5afa6f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:59.290787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2642644c-9f31-467a-a9ff-d36d5f5afa6f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:59.385956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1843e345-ca0b-4034-96ef-dc1d4cb8d41c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:59.398561 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1843e345-ca0b-4034-96ef-dc1d4cb8d41c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1320 microversion: 2.1 time: 0.488841 Aug 23 17:51:59.404282 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 152/278] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:58 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1320 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:51:59.418205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2642644c-9f31-467a-a9ff-d36d5f5afa6f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:59.423114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e69fc76a-de09-4a5a-8371-5d68e604de32 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:51:59.430977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2642644c-9f31-467a-a9ff-d36d5f5afa6f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:59.431986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e69fc76a-de09-4a5a-8371-5d68e604de32 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:51:59.436765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2642644c-9f31-467a-a9ff-d36d5f5afa6f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:59.453412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e69fc76a-de09-4a5a-8371-5d68e604de32 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:59.457366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e69fc76a-de09-4a5a-8371-5d68e604de32 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:59.462456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e69fc76a-de09-4a5a-8371-5d68e604de32 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:59.463493 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2642644c-9f31-467a-a9ff-d36d5f5afa6f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1359 microversion: 2.75 time: 0.191541 Aug 23 17:51:59.464422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e69fc76a-de09-4a5a-8371-5d68e604de32 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:51:59.468219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e69fc76a-de09-4a5a-8371-5d68e604de32 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:51:59.469019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e69fc76a-de09-4a5a-8371-5d68e604de32 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:51:59.469185 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 127/279] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:51:59 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1359 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:51:59.906716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e69fc76a-de09-4a5a-8371-5d68e604de32 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:51:59.922554 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e69fc76a-de09-4a5a-8371-5d68e604de32 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1331 microversion: 2.1 time: 0.516205 Aug 23 17:51:59.923580 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 153/280] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:51:59 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1331 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:00.198722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-e96dfcc3-68a0-4956-976a-e12a90ee1d05 req-b1f080fc-2b97-4141-ab12-0e72680e7fec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1684439-72b6-4fff-9624-39abf5a9552a", "tag": "be443953-eadd-4537-b630-37f66a56fe75"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:00.225817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e96dfcc3-68a0-4956-976a-e12a90ee1d05 req-b1f080fc-2b97-4141-ab12-0e72680e7fec service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:00.227477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e96dfcc3-68a0-4956-976a-e12a90ee1d05 req-b1f080fc-2b97-4141-ab12-0e72680e7fec service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:00.230156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e96dfcc3-68a0-4956-976a-e12a90ee1d05 req-b1f080fc-2b97-4141-ab12-0e72680e7fec service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:00.248751 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-e96dfcc3-68a0-4956-976a-e12a90ee1d05 req-b1f080fc-2b97-4141-ab12-0e72680e7fec service nova] Creating event network-changed:be443953-eadd-4537-b630-37f66a56fe75 for instance f1684439-72b6-4fff-9624-39abf5a9552a on n-h1-850468-16 Aug 23 17:52:00.255148 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-e96dfcc3-68a0-4956-976a-e12a90ee1d05 req-b1f080fc-2b97-4141-ab12-0e72680e7fec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061789 Aug 23 17:52:00.260286 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 128/281] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:52:00.286931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c73f116-540a-4236-a13a-ee6e117421cb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:00.287569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4c73f116-540a-4236-a13a-ee6e117421cb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:00.296129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c73f116-540a-4236-a13a-ee6e117421cb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:00.298329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c73f116-540a-4236-a13a-ee6e117421cb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:00.299017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c73f116-540a-4236-a13a-ee6e117421cb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:00.299933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c73f116-540a-4236-a13a-ee6e117421cb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:00.301447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c73f116-540a-4236-a13a-ee6e117421cb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:00.302109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c73f116-540a-4236-a13a-ee6e117421cb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:00.430351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2f4c8330-d090-4cdd-8367-7d28e241d9ea tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:00.431095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2f4c8330-d090-4cdd-8367-7d28e241d9ea tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:00.440995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f4c8330-d090-4cdd-8367-7d28e241d9ea tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:00.442283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f4c8330-d090-4cdd-8367-7d28e241d9ea tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:00.442764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f4c8330-d090-4cdd-8367-7d28e241d9ea tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:00.443491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f4c8330-d090-4cdd-8367-7d28e241d9ea tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:00.443954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f4c8330-d090-4cdd-8367-7d28e241d9ea tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:00.446042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f4c8330-d090-4cdd-8367-7d28e241d9ea tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:00.516385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4c73f116-540a-4236-a13a-ee6e117421cb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:00.524837 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4c73f116-540a-4236-a13a-ee6e117421cb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1388 microversion: 2.1 time: 0.243206 Aug 23 17:52:00.539525 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 154/282] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:00 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1388 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:00.545689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-671ea590-2e1e-4078-8e15-614e321b4d78 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:00.546515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-671ea590-2e1e-4078-8e15-614e321b4d78 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:00.555060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-671ea590-2e1e-4078-8e15-614e321b4d78 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:00.556249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-671ea590-2e1e-4078-8e15-614e321b4d78 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:00.556832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-671ea590-2e1e-4078-8e15-614e321b4d78 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:00.557720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-671ea590-2e1e-4078-8e15-614e321b4d78 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:00.558317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-671ea590-2e1e-4078-8e15-614e321b4d78 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:00.558932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-671ea590-2e1e-4078-8e15-614e321b4d78 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:00.656135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2f4c8330-d090-4cdd-8367-7d28e241d9ea tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:00.670621 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2f4c8330-d090-4cdd-8367-7d28e241d9ea tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1320 microversion: 2.1 time: 0.247854 Aug 23 17:52:00.671942 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 129/283] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:00 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1320 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:00.748392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-671ea590-2e1e-4078-8e15-614e321b4d78 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:00.757846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-671ea590-2e1e-4078-8e15-614e321b4d78 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:00.760078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-671ea590-2e1e-4078-8e15-614e321b4d78 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:00.766578 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-671ea590-2e1e-4078-8e15-614e321b4d78 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1411 microversion: 2.75 time: 0.225735 Aug 23 17:52:00.767408 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 155/284] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:00 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1411 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:00.946312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c85f8df-f0da-495b-a35f-1f3b28babd69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:00.947226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c85f8df-f0da-495b-a35f-1f3b28babd69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:00.954291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c85f8df-f0da-495b-a35f-1f3b28babd69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:00.954802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c85f8df-f0da-495b-a35f-1f3b28babd69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:00.955222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c85f8df-f0da-495b-a35f-1f3b28babd69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:00.956035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c85f8df-f0da-495b-a35f-1f3b28babd69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:00.957046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c85f8df-f0da-495b-a35f-1f3b28babd69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:00.957481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c85f8df-f0da-495b-a35f-1f3b28babd69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:01.122756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c85f8df-f0da-495b-a35f-1f3b28babd69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:01.131930 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c85f8df-f0da-495b-a35f-1f3b28babd69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1331 microversion: 2.1 time: 0.190507 Aug 23 17:52:01.138869 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 130/285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:00 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1331 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:01.554299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a91c6c31-d20b-44f0-988d-2ea52c7a5914 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:01.555270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-be8296ec-3bbb-4098-871f-10f3470adc27 req-f2fe7b30-d6e6-4187-9878-37deecae1737 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304e504b-7767-46b3-8785-5010fac97f7a", "name": "network-vif-plugged", "status": "completed", "tag": "ec85963d-5c39-4e97-98c6-16cfd848ed74"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:01.558385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a91c6c31-d20b-44f0-988d-2ea52c7a5914 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:01.573737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-be8296ec-3bbb-4098-871f-10f3470adc27 req-f2fe7b30-d6e6-4187-9878-37deecae1737 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:01.574371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a91c6c31-d20b-44f0-988d-2ea52c7a5914 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:01.575001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a91c6c31-d20b-44f0-988d-2ea52c7a5914 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:01.576296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-be8296ec-3bbb-4098-871f-10f3470adc27 req-f2fe7b30-d6e6-4187-9878-37deecae1737 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:01.576447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a91c6c31-d20b-44f0-988d-2ea52c7a5914 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:01.577072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a91c6c31-d20b-44f0-988d-2ea52c7a5914 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:01.578377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-be8296ec-3bbb-4098-871f-10f3470adc27 req-f2fe7b30-d6e6-4187-9878-37deecae1737 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:01.580818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a91c6c31-d20b-44f0-988d-2ea52c7a5914 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:01.581260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a91c6c31-d20b-44f0-988d-2ea52c7a5914 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:01.600233 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-be8296ec-3bbb-4098-871f-10f3470adc27 req-f2fe7b30-d6e6-4187-9878-37deecae1737 service nova] Creating event network-vif-plugged:ec85963d-5c39-4e97-98c6-16cfd848ed74 for instance 304e504b-7767-46b3-8785-5010fac97f7a on n-h2-850468-16 Aug 23 17:52:01.610452 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-be8296ec-3bbb-4098-871f-10f3470adc27 req-f2fe7b30-d6e6-4187-9878-37deecae1737 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065095 Aug 23 17:52:01.611680 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 156/286] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:01.695389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7c47bede-5d28-410f-9657-d63b85db53f8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:01.696413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7c47bede-5d28-410f-9657-d63b85db53f8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:01.704431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c47bede-5d28-410f-9657-d63b85db53f8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:01.705204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c47bede-5d28-410f-9657-d63b85db53f8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:01.705641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c47bede-5d28-410f-9657-d63b85db53f8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:01.707099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c47bede-5d28-410f-9657-d63b85db53f8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:01.707714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c47bede-5d28-410f-9657-d63b85db53f8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:01.708524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c47bede-5d28-410f-9657-d63b85db53f8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:01.715438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:01.882674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7c47bede-5d28-410f-9657-d63b85db53f8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:01.891876 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7c47bede-5d28-410f-9657-d63b85db53f8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1320 microversion: 2.1 time: 0.202681 Aug 23 17:52:01.910622 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 157/287] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:01 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1320 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:01.916131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fb744f7c-55aa-4272-a95e-ad30a01451bb tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:01.917313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fb744f7c-55aa-4272-a95e-ad30a01451bb tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:01.926517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb744f7c-55aa-4272-a95e-ad30a01451bb tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:01.927248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb744f7c-55aa-4272-a95e-ad30a01451bb tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:01.927691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb744f7c-55aa-4272-a95e-ad30a01451bb tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:01.928390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb744f7c-55aa-4272-a95e-ad30a01451bb tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:01.928989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb744f7c-55aa-4272-a95e-ad30a01451bb tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:01.929420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb744f7c-55aa-4272-a95e-ad30a01451bb tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:02.010312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb744f7c-55aa-4272-a95e-ad30a01451bb tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:02.021888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb744f7c-55aa-4272-a95e-ad30a01451bb tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:02.024820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb744f7c-55aa-4272-a95e-ad30a01451bb tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:02.031396 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fb744f7c-55aa-4272-a95e-ad30a01451bb tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1417 microversion: 2.75 time: 0.122220 Aug 23 17:52:02.032594 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 158/288] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:01 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1417 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:02.055378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a91c6c31-d20b-44f0-988d-2ea52c7a5914 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:02.063297 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a91c6c31-d20b-44f0-988d-2ea52c7a5914 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1388 microversion: 2.1 time: 0.515542 Aug 23 17:52:02.063881 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 131/289] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:01 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1388 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:02.158384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3463257c-6ac8-4952-9b2c-f92580422259 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:02.159345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3463257c-6ac8-4952-9b2c-f92580422259 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:02.166633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3463257c-6ac8-4952-9b2c-f92580422259 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:02.167999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3463257c-6ac8-4952-9b2c-f92580422259 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:02.168694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3463257c-6ac8-4952-9b2c-f92580422259 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:02.169651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3463257c-6ac8-4952-9b2c-f92580422259 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:02.170327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3463257c-6ac8-4952-9b2c-f92580422259 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:02.171192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3463257c-6ac8-4952-9b2c-f92580422259 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:02.333700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3463257c-6ac8-4952-9b2c-f92580422259 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:02.343976 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3463257c-6ac8-4952-9b2c-f92580422259 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1331 microversion: 2.1 time: 0.191968 Aug 23 17:52:02.344826 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 159/290] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:02 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1331 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:02.894008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1906274961", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:02.914603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2d3d8563-f3e7-4b0c-925c-23420a26eebc tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:02.915212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2d3d8563-f3e7-4b0c-925c-23420a26eebc tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:02.922980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d3d8563-f3e7-4b0c-925c-23420a26eebc tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:02.923776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d3d8563-f3e7-4b0c-925c-23420a26eebc tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:02.924317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d3d8563-f3e7-4b0c-925c-23420a26eebc tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:02.925972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d3d8563-f3e7-4b0c-925c-23420a26eebc tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:02.926750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d3d8563-f3e7-4b0c-925c-23420a26eebc tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:02.927279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d3d8563-f3e7-4b0c-925c-23420a26eebc tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:02.978434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:52:03.117988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2d3d8563-f3e7-4b0c-925c-23420a26eebc tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:03.130069 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2d3d8563-f3e7-4b0c-925c-23420a26eebc tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1320 microversion: 2.1 time: 0.220488 Aug 23 17:52:03.137570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 160/291] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:02 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1320 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:03.149174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3835618d-1a3e-43a1-a0fd-59a407ee7d65 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:03.152785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3835618d-1a3e-43a1-a0fd-59a407ee7d65 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:03.159406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3835618d-1a3e-43a1-a0fd-59a407ee7d65 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:03.160284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3835618d-1a3e-43a1-a0fd-59a407ee7d65 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:03.160927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3835618d-1a3e-43a1-a0fd-59a407ee7d65 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:03.161823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3835618d-1a3e-43a1-a0fd-59a407ee7d65 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:03.162458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3835618d-1a3e-43a1-a0fd-59a407ee7d65 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:03.163094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3835618d-1a3e-43a1-a0fd-59a407ee7d65 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:03.265697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3835618d-1a3e-43a1-a0fd-59a407ee7d65 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:03.281295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3835618d-1a3e-43a1-a0fd-59a407ee7d65 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:03.283506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3835618d-1a3e-43a1-a0fd-59a407ee7d65 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:03.287407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3,nova_api:DELETE=6,nova_api:UPDATE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:03.290982 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3835618d-1a3e-43a1-a0fd-59a407ee7d65 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1417 microversion: 2.75 time: 0.151818 Aug 23 17:52:03.292089 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 161/292] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:03 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1417 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:03.313060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-336d4d85-3bf1-4814-a423-06748610d218 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:03.314075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-336d4d85-3bf1-4814-a423-06748610d218 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:03.321835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336d4d85-3bf1-4814-a423-06748610d218 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:03.323016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336d4d85-3bf1-4814-a423-06748610d218 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:03.323736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336d4d85-3bf1-4814-a423-06748610d218 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:03.324960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336d4d85-3bf1-4814-a423-06748610d218 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:03.330974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:52:03.332095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:52:03.332985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:52:03.333580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:52:03.333996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:52:03.338394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336d4d85-3bf1-4814-a423-06748610d218 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:03.339751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336d4d85-3bf1-4814-a423-06748610d218 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:03.351637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:03.354956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:03.355620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:03.358826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:03.359517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:03.362166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:03.406374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Getting quotas for project ce2f527311164c75ab2a834dc4208135. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:52:03.418467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Getting quotas for user fd1226e98e7248c080c79cc291c2ce3c and project ce2f527311164c75ab2a834dc4208135. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:52:03.443379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:52:03.446776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:52:03.513976 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-088167d9-bb57-47fb-86c0-701d63a9b636 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.038861 Aug 23 17:52:03.513976 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 132/293] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1042 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:52:03.524286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1487a171-99c4-4b01-b781-adde7a062f69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:03.524923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1487a171-99c4-4b01-b781-adde7a062f69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:03.543859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1487a171-99c4-4b01-b781-adde7a062f69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:03.544576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1487a171-99c4-4b01-b781-adde7a062f69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:03.547408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1487a171-99c4-4b01-b781-adde7a062f69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:03.548458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1487a171-99c4-4b01-b781-adde7a062f69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:03.549191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1487a171-99c4-4b01-b781-adde7a062f69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:03.549631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1487a171-99c4-4b01-b781-adde7a062f69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:03.700805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-336d4d85-3bf1-4814-a423-06748610d218 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:03.723166 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-336d4d85-3bf1-4814-a423-06748610d218 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1388 microversion: 2.1 time: 0.415324 Aug 23 17:52:03.724542 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 162/294] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:03 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1388 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:03.735138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2a80275-b60b-4ca2-a74a-815e8a0aca7e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:03.736557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f2a80275-b60b-4ca2-a74a-815e8a0aca7e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:03.813625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f2a80275-b60b-4ca2-a74a-815e8a0aca7e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:03.821374 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f2a80275-b60b-4ca2-a74a-815e8a0aca7e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1219 microversion: 2.1 time: 0.095914 Aug 23 17:52:03.832006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1487a171-99c4-4b01-b781-adde7a062f69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:03.840937 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 163/295] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:03 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1219 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:03.843050 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1487a171-99c4-4b01-b781-adde7a062f69 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1331 microversion: 2.1 time: 0.329273 Aug 23 17:52:03.844069 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 133/296] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:03 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1331 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:04.038781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-50ac7e20-a467-4ff4-a9e0-462e19a7ec54 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:04.041510 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:04.041510 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:04.042747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ac7e20-a467-4ff4-a9e0-462e19a7ec54 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.044208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ac7e20-a467-4ff4-a9e0-462e19a7ec54 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.046132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ac7e20-a467-4ff4-a9e0-462e19a7ec54 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.047126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ac7e20-a467-4ff4-a9e0-462e19a7ec54 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.048829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ac7e20-a467-4ff4-a9e0-462e19a7ec54 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.049601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ac7e20-a467-4ff4-a9e0-462e19a7ec54 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.084220 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-50ac7e20-a467-4ff4-a9e0-462e19a7ec54 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.202185 Aug 23 17:52:04.085221 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 164/297] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Aug 23 17:52:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:04.105300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-391548629", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:04.152637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc1af467-a250-457d-a6bb-cce6141e2c80 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Calling method '.version_select at 0x7f27ed3ce5e0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:04.153556 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:04.153556 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:04.155356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1af467-a250-457d-a6bb-cce6141e2c80 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.155654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1af467-a250-457d-a6bb-cce6141e2c80 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.156312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1af467-a250-457d-a6bb-cce6141e2c80 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.168656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:52:04.172031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1af467-a250-457d-a6bb-cce6141e2c80 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.172682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1af467-a250-457d-a6bb-cce6141e2c80 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.173264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1af467-a250-457d-a6bb-cce6141e2c80 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.185341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1af467-a250-457d-a6bb-cce6141e2c80 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.185828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1af467-a250-457d-a6bb-cce6141e2c80 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.186278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1af467-a250-457d-a6bb-cce6141e2c80 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.195402 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc1af467-a250-457d-a6bb-cce6141e2c80 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.108671 Aug 23 17:52:04.196413 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 165/298] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:04 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:04.204267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c8cf8c9-03a4-4af0-9345-f022e67cd29a tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-733802543"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:04.207414 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:04.207414 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:04.208429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.aggregate [None req-1c8cf8c9-03a4-4af0-9345-f022e67cd29a tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Generated uuid 155db527-568a-4cff-923d-8f39c1fe41e5 for aggregate {{(pid=128808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:52:04.231295 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c8cf8c9-03a4-4af0-9345-f022e67cd29a tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.033254 Aug 23 17:52:04.232007 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 166/299] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:52:04 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:04.236746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-16ad17c1-ed28-4424-942a-d4eedd9be6f4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:04.237277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-16ad17c1-ed28-4424-942a-d4eedd9be6f4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:04.244355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16ad17c1-ed28-4424-942a-d4eedd9be6f4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.244828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16ad17c1-ed28-4424-942a-d4eedd9be6f4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.245428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16ad17c1-ed28-4424-942a-d4eedd9be6f4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.246118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16ad17c1-ed28-4424-942a-d4eedd9be6f4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.246580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16ad17c1-ed28-4424-942a-d4eedd9be6f4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.247003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16ad17c1-ed28-4424-942a-d4eedd9be6f4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.382589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:52:04.383018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:52:04.383494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:52:04.383588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-16ad17c1-ed28-4424-942a-d4eedd9be6f4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:04.383934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:52:04.384344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:52:04.386640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=1,nova_api:INSERT=9 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:04.391562 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-16ad17c1-ed28-4424-942a-d4eedd9be6f4 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1320 microversion: 2.1 time: 0.158391 Aug 23 17:52:04.392203 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 167/300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:04 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1320 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:04.395184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.395670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.396105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.396833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.397287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.397801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.417380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Getting quotas for project 5c5a1c94aed149c489a20be456895034. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:52:04.421835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Getting quotas for user d81796ff5b934d218c1b967b8c0f9882 and project 5c5a1c94aed149c489a20be456895034. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:52:04.434892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:52:04.437158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:52:04.483347 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cac3d031-8e6f-4a2b-aba3-dc8a2050c370 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594171 Aug 23 17:52:04.484218 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 134/301] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 17:52:04.489251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7322b361-fa62-49f7-8e4d-3e07c3fdc869 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-16"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:04.491922 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:04.491922 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:04.497234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00144d0a-d20e-4649-9951-29070324e879 tempest-HypervisorAdminNegativeUnderV252Test-307458322 tempest-HypervisorAdminNegativeUnderV252Test-307458322-project] Calling method '.version_select at 0x7f27ed2e9a60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:04.497959 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:04.497959 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:04.499364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-00144d0a-d20e-4649-9951-29070324e879 tempest-HypervisorAdminNegativeUnderV252Test-307458322 tempest-HypervisorAdminNegativeUnderV252Test-307458322-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': '72e091534a054b459f790ef762c87cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced5c44bf5d64d7e86b677e6d6b06b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:04.501718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7322b361-fa62-49f7-8e4d-3e07c3fdc869 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.502209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7322b361-fa62-49f7-8e4d-3e07c3fdc869 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.502777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7322b361-fa62-49f7-8e4d-3e07c3fdc869 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00144d0a-d20e-4649-9951-29070324e879 tempest-HypervisorAdminNegativeUnderV252Test-307458322 tempest-HypervisorAdminNegativeUnderV252Test-307458322-project] Request method failure captured: Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-hypervisors/n-h1-850468-16/search HTTP/1.1 Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPCoo_V3VNwaz64UAQrQyl6_a9MaPV7VGote64lvbtttDyWCLLQlpBFZSXdInZRmEGduXtNfl8VvPevs8UDaiIgcB-lyhylUM1Q2FTljektndFiAurRy9rBmMjHZYWXXCb8u4ZeBwt1TxdPNvvvmcbz46z1cRwMLlY0_1Xj80Nk5Kk Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ced5c44bf5d64d7e86b677e6d6b06b48 Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-307458322 Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:04.511095 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:04.512293 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ced5c44bf5d64d7e86b677e6d6b06b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ced5c44bf5d64d7e86b677e6d6b06b48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ced5c44bf5d64d7e86b677e6d6b06b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ced5c44bf5d64d7e86b677e6d6b06b48"}]}] Aug 23 17:52:04.512293 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-307458322 Aug 23 17:52:04.512293 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ced5c44bf5d64d7e86b677e6d6b06b48 Aug 23 17:52:04.512293 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-307458322 Aug 23 17:52:04.512293 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-307458322-project Aug 23 17:52:04.512293 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:04.512293 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:04.512293 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 72e091534a054b459f790ef762c87cb1 Aug 23 17:52:04.512293 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-307458322-project Aug 23 17:52:04.512293 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:52:04.512293 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 23 17:52:04.512293 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'n-h1-850468-16'} Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:04.512969 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Aug 23 17:52:04.514910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.516782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00144d0a-d20e-4649-9951-29070324e879 tempest-HypervisorAdminNegativeUnderV252Test-307458322 tempest-HypervisorAdminNegativeUnderV252Test-307458322-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:04.516782 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-00144d0a-d20e-4649-9951-29070324e879 tempest-HypervisorAdminNegativeUnderV252Test-307458322 tempest-HypervisorAdminNegativeUnderV252Test-307458322-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/n-h1-850468-16/search" status: 403 len: 117 microversion: 2.1 time: 0.119128 Aug 23 17:52:04.517938 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 168/302] 10.222.0.61 () {58 vars in 1212 bytes} [Tue Aug 23 17:52:04 2022] GET /compute/v2.1/os-hypervisors/n-h1-850468-16/search => generated 117 bytes in 125 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:04.522899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a82df6c1-33c1-456d-b3d8-183be7d63751 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:04.523701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a82df6c1-33c1-456d-b3d8-183be7d63751 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:04.530899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a82df6c1-33c1-456d-b3d8-183be7d63751 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.531420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a82df6c1-33c1-456d-b3d8-183be7d63751 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.532076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a82df6c1-33c1-456d-b3d8-183be7d63751 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.532806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a82df6c1-33c1-456d-b3d8-183be7d63751 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.533452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a82df6c1-33c1-456d-b3d8-183be7d63751 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.534053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a82df6c1-33c1-456d-b3d8-183be7d63751 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.622964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a82df6c1-33c1-456d-b3d8-183be7d63751 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:04.633032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a82df6c1-33c1-456d-b3d8-183be7d63751 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:04.634770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a82df6c1-33c1-456d-b3d8-183be7d63751 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:04.640834 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a82df6c1-33c1-456d-b3d8-183be7d63751 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1417 microversion: 2.75 time: 0.121815 Aug 23 17:52:04.641403 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 169/303] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:04 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1417 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:04.647480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b379bfa0-9246-45ec-ae50-28cfe660f98f tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Calling method '.version_select at 0x7f27ed2e98b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:04.648448 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:search": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:04.648448 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:04.649506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b379bfa0-9246-45ec-ae50-28cfe660f98f tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.649991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b379bfa0-9246-45ec-ae50-28cfe660f98f tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.650428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b379bfa0-9246-45ec-ae50-28cfe660f98f tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.657172 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b379bfa0-9246-45ec-ae50-28cfe660f98f tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b379bfa0-9246-45ec-ae50-28cfe660f98f tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Request method failure captured: Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPDxGPwoV9CeNMWfzJdlqanLP-hA2D0uyMbB0-_MZnCUAPgGf_QVf0ZO7z5o5uZYBwkcb01yPkGt3OBNZI8pEWBMDCJ3yN17tGEyZgTFOPLR6JgqMEopeJkOABS3AH4gqj7a-csIL5UVtDSQXUjPwUB_UoyD7PLBrI_raJMOkXiQ7E Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: bbee4d747742408ba55fc7edfd01c9b9 Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2043805015 Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:52:04.658877 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:52:04.660258 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bbee4d747742408ba55fc7edfd01c9b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bbee4d747742408ba55fc7edfd01c9b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bbee4d747742408ba55fc7edfd01c9b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bbee4d747742408ba55fc7edfd01c9b9"}]}] Aug 23 17:52:04.660258 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2043805015 Aug 23 17:52:04.660258 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: bbee4d747742408ba55fc7edfd01c9b9 Aug 23 17:52:04.660258 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2043805015 Aug 23 17:52:04.660258 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin Aug 23 17:52:04.660258 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:04.660258 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:04.660258 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: d7ab8a3c7f134c649ad9405d76ad7e00 Aug 23 17:52:04.660258 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin Aug 23 17:52:04.660258 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:52:04.660258 n-d-850468-16 devstack@n-api.service[128808]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 23 17:52:04.660258 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'nonexistent_hypervisor_name'} Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:04.661010 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:04.662063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:04.662063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:04.662063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:04.662063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Aug 23 17:52:04.662063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.662343 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7322b361-fa62-49f7-8e4d-3e07c3fdc869 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 243 microversion: 2.1 time: 0.175349 Aug 23 17:52:04.662343 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 135/304] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 17:52:04 2022] POST /compute/v2.1/os-aggregates/11/action => generated 243 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:04.663753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b379bfa0-9246-45ec-ae50-28cfe660f98f tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:04.664666 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b379bfa0-9246-45ec-ae50-28cfe660f98f tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.021269 Aug 23 17:52:04.665420 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 170/305] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Aug 23 17:52:04 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:04.666445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1319823777", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:04.673999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bb9ad8d7-21a7-48ae-86c2-ac0d3d5a9638 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-16"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:04.677186 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:04.677186 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:04.693780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb9ad8d7-21a7-48ae-86c2-ac0d3d5a9638 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.694692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb9ad8d7-21a7-48ae-86c2-ac0d3d5a9638 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.695218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb9ad8d7-21a7-48ae-86c2-ac0d3d5a9638 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.723519 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-bb9ad8d7-21a7-48ae-86c2-ac0d3d5a9638 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h1-850468-16. Aug 23 17:52:04.724276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bb9ad8d7-21a7-48ae-86c2-ac0d3d5a9638 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Request method failure captured: Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 40 Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPDZ7sEjq4Qeg3MVu4J9a_ddbprGmTc8rSv8hxjxwIIdJFAf86LjKftynJE7FjcdkvDMOAh8BqkNh6VdzEmnJRXeB5IlDy2yuP4JhzyeoKmQmhaTYiMXuNMBug99S9qCQeQCtQwpylbVn8dn8nwakIdE7NpGncQjvl5RaENoFEQWFM Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:52:04.726610 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}] Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 00b44661f1a14894baea342d415ae2db Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: {"add_host": {"host": "n-h1-850468-16"}} Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:04.727803 n-d-850468-16 devstack@n-api.service[128808]: exception: Aggregate 11 already has host n-h1-850468-16. Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h1-850468-16'}}} Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result.read() Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 17:52:04.728557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h1-850468-16-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi session.flush() Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 17:52:04.729610 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 17:52:04.730710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 17:52:04.731840 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result.read() Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h1-850468-16-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 23, 17, 52, 4, 715736), 'updated_at': None, 'host': 'n-h1-850468-16', 'aggregate_id': 11}] Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:04.733094 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6636, in add_host_to_aggregate Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h1-850468-16. Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.734185 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h1-850468-16. Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:04.735510 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:04.736928 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h1-850468-16. Aug 23 17:52:04.736928 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:04.736928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bb9ad8d7-21a7-48ae-86c2-ac0d3d5a9638 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Returning 409 to user: Aggregate 11 already has host n-h1-850468-16. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:04.736928 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bb9ad8d7-21a7-48ae-86c2-ac0d3d5a9638 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 97 microversion: 2.1 time: 0.057939 Aug 23 17:52:04.741331 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 171/306] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 17:52:04 2022] POST /compute/v2.1/os-aggregates/11/action => generated 97 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 377 bytes (1 switches on core 0) Aug 23 17:52:04.749870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3bfa0b48-1179-41ba-833a-6e66e70ce138 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Calling method '.version_select at 0x7f27ed2e9af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:04.750754 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:04.750754 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:04.751819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bfa0b48-1179-41ba-833a-6e66e70ce138 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.752305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bfa0b48-1179-41ba-833a-6e66e70ce138 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.752745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bfa0b48-1179-41ba-833a-6e66e70ce138 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.767419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bfa0b48-1179-41ba-833a-6e66e70ce138 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.767905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bfa0b48-1179-41ba-833a-6e66e70ce138 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.768341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bfa0b48-1179-41ba-833a-6e66e70ce138 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.779651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bfa0b48-1179-41ba-833a-6e66e70ce138 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.780133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bfa0b48-1179-41ba-833a-6e66e70ce138 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.780568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bfa0b48-1179-41ba-833a-6e66e70ce138 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.786940 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3bfa0b48-1179-41ba-833a-6e66e70ce138 tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.044546 Aug 23 17:52:04.787547 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 172/307] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:04 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:04.792167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-14c93f8e-bbe1-4cd4-8528-2e3184d18e4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:04.792774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-14c93f8e-bbe1-4cd4-8528-2e3184d18e4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:04.798594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c93f8e-bbe1-4cd4-8528-2e3184d18e4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.799077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c93f8e-bbe1-4cd4-8528-2e3184d18e4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.799713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c93f8e-bbe1-4cd4-8528-2e3184d18e4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.801337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c93f8e-bbe1-4cd4-8528-2e3184d18e4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.801337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c93f8e-bbe1-4cd4-8528-2e3184d18e4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.801780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c93f8e-bbe1-4cd4-8528-2e3184d18e4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.942024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:52:04.942515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:52:04.943154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:52:04.943774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:52:04.944188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:52:04.952973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.953455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.953888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.954673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:04.955134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:04.955559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:04.970100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-14c93f8e-bbe1-4cd4-8528-2e3184d18e4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:04.975365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Getting quotas for project 5c5a1c94aed149c489a20be456895034. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:52:04.980072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Getting quotas for user d81796ff5b934d218c1b967b8c0f9882 and project 5c5a1c94aed149c489a20be456895034. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:52:04.994989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:52:04.995146 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-14c93f8e-bbe1-4cd4-8528-2e3184d18e4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1388 microversion: 2.1 time: 0.206439 Aug 23 17:52:04.995683 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 173/308] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:04 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1388 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:04.997396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:52:05.007316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d198aa51-e054-48d1-a217-dbde11730911 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-16"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:05.026763 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:05.026763 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:05.038246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d198aa51-e054-48d1-a217-dbde11730911 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.038776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d198aa51-e054-48d1-a217-dbde11730911 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.039292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d198aa51-e054-48d1-a217-dbde11730911 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:05.051880 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c61f04a5-806f-4e13-a519-c81a83b3948d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.389588 Aug 23 17:52:05.052534 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 136/309] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 391 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:52:05.057074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-80f64b7f-7b5f-451b-a468-9cdc3b7916fc tempest-HypervisorAdminNegativeUnderV252Test-307458322 tempest-HypervisorAdminNegativeUnderV252Test-307458322-project] Calling method '.version_select at 0x7f27ed2ce820>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:05.057923 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:05.057923 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:05.059749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-80f64b7f-7b5f-451b-a468-9cdc3b7916fc tempest-HypervisorAdminNegativeUnderV252Test-307458322 tempest-HypervisorAdminNegativeUnderV252Test-307458322-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': '72e091534a054b459f790ef762c87cb1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ced5c44bf5d64d7e86b677e6d6b06b48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-80f64b7f-7b5f-451b-a468-9cdc3b7916fc tempest-HypervisorAdminNegativeUnderV252Test-307458322 tempest-HypervisorAdminNegativeUnderV252Test-307458322-project] Request method failure captured: Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPCoo_V3VNwaz64UAQrQyl6_a9MaPV7VGote64lvbtttDyWCLLQlpBFZSXdInZRmEGduXtNfl8VvPevs8UDaiIgcB-lyhylUM1Q2FTljektndFiAurRy9rBmMjHZYWXXCb8u4ZeBwt1TxdPNvvvmcbz46z1cRwMLlY0_1Xj80Nk5Kk Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ced5c44bf5d64d7e86b677e6d6b06b48 Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-307458322 Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:52:05.061765 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:52:05.063037 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ced5c44bf5d64d7e86b677e6d6b06b48"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ced5c44bf5d64d7e86b677e6d6b06b48"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ced5c44bf5d64d7e86b677e6d6b06b48"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ced5c44bf5d64d7e86b677e6d6b06b48"}]}] Aug 23 17:52:05.063037 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-307458322 Aug 23 17:52:05.063037 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ced5c44bf5d64d7e86b677e6d6b06b48 Aug 23 17:52:05.063037 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-307458322 Aug 23 17:52:05.063037 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-307458322-project Aug 23 17:52:05.063037 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:05.063037 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:05.063037 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 72e091534a054b459f790ef762c87cb1 Aug 23 17:52:05.063037 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-307458322-project Aug 23 17:52:05.063037 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:52:05.063037 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 23 17:52:05.063037 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '1'} Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:05.063689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Aug 23 17:52:05.064755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:05.066287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-80f64b7f-7b5f-451b-a468-9cdc3b7916fc tempest-HypervisorAdminNegativeUnderV252Test-307458322 tempest-HypervisorAdminNegativeUnderV252Test-307458322-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:05.066287 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-80f64b7f-7b5f-451b-a468-9cdc3b7916fc tempest-HypervisorAdminNegativeUnderV252Test-307458322 tempest-HypervisorAdminNegativeUnderV252Test-307458322-project] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.011196 Aug 23 17:52:05.066287 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 137/310] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Aug 23 17:52:05 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 12 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:05.072352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d4dd377-06d7-41e4-8d2a-d1b03fc7436e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:05.073040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2d4dd377-06d7-41e4-8d2a-d1b03fc7436e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:05.093512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d4dd377-06d7-41e4-8d2a-d1b03fc7436e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.094168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d4dd377-06d7-41e4-8d2a-d1b03fc7436e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.094650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d4dd377-06d7-41e4-8d2a-d1b03fc7436e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:05.095362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d4dd377-06d7-41e4-8d2a-d1b03fc7436e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.095818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d4dd377-06d7-41e4-8d2a-d1b03fc7436e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.096241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d4dd377-06d7-41e4-8d2a-d1b03fc7436e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:05.185142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2d4dd377-06d7-41e4-8d2a-d1b03fc7436e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:05.193749 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d198aa51-e054-48d1-a217-dbde11730911 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.196317 Aug 23 17:52:05.194586 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 174/311] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 17:52:04 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:05.195071 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2d4dd377-06d7-41e4-8d2a-d1b03fc7436e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1223 microversion: 2.1 time: 0.127138 Aug 23 17:52:05.204761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3ca3b563-659b-4ca2-a889-4fa057e3605b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:05.205634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3ca3b563-659b-4ca2-a889-4fa057e3605b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:05.208542 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 138/312] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:05 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1223 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:05.216395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8e6979d4-d560-4345-a94d-8bee1b79eace tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:05.217015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8e6979d4-d560-4345-a94d-8bee1b79eace tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:05.218328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ca3b563-659b-4ca2-a889-4fa057e3605b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.219292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ca3b563-659b-4ca2-a889-4fa057e3605b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.220559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ca3b563-659b-4ca2-a889-4fa057e3605b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:05.222029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ca3b563-659b-4ca2-a889-4fa057e3605b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.223304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ca3b563-659b-4ca2-a889-4fa057e3605b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.223978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ca3b563-659b-4ca2-a889-4fa057e3605b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:05.276152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8e6979d4-d560-4345-a94d-8bee1b79eace tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:05.285904 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8e6979d4-d560-4345-a94d-8bee1b79eace tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1214 microversion: 2.1 time: 0.076058 Aug 23 17:52:05.286495 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 139/313] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:05 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1214 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:05.291863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eef8ecf6-bcda-48f2-9402-2570af05253d tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Calling method '.version_select at 0x7f27ed2ce310>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:05.292796 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:servers": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:05.292796 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:05.294018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eef8ecf6-bcda-48f2-9402-2570af05253d tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.294675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eef8ecf6-bcda-48f2-9402-2570af05253d tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.295273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eef8ecf6-bcda-48f2-9402-2570af05253d tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:05.321015 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-eef8ecf6-bcda-48f2-9402-2570af05253d tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] HTTP exception thrown: No hypervisor matching '1daa1ed3-4157-4823-92b7-83495241b1b9' could be found. Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eef8ecf6-bcda-48f2-9402-2570af05253d tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Request method failure captured: Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-hypervisors/1daa1ed3-4157-4823-92b7-83495241b1b9/servers HTTP/1.1 Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPDxGPwoV9CeNMWfzJdlqanLP-hA2D0uyMbB0-_MZnCUAPgGf_QVf0ZO7z5o5uZYBwkcb01yPkGt3OBNZI8pEWBMDCJ3yN17tGEyZgTFOPLR6JgqMEopeJkOABS3AH4gqj7a-csIL5UVtDSQXUjPwUB_UoyD7PLBrI_raJMOkXiQ7E Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: bbee4d747742408ba55fc7edfd01c9b9 Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-2043805015 Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:52:05.324430 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:52:05.325928 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bbee4d747742408ba55fc7edfd01c9b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bbee4d747742408ba55fc7edfd01c9b9"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bbee4d747742408ba55fc7edfd01c9b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bbee4d747742408ba55fc7edfd01c9b9"}]}] Aug 23 17:52:05.325928 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-2043805015 Aug 23 17:52:05.325928 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: bbee4d747742408ba55fc7edfd01c9b9 Aug 23 17:52:05.325928 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-2043805015 Aug 23 17:52:05.325928 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin Aug 23 17:52:05.325928 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:05.325928 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:05.325928 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: d7ab8a3c7f134c649ad9405d76ad7e00 Aug 23 17:52:05.325928 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin Aug 23 17:52:05.325928 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:52:05.325928 n-d-850468-16 devstack@n-api.service[128807]: exception: No hypervisor matching '1daa1ed3-4157-4823-92b7-83495241b1b9' could be found. Aug 23 17:52:05.325928 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '1daa1ed3-4157-4823-92b7-83495241b1b9'} Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '1daa1ed3-4157-4823-92b7-83495241b1b9' could be found. Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:05.326862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:05.328171 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:05.328171 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:05.328171 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:05.328171 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:05.328171 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '1daa1ed3-4157-4823-92b7-83495241b1b9' could be found. Aug 23 17:52:05.328171 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:05.331009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eef8ecf6-bcda-48f2-9402-2570af05253d tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] Returning 404 to user: No hypervisor matching '1daa1ed3-4157-4823-92b7-83495241b1b9' could be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:05.332968 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eef8ecf6-bcda-48f2-9402-2570af05253d tempest-HypervisorAdminNegativeUnderV252Test-2043805015 tempest-HypervisorAdminNegativeUnderV252Test-2043805015-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors/1daa1ed3-4157-4823-92b7-83495241b1b9/servers" status: 404 len: 123 microversion: 2.1 time: 0.045242 Aug 23 17:52:05.337233 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 140/314] 10.222.0.61 () {58 vars in 1281 bytes} [Tue Aug 23 17:52:05 2022] GET /compute/v2.1/os-hypervisors/1daa1ed3-4157-4823-92b7-83495241b1b9/servers => generated 123 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:05.356056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fd152241-5722-406f-86fb-e5eb2629e853 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:05.358410 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:05.358410 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:05.410604 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fd152241-5722-406f-86fb-e5eb2629e853 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.062778 Aug 23 17:52:05.413339 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 141/315] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:52:05 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:52:05.414497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3ca3b563-659b-4ca2-a889-4fa057e3605b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:05.427621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-28761cd2-ac9d-4985-a259-6574cf7878d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:05.428313 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3ca3b563-659b-4ca2-a889-4fa057e3605b tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1331 microversion: 2.1 time: 0.231903 Aug 23 17:52:05.429638 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 175/316] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:05 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1331 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:05.429854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-28761cd2-ac9d-4985-a259-6574cf7878d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:05.443604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-357d911d-bb98-47cb-a0b4-b8a2c6be6d9f tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1049807936"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:05.449059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28761cd2-ac9d-4985-a259-6574cf7878d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.449724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28761cd2-ac9d-4985-a259-6574cf7878d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.450221 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:05.450221 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:05.450446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28761cd2-ac9d-4985-a259-6574cf7878d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:05.451241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.aggregate [None req-357d911d-bb98-47cb-a0b4-b8a2c6be6d9f tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Generated uuid 43c47814-a3c4-49a5-8c66-411039b64689 for aggregate {{(pid=128808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:52:05.451839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28761cd2-ac9d-4985-a259-6574cf7878d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.454734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28761cd2-ac9d-4985-a259-6574cf7878d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.458646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28761cd2-ac9d-4985-a259-6574cf7878d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:05.497424 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-357d911d-bb98-47cb-a0b4-b8a2c6be6d9f tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.063486 Aug 23 17:52:05.499098 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 176/317] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:52:05 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:05.520671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-d43483fb-05ac-431e-a436-0f8d64a17e30 req-c3f4f2fd-2130-4530-8871-a910cfaa51b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384a38ca-06b1-4f61-a6f1-fd316e2d373a", "name": "network-vif-plugged", "status": "completed", "tag": "126444e3-4ac6-4d94-b3f6-dfeee1a150a5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:05.540684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d43483fb-05ac-431e-a436-0f8d64a17e30 req-c3f4f2fd-2130-4530-8871-a910cfaa51b1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.546096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d43483fb-05ac-431e-a436-0f8d64a17e30 req-c3f4f2fd-2130-4530-8871-a910cfaa51b1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.549988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d43483fb-05ac-431e-a436-0f8d64a17e30 req-c3f4f2fd-2130-4530-8871-a910cfaa51b1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:05.592565 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-d43483fb-05ac-431e-a436-0f8d64a17e30 req-c3f4f2fd-2130-4530-8871-a910cfaa51b1 service nova] Creating event network-vif-plugged:126444e3-4ac6-4d94-b3f6-dfeee1a150a5 for instance 384a38ca-06b1-4f61-a6f1-fd316e2d373a on n-h1-850468-16 Aug 23 17:52:05.615618 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-d43483fb-05ac-431e-a436-0f8d64a17e30 req-c3f4f2fd-2130-4530-8871-a910cfaa51b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102764 Aug 23 17:52:05.623709 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 177/318] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:05.774636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-28761cd2-ac9d-4985-a259-6574cf7878d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:05.789745 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-28761cd2-ac9d-4985-a259-6574cf7878d8 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1469 microversion: 2.1 time: 0.374379 Aug 23 17:52:05.791203 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 142/319] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:05 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:05.800817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d82fb47e-c689-4fb1-b433-f34de27218bc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:05.805827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d82fb47e-c689-4fb1-b433-f34de27218bc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:05.820636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d82fb47e-c689-4fb1-b433-f34de27218bc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.821881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d82fb47e-c689-4fb1-b433-f34de27218bc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.823002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d82fb47e-c689-4fb1-b433-f34de27218bc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:05.824489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d82fb47e-c689-4fb1-b433-f34de27218bc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.825025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d82fb47e-c689-4fb1-b433-f34de27218bc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.825583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d82fb47e-c689-4fb1-b433-f34de27218bc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:05.857554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6f5bcb04-26f8-456a-9120-0b8bf09c8496 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-16"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:05.861289 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:05.861289 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:05.862343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6f5bcb04-26f8-456a-9120-0b8bf09c8496 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'db871ca206ca48b0a44778006c764455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a1d3c536c4366b066b0d3d5004414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6f5bcb04-26f8-456a-9120-0b8bf09c8496 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Request method failure captured: Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 40 Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPCQeRhZWIjShnbf2rA8-wf4YO0Rm5-TjwONzwy4hbouYwCu23g2QCsP_lhL_Ojnce3PG8k0UuzHvNIyUTbQA_57EZ3Yl6-TxRWJatVzXyafVoC3Cp_rDWDJrdXNb1AhqznbhDBe5RalgMvmUzTB8ffs_OJ_DDIjasyJ7kRcj2d1dQ Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0e6a1d3c536c4366b066b0d3d5004414 Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:05.871769 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e6a1d3c536c4366b066b0d3d5004414"}]}] Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0e6a1d3c536c4366b066b0d3d5004414 Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminNegativeTestJSON-1050390584-project Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: db871ca206ca48b0a44778006c764455 Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584-project Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: {"add_host": {"host": "n-h1-850468-16"}} Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:05.873297 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h1-850468-16'}}} Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:05.874263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Aug 23 17:52:05.876259 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:05.880896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6f5bcb04-26f8-456a-9120-0b8bf09c8496 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:05.882805 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6f5bcb04-26f8-456a-9120-0b8bf09c8496 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] 10.222.0.61 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.257576 Aug 23 17:52:05.883749 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 178/320] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 17:52:05 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 259 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:05.889440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5c677c93-c6f0-4f2d-97a1-a6fb6de7d7c5 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:05.892914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5c677c93-c6f0-4f2d-97a1-a6fb6de7d7c5 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:05.904672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c677c93-c6f0-4f2d-97a1-a6fb6de7d7c5 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.907401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c677c93-c6f0-4f2d-97a1-a6fb6de7d7c5 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.908278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c677c93-c6f0-4f2d-97a1-a6fb6de7d7c5 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:05.909256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c677c93-c6f0-4f2d-97a1-a6fb6de7d7c5 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:05.910472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c677c93-c6f0-4f2d-97a1-a6fb6de7d7c5 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:05.911156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c677c93-c6f0-4f2d-97a1-a6fb6de7d7c5 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.059880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d82fb47e-c689-4fb1-b433-f34de27218bc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.070362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d82fb47e-c689-4fb1-b433-f34de27218bc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.072088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d82fb47e-c689-4fb1-b433-f34de27218bc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.077807 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d82fb47e-c689-4fb1-b433-f34de27218bc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1438 microversion: 2.75 time: 0.284282 Aug 23 17:52:06.078450 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 143/321] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:05 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1438 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:06.080935 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5c677c93-c6f0-4f2d-97a1-a6fb6de7d7c5 tempest-DeleteServersAdminTestJSON-397990889 tempest-DeleteServersAdminTestJSON-397990889-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a/action" status: 202 len: 0 microversion: 2.1 time: 0.195845 Aug 23 17:52:06.081627 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 179/322] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:52:05 2022] POST /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:06.083936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e65d295-aea4-45cc-9700-7485a889daab tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:06.084866 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:06.084866 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:06.087238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9319cdf0-abbe-4d9a-bd36-ff8e65dd1f2c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:06.087857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9319cdf0-abbe-4d9a-bd36-ff8e65dd1f2c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:06.094034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9319cdf0-abbe-4d9a-bd36-ff8e65dd1f2c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.094519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9319cdf0-abbe-4d9a-bd36-ff8e65dd1f2c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.095296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9319cdf0-abbe-4d9a-bd36-ff8e65dd1f2c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.095999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9319cdf0-abbe-4d9a-bd36-ff8e65dd1f2c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.096503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9319cdf0-abbe-4d9a-bd36-ff8e65dd1f2c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.096988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9319cdf0-abbe-4d9a-bd36-ff8e65dd1f2c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.112135 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e65d295-aea4-45cc-9700-7485a889daab tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.032403 Aug 23 17:52:06.114065 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 144/323] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:52:06 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:52:06.115933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:06.122286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:06.123159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:06.130657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.131343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.131958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.133118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.133581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.134004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.167991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.168697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.169284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.170198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lazy-loading 'fault' on Instance uuid 304e504b-7767-46b3-8785-5010fac97f7a {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:06.304268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.310570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9319cdf0-abbe-4d9a-bd36-ff8e65dd1f2c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.322161 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9319cdf0-abbe-4d9a-bd36-ff8e65dd1f2c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1388 microversion: 2.1 time: 0.239152 Aug 23 17:52:06.323571 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 180/324] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:06 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1388 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:06.329491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:06.333192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:06.339629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.340492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.341001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.342307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.342868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.343392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.349086 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-43b5e3a5-60d0-4ea1-abd4-92347ab8a906 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1452 microversion: 2.1 time: 0.231040 Aug 23 17:52:06.351571 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 145/325] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:06 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1452 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:06.362070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-207e5d1b-17cf-43ac-999e-92c558a2c6ec tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-426197301"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:06.370739 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:06.370739 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:06.373774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.aggregate [None req-207e5d1b-17cf-43ac-999e-92c558a2c6ec tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Generated uuid 722ab975-6ae8-4fa0-bd62-499a2b9d5af1 for aggregate {{(pid=128807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:52:06.430026 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-207e5d1b-17cf-43ac-999e-92c558a2c6ec tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.074580 Aug 23 17:52:06.430685 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 146/326] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:52:06 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:06.455058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7c9433fb-1250-422f-9a2a-0e37954fbcae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:06.455681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7c9433fb-1250-422f-9a2a-0e37954fbcae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:06.465807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c9433fb-1250-422f-9a2a-0e37954fbcae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.466882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c9433fb-1250-422f-9a2a-0e37954fbcae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.467524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c9433fb-1250-422f-9a2a-0e37954fbcae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.468313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c9433fb-1250-422f-9a2a-0e37954fbcae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.468847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c9433fb-1250-422f-9a2a-0e37954fbcae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.469346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c9433fb-1250-422f-9a2a-0e37954fbcae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.480613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:52:06.481529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:52:06.482081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:52:06.482577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:52:06.483457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:52:06.548812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:06.553180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7c9433fb-1250-422f-9a2a-0e37954fbcae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.555299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.555794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.556234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.556941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.557407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.558569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.570883 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7c9433fb-1250-422f-9a2a-0e37954fbcae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1271 microversion: 2.1 time: 0.137378 Aug 23 17:52:06.571967 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 147/327] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:06 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1271 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:06.580528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b7b08a94-e8b6-4c5a-8e65-f57f0cb4f89e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:06.581277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b7b08a94-e8b6-4c5a-8e65-f57f0cb4f89e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:06.588812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7b08a94-e8b6-4c5a-8e65-f57f0cb4f89e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.589335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7b08a94-e8b6-4c5a-8e65-f57f0cb4f89e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.590028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7b08a94-e8b6-4c5a-8e65-f57f0cb4f89e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.590971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7b08a94-e8b6-4c5a-8e65-f57f0cb4f89e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.593427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7b08a94-e8b6-4c5a-8e65-f57f0cb4f89e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.594252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7b08a94-e8b6-4c5a-8e65-f57f0cb4f89e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.653321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.663124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.665429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.671183 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e68e59d1-0c92-45d7-90de-058033fb1341 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "POST /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08/action" status: 202 len: 1495 microversion: 2.75 time: 0.346169 Aug 23 17:52:06.678877 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 181/328] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 17:52:06 2022] POST /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08/action => generated 1495 bytes in 354 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 23 17:52:06.683888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d9cd408f-4752-40c4-a13f-1dc0e1932cff tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:06.684391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d9cd408f-4752-40c4-a13f-1dc0e1932cff tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:06.689634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b7b08a94-e8b6-4c5a-8e65-f57f0cb4f89e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.699063 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b7b08a94-e8b6-4c5a-8e65-f57f0cb4f89e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1210 microversion: 2.1 time: 0.124806 Aug 23 17:52:06.700751 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 148/329] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:06 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1210 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:06.704172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9cd408f-4752-40c4-a13f-1dc0e1932cff tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.704678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9cd408f-4752-40c4-a13f-1dc0e1932cff tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.705117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9cd408f-4752-40c4-a13f-1dc0e1932cff tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.705829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9cd408f-4752-40c4-a13f-1dc0e1932cff tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.707184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9cd408f-4752-40c4-a13f-1dc0e1932cff tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.707615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dca40928-950b-4fbd-826a-5af6a1d12539 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-2011894370"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:06.707842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9cd408f-4752-40c4-a13f-1dc0e1932cff tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.710673 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:06.710673 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:06.724625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dca40928-950b-4fbd-826a-5af6a1d12539 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.725408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dca40928-950b-4fbd-826a-5af6a1d12539 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.735470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dca40928-950b-4fbd-826a-5af6a1d12539 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.743411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d9cd408f-4752-40c4-a13f-1dc0e1932cff tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:52:06.744844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dca40928-950b-4fbd-826a-5af6a1d12539 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.745253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dca40928-950b-4fbd-826a-5af6a1d12539 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.745738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dca40928-950b-4fbd-826a-5af6a1d12539 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.756952 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-dca40928-950b-4fbd-826a-5af6a1d12539 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-2011894370 could not be found. Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dca40928-950b-4fbd-826a-5af6a1d12539 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Request method failure captured: Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 58 Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPDZ7sEjq4Qeg3MVu4J9a_ddbprGmTc8rSv8hxjxwIIdJFAf86LjKftynJE7FjcdkvDMOAh8BqkNh6VdzEmnJRXeB5IlDy2yuP4JhzyeoKmQmhaTYiMXuNMBug99S9qCQeQCtQwpylbVn8dn8nwakIdE7NpGncQjvl5RaENoFEQWFM Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:52:06.761688 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}] Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 00b44661f1a14894baea342d415ae2db Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: {"add_host": {"host": "tempest-nonexist_host-2011894370"}} Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:06.762909 n-d-850468-16 devstack@n-api.service[128807]: exception: Compute host tempest-nonexist_host-2011894370 could not be found. Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-2011894370'}}} Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-2011894370' is not mapped to any cell Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:06.763623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6616, in add_host_to_aggregate Aug 23 17:52:06.764622 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-2011894370 could not be found. Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-2011894370 could not be found. Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:06.768063 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:06.771260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:06.771260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:06.771260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:06.771260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:06.771260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:06.771260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-2011894370 could not be found. Aug 23 17:52:06.771260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:06.771260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dca40928-950b-4fbd-826a-5af6a1d12539 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-2011894370 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:06.771260 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dca40928-950b-4fbd-826a-5af6a1d12539 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 111 microversion: 2.1 time: 0.061893 Aug 23 17:52:06.771260 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 149/330] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 17:52:06 2022] POST /compute/v2.1/os-aggregates/13/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:06.776659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d6a3c76e-874c-4c12-bcf9-b72f01973908 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:06.777218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d6a3c76e-874c-4c12-bcf9-b72f01973908 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:06.783686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6a3c76e-874c-4c12-bcf9-b72f01973908 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.784313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6a3c76e-874c-4c12-bcf9-b72f01973908 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.785840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6a3c76e-874c-4c12-bcf9-b72f01973908 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.786287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6a3c76e-874c-4c12-bcf9-b72f01973908 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.786774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6a3c76e-874c-4c12-bcf9-b72f01973908 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.787320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6a3c76e-874c-4c12-bcf9-b72f01973908 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.864206 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d9cd408f-4752-40c4-a13f-1dc0e1932cff tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "DELETE /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 204 len: 0 microversion: 2.1 time: 0.182940 Aug 23 17:52:06.865142 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 182/331] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:52:06 2022] DELETE /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:52:06.871114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b5d8bd1b-09f4-4dc4-bf8c-73cd89b24fd8 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:06.871829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b5d8bd1b-09f4-4dc4-bf8c-73cd89b24fd8 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:06.879256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5d8bd1b-09f4-4dc4-bf8c-73cd89b24fd8 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.879751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5d8bd1b-09f4-4dc4-bf8c-73cd89b24fd8 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.880705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5d8bd1b-09f4-4dc4-bf8c-73cd89b24fd8 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.881413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5d8bd1b-09f4-4dc4-bf8c-73cd89b24fd8 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:06.881867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5d8bd1b-09f4-4dc4-bf8c-73cd89b24fd8 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:06.882300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5d8bd1b-09f4-4dc4-bf8c-73cd89b24fd8 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:06.964436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b5d8bd1b-09f4-4dc4-bf8c-73cd89b24fd8 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.968079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d6a3c76e-874c-4c12-bcf9-b72f01973908 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.982052 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d6a3c76e-874c-4c12-bcf9-b72f01973908 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1331 microversion: 2.1 time: 0.215964 Aug 23 17:52:06.982730 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 150/332] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:06 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1331 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:06.987261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cfbf7a02-3ec1-450c-939a-4eb9fac9c503 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:06.988836 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:06.988836 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:06.994433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b5d8bd1b-09f4-4dc4-bf8c-73cd89b24fd8 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:06.996161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b5d8bd1b-09f4-4dc4-bf8c-73cd89b24fd8 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:07.001949 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b5d8bd1b-09f4-4dc4-bf8c-73cd89b24fd8 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.135856 Aug 23 17:52:07.002523 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 183/333] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:06 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:07.007750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:07.008352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:07.014426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:07.015001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:07.015431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:07.016190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:07.016652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:07.017208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:07.031400 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cfbf7a02-3ec1-450c-939a-4eb9fac9c503 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.047013 Aug 23 17:52:07.033104 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 151/334] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:52:06 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:52:07.043217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-479b3b22-3e9b-4095-a68a-6f7a6ccc11ff tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:07.055873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:07.056353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:07.056790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:07.057251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lazy-loading 'fault' on Instance uuid 304e504b-7767-46b3-8785-5010fac97f7a {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-479b3b22-3e9b-4095-a68a-6f7a6ccc11ff tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Request method failure captured: Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 283 Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPDZ7sEjq4Qeg3MVu4J9a_ddbprGmTc8rSv8hxjxwIIdJFAf86LjKftynJE7FjcdkvDMOAh8BqkNh6VdzEmnJRXeB5IlDy2yuP4JhzyeoKmQmhaTYiMXuNMBug99S9qCQeQCtQwpylbVn8dn8nwakIdE7NpGncQjvl5RaENoFEQWFM Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:52:07.058522 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:52:07.059726 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}] Aug 23 17:52:07.059726 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.059726 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:07.059726 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.059726 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:07.059726 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:07.059726 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:07.059726 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 00b44661f1a14894baea342d415ae2db Aug 23 17:52:07.059726 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:07.059726 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:52:07.060277 n-d-850468-16 devstack@n-api.service[128807]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 23 17:52:07.060277 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:07.060277 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 17:52:07.060277 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 23 17:52:07.060277 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:07.060277 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.060277 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:52:07.060277 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:52:07.060277 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:52:07.060277 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:07.060843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.061748 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.062623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:52:07.062623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:52:07.062623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 17:52:07.062623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.063903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-479b3b22-3e9b-4095-a68a-6f7a6ccc11ff tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:07.064766 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-479b3b22-3e9b-4095-a68a-6f7a6ccc11ff tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.025617 Aug 23 17:52:07.065327 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 152/335] 10.222.0.61 () {60 vars in 1165 bytes} [Tue Aug 23 17:52:07 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 27 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:52:07.077128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3339b527-b3bd-4158-be42-da7021266d70 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3339b527-b3bd-4158-be42-da7021266d70 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Request method failure captured: Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 27 Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPDZ7sEjq4Qeg3MVu4J9a_ddbprGmTc8rSv8hxjxwIIdJFAf86LjKftynJE7FjcdkvDMOAh8BqkNh6VdzEmnJRXeB5IlDy2yuP4JhzyeoKmQmhaTYiMXuNMBug99S9qCQeQCtQwpylbVn8dn8nwakIdE7NpGncQjvl5RaENoFEQWFM Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:52:07.081113 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}] Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 00b44661f1a14894baea342d415ae2db Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: {"aggregate": {"name": ""}} Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:07.083010 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'aggregate': {'name': ''}}} Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi '' Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:07.083791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 23 17:52:07.085302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.086478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3339b527-b3bd-4158-be42-da7021266d70 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:07.086478 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3339b527-b3bd-4158-be42-da7021266d70 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.011507 Aug 23 17:52:07.086478 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 153/336] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:52:07 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 17:52:07.092637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4065cab6-a064-4b8f-bdae-e04e4d27b27e tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-24672959"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:07.095344 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.095344 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:07.096362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4065cab6-a064-4b8f-bdae-e04e4d27b27e tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'db871ca206ca48b0a44778006c764455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a1d3c536c4366b066b0d3d5004414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4065cab6-a064-4b8f-bdae-e04e4d27b27e tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Request method failure captured: Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 58 Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPCQeRhZWIjShnbf2rA8-wf4YO0Rm5-TjwONzwy4hbouYwCu23g2QCsP_lhL_Ojnce3PG8k0UuzHvNIyUTbQA_57EZ3Yl6-TxRWJatVzXyafVoC3Cp_rDWDJrdXNb1AhqznbhDBe5RalgMvmUzTB8ffs_OJ_DDIjasyJ7kRcj2d1dQ Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 0e6a1d3c536c4366b066b0d3d5004414 Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:52:07.098954 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e6a1d3c536c4366b066b0d3d5004414"}]}] Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 0e6a1d3c536c4366b066b0d3d5004414 Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AggregatesAdminNegativeTestJSON-1050390584-project Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: db871ca206ca48b0a44778006c764455 Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584-project Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: {"aggregate": {"name": "tempest-test_aggregate-24672959"}} Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:07.100122 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-24672959'}}} Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:07.100871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:07.101855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Aug 23 17:52:07.102956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.102956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4065cab6-a064-4b8f-bdae-e04e4d27b27e tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:07.102956 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4065cab6-a064-4b8f-bdae-e04e4d27b27e tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.011699 Aug 23 17:52:07.106155 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 154/337] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:52:07 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 18 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 23 17:52:07.110860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5ed2ae1a-8570-4810-be72-89be37d0bf34 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2039811781"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:07.115691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.aggregate [None req-5ed2ae1a-8570-4810-be72-89be37d0bf34 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Generated uuid 7aa3dbee-d991-4504-a4e2-e7cef0b12e91 for aggregate {{(pid=128807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:52:07.139005 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5ed2ae1a-8570-4810-be72-89be37d0bf34 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.031659 Aug 23 17:52:07.139600 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 155/338] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:52:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:07.151228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3e8d1669-eba9-42a1-9a77-5a5d19f8033c tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2039811781"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:07.153746 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.153746 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:07.154832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.aggregate [None req-3e8d1669-eba9-42a1-9a77-5a5d19f8033c tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Generated uuid a6411eb3-910b-47d7-92ab-0c4c398c217f for aggregate {{(pid=128807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:52:07.165112 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-3e8d1669-eba9-42a1-9a77-5a5d19f8033c tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2039811781 already exists. Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3e8d1669-eba9-42a1-9a77-5a5d19f8033c tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Request method failure captured: Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 60 Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPDZ7sEjq4Qeg3MVu4J9a_ddbprGmTc8rSv8hxjxwIIdJFAf86LjKftynJE7FjcdkvDMOAh8BqkNh6VdzEmnJRXeB5IlDy2yuP4JhzyeoKmQmhaTYiMXuNMBug99S9qCQeQCtQwpylbVn8dn8nwakIdE7NpGncQjvl5RaENoFEQWFM Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:52:07.167495 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}] Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 00b44661f1a14894baea342d415ae2db Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: {"aggregate": {"name": "tempest-test_aggregate-2039811781"}} Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:07.168962 n-d-850468-16 devstack@n-api.service[128807]: exception: Aggregate tempest-test_aggregate-2039811781 already exists. Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2039811781'}}} Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6453, in create_aggregate Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi aggregate.create() Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Aug 23 17:52:07.169763 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2039811781 already exists. Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:07.170859 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2039811781 already exists. Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2039811781 already exists. Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3e8d1669-eba9-42a1-9a77-5a5d19f8033c tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2039811781 already exists. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:07.171900 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3e8d1669-eba9-42a1-9a77-5a5d19f8033c tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.021657 Aug 23 17:52:07.173031 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 156/339] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:52:07 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 23 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:52:07.178428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-efca77eb-5c0e-4315-9324-244704519e51 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:07.179234 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.179234 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:07.201863 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-efca77eb-5c0e-4315-9324-244704519e51 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.028158 Aug 23 17:52:07.202434 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 157/340] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:52:07 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 23 17:52:07.212034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-872c25bc-005d-4141-b3c6-ae1298af85ec tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-61442997"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:07.215921 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.215921 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:07.216839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.aggregate [None req-872c25bc-005d-4141-b3c6-ae1298af85ec tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Generated uuid 0ac7ddbf-7b2f-4c5b-9047-19cd2c1ab52e for aggregate {{(pid=128807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:52:07.250015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:07.271910 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-872c25bc-005d-4141-b3c6-ae1298af85ec tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.062180 Aug 23 17:52:07.272866 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-30f9f5cd-ece1-4665-97ca-267105de5557 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1458 microversion: 2.1 time: 0.268201 Aug 23 17:52:07.280829 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 158/341] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:52:07 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:07.285496 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 184/342] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:07 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1458 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:07.290671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cc44251c-721a-44ed-8512-452832aeefd9 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:07.291435 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.291435 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:07.292263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cc44251c-721a-44ed-8512-452832aeefd9 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'db871ca206ca48b0a44778006c764455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a1d3c536c4366b066b0d3d5004414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cc44251c-721a-44ed-8512-452832aeefd9 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Request method failure captured: Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPCQeRhZWIjShnbf2rA8-wf4YO0Rm5-TjwONzwy4hbouYwCu23g2QCsP_lhL_Ojnce3PG8k0UuzHvNIyUTbQA_57EZ3Yl6-TxRWJatVzXyafVoC3Cp_rDWDJrdXNb1AhqznbhDBe5RalgMvmUzTB8ffs_OJ_DDIjasyJ7kRcj2d1dQ Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 0e6a1d3c536c4366b066b0d3d5004414 Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:52:07.293842 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:52:07.296246 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e6a1d3c536c4366b066b0d3d5004414"}]}] Aug 23 17:52:07.296246 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:07.296246 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 0e6a1d3c536c4366b066b0d3d5004414 Aug 23 17:52:07.296246 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:07.296246 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AggregatesAdminNegativeTestJSON-1050390584-project Aug 23 17:52:07.296246 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:07.296246 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:07.296246 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: db871ca206ca48b0a44778006c764455 Aug 23 17:52:07.296246 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584-project Aug 23 17:52:07.296246 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:07.296246 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 23 17:52:07.296246 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '15'} Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:07.297595 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.299587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cc44251c-721a-44ed-8512-452832aeefd9 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:07.302191 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cc44251c-721a-44ed-8512-452832aeefd9 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.013009 Aug 23 17:52:07.315997 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 159/343] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:52:07 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 34 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 23 17:52:07.351676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-72637e73-c046-46db-8b99-88e74771bd03 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:07.355834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1bda298b-0853-4dde-b38a-19befed86bf2 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:07.356159 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.356159 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:07.357133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1bda298b-0853-4dde-b38a-19befed86bf2 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:07.372637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bda298b-0853-4dde-b38a-19befed86bf2 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:07.373766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bda298b-0853-4dde-b38a-19befed86bf2 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:07.374853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bda298b-0853-4dde-b38a-19befed86bf2 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:07.376320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bda298b-0853-4dde-b38a-19befed86bf2 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:07.377132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bda298b-0853-4dde-b38a-19befed86bf2 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:07.377880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bda298b-0853-4dde-b38a-19befed86bf2 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:07.390145 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-72637e73-c046-46db-8b99-88e74771bd03 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.074066 Aug 23 17:52:07.391398 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 185/344] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:52:07 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:52:07.405277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c10937c7-c27c-4e34-a0c9-5fe6f47af7c3 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:07.406972 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.406972 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:07.425907 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-c10937c7-c27c-4e34-a0c9-5fe6f47af7c3 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c10937c7-c27c-4e34-a0c9-5fe6f47af7c3 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Request method failure captured: Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPDZ7sEjq4Qeg3MVu4J9a_ddbprGmTc8rSv8hxjxwIIdJFAf86LjKftynJE7FjcdkvDMOAh8BqkNh6VdzEmnJRXeB5IlDy2yuP4JhzyeoKmQmhaTYiMXuNMBug99S9qCQeQCtQwpylbVn8dn8nwakIdE7NpGncQjvl5RaENoFEQWFM Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:52:07.429211 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:52:07.430684 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}] Aug 23 17:52:07.430684 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.430684 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:07.430684 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.430684 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:07.430684 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:07.430684 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:07.430684 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 00b44661f1a14894baea342d415ae2db Aug 23 17:52:07.430684 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:07.430684 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:07.430684 n-d-850468-16 devstack@n-api.service[128808]: exception: Aggregate -1 could not be found. Aug 23 17:52:07.430684 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '-1'} Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6512, in delete_aggregate Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 23 17:52:07.431947 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.433574 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.434956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.434956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.434956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:07.434956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:07.434956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 23 17:52:07.434956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.439298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c10937c7-c27c-4e34-a0c9-5fe6f47af7c3 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:07.440374 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c10937c7-c27c-4e34-a0c9-5fe6f47af7c3 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.041865 Aug 23 17:52:07.441177 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 186/345] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:52:07 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 17:52:07.456901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-318c3a9f-9df7-4c31-b897-8387098554b9 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1904598814"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:07.462106 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.462106 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:07.463219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.aggregate [None req-318c3a9f-9df7-4c31-b897-8387098554b9 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Generated uuid d421a9b8-8ad4-47f6-9a70-f6fe022c69e1 for aggregate {{(pid=128808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:52:07.496717 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-318c3a9f-9df7-4c31-b897-8387098554b9 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.045972 Aug 23 17:52:07.502773 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 187/346] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:52:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:07.515908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f0fe67f3-83fb-455a-bdf7-0d300248b4fe tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:07.517821 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.517821 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:07.519844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f0fe67f3-83fb-455a-bdf7-0d300248b4fe tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'db871ca206ca48b0a44778006c764455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a1d3c536c4366b066b0d3d5004414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f0fe67f3-83fb-455a-bdf7-0d300248b4fe tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Request method failure captured: Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPCQeRhZWIjShnbf2rA8-wf4YO0Rm5-TjwONzwy4hbouYwCu23g2QCsP_lhL_Ojnce3PG8k0UuzHvNIyUTbQA_57EZ3Yl6-TxRWJatVzXyafVoC3Cp_rDWDJrdXNb1AhqznbhDBe5RalgMvmUzTB8ffs_OJ_DDIjasyJ7kRcj2d1dQ Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0e6a1d3c536c4366b066b0d3d5004414 Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:07.526265 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:07.527814 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e6a1d3c536c4366b066b0d3d5004414"}]}] Aug 23 17:52:07.527814 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:07.527814 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0e6a1d3c536c4366b066b0d3d5004414 Aug 23 17:52:07.527814 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:07.527814 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminNegativeTestJSON-1050390584-project Aug 23 17:52:07.527814 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:07.527814 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:07.527814 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: db871ca206ca48b0a44778006c764455 Aug 23 17:52:07.527814 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584-project Aug 23 17:52:07.527814 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:07.527814 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 23 17:52:07.527814 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '16'} Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:07.528669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Aug 23 17:52:07.529916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.531089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f0fe67f3-83fb-455a-bdf7-0d300248b4fe tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:07.534248 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f0fe67f3-83fb-455a-bdf7-0d300248b4fe tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] 10.222.0.61 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.022918 Aug 23 17:52:07.535793 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 188/347] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:52:07 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 23 17:52:07.544542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a09c00d-13f7-4874-843a-abb56e3671a0 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:07.545418 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.545418 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:07.604678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=5,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:07.639140 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6a09c00d-13f7-4874-843a-abb56e3671a0 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.087623 Aug 23 17:52:07.653954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1bda298b-0853-4dde-b38a-19befed86bf2 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:07.655027 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 189/348] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:52:07 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:52:07.665947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0cc9f4c2-11ee-4783-bb60-80ea3973c0ae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:07.667507 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1bda298b-0853-4dde-b38a-19befed86bf2 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1388 microversion: 2.1 time: 0.319052 Aug 23 17:52:07.668375 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 160/349] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:07 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1388 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:07.669846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0cc9f4c2-11ee-4783-bb60-80ea3973c0ae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:07.688531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-34113cdc-b6c4-47c6-89e2-d75f6f15a687 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:07.693904 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.693904 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:07.697947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=10,nova_api:DELETE=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:07.701366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cc9f4c2-11ee-4783-bb60-80ea3973c0ae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:07.703111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cc9f4c2-11ee-4783-bb60-80ea3973c0ae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:07.704667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cc9f4c2-11ee-4783-bb60-80ea3973c0ae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:07.707872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cc9f4c2-11ee-4783-bb60-80ea3973c0ae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:07.710747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cc9f4c2-11ee-4783-bb60-80ea3973c0ae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:07.711186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cc9f4c2-11ee-4783-bb60-80ea3973c0ae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:07.736846 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-34113cdc-b6c4-47c6-89e2-d75f6f15a687 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-34113cdc-b6c4-47c6-89e2-d75f6f15a687 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Request method failure captured: Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPDZ7sEjq4Qeg3MVu4J9a_ddbprGmTc8rSv8hxjxwIIdJFAf86LjKftynJE7FjcdkvDMOAh8BqkNh6VdzEmnJRXeB5IlDy2yuP4JhzyeoKmQmhaTYiMXuNMBug99S9qCQeQCtQwpylbVn8dn8nwakIdE7NpGncQjvl5RaENoFEQWFM Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:52:07.742461 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:52:07.744347 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}] Aug 23 17:52:07.744347 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.744347 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:07.744347 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:07.744347 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:07.744347 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:07.744347 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:07.744347 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 00b44661f1a14894baea342d415ae2db Aug 23 17:52:07.744347 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:07.744347 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:07.744347 n-d-850468-16 devstack@n-api.service[128807]: exception: Aggregate -1 could not be found. Aug 23 17:52:07.744347 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '-1'} Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6459, in get_aggregate Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.745632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Aug 23 17:52:07.747205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.748378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-34113cdc-b6c4-47c6-89e2-d75f6f15a687 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:07.748378 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-34113cdc-b6c4-47c6-89e2-d75f6f15a687 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.074976 Aug 23 17:52:07.748378 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 161/350] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:52:07 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:52:07.769883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ae2b4498-dbea-409b-ab7d-4b93a6933373 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:07.784153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ae2b4498-dbea-409b-ab7d-4b93a6933373 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:07.805139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae2b4498-dbea-409b-ab7d-4b93a6933373 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:07.806517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae2b4498-dbea-409b-ab7d-4b93a6933373 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:07.808123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae2b4498-dbea-409b-ab7d-4b93a6933373 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:07.810014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae2b4498-dbea-409b-ab7d-4b93a6933373 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:07.810418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae2b4498-dbea-409b-ab7d-4b93a6933373 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:07.812351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae2b4498-dbea-409b-ab7d-4b93a6933373 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:07.840892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0cc9f4c2-11ee-4783-bb60-80ea3973c0ae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:07.858171 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0cc9f4c2-11ee-4783-bb60-80ea3973c0ae tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1271 microversion: 2.1 time: 0.201782 Aug 23 17:52:07.864992 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 190/351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:07 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1271 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:07.877791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bf0fba76-57f5-49ff-b154-ed41238a7900 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:07.880048 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.880048 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:07.881554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bf0fba76-57f5-49ff-b154-ed41238a7900 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'db871ca206ca48b0a44778006c764455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a1d3c536c4366b066b0d3d5004414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bf0fba76-57f5-49ff-b154-ed41238a7900 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Request method failure captured: Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPCQeRhZWIjShnbf2rA8-wf4YO0Rm5-TjwONzwy4hbouYwCu23g2QCsP_lhL_Ojnce3PG8k0UuzHvNIyUTbQA_57EZ3Yl6-TxRWJatVzXyafVoC3Cp_rDWDJrdXNb1AhqznbhDBe5RalgMvmUzTB8ffs_OJ_DDIjasyJ7kRcj2d1dQ Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0e6a1d3c536c4366b066b0d3d5004414 Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:07.883885 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:07.885084 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e6a1d3c536c4366b066b0d3d5004414"}]}] Aug 23 17:52:07.885084 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:07.885084 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0e6a1d3c536c4366b066b0d3d5004414 Aug 23 17:52:07.885084 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:07.885084 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminNegativeTestJSON-1050390584-project Aug 23 17:52:07.885084 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:07.885084 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:07.885084 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: db871ca206ca48b0a44778006c764455 Aug 23 17:52:07.885084 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584-project Aug 23 17:52:07.885084 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:07.885084 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 23 17:52:07.885084 n-d-850468-16 devstack@n-api.service[128808]: action_args: {} Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:07.885724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Aug 23 17:52:07.886836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:07.889112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bf0fba76-57f5-49ff-b154-ed41238a7900 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:07.891931 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bf0fba76-57f5-49ff-b154-ed41238a7900 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.023462 Aug 23 17:52:07.894917 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 191/352] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 17:52:07 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:07.906378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9eb340c5-836d-450e-ab7d-c22f2839d8c0 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1158109206"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:07.913125 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.913125 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:07.914100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.aggregate [None req-9eb340c5-836d-450e-ab7d-c22f2839d8c0 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Generated uuid ed78f51a-3688-4e6b-b976-78709d0c3548 for aggregate {{(pid=128808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:52:07.966924 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9eb340c5-836d-450e-ab7d-c22f2839d8c0 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.064058 Aug 23 17:52:07.969795 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 192/353] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:52:07 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:52:07.981920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-69e9be64-40f9-4ca5-ac9d-f380890f5cbc tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-16"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:07.987608 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:07.987608 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:08.000501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69e9be64-40f9-4ca5-ac9d-f380890f5cbc tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:08.001633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69e9be64-40f9-4ca5-ac9d-f380890f5cbc tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:08.002443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69e9be64-40f9-4ca5-ac9d-f380890f5cbc tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:08.031329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ae2b4498-dbea-409b-ab7d-4b93a6933373 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:08.045702 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ae2b4498-dbea-409b-ab7d-4b93a6933373 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1266 microversion: 2.1 time: 0.298817 Aug 23 17:52:08.051788 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 162/354] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:07 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1266 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:08.061829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-57af957e-4349-43aa-8e0b-9a832f9090d4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:08.062814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-57af957e-4349-43aa-8e0b-9a832f9090d4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:08.076260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57af957e-4349-43aa-8e0b-9a832f9090d4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:08.076727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57af957e-4349-43aa-8e0b-9a832f9090d4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:08.078823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57af957e-4349-43aa-8e0b-9a832f9090d4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:08.079580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57af957e-4349-43aa-8e0b-9a832f9090d4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:08.080106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57af957e-4349-43aa-8e0b-9a832f9090d4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:08.080537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57af957e-4349-43aa-8e0b-9a832f9090d4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:08.143370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:08.214854 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-69e9be64-40f9-4ca5-ac9d-f380890f5cbc tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 244 microversion: 2.1 time: 0.236787 Aug 23 17:52:08.222686 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 193/355] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 17:52:07 2022] POST /compute/v2.1/os-aggregates/17/action => generated 244 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:52:08.228747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d9a7ec9f-09a0-4001-8065-4396cb29acc4 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:08.230083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d9a7ec9f-09a0-4001-8065-4396cb29acc4 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:08.238526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9a7ec9f-09a0-4001-8065-4396cb29acc4 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:08.239509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9a7ec9f-09a0-4001-8065-4396cb29acc4 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:08.240164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9a7ec9f-09a0-4001-8065-4396cb29acc4 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:08.241828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9a7ec9f-09a0-4001-8065-4396cb29acc4 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:08.242516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9a7ec9f-09a0-4001-8065-4396cb29acc4 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:08.243238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9a7ec9f-09a0-4001-8065-4396cb29acc4 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:08.370111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d9a7ec9f-09a0-4001-8065-4396cb29acc4 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:08.383031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d9a7ec9f-09a0-4001-8065-4396cb29acc4 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:08.389679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d9a7ec9f-09a0-4001-8065-4396cb29acc4 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:08.398662 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d9a7ec9f-09a0-4001-8065-4396cb29acc4 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.174433 Aug 23 17:52:08.399238 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 194/356] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:08 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:08.434978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-efddaa18-01b1-46e3-a897-b97c4f63c4f2 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-16"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:08.437995 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:08.437995 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:08.439455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-efddaa18-01b1-46e3-a897-b97c4f63c4f2 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'db871ca206ca48b0a44778006c764455', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6a1d3c536c4366b066b0d3d5004414', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-efddaa18-01b1-46e3-a897-b97c4f63c4f2 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Request method failure captured: Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 43 Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPCQeRhZWIjShnbf2rA8-wf4YO0Rm5-TjwONzwy4hbouYwCu23g2QCsP_lhL_Ojnce3PG8k0UuzHvNIyUTbQA_57EZ3Yl6-TxRWJatVzXyafVoC3Cp_rDWDJrdXNb1AhqznbhDBe5RalgMvmUzTB8ffs_OJ_DDIjasyJ7kRcj2d1dQ Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0e6a1d3c536c4366b066b0d3d5004414 Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:08.442307 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0e6a1d3c536c4366b066b0d3d5004414"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0e6a1d3c536c4366b066b0d3d5004414"}]}] Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0e6a1d3c536c4366b066b0d3d5004414 Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584 Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminNegativeTestJSON-1050390584-project Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: db871ca206ca48b0a44778006c764455 Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-1050390584-project Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: {"remove_host": {"host": "n-h1-850468-16"}} Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:08.443970 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h1-850468-16'}}} Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:08.444756 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Aug 23 17:52:08.445839 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:08.449381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-efddaa18-01b1-46e3-a897-b97c4f63c4f2 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:08.450471 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-efddaa18-01b1-46e3-a897-b97c4f63c4f2 tempest-AggregatesAdminNegativeTestJSON-1050390584 tempest-AggregatesAdminNegativeTestJSON-1050390584-project] 10.222.0.61 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.024086 Aug 23 17:52:08.454760 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 195/357] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 17:52:08 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:08.469028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:08.470314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:08.488721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:08.490121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:08.492135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:08.493891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:08.495211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:08.496267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:08.561072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:08.562982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:08.563564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:08.564202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lazy-loading 'fault' on Instance uuid 304e504b-7767-46b3-8785-5010fac97f7a {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:08.670593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-57af957e-4349-43aa-8e0b-9a832f9090d4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:08.689115 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-57af957e-4349-43aa-8e0b-9a832f9090d4 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1535 microversion: 2.1 time: 0.635657 Aug 23 17:52:08.724769 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 163/358] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:08 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1535 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:08.735621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7da6d1ca-3475-4b27-b80a-88ad850c3dce tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-16"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:08.740789 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:08.740789 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:08.761407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7da6d1ca-3475-4b27-b80a-88ad850c3dce tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:08.762201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7da6d1ca-3475-4b27-b80a-88ad850c3dce tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:08.762885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7da6d1ca-3475-4b27-b80a-88ad850c3dce tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:08.900856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:08.910321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa82afdd-2f48-4a23-84c7-8559f49dd1df tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1458 microversion: 2.1 time: 0.453981 Aug 23 17:52:08.911674 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 196/359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:08 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1458 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:08.925620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c333c275-adc3-49e9-9fbc-15cb9b4052eb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:08.927940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c333c275-adc3-49e9-9fbc-15cb9b4052eb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:08.931742 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7da6d1ca-3475-4b27-b80a-88ad850c3dce tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 228 microversion: 2.1 time: 0.205212 Aug 23 17:52:08.939212 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 164/360] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 17:52:08 2022] POST /compute/v2.1/os-aggregates/17/action => generated 228 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:08.945790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f36c3647-9222-4adb-96d9-b002953fcb55 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Action: 'create', calling method: .version_select at 0x7f27ed2cef70>, body: {"pool": "e726cca6-c66d-49c0-9b80-481af41866c3"} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:08.946079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c333c275-adc3-49e9-9fbc-15cb9b4052eb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:08.946608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c333c275-adc3-49e9-9fbc-15cb9b4052eb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:08.947052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c333c275-adc3-49e9-9fbc-15cb9b4052eb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:08.947830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c333c275-adc3-49e9-9fbc-15cb9b4052eb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:08.948283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c333c275-adc3-49e9-9fbc-15cb9b4052eb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:08.948891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c333c275-adc3-49e9-9fbc-15cb9b4052eb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:09.323454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c333c275-adc3-49e9-9fbc-15cb9b4052eb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:09.344549 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c333c275-adc3-49e9-9fbc-15cb9b4052eb tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1388 microversion: 2.1 time: 0.431742 Aug 23 17:52:09.346461 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 197/361] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:08 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1388 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:09.354212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-467b17c8-58fd-48d4-aaf7-dd926805fa02 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:09.356118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-467b17c8-58fd-48d4-aaf7-dd926805fa02 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:09.371194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-467b17c8-58fd-48d4-aaf7-dd926805fa02 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:09.371950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-467b17c8-58fd-48d4-aaf7-dd926805fa02 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:09.372166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-467b17c8-58fd-48d4-aaf7-dd926805fa02 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:09.372920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-467b17c8-58fd-48d4-aaf7-dd926805fa02 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:09.373309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-467b17c8-58fd-48d4-aaf7-dd926805fa02 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:09.375259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-467b17c8-58fd-48d4-aaf7-dd926805fa02 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:09.498064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-467b17c8-58fd-48d4-aaf7-dd926805fa02 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:09.511392 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-467b17c8-58fd-48d4-aaf7-dd926805fa02 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1277 microversion: 2.1 time: 0.162673 Aug 23 17:52:09.528632 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 198/362] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:09 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1277 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:09.533847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1eaf1f13-aaff-4903-88c8-ca7e013ce276 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:09.535666 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:09.535666 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:09.565299 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1eaf1f13-aaff-4903-88c8-ca7e013ce276 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.035083 Aug 23 17:52:09.575849 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 199/363] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:52:09 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:52:09.582134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-69b8f5a7-70ae-439c-8d57-a825a244de9a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:09.583112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-69b8f5a7-70ae-439c-8d57-a825a244de9a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:09.592179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69b8f5a7-70ae-439c-8d57-a825a244de9a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:09.594024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69b8f5a7-70ae-439c-8d57-a825a244de9a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:09.594024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69b8f5a7-70ae-439c-8d57-a825a244de9a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:09.594655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69b8f5a7-70ae-439c-8d57-a825a244de9a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:09.595244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69b8f5a7-70ae-439c-8d57-a825a244de9a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:09.596693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69b8f5a7-70ae-439c-8d57-a825a244de9a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:09.767270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-69b8f5a7-70ae-439c-8d57-a825a244de9a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:09.778828 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-69b8f5a7-70ae-439c-8d57-a825a244de9a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1272 microversion: 2.1 time: 0.201381 Aug 23 17:52:09.779993 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 200/364] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:09 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1272 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:09.785838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-078b4d5e-6576-417a-8455-f9972c5f34c1 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:09.786589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-078b4d5e-6576-417a-8455-f9972c5f34c1 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:09.793232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-078b4d5e-6576-417a-8455-f9972c5f34c1 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:09.794015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-078b4d5e-6576-417a-8455-f9972c5f34c1 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:09.794448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-078b4d5e-6576-417a-8455-f9972c5f34c1 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:09.795179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-078b4d5e-6576-417a-8455-f9972c5f34c1 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:09.795629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-078b4d5e-6576-417a-8455-f9972c5f34c1 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:09.796046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-078b4d5e-6576-417a-8455-f9972c5f34c1 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:10.044087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-078b4d5e-6576-417a-8455-f9972c5f34c1 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:10.046291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:10.056390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-078b4d5e-6576-417a-8455-f9972c5f34c1 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:10.057898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-078b4d5e-6576-417a-8455-f9972c5f34c1 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:10.073984 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-078b4d5e-6576-417a-8455-f9972c5f34c1 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.292305 Aug 23 17:52:10.074942 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 201/365] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:09 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:10.079707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9efb8305-f31a-4f6f-91f8-23cdf59308f1 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-25618480"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:10.083509 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:10.083509 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:10.084602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.aggregate [None req-9efb8305-f31a-4f6f-91f8-23cdf59308f1 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Generated uuid 4bbc3d96-25da-4c24-8e6b-f3a041c636f3 for aggregate {{(pid=128808) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 17:52:10.139628 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9efb8305-f31a-4f6f-91f8-23cdf59308f1 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.062600 Aug 23 17:52:10.147946 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 202/366] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 17:52:10 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:10.159123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-517f3314-bf71-4344-bb0e-07c29270a09d req-bcbf23bf-a893-419a-be13-bec602a56b4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1684439-72b6-4fff-9624-39abf5a9552a", "name": "network-vif-plugged", "status": "completed", "tag": "be443953-eadd-4537-b630-37f66a56fe75"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:10.180039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-517f3314-bf71-4344-bb0e-07c29270a09d req-bcbf23bf-a893-419a-be13-bec602a56b4a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:10.180974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-517f3314-bf71-4344-bb0e-07c29270a09d req-bcbf23bf-a893-419a-be13-bec602a56b4a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:10.181637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-517f3314-bf71-4344-bb0e-07c29270a09d req-bcbf23bf-a893-419a-be13-bec602a56b4a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:10.215434 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-517f3314-bf71-4344-bb0e-07c29270a09d req-bcbf23bf-a893-419a-be13-bec602a56b4a service nova] Creating event network-vif-plugged:be443953-eadd-4537-b630-37f66a56fe75 for instance f1684439-72b6-4fff-9624-39abf5a9552a on n-h1-850468-16 Aug 23 17:52:10.228362 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-517f3314-bf71-4344-bb0e-07c29270a09d req-bcbf23bf-a893-419a-be13-bec602a56b4a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077713 Aug 23 17:52:10.229422 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 203/367] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:10.245372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:10.247091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:10.259791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:10.260413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:10.261837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:10.263555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:10.264325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:10.267193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:10.359620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:10.360051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:10.364185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:10.364815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lazy-loading 'fault' on Instance uuid 304e504b-7767-46b3-8785-5010fac97f7a {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:10.517799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '969ea18ca5584a20bb82706514cf8a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1204921b96d94a2ab750e504f819dcbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:10.535371 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5f50c9c4-5f0f-45cb-8a66-0ed9f3d8b21c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 200 len: 1288 microversion: 2.1 time: 0.299329 Aug 23 17:52:10.549169 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 204/368] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:10 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 1288 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:10.555494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d054c49-c1a1-4274-9a2a-e7b025158e14 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:10.558183 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:10.558183 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:10.567300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d054c49-c1a1-4274-9a2a-e7b025158e14 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:10.567918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d054c49-c1a1-4274-9a2a-e7b025158e14 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:10.568758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d054c49-c1a1-4274-9a2a-e7b025158e14 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:10.576737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d054c49-c1a1-4274-9a2a-e7b025158e14 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:10.577199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d054c49-c1a1-4274-9a2a-e7b025158e14 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:10.577865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d054c49-c1a1-4274-9a2a-e7b025158e14 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:10.592991 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.compute.aggregates [None req-8d054c49-c1a1-4274-9a2a-e7b025158e14 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 23 17:52:10.593773 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8d054c49-c1a1-4274-9a2a-e7b025158e14 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d054c49-c1a1-4274-9a2a-e7b025158e14 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Request method failure captured: Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 42 Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPDZ7sEjq4Qeg3MVu4J9a_ddbprGmTc8rSv8hxjxwIIdJFAf86LjKftynJE7FjcdkvDMOAh8BqkNh6VdzEmnJRXeB5IlDy2yuP4JhzyeoKmQmhaTYiMXuNMBug99S9qCQeQCtQwpylbVn8dn8nwakIdE7NpGncQjvl5RaENoFEQWFM Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:52:10.598241 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc833f679f944e809f6e9f571832ee80"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc833f679f944e809f6e9f571832ee80"}]}] Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: bc833f679f944e809f6e9f571832ee80 Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-705121233 Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 00b44661f1a14894baea342d415ae2db Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: {"remove_host": {"host": "nonexist_host"}} Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:10.599530 n-d-850468-16 devstack@n-api.service[128808]: exception: Cannot remove host nonexist_host in aggregate 18 Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5994, in _get_service_in_cell_by_host Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6000, in _get_service_in_cell_by_host Aug 23 17:52:10.600253 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6678, in remove_host_from_aggregate Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Aug 23 17:52:10.601704 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6002, in _get_service_in_cell_by_host Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:10.603751 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:10.607832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:10.607832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:10.607832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:10.607832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:10.607832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Aug 23 17:52:10.607832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:10.607832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d054c49-c1a1-4274-9a2a-e7b025158e14 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:10.607832 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8d054c49-c1a1-4274-9a2a-e7b025158e14 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.049478 Aug 23 17:52:10.607832 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 205/369] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 17:52:10 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:52:10.611444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6bdb9de3-f993-477e-a8a8-713172f330b2 req-f7b3552e-f1cc-4c2f-bba4-37c4f2e1a97e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "304e504b-7767-46b3-8785-5010fac97f7a", "name": "network-vif-deleted", "tag": "ec85963d-5c39-4e97-98c6-16cfd848ed74"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:10.631496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6bdb9de3-f993-477e-a8a8-713172f330b2 req-f7b3552e-f1cc-4c2f-bba4-37c4f2e1a97e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:10.632338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6bdb9de3-f993-477e-a8a8-713172f330b2 req-f7b3552e-f1cc-4c2f-bba4-37c4f2e1a97e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:10.632948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6bdb9de3-f993-477e-a8a8-713172f330b2 req-f7b3552e-f1cc-4c2f-bba4-37c4f2e1a97e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:10.645872 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6bdb9de3-f993-477e-a8a8-713172f330b2 req-f7b3552e-f1cc-4c2f-bba4-37c4f2e1a97e service nova] Creating event network-vif-deleted:ec85963d-5c39-4e97-98c6-16cfd848ed74 for instance 304e504b-7767-46b3-8785-5010fac97f7a on n-h2-850468-16 Aug 23 17:52:10.652375 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6bdb9de3-f993-477e-a8a8-713172f330b2 req-f7b3552e-f1cc-4c2f-bba4-37c4f2e1a97e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046615 Aug 23 17:52:10.653379 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 206/370] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:10.661069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc52ad66-64a5-4540-ae76-0fd2d3655aac tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:10.662131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc52ad66-64a5-4540-ae76-0fd2d3655aac tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:10.673562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc52ad66-64a5-4540-ae76-0fd2d3655aac tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:10.674071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc52ad66-64a5-4540-ae76-0fd2d3655aac tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:10.675915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc52ad66-64a5-4540-ae76-0fd2d3655aac tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:10.676989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc52ad66-64a5-4540-ae76-0fd2d3655aac tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:10.677704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc52ad66-64a5-4540-ae76-0fd2d3655aac tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:10.678134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc52ad66-64a5-4540-ae76-0fd2d3655aac tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:10.950300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc52ad66-64a5-4540-ae76-0fd2d3655aac tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:10.982559 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc52ad66-64a5-4540-ae76-0fd2d3655aac tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1388 microversion: 2.1 time: 0.312087 Aug 23 17:52:10.985695 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 207/371] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:10 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1388 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:11.001386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c970fa83-8895-4bcd-b554-2f965a9879ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:11.002312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c970fa83-8895-4bcd-b554-2f965a9879ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:11.014340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c970fa83-8895-4bcd-b554-2f965a9879ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.014870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c970fa83-8895-4bcd-b554-2f965a9879ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.015303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c970fa83-8895-4bcd-b554-2f965a9879ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.016831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c970fa83-8895-4bcd-b554-2f965a9879ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.016831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c970fa83-8895-4bcd-b554-2f965a9879ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.017166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c970fa83-8895-4bcd-b554-2f965a9879ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.201619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c970fa83-8895-4bcd-b554-2f965a9879ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:11.215954 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c970fa83-8895-4bcd-b554-2f965a9879ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1319 microversion: 2.1 time: 0.224642 Aug 23 17:52:11.216532 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 208/372] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:10 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1319 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:11.222725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d89c69e-ac92-4d69-aa17-cc18df46ab03 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:11.223679 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:11.223679 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:11.249614 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7d89c69e-ac92-4d69-aa17-cc18df46ab03 tempest-AggregatesAdminNegativeTestJSON-705121233 tempest-AggregatesAdminNegativeTestJSON-705121233-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.031461 Aug 23 17:52:11.254657 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 209/373] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:52:11 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:52:11.259115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b596621-a46d-4ca2-9575-8ac9b3ea5848 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:11.259737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b596621-a46d-4ca2-9575-8ac9b3ea5848 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:11.267097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b596621-a46d-4ca2-9575-8ac9b3ea5848 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.268162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b596621-a46d-4ca2-9575-8ac9b3ea5848 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.268979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b596621-a46d-4ca2-9575-8ac9b3ea5848 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.272016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b596621-a46d-4ca2-9575-8ac9b3ea5848 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.273152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b596621-a46d-4ca2-9575-8ac9b3ea5848 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.273922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b596621-a46d-4ca2-9575-8ac9b3ea5848 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.617382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b596621-a46d-4ca2-9575-8ac9b3ea5848 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:11.632719 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b596621-a46d-4ca2-9575-8ac9b3ea5848 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.381342 Aug 23 17:52:11.634091 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 210/374] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:11 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:11.642370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c2f65c7e-9ceb-46c1-80bb-f8e060ec8afd tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:11.643177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c2f65c7e-9ceb-46c1-80bb-f8e060ec8afd tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:11.650837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2f65c7e-9ceb-46c1-80bb-f8e060ec8afd tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.651568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2f65c7e-9ceb-46c1-80bb-f8e060ec8afd tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.652183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2f65c7e-9ceb-46c1-80bb-f8e060ec8afd tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.653045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2f65c7e-9ceb-46c1-80bb-f8e060ec8afd tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.653646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2f65c7e-9ceb-46c1-80bb-f8e060ec8afd tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.654219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2f65c7e-9ceb-46c1-80bb-f8e060ec8afd tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.727108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c2f65c7e-9ceb-46c1-80bb-f8e060ec8afd tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:11.735754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c2f65c7e-9ceb-46c1-80bb-f8e060ec8afd tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:11.737444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c2f65c7e-9ceb-46c1-80bb-f8e060ec8afd tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:11.749849 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c2f65c7e-9ceb-46c1-80bb-f8e060ec8afd tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.111808 Aug 23 17:52:11.754693 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 211/375] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:11 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:11.764484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f025a43-47e2-4582-978e-2f81dd9565ac tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:11.765311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0f025a43-47e2-4582-978e-2f81dd9565ac tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:11.782259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f025a43-47e2-4582-978e-2f81dd9565ac tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.783707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f025a43-47e2-4582-978e-2f81dd9565ac tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.784224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f025a43-47e2-4582-978e-2f81dd9565ac tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.785617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f025a43-47e2-4582-978e-2f81dd9565ac tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.786143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f025a43-47e2-4582-978e-2f81dd9565ac tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.787239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f025a43-47e2-4582-978e-2f81dd9565ac tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.803635 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-0f025a43-47e2-4582-978e-2f81dd9565ac tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] HTTP exception thrown: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f025a43-47e2-4582-978e-2f81dd9565ac tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Request method failure captured: Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a HTTP/1.1 Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROBugJULgAJMLuUwPUgsoJKORWn6AAhmdTLExsxSm7HyBl5xXtxXRzFsmx--M1t7JcIYXi2lQ-yAAJ-OzItGQusrUdSfP0g-U2wsh_kWSQuO0UxNR-I5OBLf5tfSm_vZwCGIW3b98TGQv6QqA62qPgTiWKkE_t9b1XFDTvxwnr2GVQ Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 1204921b96d94a2ab750e504f819dcbe Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:11.805291 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:11.806764 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1204921b96d94a2ab750e504f819dcbe"}]}] Aug 23 17:52:11.806764 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.806764 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 1204921b96d94a2ab750e504f819dcbe Aug 23 17:52:11.806764 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.806764 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersAdminTestJSON-1525128900-project Aug 23 17:52:11.806764 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:11.806764 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:11.806764 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 969ea18ca5584a20bb82706514cf8a30 Aug 23 17:52:11.806764 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersAdminTestJSON-1525128900-project Aug 23 17:52:11.806764 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:11.806764 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.806764 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '304e504b-7767-46b3-8785-5010fac97f7a'} Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:11.807583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.808923 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.810105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f025a43-47e2-4582-978e-2f81dd9565ac tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Returning 404 to user: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:11.810558 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0f025a43-47e2-4582-978e-2f81dd9565ac tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 404 len: 111 microversion: 2.1 time: 0.054571 Aug 23 17:52:11.814596 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 212/376] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:11 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:11.824194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-95d1f2c8-32d3-403e-bf1e-0e6715370b0c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:11.824688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-95d1f2c8-32d3-403e-bf1e-0e6715370b0c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:11.830506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95d1f2c8-32d3-403e-bf1e-0e6715370b0c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.831019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95d1f2c8-32d3-403e-bf1e-0e6715370b0c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.832453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95d1f2c8-32d3-403e-bf1e-0e6715370b0c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.833322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95d1f2c8-32d3-403e-bf1e-0e6715370b0c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.834180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95d1f2c8-32d3-403e-bf1e-0e6715370b0c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.834180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95d1f2c8-32d3-403e-bf1e-0e6715370b0c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.851640 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-95d1f2c8-32d3-403e-bf1e-0e6715370b0c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] HTTP exception thrown: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-95d1f2c8-32d3-403e-bf1e-0e6715370b0c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Request method failure captured: Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a HTTP/1.1 Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROBugJULgAJMLuUwPUgsoJKORWn6AAhmdTLExsxSm7HyBl5xXtxXRzFsmx--M1t7JcIYXi2lQ-yAAJ-OzItGQusrUdSfP0g-U2wsh_kWSQuO0UxNR-I5OBLf5tfSm_vZwCGIW3b98TGQv6QqA62qPgTiWKkE_t9b1XFDTvxwnr2GVQ Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 1204921b96d94a2ab750e504f819dcbe Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:11.853212 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:11.854429 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1204921b96d94a2ab750e504f819dcbe"}]}] Aug 23 17:52:11.854429 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.854429 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 1204921b96d94a2ab750e504f819dcbe Aug 23 17:52:11.854429 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.854429 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersAdminTestJSON-1525128900-project Aug 23 17:52:11.854429 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:11.854429 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:11.854429 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 969ea18ca5584a20bb82706514cf8a30 Aug 23 17:52:11.854429 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersAdminTestJSON-1525128900-project Aug 23 17:52:11.854429 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:11.854429 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.854429 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '304e504b-7767-46b3-8785-5010fac97f7a'} Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:11.855112 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.856693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.857736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-95d1f2c8-32d3-403e-bf1e-0e6715370b0c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Returning 404 to user: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:11.857736 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-95d1f2c8-32d3-403e-bf1e-0e6715370b0c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "DELETE /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 404 len: 111 microversion: 2.1 time: 0.034388 Aug 23 17:52:11.857736 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 213/377] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:52:11 2022] DELETE /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:11.867219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9b913c0b-e97a-431c-b36d-e2d4788086f6 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:11.867885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9b913c0b-e97a-431c-b36d-e2d4788086f6 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: 304e504b-7767-46b3-8785-5010fac97f7a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:11.875156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b913c0b-e97a-431c-b36d-e2d4788086f6 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.876313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b913c0b-e97a-431c-b36d-e2d4788086f6 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.876426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b913c0b-e97a-431c-b36d-e2d4788086f6 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.877164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b913c0b-e97a-431c-b36d-e2d4788086f6 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.877631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b913c0b-e97a-431c-b36d-e2d4788086f6 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.879747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b913c0b-e97a-431c-b36d-e2d4788086f6 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.900393 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-9b913c0b-e97a-431c-b36d-e2d4788086f6 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] HTTP exception thrown: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9b913c0b-e97a-431c-b36d-e2d4788086f6 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Request method failure captured: Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a HTTP/1.1 Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROBugJULgAJMLuUwPUgsoJKORWn6AAhmdTLExsxSm7HyBl5xXtxXRzFsmx--M1t7JcIYXi2lQ-yAAJ-OzItGQusrUdSfP0g-U2wsh_kWSQuO0UxNR-I5OBLf5tfSm_vZwCGIW3b98TGQv6QqA62qPgTiWKkE_t9b1XFDTvxwnr2GVQ Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 1204921b96d94a2ab750e504f819dcbe Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:11.913966 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:11.915344 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1204921b96d94a2ab750e504f819dcbe"}]}] Aug 23 17:52:11.915344 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.915344 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 1204921b96d94a2ab750e504f819dcbe Aug 23 17:52:11.915344 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.915344 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersAdminTestJSON-1525128900-project Aug 23 17:52:11.915344 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:11.915344 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:11.915344 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 969ea18ca5584a20bb82706514cf8a30 Aug 23 17:52:11.915344 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersAdminTestJSON-1525128900-project Aug 23 17:52:11.915344 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:11.915344 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.915344 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '304e504b-7767-46b3-8785-5010fac97f7a'} Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:11.915977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. Aug 23 17:52:11.917007 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.917939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9b913c0b-e97a-431c-b36d-e2d4788086f6 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Returning 404 to user: Instance 304e504b-7767-46b3-8785-5010fac97f7a could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:11.917939 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9b913c0b-e97a-431c-b36d-e2d4788086f6 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a" status: 404 len: 111 microversion: 2.1 time: 0.042722 Aug 23 17:52:11.917939 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 214/378] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:11 2022] GET /compute/v2.1/servers/304e504b-7767-46b3-8785-5010fac97f7a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:11.926090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03831801-afb7-4a03-b7cc-74d99ef21437 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:11.926858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-03831801-afb7-4a03-b7cc-74d99ef21437 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:11.934151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03831801-afb7-4a03-b7cc-74d99ef21437 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.934775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03831801-afb7-4a03-b7cc-74d99ef21437 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.935203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03831801-afb7-4a03-b7cc-74d99ef21437 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.935896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03831801-afb7-4a03-b7cc-74d99ef21437 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.936342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03831801-afb7-4a03-b7cc-74d99ef21437 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.936757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03831801-afb7-4a03-b7cc-74d99ef21437 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.952746 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-03831801-afb7-4a03-b7cc-74d99ef21437 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] HTTP exception thrown: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03831801-afb7-4a03-b7cc-74d99ef21437 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Request method failure captured: Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 HTTP/1.1 Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROBugJULgAJMLuUwPUgsoJKORWn6AAhmdTLExsxSm7HyBl5xXtxXRzFsmx--M1t7JcIYXi2lQ-yAAJ-OzItGQusrUdSfP0g-U2wsh_kWSQuO0UxNR-I5OBLf5tfSm_vZwCGIW3b98TGQv6QqA62qPgTiWKkE_t9b1XFDTvxwnr2GVQ Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 1204921b96d94a2ab750e504f819dcbe Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:11.954325 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:11.955558 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1204921b96d94a2ab750e504f819dcbe"}]}] Aug 23 17:52:11.955558 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.955558 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 1204921b96d94a2ab750e504f819dcbe Aug 23 17:52:11.955558 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.955558 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersAdminTestJSON-1525128900-project Aug 23 17:52:11.955558 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:11.955558 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:11.955558 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 969ea18ca5584a20bb82706514cf8a30 Aug 23 17:52:11.955558 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersAdminTestJSON-1525128900-project Aug 23 17:52:11.955558 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:11.955558 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:52:11.955558 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f249c89c-eb04-4198-a3a4-ee5ff7c2ec03'} Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:11.956861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:52:11.957900 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.959757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03831801-afb7-4a03-b7cc-74d99ef21437 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Returning 404 to user: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:11.959757 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-03831801-afb7-4a03-b7cc-74d99ef21437 tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 404 len: 111 microversion: 2.1 time: 0.035418 Aug 23 17:52:11.959757 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 215/379] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:52:11 2022] DELETE /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:11.966946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-336ca9d5-b80a-42ba-84c6-fb0463badb5c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:11.967679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-336ca9d5-b80a-42ba-84c6-fb0463badb5c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] [instance: f249c89c-eb04-4198-a3a4-ee5ff7c2ec03] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:11.974115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336ca9d5-b80a-42ba-84c6-fb0463badb5c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.974628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336ca9d5-b80a-42ba-84c6-fb0463badb5c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.974953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336ca9d5-b80a-42ba-84c6-fb0463badb5c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.975656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336ca9d5-b80a-42ba-84c6-fb0463badb5c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:11.976117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336ca9d5-b80a-42ba-84c6-fb0463badb5c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:11.976546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336ca9d5-b80a-42ba-84c6-fb0463badb5c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:11.995101 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-336ca9d5-b80a-42ba-84c6-fb0463badb5c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] HTTP exception thrown: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-336ca9d5-b80a-42ba-84c6-fb0463badb5c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Request method failure captured: Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 HTTP/1.1 Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROBugJULgAJMLuUwPUgsoJKORWn6AAhmdTLExsxSm7HyBl5xXtxXRzFsmx--M1t7JcIYXi2lQ-yAAJ-OzItGQusrUdSfP0g-U2wsh_kWSQuO0UxNR-I5OBLf5tfSm_vZwCGIW3b98TGQv6QqA62qPgTiWKkE_t9b1XFDTvxwnr2GVQ Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 1204921b96d94a2ab750e504f819dcbe Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:11.996652 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:11.998255 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1204921b96d94a2ab750e504f819dcbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1204921b96d94a2ab750e504f819dcbe"}]}] Aug 23 17:52:11.998255 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.998255 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 1204921b96d94a2ab750e504f819dcbe Aug 23 17:52:11.998255 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-1525128900 Aug 23 17:52:11.998255 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersAdminTestJSON-1525128900-project Aug 23 17:52:11.998255 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:11.998255 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:11.998255 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 969ea18ca5584a20bb82706514cf8a30 Aug 23 17:52:11.998255 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersAdminTestJSON-1525128900-project Aug 23 17:52:11.998255 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:11.998255 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:52:11.998255 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f249c89c-eb04-4198-a3a4-ee5ff7c2ec03'} Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:11.999062 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. Aug 23 17:52:12.000325 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:12.001494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-336ca9d5-b80a-42ba-84c6-fb0463badb5c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] Returning 404 to user: Instance f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:12.001494 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-336ca9d5-b80a-42ba-84c6-fb0463badb5c tempest-DeleteServersAdminTestJSON-1525128900 tempest-DeleteServersAdminTestJSON-1525128900-project] 10.222.0.61 "GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03" status: 404 len: 111 microversion: 2.1 time: 0.035373 Aug 23 17:52:12.001494 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 216/380] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:11 2022] GET /compute/v2.1/servers/f249c89c-eb04-4198-a3a4-ee5ff7c2ec03 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:12.018827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e1f294d8-a386-4c0d-8970-6299e4674083 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:12.019685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e1f294d8-a386-4c0d-8970-6299e4674083 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:12.025523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1f294d8-a386-4c0d-8970-6299e4674083 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:12.026161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1f294d8-a386-4c0d-8970-6299e4674083 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:12.026645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1f294d8-a386-4c0d-8970-6299e4674083 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:12.027353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1f294d8-a386-4c0d-8970-6299e4674083 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:12.027804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1f294d8-a386-4c0d-8970-6299e4674083 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:12.028227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1f294d8-a386-4c0d-8970-6299e4674083 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:12.318704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e1f294d8-a386-4c0d-8970-6299e4674083 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:12.337823 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e1f294d8-a386-4c0d-8970-6299e4674083 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1388 microversion: 2.1 time: 0.323117 Aug 23 17:52:12.341937 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 217/381] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:12 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1388 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:12.348669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-84e4dbbb-b187-45bb-9179-baadf108d6eb tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:12.360685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-84e4dbbb-b187-45bb-9179-baadf108d6eb tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:12.383253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e4dbbb-b187-45bb-9179-baadf108d6eb tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:12.384911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e4dbbb-b187-45bb-9179-baadf108d6eb tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:12.387132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e4dbbb-b187-45bb-9179-baadf108d6eb tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:12.389883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e4dbbb-b187-45bb-9179-baadf108d6eb tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:12.390596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e4dbbb-b187-45bb-9179-baadf108d6eb tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:12.392873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e4dbbb-b187-45bb-9179-baadf108d6eb tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:12.826013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-84e4dbbb-b187-45bb-9179-baadf108d6eb tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:12.845791 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-84e4dbbb-b187-45bb-9179-baadf108d6eb tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1319 microversion: 2.1 time: 0.500708 Aug 23 17:52:12.848959 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 218/382] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:12 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:12.869791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-954d5b54-3084-48b7-a08a-02a28e28d18e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:12.870501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-954d5b54-3084-48b7-a08a-02a28e28d18e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:12.879905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-954d5b54-3084-48b7-a08a-02a28e28d18e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:12.880402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-954d5b54-3084-48b7-a08a-02a28e28d18e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:12.880840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-954d5b54-3084-48b7-a08a-02a28e28d18e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:12.881924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-954d5b54-3084-48b7-a08a-02a28e28d18e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:12.882483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-954d5b54-3084-48b7-a08a-02a28e28d18e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:12.883693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-954d5b54-3084-48b7-a08a-02a28e28d18e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:13.204362 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f36c3647-9222-4adb-96d9-b002953fcb55 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 4.269871 Aug 23 17:52:13.205291 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 165/383] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Aug 23 17:52:08 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 4271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:13.211332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eacecfbe-d097-4006-83ce-2dc10944c6a5 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:13.211926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eacecfbe-d097-4006-83ce-2dc10944c6a5 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:13.228202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eacecfbe-d097-4006-83ce-2dc10944c6a5 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:13.229513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eacecfbe-d097-4006-83ce-2dc10944c6a5 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:13.230110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eacecfbe-d097-4006-83ce-2dc10944c6a5 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:13.232484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eacecfbe-d097-4006-83ce-2dc10944c6a5 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:13.234117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eacecfbe-d097-4006-83ce-2dc10944c6a5 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:13.234781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eacecfbe-d097-4006-83ce-2dc10944c6a5 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:13.382928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-954d5b54-3084-48b7-a08a-02a28e28d18e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:13.391971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eacecfbe-d097-4006-83ce-2dc10944c6a5 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:13.395392 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-954d5b54-3084-48b7-a08a-02a28e28d18e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.544892 Aug 23 17:52:13.396140 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 219/384] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:12 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:13.409381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eacecfbe-d097-4006-83ce-2dc10944c6a5 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:13.418535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eacecfbe-d097-4006-83ce-2dc10944c6a5 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:13.419366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Action: 'action', calling method: .version_select at 0x7f27efbb3160>, body: {"addFloatingIp": {"address": "172.25.9.187"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:13.424022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:13.435317 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eacecfbe-d097-4006-83ce-2dc10944c6a5 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.226857 Aug 23 17:52:13.436118 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 166/385] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:13 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:13.443455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:13.444288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:13.444874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:13.445748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:13.446349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:13.447018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:13.468242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-afd6ac44-1f07-4ab1-bbf0-ff443af4d162 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:13.469132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-afd6ac44-1f07-4ab1-bbf0-ff443af4d162 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:13.478226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afd6ac44-1f07-4ab1-bbf0-ff443af4d162 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:13.478837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afd6ac44-1f07-4ab1-bbf0-ff443af4d162 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:13.479973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afd6ac44-1f07-4ab1-bbf0-ff443af4d162 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:13.482078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afd6ac44-1f07-4ab1-bbf0-ff443af4d162 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:13.494368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afd6ac44-1f07-4ab1-bbf0-ff443af4d162 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:13.494871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afd6ac44-1f07-4ab1-bbf0-ff443af4d162 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:13.602991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "refresh_cache-384a38ca-06b1-4f61-a6f1-fd316e2d373a" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 17:52:13.603444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquired lock "refresh_cache-384a38ca-06b1-4f61-a6f1-fd316e2d373a" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 17:52:13.818731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=45,nova_cell0:UPDATE=7 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:14.086065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-afd6ac44-1f07-4ab1-bbf0-ff443af4d162 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:14.104941 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-afd6ac44-1f07-4ab1-bbf0-ff443af4d162 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1587 microversion: 2.1 time: 0.654174 Aug 23 17:52:14.105529 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 167/386] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:13 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1587 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:14.127027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-63dbfffe-2933-4c07-a3a2-1ca3b8a03230 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:14.128136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-63dbfffe-2933-4c07-a3a2-1ca3b8a03230 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:14.136639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63dbfffe-2933-4c07-a3a2-1ca3b8a03230 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:14.137341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63dbfffe-2933-4c07-a3a2-1ca3b8a03230 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:14.137930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63dbfffe-2933-4c07-a3a2-1ca3b8a03230 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:14.138852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63dbfffe-2933-4c07-a3a2-1ca3b8a03230 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:14.139506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63dbfffe-2933-4c07-a3a2-1ca3b8a03230 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:14.140083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63dbfffe-2933-4c07-a3a2-1ca3b8a03230 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:14.592700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-63dbfffe-2933-4c07-a3a2-1ca3b8a03230 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:14.607698 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-63dbfffe-2933-4c07-a3a2-1ca3b8a03230 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1319 microversion: 2.1 time: 0.501085 Aug 23 17:52:14.616565 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 168/387] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:14 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:14.621961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-d3e77213-42fd-4caf-9ce3-f991ed4482e2 req-684e1ca7-1594-4462-aa21-06350d2141a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1391cef8-1476-4368-824a-344caae35cd8", "tag": "1d9b9dfa-0998-42b8-ac7c-a034fcb6e208"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:14.640197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d3e77213-42fd-4caf-9ce3-f991ed4482e2 req-684e1ca7-1594-4462-aa21-06350d2141a0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:14.645776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d3e77213-42fd-4caf-9ce3-f991ed4482e2 req-684e1ca7-1594-4462-aa21-06350d2141a0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:14.646324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d3e77213-42fd-4caf-9ce3-f991ed4482e2 req-684e1ca7-1594-4462-aa21-06350d2141a0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:14.689054 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-d3e77213-42fd-4caf-9ce3-f991ed4482e2 req-684e1ca7-1594-4462-aa21-06350d2141a0 service nova] Creating event network-changed:1d9b9dfa-0998-42b8-ac7c-a034fcb6e208 for instance 1391cef8-1476-4368-824a-344caae35cd8 on n-h1-850468-16 Aug 23 17:52:14.703277 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-d3e77213-42fd-4caf-9ce3-f991ed4482e2 req-684e1ca7-1594-4462-aa21-06350d2141a0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085289 Aug 23 17:52:14.703891 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 169/388] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:14.713044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6aaaf3e4-b6a3-4f91-9dcb-cb5b6700ba6f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:14.715111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6aaaf3e4-b6a3-4f91-9dcb-cb5b6700ba6f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:14.723799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aaaf3e4-b6a3-4f91-9dcb-cb5b6700ba6f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:14.724580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aaaf3e4-b6a3-4f91-9dcb-cb5b6700ba6f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:14.725221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aaaf3e4-b6a3-4f91-9dcb-cb5b6700ba6f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:14.726170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aaaf3e4-b6a3-4f91-9dcb-cb5b6700ba6f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:14.726846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aaaf3e4-b6a3-4f91-9dcb-cb5b6700ba6f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:14.728175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aaaf3e4-b6a3-4f91-9dcb-cb5b6700ba6f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:14.983299 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6aaaf3e4-b6a3-4f91-9dcb-cb5b6700ba6f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.275832 Aug 23 17:52:14.983874 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 170/389] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 17:52:14 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a/os-interface => generated 285 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:14.988977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-df716bc4-aa96-4649-b99a-c79aec031047 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:14.989780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-df716bc4-aa96-4649-b99a-c79aec031047 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:15.006360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df716bc4-aa96-4649-b99a-c79aec031047 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:15.007237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df716bc4-aa96-4649-b99a-c79aec031047 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:15.008963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df716bc4-aa96-4649-b99a-c79aec031047 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:15.009864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df716bc4-aa96-4649-b99a-c79aec031047 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:15.011398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df716bc4-aa96-4649-b99a-c79aec031047 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:15.012041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df716bc4-aa96-4649-b99a-c79aec031047 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:15.282630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=52 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:15.460765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-df716bc4-aa96-4649-b99a-c79aec031047 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:15.474062 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-df716bc4-aa96-4649-b99a-c79aec031047 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.487644 Aug 23 17:52:15.474855 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 171/390] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:14 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:15.490669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ecfdcd49-f81d-45b7-933c-7a741a611378 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:15.491439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ecfdcd49-f81d-45b7-933c-7a741a611378 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:15.498274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecfdcd49-f81d-45b7-933c-7a741a611378 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:15.499071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecfdcd49-f81d-45b7-933c-7a741a611378 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:15.499764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecfdcd49-f81d-45b7-933c-7a741a611378 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:15.500692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecfdcd49-f81d-45b7-933c-7a741a611378 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:15.501401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecfdcd49-f81d-45b7-933c-7a741a611378 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:15.502729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecfdcd49-f81d-45b7-933c-7a741a611378 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:15.629242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ecfdcd49-f81d-45b7-933c-7a741a611378 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:15.647911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ecfdcd49-f81d-45b7-933c-7a741a611378 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:15.652615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ecfdcd49-f81d-45b7-933c-7a741a611378 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:15.663898 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ecfdcd49-f81d-45b7-933c-7a741a611378 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.182968 Aug 23 17:52:15.664838 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 172/391] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:15 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:15.671478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-0c59ee36-37a5-4562-b345-15e0571b367b req-c26909cf-1068-4946-8d0f-02b4dcca9716 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3c92ffd-1477-4110-82ef-aff030b6a026", "tag": "67c16ee5-5cef-4062-8033-6766409800d5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:15.701083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0c59ee36-37a5-4562-b345-15e0571b367b req-c26909cf-1068-4946-8d0f-02b4dcca9716 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:15.702045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0c59ee36-37a5-4562-b345-15e0571b367b req-c26909cf-1068-4946-8d0f-02b4dcca9716 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:15.703076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0c59ee36-37a5-4562-b345-15e0571b367b req-c26909cf-1068-4946-8d0f-02b4dcca9716 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:15.733047 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-0c59ee36-37a5-4562-b345-15e0571b367b req-c26909cf-1068-4946-8d0f-02b4dcca9716 service nova] Creating event network-changed:67c16ee5-5cef-4062-8033-6766409800d5 for instance e3c92ffd-1477-4110-82ef-aff030b6a026 on n-h1-850468-16 Aug 23 17:52:15.743634 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-0c59ee36-37a5-4562-b345-15e0571b367b req-c26909cf-1068-4946-8d0f-02b4dcca9716 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077344 Aug 23 17:52:15.745464 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 173/392] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:15.752614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4222017f-f3e4-4b3b-b8ed-84e03cf8095a tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:15.754411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4222017f-f3e4-4b3b-b8ed-84e03cf8095a tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:15.762004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4222017f-f3e4-4b3b-b8ed-84e03cf8095a tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:15.763164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4222017f-f3e4-4b3b-b8ed-84e03cf8095a tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:15.763787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4222017f-f3e4-4b3b-b8ed-84e03cf8095a tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:15.765406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4222017f-f3e4-4b3b-b8ed-84e03cf8095a tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:15.766133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4222017f-f3e4-4b3b-b8ed-84e03cf8095a tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:15.766823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4222017f-f3e4-4b3b-b8ed-84e03cf8095a tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:16.071856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4222017f-f3e4-4b3b-b8ed-84e03cf8095a tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:16.085651 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4222017f-f3e4-4b3b-b8ed-84e03cf8095a tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1319 microversion: 2.1 time: 0.338020 Aug 23 17:52:16.086755 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 174/393] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:15 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:16.510114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-089223f9-5538-4866-956b-8aed0ced1ede tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:16.511202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-089223f9-5538-4866-956b-8aed0ced1ede tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:16.519890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-089223f9-5538-4866-956b-8aed0ced1ede tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:16.520597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-089223f9-5538-4866-956b-8aed0ced1ede tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:16.521490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-089223f9-5538-4866-956b-8aed0ced1ede tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:16.522417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-089223f9-5538-4866-956b-8aed0ced1ede tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:16.523226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-089223f9-5538-4866-956b-8aed0ced1ede tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:16.524074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-089223f9-5538-4866-956b-8aed0ced1ede tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:16.738017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-089223f9-5538-4866-956b-8aed0ced1ede tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:16.742997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=22 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:16.751774 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-089223f9-5538-4866-956b-8aed0ced1ede tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.258826 Aug 23 17:52:16.754258 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 175/394] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:16 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:16.764668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a2de0a3d-6334-4ab8-bff7-8ab7315f0315 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:16.765847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a2de0a3d-6334-4ab8-bff7-8ab7315f0315 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:16.782127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2de0a3d-6334-4ab8-bff7-8ab7315f0315 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:16.783272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2de0a3d-6334-4ab8-bff7-8ab7315f0315 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:16.787193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2de0a3d-6334-4ab8-bff7-8ab7315f0315 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:16.788213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2de0a3d-6334-4ab8-bff7-8ab7315f0315 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:16.791825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2de0a3d-6334-4ab8-bff7-8ab7315f0315 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:16.795770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2de0a3d-6334-4ab8-bff7-8ab7315f0315 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:16.881751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a2de0a3d-6334-4ab8-bff7-8ab7315f0315 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:16.895748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a2de0a3d-6334-4ab8-bff7-8ab7315f0315 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:16.897776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a2de0a3d-6334-4ab8-bff7-8ab7315f0315 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:16.906135 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a2de0a3d-6334-4ab8-bff7-8ab7315f0315 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.149456 Aug 23 17:52:16.906957 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 176/395] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:16 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:16.912594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-c8c4e1f1-f63b-4e83-9923-49455583b4f6 req-642a08d1-c0d4-415f-946b-93c0f9c42f74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69a4f4f5-5f3a-4907-a471-005e1f790e8b", "tag": "667d527b-7ec9-4bdb-951c-0b3029adcb79"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:16.924247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c8c4e1f1-f63b-4e83-9923-49455583b4f6 req-642a08d1-c0d4-415f-946b-93c0f9c42f74 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:16.926137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c8c4e1f1-f63b-4e83-9923-49455583b4f6 req-642a08d1-c0d4-415f-946b-93c0f9c42f74 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:16.927048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c8c4e1f1-f63b-4e83-9923-49455583b4f6 req-642a08d1-c0d4-415f-946b-93c0f9c42f74 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:16.944568 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-c8c4e1f1-f63b-4e83-9923-49455583b4f6 req-642a08d1-c0d4-415f-946b-93c0f9c42f74 service nova] Creating event network-changed:667d527b-7ec9-4bdb-951c-0b3029adcb79 for instance 69a4f4f5-5f3a-4907-a471-005e1f790e8b on n-h1-850468-16 Aug 23 17:52:16.951703 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-c8c4e1f1-f63b-4e83-9923-49455583b4f6 req-642a08d1-c0d4-415f-946b-93c0f9c42f74 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043319 Aug 23 17:52:16.957973 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 177/396] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:17.109788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-20abdb8b-cc4b-4d39-9e62-795eb532722f tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:17.109788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-20abdb8b-cc4b-4d39-9e62-795eb532722f tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:17.118616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20abdb8b-cc4b-4d39-9e62-795eb532722f tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:17.119180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20abdb8b-cc4b-4d39-9e62-795eb532722f tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:17.119855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20abdb8b-cc4b-4d39-9e62-795eb532722f tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:17.120771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20abdb8b-cc4b-4d39-9e62-795eb532722f tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:17.121421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20abdb8b-cc4b-4d39-9e62-795eb532722f tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:17.122044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20abdb8b-cc4b-4d39-9e62-795eb532722f tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:17.313458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20abdb8b-cc4b-4d39-9e62-795eb532722f tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:17.322960 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-20abdb8b-cc4b-4d39-9e62-795eb532722f tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1319 microversion: 2.1 time: 0.218194 Aug 23 17:52:17.324281 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 178/397] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:17 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:17.773718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c5ec0f7-ac42-4331-8206-4f568944d62d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:17.775697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1c5ec0f7-ac42-4331-8206-4f568944d62d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:17.783694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c5ec0f7-ac42-4331-8206-4f568944d62d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:17.785152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c5ec0f7-ac42-4331-8206-4f568944d62d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:17.786044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c5ec0f7-ac42-4331-8206-4f568944d62d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:17.787525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c5ec0f7-ac42-4331-8206-4f568944d62d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:17.788156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c5ec0f7-ac42-4331-8206-4f568944d62d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:17.788764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c5ec0f7-ac42-4331-8206-4f568944d62d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:18.210506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Building network info cache for instance {{(pid=128808) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 17:52:18.240704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1c5ec0f7-ac42-4331-8206-4f568944d62d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:18.251947 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c5ec0f7-ac42-4331-8206-4f568944d62d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.481863 Aug 23 17:52:18.254825 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 179/398] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:17 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:18.273173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56e3e9ca-a310-4b59-862b-f339a7387d3f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:18.278513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-56e3e9ca-a310-4b59-862b-f339a7387d3f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:18.301067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56e3e9ca-a310-4b59-862b-f339a7387d3f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:18.303083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56e3e9ca-a310-4b59-862b-f339a7387d3f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:18.305022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56e3e9ca-a310-4b59-862b-f339a7387d3f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:18.305791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56e3e9ca-a310-4b59-862b-f339a7387d3f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:18.317157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56e3e9ca-a310-4b59-862b-f339a7387d3f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:18.317811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56e3e9ca-a310-4b59-862b-f339a7387d3f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:18.535527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-56e3e9ca-a310-4b59-862b-f339a7387d3f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:18.548224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-56e3e9ca-a310-4b59-862b-f339a7387d3f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:18.550630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-56e3e9ca-a310-4b59-862b-f339a7387d3f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:18.570010 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-56e3e9ca-a310-4b59-862b-f339a7387d3f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.313744 Aug 23 17:52:18.587724 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 180/399] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:18 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:18.826258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a06eec0-8bc5-4ba8-9610-10a45b1596e6 tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851 tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:18.827612 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:18.827612 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:18.830570 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-6a06eec0-8bc5-4ba8-9610-10a45b1596e6 tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851 tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a06eec0-8bc5-4ba8-9610-10a45b1596e6 tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851 tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851-project-admin] Request method failure captured: Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPR9wTjVX3Ju70-qP0AbvcZMDlENXVWSLqUbx14cnqIXevrnDmlyrYHwvHhY7JSN6MF9FLlzVJTGAWVBNktj1R-fXebs3g22gwFj6CGCSKfaTicqy_ilsQ_BQQZCkpO5kgoVIAt6k2tkQ5RfJ7OnaNH7ILFSk-lWTFaqx4SqbGZG3Q Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 1d320d79b21d4eccb48d73a158c62a85 Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851 Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:52:18.844467 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:52:18.846197 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1d320d79b21d4eccb48d73a158c62a85"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d320d79b21d4eccb48d73a158c62a85"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1d320d79b21d4eccb48d73a158c62a85"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d320d79b21d4eccb48d73a158c62a85"}]}] Aug 23 17:52:18.846197 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851 Aug 23 17:52:18.846197 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 1d320d79b21d4eccb48d73a158c62a85 Aug 23 17:52:18.846197 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851 Aug 23 17:52:18.846197 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851-project-admin Aug 23 17:52:18.846197 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:18.846197 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:18.846197 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: d407b2f814b0403c8a5363491760e059 Aug 23 17:52:18.846197 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851-project-admin Aug 23 17:52:18.846197 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:18.846197 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid timestamp for date invalid_time Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'invalid_time'} Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:18.847776 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Aug 23 17:52:18.849553 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:18.852870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a06eec0-8bc5-4ba8-9610-10a45b1596e6 tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851 tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:18.853954 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a06eec0-8bc5-4ba8-9610-10a45b1596e6 tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851 tempest-InstanceUsageAuditLogNegativeTestJSON-1145607851-project-admin] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 0.264910 Aug 23 17:52:18.854739 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 181/400] 10.222.0.61 () {58 vars in 1224 bytes} [Tue Aug 23 17:52:18 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 266 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:52:18.862846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-6c49546d-5589-482d-8f91-bcae40258dd0 req-17569913-c418-4b04-a415-a4505d749dd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384a38ca-06b1-4f61-a6f1-fd316e2d373a", "tag": "126444e3-4ac6-4d94-b3f6-dfeee1a150a5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:18.879730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6c49546d-5589-482d-8f91-bcae40258dd0 req-17569913-c418-4b04-a415-a4505d749dd2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:18.880616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6c49546d-5589-482d-8f91-bcae40258dd0 req-17569913-c418-4b04-a415-a4505d749dd2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:18.881248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6c49546d-5589-482d-8f91-bcae40258dd0 req-17569913-c418-4b04-a415-a4505d749dd2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:18.897062 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-6c49546d-5589-482d-8f91-bcae40258dd0 req-17569913-c418-4b04-a415-a4505d749dd2 service nova] Creating event network-changed:126444e3-4ac6-4d94-b3f6-dfeee1a150a5 for instance 384a38ca-06b1-4f61-a6f1-fd316e2d373a on n-h1-850468-16 Aug 23 17:52:18.910236 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-6c49546d-5589-482d-8f91-bcae40258dd0 req-17569913-c418-4b04-a415-a4505d749dd2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053961 Aug 23 17:52:18.912229 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 182/401] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:18.940373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b05a6bf2-7df0-4358-9375-dce2e39b58b1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:18.947645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b05a6bf2-7df0-4358-9375-dce2e39b58b1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:18.954110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b05a6bf2-7df0-4358-9375-dce2e39b58b1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:18.954685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b05a6bf2-7df0-4358-9375-dce2e39b58b1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:18.955067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b05a6bf2-7df0-4358-9375-dce2e39b58b1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:18.961152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b05a6bf2-7df0-4358-9375-dce2e39b58b1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:18.961887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b05a6bf2-7df0-4358-9375-dce2e39b58b1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:18.962487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b05a6bf2-7df0-4358-9375-dce2e39b58b1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:19.556701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Updating instance_info_cache with network_info: [{"id": "126444e3-4ac6-4d94-b3f6-dfeee1a150a5", "address": "fa:16:3e:ec:27:66", "network": {"id": "58d40799-9801-421b-928f-d0b0563fafbd", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1432752163-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b51b697a6084440bf7a8080098925b7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap126444e3-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128808) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 17:52:19.581174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b05a6bf2-7df0-4358-9375-dce2e39b58b1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:19.587425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Releasing lock "refresh_cache-384a38ca-06b1-4f61-a6f1-fd316e2d373a" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 17:52:19.589417 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6c502498-54f9-4ad2-b9f1-2bf9a52fec64 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action" status: 202 len: 0 microversion: 2.1 time: 6.178783 Aug 23 17:52:19.591052 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b05a6bf2-7df0-4358-9375-dce2e39b58b1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1319 microversion: 2.1 time: 0.676868 Aug 23 17:52:19.608253 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 220/402] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:52:13 2022] POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action => generated 0 bytes in 6187 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 17:52:19.608725 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 183/403] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:18 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1319 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:19.623676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45df61e8-9fa5-450c-9a91-9c5403a05f3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:19.624536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-45df61e8-9fa5-450c-9a91-9c5403a05f3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:19.640313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45df61e8-9fa5-450c-9a91-9c5403a05f3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:19.641019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45df61e8-9fa5-450c-9a91-9c5403a05f3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:19.641753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45df61e8-9fa5-450c-9a91-9c5403a05f3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:19.642824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45df61e8-9fa5-450c-9a91-9c5403a05f3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:19.644025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45df61e8-9fa5-450c-9a91-9c5403a05f3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:19.644623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45df61e8-9fa5-450c-9a91-9c5403a05f3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:19.705025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3f9302e5-5abc-4169-a88d-bd2c29e25927 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1884659747", "id": 1005193875, "os-flavor-access:is_public": "True"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:19.711172 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:19.711172 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:19.730951 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3f9302e5-5abc-4169-a88d-bd2c29e25927 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.133454 Aug 23 17:52:19.738463 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 221/404] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:19 2022] POST /compute/v2.1/flavors => generated 430 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:19.870895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-45df61e8-9fa5-450c-9a91-9c5403a05f3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:19.881304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-71e94ed5-2932-4dcc-88e0-2b69b0c6ed28 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:19.883921 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:19.883921 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:19.885527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-71e94ed5-2932-4dcc-88e0-2b69b0c6ed28 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': 'dbf289c5b9c5477ea00b67976252c898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2de5a142e941de9279c5f242cfef2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:19.887483 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-45df61e8-9fa5-450c-9a91-9c5403a05f3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 200 len: 1587 microversion: 2.1 time: 0.276988 Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-71e94ed5-2932-4dcc-88e0-2b69b0c6ed28 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project] Request method failure captured: Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPRgYbdR8ussvjaowCEMJ7bQ04vCclCbzJUTLGZu_b0KsEqhin4cSu525DvQrgpCfkeP1tqzIoO-nPQCboDbv3Kg8H_9P0izUl29Qh6EiAG0ziQQYvFwtMvnjKdLWpo-72LdMivBLWMQXiCG-dStuyJ-A5a_gdKBpoWR0yL53N3eWA Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 5c2de5a142e941de9279c5f242cfef2b Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:19.888583 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:19.889799 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5c2de5a142e941de9279c5f242cfef2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c2de5a142e941de9279c5f242cfef2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5c2de5a142e941de9279c5f242cfef2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c2de5a142e941de9279c5f242cfef2b"}]}] Aug 23 17:52:19.889799 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 Aug 23 17:52:19.889799 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 5c2de5a142e941de9279c5f242cfef2b Aug 23 17:52:19.889799 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 Aug 23 17:52:19.889799 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project Aug 23 17:52:19.889799 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:19.889799 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:19.889799 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: dbf289c5b9c5477ea00b67976252c898 Aug 23 17:52:19.889799 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project Aug 23 17:52:19.889799 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: action_args: {} Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:19.890409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Aug 23 17:52:19.891661 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:19.892644 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 184/405] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:19 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 1587 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:19.895605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-71e94ed5-2932-4dcc-88e0-2b69b0c6ed28 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:19.897086 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-71e94ed5-2932-4dcc-88e0-2b69b0c6ed28 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.162649 Aug 23 17:52:19.898371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b3dd3dab-8494-48c9-bc14-7a861893ab65 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:19.898522 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 222/406] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Aug 23 17:52:19 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 164 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:19.902394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b3dd3dab-8494-48c9-bc14-7a861893ab65 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:19.903983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-97ba0a54-bedd-4247-9f52-c689b7f82104 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Action: 'create', calling method: .version_select at 0x7f27ecf65790>, body: {"pool": "e726cca6-c66d-49c0-9b80-481af41866c3"} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:19.924073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3dd3dab-8494-48c9-bc14-7a861893ab65 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:19.926005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3dd3dab-8494-48c9-bc14-7a861893ab65 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:19.926671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3dd3dab-8494-48c9-bc14-7a861893ab65 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:19.927623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3dd3dab-8494-48c9-bc14-7a861893ab65 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:19.928717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3dd3dab-8494-48c9-bc14-7a861893ab65 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:19.929166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3dd3dab-8494-48c9-bc14-7a861893ab65 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:19.950363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:20.180936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b3dd3dab-8494-48c9-bc14-7a861893ab65 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:20.188846 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b3dd3dab-8494-48c9-bc14-7a861893ab65 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.297179 Aug 23 17:52:20.194877 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 185/407] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:19 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:20.199975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6defbb75-1afa-4ed3-9cd1-3e238c8dbe4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:20.208052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6defbb75-1afa-4ed3-9cd1-3e238c8dbe4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:20.219844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6defbb75-1afa-4ed3-9cd1-3e238c8dbe4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:20.220543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6defbb75-1afa-4ed3-9cd1-3e238c8dbe4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:20.221141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6defbb75-1afa-4ed3-9cd1-3e238c8dbe4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:20.226952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6defbb75-1afa-4ed3-9cd1-3e238c8dbe4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:20.227592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6defbb75-1afa-4ed3-9cd1-3e238c8dbe4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:20.228185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6defbb75-1afa-4ed3-9cd1-3e238c8dbe4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:20.323807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6defbb75-1afa-4ed3-9cd1-3e238c8dbe4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:20.338611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6defbb75-1afa-4ed3-9cd1-3e238c8dbe4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:20.340763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6defbb75-1afa-4ed3-9cd1-3e238c8dbe4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:20.349482 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6defbb75-1afa-4ed3-9cd1-3e238c8dbe4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.152780 Aug 23 17:52:20.350652 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 186/408] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:20 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:20.357641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3403104c-3969-49fe-a734-8bf1b25409cb tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:20.358876 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:20.358876 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:20.386363 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3403104c-3969-49fe-a734-8bf1b25409cb tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1005193875" status: 202 len: 0 microversion: 2.1 time: 0.033946 Aug 23 17:52:20.387795 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 187/409] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:52:20 2022] DELETE /compute/v2.1/flavors/1005193875 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:20.396154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a457087-ddc1-4249-b001-d1f18178142b tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:20.397471 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-instance-usage-audit-log:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:20.397471 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:20.398907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a457087-ddc1-4249-b001-d1f18178142b tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': 'dbf289c5b9c5477ea00b67976252c898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c2de5a142e941de9279c5f242cfef2b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a457087-ddc1-4249-b001-d1f18178142b tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project] Request method failure captured: Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-08-23%2017:52:19 HTTP/1.1 Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPRgYbdR8ussvjaowCEMJ7bQ04vCclCbzJUTLGZu_b0KsEqhin4cSu525DvQrgpCfkeP1tqzIoO-nPQCboDbv3Kg8H_9P0izUl29Qh6EiAG0ziQQYvFwtMvnjKdLWpo-72LdMivBLWMQXiCG-dStuyJ-A5a_gdKBpoWR0yL53N3eWA Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 5c2de5a142e941de9279c5f242cfef2b Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:52:20.401558 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:52:20.403027 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5c2de5a142e941de9279c5f242cfef2b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c2de5a142e941de9279c5f242cfef2b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5c2de5a142e941de9279c5f242cfef2b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c2de5a142e941de9279c5f242cfef2b"}]}] Aug 23 17:52:20.403027 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 Aug 23 17:52:20.403027 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 5c2de5a142e941de9279c5f242cfef2b Aug 23 17:52:20.403027 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 Aug 23 17:52:20.403027 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project Aug 23 17:52:20.403027 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:20.403027 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:20.403027 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: dbf289c5b9c5477ea00b67976252c898 Aug 23 17:52:20.403027 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project Aug 23 17:52:20.403027 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2022-08-23 17:52:19'} Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:20.403630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Aug 23 17:52:20.404936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:20.411802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a457087-ddc1-4249-b001-d1f18178142b tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:20.413412 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a457087-ddc1-4249-b001-d1f18178142b tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910 tempest-InstanceUsageAuditLogNegativeTestJSON-1411245910-project] 10.222.0.61 "GET /compute/v2.1/os-instance_usage_audit_log/2022-08-23 17:52:19" status: 403 len: 128 microversion: 2.1 time: 0.024316 Aug 23 17:52:20.414631 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 188/410] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Aug 23 17:52:20 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-08-23%2017%3A52%3A19 => generated 128 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:20.425631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9550759a-f3b8-4920-87ce-245c4b7ddf87 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:20.456237 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9550759a-f3b8-4920-87ce-245c4b7ddf87 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.039959 Aug 23 17:52:20.458046 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 189/411] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:20 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:20.488979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-48036fe5-45ed-45b9-93e1-10fc39c953ab tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1713907658", "id": 1725323929, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:20.493216 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:20.493216 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:20.536936 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-48036fe5-45ed-45b9-93e1-10fc39c953ab tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 417 microversion: 2.1 time: 0.055116 Aug 23 17:52:20.538378 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 190/412] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:20 2022] POST /compute/v2.1/flavors => generated 417 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:20.564116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-02dbda75-ec27-433a-875c-f51028e2efbf tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:20.573805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:20.641247 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-02dbda75-ec27-433a-875c-f51028e2efbf tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6223 microversion: 2.1 time: 0.087482 Aug 23 17:52:20.655598 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 191/413] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:20 2022] GET /compute/v2.1/flavors/detail => generated 6223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:20.662919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-938f470e-45f5-43f3-b9a3-d116ba201f21 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:20.663545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-938f470e-45f5-43f3-b9a3-d116ba201f21 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:20.670673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-938f470e-45f5-43f3-b9a3-d116ba201f21 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:20.671175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-938f470e-45f5-43f3-b9a3-d116ba201f21 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:20.671851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-938f470e-45f5-43f3-b9a3-d116ba201f21 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:20.681328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-938f470e-45f5-43f3-b9a3-d116ba201f21 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:20.682056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-938f470e-45f5-43f3-b9a3-d116ba201f21 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:20.682527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-938f470e-45f5-43f3-b9a3-d116ba201f21 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:21.032842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-938f470e-45f5-43f3-b9a3-d116ba201f21 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:21.046476 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-938f470e-45f5-43f3-b9a3-d116ba201f21 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1319 microversion: 2.1 time: 0.389634 Aug 23 17:52:21.059071 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 192/414] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:20 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1319 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:21.069101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5fc1045b-cd30-44e9-88d0-832efab1fde9 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:21.069870 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:21.069870 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:21.116196 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5fc1045b-cd30-44e9-88d0-832efab1fde9 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1725323929" status: 202 len: 0 microversion: 2.1 time: 0.055880 Aug 23 17:52:21.116782 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 193/415] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:52:21 2022] DELETE /compute/v2.1/flavors/1725323929 => generated 0 bytes in 57 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:21.121476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-be1ef0fa-0279-41b3-8763-5b0c99379e21 req-7696753a-e776-4e42-b54f-f53a060cf5d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1684439-72b6-4fff-9624-39abf5a9552a", "tag": "be443953-eadd-4537-b630-37f66a56fe75"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:21.147711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-be1ef0fa-0279-41b3-8763-5b0c99379e21 req-7696753a-e776-4e42-b54f-f53a060cf5d4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:21.148200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-be1ef0fa-0279-41b3-8763-5b0c99379e21 req-7696753a-e776-4e42-b54f-f53a060cf5d4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:21.148632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-be1ef0fa-0279-41b3-8763-5b0c99379e21 req-7696753a-e776-4e42-b54f-f53a060cf5d4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:21.167902 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-be1ef0fa-0279-41b3-8763-5b0c99379e21 req-7696753a-e776-4e42-b54f-f53a060cf5d4 service nova] Creating event network-changed:be443953-eadd-4537-b630-37f66a56fe75 for instance f1684439-72b6-4fff-9624-39abf5a9552a on n-h1-850468-16 Aug 23 17:52:21.177169 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-be1ef0fa-0279-41b3-8763-5b0c99379e21 req-7696753a-e776-4e42-b54f-f53a060cf5d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058672 Aug 23 17:52:21.177476 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 194/416] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:21.194749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b3ad60e3-1851-410e-a510-71aba9ce3be7 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:21.243087 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b3ad60e3-1851-410e-a510-71aba9ce3be7 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.064350 Aug 23 17:52:21.243951 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 195/417] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:21 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:21.248407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d01f97db-4ae6-40d0-978c-7c2cb12f30c8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:21.249131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d01f97db-4ae6-40d0-978c-7c2cb12f30c8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:21.278927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d01f97db-4ae6-40d0-978c-7c2cb12f30c8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:21.279435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d01f97db-4ae6-40d0-978c-7c2cb12f30c8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:21.281839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d01f97db-4ae6-40d0-978c-7c2cb12f30c8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:21.284595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d01f97db-4ae6-40d0-978c-7c2cb12f30c8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:21.285933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d01f97db-4ae6-40d0-978c-7c2cb12f30c8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:21.286395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d01f97db-4ae6-40d0-978c-7c2cb12f30c8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:22.101176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d01f97db-4ae6-40d0-978c-7c2cb12f30c8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:22.111047 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d01f97db-4ae6-40d0-978c-7c2cb12f30c8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.866215 Aug 23 17:52:22.135879 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 196/418] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:21 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:22.141134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-10bbdb08-aac0-4a3b-87ab-724dde06b673 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1265572515", "id": 2007696809, "os-flavor-access:is_public": "True"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:22.144646 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:22.144646 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:22.174247 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-10bbdb08-aac0-4a3b-87ab-724dde06b673 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.036839 Aug 23 17:52:22.175451 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 197/419] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:22 2022] POST /compute/v2.1/flavors => generated 429 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:22.180410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7dcbca6a-ac90-48be-a58c-d8e44d7435b9 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:22.181021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7dcbca6a-ac90-48be-a58c-d8e44d7435b9 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:22.204332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dcbca6a-ac90-48be-a58c-d8e44d7435b9 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:22.204851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dcbca6a-ac90-48be-a58c-d8e44d7435b9 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:22.205279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dcbca6a-ac90-48be-a58c-d8e44d7435b9 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:22.206593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dcbca6a-ac90-48be-a58c-d8e44d7435b9 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:22.207299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dcbca6a-ac90-48be-a58c-d8e44d7435b9 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:22.207891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dcbca6a-ac90-48be-a58c-d8e44d7435b9 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:22.418122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7dcbca6a-ac90-48be-a58c-d8e44d7435b9 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:22.431156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7dcbca6a-ac90-48be-a58c-d8e44d7435b9 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:22.432900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7dcbca6a-ac90-48be-a58c-d8e44d7435b9 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:22.439080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=7,nova_api:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:22.442658 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7dcbca6a-ac90-48be-a58c-d8e44d7435b9 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.265831 Aug 23 17:52:22.444602 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 198/420] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:22 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:22.451223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-630d799b-a410-46bf-935c-5f222fdeafa1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:22.452110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-630d799b-a410-46bf-935c-5f222fdeafa1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:22.461264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-630d799b-a410-46bf-935c-5f222fdeafa1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:22.462155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-630d799b-a410-46bf-935c-5f222fdeafa1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:22.462912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-630d799b-a410-46bf-935c-5f222fdeafa1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:22.464057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-630d799b-a410-46bf-935c-5f222fdeafa1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:22.464666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-630d799b-a410-46bf-935c-5f222fdeafa1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:22.465466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-630d799b-a410-46bf-935c-5f222fdeafa1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:22.520014 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-97ba0a54-bedd-4247-9f52-c689b7f82104 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.620319 Aug 23 17:52:22.527043 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 223/421] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Aug 23 17:52:19 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2622 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:22.527043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-60dc05da-4e2c-4920-806a-736f3d039ba4 req-ef0ad54e-0016-487e-8987-828337039950 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1391cef8-1476-4368-824a-344caae35cd8", "name": "network-vif-plugged", "status": "completed", "tag": "1d9b9dfa-0998-42b8-ac7c-a034fcb6e208"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:22.540845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-60dc05da-4e2c-4920-806a-736f3d039ba4 req-ef0ad54e-0016-487e-8987-828337039950 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:22.541326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-60dc05da-4e2c-4920-806a-736f3d039ba4 req-ef0ad54e-0016-487e-8987-828337039950 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:22.542160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-60dc05da-4e2c-4920-806a-736f3d039ba4 req-ef0ad54e-0016-487e-8987-828337039950 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:22.553781 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-60dc05da-4e2c-4920-806a-736f3d039ba4 req-ef0ad54e-0016-487e-8987-828337039950 service nova] Creating event network-vif-plugged:1d9b9dfa-0998-42b8-ac7c-a034fcb6e208 for instance 1391cef8-1476-4368-824a-344caae35cd8 on n-h1-850468-16 Aug 23 17:52:22.559901 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-60dc05da-4e2c-4920-806a-736f3d039ba4 req-ef0ad54e-0016-487e-8987-828337039950 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037025 Aug 23 17:52:22.560769 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 224/422] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:22.566941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b5b80523-825d-4314-8945-4b37e84bdf31 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:22.567836 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:22.567836 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:22.599534 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b5b80523-825d-4314-8945-4b37e84bdf31 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/2007696809" status: 202 len: 0 microversion: 2.1 time: 0.037340 Aug 23 17:52:22.602819 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 225/423] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:52:22 2022] DELETE /compute/v2.1/flavors/2007696809 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:22.609480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.26"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:22.613816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:22.620694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=4,nova_api:DELETE=7 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:22.624718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:22.625335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:22.625882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:22.626751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:22.627437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:22.628526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:22.670605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "refresh_cache-384a38ca-06b1-4f61-a6f1-fd316e2d373a" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 17:52:22.671064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquired lock "refresh_cache-384a38ca-06b1-4f61-a6f1-fd316e2d373a" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 17:52:23.115727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-630d799b-a410-46bf-935c-5f222fdeafa1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:23.121267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG neutronclient.v2_0.client [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.9.26 (932f04a8-a864-4595-88a2-d25dd153efdd) with port 126444e3-4ac6-4d94-b3f6-dfeee1a150a5 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e726cca6-c66d-49c0-9b80-481af41866c3.", "detail": ""}} {{(pid=128808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 17:52:23.121858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Releasing lock "refresh_cache-384a38ca-06b1-4f61-a6f1-fd316e2d373a" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 17:52:23.122757 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] HTTP exception thrown: Cannot associate floating IP 172.25.9.26 (932f04a8-a864-4595-88a2-d25dd153efdd) with port 126444e3-4ac6-4d94-b3f6-dfeee1a150a5 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e726cca6-c66d-49c0-9b80-481af41866c3. Aug 23 17:52:23.122757 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-0507df8d-4c60-402b-8377-ee5873d9fe14'] Aug 23 17:52:23.129329 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-630d799b-a410-46bf-935c-5f222fdeafa1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1319 microversion: 2.1 time: 0.683446 Aug 23 17:52:23.130161 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 199/424] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:22 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1319 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Request method failure captured: Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action HTTP/1.1 Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 45 Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROzj22ezEQ2Xqi2Xep2eh8yK-WByMxOTvYeUgKiqA8658p3wD4zXOW80skbHfoHvCHBdTfR8ur1uSjyplUCPcIs2UFa3nwbXwYLNl_w7f0TDg4ppo4CQ5oqDH18h9ZuhAw9sGZriyuIbGPTRkgvplNbTjY97qXSmiu0kxl6ElVXork Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2b51b697a6084440bf7a8080098925b7 Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:23.147532 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:23.148904 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2b51b697a6084440bf7a8080098925b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b51b697a6084440bf7a8080098925b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2b51b697a6084440bf7a8080098925b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b51b697a6084440bf7a8080098925b7"}]}] Aug 23 17:52:23.148904 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:23.148904 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2b51b697a6084440bf7a8080098925b7 Aug 23 17:52:23.148904 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:23.148904 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project Aug 23 17:52:23.148904 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:23.148904 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:23.148904 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4110417440054128862efa0408fe93f7 Aug 23 17:52:23.148904 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project Aug 23 17:52:23.148904 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:52:23.148904 n-d-850468-16 devstack@n-api.service[128808]: {"addFloatingIp": {"address": "172.25.9.26"}} Aug 23 17:52:23.148904 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: exception: Cannot associate floating IP 172.25.9.26 (932f04a8-a864-4595-88a2-d25dd153efdd) with port 126444e3-4ac6-4d94-b3f6-dfeee1a150a5 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e726cca6-c66d-49c0-9b80-481af41866c3. Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-0507df8d-4c60-402b-8377-ee5873d9fe14'] Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '384a38ca-06b1-4f61-a6f1-fd316e2d373a', 'body': {'addFloatingIp': {'address': '172.25.9.26'}}} Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2706, in associate_floating_ip Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1014, in update_floatingip Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2520, in _update_resource Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:52:23.149602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 17:52:23.150531 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.9.26 (932f04a8-a864-4595-88a2-d25dd153efdd) with port 126444e3-4ac6-4d94-b3f6-dfeee1a150a5 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e726cca6-c66d-49c0-9b80-481af41866c3. Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0507df8d-4c60-402b-8377-ee5873d9fe14'] Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2708, in associate_floating_ip Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.9.26 (932f04a8-a864-4595-88a2-d25dd153efdd) with port 126444e3-4ac6-4d94-b3f6-dfeee1a150a5 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e726cca6-c66d-49c0-9b80-481af41866c3. Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0507df8d-4c60-402b-8377-ee5873d9fe14'] Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:23.151409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.9.26 (932f04a8-a864-4595-88a2-d25dd153efdd) with port 126444e3-4ac6-4d94-b3f6-dfeee1a150a5 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e726cca6-c66d-49c0-9b80-481af41866c3. Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0507df8d-4c60-402b-8377-ee5873d9fe14'] Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:23.152279 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:23.153243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:23.153243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:23.153243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:23.153243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:23.153243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:23.153243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:23.153243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.9.26 (932f04a8-a864-4595-88a2-d25dd153efdd) with port 126444e3-4ac6-4d94-b3f6-dfeee1a150a5 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e726cca6-c66d-49c0-9b80-481af41866c3. Aug 23 17:52:23.153243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0507df8d-4c60-402b-8377-ee5873d9fe14'] Aug 23 17:52:23.153243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:23.153759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3d79e9c4-0b1c-493a-b8fe-27738fc0648f tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:23.155056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Returning 400 to user: Cannot associate floating IP 172.25.9.26 (932f04a8-a864-4595-88a2-d25dd153efdd) with port 126444e3-4ac6-4d94-b3f6-dfeee1a150a5 using fixed IP 172.20.0.7, as that fixed IP already has a floating IP on external network e726cca6-c66d-49c0-9b80-481af41866c3. Aug 23 17:52:23.155056 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-0507df8d-4c60-402b-8377-ee5873d9fe14'] {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:23.156578 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-04a85dca-7128-4114-aee1-80ca5f8422c7 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action" status: 400 len: 380 microversion: 2.1 time: 0.552401 Aug 23 17:52:23.157339 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 226/425] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:52:22 2022] POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action => generated 380 bytes in 554 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:52:23.163346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-15363827-88f8-4789-ba73-4dacb4930d6d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:23.164486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-15363827-88f8-4789-ba73-4dacb4930d6d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:23.172388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15363827-88f8-4789-ba73-4dacb4930d6d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:23.173093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15363827-88f8-4789-ba73-4dacb4930d6d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:23.173689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15363827-88f8-4789-ba73-4dacb4930d6d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:23.174895 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3d79e9c4-0b1c-493a-b8fe-27738fc0648f tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.028841 Aug 23 17:52:23.175898 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 200/426] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:23 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:23.176295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15363827-88f8-4789-ba73-4dacb4930d6d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:23.177043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15363827-88f8-4789-ba73-4dacb4930d6d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:23.177749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15363827-88f8-4789-ba73-4dacb4930d6d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:23.180883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6765a082-b47f-43cf-b709-3aee8295f701 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '.version_select at 0x7f27ed185790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:23.342556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-15363827-88f8-4789-ba73-4dacb4930d6d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:23.353976 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-15363827-88f8-4789-ba73-4dacb4930d6d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.195215 Aug 23 17:52:23.354577 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 227/427] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:23 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:23.359652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d046773d-26b7-44ab-a8ba-4e3ee126da4e tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-353763842", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:23.364055 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:23.364055 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:23.397669 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d046773d-26b7-44ab-a8ba-4e3ee126da4e tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.041755 Aug 23 17:52:23.398675 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 228/428] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:23 2022] POST /compute/v2.1/flavors => generated 506 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:23.416156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b471d543-c4c6-4de6-816f-59e5e26bb06e tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:23.417008 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:23.417008 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:23.436625 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b471d543-c4c6-4de6-816f-59e5e26bb06e tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/9522c727-9716-4346-9783-1658fd631810" status: 202 len: 0 microversion: 2.1 time: 0.030341 Aug 23 17:52:23.437430 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 229/429] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:52:23 2022] DELETE /compute/v2.1/flavors/9522c727-9716-4346-9783-1658fd631810 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:23.445929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0fdf16fa-1031-452d-8b3d-3ab221616354 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:23.468058 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0fdf16fa-1031-452d-8b3d-3ab221616354 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.025438 Aug 23 17:52:23.479956 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 230/430] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:23 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:23.479956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-38d6a0ba-d5de-44ba-af7b-89ba8f37df92 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:23.479956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-38d6a0ba-d5de-44ba-af7b-89ba8f37df92 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:23.490645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-38d6a0ba-d5de-44ba-af7b-89ba8f37df92 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:23.491091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-38d6a0ba-d5de-44ba-af7b-89ba8f37df92 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:23.491681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-38d6a0ba-d5de-44ba-af7b-89ba8f37df92 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:23.493445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-38d6a0ba-d5de-44ba-af7b-89ba8f37df92 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:23.493964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-38d6a0ba-d5de-44ba-af7b-89ba8f37df92 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:23.494406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-38d6a0ba-d5de-44ba-af7b-89ba8f37df92 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:23.572389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-38d6a0ba-d5de-44ba-af7b-89ba8f37df92 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:23.581213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-38d6a0ba-d5de-44ba-af7b-89ba8f37df92 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:23.583076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-38d6a0ba-d5de-44ba-af7b-89ba8f37df92 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:23.588239 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-38d6a0ba-d5de-44ba-af7b-89ba8f37df92 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.118097 Aug 23 17:52:23.589016 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 231/431] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:23 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:23.598425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6566e51c-0876-47a0-afd6-905715e2b2c7 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-456109140", "id": "2878e121-c382-41e4-9c2d-1e011628d96f", "os-flavor-access:is_public": "True"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:23.605759 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:23.605759 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:23.633074 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6566e51c-0876-47a0-afd6-905715e2b2c7 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.042676 Aug 23 17:52:23.633925 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 232/432] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:23 2022] POST /compute/v2.1/flavors => generated 506 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:23.648939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-38982c2e-7d16-4839-9d78-510aa9d37289 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:23.649820 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:23.649820 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:23.676910 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-38982c2e-7d16-4839-9d78-510aa9d37289 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/2878e121-c382-41e4-9c2d-1e011628d96f" status: 202 len: 0 microversion: 2.1 time: 0.034149 Aug 23 17:52:23.677676 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 233/433] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:52:23 2022] DELETE /compute/v2.1/flavors/2878e121-c382-41e4-9c2d-1e011628d96f => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:52:23.685518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-43b2b592-c55f-48d4-8cc7-c176742dbd56 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:23.711498 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-43b2b592-c55f-48d4-8cc7-c176742dbd56 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.029429 Aug 23 17:52:23.712329 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 234/434] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:23 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:23.733222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4111d251-fe66-45bc-8dac-bb6f8b32d9d0 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1777379166", "id": 378019475, "os-flavor-access:is_public": "True"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:23.764517 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4111d251-fe66-45bc-8dac-bb6f8b32d9d0 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.035534 Aug 23 17:52:23.765674 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 235/435] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:23 2022] POST /compute/v2.1/flavors => generated 411 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:52:23.782022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1a94801f-633c-4788-95ac-ce0fe60e4872 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:23.799198 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1a94801f-633c-4788-95ac-ce0fe60e4872 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/378019475" status: 200 len: 411 microversion: 2.1 time: 0.025434 Aug 23 17:52:23.803188 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 236/436] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 17:52:23 2022] GET /compute/v2.1/flavors/378019475 => generated 411 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:24.208590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a50b1b71-b3f1-4e84-a865-e509b2d09129 tempest-FlavorsAdminTestJSON-256293148 tempest-FlavorsAdminTestJSON-256293148-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:24.258205 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a50b1b71-b3f1-4e84-a865-e509b2d09129 tempest-FlavorsAdminTestJSON-256293148 tempest-FlavorsAdminTestJSON-256293148-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.441404 Aug 23 17:52:24.263271 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 237/437] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:23 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:24.274838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-94c26ce8-538a-40a4-960d-3f68d6ff7e19 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:24.275592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-94c26ce8-538a-40a4-960d-3f68d6ff7e19 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:24.286815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94c26ce8-538a-40a4-960d-3f68d6ff7e19 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:24.288592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94c26ce8-538a-40a4-960d-3f68d6ff7e19 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:24.289242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94c26ce8-538a-40a4-960d-3f68d6ff7e19 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:24.290135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94c26ce8-538a-40a4-960d-3f68d6ff7e19 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:24.292598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94c26ce8-538a-40a4-960d-3f68d6ff7e19 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:24.293201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94c26ce8-538a-40a4-960d-3f68d6ff7e19 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:24.333993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:24.407506 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6765a082-b47f-43cf-b709-3aee8295f701 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/932f04a8-a864-4595-88a2-d25dd153efdd" status: 202 len: 0 microversion: 2.1 time: 1.229764 Aug 23 17:52:24.408167 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 201/438] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 17:52:23 2022] DELETE /compute/v2.1/os-floating-ips/932f04a8-a864-4595-88a2-d25dd153efdd => generated 0 bytes in 1232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:24.417820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2665c44b-ed65-47e4-950b-37af10a7d7c1 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:24.419062 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:24.419062 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:24.440949 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2665c44b-ed65-47e4-950b-37af10a7d7c1 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/378019475" status: 202 len: 0 microversion: 2.1 time: 0.027265 Aug 23 17:52:24.442286 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 202/439] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Aug 23 17:52:24 2022] DELETE /compute/v2.1/flavors/378019475 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:24.447759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5bbf7f21-1a8d-45cc-aea4-6c42d5b9109b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:24.448716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5bbf7f21-1a8d-45cc-aea4-6c42d5b9109b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:24.456668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bbf7f21-1a8d-45cc-aea4-6c42d5b9109b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:24.457569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bbf7f21-1a8d-45cc-aea4-6c42d5b9109b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:24.458270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bbf7f21-1a8d-45cc-aea4-6c42d5b9109b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:24.459207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bbf7f21-1a8d-45cc-aea4-6c42d5b9109b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:24.459890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bbf7f21-1a8d-45cc-aea4-6c42d5b9109b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:24.460520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bbf7f21-1a8d-45cc-aea4-6c42d5b9109b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:24.516354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-94c26ce8-538a-40a4-960d-3f68d6ff7e19 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:24.528946 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-94c26ce8-538a-40a4-960d-3f68d6ff7e19 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1319 microversion: 2.1 time: 0.264297 Aug 23 17:52:24.543053 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 238/440] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:24 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:24.550343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Action: 'action', calling method: .version_select at 0x7f27efbb3430>, body: {"removeFloatingIp": {"address": "172.25.9.187"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:24.678563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5bbf7f21-1a8d-45cc-aea4-6c42d5b9109b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:24.704640 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5bbf7f21-1a8d-45cc-aea4-6c42d5b9109b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.260659 Aug 23 17:52:24.706935 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 203/441] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:24 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:24.713074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6b78b155-ac61-4c47-aceb-799537fcc71f tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:24.775451 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6b78b155-ac61-4c47-aceb-799537fcc71f tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.067002 Aug 23 17:52:24.778222 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 204/442] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:24 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:24.784667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3319fea1-de1b-4ef1-9d6e-9a0688851a09 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:24.785488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3319fea1-de1b-4ef1-9d6e-9a0688851a09 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:24.803964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3319fea1-de1b-4ef1-9d6e-9a0688851a09 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:24.804516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3319fea1-de1b-4ef1-9d6e-9a0688851a09 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:24.804970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3319fea1-de1b-4ef1-9d6e-9a0688851a09 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:24.805827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3319fea1-de1b-4ef1-9d6e-9a0688851a09 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:24.806717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3319fea1-de1b-4ef1-9d6e-9a0688851a09 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:24.807498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3319fea1-de1b-4ef1-9d6e-9a0688851a09 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:24.815962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:24.829850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:24.832657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:24.833439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:24.837214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:24.837773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:24.838755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:24.936110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3319fea1-de1b-4ef1-9d6e-9a0688851a09 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:24.944831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3319fea1-de1b-4ef1-9d6e-9a0688851a09 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:24.948409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3319fea1-de1b-4ef1-9d6e-9a0688851a09 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:24.968149 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3319fea1-de1b-4ef1-9d6e-9a0688851a09 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.188379 Aug 23 17:52:24.969890 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 205/443] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:24 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:24.986847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8de7ad1f-dc9e-474e-ada3-c9f1a4c6e7c1 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-153152939", "id": 1174671478, "os-flavor-access:is_public": "False"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:24.992091 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:24.992091 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:25.039835 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8de7ad1f-dc9e-474e-ada3-c9f1a4c6e7c1 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 429 microversion: 2.1 time: 0.061002 Aug 23 17:52:25.046319 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 206/444] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:24 2022] POST /compute/v2.1/flavors => generated 429 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:25.062008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2117dc64-0b68-485e-b47b-2e8b33a5aad8 tempest-FlavorsAdminTestJSON-256293148 tempest-FlavorsAdminTestJSON-256293148-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "1174671478"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:25.086067 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2117dc64-0b68-485e-b47b-2e8b33a5aad8 tempest-FlavorsAdminTestJSON-256293148 tempest-FlavorsAdminTestJSON-256293148-project] HTTP exception thrown: Flavor 1174671478 could not be found. Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2117dc64-0b68-485e-b47b-2e8b33a5aad8 tempest-FlavorsAdminTestJSON-256293148 tempest-FlavorsAdminTestJSON-256293148-project] Request method failure captured: Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 107 Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPRgamN55tKb5_MwnUVH65MDYcsiM1TJBrjF5z-mEI8FTBCPDJmlLJQszhIWgBbDlqfjfoJRAWRvTuXdFybO0bOuiQGTv4lOm1ZUNP7bZCJx8hT_qIaSIGCdkGIqWfHEADbf8hdlkXd66nznnMJdg6xOKt-m78krTji2kDWngipi6o Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 431ce4503304458a95ccf0eb5da6434c Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-FlavorsAdminTestJSON-256293148 Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:52:25.093125 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_431ce4503304458a95ccf0eb5da6434c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/431ce4503304458a95ccf0eb5da6434c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/431ce4503304458a95ccf0eb5da6434c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/431ce4503304458a95ccf0eb5da6434c"}]}] Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-FlavorsAdminTestJSON-256293148 Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 431ce4503304458a95ccf0eb5da6434c Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-256293148 Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-FlavorsAdminTestJSON-256293148-project Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 44aee39e2120460582a421a44c2d5868 Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-FlavorsAdminTestJSON-256293148-project Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "test", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "1174671478"}} Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:25.094919 n-d-850468-16 devstack@n-api.service[128807]: exception: Flavor 1174671478 could not be found. Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'test', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '1174671478'}}} Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 1174671478 could not be found. Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:25.095841 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 1174671478 could not be found. Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:25.097738 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:25.099194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:25.099194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:25.099194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:25.099194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1174671478 could not be found. Aug 23 17:52:25.099194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:25.107236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2117dc64-0b68-485e-b47b-2e8b33a5aad8 tempest-FlavorsAdminTestJSON-256293148 tempest-FlavorsAdminTestJSON-256293148-project] Returning 400 to user: Flavor 1174671478 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:25.108635 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2117dc64-0b68-485e-b47b-2e8b33a5aad8 tempest-FlavorsAdminTestJSON-256293148 tempest-FlavorsAdminTestJSON-256293148-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 81 microversion: 2.1 time: 0.051133 Aug 23 17:52:25.113766 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 207/445] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:25 2022] POST /compute/v2.1/servers => generated 81 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:52:25.135357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff5d7394-d267-4786-b4b3-e36e1c1c617c tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:25.136205 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:25.136205 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:25.181073 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff5d7394-d267-4786-b4b3-e36e1c1c617c tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1174671478" status: 202 len: 0 microversion: 2.1 time: 0.059641 Aug 23 17:52:25.184959 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 208/446] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:52:25 2022] DELETE /compute/v2.1/flavors/1174671478 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:25.190708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6470a3e4-1da0-4e86-bfc7-87e37ea95fbe tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:25.239883 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6470a3e4-1da0-4e86-bfc7-87e37ea95fbe tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.053201 Aug 23 17:52:25.251923 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 209/447] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:25 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:25.276286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-28809192-a19f-4552-8120-2ffe77d13903 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-325574532", "id": 1922003702, "os-flavor-access:is_public": "False"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:25.304539 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-28809192-a19f-4552-8120-2ffe77d13903 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.032003 Aug 23 17:52:25.305984 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 210/448] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:25 2022] POST /compute/v2.1/flavors => generated 414 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:25.319298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-69aa4d77-ff6c-452f-afbd-47f6debd5df9 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-673581262", "id": 1935757939, "os-flavor-access:is_public": "True"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:25.357339 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-69aa4d77-ff6c-452f-afbd-47f6debd5df9 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.041706 Aug 23 17:52:25.358910 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 211/449] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:25 2022] POST /compute/v2.1/flavors => generated 413 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:25.394125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4eded571-4857-41fb-ba80-c44d5cb7e070 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:25.441216 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4eded571-4857-41fb-ba80-c44d5cb7e070 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 417 microversion: 2.1 time: 0.061630 Aug 23 17:52:25.441911 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 212/450] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Aug 23 17:52:25 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 417 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:25.456810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-985e545f-db9c-4ac1-80f1-bf0b20fccc1a tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:25.469958 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-985e545f-db9c-4ac1-80f1-bf0b20fccc1a tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 417 microversion: 2.1 time: 0.017764 Aug 23 17:52:25.479689 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 213/451] 10.222.0.61 () {58 vars in 1177 bytes} [Tue Aug 23 17:52:25 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 417 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:25.499455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5ac86ff8-0c5a-401c-b9bb-85b72a9b17d0 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:25.517049 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5ac86ff8-0c5a-401c-b9bb-85b72a9b17d0 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 417 microversion: 2.1 time: 0.033334 Aug 23 17:52:25.525433 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 214/452] 10.222.0.61 () {58 vars in 1171 bytes} [Tue Aug 23 17:52:25 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 417 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:25.548761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2eb94268-31f7-4283-aa5e-3c4b5e3c5288 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:25.573580 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2eb94268-31f7-4283-aa5e-3c4b5e3c5288 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 417 microversion: 2.1 time: 0.044313 Aug 23 17:52:25.574163 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 215/453] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Aug 23 17:52:25 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 417 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:25.583686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "refresh_cache-384a38ca-06b1-4f61-a6f1-fd316e2d373a" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 17:52:25.584509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquired lock "refresh_cache-384a38ca-06b1-4f61-a6f1-fd316e2d373a" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 17:52:25.585691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f3a97286-86ef-435c-bcb0-d3def5e7f8b2 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:25.586307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f3a97286-86ef-435c-bcb0-d3def5e7f8b2 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:25.597048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3a97286-86ef-435c-bcb0-d3def5e7f8b2 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:25.597549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3a97286-86ef-435c-bcb0-d3def5e7f8b2 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:25.597992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3a97286-86ef-435c-bcb0-d3def5e7f8b2 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:25.598742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3a97286-86ef-435c-bcb0-d3def5e7f8b2 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:25.599200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3a97286-86ef-435c-bcb0-d3def5e7f8b2 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:25.599624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3a97286-86ef-435c-bcb0-d3def5e7f8b2 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:25.904245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f3a97286-86ef-435c-bcb0-d3def5e7f8b2 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:25.911449 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f3a97286-86ef-435c-bcb0-d3def5e7f8b2 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1319 microversion: 2.1 time: 0.331834 Aug 23 17:52:25.912509 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 216/454] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:25 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1319 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:25.917157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4a3221c8-0eb1-4ad5-b9f3-94f9012c3fe8 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:25.942485 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4a3221c8-0eb1-4ad5-b9f3-94f9012c3fe8 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6219 microversion: 2.1 time: 0.028595 Aug 23 17:52:25.946606 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 217/455] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Aug 23 17:52:25 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6219 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:25.968652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5a8d07af-a08b-4ffa-b275-7a4a94cb1e31 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:25.969286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5a8d07af-a08b-4ffa-b275-7a4a94cb1e31 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:25.977090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a8d07af-a08b-4ffa-b275-7a4a94cb1e31 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:25.977490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a8d07af-a08b-4ffa-b275-7a4a94cb1e31 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:25.977938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a8d07af-a08b-4ffa-b275-7a4a94cb1e31 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:25.978701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a8d07af-a08b-4ffa-b275-7a4a94cb1e31 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:25.979362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a8d07af-a08b-4ffa-b275-7a4a94cb1e31 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:25.979590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a8d07af-a08b-4ffa-b275-7a4a94cb1e31 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:26.241810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5a8d07af-a08b-4ffa-b275-7a4a94cb1e31 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:26.250801 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5a8d07af-a08b-4ffa-b275-7a4a94cb1e31 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.306082 Aug 23 17:52:26.265736 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 218/456] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:25 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:26.271547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de91fced-7486-4612-911a-f7e4310915e5 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:26.296654 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-de91fced-7486-4612-911a-f7e4310915e5 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6219 microversion: 2.1 time: 0.029377 Aug 23 17:52:26.311818 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 219/457] 10.222.0.61 () {58 vars in 1175 bytes} [Tue Aug 23 17:52:26 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6219 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:26.318256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-183ce13d-ca48-4b80-bdf4-f5289916870e tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:26.319136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-183ce13d-ca48-4b80-bdf4-f5289916870e tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:26.325653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-183ce13d-ca48-4b80-bdf4-f5289916870e tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:26.326220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-183ce13d-ca48-4b80-bdf4-f5289916870e tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:26.326757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-183ce13d-ca48-4b80-bdf4-f5289916870e tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:26.327680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-183ce13d-ca48-4b80-bdf4-f5289916870e tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:26.328207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-183ce13d-ca48-4b80-bdf4-f5289916870e tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:26.328812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-183ce13d-ca48-4b80-bdf4-f5289916870e tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:26.435963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-183ce13d-ca48-4b80-bdf4-f5289916870e tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:26.454221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-183ce13d-ca48-4b80-bdf4-f5289916870e tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:26.457132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-183ce13d-ca48-4b80-bdf4-f5289916870e tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:26.462354 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-183ce13d-ca48-4b80-bdf4-f5289916870e tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.149306 Aug 23 17:52:26.463487 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 220/458] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:26 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:26.468506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a8d4b213-acdb-4b94-b208-04e473415302 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:26.493069 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a8d4b213-acdb-4b94-b208-04e473415302 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6219 microversion: 2.1 time: 0.028235 Aug 23 17:52:26.494162 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 221/459] 10.222.0.61 () {58 vars in 1173 bytes} [Tue Aug 23 17:52:26 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6219 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:26.517370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e186839f-18ee-41e5-8e38-a40183b09b88 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:26.548123 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e186839f-18ee-41e5-8e38-a40183b09b88 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6219 microversion: 2.1 time: 0.035341 Aug 23 17:52:26.550323 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 222/460] 10.222.0.61 () {58 vars in 1169 bytes} [Tue Aug 23 17:52:26 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6219 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:26.573943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a263ac6d-b1cf-4e4d-a431-edff4d7f9f64 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:26.575310 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:26.575310 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:26.600844 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a263ac6d-b1cf-4e4d-a431-edff4d7f9f64 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1935757939" status: 202 len: 0 microversion: 2.1 time: 0.032408 Aug 23 17:52:26.603063 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 223/461] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:52:26 2022] DELETE /compute/v2.1/flavors/1935757939 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:26.616493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5e6eabc-7661-4351-af2e-c16d4cec1a77 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:26.663397 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a5e6eabc-7661-4351-af2e-c16d4cec1a77 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.048605 Aug 23 17:52:26.664792 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 224/462] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:26 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:26.687064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a96bde44-6f2e-44ae-9853-209bb2c9ec9d tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:26.735215 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a96bde44-6f2e-44ae-9853-209bb2c9ec9d tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1922003702" status: 202 len: 0 microversion: 2.1 time: 0.055117 Aug 23 17:52:26.737020 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 225/463] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:52:26 2022] DELETE /compute/v2.1/flavors/1922003702 => generated 0 bytes in 58 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:26.754520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3c5cee57-5826-42ce-980e-ec12faf64301 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:26.810180 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3c5cee57-5826-42ce-980e-ec12faf64301 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.067753 Aug 23 17:52:26.812533 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 226/464] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:26 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:26.844044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-99b8a389-f06d-4d33-8933-ea7c3a628d89 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1978918290", "id": 970632209, "os-flavor-access:is_public": "False"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:26.854490 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:26.854490 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:26.903641 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-99b8a389-f06d-4d33-8933-ea7c3a628d89 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.065219 Aug 23 17:52:26.904300 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 227/465] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:26 2022] POST /compute/v2.1/flavors => generated 412 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:26.918864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-52a6fa11-811a-4d4d-9bd3-497a39a7a76e tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:26.952253 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-52a6fa11-811a-4d4d-9bd3-497a39a7a76e tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.038061 Aug 23 17:52:26.967772 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 228/466] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:26 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:26.981245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e1cb81f-596c-464a-9fd1-049a748334de tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:26.983201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2e1cb81f-596c-464a-9fd1-049a748334de tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:27.005011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e1cb81f-596c-464a-9fd1-049a748334de tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:27.005476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e1cb81f-596c-464a-9fd1-049a748334de tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:27.005949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e1cb81f-596c-464a-9fd1-049a748334de tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:27.009533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e1cb81f-596c-464a-9fd1-049a748334de tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:27.011674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e1cb81f-596c-464a-9fd1-049a748334de tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:27.012139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e1cb81f-596c-464a-9fd1-049a748334de tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:27.100938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Building network info cache for instance {{(pid=128808) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 17:52:27.268725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2e1cb81f-596c-464a-9fd1-049a748334de tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:27.280245 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e1cb81f-596c-464a-9fd1-049a748334de tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1319 microversion: 2.1 time: 0.306535 Aug 23 17:52:27.281181 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 229/467] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:26 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:27.286789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d0f94205-7ba7-470d-8604-819f2e37f8f7 tempest-FlavorsAdminTestJSON-256293148 tempest-FlavorsAdminTestJSON-256293148-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:27.331525 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d0f94205-7ba7-470d-8604-819f2e37f8f7 tempest-FlavorsAdminTestJSON-256293148 tempest-FlavorsAdminTestJSON-256293148-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.048416 Aug 23 17:52:27.345599 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 230/468] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:27 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:27.351935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2c36a5a9-f780-431b-8b23-b88e20b9b84f req-8213faed-cbdc-40b5-a26e-18a1e8b8b0b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "384a38ca-06b1-4f61-a6f1-fd316e2d373a", "tag": "126444e3-4ac6-4d94-b3f6-dfeee1a150a5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:27.361619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2c36a5a9-f780-431b-8b23-b88e20b9b84f req-8213faed-cbdc-40b5-a26e-18a1e8b8b0b7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:27.362783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2c36a5a9-f780-431b-8b23-b88e20b9b84f req-8213faed-cbdc-40b5-a26e-18a1e8b8b0b7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:27.363197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2c36a5a9-f780-431b-8b23-b88e20b9b84f req-8213faed-cbdc-40b5-a26e-18a1e8b8b0b7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:27.401651 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2c36a5a9-f780-431b-8b23-b88e20b9b84f req-8213faed-cbdc-40b5-a26e-18a1e8b8b0b7 service nova] Creating event network-changed:126444e3-4ac6-4d94-b3f6-dfeee1a150a5 for instance 384a38ca-06b1-4f61-a6f1-fd316e2d373a on n-h1-850468-16 Aug 23 17:52:27.413113 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2c36a5a9-f780-431b-8b23-b88e20b9b84f req-8213faed-cbdc-40b5-a26e-18a1e8b8b0b7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065392 Aug 23 17:52:27.414722 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 231/469] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:27.436625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-283b3345-4006-4085-812c-c5f493abfa80 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:27.440484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-283b3345-4006-4085-812c-c5f493abfa80 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:27.456083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-283b3345-4006-4085-812c-c5f493abfa80 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:27.457371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-283b3345-4006-4085-812c-c5f493abfa80 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:27.457993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-283b3345-4006-4085-812c-c5f493abfa80 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:27.460131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-283b3345-4006-4085-812c-c5f493abfa80 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:27.461328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-283b3345-4006-4085-812c-c5f493abfa80 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:27.461921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-283b3345-4006-4085-812c-c5f493abfa80 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:27.854064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-283b3345-4006-4085-812c-c5f493abfa80 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:27.870532 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-283b3345-4006-4085-812c-c5f493abfa80 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.452340 Aug 23 17:52:27.886938 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 232/470] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:27 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:27.900782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-143c7df7-20b9-41cd-9348-68fd4d2483f8 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:27.902332 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:27.902332 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:27.916179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=12,nova_api:INSERT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:27.959137 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-143c7df7-20b9-41cd-9348-68fd4d2483f8 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/970632209" status: 202 len: 0 microversion: 2.1 time: 0.070044 Aug 23 17:52:27.960560 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 233/471] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Aug 23 17:52:27 2022] DELETE /compute/v2.1/flavors/970632209 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:27.969882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e91a273-6c1a-459f-9704-7277a9169710 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:27.976309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4e91a273-6c1a-459f-9704-7277a9169710 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:27.992074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e91a273-6c1a-459f-9704-7277a9169710 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:27.992574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e91a273-6c1a-459f-9704-7277a9169710 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:27.993334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e91a273-6c1a-459f-9704-7277a9169710 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:27.994307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e91a273-6c1a-459f-9704-7277a9169710 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:27.994307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e91a273-6c1a-459f-9704-7277a9169710 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:27.998741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e91a273-6c1a-459f-9704-7277a9169710 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:28.363408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e91a273-6c1a-459f-9704-7277a9169710 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:28.377210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e91a273-6c1a-459f-9704-7277a9169710 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:28.380369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e91a273-6c1a-459f-9704-7277a9169710 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:28.394440 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e91a273-6c1a-459f-9704-7277a9169710 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.431460 Aug 23 17:52:28.396050 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 234/472] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:27 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:28.414657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-cb5bedfb-a467-49e6-a4c8-a647fb060993 req-e2d239e4-d6d4-48cd-8278-b157db315869 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c92ffd-1477-4110-82ef-aff030b6a026", "name": "network-vif-plugged", "status": "completed", "tag": "67c16ee5-5cef-4062-8033-6766409800d5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:28.424989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cb5bedfb-a467-49e6-a4c8-a647fb060993 req-e2d239e4-d6d4-48cd-8278-b157db315869 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:28.425970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cb5bedfb-a467-49e6-a4c8-a647fb060993 req-e2d239e4-d6d4-48cd-8278-b157db315869 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:28.426571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cb5bedfb-a467-49e6-a4c8-a647fb060993 req-e2d239e4-d6d4-48cd-8278-b157db315869 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:28.441933 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-cb5bedfb-a467-49e6-a4c8-a647fb060993 req-e2d239e4-d6d4-48cd-8278-b157db315869 service nova] Creating event network-vif-plugged:67c16ee5-5cef-4062-8033-6766409800d5 for instance e3c92ffd-1477-4110-82ef-aff030b6a026 on n-h1-850468-16 Aug 23 17:52:28.452131 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-cb5bedfb-a467-49e6-a4c8-a647fb060993 req-e2d239e4-d6d4-48cd-8278-b157db315869 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053810 Aug 23 17:52:28.452746 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 235/473] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:28.461493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e34d96b-2357-4c3e-9bf1-7c4592d99665 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:28.493095 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e34d96b-2357-4c3e-9bf1-7c4592d99665 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.038411 Aug 23 17:52:28.494028 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 236/474] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:28 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:28.499782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-82a1b97b-2173-4ff7-a968-0e3b7e145df7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:28.500676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-82a1b97b-2173-4ff7-a968-0e3b7e145df7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:28.517364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a1b97b-2173-4ff7-a968-0e3b7e145df7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:28.517364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a1b97b-2173-4ff7-a968-0e3b7e145df7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:28.517786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a1b97b-2173-4ff7-a968-0e3b7e145df7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:28.519138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a1b97b-2173-4ff7-a968-0e3b7e145df7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:28.519766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a1b97b-2173-4ff7-a968-0e3b7e145df7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:28.520350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a1b97b-2173-4ff7-a968-0e3b7e145df7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:28.960129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-82a1b97b-2173-4ff7-a968-0e3b7e145df7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:28.972652 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-82a1b97b-2173-4ff7-a968-0e3b7e145df7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1469 microversion: 2.1 time: 0.477694 Aug 23 17:52:28.973443 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 237/475] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:28 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1469 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:28.978774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d0912a81-96b5-480a-81ed-47cd9ba5980f tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-795107357", "id": 444146437, "os-flavor-access:is_public": "True"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:28.982385 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:28.982385 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:29.013361 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d0912a81-96b5-480a-81ed-47cd9ba5980f tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 410 microversion: 2.1 time: 0.038981 Aug 23 17:52:29.014677 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 238/476] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:28 2022] POST /compute/v2.1/flavors => generated 410 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:29.031541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5058108d-8151-4ed1-8f90-dc3e164c6880 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:29.034382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5058108d-8151-4ed1-8f90-dc3e164c6880 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:29.058362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5058108d-8151-4ed1-8f90-dc3e164c6880 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:29.060661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5058108d-8151-4ed1-8f90-dc3e164c6880 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:29.061257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5058108d-8151-4ed1-8f90-dc3e164c6880 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:29.062204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5058108d-8151-4ed1-8f90-dc3e164c6880 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:29.062889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5058108d-8151-4ed1-8f90-dc3e164c6880 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:29.064164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5058108d-8151-4ed1-8f90-dc3e164c6880 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:29.247123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Updating instance_info_cache with network_info: [{"id": "126444e3-4ac6-4d94-b3f6-dfeee1a150a5", "address": "fa:16:3e:ec:27:66", "network": {"id": "58d40799-9801-421b-928f-d0b0563fafbd", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-1432752163-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "2b51b697a6084440bf7a8080098925b7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap126444e3-4a", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128808) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 17:52:29.258007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Releasing lock "refresh_cache-384a38ca-06b1-4f61-a6f1-fd316e2d373a" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 17:52:29.260172 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5da64b54-e851-49f5-8883-4e808b4dd3b3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action" status: 202 len: 0 microversion: 2.1 time: 4.715114 Aug 23 17:52:29.260998 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 239/477] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:52:24 2022] POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action => generated 0 bytes in 4717 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 17:52:29.507518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5058108d-8151-4ed1-8f90-dc3e164c6880 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:29.516150 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5058108d-8151-4ed1-8f90-dc3e164c6880 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.500198 Aug 23 17:52:29.518995 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 239/478] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:29 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:29.532117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d0db420-eacf-4021-9150-d82f670044c5 tempest-FlavorsAdminTestJSON-256293148 tempest-FlavorsAdminTestJSON-256293148-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:29.553966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1918003330", "block_migration": true, "disk_over_commit": false}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:29.556802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:29.572019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:29.573920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:29.574955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:29.576285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:29.578265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:29.580160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:29.600620 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d0db420-eacf-4021-9150-d82f670044c5 tempest-FlavorsAdminTestJSON-256293148 tempest-FlavorsAdminTestJSON-256293148-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 6216 microversion: 2.1 time: 0.076406 Aug 23 17:52:29.603223 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 240/479] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:29 2022] GET /compute/v2.1/flavors/detail => generated 6216 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:29.626991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f8fa09c2-b9fe-44d0-89a9-1f0a11a424cd tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '.version_select at 0x7f27ed185790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:29.831853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lazy-loading 'flavor' on Instance uuid 1391cef8-1476-4368-824a-344caae35cd8 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:29.929328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Going to try to live migrate instance to tempest-host-1918003330 {{(pid=128808) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 17:52:29.937903 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] HTTP exception thrown: Compute host tempest-host-1918003330 could not be found. Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Request method failure captured: Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8/action HTTP/1.1 Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 107 Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPCkjmyhKomw_Dk81zx_pzuNulvytvGuBTkM026ACwiSgpNOys4ZfBDKudc1QL2qyKitQgjRi-YqtQc8V3wun24za_jT9qTKHR9A6Vw3wyVahmXdcLJ2y_j8A6ssCu1c8g_1hIARiAWKEfh2iv5Ti0Bonc8SqFqyYGHN-rptQco7z0 Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 3b2c3c5087ae40ffa520716843684824 Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-LiveMigrationNegativeTest-2085558247 Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:52:29.943300 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:52:29.944825 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3b2c3c5087ae40ffa520716843684824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3b2c3c5087ae40ffa520716843684824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3b2c3c5087ae40ffa520716843684824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3b2c3c5087ae40ffa520716843684824"}]}] Aug 23 17:52:29.944825 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-LiveMigrationNegativeTest-2085558247 Aug 23 17:52:29.944825 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 3b2c3c5087ae40ffa520716843684824 Aug 23 17:52:29.944825 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2085558247 Aug 23 17:52:29.944825 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-LiveMigrationNegativeTest-2085558247-project-admin Aug 23 17:52:29.944825 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:29.944825 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:29.944825 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: c68b735b7bbd4b42aefee51f78b6ba59 Aug 23 17:52:29.944825 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-LiveMigrationNegativeTest-2085558247-project-admin Aug 23 17:52:29.944825 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:52:29.944825 n-d-850468-16 devstack@n-api.service[128808]: {"os-migrateLive": {"host": "tempest-host-1918003330", "block_migration": true, "disk_over_commit": false}} Aug 23 17:52:29.944825 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: exception: Compute host tempest-host-1918003330 could not be found. Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '1391cef8-1476-4368-824a-344caae35cd8', 'body': {'os-migrateLive': {'host': 'tempest-host-1918003330', 'block_migration': True, 'disk_over_commit': False}}} Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 17:52:29.945642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5483, in live_migrate Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1918003330 could not be found. Aug 23 17:52:29.946902 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1918003330 could not be found. Aug 23 17:52:29.948170 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:29.949439 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:29.949439 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:29.949439 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:29.949439 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:29.949439 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:29.949439 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:29.949439 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:29.949439 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1918003330 could not be found. Aug 23 17:52:29.949439 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:29.951284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Returning 400 to user: Compute host tempest-host-1918003330 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:29.952345 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-83a2a6a2-716a-47c7-967f-7acaf60bb93f tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8/action" status: 400 len: 100 microversion: 2.1 time: 0.690177 Aug 23 17:52:29.953927 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 240/480] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Aug 23 17:52:29 2022] POST /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8/action => generated 100 bytes in 692 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:52:29.965687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1e35467f-4ec5-4c4f-80c8-625b39da984b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:29.966620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1e35467f-4ec5-4c4f-80c8-625b39da984b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:29.975400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e35467f-4ec5-4c4f-80c8-625b39da984b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:29.976119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e35467f-4ec5-4c4f-80c8-625b39da984b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:29.976740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e35467f-4ec5-4c4f-80c8-625b39da984b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:29.977879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e35467f-4ec5-4c4f-80c8-625b39da984b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:29.978559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e35467f-4ec5-4c4f-80c8-625b39da984b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:29.979232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e35467f-4ec5-4c4f-80c8-625b39da984b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:30.161222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1e35467f-4ec5-4c4f-80c8-625b39da984b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:30.173293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1e35467f-4ec5-4c4f-80c8-625b39da984b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:30.177518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1e35467f-4ec5-4c4f-80c8-625b39da984b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:30.184356 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1e35467f-4ec5-4c4f-80c8-625b39da984b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.229167 Aug 23 17:52:30.185689 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 241/481] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:29 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:30.193847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-36647f93-cfaa-4886-b270-60d4f13a9a8d tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:30.195114 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:30.195114 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:30.219717 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-36647f93-cfaa-4886-b270-60d4f13a9a8d tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/444146437" status: 202 len: 0 microversion: 2.1 time: 0.031428 Aug 23 17:52:30.220594 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 242/482] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Aug 23 17:52:30 2022] DELETE /compute/v2.1/flavors/444146437 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:30.228204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-be8cf18f-7f52-4463-b030-e73d66117fc8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:30.229128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-be8cf18f-7f52-4463-b030-e73d66117fc8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:30.236424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be8cf18f-7f52-4463-b030-e73d66117fc8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:30.237422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be8cf18f-7f52-4463-b030-e73d66117fc8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:30.238191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be8cf18f-7f52-4463-b030-e73d66117fc8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:30.239265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be8cf18f-7f52-4463-b030-e73d66117fc8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:30.239928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be8cf18f-7f52-4463-b030-e73d66117fc8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:30.240576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be8cf18f-7f52-4463-b030-e73d66117fc8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:30.444290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-be8cf18f-7f52-4463-b030-e73d66117fc8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:30.457933 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-be8cf18f-7f52-4463-b030-e73d66117fc8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1469 microversion: 2.1 time: 0.234693 Aug 23 17:52:30.472120 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 243/483] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:30 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:30.485597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cdb90c84-7e4d-44f0-b9f1-f79cb1cc5601 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:30.532220 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cdb90c84-7e4d-44f0-b9f1-f79cb1cc5601 tempest-FlavorsAdminTestJSON-684908265 tempest-FlavorsAdminTestJSON-684908265-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.057708 Aug 23 17:52:30.533242 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 244/484] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:30 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:30.543579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1723d9fc-f2e5-480c-93ec-b60034791d95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:30.546474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1723d9fc-f2e5-480c-93ec-b60034791d95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:30.561638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1723d9fc-f2e5-480c-93ec-b60034791d95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:30.562131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1723d9fc-f2e5-480c-93ec-b60034791d95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:30.563521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1723d9fc-f2e5-480c-93ec-b60034791d95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:30.565735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1723d9fc-f2e5-480c-93ec-b60034791d95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:30.576472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1723d9fc-f2e5-480c-93ec-b60034791d95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:30.577198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1723d9fc-f2e5-480c-93ec-b60034791d95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:30.927364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1723d9fc-f2e5-480c-93ec-b60034791d95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:30.937547 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1723d9fc-f2e5-480c-93ec-b60034791d95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1314 microversion: 2.1 time: 0.400591 Aug 23 17:52:30.942755 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 245/485] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:30 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:30.952080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-2033517268", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:31.056349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:52:31.471014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:52:31.471834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:52:31.471938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:52:31.472347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:52:31.472760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:52:31.498967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:31.499461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:31.499900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:31.500642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:31.501101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:31.501530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:31.548906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Getting quotas for project ce2f527311164c75ab2a834dc4208135. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:52:31.560471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Getting quotas for user fd1226e98e7248c080c79cc291c2ce3c and project ce2f527311164c75ab2a834dc4208135. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:52:31.576910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:52:31.579476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:52:31.684701 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-12d74da9-6027-4b74-903a-9274b81a90c1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.739458 Aug 23 17:52:31.685335 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 246/486] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:52:31.696511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-caaae51b-d10d-4654-85c9-b82a07fd3a4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:31.697137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-caaae51b-d10d-4654-85c9-b82a07fd3a4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:31.719011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-caaae51b-d10d-4654-85c9-b82a07fd3a4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:31.719521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-caaae51b-d10d-4654-85c9-b82a07fd3a4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:31.719969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-caaae51b-d10d-4654-85c9-b82a07fd3a4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:31.720694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-caaae51b-d10d-4654-85c9-b82a07fd3a4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:31.721179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-caaae51b-d10d-4654-85c9-b82a07fd3a4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:31.722326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-caaae51b-d10d-4654-85c9-b82a07fd3a4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:31.928243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-caaae51b-d10d-4654-85c9-b82a07fd3a4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:31.939926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-caaae51b-d10d-4654-85c9-b82a07fd3a4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:31.941803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-caaae51b-d10d-4654-85c9-b82a07fd3a4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:31.954242 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-caaae51b-d10d-4654-85c9-b82a07fd3a4b tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.267776 Aug 23 17:52:31.954880 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 247/487] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:31 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:31.965773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-607fd49f-7724-4468-a0cb-a58793c33892 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:31.966404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-607fd49f-7724-4468-a0cb-a58793c33892 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:32.050514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-607fd49f-7724-4468-a0cb-a58793c33892 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:32.058990 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-607fd49f-7724-4468-a0cb-a58793c33892 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1219 microversion: 2.1 time: 0.102872 Aug 23 17:52:32.060388 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 248/488] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:31 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:32.083246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-95941d6f-e87c-4a2f-af30-9b9dcd58c4ff tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:32.084206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-95941d6f-e87c-4a2f-af30-9b9dcd58c4ff tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:32.093017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95941d6f-e87c-4a2f-af30-9b9dcd58c4ff tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:32.094222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95941d6f-e87c-4a2f-af30-9b9dcd58c4ff tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:32.095402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95941d6f-e87c-4a2f-af30-9b9dcd58c4ff tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:32.096939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95941d6f-e87c-4a2f-af30-9b9dcd58c4ff tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:32.097676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95941d6f-e87c-4a2f-af30-9b9dcd58c4ff tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:32.098320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95941d6f-e87c-4a2f-af30-9b9dcd58c4ff tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:32.392046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-95941d6f-e87c-4a2f-af30-9b9dcd58c4ff tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:32.403163 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-95941d6f-e87c-4a2f-af30-9b9dcd58c4ff tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1463 microversion: 2.1 time: 0.329712 Aug 23 17:52:32.405630 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 249/489] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:32 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1463 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:32.429004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f8580e65-00d7-47b6-bcaa-344e3db6bb37 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:32.429981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f8580e65-00d7-47b6-bcaa-344e3db6bb37 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:32.445856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8580e65-00d7-47b6-bcaa-344e3db6bb37 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:32.449277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8580e65-00d7-47b6-bcaa-344e3db6bb37 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:32.450337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8580e65-00d7-47b6-bcaa-344e3db6bb37 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:32.453377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8580e65-00d7-47b6-bcaa-344e3db6bb37 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:32.454111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8580e65-00d7-47b6-bcaa-344e3db6bb37 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:32.454840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8580e65-00d7-47b6-bcaa-344e3db6bb37 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:32.739893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f8580e65-00d7-47b6-bcaa-344e3db6bb37 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:32.761002 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f8580e65-00d7-47b6-bcaa-344e3db6bb37 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1313 microversion: 2.1 time: 0.336495 Aug 23 17:52:32.765705 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 250/490] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:32 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1313 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:32.983399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-364630a2-4343-4180-b39f-601e744df9cc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:32.984492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-364630a2-4343-4180-b39f-601e744df9cc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:32.995519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-364630a2-4343-4180-b39f-601e744df9cc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:32.996018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-364630a2-4343-4180-b39f-601e744df9cc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:32.998458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-364630a2-4343-4180-b39f-601e744df9cc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:33.004041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-364630a2-4343-4180-b39f-601e744df9cc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:33.004882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-364630a2-4343-4180-b39f-601e744df9cc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:33.005554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-364630a2-4343-4180-b39f-601e744df9cc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:33.162950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-364630a2-4343-4180-b39f-601e744df9cc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:33.181521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-364630a2-4343-4180-b39f-601e744df9cc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:33.185210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-364630a2-4343-4180-b39f-601e744df9cc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:33.205992 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-364630a2-4343-4180-b39f-601e744df9cc tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.226665 Aug 23 17:52:33.212617 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f8fa09c2-b9fe-44d0-89a9-1f0a11a424cd tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/7dc0368b-1dbc-4e7c-bd97-b5b55fbc7011" status: 202 len: 0 microversion: 2.1 time: 3.605223 Aug 23 17:52:33.213888 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 241/491] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 17:52:29 2022] DELETE /compute/v2.1/os-floating-ips/7dc0368b-1dbc-4e7c-bd97-b5b55fbc7011 => generated 0 bytes in 3610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:33.223212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5b441fea-4fdb-4bbc-8230-99cc44558c8d tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:33.226076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5b441fea-4fdb-4bbc-8230-99cc44558c8d tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:33.236002 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 251/492] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:32 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:33.240861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b441fea-4fdb-4bbc-8230-99cc44558c8d tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:33.243603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b441fea-4fdb-4bbc-8230-99cc44558c8d tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:33.244010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b441fea-4fdb-4bbc-8230-99cc44558c8d tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:33.245831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4f533ebc-d668-4ff5-8c24-d46bbf2b6218 req-b6658c77-abac-499a-92ee-cfdcc1a0cbed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a4f4f5-5f3a-4907-a471-005e1f790e8b", "name": "network-vif-plugged", "status": "completed", "tag": "667d527b-7ec9-4bdb-951c-0b3029adcb79"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:33.251556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b441fea-4fdb-4bbc-8230-99cc44558c8d tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:33.254055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b441fea-4fdb-4bbc-8230-99cc44558c8d tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:33.255966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b441fea-4fdb-4bbc-8230-99cc44558c8d tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:33.257421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4f533ebc-d668-4ff5-8c24-d46bbf2b6218 req-b6658c77-abac-499a-92ee-cfdcc1a0cbed service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:33.258103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4f533ebc-d668-4ff5-8c24-d46bbf2b6218 req-b6658c77-abac-499a-92ee-cfdcc1a0cbed service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:33.258785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4f533ebc-d668-4ff5-8c24-d46bbf2b6218 req-b6658c77-abac-499a-92ee-cfdcc1a0cbed service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:33.275701 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4f533ebc-d668-4ff5-8c24-d46bbf2b6218 req-b6658c77-abac-499a-92ee-cfdcc1a0cbed service nova] Creating event network-vif-plugged:667d527b-7ec9-4bdb-951c-0b3029adcb79 for instance 69a4f4f5-5f3a-4907-a471-005e1f790e8b on n-h1-850468-16 Aug 23 17:52:33.285801 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4f533ebc-d668-4ff5-8c24-d46bbf2b6218 req-b6658c77-abac-499a-92ee-cfdcc1a0cbed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047785 Aug 23 17:52:33.287056 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 252/493] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:33.296644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a83a0ab0-0174-4225-9ab7-e7de0a62ebf1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": ""}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a83a0ab0-0174-4225-9ab7-e7de0a62ebf1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Request method failure captured: Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action HTTP/1.1 Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 34 Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROzj22ezEQ2Xqi2Xep2eh8yK-WByMxOTvYeUgKiqA8658p3wD4zXOW80skbHfoHvCHBdTfR8ur1uSjyplUCPcIs2UFa3nwbXwYLNl_w7f0TDg4ppo4CQ5oqDH18h9ZuhAw9sGZriyuIbGPTRkgvplNbTjY97qXSmiu0kxl6ElVXork Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2b51b697a6084440bf7a8080098925b7 Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:33.309266 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2b51b697a6084440bf7a8080098925b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b51b697a6084440bf7a8080098925b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2b51b697a6084440bf7a8080098925b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b51b697a6084440bf7a8080098925b7"}]}] Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2b51b697a6084440bf7a8080098925b7 Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4110417440054128862efa0408fe93f7 Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: {"addFloatingIp": {"address": ""}} Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:52:33.310500 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '384a38ca-06b1-4f61-a6f1-fd316e2d373a', 'body': {'addFloatingIp': {'address': ''}}} Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi '' Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:33.311323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:52:33.312482 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:52:33.314206 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Aug 23 17:52:33.314206 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.319708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a83a0ab0-0174-4225-9ab7-e7de0a62ebf1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:33.322484 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a83a0ab0-0174-4225-9ab7-e7de0a62ebf1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action" status: 400 len: 142 microversion: 2.1 time: 0.030607 Aug 23 17:52:33.323615 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 253/494] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:52:33 2022] POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action => generated 142 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:52:33.343219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:33.348224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:33.357676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:33.364432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:33.364938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:33.365545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:33.366301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:33.366867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:33.367368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:33.417671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "refresh_cache-384a38ca-06b1-4f61-a6f1-fd316e2d373a" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 17:52:33.417916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquired lock "refresh_cache-384a38ca-06b1-4f61-a6f1-fd316e2d373a" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 17:52:33.569154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Releasing lock "refresh_cache-384a38ca-06b1-4f61-a6f1-fd316e2d373a" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 17:52:33.569758 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] HTTP exception thrown: floating IP not found Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Request method failure captured: Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action HTTP/1.1 Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 41 Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROzj22ezEQ2Xqi2Xep2eh8yK-WByMxOTvYeUgKiqA8658p3wD4zXOW80skbHfoHvCHBdTfR8ur1uSjyplUCPcIs2UFa3nwbXwYLNl_w7f0TDg4ppo4CQ5oqDH18h9ZuhAw9sGZriyuIbGPTRkgvplNbTjY97qXSmiu0kxl6ElVXork Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2b51b697a6084440bf7a8080098925b7 Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:33.571599 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2b51b697a6084440bf7a8080098925b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b51b697a6084440bf7a8080098925b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2b51b697a6084440bf7a8080098925b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b51b697a6084440bf7a8080098925b7"}]}] Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2b51b697a6084440bf7a8080098925b7 Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4110417440054128862efa0408fe93f7 Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: {"addFloatingIp": {"address": "0.0.0.0"}} Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:52:33.573167 n-d-850468-16 devstack@n-api.service[128808]: exception: floating IP not found Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '384a38ca-06b1-4f61-a6f1-fd316e2d373a', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 166, in wrapper Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2702, in associate_floating_ip Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:33.574388 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Aug 23 17:52:33.576098 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.578284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Returning 404 to user: floating IP not found {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:33.578284 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d3af562e-746e-4747-9560-93b4264224b1 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action" status: 404 len: 67 microversion: 2.1 time: 0.242299 Aug 23 17:52:33.579280 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 254/495] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:52:33 2022] POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action => generated 67 bytes in 249 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:52:33.591105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3528379a-ea1a-46e9-9bc9-d2a60f97c376 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:33.672913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5b441fea-4fdb-4bbc-8230-99cc44558c8d tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:33.679760 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-3528379a-ea1a-46e9-9bc9-d2a60f97c376 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3528379a-ea1a-46e9-9bc9-d2a60f97c376 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Request method failure captured: Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action HTTP/1.1 Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 44 Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROzj22ezEQ2Xqi2Xep2eh8yK-WByMxOTvYeUgKiqA8658p3wD4zXOW80skbHfoHvCHBdTfR8ur1uSjyplUCPcIs2UFa3nwbXwYLNl_w7f0TDg4ppo4CQ5oqDH18h9ZuhAw9sGZriyuIbGPTRkgvplNbTjY97qXSmiu0kxl6ElVXork Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2b51b697a6084440bf7a8080098925b7 Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:33.682068 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2b51b697a6084440bf7a8080098925b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b51b697a6084440bf7a8080098925b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2b51b697a6084440bf7a8080098925b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b51b697a6084440bf7a8080098925b7"}]}] Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2b51b697a6084440bf7a8080098925b7 Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4110417440054128862efa0408fe93f7 Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: {"removeFloatingIp": {"address": "0.0.0.0"}} Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:52:33.683622 n-d-850468-16 devstack@n-api.service[128808]: exception: Floating IP not found for address 0.0.0.0. Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '384a38ca-06b1-4f61-a6f1-fd316e2d373a', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2930, in get_instance_id_by_floating_address Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3014, in _get_floating_ip_by_address Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:33.684526 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Aug 23 17:52:33.686095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:33.688759 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5b441fea-4fdb-4bbc-8230-99cc44558c8d tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1271 microversion: 2.1 time: 0.471487 Aug 23 17:52:33.689430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3528379a-ea1a-46e9-9bc9-d2a60f97c376 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:33.691153 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3528379a-ea1a-46e9-9bc9-d2a60f97c376 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action" status: 404 len: 88 microversion: 2.1 time: 0.106281 Aug 23 17:52:33.692978 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 255/496] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:52:33 2022] POST /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a/action => generated 88 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 17:52:33.693685 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 242/497] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:33 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1271 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:33.704281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-feb529a0-680c-4deb-8eb4-f9f277d17a07 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:33.704765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-feb529a0-680c-4deb-8eb4-f9f277d17a07 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:33.725952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:DELETE=9 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:33.735844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb529a0-680c-4deb-8eb4-f9f277d17a07 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:33.736418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb529a0-680c-4deb-8eb4-f9f277d17a07 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:33.737456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb529a0-680c-4deb-8eb4-f9f277d17a07 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:33.743767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb529a0-680c-4deb-8eb4-f9f277d17a07 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:33.744577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb529a0-680c-4deb-8eb4-f9f277d17a07 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:33.744855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb529a0-680c-4deb-8eb4-f9f277d17a07 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:33.786799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-90956b3e-f8f6-44d9-9d15-e727710741a8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:33.787511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-90956b3e-f8f6-44d9-9d15-e727710741a8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:33.797598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90956b3e-f8f6-44d9-9d15-e727710741a8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:33.801630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90956b3e-f8f6-44d9-9d15-e727710741a8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:33.802357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90956b3e-f8f6-44d9-9d15-e727710741a8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:33.803356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90956b3e-f8f6-44d9-9d15-e727710741a8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:33.809931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90956b3e-f8f6-44d9-9d15-e727710741a8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:33.811611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90956b3e-f8f6-44d9-9d15-e727710741a8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:33.842348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-feb529a0-680c-4deb-8eb4-f9f277d17a07 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:52:34.106859 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-feb529a0-680c-4deb-8eb4-f9f277d17a07 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "DELETE /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 204 len: 0 microversion: 2.1 time: 0.407020 Aug 23 17:52:34.108936 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 256/498] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:52:33 2022] DELETE /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:52:34.120183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-94b55067-d6e4-4454-87e0-53e49689d9c3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:34.125884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-94b55067-d6e4-4454-87e0-53e49689d9c3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:34.134049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94b55067-d6e4-4454-87e0-53e49689d9c3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:34.135023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94b55067-d6e4-4454-87e0-53e49689d9c3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:34.135612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94b55067-d6e4-4454-87e0-53e49689d9c3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:34.136835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94b55067-d6e4-4454-87e0-53e49689d9c3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:34.137436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94b55067-d6e4-4454-87e0-53e49689d9c3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:34.138005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94b55067-d6e4-4454-87e0-53e49689d9c3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:34.336553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-94b55067-d6e4-4454-87e0-53e49689d9c3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:34.346761 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-94b55067-d6e4-4454-87e0-53e49689d9c3 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1541 microversion: 2.1 time: 0.231844 Aug 23 17:52:34.348671 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 257/499] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:34 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1541 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:34.354334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f3f311d-5102-448e-8320-e3ecbc97aa96 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:34.355280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5f3f311d-5102-448e-8320-e3ecbc97aa96 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:34.369069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f3f311d-5102-448e-8320-e3ecbc97aa96 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:34.369901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f3f311d-5102-448e-8320-e3ecbc97aa96 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:34.370604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f3f311d-5102-448e-8320-e3ecbc97aa96 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:34.374338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f3f311d-5102-448e-8320-e3ecbc97aa96 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:34.375123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f3f311d-5102-448e-8320-e3ecbc97aa96 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:34.375782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f3f311d-5102-448e-8320-e3ecbc97aa96 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:34.476858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-90956b3e-f8f6-44d9-9d15-e727710741a8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:34.492600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f3f311d-5102-448e-8320-e3ecbc97aa96 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:34.494824 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-90956b3e-f8f6-44d9-9d15-e727710741a8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1313 microversion: 2.1 time: 0.710155 Aug 23 17:52:34.506638 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 243/500] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:33 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1313 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:34.515377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f3f311d-5102-448e-8320-e3ecbc97aa96 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:34.517207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f3f311d-5102-448e-8320-e3ecbc97aa96 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:34.522820 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5f3f311d-5102-448e-8320-e3ecbc97aa96 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1447 microversion: 2.75 time: 0.173014 Aug 23 17:52:34.523394 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 258/501] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:34 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1447 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:34.716535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e46fc321-6b45-4eb4-90aa-e5e5383927ed tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:34.717534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e46fc321-6b45-4eb4-90aa-e5e5383927ed tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:34.734648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e46fc321-6b45-4eb4-90aa-e5e5383927ed tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:34.735905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e46fc321-6b45-4eb4-90aa-e5e5383927ed tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:34.736536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e46fc321-6b45-4eb4-90aa-e5e5383927ed tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:34.738726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e46fc321-6b45-4eb4-90aa-e5e5383927ed tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:34.739422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e46fc321-6b45-4eb4-90aa-e5e5383927ed tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:34.740054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e46fc321-6b45-4eb4-90aa-e5e5383927ed tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:34.993546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e46fc321-6b45-4eb4-90aa-e5e5383927ed tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:35.012982 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e46fc321-6b45-4eb4-90aa-e5e5383927ed tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1289 microversion: 2.1 time: 0.300664 Aug 23 17:52:35.013640 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 244/502] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:34 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1289 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:35.369954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-912f8acc-86dc-4c66-a47a-2650e62757fc tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:35.370631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-912f8acc-86dc-4c66-a47a-2650e62757fc tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:35.388507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-912f8acc-86dc-4c66-a47a-2650e62757fc tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:35.389336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-912f8acc-86dc-4c66-a47a-2650e62757fc tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:35.390844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-912f8acc-86dc-4c66-a47a-2650e62757fc tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:35.391863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-912f8acc-86dc-4c66-a47a-2650e62757fc tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:35.392482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-912f8acc-86dc-4c66-a47a-2650e62757fc tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:35.394300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-912f8acc-86dc-4c66-a47a-2650e62757fc tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:35.402917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:35.519257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1cee9a02-ad07-4fa2-a6ea-0b81489702d5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:35.520255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1cee9a02-ad07-4fa2-a6ea-0b81489702d5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:35.542444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cee9a02-ad07-4fa2-a6ea-0b81489702d5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:35.543140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cee9a02-ad07-4fa2-a6ea-0b81489702d5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:35.543722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cee9a02-ad07-4fa2-a6ea-0b81489702d5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:35.544813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cee9a02-ad07-4fa2-a6ea-0b81489702d5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:35.545497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cee9a02-ad07-4fa2-a6ea-0b81489702d5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:35.546138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cee9a02-ad07-4fa2-a6ea-0b81489702d5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:35.749242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-912f8acc-86dc-4c66-a47a-2650e62757fc tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:35.760165 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-912f8acc-86dc-4c66-a47a-2650e62757fc tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1541 microversion: 2.1 time: 0.394747 Aug 23 17:52:35.764240 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 259/503] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:35 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1541 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:35.770431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-64cd60b0-0427-4a9c-9168-d4e53f8e5647 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:35.771211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-64cd60b0-0427-4a9c-9168-d4e53f8e5647 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:35.778385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64cd60b0-0427-4a9c-9168-d4e53f8e5647 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:35.779055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64cd60b0-0427-4a9c-9168-d4e53f8e5647 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:35.779635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64cd60b0-0427-4a9c-9168-d4e53f8e5647 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:35.780524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64cd60b0-0427-4a9c-9168-d4e53f8e5647 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:35.781119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64cd60b0-0427-4a9c-9168-d4e53f8e5647 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:35.781686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64cd60b0-0427-4a9c-9168-d4e53f8e5647 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:35.908156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-64cd60b0-0427-4a9c-9168-d4e53f8e5647 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:35.922802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-64cd60b0-0427-4a9c-9168-d4e53f8e5647 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:35.927728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-64cd60b0-0427-4a9c-9168-d4e53f8e5647 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:35.945121 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-64cd60b0-0427-4a9c-9168-d4e53f8e5647 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1453 microversion: 2.75 time: 0.179460 Aug 23 17:52:35.959461 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 260/504] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:35 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1453 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:36.038847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a2752f2-2399-4bb7-a6cd-7a4776bcae91 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:36.039467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5a2752f2-2399-4bb7-a6cd-7a4776bcae91 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:36.054926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a2752f2-2399-4bb7-a6cd-7a4776bcae91 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:36.055428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a2752f2-2399-4bb7-a6cd-7a4776bcae91 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:36.055865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a2752f2-2399-4bb7-a6cd-7a4776bcae91 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:36.056575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a2752f2-2399-4bb7-a6cd-7a4776bcae91 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:36.057194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a2752f2-2399-4bb7-a6cd-7a4776bcae91 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:36.057820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a2752f2-2399-4bb7-a6cd-7a4776bcae91 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:36.281078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1cee9a02-ad07-4fa2-a6ea-0b81489702d5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:36.281751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5a2752f2-2399-4bb7-a6cd-7a4776bcae91 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:36.293545 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a2752f2-2399-4bb7-a6cd-7a4776bcae91 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1319 microversion: 2.1 time: 0.259905 Aug 23 17:52:36.300543 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1cee9a02-ad07-4fa2-a6ea-0b81489702d5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1313 microversion: 2.1 time: 0.786267 Aug 23 17:52:36.301144 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 261/505] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:36 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:36.303671 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 245/506] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:35 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1313 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:36.479605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48ea3c96-0ec5-443c-a708-bf59be01cdab tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-694925816", "ram": 512, "vcpus": 1, "disk": 10, "id": 1399820417, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:36.484673 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:36.484673 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:36.512336 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48ea3c96-0ec5-443c-a708-bf59be01cdab tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 0.209810 Aug 23 17:52:36.513794 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 262/507] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:36 2022] POST /compute/v2.1/flavors => generated 415 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:36.776886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-46a29527-574c-4cae-9fd9-d0cfa5f00c43 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:36.786083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b706a00-384b-4970-9444-f4214743d959 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:36.788253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b706a00-384b-4970-9444-f4214743d959 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:36.791606 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-46a29527-574c-4cae-9fd9-d0cfa5f00c43 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] HTTP exception thrown: Flavor 1399820417 has no extra specs with key hw:cpu_thread_policy. Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-46a29527-574c-4cae-9fd9-d0cfa5f00c43 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Request method failure captured: Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/flavors/1399820417/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPi9U60QpecxNlTPMwNylIZ3iXwu3iX4sO-4WrQRlRLa68YhPsQgtEjzzzKYTbXgQUMSfhvY5aJkvDVmfSGvJcpqQwnZM218_eM2BUGjgVDE-L51Er0YxnrJ9KvnRykolfOaEz5hw4ckjzLUPcEDhKFt6MeA092rVD0VVNvPg--4PQ Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: eb47d8726afa4fdcb48893eb5c79697a Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:52:36.797276 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:52:36.798802 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eb47d8726afa4fdcb48893eb5c79697a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb47d8726afa4fdcb48893eb5c79697a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eb47d8726afa4fdcb48893eb5c79697a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb47d8726afa4fdcb48893eb5c79697a"}]}] Aug 23 17:52:36.798802 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 Aug 23 17:52:36.798802 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: eb47d8726afa4fdcb48893eb5c79697a Aug 23 17:52:36.798802 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 Aug 23 17:52:36.798802 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project Aug 23 17:52:36.798802 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:36.798802 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:36.798802 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a04a524d836649b594d82d2261377f36 Aug 23 17:52:36.798802 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project Aug 23 17:52:36.798802 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:36.798802 n-d-850468-16 devstack@n-api.service[128807]: exception: Flavor 1399820417 has no extra specs with key hw:cpu_thread_policy. Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'flavor_id': '1399820417', 'id': 'hw:cpu_thread_policy'} Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1399820417 has no extra specs with key hw:cpu_thread_policy. Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:36.800239 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:36.801878 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:36.801878 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:36.801878 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:36.801878 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:36.801878 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:36.801878 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1399820417 has no extra specs with key hw:cpu_thread_policy. Aug 23 17:52:36.801878 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:36.803534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-46a29527-574c-4cae-9fd9-d0cfa5f00c43 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Returning 404 to user: Flavor 1399820417 has no extra specs with key hw:cpu_thread_policy. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:36.805104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b706a00-384b-4970-9444-f4214743d959 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:36.805703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b706a00-384b-4970-9444-f4214743d959 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:36.806152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b706a00-384b-4970-9444-f4214743d959 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:36.806425 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-46a29527-574c-4cae-9fd9-d0cfa5f00c43 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] 10.222.0.61 "GET /compute/v2.1/flavors/1399820417/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.283193 Aug 23 17:52:36.806944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b706a00-384b-4970-9444-f4214743d959 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:36.807402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b706a00-384b-4970-9444-f4214743d959 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:36.810148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b706a00-384b-4970-9444-f4214743d959 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:36.824135 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 246/508] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Aug 23 17:52:36 2022] GET /compute/v2.1/flavors/1399820417/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 298 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:36.829811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1fbb8db4-92ef-4499-8cfa-5c2a0a8075c7 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:36.834403 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:36.834403 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:36.836641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1fbb8db4-92ef-4499-8cfa-5c2a0a8075c7 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': 'a04a524d836649b594d82d2261377f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb47d8726afa4fdcb48893eb5c79697a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1fbb8db4-92ef-4499-8cfa-5c2a0a8075c7 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Request method failure captured: Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/flavors/1399820417/os-extra_specs HTTP/1.1 Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 66 Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPi9U60QpecxNlTPMwNylIZ3iXwu3iX4sO-4WrQRlRLa68YhPsQgtEjzzzKYTbXgQUMSfhvY5aJkvDVmfSGvJcpqQwnZM218_eM2BUGjgVDE-L51Er0YxnrJ9KvnRykolfOaEz5hw4ckjzLUPcEDhKFt6MeA092rVD0VVNvPg--4PQ Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: eb47d8726afa4fdcb48893eb5c79697a Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:52:36.838575 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:52:36.839844 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eb47d8726afa4fdcb48893eb5c79697a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb47d8726afa4fdcb48893eb5c79697a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eb47d8726afa4fdcb48893eb5c79697a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb47d8726afa4fdcb48893eb5c79697a"}]}] Aug 23 17:52:36.839844 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 Aug 23 17:52:36.839844 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: eb47d8726afa4fdcb48893eb5c79697a Aug 23 17:52:36.839844 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 Aug 23 17:52:36.839844 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project Aug 23 17:52:36.839844 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:36.839844 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:36.839844 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a04a524d836649b594d82d2261377f36 Aug 23 17:52:36.839844 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project Aug 23 17:52:36.839844 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:52:36.839844 n-d-850468-16 devstack@n-api.service[128807]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Aug 23 17:52:36.839844 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'flavor_id': '1399820417', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:36.840796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Aug 23 17:52:36.841875 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:36.845308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1fbb8db4-92ef-4499-8cfa-5c2a0a8075c7 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:36.847026 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1fbb8db4-92ef-4499-8cfa-5c2a0a8075c7 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] 10.222.0.61 "POST /compute/v2.1/flavors/1399820417/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.020785 Aug 23 17:52:36.848068 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 247/509] 10.222.0.61 () {60 vars in 1224 bytes} [Tue Aug 23 17:52:36 2022] POST /compute/v2.1/flavors/1399820417/os-extra_specs => generated 124 bytes in 23 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Aug 23 17:52:36.862953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1916d2a7-2399-48af-9336-81b02cc3e2ce tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:36.937101 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1916d2a7-2399-48af-9336-81b02cc3e2ce tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1399820417/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.082068 Aug 23 17:52:36.938025 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 248/510] 10.222.0.61 () {60 vars in 1224 bytes} [Tue Aug 23 17:52:36 2022] POST /compute/v2.1/flavors/1399820417/os-extra_specs => generated 66 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 17:52:36.976018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0272147d-26a9-4e08-94ff-86012690ae1a tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:36.978843 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:36.978843 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:36.989841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0272147d-26a9-4e08-94ff-86012690ae1a tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': 'a04a524d836649b594d82d2261377f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb47d8726afa4fdcb48893eb5c79697a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0272147d-26a9-4e08-94ff-86012690ae1a tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Request method failure captured: Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/flavors/1399820417/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPi9U60QpecxNlTPMwNylIZ3iXwu3iX4sO-4WrQRlRLa68YhPsQgtEjzzzKYTbXgQUMSfhvY5aJkvDVmfSGvJcpqQwnZM218_eM2BUGjgVDE-L51Er0YxnrJ9KvnRykolfOaEz5hw4ckjzLUPcEDhKFt6MeA092rVD0VVNvPg--4PQ Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: eb47d8726afa4fdcb48893eb5c79697a Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:52:36.995664 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:52:36.997018 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eb47d8726afa4fdcb48893eb5c79697a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb47d8726afa4fdcb48893eb5c79697a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eb47d8726afa4fdcb48893eb5c79697a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb47d8726afa4fdcb48893eb5c79697a"}]}] Aug 23 17:52:36.997018 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 Aug 23 17:52:36.997018 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: eb47d8726afa4fdcb48893eb5c79697a Aug 23 17:52:36.997018 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 Aug 23 17:52:36.997018 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project Aug 23 17:52:36.997018 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:36.997018 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:36.997018 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a04a524d836649b594d82d2261377f36 Aug 23 17:52:36.997018 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project Aug 23 17:52:36.997018 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:36.997018 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'flavor_id': '1399820417', 'id': 'hw:numa_nodes'} Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:36.997679 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Aug 23 17:52:36.999855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:37.004098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0272147d-26a9-4e08-94ff-86012690ae1a tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:37.007518 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0272147d-26a9-4e08-94ff-86012690ae1a tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] 10.222.0.61 "DELETE /compute/v2.1/flavors/1399820417/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.045857 Aug 23 17:52:37.014489 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 249/511] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 17:52:36 2022] DELETE /compute/v2.1/flavors/1399820417/os-extra_specs/hw:numa_nodes => generated 124 bytes in 54 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:37.027437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2b1a5dca-c21f-4595-84e8-324d4b6fc975 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:37.041944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2b1a5dca-c21f-4595-84e8-324d4b6fc975 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:37.049723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b1a5dca-c21f-4595-84e8-324d4b6fc975 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:37.050582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b1a5dca-c21f-4595-84e8-324d4b6fc975 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:37.051241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b1a5dca-c21f-4595-84e8-324d4b6fc975 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:37.052446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b1a5dca-c21f-4595-84e8-324d4b6fc975 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:37.053116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b1a5dca-c21f-4595-84e8-324d4b6fc975 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:37.053787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b1a5dca-c21f-4595-84e8-324d4b6fc975 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:37.137733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b706a00-384b-4970-9444-f4214743d959 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:37.148452 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b706a00-384b-4970-9444-f4214743d959 tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1541 microversion: 2.1 time: 0.367511 Aug 23 17:52:37.149585 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 263/512] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:36 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1541 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:37.223502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2b1a5dca-c21f-4595-84e8-324d4b6fc975 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:37.229490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-2125306553", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "01db69ea-76ab-43b6-bec6-04f17d268a24"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:37.234303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2b1a5dca-c21f-4595-84e8-324d4b6fc975 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:37.239253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2b1a5dca-c21f-4595-84e8-324d4b6fc975 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:37.250025 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2b1a5dca-c21f-4595-84e8-324d4b6fc975 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1453 microversion: 2.75 time: 0.234001 Aug 23 17:52:37.253686 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 250/513] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:37 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1453 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:37.272068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-126bd6d7-af30-4bda-b347-2d8cfa97aaf7 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:37.275269 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:37.275269 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:37.335320 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-126bd6d7-af30-4bda-b347-2d8cfa97aaf7 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/1399820417/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.076779 Aug 23 17:52:37.335924 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 251/514] 10.222.0.61 () {60 vars in 1224 bytes} [Tue Aug 23 17:52:37 2022] POST /compute/v2.1/flavors/1399820417/os-extra_specs => generated 66 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:52:37.345641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dda49fbf-31a4-46ad-91dd-08cc6aa706d0 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:37.346837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dda49fbf-31a4-46ad-91dd-08cc6aa706d0 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:37.357180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dda49fbf-31a4-46ad-91dd-08cc6aa706d0 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:37.357672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dda49fbf-31a4-46ad-91dd-08cc6aa706d0 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:37.364498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] validate_networks() for [('01db69ea-76ab-43b6-bec6-04f17d268a24', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:52:37.366097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dda49fbf-31a4-46ad-91dd-08cc6aa706d0 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:37.366905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dda49fbf-31a4-46ad-91dd-08cc6aa706d0 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:37.367384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dda49fbf-31a4-46ad-91dd-08cc6aa706d0 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:37.367818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dda49fbf-31a4-46ad-91dd-08cc6aa706d0 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:38.007702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dda49fbf-31a4-46ad-91dd-08cc6aa706d0 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:38.022738 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dda49fbf-31a4-46ad-91dd-08cc6aa706d0 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1319 microversion: 2.1 time: 0.685657 Aug 23 17:52:38.029338 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 252/515] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:37 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1319 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:38.055424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-645781e4-9a07-4bb2-942f-20a796f185c2 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:38.064446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-645781e4-9a07-4bb2-942f-20a796f185c2 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:38.082718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-645781e4-9a07-4bb2-942f-20a796f185c2 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:38.085909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-645781e4-9a07-4bb2-942f-20a796f185c2 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:38.091949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-645781e4-9a07-4bb2-942f-20a796f185c2 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:38.093758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-645781e4-9a07-4bb2-942f-20a796f185c2 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:38.094411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-645781e4-9a07-4bb2-942f-20a796f185c2 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:38.095027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-645781e4-9a07-4bb2-942f-20a796f185c2 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:38.426328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-645781e4-9a07-4bb2-942f-20a796f185c2 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:38.450580 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-645781e4-9a07-4bb2-942f-20a796f185c2 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1463 microversion: 2.1 time: 0.397155 Aug 23 17:52:38.455091 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 253/516] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:38 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1463 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:38.474512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2b73a415-d963-42b3-b4ac-6a05a62fae96 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:38.485014 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:38.485014 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:38.492822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2b73a415-d963-42b3-b4ac-6a05a62fae96 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': 'a04a524d836649b594d82d2261377f36', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb47d8726afa4fdcb48893eb5c79697a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2b73a415-d963-42b3-b4ac-6a05a62fae96 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Request method failure captured: Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: request: PUT /compute/v2.1/flavors/1399820417/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 22 Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPi9U60QpecxNlTPMwNylIZ3iXwu3iX4sO-4WrQRlRLa68YhPsQgtEjzzzKYTbXgQUMSfhvY5aJkvDVmfSGvJcpqQwnZM218_eM2BUGjgVDE-L51Er0YxnrJ9KvnRykolfOaEz5hw4ckjzLUPcEDhKFt6MeA092rVD0VVNvPg--4PQ Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: eb47d8726afa4fdcb48893eb5c79697a Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:52:38.497101 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eb47d8726afa4fdcb48893eb5c79697a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb47d8726afa4fdcb48893eb5c79697a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eb47d8726afa4fdcb48893eb5c79697a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eb47d8726afa4fdcb48893eb5c79697a"}]}] Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: eb47d8726afa4fdcb48893eb5c79697a Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a04a524d836649b594d82d2261377f36 Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: {"hw:numa_nodes": "1"} Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:38.498579 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'flavor_id': '1399820417', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:52:38.499772 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Aug 23 17:52:38.501076 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:38.509097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2b73a415-d963-42b3-b4ac-6a05a62fae96 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:38.510128 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2b73a415-d963-42b3-b4ac-6a05a62fae96 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660 tempest-FlavorsExtraSpecsNegativeTestJSON-466647660-project] 10.222.0.61 "PUT /compute/v2.1/flavors/1399820417/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.052864 Aug 23 17:52:38.512002 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 254/517] 10.222.0.61 () {60 vars in 1265 bytes} [Tue Aug 23 17:52:38 2022] PUT /compute/v2.1/flavors/1399820417/os-extra_specs/hw:numa_nodes => generated 124 bytes in 56 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:38.518634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-70fb0ae3-5f19-4300-b5a8-46675b26565b req-691e2c8f-4978-43de-b5a8-bb9f35db13c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "384a38ca-06b1-4f61-a6f1-fd316e2d373a", "name": "network-vif-deleted", "tag": "126444e3-4ac6-4d94-b3f6-dfeee1a150a5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:38.539040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-70fb0ae3-5f19-4300-b5a8-46675b26565b req-691e2c8f-4978-43de-b5a8-bb9f35db13c0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:38.540328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-70fb0ae3-5f19-4300-b5a8-46675b26565b req-691e2c8f-4978-43de-b5a8-bb9f35db13c0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:38.544105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-70fb0ae3-5f19-4300-b5a8-46675b26565b req-691e2c8f-4978-43de-b5a8-bb9f35db13c0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:38.577690 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-70fb0ae3-5f19-4300-b5a8-46675b26565b req-691e2c8f-4978-43de-b5a8-bb9f35db13c0 service nova] Creating event network-vif-deleted:126444e3-4ac6-4d94-b3f6-dfeee1a150a5 for instance 384a38ca-06b1-4f61-a6f1-fd316e2d373a on n-h1-850468-16 Aug 23 17:52:38.591564 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-70fb0ae3-5f19-4300-b5a8-46675b26565b req-691e2c8f-4978-43de-b5a8-bb9f35db13c0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077864 Aug 23 17:52:38.597346 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 255/518] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:38.611195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:38.615018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:38.633671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:38.640366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:38.640965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:38.644219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:38.644730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:38.645176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:38.726651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:38.727230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:38.727799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:38.728320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lazy-loading 'fault' on Instance uuid 384a38ca-06b1-4f61-a6f1-fd316e2d373a {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:38.882771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4110417440054128862efa0408fe93f7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b51b697a6084440bf7a8080098925b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:38.914046 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49a1deaf-e168-4e77-9261-bf5ae2462dff tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 200 len: 1321 microversion: 2.1 time: 0.313851 Aug 23 17:52:38.915063 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 256/519] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:38 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:38.920992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-38903169-a3ee-4bba-aff6-a84bcfccd5ed tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:38.921858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-38903169-a3ee-4bba-aff6-a84bcfccd5ed tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:38.932175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38903169-a3ee-4bba-aff6-a84bcfccd5ed tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:38.932713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38903169-a3ee-4bba-aff6-a84bcfccd5ed tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:38.933152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38903169-a3ee-4bba-aff6-a84bcfccd5ed tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:38.936859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38903169-a3ee-4bba-aff6-a84bcfccd5ed tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:38.937448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38903169-a3ee-4bba-aff6-a84bcfccd5ed tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:38.937905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38903169-a3ee-4bba-aff6-a84bcfccd5ed tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:39.083528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:52:39.084144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:52:39.084739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:52:39.085208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:52:39.085834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:52:39.116592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:39.117085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:39.117526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:39.118261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:39.118823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:39.119256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:39.189118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Getting quotas for project 5bbd01aaed704a1b8509e754d19a4b8d. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:52:39.207220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Getting quotas for user 0ef389420da8493386a7f8dfb747afab and project 5bbd01aaed704a1b8509e754d19a4b8d. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:52:39.280341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-38903169-a3ee-4bba-aff6-a84bcfccd5ed tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:39.296179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-38903169-a3ee-4bba-aff6-a84bcfccd5ed tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:39.297577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:52:39.298524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-38903169-a3ee-4bba-aff6-a84bcfccd5ed tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:39.314401 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-38903169-a3ee-4bba-aff6-a84bcfccd5ed tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1453 microversion: 2.75 time: 0.397796 Aug 23 17:52:39.317255 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 257/520] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:38 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1453 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:39.318301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:52:39.344981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-01abb6a2-56b2-47a1-a1ef-d8849e4d3cd6 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:39.347460 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:39.347460 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:39.355921 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-01abb6a2-56b2-47a1-a1ef-d8849e4d3cd6 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] HTTP exception thrown: Flavor 1399820417 has no extra specs with key hw:cpu_thread_policy. Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-01abb6a2-56b2-47a1-a1ef-d8849e4d3cd6 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Request method failure captured: Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/flavors/1399820417/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPjSNHkrkX59Ake-ZoP---1gETzDEuKkulQjkQylNUAoAgXac5z5kztdK-flAuRBcs6i2AJ3dJ72n_ASQHTettGHX6SaDlxyk7BXTsfX2FMFnyXkFYfyJtM-8V5on60pvLkb_OoLg77TK4gMnIZkdKu-jRmDiaL8vhW6BBgSLPl4js Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fc06969d673647b39d79161dc1ff4c8e Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:52:39.358801 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:52:39.360063 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fc06969d673647b39d79161dc1ff4c8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc06969d673647b39d79161dc1ff4c8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fc06969d673647b39d79161dc1ff4c8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc06969d673647b39d79161dc1ff4c8e"}]}] Aug 23 17:52:39.360063 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 Aug 23 17:52:39.360063 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fc06969d673647b39d79161dc1ff4c8e Aug 23 17:52:39.360063 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 Aug 23 17:52:39.360063 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin Aug 23 17:52:39.360063 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:39.360063 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:39.360063 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2217d2ce05214c7498be24818fa01e94 Aug 23 17:52:39.360063 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin Aug 23 17:52:39.360063 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:39.360063 n-d-850468-16 devstack@n-api.service[128807]: exception: Flavor 1399820417 has no extra specs with key hw:cpu_thread_policy. Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'flavor_id': '1399820417', 'id': 'hw:cpu_thread_policy'} Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1399820417 has no extra specs with key hw:cpu_thread_policy. Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:39.360812 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:39.363251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:39.363251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:39.363251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:39.363251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:39.363251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:39.363251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1399820417 has no extra specs with key hw:cpu_thread_policy. Aug 23 17:52:39.363251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:39.366201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-01abb6a2-56b2-47a1-a1ef-d8849e4d3cd6 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Returning 404 to user: Flavor 1399820417 has no extra specs with key hw:cpu_thread_policy. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:39.367675 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-01abb6a2-56b2-47a1-a1ef-d8849e4d3cd6 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1399820417/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.048906 Aug 23 17:52:39.368814 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 258/521] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 17:52:39 2022] DELETE /compute/v2.1/flavors/1399820417/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:39.374764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-511428551", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "69a4f4f5-5f3a-4907-a471-005e1f790e8b"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:39.457875 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f155627-7976-4cb6-803b-313fe47ceb60 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.303624 Aug 23 17:52:39.459262 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 264/522] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2309 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:52:39.489268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adc45db9-ed45-4e7a-b114-be5a3108ada6 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:39.492578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-adc45db9-ed45-4e7a-b114-be5a3108ada6 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:39.507515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adc45db9-ed45-4e7a-b114-be5a3108ada6 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:39.511103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adc45db9-ed45-4e7a-b114-be5a3108ada6 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:39.513668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adc45db9-ed45-4e7a-b114-be5a3108ada6 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:39.514657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adc45db9-ed45-4e7a-b114-be5a3108ada6 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:39.527747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adc45db9-ed45-4e7a-b114-be5a3108ada6 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:39.528217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adc45db9-ed45-4e7a-b114-be5a3108ada6 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:39.585237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:52:40.063656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:52:40.064202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:52:40.065738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:52:40.066758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:52:40.067256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:52:40.089928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:40.090939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:40.091808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:40.094764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:40.098636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:40.099434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:40.139246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Getting quotas for project 5c5a1c94aed149c489a20be456895034. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:52:40.158102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Getting quotas for user d81796ff5b934d218c1b967b8c0f9882 and project 5c5a1c94aed149c489a20be456895034. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:52:40.168223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-adc45db9-ed45-4e7a-b114-be5a3108ada6 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:40.174962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:52:40.177963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:52:40.179163 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-adc45db9-ed45-4e7a-b114-be5a3108ada6 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1319 microversion: 2.1 time: 0.702090 Aug 23 17:52:40.179749 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 265/523] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:39 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1319 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:40.200257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adca2cd1-4450-4a77-8501-e26b0199db4f tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:40.204807 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:40.204807 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:52:40.205808 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-adca2cd1-4450-4a77-8501-e26b0199db4f tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] HTTP exception thrown: Request body and URI mismatch Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adca2cd1-4450-4a77-8501-e26b0199db4f tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Request method failure captured: Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: request: PUT /compute/v2.1/flavors/1399820417/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 27 Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPjSNHkrkX59Ake-ZoP---1gETzDEuKkulQjkQylNUAoAgXac5z5kztdK-flAuRBcs6i2AJ3dJ72n_ASQHTettGHX6SaDlxyk7BXTsfX2FMFnyXkFYfyJtM-8V5on60pvLkb_OoLg77TK4gMnIZkdKu-jRmDiaL8vhW6BBgSLPl4js Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: fc06969d673647b39d79161dc1ff4c8e Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:52:40.216571 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fc06969d673647b39d79161dc1ff4c8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc06969d673647b39d79161dc1ff4c8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fc06969d673647b39d79161dc1ff4c8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc06969d673647b39d79161dc1ff4c8e"}]}] Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: fc06969d673647b39d79161dc1ff4c8e Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2217d2ce05214c7498be24818fa01e94 Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: {"hw:cpu_policy": "shared"} Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:40.217948 n-d-850468-16 devstack@n-api.service[128808]: exception: Request body and URI mismatch Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'flavor_id': '1399820417', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:40.225916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:40.227132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:40.227132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:40.227132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Aug 23 17:52:40.227132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.227132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adca2cd1-4450-4a77-8501-e26b0199db4f tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:40.227132 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-adca2cd1-4450-4a77-8501-e26b0199db4f tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/1399820417/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.024211 Aug 23 17:52:40.227132 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 266/524] 10.222.0.61 () {60 vars in 1265 bytes} [Tue Aug 23 17:52:40 2022] PUT /compute/v2.1/flavors/1399820417/os-extra_specs/hw:numa_nodes => generated 73 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:52:40.227132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bd9ee666-b2f8-48a6-a883-b977f0c82b5b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:40.227603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bd9ee666-b2f8-48a6-a883-b977f0c82b5b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:40.266132 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5634a62c-b15d-4a46-830b-d426f1eca3dd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.895697 Aug 23 17:52:40.268086 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 259/525] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:52:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 898 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:52:40.275639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-032d4b29-af7f-4563-bf36-fd2a260930d0 req-fc3f815e-955a-44fd-abb5-5efdde9e3ec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7a97134-e24f-4d8a-bb6f-dd6370863fb9", "tag": "3b22a4b6-90a5-46af-93ec-ba8bdf0f07ae"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:40.288456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-032d4b29-af7f-4563-bf36-fd2a260930d0 req-fc3f815e-955a-44fd-abb5-5efdde9e3ec8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:40.289089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-032d4b29-af7f-4563-bf36-fd2a260930d0 req-fc3f815e-955a-44fd-abb5-5efdde9e3ec8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:40.289516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-032d4b29-af7f-4563-bf36-fd2a260930d0 req-fc3f815e-955a-44fd-abb5-5efdde9e3ec8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:40.307405 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-032d4b29-af7f-4563-bf36-fd2a260930d0 req-fc3f815e-955a-44fd-abb5-5efdde9e3ec8 service nova] Creating event network-changed:3b22a4b6-90a5-46af-93ec-ba8bdf0f07ae for instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 on n-h2-850468-16 Aug 23 17:52:40.318632 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-032d4b29-af7f-4563-bf36-fd2a260930d0 req-fc3f815e-955a-44fd-abb5-5efdde9e3ec8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046474 Aug 23 17:52:40.321485 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 260/526] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:40.348245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f9052be6-b123-4819-b930-82ca14fbd86e tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:40.349153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f9052be6-b123-4819-b930-82ca14fbd86e tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] [instance: 384a38ca-06b1-4f61-a6f1-fd316e2d373a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:40.363596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9052be6-b123-4819-b930-82ca14fbd86e tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:40.367659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9052be6-b123-4819-b930-82ca14fbd86e tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:40.368647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9052be6-b123-4819-b930-82ca14fbd86e tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:40.369709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9052be6-b123-4819-b930-82ca14fbd86e tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:40.372055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9052be6-b123-4819-b930-82ca14fbd86e tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:40.373173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9052be6-b123-4819-b930-82ca14fbd86e tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:40.392464 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-f9052be6-b123-4819-b930-82ca14fbd86e tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] HTTP exception thrown: Instance 384a38ca-06b1-4f61-a6f1-fd316e2d373a could not be found. Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f9052be6-b123-4819-b930-82ca14fbd86e tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Request method failure captured: Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a HTTP/1.1 Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBROzj22ezEQ2Xqi2Xep2eh8yK-WByMxOTvYeUgKiqA8658p3wD4zXOW80skbHfoHvCHBdTfR8ur1uSjyplUCPcIs2UFa3nwbXwYLNl_w7f0TDg4ppo4CQ5oqDH18h9ZuhAw9sGZriyuIbGPTRkgvplNbTjY97qXSmiu0kxl6ElVXork Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 2b51b697a6084440bf7a8080098925b7 Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:52:40.396778 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:52:40.398275 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2b51b697a6084440bf7a8080098925b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b51b697a6084440bf7a8080098925b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2b51b697a6084440bf7a8080098925b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2b51b697a6084440bf7a8080098925b7"}]}] Aug 23 17:52:40.398275 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:40.398275 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 2b51b697a6084440bf7a8080098925b7 Aug 23 17:52:40.398275 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038 Aug 23 17:52:40.398275 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project Aug 23 17:52:40.398275 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:40.398275 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:40.398275 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4110417440054128862efa0408fe93f7 Aug 23 17:52:40.398275 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project Aug 23 17:52:40.398275 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:40.398275 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 384a38ca-06b1-4f61-a6f1-fd316e2d373a could not be found. Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '384a38ca-06b1-4f61-a6f1-fd316e2d373a'} Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 384a38ca-06b1-4f61-a6f1-fd316e2d373a could not be found. Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:40.399052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 384a38ca-06b1-4f61-a6f1-fd316e2d373a could not be found. Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 384a38ca-06b1-4f61-a6f1-fd316e2d373a could not be found. Aug 23 17:52:40.400185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.401279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f9052be6-b123-4819-b930-82ca14fbd86e tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] Returning 404 to user: Instance 384a38ca-06b1-4f61-a6f1-fd316e2d373a could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:40.401279 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f9052be6-b123-4819-b930-82ca14fbd86e tempest-FloatingIPsAssociationNegativeTestJSON-103062038 tempest-FloatingIPsAssociationNegativeTestJSON-103062038-project] 10.222.0.61 "GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a" status: 404 len: 111 microversion: 2.1 time: 0.076380 Aug 23 17:52:40.405233 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 261/527] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:40 2022] GET /compute/v2.1/servers/384a38ca-06b1-4f61-a6f1-fd316e2d373a => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:52:40.410627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-531052a8-eda7-47c1-bc5a-e352071ee6f9 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:40.414526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bd9ee666-b2f8-48a6-a883-b977f0c82b5b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-531052a8-eda7-47c1-bc5a-e352071ee6f9 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Request method failure captured: Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: request: PUT /compute/v2.1/flavors/1399820417/os-extra_specs/hw:numa_nodes HTTP/1.1 Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 49 Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPjSNHkrkX59Ake-ZoP---1gETzDEuKkulQjkQylNUAoAgXac5z5kztdK-flAuRBcs6i2AJ3dJ72n_ASQHTettGHX6SaDlxyk7BXTsfX2FMFnyXkFYfyJtM-8V5on60pvLkb_OoLg77TK4gMnIZkdKu-jRmDiaL8vhW6BBgSLPl4js Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fc06969d673647b39d79161dc1ff4c8e Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:52:40.416085 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:52:40.417322 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fc06969d673647b39d79161dc1ff4c8e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc06969d673647b39d79161dc1ff4c8e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fc06969d673647b39d79161dc1ff4c8e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc06969d673647b39d79161dc1ff4c8e"}]}] Aug 23 17:52:40.417322 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 Aug 23 17:52:40.417322 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fc06969d673647b39d79161dc1ff4c8e Aug 23 17:52:40.417322 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 Aug 23 17:52:40.417322 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin Aug 23 17:52:40.417322 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:40.417322 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:40.417322 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2217d2ce05214c7498be24818fa01e94 Aug 23 17:52:40.417322 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin Aug 23 17:52:40.417322 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:52:40.417322 n-d-850468-16 devstack@n-api.service[128807]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Aug 23 17:52:40.417322 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'flavor_id': '1399820417', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': ['string', Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'number']}}, Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance: Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Aug 23 17:52:40.418006 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.419688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:40.420802 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:40.420802 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:40.420802 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:52:40.420802 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:52:40.420802 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Aug 23 17:52:40.420802 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:40.420802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-531052a8-eda7-47c1-bc5a-e352071ee6f9 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:40.420802 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-531052a8-eda7-47c1-bc5a-e352071ee6f9 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/1399820417/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.011193 Aug 23 17:52:40.422031 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bd9ee666-b2f8-48a6-a883-b977f0c82b5b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1211 microversion: 2.1 time: 0.202247 Aug 23 17:52:40.423630 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 262/528] 10.222.0.61 () {60 vars in 1265 bytes} [Tue Aug 23 17:52:40 2022] PUT /compute/v2.1/flavors/1399820417/os-extra_specs/hw:numa_nodes => generated 117 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:52:40.429829 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 267/529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:40 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1211 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:40.444102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-676faac4-fd72-4a67-a3a2-f26f58fda013 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:40.445207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-676faac4-fd72-4a67-a3a2-f26f58fda013 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:40.446058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83dba126-7227-4231-ba0b-bb0e19d28c8f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:40.449298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-83dba126-7227-4231-ba0b-bb0e19d28c8f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:40.477612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83dba126-7227-4231-ba0b-bb0e19d28c8f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:40.480158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83dba126-7227-4231-ba0b-bb0e19d28c8f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:40.480633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83dba126-7227-4231-ba0b-bb0e19d28c8f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:40.485305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83dba126-7227-4231-ba0b-bb0e19d28c8f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:40.485887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83dba126-7227-4231-ba0b-bb0e19d28c8f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:40.486342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83dba126-7227-4231-ba0b-bb0e19d28c8f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:40.694314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-676faac4-fd72-4a67-a3a2-f26f58fda013 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:40.699441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-83dba126-7227-4231-ba0b-bb0e19d28c8f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:40.712634 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-676faac4-fd72-4a67-a3a2-f26f58fda013 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1213 microversion: 2.1 time: 0.276294 Aug 23 17:52:40.714759 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 263/530] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:40 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1213 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:40.719699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-83dba126-7227-4231-ba0b-bb0e19d28c8f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:40.722118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-83dba126-7227-4231-ba0b-bb0e19d28c8f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:40.731906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-23a58cbe-35b8-4502-8097-edfa9906a8b2 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:40.733089 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:40.733089 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:40.741286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=83,nova_api:INSERT=6,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:40.770701 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-83dba126-7227-4231-ba0b-bb0e19d28c8f tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1438 microversion: 2.75 time: 0.336169 Aug 23 17:52:40.774065 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 268/531] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:40 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1438 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:40.850260 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-23a58cbe-35b8-4502-8097-edfa9906a8b2 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1399820417" status: 202 len: 0 microversion: 2.1 time: 0.133946 Aug 23 17:52:40.851166 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 264/532] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:52:40 2022] DELETE /compute/v2.1/flavors/1399820417 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:40.870416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-709029e4-d189-44dd-a197-1bb3effc35bb tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:40.947044 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-709029e4-d189-44dd-a197-1bb3effc35bb tempest-FlavorsExtraSpecsNegativeTestJSON-913925910 tempest-FlavorsExtraSpecsNegativeTestJSON-913925910-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5816 microversion: 2.1 time: 0.082456 Aug 23 17:52:40.959246 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 265/533] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:40 2022] GET /compute/v2.1/flavors/detail => generated 5816 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:41.199559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ceaee80-6007-42ef-bd7a-6c4819c954d9 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:41.201804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8ceaee80-6007-42ef-bd7a-6c4819c954d9 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:41.241271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ceaee80-6007-42ef-bd7a-6c4819c954d9 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:41.242563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ceaee80-6007-42ef-bd7a-6c4819c954d9 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:41.244919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ceaee80-6007-42ef-bd7a-6c4819c954d9 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:41.253730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ceaee80-6007-42ef-bd7a-6c4819c954d9 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:41.257608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ceaee80-6007-42ef-bd7a-6c4819c954d9 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:41.260933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ceaee80-6007-42ef-bd7a-6c4819c954d9 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:41.601330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:41.605140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:41.640184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:41.640704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:41.647562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:41.648412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:41.648838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:41.653901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:41.883264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:52:41.883898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:52:41.884553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:52:41.885188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:52:41.885747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:52:41.969436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:41.980894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:41.981940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:41.982572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:41.983636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:41.984325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:41.984996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:42.137441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8ceaee80-6007-42ef-bd7a-6c4819c954d9 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:42.149812 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8ceaee80-6007-42ef-bd7a-6c4819c954d9 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1319 microversion: 2.1 time: 0.954144 Aug 23 17:52:42.162260 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 266/534] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:41 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1319 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:42.185284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e6e469b-538e-4a56-a59a-6c8f0387db0d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:42.186114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e6e469b-538e-4a56-a59a-6c8f0387db0d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:42.201348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e6e469b-538e-4a56-a59a-6c8f0387db0d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:42.201860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e6e469b-538e-4a56-a59a-6c8f0387db0d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:42.203180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e6e469b-538e-4a56-a59a-6c8f0387db0d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:42.204265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e6e469b-538e-4a56-a59a-6c8f0387db0d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:42.204807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e6e469b-538e-4a56-a59a-6c8f0387db0d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:42.205950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e6e469b-538e-4a56-a59a-6c8f0387db0d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:42.240048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:42.381213 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2762de6a-2bc3-4161-8b5e-6d57da5831fa tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08/action" status: 202 len: 1944 microversion: 2.75 time: 1.582849 Aug 23 17:52:42.383135 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 269/535] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 17:52:40 2022] POST /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08/action => generated 1944 bytes in 1585 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 23 17:52:42.390718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1dc29357-92f0-4656-861e-f844b32bc25d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:42.391778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1dc29357-92f0-4656-861e-f844b32bc25d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:42.402475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dc29357-92f0-4656-861e-f844b32bc25d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:42.403346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dc29357-92f0-4656-861e-f844b32bc25d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:42.404602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dc29357-92f0-4656-861e-f844b32bc25d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:42.408687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dc29357-92f0-4656-861e-f844b32bc25d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:42.409634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dc29357-92f0-4656-861e-f844b32bc25d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:42.410784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dc29357-92f0-4656-861e-f844b32bc25d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:42.443711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7e6e469b-538e-4a56-a59a-6c8f0387db0d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:42.455024 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e6e469b-538e-4a56-a59a-6c8f0387db0d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1263 microversion: 2.1 time: 0.291461 Aug 23 17:52:42.456756 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 267/536] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:42 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1263 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:42.463723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c9ed9974-d0a3-40af-a997-17469bd74a23 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:42.468945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c9ed9974-d0a3-40af-a997-17469bd74a23 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:42.482690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9ed9974-d0a3-40af-a997-17469bd74a23 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:42.483423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9ed9974-d0a3-40af-a997-17469bd74a23 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:42.484096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9ed9974-d0a3-40af-a997-17469bd74a23 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:42.487579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9ed9974-d0a3-40af-a997-17469bd74a23 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:42.488561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9ed9974-d0a3-40af-a997-17469bd74a23 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:42.489213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9ed9974-d0a3-40af-a997-17469bd74a23 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:42.569364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1dc29357-92f0-4656-861e-f844b32bc25d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:42.601614 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1dc29357-92f0-4656-861e-f844b32bc25d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1265 microversion: 2.1 time: 0.216855 Aug 23 17:52:42.603378 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 270/537] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:42 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:42.729230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-c9ed9974-d0a3-40af-a997-17469bd74a23 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:42.873060 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c9ed9974-d0a3-40af-a997-17469bd74a23 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.412791 Aug 23 17:52:42.874259 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 268/538] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:42 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:43.183339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0ffecc53-d5c8-44a6-a0c3-79fef3218b17 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:43.184105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0ffecc53-d5c8-44a6-a0c3-79fef3218b17 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:43.195442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ffecc53-d5c8-44a6-a0c3-79fef3218b17 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:43.196059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ffecc53-d5c8-44a6-a0c3-79fef3218b17 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:43.196774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ffecc53-d5c8-44a6-a0c3-79fef3218b17 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:43.208979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ffecc53-d5c8-44a6-a0c3-79fef3218b17 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:43.214314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ffecc53-d5c8-44a6-a0c3-79fef3218b17 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:43.215863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ffecc53-d5c8-44a6-a0c3-79fef3218b17 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:43.476490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-58d6026e-2d0c-40dc-94c0-029e5f22694b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:43.477949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-58d6026e-2d0c-40dc-94c0-029e5f22694b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:43.485366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58d6026e-2d0c-40dc-94c0-029e5f22694b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:43.486907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58d6026e-2d0c-40dc-94c0-029e5f22694b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:43.487536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58d6026e-2d0c-40dc-94c0-029e5f22694b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:43.488587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58d6026e-2d0c-40dc-94c0-029e5f22694b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:43.489350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58d6026e-2d0c-40dc-94c0-029e5f22694b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:43.489984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58d6026e-2d0c-40dc-94c0-029e5f22694b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:43.491337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0ffecc53-d5c8-44a6-a0c3-79fef3218b17 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:43.513080 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0ffecc53-d5c8-44a6-a0c3-79fef3218b17 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1319 microversion: 2.1 time: 0.331073 Aug 23 17:52:43.541984 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 271/539] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:43 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1319 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:43.646921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9097d8f4-e5fc-4543-872d-29f9259d5db5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:43.648416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9097d8f4-e5fc-4543-872d-29f9259d5db5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:43.656839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9097d8f4-e5fc-4543-872d-29f9259d5db5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:43.657550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9097d8f4-e5fc-4543-872d-29f9259d5db5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:43.658143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9097d8f4-e5fc-4543-872d-29f9259d5db5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:43.665217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9097d8f4-e5fc-4543-872d-29f9259d5db5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:43.665839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9097d8f4-e5fc-4543-872d-29f9259d5db5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:43.666377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9097d8f4-e5fc-4543-872d-29f9259d5db5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:43.820285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-58d6026e-2d0c-40dc-94c0-029e5f22694b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:43.848198 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-58d6026e-2d0c-40dc-94c0-029e5f22694b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1263 microversion: 2.1 time: 0.375454 Aug 23 17:52:43.857579 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 269/540] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:43 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1263 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:43.874943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9097d8f4-e5fc-4543-872d-29f9259d5db5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:43.897969 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9097d8f4-e5fc-4543-872d-29f9259d5db5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1271 microversion: 2.1 time: 0.273053 Aug 23 17:52:43.899914 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 272/541] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:43 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1271 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:43.901474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-382cb254-9cc6-43b1-9756-c53d18bf4cc4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:43.902460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-382cb254-9cc6-43b1-9756-c53d18bf4cc4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:43.915993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-382cb254-9cc6-43b1-9756-c53d18bf4cc4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:43.916603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-382cb254-9cc6-43b1-9756-c53d18bf4cc4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:43.920649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-382cb254-9cc6-43b1-9756-c53d18bf4cc4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:43.921872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-382cb254-9cc6-43b1-9756-c53d18bf4cc4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:43.922442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-382cb254-9cc6-43b1-9756-c53d18bf4cc4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:43.923297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-382cb254-9cc6-43b1-9756-c53d18bf4cc4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:44.313867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-382cb254-9cc6-43b1-9756-c53d18bf4cc4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:44.355158 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-382cb254-9cc6-43b1-9756-c53d18bf4cc4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.458205 Aug 23 17:52:44.358357 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 270/542] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:43 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:44.553194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1194d58c-9921-4413-8d52-0a16d03d1394 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:44.554060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1194d58c-9921-4413-8d52-0a16d03d1394 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:44.568528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1194d58c-9921-4413-8d52-0a16d03d1394 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:44.570899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1194d58c-9921-4413-8d52-0a16d03d1394 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:44.574746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1194d58c-9921-4413-8d52-0a16d03d1394 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:44.575778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1194d58c-9921-4413-8d52-0a16d03d1394 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:44.577102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1194d58c-9921-4413-8d52-0a16d03d1394 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:44.577795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1194d58c-9921-4413-8d52-0a16d03d1394 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:44.874932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d715ecde-2bd7-4ffd-b8db-c867f37a0501 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:44.875428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d715ecde-2bd7-4ffd-b8db-c867f37a0501 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:44.891542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d715ecde-2bd7-4ffd-b8db-c867f37a0501 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:44.892323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d715ecde-2bd7-4ffd-b8db-c867f37a0501 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:44.893539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d715ecde-2bd7-4ffd-b8db-c867f37a0501 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:44.897082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d715ecde-2bd7-4ffd-b8db-c867f37a0501 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:44.897878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d715ecde-2bd7-4ffd-b8db-c867f37a0501 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:44.898885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d715ecde-2bd7-4ffd-b8db-c867f37a0501 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:44.929818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:45.115304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d715ecde-2bd7-4ffd-b8db-c867f37a0501 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:45.125271 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d715ecde-2bd7-4ffd-b8db-c867f37a0501 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1269 microversion: 2.1 time: 0.254304 Aug 23 17:52:45.164236 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 271/543] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:44 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1269 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:45.196614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6c604659-66e1-4624-96f0-130a39ecae7d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:45.201000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6c604659-66e1-4624-96f0-130a39ecae7d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:45.234466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c604659-66e1-4624-96f0-130a39ecae7d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:45.237532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c604659-66e1-4624-96f0-130a39ecae7d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:45.237991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c604659-66e1-4624-96f0-130a39ecae7d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:45.239775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c604659-66e1-4624-96f0-130a39ecae7d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:45.240839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c604659-66e1-4624-96f0-130a39ecae7d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:45.243249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c604659-66e1-4624-96f0-130a39ecae7d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:45.383598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1194d58c-9921-4413-8d52-0a16d03d1394 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:45.400956 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1194d58c-9921-4413-8d52-0a16d03d1394 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1319 microversion: 2.1 time: 0.851123 Aug 23 17:52:45.403585 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 273/544] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:44 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1319 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:45.422600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc593d9e-bbd8-4eb3-b7e2-0b9b74bab915 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:45.423234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc593d9e-bbd8-4eb3-b7e2-0b9b74bab915 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:45.453890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc593d9e-bbd8-4eb3-b7e2-0b9b74bab915 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:45.456944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc593d9e-bbd8-4eb3-b7e2-0b9b74bab915 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:45.457416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc593d9e-bbd8-4eb3-b7e2-0b9b74bab915 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:45.458183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc593d9e-bbd8-4eb3-b7e2-0b9b74bab915 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:45.463993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc593d9e-bbd8-4eb3-b7e2-0b9b74bab915 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:45.465006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc593d9e-bbd8-4eb3-b7e2-0b9b74bab915 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:45.659587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-bc593d9e-bbd8-4eb3-b7e2-0b9b74bab915 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:45.711510 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc593d9e-bbd8-4eb3-b7e2-0b9b74bab915 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.299599 Aug 23 17:52:45.712278 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 274/545] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:45 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:46.149911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d0044e01-c179-47d9-8709-0f993b0f6a7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:46.150532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d0044e01-c179-47d9-8709-0f993b0f6a7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:46.161336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0044e01-c179-47d9-8709-0f993b0f6a7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:46.161825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0044e01-c179-47d9-8709-0f993b0f6a7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:46.168732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0044e01-c179-47d9-8709-0f993b0f6a7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:46.172984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0044e01-c179-47d9-8709-0f993b0f6a7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:46.173476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0044e01-c179-47d9-8709-0f993b0f6a7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:46.175486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0044e01-c179-47d9-8709-0f993b0f6a7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:46.235779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c604659-66e1-4624-96f0-130a39ecae7d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:46.278126 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6c604659-66e1-4624-96f0-130a39ecae7d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1313 microversion: 2.1 time: 1.102207 Aug 23 17:52:46.285672 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 272/546] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:45 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1313 bytes in 1119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:46.426249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8e14ecf6-6ed8-426c-92a4-a825fbf6d047 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:46.427234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8e14ecf6-6ed8-426c-92a4-a825fbf6d047 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:46.442643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e14ecf6-6ed8-426c-92a4-a825fbf6d047 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:46.445265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e14ecf6-6ed8-426c-92a4-a825fbf6d047 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:46.447112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e14ecf6-6ed8-426c-92a4-a825fbf6d047 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:46.448510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e14ecf6-6ed8-426c-92a4-a825fbf6d047 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:46.450270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e14ecf6-6ed8-426c-92a4-a825fbf6d047 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:46.450891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e14ecf6-6ed8-426c-92a4-a825fbf6d047 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:46.481775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d0044e01-c179-47d9-8709-0f993b0f6a7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:46.491651 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d0044e01-c179-47d9-8709-0f993b0f6a7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1269 microversion: 2.1 time: 0.345436 Aug 23 17:52:46.496044 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 275/547] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:46 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1269 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:46.738771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d8b3c4c-ee13-4263-8d62-9794d69612d9 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:46.739398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7d8b3c4c-ee13-4263-8d62-9794d69612d9 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:46.748002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d8b3c4c-ee13-4263-8d62-9794d69612d9 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:46.750863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d8b3c4c-ee13-4263-8d62-9794d69612d9 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:46.751553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d8b3c4c-ee13-4263-8d62-9794d69612d9 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:46.755146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d8b3c4c-ee13-4263-8d62-9794d69612d9 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:46.755710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d8b3c4c-ee13-4263-8d62-9794d69612d9 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:46.756157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d8b3c4c-ee13-4263-8d62-9794d69612d9 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:46.804757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:47.038247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-7d8b3c4c-ee13-4263-8d62-9794d69612d9 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:47.077771 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7d8b3c4c-ee13-4263-8d62-9794d69612d9 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.342838 Aug 23 17:52:47.082878 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 276/548] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:46 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:52:47.304840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2662dee-91c2-462a-af00-2c91cdea8bb5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:47.305707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f2662dee-91c2-462a-af00-2c91cdea8bb5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:47.306211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8e14ecf6-6ed8-426c-92a4-a825fbf6d047 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:47.317647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2662dee-91c2-462a-af00-2c91cdea8bb5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:47.318299 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8e14ecf6-6ed8-426c-92a4-a825fbf6d047 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1319 microversion: 2.1 time: 0.898017 Aug 23 17:52:47.320622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2662dee-91c2-462a-af00-2c91cdea8bb5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:47.320888 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 273/549] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:46 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1319 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:47.323130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2662dee-91c2-462a-af00-2c91cdea8bb5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:47.324052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2662dee-91c2-462a-af00-2c91cdea8bb5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:47.324952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2662dee-91c2-462a-af00-2c91cdea8bb5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:47.328333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2662dee-91c2-462a-af00-2c91cdea8bb5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:47.515618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cc903028-928c-4438-ba8b-a7f809b1bdb8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:47.516487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cc903028-928c-4438-ba8b-a7f809b1bdb8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:47.524160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc903028-928c-4438-ba8b-a7f809b1bdb8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:47.525524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc903028-928c-4438-ba8b-a7f809b1bdb8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:47.526156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc903028-928c-4438-ba8b-a7f809b1bdb8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:47.527067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc903028-928c-4438-ba8b-a7f809b1bdb8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:47.527687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc903028-928c-4438-ba8b-a7f809b1bdb8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:47.528274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc903028-928c-4438-ba8b-a7f809b1bdb8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:48.101776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cc903028-928c-4438-ba8b-a7f809b1bdb8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:48.118220 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cc903028-928c-4438-ba8b-a7f809b1bdb8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1311 microversion: 2.1 time: 0.606155 Aug 23 17:52:48.147071 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 274/550] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:47 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1311 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:48.152681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-a497a0ed-2052-4d8b-b62b-92181c044aa6 req-7a360bd6-5a68-4ac9-9dee-ecd565e58ca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b87c54c7-d7eb-443a-b682-00663df7b2a3", "tag": "802c8a75-8773-432e-b8e4-e1714fd925b3"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:48.166274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f2662dee-91c2-462a-af00-2c91cdea8bb5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:48.184056 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f2662dee-91c2-462a-af00-2c91cdea8bb5 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1313 microversion: 2.1 time: 0.883412 Aug 23 17:52:48.188883 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 277/551] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:47 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1313 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:48.205781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3e2c4d1f-98a6-4e59-8b69-73aaef2653df tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:48.206933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a497a0ed-2052-4d8b-b62b-92181c044aa6 req-7a360bd6-5a68-4ac9-9dee-ecd565e58ca7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:48.208584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3e2c4d1f-98a6-4e59-8b69-73aaef2653df tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:48.208744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a497a0ed-2052-4d8b-b62b-92181c044aa6 req-7a360bd6-5a68-4ac9-9dee-ecd565e58ca7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:48.209378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a497a0ed-2052-4d8b-b62b-92181c044aa6 req-7a360bd6-5a68-4ac9-9dee-ecd565e58ca7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:48.228354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e2c4d1f-98a6-4e59-8b69-73aaef2653df tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:48.229161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e2c4d1f-98a6-4e59-8b69-73aaef2653df tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:48.229868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e2c4d1f-98a6-4e59-8b69-73aaef2653df tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:48.242586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e2c4d1f-98a6-4e59-8b69-73aaef2653df tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:48.247264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e2c4d1f-98a6-4e59-8b69-73aaef2653df tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:48.248540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e2c4d1f-98a6-4e59-8b69-73aaef2653df tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:48.260701 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-a497a0ed-2052-4d8b-b62b-92181c044aa6 req-7a360bd6-5a68-4ac9-9dee-ecd565e58ca7 service nova] Creating event network-changed:802c8a75-8773-432e-b8e4-e1714fd925b3 for instance b87c54c7-d7eb-443a-b682-00663df7b2a3 on n-h1-850468-16 Aug 23 17:52:48.281812 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-a497a0ed-2052-4d8b-b62b-92181c044aa6 req-7a360bd6-5a68-4ac9-9dee-ecd565e58ca7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132665 Aug 23 17:52:48.300346 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 275/552] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:48.348343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9607e7b3-591f-4d53-8cc2-38e2fb015c37 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:48.349286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9607e7b3-591f-4d53-8cc2-38e2fb015c37 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:48.363342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9607e7b3-591f-4d53-8cc2-38e2fb015c37 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:48.364388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9607e7b3-591f-4d53-8cc2-38e2fb015c37 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:48.368181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9607e7b3-591f-4d53-8cc2-38e2fb015c37 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:48.369541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9607e7b3-591f-4d53-8cc2-38e2fb015c37 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:48.369541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9607e7b3-591f-4d53-8cc2-38e2fb015c37 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:48.370247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9607e7b3-591f-4d53-8cc2-38e2fb015c37 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:48.453462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-3e2c4d1f-98a6-4e59-8b69-73aaef2653df tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:48.478708 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3e2c4d1f-98a6-4e59-8b69-73aaef2653df tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.285726 Aug 23 17:52:48.479980 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 278/553] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:48 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:48.833039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9607e7b3-591f-4d53-8cc2-38e2fb015c37 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:48.843056 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9607e7b3-591f-4d53-8cc2-38e2fb015c37 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1319 microversion: 2.1 time: 0.505035 Aug 23 17:52:48.844040 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 276/554] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:48 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1319 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:49.146630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-56aff026-4170-4cf6-ab8a-4a6718ead354 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:49.147827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-56aff026-4170-4cf6-ab8a-4a6718ead354 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:49.150272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:49.160536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56aff026-4170-4cf6-ab8a-4a6718ead354 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:49.161209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56aff026-4170-4cf6-ab8a-4a6718ead354 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:49.161828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56aff026-4170-4cf6-ab8a-4a6718ead354 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:49.162793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56aff026-4170-4cf6-ab8a-4a6718ead354 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:49.163369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56aff026-4170-4cf6-ab8a-4a6718ead354 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:49.164006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56aff026-4170-4cf6-ab8a-4a6718ead354 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:49.213429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d4d75b6e-d074-46a6-b50c-e88d4efd7133 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:49.214277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d4d75b6e-d074-46a6-b50c-e88d4efd7133 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:49.229492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4d75b6e-d074-46a6-b50c-e88d4efd7133 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:49.230753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4d75b6e-d074-46a6-b50c-e88d4efd7133 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:49.231368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4d75b6e-d074-46a6-b50c-e88d4efd7133 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:49.232261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4d75b6e-d074-46a6-b50c-e88d4efd7133 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:49.233227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4d75b6e-d074-46a6-b50c-e88d4efd7133 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:49.234003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4d75b6e-d074-46a6-b50c-e88d4efd7133 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:49.608295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d4d75b6e-d074-46a6-b50c-e88d4efd7133 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:49.624305 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d4d75b6e-d074-46a6-b50c-e88d4efd7133 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1313 microversion: 2.1 time: 0.416745 Aug 23 17:52:49.625504 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 277/555] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:49 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1313 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:49.633005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0aa24a11-e60f-4ac1-a4e8-8a0a5746d2d1 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:49.633941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0aa24a11-e60f-4ac1-a4e8-8a0a5746d2d1 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:49.641845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0aa24a11-e60f-4ac1-a4e8-8a0a5746d2d1 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:49.643706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0aa24a11-e60f-4ac1-a4e8-8a0a5746d2d1 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:49.644342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0aa24a11-e60f-4ac1-a4e8-8a0a5746d2d1 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:49.647575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0aa24a11-e60f-4ac1-a4e8-8a0a5746d2d1 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:49.648276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0aa24a11-e60f-4ac1-a4e8-8a0a5746d2d1 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:49.649914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0aa24a11-e60f-4ac1-a4e8-8a0a5746d2d1 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:49.817953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-0aa24a11-e60f-4ac1-a4e8-8a0a5746d2d1 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:49.849370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-56aff026-4170-4cf6-ab8a-4a6718ead354 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:49.864477 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0aa24a11-e60f-4ac1-a4e8-8a0a5746d2d1 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.237157 Aug 23 17:52:49.865081 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 278/556] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:49 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:49.866144 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-56aff026-4170-4cf6-ab8a-4a6718ead354 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1311 microversion: 2.1 time: 0.724652 Aug 23 17:52:49.868138 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 279/557] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:49 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1311 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:49.873829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2bc873f0-ec03-422a-bfc3-61c16c10a5d3 req-4eb7a9ca-9efb-48b6-a6de-b7240d78cef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4da944-47f7-4b06-9249-260dcdd68610", "tag": "b3bc7d2d-b6b3-4cc1-9f85-2099cfcc50c4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:49.883818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d19a8bbb-3d7f-4196-82c9-e84ad1d763bd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:49.884678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d19a8bbb-3d7f-4196-82c9-e84ad1d763bd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:49.898427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d19a8bbb-3d7f-4196-82c9-e84ad1d763bd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:49.901350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d19a8bbb-3d7f-4196-82c9-e84ad1d763bd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:49.901800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d19a8bbb-3d7f-4196-82c9-e84ad1d763bd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:49.904326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d19a8bbb-3d7f-4196-82c9-e84ad1d763bd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:49.905112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2bc873f0-ec03-422a-bfc3-61c16c10a5d3 req-4eb7a9ca-9efb-48b6-a6de-b7240d78cef1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:49.906035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d19a8bbb-3d7f-4196-82c9-e84ad1d763bd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:49.907707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d19a8bbb-3d7f-4196-82c9-e84ad1d763bd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:49.908015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2bc873f0-ec03-422a-bfc3-61c16c10a5d3 req-4eb7a9ca-9efb-48b6-a6de-b7240d78cef1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:49.912424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2bc873f0-ec03-422a-bfc3-61c16c10a5d3 req-4eb7a9ca-9efb-48b6-a6de-b7240d78cef1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:49.942625 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2bc873f0-ec03-422a-bfc3-61c16c10a5d3 req-4eb7a9ca-9efb-48b6-a6de-b7240d78cef1 service nova] Creating event network-changed:b3bc7d2d-b6b3-4cc1-9f85-2099cfcc50c4 for instance 1e4da944-47f7-4b06-9249-260dcdd68610 on n-h2-850468-16 Aug 23 17:52:49.949340 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2bc873f0-ec03-422a-bfc3-61c16c10a5d3 req-4eb7a9ca-9efb-48b6-a6de-b7240d78cef1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081522 Aug 23 17:52:49.953536 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 279/558] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:50.371708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d19a8bbb-3d7f-4196-82c9-e84ad1d763bd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:50.392357 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d19a8bbb-3d7f-4196-82c9-e84ad1d763bd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1319 microversion: 2.1 time: 0.522546 Aug 23 17:52:50.394348 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 280/559] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:49 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1319 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:50.535380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-86b6dff6-60f4-4bf5-bfd1-9db08d0c4b1c req-4760c27b-d04f-4490-aeb7-9dd015f9e808 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a97134-e24f-4d8a-bb6f-dd6370863fb9", "name": "network-vif-plugged", "status": "completed", "tag": "3b22a4b6-90a5-46af-93ec-ba8bdf0f07ae"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:50.548061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:50.583093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-86b6dff6-60f4-4bf5-bfd1-9db08d0c4b1c req-4760c27b-d04f-4490-aeb7-9dd015f9e808 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:50.584109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-86b6dff6-60f4-4bf5-bfd1-9db08d0c4b1c req-4760c27b-d04f-4490-aeb7-9dd015f9e808 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:50.584826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-86b6dff6-60f4-4bf5-bfd1-9db08d0c4b1c req-4760c27b-d04f-4490-aeb7-9dd015f9e808 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:50.624288 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-86b6dff6-60f4-4bf5-bfd1-9db08d0c4b1c req-4760c27b-d04f-4490-aeb7-9dd015f9e808 service nova] Creating event network-vif-plugged:3b22a4b6-90a5-46af-93ec-ba8bdf0f07ae for instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 on n-h2-850468-16 Aug 23 17:52:50.645413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-111c1db4-21e8-407d-a9ff-66647f8b2c73 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:50.646229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-111c1db4-21e8-407d-a9ff-66647f8b2c73 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:50.649953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=16 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:50.652956 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-86b6dff6-60f4-4bf5-bfd1-9db08d0c4b1c req-4760c27b-d04f-4490-aeb7-9dd015f9e808 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107920 Aug 23 17:52:50.655653 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 280/560] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:50.658742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-111c1db4-21e8-407d-a9ff-66647f8b2c73 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:50.659478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-111c1db4-21e8-407d-a9ff-66647f8b2c73 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:50.660098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-111c1db4-21e8-407d-a9ff-66647f8b2c73 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:50.666425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-111c1db4-21e8-407d-a9ff-66647f8b2c73 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:50.667118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-111c1db4-21e8-407d-a9ff-66647f8b2c73 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:50.667738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-111c1db4-21e8-407d-a9ff-66647f8b2c73 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:50.895756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-111c1db4-21e8-407d-a9ff-66647f8b2c73 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:50.901111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9dc7d07c-5274-4cf3-bf8e-4d636886256b tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:50.904733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9dc7d07c-5274-4cf3-bf8e-4d636886256b tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:50.907392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:50.914859 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-111c1db4-21e8-407d-a9ff-66647f8b2c73 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1313 microversion: 2.1 time: 0.273268 Aug 23 17:52:50.915448 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 281/561] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:50 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:50.934395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2519435b-25a2-4c8e-8da6-0c0c99555743 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:50.935291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2519435b-25a2-4c8e-8da6-0c0c99555743 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:50.941812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2519435b-25a2-4c8e-8da6-0c0c99555743 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:50.942534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2519435b-25a2-4c8e-8da6-0c0c99555743 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:50.943844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2519435b-25a2-4c8e-8da6-0c0c99555743 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:50.944745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2519435b-25a2-4c8e-8da6-0c0c99555743 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:50.945371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2519435b-25a2-4c8e-8da6-0c0c99555743 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:50.945949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2519435b-25a2-4c8e-8da6-0c0c99555743 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:50.947195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dc7d07c-5274-4cf3-bf8e-4d636886256b tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:50.947695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dc7d07c-5274-4cf3-bf8e-4d636886256b tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:50.948145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dc7d07c-5274-4cf3-bf8e-4d636886256b tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:50.948861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dc7d07c-5274-4cf3-bf8e-4d636886256b tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:50.949320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dc7d07c-5274-4cf3-bf8e-4d636886256b tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:50.949749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dc7d07c-5274-4cf3-bf8e-4d636886256b tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:51.164105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-9dc7d07c-5274-4cf3-bf8e-4d636886256b tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:51.197603 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9dc7d07c-5274-4cf3-bf8e-4d636886256b tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.310632 Aug 23 17:52:51.198810 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 281/562] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:50 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:51.413880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-be834954-14f1-4441-aff0-ec907f9b231c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:51.414720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-be834954-14f1-4441-aff0-ec907f9b231c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:51.424990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be834954-14f1-4441-aff0-ec907f9b231c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:51.425691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be834954-14f1-4441-aff0-ec907f9b231c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:51.426282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be834954-14f1-4441-aff0-ec907f9b231c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:51.427531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be834954-14f1-4441-aff0-ec907f9b231c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:51.429178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be834954-14f1-4441-aff0-ec907f9b231c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:51.430566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be834954-14f1-4441-aff0-ec907f9b231c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:51.563040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2519435b-25a2-4c8e-8da6-0c0c99555743 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:51.572422 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2519435b-25a2-4c8e-8da6-0c0c99555743 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1311 microversion: 2.1 time: 0.643925 Aug 23 17:52:51.573597 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 282/563] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:50 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1311 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:51.850352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-be834954-14f1-4441-aff0-ec907f9b231c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:51.863042 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-be834954-14f1-4441-aff0-ec907f9b231c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1319 microversion: 2.1 time: 0.452994 Aug 23 17:52:51.866504 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 282/564] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:51 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1319 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:51.944258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-396573dc-e697-4c6f-90d7-3735b7985536 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:51.945064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-396573dc-e697-4c6f-90d7-3735b7985536 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:51.961338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-396573dc-e697-4c6f-90d7-3735b7985536 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:51.965409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-396573dc-e697-4c6f-90d7-3735b7985536 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:51.967319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-396573dc-e697-4c6f-90d7-3735b7985536 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:51.968179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-396573dc-e697-4c6f-90d7-3735b7985536 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:51.971694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-396573dc-e697-4c6f-90d7-3735b7985536 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:51.974817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-396573dc-e697-4c6f-90d7-3735b7985536 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:52.230184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c88fa8c-d750-4cae-8e03-ba3b4665f362 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:52.230848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0c88fa8c-d750-4cae-8e03-ba3b4665f362 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:52.239341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c88fa8c-d750-4cae-8e03-ba3b4665f362 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:52.240024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c88fa8c-d750-4cae-8e03-ba3b4665f362 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:52.240720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c88fa8c-d750-4cae-8e03-ba3b4665f362 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:52.241589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c88fa8c-d750-4cae-8e03-ba3b4665f362 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:52.242192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c88fa8c-d750-4cae-8e03-ba3b4665f362 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:52.242795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c88fa8c-d750-4cae-8e03-ba3b4665f362 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:52.495399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-0c88fa8c-d750-4cae-8e03-ba3b4665f362 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:52.542975 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c88fa8c-d750-4cae-8e03-ba3b4665f362 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.322228 Aug 23 17:52:52.545164 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 283/565] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:52 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:52.602876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c45edf9-34bc-43f4-8cb9-5b3d48190f57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:52.603900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5c45edf9-34bc-43f4-8cb9-5b3d48190f57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:52.613224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c45edf9-34bc-43f4-8cb9-5b3d48190f57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:52.614112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c45edf9-34bc-43f4-8cb9-5b3d48190f57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:52.615063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c45edf9-34bc-43f4-8cb9-5b3d48190f57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:52.616319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c45edf9-34bc-43f4-8cb9-5b3d48190f57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:52.617031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c45edf9-34bc-43f4-8cb9-5b3d48190f57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:52.617687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c45edf9-34bc-43f4-8cb9-5b3d48190f57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:52.785793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-396573dc-e697-4c6f-90d7-3735b7985536 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:52.802284 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-396573dc-e697-4c6f-90d7-3735b7985536 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1313 microversion: 2.1 time: 0.857780 Aug 23 17:52:52.806881 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 283/566] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:51 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1313 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:52.891072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9cc1c272-80bb-4515-b201-4d955869c203 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:52.892081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9cc1c272-80bb-4515-b201-4d955869c203 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:52.910723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cc1c272-80bb-4515-b201-4d955869c203 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:52.911487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cc1c272-80bb-4515-b201-4d955869c203 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:52.912276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cc1c272-80bb-4515-b201-4d955869c203 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:52.913347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cc1c272-80bb-4515-b201-4d955869c203 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:52.914016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cc1c272-80bb-4515-b201-4d955869c203 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:52.914812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cc1c272-80bb-4515-b201-4d955869c203 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:53.283961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9cc1c272-80bb-4515-b201-4d955869c203 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:53.314107 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9cc1c272-80bb-4515-b201-4d955869c203 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1319 microversion: 2.1 time: 0.429881 Aug 23 17:52:53.315524 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 284/567] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:52 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1319 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:53.342700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5c45edf9-34bc-43f4-8cb9-5b3d48190f57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:53.358573 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5c45edf9-34bc-43f4-8cb9-5b3d48190f57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1311 microversion: 2.1 time: 0.768767 Aug 23 17:52:53.365933 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 284/568] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:52 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1311 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:52:53.600000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d2a32ef-3fbc-41a0-84db-cbf9ec7bb531 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:53.600630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8d2a32ef-3fbc-41a0-84db-cbf9ec7bb531 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:53.610083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d2a32ef-3fbc-41a0-84db-cbf9ec7bb531 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:53.610815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d2a32ef-3fbc-41a0-84db-cbf9ec7bb531 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:53.611075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d2a32ef-3fbc-41a0-84db-cbf9ec7bb531 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:53.621316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d2a32ef-3fbc-41a0-84db-cbf9ec7bb531 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:53.622700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d2a32ef-3fbc-41a0-84db-cbf9ec7bb531 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:53.623323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d2a32ef-3fbc-41a0-84db-cbf9ec7bb531 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:53.832186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c5e2b53b-f951-405f-858a-c3a3822ed8cf tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:53.832666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c5e2b53b-f951-405f-858a-c3a3822ed8cf tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:53.853020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5e2b53b-f951-405f-858a-c3a3822ed8cf tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:53.853536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5e2b53b-f951-405f-858a-c3a3822ed8cf tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:53.853982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5e2b53b-f951-405f-858a-c3a3822ed8cf tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:53.861517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5e2b53b-f951-405f-858a-c3a3822ed8cf tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:53.862831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5e2b53b-f951-405f-858a-c3a3822ed8cf tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:53.865102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5e2b53b-f951-405f-858a-c3a3822ed8cf tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:53.875730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-8d2a32ef-3fbc-41a0-84db-cbf9ec7bb531 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:53.920543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:53.922322 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8d2a32ef-3fbc-41a0-84db-cbf9ec7bb531 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.327543 Aug 23 17:52:53.926867 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 285/569] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:53 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:54.188917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c5e2b53b-f951-405f-858a-c3a3822ed8cf tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:54.203057 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c5e2b53b-f951-405f-858a-c3a3822ed8cf tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1313 microversion: 2.1 time: 0.376178 Aug 23 17:52:54.207138 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 285/570] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:53 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:54.337832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d83d7c8d-43d6-4848-b77d-1a1e034595e7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:54.338449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d83d7c8d-43d6-4848-b77d-1a1e034595e7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:54.356611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d83d7c8d-43d6-4848-b77d-1a1e034595e7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:54.357138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d83d7c8d-43d6-4848-b77d-1a1e034595e7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:54.357586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d83d7c8d-43d6-4848-b77d-1a1e034595e7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:54.358311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d83d7c8d-43d6-4848-b77d-1a1e034595e7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:54.361077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d83d7c8d-43d6-4848-b77d-1a1e034595e7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:54.362911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d83d7c8d-43d6-4848-b77d-1a1e034595e7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:54.382371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8d1c6f65-e364-4cb9-ac41-49ea7ec22435 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:54.383971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8d1c6f65-e364-4cb9-ac41-49ea7ec22435 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:54.393763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d1c6f65-e364-4cb9-ac41-49ea7ec22435 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:54.394763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d1c6f65-e364-4cb9-ac41-49ea7ec22435 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:54.395418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d1c6f65-e364-4cb9-ac41-49ea7ec22435 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:54.396781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d1c6f65-e364-4cb9-ac41-49ea7ec22435 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:54.397509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d1c6f65-e364-4cb9-ac41-49ea7ec22435 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:54.398013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d1c6f65-e364-4cb9-ac41-49ea7ec22435 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:54.681726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8d1c6f65-e364-4cb9-ac41-49ea7ec22435 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:54.691866 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8d1c6f65-e364-4cb9-ac41-49ea7ec22435 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1311 microversion: 2.1 time: 0.315424 Aug 23 17:52:54.692783 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 286/571] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:54 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1311 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:54.952618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff6ed85d-f0b8-4bfb-91e5-e277833915ea tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:54.953302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff6ed85d-f0b8-4bfb-91e5-e277833915ea tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:54.980724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff6ed85d-f0b8-4bfb-91e5-e277833915ea tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:54.981206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff6ed85d-f0b8-4bfb-91e5-e277833915ea tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:54.981649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff6ed85d-f0b8-4bfb-91e5-e277833915ea tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:54.982348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff6ed85d-f0b8-4bfb-91e5-e277833915ea tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:54.990836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff6ed85d-f0b8-4bfb-91e5-e277833915ea tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:54.992278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff6ed85d-f0b8-4bfb-91e5-e277833915ea tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:55.133198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-ff6ed85d-f0b8-4bfb-91e5-e277833915ea tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:55.185082 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff6ed85d-f0b8-4bfb-91e5-e277833915ea tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.237657 Aug 23 17:52:55.188764 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 287/572] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:54 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:52:55.227740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d83d7c8d-43d6-4848-b77d-1a1e034595e7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:55.239911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3f2e8a25-45a2-4e38-af79-cfff8d746deb tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:55.240649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3f2e8a25-45a2-4e38-af79-cfff8d746deb tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:55.258572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f2e8a25-45a2-4e38-af79-cfff8d746deb tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:55.262180 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d83d7c8d-43d6-4848-b77d-1a1e034595e7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1319 microversion: 2.1 time: 0.928445 Aug 23 17:52:55.270887 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 286/573] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:54 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1319 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:55.271410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f2e8a25-45a2-4e38-af79-cfff8d746deb tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:55.271896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f2e8a25-45a2-4e38-af79-cfff8d746deb tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:55.272704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f2e8a25-45a2-4e38-af79-cfff8d746deb tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:55.273175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f2e8a25-45a2-4e38-af79-cfff8d746deb tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:55.273601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f2e8a25-45a2-4e38-af79-cfff8d746deb tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:55.519567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9264a893-61b6-4349-a473-bcb6a039275f tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] Calling method '.version_select at 0x7f27ecfadee0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:55.546575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9264a893-61b6-4349-a473-bcb6a039275f tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:55.549077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9264a893-61b6-4349-a473-bcb6a039275f tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:55.551895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9264a893-61b6-4349-a473-bcb6a039275f tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:55.554291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9264a893-61b6-4349-a473-bcb6a039275f tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:55.557820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9264a893-61b6-4349-a473-bcb6a039275f tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:55.558663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9264a893-61b6-4349-a473-bcb6a039275f tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:55.604184 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9264a893-61b6-4349-a473-bcb6a039275f tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] 10.222.0.61 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.261192 Aug 23 17:52:55.619534 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 287/574] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 17:52:55 2022] GET /compute/v2.1/limits => generated 511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:52:55.712738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ba3516f6-b79f-4727-ab1c-85d0dfed0bb2 tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1576968956", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:55.748989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3f2e8a25-45a2-4e38-af79-cfff8d746deb tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:55.753852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:55.774863 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3f2e8a25-45a2-4e38-af79-cfff8d746deb tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1313 microversion: 2.1 time: 0.551712 Aug 23 17:52:55.782597 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 288/575] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:55 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1313 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:55.785569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ffa7574d-4c3c-4c6e-af39-590023958418 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:55.786188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ffa7574d-4c3c-4c6e-af39-590023958418 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:55.802917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-ba3516f6-b79f-4727-ab1c-85d0dfed0bb2 tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:52:55.818446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ffa7574d-4c3c-4c6e-af39-590023958418 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:55.819163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ffa7574d-4c3c-4c6e-af39-590023958418 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:55.819770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ffa7574d-4c3c-4c6e-af39-590023958418 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:55.820685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ffa7574d-4c3c-4c6e-af39-590023958418 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:55.821330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ffa7574d-4c3c-4c6e-af39-590023958418 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:55.821964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ffa7574d-4c3c-4c6e-af39-590023958418 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:56.104111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ffa7574d-4c3c-4c6e-af39-590023958418 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:56.116563 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ffa7574d-4c3c-4c6e-af39-590023958418 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1311 microversion: 2.1 time: 0.337159 Aug 23 17:52:56.118452 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 289/576] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:55 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1311 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:56.219752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aa959a21-3385-4b43-98b0-01fe9565d196 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:56.221293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aa959a21-3385-4b43-98b0-01fe9565d196 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:56.235710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa959a21-3385-4b43-98b0-01fe9565d196 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:56.238935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa959a21-3385-4b43-98b0-01fe9565d196 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:56.239656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa959a21-3385-4b43-98b0-01fe9565d196 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:56.241166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa959a21-3385-4b43-98b0-01fe9565d196 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:56.243189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa959a21-3385-4b43-98b0-01fe9565d196 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:56.243852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa959a21-3385-4b43-98b0-01fe9565d196 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:56.365766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-aa959a21-3385-4b43-98b0-01fe9565d196 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:56.404556 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aa959a21-3385-4b43-98b0-01fe9565d196 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.192408 Aug 23 17:52:56.405841 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 290/577] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:56 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:56.411667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-777d1041-a252-4177-8d7d-4424f49274fd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:56.414841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-777d1041-a252-4177-8d7d-4424f49274fd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:56.456783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-777d1041-a252-4177-8d7d-4424f49274fd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:56.462296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-777d1041-a252-4177-8d7d-4424f49274fd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:56.463813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-777d1041-a252-4177-8d7d-4424f49274fd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:56.476024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-777d1041-a252-4177-8d7d-4424f49274fd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:56.476816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-777d1041-a252-4177-8d7d-4424f49274fd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:56.480719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-777d1041-a252-4177-8d7d-4424f49274fd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:56.662696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-777d1041-a252-4177-8d7d-4424f49274fd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:56.671248 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-777d1041-a252-4177-8d7d-4424f49274fd tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1469 microversion: 2.1 time: 0.264019 Aug 23 17:52:56.671827 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 291/578] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:56 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1469 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:56.677546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-fcf75f9c-8048-4e0b-8a6d-24efbfa1b992 req-c974da08-9004-4c47-866f-dec793500df1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87c54c7-d7eb-443a-b682-00663df7b2a3", "name": "network-vif-plugged", "status": "completed", "tag": "802c8a75-8773-432e-b8e4-e1714fd925b3"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:56.687591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fcf75f9c-8048-4e0b-8a6d-24efbfa1b992 req-c974da08-9004-4c47-866f-dec793500df1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:56.688410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fcf75f9c-8048-4e0b-8a6d-24efbfa1b992 req-c974da08-9004-4c47-866f-dec793500df1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:56.688906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fcf75f9c-8048-4e0b-8a6d-24efbfa1b992 req-c974da08-9004-4c47-866f-dec793500df1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:56.702476 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-fcf75f9c-8048-4e0b-8a6d-24efbfa1b992 req-c974da08-9004-4c47-866f-dec793500df1 service nova] Creating event network-vif-plugged:802c8a75-8773-432e-b8e4-e1714fd925b3 for instance b87c54c7-d7eb-443a-b682-00663df7b2a3 on n-h1-850468-16 Aug 23 17:52:56.708560 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-fcf75f9c-8048-4e0b-8a6d-24efbfa1b992 req-c974da08-9004-4c47-866f-dec793500df1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035244 Aug 23 17:52:56.709716 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 292/579] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:56.715703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b0c2c214-4c45-4a7b-a0c7-3e292c1d49c7 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:56.716808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b0c2c214-4c45-4a7b-a0c7-3e292c1d49c7 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:56.739695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0c2c214-4c45-4a7b-a0c7-3e292c1d49c7 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:56.740207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0c2c214-4c45-4a7b-a0c7-3e292c1d49c7 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:56.744341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0c2c214-4c45-4a7b-a0c7-3e292c1d49c7 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:56.745475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0c2c214-4c45-4a7b-a0c7-3e292c1d49c7 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:56.747209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0c2c214-4c45-4a7b-a0c7-3e292c1d49c7 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:56.763229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0c2c214-4c45-4a7b-a0c7-3e292c1d49c7 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:56.813955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-b0c2c214-4c45-4a7b-a0c7-3e292c1d49c7 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lazy-loading 'flavor' on Instance uuid e7a97134-e24f-4d8a-bb6f-dd6370863fb9 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:56.945674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ba3516f6-b79f-4727-ab1c-85d0dfed0bb2 tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] Getting quotas for project 48e16aa3f4584109b739e1387f386270. Resources: dict_keys(['metadata_items']) {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:52:56.961884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ba3516f6-b79f-4727-ab1c-85d0dfed0bb2 tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] Getting quotas for user af118cd930ca48618494ed9f4d73d713 and project 48e16aa3f4584109b739e1387f386270. Resources: dict_keys(['metadata_items']) {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:52:56.978337 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-ba3516f6-b79f-4727-ab1c-85d0dfed0bb2 tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ba3516f6-b79f-4727-ab1c-85d0dfed0bb2 tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] Request method failure captured: Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 1752 Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRP3oS9IZuQlsyJST5xN5vT9X0CSdgllwOd8Vv8qjlK7XForRnmYCAc9OTtbEGJmrjdqlxiIHnyYlCz-giU2mkE31Zse-435QuAEM55-WOdXNesb9HM34buQHAQrzbddosyNNfpxpEz-8L5CcdIYKbLTGmTvyKPH5U2HZDeptAdUeIs Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 48e16aa3f4584109b739e1387f386270 Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-341384684 Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_48e16aa3f4584109b739e1387f386270"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/48e16aa3f4584109b739e1387f386270"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/48e16aa3f4584109b739e1387f386270"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/48e16aa3f4584109b739e1387f386270"}]}] Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-341384684 Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 48e16aa3f4584109b739e1387f386270 Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-341384684 Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-341384684-project Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: af118cd930ca48618494ed9f4d73d713 Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-341384684-project Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1576968956", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:52:56.981824 n-d-850468-16 devstack@n-api.service[128808]: exception: Maximum number of metadata items exceeds 128 Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1576968956', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 463, in _check_metadata_properties_quota Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1003, in _checks_for_create_and_rebuild Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 470, in _check_metadata_properties_quota Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:56.984101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Aug 23 17:52:56.987754 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:52:56.991058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ba3516f6-b79f-4727-ab1c-85d0dfed0bb2 tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:56.992441 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ba3516f6-b79f-4727-ab1c-85d0dfed0bb2 tempest-AbsoluteLimitsNegativeTestJSON-341384684 tempest-AbsoluteLimitsNegativeTestJSON-341384684-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 1.284882 Aug 23 17:52:56.993609 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 288/580] 10.222.0.61 () {60 vars in 1148 bytes} [Tue Aug 23 17:52:55 2022] POST /compute/v2.1/servers => generated 87 bytes in 1287 msecs (HTTP/1.1 403) 9 headers in 378 bytes (2 switches on core 0) Aug 23 17:52:57.003617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6956fb43-65ee-4add-a1c4-0d51fb35a6b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:57.004638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6956fb43-65ee-4add-a1c4-0d51fb35a6b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:57.011323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6956fb43-65ee-4add-a1c4-0d51fb35a6b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:57.012087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6956fb43-65ee-4add-a1c4-0d51fb35a6b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:57.012762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6956fb43-65ee-4add-a1c4-0d51fb35a6b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:57.013714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6956fb43-65ee-4add-a1c4-0d51fb35a6b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:57.014378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6956fb43-65ee-4add-a1c4-0d51fb35a6b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:57.015101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6956fb43-65ee-4add-a1c4-0d51fb35a6b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:57.034050 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b0c2c214-4c45-4a7b-a0c7-3e292c1d49c7 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9/action" status: 202 len: 0 microversion: 2.1 time: 0.319349 Aug 23 17:52:57.034380 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 293/581] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:52:56 2022] POST /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:52:57.058766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-018aede3-4c93-4b5a-9bdf-ab835fd8a4ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:57.059495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-018aede3-4c93-4b5a-9bdf-ab835fd8a4ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:57.067809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-018aede3-4c93-4b5a-9bdf-ab835fd8a4ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:57.068640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-018aede3-4c93-4b5a-9bdf-ab835fd8a4ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:57.069303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-018aede3-4c93-4b5a-9bdf-ab835fd8a4ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:57.070458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-018aede3-4c93-4b5a-9bdf-ab835fd8a4ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:57.071148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-018aede3-4c93-4b5a-9bdf-ab835fd8a4ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:57.071782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-018aede3-4c93-4b5a-9bdf-ab835fd8a4ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:57.277353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-018aede3-4c93-4b5a-9bdf-ab835fd8a4ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:57.289659 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-018aede3-4c93-4b5a-9bdf-ab835fd8a4ce tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1477 microversion: 2.1 time: 0.236334 Aug 23 17:52:57.302569 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 294/582] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:57 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1477 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:57.303086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-af60472b-3841-4429-ae21-238586a727b9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:57.304347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-af60472b-3841-4429-ae21-238586a727b9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:57.317110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af60472b-3841-4429-ae21-238586a727b9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:57.317458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af60472b-3841-4429-ae21-238586a727b9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:57.317900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af60472b-3841-4429-ae21-238586a727b9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:57.318687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af60472b-3841-4429-ae21-238586a727b9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:57.319139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af60472b-3841-4429-ae21-238586a727b9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:57.322698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af60472b-3841-4429-ae21-238586a727b9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:57.459594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6956fb43-65ee-4add-a1c4-0d51fb35a6b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:57.468239 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6956fb43-65ee-4add-a1c4-0d51fb35a6b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1313 microversion: 2.1 time: 0.473364 Aug 23 17:52:57.473746 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 289/583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:56 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1313 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:57.480999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6d68255d-f013-4133-8254-fa5a4acb0db3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:57.481907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6d68255d-f013-4133-8254-fa5a4acb0db3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:57.495613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d68255d-f013-4133-8254-fa5a4acb0db3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:57.497228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d68255d-f013-4133-8254-fa5a4acb0db3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:57.502461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d68255d-f013-4133-8254-fa5a4acb0db3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:57.503826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d68255d-f013-4133-8254-fa5a4acb0db3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:57.506419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d68255d-f013-4133-8254-fa5a4acb0db3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:57.507068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d68255d-f013-4133-8254-fa5a4acb0db3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:57.511596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-af60472b-3841-4429-ae21-238586a727b9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:57.524515 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-af60472b-3841-4429-ae21-238586a727b9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1311 microversion: 2.1 time: 0.229898 Aug 23 17:52:57.527173 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 295/584] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:57 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1311 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:57.685490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-6d68255d-f013-4133-8254-fa5a4acb0db3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:57.714802 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6d68255d-f013-4133-8254-fa5a4acb0db3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.238089 Aug 23 17:52:57.716159 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 290/585] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:57 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:58.313201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3405bc90-bd97-44ca-894a-9d232bd2728e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:58.313825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3405bc90-bd97-44ca-894a-9d232bd2728e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:58.326757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3405bc90-bd97-44ca-894a-9d232bd2728e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:58.327266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3405bc90-bd97-44ca-894a-9d232bd2728e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:58.327718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3405bc90-bd97-44ca-894a-9d232bd2728e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:58.328447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3405bc90-bd97-44ca-894a-9d232bd2728e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:58.328909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3405bc90-bd97-44ca-894a-9d232bd2728e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:58.329344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3405bc90-bd97-44ca-894a-9d232bd2728e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:58.496285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-540c98c6-2ad6-4e81-b27f-9eba9f35913a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:58.498063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-540c98c6-2ad6-4e81-b27f-9eba9f35913a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:58.520932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-540c98c6-2ad6-4e81-b27f-9eba9f35913a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:58.521575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-540c98c6-2ad6-4e81-b27f-9eba9f35913a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:58.522039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-540c98c6-2ad6-4e81-b27f-9eba9f35913a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:58.531195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-540c98c6-2ad6-4e81-b27f-9eba9f35913a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:58.531755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-540c98c6-2ad6-4e81-b27f-9eba9f35913a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:58.534763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-540c98c6-2ad6-4e81-b27f-9eba9f35913a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:58.768426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3405bc90-bd97-44ca-894a-9d232bd2728e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:58.779594 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3405bc90-bd97-44ca-894a-9d232bd2728e tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1460 microversion: 2.1 time: 0.470071 Aug 23 17:52:58.782022 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 296/586] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:58 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1460 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:58.792683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ff5f1e3-adea-4e78-a5cc-a324fc345947 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:58.795975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2ff5f1e3-adea-4e78-a5cc-a324fc345947 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:58.807807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff5f1e3-adea-4e78-a5cc-a324fc345947 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:58.809758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff5f1e3-adea-4e78-a5cc-a324fc345947 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:58.810450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff5f1e3-adea-4e78-a5cc-a324fc345947 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:58.811807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff5f1e3-adea-4e78-a5cc-a324fc345947 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:58.812474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff5f1e3-adea-4e78-a5cc-a324fc345947 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:58.813196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff5f1e3-adea-4e78-a5cc-a324fc345947 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.007782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-540c98c6-2ad6-4e81-b27f-9eba9f35913a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:59.020318 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-540c98c6-2ad6-4e81-b27f-9eba9f35913a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1463 microversion: 2.1 time: 0.529264 Aug 23 17:52:59.021855 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 291/587] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:58 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1463 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:59.027415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-da703a87-745b-48c9-b6c6-182583f39219 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:59.028028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-da703a87-745b-48c9-b6c6-182583f39219 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:59.038008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da703a87-745b-48c9-b6c6-182583f39219 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.038589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da703a87-745b-48c9-b6c6-182583f39219 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.039001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da703a87-745b-48c9-b6c6-182583f39219 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.040083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da703a87-745b-48c9-b6c6-182583f39219 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.041073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da703a87-745b-48c9-b6c6-182583f39219 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.042590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da703a87-745b-48c9-b6c6-182583f39219 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.141374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2ff5f1e3-adea-4e78-a5cc-a324fc345947 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:52:59.154699 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2ff5f1e3-adea-4e78-a5cc-a324fc345947 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1311 microversion: 2.1 time: 0.366235 Aug 23 17:52:59.156556 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 297/588] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:58 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1311 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:59.175039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a3e84753-7cff-4bb7-8ee3-6e316e119534 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:59.175655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a3e84753-7cff-4bb7-8ee3-6e316e119534 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:59.182648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e84753-7cff-4bb7-8ee3-6e316e119534 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.184078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e84753-7cff-4bb7-8ee3-6e316e119534 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.184713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e84753-7cff-4bb7-8ee3-6e316e119534 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.185726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e84753-7cff-4bb7-8ee3-6e316e119534 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.186369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e84753-7cff-4bb7-8ee3-6e316e119534 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.187050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e84753-7cff-4bb7-8ee3-6e316e119534 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.332174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-da703a87-745b-48c9-b6c6-182583f39219 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:59.355613 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-da703a87-745b-48c9-b6c6-182583f39219 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.331732 Aug 23 17:52:59.372533 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 292/589] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:52:59 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:52:59.525192 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a3e84753-7cff-4bb7-8ee3-6e316e119534 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1613 microversion: 2.1 time: 0.363950 Aug 23 17:52:59.542142 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 298/590] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:52:59 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1613 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:52:59.551267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a8a83756-d48e-4f09-ba5f-d0c5e1a0c126 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:59.555695 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:52:59.555695 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:52:59.557164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8a83756-d48e-4f09-ba5f-d0c5e1a0c126 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.557869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8a83756-d48e-4f09-ba5f-d0c5e1a0c126 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.558460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8a83756-d48e-4f09-ba5f-d0c5e1a0c126 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.559393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8a83756-d48e-4f09-ba5f-d0c5e1a0c126 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.560039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8a83756-d48e-4f09-ba5f-d0c5e1a0c126 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.560902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8a83756-d48e-4f09-ba5f-d0c5e1a0c126 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.597960 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a8a83756-d48e-4f09-ba5f-d0c5e1a0c126 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.054215 Aug 23 17:52:59.599320 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 299/591] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Aug 23 17:52:59 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:52:59.621527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-16", "block_migration": true, "disk_over_commit": false}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:59.628307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:59.649982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.650507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.650976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.651731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.658630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.659840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.731376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-86ed05fa-535a-4280-8eaa-56e791925bfd tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:59.738189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-86ed05fa-535a-4280-8eaa-56e791925bfd tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Searching by: {'deleted': False, 'project_id': '46be13d1a0a847499a1efbd16157c012'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:52:59.744673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86ed05fa-535a-4280-8eaa-56e791925bfd tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.745392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86ed05fa-535a-4280-8eaa-56e791925bfd tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.746024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86ed05fa-535a-4280-8eaa-56e791925bfd tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.747035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86ed05fa-535a-4280-8eaa-56e791925bfd tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.747640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86ed05fa-535a-4280-8eaa-56e791925bfd tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.748217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86ed05fa-535a-4280-8eaa-56e791925bfd tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.826144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Lazy-loading 'flavor' on Instance uuid e7a97134-e24f-4d8a-bb6f-dd6370863fb9 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:52:59.851926 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 while it is in vm_state suspended Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Request method failure captured: Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9/action HTTP/1.1 Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 98 Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPCkjmyhKomw_Dk81zx_pzuNulvytvGuBTkM026ACwiSgpNOys4ZfBDKudc1QL2qyKitQgjRi-YqtQc8V3wun24za_jT9qTKHR9A6Vw3wyVahmXdcLJ2y_j8A6ssCu1c8g_1hIARiAWKEfh2iv5Ti0Bonc8SqFqyYGHN-rptQco7z0 Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 3b2c3c5087ae40ffa520716843684824 Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-LiveMigrationNegativeTest-2085558247 Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3b2c3c5087ae40ffa520716843684824"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3b2c3c5087ae40ffa520716843684824"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3b2c3c5087ae40ffa520716843684824"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3b2c3c5087ae40ffa520716843684824"}]}] Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-LiveMigrationNegativeTest-2085558247 Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 3b2c3c5087ae40ffa520716843684824 Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-2085558247 Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-LiveMigrationNegativeTest-2085558247-project-admin Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: c68b735b7bbd4b42aefee51f78b6ba59 Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-LiveMigrationNegativeTest-2085558247-project-admin Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: {"os-migrateLive": {"host": "n-h1-850468-16", "block_migration": true, "disk_over_commit": false}} Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: exception: Cannot 'os-migrateLive' instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 while it is in vm_state suspended Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'e7a97134-e24f-4d8a-bb6f-dd6370863fb9', 'body': {'os-migrateLive': {'host': 'n-h1-850468-16', 'block_migration': True, 'disk_over_commit': False}}} Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 in vm_state suspended. Cannot live_migrate while the instance is in this state. Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:59.856195 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 while it is in vm_state suspended Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 while it is in vm_state suspended Aug 23 17:52:59.860374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:52:59.866567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 while it is in vm_state suspended {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:52:59.868169 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c7bbff78-27e0-42b7-8976-405015914061 tempest-LiveMigrationNegativeTest-2085558247 tempest-LiveMigrationNegativeTest-2085558247-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9/action" status: 409 len: 155 microversion: 2.1 time: 0.260408 Aug 23 17:52:59.869241 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 300/592] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:52:59 2022] POST /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9/action => generated 155 bytes in 262 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:52:59.882639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5ee1013-ca18-4cef-a304-dc6ff87838a8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:52:59.883334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a5ee1013-ca18-4cef-a304-dc6ff87838a8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:52:59.887991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:52:59.891554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5ee1013-ca18-4cef-a304-dc6ff87838a8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.892965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5ee1013-ca18-4cef-a304-dc6ff87838a8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.893934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5ee1013-ca18-4cef-a304-dc6ff87838a8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.895059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5ee1013-ca18-4cef-a304-dc6ff87838a8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.896558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5ee1013-ca18-4cef-a304-dc6ff87838a8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.897979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5ee1013-ca18-4cef-a304-dc6ff87838a8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.943411 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-86ed05fa-535a-4280-8eaa-56e791925bfd tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.569362 Aug 23 17:52:59.951591 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 293/593] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:52:59 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:52:59.958370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a5ee1013-ca18-4cef-a304-dc6ff87838a8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:52:59.965030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-288e88b1-eedb-4a15-a662-586ac6feef52 req-4ab4f4f9-07e3-49d7-93c4-9b51ec7795d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4da944-47f7-4b06-9249-260dcdd68610", "name": "network-vif-plugged", "status": "completed", "tag": "b3bc7d2d-b6b3-4cc1-9f85-2099cfcc50c4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:52:59.978101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-288e88b1-eedb-4a15-a662-586ac6feef52 req-4ab4f4f9-07e3-49d7-93c4-9b51ec7795d3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:52:59.979616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-288e88b1-eedb-4a15-a662-586ac6feef52 req-4ab4f4f9-07e3-49d7-93c4-9b51ec7795d3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:52:59.980284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-288e88b1-eedb-4a15-a662-586ac6feef52 req-4ab4f4f9-07e3-49d7-93c4-9b51ec7795d3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:52:59.995296 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-288e88b1-eedb-4a15-a662-586ac6feef52 req-4ab4f4f9-07e3-49d7-93c4-9b51ec7795d3 service nova] Creating event network-vif-plugged:b3bc7d2d-b6b3-4cc1-9f85-2099cfcc50c4 for instance 1e4da944-47f7-4b06-9249-260dcdd68610 on n-h2-850468-16 Aug 23 17:53:00.002186 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-288e88b1-eedb-4a15-a662-586ac6feef52 req-4ab4f4f9-07e3-49d7-93c4-9b51ec7795d3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040103 Aug 23 17:53:00.003636 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 294/594] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:52:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:00.009190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:00.019775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Searching by: {'deleted': False} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:53:00.038957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:00.041349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:00.041814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:00.044112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:00.049636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:00.052387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:00.133196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:00.157984 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a5ee1013-ca18-4cef-a304-dc6ff87838a8 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 204 len: 0 microversion: 2.1 time: 0.280480 Aug 23 17:53:00.159026 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 301/595] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:52:59 2022] DELETE /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:53:00.168367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-359ffb13-8e42-4703-9132-498000bbf371 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:00.169089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-359ffb13-8e42-4703-9132-498000bbf371 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:00.185133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-359ffb13-8e42-4703-9132-498000bbf371 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:00.185626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-359ffb13-8e42-4703-9132-498000bbf371 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:00.186070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-359ffb13-8e42-4703-9132-498000bbf371 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:00.191185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-359ffb13-8e42-4703-9132-498000bbf371 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:00.191835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-359ffb13-8e42-4703-9132-498000bbf371 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:00.192291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-359ffb13-8e42-4703-9132-498000bbf371 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:00.326635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Listed batch of 8 results from cell out of 1000 limit. Returned 8 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:53:00.776307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-359ffb13-8e42-4703-9132-498000bbf371 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:00.788283 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-359ffb13-8e42-4703-9132-498000bbf371 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1466 microversion: 2.1 time: 0.624700 Aug 23 17:53:00.789179 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 302/596] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:00 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1466 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:00.806453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-27270f8d-d2ac-4c0d-bb6d-604ae4a73f0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:00.807532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-27270f8d-d2ac-4c0d-bb6d-604ae4a73f0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:00.815499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27270f8d-d2ac-4c0d-bb6d-604ae4a73f0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:00.820934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:00.822019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:00.822172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27270f8d-d2ac-4c0d-bb6d-604ae4a73f0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:00.822593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27270f8d-d2ac-4c0d-bb6d-604ae4a73f0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:00.823069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:00.823398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27270f8d-d2ac-4c0d-bb6d-604ae4a73f0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:00.823856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27270f8d-d2ac-4c0d-bb6d-604ae4a73f0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:00.824277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27270f8d-d2ac-4c0d-bb6d-604ae4a73f0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:00.828683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:01.516485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-27270f8d-d2ac-4c0d-bb6d-604ae4a73f0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:01.528947 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-27270f8d-d2ac-4c0d-bb6d-604ae4a73f0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1311 microversion: 2.1 time: 0.738231 Aug 23 17:53:01.529877 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 303/597] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:00 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1311 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:01.535691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-00ea0da3-a257-41af-a830-bf749953b2a5 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:01.536723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-00ea0da3-a257-41af-a830-bf749953b2a5 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:01.544338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00ea0da3-a257-41af-a830-bf749953b2a5 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:01.545158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00ea0da3-a257-41af-a830-bf749953b2a5 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:01.545792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00ea0da3-a257-41af-a830-bf749953b2a5 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:01.546784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00ea0da3-a257-41af-a830-bf749953b2a5 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:01.547463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00ea0da3-a257-41af-a830-bf749953b2a5 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:01.548138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00ea0da3-a257-41af-a830-bf749953b2a5 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:01.652222 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3e137eb7-7f32-467a-ad37-1d9ce984b180 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 12798 microversion: 2.1 time: 1.647132 Aug 23 17:53:01.652831 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 295/598] 10.222.0.61 () {58 vars in 1171 bytes} [Tue Aug 23 17:53:00 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 12798 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:53:01.670826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-00ea0da3-a257-41af-a830-bf749953b2a5 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:01.697709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e52be5b7-4173-45bc-a034-845983113a99 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:01.698004 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-00ea0da3-a257-41af-a830-bf749953b2a5 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.166424 Aug 23 17:53:01.699265 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 304/599] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:01 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:01.707274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e52be5b7-4173-45bc-a034-845983113a99 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Searching by: {'deleted': False, 'project_id': '46be13d1a0a847499a1efbd16157c012'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:53:01.718450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e52be5b7-4173-45bc-a034-845983113a99 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:01.722917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e52be5b7-4173-45bc-a034-845983113a99 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:01.723615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e52be5b7-4173-45bc-a034-845983113a99 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:01.725151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e52be5b7-4173-45bc-a034-845983113a99 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:01.731859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e52be5b7-4173-45bc-a034-845983113a99 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:01.732679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e52be5b7-4173-45bc-a034-845983113a99 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:01.781067 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e52be5b7-4173-45bc-a034-845983113a99 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?tenant_id=5c5a1c94aed149c489a20be456895034" status: 200 len: 15 microversion: 2.1 time: 0.087589 Aug 23 17:53:01.784359 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 296/600] 10.222.0.61 () {58 vars in 1231 bytes} [Tue Aug 23 17:53:01 2022] GET /compute/v2.1/servers/detail?tenant_id=5c5a1c94aed149c489a20be456895034 => generated 15 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 17:53:01.804235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:01.823549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-936e5e1f-967a-4b0b-9b02-e9c685e6955c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:01.824481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-936e5e1f-967a-4b0b-9b02-e9c685e6955c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:01.831451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Searching by: {'tenant_id': '5c5a1c94aed149c489a20be456895034', 'deleted': False} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:53:01.848005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-936e5e1f-967a-4b0b-9b02-e9c685e6955c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:01.850341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-936e5e1f-967a-4b0b-9b02-e9c685e6955c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:01.850809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-936e5e1f-967a-4b0b-9b02-e9c685e6955c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:01.851688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-936e5e1f-967a-4b0b-9b02-e9c685e6955c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:01.852293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-936e5e1f-967a-4b0b-9b02-e9c685e6955c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:01.852871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-936e5e1f-967a-4b0b-9b02-e9c685e6955c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:01.857750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:01.865238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:01.867035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:01.867916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:01.868398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:01.868831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:02.042029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:53:02.205495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:02.205995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:02.206572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:02.463016 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-125864b4-26c4-4726-975a-e4926a1f8eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5c5a1c94aed149c489a20be456895034" status: 200 len: 4831 microversion: 2.1 time: 0.663514 Aug 23 17:53:02.463606 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 305/601] 10.222.0.61 () {58 vars in 1257 bytes} [Tue Aug 23 17:53:01 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=5c5a1c94aed149c489a20be456895034 => generated 4831 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:02.491693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-837d31af-9253-4019-add4-cdc92f7130c4 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:02.502391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-837d31af-9253-4019-add4-cdc92f7130c4 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Searching by: {'tenant_id': '46be13d1a0a847499a1efbd16157c012', 'deleted': False} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:53:02.508297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-837d31af-9253-4019-add4-cdc92f7130c4 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:02.509016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-837d31af-9253-4019-add4-cdc92f7130c4 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:02.509596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-837d31af-9253-4019-add4-cdc92f7130c4 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:02.511017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-837d31af-9253-4019-add4-cdc92f7130c4 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:02.511899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-837d31af-9253-4019-add4-cdc92f7130c4 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:02.512545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-837d31af-9253-4019-add4-cdc92f7130c4 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:02.560277 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-837d31af-9253-4019-add4-cdc92f7130c4 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=46be13d1a0a847499a1efbd16157c012" status: 200 len: 15 microversion: 2.1 time: 0.074575 Aug 23 17:53:02.576013 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 306/602] 10.222.0.61 () {58 vars in 1257 bytes} [Tue Aug 23 17:53:02 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=46be13d1a0a847499a1efbd16157c012 => generated 15 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:53:02.589835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8fc3a26-ba77-4f11-95df-ba956c2cbf6e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:02.590790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c8fc3a26-ba77-4f11-95df-ba956c2cbf6e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:02.598833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8fc3a26-ba77-4f11-95df-ba956c2cbf6e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:02.599382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8fc3a26-ba77-4f11-95df-ba956c2cbf6e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:02.599817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8fc3a26-ba77-4f11-95df-ba956c2cbf6e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:02.600592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8fc3a26-ba77-4f11-95df-ba956c2cbf6e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:02.601099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8fc3a26-ba77-4f11-95df-ba956c2cbf6e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:02.602404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8fc3a26-ba77-4f11-95df-ba956c2cbf6e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:02.899629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c8fc3a26-ba77-4f11-95df-ba956c2cbf6e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:02.915850 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c8fc3a26-ba77-4f11-95df-ba956c2cbf6e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1311 microversion: 2.1 time: 0.329623 Aug 23 17:53:02.918123 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 307/603] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:02 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1311 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:02.925715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8e90909-fe36-4109-b6a9-51f870b7fbf8 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:02.936707 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c8e90909-fe36-4109-b6a9-51f870b7fbf8 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.015710 Aug 23 17:53:02.937446 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 308/604] 10.222.0.61 () {58 vars in 1189 bytes} [Tue Aug 23 17:53:02 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:53:02.944143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c90c615-8dba-49d1-a438-4399fee8c3e4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:02.944869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1c90c615-8dba-49d1-a438-4399fee8c3e4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:02.953834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c90c615-8dba-49d1-a438-4399fee8c3e4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:02.954407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c90c615-8dba-49d1-a438-4399fee8c3e4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:02.955670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c90c615-8dba-49d1-a438-4399fee8c3e4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:02.956468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c90c615-8dba-49d1-a438-4399fee8c3e4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:02.957000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c90c615-8dba-49d1-a438-4399fee8c3e4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:02.957700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c90c615-8dba-49d1-a438-4399fee8c3e4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:03.075667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-936e5e1f-967a-4b0b-9b02-e9c685e6955c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:03.084389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-1c90c615-8dba-49d1-a438-4399fee8c3e4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:03.084668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-936e5e1f-967a-4b0b-9b02-e9c685e6955c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1466 microversion: 2.1 time: 1.264933 Aug 23 17:53:03.088323 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 297/605] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:01 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1466 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:03.094490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cc2941dd-025b-4c51-8a87-dc586b188bd2 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:03.096814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cc2941dd-025b-4c51-8a87-dc586b188bd2 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:03.118175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc2941dd-025b-4c51-8a87-dc586b188bd2 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:03.119549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc2941dd-025b-4c51-8a87-dc586b188bd2 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:03.120007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc2941dd-025b-4c51-8a87-dc586b188bd2 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:03.129928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc2941dd-025b-4c51-8a87-dc586b188bd2 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:03.130456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc2941dd-025b-4c51-8a87-dc586b188bd2 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:03.130871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc2941dd-025b-4c51-8a87-dc586b188bd2 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:03.148885 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c90c615-8dba-49d1-a438-4399fee8c3e4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.210124 Aug 23 17:53:03.150195 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 309/606] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:02 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:03.282028 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cc2941dd-025b-4c51-8a87-dc586b188bd2 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action" status: 202 len: 0 microversion: 2.1 time: 0.188570 Aug 23 17:53:03.295647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3dc268d3-d09a-4d46-a3d6-b8e41120b372 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:03.301201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3dc268d3-d09a-4d46-a3d6-b8e41120b372 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:03.302068 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 298/607] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:53:03 2022] POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:53:03.302892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3dc268d3-d09a-4d46-a3d6-b8e41120b372 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '5c5a1c94aed149c489a20be456895034'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:53:03.313565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3dc268d3-d09a-4d46-a3d6-b8e41120b372 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:03.313565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3dc268d3-d09a-4d46-a3d6-b8e41120b372 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:03.313565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3dc268d3-d09a-4d46-a3d6-b8e41120b372 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:03.313565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3dc268d3-d09a-4d46-a3d6-b8e41120b372 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:03.313565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3dc268d3-d09a-4d46-a3d6-b8e41120b372 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:03.316224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3dc268d3-d09a-4d46-a3d6-b8e41120b372 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:03.445431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-3dc268d3-d09a-4d46-a3d6-b8e41120b372 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:53:03.540824 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3dc268d3-d09a-4d46-a3d6-b8e41120b372 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers?status=error" status: 200 len: 338 microversion: 2.1 time: 0.254795 Aug 23 17:53:03.542253 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 310/608] 10.222.0.61 () {58 vars in 1150 bytes} [Tue Aug 23 17:53:03 2022] GET /compute/v2.1/servers?status=error => generated 338 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:03.556277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-320cc174-1f1c-4d11-ac62-34ed1ff1c496 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:03.560199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-320cc174-1f1c-4d11-ac62-34ed1ff1c496 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:03.569128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-320cc174-1f1c-4d11-ac62-34ed1ff1c496 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:03.569897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-320cc174-1f1c-4d11-ac62-34ed1ff1c496 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:03.571065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-320cc174-1f1c-4d11-ac62-34ed1ff1c496 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:03.571985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-320cc174-1f1c-4d11-ac62-34ed1ff1c496 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:03.572610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-320cc174-1f1c-4d11-ac62-34ed1ff1c496 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:03.573203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-320cc174-1f1c-4d11-ac62-34ed1ff1c496 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:03.773191 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-320cc174-1f1c-4d11-ac62-34ed1ff1c496 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action" status: 202 len: 0 microversion: 2.1 time: 0.223197 Aug 23 17:53:03.776114 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 299/609] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:53:03 2022] POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:53:03.787768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-781c8dd3-e62b-4256-8814-203276842eae tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:03.788871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-781c8dd3-e62b-4256-8814-203276842eae tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:03.811313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-781c8dd3-e62b-4256-8814-203276842eae tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:03.815095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-781c8dd3-e62b-4256-8814-203276842eae tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:03.816178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-781c8dd3-e62b-4256-8814-203276842eae tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:03.818835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-781c8dd3-e62b-4256-8814-203276842eae tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:03.820138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-781c8dd3-e62b-4256-8814-203276842eae tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:03.821417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-781c8dd3-e62b-4256-8814-203276842eae tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:03.938004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d910a4c3-ea40-4e44-8626-1cc432c4651c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:03.938488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d910a4c3-ea40-4e44-8626-1cc432c4651c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:03.952831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d910a4c3-ea40-4e44-8626-1cc432c4651c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:03.953327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d910a4c3-ea40-4e44-8626-1cc432c4651c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:03.953769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d910a4c3-ea40-4e44-8626-1cc432c4651c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:03.955889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d910a4c3-ea40-4e44-8626-1cc432c4651c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:03.958407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d910a4c3-ea40-4e44-8626-1cc432c4651c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:03.958971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d910a4c3-ea40-4e44-8626-1cc432c4651c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:04.126478 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-781c8dd3-e62b-4256-8814-203276842eae tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1616 microversion: 2.1 time: 0.346833 Aug 23 17:53:04.128665 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 311/610] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:03 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1616 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:04.153409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-794ed2ed-0e59-4c45-b2d2-8888cd823b26 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:04.156356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-794ed2ed-0e59-4c45-b2d2-8888cd823b26 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:04.167283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-794ed2ed-0e59-4c45-b2d2-8888cd823b26 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:04.168477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-794ed2ed-0e59-4c45-b2d2-8888cd823b26 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:04.169232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-794ed2ed-0e59-4c45-b2d2-8888cd823b26 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:04.170201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-794ed2ed-0e59-4c45-b2d2-8888cd823b26 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:04.170848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-794ed2ed-0e59-4c45-b2d2-8888cd823b26 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:04.172702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-794ed2ed-0e59-4c45-b2d2-8888cd823b26 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:04.452323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-794ed2ed-0e59-4c45-b2d2-8888cd823b26 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:04.464423 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-794ed2ed-0e59-4c45-b2d2-8888cd823b26 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 200 len: 1466 microversion: 2.1 time: 0.333991 Aug 23 17:53:04.466938 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 312/611] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:04 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 1466 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:04.474232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0167bea6-7b50-454c-a94b-820932c452da tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:04.477697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0167bea6-7b50-454c-a94b-820932c452da tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:04.490002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0167bea6-7b50-454c-a94b-820932c452da tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:04.493258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0167bea6-7b50-454c-a94b-820932c452da tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:04.493258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0167bea6-7b50-454c-a94b-820932c452da tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:04.493743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0167bea6-7b50-454c-a94b-820932c452da tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:04.494334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0167bea6-7b50-454c-a94b-820932c452da tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:04.494688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0167bea6-7b50-454c-a94b-820932c452da tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:04.500704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d910a4c3-ea40-4e44-8626-1cc432c4651c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:04.510579 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d910a4c3-ea40-4e44-8626-1cc432c4651c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1495 microversion: 2.1 time: 0.576920 Aug 23 17:53:04.519499 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 300/612] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:03 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1495 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:04.526603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-303ea5b6-8d9a-47d4-bf53-042c99a49a5a tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:04.538289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-303ea5b6-8d9a-47d4-bf53-042c99a49a5a tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:04.560135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-303ea5b6-8d9a-47d4-bf53-042c99a49a5a tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:04.560627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-303ea5b6-8d9a-47d4-bf53-042c99a49a5a tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:04.561057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-303ea5b6-8d9a-47d4-bf53-042c99a49a5a tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:04.561768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-303ea5b6-8d9a-47d4-bf53-042c99a49a5a tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:04.570958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-303ea5b6-8d9a-47d4-bf53-042c99a49a5a tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:04.571597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-303ea5b6-8d9a-47d4-bf53-042c99a49a5a tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:04.787387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-303ea5b6-8d9a-47d4-bf53-042c99a49a5a tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:04.826863 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-303ea5b6-8d9a-47d4-bf53-042c99a49a5a tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.305956 Aug 23 17:53:04.836473 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 301/613] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:04 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:04.998495 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0167bea6-7b50-454c-a94b-820932c452da tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1616 microversion: 2.1 time: 0.522636 Aug 23 17:53:04.999169 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 313/614] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:04 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1616 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:05.013429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f4d771e6-9c8e-4920-8df1-61cb605daa6c req-6a8cb127-1316-4de8-98ea-fe83c8c474ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7a97134-e24f-4d8a-bb6f-dd6370863fb9", "name": "network-vif-deleted", "tag": "3b22a4b6-90a5-46af-93ec-ba8bdf0f07ae"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:05.034666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f4d771e6-9c8e-4920-8df1-61cb605daa6c req-6a8cb127-1316-4de8-98ea-fe83c8c474ee service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.034666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f4d771e6-9c8e-4920-8df1-61cb605daa6c req-6a8cb127-1316-4de8-98ea-fe83c8c474ee service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.039425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f4d771e6-9c8e-4920-8df1-61cb605daa6c req-6a8cb127-1316-4de8-98ea-fe83c8c474ee service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.061773 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f4d771e6-9c8e-4920-8df1-61cb605daa6c req-6a8cb127-1316-4de8-98ea-fe83c8c474ee service nova] Creating event network-vif-deleted:3b22a4b6-90a5-46af-93ec-ba8bdf0f07ae for instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 on n-h2-850468-16 Aug 23 17:53:05.068525 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f4d771e6-9c8e-4920-8df1-61cb605daa6c req-6a8cb127-1316-4de8-98ea-fe83c8c474ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068112 Aug 23 17:53:05.069519 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 314/615] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:05.075188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5be78db4-8f9f-479c-8796-d7c2cb66ba8c tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:05.084418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5be78db4-8f9f-479c-8796-d7c2cb66ba8c tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Searching by: {'host': 'n-h1-850468-16', 'deleted': False} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:53:05.092050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5be78db4-8f9f-479c-8796-d7c2cb66ba8c tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.092939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5be78db4-8f9f-479c-8796-d7c2cb66ba8c tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.093563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5be78db4-8f9f-479c-8796-d7c2cb66ba8c tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.094297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5be78db4-8f9f-479c-8796-d7c2cb66ba8c tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.094995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5be78db4-8f9f-479c-8796-d7c2cb66ba8c tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.095729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5be78db4-8f9f-479c-8796-d7c2cb66ba8c tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.278515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-5be78db4-8f9f-479c-8796-d7c2cb66ba8c tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Listed batch of 5 results from cell out of 1000 limit. Returned 5 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:53:05.363383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cb808874-78ff-4053-91e4-c3c46faf0f54 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:05.364024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cb808874-78ff-4053-91e4-c3c46faf0f54 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:05.370966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb808874-78ff-4053-91e4-c3c46faf0f54 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.371460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb808874-78ff-4053-91e4-c3c46faf0f54 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.375878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb808874-78ff-4053-91e4-c3c46faf0f54 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.376874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb808874-78ff-4053-91e4-c3c46faf0f54 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.384747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb808874-78ff-4053-91e4-c3c46faf0f54 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.385415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb808874-78ff-4053-91e4-c3c46faf0f54 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.391025 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5be78db4-8f9f-479c-8796-d7c2cb66ba8c tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "GET /compute/v2.1/servers?host=n-h1-850468-16&all_tenants=1" status: 200 len: 1659 microversion: 2.1 time: 0.319909 Aug 23 17:53:05.392724 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 315/616] 10.222.0.61 () {58 vars in 1192 bytes} [Tue Aug 23 17:53:05 2022] GET /compute/v2.1/servers?host=n-h1-850468-16&all_tenants=1 => generated 1659 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:05.406092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-999217c1-3788-4b45-a1d3-f24af84a5193 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:05.424128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-999217c1-3788-4b45-a1d3-f24af84a5193 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:53:05.432802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-999217c1-3788-4b45-a1d3-f24af84a5193 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.433290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-999217c1-3788-4b45-a1d3-f24af84a5193 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.433724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-999217c1-3788-4b45-a1d3-f24af84a5193 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.438445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-999217c1-3788-4b45-a1d3-f24af84a5193 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.438946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-999217c1-3788-4b45-a1d3-f24af84a5193 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.439444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-999217c1-3788-4b45-a1d3-f24af84a5193 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.464929 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-999217c1-3788-4b45-a1d3-f24af84a5193 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.063768 Aug 23 17:53:05.466291 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 316/617] 10.222.0.61 () {58 vars in 1196 bytes} [Tue Aug 23 17:53:05 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 17:53:05.480221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b12ac92e-7cac-49fa-8a56-65b0b48bb841 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:05.482644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b12ac92e-7cac-49fa-8a56-65b0b48bb841 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:05.489680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b12ac92e-7cac-49fa-8a56-65b0b48bb841 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.490176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b12ac92e-7cac-49fa-8a56-65b0b48bb841 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.490793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b12ac92e-7cac-49fa-8a56-65b0b48bb841 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.491503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b12ac92e-7cac-49fa-8a56-65b0b48bb841 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.491957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b12ac92e-7cac-49fa-8a56-65b0b48bb841 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.492383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b12ac92e-7cac-49fa-8a56-65b0b48bb841 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.854491 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cb808874-78ff-4053-91e4-c3c46faf0f54 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1648 microversion: 2.1 time: 1.016504 Aug 23 17:53:05.868801 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 302/618] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:04 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1648 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:05.873708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-31e77e9e-a33e-4dbb-b789-b4b3e72563a7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:05.874323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-31e77e9e-a33e-4dbb-b789-b4b3e72563a7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: e7a97134-e24f-4d8a-bb6f-dd6370863fb9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:05.893138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31e77e9e-a33e-4dbb-b789-b4b3e72563a7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.893641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31e77e9e-a33e-4dbb-b789-b4b3e72563a7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.894165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31e77e9e-a33e-4dbb-b789-b4b3e72563a7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.894923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31e77e9e-a33e-4dbb-b789-b4b3e72563a7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.895372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31e77e9e-a33e-4dbb-b789-b4b3e72563a7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.895794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31e77e9e-a33e-4dbb-b789-b4b3e72563a7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.924899 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-31e77e9e-a33e-4dbb-b789-b4b3e72563a7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] HTTP exception thrown: Instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 could not be found. Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-31e77e9e-a33e-4dbb-b789-b4b3e72563a7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Request method failure captured: Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 HTTP/1.1 Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPAijkDqa8AqciDdlUEL-efq_2DmlRWrrQ1Kaa2FeiYf-K2WSWSddfGTqKWv4vMwxdNNAHDevAQyq4f5Hxl1dejuloqEQjtOQY_UtBqrEqGYk0AF4XCnLvRt913EpfYJZFzQj5jPQfGAyMjvJDDyYxMDCj3h62lpvxt3OO1gIUhSJY Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ce2f527311164c75ab2a834dc4208135 Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-LiveMigrationNegativeTest-734923912 Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ce2f527311164c75ab2a834dc4208135"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2f527311164c75ab2a834dc4208135"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ce2f527311164c75ab2a834dc4208135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2f527311164c75ab2a834dc4208135"}]}] Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-LiveMigrationNegativeTest-734923912 Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ce2f527311164c75ab2a834dc4208135 Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-734923912 Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-LiveMigrationNegativeTest-734923912-project Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: fd1226e98e7248c080c79cc291c2ce3c Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-LiveMigrationNegativeTest-734923912-project Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 could not be found. Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'e7a97134-e24f-4d8a-bb6f-dd6370863fb9'} Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 could not be found. Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 could not be found. Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:05.926501 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:05.930587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:05.930587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:05.930587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:05.930587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:05.930587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:05.930587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 could not be found. Aug 23 17:53:05.930587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:05.930587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-31e77e9e-a33e-4dbb-b789-b4b3e72563a7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Returning 404 to user: Instance e7a97134-e24f-4d8a-bb6f-dd6370863fb9 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:05.930587 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-31e77e9e-a33e-4dbb-b789-b4b3e72563a7 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9" status: 404 len: 111 microversion: 2.1 time: 0.058193 Aug 23 17:53:05.939265 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 303/619] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:05 2022] GET /compute/v2.1/servers/e7a97134-e24f-4d8a-bb6f-dd6370863fb9 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:53:05.947086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9f150e6-6d91-497e-831d-4b7c32b8874d tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:05.947747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b9f150e6-6d91-497e-831d-4b7c32b8874d tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:05.964478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9f150e6-6d91-497e-831d-4b7c32b8874d tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.965032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9f150e6-6d91-497e-831d-4b7c32b8874d tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.965698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9f150e6-6d91-497e-831d-4b7c32b8874d tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.966441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9f150e6-6d91-497e-831d-4b7c32b8874d tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:05.966958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9f150e6-6d91-497e-831d-4b7c32b8874d tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:05.967342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9f150e6-6d91-497e-831d-4b7c32b8874d tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:05.997000 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b12ac92e-7cac-49fa-8a56-65b0b48bb841 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action" status: 202 len: 0 microversion: 2.1 time: 0.521116 Aug 23 17:53:06.000329 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 317/620] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:53:05 2022] POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action => generated 0 bytes in 525 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:53:06.010791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e5fe32cf-0594-4590-a29d-98f5694ec3f9 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:06.011956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e5fe32cf-0594-4590-a29d-98f5694ec3f9 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:06.021236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5fe32cf-0594-4590-a29d-98f5694ec3f9 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:06.023433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5fe32cf-0594-4590-a29d-98f5694ec3f9 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:06.024178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5fe32cf-0594-4590-a29d-98f5694ec3f9 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:06.025357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5fe32cf-0594-4590-a29d-98f5694ec3f9 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:06.026070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5fe32cf-0594-4590-a29d-98f5694ec3f9 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:06.026738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5fe32cf-0594-4590-a29d-98f5694ec3f9 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:06.410446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-b9f150e6-6d91-497e-831d-4b7c32b8874d tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:06.455141 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b9f150e6-6d91-497e-831d-4b7c32b8874d tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.511320 Aug 23 17:53:06.456319 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 304/621] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:05 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:06.461455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ad0c597c-94e2-42fe-b951-d36b920bf34c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:06.471497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ad0c597c-94e2-42fe-b951-d36b920bf34c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:06.477852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad0c597c-94e2-42fe-b951-d36b920bf34c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:06.478344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad0c597c-94e2-42fe-b951-d36b920bf34c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:06.478810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad0c597c-94e2-42fe-b951-d36b920bf34c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:06.490670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad0c597c-94e2-42fe-b951-d36b920bf34c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:06.491286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad0c597c-94e2-42fe-b951-d36b920bf34c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:06.491737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad0c597c-94e2-42fe-b951-d36b920bf34c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:06.512944 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e5fe32cf-0594-4590-a29d-98f5694ec3f9 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1648 microversion: 2.1 time: 0.510909 Aug 23 17:53:06.515550 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 318/622] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:06 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1648 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:06.533556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:06.536869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:06.544786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:06.545331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ad0c597c-94e2-42fe-b951-d36b920bf34c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:53:06.545461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:06.546032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:06.546922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:06.547484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:06.548028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:06.573947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:06.716087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:53:06.717108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:53:06.717832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:53:06.719115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:53:06.719792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:53:06.725870 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ad0c597c-94e2-42fe-b951-d36b920bf34c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 204 len: 0 microversion: 2.1 time: 0.267996 Aug 23 17:53:06.727174 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 305/623] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:53:06 2022] DELETE /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:53:06.737576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b42054d-0997-4fc2-899e-c4b95f84e283 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:06.741020 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:53:06.741020 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:53:06.742589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b42054d-0997-4fc2-899e-c4b95f84e283 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:06.747328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b42054d-0997-4fc2-899e-c4b95f84e283 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:06.747989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b42054d-0997-4fc2-899e-c4b95f84e283 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:06.748944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b42054d-0997-4fc2-899e-c4b95f84e283 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:06.749556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b42054d-0997-4fc2-899e-c4b95f84e283 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:06.750162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b42054d-0997-4fc2-899e-c4b95f84e283 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:06.805891 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b42054d-0997-4fc2-899e-c4b95f84e283 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.077181 Aug 23 17:53:06.811136 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 306/624] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Aug 23 17:53:06 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:06.820172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3f4df690-13e1-4f68-8d39-06c26e92dc72 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:06.821716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3f4df690-13e1-4f68-8d39-06c26e92dc72 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:06.851078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f4df690-13e1-4f68-8d39-06c26e92dc72 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:06.852311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f4df690-13e1-4f68-8d39-06c26e92dc72 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:06.852918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f4df690-13e1-4f68-8d39-06c26e92dc72 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:06.862434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f4df690-13e1-4f68-8d39-06c26e92dc72 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:06.867523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f4df690-13e1-4f68-8d39-06c26e92dc72 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:06.868611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f4df690-13e1-4f68-8d39-06c26e92dc72 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:06.895787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:06.923121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:06.939985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:06.940744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:06.941906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:06.943309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:06.946490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:06.948317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:07.026429 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fae46492-c41a-4b46-b3b8-c59268df4f5b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action" status: 202 len: 1067 microversion: 2.1 time: 0.498567 Aug 23 17:53:07.034885 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 319/625] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:53:06 2022] POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action => generated 1067 bytes in 508 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 23 17:53:07.051295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e95ffced-35fb-4c40-8b59-d6515e2563ee tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-16", "block_migration": true, "disk_over_commit": false}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:07.054711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e95ffced-35fb-4c40-8b59-d6515e2563ee tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:07.071622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95ffced-35fb-4c40-8b59-d6515e2563ee tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:07.073762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95ffced-35fb-4c40-8b59-d6515e2563ee tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:07.074749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95ffced-35fb-4c40-8b59-d6515e2563ee tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:07.092066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95ffced-35fb-4c40-8b59-d6515e2563ee tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:07.101617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95ffced-35fb-4c40-8b59-d6515e2563ee tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:07.102268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95ffced-35fb-4c40-8b59-d6515e2563ee tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:07.178773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3f4df690-13e1-4f68-8d39-06c26e92dc72 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:07.193461 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3f4df690-13e1-4f68-8d39-06c26e92dc72 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1475 microversion: 2.1 time: 0.380901 Aug 23 17:53:07.196549 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 307/626] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:06 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1475 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:07.213436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-e95ffced-35fb-4c40-8b59-d6515e2563ee tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lazy-loading 'flavor' on Instance uuid 1e4da944-47f7-4b06-9249-260dcdd68610 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:07.214362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-feb625fd-7915-4326-a7be-a0f4c830fa9d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:07.215681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-feb625fd-7915-4326-a7be-a0f4c830fa9d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:07.239193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb625fd-7915-4326-a7be-a0f4c830fa9d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:07.243638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e95ffced-35fb-4c40-8b59-d6515e2563ee tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Going to try to live migrate instance to n-h1-850468-16 {{(pid=128807) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 17:53:07.253529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb625fd-7915-4326-a7be-a0f4c830fa9d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:07.253987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb625fd-7915-4326-a7be-a0f4c830fa9d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:07.265598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb625fd-7915-4326-a7be-a0f4c830fa9d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:07.266106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb625fd-7915-4326-a7be-a0f4c830fa9d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:07.268129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb625fd-7915-4326-a7be-a0f4c830fa9d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:08.572994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-feb625fd-7915-4326-a7be-a0f4c830fa9d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:08.585461 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-feb625fd-7915-4326-a7be-a0f4c830fa9d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1471 microversion: 2.1 time: 1.386475 Aug 23 17:53:08.587200 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 308/627] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:07 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1471 bytes in 1390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:08.600140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-85637df4-b20c-43b1-8859-1fb4bff15ebd tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:08.601855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-85637df4-b20c-43b1-8859-1fb4bff15ebd tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:08.619901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85637df4-b20c-43b1-8859-1fb4bff15ebd tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:08.620461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85637df4-b20c-43b1-8859-1fb4bff15ebd tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:08.620952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85637df4-b20c-43b1-8859-1fb4bff15ebd tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:08.621661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85637df4-b20c-43b1-8859-1fb4bff15ebd tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:08.622498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85637df4-b20c-43b1-8859-1fb4bff15ebd tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:08.623133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85637df4-b20c-43b1-8859-1fb4bff15ebd tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:08.847670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-85637df4-b20c-43b1-8859-1fb4bff15ebd tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:08.902932 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-85637df4-b20c-43b1-8859-1fb4bff15ebd tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1931 microversion: 2.75 time: 0.312979 Aug 23 17:53:08.906103 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 309/628] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:08 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1931 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:08.919486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-80cf3508-8f16-49ca-becd-7dedf4750fc1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:08.920635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-80cf3508-8f16-49ca-becd-7dedf4750fc1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:08.940263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80cf3508-8f16-49ca-becd-7dedf4750fc1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:08.942750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80cf3508-8f16-49ca-becd-7dedf4750fc1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:08.945053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80cf3508-8f16-49ca-becd-7dedf4750fc1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:08.945895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80cf3508-8f16-49ca-becd-7dedf4750fc1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:08.947964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80cf3508-8f16-49ca-becd-7dedf4750fc1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:08.948426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80cf3508-8f16-49ca-becd-7dedf4750fc1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:09.721608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-80cf3508-8f16-49ca-becd-7dedf4750fc1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:09.753417 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-80cf3508-8f16-49ca-becd-7dedf4750fc1 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1475 microversion: 2.1 time: 0.845790 Aug 23 17:53:09.769954 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 310/629] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:08 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1475 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:09.783897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b5ef502-2e3d-4fc7-a494-5bc7296d01d1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:09.785353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3b5ef502-2e3d-4fc7-a494-5bc7296d01d1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:09.805524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b5ef502-2e3d-4fc7-a494-5bc7296d01d1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:09.806168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b5ef502-2e3d-4fc7-a494-5bc7296d01d1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:09.806762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b5ef502-2e3d-4fc7-a494-5bc7296d01d1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:09.807494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b5ef502-2e3d-4fc7-a494-5bc7296d01d1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:09.807952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b5ef502-2e3d-4fc7-a494-5bc7296d01d1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:09.808508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b5ef502-2e3d-4fc7-a494-5bc7296d01d1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:10.671992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3b5ef502-2e3d-4fc7-a494-5bc7296d01d1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:10.689891 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3b5ef502-2e3d-4fc7-a494-5bc7296d01d1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1471 microversion: 2.1 time: 0.916998 Aug 23 17:53:10.692570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 311/630] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:09 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1471 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:10.725308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-07b71056-16c9-4a54-9b5a-b3c396107ad3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:10.729387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-07b71056-16c9-4a54-9b5a-b3c396107ad3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:10.743985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07b71056-16c9-4a54-9b5a-b3c396107ad3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:10.745016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07b71056-16c9-4a54-9b5a-b3c396107ad3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:10.745701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07b71056-16c9-4a54-9b5a-b3c396107ad3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:10.746708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07b71056-16c9-4a54-9b5a-b3c396107ad3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:10.748400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07b71056-16c9-4a54-9b5a-b3c396107ad3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:10.749034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07b71056-16c9-4a54-9b5a-b3c396107ad3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:10.839571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:11.015758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-07b71056-16c9-4a54-9b5a-b3c396107ad3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:11.061869 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-07b71056-16c9-4a54-9b5a-b3c396107ad3 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1949 microversion: 2.75 time: 0.350573 Aug 23 17:53:11.063213 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 312/631] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:10 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1949 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:11.074850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-593cfd43-3af7-4255-b468-238d825b9bab req-64c498e6-2daa-4582-8e46-83097a6755a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1391cef8-1476-4368-824a-344caae35cd8", "name": "network-vif-deleted", "tag": "1d9b9dfa-0998-42b8-ac7c-a034fcb6e208"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:11.095485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-593cfd43-3af7-4255-b468-238d825b9bab req-64c498e6-2daa-4582-8e46-83097a6755a7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:11.095974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-593cfd43-3af7-4255-b468-238d825b9bab req-64c498e6-2daa-4582-8e46-83097a6755a7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:11.096399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-593cfd43-3af7-4255-b468-238d825b9bab req-64c498e6-2daa-4582-8e46-83097a6755a7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:11.114124 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-593cfd43-3af7-4255-b468-238d825b9bab req-64c498e6-2daa-4582-8e46-83097a6755a7 service nova] Creating event network-vif-deleted:1d9b9dfa-0998-42b8-ac7c-a034fcb6e208 for instance 1391cef8-1476-4368-824a-344caae35cd8 on n-h1-850468-16 Aug 23 17:53:11.125278 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-593cfd43-3af7-4255-b468-238d825b9bab req-64c498e6-2daa-4582-8e46-83097a6755a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060479 Aug 23 17:53:11.126695 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 313/632] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:11.133293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:11.134001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:11.141677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:11.142369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:11.143173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:11.144032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:11.144756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:11.145381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:11.189373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:11.190514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:11.191996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:11.193502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lazy-loading 'fault' on Instance uuid 1391cef8-1476-4368-824a-344caae35cd8 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:11.308795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fd1226e98e7248c080c79cc291c2ce3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2f527311164c75ab2a834dc4208135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:11.324233 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8a5c5ec9-80eb-483b-b3b2-a33f73eb4802 tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 200 len: 1309 microversion: 2.1 time: 0.195937 Aug 23 17:53:11.326206 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 314/633] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:11 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 1309 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:11.402923 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e95ffced-35fb-4c40-8b59-d6515e2563ee tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610/action" status: 202 len: 0 microversion: 2.1 time: 4.363096 Aug 23 17:53:11.407256 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 320/634] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:53:07 2022] POST /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610/action => generated 0 bytes in 4366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:53:11.417974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-22fa0ff3-f123-4062-bf12-cb44c06d249b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:11.418656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-22fa0ff3-f123-4062-bf12-cb44c06d249b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:11.427806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22fa0ff3-f123-4062-bf12-cb44c06d249b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:11.428300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22fa0ff3-f123-4062-bf12-cb44c06d249b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:11.428968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22fa0ff3-f123-4062-bf12-cb44c06d249b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:11.430148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22fa0ff3-f123-4062-bf12-cb44c06d249b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:11.430955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22fa0ff3-f123-4062-bf12-cb44c06d249b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:11.431549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22fa0ff3-f123-4062-bf12-cb44c06d249b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:11.432425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1372316370", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "18890100-9652-4122-9a4a-c466e7188bca"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:11.458227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:11.563198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] validate_networks() for [('18890100-9652-4122-9a4a-c466e7188bca', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:53:11.701685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22fa0ff3-f123-4062-bf12-cb44c06d249b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:11.724160 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-22fa0ff3-f123-4062-bf12-cb44c06d249b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 0.313811 Aug 23 17:53:11.745462 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 321/635] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:11 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:11.754366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41a4c485-42d3-4755-9015-d296d6c36cfc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:11.755432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-41a4c485-42d3-4755-9015-d296d6c36cfc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:11.771171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41a4c485-42d3-4755-9015-d296d6c36cfc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:11.771771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41a4c485-42d3-4755-9015-d296d6c36cfc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:11.772380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41a4c485-42d3-4755-9015-d296d6c36cfc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:11.773266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41a4c485-42d3-4755-9015-d296d6c36cfc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:11.773933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41a4c485-42d3-4755-9015-d296d6c36cfc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:11.774512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41a4c485-42d3-4755-9015-d296d6c36cfc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:12.070378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41a4c485-42d3-4755-9015-d296d6c36cfc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:12.080654 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-41a4c485-42d3-4755-9015-d296d6c36cfc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1471 microversion: 2.1 time: 0.332905 Aug 23 17:53:12.081264 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 322/636] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:11 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1471 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:12.102168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bb898875-8663-479c-8a6b-376b85450869 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:12.102730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bb898875-8663-479c-8a6b-376b85450869 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:12.122258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb898875-8663-479c-8a6b-376b85450869 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:12.122761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb898875-8663-479c-8a6b-376b85450869 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:12.123208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb898875-8663-479c-8a6b-376b85450869 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:12.123922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb898875-8663-479c-8a6b-376b85450869 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:12.124425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb898875-8663-479c-8a6b-376b85450869 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:12.124855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb898875-8663-479c-8a6b-376b85450869 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:12.186967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:12.297170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-bb898875-8663-479c-8a6b-376b85450869 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:12.338535 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bb898875-8663-479c-8a6b-376b85450869 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1937 microversion: 2.75 time: 0.241660 Aug 23 17:53:12.339873 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 323/637] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:12 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1937 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:12.349687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b9ae84c-9f30-4102-b95f-57486096333c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:12.350692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7b9ae84c-9f30-4102-b95f-57486096333c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] [instance: 1391cef8-1476-4368-824a-344caae35cd8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:12.365775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b9ae84c-9f30-4102-b95f-57486096333c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:12.366626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b9ae84c-9f30-4102-b95f-57486096333c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:12.367293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b9ae84c-9f30-4102-b95f-57486096333c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:12.368019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b9ae84c-9f30-4102-b95f-57486096333c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:12.372642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b9ae84c-9f30-4102-b95f-57486096333c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:12.374973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b9ae84c-9f30-4102-b95f-57486096333c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:12.409202 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-7b9ae84c-9f30-4102-b95f-57486096333c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] HTTP exception thrown: Instance 1391cef8-1476-4368-824a-344caae35cd8 could not be found. Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b9ae84c-9f30-4102-b95f-57486096333c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Request method failure captured: Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 HTTP/1.1 Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPAijkDqa8AqciDdlUEL-efq_2DmlRWrrQ1Kaa2FeiYf-K2WSWSddfGTqKWv4vMwxdNNAHDevAQyq4f5Hxl1dejuloqEQjtOQY_UtBqrEqGYk0AF4XCnLvRt913EpfYJZFzQj5jPQfGAyMjvJDDyYxMDCj3h62lpvxt3OO1gIUhSJY Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ce2f527311164c75ab2a834dc4208135 Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-LiveMigrationNegativeTest-734923912 Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ce2f527311164c75ab2a834dc4208135"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2f527311164c75ab2a834dc4208135"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ce2f527311164c75ab2a834dc4208135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2f527311164c75ab2a834dc4208135"}]}] Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-LiveMigrationNegativeTest-734923912 Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ce2f527311164c75ab2a834dc4208135 Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-734923912 Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-LiveMigrationNegativeTest-734923912-project Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: fd1226e98e7248c080c79cc291c2ce3c Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-LiveMigrationNegativeTest-734923912-project Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 1391cef8-1476-4368-824a-344caae35cd8 could not be found. Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '1391cef8-1476-4368-824a-344caae35cd8'} Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1391cef8-1476-4368-824a-344caae35cd8 could not be found. Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1391cef8-1476-4368-824a-344caae35cd8 could not be found. Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:12.410951 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:12.414987 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:12.414987 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:12.414987 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:12.414987 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:12.414987 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:12.414987 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1391cef8-1476-4368-824a-344caae35cd8 could not be found. Aug 23 17:53:12.414987 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:12.414987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b9ae84c-9f30-4102-b95f-57486096333c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] Returning 404 to user: Instance 1391cef8-1476-4368-824a-344caae35cd8 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:12.414987 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7b9ae84c-9f30-4102-b95f-57486096333c tempest-LiveMigrationNegativeTest-734923912 tempest-LiveMigrationNegativeTest-734923912-project] 10.222.0.61 "GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8" status: 404 len: 111 microversion: 2.1 time: 0.068590 Aug 23 17:53:12.422911 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 324/638] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:12 2022] GET /compute/v2.1/servers/1391cef8-1476-4368-824a-344caae35cd8 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:53:12.753153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9bc2c7cf-2569-42e6-a084-375d7e86f575 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:12.753773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9bc2c7cf-2569-42e6-a084-375d7e86f575 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:12.761727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bc2c7cf-2569-42e6-a084-375d7e86f575 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:12.762226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bc2c7cf-2569-42e6-a084-375d7e86f575 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:12.762737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bc2c7cf-2569-42e6-a084-375d7e86f575 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:12.763469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bc2c7cf-2569-42e6-a084-375d7e86f575 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:12.763945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bc2c7cf-2569-42e6-a084-375d7e86f575 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:12.764357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bc2c7cf-2569-42e6-a084-375d7e86f575 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:13.050900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9bc2c7cf-2569-42e6-a084-375d7e86f575 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:13.060328 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9bc2c7cf-2569-42e6-a084-375d7e86f575 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 0.311131 Aug 23 17:53:13.065698 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 325/639] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:12 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:13.108801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2da2bcef-506d-49bf-8f68-4f8f935222f4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:13.109877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2da2bcef-506d-49bf-8f68-4f8f935222f4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:13.123592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da2bcef-506d-49bf-8f68-4f8f935222f4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:13.124250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da2bcef-506d-49bf-8f68-4f8f935222f4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:13.124830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da2bcef-506d-49bf-8f68-4f8f935222f4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:13.125672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da2bcef-506d-49bf-8f68-4f8f935222f4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:13.127352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da2bcef-506d-49bf-8f68-4f8f935222f4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:13.127875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da2bcef-506d-49bf-8f68-4f8f935222f4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:13.395511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2da2bcef-506d-49bf-8f68-4f8f935222f4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:13.406098 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2da2bcef-506d-49bf-8f68-4f8f935222f4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1471 microversion: 2.1 time: 0.302347 Aug 23 17:53:13.418727 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 326/640] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:13 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1471 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:13.429405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7768dfbd-4097-48e1-a7bc-6dd4fb3cfbf4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:13.441816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7768dfbd-4097-48e1-a7bc-6dd4fb3cfbf4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:13.474172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7768dfbd-4097-48e1-a7bc-6dd4fb3cfbf4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:13.491367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7768dfbd-4097-48e1-a7bc-6dd4fb3cfbf4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:13.491980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7768dfbd-4097-48e1-a7bc-6dd4fb3cfbf4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:13.492999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7768dfbd-4097-48e1-a7bc-6dd4fb3cfbf4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:13.493803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7768dfbd-4097-48e1-a7bc-6dd4fb3cfbf4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:13.496076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7768dfbd-4097-48e1-a7bc-6dd4fb3cfbf4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:13.656617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-7768dfbd-4097-48e1-a7bc-6dd4fb3cfbf4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:13.721729 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7768dfbd-4097-48e1-a7bc-6dd4fb3cfbf4 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1937 microversion: 2.75 time: 0.301526 Aug 23 17:53:13.726709 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 327/641] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:13 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1937 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:14.083133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83d589ae-8e83-4c0f-b5ec-7c654e3ca26f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:14.084523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-83d589ae-8e83-4c0f-b5ec-7c654e3ca26f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:14.099545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83d589ae-8e83-4c0f-b5ec-7c654e3ca26f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:14.103273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83d589ae-8e83-4c0f-b5ec-7c654e3ca26f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:14.103971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83d589ae-8e83-4c0f-b5ec-7c654e3ca26f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:14.104948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83d589ae-8e83-4c0f-b5ec-7c654e3ca26f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:14.106040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83d589ae-8e83-4c0f-b5ec-7c654e3ca26f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:14.107551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83d589ae-8e83-4c0f-b5ec-7c654e3ca26f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:14.551089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-83d589ae-8e83-4c0f-b5ec-7c654e3ca26f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:14.584869 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-83d589ae-8e83-4c0f-b5ec-7c654e3ca26f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 0.503765 Aug 23 17:53:14.591572 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 328/642] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:14 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:14.599351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8e7730ec-0fc3-4a0e-bdef-28c44ee826b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:14.609651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8e7730ec-0fc3-4a0e-bdef-28c44ee826b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:14.616906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e7730ec-0fc3-4a0e-bdef-28c44ee826b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:14.618868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e7730ec-0fc3-4a0e-bdef-28c44ee826b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:14.619499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e7730ec-0fc3-4a0e-bdef-28c44ee826b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:14.621785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e7730ec-0fc3-4a0e-bdef-28c44ee826b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:14.622433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e7730ec-0fc3-4a0e-bdef-28c44ee826b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:14.625687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e7730ec-0fc3-4a0e-bdef-28c44ee826b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:14.683759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:53:14.684283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:53:14.684971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:53:14.685175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:53:14.685590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:53:14.709814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:14.712743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:14.713226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:14.714020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:14.714500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:14.714951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:14.767778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Getting quotas for project a847d523b7944595aa39244f15b37665. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:53:14.775258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Getting quotas for user bb8758f075834ca59962ab82f042ec34 and project a847d523b7944595aa39244f15b37665. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:53:14.812662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:53:14.816386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:53:14.915843 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3b3f6981-7ec3-4e0d-aa62-33660a4cce07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.588162 Aug 23 17:53:14.918142 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 315/643] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 17:53:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 3591 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 17:53:14.932324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cf3ab32a-7b56-43a2-917e-5f4e19a6d095 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:14.933085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cf3ab32a-7b56-43a2-917e-5f4e19a6d095 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:14.965596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf3ab32a-7b56-43a2-917e-5f4e19a6d095 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:14.967776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf3ab32a-7b56-43a2-917e-5f4e19a6d095 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:14.967921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8e7730ec-0fc3-4a0e-bdef-28c44ee826b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:14.968563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf3ab32a-7b56-43a2-917e-5f4e19a6d095 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:14.969474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf3ab32a-7b56-43a2-917e-5f4e19a6d095 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:14.970780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf3ab32a-7b56-43a2-917e-5f4e19a6d095 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:14.971398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf3ab32a-7b56-43a2-917e-5f4e19a6d095 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:14.982041 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8e7730ec-0fc3-4a0e-bdef-28c44ee826b1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1471 microversion: 2.1 time: 0.389259 Aug 23 17:53:14.982655 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 329/644] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:14 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1471 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:14.992575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b95ab7cc-78c5-4057-a3e6-546c18a7b02b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:14.996977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b95ab7cc-78c5-4057-a3e6-546c18a7b02b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:15.113197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b95ab7cc-78c5-4057-a3e6-546c18a7b02b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:15.129422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b95ab7cc-78c5-4057-a3e6-546c18a7b02b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:15.134469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b95ab7cc-78c5-4057-a3e6-546c18a7b02b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:15.142671 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b95ab7cc-78c5-4057-a3e6-546c18a7b02b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1262 microversion: 2.25 time: 0.153302 Aug 23 17:53:15.146591 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 330/645] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:14 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1262 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:15.189811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-cf3ab32a-7b56-43a2-917e-5f4e19a6d095 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:15.235897 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cf3ab32a-7b56-43a2-917e-5f4e19a6d095 tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1937 microversion: 2.75 time: 0.315921 Aug 23 17:53:15.236479 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 316/646] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:14 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1937 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:15.611185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-78074cb5-87a9-43cf-af70-a46d0eba6d85 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:15.619511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-78074cb5-87a9-43cf-af70-a46d0eba6d85 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:15.625588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=12 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:15.665902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78074cb5-87a9-43cf-af70-a46d0eba6d85 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:15.667040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78074cb5-87a9-43cf-af70-a46d0eba6d85 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:15.670400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78074cb5-87a9-43cf-af70-a46d0eba6d85 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:15.674049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78074cb5-87a9-43cf-af70-a46d0eba6d85 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:15.675754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78074cb5-87a9-43cf-af70-a46d0eba6d85 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:15.676931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78074cb5-87a9-43cf-af70-a46d0eba6d85 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:16.018878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-09941bc4-07fe-45cb-87b0-7ebe3c87240b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:16.019633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-09941bc4-07fe-45cb-87b0-7ebe3c87240b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:16.059675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09941bc4-07fe-45cb-87b0-7ebe3c87240b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:16.061549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09941bc4-07fe-45cb-87b0-7ebe3c87240b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:16.064731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09941bc4-07fe-45cb-87b0-7ebe3c87240b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:16.068110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09941bc4-07fe-45cb-87b0-7ebe3c87240b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:16.068632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09941bc4-07fe-45cb-87b0-7ebe3c87240b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:16.069754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09941bc4-07fe-45cb-87b0-7ebe3c87240b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:16.168984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-78074cb5-87a9-43cf-af70-a46d0eba6d85 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:16.204929 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-78074cb5-87a9-43cf-af70-a46d0eba6d85 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 0.598708 Aug 23 17:53:16.213002 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 331/647] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:15 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:16.232354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ce1afb49-9f81-4403-a25d-7456ab9ed28e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:16.235524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ce1afb49-9f81-4403-a25d-7456ab9ed28e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:16.256763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce1afb49-9f81-4403-a25d-7456ab9ed28e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:16.259858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce1afb49-9f81-4403-a25d-7456ab9ed28e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:16.262239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce1afb49-9f81-4403-a25d-7456ab9ed28e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:16.277660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce1afb49-9f81-4403-a25d-7456ab9ed28e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:16.279092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce1afb49-9f81-4403-a25d-7456ab9ed28e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:16.283368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce1afb49-9f81-4403-a25d-7456ab9ed28e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:16.545317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ce1afb49-9f81-4403-a25d-7456ab9ed28e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:16.571011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ce1afb49-9f81-4403-a25d-7456ab9ed28e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:16.572777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ce1afb49-9f81-4403-a25d-7456ab9ed28e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:16.573906 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ce1afb49-9f81-4403-a25d-7456ab9ed28e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1258 microversion: 2.25 time: 0.359197 Aug 23 17:53:16.574690 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 332/648] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:16 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1258 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:16.591205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4444c971-7a55-4a8b-9a81-01feea932f7f tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:16.592362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4444c971-7a55-4a8b-9a81-01feea932f7f tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:16.606232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4444c971-7a55-4a8b-9a81-01feea932f7f tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:16.607156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4444c971-7a55-4a8b-9a81-01feea932f7f tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:16.607787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4444c971-7a55-4a8b-9a81-01feea932f7f tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:16.613134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4444c971-7a55-4a8b-9a81-01feea932f7f tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:16.616379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4444c971-7a55-4a8b-9a81-01feea932f7f tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:16.621175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4444c971-7a55-4a8b-9a81-01feea932f7f tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:16.625902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:16.855282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-4444c971-7a55-4a8b-9a81-01feea932f7f tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] Lazy-loading 'services' on Instance uuid 77d543be-8594-4496-aa9d-0caae1cabf08 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:16.917214 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4444c971-7a55-4a8b-9a81-01feea932f7f tempest-ServersAdmin275Test-1359704734 tempest-ServersAdmin275Test-1359704734-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1922 microversion: 2.75 time: 0.341296 Aug 23 17:53:16.924071 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 333/649] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:16 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1922 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:16.968791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-524a8dd0-e333-42d2-9ac4-1a11bbcc0386 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:16.969444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-524a8dd0-e333-42d2-9ac4-1a11bbcc0386 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:16.995849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-524a8dd0-e333-42d2-9ac4-1a11bbcc0386 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:16.997539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-524a8dd0-e333-42d2-9ac4-1a11bbcc0386 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:17.000322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-524a8dd0-e333-42d2-9ac4-1a11bbcc0386 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:17.001290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-524a8dd0-e333-42d2-9ac4-1a11bbcc0386 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:17.015877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-524a8dd0-e333-42d2-9ac4-1a11bbcc0386 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:17.016647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-524a8dd0-e333-42d2-9ac4-1a11bbcc0386 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:17.086155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-09941bc4-07fe-45cb-87b0-7ebe3c87240b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:17.087803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-524a8dd0-e333-42d2-9ac4-1a11bbcc0386 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:53:17.105591 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-09941bc4-07fe-45cb-87b0-7ebe3c87240b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1471 microversion: 2.1 time: 1.105729 Aug 23 17:53:17.129119 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 317/650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:15 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1471 bytes in 1129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:17.143939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5f9de3af-80ee-4bd8-afd2-61c29ce3c2e9 req-121380d8-3928-4a4c-ac7f-6d60cd933ffc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4da944-47f7-4b06-9249-260dcdd68610", "name": "network-vif-unplugged", "status": "completed", "tag": "b3bc7d2d-b6b3-4cc1-9f85-2099cfcc50c4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:17.169376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5f9de3af-80ee-4bd8-afd2-61c29ce3c2e9 req-121380d8-3928-4a4c-ac7f-6d60cd933ffc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:17.170247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5f9de3af-80ee-4bd8-afd2-61c29ce3c2e9 req-121380d8-3928-4a4c-ac7f-6d60cd933ffc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:17.171032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5f9de3af-80ee-4bd8-afd2-61c29ce3c2e9 req-121380d8-3928-4a4c-ac7f-6d60cd933ffc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:17.216692 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5f9de3af-80ee-4bd8-afd2-61c29ce3c2e9 req-121380d8-3928-4a4c-ac7f-6d60cd933ffc service nova] Creating event network-vif-unplugged:b3bc7d2d-b6b3-4cc1-9f85-2099cfcc50c4 for instance 1e4da944-47f7-4b06-9249-260dcdd68610 on n-h2-850468-16 Aug 23 17:53:17.229867 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5f9de3af-80ee-4bd8-afd2-61c29ce3c2e9 req-121380d8-3928-4a4c-ac7f-6d60cd933ffc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096680 Aug 23 17:53:17.232197 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 318/651] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:17.240765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-354b778f-0aa5-458f-a17a-5dcb7c446d21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:17.242022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-354b778f-0aa5-458f-a17a-5dcb7c446d21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:17.251044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-354b778f-0aa5-458f-a17a-5dcb7c446d21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:17.252979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-354b778f-0aa5-458f-a17a-5dcb7c446d21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:17.253833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-354b778f-0aa5-458f-a17a-5dcb7c446d21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:17.255232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-354b778f-0aa5-458f-a17a-5dcb7c446d21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:17.257116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-354b778f-0aa5-458f-a17a-5dcb7c446d21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:17.258767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-354b778f-0aa5-458f-a17a-5dcb7c446d21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:17.343756 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-524a8dd0-e333-42d2-9ac4-1a11bbcc0386 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "DELETE /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 204 len: 0 microversion: 2.75 time: 0.379016 Aug 23 17:53:17.344639 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 334/652] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:53:16 2022] DELETE /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:53:17.367769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7f6a5815-335a-4c49-8dcc-38ab2c5d7620 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:17.369717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7f6a5815-335a-4c49-8dcc-38ab2c5d7620 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:17.389220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f6a5815-335a-4c49-8dcc-38ab2c5d7620 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:17.390178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f6a5815-335a-4c49-8dcc-38ab2c5d7620 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:17.390849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f6a5815-335a-4c49-8dcc-38ab2c5d7620 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:17.392773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f6a5815-335a-4c49-8dcc-38ab2c5d7620 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:17.394471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f6a5815-335a-4c49-8dcc-38ab2c5d7620 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:17.395449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f6a5815-335a-4c49-8dcc-38ab2c5d7620 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:17.641869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7f6a5815-335a-4c49-8dcc-38ab2c5d7620 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:17.652698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7f6a5815-335a-4c49-8dcc-38ab2c5d7620 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:17.663854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7f6a5815-335a-4c49-8dcc-38ab2c5d7620 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:17.695026 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7f6a5815-335a-4c49-8dcc-38ab2c5d7620 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1444 microversion: 2.75 time: 0.327201 Aug 23 17:53:17.712340 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 335/653] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:17 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1444 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:17.730376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d0e4e3e-8dbb-4fc3-ab3e-8745b8273066 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:17.730936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d0e4e3e-8dbb-4fc3-ab3e-8745b8273066 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:17.733889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=98 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:17.749934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d0e4e3e-8dbb-4fc3-ab3e-8745b8273066 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:17.752657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d0e4e3e-8dbb-4fc3-ab3e-8745b8273066 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:17.754029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d0e4e3e-8dbb-4fc3-ab3e-8745b8273066 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:17.755221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d0e4e3e-8dbb-4fc3-ab3e-8745b8273066 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:17.757991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d0e4e3e-8dbb-4fc3-ab3e-8745b8273066 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:17.763274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d0e4e3e-8dbb-4fc3-ab3e-8745b8273066 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:17.899920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6d0e4e3e-8dbb-4fc3-ab3e-8745b8273066 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:17.910695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6d0e4e3e-8dbb-4fc3-ab3e-8745b8273066 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:17.912448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6d0e4e3e-8dbb-4fc3-ab3e-8745b8273066 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:17.913740 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d0e4e3e-8dbb-4fc3-ab3e-8745b8273066 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1332 microversion: 2.25 time: 0.199639 Aug 23 17:53:17.926991 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 336/654] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:17 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1332 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:18.140715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb974548-12ee-4802-b03c-1acc41d639d7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:18.141191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eb974548-12ee-4802-b03c-1acc41d639d7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:18.153467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb974548-12ee-4802-b03c-1acc41d639d7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:18.156234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb974548-12ee-4802-b03c-1acc41d639d7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:18.158233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb974548-12ee-4802-b03c-1acc41d639d7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:18.159472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb974548-12ee-4802-b03c-1acc41d639d7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:18.160132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb974548-12ee-4802-b03c-1acc41d639d7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:18.160859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb974548-12ee-4802-b03c-1acc41d639d7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:18.220856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-354b778f-0aa5-458f-a17a-5dcb7c446d21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:18.233720 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-354b778f-0aa5-458f-a17a-5dcb7c446d21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 1.000094 Aug 23 17:53:18.234463 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 319/655] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:17 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:18.662576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eb974548-12ee-4802-b03c-1acc41d639d7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:18.671281 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eb974548-12ee-4802-b03c-1acc41d639d7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1471 microversion: 2.1 time: 0.534825 Aug 23 17:53:18.685341 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 337/656] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:18 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1471 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:18.723787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1d97f92e-b044-45db-9865-54197c7a715a tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:18.724536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1d97f92e-b044-45db-9865-54197c7a715a tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:18.735959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d97f92e-b044-45db-9865-54197c7a715a tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:18.736427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d97f92e-b044-45db-9865-54197c7a715a tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:18.736882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d97f92e-b044-45db-9865-54197c7a715a tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:18.737609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d97f92e-b044-45db-9865-54197c7a715a tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:18.743250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d97f92e-b044-45db-9865-54197c7a715a tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:18.743581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d97f92e-b044-45db-9865-54197c7a715a tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:18.878029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d97f92e-b044-45db-9865-54197c7a715a tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:18.893302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d97f92e-b044-45db-9865-54197c7a715a tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:18.898428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d97f92e-b044-45db-9865-54197c7a715a tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:18.912791 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1d97f92e-b044-45db-9865-54197c7a715a tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1444 microversion: 2.75 time: 0.193969 Aug 23 17:53:18.913715 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 320/657] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:18 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1444 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:18.940116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1dfb4340-9c0b-4514-903a-ce62fdb31fbc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:18.940983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1dfb4340-9c0b-4514-903a-ce62fdb31fbc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:18.957431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dfb4340-9c0b-4514-903a-ce62fdb31fbc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:18.958913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dfb4340-9c0b-4514-903a-ce62fdb31fbc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:18.959736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dfb4340-9c0b-4514-903a-ce62fdb31fbc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:18.960621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dfb4340-9c0b-4514-903a-ce62fdb31fbc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:18.961292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dfb4340-9c0b-4514-903a-ce62fdb31fbc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:18.962182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dfb4340-9c0b-4514-903a-ce62fdb31fbc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:19.027999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2104707373", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:19.172751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:53:19.497910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:53:19.498401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:53:19.498937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:53:19.499502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:53:19.500041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:53:19.511205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:19.511702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:19.512137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:19.512874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:19.513358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:19.513977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:19.534109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Getting quotas for project 88baf37ceb1342e3bc666ba96b4988ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:53:19.540151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Getting quotas for user 8d66dd8a72974b1791fa449fb91c3282 and project 88baf37ceb1342e3bc666ba96b4988ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:53:19.554696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:53:19.557591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:53:19.624909 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-94c18082-b58b-4ce1-b611-ef4b94028dc9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821745 Aug 23 17:53:19.625915 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 338/658] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:53:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:53:19.762220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4520804a-9b4a-4bf7-a056-2102efba3697 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ed14c5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-416127966", "description": "tempest-description-1432725493"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:19.789701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1dfb4340-9c0b-4514-903a-ce62fdb31fbc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:19.800794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1dfb4340-9c0b-4514-903a-ce62fdb31fbc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:19.804395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1dfb4340-9c0b-4514-903a-ce62fdb31fbc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:19.806738 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1dfb4340-9c0b-4514-903a-ce62fdb31fbc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.870591 Aug 23 17:53:19.824644 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 321/659] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:18 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 889 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:53:19.831901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7a1ea91f-c5f7-4635-acc5-f042e88ec2f3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:19.832789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7a1ea91f-c5f7-4635-acc5-f042e88ec2f3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:19.839926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a1ea91f-c5f7-4635-acc5-f042e88ec2f3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:19.840887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a1ea91f-c5f7-4635-acc5-f042e88ec2f3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:19.841394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a1ea91f-c5f7-4635-acc5-f042e88ec2f3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:19.842176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a1ea91f-c5f7-4635-acc5-f042e88ec2f3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:19.842760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a1ea91f-c5f7-4635-acc5-f042e88ec2f3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:19.843254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a1ea91f-c5f7-4635-acc5-f042e88ec2f3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:20.063257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a1ea91f-c5f7-4635-acc5-f042e88ec2f3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:20.073909 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7a1ea91f-c5f7-4635-acc5-f042e88ec2f3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 0.247634 Aug 23 17:53:20.075241 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 322/660] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:19 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:20.081632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c9099668-3600-4fd4-af84-6bf4cfefeb49 req-2ca31531-f4cf-4c46-8710-9b9bc134b5e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1e4da944-47f7-4b06-9249-260dcdd68610", "tag": "b3bc7d2d-b6b3-4cc1-9f85-2099cfcc50c4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:20.093791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c9099668-3600-4fd4-af84-6bf4cfefeb49 req-2ca31531-f4cf-4c46-8710-9b9bc134b5e7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:20.094441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c9099668-3600-4fd4-af84-6bf4cfefeb49 req-2ca31531-f4cf-4c46-8710-9b9bc134b5e7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:20.095385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c9099668-3600-4fd4-af84-6bf4cfefeb49 req-2ca31531-f4cf-4c46-8710-9b9bc134b5e7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:20.109610 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c9099668-3600-4fd4-af84-6bf4cfefeb49 req-2ca31531-f4cf-4c46-8710-9b9bc134b5e7 service nova] Creating event network-changed:b3bc7d2d-b6b3-4cc1-9f85-2099cfcc50c4 for instance 1e4da944-47f7-4b06-9249-260dcdd68610 on n-h2-850468-16 Aug 23 17:53:20.117614 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c9099668-3600-4fd4-af84-6bf4cfefeb49 req-2ca31531-f4cf-4c46-8710-9b9bc134b5e7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040326 Aug 23 17:53:20.120774 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 323/661] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:20.131252 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4520804a-9b4a-4bf7-a056-2102efba3697 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.503588 Aug 23 17:53:20.132147 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 339/662] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 17:53:19 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:20.138943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a09c4ba2-4991-465d-84da-d2915daad7ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:20.139571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a09c4ba2-4991-465d-84da-d2915daad7ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:20.145931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bf4891d0-2669-4c34-8d4e-0716d1322449 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:20.146690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bf4891d0-2669-4c34-8d4e-0716d1322449 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:20.164619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a09c4ba2-4991-465d-84da-d2915daad7ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:20.165284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a09c4ba2-4991-465d-84da-d2915daad7ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:20.166302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a09c4ba2-4991-465d-84da-d2915daad7ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:20.167232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a09c4ba2-4991-465d-84da-d2915daad7ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:20.167840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a09c4ba2-4991-465d-84da-d2915daad7ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:20.168417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a09c4ba2-4991-465d-84da-d2915daad7ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:20.374637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bf4891d0-2669-4c34-8d4e-0716d1322449 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:20.384578 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bf4891d0-2669-4c34-8d4e-0716d1322449 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1213 microversion: 2.1 time: 0.259067 Aug 23 17:53:20.385515 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 324/663] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:20 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1213 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:20.404080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc7672aa-6809-4966-97ae-9f59888b2195 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:20.404728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc7672aa-6809-4966-97ae-9f59888b2195 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:20.422657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7672aa-6809-4966-97ae-9f59888b2195 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:20.423195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7672aa-6809-4966-97ae-9f59888b2195 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:20.423753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7672aa-6809-4966-97ae-9f59888b2195 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:20.425037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7672aa-6809-4966-97ae-9f59888b2195 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:20.426447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7672aa-6809-4966-97ae-9f59888b2195 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:20.428941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7672aa-6809-4966-97ae-9f59888b2195 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:20.607553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a09c4ba2-4991-465d-84da-d2915daad7ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:20.617635 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a09c4ba2-4991-465d-84da-d2915daad7ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1471 microversion: 2.1 time: 0.484322 Aug 23 17:53:20.618221 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 340/664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:20 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1471 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:20.635945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c373fae6-664e-4db8-8023-1f1077f68646 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ed0468b0>, body: {"security_group_rule": {"parent_group_id": "28a8eb57-8cdc-4904-b1a8-484af76dca7b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:20.637480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc7672aa-6809-4966-97ae-9f59888b2195 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:20.656979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc7672aa-6809-4966-97ae-9f59888b2195 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:20.659668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc7672aa-6809-4966-97ae-9f59888b2195 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bc39304646834dac8c1dd65311536535', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb3d7bb9771d4263987873b4f635d778', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:20.687467 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc7672aa-6809-4966-97ae-9f59888b2195 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 200 len: 1444 microversion: 2.75 time: 0.295892 Aug 23 17:53:20.688285 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 325/665] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:20 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 1444 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:20.836187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-490d9834-e7eb-4a58-a688-f8a348171662 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:20.836953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-490d9834-e7eb-4a58-a688-f8a348171662 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:20.851973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-490d9834-e7eb-4a58-a688-f8a348171662 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:20.855754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-490d9834-e7eb-4a58-a688-f8a348171662 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:20.857006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-490d9834-e7eb-4a58-a688-f8a348171662 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:20.858203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-490d9834-e7eb-4a58-a688-f8a348171662 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:20.858851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-490d9834-e7eb-4a58-a688-f8a348171662 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:20.859453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-490d9834-e7eb-4a58-a688-f8a348171662 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:20.864642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:21.067439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-490d9834-e7eb-4a58-a688-f8a348171662 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:21.109342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-490d9834-e7eb-4a58-a688-f8a348171662 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:21.115082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-490d9834-e7eb-4a58-a688-f8a348171662 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:21.121275 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-490d9834-e7eb-4a58-a688-f8a348171662 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.288458 Aug 23 17:53:21.124160 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 326/666] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:20 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:53:21.138123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-909ff3ed-0cf1-4a94-b97b-839c9b33917a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:21.139041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-909ff3ed-0cf1-4a94-b97b-839c9b33917a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:21.145609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-909ff3ed-0cf1-4a94-b97b-839c9b33917a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:21.146394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-909ff3ed-0cf1-4a94-b97b-839c9b33917a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:21.147048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-909ff3ed-0cf1-4a94-b97b-839c9b33917a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:21.147971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-909ff3ed-0cf1-4a94-b97b-839c9b33917a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:21.148606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-909ff3ed-0cf1-4a94-b97b-839c9b33917a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:21.149536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-909ff3ed-0cf1-4a94-b97b-839c9b33917a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:21.435473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-909ff3ed-0cf1-4a94-b97b-839c9b33917a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:21.447583 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-909ff3ed-0cf1-4a94-b97b-839c9b33917a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 0.320410 Aug 23 17:53:21.448154 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 327/667] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:21 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:21.456859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc356648-a838-402b-9b8f-716803f7f90b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:21.457470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc356648-a838-402b-9b8f-716803f7f90b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:21.488155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc356648-a838-402b-9b8f-716803f7f90b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:21.488655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc356648-a838-402b-9b8f-716803f7f90b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:21.489092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc356648-a838-402b-9b8f-716803f7f90b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:21.490166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc356648-a838-402b-9b8f-716803f7f90b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:21.494325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc356648-a838-402b-9b8f-716803f7f90b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:21.495730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc356648-a838-402b-9b8f-716803f7f90b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:21.553252 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c373fae6-664e-4db8-8023-1f1077f68646 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.932989 Aug 23 17:53:21.554339 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 341/668] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 17:53:20 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:21.571202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7f3ef05f-2d9f-495f-aa12-0e345218615c tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ed2a1700>, body: {"security_group_rule": {"parent_group_id": "28a8eb57-8cdc-4904-b1a8-484af76dca7b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:21.613958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc356648-a838-402b-9b8f-716803f7f90b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:21.624220 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc356648-a838-402b-9b8f-716803f7f90b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1265 microversion: 2.1 time: 0.175016 Aug 23 17:53:21.638732 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 328/669] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:21 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:21.645390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-91fefed4-13a1-458d-8fcb-f5000d991cd6 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:21.646711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-91fefed4-13a1-458d-8fcb-f5000d991cd6 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:21.668079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91fefed4-13a1-458d-8fcb-f5000d991cd6 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:21.668631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91fefed4-13a1-458d-8fcb-f5000d991cd6 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:21.669079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91fefed4-13a1-458d-8fcb-f5000d991cd6 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:21.669813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91fefed4-13a1-458d-8fcb-f5000d991cd6 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:21.670275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91fefed4-13a1-458d-8fcb-f5000d991cd6 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:21.670726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91fefed4-13a1-458d-8fcb-f5000d991cd6 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:21.756641 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-7f3ef05f-2d9f-495f-aa12-0e345218615c tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] HTTP exception thrown: This rule already exists in group 28a8eb57-8cdc-4904-b1a8-484af76dca7b Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7f3ef05f-2d9f-495f-aa12-0e345218615c tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Request method failure captured: Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 138 Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQPhAT_ZbrOZw3MuPhH0YD2fMocGdpTYcY7mS2PmOqTIQT_9FQyBnpY_ykju4YJraxD5Q8ptSXaSxJAhGOjxt9JtqXlbRlhznfVtIZSIIl2bYg4cSAzF4Fb-M8bIyRBpHFpTmUbai1NzjVgJZMYx6qzEYohEySBT7IoBdmLjgHeGMU Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_407648268541424483dd31eda8b7c064"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/407648268541424483dd31eda8b7c064"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}] Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4c78b71a4f974312b30f93fe410b448b Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: {"security_group_rule": {"parent_group_id": "28a8eb57-8cdc-4904-b1a8-484af76dca7b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: exception: This rule already exists in group 28a8eb57-8cdc-4904-b1a8-484af76dca7b Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'security_group_rule': {'parent_group_id': '28a8eb57-8cdc-4904-b1a8-484af76dca7b', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 28a8eb57-8cdc-4904-b1a8-484af76dca7b Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 28a8eb57-8cdc-4904-b1a8-484af76dca7b Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:21.759767 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:21.764802 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:21.764802 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:21.764802 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 28a8eb57-8cdc-4904-b1a8-484af76dca7b Aug 23 17:53:21.764802 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:21.764802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7f3ef05f-2d9f-495f-aa12-0e345218615c tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Returning 400 to user: This rule already exists in group 28a8eb57-8cdc-4904-b1a8-484af76dca7b {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:21.764802 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7f3ef05f-2d9f-495f-aa12-0e345218615c tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.199039 Aug 23 17:53:21.764802 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 342/670] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 17:53:21 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 201 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 17:53:21.771413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6483f700-ed29-4c5c-8927-129c4f3d7cb2 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:21.772966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6483f700-ed29-4c5c-8927-129c4f3d7cb2 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] [instance: 77d543be-8594-4496-aa9d-0caae1cabf08] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:21.793765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6483f700-ed29-4c5c-8927-129c4f3d7cb2 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:21.794271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6483f700-ed29-4c5c-8927-129c4f3d7cb2 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:21.794749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6483f700-ed29-4c5c-8927-129c4f3d7cb2 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:21.795540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6483f700-ed29-4c5c-8927-129c4f3d7cb2 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:21.796011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6483f700-ed29-4c5c-8927-129c4f3d7cb2 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:21.796529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6483f700-ed29-4c5c-8927-129c4f3d7cb2 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:21.817496 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-6483f700-ed29-4c5c-8927-129c4f3d7cb2 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] HTTP exception thrown: Instance 77d543be-8594-4496-aa9d-0caae1cabf08 could not be found. Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6483f700-ed29-4c5c-8927-129c4f3d7cb2 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Request method failure captured: Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 HTTP/1.1 Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRO7Nz4jdQadFZicUL6Nc1eHM__GNt-XEVUUZgC-F8bBdvc0A_nFJuZv6bBkbIXsg_9Eyx7_V6xIL5MkztE_k4aXe1JJ6hsEmBQGLtAqTascbAvvyQb9ptyPYFf5jpnqRtdcFtLQ3SBVfyLrTazJyU1dMDCGldNkXRav4X3syNnBnBY Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.75 Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: cb3d7bb9771d4263987873b4f635d778 Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersAdmin275Test-1018530572 Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cb3d7bb9771d4263987873b4f635d778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cb3d7bb9771d4263987873b4f635d778"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cb3d7bb9771d4263987873b4f635d778"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cb3d7bb9771d4263987873b4f635d778"}]}] Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersAdmin275Test-1018530572 Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: cb3d7bb9771d4263987873b4f635d778 Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersAdmin275Test-1018530572 Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersAdmin275Test-1018530572-project Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: bc39304646834dac8c1dd65311536535 Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersAdmin275Test-1018530572-project Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 77d543be-8594-4496-aa9d-0caae1cabf08 could not be found. Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '77d543be-8594-4496-aa9d-0caae1cabf08'} Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77d543be-8594-4496-aa9d-0caae1cabf08 could not be found. Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77d543be-8594-4496-aa9d-0caae1cabf08 could not be found. Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:21.819571 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:21.825864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:21.825864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:21.825864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:21.825864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:21.825864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:21.825864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77d543be-8594-4496-aa9d-0caae1cabf08 could not be found. Aug 23 17:53:21.825864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:21.825864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6483f700-ed29-4c5c-8927-129c4f3d7cb2 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] Returning 404 to user: Instance 77d543be-8594-4496-aa9d-0caae1cabf08 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:21.825864 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6483f700-ed29-4c5c-8927-129c4f3d7cb2 tempest-ServersAdmin275Test-1018530572 tempest-ServersAdmin275Test-1018530572-project] 10.222.0.61 "GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08" status: 404 len: 111 microversion: 2.75 time: 0.057713 Aug 23 17:53:21.825864 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 343/671] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:21 2022] GET /compute/v2.1/servers/77d543be-8594-4496-aa9d-0caae1cabf08 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:53:21.827520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dfc9eb28-46a9-47fc-a16d-ce71ad668fe1 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Calling method '.version_select at 0x7f27ed046430>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:22.114054 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dfc9eb28-46a9-47fc-a16d-ce71ad668fe1 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-group-rules/f20645c8-f4d1-4d67-aa5a-c45b4848eada" status: 202 len: 0 microversion: 2.1 time: 0.290896 Aug 23 17:53:22.115033 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 344/672] 10.222.0.61 () {58 vars in 1287 bytes} [Tue Aug 23 17:53:21 2022] DELETE /compute/v2.1/os-security-group-rules/f20645c8-f4d1-4d67-aa5a-c45b4848eada => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:53:22.124003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-727f3f20-36cd-4bdd-8fab-7d52444d9bf5 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ed138670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1185903013", "description": "tempest-description-34277645"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:22.199925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-91fefed4-13a1-458d-8fcb-f5000d991cd6 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:22.214780 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-91fefed4-13a1-458d-8fcb-f5000d991cd6 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1477 microversion: 2.1 time: 0.579746 Aug 23 17:53:22.216147 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 329/673] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:21 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1477 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:22.221624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-04d368ef-f95a-4f17-b88c-cf165007f940 req-79fcb822-b8a2-40a2-9ee8-986764174006 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9504575-e074-4aad-871d-bcb9db7a22e3", "tag": "039de3f2-8782-4e97-9d10-be32f83014de"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:22.231609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-04d368ef-f95a-4f17-b88c-cf165007f940 req-79fcb822-b8a2-40a2-9ee8-986764174006 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:22.232364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-04d368ef-f95a-4f17-b88c-cf165007f940 req-79fcb822-b8a2-40a2-9ee8-986764174006 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:22.232978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-04d368ef-f95a-4f17-b88c-cf165007f940 req-79fcb822-b8a2-40a2-9ee8-986764174006 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:22.250120 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-04d368ef-f95a-4f17-b88c-cf165007f940 req-79fcb822-b8a2-40a2-9ee8-986764174006 service nova] Creating event network-changed:039de3f2-8782-4e97-9d10-be32f83014de for instance b9504575-e074-4aad-871d-bcb9db7a22e3 on n-h1-850468-16 Aug 23 17:53:22.256711 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-04d368ef-f95a-4f17-b88c-cf165007f940 req-79fcb822-b8a2-40a2-9ee8-986764174006 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039223 Aug 23 17:53:22.257562 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 330/674] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:22.263447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-76413c27-b10b-4151-88ad-5e17a638d7ca tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:22.264149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-76413c27-b10b-4151-88ad-5e17a638d7ca tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:22.278231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76413c27-b10b-4151-88ad-5e17a638d7ca tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:22.279950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76413c27-b10b-4151-88ad-5e17a638d7ca tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:22.280394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76413c27-b10b-4151-88ad-5e17a638d7ca tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:22.281410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76413c27-b10b-4151-88ad-5e17a638d7ca tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:22.281872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76413c27-b10b-4151-88ad-5e17a638d7ca tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:22.286578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76413c27-b10b-4151-88ad-5e17a638d7ca tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:22.479314 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-727f3f20-36cd-4bdd-8fab-7d52444d9bf5 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.359381 Aug 23 17:53:22.480929 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 345/675] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 17:53:22 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:22.487113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8857b942-df44-42a3-a7e3-0f53265d88a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:22.488183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8857b942-df44-42a3-a7e3-0f53265d88a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:22.507049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8857b942-df44-42a3-a7e3-0f53265d88a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:22.515257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8857b942-df44-42a3-a7e3-0f53265d88a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:22.515935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8857b942-df44-42a3-a7e3-0f53265d88a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:22.518399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8857b942-df44-42a3-a7e3-0f53265d88a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:22.519073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8857b942-df44-42a3-a7e3-0f53265d88a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:22.519686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8857b942-df44-42a3-a7e3-0f53265d88a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:22.601336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-76413c27-b10b-4151-88ad-5e17a638d7ca tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:22.621786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-76413c27-b10b-4151-88ad-5e17a638d7ca tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:22.624910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-76413c27-b10b-4151-88ad-5e17a638d7ca tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:22.629487 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-76413c27-b10b-4151-88ad-5e17a638d7ca tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.370594 Aug 23 17:53:22.646494 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 331/676] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:22 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:22.659292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e646406c-c241-43d6-9f8a-8fafbe0749e1 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ecced3a0>, body: {"security_group_rule": {"parent_group_id": "1064f894-47e5-46a9-9158-743af51f0a53", "ip_protocol": "tcp", "from_port": 1073327009, "to_port": 22}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:22.832004 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-e646406c-c241-43d6-9f8a-8fafbe0749e1 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] HTTP exception thrown: Invalid port range 1073327009:22. Former value cannot be greater than the later Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e646406c-c241-43d6-9f8a-8fafbe0749e1 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Request method failure captured: Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 146 Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRQPhAT_ZbrOZw3MuPhH0YD2fMocGdpTYcY7mS2PmOqTIQT_9FQyBnpY_ykju4YJraxD5Q8ptSXaSxJAhGOjxt9JtqXlbRlhznfVtIZSIIl2bYg4cSAzF4Fb-M8bIyRBpHFpTmUbai1NzjVgJZMYx6qzEYohEySBT7IoBdmLjgHeGMU Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_407648268541424483dd31eda8b7c064"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/407648268541424483dd31eda8b7c064"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}] Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4c78b71a4f974312b30f93fe410b448b Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: {"security_group_rule": {"parent_group_id": "1064f894-47e5-46a9-9158-743af51f0a53", "ip_protocol": "tcp", "from_port": 1073327009, "to_port": 22}} Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid port range 1073327009:22. Former value cannot be greater than the later Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'security_group_rule': {'parent_group_id': '1064f894-47e5-46a9-9158-743af51f0a53', 'ip_protocol': 'tcp', 'from_port': 1073327009, 'to_port': 22}}} Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 1073327009:22. Former value cannot be greater than the later Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 1073327009:22. Former value cannot be greater than the later Aug 23 17:53:22.835679 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:22.839356 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:22.839356 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:22.839356 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:22.839356 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:22.839356 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:22.839356 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:22.839356 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:22.839356 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 1073327009:22. Former value cannot be greater than the later Aug 23 17:53:22.839356 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:22.839969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8857b942-df44-42a3-a7e3-0f53265d88a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:22.842806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e646406c-c241-43d6-9f8a-8fafbe0749e1 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Returning 400 to user: Invalid port range 1073327009:22. Former value cannot be greater than the later {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:22.843973 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e646406c-c241-43d6-9f8a-8fafbe0749e1 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 123 microversion: 2.1 time: 0.197780 Aug 23 17:53:22.845566 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 332/677] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 17:53:22 2022] POST /compute/v2.1/os-security-group-rules => generated 123 bytes in 200 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:53:22.848876 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8857b942-df44-42a3-a7e3-0f53265d88a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 0.366521 Aug 23 17:53:22.857511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c59817b3-a7ce-4c2a-b9c5-2f273d757f16 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:22.859803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c59817b3-a7ce-4c2a-b9c5-2f273d757f16 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:22.864187 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 346/678] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:22 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:22.868714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c59817b3-a7ce-4c2a-b9c5-2f273d757f16 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:22.869907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c59817b3-a7ce-4c2a-b9c5-2f273d757f16 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:22.870570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c59817b3-a7ce-4c2a-b9c5-2f273d757f16 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:22.871625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c59817b3-a7ce-4c2a-b9c5-2f273d757f16 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:22.872624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c59817b3-a7ce-4c2a-b9c5-2f273d757f16 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:22.873387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c59817b3-a7ce-4c2a-b9c5-2f273d757f16 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:22.876293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e6db356-4d00-443b-bce2-87184478d464 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ed1d7d30>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1069547209", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:22.888631 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2e6db356-4d00-443b-bce2-87184478d464 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] HTTP exception thrown: Security group id should be uuid Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e6db356-4d00-443b-bce2-87184478d464 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Request method failure captured: Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 131 Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQPhAT_ZbrOZw3MuPhH0YD2fMocGdpTYcY7mS2PmOqTIQT_9FQyBnpY_ykju4YJraxD5Q8ptSXaSxJAhGOjxt9JtqXlbRlhznfVtIZSIIl2bYg4cSAzF4Fb-M8bIyRBpHFpTmUbai1NzjVgJZMYx6qzEYohEySBT7IoBdmLjgHeGMU Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_407648268541424483dd31eda8b7c064"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/407648268541424483dd31eda8b7c064"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}] Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4c78b71a4f974312b30f93fe410b448b Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-1069547209", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: exception: Security group id should be uuid Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-1069547209', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:22.890177 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:22.895148 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Aug 23 17:53:22.895148 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:22.895148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e6db356-4d00-443b-bce2-87184478d464 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Returning 400 to user: Security group id should be uuid {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:22.897921 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e6db356-4d00-443b-bce2-87184478d464 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.027378 Aug 23 17:53:22.902683 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 347/679] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 17:53:22 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:53:22.922198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-08d60c40-2ff0-4577-ae89-0d49b735c0a5 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ee97d550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1690633869", "description": "tempest-description-2004959267"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:23.013081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c59817b3-a7ce-4c2a-b9c5-2f273d757f16 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:23.038373 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c59817b3-a7ce-4c2a-b9c5-2f273d757f16 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1271 microversion: 2.1 time: 0.191479 Aug 23 17:53:23.039446 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 333/680] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:22 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1271 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:23.121517 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-08d60c40-2ff0-4577-ae89-0d49b735c0a5 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 0.208936 Aug 23 17:53:23.122185 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 348/681] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 17:53:22 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:23.137584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ec331365-d114-490a-8930-e2cfc6fed880 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ece7d4c0>, body: {"security_group_rule": {"parent_group_id": "8011a0e7-10db-4197-80de-cc51850308dc", "ip_protocol": "tempest-999-1911308323", "from_port": 22, "to_port": 22}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:23.242156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e18add4-42da-486f-b460-398d9d2614f8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:23.242811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2e18add4-42da-486f-b460-398d9d2614f8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:23.249854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e18add4-42da-486f-b460-398d9d2614f8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:23.251808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e18add4-42da-486f-b460-398d9d2614f8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:23.252734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e18add4-42da-486f-b460-398d9d2614f8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:23.254163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e18add4-42da-486f-b460-398d9d2614f8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:23.255123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e18add4-42da-486f-b460-398d9d2614f8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:23.255849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e18add4-42da-486f-b460-398d9d2614f8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:23.260962 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-ec331365-d114-490a-8930-e2cfc6fed880 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] HTTP exception thrown: Invalid IP protocol tempest-999-1911308323. Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ec331365-d114-490a-8930-e2cfc6fed880 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Request method failure captured: Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 157 Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRQPhAT_ZbrOZw3MuPhH0YD2fMocGdpTYcY7mS2PmOqTIQT_9FQyBnpY_ykju4YJraxD5Q8ptSXaSxJAhGOjxt9JtqXlbRlhznfVtIZSIIl2bYg4cSAzF4Fb-M8bIyRBpHFpTmUbai1NzjVgJZMYx6qzEYohEySBT7IoBdmLjgHeGMU Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_407648268541424483dd31eda8b7c064"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/407648268541424483dd31eda8b7c064"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}] Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4c78b71a4f974312b30f93fe410b448b Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: {"security_group_rule": {"parent_group_id": "8011a0e7-10db-4197-80de-cc51850308dc", "ip_protocol": "tempest-999-1911308323", "from_port": 22, "to_port": 22}} Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid IP protocol tempest-999-1911308323. Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8011a0e7-10db-4197-80de-cc51850308dc', 'ip_protocol': 'tempest-999-1911308323', 'from_port': 22, 'to_port': 22}}} Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1911308323. Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1911308323. Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:23.262663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:23.267390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:23.267390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:23.267390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:23.267390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:23.267390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:23.267390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:23.267390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1911308323. Aug 23 17:53:23.267390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:23.267390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ec331365-d114-490a-8930-e2cfc6fed880 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Returning 400 to user: Invalid IP protocol tempest-999-1911308323. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:23.267390 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ec331365-d114-490a-8930-e2cfc6fed880 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.133358 Aug 23 17:53:23.270770 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 334/682] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 17:53:23 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:53:23.280057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b4d23899-a473-4851-83b0-a3921c573e36 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ed5058b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-166533133", "description": "tempest-description-1896466017"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:23.456446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2e18add4-42da-486f-b460-398d9d2614f8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:23.472991 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e18add4-42da-486f-b460-398d9d2614f8 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1477 microversion: 2.1 time: 0.235267 Aug 23 17:53:23.486900 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 349/683] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:23 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1477 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:23.640732 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b4d23899-a473-4851-83b0-a3921c573e36 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.355866 Aug 23 17:53:23.643527 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 335/684] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 17:53:23 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:23.655603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9325c29-c57d-412b-bdd1-4f1b54b0afb0 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ed0460d0>, body: {"security_group_rule": {"parent_group_id": "a0f3cef8-8def-4a93-9dea-f8f938624ae5", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:23.661737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fc7917f3-0471-4f65-a098-4d6c82e7c3fa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:23.663608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fc7917f3-0471-4f65-a098-4d6c82e7c3fa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:23.685556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc7917f3-0471-4f65-a098-4d6c82e7c3fa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:23.686062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc7917f3-0471-4f65-a098-4d6c82e7c3fa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:23.686525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc7917f3-0471-4f65-a098-4d6c82e7c3fa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:23.698878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc7917f3-0471-4f65-a098-4d6c82e7c3fa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:23.699776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc7917f3-0471-4f65-a098-4d6c82e7c3fa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:23.700240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc7917f3-0471-4f65-a098-4d6c82e7c3fa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:23.722641 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-d9325c29-c57d-412b-bdd1-4f1b54b0afb0 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9325c29-c57d-412b-bdd1-4f1b54b0afb0 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Request method failure captured: Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 138 Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQPhAT_ZbrOZw3MuPhH0YD2fMocGdpTYcY7mS2PmOqTIQT_9FQyBnpY_ykju4YJraxD5Q8ptSXaSxJAhGOjxt9JtqXlbRlhznfVtIZSIIl2bYg4cSAzF4Fb-M8bIyRBpHFpTmUbai1NzjVgJZMYx6qzEYohEySBT7IoBdmLjgHeGMU Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_407648268541424483dd31eda8b7c064"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/407648268541424483dd31eda8b7c064"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}] Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4c78b71a4f974312b30f93fe410b448b Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: {"security_group_rule": {"parent_group_id": "a0f3cef8-8def-4a93-9dea-f8f938624ae5", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid port range 22:21. Former value cannot be greater than the later Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'a0f3cef8-8def-4a93-9dea-f8f938624ae5', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Aug 23 17:53:23.724234 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:23.728942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:23.728942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:23.728942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:23.728942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:23.728942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:23.728942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:23.728942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:23.728942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Aug 23 17:53:23.728942 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:23.728942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9325c29-c57d-412b-bdd1-4f1b54b0afb0 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:23.728942 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d9325c29-c57d-412b-bdd1-4f1b54b0afb0 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.074108 Aug 23 17:53:23.730795 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 350/685] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 17:53:23 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 79 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:53:23.738055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-50282d32-b493-4c33-96f4-c85ed62915ff tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ece37550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-417440677", "description": "tempest-description-2022733102"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:24.175543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fc7917f3-0471-4f65-a098-4d6c82e7c3fa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:24.186130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fc7917f3-0471-4f65-a098-4d6c82e7c3fa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:24.188190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fc7917f3-0471-4f65-a098-4d6c82e7c3fa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:24.191191 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fc7917f3-0471-4f65-a098-4d6c82e7c3fa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.536471 Aug 23 17:53:24.192400 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 336/686] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:23 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:53:24.210147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3e73b5a7-2062-4b13-b30a-439c2c99b745 req-93cda196-502b-4942-8a85-af377ea44a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a4f4f5-5f3a-4907-a471-005e1f790e8b", "name": "network-vif-unplugged", "status": "completed", "tag": "667d527b-7ec9-4bdb-951c-0b3029adcb79"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:24.224674 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-50282d32-b493-4c33-96f4-c85ed62915ff tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.493037 Aug 23 17:53:24.225587 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 351/687] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 17:53:23 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:24.228772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3e73b5a7-2062-4b13-b30a-439c2c99b745 req-93cda196-502b-4942-8a85-af377ea44a72 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:24.229486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3e73b5a7-2062-4b13-b30a-439c2c99b745 req-93cda196-502b-4942-8a85-af377ea44a72 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:24.230458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3e73b5a7-2062-4b13-b30a-439c2c99b745 req-93cda196-502b-4942-8a85-af377ea44a72 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:24.239384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa6214da-7acc-40b2-9e5e-2345d0e0342e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:24.240104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fa6214da-7acc-40b2-9e5e-2345d0e0342e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:24.259207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa6214da-7acc-40b2-9e5e-2345d0e0342e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:24.259692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa6214da-7acc-40b2-9e5e-2345d0e0342e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:24.260126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa6214da-7acc-40b2-9e5e-2345d0e0342e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:24.260838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa6214da-7acc-40b2-9e5e-2345d0e0342e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:24.261291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa6214da-7acc-40b2-9e5e-2345d0e0342e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:24.261713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa6214da-7acc-40b2-9e5e-2345d0e0342e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:24.273501 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3e73b5a7-2062-4b13-b30a-439c2c99b745 req-93cda196-502b-4942-8a85-af377ea44a72 service nova] Creating event network-vif-unplugged:667d527b-7ec9-4bdb-951c-0b3029adcb79 for instance 69a4f4f5-5f3a-4907-a471-005e1f790e8b on n-h1-850468-16 Aug 23 17:53:24.285771 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3e73b5a7-2062-4b13-b30a-439c2c99b745 req-93cda196-502b-4942-8a85-af377ea44a72 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.091850 Aug 23 17:53:24.287576 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 337/688] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:24.301966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d0f52a4-0d05-4e1f-b30b-33faf7016343 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:24.303295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7d0f52a4-0d05-4e1f-b30b-33faf7016343 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:24.314935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d0f52a4-0d05-4e1f-b30b-33faf7016343 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:24.315719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d0f52a4-0d05-4e1f-b30b-33faf7016343 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:24.316592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d0f52a4-0d05-4e1f-b30b-33faf7016343 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:24.317815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d0f52a4-0d05-4e1f-b30b-33faf7016343 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:24.318447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d0f52a4-0d05-4e1f-b30b-33faf7016343 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:24.319293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d0f52a4-0d05-4e1f-b30b-33faf7016343 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:24.584435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fa6214da-7acc-40b2-9e5e-2345d0e0342e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:24.597391 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fa6214da-7acc-40b2-9e5e-2345d0e0342e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 0.369278 Aug 23 17:53:24.597620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7d0f52a4-0d05-4e1f-b30b-33faf7016343 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:24.598584 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 352/689] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:24 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:24.606765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8576e3d9-d167-4b7f-a6f5-35bb225724d9 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ed046040>, body: {"security_group_rule": {"parent_group_id": "76b57974-51d1-4f83-a99a-1985160bed18", "ip_protocol": "tcp", "from_port": 22, "to_port": 1230301993}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:24.628438 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7d0f52a4-0d05-4e1f-b30b-33faf7016343 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1313 microversion: 2.1 time: 0.339145 Aug 23 17:53:24.632974 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 338/690] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:24 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:24.644022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-99927ff0-f3bc-4f6b-80f1-a74e97d6e90a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:24.650069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-99927ff0-f3bc-4f6b-80f1-a74e97d6e90a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:24.668417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99927ff0-f3bc-4f6b-80f1-a74e97d6e90a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:24.671107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99927ff0-f3bc-4f6b-80f1-a74e97d6e90a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:24.671861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99927ff0-f3bc-4f6b-80f1-a74e97d6e90a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:24.673937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99927ff0-f3bc-4f6b-80f1-a74e97d6e90a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:24.676184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99927ff0-f3bc-4f6b-80f1-a74e97d6e90a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:24.677097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99927ff0-f3bc-4f6b-80f1-a74e97d6e90a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:24.725955 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-8576e3d9-d167-4b7f-a6f5-35bb225724d9 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] HTTP exception thrown: Invalid port range 22:1230301993. Valid TCP ports should be between 1-65535 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8576e3d9-d167-4b7f-a6f5-35bb225724d9 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Request method failure captured: Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 146 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQPhAT_ZbrOZw3MuPhH0YD2fMocGdpTYcY7mS2PmOqTIQT_9FQyBnpY_ykju4YJraxD5Q8ptSXaSxJAhGOjxt9JtqXlbRlhznfVtIZSIIl2bYg4cSAzF4Fb-M8bIyRBpHFpTmUbai1NzjVgJZMYx6qzEYohEySBT7IoBdmLjgHeGMU Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_407648268541424483dd31eda8b7c064"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/407648268541424483dd31eda8b7c064"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}] Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4c78b71a4f974312b30f93fe410b448b Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: {"security_group_rule": {"parent_group_id": "76b57974-51d1-4f83-a99a-1985160bed18", "ip_protocol": "tcp", "from_port": 22, "to_port": 1230301993}} Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid port range 22:1230301993. Valid TCP ports should be between 1-65535 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'security_group_rule': {'parent_group_id': '76b57974-51d1-4f83-a99a-1985160bed18', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1230301993}}} Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1230301993. Valid TCP ports should be between 1-65535 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1230301993. Valid TCP ports should be between 1-65535 Aug 23 17:53:24.728651 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:24.732642 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:24.732642 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:24.732642 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:24.732642 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:24.732642 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:24.732642 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:24.732642 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:24.732642 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1230301993. Valid TCP ports should be between 1-65535 Aug 23 17:53:24.732642 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:24.735144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8576e3d9-d167-4b7f-a6f5-35bb225724d9 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Returning 400 to user: Invalid port range 22:1230301993. Valid TCP ports should be between 1-65535 {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:24.736938 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8576e3d9-d167-4b7f-a6f5-35bb225724d9 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.137071 Aug 23 17:53:24.737587 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 353/691] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 17:53:24 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:53:24.739075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=12 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:24.751326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb6bc6fd-9726-4ed4-9b24-31da6027e5bf tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Action: 'create', calling method: .version_select at 0x7f27ed2a14c0>, body: {"security_group_rule": {"parent_group_id": "e0134f6c-5ff1-4525-9b41-0b892efccde9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:24.866275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-eb6bc6fd-9726-4ed4-9b24-31da6027e5bf tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e0134f6c-5ff1-4525-9b41-0b892efccde9 does not exist", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 17:53:24.866975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.security_group_api [None req-eb6bc6fd-9726-4ed4-9b24-31da6027e5bf tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Neutron security group e0134f6c-5ff1-4525-9b41-0b892efccde9 not found {{(pid=128807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 17:53:24.868821 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-eb6bc6fd-9726-4ed4-9b24-31da6027e5bf tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] HTTP exception thrown: Security group e0134f6c-5ff1-4525-9b41-0b892efccde9 does not exist Aug 23 17:53:24.868821 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-2ba3b98c-23df-4a10-ae72-b0e8b15e0293'] Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb6bc6fd-9726-4ed4-9b24-31da6027e5bf tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Request method failure captured: Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 138 Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQPhAT_ZbrOZw3MuPhH0YD2fMocGdpTYcY7mS2PmOqTIQT_9FQyBnpY_ykju4YJraxD5Q8ptSXaSxJAhGOjxt9JtqXlbRlhznfVtIZSIIl2bYg4cSAzF4Fb-M8bIyRBpHFpTmUbai1NzjVgJZMYx6qzEYohEySBT7IoBdmLjgHeGMU Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_407648268541424483dd31eda8b7c064"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/407648268541424483dd31eda8b7c064"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}] Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4c78b71a4f974312b30f93fe410b448b Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: {"security_group_rule": {"parent_group_id": "e0134f6c-5ff1-4525-9b41-0b892efccde9", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: exception: Security group e0134f6c-5ff1-4525-9b41-0b892efccde9 does not exist Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-2ba3b98c-23df-4a10-ae72-b0e8b15e0293'] Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'e0134f6c-5ff1-4525-9b41-0b892efccde9', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 17:53:24.873630 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e0134f6c-5ff1-4525-9b41-0b892efccde9 does not exist Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ba3b98c-23df-4a10-ae72-b0e8b15e0293'] Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e0134f6c-5ff1-4525-9b41-0b892efccde9 does not exist Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ba3b98c-23df-4a10-ae72-b0e8b15e0293'] Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e0134f6c-5ff1-4525-9b41-0b892efccde9 does not exist Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ba3b98c-23df-4a10-ae72-b0e8b15e0293'] Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e0134f6c-5ff1-4525-9b41-0b892efccde9 does not exist Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-2ba3b98c-23df-4a10-ae72-b0e8b15e0293'] Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb6bc6fd-9726-4ed4-9b24-31da6027e5bf tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Returning 404 to user: Security group e0134f6c-5ff1-4525-9b41-0b892efccde9 does not exist Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-2ba3b98c-23df-4a10-ae72-b0e8b15e0293'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eb6bc6fd-9726-4ed4-9b24-31da6027e5bf tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.130071 Aug 23 17:53:24.878531 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 354/692] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 17:53:24 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 17:53:24.887784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47228e65-5a6c-41fb-9abb-ac52d068dc87 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Calling method '.version_select at 0x7f27ed3e0040>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:24.949840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-99927ff0-f3bc-4f6b-80f1-a74e97d6e90a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:24.963408 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-99927ff0-f3bc-4f6b-80f1-a74e97d6e90a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1477 microversion: 2.1 time: 0.328456 Aug 23 17:53:24.975850 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 339/693] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:24 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1477 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:25.147216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-47228e65-5a6c-41fb-9abb-ac52d068dc87 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule 55c1cd06-711d-4b5b-afe6-2f11672c9b81 does not exist", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 17:53:25.148274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.security_group_api [None req-47228e65-5a6c-41fb-9abb-ac52d068dc87 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Neutron security group rule 55c1cd06-711d-4b5b-afe6-2f11672c9b81 not found {{(pid=128807) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Aug 23 17:53:25.149002 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-47228e65-5a6c-41fb-9abb-ac52d068dc87 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] HTTP exception thrown: Security group rule 55c1cd06-711d-4b5b-afe6-2f11672c9b81 does not exist Aug 23 17:53:25.149002 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-f882888e-6e09-45a7-9dc3-e96b31bc0e7c'] Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47228e65-5a6c-41fb-9abb-ac52d068dc87 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Request method failure captured: Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-security-group-rules/55c1cd06-711d-4b5b-afe6-2f11672c9b81 HTTP/1.1 Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQPhAT_ZbrOZw3MuPhH0YD2fMocGdpTYcY7mS2PmOqTIQT_9FQyBnpY_ykju4YJraxD5Q8ptSXaSxJAhGOjxt9JtqXlbRlhznfVtIZSIIl2bYg4cSAzF4Fb-M8bIyRBpHFpTmUbai1NzjVgJZMYx6qzEYohEySBT7IoBdmLjgHeGMU Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_407648268541424483dd31eda8b7c064"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/407648268541424483dd31eda8b7c064"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/407648268541424483dd31eda8b7c064"}]}] Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 407648268541424483dd31eda8b7c064 Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986 Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4c78b71a4f974312b30f93fe410b448b Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-570391986-project Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: exception: Security group rule 55c1cd06-711d-4b5b-afe6-2f11672c9b81 does not exist Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-f882888e-6e09-45a7-9dc3-e96b31bc0e7c'] Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '55c1cd06-711d-4b5b-afe6-2f11672c9b81'} Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1064, in show_security_group_rule Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 17:53:25.151472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule 55c1cd06-711d-4b5b-afe6-2f11672c9b81 does not exist Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f882888e-6e09-45a7-9dc3-e96b31bc0e7c'] Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule 55c1cd06-711d-4b5b-afe6-2f11672c9b81 does not exist Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f882888e-6e09-45a7-9dc3-e96b31bc0e7c'] Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule 55c1cd06-711d-4b5b-afe6-2f11672c9b81 does not exist Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f882888e-6e09-45a7-9dc3-e96b31bc0e7c'] Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule 55c1cd06-711d-4b5b-afe6-2f11672c9b81 does not exist Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-f882888e-6e09-45a7-9dc3-e96b31bc0e7c'] Aug 23 17:53:25.155047 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:25.165456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47228e65-5a6c-41fb-9abb-ac52d068dc87 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Returning 404 to user: Security group rule 55c1cd06-711d-4b5b-afe6-2f11672c9b81 does not exist Aug 23 17:53:25.165456 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-f882888e-6e09-45a7-9dc3-e96b31bc0e7c'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:25.167216 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-47228e65-5a6c-41fb-9abb-ac52d068dc87 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-group-rules/55c1cd06-711d-4b5b-afe6-2f11672c9b81" status: 404 len: 199 microversion: 2.1 time: 0.283858 Aug 23 17:53:25.168563 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 355/694] 10.222.0.61 () {58 vars in 1287 bytes} [Tue Aug 23 17:53:24 2022] DELETE /compute/v2.1/os-security-group-rules/55c1cd06-711d-4b5b-afe6-2f11672c9b81 => generated 199 bytes in 286 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:53:25.179318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-8cb5f85e-ba1c-45b8-b331-d81caaad3bd6 req-75f76a5e-8f74-4dca-b6ab-32ea567e2592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4", "tag": "ee6fb24a-f8ec-4d67-b529-6a7b42386fd6"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:25.195818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8cb5f85e-ba1c-45b8-b331-d81caaad3bd6 req-75f76a5e-8f74-4dca-b6ab-32ea567e2592 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:25.196316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8cb5f85e-ba1c-45b8-b331-d81caaad3bd6 req-75f76a5e-8f74-4dca-b6ab-32ea567e2592 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:25.196859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8cb5f85e-ba1c-45b8-b331-d81caaad3bd6 req-75f76a5e-8f74-4dca-b6ab-32ea567e2592 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:25.210348 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-8cb5f85e-ba1c-45b8-b331-d81caaad3bd6 req-75f76a5e-8f74-4dca-b6ab-32ea567e2592 service nova] Creating event network-changed:ee6fb24a-f8ec-4d67-b529-6a7b42386fd6 for instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 on n-h2-850468-16 Aug 23 17:53:25.216725 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-8cb5f85e-ba1c-45b8-b331-d81caaad3bd6 req-75f76a5e-8f74-4dca-b6ab-32ea567e2592 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046150 Aug 23 17:53:25.217322 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 356/695] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:25.224254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b693792e-732e-4eb9-9f15-ef31f73597b8 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Calling method '.version_select at 0x7f27ed3e01f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:25.439921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-405f784c-1038-42f3-86f6-6140354a80e1 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Action: 'update', calling method: .version_select at 0x7f27ed199dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:25.650134 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b693792e-732e-4eb9-9f15-ef31f73597b8 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/76b57974-51d1-4f83-a99a-1985160bed18" status: 202 len: 0 microversion: 2.1 time: 0.431335 Aug 23 17:53:25.650945 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 357/696] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 17:53:25 2022] DELETE /compute/v2.1/os-security-groups/76b57974-51d1-4f83-a99a-1985160bed18 => generated 0 bytes in 433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:53:25.662263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25efef71-a20b-4d4a-8147-430469a433d7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:25.664553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-25efef71-a20b-4d4a-8147-430469a433d7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:25.672566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25efef71-a20b-4d4a-8147-430469a433d7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:25.676100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25efef71-a20b-4d4a-8147-430469a433d7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:25.680446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25efef71-a20b-4d4a-8147-430469a433d7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:25.685088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25efef71-a20b-4d4a-8147-430469a433d7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:25.685780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25efef71-a20b-4d4a-8147-430469a433d7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:25.686465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25efef71-a20b-4d4a-8147-430469a433d7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:25.743746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-405f784c-1038-42f3-86f6-6140354a80e1 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:25.746928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-405f784c-1038-42f3-86f6-6140354a80e1 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:25.748211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-405f784c-1038-42f3-86f6-6140354a80e1 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:25.749437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-405f784c-1038-42f3-86f6-6140354a80e1 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:25.751770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-405f784c-1038-42f3-86f6-6140354a80e1 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:25.752414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-405f784c-1038-42f3-86f6-6140354a80e1 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:25.927245 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-405f784c-1038-42f3-86f6-6140354a80e1 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/2da339a54c1a485382a7df363d7b2a37" status: 200 len: 148 microversion: 2.57 time: 0.844953 Aug 23 17:53:25.927891 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 340/697] 10.222.0.61 () {62 vars in 1303 bytes} [Tue Aug 23 17:53:25 2022] PUT /compute/v2.1/os-quota-sets/2da339a54c1a485382a7df363d7b2a37 => generated 148 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:53:25.948461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-238469bf-2df6-47af-bfdc-14a3ff8fabf3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:25.949123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-238469bf-2df6-47af-bfdc-14a3ff8fabf3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:25.963119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-238469bf-2df6-47af-bfdc-14a3ff8fabf3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:25.963613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-238469bf-2df6-47af-bfdc-14a3ff8fabf3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:25.964049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-238469bf-2df6-47af-bfdc-14a3ff8fabf3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:25.964763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-238469bf-2df6-47af-bfdc-14a3ff8fabf3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:25.965475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-238469bf-2df6-47af-bfdc-14a3ff8fabf3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:25.965909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-238469bf-2df6-47af-bfdc-14a3ff8fabf3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:25.968544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-25efef71-a20b-4d4a-8147-430469a433d7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:25.982367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-25efef71-a20b-4d4a-8147-430469a433d7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:25.987696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-25efef71-a20b-4d4a-8147-430469a433d7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:25.994146 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-25efef71-a20b-4d4a-8147-430469a433d7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.337639 Aug 23 17:53:25.999824 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 358/698] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:25 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:26.011510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-218c1941-d64f-47e1-aa71-763e395c89ec tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:26.014881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-218c1941-d64f-47e1-aa71-763e395c89ec tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:26.024305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-218c1941-d64f-47e1-aa71-763e395c89ec tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:26.025236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-218c1941-d64f-47e1-aa71-763e395c89ec tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:26.025857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-218c1941-d64f-47e1-aa71-763e395c89ec tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:26.026842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-218c1941-d64f-47e1-aa71-763e395c89ec tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:26.027698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-218c1941-d64f-47e1-aa71-763e395c89ec tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:26.028789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-218c1941-d64f-47e1-aa71-763e395c89ec tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:26.229547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-218c1941-d64f-47e1-aa71-763e395c89ec tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:26.239407 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-218c1941-d64f-47e1-aa71-763e395c89ec tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1313 microversion: 2.1 time: 0.237511 Aug 23 17:53:26.240569 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 359/699] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:26 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1313 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:26.249264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0329197f-d9ef-4c97-a945-f900cda07cf3 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Calling method '.version_select at 0x7f27ed220a60>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:26.521087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-238469bf-2df6-47af-bfdc-14a3ff8fabf3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:26.530208 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-238469bf-2df6-47af-bfdc-14a3ff8fabf3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 0.595837 Aug 23 17:53:26.531311 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 341/700] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:25 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:26.545779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3866526-9ede-4db0-ae29-529aee7920a9 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Calling method '.version_select at 0x7f27ed1049d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:26.625352 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0329197f-d9ef-4c97-a945-f900cda07cf3 tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/a0f3cef8-8def-4a93-9dea-f8f938624ae5" status: 202 len: 0 microversion: 2.1 time: 0.380234 Aug 23 17:53:26.627404 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 360/701] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 17:53:26 2022] DELETE /compute/v2.1/os-security-groups/a0f3cef8-8def-4a93-9dea-f8f938624ae5 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:53:26.633337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-930315cc-c2d2-435c-8680-ba93fc83f4d3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:26.634412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-930315cc-c2d2-435c-8680-ba93fc83f4d3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:26.642320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-930315cc-c2d2-435c-8680-ba93fc83f4d3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:26.643119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-930315cc-c2d2-435c-8680-ba93fc83f4d3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:26.643687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-930315cc-c2d2-435c-8680-ba93fc83f4d3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:26.644433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-930315cc-c2d2-435c-8680-ba93fc83f4d3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:26.644957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-930315cc-c2d2-435c-8680-ba93fc83f4d3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:26.645554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-930315cc-c2d2-435c-8680-ba93fc83f4d3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:26.842497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3866526-9ede-4db0-ae29-529aee7920a9 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:26.843152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3866526-9ede-4db0-ae29-529aee7920a9 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:26.843669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3866526-9ede-4db0-ae29-529aee7920a9 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:26.846197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3866526-9ede-4db0-ae29-529aee7920a9 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:26.846822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3866526-9ede-4db0-ae29-529aee7920a9 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:26.847438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3866526-9ede-4db0-ae29-529aee7920a9 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:26.855011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-930315cc-c2d2-435c-8680-ba93fc83f4d3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:26.865151 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-930315cc-c2d2-435c-8680-ba93fc83f4d3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1477 microversion: 2.1 time: 0.236495 Aug 23 17:53:26.866720 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 361/702] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:26 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1477 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:26.873829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7007cc08-5217-4c7d-abd8-ba21e2cd055c tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Calling method '.version_select at 0x7f27ed09eee0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:26.882167 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d3866526-9ede-4db0-ae29-529aee7920a9 tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2da339a54c1a485382a7df363d7b2a37/detail" status: 200 len: 463 microversion: 2.57 time: 0.348496 Aug 23 17:53:26.882940 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 342/703] 10.222.0.61 () {60 vars in 1304 bytes} [Tue Aug 23 17:53:26 2022] GET /compute/v2.1/os-quota-sets/2da339a54c1a485382a7df363d7b2a37/detail => generated 463 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:53:27.021672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d5b1c7e2-38fe-4ee8-ba85-a0478383cd52 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:27.022596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d5b1c7e2-38fe-4ee8-ba85-a0478383cd52 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:27.030890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5b1c7e2-38fe-4ee8-ba85-a0478383cd52 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:27.032167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5b1c7e2-38fe-4ee8-ba85-a0478383cd52 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:27.034121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5b1c7e2-38fe-4ee8-ba85-a0478383cd52 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:27.035411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5b1c7e2-38fe-4ee8-ba85-a0478383cd52 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:27.036088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5b1c7e2-38fe-4ee8-ba85-a0478383cd52 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:27.037637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5b1c7e2-38fe-4ee8-ba85-a0478383cd52 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:27.118511 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7007cc08-5217-4c7d-abd8-ba21e2cd055c tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/8011a0e7-10db-4197-80de-cc51850308dc" status: 202 len: 0 microversion: 2.1 time: 0.248471 Aug 23 17:53:27.118511 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 362/704] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 17:53:26 2022] DELETE /compute/v2.1/os-security-groups/8011a0e7-10db-4197-80de-cc51850308dc => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:53:27.127163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Action: 'update', calling method: .version_select at 0x7f27ed3e0310>, body: {"quota_set": {"ram": "2048"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:27.205925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5b1c7e2-38fe-4ee8-ba85-a0478383cd52 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:27.216859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:27.217395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:27.217832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:27.218577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:27.218866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5b1c7e2-38fe-4ee8-ba85-a0478383cd52 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:27.219013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:27.219466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:27.223258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5b1c7e2-38fe-4ee8-ba85-a0478383cd52 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:27.225148 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d5b1c7e2-38fe-4ee8-ba85-a0478383cd52 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.207523 Aug 23 17:53:27.238721 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 343/705] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:27 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:27.247769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6995e481-6133-4b63-8b18-41ba3dfd7ddd tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Calling method '.version_select at 0x7f27ecbde280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:27.290921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:27.291840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:27.292987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:27.295539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:27.296875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:27.298998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:27.407781 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e6a8ec31-227c-40dd-b7ef-d960ef664d7d tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/2da339a54c1a485382a7df363d7b2a37?user_id=fdbb9949127d49af8a6f7c046997c832" status: 200 len: 148 microversion: 2.57 time: 0.288030 Aug 23 17:53:27.414193 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 363/706] 10.222.0.61 () {62 vars in 1384 bytes} [Tue Aug 23 17:53:27 2022] PUT /compute/v2.1/os-quota-sets/2da339a54c1a485382a7df363d7b2a37?user_id=fdbb9949127d49af8a6f7c046997c832 => generated 148 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:53:27.423441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1eb750af-8d11-4d6d-8866-8842653f0814 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:27.426907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1eb750af-8d11-4d6d-8866-8842653f0814 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:27.437792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1eb750af-8d11-4d6d-8866-8842653f0814 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:27.439091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1eb750af-8d11-4d6d-8866-8842653f0814 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:27.440317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1eb750af-8d11-4d6d-8866-8842653f0814 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:27.441321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1eb750af-8d11-4d6d-8866-8842653f0814 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:27.442770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1eb750af-8d11-4d6d-8866-8842653f0814 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:27.444010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1eb750af-8d11-4d6d-8866-8842653f0814 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:27.479685 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6995e481-6133-4b63-8b18-41ba3dfd7ddd tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/1064f894-47e5-46a9-9158-743af51f0a53" status: 202 len: 0 microversion: 2.1 time: 0.242202 Aug 23 17:53:27.480695 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 344/707] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 17:53:27 2022] DELETE /compute/v2.1/os-security-groups/1064f894-47e5-46a9-9158-743af51f0a53 => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:53:27.485996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d0b242d-932f-4886-b069-b64b67ed65aa tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] Calling method '.version_select at 0x7f27ecfadaf0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:27.583085 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7d0b242d-932f-4886-b069-b64b67ed65aa tempest-QuotasAdminTestV257-1312236753 tempest-QuotasAdminTestV257-1312236753-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2da339a54c1a485382a7df363d7b2a37?user_id=fdbb9949127d49af8a6f7c046997c832" status: 200 len: 190 microversion: 2.57 time: 0.101000 Aug 23 17:53:27.584702 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 345/708] 10.222.0.61 () {60 vars in 1364 bytes} [Tue Aug 23 17:53:27 2022] GET /compute/v2.1/os-quota-sets/2da339a54c1a485382a7df363d7b2a37?user_id=fdbb9949127d49af8a6f7c046997c832 => generated 190 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:53:27.590045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cab0cfa7-076d-47c0-bd18-b7bdcb6f57ba tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] Calling method '.version_select at 0x7f27ecbdeaf0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:27.743265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1eb750af-8d11-4d6d-8866-8842653f0814 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:27.747410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:27.755602 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1eb750af-8d11-4d6d-8866-8842653f0814 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1313 microversion: 2.1 time: 0.341797 Aug 23 17:53:27.756190 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 364/709] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:27 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1313 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:27.773345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2fb68729-5cbd-4f4d-8292-2d59594cba99 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:27.773918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2fb68729-5cbd-4f4d-8292-2d59594cba99 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:27.793269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fb68729-5cbd-4f4d-8292-2d59594cba99 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:27.793760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fb68729-5cbd-4f4d-8292-2d59594cba99 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:27.794195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fb68729-5cbd-4f4d-8292-2d59594cba99 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:27.794929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fb68729-5cbd-4f4d-8292-2d59594cba99 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:27.795381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fb68729-5cbd-4f4d-8292-2d59594cba99 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:27.795800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fb68729-5cbd-4f4d-8292-2d59594cba99 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:27.869313 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cab0cfa7-076d-47c0-bd18-b7bdcb6f57ba tempest-SecurityGroupRulesNegativeTestJSON-570391986 tempest-SecurityGroupRulesNegativeTestJSON-570391986-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/28a8eb57-8cdc-4904-b1a8-484af76dca7b" status: 202 len: 0 microversion: 2.1 time: 0.283094 Aug 23 17:53:27.874175 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 346/710] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 17:53:27 2022] DELETE /compute/v2.1/os-security-groups/28a8eb57-8cdc-4904-b1a8-484af76dca7b => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:53:27.890893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-89101126-c6e5-40b4-9a09-32d8cc27468b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:27.892175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-89101126-c6e5-40b4-9a09-32d8cc27468b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:27.904204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89101126-c6e5-40b4-9a09-32d8cc27468b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:27.906489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89101126-c6e5-40b4-9a09-32d8cc27468b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:27.907422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89101126-c6e5-40b4-9a09-32d8cc27468b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:27.908890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89101126-c6e5-40b4-9a09-32d8cc27468b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:27.910467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89101126-c6e5-40b4-9a09-32d8cc27468b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:27.913736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89101126-c6e5-40b4-9a09-32d8cc27468b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:28.234141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2fb68729-5cbd-4f4d-8292-2d59594cba99 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:28.253372 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2fb68729-5cbd-4f4d-8292-2d59594cba99 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 0.496099 Aug 23 17:53:28.269688 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 365/711] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:27 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:28.275743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-89101126-c6e5-40b4-9a09-32d8cc27468b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:28.280016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e0d21832-159c-401d-a87c-f8327a026738 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:28.281837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e0d21832-159c-401d-a87c-f8327a026738 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:28.292811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0d21832-159c-401d-a87c-f8327a026738 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:28.293791 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-89101126-c6e5-40b4-9a09-32d8cc27468b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1477 microversion: 2.1 time: 0.406972 Aug 23 17:53:28.298593 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 347/712] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:27 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1477 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:28.298886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0d21832-159c-401d-a87c-f8327a026738 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:28.298886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0d21832-159c-401d-a87c-f8327a026738 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:28.301748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0d21832-159c-401d-a87c-f8327a026738 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:28.302168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0d21832-159c-401d-a87c-f8327a026738 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:28.302944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0d21832-159c-401d-a87c-f8327a026738 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:28.551805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-417318f8-138a-43a2-b66b-3bba270f7540 req-44f78b4a-b462-4c5f-b9fb-50aca161df89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a4f4f5-5f3a-4907-a471-005e1f790e8b", "name": "network-vif-plugged", "status": "completed", "tag": "667d527b-7ec9-4bdb-951c-0b3029adcb79"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:28.568922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-417318f8-138a-43a2-b66b-3bba270f7540 req-44f78b4a-b462-4c5f-b9fb-50aca161df89 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:28.572135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-417318f8-138a-43a2-b66b-3bba270f7540 req-44f78b4a-b462-4c5f-b9fb-50aca161df89 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:28.572840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-417318f8-138a-43a2-b66b-3bba270f7540 req-44f78b4a-b462-4c5f-b9fb-50aca161df89 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:28.629014 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-417318f8-138a-43a2-b66b-3bba270f7540 req-44f78b4a-b462-4c5f-b9fb-50aca161df89 service nova] Creating event network-vif-plugged:667d527b-7ec9-4bdb-951c-0b3029adcb79 for instance 69a4f4f5-5f3a-4907-a471-005e1f790e8b on n-h1-850468-16 Aug 23 17:53:28.642698 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-417318f8-138a-43a2-b66b-3bba270f7540 req-44f78b4a-b462-4c5f-b9fb-50aca161df89 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093018 Aug 23 17:53:28.644981 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 348/713] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:53:28.663542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e0d21832-159c-401d-a87c-f8327a026738 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:28.681360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e0d21832-159c-401d-a87c-f8327a026738 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:28.689645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e0d21832-159c-401d-a87c-f8327a026738 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:28.693878 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e0d21832-159c-401d-a87c-f8327a026738 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.422204 Aug 23 17:53:28.710454 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 366/714] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:28 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:28.784229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-829b0945-4309-4af1-9931-9eff9c0db380 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:28.785203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-829b0945-4309-4af1-9931-9eff9c0db380 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:28.797582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:28.800219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-829b0945-4309-4af1-9931-9eff9c0db380 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:28.805129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-829b0945-4309-4af1-9931-9eff9c0db380 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:28.805794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-829b0945-4309-4af1-9931-9eff9c0db380 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:28.808716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-829b0945-4309-4af1-9931-9eff9c0db380 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:28.809367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-829b0945-4309-4af1-9931-9eff9c0db380 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:28.809985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-829b0945-4309-4af1-9931-9eff9c0db380 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:29.232685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-829b0945-4309-4af1-9931-9eff9c0db380 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:29.246724 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-829b0945-4309-4af1-9931-9eff9c0db380 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1313 microversion: 2.1 time: 0.468642 Aug 23 17:53:29.253171 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 349/715] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:28 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1313 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:29.281780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-550e4cb7-50c6-40e3-b10a-6e9625530a26 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:29.284786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-550e4cb7-50c6-40e3-b10a-6e9625530a26 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:29.309968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-550e4cb7-50c6-40e3-b10a-6e9625530a26 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:29.312061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-550e4cb7-50c6-40e3-b10a-6e9625530a26 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:29.317048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-550e4cb7-50c6-40e3-b10a-6e9625530a26 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:29.318763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-550e4cb7-50c6-40e3-b10a-6e9625530a26 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:29.319115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d0d38946-886c-496b-8fc3-19136d7f808b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:29.319639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-550e4cb7-50c6-40e3-b10a-6e9625530a26 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:29.319963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d0d38946-886c-496b-8fc3-19136d7f808b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:29.322099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-550e4cb7-50c6-40e3-b10a-6e9625530a26 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:29.333176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0d38946-886c-496b-8fc3-19136d7f808b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:29.333984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0d38946-886c-496b-8fc3-19136d7f808b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:29.336825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0d38946-886c-496b-8fc3-19136d7f808b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:29.337934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0d38946-886c-496b-8fc3-19136d7f808b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:29.338598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0d38946-886c-496b-8fc3-19136d7f808b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:29.340978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0d38946-886c-496b-8fc3-19136d7f808b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:29.728584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d0d38946-886c-496b-8fc3-19136d7f808b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:29.739480 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d0d38946-886c-496b-8fc3-19136d7f808b tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1477 microversion: 2.1 time: 0.425906 Aug 23 17:53:29.740504 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 350/716] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:29 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1477 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:29.746506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5df18632-552a-462b-a5ab-6761382f1142 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:29.747376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5df18632-552a-462b-a5ab-6761382f1142 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:29.759579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5df18632-552a-462b-a5ab-6761382f1142 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:29.761230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5df18632-552a-462b-a5ab-6761382f1142 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:29.762233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5df18632-552a-462b-a5ab-6761382f1142 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:29.764075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5df18632-552a-462b-a5ab-6761382f1142 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:29.765382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5df18632-552a-462b-a5ab-6761382f1142 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:29.766229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5df18632-552a-462b-a5ab-6761382f1142 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:30.075379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5df18632-552a-462b-a5ab-6761382f1142 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:30.085149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5df18632-552a-462b-a5ab-6761382f1142 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:30.090735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5df18632-552a-462b-a5ab-6761382f1142 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:30.095731 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5df18632-552a-462b-a5ab-6761382f1142 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.353993 Aug 23 17:53:30.098610 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 351/717] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:29 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:30.272250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-14424594-d264-4a89-a646-0b5724f8c970 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:30.272776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-14424594-d264-4a89-a646-0b5724f8c970 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:30.278790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14424594-d264-4a89-a646-0b5724f8c970 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:30.279470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14424594-d264-4a89-a646-0b5724f8c970 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:30.280054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14424594-d264-4a89-a646-0b5724f8c970 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:30.280975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14424594-d264-4a89-a646-0b5724f8c970 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:30.281659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14424594-d264-4a89-a646-0b5724f8c970 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:30.283119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14424594-d264-4a89-a646-0b5724f8c970 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:30.288464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:30.296684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-550e4cb7-50c6-40e3-b10a-6e9625530a26 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:30.311827 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-550e4cb7-50c6-40e3-b10a-6e9625530a26 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 1.039688 Aug 23 17:53:30.316140 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 367/718] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:29 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:30.569090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-14424594-d264-4a89-a646-0b5724f8c970 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:30.578600 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-14424594-d264-4a89-a646-0b5724f8c970 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1313 microversion: 2.1 time: 0.310410 Aug 23 17:53:30.582897 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 352/719] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:30 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1313 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:30.763391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d588e544-50cb-4e3a-ae69-5cf43c721a70 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:30.764383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d588e544-50cb-4e3a-ae69-5cf43c721a70 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:30.781119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d588e544-50cb-4e3a-ae69-5cf43c721a70 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:30.784113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d588e544-50cb-4e3a-ae69-5cf43c721a70 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:30.784805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d588e544-50cb-4e3a-ae69-5cf43c721a70 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:30.786169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d588e544-50cb-4e3a-ae69-5cf43c721a70 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:30.788623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d588e544-50cb-4e3a-ae69-5cf43c721a70 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:30.790869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d588e544-50cb-4e3a-ae69-5cf43c721a70 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:31.121819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-128214a0-34d5-450e-9b7f-9903152a3c10 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:31.123201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-128214a0-34d5-450e-9b7f-9903152a3c10 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:31.135496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-128214a0-34d5-450e-9b7f-9903152a3c10 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:31.138878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-128214a0-34d5-450e-9b7f-9903152a3c10 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:31.139502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-128214a0-34d5-450e-9b7f-9903152a3c10 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:31.142045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-128214a0-34d5-450e-9b7f-9903152a3c10 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:31.144408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-128214a0-34d5-450e-9b7f-9903152a3c10 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:31.147100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-128214a0-34d5-450e-9b7f-9903152a3c10 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:31.164083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d588e544-50cb-4e3a-ae69-5cf43c721a70 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:31.176099 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d588e544-50cb-4e3a-ae69-5cf43c721a70 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1477 microversion: 2.1 time: 0.417881 Aug 23 17:53:31.180123 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 368/720] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:30 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1477 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:31.339589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2b4340ae-d4cb-4713-ac28-334039cb8230 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:31.340849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2b4340ae-d4cb-4713-ac28-334039cb8230 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:31.360056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b4340ae-d4cb-4713-ac28-334039cb8230 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:31.373868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b4340ae-d4cb-4713-ac28-334039cb8230 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:31.377426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b4340ae-d4cb-4713-ac28-334039cb8230 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:31.378254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b4340ae-d4cb-4713-ac28-334039cb8230 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:31.378840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b4340ae-d4cb-4713-ac28-334039cb8230 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:31.379284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b4340ae-d4cb-4713-ac28-334039cb8230 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:31.510859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-128214a0-34d5-450e-9b7f-9903152a3c10 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:31.521676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-128214a0-34d5-450e-9b7f-9903152a3c10 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:31.523505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-128214a0-34d5-450e-9b7f-9903152a3c10 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:31.524810 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-128214a0-34d5-450e-9b7f-9903152a3c10 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.407614 Aug 23 17:53:31.544043 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 353/721] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:31 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:53:31.603820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2f14c111-7ddc-49b6-89a2-2b46f9939286 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:31.604632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2f14c111-7ddc-49b6-89a2-2b46f9939286 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:31.615071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f14c111-7ddc-49b6-89a2-2b46f9939286 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:31.615844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f14c111-7ddc-49b6-89a2-2b46f9939286 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:31.616437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f14c111-7ddc-49b6-89a2-2b46f9939286 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:31.624978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f14c111-7ddc-49b6-89a2-2b46f9939286 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:31.625700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f14c111-7ddc-49b6-89a2-2b46f9939286 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:31.626863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f14c111-7ddc-49b6-89a2-2b46f9939286 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:31.849851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2b4340ae-d4cb-4713-ac28-334039cb8230 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:31.858416 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2b4340ae-d4cb-4713-ac28-334039cb8230 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1505 microversion: 2.1 time: 0.525348 Aug 23 17:53:31.863294 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 369/722] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:31 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1505 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:31.947257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2f14c111-7ddc-49b6-89a2-2b46f9939286 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:31.957039 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2f14c111-7ddc-49b6-89a2-2b46f9939286 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1313 microversion: 2.1 time: 0.357207 Aug 23 17:53:31.965510 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 354/723] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:31 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1313 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:32.160388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-fbef7939-d714-4967-8799-13d5ebae6290 req-6be603bc-07f8-4a9b-8a29-83541974124b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4", "name": "network-vif-plugged", "status": "completed", "tag": "ee6fb24a-f8ec-4d67-b529-6a7b42386fd6"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:32.178198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fbef7939-d714-4967-8799-13d5ebae6290 req-6be603bc-07f8-4a9b-8a29-83541974124b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:32.178708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fbef7939-d714-4967-8799-13d5ebae6290 req-6be603bc-07f8-4a9b-8a29-83541974124b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:32.179310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fbef7939-d714-4967-8799-13d5ebae6290 req-6be603bc-07f8-4a9b-8a29-83541974124b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:32.199688 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-fbef7939-d714-4967-8799-13d5ebae6290 req-6be603bc-07f8-4a9b-8a29-83541974124b service nova] Creating event network-vif-plugged:ee6fb24a-f8ec-4d67-b529-6a7b42386fd6 for instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 on n-h2-850468-16 Aug 23 17:53:32.205937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ed6995b5-eb88-42ff-a90a-646d5d9e4da4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:32.208279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ed6995b5-eb88-42ff-a90a-646d5d9e4da4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:32.211475 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-fbef7939-d714-4967-8799-13d5ebae6290 req-6be603bc-07f8-4a9b-8a29-83541974124b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055677 Aug 23 17:53:32.213687 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 370/724] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:32.219786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed6995b5-eb88-42ff-a90a-646d5d9e4da4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:32.225447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed6995b5-eb88-42ff-a90a-646d5d9e4da4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:32.226127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed6995b5-eb88-42ff-a90a-646d5d9e4da4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:32.227546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed6995b5-eb88-42ff-a90a-646d5d9e4da4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:32.231308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed6995b5-eb88-42ff-a90a-646d5d9e4da4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:32.231783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed6995b5-eb88-42ff-a90a-646d5d9e4da4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:32.555289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eafe3ae9-3307-4cf4-a612-fbb9c83c499e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:32.556016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eafe3ae9-3307-4cf4-a612-fbb9c83c499e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:32.581444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eafe3ae9-3307-4cf4-a612-fbb9c83c499e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:32.582810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eafe3ae9-3307-4cf4-a612-fbb9c83c499e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:32.583270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eafe3ae9-3307-4cf4-a612-fbb9c83c499e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:32.585186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eafe3ae9-3307-4cf4-a612-fbb9c83c499e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:32.585657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eafe3ae9-3307-4cf4-a612-fbb9c83c499e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:32.602395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eafe3ae9-3307-4cf4-a612-fbb9c83c499e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:32.671742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ed6995b5-eb88-42ff-a90a-646d5d9e4da4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:32.684030 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ed6995b5-eb88-42ff-a90a-646d5d9e4da4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1463 microversion: 2.1 time: 0.482935 Aug 23 17:53:32.684631 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 355/725] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:32 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1463 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:32.708283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e5a3b6d-101c-407c-ac18-1c5aadb0409c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:32.708909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e5a3b6d-101c-407c-ac18-1c5aadb0409c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:32.725551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e5a3b6d-101c-407c-ac18-1c5aadb0409c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:32.726065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e5a3b6d-101c-407c-ac18-1c5aadb0409c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:32.726516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e5a3b6d-101c-407c-ac18-1c5aadb0409c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:32.727261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e5a3b6d-101c-407c-ac18-1c5aadb0409c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:32.731140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e5a3b6d-101c-407c-ac18-1c5aadb0409c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:32.731786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e5a3b6d-101c-407c-ac18-1c5aadb0409c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:32.952608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eafe3ae9-3307-4cf4-a612-fbb9c83c499e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:32.968016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eafe3ae9-3307-4cf4-a612-fbb9c83c499e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:32.970157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eafe3ae9-3307-4cf4-a612-fbb9c83c499e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:32.976666 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eafe3ae9-3307-4cf4-a612-fbb9c83c499e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.429780 Aug 23 17:53:32.996295 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 371/726] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:32 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:33.003181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8e5a3b6d-101c-407c-ac18-1c5aadb0409c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:33.004443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d8217d36-1c4e-46a5-b448-1f783f5ebb73 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:33.005068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d8217d36-1c4e-46a5-b448-1f783f5ebb73 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:33.013030 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e5a3b6d-101c-407c-ac18-1c5aadb0409c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1463 microversion: 2.1 time: 0.308577 Aug 23 17:53:33.017136 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 356/727] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:32 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1463 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:33.029914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8217d36-1c4e-46a5-b448-1f783f5ebb73 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:33.030420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8217d36-1c4e-46a5-b448-1f783f5ebb73 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:33.034995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8217d36-1c4e-46a5-b448-1f783f5ebb73 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:33.036027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8217d36-1c4e-46a5-b448-1f783f5ebb73 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:33.036706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8217d36-1c4e-46a5-b448-1f783f5ebb73 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:33.037228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8217d36-1c4e-46a5-b448-1f783f5ebb73 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:33.039331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-11294164-da5a-40ad-b055-8201500a8cd2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:33.041212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-11294164-da5a-40ad-b055-8201500a8cd2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:33.057409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11294164-da5a-40ad-b055-8201500a8cd2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:33.059218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11294164-da5a-40ad-b055-8201500a8cd2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:33.060326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11294164-da5a-40ad-b055-8201500a8cd2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:33.061746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11294164-da5a-40ad-b055-8201500a8cd2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:33.066163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11294164-da5a-40ad-b055-8201500a8cd2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:33.067533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11294164-da5a-40ad-b055-8201500a8cd2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:33.369814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-11294164-da5a-40ad-b055-8201500a8cd2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:33.379285 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-11294164-da5a-40ad-b055-8201500a8cd2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1313 microversion: 2.1 time: 0.356981 Aug 23 17:53:33.380481 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 357/728] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:33 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1313 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:33.390141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:33.396867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:33.416342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:33.417323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:33.421358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:33.422141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:33.423158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:33.428781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:33.624519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:53:33.625277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:53:33.627303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:53:33.634190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:53:33.634190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:53:33.866164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:33.877935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d8217d36-1c4e-46a5-b448-1f783f5ebb73 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:33.896568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:33.899706 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d8217d36-1c4e-46a5-b448-1f783f5ebb73 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1495 microversion: 2.1 time: 0.901970 Aug 23 17:53:33.908751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:33.908751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:33.908751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:33.908751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:33.909276 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 372/729] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:32 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1495 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:33.911881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:33.928220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4073a771-48fa-427b-bac9-f346d6d7cf88 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '.version_select at 0x7f27ecc10940>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:33.941630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4073a771-48fa-427b-bac9-f346d6d7cf88 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:33.960953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4073a771-48fa-427b-bac9-f346d6d7cf88 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:33.961780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4073a771-48fa-427b-bac9-f346d6d7cf88 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:34.008073 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4073a771-48fa-427b-bac9-f346d6d7cf88 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 402 microversion: 2.1 time: 0.083633 Aug 23 17:53:34.008701 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 373/730] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 17:53:33 2022] GET /compute/v2.1/os-migrations => generated 402 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:34.021330 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3ddfd431-c7cd-441e-9aec-32e00b1ac481 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action" status: 202 len: 1067 microversion: 2.1 time: 0.639506 Aug 23 17:53:34.022149 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 358/731] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:53:33 2022] POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action => generated 1067 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 23 17:53:34.026981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-221540e0-6e72-4a7c-a275-269e494bc4a3 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:34.030018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3e33c9a2-43e4-433d-a4c1-4905135abcb7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:34.033204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3e33c9a2-43e4-433d-a4c1-4905135abcb7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:34.034707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-221540e0-6e72-4a7c-a275-269e494bc4a3 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:34.061128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-221540e0-6e72-4a7c-a275-269e494bc4a3 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:34.063739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e33c9a2-43e4-433d-a4c1-4905135abcb7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:34.064552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-221540e0-6e72-4a7c-a275-269e494bc4a3 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:34.065181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-221540e0-6e72-4a7c-a275-269e494bc4a3 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:34.065844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e33c9a2-43e4-433d-a4c1-4905135abcb7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:34.066845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-221540e0-6e72-4a7c-a275-269e494bc4a3 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:34.067410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e33c9a2-43e4-433d-a4c1-4905135abcb7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:34.068275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e33c9a2-43e4-433d-a4c1-4905135abcb7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:34.069041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-221540e0-6e72-4a7c-a275-269e494bc4a3 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:34.069733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e33c9a2-43e4-433d-a4c1-4905135abcb7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:34.070419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-221540e0-6e72-4a7c-a275-269e494bc4a3 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:34.073137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e33c9a2-43e4-433d-a4c1-4905135abcb7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:34.632941 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-221540e0-6e72-4a7c-a275-269e494bc4a3 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1648 microversion: 2.1 time: 0.609293 Aug 23 17:53:34.636607 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 359/732] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:34 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1648 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:34.650717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-34768fdb-33b2-4dff-b283-44d44e066cfa tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:34.652312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-34768fdb-33b2-4dff-b283-44d44e066cfa tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:34.666878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34768fdb-33b2-4dff-b283-44d44e066cfa tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:34.667390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34768fdb-33b2-4dff-b283-44d44e066cfa tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:34.667834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34768fdb-33b2-4dff-b283-44d44e066cfa tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:34.668563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34768fdb-33b2-4dff-b283-44d44e066cfa tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:34.674303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34768fdb-33b2-4dff-b283-44d44e066cfa tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:34.675092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34768fdb-33b2-4dff-b283-44d44e066cfa tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:34.887591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3e33c9a2-43e4-433d-a4c1-4905135abcb7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:34.897159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3e33c9a2-43e4-433d-a4c1-4905135abcb7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:34.904409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3e33c9a2-43e4-433d-a4c1-4905135abcb7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:34.905690 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3e33c9a2-43e4-433d-a4c1-4905135abcb7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.896049 Aug 23 17:53:34.919035 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 374/733] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:34 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:35.103459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f94b2b95-5f08-419b-97f0-8fc5e9e26102 tempest-FlavorsV2NegativeTest-626815161 tempest-FlavorsV2NegativeTest-626815161-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:35.107492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-34768fdb-33b2-4dff-b283-44d44e066cfa tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:35.116871 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f94b2b95-5f08-419b-97f0-8fc5e9e26102 tempest-FlavorsV2NegativeTest-626815161 tempest-FlavorsV2NegativeTest-626815161-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.193285 Aug 23 17:53:35.117537 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 375/734] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:53:34 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:35.128321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-34768fdb-33b2-4dff-b283-44d44e066cfa tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.486675 Aug 23 17:53:35.153985 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 360/735] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:34 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:35.165190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-16a600ac-7917-42ef-b79b-9a70895f8387 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:35.165817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-16a600ac-7917-42ef-b79b-9a70895f8387 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:35.168994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-49a8875c-371e-4f98-9c4a-7188fb9d7360 req-4737d2d4-62bd-4a17-9785-04f743e54288 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9504575-e074-4aad-871d-bcb9db7a22e3", "name": "network-vif-plugged", "status": "completed", "tag": "039de3f2-8782-4e97-9d10-be32f83014de"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:35.171993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a600ac-7917-42ef-b79b-9a70895f8387 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:35.173534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a600ac-7917-42ef-b79b-9a70895f8387 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:35.174204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a600ac-7917-42ef-b79b-9a70895f8387 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:35.175016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a600ac-7917-42ef-b79b-9a70895f8387 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:35.175479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a600ac-7917-42ef-b79b-9a70895f8387 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:35.175902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a600ac-7917-42ef-b79b-9a70895f8387 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:35.200481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-49a8875c-371e-4f98-9c4a-7188fb9d7360 req-4737d2d4-62bd-4a17-9785-04f743e54288 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:35.201453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-49a8875c-371e-4f98-9c4a-7188fb9d7360 req-4737d2d4-62bd-4a17-9785-04f743e54288 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:35.203375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-49a8875c-371e-4f98-9c4a-7188fb9d7360 req-4737d2d4-62bd-4a17-9785-04f743e54288 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:35.225897 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-49a8875c-371e-4f98-9c4a-7188fb9d7360 req-4737d2d4-62bd-4a17-9785-04f743e54288 service nova] Creating event network-vif-plugged:039de3f2-8782-4e97-9d10-be32f83014de for instance b9504575-e074-4aad-871d-bcb9db7a22e3 on n-h1-850468-16 Aug 23 17:53:35.235559 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-49a8875c-371e-4f98-9c4a-7188fb9d7360 req-4737d2d4-62bd-4a17-9785-04f743e54288 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079115 Aug 23 17:53:35.237083 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 361/736] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:35.246090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1466146768", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "01db69ea-76ab-43b6-bec6-04f17d268a24"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:35.372785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] validate_networks() for [('01db69ea-76ab-43b6-bec6-04f17d268a24', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:53:35.659215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-16a600ac-7917-42ef-b79b-9a70895f8387 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:35.669642 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-16a600ac-7917-42ef-b79b-9a70895f8387 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1463 microversion: 2.1 time: 0.538817 Aug 23 17:53:35.670218 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 376/737] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:35 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1463 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:35.913711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:53:35.914168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:53:35.914653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:53:35.915091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:53:35.915511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:53:35.935750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:35.936447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:35.937258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:35.938832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:35.940334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:35.941298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:35.988919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Getting quotas for project 5bbd01aaed704a1b8509e754d19a4b8d. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:53:35.997333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Getting quotas for user 0ef389420da8493386a7f8dfb747afab and project 5bbd01aaed704a1b8509e754d19a4b8d. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:53:36.014240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:53:36.017521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:53:36.045896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a0d3be5-b602-4cde-88f0-94ad0422b6d5 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:36.047160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6a0d3be5-b602-4cde-88f0-94ad0422b6d5 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:36.059118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a0d3be5-b602-4cde-88f0-94ad0422b6d5 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:36.059982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a0d3be5-b602-4cde-88f0-94ad0422b6d5 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:36.061302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a0d3be5-b602-4cde-88f0-94ad0422b6d5 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:36.062420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a0d3be5-b602-4cde-88f0-94ad0422b6d5 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:36.064786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a0d3be5-b602-4cde-88f0-94ad0422b6d5 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:36.065432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a0d3be5-b602-4cde-88f0-94ad0422b6d5 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:36.098145 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6998675a-57a2-44b9-8aba-9e1572e6617d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.859518 Aug 23 17:53:36.099205 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 362/738] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:53:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:53:36.109094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-66fd1f52-0d54-4270-85ac-8d84b5efca07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:36.111117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-66fd1f52-0d54-4270-85ac-8d84b5efca07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:36.119166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66fd1f52-0d54-4270-85ac-8d84b5efca07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:36.124553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66fd1f52-0d54-4270-85ac-8d84b5efca07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:36.125687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66fd1f52-0d54-4270-85ac-8d84b5efca07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:36.126770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66fd1f52-0d54-4270-85ac-8d84b5efca07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:36.127511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66fd1f52-0d54-4270-85ac-8d84b5efca07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:36.128319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66fd1f52-0d54-4270-85ac-8d84b5efca07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:36.374100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-66fd1f52-0d54-4270-85ac-8d84b5efca07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:36.386730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-66fd1f52-0d54-4270-85ac-8d84b5efca07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:36.388928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-66fd1f52-0d54-4270-85ac-8d84b5efca07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:36.391051 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-66fd1f52-0d54-4270-85ac-8d84b5efca07 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.290183 Aug 23 17:53:36.392328 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 363/739] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:36 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:36.413727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0e207ddf-3e7d-4516-a29d-5e815ebedd0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:36.416064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0e207ddf-3e7d-4516-a29d-5e815ebedd0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:36.549547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0e207ddf-3e7d-4516-a29d-5e815ebedd0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:36.557923 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0e207ddf-3e7d-4516-a29d-5e815ebedd0c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1211 microversion: 2.1 time: 0.164134 Aug 23 17:53:36.558935 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 364/740] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:36 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1211 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:36.565424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0690b02c-8c49-4bf4-9633-d46efadb3763 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:36.566234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0690b02c-8c49-4bf4-9633-d46efadb3763 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:36.572836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0690b02c-8c49-4bf4-9633-d46efadb3763 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:36.573974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0690b02c-8c49-4bf4-9633-d46efadb3763 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:36.574608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0690b02c-8c49-4bf4-9633-d46efadb3763 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:36.575313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0690b02c-8c49-4bf4-9633-d46efadb3763 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:36.575920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0690b02c-8c49-4bf4-9633-d46efadb3763 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:36.576497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0690b02c-8c49-4bf4-9633-d46efadb3763 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:36.780690 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a0d3be5-b602-4cde-88f0-94ad0422b6d5 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1616 microversion: 2.1 time: 1.093878 Aug 23 17:53:36.784286 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 377/741] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:35 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1616 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:36.800872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c95274d-319f-407f-baa8-a64d225cb2a8 tempest-FlavorsV2NegativeTest-626815161 tempest-FlavorsV2NegativeTest-626815161-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-841058364", "imageRef": "0dbe6084-7173-43ea-951b-427f0c6ee905", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:36.880554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0690b02c-8c49-4bf4-9633-d46efadb3763 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:36.893773 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0690b02c-8c49-4bf4-9633-d46efadb3763 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.333612 Aug 23 17:53:36.894647 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 365/742] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:36 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:36.920460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-5c95274d-319f-407f-baa8-a64d225cb2a8 tempest-FlavorsV2NegativeTest-626815161 tempest-FlavorsV2NegativeTest-626815161-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:53:36.931648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-35cb7ae1-dbfc-47e7-b312-fb005c1cc7c4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:36.935527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-35cb7ae1-dbfc-47e7-b312-fb005c1cc7c4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:36.949731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35cb7ae1-dbfc-47e7-b312-fb005c1cc7c4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:36.950393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35cb7ae1-dbfc-47e7-b312-fb005c1cc7c4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:36.951620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35cb7ae1-dbfc-47e7-b312-fb005c1cc7c4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:36.952604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35cb7ae1-dbfc-47e7-b312-fb005c1cc7c4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:36.953210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35cb7ae1-dbfc-47e7-b312-fb005c1cc7c4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:36.955389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35cb7ae1-dbfc-47e7-b312-fb005c1cc7c4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:37.121075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-35cb7ae1-dbfc-47e7-b312-fb005c1cc7c4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1cc67f27fe034d19b33cd71de620fe1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069daa30186d4d9e859500618adaf444', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:37.121679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-35cb7ae1-dbfc-47e7-b312-fb005c1cc7c4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] flavor_id is None. Assuming migration. {{(pid=128808) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 23 17:53:37.122115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-35cb7ae1-dbfc-47e7-b312-fb005c1cc7c4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128808) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 17:53:37.238198 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-5c95274d-319f-407f-baa8-a64d225cb2a8 tempest-FlavorsV2NegativeTest-626815161 tempest-FlavorsV2NegativeTest-626815161-project] HTTP exception thrown: Flavor's memory is too small for requested image. Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c95274d-319f-407f-baa8-a64d225cb2a8 tempest-FlavorsV2NegativeTest-626815161 tempest-FlavorsV2NegativeTest-626815161-project] Request method failure captured: Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 142 Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQeJsn4h5WMhMw31HVlI9ZlCGCMm9cJDiyodHgtnhDf_RBJYGy6mpelhKtp8Tdj20j3iZtHKy8yOim49nXvyddfXQ597XZNXdrGydKg-g4H804ezy2uYuFH7oCwdIih5dHxsRsHTgkKCeHz0c1aZFgPfFVXrG5pB7ymVAZfpfoPdA4 Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 5c7e5616f6c94e668b9bf7580b731ea2 Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-FlavorsV2NegativeTest-626815161 Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5c7e5616f6c94e668b9bf7580b731ea2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c7e5616f6c94e668b9bf7580b731ea2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5c7e5616f6c94e668b9bf7580b731ea2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c7e5616f6c94e668b9bf7580b731ea2"}]}] Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-FlavorsV2NegativeTest-626815161 Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 5c7e5616f6c94e668b9bf7580b731ea2 Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-626815161 Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-FlavorsV2NegativeTest-626815161-project Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: addbdf952fd5461caf98faf4655a2069 Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-FlavorsV2NegativeTest-626815161-project Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-841058364", "imageRef": "0dbe6084-7173-43ea-951b-427f0c6ee905", "flavorRef": "452"}} Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: exception: Flavor's memory is too small for requested image. Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-841058364', 'imageRef': '0dbe6084-7173-43ea-951b-427f0c6ee905', 'flavorRef': '452'}}} Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1711, in _create_instance Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1006, in _checks_for_create_and_rebuild Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 670, in _validate_flavor_image Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 738, in _validate_flavor_image_nostatus Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:53:37.240331 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Aug 23 17:53:37.245020 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:53:37.253371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c95274d-319f-407f-baa8-a64d225cb2a8 tempest-FlavorsV2NegativeTest-626815161 tempest-FlavorsV2NegativeTest-626815161-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:37.257606 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5c95274d-319f-407f-baa8-a64d225cb2a8 tempest-FlavorsV2NegativeTest-626815161 tempest-FlavorsV2NegativeTest-626815161-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 0.472144 Aug 23 17:53:37.258375 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 378/743] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:53:36 2022] POST /compute/v2.1/servers => generated 93 bytes in 473 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:53:37.275723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-377214b4-d04d-4e21-b20c-895600b418ce tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:37.280531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-377214b4-d04d-4e21-b20c-895600b418ce tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:37.296241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-377214b4-d04d-4e21-b20c-895600b418ce tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:37.296942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-377214b4-d04d-4e21-b20c-895600b418ce tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:37.297829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-377214b4-d04d-4e21-b20c-895600b418ce tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:37.299116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-377214b4-d04d-4e21-b20c-895600b418ce tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:37.305634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-377214b4-d04d-4e21-b20c-895600b418ce tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:37.306143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-377214b4-d04d-4e21-b20c-895600b418ce tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:37.323958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=7 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:37.399852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=20 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:37.412312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-377214b4-d04d-4e21-b20c-895600b418ce tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:53:37.582206 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-35cb7ae1-dbfc-47e7-b312-fb005c1cc7c4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4/action" status: 202 len: 0 microversion: 2.1 time: 0.672220 Aug 23 17:53:37.582865 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 366/744] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:53:36 2022] POST /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4/action => generated 0 bytes in 674 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:53:37.588607 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-377214b4-d04d-4e21-b20c-895600b418ce tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 204 len: 0 microversion: 2.1 time: 0.328870 Aug 23 17:53:37.592994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d0a4797f-80df-47de-86b4-72d424b672cb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:37.593627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d0a4797f-80df-47de-86b4-72d424b672cb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:37.596541 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 379/745] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:53:37 2022] DELETE /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:53:37.609278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0a4797f-80df-47de-86b4-72d424b672cb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:37.617338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0a4797f-80df-47de-86b4-72d424b672cb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:37.618090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0a4797f-80df-47de-86b4-72d424b672cb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:37.620219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0a4797f-80df-47de-86b4-72d424b672cb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:37.620866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0a4797f-80df-47de-86b4-72d424b672cb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:37.621494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0a4797f-80df-47de-86b4-72d424b672cb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:37.621733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-88e0d378-8f32-43da-b282-175925f0116b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:37.622468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-88e0d378-8f32-43da-b282-175925f0116b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:37.653136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88e0d378-8f32-43da-b282-175925f0116b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:37.659291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88e0d378-8f32-43da-b282-175925f0116b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:37.660027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88e0d378-8f32-43da-b282-175925f0116b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:37.661083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88e0d378-8f32-43da-b282-175925f0116b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:37.661745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88e0d378-8f32-43da-b282-175925f0116b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:37.662350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88e0d378-8f32-43da-b282-175925f0116b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:37.676077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:37.822755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-88e0d378-8f32-43da-b282-175925f0116b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:37.835594 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-88e0d378-8f32-43da-b282-175925f0116b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1263 microversion: 2.1 time: 0.233770 Aug 23 17:53:37.836486 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 380/746] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:37 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1263 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:37.847865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-35f71e31-f7a0-4a7f-9d7b-cb1ccd662a7c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:37.852778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-35f71e31-f7a0-4a7f-9d7b-cb1ccd662a7c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:37.866617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35f71e31-f7a0-4a7f-9d7b-cb1ccd662a7c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:37.869109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35f71e31-f7a0-4a7f-9d7b-cb1ccd662a7c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:37.869837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35f71e31-f7a0-4a7f-9d7b-cb1ccd662a7c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:37.870783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35f71e31-f7a0-4a7f-9d7b-cb1ccd662a7c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:37.873623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35f71e31-f7a0-4a7f-9d7b-cb1ccd662a7c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:37.874427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35f71e31-f7a0-4a7f-9d7b-cb1ccd662a7c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:37.932493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d0a4797f-80df-47de-86b4-72d424b672cb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:37.944344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d0a4797f-80df-47de-86b4-72d424b672cb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:37.946189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d0a4797f-80df-47de-86b4-72d424b672cb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:37.947895 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d0a4797f-80df-47de-86b4-72d424b672cb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1362 microversion: 2.25 time: 0.363331 Aug 23 17:53:37.962749 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 367/747] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:37 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1362 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:37.971800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-231563822", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "1839114851", "adminPass": "***", "networks": [{"uuid": "9b52ecc3-3b67-475a-959e-4fa93e805f56"}], "security_groups": [{"name": "tempest-securitygroup--315050541"}], "key_name": "tempest-keypair-2110049289", "user_data": "}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:38.325080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-35f71e31-f7a0-4a7f-9d7b-cb1ccd662a7c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:38.341557 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-35f71e31-f7a0-4a7f-9d7b-cb1ccd662a7c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1472 microversion: 2.1 time: 0.498362 Aug 23 17:53:38.342494 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 381/748] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:37 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1472 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:38.349698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6799f4ea-4e93-4123-a8e7-7492df890563 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:38.353779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6799f4ea-4e93-4123-a8e7-7492df890563 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:38.365943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:38.373065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6799f4ea-4e93-4123-a8e7-7492df890563 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:38.376755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] validate_networks() for [('9b52ecc3-3b67-475a-959e-4fa93e805f56', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:53:38.377527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6799f4ea-4e93-4123-a8e7-7492df890563 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:38.378201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6799f4ea-4e93-4123-a8e7-7492df890563 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:38.379252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6799f4ea-4e93-4123-a8e7-7492df890563 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:38.379862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6799f4ea-4e93-4123-a8e7-7492df890563 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:38.387445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6799f4ea-4e93-4123-a8e7-7492df890563 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:38.697745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6799f4ea-4e93-4123-a8e7-7492df890563 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:38.707919 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6799f4ea-4e93-4123-a8e7-7492df890563 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.364332 Aug 23 17:53:38.711369 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 382/749] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:38 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:38.858557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e78bb454-c445-4d90-8a0a-caf228671f48 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:38.860319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e78bb454-c445-4d90-8a0a-caf228671f48 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:38.873098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e78bb454-c445-4d90-8a0a-caf228671f48 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:38.882673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e78bb454-c445-4d90-8a0a-caf228671f48 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:38.883314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e78bb454-c445-4d90-8a0a-caf228671f48 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:38.884076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e78bb454-c445-4d90-8a0a-caf228671f48 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:38.884548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e78bb454-c445-4d90-8a0a-caf228671f48 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:38.884973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e78bb454-c445-4d90-8a0a-caf228671f48 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:38.889445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:39.086246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e78bb454-c445-4d90-8a0a-caf228671f48 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:39.102993 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e78bb454-c445-4d90-8a0a-caf228671f48 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1269 microversion: 2.1 time: 0.244534 Aug 23 17:53:39.120627 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 383/750] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:38 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1269 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:39.150972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-80aa4dad-1584-443c-bc1c-b17d99f97b44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:39.151833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-80aa4dad-1584-443c-bc1c-b17d99f97b44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:39.161299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80aa4dad-1584-443c-bc1c-b17d99f97b44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:39.162173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80aa4dad-1584-443c-bc1c-b17d99f97b44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:39.162974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80aa4dad-1584-443c-bc1c-b17d99f97b44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:39.164039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80aa4dad-1584-443c-bc1c-b17d99f97b44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:39.165514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80aa4dad-1584-443c-bc1c-b17d99f97b44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:39.166122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80aa4dad-1584-443c-bc1c-b17d99f97b44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:39.683110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-80aa4dad-1584-443c-bc1c-b17d99f97b44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:39.694449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-80aa4dad-1584-443c-bc1c-b17d99f97b44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:39.696915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-80aa4dad-1584-443c-bc1c-b17d99f97b44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:39.698469 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-80aa4dad-1584-443c-bc1c-b17d99f97b44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1557 microversion: 2.25 time: 0.575369 Aug 23 17:53:39.700185 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 384/751] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:39 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1557 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:39.708584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d3ab6c3-dcc6-49ce-aa88-8b9a4bada8cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:39.710141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d3ab6c3-dcc6-49ce-aa88-8b9a4bada8cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:39.735841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d3ab6c3-dcc6-49ce-aa88-8b9a4bada8cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:39.737976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d3ab6c3-dcc6-49ce-aa88-8b9a4bada8cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:39.741209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d3ab6c3-dcc6-49ce-aa88-8b9a4bada8cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:39.743398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d3ab6c3-dcc6-49ce-aa88-8b9a4bada8cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:39.744739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d3ab6c3-dcc6-49ce-aa88-8b9a4bada8cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:39.746448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d3ab6c3-dcc6-49ce-aa88-8b9a4bada8cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:40.099593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:53:40.101433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:53:40.102127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:53:40.102855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:53:40.103437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:53:40.134317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:40.136605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:40.138244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:40.139616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:40.156246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:40.160025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:40.224287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Getting quotas for project 1d19cb17d3014429a4eda825eb937161. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:53:40.236482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Getting quotas for user df1d56f4fa244d49829c18545cde4308 and project 1d19cb17d3014429a4eda825eb937161. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:53:40.289191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:53:40.294679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:53:40.439646 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-472decb0-4fb3-4b44-beff-c39164c4f581 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.474962 Aug 23 17:53:40.440328 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 368/752] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:53:37 2022] POST /compute/v2.1/servers => generated 401 bytes in 2477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:53:40.575261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4d3ab6c3-dcc6-49ce-aa88-8b9a4bada8cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:40.587744 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d3ab6c3-dcc6-49ce-aa88-8b9a4bada8cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1472 microversion: 2.1 time: 0.886012 Aug 23 17:53:40.588325 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 385/753] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:39 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1472 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:40.606682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e540a3f6-05a8-429f-8116-33de59654349 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:40.619407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e540a3f6-05a8-429f-8116-33de59654349 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:40.658812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e540a3f6-05a8-429f-8116-33de59654349 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:40.659204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e540a3f6-05a8-429f-8116-33de59654349 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:40.659650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e540a3f6-05a8-429f-8116-33de59654349 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:40.660757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e540a3f6-05a8-429f-8116-33de59654349 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:40.662934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e540a3f6-05a8-429f-8116-33de59654349 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:40.663614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e540a3f6-05a8-429f-8116-33de59654349 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:40.850702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-14c7a895-fd70-4d06-a815-fdcf54aa6fee tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:40.851396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-14c7a895-fd70-4d06-a815-fdcf54aa6fee tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:40.861599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c7a895-fd70-4d06-a815-fdcf54aa6fee tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:40.862123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c7a895-fd70-4d06-a815-fdcf54aa6fee tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:40.862721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c7a895-fd70-4d06-a815-fdcf54aa6fee tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:40.865782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c7a895-fd70-4d06-a815-fdcf54aa6fee tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:40.866269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c7a895-fd70-4d06-a815-fdcf54aa6fee tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:40.869849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c7a895-fd70-4d06-a815-fdcf54aa6fee tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:41.293445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-14c7a895-fd70-4d06-a815-fdcf54aa6fee tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid b9504575-e074-4aad-871d-bcb9db7a22e3 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:41.320359 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-14c7a895-fd70-4d06-a815-fdcf54aa6fee tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 2052 microversion: 2.25 time: 0.878942 Aug 23 17:53:41.321048 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 369/754] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:40 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 2052 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:41.337382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac7e5917-c7f8-4fd4-b2cc-c805dae38a21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:41.339523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac7e5917-c7f8-4fd4-b2cc-c805dae38a21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:41.362055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7e5917-c7f8-4fd4-b2cc-c805dae38a21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:41.362618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7e5917-c7f8-4fd4-b2cc-c805dae38a21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:41.363027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7e5917-c7f8-4fd4-b2cc-c805dae38a21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:41.367544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7e5917-c7f8-4fd4-b2cc-c805dae38a21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:41.368033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7e5917-c7f8-4fd4-b2cc-c805dae38a21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:41.368605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7e5917-c7f8-4fd4-b2cc-c805dae38a21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:41.866254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac7e5917-c7f8-4fd4-b2cc-c805dae38a21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:41.884563 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac7e5917-c7f8-4fd4-b2cc-c805dae38a21 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1311 microversion: 2.1 time: 0.562179 Aug 23 17:53:41.912004 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 370/755] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:41 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1311 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:41.920003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5cb71433-c568-437d-bd62-671b6093014e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:41.924300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5cb71433-c568-437d-bd62-671b6093014e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:41.944341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cb71433-c568-437d-bd62-671b6093014e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:41.945383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cb71433-c568-437d-bd62-671b6093014e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:41.947577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cb71433-c568-437d-bd62-671b6093014e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:41.948621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cb71433-c568-437d-bd62-671b6093014e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:41.949335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cb71433-c568-437d-bd62-671b6093014e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:41.950812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cb71433-c568-437d-bd62-671b6093014e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:42.041533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e540a3f6-05a8-429f-8116-33de59654349 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:42.059629 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e540a3f6-05a8-429f-8116-33de59654349 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 1.461383 Aug 23 17:53:42.060333 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 386/756] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:40 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 1463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:42.080162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec3ada10-5278-4970-b5e4-9ac3d0ca370c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:42.081268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ec3ada10-5278-4970-b5e4-9ac3d0ca370c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:42.094759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec3ada10-5278-4970-b5e4-9ac3d0ca370c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:42.096713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec3ada10-5278-4970-b5e4-9ac3d0ca370c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:42.099885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec3ada10-5278-4970-b5e4-9ac3d0ca370c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:42.100827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec3ada10-5278-4970-b5e4-9ac3d0ca370c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:42.101577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec3ada10-5278-4970-b5e4-9ac3d0ca370c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:42.102218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec3ada10-5278-4970-b5e4-9ac3d0ca370c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:42.276314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5cb71433-c568-437d-bd62-671b6093014e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:42.295975 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5cb71433-c568-437d-bd62-671b6093014e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1316 microversion: 2.1 time: 0.382188 Aug 23 17:53:42.296628 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 371/757] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:41 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1316 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:42.333953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1fb8fdff-f464-4ec2-9fde-cb35fa1588fc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:42.335495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1fb8fdff-f464-4ec2-9fde-cb35fa1588fc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:42.350843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1fb8fdff-f464-4ec2-9fde-cb35fa1588fc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:42.351627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1fb8fdff-f464-4ec2-9fde-cb35fa1588fc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:42.352264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1fb8fdff-f464-4ec2-9fde-cb35fa1588fc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:42.353236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1fb8fdff-f464-4ec2-9fde-cb35fa1588fc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:42.353907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1fb8fdff-f464-4ec2-9fde-cb35fa1588fc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:42.354532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1fb8fdff-f464-4ec2-9fde-cb35fa1588fc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:42.673435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-ec3ada10-5278-4970-b5e4-9ac3d0ca370c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid b9504575-e074-4aad-871d-bcb9db7a22e3 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:42.719176 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec3ada10-5278-4970-b5e4-9ac3d0ca370c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 2052 microversion: 2.25 time: 0.656502 Aug 23 17:53:42.740224 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 387/758] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:42 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 2052 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:42.754320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96a866b1-a0dd-4530-a13e-8bddc0cde4e8 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:42.764120 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:53:42.764120 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:53:42.765703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96a866b1-a0dd-4530-a13e-8bddc0cde4e8 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:42.767269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96a866b1-a0dd-4530-a13e-8bddc0cde4e8 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:42.772181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96a866b1-a0dd-4530-a13e-8bddc0cde4e8 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:42.773503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96a866b1-a0dd-4530-a13e-8bddc0cde4e8 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:42.774216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96a866b1-a0dd-4530-a13e-8bddc0cde4e8 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:42.774927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96a866b1-a0dd-4530-a13e-8bddc0cde4e8 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:42.907253 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-96a866b1-a0dd-4530-a13e-8bddc0cde4e8 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.154669 Aug 23 17:53:42.923700 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 388/759] 10.222.0.61 () {60 vars in 1217 bytes} [Tue Aug 23 17:53:42 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:53:42.933821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ffc008b6-a5ea-4c38-bf45-42ac5d2f7b34 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:42.935077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ffc008b6-a5ea-4c38-bf45-42ac5d2f7b34 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:42.960770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ffc008b6-a5ea-4c38-bf45-42ac5d2f7b34 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:42.961650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ffc008b6-a5ea-4c38-bf45-42ac5d2f7b34 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:42.962440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ffc008b6-a5ea-4c38-bf45-42ac5d2f7b34 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:42.963771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ffc008b6-a5ea-4c38-bf45-42ac5d2f7b34 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:42.978849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ffc008b6-a5ea-4c38-bf45-42ac5d2f7b34 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:42.979435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ffc008b6-a5ea-4c38-bf45-42ac5d2f7b34 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:43.130886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1fb8fdff-f464-4ec2-9fde-cb35fa1588fc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:43.144562 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1fb8fdff-f464-4ec2-9fde-cb35fa1588fc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1472 microversion: 2.1 time: 0.828766 Aug 23 17:53:43.154821 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 372/760] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:42 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1472 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:43.169210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6c21ef03-c198-4f9d-912c-f3fd3e823006 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850468-16", "block_migration": "auto"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:43.181815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6c21ef03-c198-4f9d-912c-f3fd3e823006 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:43.201950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c21ef03-c198-4f9d-912c-f3fd3e823006 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:43.202518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c21ef03-c198-4f9d-912c-f3fd3e823006 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:43.204123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c21ef03-c198-4f9d-912c-f3fd3e823006 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:43.204960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c21ef03-c198-4f9d-912c-f3fd3e823006 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:43.206779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c21ef03-c198-4f9d-912c-f3fd3e823006 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:43.207656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c21ef03-c198-4f9d-912c-f3fd3e823006 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:43.263031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-6c21ef03-c198-4f9d-912c-f3fd3e823006 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'flavor' on Instance uuid b9504575-e074-4aad-871d-bcb9db7a22e3 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:53:43.293584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6c21ef03-c198-4f9d-912c-f3fd3e823006 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Going to try to live migrate instance to n-h2-850468-16 {{(pid=128808) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 17:53:44.178249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ffc008b6-a5ea-4c38-bf45-42ac5d2f7b34 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:44.198754 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ffc008b6-a5ea-4c38-bf45-42ac5d2f7b34 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1311 microversion: 2.1 time: 1.270136 Aug 23 17:53:44.200917 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 389/761] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:42 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1311 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:44.218452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c5190fbe-fa06-413c-8fe3-e4dd968b4ee1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:44.221785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c5190fbe-fa06-413c-8fe3-e4dd968b4ee1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:44.239274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5190fbe-fa06-413c-8fe3-e4dd968b4ee1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:44.239717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5190fbe-fa06-413c-8fe3-e4dd968b4ee1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:44.241787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5190fbe-fa06-413c-8fe3-e4dd968b4ee1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:44.247092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5190fbe-fa06-413c-8fe3-e4dd968b4ee1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:44.247586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5190fbe-fa06-413c-8fe3-e4dd968b4ee1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:44.248202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5190fbe-fa06-413c-8fe3-e4dd968b4ee1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:45.488005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c5190fbe-fa06-413c-8fe3-e4dd968b4ee1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:45.503828 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c5190fbe-fa06-413c-8fe3-e4dd968b4ee1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 1.296474 Aug 23 17:53:45.504436 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 390/762] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:44 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:45.519289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a71a2ebe-939d-450f-8745-e79a20c997bc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:45.519915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a71a2ebe-939d-450f-8745-e79a20c997bc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:45.562852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a71a2ebe-939d-450f-8745-e79a20c997bc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:45.570683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a71a2ebe-939d-450f-8745-e79a20c997bc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:45.571568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a71a2ebe-939d-450f-8745-e79a20c997bc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:45.577125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a71a2ebe-939d-450f-8745-e79a20c997bc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:45.578197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a71a2ebe-939d-450f-8745-e79a20c997bc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:45.579567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a71a2ebe-939d-450f-8745-e79a20c997bc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:45.765611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a71a2ebe-939d-450f-8745-e79a20c997bc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:45.786064 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a71a2ebe-939d-450f-8745-e79a20c997bc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1322 microversion: 2.1 time: 0.280500 Aug 23 17:53:45.805624 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 391/763] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:45 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:45.822618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-0bb0e57f-e0d4-4874-aeba-b716d5b3037f req-6abc47d9-4d20-41ef-a5bd-65b480fc57f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1684439-72b6-4fff-9624-39abf5a9552a", "name": "network-vif-deleted", "tag": "be443953-eadd-4537-b630-37f66a56fe75"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:45.863827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0bb0e57f-e0d4-4874-aeba-b716d5b3037f req-6abc47d9-4d20-41ef-a5bd-65b480fc57f7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:45.864721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0bb0e57f-e0d4-4874-aeba-b716d5b3037f req-6abc47d9-4d20-41ef-a5bd-65b480fc57f7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:45.865574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0bb0e57f-e0d4-4874-aeba-b716d5b3037f req-6abc47d9-4d20-41ef-a5bd-65b480fc57f7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:45.878970 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-0bb0e57f-e0d4-4874-aeba-b716d5b3037f req-6abc47d9-4d20-41ef-a5bd-65b480fc57f7 service nova] Creating event network-vif-deleted:be443953-eadd-4537-b630-37f66a56fe75 for instance f1684439-72b6-4fff-9624-39abf5a9552a on n-h1-850468-16 Aug 23 17:53:45.885158 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-0bb0e57f-e0d4-4874-aeba-b716d5b3037f req-6abc47d9-4d20-41ef-a5bd-65b480fc57f7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077418 Aug 23 17:53:45.887211 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 392/764] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:45.894062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-faab92f5-df17-4d9f-9a7c-7f42dd26c9af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:45.895155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-faab92f5-df17-4d9f-9a7c-7f42dd26c9af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:45.912755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-faab92f5-df17-4d9f-9a7c-7f42dd26c9af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:45.914015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-faab92f5-df17-4d9f-9a7c-7f42dd26c9af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:45.915908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-faab92f5-df17-4d9f-9a7c-7f42dd26c9af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:45.916907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-faab92f5-df17-4d9f-9a7c-7f42dd26c9af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:45.917786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-faab92f5-df17-4d9f-9a7c-7f42dd26c9af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:45.918441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-faab92f5-df17-4d9f-9a7c-7f42dd26c9af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:46.394012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-faab92f5-df17-4d9f-9a7c-7f42dd26c9af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:46.403230 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-faab92f5-df17-4d9f-9a7c-7f42dd26c9af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1477 microversion: 2.1 time: 0.514175 Aug 23 17:53:46.418966 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 393/765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:45 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1477 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:46.427625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-08d6b499-1d21-45b7-a564-694ab0547188 req-ea3d83a3-ee95-4ce7-8db8-381052b31777 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdfabf0c-2561-40d0-9f96-f81d60908fec", "tag": "cf4c929b-222c-42c4-b117-5dea5790b383"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:46.437272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-08d6b499-1d21-45b7-a564-694ab0547188 req-ea3d83a3-ee95-4ce7-8db8-381052b31777 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:46.438143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-08d6b499-1d21-45b7-a564-694ab0547188 req-ea3d83a3-ee95-4ce7-8db8-381052b31777 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:46.438907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-08d6b499-1d21-45b7-a564-694ab0547188 req-ea3d83a3-ee95-4ce7-8db8-381052b31777 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:46.451044 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-08d6b499-1d21-45b7-a564-694ab0547188 req-ea3d83a3-ee95-4ce7-8db8-381052b31777 service nova] Creating event network-changed:cf4c929b-222c-42c4-b117-5dea5790b383 for instance cdfabf0c-2561-40d0-9f96-f81d60908fec on n-h2-850468-16 Aug 23 17:53:46.457121 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-08d6b499-1d21-45b7-a564-694ab0547188 req-ea3d83a3-ee95-4ce7-8db8-381052b31777 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036584 Aug 23 17:53:46.458310 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 394/766] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:46.463812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8d0ace8e-ace2-4952-b5ce-568d66716813 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:46.464817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8d0ace8e-ace2-4952-b5ce-568d66716813 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:46.473553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d0ace8e-ace2-4952-b5ce-568d66716813 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:46.474281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d0ace8e-ace2-4952-b5ce-568d66716813 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:46.474974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d0ace8e-ace2-4952-b5ce-568d66716813 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:46.475985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d0ace8e-ace2-4952-b5ce-568d66716813 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:46.476620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d0ace8e-ace2-4952-b5ce-568d66716813 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:46.477231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d0ace8e-ace2-4952-b5ce-568d66716813 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:46.952594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8d0ace8e-ace2-4952-b5ce-568d66716813 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:46.963834 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8d0ace8e-ace2-4952-b5ce-568d66716813 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1311 microversion: 2.1 time: 0.504108 Aug 23 17:53:46.979376 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 395/767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:46 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1311 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:46.990017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-994c72f9-738e-4175-8a2d-ead817fdb6ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:46.990952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-994c72f9-738e-4175-8a2d-ead817fdb6ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:46.997571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-994c72f9-738e-4175-8a2d-ead817fdb6ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:46.998278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-994c72f9-738e-4175-8a2d-ead817fdb6ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:46.998746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-994c72f9-738e-4175-8a2d-ead817fdb6ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:46.999803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-994c72f9-738e-4175-8a2d-ead817fdb6ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:47.000328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-994c72f9-738e-4175-8a2d-ead817fdb6ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:47.000932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-994c72f9-738e-4175-8a2d-ead817fdb6ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:47.217919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-994c72f9-738e-4175-8a2d-ead817fdb6ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:47.228867 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-994c72f9-738e-4175-8a2d-ead817fdb6ee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.248260 Aug 23 17:53:47.229715 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 396/768] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:46 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:47.249383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6293de1c-b24c-4494-ba3d-377d00c32141 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:47.250103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6293de1c-b24c-4494-ba3d-377d00c32141 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:47.259438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6293de1c-b24c-4494-ba3d-377d00c32141 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:47.260188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6293de1c-b24c-4494-ba3d-377d00c32141 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:47.260629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6293de1c-b24c-4494-ba3d-377d00c32141 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:47.261348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6293de1c-b24c-4494-ba3d-377d00c32141 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:47.261806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6293de1c-b24c-4494-ba3d-377d00c32141 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:47.262236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6293de1c-b24c-4494-ba3d-377d00c32141 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:47.357782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6293de1c-b24c-4494-ba3d-377d00c32141 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:47.366805 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6293de1c-b24c-4494-ba3d-377d00c32141 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1322 microversion: 2.1 time: 0.122415 Aug 23 17:53:47.367596 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 397/769] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:47 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1322 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:47.439753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e9ac397d-e128-4f87-b97a-3bdc741f4fcc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:47.440964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e9ac397d-e128-4f87-b97a-3bdc741f4fcc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:47.452961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9ac397d-e128-4f87-b97a-3bdc741f4fcc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:47.454463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9ac397d-e128-4f87-b97a-3bdc741f4fcc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:47.455211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9ac397d-e128-4f87-b97a-3bdc741f4fcc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:47.456281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9ac397d-e128-4f87-b97a-3bdc741f4fcc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:47.457750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9ac397d-e128-4f87-b97a-3bdc741f4fcc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:47.458497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9ac397d-e128-4f87-b97a-3bdc741f4fcc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:47.762674 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6c21ef03-c198-4f9d-912c-f3fd3e823006 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3/action" status: 202 len: 0 microversion: 2.25 time: 4.616064 Aug 23 17:53:47.763806 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 373/770] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 17:53:43 2022] POST /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3/action => generated 0 bytes in 4618 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:53:47.775762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d50f081c-a9ae-467b-bcaf-4dbbc2b96209 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:47.776596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d50f081c-a9ae-467b-bcaf-4dbbc2b96209 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:47.790392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d50f081c-a9ae-467b-bcaf-4dbbc2b96209 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:47.792987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d50f081c-a9ae-467b-bcaf-4dbbc2b96209 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:47.793440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d50f081c-a9ae-467b-bcaf-4dbbc2b96209 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:47.794184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d50f081c-a9ae-467b-bcaf-4dbbc2b96209 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:47.795934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d50f081c-a9ae-467b-bcaf-4dbbc2b96209 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:47.797552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d50f081c-a9ae-467b-bcaf-4dbbc2b96209 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:48.288954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e9ac397d-e128-4f87-b97a-3bdc741f4fcc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:48.297920 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e9ac397d-e128-4f87-b97a-3bdc741f4fcc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1477 microversion: 2.1 time: 0.868109 Aug 23 17:53:48.298715 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 398/771] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:47 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1477 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:48.314134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ecb8b4c5-91ae-479a-9d66-3e1ef172aa69 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:48.314816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ecb8b4c5-91ae-479a-9d66-3e1ef172aa69 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:48.325458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecb8b4c5-91ae-479a-9d66-3e1ef172aa69 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:48.326471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecb8b4c5-91ae-479a-9d66-3e1ef172aa69 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:48.327128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecb8b4c5-91ae-479a-9d66-3e1ef172aa69 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:48.328045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecb8b4c5-91ae-479a-9d66-3e1ef172aa69 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:48.329538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecb8b4c5-91ae-479a-9d66-3e1ef172aa69 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:48.334495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecb8b4c5-91ae-479a-9d66-3e1ef172aa69 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:48.546946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d50f081c-a9ae-467b-bcaf-4dbbc2b96209 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:48.571583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d50f081c-a9ae-467b-bcaf-4dbbc2b96209 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:48.573388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d50f081c-a9ae-467b-bcaf-4dbbc2b96209 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:48.575814 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d50f081c-a9ae-467b-bcaf-4dbbc2b96209 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1567 microversion: 2.25 time: 0.806390 Aug 23 17:53:48.582247 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 374/772] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:47 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1567 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:53:48.595610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-245f7434-c1d5-4735-a3d0-4fbce46bfced tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:48.598384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-245f7434-c1d5-4735-a3d0-4fbce46bfced tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:48.632184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-245f7434-c1d5-4735-a3d0-4fbce46bfced tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:48.633026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-245f7434-c1d5-4735-a3d0-4fbce46bfced tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:48.633677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-245f7434-c1d5-4735-a3d0-4fbce46bfced tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:48.635501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-245f7434-c1d5-4735-a3d0-4fbce46bfced tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:48.636257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-245f7434-c1d5-4735-a3d0-4fbce46bfced tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:48.636874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-245f7434-c1d5-4735-a3d0-4fbce46bfced tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:48.909436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-245f7434-c1d5-4735-a3d0-4fbce46bfced tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:48.939275 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-245f7434-c1d5-4735-a3d0-4fbce46bfced tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.353441 Aug 23 17:53:48.941360 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 375/773] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:48 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:48.951028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b36b4a4d-19c6-444b-8ca6-d04f4ae47cfc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:48.952972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b36b4a4d-19c6-444b-8ca6-d04f4ae47cfc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:48.978857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b36b4a4d-19c6-444b-8ca6-d04f4ae47cfc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:48.979557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b36b4a4d-19c6-444b-8ca6-d04f4ae47cfc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:48.980353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b36b4a4d-19c6-444b-8ca6-d04f4ae47cfc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:48.981267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b36b4a4d-19c6-444b-8ca6-d04f4ae47cfc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:48.981870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b36b4a4d-19c6-444b-8ca6-d04f4ae47cfc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:48.982655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b36b4a4d-19c6-444b-8ca6-d04f4ae47cfc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:49.087099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ecb8b4c5-91ae-479a-9d66-3e1ef172aa69 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:49.101372 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ecb8b4c5-91ae-479a-9d66-3e1ef172aa69 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1311 microversion: 2.1 time: 0.801450 Aug 23 17:53:49.122234 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 399/774] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:48 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1311 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:49.275171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b36b4a4d-19c6-444b-8ca6-d04f4ae47cfc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:49.304195 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b36b4a4d-19c6-444b-8ca6-d04f4ae47cfc tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1389 microversion: 2.1 time: 0.360561 Aug 23 17:53:49.306926 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 376/775] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:48 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1389 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:49.323552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2c9974a2-390d-46dd-bf94-b32d3400e0d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:49.325938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2c9974a2-390d-46dd-bf94-b32d3400e0d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:49.336502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c9974a2-390d-46dd-bf94-b32d3400e0d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:49.339664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c9974a2-390d-46dd-bf94-b32d3400e0d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:49.341335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c9974a2-390d-46dd-bf94-b32d3400e0d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:49.344584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c9974a2-390d-46dd-bf94-b32d3400e0d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:49.345496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c9974a2-390d-46dd-bf94-b32d3400e0d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:49.350534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c9974a2-390d-46dd-bf94-b32d3400e0d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:49.620641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-558fcc66-4fb7-430f-8d65-54dd39ec558e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:49.621460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-558fcc66-4fb7-430f-8d65-54dd39ec558e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:49.629736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-558fcc66-4fb7-430f-8d65-54dd39ec558e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:49.630583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-558fcc66-4fb7-430f-8d65-54dd39ec558e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:49.631331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-558fcc66-4fb7-430f-8d65-54dd39ec558e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:49.632262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-558fcc66-4fb7-430f-8d65-54dd39ec558e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:49.633001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-558fcc66-4fb7-430f-8d65-54dd39ec558e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:49.633773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-558fcc66-4fb7-430f-8d65-54dd39ec558e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:49.717184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2c9974a2-390d-46dd-bf94-b32d3400e0d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:49.767371 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2c9974a2-390d-46dd-bf94-b32d3400e0d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1477 microversion: 2.1 time: 0.452043 Aug 23 17:53:49.768021 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 400/776] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:49 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1477 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:49.964200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-427d758e-1e59-4c57-8e75-8a3d3feaec8e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:49.965069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-427d758e-1e59-4c57-8e75-8a3d3feaec8e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:49.986662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-427d758e-1e59-4c57-8e75-8a3d3feaec8e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:49.990509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-427d758e-1e59-4c57-8e75-8a3d3feaec8e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:49.991181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-427d758e-1e59-4c57-8e75-8a3d3feaec8e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:49.992098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-427d758e-1e59-4c57-8e75-8a3d3feaec8e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:49.995243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-427d758e-1e59-4c57-8e75-8a3d3feaec8e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:49.996006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-427d758e-1e59-4c57-8e75-8a3d3feaec8e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:50.041423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:50.197948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:50.278001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=36 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:50.625795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-427d758e-1e59-4c57-8e75-8a3d3feaec8e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:50.665286 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-427d758e-1e59-4c57-8e75-8a3d3feaec8e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.703203 Aug 23 17:53:50.671051 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 401/777] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:49 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:50.684098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1cf4fcf2-bf3e-4143-8eed-94f1162d8e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:50.684916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1cf4fcf2-bf3e-4143-8eed-94f1162d8e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:50.688421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-558fcc66-4fb7-430f-8d65-54dd39ec558e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:50.698757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cf4fcf2-bf3e-4143-8eed-94f1162d8e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:50.700316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cf4fcf2-bf3e-4143-8eed-94f1162d8e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:50.700931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cf4fcf2-bf3e-4143-8eed-94f1162d8e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:50.702323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cf4fcf2-bf3e-4143-8eed-94f1162d8e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:50.702737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-558fcc66-4fb7-430f-8d65-54dd39ec558e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:50.704965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cf4fcf2-bf3e-4143-8eed-94f1162d8e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:50.705594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cf4fcf2-bf3e-4143-8eed-94f1162d8e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:50.707073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-558fcc66-4fb7-430f-8d65-54dd39ec558e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:50.710522 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-558fcc66-4fb7-430f-8d65-54dd39ec558e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1567 microversion: 2.25 time: 1.109047 Aug 23 17:53:50.713767 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 377/778] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:49 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1567 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:50.723123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-01c5ef9d-b532-4f86-a441-c22b66ed5c96 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:50.727664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-01c5ef9d-b532-4f86-a441-c22b66ed5c96 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:50.745816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01c5ef9d-b532-4f86-a441-c22b66ed5c96 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:50.746756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01c5ef9d-b532-4f86-a441-c22b66ed5c96 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:50.747405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01c5ef9d-b532-4f86-a441-c22b66ed5c96 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:50.748309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01c5ef9d-b532-4f86-a441-c22b66ed5c96 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:50.748927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01c5ef9d-b532-4f86-a441-c22b66ed5c96 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:50.749529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01c5ef9d-b532-4f86-a441-c22b66ed5c96 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:51.272017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1cf4fcf2-bf3e-4143-8eed-94f1162d8e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:51.280253 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1cf4fcf2-bf3e-4143-8eed-94f1162d8e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1311 microversion: 2.1 time: 0.607795 Aug 23 17:53:51.281032 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 402/779] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:50 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1311 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:51.307798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7710f955-3aa3-4db4-909e-a3afea7d2cfc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:51.310575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7710f955-3aa3-4db4-909e-a3afea7d2cfc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:51.321765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7710f955-3aa3-4db4-909e-a3afea7d2cfc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:51.323427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7710f955-3aa3-4db4-909e-a3afea7d2cfc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:51.326530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7710f955-3aa3-4db4-909e-a3afea7d2cfc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:51.331050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7710f955-3aa3-4db4-909e-a3afea7d2cfc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:51.331979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7710f955-3aa3-4db4-909e-a3afea7d2cfc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:51.332646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7710f955-3aa3-4db4-909e-a3afea7d2cfc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:51.508892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-01c5ef9d-b532-4f86-a441-c22b66ed5c96 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:51.522612 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-01c5ef9d-b532-4f86-a441-c22b66ed5c96 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1389 microversion: 2.1 time: 0.807416 Aug 23 17:53:51.538130 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 378/780] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:50 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1389 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:51.693054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b4964766-e639-41fb-bb10-f6cabb5a8374 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:51.693922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b4964766-e639-41fb-bb10-f6cabb5a8374 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:51.698777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:51.720164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4964766-e639-41fb-bb10-f6cabb5a8374 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:51.722075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4964766-e639-41fb-bb10-f6cabb5a8374 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:51.722558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4964766-e639-41fb-bb10-f6cabb5a8374 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:51.726488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4964766-e639-41fb-bb10-f6cabb5a8374 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:51.727134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4964766-e639-41fb-bb10-f6cabb5a8374 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:51.730454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4964766-e639-41fb-bb10-f6cabb5a8374 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:51.899361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7710f955-3aa3-4db4-909e-a3afea7d2cfc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:51.908082 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7710f955-3aa3-4db4-909e-a3afea7d2cfc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1477 microversion: 2.1 time: 0.623670 Aug 23 17:53:51.918760 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 403/781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:51 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1477 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:51.924084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c763d13a-d1ff-49bc-afc8-3f0698aaf2f8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:51.940030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c763d13a-d1ff-49bc-afc8-3f0698aaf2f8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:51.946193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c763d13a-d1ff-49bc-afc8-3f0698aaf2f8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:51.946727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c763d13a-d1ff-49bc-afc8-3f0698aaf2f8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:51.947173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c763d13a-d1ff-49bc-afc8-3f0698aaf2f8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:51.947896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c763d13a-d1ff-49bc-afc8-3f0698aaf2f8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:51.948355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c763d13a-d1ff-49bc-afc8-3f0698aaf2f8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:51.948783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c763d13a-d1ff-49bc-afc8-3f0698aaf2f8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:52.562569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b4964766-e639-41fb-bb10-f6cabb5a8374 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:52.573605 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b4964766-e639-41fb-bb10-f6cabb5a8374 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.886035 Aug 23 17:53:52.577431 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 379/782] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:51 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:52.588225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c5837974-c10b-4e14-b54f-43f458db152b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:52.590085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c5837974-c10b-4e14-b54f-43f458db152b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:52.602346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5837974-c10b-4e14-b54f-43f458db152b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:52.603778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5837974-c10b-4e14-b54f-43f458db152b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:52.605174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5837974-c10b-4e14-b54f-43f458db152b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:52.608539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5837974-c10b-4e14-b54f-43f458db152b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:52.612495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5837974-c10b-4e14-b54f-43f458db152b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:52.614155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5837974-c10b-4e14-b54f-43f458db152b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:52.641124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c763d13a-d1ff-49bc-afc8-3f0698aaf2f8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:52.659841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c763d13a-d1ff-49bc-afc8-3f0698aaf2f8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:52.661824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c763d13a-d1ff-49bc-afc8-3f0698aaf2f8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:52.663260 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c763d13a-d1ff-49bc-afc8-3f0698aaf2f8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1567 microversion: 2.25 time: 0.743233 Aug 23 17:53:52.673904 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 404/783] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:51 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1567 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:52.678956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-138ec56d-9d99-4f08-a794-b02d4642bc85 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:52.679785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-138ec56d-9d99-4f08-a794-b02d4642bc85 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:52.689913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-138ec56d-9d99-4f08-a794-b02d4642bc85 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:52.699375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-138ec56d-9d99-4f08-a794-b02d4642bc85 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:52.711336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-138ec56d-9d99-4f08-a794-b02d4642bc85 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:52.712112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-138ec56d-9d99-4f08-a794-b02d4642bc85 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:52.712743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-138ec56d-9d99-4f08-a794-b02d4642bc85 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:52.713183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-138ec56d-9d99-4f08-a794-b02d4642bc85 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:52.791359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:53.065174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-138ec56d-9d99-4f08-a794-b02d4642bc85 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:53.086335 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-138ec56d-9d99-4f08-a794-b02d4642bc85 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1389 microversion: 2.1 time: 0.411079 Aug 23 17:53:53.087698 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 405/784] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:52 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1389 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:53.107899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-02d297af-4376-4552-911f-4749bcad75ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:53.113161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-02d297af-4376-4552-911f-4749bcad75ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:53.128093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02d297af-4376-4552-911f-4749bcad75ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:53.128761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02d297af-4376-4552-911f-4749bcad75ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:53.129382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02d297af-4376-4552-911f-4749bcad75ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:53.132061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02d297af-4376-4552-911f-4749bcad75ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:53.133777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02d297af-4376-4552-911f-4749bcad75ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:53.138165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02d297af-4376-4552-911f-4749bcad75ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:53.286254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c5837974-c10b-4e14-b54f-43f458db152b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:53.301063 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c5837974-c10b-4e14-b54f-43f458db152b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1311 microversion: 2.1 time: 0.715600 Aug 23 17:53:53.304851 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 380/785] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:52 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1311 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:53.508359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-dbefc617-1055-4aab-84d5-6dabc25e48d5 req-fa289d48-f30a-498b-8f15-3de8f6f692b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482c06a7-2b1f-4a6e-8b62-b702d32c4c3f", "tag": "61e068c3-e07e-47db-a508-2528903c28f7"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:53.522257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-dbefc617-1055-4aab-84d5-6dabc25e48d5 req-fa289d48-f30a-498b-8f15-3de8f6f692b7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:53.534928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-dbefc617-1055-4aab-84d5-6dabc25e48d5 req-fa289d48-f30a-498b-8f15-3de8f6f692b7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:53.535500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-dbefc617-1055-4aab-84d5-6dabc25e48d5 req-fa289d48-f30a-498b-8f15-3de8f6f692b7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:53.549762 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-dbefc617-1055-4aab-84d5-6dabc25e48d5 req-fa289d48-f30a-498b-8f15-3de8f6f692b7 service nova] Creating event network-changed:61e068c3-e07e-47db-a508-2528903c28f7 for instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f on n-h2-850468-16 Aug 23 17:53:53.566837 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-dbefc617-1055-4aab-84d5-6dabc25e48d5 req-fa289d48-f30a-498b-8f15-3de8f6f692b7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061329 Aug 23 17:53:53.573232 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 381/786] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:53:53.597479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7b1f0f2b-482f-4a9c-8f02-9b6e17bc8023 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:53.598380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7b1f0f2b-482f-4a9c-8f02-9b6e17bc8023 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:53.611197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b1f0f2b-482f-4a9c-8f02-9b6e17bc8023 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:53.616716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b1f0f2b-482f-4a9c-8f02-9b6e17bc8023 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:53.620341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b1f0f2b-482f-4a9c-8f02-9b6e17bc8023 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:53.621318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b1f0f2b-482f-4a9c-8f02-9b6e17bc8023 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:53.626496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b1f0f2b-482f-4a9c-8f02-9b6e17bc8023 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:53.627465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b1f0f2b-482f-4a9c-8f02-9b6e17bc8023 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:53.989758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-02d297af-4376-4552-911f-4749bcad75ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:54.002108 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-02d297af-4376-4552-911f-4749bcad75ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1477 microversion: 2.1 time: 0.912889 Aug 23 17:53:54.015377 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 406/787] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:53 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1477 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:54.023151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c07e035-a03e-4f54-b341-98b6ff296639 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:54.024247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0c07e035-a03e-4f54-b341-98b6ff296639 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:54.031156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c07e035-a03e-4f54-b341-98b6ff296639 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:54.032034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c07e035-a03e-4f54-b341-98b6ff296639 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:54.032785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c07e035-a03e-4f54-b341-98b6ff296639 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:54.033763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c07e035-a03e-4f54-b341-98b6ff296639 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:54.034440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c07e035-a03e-4f54-b341-98b6ff296639 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:54.035111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c07e035-a03e-4f54-b341-98b6ff296639 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:54.323758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7b1f0f2b-482f-4a9c-8f02-9b6e17bc8023 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:54.334563 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7b1f0f2b-482f-4a9c-8f02-9b6e17bc8023 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.742327 Aug 23 17:53:54.346238 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 382/788] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:53 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:54.358773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1ac5ed5e-7b8e-4a8c-a48d-1f749c229296 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:54.358773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1ac5ed5e-7b8e-4a8c-a48d-1f749c229296 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:54.382230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ac5ed5e-7b8e-4a8c-a48d-1f749c229296 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:54.382748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ac5ed5e-7b8e-4a8c-a48d-1f749c229296 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:54.383182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ac5ed5e-7b8e-4a8c-a48d-1f749c229296 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:54.394918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ac5ed5e-7b8e-4a8c-a48d-1f749c229296 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:54.395419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ac5ed5e-7b8e-4a8c-a48d-1f749c229296 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:54.395864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ac5ed5e-7b8e-4a8c-a48d-1f749c229296 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:54.410850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:54.506374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0c07e035-a03e-4f54-b341-98b6ff296639 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:54.523907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0c07e035-a03e-4f54-b341-98b6ff296639 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:54.525723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0c07e035-a03e-4f54-b341-98b6ff296639 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:54.529072 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c07e035-a03e-4f54-b341-98b6ff296639 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1567 microversion: 2.25 time: 0.512197 Aug 23 17:53:54.532058 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 407/789] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:54 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1567 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:54.856037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6e00ef3-7441-4062-a6d7-fe50348a317a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Action: 'create', calling method: .version_select at 0x7f27ecc0d0d0>, body: {"keypair": {"name": "tempest-keypair-1062296527", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIVVXxJYrBzKlBDoAUwFItLDOwD7hei1NTgjwOivYw0w9YvDG6bOOpX6vHKkQH3jQ4kJDLIpjh1Rs4rWw480QIhIp2n3axd2MxJHeJz9nvmz+iyAUV3bjgiuAzG0TxPlpA=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:54.900662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-f6e00ef3-7441-4062-a6d7-fe50348a317a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Getting quotas for project d60b8676313b4607b015755341be1331. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:53:54.908098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-f6e00ef3-7441-4062-a6d7-fe50348a317a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Getting quotas for user d4e792ec8c584ba489b976f62f409d94 and project d60b8676313b4607b015755341be1331. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:53:54.979906 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6e00ef3-7441-4062-a6d7-fe50348a317a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.446300 Aug 23 17:53:54.981153 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 408/790] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:53:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:54.992245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-185c6309-ba14-4b7c-928b-c64a18ab3c29 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:54.992933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-185c6309-ba14-4b7c-928b-c64a18ab3c29 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:55.009166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-185c6309-ba14-4b7c-928b-c64a18ab3c29 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:55.009618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-185c6309-ba14-4b7c-928b-c64a18ab3c29 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:55.009978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-185c6309-ba14-4b7c-928b-c64a18ab3c29 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:55.010732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-185c6309-ba14-4b7c-928b-c64a18ab3c29 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:55.011197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-185c6309-ba14-4b7c-928b-c64a18ab3c29 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:55.011628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-185c6309-ba14-4b7c-928b-c64a18ab3c29 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:55.445734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-185c6309-ba14-4b7c-928b-c64a18ab3c29 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:55.461740 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-185c6309-ba14-4b7c-928b-c64a18ab3c29 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1311 microversion: 2.1 time: 0.479340 Aug 23 17:53:55.470388 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 409/791] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:54 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1311 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:55.477838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cea2d92f-fe12-4b5e-aca7-125efa485cf0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:55.482348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cea2d92f-fe12-4b5e-aca7-125efa485cf0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:55.497139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cea2d92f-fe12-4b5e-aca7-125efa485cf0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:55.501157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cea2d92f-fe12-4b5e-aca7-125efa485cf0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:55.501714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cea2d92f-fe12-4b5e-aca7-125efa485cf0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:55.502564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cea2d92f-fe12-4b5e-aca7-125efa485cf0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:55.505677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cea2d92f-fe12-4b5e-aca7-125efa485cf0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:55.506388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cea2d92f-fe12-4b5e-aca7-125efa485cf0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:56.016287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cea2d92f-fe12-4b5e-aca7-125efa485cf0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:56.030991 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cea2d92f-fe12-4b5e-aca7-125efa485cf0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1477 microversion: 2.1 time: 0.556876 Aug 23 17:53:56.032557 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 410/792] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:55 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1477 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:56.043321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d062aa54-e186-4813-88c1-934b3f229726 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:56.049056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d062aa54-e186-4813-88c1-934b3f229726 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:56.065216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d062aa54-e186-4813-88c1-934b3f229726 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:56.069676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1ac5ed5e-7b8e-4a8c-a48d-1f749c229296 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:56.070375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d062aa54-e186-4813-88c1-934b3f229726 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:56.071151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d062aa54-e186-4813-88c1-934b3f229726 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:56.072968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d062aa54-e186-4813-88c1-934b3f229726 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:56.075834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d062aa54-e186-4813-88c1-934b3f229726 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:56.077823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d062aa54-e186-4813-88c1-934b3f229726 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:56.100209 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1ac5ed5e-7b8e-4a8c-a48d-1f749c229296 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1389 microversion: 2.1 time: 1.750681 Aug 23 17:53:56.119207 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 383/793] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:54 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1389 bytes in 1772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:56.136457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-91a69aa9-a9b3-431c-a704-05d3ed6ddc82 req-3079049f-8b33-4db3-a7c8-9d7c0c4e222a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfabf0c-2561-40d0-9f96-f81d60908fec", "name": "network-vif-plugged", "status": "completed", "tag": "cf4c929b-222c-42c4-b117-5dea5790b383"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:56.155402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-91a69aa9-a9b3-431c-a704-05d3ed6ddc82 req-3079049f-8b33-4db3-a7c8-9d7c0c4e222a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:56.157403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-91a69aa9-a9b3-431c-a704-05d3ed6ddc82 req-3079049f-8b33-4db3-a7c8-9d7c0c4e222a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:56.158974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-91a69aa9-a9b3-431c-a704-05d3ed6ddc82 req-3079049f-8b33-4db3-a7c8-9d7c0c4e222a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:56.179322 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-91a69aa9-a9b3-431c-a704-05d3ed6ddc82 req-3079049f-8b33-4db3-a7c8-9d7c0c4e222a service nova] Creating event network-vif-plugged:cf4c929b-222c-42c4-b117-5dea5790b383 for instance cdfabf0c-2561-40d0-9f96-f81d60908fec on n-h2-850468-16 Aug 23 17:53:56.189305 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-91a69aa9-a9b3-431c-a704-05d3ed6ddc82 req-3079049f-8b33-4db3-a7c8-9d7c0c4e222a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064932 Aug 23 17:53:56.195665 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 384/794] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:56.211225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef968f75-cebd-488b-ac63-8b68c7a0ab6f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:56.212132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef968f75-cebd-488b-ac63-8b68c7a0ab6f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:56.221837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef968f75-cebd-488b-ac63-8b68c7a0ab6f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:56.222970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef968f75-cebd-488b-ac63-8b68c7a0ab6f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:56.225191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef968f75-cebd-488b-ac63-8b68c7a0ab6f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:56.244472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef968f75-cebd-488b-ac63-8b68c7a0ab6f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:56.246523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef968f75-cebd-488b-ac63-8b68c7a0ab6f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:56.248673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef968f75-cebd-488b-ac63-8b68c7a0ab6f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:56.573777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d062aa54-e186-4813-88c1-934b3f229726 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:56.586488 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d062aa54-e186-4813-88c1-934b3f229726 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.552388 Aug 23 17:53:56.587391 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 411/795] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:56 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:56.604071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-02abb020-40ba-4054-b39e-c729efb72ebd req-f107406e-c4f0-4830-b183-fe9503c8b14b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9504575-e074-4aad-871d-bcb9db7a22e3", "name": "network-vif-unplugged", "status": "completed", "tag": "039de3f2-8782-4e97-9d10-be32f83014de"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:56.625205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-02abb020-40ba-4054-b39e-c729efb72ebd req-f107406e-c4f0-4830-b183-fe9503c8b14b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:56.626048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-02abb020-40ba-4054-b39e-c729efb72ebd req-f107406e-c4f0-4830-b183-fe9503c8b14b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:56.629684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-02abb020-40ba-4054-b39e-c729efb72ebd req-f107406e-c4f0-4830-b183-fe9503c8b14b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:56.662771 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-02abb020-40ba-4054-b39e-c729efb72ebd req-f107406e-c4f0-4830-b183-fe9503c8b14b service nova] Creating event network-vif-unplugged:039de3f2-8782-4e97-9d10-be32f83014de for instance b9504575-e074-4aad-871d-bcb9db7a22e3 on n-h1-850468-16 Aug 23 17:53:56.675653 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-02abb020-40ba-4054-b39e-c729efb72ebd req-f107406e-c4f0-4830-b183-fe9503c8b14b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085601 Aug 23 17:53:56.680111 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 412/796] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:56.697866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-73dbbac7-e754-4cfd-bf40-9487e8ecfde5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:56.698798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-73dbbac7-e754-4cfd-bf40-9487e8ecfde5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:56.712515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73dbbac7-e754-4cfd-bf40-9487e8ecfde5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:56.713022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73dbbac7-e754-4cfd-bf40-9487e8ecfde5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:56.717676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73dbbac7-e754-4cfd-bf40-9487e8ecfde5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:56.719099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73dbbac7-e754-4cfd-bf40-9487e8ecfde5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:56.719845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73dbbac7-e754-4cfd-bf40-9487e8ecfde5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:56.720609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73dbbac7-e754-4cfd-bf40-9487e8ecfde5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:56.904574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef968f75-cebd-488b-ac63-8b68c7a0ab6f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:56.914650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef968f75-cebd-488b-ac63-8b68c7a0ab6f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:56.916060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef968f75-cebd-488b-ac63-8b68c7a0ab6f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:56.917229 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef968f75-cebd-488b-ac63-8b68c7a0ab6f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1567 microversion: 2.25 time: 0.719876 Aug 23 17:53:56.924191 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 385/797] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:56 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1567 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:53:56.984164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-73dbbac7-e754-4cfd-bf40-9487e8ecfde5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:57.002742 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-73dbbac7-e754-4cfd-bf40-9487e8ecfde5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1311 microversion: 2.1 time: 0.321485 Aug 23 17:53:57.015999 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 413/798] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:56 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1311 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:57.053121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1ba38d72-b8ac-478c-b705-01750466311d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:57.054364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1ba38d72-b8ac-478c-b705-01750466311d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:57.067130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ba38d72-b8ac-478c-b705-01750466311d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:57.067551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ba38d72-b8ac-478c-b705-01750466311d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:57.068001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ba38d72-b8ac-478c-b705-01750466311d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:57.068906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ba38d72-b8ac-478c-b705-01750466311d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:57.069186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ba38d72-b8ac-478c-b705-01750466311d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:57.072772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ba38d72-b8ac-478c-b705-01750466311d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:57.123699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0013824a-0138-40b0-9fab-41fd45c62c3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:57.124316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0013824a-0138-40b0-9fab-41fd45c62c3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:57.135426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0013824a-0138-40b0-9fab-41fd45c62c3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:57.140356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0013824a-0138-40b0-9fab-41fd45c62c3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:57.141563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0013824a-0138-40b0-9fab-41fd45c62c3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:57.144607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0013824a-0138-40b0-9fab-41fd45c62c3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:57.147504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0013824a-0138-40b0-9fab-41fd45c62c3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:57.148362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0013824a-0138-40b0-9fab-41fd45c62c3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:57.488307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0013824a-0138-40b0-9fab-41fd45c62c3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:57.509310 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0013824a-0138-40b0-9fab-41fd45c62c3b tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1389 microversion: 2.1 time: 0.389854 Aug 23 17:53:57.510485 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 414/799] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:57 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1389 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:57.616248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed04abc3-29a1-4a91-b1a9-093264fc7250 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:57.618479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ed04abc3-29a1-4a91-b1a9-093264fc7250 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:57.630986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed04abc3-29a1-4a91-b1a9-093264fc7250 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:57.631756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed04abc3-29a1-4a91-b1a9-093264fc7250 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:57.632351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed04abc3-29a1-4a91-b1a9-093264fc7250 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:57.633369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed04abc3-29a1-4a91-b1a9-093264fc7250 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:57.634148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed04abc3-29a1-4a91-b1a9-093264fc7250 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:57.636697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed04abc3-29a1-4a91-b1a9-093264fc7250 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:57.739808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1ba38d72-b8ac-478c-b705-01750466311d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:57.756451 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1ba38d72-b8ac-478c-b705-01750466311d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1477 microversion: 2.1 time: 0.706872 Aug 23 17:53:57.763485 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 386/800] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:57 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1477 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:57.948749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b1764e4-d7ef-4dc6-b1a7-dc02d71141e7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:57.949827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b1764e4-d7ef-4dc6-b1a7-dc02d71141e7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:57.969188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b1764e4-d7ef-4dc6-b1a7-dc02d71141e7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:57.969937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b1764e4-d7ef-4dc6-b1a7-dc02d71141e7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:57.970386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b1764e4-d7ef-4dc6-b1a7-dc02d71141e7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:57.971527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b1764e4-d7ef-4dc6-b1a7-dc02d71141e7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:57.972134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b1764e4-d7ef-4dc6-b1a7-dc02d71141e7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:57.972510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b1764e4-d7ef-4dc6-b1a7-dc02d71141e7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:58.164040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ed04abc3-29a1-4a91-b1a9-093264fc7250 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:58.176315 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ed04abc3-29a1-4a91-b1a9-093264fc7250 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.568998 Aug 23 17:53:58.183594 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 415/801] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:57 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:58.192477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-35406b88-81e2-4f37-94e5-a597f2893c9a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:58.193202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-35406b88-81e2-4f37-94e5-a597f2893c9a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:58.200999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35406b88-81e2-4f37-94e5-a597f2893c9a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:58.201495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35406b88-81e2-4f37-94e5-a597f2893c9a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:58.201940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35406b88-81e2-4f37-94e5-a597f2893c9a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:58.202725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35406b88-81e2-4f37-94e5-a597f2893c9a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:58.203272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35406b88-81e2-4f37-94e5-a597f2893c9a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:58.203707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35406b88-81e2-4f37-94e5-a597f2893c9a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:58.295581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b1764e4-d7ef-4dc6-b1a7-dc02d71141e7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:58.308288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b1764e4-d7ef-4dc6-b1a7-dc02d71141e7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:58.310259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b1764e4-d7ef-4dc6-b1a7-dc02d71141e7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:58.325359 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b1764e4-d7ef-4dc6-b1a7-dc02d71141e7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1567 microversion: 2.25 time: 0.381270 Aug 23 17:53:58.326793 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 387/802] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:57 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1567 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:53:58.468055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-35406b88-81e2-4f37-94e5-a597f2893c9a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:58.480545 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-35406b88-81e2-4f37-94e5-a597f2893c9a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1311 microversion: 2.1 time: 0.295557 Aug 23 17:53:58.500605 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 416/803] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:58 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1311 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:58.536621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-470089a2-540e-4935-ae1e-ab90cb977e03 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:58.537251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-470089a2-540e-4935-ae1e-ab90cb977e03 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:58.542877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7ee66a7-bb11-432d-98fa-c25b3175a8e3 tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] Calling method '.version_select at 0x7f27ec903a60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:58.553500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-470089a2-540e-4935-ae1e-ab90cb977e03 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:58.554014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-470089a2-540e-4935-ae1e-ab90cb977e03 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:58.556374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-470089a2-540e-4935-ae1e-ab90cb977e03 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:58.557085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-470089a2-540e-4935-ae1e-ab90cb977e03 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:58.557559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-470089a2-540e-4935-ae1e-ab90cb977e03 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:58.557995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-470089a2-540e-4935-ae1e-ab90cb977e03 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:58.750236 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7ee66a7-bb11-432d-98fa-c25b3175a8e3 tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.333606 Aug 23 17:53:58.751358 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 388/804] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Aug 23 17:53:58 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 17:53:58.763066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-85734c8c-7d3d-45ea-8f63-7bb481ec8b60 req-6c510f81-791e-4934-a39e-85957a944289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9504575-e074-4aad-871d-bcb9db7a22e3", "tag": "039de3f2-8782-4e97-9d10-be32f83014de"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:58.782454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-85734c8c-7d3d-45ea-8f63-7bb481ec8b60 req-6c510f81-791e-4934-a39e-85957a944289 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:58.785240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-85734c8c-7d3d-45ea-8f63-7bb481ec8b60 req-6c510f81-791e-4934-a39e-85957a944289 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:58.786040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-85734c8c-7d3d-45ea-8f63-7bb481ec8b60 req-6c510f81-791e-4934-a39e-85957a944289 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:58.805323 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-85734c8c-7d3d-45ea-8f63-7bb481ec8b60 req-6c510f81-791e-4934-a39e-85957a944289 service nova] Creating event network-changed:039de3f2-8782-4e97-9d10-be32f83014de for instance b9504575-e074-4aad-871d-bcb9db7a22e3 on n-h1-850468-16 Aug 23 17:53:58.811023 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-85734c8c-7d3d-45ea-8f63-7bb481ec8b60 req-6c510f81-791e-4934-a39e-85957a944289 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058154 Aug 23 17:53:58.811926 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 389/805] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:53:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:53:58.818774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-53b5fa52-18db-4162-b064-dce8ef7e99cb tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] Action: 'create', calling method: .version_select at 0x7f27ed2e94c0>, body: {"pool": "non_exist_pool"} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:53:58.826648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-470089a2-540e-4935-ae1e-ab90cb977e03 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:58.842386 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-470089a2-540e-4935-ae1e-ab90cb977e03 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1389 microversion: 2.1 time: 0.310019 Aug 23 17:53:58.843892 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 417/806] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:58 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1389 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:53:58.849618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6fe102e-ba7b-4eb8-ac20-5325320abc2b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:58.850429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6fe102e-ba7b-4eb8-ac20-5325320abc2b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:58.860436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6fe102e-ba7b-4eb8-ac20-5325320abc2b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:58.861411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6fe102e-ba7b-4eb8-ac20-5325320abc2b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:58.862081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6fe102e-ba7b-4eb8-ac20-5325320abc2b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:58.863039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6fe102e-ba7b-4eb8-ac20-5325320abc2b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:58.863773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6fe102e-ba7b-4eb8-ac20-5325320abc2b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:58.864399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6fe102e-ba7b-4eb8-ac20-5325320abc2b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:58.926589 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-53b5fa52-18db-4162-b064-dce8ef7e99cb tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] HTTP exception thrown: Floating IP pool not found. Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-53b5fa52-18db-4162-b064-dce8ef7e99cb tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] Request method failure captured: Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 26 Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRQ2u5LV5qP9bmweBo55vuUuD8XHeIoMNtDTTmtlrZvqeyFkhnShw9UzUTi-db1G5PdkJf55TmLTz4HDzBlc_WECcLzoAVIQry2twnS3FYIqRacsSQCreSSV3MS9rBlCLCudmOWFY6-5J7OBU0bfede2dEomKh8bQJ7TmiCIUo7xNy4 Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 560dd0080cf64225aa2aee94b6f0d94b Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1963902375 Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_560dd0080cf64225aa2aee94b6f0d94b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/560dd0080cf64225aa2aee94b6f0d94b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/560dd0080cf64225aa2aee94b6f0d94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/560dd0080cf64225aa2aee94b6f0d94b"}]}] Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1963902375 Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 560dd0080cf64225aa2aee94b6f0d94b Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1963902375 Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FloatingIPsNegativeTestJSON-1963902375-project Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 9a5ef3bf10e047c3bf703b34f23733b4 Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1963902375-project Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: {"pool": "non_exist_pool"} Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: exception: Floating IP pool not found. Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'pool': 'non_exist_pool'}} Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2975, in allocate_floating_ip Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2965, in _get_floating_ip_pool_id_by_name_or_id Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:58.929539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:58.934330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Aug 23 17:53:58.934330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:58.934330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-53b5fa52-18db-4162-b064-dce8ef7e99cb tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] Returning 404 to user: Floating IP pool not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:58.934330 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-53b5fa52-18db-4162-b064-dce8ef7e99cb tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.117121 Aug 23 17:53:58.934330 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 390/807] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Aug 23 17:53:58 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:53:58.943715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ad5ee57e-e3b8-43ab-83ba-fa4bdb6d3fe2 tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] Calling method '.version_select at 0x7f27ec903e50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:59.334889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f6fe102e-ba7b-4eb8-ac20-5325320abc2b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:59.350905 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6fe102e-ba7b-4eb8-ac20-5325320abc2b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1477 microversion: 2.1 time: 0.504719 Aug 23 17:53:59.351756 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 418/808] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:58 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1477 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:59.360748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5388d9fa-5ee1-4309-9679-a9fef96e7fc3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:59.362686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5388d9fa-5ee1-4309-9679-a9fef96e7fc3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:59.375123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5388d9fa-5ee1-4309-9679-a9fef96e7fc3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:59.376545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5388d9fa-5ee1-4309-9679-a9fef96e7fc3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:59.377713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5388d9fa-5ee1-4309-9679-a9fef96e7fc3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:59.378738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5388d9fa-5ee1-4309-9679-a9fef96e7fc3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:59.379443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5388d9fa-5ee1-4309-9679-a9fef96e7fc3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:59.381262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5388d9fa-5ee1-4309-9679-a9fef96e7fc3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:59.602482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5388d9fa-5ee1-4309-9679-a9fef96e7fc3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:53:59.606295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:53:59.613641 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5388d9fa-5ee1-4309-9679-a9fef96e7fc3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.260336 Aug 23 17:53:59.614911 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 419/809] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:59 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:53:59.620122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-be203e13-9d60-4840-b707-df05e1ef2c49 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:59.620934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-be203e13-9d60-4840-b707-df05e1ef2c49 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:59.629181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be203e13-9d60-4840-b707-df05e1ef2c49 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:59.629860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be203e13-9d60-4840-b707-df05e1ef2c49 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:59.630467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be203e13-9d60-4840-b707-df05e1ef2c49 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:59.631376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be203e13-9d60-4840-b707-df05e1ef2c49 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:59.632014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be203e13-9d60-4840-b707-df05e1ef2c49 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:59.632601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be203e13-9d60-4840-b707-df05e1ef2c49 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:59.669376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG neutronclient.v2_0.client [None req-ad5ee57e-e3b8-43ab-83ba-fa4bdb6d3fe2 tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 40e35846-df2c-4cb1-bbd2-221a7f65fda7 could not be found", "detail": ""}} {{(pid=128808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 17:53:59.670132 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-ad5ee57e-e3b8-43ab-83ba-fa4bdb6d3fe2 tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] HTTP exception thrown: Floating IP not found for ID 40e35846-df2c-4cb1-bbd2-221a7f65fda7 Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ad5ee57e-e3b8-43ab-83ba-fa4bdb6d3fe2 tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] Request method failure captured: Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/os-floating-ips/40e35846-df2c-4cb1-bbd2-221a7f65fda7 HTTP/1.1 Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRQ2u5LV5qP9bmweBo55vuUuD8XHeIoMNtDTTmtlrZvqeyFkhnShw9UzUTi-db1G5PdkJf55TmLTz4HDzBlc_WECcLzoAVIQry2twnS3FYIqRacsSQCreSSV3MS9rBlCLCudmOWFY6-5J7OBU0bfede2dEomKh8bQJ7TmiCIUo7xNy4 Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 560dd0080cf64225aa2aee94b6f0d94b Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-1963902375 Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_560dd0080cf64225aa2aee94b6f0d94b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/560dd0080cf64225aa2aee94b6f0d94b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/560dd0080cf64225aa2aee94b6f0d94b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/560dd0080cf64225aa2aee94b6f0d94b"}]}] Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-1963902375 Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 560dd0080cf64225aa2aee94b6f0d94b Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-1963902375 Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FloatingIPsNegativeTestJSON-1963902375-project Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 9a5ef3bf10e047c3bf703b34f23733b4 Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-1963902375-project Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: exception: Floating IP not found for ID 40e35846-df2c-4cb1-bbd2-221a7f65fda7 Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '40e35846-df2c-4cb1-bbd2-221a7f65fda7'} Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 40e35846-df2c-4cb1-bbd2-221a7f65fda7 could not be found Aug 23 17:53:59.673407 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e0b4a07f-e393-4545-84e7-f72bd1b71bd5'] Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 40e35846-df2c-4cb1-bbd2-221a7f65fda7. Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 40e35846-df2c-4cb1-bbd2-221a7f65fda7 Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 40e35846-df2c-4cb1-bbd2-221a7f65fda7 Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ad5ee57e-e3b8-43ab-83ba-fa4bdb6d3fe2 tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] Returning 404 to user: Floating IP not found for ID 40e35846-df2c-4cb1-bbd2-221a7f65fda7 {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:53:59.678571 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ad5ee57e-e3b8-43ab-83ba-fa4bdb6d3fe2 tempest-FloatingIPsNegativeTestJSON-1963902375 tempest-FloatingIPsNegativeTestJSON-1963902375-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/40e35846-df2c-4cb1-bbd2-221a7f65fda7" status: 404 len: 111 microversion: 2.1 time: 0.735840 Aug 23 17:53:59.682575 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 391/810] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 17:53:58 2022] DELETE /compute/v2.1/os-floating-ips/40e35846-df2c-4cb1-bbd2-221a7f65fda7 => generated 111 bytes in 743 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 17:53:59.693183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fe20505d-31c2-4730-b8bf-39264058275e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:53:59.694739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fe20505d-31c2-4730-b8bf-39264058275e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:53:59.703026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe20505d-31c2-4730-b8bf-39264058275e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:59.703890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe20505d-31c2-4730-b8bf-39264058275e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:59.704554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe20505d-31c2-4730-b8bf-39264058275e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:53:59.705479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe20505d-31c2-4730-b8bf-39264058275e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:53:59.706803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe20505d-31c2-4730-b8bf-39264058275e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:53:59.708846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe20505d-31c2-4730-b8bf-39264058275e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:00.118980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fe20505d-31c2-4730-b8bf-39264058275e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:00.149573 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fe20505d-31c2-4730-b8bf-39264058275e tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1311 microversion: 2.1 time: 0.455767 Aug 23 17:54:00.150883 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 392/811] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:53:59 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1311 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:00.173396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-889775a2-b62e-46d7-a172-574306a8d0c5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:00.175519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-889775a2-b62e-46d7-a172-574306a8d0c5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:00.202225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-889775a2-b62e-46d7-a172-574306a8d0c5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:00.203880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-889775a2-b62e-46d7-a172-574306a8d0c5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:00.207335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-889775a2-b62e-46d7-a172-574306a8d0c5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:00.208629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-889775a2-b62e-46d7-a172-574306a8d0c5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:00.209449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-889775a2-b62e-46d7-a172-574306a8d0c5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:00.215578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-889775a2-b62e-46d7-a172-574306a8d0c5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:00.489004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-889775a2-b62e-46d7-a172-574306a8d0c5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:00.505917 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-889775a2-b62e-46d7-a172-574306a8d0c5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1389 microversion: 2.1 time: 0.345725 Aug 23 17:54:00.507399 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 393/812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:00 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1389 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:00.628190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1476009966", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "d34de626-333e-499b-90dc-683ea857f834"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:00.707673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] validate_networks() for [('d34de626-333e-499b-90dc-683ea857f834', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:54:01.097318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-be203e13-9d60-4840-b707-df05e1ef2c49 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:01.134499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-be203e13-9d60-4840-b707-df05e1ef2c49 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:01.142089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-be203e13-9d60-4840-b707-df05e1ef2c49 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:01.143726 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-be203e13-9d60-4840-b707-df05e1ef2c49 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1567 microversion: 2.25 time: 1.527703 Aug 23 17:54:01.159162 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 420/813] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:53:59 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1567 bytes in 1544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:01.165285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9f08a0e5-49a2-4aa1-90fd-9efdddb8ae39 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:01.166123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9f08a0e5-49a2-4aa1-90fd-9efdddb8ae39 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:01.182465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f08a0e5-49a2-4aa1-90fd-9efdddb8ae39 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:01.183562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f08a0e5-49a2-4aa1-90fd-9efdddb8ae39 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:01.186292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f08a0e5-49a2-4aa1-90fd-9efdddb8ae39 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:01.187833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f08a0e5-49a2-4aa1-90fd-9efdddb8ae39 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:01.189128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f08a0e5-49a2-4aa1-90fd-9efdddb8ae39 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:01.189733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f08a0e5-49a2-4aa1-90fd-9efdddb8ae39 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:01.679692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:54:01.680117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:54:01.680596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:54:01.681007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:54:01.681416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:54:01.706078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:01.706971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:01.707665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:01.708655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:01.710726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:01.711431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:01.736852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Getting quotas for project 9a5927f8e0d84b1b8ea34676a04b132c. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:01.745469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Getting quotas for user c56f1a67ae114ab688a350a1551fda80 and project 9a5927f8e0d84b1b8ea34676a04b132c. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:01.764068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:54:01.769030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:54:01.844464 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-63593dbd-ab03-47fe-b156-d5cf52601eca tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 1.333676 Aug 23 17:54:01.851207 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 394/814] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 17:54:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 17:54:01.860540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1194147966", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "4550622a-cff7-419e-a835-665a217cd811"}], "security_groups": [{"name": "tempest-securitygroup--649459975"}], "key_name": "tempest-keypair-1062296527", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:01.980977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9f08a0e5-49a2-4aa1-90fd-9efdddb8ae39 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:02.001116 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9f08a0e5-49a2-4aa1-90fd-9efdddb8ae39 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1477 microversion: 2.1 time: 0.840517 Aug 23 17:54:02.021451 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 421/815] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:01 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1477 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:02.027544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7bc2456b-adfd-4453-bee3-599366b2d239 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:02.028375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7bc2456b-adfd-4453-bee3-599366b2d239 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:02.034362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] validate_networks() for [('4550622a-cff7-419e-a835-665a217cd811', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:54:02.037446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bc2456b-adfd-4453-bee3-599366b2d239 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:02.038387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bc2456b-adfd-4453-bee3-599366b2d239 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:02.038895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bc2456b-adfd-4453-bee3-599366b2d239 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:02.041716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bc2456b-adfd-4453-bee3-599366b2d239 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:02.042465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bc2456b-adfd-4453-bee3-599366b2d239 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:02.043088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bc2456b-adfd-4453-bee3-599366b2d239 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:02.620218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7bc2456b-adfd-4453-bee3-599366b2d239 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:02.635107 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7bc2456b-adfd-4453-bee3-599366b2d239 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.612263 Aug 23 17:54:02.635703 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 422/816] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:02 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:02.642964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e19c4549-9094-48c9-a03a-fcd6f6a078d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:02.644666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e19c4549-9094-48c9-a03a-fcd6f6a078d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:02.652627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e19c4549-9094-48c9-a03a-fcd6f6a078d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:02.653392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e19c4549-9094-48c9-a03a-fcd6f6a078d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:02.654129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e19c4549-9094-48c9-a03a-fcd6f6a078d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:02.654897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e19c4549-9094-48c9-a03a-fcd6f6a078d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:02.655493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e19c4549-9094-48c9-a03a-fcd6f6a078d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:02.657348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e19c4549-9094-48c9-a03a-fcd6f6a078d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:02.692673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:54:02.693295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:54:02.693987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:54:02.694892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:54:02.695384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:54:02.705609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:02.706621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:02.707352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:02.708118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:02.708853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:02.709570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:02.750790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Getting quotas for project d60b8676313b4607b015755341be1331. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:02.756469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Getting quotas for user d4e792ec8c584ba489b976f62f409d94 and project d60b8676313b4607b015755341be1331. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:02.770582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:54:02.773841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:54:02.846447 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a5ccb12-467b-4de1-9adf-2e2e3e8de5ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.999445 Aug 23 17:54:02.853827 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 395/817] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:54:01 2022] POST /compute/v2.1/servers => generated 405 bytes in 1007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:54:02.859322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-40a12bcd-740a-4f15-9ad7-29ee64c515b5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:02.860569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-40a12bcd-740a-4f15-9ad7-29ee64c515b5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:02.868067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40a12bcd-740a-4f15-9ad7-29ee64c515b5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:02.868812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40a12bcd-740a-4f15-9ad7-29ee64c515b5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:02.869473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40a12bcd-740a-4f15-9ad7-29ee64c515b5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:02.870499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40a12bcd-740a-4f15-9ad7-29ee64c515b5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:02.871379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40a12bcd-740a-4f15-9ad7-29ee64c515b5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:02.872038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40a12bcd-740a-4f15-9ad7-29ee64c515b5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.065134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-40a12bcd-740a-4f15-9ad7-29ee64c515b5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:03.086099 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-40a12bcd-740a-4f15-9ad7-29ee64c515b5 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1389 microversion: 2.1 time: 0.230590 Aug 23 17:54:03.087062 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 396/818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:02 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1389 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:03.087062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4b387edb-85c0-439b-b913-d50db8f99e08 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:03.087062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4b387edb-85c0-439b-b913-d50db8f99e08 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:03.101086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e19c4549-9094-48c9-a03a-fcd6f6a078d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:03.113834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b387edb-85c0-439b-b913-d50db8f99e08 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.114325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b387edb-85c0-439b-b913-d50db8f99e08 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.114791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b387edb-85c0-439b-b913-d50db8f99e08 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.115498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b387edb-85c0-439b-b913-d50db8f99e08 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.116092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b387edb-85c0-439b-b913-d50db8f99e08 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.116360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b387edb-85c0-439b-b913-d50db8f99e08 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.117209 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e19c4549-9094-48c9-a03a-fcd6f6a078d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1494 microversion: 2.1 time: 0.472617 Aug 23 17:54:03.118821 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 423/819] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:02 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1494 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:03.124112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-119d207d-82d4-4a2f-a15f-d9af798ec926 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:03.124847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-119d207d-82d4-4a2f-a15f-d9af798ec926 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:03.132863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-119d207d-82d4-4a2f-a15f-d9af798ec926 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.133358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-119d207d-82d4-4a2f-a15f-d9af798ec926 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.133795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-119d207d-82d4-4a2f-a15f-d9af798ec926 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.134535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-119d207d-82d4-4a2f-a15f-d9af798ec926 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.135010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-119d207d-82d4-4a2f-a15f-d9af798ec926 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.135623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-119d207d-82d4-4a2f-a15f-d9af798ec926 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.222041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b387edb-85c0-439b-b913-d50db8f99e08 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:03.230691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b387edb-85c0-439b-b913-d50db8f99e08 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:03.232208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b387edb-85c0-439b-b913-d50db8f99e08 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:03.233311 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4b387edb-85c0-439b-b913-d50db8f99e08 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1255 microversion: 2.21 time: 0.145120 Aug 23 17:54:03.233904 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 397/820] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:03 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1255 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:03.248237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-625b62a1-85c1-44dd-acb6-8fca42faf86a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:03.248854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-625b62a1-85c1-44dd-acb6-8fca42faf86a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:03.345885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-625b62a1-85c1-44dd-acb6-8fca42faf86a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:03.355267 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-625b62a1-85c1-44dd-acb6-8fca42faf86a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1242 microversion: 2.1 time: 0.119975 Aug 23 17:54:03.356159 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 398/821] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:03 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1242 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:03.371528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5d1ff660-5956-4c07-af5d-e0f5cb0d65ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:03.372138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5d1ff660-5956-4c07-af5d-e0f5cb0d65ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:03.389912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d1ff660-5956-4c07-af5d-e0f5cb0d65ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.390140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d1ff660-5956-4c07-af5d-e0f5cb0d65ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.391393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d1ff660-5956-4c07-af5d-e0f5cb0d65ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.392447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d1ff660-5956-4c07-af5d-e0f5cb0d65ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.393059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d1ff660-5956-4c07-af5d-e0f5cb0d65ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.394474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d1ff660-5956-4c07-af5d-e0f5cb0d65ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.451275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-119d207d-82d4-4a2f-a15f-d9af798ec926 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:03.474163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-119d207d-82d4-4a2f-a15f-d9af798ec926 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:03.475954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-119d207d-82d4-4a2f-a15f-d9af798ec926 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:03.477775 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-119d207d-82d4-4a2f-a15f-d9af798ec926 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1567 microversion: 2.25 time: 0.357928 Aug 23 17:54:03.478499 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 424/822] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:03 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1567 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:03.488143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2cf4daa2-0680-4c5b-8b66-a1abba77b222 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:03.494624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2cf4daa2-0680-4c5b-8b66-a1abba77b222 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:03.509987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cf4daa2-0680-4c5b-8b66-a1abba77b222 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.510676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cf4daa2-0680-4c5b-8b66-a1abba77b222 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.512040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cf4daa2-0680-4c5b-8b66-a1abba77b222 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.514947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cf4daa2-0680-4c5b-8b66-a1abba77b222 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.523177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cf4daa2-0680-4c5b-8b66-a1abba77b222 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.523754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cf4daa2-0680-4c5b-8b66-a1abba77b222 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.724728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5d1ff660-5956-4c07-af5d-e0f5cb0d65ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:03.735316 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5d1ff660-5956-4c07-af5d-e0f5cb0d65ea tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1477 microversion: 2.1 time: 0.376153 Aug 23 17:54:03.737579 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 399/823] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:03 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1477 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:03.743285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7b4e6477-cc0e-41c1-b12a-d5f50e5f3b19 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:03.744402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7b4e6477-cc0e-41c1-b12a-d5f50e5f3b19 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:03.756794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b4e6477-cc0e-41c1-b12a-d5f50e5f3b19 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.757651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b4e6477-cc0e-41c1-b12a-d5f50e5f3b19 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.758158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b4e6477-cc0e-41c1-b12a-d5f50e5f3b19 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.759162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b4e6477-cc0e-41c1-b12a-d5f50e5f3b19 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.759697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b4e6477-cc0e-41c1-b12a-d5f50e5f3b19 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.761473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b4e6477-cc0e-41c1-b12a-d5f50e5f3b19 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.866485 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2cf4daa2-0680-4c5b-8b66-a1abba77b222 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1647 microversion: 2.1 time: 0.384909 Aug 23 17:54:03.867737 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 425/824] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:03 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1647 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:03.872505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1cb07f35-91dc-42e3-8008-16c89f14b423 req-30e32be4-e1e8-4edd-9b70-b0b090c8749b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482c06a7-2b1f-4a6e-8b62-b702d32c4c3f", "name": "network-vif-plugged", "status": "completed", "tag": "61e068c3-e07e-47db-a508-2528903c28f7"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:03.882955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:03.885243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1cb07f35-91dc-42e3-8008-16c89f14b423 req-30e32be4-e1e8-4edd-9b70-b0b090c8749b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.885736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1cb07f35-91dc-42e3-8008-16c89f14b423 req-30e32be4-e1e8-4edd-9b70-b0b090c8749b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.886171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1cb07f35-91dc-42e3-8008-16c89f14b423 req-30e32be4-e1e8-4edd-9b70-b0b090c8749b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.899684 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1cb07f35-91dc-42e3-8008-16c89f14b423 req-30e32be4-e1e8-4edd-9b70-b0b090c8749b service nova] Creating event network-vif-plugged:61e068c3-e07e-47db-a508-2528903c28f7 for instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f on n-h2-850468-16 Aug 23 17:54:03.905008 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1cb07f35-91dc-42e3-8008-16c89f14b423 req-30e32be4-e1e8-4edd-9b70-b0b090c8749b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036027 Aug 23 17:54:03.906022 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 426/825] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:03.912531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf504434-a4e3-4189-b03c-e1c79c51e91c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:03.913443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf504434-a4e3-4189-b03c-e1c79c51e91c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:03.920596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf504434-a4e3-4189-b03c-e1c79c51e91c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.921304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf504434-a4e3-4189-b03c-e1c79c51e91c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.922852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf504434-a4e3-4189-b03c-e1c79c51e91c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:03.923593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf504434-a4e3-4189-b03c-e1c79c51e91c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:03.924065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf504434-a4e3-4189-b03c-e1c79c51e91c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:03.924502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf504434-a4e3-4189-b03c-e1c79c51e91c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.067977 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf504434-a4e3-4189-b03c-e1c79c51e91c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1647 microversion: 2.1 time: 0.160316 Aug 23 17:54:04.068549 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 427/826] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:03 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1647 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:04.087894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d170fe5-a692-41d5-9291-93e619651e1a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:04.091420 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:54:04.091420 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:54:04.095033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d170fe5-a692-41d5-9291-93e619651e1a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.095886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d170fe5-a692-41d5-9291-93e619651e1a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.096600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d170fe5-a692-41d5-9291-93e619651e1a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.097500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d170fe5-a692-41d5-9291-93e619651e1a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.098182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d170fe5-a692-41d5-9291-93e619651e1a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.098930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d170fe5-a692-41d5-9291-93e619651e1a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.138242 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d170fe5-a692-41d5-9291-93e619651e1a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.053476 Aug 23 17:54:04.139440 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 428/827] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Aug 23 17:54:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:04.144998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2bdcd348-df5a-4624-af55-dd050c7b4157 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:04.146429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2bdcd348-df5a-4624-af55-dd050c7b4157 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:04.154028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bdcd348-df5a-4624-af55-dd050c7b4157 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.154895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bdcd348-df5a-4624-af55-dd050c7b4157 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.155694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bdcd348-df5a-4624-af55-dd050c7b4157 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.157275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bdcd348-df5a-4624-af55-dd050c7b4157 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.157933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bdcd348-df5a-4624-af55-dd050c7b4157 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.158891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bdcd348-df5a-4624-af55-dd050c7b4157 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.162053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7b4e6477-cc0e-41c1-b12a-d5f50e5f3b19 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:04.173405 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7b4e6477-cc0e-41c1-b12a-d5f50e5f3b19 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.432117 Aug 23 17:54:04.174192 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 400/828] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:03 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:04.185740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e596f3f2-aa76-457d-8b95-221490331387 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:04.186522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e596f3f2-aa76-457d-8b95-221490331387 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:04.207159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e596f3f2-aa76-457d-8b95-221490331387 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.207807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e596f3f2-aa76-457d-8b95-221490331387 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.208502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e596f3f2-aa76-457d-8b95-221490331387 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.209477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e596f3f2-aa76-457d-8b95-221490331387 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.211828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e596f3f2-aa76-457d-8b95-221490331387 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.212273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e596f3f2-aa76-457d-8b95-221490331387 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.306622 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e596f3f2-aa76-457d-8b95-221490331387 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec/action" status: 202 len: 0 microversion: 2.1 time: 0.129125 Aug 23 17:54:04.308098 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 401/829] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:54:04 2022] POST /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:54:04.317711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b12291b6-25a8-4619-837c-899bc36f8446 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:04.319072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b12291b6-25a8-4619-837c-899bc36f8446 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:04.328642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b12291b6-25a8-4619-837c-899bc36f8446 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.329519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b12291b6-25a8-4619-837c-899bc36f8446 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.330117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b12291b6-25a8-4619-837c-899bc36f8446 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.331098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b12291b6-25a8-4619-837c-899bc36f8446 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.331706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b12291b6-25a8-4619-837c-899bc36f8446 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.332324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b12291b6-25a8-4619-837c-899bc36f8446 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.454611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b12291b6-25a8-4619-837c-899bc36f8446 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:04.464475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b12291b6-25a8-4619-837c-899bc36f8446 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:04.469120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b12291b6-25a8-4619-837c-899bc36f8446 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:04.470639 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b12291b6-25a8-4619-837c-899bc36f8446 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1329 microversion: 2.21 time: 0.160372 Aug 23 17:54:04.485431 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 402/830] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:04 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1329 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:04.493039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-58aeb219-d43d-467b-9d58-c1260efaa48f tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:04.493969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-58aeb219-d43d-467b-9d58-c1260efaa48f tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:04.500484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58aeb219-d43d-467b-9d58-c1260efaa48f tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.500988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58aeb219-d43d-467b-9d58-c1260efaa48f tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.501438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58aeb219-d43d-467b-9d58-c1260efaa48f tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.502153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58aeb219-d43d-467b-9d58-c1260efaa48f tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.502743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58aeb219-d43d-467b-9d58-c1260efaa48f tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.503169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58aeb219-d43d-467b-9d58-c1260efaa48f tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.758379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2bdcd348-df5a-4624-af55-dd050c7b4157 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:04.769230 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2bdcd348-df5a-4624-af55-dd050c7b4157 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1389 microversion: 2.1 time: 0.627739 Aug 23 17:54:04.770042 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 429/831] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:04 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1389 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:04.776754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7742cd8b-145c-4f02-b100-55b11dac8418 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:04.777537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7742cd8b-145c-4f02-b100-55b11dac8418 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:04.785970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7742cd8b-145c-4f02-b100-55b11dac8418 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.786749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7742cd8b-145c-4f02-b100-55b11dac8418 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.787474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7742cd8b-145c-4f02-b100-55b11dac8418 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.792892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7742cd8b-145c-4f02-b100-55b11dac8418 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.793639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7742cd8b-145c-4f02-b100-55b11dac8418 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.794270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7742cd8b-145c-4f02-b100-55b11dac8418 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.925392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7742cd8b-145c-4f02-b100-55b11dac8418 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:04.931584 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-58aeb219-d43d-467b-9d58-c1260efaa48f tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1652 microversion: 2.1 time: 0.444635 Aug 23 17:54:04.932287 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 403/832] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:04 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1652 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:04.933680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:04.938583 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7742cd8b-145c-4f02-b100-55b11dac8418 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1294 microversion: 2.1 time: 0.167125 Aug 23 17:54:04.939373 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 430/833] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:04 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1294 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:04.944327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-84c949d4-9695-42ee-b466-b9a78940e69e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:04.945138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-84c949d4-9695-42ee-b466-b9a78940e69e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:04.952501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84c949d4-9695-42ee-b466-b9a78940e69e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.954020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84c949d4-9695-42ee-b466-b9a78940e69e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.954685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84c949d4-9695-42ee-b466-b9a78940e69e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.955758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84c949d4-9695-42ee-b466-b9a78940e69e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.956532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84c949d4-9695-42ee-b466-b9a78940e69e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.957149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84c949d4-9695-42ee-b466-b9a78940e69e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.957372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0fd7a2c5-1f19-4d93-b45b-0de9ca4becdf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:04.958006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0fd7a2c5-1f19-4d93-b45b-0de9ca4becdf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:04.970335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fd7a2c5-1f19-4d93-b45b-0de9ca4becdf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.970869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fd7a2c5-1f19-4d93-b45b-0de9ca4becdf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.979071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fd7a2c5-1f19-4d93-b45b-0de9ca4becdf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:04.979877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fd7a2c5-1f19-4d93-b45b-0de9ca4becdf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:04.980363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fd7a2c5-1f19-4d93-b45b-0de9ca4becdf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:04.980809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fd7a2c5-1f19-4d93-b45b-0de9ca4becdf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:05.192369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-84c949d4-9695-42ee-b466-b9a78940e69e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:05.224621 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-84c949d4-9695-42ee-b466-b9a78940e69e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1477 microversion: 2.1 time: 0.282017 Aug 23 17:54:05.225834 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 431/834] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:04 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1477 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:05.233917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-57c19bf3-eb87-4831-a35b-35b80a37a15d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:05.235017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-57c19bf3-eb87-4831-a35b-35b80a37a15d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:05.269511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57c19bf3-eb87-4831-a35b-35b80a37a15d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:05.270696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57c19bf3-eb87-4831-a35b-35b80a37a15d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:05.273073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57c19bf3-eb87-4831-a35b-35b80a37a15d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:05.274100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57c19bf3-eb87-4831-a35b-35b80a37a15d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:05.274677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57c19bf3-eb87-4831-a35b-35b80a37a15d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:05.275071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57c19bf3-eb87-4831-a35b-35b80a37a15d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:05.334233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0fd7a2c5-1f19-4d93-b45b-0de9ca4becdf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:05.344212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0fd7a2c5-1f19-4d93-b45b-0de9ca4becdf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:05.348009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0fd7a2c5-1f19-4d93-b45b-0de9ca4becdf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:05.362483 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0fd7a2c5-1f19-4d93-b45b-0de9ca4becdf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1567 microversion: 2.25 time: 0.428638 Aug 23 17:54:05.363357 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 404/835] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:04 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1567 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:05.498445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f6fcd452-c70a-49e4-a1e1-306d78925b35 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:05.499100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f6fcd452-c70a-49e4-a1e1-306d78925b35 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:05.506918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6fcd452-c70a-49e4-a1e1-306d78925b35 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:05.507537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6fcd452-c70a-49e4-a1e1-306d78925b35 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:05.508030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6fcd452-c70a-49e4-a1e1-306d78925b35 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:05.509003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6fcd452-c70a-49e4-a1e1-306d78925b35 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:05.509534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6fcd452-c70a-49e4-a1e1-306d78925b35 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:05.510063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6fcd452-c70a-49e4-a1e1-306d78925b35 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:05.523724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-57c19bf3-eb87-4831-a35b-35b80a37a15d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:05.535105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:05.537216 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-57c19bf3-eb87-4831-a35b-35b80a37a15d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1472 microversion: 2.1 time: 0.310127 Aug 23 17:54:05.538706 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 432/836] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:05 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1472 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:05.589891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f6fcd452-c70a-49e4-a1e1-306d78925b35 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:05.599603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f6fcd452-c70a-49e4-a1e1-306d78925b35 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:05.601110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f6fcd452-c70a-49e4-a1e1-306d78925b35 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:05.602217 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f6fcd452-c70a-49e4-a1e1-306d78925b35 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1317 microversion: 2.21 time: 0.107915 Aug 23 17:54:05.602797 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 405/837] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:05 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1317 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:54:05.789735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07fb0514-2800-4261-8c1e-7f6b92b8ed34 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:05.790732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07fb0514-2800-4261-8c1e-7f6b92b8ed34 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:05.802432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07fb0514-2800-4261-8c1e-7f6b92b8ed34 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:05.803218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07fb0514-2800-4261-8c1e-7f6b92b8ed34 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:05.803925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07fb0514-2800-4261-8c1e-7f6b92b8ed34 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:05.804983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07fb0514-2800-4261-8c1e-7f6b92b8ed34 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:05.805648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07fb0514-2800-4261-8c1e-7f6b92b8ed34 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:05.806315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07fb0514-2800-4261-8c1e-7f6b92b8ed34 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:05.955582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00d7512a-5b63-4cfd-985d-c6bc2f755195 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:05.956200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-00d7512a-5b63-4cfd-985d-c6bc2f755195 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:05.964688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00d7512a-5b63-4cfd-985d-c6bc2f755195 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:05.966003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00d7512a-5b63-4cfd-985d-c6bc2f755195 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:05.966444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00d7512a-5b63-4cfd-985d-c6bc2f755195 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:05.967186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00d7512a-5b63-4cfd-985d-c6bc2f755195 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:05.967642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00d7512a-5b63-4cfd-985d-c6bc2f755195 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:05.968066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00d7512a-5b63-4cfd-985d-c6bc2f755195 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:06.078480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-07fb0514-2800-4261-8c1e-7f6b92b8ed34 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:06.088212 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-07fb0514-2800-4261-8c1e-7f6b92b8ed34 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1389 microversion: 2.1 time: 0.302629 Aug 23 17:54:06.103839 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 433/838] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:05 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1389 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:06.115109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9489f5fb-f6d8-4607-a4f9-5fc939de0c96 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:06.116017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9489f5fb-f6d8-4607-a4f9-5fc939de0c96 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:06.133087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9489f5fb-f6d8-4607-a4f9-5fc939de0c96 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:06.133630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9489f5fb-f6d8-4607-a4f9-5fc939de0c96 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:06.135927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9489f5fb-f6d8-4607-a4f9-5fc939de0c96 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:06.136704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9489f5fb-f6d8-4607-a4f9-5fc939de0c96 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:06.137171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9489f5fb-f6d8-4607-a4f9-5fc939de0c96 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:06.137617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9489f5fb-f6d8-4607-a4f9-5fc939de0c96 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:06.213929 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-00d7512a-5b63-4cfd-985d-c6bc2f755195 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1632 microversion: 2.1 time: 0.262300 Aug 23 17:54:06.217949 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 406/839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:05 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1632 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:06.241712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f1b0874a-9300-44bc-b18d-40c8db84fff5 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-16", "block_migration": true, "disk_over_commit": false}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:06.242445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9489f5fb-f6d8-4607-a4f9-5fc939de0c96 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:06.249790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f1b0874a-9300-44bc-b18d-40c8db84fff5 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:06.266994 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9489f5fb-f6d8-4607-a4f9-5fc939de0c96 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1294 microversion: 2.1 time: 0.159530 Aug 23 17:54:06.271754 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 434/840] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:06 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1294 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:06.278532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-000730b5-cb5f-42d4-ab85-afe754b119fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:06.282307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-000730b5-cb5f-42d4-ab85-afe754b119fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:06.295224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-000730b5-cb5f-42d4-ab85-afe754b119fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:06.297498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-000730b5-cb5f-42d4-ab85-afe754b119fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:06.299025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-000730b5-cb5f-42d4-ab85-afe754b119fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:06.300245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f1b0874a-9300-44bc-b18d-40c8db84fff5 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:06.301110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-000730b5-cb5f-42d4-ab85-afe754b119fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:06.303422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-000730b5-cb5f-42d4-ab85-afe754b119fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:06.303872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-000730b5-cb5f-42d4-ab85-afe754b119fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:06.311603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f1b0874a-9300-44bc-b18d-40c8db84fff5 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:06.312682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f1b0874a-9300-44bc-b18d-40c8db84fff5 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:06.314326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f1b0874a-9300-44bc-b18d-40c8db84fff5 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:06.315046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f1b0874a-9300-44bc-b18d-40c8db84fff5 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:06.315922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f1b0874a-9300-44bc-b18d-40c8db84fff5 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:06.426314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-f1b0874a-9300-44bc-b18d-40c8db84fff5 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lazy-loading 'flavor' on Instance uuid cdfabf0c-2561-40d0-9f96-f81d60908fec {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:54:06.488538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f1b0874a-9300-44bc-b18d-40c8db84fff5 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Going to try to live migrate instance to n-h1-850468-16 {{(pid=128808) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 17:54:06.925811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-000730b5-cb5f-42d4-ab85-afe754b119fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:06.941769 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-000730b5-cb5f-42d4-ab85-afe754b119fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1477 microversion: 2.1 time: 0.668689 Aug 23 17:54:06.956140 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 435/841] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:06 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1477 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:06.960983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41c2c5a4-61a9-4946-817b-198c20734864 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:06.961594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-41c2c5a4-61a9-4946-817b-198c20734864 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:06.982112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41c2c5a4-61a9-4946-817b-198c20734864 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:06.982648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41c2c5a4-61a9-4946-817b-198c20734864 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:06.983275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41c2c5a4-61a9-4946-817b-198c20734864 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:06.983826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41c2c5a4-61a9-4946-817b-198c20734864 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:06.984613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41c2c5a4-61a9-4946-817b-198c20734864 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:06.985272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41c2c5a4-61a9-4946-817b-198c20734864 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:07.522642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41c2c5a4-61a9-4946-817b-198c20734864 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:07.537595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41c2c5a4-61a9-4946-817b-198c20734864 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:07.539768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41c2c5a4-61a9-4946-817b-198c20734864 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:07.540986 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-41c2c5a4-61a9-4946-817b-198c20734864 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1567 microversion: 2.25 time: 0.583857 Aug 23 17:54:07.541862 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 436/842] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:06 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1567 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:07.549317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-432d3227-0fe6-4071-9c08-3f52c9997fa1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:07.549947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-432d3227-0fe6-4071-9c08-3f52c9997fa1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:07.556663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-432d3227-0fe6-4071-9c08-3f52c9997fa1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:07.557472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-432d3227-0fe6-4071-9c08-3f52c9997fa1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:07.558113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-432d3227-0fe6-4071-9c08-3f52c9997fa1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:07.558862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-432d3227-0fe6-4071-9c08-3f52c9997fa1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:07.559326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-432d3227-0fe6-4071-9c08-3f52c9997fa1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:07.559759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-432d3227-0fe6-4071-9c08-3f52c9997fa1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:07.975516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-432d3227-0fe6-4071-9c08-3f52c9997fa1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:07.978971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:07.991214 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-432d3227-0fe6-4071-9c08-3f52c9997fa1 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.448251 Aug 23 17:54:07.991893 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 437/843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:07 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:08.008254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0306abda-128e-432a-b308-a6fe30ba7d74 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:08.008953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0306abda-128e-432a-b308-a6fe30ba7d74 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:08.031566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0306abda-128e-432a-b308-a6fe30ba7d74 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:08.032430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0306abda-128e-432a-b308-a6fe30ba7d74 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:08.033096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0306abda-128e-432a-b308-a6fe30ba7d74 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:08.035505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0306abda-128e-432a-b308-a6fe30ba7d74 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:08.035974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0306abda-128e-432a-b308-a6fe30ba7d74 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:08.036411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0306abda-128e-432a-b308-a6fe30ba7d74 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:08.433618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0306abda-128e-432a-b308-a6fe30ba7d74 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:08.442823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0306abda-128e-432a-b308-a6fe30ba7d74 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:08.444592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0306abda-128e-432a-b308-a6fe30ba7d74 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:08.451648 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0306abda-128e-432a-b308-a6fe30ba7d74 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.452065 Aug 23 17:54:08.452245 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 438/844] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:07 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:08.461566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-636d7bb0-ae9e-4fa6-8022-a1ae0ff8731a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:08.462371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-636d7bb0-ae9e-4fa6-8022-a1ae0ff8731a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:08.469447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-636d7bb0-ae9e-4fa6-8022-a1ae0ff8731a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:08.469969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-636d7bb0-ae9e-4fa6-8022-a1ae0ff8731a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:08.470632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-636d7bb0-ae9e-4fa6-8022-a1ae0ff8731a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:08.471326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-636d7bb0-ae9e-4fa6-8022-a1ae0ff8731a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:08.471869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-636d7bb0-ae9e-4fa6-8022-a1ae0ff8731a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:08.472416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-636d7bb0-ae9e-4fa6-8022-a1ae0ff8731a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:08.679363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-636d7bb0-ae9e-4fa6-8022-a1ae0ff8731a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:08.689511 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-636d7bb0-ae9e-4fa6-8022-a1ae0ff8731a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1588 microversion: 2.1 time: 0.235494 Aug 23 17:54:08.690674 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 439/845] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:08 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1588 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:08.710969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fb26759c-2ab0-4554-bb4a-62569077cd23 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:08.711503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fb26759c-2ab0-4554-bb4a-62569077cd23 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:08.717808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb26759c-2ab0-4554-bb4a-62569077cd23 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:08.720260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb26759c-2ab0-4554-bb4a-62569077cd23 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:08.720260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb26759c-2ab0-4554-bb4a-62569077cd23 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:08.720260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb26759c-2ab0-4554-bb4a-62569077cd23 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:08.720576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb26759c-2ab0-4554-bb4a-62569077cd23 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:08.721195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb26759c-2ab0-4554-bb4a-62569077cd23 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:08.930603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fb26759c-2ab0-4554-bb4a-62569077cd23 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:08.940428 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fb26759c-2ab0-4554-bb4a-62569077cd23 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.233245 Aug 23 17:54:08.941155 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 440/846] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:08 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:08.945643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a28ea62a-93a6-41d2-be2f-916b1c063f35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:08.946307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a28ea62a-93a6-41d2-be2f-916b1c063f35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:08.953994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a28ea62a-93a6-41d2-be2f-916b1c063f35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:08.954576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a28ea62a-93a6-41d2-be2f-916b1c063f35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:08.955108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a28ea62a-93a6-41d2-be2f-916b1c063f35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:08.955831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a28ea62a-93a6-41d2-be2f-916b1c063f35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:08.956421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a28ea62a-93a6-41d2-be2f-916b1c063f35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:08.957021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a28ea62a-93a6-41d2-be2f-916b1c063f35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:09.093810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a28ea62a-93a6-41d2-be2f-916b1c063f35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:09.102308 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a28ea62a-93a6-41d2-be2f-916b1c063f35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1476 microversion: 2.1 time: 0.160179 Aug 23 17:54:09.102912 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 441/847] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:08 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1476 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:09.107669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7cd0fa70-bef4-4be6-95e5-0986b2a63b46 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:09.108270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7cd0fa70-bef4-4be6-95e5-0986b2a63b46 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:09.114807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7cd0fa70-bef4-4be6-95e5-0986b2a63b46 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:09.115297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7cd0fa70-bef4-4be6-95e5-0986b2a63b46 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:09.115732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7cd0fa70-bef4-4be6-95e5-0986b2a63b46 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:09.116443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7cd0fa70-bef4-4be6-95e5-0986b2a63b46 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:09.116896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7cd0fa70-bef4-4be6-95e5-0986b2a63b46 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:09.117322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7cd0fa70-bef4-4be6-95e5-0986b2a63b46 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:09.252663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7cd0fa70-bef4-4be6-95e5-0986b2a63b46 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:09.260914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7cd0fa70-bef4-4be6-95e5-0986b2a63b46 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:09.262524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7cd0fa70-bef4-4be6-95e5-0986b2a63b46 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:09.263705 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7cd0fa70-bef4-4be6-95e5-0986b2a63b46 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1567 microversion: 2.25 time: 0.159873 Aug 23 17:54:09.264261 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 442/848] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:09 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:09.269521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2fbd854a-2423-4428-8e90-29c08f285029 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:09.270021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2fbd854a-2423-4428-8e90-29c08f285029 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:09.275852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fbd854a-2423-4428-8e90-29c08f285029 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:09.276339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fbd854a-2423-4428-8e90-29c08f285029 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:09.276780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fbd854a-2423-4428-8e90-29c08f285029 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:09.277479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fbd854a-2423-4428-8e90-29c08f285029 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:09.277937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fbd854a-2423-4428-8e90-29c08f285029 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:09.278373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fbd854a-2423-4428-8e90-29c08f285029 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:09.365680 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2fbd854a-2423-4428-8e90-29c08f285029 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100302 Aug 23 17:54:09.366913 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 443/849] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 17:54:09 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:09.372017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c7954ce-9515-43f3-b4e7-0244d4b51d35 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Calling method '.version_select at 0x7f27ecb6a4c0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:09.422079 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c7954ce-9515-43f3-b4e7-0244d4b51d35 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378" status: 200 len: 636 microversion: 2.1 time: 0.053310 Aug 23 17:54:09.422980 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 444/850] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:54:09 2022] GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378 => generated 636 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:09.428239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-61add1ea-2954-4c32-831f-679735d05a95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:09.428857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-61add1ea-2954-4c32-831f-679735d05a95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:09.435578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61add1ea-2954-4c32-831f-679735d05a95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:09.436312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61add1ea-2954-4c32-831f-679735d05a95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:09.436759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61add1ea-2954-4c32-831f-679735d05a95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:09.437618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61add1ea-2954-4c32-831f-679735d05a95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:09.438085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61add1ea-2954-4c32-831f-679735d05a95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:09.438520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61add1ea-2954-4c32-831f-679735d05a95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:09.582116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-61add1ea-2954-4c32-831f-679735d05a95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:09.590805 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-61add1ea-2954-4c32-831f-679735d05a95 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.166294 Aug 23 17:54:09.591387 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 445/851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:09 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:09.596257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-343e4066-ac6b-4c44-8f83-bcfae8d870d7 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Action: 'update_all', calling method: .version_select at 0x7f27ecb741f0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:09.646124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-343e4066-ac6b-4c44-8f83-bcfae8d870d7 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:09.650909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-343e4066-ac6b-4c44-8f83-bcfae8d870d7 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for user 0afe24057b6e4e60be3bb0000af74705 and project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:09.931200 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-343e4066-ac6b-4c44-8f83-bcfae8d870d7 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 61 microversion: 2.1 time: 0.338738 Aug 23 17:54:09.931868 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 446/852] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:54:09 2022] PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 61 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:54:09.937500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-20d90550-85f9-4406-a28e-6649cd34cea6 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:09.938469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-20d90550-85f9-4406-a28e-6649cd34cea6 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:09.944639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20d90550-85f9-4406-a28e-6649cd34cea6 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:09.945206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20d90550-85f9-4406-a28e-6649cd34cea6 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:09.946017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20d90550-85f9-4406-a28e-6649cd34cea6 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:09.947188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20d90550-85f9-4406-a28e-6649cd34cea6 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:09.947724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20d90550-85f9-4406-a28e-6649cd34cea6 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:09.948353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20d90550-85f9-4406-a28e-6649cd34cea6 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:10.081064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20d90550-85f9-4406-a28e-6649cd34cea6 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:10.089385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20d90550-85f9-4406-a28e-6649cd34cea6 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:10.091231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20d90550-85f9-4406-a28e-6649cd34cea6 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:10.092341 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-20d90550-85f9-4406-a28e-6649cd34cea6 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.159470 Aug 23 17:54:10.092990 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 447/853] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:09 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:10.098401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e85d5556-a43f-4492-8487-19ee503f455c tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Calling method '.version_select at 0x7f27ecbdee50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:10.355760 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e85d5556-a43f-4492-8487-19ee503f455c tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "DELETE /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.261180 Aug 23 17:54:10.356343 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 448/854] 10.222.0.61 () {58 vars in 1296 bytes} [Tue Aug 23 17:54:10 2022] DELETE /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata/os_version => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:54:10.363627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-27ca43e0-7278-4ef1-b8cb-1548d425f40c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:10.364420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-27ca43e0-7278-4ef1-b8cb-1548d425f40c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:10.370455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27ca43e0-7278-4ef1-b8cb-1548d425f40c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:10.370969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27ca43e0-7278-4ef1-b8cb-1548d425f40c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:10.371408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27ca43e0-7278-4ef1-b8cb-1548d425f40c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:10.372099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27ca43e0-7278-4ef1-b8cb-1548d425f40c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:10.372566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27ca43e0-7278-4ef1-b8cb-1548d425f40c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:10.372971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27ca43e0-7278-4ef1-b8cb-1548d425f40c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:10.510767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-27ca43e0-7278-4ef1-b8cb-1548d425f40c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:10.520868 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-27ca43e0-7278-4ef1-b8cb-1548d425f40c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.163406 Aug 23 17:54:10.542996 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 449/855] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:10 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:10.542996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c34d52d7-2d75-4711-8662-294e0ac269da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:10.542996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c34d52d7-2d75-4711-8662-294e0ac269da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:10.542996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c34d52d7-2d75-4711-8662-294e0ac269da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:10.542996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c34d52d7-2d75-4711-8662-294e0ac269da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:10.542996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c34d52d7-2d75-4711-8662-294e0ac269da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:10.543702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c34d52d7-2d75-4711-8662-294e0ac269da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:10.551935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c34d52d7-2d75-4711-8662-294e0ac269da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:10.552500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c34d52d7-2d75-4711-8662-294e0ac269da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:11.274837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c34d52d7-2d75-4711-8662-294e0ac269da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:11.290063 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c34d52d7-2d75-4711-8662-294e0ac269da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1476 microversion: 2.1 time: 0.756757 Aug 23 17:54:11.290948 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 450/856] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:10 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1476 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:11.306836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-047b329b-0182-4cdb-807e-fa9950b7eab9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:11.309801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-047b329b-0182-4cdb-807e-fa9950b7eab9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:11.329526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-047b329b-0182-4cdb-807e-fa9950b7eab9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:11.331296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-047b329b-0182-4cdb-807e-fa9950b7eab9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:11.332916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-047b329b-0182-4cdb-807e-fa9950b7eab9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:11.333869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-047b329b-0182-4cdb-807e-fa9950b7eab9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:11.336605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-047b329b-0182-4cdb-807e-fa9950b7eab9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:11.337477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-047b329b-0182-4cdb-807e-fa9950b7eab9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:11.401541 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f1b0874a-9300-44bc-b18d-40c8db84fff5 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec/action" status: 202 len: 0 microversion: 2.1 time: 5.167250 Aug 23 17:54:11.411260 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 407/857] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:54:06 2022] POST /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec/action => generated 0 bytes in 5178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:54:11.423525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa090cb6-ffd4-4437-8dc3-79801556b10d tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Calling method '.version_select at 0x7f27ec9450d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:11.501817 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa090cb6-ffd4-4437-8dc3-79801556b10d tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 37 microversion: 2.1 time: 0.086536 Aug 23 17:54:11.503652 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 408/858] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Aug 23 17:54:11 2022] GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 37 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:54:11.514287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8336525e-7f37-4d85-be01-b4a2ee250e86 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:11.517689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8336525e-7f37-4d85-be01-b4a2ee250e86 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:11.527875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8336525e-7f37-4d85-be01-b4a2ee250e86 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:11.528536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8336525e-7f37-4d85-be01-b4a2ee250e86 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:11.530242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8336525e-7f37-4d85-be01-b4a2ee250e86 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:11.531809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8336525e-7f37-4d85-be01-b4a2ee250e86 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:11.532402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8336525e-7f37-4d85-be01-b4a2ee250e86 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:11.533412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8336525e-7f37-4d85-be01-b4a2ee250e86 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:11.957603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8336525e-7f37-4d85-be01-b4a2ee250e86 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:11.966478 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8336525e-7f37-4d85-be01-b4a2ee250e86 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.461414 Aug 23 17:54:11.967465 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 409/859] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:11 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:11.987756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48859779-cb1a-49a7-a4f3-6a25cf7f80e6 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:11.988568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-48859779-cb1a-49a7-a4f3-6a25cf7f80e6 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:11.997056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48859779-cb1a-49a7-a4f3-6a25cf7f80e6 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:11.997714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48859779-cb1a-49a7-a4f3-6a25cf7f80e6 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:11.998266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48859779-cb1a-49a7-a4f3-6a25cf7f80e6 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:11.999135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48859779-cb1a-49a7-a4f3-6a25cf7f80e6 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:11.999777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48859779-cb1a-49a7-a4f3-6a25cf7f80e6 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:12.000423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48859779-cb1a-49a7-a4f3-6a25cf7f80e6 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:12.040631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-047b329b-0182-4cdb-807e-fa9950b7eab9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:12.049769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-047b329b-0182-4cdb-807e-fa9950b7eab9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:12.051877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-047b329b-0182-4cdb-807e-fa9950b7eab9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:12.053807 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-047b329b-0182-4cdb-807e-fa9950b7eab9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1567 microversion: 2.25 time: 0.762080 Aug 23 17:54:12.066064 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 451/860] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:11 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1567 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:12.066064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-03269b4b-1ff2-4200-9659-9773c1f711ca req-8baa5f26-1fa1-4d87-b391-d3148331f4ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "482c06a7-2b1f-4a6e-8b62-b702d32c4c3f", "tag": "61e068c3-e07e-47db-a508-2528903c28f7"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:12.072709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-03269b4b-1ff2-4200-9659-9773c1f711ca req-8baa5f26-1fa1-4d87-b391-d3148331f4ec service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:12.073208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-03269b4b-1ff2-4200-9659-9773c1f711ca req-8baa5f26-1fa1-4d87-b391-d3148331f4ec service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:12.073648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-03269b4b-1ff2-4200-9659-9773c1f711ca req-8baa5f26-1fa1-4d87-b391-d3148331f4ec service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:12.092811 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-03269b4b-1ff2-4200-9659-9773c1f711ca req-8baa5f26-1fa1-4d87-b391-d3148331f4ec service nova] Creating event network-changed:61e068c3-e07e-47db-a508-2528903c28f7 for instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f on n-h2-850468-16 Aug 23 17:54:12.100416 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-03269b4b-1ff2-4200-9659-9773c1f711ca req-8baa5f26-1fa1-4d87-b391-d3148331f4ec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043957 Aug 23 17:54:12.101325 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 452/861] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:12.107557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-35715460-05c5-4f99-8b07-9e7e8271f432 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:12.108300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-35715460-05c5-4f99-8b07-9e7e8271f432 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:12.118868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35715460-05c5-4f99-8b07-9e7e8271f432 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:12.119399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35715460-05c5-4f99-8b07-9e7e8271f432 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:12.119905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35715460-05c5-4f99-8b07-9e7e8271f432 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:12.121112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35715460-05c5-4f99-8b07-9e7e8271f432 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:12.121613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35715460-05c5-4f99-8b07-9e7e8271f432 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:12.122160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35715460-05c5-4f99-8b07-9e7e8271f432 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:12.502103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-48859779-cb1a-49a7-a4f3-6a25cf7f80e6 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:12.520564 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48859779-cb1a-49a7-a4f3-6a25cf7f80e6 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1588 microversion: 2.1 time: 0.537884 Aug 23 17:54:12.521410 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 410/862] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:11 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1588 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:12.541460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-09f1190e-3eab-43f2-88b3-51205359ca27 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:12.542532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-09f1190e-3eab-43f2-88b3-51205359ca27 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:12.552963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09f1190e-3eab-43f2-88b3-51205359ca27 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:12.554811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09f1190e-3eab-43f2-88b3-51205359ca27 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:12.555407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09f1190e-3eab-43f2-88b3-51205359ca27 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:12.557590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09f1190e-3eab-43f2-88b3-51205359ca27 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:12.558809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09f1190e-3eab-43f2-88b3-51205359ca27 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:12.560849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09f1190e-3eab-43f2-88b3-51205359ca27 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:12.688672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-35715460-05c5-4f99-8b07-9e7e8271f432 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:12.697187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-35715460-05c5-4f99-8b07-9e7e8271f432 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:12.698739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-35715460-05c5-4f99-8b07-9e7e8271f432 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:12.699864 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-35715460-05c5-4f99-8b07-9e7e8271f432 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.597538 Aug 23 17:54:12.715769 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 453/863] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:12 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:12.721274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b0f8906a-945c-4c44-bf18-485862cc83a3 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Action: 'update_all', calling method: .version_select at 0x7f27ecbde4c0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:12.729473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:12.846795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-b0f8906a-945c-4c44-bf18-485862cc83a3 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:12.852873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-b0f8906a-945c-4c44-bf18-485862cc83a3 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for user 0afe24057b6e4e60be3bb0000af74705 and project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:13.254718 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b0f8906a-945c-4c44-bf18-485862cc83a3 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 61 microversion: 2.1 time: 0.537417 Aug 23 17:54:13.263050 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 454/864] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:54:12 2022] PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 61 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:54:13.284300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc1581c3-afe6-44de-b1d2-2af28b438a63 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:13.288710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc1581c3-afe6-44de-b1d2-2af28b438a63 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:13.296685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc1581c3-afe6-44de-b1d2-2af28b438a63 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:13.297632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc1581c3-afe6-44de-b1d2-2af28b438a63 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:13.298416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc1581c3-afe6-44de-b1d2-2af28b438a63 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:13.301817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc1581c3-afe6-44de-b1d2-2af28b438a63 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:13.302652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc1581c3-afe6-44de-b1d2-2af28b438a63 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:13.303577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc1581c3-afe6-44de-b1d2-2af28b438a63 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:13.350604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=14 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:13.476482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-09f1190e-3eab-43f2-88b3-51205359ca27 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:13.485083 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-09f1190e-3eab-43f2-88b3-51205359ca27 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.962629 Aug 23 17:54:13.486216 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 411/865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:12 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:13.490985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f6033ee-07ef-495a-ab11-adc5c70d74d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:13.491778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5f6033ee-07ef-495a-ab11-adc5c70d74d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:13.497770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f6033ee-07ef-495a-ab11-adc5c70d74d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:13.498431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f6033ee-07ef-495a-ab11-adc5c70d74d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:13.499228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f6033ee-07ef-495a-ab11-adc5c70d74d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:13.500518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f6033ee-07ef-495a-ab11-adc5c70d74d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:13.500979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f6033ee-07ef-495a-ab11-adc5c70d74d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:13.501406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f6033ee-07ef-495a-ab11-adc5c70d74d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:13.775012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bc1581c3-afe6-44de-b1d2-2af28b438a63 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:13.791455 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc1581c3-afe6-44de-b1d2-2af28b438a63 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.522045 Aug 23 17:54:13.792984 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 455/866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:13 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:13.799403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f6033ee-07ef-495a-ab11-adc5c70d74d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:13.809681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b54ddc82-4852-4498-99a2-b1ecc5fa23a0 req-577cbfd5-7fd3-4789-b72c-686b17851b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4", "name": "network-vif-unplugged", "status": "completed", "tag": "ee6fb24a-f8ec-4d67-b529-6a7b42386fd6"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:13.815002 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5f6033ee-07ef-495a-ab11-adc5c70d74d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1476 microversion: 2.1 time: 0.327478 Aug 23 17:54:13.816871 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 412/867] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:13 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1476 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:13.833400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d17c03d4-3bee-490a-a48f-d87545f4487c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:13.834019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d17c03d4-3bee-490a-a48f-d87545f4487c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:13.838192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b54ddc82-4852-4498-99a2-b1ecc5fa23a0 req-577cbfd5-7fd3-4789-b72c-686b17851b11 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:13.839958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b54ddc82-4852-4498-99a2-b1ecc5fa23a0 req-577cbfd5-7fd3-4789-b72c-686b17851b11 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:13.840900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b54ddc82-4852-4498-99a2-b1ecc5fa23a0 req-577cbfd5-7fd3-4789-b72c-686b17851b11 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:13.842675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d17c03d4-3bee-490a-a48f-d87545f4487c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:13.846441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d17c03d4-3bee-490a-a48f-d87545f4487c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:13.851527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d17c03d4-3bee-490a-a48f-d87545f4487c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:13.852480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d17c03d4-3bee-490a-a48f-d87545f4487c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:13.853018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d17c03d4-3bee-490a-a48f-d87545f4487c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:13.853456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d17c03d4-3bee-490a-a48f-d87545f4487c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:13.860421 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b54ddc82-4852-4498-99a2-b1ecc5fa23a0 req-577cbfd5-7fd3-4789-b72c-686b17851b11 service nova] Creating event network-vif-unplugged:ee6fb24a-f8ec-4d67-b529-6a7b42386fd6 for instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 on n-h1-850468-16 Aug 23 17:54:13.869609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-b54ddc82-4852-4498-99a2-b1ecc5fa23a0 req-577cbfd5-7fd3-4789-b72c-686b17851b11 service nova] Instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 17:54:13.884933 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b54ddc82-4852-4498-99a2-b1ecc5fa23a0 req-577cbfd5-7fd3-4789-b72c-686b17851b11 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.088464 Aug 23 17:54:13.887454 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 456/868] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:13.895381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-846a1653-55f2-49bb-9389-af82cfeeda77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:13.896682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-846a1653-55f2-49bb-9389-af82cfeeda77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:13.905276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-846a1653-55f2-49bb-9389-af82cfeeda77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:13.907085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-846a1653-55f2-49bb-9389-af82cfeeda77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:13.908460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-846a1653-55f2-49bb-9389-af82cfeeda77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:13.909606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-846a1653-55f2-49bb-9389-af82cfeeda77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:13.910483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-846a1653-55f2-49bb-9389-af82cfeeda77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:13.911926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-846a1653-55f2-49bb-9389-af82cfeeda77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:14.113921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:14.182699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d17c03d4-3bee-490a-a48f-d87545f4487c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:14.192245 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d17c03d4-3bee-490a-a48f-d87545f4487c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.372980 Aug 23 17:54:14.194845 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 413/869] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:13 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:14.207466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-26e05d7b-61be-4df9-9b79-74d06beba931 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Calling method '.version_select at 0x7f27ed2e9820>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:14.270590 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-26e05d7b-61be-4df9-9b79-74d06beba931 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.074241 Aug 23 17:54:14.271310 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 414/870] 10.222.0.61 () {58 vars in 1290 bytes} [Tue Aug 23 17:54:14 2022] GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata/os_distro => generated 33 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:54:14.276788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-24d5ca12-27e5-4c5a-bf32-08c0b89101cb tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:14.279604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-24d5ca12-27e5-4c5a-bf32-08c0b89101cb tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:14.288228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24d5ca12-27e5-4c5a-bf32-08c0b89101cb tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:14.288912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24d5ca12-27e5-4c5a-bf32-08c0b89101cb tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:14.289365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24d5ca12-27e5-4c5a-bf32-08c0b89101cb tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:14.290375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24d5ca12-27e5-4c5a-bf32-08c0b89101cb tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:14.291180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24d5ca12-27e5-4c5a-bf32-08c0b89101cb tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:14.291678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24d5ca12-27e5-4c5a-bf32-08c0b89101cb tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:14.399966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-846a1653-55f2-49bb-9389-af82cfeeda77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:14.414345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-846a1653-55f2-49bb-9389-af82cfeeda77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:14.418671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-846a1653-55f2-49bb-9389-af82cfeeda77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:14.420649 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-846a1653-55f2-49bb-9389-af82cfeeda77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1557 microversion: 2.25 time: 0.531230 Aug 23 17:54:14.423207 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 457/871] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:13 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1557 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:14.429084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b410ec73-0f4a-47e3-892e-2ad3dbb11b4d req-928d443b-b579-4625-9ac8-c6334664fadf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a4f4f5-5f3a-4907-a471-005e1f790e8b", "name": "network-vif-plugged", "status": "completed", "tag": "667d527b-7ec9-4bdb-951c-0b3029adcb79"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:14.443996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b410ec73-0f4a-47e3-892e-2ad3dbb11b4d req-928d443b-b579-4625-9ac8-c6334664fadf service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:14.444937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b410ec73-0f4a-47e3-892e-2ad3dbb11b4d req-928d443b-b579-4625-9ac8-c6334664fadf service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:14.445525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b410ec73-0f4a-47e3-892e-2ad3dbb11b4d req-928d443b-b579-4625-9ac8-c6334664fadf service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:14.463268 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b410ec73-0f4a-47e3-892e-2ad3dbb11b4d req-928d443b-b579-4625-9ac8-c6334664fadf service nova] Creating event network-vif-plugged:667d527b-7ec9-4bdb-951c-0b3029adcb79 for instance 69a4f4f5-5f3a-4907-a471-005e1f790e8b on n-h1-850468-16 Aug 23 17:54:14.471768 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b410ec73-0f4a-47e3-892e-2ad3dbb11b4d req-928d443b-b579-4625-9ac8-c6334664fadf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046002 Aug 23 17:54:14.472905 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 458/872] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:14.480908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6293f019-a80a-465d-8058-feb92d513e99 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Action: 'update_all', calling method: .version_select at 0x7f27ecb78e50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:14.561703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-24d5ca12-27e5-4c5a-bf32-08c0b89101cb tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:14.571580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-24d5ca12-27e5-4c5a-bf32-08c0b89101cb tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:14.578423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-24d5ca12-27e5-4c5a-bf32-08c0b89101cb tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:14.585200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-6293f019-a80a-465d-8058-feb92d513e99 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:14.591885 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-24d5ca12-27e5-4c5a-bf32-08c0b89101cb tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.319185 Aug 23 17:54:14.592494 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 415/873] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:14 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:14.592907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-6293f019-a80a-465d-8058-feb92d513e99 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for user 0afe24057b6e4e60be3bb0000af74705 and project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:14.597840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6d7d08b8-9355-4a76-9e80-eb780465b4f5 req-a2e21cda-1b38-40da-9466-db60eea4e98b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfabf0c-2561-40d0-9f96-f81d60908fec", "name": "network-vif-unplugged", "status": "completed", "tag": "cf4c929b-222c-42c4-b117-5dea5790b383"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:14.611347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6d7d08b8-9355-4a76-9e80-eb780465b4f5 req-a2e21cda-1b38-40da-9466-db60eea4e98b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:14.611747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6d7d08b8-9355-4a76-9e80-eb780465b4f5 req-a2e21cda-1b38-40da-9466-db60eea4e98b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:14.612184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6d7d08b8-9355-4a76-9e80-eb780465b4f5 req-a2e21cda-1b38-40da-9466-db60eea4e98b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:14.652787 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6d7d08b8-9355-4a76-9e80-eb780465b4f5 req-a2e21cda-1b38-40da-9466-db60eea4e98b service nova] Creating event network-vif-unplugged:cf4c929b-222c-42c4-b117-5dea5790b383 for instance cdfabf0c-2561-40d0-9f96-f81d60908fec on n-h2-850468-16 Aug 23 17:54:14.660629 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6d7d08b8-9355-4a76-9e80-eb780465b4f5 req-a2e21cda-1b38-40da-9466-db60eea4e98b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066932 Aug 23 17:54:14.662201 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 416/874] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:14.667587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7383b96b-1435-420b-86cc-de644e99dae2 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '.version_select at 0x7f27ecbded30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:14.672041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7383b96b-1435-420b-86cc-de644e99dae2 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:14.672723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7383b96b-1435-420b-86cc-de644e99dae2 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:14.673697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7383b96b-1435-420b-86cc-de644e99dae2 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:14.696861 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7383b96b-1435-420b-86cc-de644e99dae2 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 2211 microversion: 2.25 time: 0.033094 Aug 23 17:54:14.697982 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 417/875] 10.222.0.61 () {60 vars in 1184 bytes} [Tue Aug 23 17:54:14 2022] GET /compute/v2.1/os-migrations => generated 2211 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:14.703985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-92fb8892-d12d-46fb-a45c-e26cf3840d19 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:14.704939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-92fb8892-d12d-46fb-a45c-e26cf3840d19 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:14.712858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:14.714483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92fb8892-d12d-46fb-a45c-e26cf3840d19 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:14.715057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92fb8892-d12d-46fb-a45c-e26cf3840d19 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:14.715770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92fb8892-d12d-46fb-a45c-e26cf3840d19 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:14.716488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92fb8892-d12d-46fb-a45c-e26cf3840d19 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:14.716944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92fb8892-d12d-46fb-a45c-e26cf3840d19 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:14.717363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92fb8892-d12d-46fb-a45c-e26cf3840d19 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:14.822967 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6293f019-a80a-465d-8058-feb92d513e99 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 61 microversion: 2.1 time: 0.348272 Aug 23 17:54:14.828350 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 459/876] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:54:14 2022] PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 61 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:54:14.829917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-23d33731-ab3f-46f6-ad6b-acef091ae32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:14.832179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-23d33731-ab3f-46f6-ad6b-acef091ae32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:14.839093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23d33731-ab3f-46f6-ad6b-acef091ae32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:14.839592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23d33731-ab3f-46f6-ad6b-acef091ae32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:14.840044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23d33731-ab3f-46f6-ad6b-acef091ae32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:14.840994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23d33731-ab3f-46f6-ad6b-acef091ae32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:14.841450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23d33731-ab3f-46f6-ad6b-acef091ae32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:14.841857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23d33731-ab3f-46f6-ad6b-acef091ae32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:15.003013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-92fb8892-d12d-46fb-a45c-e26cf3840d19 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:15.011449 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-92fb8892-d12d-46fb-a45c-e26cf3840d19 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.312155 Aug 23 17:54:15.012032 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 418/877] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:14 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:15.017476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a7dfa8b7-abbb-4c18-b9f6-2cf9b827c48b tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:15.018428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a7dfa8b7-abbb-4c18-b9f6-2cf9b827c48b tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:15.024526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7dfa8b7-abbb-4c18-b9f6-2cf9b827c48b tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:15.025014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7dfa8b7-abbb-4c18-b9f6-2cf9b827c48b tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:15.025453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7dfa8b7-abbb-4c18-b9f6-2cf9b827c48b tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:15.026162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7dfa8b7-abbb-4c18-b9f6-2cf9b827c48b tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:15.026782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7dfa8b7-abbb-4c18-b9f6-2cf9b827c48b tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:15.027215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7dfa8b7-abbb-4c18-b9f6-2cf9b827c48b tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:15.201914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a7dfa8b7-abbb-4c18-b9f6-2cf9b827c48b tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:15.213072 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a7dfa8b7-abbb-4c18-b9f6-2cf9b827c48b tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.199944 Aug 23 17:54:15.214463 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 419/878] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:15 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:15.221575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a13a471f-0a15-43b1-add4-9347b86f2c6a tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Calling method '.version_select at 0x7f27ec87baf0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:15.268301 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a13a471f-0a15-43b1-add4-9347b86f2c6a tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 61 microversion: 2.1 time: 0.052630 Aug 23 17:54:15.269238 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 420/879] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Aug 23 17:54:15 2022] GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 61 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:54:15.276598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f6a99ee3-3181-4ac4-8da7-ad0a63e15c37 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:15.277214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f6a99ee3-3181-4ac4-8da7-ad0a63e15c37 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:15.285245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6a99ee3-3181-4ac4-8da7-ad0a63e15c37 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:15.285738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6a99ee3-3181-4ac4-8da7-ad0a63e15c37 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:15.286579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6a99ee3-3181-4ac4-8da7-ad0a63e15c37 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:15.287496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6a99ee3-3181-4ac4-8da7-ad0a63e15c37 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:15.288099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6a99ee3-3181-4ac4-8da7-ad0a63e15c37 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:15.288671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6a99ee3-3181-4ac4-8da7-ad0a63e15c37 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:15.378897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-23d33731-ab3f-46f6-ad6b-acef091ae32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid b9504575-e074-4aad-871d-bcb9db7a22e3 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:54:15.394268 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-23d33731-ab3f-46f6-ad6b-acef091ae32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 2052 microversion: 2.25 time: 0.569298 Aug 23 17:54:15.395197 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 460/880] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:14 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 2052 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:15.400583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0ea14769-d8e8-4642-9ca8-77fae29560b9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:15.401391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0ea14769-d8e8-4642-9ca8-77fae29560b9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:15.408660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ea14769-d8e8-4642-9ca8-77fae29560b9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:15.409447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ea14769-d8e8-4642-9ca8-77fae29560b9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:15.410148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ea14769-d8e8-4642-9ca8-77fae29560b9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:15.411063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ea14769-d8e8-4642-9ca8-77fae29560b9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:15.419281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ea14769-d8e8-4642-9ca8-77fae29560b9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:15.420026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ea14769-d8e8-4642-9ca8-77fae29560b9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:15.426774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:15.446212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f6a99ee3-3181-4ac4-8da7-ad0a63e15c37 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:15.455731 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f6a99ee3-3181-4ac4-8da7-ad0a63e15c37 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1476 microversion: 2.1 time: 0.184915 Aug 23 17:54:15.472078 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 421/881] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:15 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1476 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:15.477315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2290ea5a-54b7-4d8c-8db8-d180b8c383a8 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Action: 'update_all', calling method: .version_select at 0x7f27ec921790>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:15.537265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-2290ea5a-54b7-4d8c-8db8-d180b8c383a8 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:15.544060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-2290ea5a-54b7-4d8c-8db8-d180b8c383a8 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for user 0afe24057b6e4e60be3bb0000af74705 and project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:15.584688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0ea14769-d8e8-4642-9ca8-77fae29560b9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:15.593896 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0ea14769-d8e8-4642-9ca8-77fae29560b9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.196893 Aug 23 17:54:15.599190 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 461/882] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:15 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:15.604072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-2102263963", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "18890100-9652-4122-9a4a-c466e7188bca"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:15.666665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] validate_networks() for [('18890100-9652-4122-9a4a-c466e7188bca', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:54:15.725870 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2290ea5a-54b7-4d8c-8db8-d180b8c383a8 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 61 microversion: 2.1 time: 0.252487 Aug 23 17:54:15.726462 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 422/883] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:54:15 2022] PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 61 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:54:15.731246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9d21c480-44df-40ec-9951-4e60702af927 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:15.731884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9d21c480-44df-40ec-9951-4e60702af927 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:15.738784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d21c480-44df-40ec-9951-4e60702af927 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:15.739289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d21c480-44df-40ec-9951-4e60702af927 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:15.739733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d21c480-44df-40ec-9951-4e60702af927 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:15.740443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d21c480-44df-40ec-9951-4e60702af927 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:15.740900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d21c480-44df-40ec-9951-4e60702af927 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:15.741327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d21c480-44df-40ec-9951-4e60702af927 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:15.883321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9d21c480-44df-40ec-9951-4e60702af927 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:15.901292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9d21c480-44df-40ec-9951-4e60702af927 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:15.904331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9d21c480-44df-40ec-9951-4e60702af927 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:15.908767 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9d21c480-44df-40ec-9951-4e60702af927 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.179353 Aug 23 17:54:15.909382 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 423/884] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:15 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:15.916430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aac70ed6-16b0-444a-92cd-09e7541e87ec tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Action: 'update_all', calling method: .version_select at 0x7f27ec87b8b0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:15.970996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-aac70ed6-16b0-444a-92cd-09e7541e87ec tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:15.975725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-aac70ed6-16b0-444a-92cd-09e7541e87ec tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for user 0afe24057b6e4e60be3bb0000af74705 and project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:16.087715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:54:16.088250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:54:16.088832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:54:16.089385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:54:16.090063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:54:16.101715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:16.102521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:16.103744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:16.105102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:16.105711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:16.106130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:16.124097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Getting quotas for project a847d523b7944595aa39244f15b37665. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:16.129577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Getting quotas for user bb8758f075834ca59962ab82f042ec34 and project a847d523b7944595aa39244f15b37665. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:16.142412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:54:16.144672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:54:16.154765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:16.192259 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-de8e1421-76d4-46e7-ae7d-fc484002bcbb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.591981 Aug 23 17:54:16.198678 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 462/885] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 17:54:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 17:54:16.198678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1cce62fa-e59d-4e92-b0f6-8b544c21def1 req-3f85a453-6353-49e9-a07b-e31ad45a8f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af054669-ae48-40f0-88d8-e163ab916c8c", "tag": "09a1fff1-1cd6-49a8-8af1-c239514e392e"}, {"name": "network-changed", "server_uuid": "13c4d28d-309a-4458-9d1e-91ac80454833", "tag": "3fb7efac-faa0-444f-bf74-83a2d19ebc05"}, {"name": "network-changed", "server_uuid": "ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4", "tag": "ee6fb24a-f8ec-4d67-b529-6a7b42386fd6"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:16.209853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1cce62fa-e59d-4e92-b0f6-8b544c21def1 req-3f85a453-6353-49e9-a07b-e31ad45a8f22 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:16.211610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1cce62fa-e59d-4e92-b0f6-8b544c21def1 req-3f85a453-6353-49e9-a07b-e31ad45a8f22 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:16.211610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1cce62fa-e59d-4e92-b0f6-8b544c21def1 req-3f85a453-6353-49e9-a07b-e31ad45a8f22 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:16.227638 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1cce62fa-e59d-4e92-b0f6-8b544c21def1 req-3f85a453-6353-49e9-a07b-e31ad45a8f22 service nova] Creating event network-changed:09a1fff1-1cd6-49a8-8af1-c239514e392e for instance af054669-ae48-40f0-88d8-e163ab916c8c on n-h1-850468-16 Aug 23 17:54:16.228145 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1cce62fa-e59d-4e92-b0f6-8b544c21def1 req-3f85a453-6353-49e9-a07b-e31ad45a8f22 service nova] Creating event network-changed:3fb7efac-faa0-444f-bf74-83a2d19ebc05 for instance 13c4d28d-309a-4458-9d1e-91ac80454833 on n-h1-850468-16 Aug 23 17:54:16.230436 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1cce62fa-e59d-4e92-b0f6-8b544c21def1 req-3f85a453-6353-49e9-a07b-e31ad45a8f22 service nova] Creating event network-changed:ee6fb24a-f8ec-4d67-b529-6a7b42386fd6 for instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 on n-h1-850468-16 Aug 23 17:54:16.238079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-1cce62fa-e59d-4e92-b0f6-8b544c21def1 req-3f85a453-6353-49e9-a07b-e31ad45a8f22 service nova] Instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 17:54:16.253522 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1cce62fa-e59d-4e92-b0f6-8b544c21def1 req-3f85a453-6353-49e9-a07b-e31ad45a8f22 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.058872 Aug 23 17:54:16.258090 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 463/886] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:16.263091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a05e9b64-27df-458b-a6a4-5e645065a855 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:16.263792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a05e9b64-27df-458b-a6a4-5e645065a855 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:16.276465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a05e9b64-27df-458b-a6a4-5e645065a855 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:16.277146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a05e9b64-27df-458b-a6a4-5e645065a855 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:16.277742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a05e9b64-27df-458b-a6a4-5e645065a855 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:16.279743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a05e9b64-27df-458b-a6a4-5e645065a855 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:16.280357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a05e9b64-27df-458b-a6a4-5e645065a855 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:16.281522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a05e9b64-27df-458b-a6a4-5e645065a855 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:16.353505 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aac70ed6-16b0-444a-92cd-09e7541e87ec tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 64 microversion: 2.1 time: 0.442133 Aug 23 17:54:16.354189 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 424/887] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:54:15 2022] PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 64 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:54:16.363015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dc71ab49-120d-44d6-85ea-00f4f1e5b88f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:16.363764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc71ab49-120d-44d6-85ea-00f4f1e5b88f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:16.456122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dc71ab49-120d-44d6-85ea-00f4f1e5b88f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:16.473072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dc71ab49-120d-44d6-85ea-00f4f1e5b88f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:16.476917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a05e9b64-27df-458b-a6a4-5e645065a855 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:16.477118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dc71ab49-120d-44d6-85ea-00f4f1e5b88f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:16.478197 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dc71ab49-120d-44d6-85ea-00f4f1e5b88f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1262 microversion: 2.25 time: 0.122942 Aug 23 17:54:16.490585 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 425/888] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:16 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1262 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:16.490585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-793dcfe1-572d-4d1c-a9d6-303b197c9758 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:16.490585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-793dcfe1-572d-4d1c-a9d6-303b197c9758 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:16.491755 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a05e9b64-27df-458b-a6a4-5e645065a855 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.231408 Aug 23 17:54:16.491755 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 464/889] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:16 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:16.497426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-524b3801-fcc6-492c-b8ce-6bdbd0cd9044 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Calling method '.version_select at 0x7f27ecb788b0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:16.510454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-793dcfe1-572d-4d1c-a9d6-303b197c9758 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:16.511096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-793dcfe1-572d-4d1c-a9d6-303b197c9758 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:16.511474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-793dcfe1-572d-4d1c-a9d6-303b197c9758 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:16.512249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-793dcfe1-572d-4d1c-a9d6-303b197c9758 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:16.512617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-793dcfe1-572d-4d1c-a9d6-303b197c9758 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:16.515122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-793dcfe1-572d-4d1c-a9d6-303b197c9758 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:16.562835 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-524b3801-fcc6-492c-b8ce-6bdbd0cd9044 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 64 microversion: 2.1 time: 0.070170 Aug 23 17:54:16.563543 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 465/890] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Aug 23 17:54:16 2022] GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 64 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:54:16.570086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f70a67bb-5de1-4bcb-af20-63146420689d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:16.570982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f70a67bb-5de1-4bcb-af20-63146420689d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:16.577091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f70a67bb-5de1-4bcb-af20-63146420689d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:16.577697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f70a67bb-5de1-4bcb-af20-63146420689d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:16.578205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f70a67bb-5de1-4bcb-af20-63146420689d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:16.578955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f70a67bb-5de1-4bcb-af20-63146420689d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:16.579398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f70a67bb-5de1-4bcb-af20-63146420689d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:16.579824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f70a67bb-5de1-4bcb-af20-63146420689d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:16.747717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f70a67bb-5de1-4bcb-af20-63146420689d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:16.757147 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f70a67bb-5de1-4bcb-af20-63146420689d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1476 microversion: 2.1 time: 0.192316 Aug 23 17:54:16.758019 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 466/891] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:16 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1476 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:16.762990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dbd6c676-d270-4e88-af1d-71dafb2088cd tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Action: 'update_all', calling method: .version_select at 0x7f27ed09e5e0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:16.795603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-793dcfe1-572d-4d1c-a9d6-303b197c9758 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:16.806761 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-793dcfe1-572d-4d1c-a9d6-303b197c9758 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.325256 Aug 23 17:54:16.807843 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 426/892] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:16 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:16.821672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-dbd6c676-d270-4e88-af1d-71dafb2088cd tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:16.823203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-dbd6c676-d270-4e88-af1d-71dafb2088cd tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for user 0afe24057b6e4e60be3bb0000af74705 and project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:16.827735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ddd2ad76-ec39-4351-b67d-8bab82c175a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:16.828476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ddd2ad76-ec39-4351-b67d-8bab82c175a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:16.834944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddd2ad76-ec39-4351-b67d-8bab82c175a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:16.835643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddd2ad76-ec39-4351-b67d-8bab82c175a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:16.836256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddd2ad76-ec39-4351-b67d-8bab82c175a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:16.837118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddd2ad76-ec39-4351-b67d-8bab82c175a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:16.837716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddd2ad76-ec39-4351-b67d-8bab82c175a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:16.838285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddd2ad76-ec39-4351-b67d-8bab82c175a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:16.860128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:17.066786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ddd2ad76-ec39-4351-b67d-8bab82c175a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:17.078586 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ddd2ad76-ec39-4351-b67d-8bab82c175a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.254637 Aug 23 17:54:17.092177 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 427/893] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:16 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:17.092177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7b6c260e-e269-4648-a8f4-a3dfa3107a2a req-1d72c237-3ec0-4ec8-9010-de8df762de3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cdfabf0c-2561-40d0-9f96-f81d60908fec", "tag": "cf4c929b-222c-42c4-b117-5dea5790b383"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:17.097507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7b6c260e-e269-4648-a8f4-a3dfa3107a2a req-1d72c237-3ec0-4ec8-9010-de8df762de3a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:17.098135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7b6c260e-e269-4648-a8f4-a3dfa3107a2a req-1d72c237-3ec0-4ec8-9010-de8df762de3a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:17.099249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7b6c260e-e269-4648-a8f4-a3dfa3107a2a req-1d72c237-3ec0-4ec8-9010-de8df762de3a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:17.116890 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7b6c260e-e269-4648-a8f4-a3dfa3107a2a req-1d72c237-3ec0-4ec8-9010-de8df762de3a service nova] Creating event network-changed:cf4c929b-222c-42c4-b117-5dea5790b383 for instance cdfabf0c-2561-40d0-9f96-f81d60908fec on n-h2-850468-16 Aug 23 17:54:17.127735 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7b6c260e-e269-4648-a8f4-a3dfa3107a2a req-1d72c237-3ec0-4ec8-9010-de8df762de3a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046221 Aug 23 17:54:17.129833 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 428/894] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:17.139340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-57ecc789-a4d8-4cb7-b206-56563f9f3e46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:17.140824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-57ecc789-a4d8-4cb7-b206-56563f9f3e46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:17.148646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57ecc789-a4d8-4cb7-b206-56563f9f3e46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:17.149463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57ecc789-a4d8-4cb7-b206-56563f9f3e46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:17.150152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57ecc789-a4d8-4cb7-b206-56563f9f3e46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:17.151313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57ecc789-a4d8-4cb7-b206-56563f9f3e46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:17.152044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57ecc789-a4d8-4cb7-b206-56563f9f3e46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:17.152821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57ecc789-a4d8-4cb7-b206-56563f9f3e46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:17.162882 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dbd6c676-d270-4e88-af1d-71dafb2088cd tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 61 microversion: 2.1 time: 0.403388 Aug 23 17:54:17.163967 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 467/895] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:54:16 2022] PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 61 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:54:17.176615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc9e8dfb-069b-45a3-bb10-8216a6495757 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Action: 'update', calling method: .version_select at 0x7f27ecc0d670>, body: {"meta": {"os_version": "alt"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:17.246879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fc9e8dfb-069b-45a3-bb10-8216a6495757 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:17.254511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fc9e8dfb-069b-45a3-bb10-8216a6495757 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for user 0afe24057b6e4e60be3bb0000af74705 and project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:17.480758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-57ecc789-a4d8-4cb7-b206-56563f9f3e46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:17.490700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-57ecc789-a4d8-4cb7-b206-56563f9f3e46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:17.492215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-57ecc789-a4d8-4cb7-b206-56563f9f3e46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:17.493545 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-57ecc789-a4d8-4cb7-b206-56563f9f3e46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.362547 Aug 23 17:54:17.494097 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 429/896] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:17 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:17.516260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93fd61cb-7f7b-4602-91f3-12febe77a316 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:17.517577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-93fd61cb-7f7b-4602-91f3-12febe77a316 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:17.524184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93fd61cb-7f7b-4602-91f3-12febe77a316 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:17.524671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93fd61cb-7f7b-4602-91f3-12febe77a316 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:17.525299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93fd61cb-7f7b-4602-91f3-12febe77a316 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:17.526010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93fd61cb-7f7b-4602-91f3-12febe77a316 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:17.526467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93fd61cb-7f7b-4602-91f3-12febe77a316 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:17.526975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93fd61cb-7f7b-4602-91f3-12febe77a316 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:17.579653 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fc9e8dfb-069b-45a3-bb10-8216a6495757 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.408984 Aug 23 17:54:17.580313 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 468/897] 10.222.0.61 () {60 vars in 1313 bytes} [Tue Aug 23 17:54:17 2022] PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata/os_version => generated 31 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 17:54:17.587775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-418fec16-8250-4b5e-99d2-802587fdce39 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:17.588715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-418fec16-8250-4b5e-99d2-802587fdce39 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:17.597303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-418fec16-8250-4b5e-99d2-802587fdce39 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:17.597803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-418fec16-8250-4b5e-99d2-802587fdce39 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:17.598248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-418fec16-8250-4b5e-99d2-802587fdce39 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:17.599134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-418fec16-8250-4b5e-99d2-802587fdce39 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:17.599598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-418fec16-8250-4b5e-99d2-802587fdce39 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:17.600029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-418fec16-8250-4b5e-99d2-802587fdce39 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:17.636386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93fd61cb-7f7b-4602-91f3-12febe77a316 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:17.645091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93fd61cb-7f7b-4602-91f3-12febe77a316 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:17.647044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93fd61cb-7f7b-4602-91f3-12febe77a316 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:17.648351 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93fd61cb-7f7b-4602-91f3-12febe77a316 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1314 microversion: 2.25 time: 0.141911 Aug 23 17:54:17.649381 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 430/898] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:17 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1314 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:54:17.654078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4b4a4baa-cd8d-43d2-95d7-8562686aeeb7 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Calling method '.version_select at 0x7f27ec921e50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:17.699124 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4b4a4baa-cd8d-43d2-95d7-8562686aeeb7 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 58 microversion: 2.1 time: 0.048426 Aug 23 17:54:17.699691 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 431/899] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Aug 23 17:54:17 2022] GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 58 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:54:17.710630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1f2e9140-eaa2-4aaf-bde4-55eec7a21c5e tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Action: 'update_all', calling method: .version_select at 0x7f27ec891700>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:17.767256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-418fec16-8250-4b5e-99d2-802587fdce39 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:17.771923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-1f2e9140-eaa2-4aaf-bde4-55eec7a21c5e tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:17.777442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-1f2e9140-eaa2-4aaf-bde4-55eec7a21c5e tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for user 0afe24057b6e4e60be3bb0000af74705 and project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:17.779430 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-418fec16-8250-4b5e-99d2-802587fdce39 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.197794 Aug 23 17:54:17.780281 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 469/900] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:17 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:17.785204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d6d311d1-9c2d-4a09-ab39-9582dca703e8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:17.786064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d6d311d1-9c2d-4a09-ab39-9582dca703e8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:17.792459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6d311d1-9c2d-4a09-ab39-9582dca703e8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:17.793196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6d311d1-9c2d-4a09-ab39-9582dca703e8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:17.793855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6d311d1-9c2d-4a09-ab39-9582dca703e8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:17.794707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6d311d1-9c2d-4a09-ab39-9582dca703e8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:17.795335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6d311d1-9c2d-4a09-ab39-9582dca703e8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:17.795766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6d311d1-9c2d-4a09-ab39-9582dca703e8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:17.950835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d6d311d1-9c2d-4a09-ab39-9582dca703e8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:17.960637 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d6d311d1-9c2d-4a09-ab39-9582dca703e8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1476 microversion: 2.1 time: 0.179049 Aug 23 17:54:17.961263 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 470/901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:17 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1476 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:17.966093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9436e0b-bba9-4fdf-9371-13db59e7e3ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:17.966924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d9436e0b-bba9-4fdf-9371-13db59e7e3ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:17.975863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9436e0b-bba9-4fdf-9371-13db59e7e3ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:17.976633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9436e0b-bba9-4fdf-9371-13db59e7e3ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:17.977250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9436e0b-bba9-4fdf-9371-13db59e7e3ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:17.978747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9436e0b-bba9-4fdf-9371-13db59e7e3ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:17.979368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9436e0b-bba9-4fdf-9371-13db59e7e3ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:17.979970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9436e0b-bba9-4fdf-9371-13db59e7e3ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:18.113484 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1f2e9140-eaa2-4aaf-bde4-55eec7a21c5e tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 61 microversion: 2.1 time: 0.407075 Aug 23 17:54:18.114636 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 432/902] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:54:17 2022] PUT /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 61 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 17:54:18.119914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-39a0b387-fbfe-4b42-bf1a-237be030a699 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:18.120566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-39a0b387-fbfe-4b42-bf1a-237be030a699 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:18.128819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39a0b387-fbfe-4b42-bf1a-237be030a699 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:18.129597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39a0b387-fbfe-4b42-bf1a-237be030a699 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:18.130204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39a0b387-fbfe-4b42-bf1a-237be030a699 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:18.131256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39a0b387-fbfe-4b42-bf1a-237be030a699 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:18.132022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39a0b387-fbfe-4b42-bf1a-237be030a699 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:18.132815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39a0b387-fbfe-4b42-bf1a-237be030a699 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:18.168590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d9436e0b-bba9-4fdf-9371-13db59e7e3ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:18.177655 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d9436e0b-bba9-4fdf-9371-13db59e7e3ec tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.215155 Aug 23 17:54:18.178320 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 471/903] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:17 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:18.183178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e239fab5-81ab-491c-9caa-8c1278a7e9c2 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Action: 'create', calling method: .version_select at 0x7f27ed2204c0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:18.237821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-e239fab5-81ab-491c-9caa-8c1278a7e9c2 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:18.242271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-e239fab5-81ab-491c-9caa-8c1278a7e9c2 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Getting quotas for user 0afe24057b6e4e60be3bb0000af74705 and project 4c94fe37b48c44e3a9ff77f10a5dc68a. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:18.450197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-39a0b387-fbfe-4b42-bf1a-237be030a699 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:18.461608 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-39a0b387-fbfe-4b42-bf1a-237be030a699 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.345361 Aug 23 17:54:18.462029 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 433/904] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:18 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:18.518222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1056a62a-a499-4a79-9682-6e124b0e9591 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:18.518884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1056a62a-a499-4a79-9682-6e124b0e9591 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:18.526098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1056a62a-a499-4a79-9682-6e124b0e9591 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:18.526612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1056a62a-a499-4a79-9682-6e124b0e9591 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:18.527286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1056a62a-a499-4a79-9682-6e124b0e9591 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:18.528005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1056a62a-a499-4a79-9682-6e124b0e9591 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:18.528529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1056a62a-a499-4a79-9682-6e124b0e9591 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:18.528963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1056a62a-a499-4a79-9682-6e124b0e9591 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:18.556280 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e239fab5-81ab-491c-9caa-8c1278a7e9c2 tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "POST /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 85 microversion: 2.1 time: 0.376806 Aug 23 17:54:18.556978 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 472/905] 10.222.0.61 () {60 vars in 1281 bytes} [Tue Aug 23 17:54:18 2022] POST /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 85 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:54:18.566985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-007f84ef-9fec-469f-bebe-0c88153b231e tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] Calling method '.version_select at 0x7f27ecc0d0d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:18.607320 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-007f84ef-9fec-469f-bebe-0c88153b231e tempest-ImagesMetadataTestJSON-1030429117 tempest-ImagesMetadataTestJSON-1030429117-project] 10.222.0.61 "GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata" status: 200 len: 85 microversion: 2.1 time: 0.044546 Aug 23 17:54:18.607887 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 473/906] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Aug 23 17:54:18 2022] GET /compute/v2.1/images/07004198-27b0-4720-9f6b-d0752e9de378/metadata => generated 85 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 17:54:18.671719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e38a82f5-9577-44f1-b552-ebc529302b5e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:18.672342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e38a82f5-9577-44f1-b552-ebc529302b5e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:18.680364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e38a82f5-9577-44f1-b552-ebc529302b5e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:18.680864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e38a82f5-9577-44f1-b552-ebc529302b5e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:18.681306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e38a82f5-9577-44f1-b552-ebc529302b5e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:18.682019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e38a82f5-9577-44f1-b552-ebc529302b5e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:18.682480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e38a82f5-9577-44f1-b552-ebc529302b5e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:18.682935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e38a82f5-9577-44f1-b552-ebc529302b5e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:18.760466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1056a62a-a499-4a79-9682-6e124b0e9591 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:18.768016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e38a82f5-9577-44f1-b552-ebc529302b5e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:18.769750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1056a62a-a499-4a79-9682-6e124b0e9591 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:18.771693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1056a62a-a499-4a79-9682-6e124b0e9591 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:18.772815 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1056a62a-a499-4a79-9682-6e124b0e9591 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.259447 Aug 23 17:54:18.773370 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 434/907] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:18 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:54:18.781101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e38a82f5-9577-44f1-b552-ebc529302b5e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:18.783491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e38a82f5-9577-44f1-b552-ebc529302b5e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:18.784657 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e38a82f5-9577-44f1-b552-ebc529302b5e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1320 microversion: 2.25 time: 0.116888 Aug 23 17:54:18.803578 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 474/908] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:18 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1320 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:54:18.803744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0e3c4301-e23f-45b0-9485-dd13b495eadc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:18.804256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0e3c4301-e23f-45b0-9485-dd13b495eadc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:18.811494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e3c4301-e23f-45b0-9485-dd13b495eadc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:18.813086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e3c4301-e23f-45b0-9485-dd13b495eadc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:18.813086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e3c4301-e23f-45b0-9485-dd13b495eadc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:18.813786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e3c4301-e23f-45b0-9485-dd13b495eadc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:18.814235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e3c4301-e23f-45b0-9485-dd13b495eadc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:18.814854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e3c4301-e23f-45b0-9485-dd13b495eadc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:18.984098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-74557307-1f41-41b3-835e-56d0253b8e7d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:18.984788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-74557307-1f41-41b3-835e-56d0253b8e7d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:18.991950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74557307-1f41-41b3-835e-56d0253b8e7d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:18.992445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74557307-1f41-41b3-835e-56d0253b8e7d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:18.992888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74557307-1f41-41b3-835e-56d0253b8e7d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:18.993908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74557307-1f41-41b3-835e-56d0253b8e7d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:18.994378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74557307-1f41-41b3-835e-56d0253b8e7d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:18.994838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74557307-1f41-41b3-835e-56d0253b8e7d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:19.044274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0e3c4301-e23f-45b0-9485-dd13b495eadc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:19.057459 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0e3c4301-e23f-45b0-9485-dd13b495eadc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.258402 Aug 23 17:54:19.058184 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 435/909] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:18 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:19.151312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-74557307-1f41-41b3-835e-56d0253b8e7d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:19.159403 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-74557307-1f41-41b3-835e-56d0253b8e7d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1476 microversion: 2.1 time: 0.179239 Aug 23 17:54:19.160059 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 475/910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:18 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1476 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:19.199144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b08c46bf-df21-4914-a937-5a26dfc4edaf tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:19.199867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b08c46bf-df21-4914-a937-5a26dfc4edaf tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:19.208190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b08c46bf-df21-4914-a937-5a26dfc4edaf tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:19.208786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b08c46bf-df21-4914-a937-5a26dfc4edaf tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:19.209299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b08c46bf-df21-4914-a937-5a26dfc4edaf tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:19.210088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b08c46bf-df21-4914-a937-5a26dfc4edaf tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:19.210730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b08c46bf-df21-4914-a937-5a26dfc4edaf tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:19.211208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b08c46bf-df21-4914-a937-5a26dfc4edaf tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:19.460423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b08c46bf-df21-4914-a937-5a26dfc4edaf tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:19.469595 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b08c46bf-df21-4914-a937-5a26dfc4edaf tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.274307 Aug 23 17:54:19.470180 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 436/911] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:19 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:19.484763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-975194da-ce2e-44f1-9fe0-224ebde3351f tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:19.485443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-975194da-ce2e-44f1-9fe0-224ebde3351f tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:19.493598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-975194da-ce2e-44f1-9fe0-224ebde3351f tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:19.494088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-975194da-ce2e-44f1-9fe0-224ebde3351f tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:19.494526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-975194da-ce2e-44f1-9fe0-224ebde3351f tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:19.495381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-975194da-ce2e-44f1-9fe0-224ebde3351f tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:19.496009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-975194da-ce2e-44f1-9fe0-224ebde3351f tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:19.496432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-975194da-ce2e-44f1-9fe0-224ebde3351f tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:19.704852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-975194da-ce2e-44f1-9fe0-224ebde3351f tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:19.721986 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-975194da-ce2e-44f1-9fe0-224ebde3351f tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.241563 Aug 23 17:54:19.723509 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 476/912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:19 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:19.804382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-957e4a4c-b18d-439d-8a18-88278745723c tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:19.805933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-957e4a4c-b18d-439d-8a18-88278745723c tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:19.809976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-44b9f63a-44e6-4242-93fe-dbc83736face tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:19.810810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-44b9f63a-44e6-4242-93fe-dbc83736face tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:19.837202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44b9f63a-44e6-4242-93fe-dbc83736face tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:19.837719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44b9f63a-44e6-4242-93fe-dbc83736face tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:19.838175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44b9f63a-44e6-4242-93fe-dbc83736face tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:19.838880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44b9f63a-44e6-4242-93fe-dbc83736face tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:19.839337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44b9f63a-44e6-4242-93fe-dbc83736face tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:19.847554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-957e4a4c-b18d-439d-8a18-88278745723c tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:19.849470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-957e4a4c-b18d-439d-8a18-88278745723c tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:19.850388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-957e4a4c-b18d-439d-8a18-88278745723c tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:19.851816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44b9f63a-44e6-4242-93fe-dbc83736face tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:19.854272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-957e4a4c-b18d-439d-8a18-88278745723c tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:19.859722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-957e4a4c-b18d-439d-8a18-88278745723c tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:19.860463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-957e4a4c-b18d-439d-8a18-88278745723c tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:20.191444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-44b9f63a-44e6-4242-93fe-dbc83736face tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:20.201141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-44b9f63a-44e6-4242-93fe-dbc83736face tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:20.203507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-44b9f63a-44e6-4242-93fe-dbc83736face tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:20.204646 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-44b9f63a-44e6-4242-93fe-dbc83736face tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1362 microversion: 2.25 time: 0.399601 Aug 23 17:54:20.216684 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 477/913] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:19 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1362 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:20.216684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4511ed51-833b-4b47-88a4-6b5a88270568 req-1fb16b19-71eb-47b6-8dc2-510a4bb5581d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af054669-ae48-40f0-88d8-e163ab916c8c", "name": "network-vif-plugged", "status": "completed", "tag": "09a1fff1-1cd6-49a8-8af1-c239514e392e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:20.230266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4511ed51-833b-4b47-88a4-6b5a88270568 req-1fb16b19-71eb-47b6-8dc2-510a4bb5581d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:20.231174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4511ed51-833b-4b47-88a4-6b5a88270568 req-1fb16b19-71eb-47b6-8dc2-510a4bb5581d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:20.231794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4511ed51-833b-4b47-88a4-6b5a88270568 req-1fb16b19-71eb-47b6-8dc2-510a4bb5581d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:20.247545 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4511ed51-833b-4b47-88a4-6b5a88270568 req-1fb16b19-71eb-47b6-8dc2-510a4bb5581d service nova] Creating event network-vif-plugged:09a1fff1-1cd6-49a8-8af1-c239514e392e for instance af054669-ae48-40f0-88d8-e163ab916c8c on n-h1-850468-16 Aug 23 17:54:20.256099 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4511ed51-833b-4b47-88a4-6b5a88270568 req-1fb16b19-71eb-47b6-8dc2-510a4bb5581d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049247 Aug 23 17:54:20.256843 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 478/914] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:20.262803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-75fa0070-7130-4e0e-9048-47728d75e302 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:20.263514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-75fa0070-7130-4e0e-9048-47728d75e302 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:20.270867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75fa0070-7130-4e0e-9048-47728d75e302 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:20.271355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75fa0070-7130-4e0e-9048-47728d75e302 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:20.271786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75fa0070-7130-4e0e-9048-47728d75e302 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:20.272542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75fa0070-7130-4e0e-9048-47728d75e302 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:20.273150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75fa0070-7130-4e0e-9048-47728d75e302 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:20.273574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75fa0070-7130-4e0e-9048-47728d75e302 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:20.439392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-75fa0070-7130-4e0e-9048-47728d75e302 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:20.448656 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-75fa0070-7130-4e0e-9048-47728d75e302 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.190646 Aug 23 17:54:20.449439 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 479/915] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:20 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:20.455263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b8c0ee75-96b9-4172-be30-75c66fb59830 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:20.456064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b8c0ee75-96b9-4172-be30-75c66fb59830 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:20.476509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8c0ee75-96b9-4172-be30-75c66fb59830 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:20.477011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8c0ee75-96b9-4172-be30-75c66fb59830 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:20.477453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8c0ee75-96b9-4172-be30-75c66fb59830 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:20.478172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8c0ee75-96b9-4172-be30-75c66fb59830 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:20.479324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8c0ee75-96b9-4172-be30-75c66fb59830 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:20.479952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8c0ee75-96b9-4172-be30-75c66fb59830 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:20.547374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-957e4a4c-b18d-439d-8a18-88278745723c tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:20.557303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-957e4a4c-b18d-439d-8a18-88278745723c tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:20.560574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-957e4a4c-b18d-439d-8a18-88278745723c tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:20.561543 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-957e4a4c-b18d-439d-8a18-88278745723c tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.768216 Aug 23 17:54:20.568775 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 437/916] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:19 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:20.581306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6206595-d507-497e-8482-9013f1af80de tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:20.585431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6206595-d507-497e-8482-9013f1af80de tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:20.597422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6206595-d507-497e-8482-9013f1af80de tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:20.598004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6206595-d507-497e-8482-9013f1af80de tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:20.598512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6206595-d507-497e-8482-9013f1af80de tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:20.599347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6206595-d507-497e-8482-9013f1af80de tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:20.599871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6206595-d507-497e-8482-9013f1af80de tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:20.600357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6206595-d507-497e-8482-9013f1af80de tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:20.676217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b8c0ee75-96b9-4172-be30-75c66fb59830 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:20.684863 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b8c0ee75-96b9-4172-be30-75c66fb59830 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1474 microversion: 2.1 time: 0.234518 Aug 23 17:54:20.685575 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 480/917] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:20 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1474 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:20.696259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ab0ba455-0a5a-4886-8075-36f01fad1119 req-9f8fb11c-e82a-4f11-927d-9eecf2a0f110 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "21266578-6a91-43ab-9daf-38e646ac90c4", "tag": "3a03ba29-b382-4f61-bc36-18987e4b2089"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:20.706836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ab0ba455-0a5a-4886-8075-36f01fad1119 req-9f8fb11c-e82a-4f11-927d-9eecf2a0f110 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:20.707415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ab0ba455-0a5a-4886-8075-36f01fad1119 req-9f8fb11c-e82a-4f11-927d-9eecf2a0f110 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:20.707913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ab0ba455-0a5a-4886-8075-36f01fad1119 req-9f8fb11c-e82a-4f11-927d-9eecf2a0f110 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:20.720316 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ab0ba455-0a5a-4886-8075-36f01fad1119 req-9f8fb11c-e82a-4f11-927d-9eecf2a0f110 service nova] Creating event network-changed:3a03ba29-b382-4f61-bc36-18987e4b2089 for instance 21266578-6a91-43ab-9daf-38e646ac90c4 on n-h2-850468-16 Aug 23 17:54:20.725532 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ab0ba455-0a5a-4886-8075-36f01fad1119 req-9f8fb11c-e82a-4f11-927d-9eecf2a0f110 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038567 Aug 23 17:54:20.726431 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 481/918] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:20.746733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-59ffe0e2-2442-4de7-b2bf-b1db8d83e498 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:20.747557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-59ffe0e2-2442-4de7-b2bf-b1db8d83e498 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:20.754909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59ffe0e2-2442-4de7-b2bf-b1db8d83e498 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:20.755435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59ffe0e2-2442-4de7-b2bf-b1db8d83e498 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:20.756055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59ffe0e2-2442-4de7-b2bf-b1db8d83e498 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:20.756965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59ffe0e2-2442-4de7-b2bf-b1db8d83e498 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:20.757605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59ffe0e2-2442-4de7-b2bf-b1db8d83e498 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:20.758143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59ffe0e2-2442-4de7-b2bf-b1db8d83e498 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:20.852615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6206595-d507-497e-8482-9013f1af80de tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:20.861554 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6206595-d507-497e-8482-9013f1af80de tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.291676 Aug 23 17:54:20.862137 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 438/919] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:20 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:20.947121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-59ffe0e2-2442-4de7-b2bf-b1db8d83e498 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:20.956884 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-59ffe0e2-2442-4de7-b2bf-b1db8d83e498 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.215037 Aug 23 17:54:20.957589 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 482/920] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:20 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:21.076351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d652e1b4-d6c4-46d8-af67-e14748bce88a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Action: 'create', calling method: .version_select at 0x7f27ed2e94c0>, body: {"keypair": {"name": "tempest-keypair-1596214210", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNVeTrMLWV03fNUcJq73M6RrWxD1IB0Jwc5q6WGQmp2nO3YcVTcdFt/r5Y15KSG7dpZmCV5Hzw+gLngk73Fn0YwIO+D9vv8rrrXGGl10HyWUjBBWxn1fFtqkx9qPDOE7nA=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:21.097373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d652e1b4-d6c4-46d8-af67-e14748bce88a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Getting quotas for project ec269083262043d28603a16ec1600452. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:21.102153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d652e1b4-d6c4-46d8-af67-e14748bce88a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Getting quotas for user b056b39e8965411c966a5e7d1528322a and project ec269083262043d28603a16ec1600452. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:21.128009 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d652e1b4-d6c4-46d8-af67-e14748bce88a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.169817 Aug 23 17:54:21.128790 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 439/921] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:21.139016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8e6e2b41-5d6c-4882-baef-5f5b2f6090b9 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Calling method '.version_select at 0x7f27ecb5f700>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.148846 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8e6e2b41-5d6c-4882-baef-5f5b2f6090b9 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-1596214210" status: 200 len: 497 microversion: 2.1 time: 0.013639 Aug 23 17:54:21.149674 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 483/922] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Aug 23 17:54:21 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1596214210 => generated 497 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:21.161351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4cce0af1-b956-4c30-8c88-68c72f3adceb tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Calling method '.version_select at 0x7f27ec891c10>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.180480 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4cce0af1-b956-4c30-8c88-68c72f3adceb tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596214210" status: 202 len: 0 microversion: 2.1 time: 0.023091 Aug 23 17:54:21.181067 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 440/923] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 17:54:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1596214210 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:54:21.194991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aea7d423-7fac-4cd1-9b84-b442c9cb9310 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Action: 'create', calling method: .version_select at 0x7f27ecc0d4c0>, body: {"keypair": {"name": "tempest-keypair-1201829055", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBNsGlnLI+uR0vfLXzNNsbs8IW9nAskjzZr0/NI0mfzIwjPqH6nB+npGgzYoExrrg/nR+3iXi+MG1oCIe0eAFwEU8+dSJ1Z0mqNud0kkp7YCAznMLvRtp6GD/LJFGMPdng=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:21.211064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-aea7d423-7fac-4cd1-9b84-b442c9cb9310 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Getting quotas for project ec269083262043d28603a16ec1600452. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:21.217650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-aea7d423-7fac-4cd1-9b84-b442c9cb9310 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Getting quotas for user b056b39e8965411c966a5e7d1528322a and project ec269083262043d28603a16ec1600452. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:21.229620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4154673d-11a6-4c6c-9704-99edaf04b6c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.230564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4154673d-11a6-4c6c-9704-99edaf04b6c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:21.238396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4154673d-11a6-4c6c-9704-99edaf04b6c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:21.239021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4154673d-11a6-4c6c-9704-99edaf04b6c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:21.239551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4154673d-11a6-4c6c-9704-99edaf04b6c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:21.240359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4154673d-11a6-4c6c-9704-99edaf04b6c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:21.240983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4154673d-11a6-4c6c-9704-99edaf04b6c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:21.241349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4154673d-11a6-4c6c-9704-99edaf04b6c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:21.247357 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aea7d423-7fac-4cd1-9b84-b442c9cb9310 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056981 Aug 23 17:54:21.248815 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 484/924] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:21.259355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-40fda2ce-14e6-49cd-82e8-4bf31ef028bb tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Calling method '.version_select at 0x7f27ecb44af0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.290434 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-40fda2ce-14e6-49cd-82e8-4bf31ef028bb tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1201829055" status: 202 len: 0 microversion: 2.1 time: 0.035123 Aug 23 17:54:21.295042 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 485/925] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 17:54:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1201829055 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:54:21.304267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6ae64609-5d42-45f8-bc53-a0278f687b4a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Action: 'create', calling method: .version_select at 0x7f27ecb5f5e0>, body: {"keypair": {"name": "tempest-keypair-1645023073", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:21.324686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-6ae64609-5d42-45f8-bc53-a0278f687b4a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Getting quotas for project ec269083262043d28603a16ec1600452. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:21.330509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-6ae64609-5d42-45f8-bc53-a0278f687b4a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Getting quotas for user b056b39e8965411c966a5e7d1528322a and project ec269083262043d28603a16ec1600452. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:21.361942 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6ae64609-5d42-45f8-bc53-a0278f687b4a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 574 microversion: 2.1 time: 0.065263 Aug 23 17:54:21.362562 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 486/926] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:21 2022] POST /compute/v2.1/os-keypairs => generated 574 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:21.373043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ba866211-2e10-427a-9758-a5ba94837351 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Calling method '.version_select at 0x7f27ecb5fe50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.396346 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ba866211-2e10-427a-9758-a5ba94837351 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645023073" status: 202 len: 0 microversion: 2.1 time: 0.027102 Aug 23 17:54:21.397232 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 487/927] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 17:54:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645023073 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:54:21.410633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-28796597-1302-4224-9644-6d05c2b2990a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Action: 'create', calling method: .version_select at 0x7f27ecbdeee0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-273714961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA11YRLD2r8isTnJi/rmT0ntH3hMPlZ5oPuD8FdLrFwsl4Hmu8bv+bMndLpL1g65+C3iucXcAHC4C0TUzcoteYLoSy1cxIqJxo5XWPc8YWIxFfjMUdLnkZdW7xP/xUcCCQ=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:21.421898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4154673d-11a6-4c6c-9704-99edaf04b6c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:21.429049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-28796597-1302-4224-9644-6d05c2b2990a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Getting quotas for project ec269083262043d28603a16ec1600452. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:21.430007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4154673d-11a6-4c6c-9704-99edaf04b6c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:21.431747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4154673d-11a6-4c6c-9704-99edaf04b6c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:21.432844 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4154673d-11a6-4c6c-9704-99edaf04b6c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1362 microversion: 2.25 time: 0.207745 Aug 23 17:54:21.433404 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 441/928] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:21 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:21.433899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-28796597-1302-4224-9644-6d05c2b2990a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Getting quotas for user b056b39e8965411c966a5e7d1528322a and project ec269083262043d28603a16ec1600452. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:21.442440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=93,nova_api:DELETE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:21.460910 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-28796597-1302-4224-9644-6d05c2b2990a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.055846 Aug 23 17:54:21.461577 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 488/929] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:21 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:21.470260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-58d7ec9f-7313-401e-b940-1b83789c3740 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.470931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-58d7ec9f-7313-401e-b940-1b83789c3740 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:21.474889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0bafdb51-469c-43bb-a0d2-30766a9d7736 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Action: 'create', calling method: .version_select at 0x7f27ecb55f70>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-500028809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCNMm5LKlaZw4/tQS8zKBLiTtPp+4beskE9Arcy6uTEmnNKoFejzlJV6VyEB7PqX/s412Xn+OUgPK7SKfmNQPP4y545UJ3PgZVYbrFNkjhmzsCi68VuBk1D88yg474zTxA=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:21.476912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58d7ec9f-7313-401e-b940-1b83789c3740 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:21.477398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58d7ec9f-7313-401e-b940-1b83789c3740 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:21.477862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58d7ec9f-7313-401e-b940-1b83789c3740 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:21.478583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58d7ec9f-7313-401e-b940-1b83789c3740 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:21.479042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58d7ec9f-7313-401e-b940-1b83789c3740 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:21.479476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58d7ec9f-7313-401e-b940-1b83789c3740 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:21.491062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-0bafdb51-469c-43bb-a0d2-30766a9d7736 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Getting quotas for project ec269083262043d28603a16ec1600452. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:21.495877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-0bafdb51-469c-43bb-a0d2-30766a9d7736 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Getting quotas for user b056b39e8965411c966a5e7d1528322a and project ec269083262043d28603a16ec1600452. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:21.524592 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0bafdb51-469c-43bb-a0d2-30766a9d7736 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.053292 Aug 23 17:54:21.525335 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 489/930] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:21 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:54:21.538357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-210b929e-da81-4685-a2ae-3c2fce28eda2 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Action: 'create', calling method: .version_select at 0x7f27ecb5f8b0>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-833177358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLTalJjFXvLv106iyCUismziwE7rqvnwfShSLiYCDTgcsj0WDWcIXPZH5O+pqtLNgB43jKb0JjwDcz9YE+H3sWrQfvm6+BEaVWC+g4YA2pP0rkbGWllRDrKMRs3CrgYWug=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:21.554639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-210b929e-da81-4685-a2ae-3c2fce28eda2 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Getting quotas for project ec269083262043d28603a16ec1600452. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:21.559665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-210b929e-da81-4685-a2ae-3c2fce28eda2 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Getting quotas for user b056b39e8965411c966a5e7d1528322a and project ec269083262043d28603a16ec1600452. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:21.582422 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-210b929e-da81-4685-a2ae-3c2fce28eda2 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.047544 Aug 23 17:54:21.583213 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 490/931] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:21 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:54:21.591618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c881467-410d-433c-98be-5b104784eb18 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.592308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1c881467-410d-433c-98be-5b104784eb18 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:21.598881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c881467-410d-433c-98be-5b104784eb18 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:21.599361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c881467-410d-433c-98be-5b104784eb18 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:21.599792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c881467-410d-433c-98be-5b104784eb18 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:21.600480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c881467-410d-433c-98be-5b104784eb18 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:21.600953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c881467-410d-433c-98be-5b104784eb18 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:21.601374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c881467-410d-433c-98be-5b104784eb18 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:21.612480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-58d7ec9f-7313-401e-b940-1b83789c3740 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:21.620810 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-58d7ec9f-7313-401e-b940-1b83789c3740 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.155553 Aug 23 17:54:21.621416 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 442/932] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:21 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:21.637506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-39e49802-0836-48b7-9196-a0c6e5ebbf82 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Calling method '.version_select at 0x7f27ec891310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.642557 n-d-850468-16 devstack@n-api.service[128808]: WARNING oslo_db.sqlalchemy.utils [None req-39e49802-0836-48b7-9196-a0c6e5ebbf82 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 23 17:54:21.649379 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-39e49802-0836-48b7-9196-a0c6e5ebbf82 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 1091 microversion: 2.1 time: 0.027004 Aug 23 17:54:21.649941 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 443/933] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:54:21 2022] GET /compute/v2.1/os-keypairs => generated 1091 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:21.660640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d88d129-5444-4e69-9e8d-4e6397758274 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Calling method '.version_select at 0x7f27ec82b0d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.680435 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7d88d129-5444-4e69-9e8d-4e6397758274 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-833177358" status: 202 len: 0 microversion: 2.1 time: 0.023357 Aug 23 17:54:21.681003 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 444/934] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 17:54:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-833177358 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:54:21.689978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bcacef73-bdce-4c77-aef4-71539b52c29a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Calling method '.version_select at 0x7f27ec82b790>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.709983 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bcacef73-bdce-4c77-aef4-71539b52c29a tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-500028809" status: 202 len: 0 microversion: 2.1 time: 0.024549 Aug 23 17:54:21.714085 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 445/935] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 17:54:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-500028809 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:54:21.720081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d53be786-60bb-4943-8c67-8d5f875020b8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.720732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d53be786-60bb-4943-8c67-8d5f875020b8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:21.727522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d53be786-60bb-4943-8c67-8d5f875020b8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:21.728043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d53be786-60bb-4943-8c67-8d5f875020b8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:21.728499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d53be786-60bb-4943-8c67-8d5f875020b8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:21.729273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d53be786-60bb-4943-8c67-8d5f875020b8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:21.729722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d53be786-60bb-4943-8c67-8d5f875020b8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:21.730145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d53be786-60bb-4943-8c67-8d5f875020b8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:21.745650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1c881467-410d-433c-98be-5b104784eb18 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:21.754812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1c881467-410d-433c-98be-5b104784eb18 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:21.756311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1c881467-410d-433c-98be-5b104784eb18 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:21.757442 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c881467-410d-433c-98be-5b104784eb18 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.169910 Aug 23 17:54:21.758344 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 491/936] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:21 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:21.762968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-be2e43aa-2feb-47a3-bd5f-50cba6a7d3b9 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] Calling method '.version_select at 0x7f27ecb44310>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.784693 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-be2e43aa-2feb-47a3-bd5f-50cba6a7d3b9 tempest-KeyPairsV2TestJSON-197885541 tempest-KeyPairsV2TestJSON-197885541-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-273714961" status: 202 len: 0 microversion: 2.1 time: 0.025192 Aug 23 17:54:21.785278 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 492/937] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 17:54:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-273714961 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:54:21.875423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d53be786-60bb-4943-8c67-8d5f875020b8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:21.883497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e34c81e3-5385-4f21-a34b-65807787cc66 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.884252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e34c81e3-5385-4f21-a34b-65807787cc66 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:21.886371 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d53be786-60bb-4943-8c67-8d5f875020b8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1474 microversion: 2.1 time: 0.171179 Aug 23 17:54:21.886972 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 446/938] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:21 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1474 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:21.897766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e34c81e3-5385-4f21-a34b-65807787cc66 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:21.898422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e34c81e3-5385-4f21-a34b-65807787cc66 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:21.899287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e34c81e3-5385-4f21-a34b-65807787cc66 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:21.899683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e34c81e3-5385-4f21-a34b-65807787cc66 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:21.900467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e34c81e3-5385-4f21-a34b-65807787cc66 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:21.900925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e34c81e3-5385-4f21-a34b-65807787cc66 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:21.978939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2eeeeb63-8293-4119-b317-6619313882a9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:21.979461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2eeeeb63-8293-4119-b317-6619313882a9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:21.986268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2eeeeb63-8293-4119-b317-6619313882a9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:21.986926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2eeeeb63-8293-4119-b317-6619313882a9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:21.987455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2eeeeb63-8293-4119-b317-6619313882a9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:21.988253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2eeeeb63-8293-4119-b317-6619313882a9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:21.988867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2eeeeb63-8293-4119-b317-6619313882a9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:21.989391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2eeeeb63-8293-4119-b317-6619313882a9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:22.048838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e34c81e3-5385-4f21-a34b-65807787cc66 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:22.057394 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e34c81e3-5385-4f21-a34b-65807787cc66 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.178265 Aug 23 17:54:22.057959 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 493/939] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:21 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:22.130009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2eeeeb63-8293-4119-b317-6619313882a9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:22.137675 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2eeeeb63-8293-4119-b317-6619313882a9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.162843 Aug 23 17:54:22.138231 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 447/940] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:21 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:22.455960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1f5c7399-89b1-4945-b4df-8050945d0abf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:22.456980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1f5c7399-89b1-4945-b4df-8050945d0abf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:22.465594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f5c7399-89b1-4945-b4df-8050945d0abf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:22.466021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f5c7399-89b1-4945-b4df-8050945d0abf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:22.466473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f5c7399-89b1-4945-b4df-8050945d0abf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:22.467214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f5c7399-89b1-4945-b4df-8050945d0abf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:22.467682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f5c7399-89b1-4945-b4df-8050945d0abf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:22.468175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f5c7399-89b1-4945-b4df-8050945d0abf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:22.472370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:22.605232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1f5c7399-89b1-4945-b4df-8050945d0abf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:22.617367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1f5c7399-89b1-4945-b4df-8050945d0abf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:22.619895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1f5c7399-89b1-4945-b4df-8050945d0abf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:22.621380 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1f5c7399-89b1-4945-b4df-8050945d0abf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1362 microversion: 2.25 time: 0.170065 Aug 23 17:54:22.634658 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 494/941] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:22 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:22.649004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-809110c6-3d25-4ce1-93db-da91257fef56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:22.649715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-809110c6-3d25-4ce1-93db-da91257fef56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:22.655859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-809110c6-3d25-4ce1-93db-da91257fef56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:22.656479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-809110c6-3d25-4ce1-93db-da91257fef56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:22.657023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-809110c6-3d25-4ce1-93db-da91257fef56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:22.657823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-809110c6-3d25-4ce1-93db-da91257fef56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:22.658499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-809110c6-3d25-4ce1-93db-da91257fef56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:22.659015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-809110c6-3d25-4ce1-93db-da91257fef56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:22.781659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96d51909-f524-4a8c-915a-40609e94de51 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:22.783643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-96d51909-f524-4a8c-915a-40609e94de51 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:22.791229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96d51909-f524-4a8c-915a-40609e94de51 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:22.792048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96d51909-f524-4a8c-915a-40609e94de51 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:22.792656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96d51909-f524-4a8c-915a-40609e94de51 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:22.795064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96d51909-f524-4a8c-915a-40609e94de51 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:22.796717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96d51909-f524-4a8c-915a-40609e94de51 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:22.797840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96d51909-f524-4a8c-915a-40609e94de51 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:22.818360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-809110c6-3d25-4ce1-93db-da91257fef56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:22.827626 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-809110c6-3d25-4ce1-93db-da91257fef56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.190064 Aug 23 17:54:22.828910 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 448/942] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:22 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:22.908403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ba195c7-10a5-4aed-811b-afafedf27882 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:22.909080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2ba195c7-10a5-4aed-811b-afafedf27882 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:22.916961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ba195c7-10a5-4aed-811b-afafedf27882 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:22.917382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ba195c7-10a5-4aed-811b-afafedf27882 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:22.917810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ba195c7-10a5-4aed-811b-afafedf27882 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:22.918514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ba195c7-10a5-4aed-811b-afafedf27882 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:22.918989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ba195c7-10a5-4aed-811b-afafedf27882 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:22.922136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ba195c7-10a5-4aed-811b-afafedf27882 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:22.969967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-96d51909-f524-4a8c-915a-40609e94de51 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:22.980263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-96d51909-f524-4a8c-915a-40609e94de51 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:22.981770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-96d51909-f524-4a8c-915a-40609e94de51 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:22.982922 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-96d51909-f524-4a8c-915a-40609e94de51 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.205582 Aug 23 17:54:22.994580 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 495/943] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:22 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:54:22.994580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-30b1170c-f8e3-4baf-bba7-2f1bcc83c53f req-1605b5ba-9e0e-4b7b-b204-928fc70541be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c4d28d-309a-4458-9d1e-91ac80454833", "name": "network-vif-plugged", "status": "completed", "tag": "3fb7efac-faa0-444f-bf74-83a2d19ebc05"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:23.002260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-30b1170c-f8e3-4baf-bba7-2f1bcc83c53f req-1605b5ba-9e0e-4b7b-b204-928fc70541be service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:23.003049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-30b1170c-f8e3-4baf-bba7-2f1bcc83c53f req-1605b5ba-9e0e-4b7b-b204-928fc70541be service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:23.003588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-30b1170c-f8e3-4baf-bba7-2f1bcc83c53f req-1605b5ba-9e0e-4b7b-b204-928fc70541be service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:23.020032 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-30b1170c-f8e3-4baf-bba7-2f1bcc83c53f req-1605b5ba-9e0e-4b7b-b204-928fc70541be service nova] Creating event network-vif-plugged:3fb7efac-faa0-444f-bf74-83a2d19ebc05 for instance 13c4d28d-309a-4458-9d1e-91ac80454833 on n-h1-850468-16 Aug 23 17:54:23.025208 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-30b1170c-f8e3-4baf-bba7-2f1bcc83c53f req-1605b5ba-9e0e-4b7b-b204-928fc70541be service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038601 Aug 23 17:54:23.026134 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 496/944] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:23.083564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2ba195c7-10a5-4aed-811b-afafedf27882 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:23.085554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b6c13280-8a3b-4d34-846c-8b73c6f27884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:23.086279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b6c13280-8a3b-4d34-846c-8b73c6f27884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:23.094597 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2ba195c7-10a5-4aed-811b-afafedf27882 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1474 microversion: 2.1 time: 0.188176 Aug 23 17:54:23.094597 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 449/945] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:22 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1474 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:23.094984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6c13280-8a3b-4d34-846c-8b73c6f27884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:23.094984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6c13280-8a3b-4d34-846c-8b73c6f27884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:23.094984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6c13280-8a3b-4d34-846c-8b73c6f27884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:23.095787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6c13280-8a3b-4d34-846c-8b73c6f27884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:23.096173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6c13280-8a3b-4d34-846c-8b73c6f27884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:23.096551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6c13280-8a3b-4d34-846c-8b73c6f27884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:23.160752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-410e17e7-84dd-4f12-b41a-0de59d0c5036 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:23.161365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-410e17e7-84dd-4f12-b41a-0de59d0c5036 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:23.168323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-410e17e7-84dd-4f12-b41a-0de59d0c5036 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:23.168811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-410e17e7-84dd-4f12-b41a-0de59d0c5036 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:23.169439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-410e17e7-84dd-4f12-b41a-0de59d0c5036 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:23.170299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-410e17e7-84dd-4f12-b41a-0de59d0c5036 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:23.170802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-410e17e7-84dd-4f12-b41a-0de59d0c5036 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:23.172063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-410e17e7-84dd-4f12-b41a-0de59d0c5036 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:23.244634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b6c13280-8a3b-4d34-846c-8b73c6f27884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:23.252941 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b6c13280-8a3b-4d34-846c-8b73c6f27884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.174361 Aug 23 17:54:23.253520 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 497/946] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:23 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:23.304897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-410e17e7-84dd-4f12-b41a-0de59d0c5036 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:23.313392 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-410e17e7-84dd-4f12-b41a-0de59d0c5036 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.158053 Aug 23 17:54:23.313959 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 450/947] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:23 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:23.370477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6854e26a-05cb-4dff-b7cb-3f01cd01149b tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Action: 'create', calling method: .version_select at 0x7f27ecb55af0>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFnQ5RCVMV6nT0NYP0HWKoFvajfaM408Dfe8i3XlNp66hQdB6hnwg47G67wFZeHd0wX0XNxeKTix7P1dVHkF/kqsBQkQL6ebGyOUoisfLxpLiGr2eJSoe2WIfza+tiWeA=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6854e26a-05cb-4dff-b7cb-3f01cd01149b tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Request method failure captured: Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 257 Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRRP-ZSxiYvSxqZ6QZKGUpy6oyT0TR6EkDIeUwUsO6OBjuu0FQdMNZLTqEDL3pR6FrJq_b54X6ZEpoKVCvmBPNZ4AY35jaJ-oOfhlS4OTfM15dif-IeGv766-6-0sMKstYWi7i2irMNAf9Fz-6yCjfm9mU3NN5MzGa5gqBBiQXsDWzw Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}] Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFnQ5RCVMV6nT0NYP0HWKoFvajfaM408Dfe8i3XlNp66hQdB6hnwg47G67wFZeHd0wX0XNxeKTix7P1dVHkF/kqsBQkQL6ebGyOUoisfLxpLiGr2eJSoe2WIfza+tiWeA=="}} Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCFnQ5RCVMV6nT0NYP0HWKoFvajfaM408Dfe8i3XlNp66hQdB6hnwg47G67wFZeHd0wX0XNxeKTix7P1dVHkF/kqsBQkQL6ebGyOUoisfLxpLiGr2eJSoe2WIfza+tiWeA=='}}} Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'minLength': 1, Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Aug 23 17:54:23.374852 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6854e26a-05cb-4dff-b7cb-3f01cd01149b tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6854e26a-05cb-4dff-b7cb-3f01cd01149b tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.121763 Aug 23 17:54:23.379499 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 498/948] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:23 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 123 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:54:23.385997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4194599a-6334-43f1-bd91-cc5b6d5fce08 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Action: 'create', calling method: .version_select at 0x7f27ec87b040>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1530039143", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:23.396371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:23.404695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-4194599a-6334-43f1-bd91-cc5b6d5fce08 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Getting quotas for project 58f7be1c56ab4827860723aa45161d51. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:23.410473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-4194599a-6334-43f1-bd91-cc5b6d5fce08 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Getting quotas for user 47e603064f274dd68889495d29beaa63 and project 58f7be1c56ab4827860723aa45161d51. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:23.426620 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-4194599a-6334-43f1-bd91-cc5b6d5fce08 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4194599a-6334-43f1-bd91-cc5b6d5fce08 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Request method failure captured: Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 2167 Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRRP-ZSxiYvSxqZ6QZKGUpy6oyT0TR6EkDIeUwUsO6OBjuu0FQdMNZLTqEDL3pR6FrJq_b54X6ZEpoKVCvmBPNZ4AY35jaJ-oOfhlS4OTfM15dif-IeGv766-6-0sMKstYWi7i2irMNAf9Fz-6yCjfm9mU3NN5MzGa5gqBBiQXsDWzw Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}] Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1530039143", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:54:23.434907 n-d-850468-16 devstack@n-api.service[128808]: exception: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1530039143', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:23.437416 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4194599a-6334-43f1-bd91-cc5b6d5fce08 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4194599a-6334-43f1-bd91-cc5b6d5fce08 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.054441 Aug 23 17:54:23.440548 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 451/949] 10.222.0.61 () {60 vars in 1160 bytes} [Tue Aug 23 17:54:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 56 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:54:23.449009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e738f160-45f4-43df-8fe0-928dd4ad27f4 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Action: 'create', calling method: .version_select at 0x7f27ecb44430>, body: {"keypair": {"name": "tempest-keypair-647947485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCed7zZR1qF3BF++8hynO0u8+hr7tc9ntPk7Bd3UggcPlj/l+41dBVl0ANH6SoFysTFELkpLgQT3MsiZk9EkWU2zCj4DIIkO/mssROVTdBJeXjQnPbVwRx2j507ZQ0oZpg=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:23.465606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-e738f160-45f4-43df-8fe0-928dd4ad27f4 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Getting quotas for project 58f7be1c56ab4827860723aa45161d51. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:23.470991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-e738f160-45f4-43df-8fe0-928dd4ad27f4 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Getting quotas for user 47e603064f274dd68889495d29beaa63 and project 58f7be1c56ab4827860723aa45161d51. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:23.495493 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e738f160-45f4-43df-8fe0-928dd4ad27f4 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050260 Aug 23 17:54:23.496086 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 499/950] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:23.510175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-62aa0693-6631-4be1-9e49-5d9977e64ed4 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Action: 'create', calling method: .version_select at 0x7f27ec845af0>, body: {"keypair": {"name": "tempest-keypair-647947485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU04C9pKIK7R4/YsEGaaJ0OWVQacBGddTsuKYQSz3oxCkwA4k2w74hz1xLR9JH1QFchPl0ucTm0BYnXRQYaZq3T2a+oHOLmZUHMYCZD0g4sdXLuNJr+zdseGi1T8FkrhQ=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:23.527813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-62aa0693-6631-4be1-9e49-5d9977e64ed4 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Getting quotas for project 58f7be1c56ab4827860723aa45161d51. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:23.533826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-62aa0693-6631-4be1-9e49-5d9977e64ed4 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Getting quotas for user 47e603064f274dd68889495d29beaa63 and project 58f7be1c56ab4827860723aa45161d51. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:23.555935 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-62aa0693-6631-4be1-9e49-5d9977e64ed4 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] HTTP exception thrown: Key pair 'tempest-keypair-647947485' already exists. Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-62aa0693-6631-4be1-9e49-5d9977e64ed4 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Request method failure captured: Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 272 Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRRP-ZSxiYvSxqZ6QZKGUpy6oyT0TR6EkDIeUwUsO6OBjuu0FQdMNZLTqEDL3pR6FrJq_b54X6ZEpoKVCvmBPNZ4AY35jaJ-oOfhlS4OTfM15dif-IeGv766-6-0sMKstYWi7i2irMNAf9Fz-6yCjfm9mU3NN5MzGa5gqBBiQXsDWzw Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}] Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: {"keypair": {"name": "tempest-keypair-647947485", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU04C9pKIK7R4/YsEGaaJ0OWVQacBGddTsuKYQSz3oxCkwA4k2w74hz1xLR9JH1QFchPl0ucTm0BYnXRQYaZq3T2a+oHOLmZUHMYCZD0g4sdXLuNJr+zdseGi1T8FkrhQ=="}} Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: exception: Key pair 'tempest-keypair-647947485' already exists. Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-647947485', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU04C9pKIK7R4/YsEGaaJ0OWVQacBGddTsuKYQSz3oxCkwA4k2w74hz1xLR9JH1QFchPl0ucTm0BYnXRQYaZq3T2a+oHOLmZUHMYCZD0g4sdXLuNJr+zdseGi1T8FkrhQ=='}}} Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result.read() Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '47e603064f274dd68889495d29beaa63-tempest-keypair-647947485' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 23 17:54:23.559467 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi kp.save(context.session) Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi session.flush() Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._flush(objects) Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi compat.raise_( Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi flush_context.execute() Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi rec.execute(self) Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = self._query(query) Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi conn.query(q) Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result.read() Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Aug 23 17:54:23.564462 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '47e603064f274dd68889495d29beaa63-tempest-keypair-647947485' for key 'key_pairs.uniq_key_pairs0user_id0name'") Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 8, 23, 17, 54, 23, 549778), 'updated_at': None, 'name': 'tempest-keypair-647947485', 'user_id': '47e603064f274dd68889495d29beaa63', 'fingerprint': '51:ac:d6:2f:03:d6:dd:a0:fb:48:4b:23:e5:8a:32:74', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNU04C9pKIK7R4/YsEGaaJ0OWVQacBGddTsuKYQSz3oxCkwA4k2w74hz1xLR9JH1QFchPl0ucTm0BYnXRQYaZq3T2a+oHOLmZUHMYCZD0g4sdXLuNJr+zdseGi1T8FkrhQ==', 'type': 'ssh'}] Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6772, in import_key_pair Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi keypair.create() Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._create() Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-647947485' already exists. Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Aug 23 17:54:23.568323 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-647947485' already exists. Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-647947485' already exists. Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-62aa0693-6631-4be1-9e49-5d9977e64ed4 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Returning 409 to user: Key pair 'tempest-keypair-647947485' already exists. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-62aa0693-6631-4be1-9e49-5d9977e64ed4 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.055086 Aug 23 17:54:23.572830 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 452/951] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:23 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 56 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:54:23.573854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7388b643-6200-4f99-85f6-1b4c5005dc63 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Calling method '.version_select at 0x7f27ecb25790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:23.589115 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7388b643-6200-4f99-85f6-1b4c5005dc63 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-647947485" status: 202 len: 0 microversion: 2.1 time: 0.022574 Aug 23 17:54:23.589635 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 500/952] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Aug 23 17:54:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-647947485 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:54:23.602490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-229a76a1-18f0-4591-a73f-029bfbe3be3a tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Action: 'create', calling method: .version_select at 0x7f27ec8913a0>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEowj0Lf990hC3A50msWXP4r2O3AOSdNiyDRaloZMJptiTM+qjdJloUnP2BmUOqS4s+aq5mu//TS2vXS6EMpey3EhfrkMLTZvusPAcv7vQG0Cp/dGTbzGdKeKLCraqKEzQ=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-229a76a1-18f0-4591-a73f-029bfbe3be3a tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Request method failure captured: Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 247 Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRRP-ZSxiYvSxqZ6QZKGUpy6oyT0TR6EkDIeUwUsO6OBjuu0FQdMNZLTqEDL3pR6FrJq_b54X6ZEpoKVCvmBPNZ4AY35jaJ-oOfhlS4OTfM15dif-IeGv766-6-0sMKstYWi7i2irMNAf9Fz-6yCjfm9mU3NN5MzGa5gqBBiQXsDWzw Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}] Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEowj0Lf990hC3A50msWXP4r2O3AOSdNiyDRaloZMJptiTM+qjdJloUnP2BmUOqS4s+aq5mu//TS2vXS6EMpey3EhfrkMLTZvusPAcv7vQG0Cp/dGTbzGdKeKLCraqKEzQ=="}} Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEowj0Lf990hC3A50msWXP4r2O3AOSdNiyDRaloZMJptiTM+qjdJloUnP2BmUOqS4s+aq5mu//TS2vXS6EMpey3EhfrkMLTZvusPAcv7vQG0Cp/dGTbzGdKeKLCraqKEzQ=='}}} Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi '' Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:54:23.606262 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-229a76a1-18f0-4591-a73f-029bfbe3be3a tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-229a76a1-18f0-4591-a73f-029bfbe3be3a tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.009606 Aug 23 17:54:23.614438 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 453/953] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:23 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:54:23.620868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77a90143-2036-4086-8417-b7fdffd57956 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Action: 'create', calling method: .version_select at 0x7f27ecb5faf0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1059702205", "public_key": " "}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:23.638415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-77a90143-2036-4086-8417-b7fdffd57956 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Getting quotas for project 58f7be1c56ab4827860723aa45161d51. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:23.646629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-77a90143-2036-4086-8417-b7fdffd57956 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Getting quotas for user 47e603064f274dd68889495d29beaa63 and project 58f7be1c56ab4827860723aa45161d51. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:23.649168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fb4d9bb6-ebd2-4ee2-b774-bee55edcf9dd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:23.649778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fb4d9bb6-ebd2-4ee2-b774-bee55edcf9dd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:23.656823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb4d9bb6-ebd2-4ee2-b774-bee55edcf9dd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:23.657442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb4d9bb6-ebd2-4ee2-b774-bee55edcf9dd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:23.657881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb4d9bb6-ebd2-4ee2-b774-bee55edcf9dd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:23.658773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb4d9bb6-ebd2-4ee2-b774-bee55edcf9dd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:23.659351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb4d9bb6-ebd2-4ee2-b774-bee55edcf9dd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:23.659779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb4d9bb6-ebd2-4ee2-b774-bee55edcf9dd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:23.663146 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-77a90143-2036-4086-8417-b7fdffd57956 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77a90143-2036-4086-8417-b7fdffd57956 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Request method failure captured: Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 95 Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRRP-ZSxiYvSxqZ6QZKGUpy6oyT0TR6EkDIeUwUsO6OBjuu0FQdMNZLTqEDL3pR6FrJq_b54X6ZEpoKVCvmBPNZ4AY35jaJ-oOfhlS4OTfM15dif-IeGv766-6-0sMKstYWi7i2irMNAf9Fz-6yCjfm9mU3NN5MzGa5gqBBiQXsDWzw Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}] Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1059702205", "public_key": " "}} Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: exception: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1059702205', 'public_key': ' '}}} Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.665855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77a90143-2036-4086-8417-b7fdffd57956 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:23.670484 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-77a90143-2036-4086-8417-b7fdffd57956 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.051661 Aug 23 17:54:23.674690 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 501/954] 10.222.0.61 () {60 vars in 1158 bytes} [Tue Aug 23 17:54:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 61 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Aug 23 17:54:23.683399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-412c0c04-e299-4716-a86c-79ca5b661ad3 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Action: 'create', calling method: .version_select at 0x7f27ecb55ca0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxglvdjxA0XMRsdnxJUtIoReq8mCz9BdQkzxQbDLr6lMjIyHh3gxuqxcEU42ky66/o7W11IwB3UtKEbBLzZuDZ9TV8wZQ3aEJUA7Hb0x0MhmLAbEd1W3FriUvsMQEcwFg=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-412c0c04-e299-4716-a86c-79ca5b661ad3 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Request method failure captured: Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 507 Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRRP-ZSxiYvSxqZ6QZKGUpy6oyT0TR6EkDIeUwUsO6OBjuu0FQdMNZLTqEDL3pR6FrJq_b54X6ZEpoKVCvmBPNZ4AY35jaJ-oOfhlS4OTfM15dif-IeGv766-6-0sMKstYWi7i2irMNAf9Fz-6yCjfm9mU3NN5MzGa5gqBBiQXsDWzw Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}] Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxglvdjxA0XMRsdnxJUtIoReq8mCz9BdQkzxQbDLr6lMjIyHh3gxuqxcEU42ky66/o7W11IwB3UtKEbBLzZuDZ9TV8wZQ3aEJUA7Hb0x0MhmLAbEd1W3FriUvsMQEcwFg=="}} Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNxglvdjxA0XMRsdnxJUtIoReq8mCz9BdQkzxQbDLr6lMjIyHh3gxuqxcEU42ky66/o7W11IwB3UtKEbBLzZuDZ9TV8wZQ3aEJUA7Hb0x0MhmLAbEd1W3FriUvsMQEcwFg=='}}} Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['keypair']: Aug 23 17:54:23.687358 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Aug 23 17:54:23.690978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.695003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-412c0c04-e299-4716-a86c-79ca5b661ad3 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:23.695803 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-412c0c04-e299-4716-a86c-79ca5b661ad3 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.016215 Aug 23 17:54:23.696366 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 502/955] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:23 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 17 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:54:23.707397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96a613af-7f7f-4c7f-b9bb-0a7eb4a76709 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Action: 'create', calling method: .version_select at 0x7f27ecaf4550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1383769618", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:23.724421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-96a613af-7f7f-4c7f-b9bb-0a7eb4a76709 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Getting quotas for project 58f7be1c56ab4827860723aa45161d51. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:23.728867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-96a613af-7f7f-4c7f-b9bb-0a7eb4a76709 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Getting quotas for user 47e603064f274dd68889495d29beaa63 and project 58f7be1c56ab4827860723aa45161d51. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:23.745661 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-96a613af-7f7f-4c7f-b9bb-0a7eb4a76709 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96a613af-7f7f-4c7f-b9bb-0a7eb4a76709 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Request method failure captured: Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 118 Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRRP-ZSxiYvSxqZ6QZKGUpy6oyT0TR6EkDIeUwUsO6OBjuu0FQdMNZLTqEDL3pR6FrJq_b54X6ZEpoKVCvmBPNZ4AY35jaJ-oOfhlS4OTfM15dif-IeGv766-6-0sMKstYWi7i2irMNAf9Fz-6yCjfm9mU3NN5MzGa5gqBBiQXsDWzw Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}] Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1383769618", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: exception: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1383769618', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6769, in import_key_pair Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6842, in _generate_fingerprint Aug 23 17:54:23.747592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._create(req, body) Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96a613af-7f7f-4c7f-b9bb-0a7eb4a76709 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-96a613af-7f7f-4c7f-b9bb-0a7eb4a76709 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.045473 Aug 23 17:54:23.751755 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 503/956] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:23 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 17:54:23.758485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6929758b-7ae3-4280-93e1-aa07053cb7c0 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Calling method '.version_select at 0x7f27ecb5f820>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:23.770220 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-6929758b-7ae3-4280-93e1-aa07053cb7c0 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-879702464 not found for user 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6929758b-7ae3-4280-93e1-aa07053cb7c0 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Request method failure captured: Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-879702464 HTTP/1.1 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRRP-ZSxiYvSxqZ6QZKGUpy6oyT0TR6EkDIeUwUsO6OBjuu0FQdMNZLTqEDL3pR6FrJq_b54X6ZEpoKVCvmBPNZ4AY35jaJ-oOfhlS4OTfM15dif-IeGv766-6-0sMKstYWi7i2irMNAf9Fz-6yCjfm9mU3NN5MzGa5gqBBiQXsDWzw Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/58f7be1c56ab4827860723aa45161d51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/58f7be1c56ab4827860723aa45161d51"}]}] Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 58f7be1c56ab4827860723aa45161d51 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-406088096 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-KeyPairsNegativeTestJSON-406088096-project Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: exception: Keypair tempest-keypair-non-existent-879702464 not found for user 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'tempest-keypair-non-existent-879702464'} Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6856, in delete_key_pair Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6877, in get_key_pair Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-879702464 not found for user 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.772288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req, id) Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-879702464 not found for user 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-879702464 not found for user 47e603064f274dd68889495d29beaa63 Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6929758b-7ae3-4280-93e1-aa07053cb7c0 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] Returning 404 to user: Keypair tempest-keypair-non-existent-879702464 not found for user 47e603064f274dd68889495d29beaa63 {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6929758b-7ae3-4280-93e1-aa07053cb7c0 tempest-KeyPairsNegativeTestJSON-406088096 tempest-KeyPairsNegativeTestJSON-406088096-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-879702464" status: 404 len: 144 microversion: 2.1 time: 0.018899 Aug 23 17:54:23.776405 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 504/957] 10.222.0.61 () {58 vars in 1257 bytes} [Tue Aug 23 17:54:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-879702464 => generated 144 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:54:23.803267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb4d9bb6-ebd2-4ee2-b774-bee55edcf9dd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:23.807595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:23.816433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb4d9bb6-ebd2-4ee2-b774-bee55edcf9dd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:23.817970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb4d9bb6-ebd2-4ee2-b774-bee55edcf9dd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:23.819148 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fb4d9bb6-ebd2-4ee2-b774-bee55edcf9dd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1362 microversion: 2.25 time: 0.175326 Aug 23 17:54:23.819694 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 454/958] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:23 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:23.851547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b668e1e9-23e9-4406-adb3-dd1487892e02 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:23.851937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b668e1e9-23e9-4406-adb3-dd1487892e02 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:23.858103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b668e1e9-23e9-4406-adb3-dd1487892e02 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:23.859530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b668e1e9-23e9-4406-adb3-dd1487892e02 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:23.860321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b668e1e9-23e9-4406-adb3-dd1487892e02 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:23.861414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b668e1e9-23e9-4406-adb3-dd1487892e02 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:23.862041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b668e1e9-23e9-4406-adb3-dd1487892e02 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:23.862486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b668e1e9-23e9-4406-adb3-dd1487892e02 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:24.012879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d25e5fdd-c4ae-4ea4-8c23-1a4afc23c7fd tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:24.015488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d25e5fdd-c4ae-4ea4-8c23-1a4afc23c7fd tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:24.023749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d25e5fdd-c4ae-4ea4-8c23-1a4afc23c7fd tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:24.024597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d25e5fdd-c4ae-4ea4-8c23-1a4afc23c7fd tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:24.025283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d25e5fdd-c4ae-4ea4-8c23-1a4afc23c7fd tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:24.026245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d25e5fdd-c4ae-4ea4-8c23-1a4afc23c7fd tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:24.026951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d25e5fdd-c4ae-4ea4-8c23-1a4afc23c7fd tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:24.027587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d25e5fdd-c4ae-4ea4-8c23-1a4afc23c7fd tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:24.047890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b668e1e9-23e9-4406-adb3-dd1487892e02 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:24.055791 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b668e1e9-23e9-4406-adb3-dd1487892e02 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.209902 Aug 23 17:54:24.070186 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 505/959] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:23 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:24.115843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e9d4ba7-6b6d-40f1-aec9-8027e8b3bddc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:24.116497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4e9d4ba7-6b6d-40f1-aec9-8027e8b3bddc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:24.123366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e9d4ba7-6b6d-40f1-aec9-8027e8b3bddc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:24.124069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e9d4ba7-6b6d-40f1-aec9-8027e8b3bddc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:24.125664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e9d4ba7-6b6d-40f1-aec9-8027e8b3bddc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:24.126384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e9d4ba7-6b6d-40f1-aec9-8027e8b3bddc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:24.126982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e9d4ba7-6b6d-40f1-aec9-8027e8b3bddc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:24.127416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e9d4ba7-6b6d-40f1-aec9-8027e8b3bddc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:24.304260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d25e5fdd-c4ae-4ea4-8c23-1a4afc23c7fd tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:24.315388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d25e5fdd-c4ae-4ea4-8c23-1a4afc23c7fd tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:24.317040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d25e5fdd-c4ae-4ea4-8c23-1a4afc23c7fd tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:24.318317 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d25e5fdd-c4ae-4ea4-8c23-1a4afc23c7fd tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.312661 Aug 23 17:54:24.319409 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 455/960] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:24 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:54:24.325657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8b85fefe-5c12-4279-821a-9eb06cc6e1df tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:24.326726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8b85fefe-5c12-4279-821a-9eb06cc6e1df tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:24.339583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b85fefe-5c12-4279-821a-9eb06cc6e1df tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:24.341136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b85fefe-5c12-4279-821a-9eb06cc6e1df tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:24.341774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b85fefe-5c12-4279-821a-9eb06cc6e1df tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:24.345098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b85fefe-5c12-4279-821a-9eb06cc6e1df tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:24.345984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b85fefe-5c12-4279-821a-9eb06cc6e1df tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:24.346995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b85fefe-5c12-4279-821a-9eb06cc6e1df tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:24.399030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e9d4ba7-6b6d-40f1-aec9-8027e8b3bddc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:24.407617 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e9d4ba7-6b6d-40f1-aec9-8027e8b3bddc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1474 microversion: 2.1 time: 0.295759 Aug 23 17:54:24.420775 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 506/961] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:24 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1474 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:24.426584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7c30b020-86f6-4802-8c8c-1d3dd6a1e817 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:24.427329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7c30b020-86f6-4802-8c8c-1d3dd6a1e817 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:24.433378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c30b020-86f6-4802-8c8c-1d3dd6a1e817 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:24.434057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c30b020-86f6-4802-8c8c-1d3dd6a1e817 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:24.434502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c30b020-86f6-4802-8c8c-1d3dd6a1e817 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:24.435215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c30b020-86f6-4802-8c8c-1d3dd6a1e817 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:24.435821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c30b020-86f6-4802-8c8c-1d3dd6a1e817 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:24.436397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c30b020-86f6-4802-8c8c-1d3dd6a1e817 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:24.566165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8b85fefe-5c12-4279-821a-9eb06cc6e1df tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:24.575866 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8b85fefe-5c12-4279-821a-9eb06cc6e1df tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.254082 Aug 23 17:54:24.580033 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 456/962] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:24 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:24.660558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7c30b020-86f6-4802-8c8c-1d3dd6a1e817 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:24.669428 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7c30b020-86f6-4802-8c8c-1d3dd6a1e817 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.249175 Aug 23 17:54:24.670005 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 507/963] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:24 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:24.841307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f413824d-2bc4-4813-b136-cc4d2528103c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:24.841912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f413824d-2bc4-4813-b136-cc4d2528103c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:24.850459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f413824d-2bc4-4813-b136-cc4d2528103c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:24.851285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f413824d-2bc4-4813-b136-cc4d2528103c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:24.852025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f413824d-2bc4-4813-b136-cc4d2528103c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:24.852953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f413824d-2bc4-4813-b136-cc4d2528103c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:24.853656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f413824d-2bc4-4813-b136-cc4d2528103c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:24.854716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f413824d-2bc4-4813-b136-cc4d2528103c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:25.004047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f413824d-2bc4-4813-b136-cc4d2528103c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:25.013331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f413824d-2bc4-4813-b136-cc4d2528103c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:25.015604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f413824d-2bc4-4813-b136-cc4d2528103c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:25.017196 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f413824d-2bc4-4813-b136-cc4d2528103c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1362 microversion: 2.25 time: 0.179957 Aug 23 17:54:25.017953 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 457/964] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:24 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:25.077942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d706845-464c-40fe-8327-cc7f7d118665 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:25.078861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d706845-464c-40fe-8327-cc7f7d118665 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:25.087022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d706845-464c-40fe-8327-cc7f7d118665 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:25.087935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d706845-464c-40fe-8327-cc7f7d118665 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:25.088494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d706845-464c-40fe-8327-cc7f7d118665 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:25.089402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d706845-464c-40fe-8327-cc7f7d118665 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:25.089872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d706845-464c-40fe-8327-cc7f7d118665 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:25.090600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d706845-464c-40fe-8327-cc7f7d118665 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:25.234973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7d706845-464c-40fe-8327-cc7f7d118665 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:25.243535 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d706845-464c-40fe-8327-cc7f7d118665 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.170146 Aug 23 17:54:25.244106 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 508/965] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:25 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:25.345701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-61cc4642-9b92-4e26-9be5-0783c425785e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:25.346316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-61cc4642-9b92-4e26-9be5-0783c425785e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:25.352878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61cc4642-9b92-4e26-9be5-0783c425785e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:25.353372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61cc4642-9b92-4e26-9be5-0783c425785e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:25.353811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61cc4642-9b92-4e26-9be5-0783c425785e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:25.354528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61cc4642-9b92-4e26-9be5-0783c425785e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:25.354993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61cc4642-9b92-4e26-9be5-0783c425785e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:25.355419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61cc4642-9b92-4e26-9be5-0783c425785e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:25.428347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e720b146-9aa7-4930-91b4-bee5e40626b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:25.429753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e720b146-9aa7-4930-91b4-bee5e40626b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:25.435657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e720b146-9aa7-4930-91b4-bee5e40626b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:25.436141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e720b146-9aa7-4930-91b4-bee5e40626b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:25.437156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e720b146-9aa7-4930-91b4-bee5e40626b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:25.437908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e720b146-9aa7-4930-91b4-bee5e40626b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:25.438407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e720b146-9aa7-4930-91b4-bee5e40626b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:25.438856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e720b146-9aa7-4930-91b4-bee5e40626b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:25.507580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-61cc4642-9b92-4e26-9be5-0783c425785e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:25.523828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-61cc4642-9b92-4e26-9be5-0783c425785e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:25.525583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-61cc4642-9b92-4e26-9be5-0783c425785e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:25.526777 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-61cc4642-9b92-4e26-9be5-0783c425785e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.185135 Aug 23 17:54:25.527335 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 458/966] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:25 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:25.598067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f1608d0-36b6-4e87-83ce-90454d8b6528 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:25.598925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7f1608d0-36b6-4e87-83ce-90454d8b6528 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:25.606800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f1608d0-36b6-4e87-83ce-90454d8b6528 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:25.607599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f1608d0-36b6-4e87-83ce-90454d8b6528 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:25.608194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f1608d0-36b6-4e87-83ce-90454d8b6528 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:25.609771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f1608d0-36b6-4e87-83ce-90454d8b6528 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:25.610405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f1608d0-36b6-4e87-83ce-90454d8b6528 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:25.611005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f1608d0-36b6-4e87-83ce-90454d8b6528 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:25.669522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e720b146-9aa7-4930-91b4-bee5e40626b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:25.683088 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e720b146-9aa7-4930-91b4-bee5e40626b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1474 microversion: 2.1 time: 0.258288 Aug 23 17:54:25.684317 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 509/967] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:25 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1474 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:25.704011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-89cc31e8-efde-4fef-a17c-266a2ace0712 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:25.704943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-89cc31e8-efde-4fef-a17c-266a2ace0712 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:25.713018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89cc31e8-efde-4fef-a17c-266a2ace0712 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:25.713898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89cc31e8-efde-4fef-a17c-266a2ace0712 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:25.714808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89cc31e8-efde-4fef-a17c-266a2ace0712 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:25.715734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89cc31e8-efde-4fef-a17c-266a2ace0712 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:25.716349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89cc31e8-efde-4fef-a17c-266a2ace0712 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:25.718523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89cc31e8-efde-4fef-a17c-266a2ace0712 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:25.907915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7f1608d0-36b6-4e87-83ce-90454d8b6528 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:25.917595 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7f1608d0-36b6-4e87-83ce-90454d8b6528 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.323631 Aug 23 17:54:25.935743 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 459/968] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:25 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:25.941700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c4ad2a00-37a3-4024-beb8-4f580ecbc84b req-c24e591f-0a1e-4eb9-ab08-c88d200b0cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21266578-6a91-43ab-9daf-38e646ac90c4", "name": "network-vif-plugged", "status": "completed", "tag": "3a03ba29-b382-4f61-bc36-18987e4b2089"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:25.955754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c4ad2a00-37a3-4024-beb8-4f580ecbc84b req-c24e591f-0a1e-4eb9-ab08-c88d200b0cb3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:25.956461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c4ad2a00-37a3-4024-beb8-4f580ecbc84b req-c24e591f-0a1e-4eb9-ab08-c88d200b0cb3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:25.957119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c4ad2a00-37a3-4024-beb8-4f580ecbc84b req-c24e591f-0a1e-4eb9-ab08-c88d200b0cb3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:25.973730 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c4ad2a00-37a3-4024-beb8-4f580ecbc84b req-c24e591f-0a1e-4eb9-ab08-c88d200b0cb3 service nova] Creating event network-vif-plugged:3a03ba29-b382-4f61-bc36-18987e4b2089 for instance 21266578-6a91-43ab-9daf-38e646ac90c4 on n-h2-850468-16 Aug 23 17:54:25.980205 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c4ad2a00-37a3-4024-beb8-4f580ecbc84b req-c24e591f-0a1e-4eb9-ab08-c88d200b0cb3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042718 Aug 23 17:54:25.981220 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 460/969] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:26.038839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-89cc31e8-efde-4fef-a17c-266a2ace0712 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:26.044807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5959df7a-185e-45b3-a045-2bb05a5193f5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:26.045548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5959df7a-185e-45b3-a045-2bb05a5193f5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:26.048793 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-89cc31e8-efde-4fef-a17c-266a2ace0712 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1478 microversion: 2.1 time: 0.361121 Aug 23 17:54:26.053575 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 510/970] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:25 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1478 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:26.069235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5959df7a-185e-45b3-a045-2bb05a5193f5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:26.070997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5959df7a-185e-45b3-a045-2bb05a5193f5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:26.071614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5959df7a-185e-45b3-a045-2bb05a5193f5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:26.072677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5959df7a-185e-45b3-a045-2bb05a5193f5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:26.073293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5959df7a-185e-45b3-a045-2bb05a5193f5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:26.073988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5959df7a-185e-45b3-a045-2bb05a5193f5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:26.262850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:26.267652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-211b7737-eeef-41cd-9c6d-8f7945dc90cd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:26.268741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-211b7737-eeef-41cd-9c6d-8f7945dc90cd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:26.275300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-211b7737-eeef-41cd-9c6d-8f7945dc90cd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:26.275994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-211b7737-eeef-41cd-9c6d-8f7945dc90cd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:26.276589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-211b7737-eeef-41cd-9c6d-8f7945dc90cd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:26.277477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-211b7737-eeef-41cd-9c6d-8f7945dc90cd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:26.278125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-211b7737-eeef-41cd-9c6d-8f7945dc90cd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:26.278528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-211b7737-eeef-41cd-9c6d-8f7945dc90cd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:26.456893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5959df7a-185e-45b3-a045-2bb05a5193f5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:26.465890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5959df7a-185e-45b3-a045-2bb05a5193f5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:26.467976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5959df7a-185e-45b3-a045-2bb05a5193f5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:26.469665 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5959df7a-185e-45b3-a045-2bb05a5193f5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1362 microversion: 2.25 time: 0.431860 Aug 23 17:54:26.470777 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 461/971] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:26 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1362 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:54:26.551727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-211b7737-eeef-41cd-9c6d-8f7945dc90cd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:26.552833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b76bbbb-7865-4d6e-9224-3868081faa9e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:26.553466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b76bbbb-7865-4d6e-9224-3868081faa9e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:26.563739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b76bbbb-7865-4d6e-9224-3868081faa9e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:26.564368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b76bbbb-7865-4d6e-9224-3868081faa9e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:26.565929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b76bbbb-7865-4d6e-9224-3868081faa9e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:26.567024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b76bbbb-7865-4d6e-9224-3868081faa9e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:26.568050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b76bbbb-7865-4d6e-9224-3868081faa9e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:26.568768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b76bbbb-7865-4d6e-9224-3868081faa9e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:26.569542 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-211b7737-eeef-41cd-9c6d-8f7945dc90cd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.308687 Aug 23 17:54:26.571259 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 511/972] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:26 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:26.705963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-04679207-1a11-44ee-8493-f268cbd66523 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:26.706610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-04679207-1a11-44ee-8493-f268cbd66523 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:26.722476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04679207-1a11-44ee-8493-f268cbd66523 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:26.723089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04679207-1a11-44ee-8493-f268cbd66523 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:26.723426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04679207-1a11-44ee-8493-f268cbd66523 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:26.724197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04679207-1a11-44ee-8493-f268cbd66523 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:26.724660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04679207-1a11-44ee-8493-f268cbd66523 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:26.725410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04679207-1a11-44ee-8493-f268cbd66523 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:26.946579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b76bbbb-7865-4d6e-9224-3868081faa9e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:26.958647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b76bbbb-7865-4d6e-9224-3868081faa9e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:26.960828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b76bbbb-7865-4d6e-9224-3868081faa9e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:26.963618 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b76bbbb-7865-4d6e-9224-3868081faa9e tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1359 microversion: 2.21 time: 0.417216 Aug 23 17:54:26.964400 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 462/973] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:26 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1359 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:54:26.970317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f8fdb246-6c1e-4397-9e83-f5b1877d2aae tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:26.971253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f8fdb246-6c1e-4397-9e83-f5b1877d2aae tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:26.980684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8fdb246-6c1e-4397-9e83-f5b1877d2aae tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:26.981727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8fdb246-6c1e-4397-9e83-f5b1877d2aae tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:26.982396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8fdb246-6c1e-4397-9e83-f5b1877d2aae tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:26.985365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8fdb246-6c1e-4397-9e83-f5b1877d2aae tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:26.985902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8fdb246-6c1e-4397-9e83-f5b1877d2aae tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:26.986350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8fdb246-6c1e-4397-9e83-f5b1877d2aae tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:27.166046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-04679207-1a11-44ee-8493-f268cbd66523 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:27.183161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f8fdb246-6c1e-4397-9e83-f5b1877d2aae tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:27.191347 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-04679207-1a11-44ee-8493-f268cbd66523 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1471 microversion: 2.1 time: 0.484887 Aug 23 17:54:27.192069 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 512/974] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:26 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1471 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:27.199933 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f8fdb246-6c1e-4397-9e83-f5b1877d2aae tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.233034 Aug 23 17:54:27.213836 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 463/975] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:26 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:27.216456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ef5098dd-d9ba-4e09-99c1-32e693bf4b11 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:27.221570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ef5098dd-d9ba-4e09-99c1-32e693bf4b11 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:27.229030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7123ee5b-0fd9-44f3-9c78-9f5991943270 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:27.232357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef5098dd-d9ba-4e09-99c1-32e693bf4b11 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:27.232999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7123ee5b-0fd9-44f3-9c78-9f5991943270 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:27.236911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef5098dd-d9ba-4e09-99c1-32e693bf4b11 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:27.237362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef5098dd-d9ba-4e09-99c1-32e693bf4b11 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:27.238096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef5098dd-d9ba-4e09-99c1-32e693bf4b11 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:27.238591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef5098dd-d9ba-4e09-99c1-32e693bf4b11 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:27.239245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef5098dd-d9ba-4e09-99c1-32e693bf4b11 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:27.248412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7123ee5b-0fd9-44f3-9c78-9f5991943270 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:27.249018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7123ee5b-0fd9-44f3-9c78-9f5991943270 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:27.249677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7123ee5b-0fd9-44f3-9c78-9f5991943270 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:27.250523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7123ee5b-0fd9-44f3-9c78-9f5991943270 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:27.261259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7123ee5b-0fd9-44f3-9c78-9f5991943270 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:27.261735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7123ee5b-0fd9-44f3-9c78-9f5991943270 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:27.352215 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7123ee5b-0fd9-44f3-9c78-9f5991943270 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "POST /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4/action" status: 204 len: 0 microversion: 2.1 time: 0.136938 Aug 23 17:54:27.353056 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 464/976] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:54:27 2022] POST /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4/action => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:54:27.364695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3a27421f-30f9-4f73-8f16-b23e1ebe3daf tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:27.367076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3a27421f-30f9-4f73-8f16-b23e1ebe3daf tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:27.374622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a27421f-30f9-4f73-8f16-b23e1ebe3daf tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:27.375443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a27421f-30f9-4f73-8f16-b23e1ebe3daf tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:27.375851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a27421f-30f9-4f73-8f16-b23e1ebe3daf tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:27.376619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a27421f-30f9-4f73-8f16-b23e1ebe3daf tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:27.377024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a27421f-30f9-4f73-8f16-b23e1ebe3daf tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:27.377468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a27421f-30f9-4f73-8f16-b23e1ebe3daf tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:27.585845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ef5098dd-d9ba-4e09-99c1-32e693bf4b11 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:27.601263 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ef5098dd-d9ba-4e09-99c1-32e693bf4b11 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1463 microversion: 2.1 time: 0.407964 Aug 23 17:54:27.615435 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 513/977] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:27 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1463 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:27.628054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-88f12aa2-0644-427b-86c7-acccfa8f8a24 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:27.630762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-88f12aa2-0644-427b-86c7-acccfa8f8a24 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:27.635502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:DELETE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:27.639425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88f12aa2-0644-427b-86c7-acccfa8f8a24 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:27.640425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88f12aa2-0644-427b-86c7-acccfa8f8a24 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:27.641015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88f12aa2-0644-427b-86c7-acccfa8f8a24 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:27.641907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88f12aa2-0644-427b-86c7-acccfa8f8a24 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:27.642516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88f12aa2-0644-427b-86c7-acccfa8f8a24 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:27.643110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88f12aa2-0644-427b-86c7-acccfa8f8a24 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:27.813648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3a27421f-30f9-4f73-8f16-b23e1ebe3daf tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:27.821631 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3a27421f-30f9-4f73-8f16-b23e1ebe3daf tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1471 microversion: 2.1 time: 0.464284 Aug 23 17:54:27.822421 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 465/978] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:27 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1471 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:27.828335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eee6eb34-ae87-46fe-b377-950f83bfd83d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:27.829363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eee6eb34-ae87-46fe-b377-950f83bfd83d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:27.848341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eee6eb34-ae87-46fe-b377-950f83bfd83d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:27.849089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eee6eb34-ae87-46fe-b377-950f83bfd83d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:27.854795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eee6eb34-ae87-46fe-b377-950f83bfd83d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:27.855819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eee6eb34-ae87-46fe-b377-950f83bfd83d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:27.856511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eee6eb34-ae87-46fe-b377-950f83bfd83d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:27.859733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eee6eb34-ae87-46fe-b377-950f83bfd83d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.036728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-88f12aa2-0644-427b-86c7-acccfa8f8a24 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:28.047954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-88f12aa2-0644-427b-86c7-acccfa8f8a24 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:28.049889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-88f12aa2-0644-427b-86c7-acccfa8f8a24 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:28.052778 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-88f12aa2-0644-427b-86c7-acccfa8f8a24 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1362 microversion: 2.25 time: 0.435361 Aug 23 17:54:28.053545 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 514/979] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:27 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1362 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:28.058692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c06dea8a-91c4-4215-bb45-9999d47faea9 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:28.061247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c06dea8a-91c4-4215-bb45-9999d47faea9 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:28.069858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06dea8a-91c4-4215-bb45-9999d47faea9 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:28.070767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06dea8a-91c4-4215-bb45-9999d47faea9 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:28.071066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06dea8a-91c4-4215-bb45-9999d47faea9 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.071875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06dea8a-91c4-4215-bb45-9999d47faea9 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:28.072328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06dea8a-91c4-4215-bb45-9999d47faea9 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:28.072960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06dea8a-91c4-4215-bb45-9999d47faea9 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.159310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eee6eb34-ae87-46fe-b377-950f83bfd83d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:28.169517 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eee6eb34-ae87-46fe-b377-950f83bfd83d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.345579 Aug 23 17:54:28.170117 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 466/980] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:27 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:28.178688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-72e95541-9c4b-4bff-af70-7901f57d1779 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:28.180287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-72e95541-9c4b-4bff-af70-7901f57d1779 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:28.208343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72e95541-9c4b-4bff-af70-7901f57d1779 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:28.209573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72e95541-9c4b-4bff-af70-7901f57d1779 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:28.210943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72e95541-9c4b-4bff-af70-7901f57d1779 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.212089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72e95541-9c4b-4bff-af70-7901f57d1779 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:28.212347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72e95541-9c4b-4bff-af70-7901f57d1779 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:28.213463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72e95541-9c4b-4bff-af70-7901f57d1779 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.222767 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c06dea8a-91c4-4215-bb45-9999d47faea9 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action" status: 202 len: 0 microversion: 2.1 time: 0.167934 Aug 23 17:54:28.223694 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 515/981] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:54:28 2022] POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:54:28.229415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ec8527ce-6d16-4755-a328-19e444003d27 req-c0cbee8a-efaa-420f-80bf-0d9293142d63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4", "name": "network-vif-plugged", "status": "completed", "tag": "ee6fb24a-f8ec-4d67-b529-6a7b42386fd6"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:28.242500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ec8527ce-6d16-4755-a328-19e444003d27 req-c0cbee8a-efaa-420f-80bf-0d9293142d63 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:28.244062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ec8527ce-6d16-4755-a328-19e444003d27 req-c0cbee8a-efaa-420f-80bf-0d9293142d63 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:28.244701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ec8527ce-6d16-4755-a328-19e444003d27 req-c0cbee8a-efaa-420f-80bf-0d9293142d63 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.261091 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ec8527ce-6d16-4755-a328-19e444003d27 req-c0cbee8a-efaa-420f-80bf-0d9293142d63 service nova] Creating event network-vif-plugged:ee6fb24a-f8ec-4d67-b529-6a7b42386fd6 for instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 on n-h1-850468-16 Aug 23 17:54:28.267524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-ec8527ce-6d16-4755-a328-19e444003d27 req-c0cbee8a-efaa-420f-80bf-0d9293142d63 service nova] Instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 17:54:28.280500 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ec8527ce-6d16-4755-a328-19e444003d27 req-c0cbee8a-efaa-420f-80bf-0d9293142d63 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055036 Aug 23 17:54:28.281343 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 516/982] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:28.287811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f0ee1e90-23a8-4cd0-a3f7-74ec7e6c6093 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:28.288727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f0ee1e90-23a8-4cd0-a3f7-74ec7e6c6093 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:28.295158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0ee1e90-23a8-4cd0-a3f7-74ec7e6c6093 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:28.295645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0ee1e90-23a8-4cd0-a3f7-74ec7e6c6093 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:28.296144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0ee1e90-23a8-4cd0-a3f7-74ec7e6c6093 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.296857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0ee1e90-23a8-4cd0-a3f7-74ec7e6c6093 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:28.297309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0ee1e90-23a8-4cd0-a3f7-74ec7e6c6093 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:28.297737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0ee1e90-23a8-4cd0-a3f7-74ec7e6c6093 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.314881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:28.516345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-72e95541-9c4b-4bff-af70-7901f57d1779 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:28.525842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-72e95541-9c4b-4bff-af70-7901f57d1779 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:28.527838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-72e95541-9c4b-4bff-af70-7901f57d1779 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:28.529060 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-72e95541-9c4b-4bff-af70-7901f57d1779 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1553 microversion: 2.21 time: 0.357130 Aug 23 17:54:28.531131 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 467/983] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:28 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1553 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:28.536028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:28.536757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:28.559980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:28.571402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:28.572130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.573277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:28.574080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:28.574727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.615445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:28.616342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:28.617003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.617711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lazy-loading 'fault' on Instance uuid 69a4f4f5-5f3a-4907-a471-005e1f790e8b {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:54:28.822208 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-81fa9713-46f1-48de-9dd1-0db585d37eca tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1599 microversion: 2.1 time: 0.289701 Aug 23 17:54:28.835597 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 468/984] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:28 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1599 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:28.841418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c1ba72a1-7577-4e78-bb41-bca4e27a4a46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:28.842129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c1ba72a1-7577-4e78-bb41-bca4e27a4a46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:28.859759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1ba72a1-7577-4e78-bb41-bca4e27a4a46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:28.860721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1ba72a1-7577-4e78-bb41-bca4e27a4a46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:28.861459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1ba72a1-7577-4e78-bb41-bca4e27a4a46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.862338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1ba72a1-7577-4e78-bb41-bca4e27a4a46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:28.862977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1ba72a1-7577-4e78-bb41-bca4e27a4a46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:28.863563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1ba72a1-7577-4e78-bb41-bca4e27a4a46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:28.921383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c1ba72a1-7577-4e78-bb41-bca4e27a4a46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:54:29.000437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:29.022060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f0ee1e90-23a8-4cd0-a3f7-74ec7e6c6093 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:29.031080 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f0ee1e90-23a8-4cd0-a3f7-74ec7e6c6093 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1367 microversion: 2.1 time: 0.748079 Aug 23 17:54:29.031665 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 517/985] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:28 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1367 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:29.047049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1e2b5c91-d819-46dd-aad1-a268c5856f69 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:29.047969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1e2b5c91-d819-46dd-aad1-a268c5856f69 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:29.057796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e2b5c91-d819-46dd-aad1-a268c5856f69 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.058708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e2b5c91-d819-46dd-aad1-a268c5856f69 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.059373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e2b5c91-d819-46dd-aad1-a268c5856f69 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.063324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e2b5c91-d819-46dd-aad1-a268c5856f69 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.064052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e2b5c91-d819-46dd-aad1-a268c5856f69 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.064706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e2b5c91-d819-46dd-aad1-a268c5856f69 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.099508 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c1ba72a1-7577-4e78-bb41-bca4e27a4a46 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "DELETE /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 204 len: 0 microversion: 2.21 time: 0.261940 Aug 23 17:54:29.105091 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 469/986] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:54:28 2022] DELETE /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:54:29.110955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b396b3d8-cb54-4b6f-86a5-9e5ef9159326 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:29.126357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b396b3d8-cb54-4b6f-86a5-9e5ef9159326 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:29.135703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b396b3d8-cb54-4b6f-86a5-9e5ef9159326 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.138083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b396b3d8-cb54-4b6f-86a5-9e5ef9159326 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.138577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b396b3d8-cb54-4b6f-86a5-9e5ef9159326 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.139608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b396b3d8-cb54-4b6f-86a5-9e5ef9159326 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.140750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b396b3d8-cb54-4b6f-86a5-9e5ef9159326 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.141496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b396b3d8-cb54-4b6f-86a5-9e5ef9159326 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.254093 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b396b3d8-cb54-4b6f-86a5-9e5ef9159326 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action" status: 202 len: 0 microversion: 2.1 time: 0.147449 Aug 23 17:54:29.254760 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 470/987] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:54:29 2022] POST /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b/action => generated 0 bytes in 149 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:54:29.264112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-014bcb00-c6c8-4b37-a453-78343dfd43fe tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:29.264936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-014bcb00-c6c8-4b37-a453-78343dfd43fe tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:29.271721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-014bcb00-c6c8-4b37-a453-78343dfd43fe tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.272219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-014bcb00-c6c8-4b37-a453-78343dfd43fe tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.272743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-014bcb00-c6c8-4b37-a453-78343dfd43fe tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.273457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-014bcb00-c6c8-4b37-a453-78343dfd43fe tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.273911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-014bcb00-c6c8-4b37-a453-78343dfd43fe tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.274333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-014bcb00-c6c8-4b37-a453-78343dfd43fe tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.424031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1e2b5c91-d819-46dd-aad1-a268c5856f69 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:29.441304 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1e2b5c91-d819-46dd-aad1-a268c5856f69 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1471 microversion: 2.1 time: 0.408182 Aug 23 17:54:29.443202 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 518/988] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:29 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1471 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:29.448496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7afd4b3d-81e2-4b98-8825-8203fd8d00d5 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:29.449979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7afd4b3d-81e2-4b98-8825-8203fd8d00d5 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:29.472977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7afd4b3d-81e2-4b98-8825-8203fd8d00d5 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.475667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-014bcb00-c6c8-4b37-a453-78343dfd43fe tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:29.482468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7afd4b3d-81e2-4b98-8825-8203fd8d00d5 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.483243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7afd4b3d-81e2-4b98-8825-8203fd8d00d5 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.484148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7afd4b3d-81e2-4b98-8825-8203fd8d00d5 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.484704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7afd4b3d-81e2-4b98-8825-8203fd8d00d5 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.485643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-014bcb00-c6c8-4b37-a453-78343dfd43fe tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:29.486223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7afd4b3d-81e2-4b98-8825-8203fd8d00d5 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.487299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-014bcb00-c6c8-4b37-a453-78343dfd43fe tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:29.488492 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-014bcb00-c6c8-4b37-a453-78343dfd43fe tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1557 microversion: 2.25 time: 0.230149 Aug 23 17:54:29.489048 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 471/989] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:29 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1557 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:29.495448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e4d799de-edcf-4788-81d4-1de90f3ce6fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:29.496057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e4d799de-edcf-4788-81d4-1de90f3ce6fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:29.502161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4d799de-edcf-4788-81d4-1de90f3ce6fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.502976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4d799de-edcf-4788-81d4-1de90f3ce6fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.503413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4d799de-edcf-4788-81d4-1de90f3ce6fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.504453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4d799de-edcf-4788-81d4-1de90f3ce6fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.504632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4d799de-edcf-4788-81d4-1de90f3ce6fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.505057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4d799de-edcf-4788-81d4-1de90f3ce6fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.730034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e4d799de-edcf-4788-81d4-1de90f3ce6fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:29.739127 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e4d799de-edcf-4788-81d4-1de90f3ce6fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.248937 Aug 23 17:54:29.746601 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 472/990] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:29 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:29.746601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-864019ff-ed6a-4b8c-8e92-8c36cdb7d625 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:29.746601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-864019ff-ed6a-4b8c-8e92-8c36cdb7d625 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:29.755735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-864019ff-ed6a-4b8c-8e92-8c36cdb7d625 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.756372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-864019ff-ed6a-4b8c-8e92-8c36cdb7d625 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.756895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-864019ff-ed6a-4b8c-8e92-8c36cdb7d625 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.757614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-864019ff-ed6a-4b8c-8e92-8c36cdb7d625 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.758242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-864019ff-ed6a-4b8c-8e92-8c36cdb7d625 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.758706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-864019ff-ed6a-4b8c-8e92-8c36cdb7d625 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.759418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7afd4b3d-81e2-4b98-8825-8203fd8d00d5 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:29.769719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7afd4b3d-81e2-4b98-8825-8203fd8d00d5 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:29.771661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7afd4b3d-81e2-4b98-8825-8203fd8d00d5 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:29.772940 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7afd4b3d-81e2-4b98-8825-8203fd8d00d5 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1559 microversion: 2.21 time: 0.328463 Aug 23 17:54:29.773677 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 519/991] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:29 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1559 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:29.779627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b7678e80-6ebd-4a86-ae17-c409fe5e2179 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:29.780719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b7678e80-6ebd-4a86-ae17-c409fe5e2179 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:29.787275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7678e80-6ebd-4a86-ae17-c409fe5e2179 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.788035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7678e80-6ebd-4a86-ae17-c409fe5e2179 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.788683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7678e80-6ebd-4a86-ae17-c409fe5e2179 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.789618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7678e80-6ebd-4a86-ae17-c409fe5e2179 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.790269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7678e80-6ebd-4a86-ae17-c409fe5e2179 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.790788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7678e80-6ebd-4a86-ae17-c409fe5e2179 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.912658 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-864019ff-ed6a-4b8c-8e92-8c36cdb7d625 tempest-ServersAdminTestJSON-404680717 tempest-ServersAdminTestJSON-404680717-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1616 microversion: 2.1 time: 0.171883 Aug 23 17:54:29.913358 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 473/992] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:29 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1616 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:29.935147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cccca890-7ec8-43ea-9f89-35f1d829cab3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:29.935657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cccca890-7ec8-43ea-9f89-35f1d829cab3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:29.942121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cccca890-7ec8-43ea-9f89-35f1d829cab3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.942703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cccca890-7ec8-43ea-9f89-35f1d829cab3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.943137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cccca890-7ec8-43ea-9f89-35f1d829cab3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.943898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cccca890-7ec8-43ea-9f89-35f1d829cab3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:29.944382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cccca890-7ec8-43ea-9f89-35f1d829cab3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:29.944860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cccca890-7ec8-43ea-9f89-35f1d829cab3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:29.993693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-b7678e80-6ebd-4a86-ae17-c409fe5e2179 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid 21266578-6a91-43ab-9daf-38e646ac90c4 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:54:29.996627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cccca890-7ec8-43ea-9f89-35f1d829cab3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:54:30.008301 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b7678e80-6ebd-4a86-ae17-c409fe5e2179 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 2052 microversion: 2.25 time: 0.231962 Aug 23 17:54:30.008940 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 520/993] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:29 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 2052 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:30.032653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56b09e1b-ab9a-4ca9-b68d-24d1fbcacbbf tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:30.034487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-56b09e1b-ab9a-4ca9-b68d-24d1fbcacbbf tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:30.041852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56b09e1b-ab9a-4ca9-b68d-24d1fbcacbbf tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.042631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56b09e1b-ab9a-4ca9-b68d-24d1fbcacbbf tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.043327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56b09e1b-ab9a-4ca9-b68d-24d1fbcacbbf tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.044523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56b09e1b-ab9a-4ca9-b68d-24d1fbcacbbf tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.045403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56b09e1b-ab9a-4ca9-b68d-24d1fbcacbbf tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.046998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56b09e1b-ab9a-4ca9-b68d-24d1fbcacbbf tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.160373 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cccca890-7ec8-43ea-9f89-35f1d829cab3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 204 len: 0 microversion: 2.1 time: 0.229720 Aug 23 17:54:30.161154 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 474/994] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:54:29 2022] DELETE /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 17:54:30.166144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-65cfa62b-d8cf-464b-807a-7d8067deb00a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:30.167716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-65cfa62b-d8cf-464b-807a-7d8067deb00a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:30.181888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65cfa62b-d8cf-464b-807a-7d8067deb00a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.182934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65cfa62b-d8cf-464b-807a-7d8067deb00a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.183542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65cfa62b-d8cf-464b-807a-7d8067deb00a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.184447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65cfa62b-d8cf-464b-807a-7d8067deb00a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.185084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65cfa62b-d8cf-464b-807a-7d8067deb00a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.185731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65cfa62b-d8cf-464b-807a-7d8067deb00a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.250275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-56b09e1b-ab9a-4ca9-b68d-24d1fbcacbbf tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid 21266578-6a91-43ab-9daf-38e646ac90c4 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:54:30.267086 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-56b09e1b-ab9a-4ca9-b68d-24d1fbcacbbf tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 2052 microversion: 2.25 time: 0.239258 Aug 23 17:54:30.279696 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 521/995] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:30 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 2052 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:30.293996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd2896eb-3b2d-46d5-8fb9-c6ee17702c42 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:30.294930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd2896eb-3b2d-46d5-8fb9-c6ee17702c42 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:30.304302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd2896eb-3b2d-46d5-8fb9-c6ee17702c42 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.305054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd2896eb-3b2d-46d5-8fb9-c6ee17702c42 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.305836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd2896eb-3b2d-46d5-8fb9-c6ee17702c42 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.306913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd2896eb-3b2d-46d5-8fb9-c6ee17702c42 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.307582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd2896eb-3b2d-46d5-8fb9-c6ee17702c42 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.308261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd2896eb-3b2d-46d5-8fb9-c6ee17702c42 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.497021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bd2896eb-3b2d-46d5-8fb9-c6ee17702c42 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:30.505479 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd2896eb-3b2d-46d5-8fb9-c6ee17702c42 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1469 microversion: 2.1 time: 0.216673 Aug 23 17:54:30.506308 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 522/996] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:30 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1469 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:30.521057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49b31ee0-0962-4167-8d7d-3de583eba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:30.523999 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:54:30.523999 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:54:30.525257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49b31ee0-0962-4167-8d7d-3de583eba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.525950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49b31ee0-0962-4167-8d7d-3de583eba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.526389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49b31ee0-0962-4167-8d7d-3de583eba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.527312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49b31ee0-0962-4167-8d7d-3de583eba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.527801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49b31ee0-0962-4167-8d7d-3de583eba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.528321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49b31ee0-0962-4167-8d7d-3de583eba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.555609 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49b31ee0-0962-4167-8d7d-3de583eba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.038746 Aug 23 17:54:30.556519 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 523/997] 10.222.0.61 () {60 vars in 1217 bytes} [Tue Aug 23 17:54:30 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:54:30.565348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc50cedc-a7e6-49d3-8bfc-df358e5bbc35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:30.565799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc50cedc-a7e6-49d3-8bfc-df358e5bbc35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:30.572858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc50cedc-a7e6-49d3-8bfc-df358e5bbc35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.573338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc50cedc-a7e6-49d3-8bfc-df358e5bbc35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.573972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc50cedc-a7e6-49d3-8bfc-df358e5bbc35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.574866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc50cedc-a7e6-49d3-8bfc-df358e5bbc35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.575498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc50cedc-a7e6-49d3-8bfc-df358e5bbc35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.576070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc50cedc-a7e6-49d3-8bfc-df358e5bbc35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.720472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bc50cedc-a7e6-49d3-8bfc-df358e5bbc35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:30.728865 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc50cedc-a7e6-49d3-8bfc-df358e5bbc35 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1463 microversion: 2.1 time: 0.170799 Aug 23 17:54:30.729214 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 524/998] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:30 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1463 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:30.734038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b19ef0d0-afbd-48e9-a75f-4b0e89793e9e tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:30.734713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b19ef0d0-afbd-48e9-a75f-4b0e89793e9e tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:30.741851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b19ef0d0-afbd-48e9-a75f-4b0e89793e9e tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.742272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b19ef0d0-afbd-48e9-a75f-4b0e89793e9e tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.742745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b19ef0d0-afbd-48e9-a75f-4b0e89793e9e tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.743457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b19ef0d0-afbd-48e9-a75f-4b0e89793e9e tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.744021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b19ef0d0-afbd-48e9-a75f-4b0e89793e9e tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.744549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b19ef0d0-afbd-48e9-a75f-4b0e89793e9e tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.788477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65cfa62b-d8cf-464b-807a-7d8067deb00a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:30.796827 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-65cfa62b-d8cf-464b-807a-7d8067deb00a tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1557 microversion: 2.1 time: 0.634126 Aug 23 17:54:30.810525 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 475/999] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:30 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1557 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:30.817605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-430ee02a-c196-4113-bfe4-20f698a3fba8 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:30.818569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-430ee02a-c196-4113-bfe4-20f698a3fba8 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:30.825675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-430ee02a-c196-4113-bfe4-20f698a3fba8 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.826501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-430ee02a-c196-4113-bfe4-20f698a3fba8 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.827881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-430ee02a-c196-4113-bfe4-20f698a3fba8 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.829444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-430ee02a-c196-4113-bfe4-20f698a3fba8 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.829900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-430ee02a-c196-4113-bfe4-20f698a3fba8 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.830358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-430ee02a-c196-4113-bfe4-20f698a3fba8 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.847891 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b19ef0d0-afbd-48e9-a75f-4b0e89793e9e tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4/action" status: 202 len: 0 microversion: 2.25 time: 0.117186 Aug 23 17:54:30.848696 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 525/1000] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 17:54:30 2022] POST /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:54:30.860637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3d9e49d7-69e9-4d65-9665-6ef9da1b3b7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:30.861355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3d9e49d7-69e9-4d65-9665-6ef9da1b3b7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:30.868819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9e49d7-69e9-4d65-9665-6ef9da1b3b7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.869315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9e49d7-69e9-4d65-9665-6ef9da1b3b7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.869748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9e49d7-69e9-4d65-9665-6ef9da1b3b7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:30.870473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9e49d7-69e9-4d65-9665-6ef9da1b3b7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:30.870954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9e49d7-69e9-4d65-9665-6ef9da1b3b7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:30.871374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9e49d7-69e9-4d65-9665-6ef9da1b3b7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:31.019721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3d9e49d7-69e9-4d65-9665-6ef9da1b3b7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:31.028972 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3d9e49d7-69e9-4d65-9665-6ef9da1b3b7c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 0.179146 Aug 23 17:54:31.030036 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 526/1001] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:30 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:31.036517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8b9c2728-825c-4b4b-8f0f-6ce95d12ac3d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:31.037099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8b9c2728-825c-4b4b-8f0f-6ce95d12ac3d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:31.043627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9c2728-825c-4b4b-8f0f-6ce95d12ac3d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:31.044251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9c2728-825c-4b4b-8f0f-6ce95d12ac3d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:31.044751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9c2728-825c-4b4b-8f0f-6ce95d12ac3d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:31.045527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9c2728-825c-4b4b-8f0f-6ce95d12ac3d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:31.047050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9c2728-825c-4b4b-8f0f-6ce95d12ac3d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:31.048685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9c2728-825c-4b4b-8f0f-6ce95d12ac3d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:31.073496 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-430ee02a-c196-4113-bfe4-20f698a3fba8 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1616 microversion: 2.1 time: 0.260296 Aug 23 17:54:31.076220 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 476/1002] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:30 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1616 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:31.091234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-caeb70a2-5d7b-412e-8358-66e012645f35 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:31.091984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-caeb70a2-5d7b-412e-8358-66e012645f35 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:31.112989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-caeb70a2-5d7b-412e-8358-66e012645f35 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:31.113743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-caeb70a2-5d7b-412e-8358-66e012645f35 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:31.114366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-caeb70a2-5d7b-412e-8358-66e012645f35 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:31.115473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-caeb70a2-5d7b-412e-8358-66e012645f35 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:31.116100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-caeb70a2-5d7b-412e-8358-66e012645f35 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:31.116696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-caeb70a2-5d7b-412e-8358-66e012645f35 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:31.233305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8b9c2728-825c-4b4b-8f0f-6ce95d12ac3d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:31.245600 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-caeb70a2-5d7b-412e-8358-66e012645f35 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166198 Aug 23 17:54:31.246454 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 477/1003] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 17:54:31 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-interface => generated 285 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:31.248155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8b9c2728-825c-4b4b-8f0f-6ce95d12ac3d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:31.253761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8b9c2728-825c-4b4b-8f0f-6ce95d12ac3d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:31.258387 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8b9c2728-825c-4b4b-8f0f-6ce95d12ac3d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1559 microversion: 2.21 time: 0.226795 Aug 23 17:54:31.259776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-39a51505-4854-4758-93d1-07eaacd8a93c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:31.260192 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 527/1004] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:31 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1559 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:31.265678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-39a51505-4854-4758-93d1-07eaacd8a93c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:31.268860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-10ee4f17-c1ea-49e6-92ae-edd6791f2f05 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Calling method '.version_select at 0x7f27ed5daca0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:31.275535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10ee4f17-c1ea-49e6-92ae-edd6791f2f05 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:31.279780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39a51505-4854-4758-93d1-07eaacd8a93c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:31.280493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39a51505-4854-4758-93d1-07eaacd8a93c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:31.281122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39a51505-4854-4758-93d1-07eaacd8a93c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:31.285717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10ee4f17-c1ea-49e6-92ae-edd6791f2f05 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:31.286150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10ee4f17-c1ea-49e6-92ae-edd6791f2f05 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:31.303041 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-10ee4f17-c1ea-49e6-92ae-edd6791f2f05 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 1575 microversion: 2.1 time: 0.041124 Aug 23 17:54:31.309579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39a51505-4854-4758-93d1-07eaacd8a93c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:31.314325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39a51505-4854-4758-93d1-07eaacd8a93c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:31.317235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39a51505-4854-4758-93d1-07eaacd8a93c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:31.323459 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 528/1005] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 17:54:31 2022] GET /compute/v2.1/os-migrations => generated 1575 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:31.478192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1298100811", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:31.549463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:54:31.609785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-39a51505-4854-4758-93d1-07eaacd8a93c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid 21266578-6a91-43ab-9daf-38e646ac90c4 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:54:31.629926 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-39a51505-4854-4758-93d1-07eaacd8a93c tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 2037 microversion: 2.25 time: 0.382210 Aug 23 17:54:31.642569 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 478/1006] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:31 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 2037 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:31.649846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5b836d68-f540-4fdc-af79-d7e6433c75ea tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:31.649846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5b836d68-f540-4fdc-af79-d7e6433c75ea tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:31.660440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b836d68-f540-4fdc-af79-d7e6433c75ea tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:31.661026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b836d68-f540-4fdc-af79-d7e6433c75ea tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:31.661782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b836d68-f540-4fdc-af79-d7e6433c75ea tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:31.662228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b836d68-f540-4fdc-af79-d7e6433c75ea tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:31.663859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b836d68-f540-4fdc-af79-d7e6433c75ea tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:31.666906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b836d68-f540-4fdc-af79-d7e6433c75ea tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:32.043793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5b836d68-f540-4fdc-af79-d7e6433c75ea tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:32.063263 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5b836d68-f540-4fdc-af79-d7e6433c75ea tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1469 microversion: 2.1 time: 0.430645 Aug 23 17:54:32.064279 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 479/1007] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:31 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1469 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:32.080830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9729f398-1c73-4a14-bd6c-3daf3cef3163 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-16", "block_migration": "auto"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:32.083767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9729f398-1c73-4a14-bd6c-3daf3cef3163 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:32.091540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9729f398-1c73-4a14-bd6c-3daf3cef3163 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:32.092267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9729f398-1c73-4a14-bd6c-3daf3cef3163 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:32.094172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9729f398-1c73-4a14-bd6c-3daf3cef3163 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:32.095281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9729f398-1c73-4a14-bd6c-3daf3cef3163 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:32.104923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9729f398-1c73-4a14-bd6c-3daf3cef3163 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:32.105496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9729f398-1c73-4a14-bd6c-3daf3cef3163 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:32.142853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-9729f398-1c73-4a14-bd6c-3daf3cef3163 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'flavor' on Instance uuid 21266578-6a91-43ab-9daf-38e646ac90c4 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:54:32.162022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9729f398-1c73-4a14-bd6c-3daf3cef3163 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Going to try to live migrate instance to n-h1-850468-16 {{(pid=128808) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 17:54:32.222114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:32.434707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:54:32.435254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:54:32.436122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:54:32.436122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:54:32.436622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:54:32.453055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:32.457880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:32.458420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:32.459320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:32.459861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:32.460363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:32.501959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Getting quotas for project 88baf37ceb1342e3bc666ba96b4988ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:32.516769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Getting quotas for user 8d66dd8a72974b1791fa449fb91c3282 and project 88baf37ceb1342e3bc666ba96b4988ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:32.551833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:54:32.553583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:54:32.686361 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5b85441f-7045-4ec3-960c-44f8ffae074b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.211209 Aug 23 17:54:32.688470 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 529/1008] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:54:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:54:32.701944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e9d928a-6ddd-443f-910b-afd7dfb467df tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:32.702834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e9d928a-6ddd-443f-910b-afd7dfb467df tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:32.716268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e9d928a-6ddd-443f-910b-afd7dfb467df tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:32.717103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e9d928a-6ddd-443f-910b-afd7dfb467df tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:32.718329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e9d928a-6ddd-443f-910b-afd7dfb467df tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:32.719433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e9d928a-6ddd-443f-910b-afd7dfb467df tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:32.720094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e9d928a-6ddd-443f-910b-afd7dfb467df tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:32.721243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e9d928a-6ddd-443f-910b-afd7dfb467df tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:33.540726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=26 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:33.899488 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9729f398-1c73-4a14-bd6c-3daf3cef3163 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4/action" status: 202 len: 0 microversion: 2.25 time: 1.833566 Aug 23 17:54:33.905791 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 480/1009] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 17:54:32 2022] POST /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4/action => generated 0 bytes in 1840 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:54:33.912257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ffae65f6-2994-4e10-8c7a-ac3571a784e3 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:33.915210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ffae65f6-2994-4e10-8c7a-ac3571a784e3 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:33.938133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffae65f6-2994-4e10-8c7a-ac3571a784e3 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:33.938649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffae65f6-2994-4e10-8c7a-ac3571a784e3 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:33.939279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffae65f6-2994-4e10-8c7a-ac3571a784e3 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:33.940290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffae65f6-2994-4e10-8c7a-ac3571a784e3 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:33.940933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffae65f6-2994-4e10-8c7a-ac3571a784e3 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:33.942116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffae65f6-2994-4e10-8c7a-ac3571a784e3 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:33.948691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e9d928a-6ddd-443f-910b-afd7dfb467df tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:33.963786 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e9d928a-6ddd-443f-910b-afd7dfb467df tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1504 microversion: 2.1 time: 1.268440 Aug 23 17:54:33.964961 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 530/1010] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:32 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1504 bytes in 1276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:33.991776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d155b27a-cb06-4aa2-bc6f-f436a73a95ad tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:33.992400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d155b27a-cb06-4aa2-bc6f-f436a73a95ad tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:34.003506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d155b27a-cb06-4aa2-bc6f-f436a73a95ad tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:34.004058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d155b27a-cb06-4aa2-bc6f-f436a73a95ad tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:34.005841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d155b27a-cb06-4aa2-bc6f-f436a73a95ad tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:34.006808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d155b27a-cb06-4aa2-bc6f-f436a73a95ad tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:34.007469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d155b27a-cb06-4aa2-bc6f-f436a73a95ad tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:34.008089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d155b27a-cb06-4aa2-bc6f-f436a73a95ad tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:34.139124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ffae65f6-2994-4e10-8c7a-ac3571a784e3 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:34.150849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ffae65f6-2994-4e10-8c7a-ac3571a784e3 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:34.153596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ffae65f6-2994-4e10-8c7a-ac3571a784e3 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:34.156384 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ffae65f6-2994-4e10-8c7a-ac3571a784e3 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1559 microversion: 2.21 time: 0.248812 Aug 23 17:54:34.159022 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 481/1011] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:33 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1559 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:34.164871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1b96a7ac-4f2e-47bc-a46f-0e9d0347cecd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:34.165760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1b96a7ac-4f2e-47bc-a46f-0e9d0347cecd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:34.174507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b96a7ac-4f2e-47bc-a46f-0e9d0347cecd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:34.175255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b96a7ac-4f2e-47bc-a46f-0e9d0347cecd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:34.175899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b96a7ac-4f2e-47bc-a46f-0e9d0347cecd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:34.176855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b96a7ac-4f2e-47bc-a46f-0e9d0347cecd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:34.177490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b96a7ac-4f2e-47bc-a46f-0e9d0347cecd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:34.178125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b96a7ac-4f2e-47bc-a46f-0e9d0347cecd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:34.233303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d155b27a-cb06-4aa2-bc6f-f436a73a95ad tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:34.258729 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d155b27a-cb06-4aa2-bc6f-f436a73a95ad tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1265 microversion: 2.1 time: 0.291679 Aug 23 17:54:34.286307 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 531/1012] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:33 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:34.297944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c9e8845-d691-4a53-8694-7b1d511ba6bc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:34.301717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1c9e8845-d691-4a53-8694-7b1d511ba6bc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:34.312170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c9e8845-d691-4a53-8694-7b1d511ba6bc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:34.312819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c9e8845-d691-4a53-8694-7b1d511ba6bc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:34.313359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c9e8845-d691-4a53-8694-7b1d511ba6bc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:34.314182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c9e8845-d691-4a53-8694-7b1d511ba6bc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:34.314860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c9e8845-d691-4a53-8694-7b1d511ba6bc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:34.315540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c9e8845-d691-4a53-8694-7b1d511ba6bc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:34.364874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1b96a7ac-4f2e-47bc-a46f-0e9d0347cecd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:34.375362 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1b96a7ac-4f2e-47bc-a46f-0e9d0347cecd tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1469 microversion: 2.1 time: 0.214899 Aug 23 17:54:34.388672 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 482/1013] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:34 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1469 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:34.575822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1520760376", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "9e22243b-e810-4a47-b1c2-64da1b0be147"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:34.664732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] validate_networks() for [('9e22243b-e810-4a47-b1c2-64da1b0be147', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:54:34.796247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1c9e8845-d691-4a53-8694-7b1d511ba6bc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:34.804771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1c9e8845-d691-4a53-8694-7b1d511ba6bc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:34.806277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1c9e8845-d691-4a53-8694-7b1d511ba6bc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:34.824161 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c9e8845-d691-4a53-8694-7b1d511ba6bc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.536273 Aug 23 17:54:34.824753 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 532/1014] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:34 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:34.843419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-bb348c1f-f978-4992-9944-c8a319dd04dd req-27203c3c-acf3-47e5-bf3f-bfcc5c3d44ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b87c54c7-d7eb-443a-b682-00663df7b2a3", "name": "network-vif-deleted", "tag": "802c8a75-8773-432e-b8e4-e1714fd925b3"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:34.864186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bb348c1f-f978-4992-9944-c8a319dd04dd req-27203c3c-acf3-47e5-bf3f-bfcc5c3d44ab service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:34.864896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bb348c1f-f978-4992-9944-c8a319dd04dd req-27203c3c-acf3-47e5-bf3f-bfcc5c3d44ab service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:34.865490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bb348c1f-f978-4992-9944-c8a319dd04dd req-27203c3c-acf3-47e5-bf3f-bfcc5c3d44ab service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:34.895312 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-bb348c1f-f978-4992-9944-c8a319dd04dd req-27203c3c-acf3-47e5-bf3f-bfcc5c3d44ab service nova] Creating event network-vif-deleted:802c8a75-8773-432e-b8e4-e1714fd925b3 for instance b87c54c7-d7eb-443a-b682-00663df7b2a3 on n-h1-850468-16 Aug 23 17:54:34.925695 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-bb348c1f-f978-4992-9944-c8a319dd04dd req-27203c3c-acf3-47e5-bf3f-bfcc5c3d44ab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099628 Aug 23 17:54:34.926324 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 533/1015] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:34.987413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5440d975-7d37-45a1-92a0-b984034199e6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:34.988139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5440d975-7d37-45a1-92a0-b984034199e6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:35.000688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5440d975-7d37-45a1-92a0-b984034199e6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:35.001187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5440d975-7d37-45a1-92a0-b984034199e6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:35.001628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5440d975-7d37-45a1-92a0-b984034199e6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:35.002363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5440d975-7d37-45a1-92a0-b984034199e6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:35.002857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5440d975-7d37-45a1-92a0-b984034199e6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:35.003287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5440d975-7d37-45a1-92a0-b984034199e6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:35.511191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:54:35.511615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:54:35.514468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:54:35.517519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:54:35.517675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:54:35.537413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:35.538067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:35.539127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:35.540464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:35.541439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:35.543290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:35.570304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Getting quotas for project f14225f216754bad9f6532b176593449. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:35.575749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1,nova_api:UPDATE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:35.577434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Getting quotas for user 8f9cab3e3fbc4251aeb3cedf6dfa38de and project f14225f216754bad9f6532b176593449. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:35.596842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:54:35.600542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:54:35.666719 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b1336e59-1835-4299-ac6c-1f5c8e88a9a1 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.286298 Aug 23 17:54:35.668109 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 483/1016] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:54:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1288 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:54:35.674575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:35.675690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:35.682481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:35.683249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:35.683928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:35.684842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:35.685710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:35.687107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:35.727687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5440d975-7d37-45a1-92a0-b984034199e6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:35.740439 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5440d975-7d37-45a1-92a0-b984034199e6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1479 microversion: 2.1 time: 0.756969 Aug 23 17:54:35.742675 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 534/1017] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:34 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1479 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:35.751579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b466bd1-7eaa-41fe-bef7-609da274a16d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:35.757962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4b466bd1-7eaa-41fe-bef7-609da274a16d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:35.768510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:35.769040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:35.769485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:35.769943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lazy-loading 'fault' on Instance uuid af054669-ae48-40f0-88d8-e163ab916c8c {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:54:35.770224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b466bd1-7eaa-41fe-bef7-609da274a16d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:35.770753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b466bd1-7eaa-41fe-bef7-609da274a16d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:35.771342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b466bd1-7eaa-41fe-bef7-609da274a16d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:35.772838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b466bd1-7eaa-41fe-bef7-609da274a16d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:35.773451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b466bd1-7eaa-41fe-bef7-609da274a16d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:35.774711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b466bd1-7eaa-41fe-bef7-609da274a16d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:35.780571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:35.854642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:35.882582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:35.891743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c56f1a67ae114ab688a350a1551fda80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a5927f8e0d84b1b8ea34676a04b132c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:35.893760 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4d5c6b39-7804-424b-b167-fb98a5fe30b1 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 200 len: 1349 microversion: 2.21 time: 0.223938 Aug 23 17:54:35.894658 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 484/1018] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:35 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 1349 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:35.904591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:35.911188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:35.918822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:35.922241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:35.924930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4b466bd1-7eaa-41fe-bef7-609da274a16d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:35.934081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:35.940095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:35.940262 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b466bd1-7eaa-41fe-bef7-609da274a16d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1271 microversion: 2.1 time: 0.196135 Aug 23 17:54:35.940618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:35.941181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:35.956404 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 535/1019] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:35 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1271 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:35.977624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b31dd05e-dbf5-48dc-9275-28bc9b642c65 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:35.978315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b31dd05e-dbf5-48dc-9275-28bc9b642c65 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:36.023349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:36.025670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:36.026136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:36.028630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lazy-loading 'fault' on Instance uuid b87c54c7-d7eb-443a-b682-00663df7b2a3 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:54:36.113001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:36.125885 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d8f70c13-ab42-4f89-b14d-62190bdd21d9 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 200 len: 1303 microversion: 2.1 time: 0.229804 Aug 23 17:54:36.134876 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 485/1020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:35 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 1303 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:36.140101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a1019a07-3d9c-494d-8665-dd93c7eca560 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '.version_select at 0x7f27ec8bcca0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:36.145831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1019a07-3d9c-494d-8665-dd93c7eca560 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:36.148753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1019a07-3d9c-494d-8665-dd93c7eca560 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:36.149592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1019a07-3d9c-494d-8665-dd93c7eca560 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:36.167543 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a1019a07-3d9c-494d-8665-dd93c7eca560 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 1960 microversion: 2.1 time: 0.031333 Aug 23 17:54:36.168448 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 486/1021] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 17:54:36 2022] GET /compute/v2.1/os-migrations => generated 1960 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:36.168627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b31dd05e-dbf5-48dc-9275-28bc9b642c65 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:36.171769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=69 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:36.178244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8311ba17-1f3e-42b4-b787-7c6c95411b26 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:36.181483 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b31dd05e-dbf5-48dc-9275-28bc9b642c65 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1216 microversion: 2.1 time: 0.223902 Aug 23 17:54:36.182069 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 536/1022] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:35 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1216 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:36.185987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8311ba17-1f3e-42b4-b787-7c6c95411b26 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:36.199392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8311ba17-1f3e-42b4-b787-7c6c95411b26 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:36.200203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8311ba17-1f3e-42b4-b787-7c6c95411b26 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:36.203045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8311ba17-1f3e-42b4-b787-7c6c95411b26 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:36.203542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a247cc5b-ccbb-40c6-af73-c13d07064a05 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:36.204912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8311ba17-1f3e-42b4-b787-7c6c95411b26 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:36.205390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8311ba17-1f3e-42b4-b787-7c6c95411b26 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:36.205834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8311ba17-1f3e-42b4-b787-7c6c95411b26 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:36.207470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a247cc5b-ccbb-40c6-af73-c13d07064a05 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:36.219484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a247cc5b-ccbb-40c6-af73-c13d07064a05 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:36.220055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a247cc5b-ccbb-40c6-af73-c13d07064a05 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:36.220512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a247cc5b-ccbb-40c6-af73-c13d07064a05 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:36.221236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a247cc5b-ccbb-40c6-af73-c13d07064a05 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:36.221798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a247cc5b-ccbb-40c6-af73-c13d07064a05 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:36.222114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a247cc5b-ccbb-40c6-af73-c13d07064a05 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:36.526517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8311ba17-1f3e-42b4-b787-7c6c95411b26 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:36.591250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8311ba17-1f3e-42b4-b787-7c6c95411b26 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:36.595261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8311ba17-1f3e-42b4-b787-7c6c95411b26 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:36.598881 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8311ba17-1f3e-42b4-b787-7c6c95411b26 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.428762 Aug 23 17:54:36.599462 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 487/1023] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:36 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:36.604315 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a247cc5b-ccbb-40c6-af73-c13d07064a05 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1632 microversion: 2.1 time: 0.420627 Aug 23 17:54:36.605174 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 537/1024] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:36 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1632 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:36.643947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2bf1c2de-6d93-494f-8de4-104e1ccc6754 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Action: 'create', calling method: .version_select at 0x7f27ec7b9280>, body: {"keypair": {"name": "tempest-keypair-155021394", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBORHvx462hXy3/oqRS4IxFcEuVFMdFjYVgyl+9j5Qo2xbEDtgKAMZFSuXaNtBiWO2/iYS/kHt3Fadv/JpS8LHaKOpRYhKBtfqxcwqfLyA4C63rZUFcirwv+lzs4VyxzEfw=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:36.677960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-2bf1c2de-6d93-494f-8de4-104e1ccc6754 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Getting quotas for project 5bbd01aaed704a1b8509e754d19a4b8d. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:36.692110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-2bf1c2de-6d93-494f-8de4-104e1ccc6754 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Getting quotas for user 0ef389420da8493386a7f8dfb747afab and project 5bbd01aaed704a1b8509e754d19a4b8d. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:36.744103 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2bf1c2de-6d93-494f-8de4-104e1ccc6754 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104362 Aug 23 17:54:36.745644 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 488/1025] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:54:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:36.917232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ee8b64a-a38d-4ee6-afbd-3de7b0c2c98a tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:36.917848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2ee8b64a-a38d-4ee6-afbd-3de7b0c2c98a tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:36.932533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ee8b64a-a38d-4ee6-afbd-3de7b0c2c98a tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:36.936943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ee8b64a-a38d-4ee6-afbd-3de7b0c2c98a tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:36.939748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ee8b64a-a38d-4ee6-afbd-3de7b0c2c98a tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:36.940519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ee8b64a-a38d-4ee6-afbd-3de7b0c2c98a tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:36.940997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ee8b64a-a38d-4ee6-afbd-3de7b0c2c98a tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:36.941429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ee8b64a-a38d-4ee6-afbd-3de7b0c2c98a tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:36.969200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-27b018cf-e094-40ad-a575-bfe1ed4781cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:36.970122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-27b018cf-e094-40ad-a575-bfe1ed4781cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:36.994902 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2ee8b64a-a38d-4ee6-afbd-3de7b0c2c98a tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] HTTP exception thrown: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:36.997315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27b018cf-e094-40ad-a575-bfe1ed4781cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ee8b64a-a38d-4ee6-afbd-3de7b0c2c98a tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Request method failure captured: Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c HTTP/1.1 Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQ4Y0CZX4ptERjKjpQljJs6KY8Xefk50upzhV_eiSBHRtkaaohaLQlBh-nd51leqK5huYPAeCtj_vTyJl5aipTbniiwEEsGZ9N97JQBXlGCfQ8yDo6YZtmLyxdy6zdyVMnd-e0Z9OrKWAROo6LZyCYPD3KehW-cHCf4GQkHSSvFM5U Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.21 Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 9a5927f8e0d84b1b8ea34676a04b132c Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1407461770 Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a5927f8e0d84b1b8ea34676a04b132c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a5927f8e0d84b1b8ea34676a04b132c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a5927f8e0d84b1b8ea34676a04b132c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a5927f8e0d84b1b8ea34676a04b132c"}]}] Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-InstanceActionsV221TestJSON-1407461770 Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 9a5927f8e0d84b1b8ea34676a04b132c Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1407461770 Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-InstanceActionsV221TestJSON-1407461770-project Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: c56f1a67ae114ab688a350a1551fda80 Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-InstanceActionsV221TestJSON-1407461770-project Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'af054669-ae48-40f0-88d8-e163ab916c8c'} Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:36.998222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:37.003542 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.003542 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:37.003542 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:37.003542 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:37.003542 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:54:37.003542 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:54:37.003542 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:37.003542 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.007443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ee8b64a-a38d-4ee6-afbd-3de7b0c2c98a tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Returning 404 to user: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:37.008531 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2ee8b64a-a38d-4ee6-afbd-3de7b0c2c98a tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 404 len: 111 microversion: 2.21 time: 0.095227 Aug 23 17:54:37.009313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27b018cf-e094-40ad-a575-bfe1ed4781cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.010472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27b018cf-e094-40ad-a575-bfe1ed4781cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.011003 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 538/1026] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:36 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:54:37.012596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27b018cf-e094-40ad-a575-bfe1ed4781cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.014849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27b018cf-e094-40ad-a575-bfe1ed4781cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.016728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27b018cf-e094-40ad-a575-bfe1ed4781cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.023095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-80d93329-dbc4-4a40-9f7a-2fce3b411180 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '.version_select at 0x7f27ecac5dc0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:37.025573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-80d93329-dbc4-4a40-9f7a-2fce3b411180 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:37.039839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80d93329-dbc4-4a40-9f7a-2fce3b411180 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.040629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80d93329-dbc4-4a40-9f7a-2fce3b411180 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.041369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80d93329-dbc4-4a40-9f7a-2fce3b411180 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.042262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80d93329-dbc4-4a40-9f7a-2fce3b411180 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.047260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80d93329-dbc4-4a40-9f7a-2fce3b411180 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.056169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80d93329-dbc4-4a40-9f7a-2fce3b411180 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.180114 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-80d93329-dbc4-4a40-9f7a-2fce3b411180 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.163972 Aug 23 17:54:37.181766 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 539/1027] 10.222.0.61 () {60 vars in 1337 bytes} [Tue Aug 23 17:54:37 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c/os-instance-actions => generated 611 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:54:37.195288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25393d22-1ab4-4b57-b3f5-b6670b1e748a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:37.195922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-25393d22-1ab4-4b57-b3f5-b6670b1e748a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: b87c54c7-d7eb-443a-b682-00663df7b2a3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:37.212118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25393d22-1ab4-4b57-b3f5-b6670b1e748a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.212626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25393d22-1ab4-4b57-b3f5-b6670b1e748a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.213069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25393d22-1ab4-4b57-b3f5-b6670b1e748a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.213785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25393d22-1ab4-4b57-b3f5-b6670b1e748a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.214242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25393d22-1ab4-4b57-b3f5-b6670b1e748a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.214703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25393d22-1ab4-4b57-b3f5-b6670b1e748a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.220120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-27b018cf-e094-40ad-a575-bfe1ed4781cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:37.233093 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-27b018cf-e094-40ad-a575-bfe1ed4781cd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1271 microversion: 2.1 time: 0.267957 Aug 23 17:54:37.235285 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 489/1028] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:36 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1271 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:37.239383 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-25393d22-1ab4-4b57-b3f5-b6670b1e748a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] HTTP exception thrown: Instance b87c54c7-d7eb-443a-b682-00663df7b2a3 could not be found. Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25393d22-1ab4-4b57-b3f5-b6670b1e748a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Request method failure captured: Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 HTTP/1.1 Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPBfuKQwdprs3Tli4dXoJZynp5FCB9H1q_O3fpjLaohBvtSQd4rxC9-h4-c6OpBv8JgW7Wm2673yFnfE3qIrrCCl3dW2uZ3BuPRqAEbVfBtcWfVvHZ3SfSaZ6DCQJBUcSIOevCi4uILfiYmtJuyO7QGGgvuutq6HYs9iRO-ut_0-3A Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 5c5a1c94aed149c489a20be456895034 Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersAdminTestJSON-657395626 Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5c5a1c94aed149c489a20be456895034"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c5a1c94aed149c489a20be456895034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5c5a1c94aed149c489a20be456895034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c5a1c94aed149c489a20be456895034"}]}] Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersAdminTestJSON-657395626 Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 5c5a1c94aed149c489a20be456895034 Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersAdminTestJSON-657395626 Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersAdminTestJSON-657395626-project Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: d81796ff5b934d218c1b967b8c0f9882 Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersAdminTestJSON-657395626-project Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance b87c54c7-d7eb-443a-b682-00663df7b2a3 could not be found. Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'b87c54c7-d7eb-443a-b682-00663df7b2a3'} Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b87c54c7-d7eb-443a-b682-00663df7b2a3 could not be found. Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b87c54c7-d7eb-443a-b682-00663df7b2a3 could not be found. Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:37.241136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.245750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:37.245750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:37.245750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:37.245750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:54:37.245750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:54:37.245750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b87c54c7-d7eb-443a-b682-00663df7b2a3 could not be found. Aug 23 17:54:37.245750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.246251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d31912a4-33cb-4039-a450-c66f0691ce2d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:37.246251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d31912a4-33cb-4039-a450-c66f0691ce2d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:37.247281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25393d22-1ab4-4b57-b3f5-b6670b1e748a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Returning 404 to user: Instance b87c54c7-d7eb-443a-b682-00663df7b2a3 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:37.248383 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-25393d22-1ab4-4b57-b3f5-b6670b1e748a tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3" status: 404 len: 111 microversion: 2.1 time: 0.065169 Aug 23 17:54:37.250068 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 540/1029] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:37 2022] GET /compute/v2.1/servers/b87c54c7-d7eb-443a-b682-00663df7b2a3 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:54:37.265068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d31912a4-33cb-4039-a450-c66f0691ce2d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.270376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a612f539-5a04-4e40-8bc8-0bd843b37b29 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:37.271027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a612f539-5a04-4e40-8bc8-0bd843b37b29 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:37.272991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d31912a4-33cb-4039-a450-c66f0691ce2d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.273660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d31912a4-33cb-4039-a450-c66f0691ce2d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.274443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d31912a4-33cb-4039-a450-c66f0691ce2d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.274952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d31912a4-33cb-4039-a450-c66f0691ce2d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.275386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d31912a4-33cb-4039-a450-c66f0691ce2d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.288799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a612f539-5a04-4e40-8bc8-0bd843b37b29 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.289606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a612f539-5a04-4e40-8bc8-0bd843b37b29 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.290398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a612f539-5a04-4e40-8bc8-0bd843b37b29 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.291294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a612f539-5a04-4e40-8bc8-0bd843b37b29 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.294806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a612f539-5a04-4e40-8bc8-0bd843b37b29 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.295492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a612f539-5a04-4e40-8bc8-0bd843b37b29 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.330140 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-d31912a4-33cb-4039-a450-c66f0691ce2d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] HTTP exception thrown: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d31912a4-33cb-4039-a450-c66f0691ce2d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Request method failure captured: Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c HTTP/1.1 Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRQ4Y0CZX4ptERjKjpQljJs6KY8Xefk50upzhV_eiSBHRtkaaohaLQlBh-nd51leqK5huYPAeCtj_vTyJl5aipTbniiwEEsGZ9N97JQBXlGCfQ8yDo6YZtmLyxdy6zdyVMnd-e0Z9OrKWAROo6LZyCYPD3KehW-cHCf4GQkHSSvFM5U Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.21 Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 9a5927f8e0d84b1b8ea34676a04b132c Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1407461770 Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a5927f8e0d84b1b8ea34676a04b132c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a5927f8e0d84b1b8ea34676a04b132c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a5927f8e0d84b1b8ea34676a04b132c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a5927f8e0d84b1b8ea34676a04b132c"}]}] Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-InstanceActionsV221TestJSON-1407461770 Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 9a5927f8e0d84b1b8ea34676a04b132c Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1407461770 Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-InstanceActionsV221TestJSON-1407461770-project Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: c56f1a67ae114ab688a350a1551fda80 Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-InstanceActionsV221TestJSON-1407461770-project Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'af054669-ae48-40f0-88d8-e163ab916c8c'} Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:54:37.331999 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d31912a4-33cb-4039-a450-c66f0691ce2d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Returning 404 to user: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d31912a4-33cb-4039-a450-c66f0691ce2d tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "DELETE /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 404 len: 111 microversion: 2.21 time: 0.097281 Aug 23 17:54:37.336601 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 490/1030] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:54:37 2022] DELETE /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:54:37.340674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-14442a3e-fbf9-4fd5-ae6c-c35254165e4d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:37.341172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-14442a3e-fbf9-4fd5-ae6c-c35254165e4d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:37.348905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14442a3e-fbf9-4fd5-ae6c-c35254165e4d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.349702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14442a3e-fbf9-4fd5-ae6c-c35254165e4d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.350150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14442a3e-fbf9-4fd5-ae6c-c35254165e4d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.351020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14442a3e-fbf9-4fd5-ae6c-c35254165e4d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.351480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14442a3e-fbf9-4fd5-ae6c-c35254165e4d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.352003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14442a3e-fbf9-4fd5-ae6c-c35254165e4d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.456539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-14442a3e-fbf9-4fd5-ae6c-c35254165e4d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:54:37.696558 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-14442a3e-fbf9-4fd5-ae6c-c35254165e4d tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 204 len: 0 microversion: 2.1 time: 0.360363 Aug 23 17:54:37.698179 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 491/1031] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:54:37 2022] DELETE /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:54:37.711972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-de1a109c-6fcc-4277-804f-6d91ec3cb421 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:37.712959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-de1a109c-6fcc-4277-804f-6d91ec3cb421 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] [instance: af054669-ae48-40f0-88d8-e163ab916c8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:37.728786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de1a109c-6fcc-4277-804f-6d91ec3cb421 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.737119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de1a109c-6fcc-4277-804f-6d91ec3cb421 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.737802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de1a109c-6fcc-4277-804f-6d91ec3cb421 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.738724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de1a109c-6fcc-4277-804f-6d91ec3cb421 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.739199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de1a109c-6fcc-4277-804f-6d91ec3cb421 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.739927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de1a109c-6fcc-4277-804f-6d91ec3cb421 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.760326 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-de1a109c-6fcc-4277-804f-6d91ec3cb421 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] HTTP exception thrown: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-de1a109c-6fcc-4277-804f-6d91ec3cb421 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Request method failure captured: Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c HTTP/1.1 Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRQ4Y0CZX4ptERjKjpQljJs6KY8Xefk50upzhV_eiSBHRtkaaohaLQlBh-nd51leqK5huYPAeCtj_vTyJl5aipTbniiwEEsGZ9N97JQBXlGCfQ8yDo6YZtmLyxdy6zdyVMnd-e0Z9OrKWAROo6LZyCYPD3KehW-cHCf4GQkHSSvFM5U Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.21 Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 9a5927f8e0d84b1b8ea34676a04b132c Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1407461770 Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9a5927f8e0d84b1b8ea34676a04b132c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a5927f8e0d84b1b8ea34676a04b132c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9a5927f8e0d84b1b8ea34676a04b132c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9a5927f8e0d84b1b8ea34676a04b132c"}]}] Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-InstanceActionsV221TestJSON-1407461770 Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 9a5927f8e0d84b1b8ea34676a04b132c Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1407461770 Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-InstanceActionsV221TestJSON-1407461770-project Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: c56f1a67ae114ab688a350a1551fda80 Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-InstanceActionsV221TestJSON-1407461770-project Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'af054669-ae48-40f0-88d8-e163ab916c8c'} Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.763227 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:37.772774 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.772774 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:37.772774 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:37.772774 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:37.772774 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:54:37.772774 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:54:37.772774 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. Aug 23 17:54:37.772774 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:54:37.775650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-de1a109c-6fcc-4277-804f-6d91ec3cb421 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] Returning 404 to user: Instance af054669-ae48-40f0-88d8-e163ab916c8c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:37.776690 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-de1a109c-6fcc-4277-804f-6d91ec3cb421 tempest-InstanceActionsV221TestJSON-1407461770 tempest-InstanceActionsV221TestJSON-1407461770-project] 10.222.0.61 "GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c" status: 404 len: 111 microversion: 2.21 time: 0.076922 Aug 23 17:54:37.777599 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 492/1032] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:37 2022] GET /compute/v2.1/servers/af054669-ae48-40f0-88d8-e163ab916c8c => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:54:37.783207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef8db4c2-31c7-4443-8c5e-eda9d9b366c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:37.790468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef8db4c2-31c7-4443-8c5e-eda9d9b366c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:37.810672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef8db4c2-31c7-4443-8c5e-eda9d9b366c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.811856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef8db4c2-31c7-4443-8c5e-eda9d9b366c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.812350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef8db4c2-31c7-4443-8c5e-eda9d9b366c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.813094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef8db4c2-31c7-4443-8c5e-eda9d9b366c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:37.813563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef8db4c2-31c7-4443-8c5e-eda9d9b366c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:37.813999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef8db4c2-31c7-4443-8c5e-eda9d9b366c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:37.951456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a612f539-5a04-4e40-8bc8-0bd843b37b29 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:37.977599 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a612f539-5a04-4e40-8bc8-0bd843b37b29 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1268 microversion: 2.1 time: 0.722024 Aug 23 17:54:37.992345 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 541/1033] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:37 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1268 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:38.003172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3e61527c-8a64-4cf1-8c2e-90245c543cee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:38.003823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3e61527c-8a64-4cf1-8c2e-90245c543cee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:38.019354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e61527c-8a64-4cf1-8c2e-90245c543cee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:38.019854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e61527c-8a64-4cf1-8c2e-90245c543cee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:38.020295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e61527c-8a64-4cf1-8c2e-90245c543cee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:38.022561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e61527c-8a64-4cf1-8c2e-90245c543cee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:38.023040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e61527c-8a64-4cf1-8c2e-90245c543cee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:38.023472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e61527c-8a64-4cf1-8c2e-90245c543cee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:38.376437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef8db4c2-31c7-4443-8c5e-eda9d9b366c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:38.386698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3e61527c-8a64-4cf1-8c2e-90245c543cee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:38.387191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef8db4c2-31c7-4443-8c5e-eda9d9b366c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:38.387704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef8db4c2-31c7-4443-8c5e-eda9d9b366c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:38.389093 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef8db4c2-31c7-4443-8c5e-eda9d9b366c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.610597 Aug 23 17:54:38.400053 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3e61527c-8a64-4cf1-8c2e-90245c543cee tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1469 microversion: 2.1 time: 0.402068 Aug 23 17:54:38.400053 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 542/1034] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:37 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1469 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:38.400787 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 493/1035] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:37 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:38.406189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b77b93d1-a2f7-4008-84d6-3836d574a3a2 req-3a28beba-e01d-4ac4-b5c3-538e93b709aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af054669-ae48-40f0-88d8-e163ab916c8c", "name": "network-vif-deleted", "tag": "09a1fff1-1cd6-49a8-8af1-c239514e392e"}, {"name": "network-changed", "server_uuid": "13c4d28d-309a-4458-9d1e-91ac80454833", "tag": "3fb7efac-faa0-444f-bf74-83a2d19ebc05"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:38.422658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b77b93d1-a2f7-4008-84d6-3836d574a3a2 req-3a28beba-e01d-4ac4-b5c3-538e93b709aa service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:38.423151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b77b93d1-a2f7-4008-84d6-3836d574a3a2 req-3a28beba-e01d-4ac4-b5c3-538e93b709aa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:38.423589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b77b93d1-a2f7-4008-84d6-3836d574a3a2 req-3a28beba-e01d-4ac4-b5c3-538e93b709aa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:38.428986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f460ff01-5ad2-40ef-b16c-93d662db9b68 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:38.429611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f460ff01-5ad2-40ef-b16c-93d662db9b68 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:38.438723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f460ff01-5ad2-40ef-b16c-93d662db9b68 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:38.439220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f460ff01-5ad2-40ef-b16c-93d662db9b68 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:38.439845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f460ff01-5ad2-40ef-b16c-93d662db9b68 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:38.439986 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b77b93d1-a2f7-4008-84d6-3836d574a3a2 req-3a28beba-e01d-4ac4-b5c3-538e93b709aa service nova] Creating event network-vif-deleted:09a1fff1-1cd6-49a8-8af1-c239514e392e for instance af054669-ae48-40f0-88d8-e163ab916c8c on n-h1-850468-16 Aug 23 17:54:38.440356 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b77b93d1-a2f7-4008-84d6-3836d574a3a2 req-3a28beba-e01d-4ac4-b5c3-538e93b709aa service nova] Creating event network-changed:3fb7efac-faa0-444f-bf74-83a2d19ebc05 for instance 13c4d28d-309a-4458-9d1e-91ac80454833 on n-h1-850468-16 Aug 23 17:54:38.440556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f460ff01-5ad2-40ef-b16c-93d662db9b68 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:38.441159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f460ff01-5ad2-40ef-b16c-93d662db9b68 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:38.441738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f460ff01-5ad2-40ef-b16c-93d662db9b68 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:38.448254 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b77b93d1-a2f7-4008-84d6-3836d574a3a2 req-3a28beba-e01d-4ac4-b5c3-538e93b709aa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.049474 Aug 23 17:54:38.448869 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 543/1036] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:38.765507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f460ff01-5ad2-40ef-b16c-93d662db9b68 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:38.773228 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f460ff01-5ad2-40ef-b16c-93d662db9b68 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1313 microversion: 2.1 time: 0.365871 Aug 23 17:54:38.773872 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 494/1037] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:38 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1313 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:39.003553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-04f12e3b-cd32-4da5-b39e-9aaa09676528 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:39.004374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-04f12e3b-cd32-4da5-b39e-9aaa09676528 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:39.011141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04f12e3b-cd32-4da5-b39e-9aaa09676528 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:39.011724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04f12e3b-cd32-4da5-b39e-9aaa09676528 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:39.012297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04f12e3b-cd32-4da5-b39e-9aaa09676528 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:39.013460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04f12e3b-cd32-4da5-b39e-9aaa09676528 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:39.013460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04f12e3b-cd32-4da5-b39e-9aaa09676528 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:39.014035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04f12e3b-cd32-4da5-b39e-9aaa09676528 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:39.260423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-04f12e3b-cd32-4da5-b39e-9aaa09676528 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:39.282317 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-04f12e3b-cd32-4da5-b39e-9aaa09676528 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1268 microversion: 2.1 time: 0.283229 Aug 23 17:54:39.285424 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 544/1038] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:38 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1268 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:39.430496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-44a8f633-c2c7-4e59-8dd3-63415665a070 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:39.434968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-44a8f633-c2c7-4e59-8dd3-63415665a070 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:39.436690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-641f0f53-5cb7-47dc-9562-04d0811b79a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:39.438849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-641f0f53-5cb7-47dc-9562-04d0811b79a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:39.449355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-641f0f53-5cb7-47dc-9562-04d0811b79a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:39.451137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44a8f633-c2c7-4e59-8dd3-63415665a070 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:39.456288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44a8f633-c2c7-4e59-8dd3-63415665a070 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:39.456889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44a8f633-c2c7-4e59-8dd3-63415665a070 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:39.457738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44a8f633-c2c7-4e59-8dd3-63415665a070 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:39.458524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-641f0f53-5cb7-47dc-9562-04d0811b79a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:39.459239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-641f0f53-5cb7-47dc-9562-04d0811b79a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:39.459786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44a8f633-c2c7-4e59-8dd3-63415665a070 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:39.460706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44a8f633-c2c7-4e59-8dd3-63415665a070 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:39.462209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-641f0f53-5cb7-47dc-9562-04d0811b79a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:39.468643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-641f0f53-5cb7-47dc-9562-04d0811b79a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:39.470039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-641f0f53-5cb7-47dc-9562-04d0811b79a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:39.902084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-641f0f53-5cb7-47dc-9562-04d0811b79a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:39.911972 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-641f0f53-5cb7-47dc-9562-04d0811b79a7 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1469 microversion: 2.1 time: 0.489476 Aug 23 17:54:39.912568 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 495/1039] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:39 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1469 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:39.918737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e47e7e27-d327-4e36-b54c-ebc0d7b6d099 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:39.919819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e47e7e27-d327-4e36-b54c-ebc0d7b6d099 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:39.929065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e47e7e27-d327-4e36-b54c-ebc0d7b6d099 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:39.929578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e47e7e27-d327-4e36-b54c-ebc0d7b6d099 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:39.930497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e47e7e27-d327-4e36-b54c-ebc0d7b6d099 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:39.931237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e47e7e27-d327-4e36-b54c-ebc0d7b6d099 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:39.931685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e47e7e27-d327-4e36-b54c-ebc0d7b6d099 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:39.932429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e47e7e27-d327-4e36-b54c-ebc0d7b6d099 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:39.971798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-44a8f633-c2c7-4e59-8dd3-63415665a070 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:39.987460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-44a8f633-c2c7-4e59-8dd3-63415665a070 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:39.989238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-44a8f633-c2c7-4e59-8dd3-63415665a070 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:39.990617 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-44a8f633-c2c7-4e59-8dd3-63415665a070 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.563807 Aug 23 17:54:39.991233 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 545/1040] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:39 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:40.308484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7a2facfa-b28e-423c-9199-da754239b534 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:40.309752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7a2facfa-b28e-423c-9199-da754239b534 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:40.326245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a2facfa-b28e-423c-9199-da754239b534 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:40.328030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a2facfa-b28e-423c-9199-da754239b534 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:40.328654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a2facfa-b28e-423c-9199-da754239b534 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:40.329570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a2facfa-b28e-423c-9199-da754239b534 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:40.330339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a2facfa-b28e-423c-9199-da754239b534 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:40.330952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a2facfa-b28e-423c-9199-da754239b534 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:40.372566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e47e7e27-d327-4e36-b54c-ebc0d7b6d099 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:40.383530 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e47e7e27-d327-4e36-b54c-ebc0d7b6d099 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1313 microversion: 2.1 time: 0.469709 Aug 23 17:54:40.398986 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 496/1041] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:39 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1313 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:40.487039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7a2facfa-b28e-423c-9199-da754239b534 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:40.497368 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7a2facfa-b28e-423c-9199-da754239b534 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1274 microversion: 2.1 time: 0.195881 Aug 23 17:54:40.499780 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 546/1042] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:40 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1274 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:40.774153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1152558321", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "01db69ea-76ab-43b6-bec6-04f17d268a24"}], "security_groups": [{"name": "tempest-securitygroup--640499373"}], "key_name": "tempest-keypair-155021394", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:40.934669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-72e0f588-ed74-443a-999a-884953126340 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:40.935341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-72e0f588-ed74-443a-999a-884953126340 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:40.950000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72e0f588-ed74-443a-999a-884953126340 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:40.950925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72e0f588-ed74-443a-999a-884953126340 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:40.951610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72e0f588-ed74-443a-999a-884953126340 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:40.955720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72e0f588-ed74-443a-999a-884953126340 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:40.956457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72e0f588-ed74-443a-999a-884953126340 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:40.957258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72e0f588-ed74-443a-999a-884953126340 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:41.088875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] validate_networks() for [('01db69ea-76ab-43b6-bec6-04f17d268a24', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:54:41.586367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-72e0f588-ed74-443a-999a-884953126340 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:41.600594 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-72e0f588-ed74-443a-999a-884953126340 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 200 len: 1469 microversion: 2.1 time: 0.670832 Aug 23 17:54:41.603268 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 547/1043] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:40 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 1469 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:41.610877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-22f6d184-fc1b-4e25-9591-ac57d8b816d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:41.611751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-22f6d184-fc1b-4e25-9591-ac57d8b816d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:41.635747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22f6d184-fc1b-4e25-9591-ac57d8b816d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:41.639513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22f6d184-fc1b-4e25-9591-ac57d8b816d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:41.642396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22f6d184-fc1b-4e25-9591-ac57d8b816d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:41.643386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22f6d184-fc1b-4e25-9591-ac57d8b816d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:41.644021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22f6d184-fc1b-4e25-9591-ac57d8b816d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:41.647751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22f6d184-fc1b-4e25-9591-ac57d8b816d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:42.367730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22f6d184-fc1b-4e25-9591-ac57d8b816d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:42.378775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22f6d184-fc1b-4e25-9591-ac57d8b816d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:42.381491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22f6d184-fc1b-4e25-9591-ac57d8b816d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:42.383665 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-22f6d184-fc1b-4e25-9591-ac57d8b816d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.779150 Aug 23 17:54:42.387196 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 548/1044] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:41 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:42.396294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-0e711454-acd8-466a-83cd-ba6d4f60d188 req-43467b92-781a-48c5-b82a-59fc55813f57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "856ac0cb-cfb2-43f5-9e4f-df662c38f02d", "tag": "a3f7e262-db57-4792-9f23-2fbc005cd02a"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:42.409178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0e711454-acd8-466a-83cd-ba6d4f60d188 req-43467b92-781a-48c5-b82a-59fc55813f57 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:42.410034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0e711454-acd8-466a-83cd-ba6d4f60d188 req-43467b92-781a-48c5-b82a-59fc55813f57 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:42.411130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0e711454-acd8-466a-83cd-ba6d4f60d188 req-43467b92-781a-48c5-b82a-59fc55813f57 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:42.439786 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-0e711454-acd8-466a-83cd-ba6d4f60d188 req-43467b92-781a-48c5-b82a-59fc55813f57 service nova] Creating event network-changed:a3f7e262-db57-4792-9f23-2fbc005cd02a for instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d on n-h1-850468-16 Aug 23 17:54:42.449827 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-0e711454-acd8-466a-83cd-ba6d4f60d188 req-43467b92-781a-48c5-b82a-59fc55813f57 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058791 Aug 23 17:54:42.451370 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 549/1045] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:42.459655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb285aff-01d6-4779-b438-ecba3f7fc9a0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:42.461221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eb285aff-01d6-4779-b438-ecba3f7fc9a0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:42.471315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb285aff-01d6-4779-b438-ecba3f7fc9a0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:42.471629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb285aff-01d6-4779-b438-ecba3f7fc9a0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:42.472106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb285aff-01d6-4779-b438-ecba3f7fc9a0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:42.473703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb285aff-01d6-4779-b438-ecba3f7fc9a0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:42.475545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb285aff-01d6-4779-b438-ecba3f7fc9a0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:42.475545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb285aff-01d6-4779-b438-ecba3f7fc9a0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:42.505841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:42.645706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:54:42.647520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:54:42.648127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:54:42.648640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:54:42.649155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:54:42.672531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:42.673157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:42.673716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:42.674669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:42.675870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:42.676390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:42.698708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Getting quotas for project 5bbd01aaed704a1b8509e754d19a4b8d. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:42.705026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Getting quotas for user 0ef389420da8493386a7f8dfb747afab and project 5bbd01aaed704a1b8509e754d19a4b8d. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:42.740931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:54:42.744172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:54:42.818362 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9bdc5786-b1df-49c6-82a2-905a1378f920 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.047954 Aug 23 17:54:42.819994 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 497/1046] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:54:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 2050 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:54:42.828455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3c0860b-8efd-44da-8624-0df37408b317 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:42.829597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d3c0860b-8efd-44da-8624-0df37408b317 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:42.838618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3c0860b-8efd-44da-8624-0df37408b317 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:42.839452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3c0860b-8efd-44da-8624-0df37408b317 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:42.840122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3c0860b-8efd-44da-8624-0df37408b317 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:42.841360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3c0860b-8efd-44da-8624-0df37408b317 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:42.842016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3c0860b-8efd-44da-8624-0df37408b317 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:42.843417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3c0860b-8efd-44da-8624-0df37408b317 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:42.874279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eb285aff-01d6-4779-b438-ecba3f7fc9a0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:42.885612 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eb285aff-01d6-4779-b438-ecba3f7fc9a0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1313 microversion: 2.1 time: 0.431833 Aug 23 17:54:42.890532 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 550/1047] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:42 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:42.895777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d8274bd-1590-4e07-9931-90518524136e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:42.900820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2d8274bd-1590-4e07-9931-90518524136e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: e3c92ffd-1477-4110-82ef-aff030b6a026] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:42.917005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d8274bd-1590-4e07-9931-90518524136e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:42.923225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d8274bd-1590-4e07-9931-90518524136e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:42.923946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d8274bd-1590-4e07-9931-90518524136e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:42.924670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d8274bd-1590-4e07-9931-90518524136e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:42.925088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d8274bd-1590-4e07-9931-90518524136e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:42.925512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d8274bd-1590-4e07-9931-90518524136e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:42.964671 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2d8274bd-1590-4e07-9931-90518524136e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] HTTP exception thrown: Instance e3c92ffd-1477-4110-82ef-aff030b6a026 could not be found. Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d8274bd-1590-4e07-9931-90518524136e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Request method failure captured: Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 HTTP/1.1 Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPBfuKQwdprs3Tli4dXoJZynp5FCB9H1q_O3fpjLaohBvtSQd4rxC9-h4-c6OpBv8JgW7Wm2673yFnfE3qIrrCCl3dW2uZ3BuPRqAEbVfBtcWfVvHZ3SfSaZ6DCQJBUcSIOevCi4uILfiYmtJuyO7QGGgvuutq6HYs9iRO-ut_0-3A Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 5c5a1c94aed149c489a20be456895034 Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersAdminTestJSON-657395626 Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5c5a1c94aed149c489a20be456895034"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c5a1c94aed149c489a20be456895034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5c5a1c94aed149c489a20be456895034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c5a1c94aed149c489a20be456895034"}]}] Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersAdminTestJSON-657395626 Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 5c5a1c94aed149c489a20be456895034 Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersAdminTestJSON-657395626 Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersAdminTestJSON-657395626-project Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: d81796ff5b934d218c1b967b8c0f9882 Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersAdminTestJSON-657395626-project Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance e3c92ffd-1477-4110-82ef-aff030b6a026 could not be found. Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'e3c92ffd-1477-4110-82ef-aff030b6a026'} Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3c92ffd-1477-4110-82ef-aff030b6a026 could not be found. Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3c92ffd-1477-4110-82ef-aff030b6a026 could not be found. Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:42.966628 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:42.971734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:42.971734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:42.971734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:42.971734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:54:42.971734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:54:42.971734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3c92ffd-1477-4110-82ef-aff030b6a026 could not be found. Aug 23 17:54:42.971734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:42.971734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d8274bd-1590-4e07-9931-90518524136e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Returning 404 to user: Instance e3c92ffd-1477-4110-82ef-aff030b6a026 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:42.971734 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2d8274bd-1590-4e07-9931-90518524136e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026" status: 404 len: 111 microversion: 2.1 time: 0.076665 Aug 23 17:54:42.976001 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 551/1048] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:42 2022] GET /compute/v2.1/servers/e3c92ffd-1477-4110-82ef-aff030b6a026 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:54:42.985359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eddf0392-fa14-4d5a-8871-07acace25ac8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:42.985997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eddf0392-fa14-4d5a-8871-07acace25ac8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:43.125606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eddf0392-fa14-4d5a-8871-07acace25ac8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:43.136568 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eddf0392-fa14-4d5a-8871-07acace25ac8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1234 microversion: 2.1 time: 0.159416 Aug 23 17:54:43.137359 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 552/1049] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:42 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1234 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:43.144240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c7f7a767-9c0b-4280-9116-3a2c7fe1736e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:43.144240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7f7a767-9c0b-4280-9116-3a2c7fe1736e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:43.165362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7f7a767-9c0b-4280-9116-3a2c7fe1736e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:43.166040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7f7a767-9c0b-4280-9116-3a2c7fe1736e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:43.166689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7f7a767-9c0b-4280-9116-3a2c7fe1736e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:43.167686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7f7a767-9c0b-4280-9116-3a2c7fe1736e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:43.168224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7f7a767-9c0b-4280-9116-3a2c7fe1736e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:43.168865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7f7a767-9c0b-4280-9116-3a2c7fe1736e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:43.205148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7f7a767-9c0b-4280-9116-3a2c7fe1736e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:54:43.249148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d3c0860b-8efd-44da-8624-0df37408b317 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:43.262594 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d3c0860b-8efd-44da-8624-0df37408b317 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1316 microversion: 2.1 time: 0.438397 Aug 23 17:54:43.279436 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 498/1050] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:42 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1316 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:43.314611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:43.340846 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c7f7a767-9c0b-4280-9116-3a2c7fe1736e tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "DELETE /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 204 len: 0 microversion: 2.1 time: 0.201468 Aug 23 17:54:43.343038 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 553/1051] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:54:43 2022] DELETE /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:54:43.351783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ebec0f68-8964-4159-8b6d-ec0256478002 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:43.352541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ebec0f68-8964-4159-8b6d-ec0256478002 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:43.360728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebec0f68-8964-4159-8b6d-ec0256478002 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:43.361235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebec0f68-8964-4159-8b6d-ec0256478002 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:43.361684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebec0f68-8964-4159-8b6d-ec0256478002 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:43.362450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebec0f68-8964-4159-8b6d-ec0256478002 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:43.370158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebec0f68-8964-4159-8b6d-ec0256478002 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:43.370722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebec0f68-8964-4159-8b6d-ec0256478002 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:43.379387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:43.414647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e1e501f3-f214-44ed-9c9b-2bb14cd7c5d2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:43.415682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e1e501f3-f214-44ed-9c9b-2bb14cd7c5d2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:43.429352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1e501f3-f214-44ed-9c9b-2bb14cd7c5d2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:43.429870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1e501f3-f214-44ed-9c9b-2bb14cd7c5d2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:43.430317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1e501f3-f214-44ed-9c9b-2bb14cd7c5d2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:43.431123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1e501f3-f214-44ed-9c9b-2bb14cd7c5d2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:43.431759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1e501f3-f214-44ed-9c9b-2bb14cd7c5d2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:43.432391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1e501f3-f214-44ed-9c9b-2bb14cd7c5d2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:43.617414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e1e501f3-f214-44ed-9c9b-2bb14cd7c5d2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:43.653830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e1e501f3-f214-44ed-9c9b-2bb14cd7c5d2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:43.657859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e1e501f3-f214-44ed-9c9b-2bb14cd7c5d2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:43.659376 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e1e501f3-f214-44ed-9c9b-2bb14cd7c5d2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.249686 Aug 23 17:54:43.660584 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 554/1052] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:43 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:54:43.665351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-da364ed7-d9b0-4f28-bf03-65e1313b2ff0 req-1fe37212-3deb-44b7-aef5-74a21669dc55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4d824a1-8074-4d3e-9bbc-acc08f561753", "tag": "d1dc2eca-8039-40a2-99c0-5e25a2603b1d"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:43.684987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-da364ed7-d9b0-4f28-bf03-65e1313b2ff0 req-1fe37212-3deb-44b7-aef5-74a21669dc55 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:43.687334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ebec0f68-8964-4159-8b6d-ec0256478002 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:43.688407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-da364ed7-d9b0-4f28-bf03-65e1313b2ff0 req-1fe37212-3deb-44b7-aef5-74a21669dc55 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:43.689036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-da364ed7-d9b0-4f28-bf03-65e1313b2ff0 req-1fe37212-3deb-44b7-aef5-74a21669dc55 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:43.704632 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ebec0f68-8964-4159-8b6d-ec0256478002 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1469 microversion: 2.1 time: 0.353899 Aug 23 17:54:43.705814 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-da364ed7-d9b0-4f28-bf03-65e1313b2ff0 req-1fe37212-3deb-44b7-aef5-74a21669dc55 service nova] Creating event network-changed:d1dc2eca-8039-40a2-99c0-5e25a2603b1d for instance c4d824a1-8074-4d3e-9bbc-acc08f561753 on n-h1-850468-16 Aug 23 17:54:43.706055 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 499/1053] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:43 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1469 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:43.712281 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-da364ed7-d9b0-4f28-bf03-65e1313b2ff0 req-1fe37212-3deb-44b7-aef5-74a21669dc55 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050242 Aug 23 17:54:43.713400 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 555/1054] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:43.911823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-441b7c1a-57d3-48e4-868c-71f1c76c7a31 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:43.912463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-441b7c1a-57d3-48e4-868c-71f1c76c7a31 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:43.922770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-441b7c1a-57d3-48e4-868c-71f1c76c7a31 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:43.923379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-441b7c1a-57d3-48e4-868c-71f1c76c7a31 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:43.926123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-441b7c1a-57d3-48e4-868c-71f1c76c7a31 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:43.926938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-441b7c1a-57d3-48e4-868c-71f1c76c7a31 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:43.927459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-441b7c1a-57d3-48e4-868c-71f1c76c7a31 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:43.928116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-441b7c1a-57d3-48e4-868c-71f1c76c7a31 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:44.128826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-441b7c1a-57d3-48e4-868c-71f1c76c7a31 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:44.136791 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-441b7c1a-57d3-48e4-868c-71f1c76c7a31 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1313 microversion: 2.1 time: 0.231218 Aug 23 17:54:44.137367 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 500/1055] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:43 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:44.158673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a14b682f-5d15-42dd-83fa-7295940bb860 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:44.159380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a14b682f-5d15-42dd-83fa-7295940bb860 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:44.165548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a14b682f-5d15-42dd-83fa-7295940bb860 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:44.166033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a14b682f-5d15-42dd-83fa-7295940bb860 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:44.166475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a14b682f-5d15-42dd-83fa-7295940bb860 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:44.167193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a14b682f-5d15-42dd-83fa-7295940bb860 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:44.167652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a14b682f-5d15-42dd-83fa-7295940bb860 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:44.168077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a14b682f-5d15-42dd-83fa-7295940bb860 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:44.173652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:44.247934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a14b682f-5d15-42dd-83fa-7295940bb860 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:44.256367 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a14b682f-5d15-42dd-83fa-7295940bb860 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1286 microversion: 2.1 time: 0.102525 Aug 23 17:54:44.256944 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 556/1056] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:44 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:44.285594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a816d3b6-b31d-433a-9299-5f323f893e59 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:44.286297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a816d3b6-b31d-433a-9299-5f323f893e59 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:44.292601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a816d3b6-b31d-433a-9299-5f323f893e59 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:44.293222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a816d3b6-b31d-433a-9299-5f323f893e59 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:44.293821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a816d3b6-b31d-433a-9299-5f323f893e59 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:44.294683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a816d3b6-b31d-433a-9299-5f323f893e59 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:44.295874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a816d3b6-b31d-433a-9299-5f323f893e59 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:44.296434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a816d3b6-b31d-433a-9299-5f323f893e59 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:44.476802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-5cf470dd-a2c7-4643-aaba-3ca0d4c17062 req-442e0912-eed1-4ab3-8f59-a1d42dab8292 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3c92ffd-1477-4110-82ef-aff030b6a026", "name": "network-vif-deleted", "tag": "67c16ee5-5cef-4062-8033-6766409800d5"}, {"server_uuid": "21266578-6a91-43ab-9daf-38e646ac90c4", "name": "network-vif-unplugged", "status": "completed", "tag": "3a03ba29-b382-4f61-bc36-18987e4b2089"}, {"name": "network-changed", "server_uuid": "21266578-6a91-43ab-9daf-38e646ac90c4", "tag": "3a03ba29-b382-4f61-bc36-18987e4b2089"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:44.498709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5cf470dd-a2c7-4643-aaba-3ca0d4c17062 req-442e0912-eed1-4ab3-8f59-a1d42dab8292 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:44.500603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5cf470dd-a2c7-4643-aaba-3ca0d4c17062 req-442e0912-eed1-4ab3-8f59-a1d42dab8292 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:44.501066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5cf470dd-a2c7-4643-aaba-3ca0d4c17062 req-442e0912-eed1-4ab3-8f59-a1d42dab8292 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:44.530820 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5cf470dd-a2c7-4643-aaba-3ca0d4c17062 req-442e0912-eed1-4ab3-8f59-a1d42dab8292 service nova] Creating event network-vif-deleted:67c16ee5-5cef-4062-8033-6766409800d5 for instance e3c92ffd-1477-4110-82ef-aff030b6a026 on n-h1-850468-16 Aug 23 17:54:44.531629 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5cf470dd-a2c7-4643-aaba-3ca0d4c17062 req-442e0912-eed1-4ab3-8f59-a1d42dab8292 service nova] Creating event network-vif-unplugged:3a03ba29-b382-4f61-bc36-18987e4b2089 for instance 21266578-6a91-43ab-9daf-38e646ac90c4 on n-h2-850468-16 Aug 23 17:54:44.540603 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5cf470dd-a2c7-4643-aaba-3ca0d4c17062 req-442e0912-eed1-4ab3-8f59-a1d42dab8292 service nova] Creating event network-changed:3a03ba29-b382-4f61-bc36-18987e4b2089 for instance 21266578-6a91-43ab-9daf-38e646ac90c4 on n-h2-850468-16 Aug 23 17:54:44.550169 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-5cf470dd-a2c7-4643-aaba-3ca0d4c17062 req-442e0912-eed1-4ab3-8f59-a1d42dab8292 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 523 microversion: 2.1 time: 0.077817 Aug 23 17:54:44.551398 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 557/1057] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:44 2022] POST /compute/v2.1/os-server-external-events => generated 523 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:44.685423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b85069ec-abdb-417a-b95e-91ba37b0bc69 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:44.686776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b85069ec-abdb-417a-b95e-91ba37b0bc69 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:44.696648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b85069ec-abdb-417a-b95e-91ba37b0bc69 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:44.697409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b85069ec-abdb-417a-b95e-91ba37b0bc69 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:44.698026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b85069ec-abdb-417a-b95e-91ba37b0bc69 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:44.698943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b85069ec-abdb-417a-b95e-91ba37b0bc69 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:44.699557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b85069ec-abdb-417a-b95e-91ba37b0bc69 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:44.700144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b85069ec-abdb-417a-b95e-91ba37b0bc69 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:44.742195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a816d3b6-b31d-433a-9299-5f323f893e59 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:44.755420 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a816d3b6-b31d-433a-9299-5f323f893e59 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1316 microversion: 2.1 time: 0.473634 Aug 23 17:54:44.770093 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 501/1058] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:44 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1316 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:44.776310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-10bc024c-7402-415f-975c-66c625f362bc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:44.776936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-10bc024c-7402-415f-975c-66c625f362bc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:44.784533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10bc024c-7402-415f-975c-66c625f362bc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:44.785036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10bc024c-7402-415f-975c-66c625f362bc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:44.786058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10bc024c-7402-415f-975c-66c625f362bc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:44.787042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10bc024c-7402-415f-975c-66c625f362bc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:44.787675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10bc024c-7402-415f-975c-66c625f362bc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:44.788269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10bc024c-7402-415f-975c-66c625f362bc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:44.966776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b85069ec-abdb-417a-b95e-91ba37b0bc69 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:44.981361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b85069ec-abdb-417a-b95e-91ba37b0bc69 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:44.985083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b85069ec-abdb-417a-b95e-91ba37b0bc69 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:44.994685 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b85069ec-abdb-417a-b95e-91ba37b0bc69 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.305937 Aug 23 17:54:45.011458 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 558/1059] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:44 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:45.157940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d36e5847-b369-4f61-bbd2-103831be0de4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:45.158484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d36e5847-b369-4f61-bbd2-103831be0de4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:45.164687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d36e5847-b369-4f61-bbd2-103831be0de4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:45.165289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d36e5847-b369-4f61-bbd2-103831be0de4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:45.165609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d36e5847-b369-4f61-bbd2-103831be0de4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:45.166452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d36e5847-b369-4f61-bbd2-103831be0de4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:45.166951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d36e5847-b369-4f61-bbd2-103831be0de4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:45.167394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d36e5847-b369-4f61-bbd2-103831be0de4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:45.192776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-10bc024c-7402-415f-975c-66c625f362bc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:45.200637 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-10bc024c-7402-415f-975c-66c625f362bc tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1469 microversion: 2.1 time: 0.429321 Aug 23 17:54:45.214882 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 502/1060] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:44 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1469 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:45.279268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcb5e9ed-8ee4-42c5-85ef-d1b1873137cc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:45.280701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fcb5e9ed-8ee4-42c5-85ef-d1b1873137cc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:45.287717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcb5e9ed-8ee4-42c5-85ef-d1b1873137cc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:45.288489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcb5e9ed-8ee4-42c5-85ef-d1b1873137cc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:45.289124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcb5e9ed-8ee4-42c5-85ef-d1b1873137cc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:45.290045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcb5e9ed-8ee4-42c5-85ef-d1b1873137cc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:45.290723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcb5e9ed-8ee4-42c5-85ef-d1b1873137cc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:45.291310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcb5e9ed-8ee4-42c5-85ef-d1b1873137cc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:45.369470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d36e5847-b369-4f61-bbd2-103831be0de4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:45.379602 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d36e5847-b369-4f61-bbd2-103831be0de4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1313 microversion: 2.1 time: 0.226568 Aug 23 17:54:45.380178 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 559/1061] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:45 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1313 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:45.408903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fcb5e9ed-8ee4-42c5-85ef-d1b1873137cc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:45.419100 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fcb5e9ed-8ee4-42c5-85ef-d1b1873137cc tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1292 microversion: 2.1 time: 0.143825 Aug 23 17:54:45.419682 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 503/1062] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:45 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1292 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:45.778111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ac7ead8-972c-4995-8731-e8873f46efb3 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:45.778811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9ac7ead8-972c-4995-8731-e8873f46efb3 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:45.787020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ac7ead8-972c-4995-8731-e8873f46efb3 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:45.787517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ac7ead8-972c-4995-8731-e8873f46efb3 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:45.788695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ac7ead8-972c-4995-8731-e8873f46efb3 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:45.789674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ac7ead8-972c-4995-8731-e8873f46efb3 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:45.790341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ac7ead8-972c-4995-8731-e8873f46efb3 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:45.790966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ac7ead8-972c-4995-8731-e8873f46efb3 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:45.949127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9ac7ead8-972c-4995-8731-e8873f46efb3 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:45.956429 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9ac7ead8-972c-4995-8731-e8873f46efb3 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1316 microversion: 2.1 time: 0.183015 Aug 23 17:54:45.957118 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 560/1063] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:45 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:46.020287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a141a644-c5ca-43fa-8cc9-46bbff8b72e4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:46.021577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a141a644-c5ca-43fa-8cc9-46bbff8b72e4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:46.029971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a141a644-c5ca-43fa-8cc9-46bbff8b72e4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:46.030912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a141a644-c5ca-43fa-8cc9-46bbff8b72e4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:46.031692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a141a644-c5ca-43fa-8cc9-46bbff8b72e4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:46.032511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a141a644-c5ca-43fa-8cc9-46bbff8b72e4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:46.033077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a141a644-c5ca-43fa-8cc9-46bbff8b72e4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:46.033602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a141a644-c5ca-43fa-8cc9-46bbff8b72e4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:46.227769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e5349f91-8baa-4ad6-8815-e4eaf5bb2e4c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:46.229045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e5349f91-8baa-4ad6-8815-e4eaf5bb2e4c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:46.240321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5349f91-8baa-4ad6-8815-e4eaf5bb2e4c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:46.240821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5349f91-8baa-4ad6-8815-e4eaf5bb2e4c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:46.241651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5349f91-8baa-4ad6-8815-e4eaf5bb2e4c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:46.242625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5349f91-8baa-4ad6-8815-e4eaf5bb2e4c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:46.243809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5349f91-8baa-4ad6-8815-e4eaf5bb2e4c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:46.244731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5349f91-8baa-4ad6-8815-e4eaf5bb2e4c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:46.254833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a141a644-c5ca-43fa-8cc9-46bbff8b72e4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:46.273204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a141a644-c5ca-43fa-8cc9-46bbff8b72e4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:46.275038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a141a644-c5ca-43fa-8cc9-46bbff8b72e4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:46.277127 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a141a644-c5ca-43fa-8cc9-46bbff8b72e4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.263008 Aug 23 17:54:46.308232 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 504/1064] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:46 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:46.407944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6d355dd3-d492-46cd-95ef-4f04c1b83320 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:46.408960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6d355dd3-d492-46cd-95ef-4f04c1b83320 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:46.417264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d355dd3-d492-46cd-95ef-4f04c1b83320 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:46.417990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d355dd3-d492-46cd-95ef-4f04c1b83320 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:46.418793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d355dd3-d492-46cd-95ef-4f04c1b83320 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:46.419967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d355dd3-d492-46cd-95ef-4f04c1b83320 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:46.421696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d355dd3-d492-46cd-95ef-4f04c1b83320 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:46.422247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d355dd3-d492-46cd-95ef-4f04c1b83320 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:46.457617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5349f91-8baa-4ad6-8815-e4eaf5bb2e4c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:46.472122 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e5349f91-8baa-4ad6-8815-e4eaf5bb2e4c tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1469 microversion: 2.1 time: 0.252530 Aug 23 17:54:46.473343 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 561/1065] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:46 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1469 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:46.479944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d626a97-fc80-40a3-ace0-b4992dedaadf tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:46.480868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2d626a97-fc80-40a3-ace0-b4992dedaadf tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:46.489760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d626a97-fc80-40a3-ace0-b4992dedaadf tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:46.490395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d626a97-fc80-40a3-ace0-b4992dedaadf tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:46.490990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d626a97-fc80-40a3-ace0-b4992dedaadf tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:46.492322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d626a97-fc80-40a3-ace0-b4992dedaadf tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:46.492887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d626a97-fc80-40a3-ace0-b4992dedaadf tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:46.493421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d626a97-fc80-40a3-ace0-b4992dedaadf tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:46.674454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2d626a97-fc80-40a3-ace0-b4992dedaadf tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:46.684629 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2d626a97-fc80-40a3-ace0-b4992dedaadf tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1359 microversion: 2.1 time: 0.209871 Aug 23 17:54:46.685433 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 562/1066] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:46 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1359 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:46.811743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6d355dd3-d492-46cd-95ef-4f04c1b83320 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:46.819858 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6d355dd3-d492-46cd-95ef-4f04c1b83320 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1313 microversion: 2.1 time: 0.422406 Aug 23 17:54:46.820598 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 505/1067] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:46 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1313 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:46.980917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-139d086f-d370-4a08-83ca-b5d35c9f7f84 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:46.981829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-139d086f-d370-4a08-83ca-b5d35c9f7f84 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:46.991259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-139d086f-d370-4a08-83ca-b5d35c9f7f84 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:46.991771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-139d086f-d370-4a08-83ca-b5d35c9f7f84 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:46.992205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-139d086f-d370-4a08-83ca-b5d35c9f7f84 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:46.992909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-139d086f-d370-4a08-83ca-b5d35c9f7f84 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:46.993845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-139d086f-d370-4a08-83ca-b5d35c9f7f84 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:46.994296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-139d086f-d370-4a08-83ca-b5d35c9f7f84 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:47.191734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-139d086f-d370-4a08-83ca-b5d35c9f7f84 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:47.202579 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-139d086f-d370-4a08-83ca-b5d35c9f7f84 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1316 microversion: 2.1 time: 0.227786 Aug 23 17:54:47.203363 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 563/1068] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:46 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1316 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:47.304588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e0805329-4630-46d8-8082-6307dff24d68 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:47.305298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e0805329-4630-46d8-8082-6307dff24d68 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:47.312227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0805329-4630-46d8-8082-6307dff24d68 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:47.312818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0805329-4630-46d8-8082-6307dff24d68 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:47.313331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0805329-4630-46d8-8082-6307dff24d68 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:47.314109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0805329-4630-46d8-8082-6307dff24d68 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:47.314669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0805329-4630-46d8-8082-6307dff24d68 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:47.315168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0805329-4630-46d8-8082-6307dff24d68 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:47.494979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-09150d73-1209-4031-bb98-ef7ebcfd87d4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:47.495718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-09150d73-1209-4031-bb98-ef7ebcfd87d4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:47.503220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09150d73-1209-4031-bb98-ef7ebcfd87d4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:47.504535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09150d73-1209-4031-bb98-ef7ebcfd87d4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:47.505403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09150d73-1209-4031-bb98-ef7ebcfd87d4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:47.506312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09150d73-1209-4031-bb98-ef7ebcfd87d4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:47.506806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09150d73-1209-4031-bb98-ef7ebcfd87d4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:47.507240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09150d73-1209-4031-bb98-ef7ebcfd87d4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:47.659243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e0805329-4630-46d8-8082-6307dff24d68 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:47.669263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e0805329-4630-46d8-8082-6307dff24d68 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:47.673526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e0805329-4630-46d8-8082-6307dff24d68 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:47.675082 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e0805329-4630-46d8-8082-6307dff24d68 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.374377 Aug 23 17:54:47.676133 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 506/1069] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:47 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:47.711802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c2d9968f-0968-481d-abab-9299ba1c0833 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:47.712428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c2d9968f-0968-481d-abab-9299ba1c0833 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:47.726956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2d9968f-0968-481d-abab-9299ba1c0833 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:47.727661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2d9968f-0968-481d-abab-9299ba1c0833 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:47.728213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2d9968f-0968-481d-abab-9299ba1c0833 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:47.729090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2d9968f-0968-481d-abab-9299ba1c0833 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:47.729768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2d9968f-0968-481d-abab-9299ba1c0833 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:47.731153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2d9968f-0968-481d-abab-9299ba1c0833 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:47.894746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-09150d73-1209-4031-bb98-ef7ebcfd87d4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:47.909419 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-09150d73-1209-4031-bb98-ef7ebcfd87d4 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1469 microversion: 2.1 time: 0.418029 Aug 23 17:54:47.926961 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 564/1070] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:47 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1469 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:47.936625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-32ed7d61-f709-408a-be5b-8c4c4b9e7d0a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:47.937680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-32ed7d61-f709-408a-be5b-8c4c4b9e7d0a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:47.947651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32ed7d61-f709-408a-be5b-8c4c4b9e7d0a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:47.948902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32ed7d61-f709-408a-be5b-8c4c4b9e7d0a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:47.949509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32ed7d61-f709-408a-be5b-8c4c4b9e7d0a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:47.950384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32ed7d61-f709-408a-be5b-8c4c4b9e7d0a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:47.951024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32ed7d61-f709-408a-be5b-8c4c4b9e7d0a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:47.952499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32ed7d61-f709-408a-be5b-8c4c4b9e7d0a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:48.248939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c2d9968f-0968-481d-abab-9299ba1c0833 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:48.266466 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c2d9968f-0968-481d-abab-9299ba1c0833 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1359 microversion: 2.1 time: 0.560416 Aug 23 17:54:48.282802 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 507/1071] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:47 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1359 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:48.293181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7f78ec8b-a3c8-4144-9394-d8244083d382 req-157e7904-8120-42d8-91d7-d3144b9cd307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b3cf3a-784f-48f6-9ee3-1e98f527d4aa", "tag": "e7e8c36a-a65f-4586-97ce-22fec636459f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:48.297216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-32ed7d61-f709-408a-be5b-8c4c4b9e7d0a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:48.307563 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-32ed7d61-f709-408a-be5b-8c4c4b9e7d0a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1313 microversion: 2.1 time: 0.378027 Aug 23 17:54:48.310810 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 565/1072] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:47 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1313 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:48.316992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7f78ec8b-a3c8-4144-9394-d8244083d382 req-157e7904-8120-42d8-91d7-d3144b9cd307 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:48.318862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7f78ec8b-a3c8-4144-9394-d8244083d382 req-157e7904-8120-42d8-91d7-d3144b9cd307 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:48.320095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7f78ec8b-a3c8-4144-9394-d8244083d382 req-157e7904-8120-42d8-91d7-d3144b9cd307 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:48.333374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d443499-d2cd-43f7-89b3-e6871fdc51f5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:48.338677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d443499-d2cd-43f7-89b3-e6871fdc51f5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:48.347008 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7f78ec8b-a3c8-4144-9394-d8244083d382 req-157e7904-8120-42d8-91d7-d3144b9cd307 service nova] Creating event network-changed:e7e8c36a-a65f-4586-97ce-22fec636459f for instance 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa on n-h2-850468-16 Aug 23 17:54:48.350975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d443499-d2cd-43f7-89b3-e6871fdc51f5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:48.354946 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7f78ec8b-a3c8-4144-9394-d8244083d382 req-157e7904-8120-42d8-91d7-d3144b9cd307 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067500 Aug 23 17:54:48.355422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d443499-d2cd-43f7-89b3-e6871fdc51f5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:48.356536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d443499-d2cd-43f7-89b3-e6871fdc51f5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:48.356796 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 508/1073] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:48.357681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d443499-d2cd-43f7-89b3-e6871fdc51f5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:48.360099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d443499-d2cd-43f7-89b3-e6871fdc51f5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:48.362868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d443499-d2cd-43f7-89b3-e6871fdc51f5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:48.584263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6d443499-d2cd-43f7-89b3-e6871fdc51f5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:48.595557 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d443499-d2cd-43f7-89b3-e6871fdc51f5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1316 microversion: 2.1 time: 0.268677 Aug 23 17:54:48.606813 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 566/1074] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:48 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1316 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:48.697973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-7f00f356-e850-42bd-b7ab-6c7ba6b7415a req-b52fa3ea-5293-4c1a-b16f-eb06ee4e9c7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69a4f4f5-5f3a-4907-a471-005e1f790e8b", "name": "network-vif-deleted", "tag": "667d527b-7ec9-4bdb-951c-0b3029adcb79"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:48.698591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-94a0225e-b27b-4071-8114-c4bdb9e1426f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:48.699305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-94a0225e-b27b-4071-8114-c4bdb9e1426f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:48.710010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7f00f356-e850-42bd-b7ab-6c7ba6b7415a req-b52fa3ea-5293-4c1a-b16f-eb06ee4e9c7f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:48.710523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7f00f356-e850-42bd-b7ab-6c7ba6b7415a req-b52fa3ea-5293-4c1a-b16f-eb06ee4e9c7f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:48.711233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7f00f356-e850-42bd-b7ab-6c7ba6b7415a req-b52fa3ea-5293-4c1a-b16f-eb06ee4e9c7f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:48.719960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94a0225e-b27b-4071-8114-c4bdb9e1426f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:48.720631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94a0225e-b27b-4071-8114-c4bdb9e1426f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:48.721091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94a0225e-b27b-4071-8114-c4bdb9e1426f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:48.721852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94a0225e-b27b-4071-8114-c4bdb9e1426f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:48.722317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94a0225e-b27b-4071-8114-c4bdb9e1426f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:48.722778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94a0225e-b27b-4071-8114-c4bdb9e1426f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:48.732160 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-7f00f356-e850-42bd-b7ab-6c7ba6b7415a req-b52fa3ea-5293-4c1a-b16f-eb06ee4e9c7f service nova] Creating event network-vif-deleted:667d527b-7ec9-4bdb-951c-0b3029adcb79 for instance 69a4f4f5-5f3a-4907-a471-005e1f790e8b on n-h1-850468-16 Aug 23 17:54:48.739398 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-7f00f356-e850-42bd-b7ab-6c7ba6b7415a req-b52fa3ea-5293-4c1a-b16f-eb06ee4e9c7f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044602 Aug 23 17:54:48.740444 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 567/1075] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:54:48.933178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a372c845-2377-4a4b-8c9a-1d6ac68569f3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:48.933880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a372c845-2377-4a4b-8c9a-1d6ac68569f3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:48.941353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a372c845-2377-4a4b-8c9a-1d6ac68569f3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:48.941845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a372c845-2377-4a4b-8c9a-1d6ac68569f3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:48.942465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a372c845-2377-4a4b-8c9a-1d6ac68569f3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:48.943398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a372c845-2377-4a4b-8c9a-1d6ac68569f3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:48.944016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a372c845-2377-4a4b-8c9a-1d6ac68569f3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:48.944602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a372c845-2377-4a4b-8c9a-1d6ac68569f3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:49.018491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a372c845-2377-4a4b-8c9a-1d6ac68569f3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:49.029602 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a372c845-2377-4a4b-8c9a-1d6ac68569f3 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1427 microversion: 2.1 time: 0.100989 Aug 23 17:54:49.030935 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 568/1076] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:48 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1427 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:49.112063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-94a0225e-b27b-4071-8114-c4bdb9e1426f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:49.123508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-94a0225e-b27b-4071-8114-c4bdb9e1426f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:49.125240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-94a0225e-b27b-4071-8114-c4bdb9e1426f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:49.126706 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-94a0225e-b27b-4071-8114-c4bdb9e1426f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.432974 Aug 23 17:54:49.142503 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 509/1077] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:48 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:49.288703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-76821e4a-1975-48b5-afd8-ac87847ed99b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:49.289722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-76821e4a-1975-48b5-afd8-ac87847ed99b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:49.296738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76821e4a-1975-48b5-afd8-ac87847ed99b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:49.297531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76821e4a-1975-48b5-afd8-ac87847ed99b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:49.298306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76821e4a-1975-48b5-afd8-ac87847ed99b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:49.299204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76821e4a-1975-48b5-afd8-ac87847ed99b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:49.299957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76821e4a-1975-48b5-afd8-ac87847ed99b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:49.300397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76821e4a-1975-48b5-afd8-ac87847ed99b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:49.333564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5ca8ed82-cc2f-4757-bbe1-1fe6700e563f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:49.334190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5ca8ed82-cc2f-4757-bbe1-1fe6700e563f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:49.341230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ca8ed82-cc2f-4757-bbe1-1fe6700e563f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:49.342008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ca8ed82-cc2f-4757-bbe1-1fe6700e563f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:49.342666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ca8ed82-cc2f-4757-bbe1-1fe6700e563f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:49.343727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ca8ed82-cc2f-4757-bbe1-1fe6700e563f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:49.344340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ca8ed82-cc2f-4757-bbe1-1fe6700e563f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:49.344935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ca8ed82-cc2f-4757-bbe1-1fe6700e563f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:49.463953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-76821e4a-1975-48b5-afd8-ac87847ed99b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:49.476203 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-76821e4a-1975-48b5-afd8-ac87847ed99b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1359 microversion: 2.1 time: 0.191559 Aug 23 17:54:49.477055 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 569/1078] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:49 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1359 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:49.605620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5ca8ed82-cc2f-4757-bbe1-1fe6700e563f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:49.618389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-11e45e7e-a755-4a29-83de-b52623a9dfcd tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:49.619742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-11e45e7e-a755-4a29-83de-b52623a9dfcd tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:49.626453 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5ca8ed82-cc2f-4757-bbe1-1fe6700e563f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1313 microversion: 2.1 time: 0.296653 Aug 23 17:54:49.627351 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 510/1079] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:49 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1313 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:49.630118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-11e45e7e-a755-4a29-83de-b52623a9dfcd tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:49.630639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-11e45e7e-a755-4a29-83de-b52623a9dfcd tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:49.631248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-11e45e7e-a755-4a29-83de-b52623a9dfcd tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:49.633256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-11e45e7e-a755-4a29-83de-b52623a9dfcd tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:49.633908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-11e45e7e-a755-4a29-83de-b52623a9dfcd tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:49.635055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-11e45e7e-a755-4a29-83de-b52623a9dfcd tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:49.818045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-11e45e7e-a755-4a29-83de-b52623a9dfcd tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:49.829781 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-11e45e7e-a755-4a29-83de-b52623a9dfcd tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1316 microversion: 2.1 time: 0.215337 Aug 23 17:54:49.830591 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 570/1080] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:49 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:49.888801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-eac333f3-bf07-47e7-b567-dcffbc930ab5 req-0f32607e-a4c9-4f00-a184-51ee5757eae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "856ac0cb-cfb2-43f5-9e4f-df662c38f02d", "name": "network-vif-plugged", "status": "completed", "tag": "a3f7e262-db57-4792-9f23-2fbc005cd02a"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:49.906702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eac333f3-bf07-47e7-b567-dcffbc930ab5 req-0f32607e-a4c9-4f00-a184-51ee5757eae4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:49.907295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eac333f3-bf07-47e7-b567-dcffbc930ab5 req-0f32607e-a4c9-4f00-a184-51ee5757eae4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:49.907805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eac333f3-bf07-47e7-b567-dcffbc930ab5 req-0f32607e-a4c9-4f00-a184-51ee5757eae4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:49.920968 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-eac333f3-bf07-47e7-b567-dcffbc930ab5 req-0f32607e-a4c9-4f00-a184-51ee5757eae4 service nova] Creating event network-vif-plugged:a3f7e262-db57-4792-9f23-2fbc005cd02a for instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d on n-h1-850468-16 Aug 23 17:54:49.928518 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-eac333f3-bf07-47e7-b567-dcffbc930ab5 req-0f32607e-a4c9-4f00-a184-51ee5757eae4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047020 Aug 23 17:54:49.930211 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 511/1081] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:50.051342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-739cbe08-be83-4b2a-bccd-45846548bb23 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:50.051955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-739cbe08-be83-4b2a-bccd-45846548bb23 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:50.058905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-739cbe08-be83-4b2a-bccd-45846548bb23 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:50.059653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-739cbe08-be83-4b2a-bccd-45846548bb23 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:50.060087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-739cbe08-be83-4b2a-bccd-45846548bb23 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:50.060791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-739cbe08-be83-4b2a-bccd-45846548bb23 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:50.061496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-739cbe08-be83-4b2a-bccd-45846548bb23 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:50.062086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-739cbe08-be83-4b2a-bccd-45846548bb23 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:50.135776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-739cbe08-be83-4b2a-bccd-45846548bb23 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:50.145383 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-739cbe08-be83-4b2a-bccd-45846548bb23 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1427 microversion: 2.1 time: 0.097877 Aug 23 17:54:50.145958 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 571/1082] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:50 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1427 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:50.149714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-492f0d1b-2154-4d9f-b2c4-a4d647b6fa51 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:50.150657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-492f0d1b-2154-4d9f-b2c4-a4d647b6fa51 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:50.152806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:50.159252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-492f0d1b-2154-4d9f-b2c4-a4d647b6fa51 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:50.159747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-492f0d1b-2154-4d9f-b2c4-a4d647b6fa51 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:50.160183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-492f0d1b-2154-4d9f-b2c4-a4d647b6fa51 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:50.160895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-492f0d1b-2154-4d9f-b2c4-a4d647b6fa51 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:50.161347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-492f0d1b-2154-4d9f-b2c4-a4d647b6fa51 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:50.161772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-492f0d1b-2154-4d9f-b2c4-a4d647b6fa51 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:50.403288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-492f0d1b-2154-4d9f-b2c4-a4d647b6fa51 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:50.417124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-492f0d1b-2154-4d9f-b2c4-a4d647b6fa51 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:50.419014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-492f0d1b-2154-4d9f-b2c4-a4d647b6fa51 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:50.420469 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-492f0d1b-2154-4d9f-b2c4-a4d647b6fa51 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.275012 Aug 23 17:54:50.421573 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 512/1083] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:50 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:54:50.498492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eabe58dd-2518-4363-adfd-bf30f89354ec tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:50.499203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eabe58dd-2518-4363-adfd-bf30f89354ec tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:50.505561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eabe58dd-2518-4363-adfd-bf30f89354ec tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:50.506047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eabe58dd-2518-4363-adfd-bf30f89354ec tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:50.506483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eabe58dd-2518-4363-adfd-bf30f89354ec tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:50.507391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eabe58dd-2518-4363-adfd-bf30f89354ec tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:50.507800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eabe58dd-2518-4363-adfd-bf30f89354ec tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:50.508246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eabe58dd-2518-4363-adfd-bf30f89354ec tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:50.650142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-43b103f6-4beb-435c-a130-b6fb4a5f7c1b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:50.650947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-43b103f6-4beb-435c-a130-b6fb4a5f7c1b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:50.662308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eabe58dd-2518-4363-adfd-bf30f89354ec tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:50.665378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43b103f6-4beb-435c-a130-b6fb4a5f7c1b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:50.665998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43b103f6-4beb-435c-a130-b6fb4a5f7c1b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:50.666945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43b103f6-4beb-435c-a130-b6fb4a5f7c1b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:50.667919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43b103f6-4beb-435c-a130-b6fb4a5f7c1b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:50.668603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43b103f6-4beb-435c-a130-b6fb4a5f7c1b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:50.669251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43b103f6-4beb-435c-a130-b6fb4a5f7c1b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:50.671178 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eabe58dd-2518-4363-adfd-bf30f89354ec tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1359 microversion: 2.1 time: 0.176924 Aug 23 17:54:50.671784 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 572/1084] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:50 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:50.852758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91e9b91f-4019-49d2-ba1b-ff0b8de772ce tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:50.853485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-91e9b91f-4019-49d2-ba1b-ff0b8de772ce tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:50.860887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91e9b91f-4019-49d2-ba1b-ff0b8de772ce tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:50.862132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91e9b91f-4019-49d2-ba1b-ff0b8de772ce tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:50.862685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91e9b91f-4019-49d2-ba1b-ff0b8de772ce tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:50.864307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91e9b91f-4019-49d2-ba1b-ff0b8de772ce tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:50.864307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91e9b91f-4019-49d2-ba1b-ff0b8de772ce tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:50.864701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91e9b91f-4019-49d2-ba1b-ff0b8de772ce tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:51.030101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-91e9b91f-4019-49d2-ba1b-ff0b8de772ce tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:51.031707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-43b103f6-4beb-435c-a130-b6fb4a5f7c1b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:51.039609 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-91e9b91f-4019-49d2-ba1b-ff0b8de772ce tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1316 microversion: 2.1 time: 0.191725 Aug 23 17:54:51.040359 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 573/1085] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:50 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1316 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:51.053458 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-43b103f6-4beb-435c-a130-b6fb4a5f7c1b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1313 microversion: 2.1 time: 0.400266 Aug 23 17:54:51.054685 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 513/1086] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:50 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1313 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:51.168527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96ecbc9d-ef1c-440a-98b9-9e21c687c276 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:51.169424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-96ecbc9d-ef1c-440a-98b9-9e21c687c276 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:51.179070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96ecbc9d-ef1c-440a-98b9-9e21c687c276 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:51.179848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96ecbc9d-ef1c-440a-98b9-9e21c687c276 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:51.181731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96ecbc9d-ef1c-440a-98b9-9e21c687c276 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:51.182778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96ecbc9d-ef1c-440a-98b9-9e21c687c276 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:51.183745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96ecbc9d-ef1c-440a-98b9-9e21c687c276 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:51.184413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96ecbc9d-ef1c-440a-98b9-9e21c687c276 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:51.190985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:51.268659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-96ecbc9d-ef1c-440a-98b9-9e21c687c276 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:51.277453 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-96ecbc9d-ef1c-440a-98b9-9e21c687c276 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1427 microversion: 2.1 time: 0.113689 Aug 23 17:54:51.278235 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 574/1087] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:51 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1427 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:51.443172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a6fbba0-3cd1-4645-9e7a-cb2493ba6b9f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:51.443844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6a6fbba0-3cd1-4645-9e7a-cb2493ba6b9f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:51.450709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a6fbba0-3cd1-4645-9e7a-cb2493ba6b9f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:51.451524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a6fbba0-3cd1-4645-9e7a-cb2493ba6b9f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:51.452390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a6fbba0-3cd1-4645-9e7a-cb2493ba6b9f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:51.453344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a6fbba0-3cd1-4645-9e7a-cb2493ba6b9f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:51.453967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a6fbba0-3cd1-4645-9e7a-cb2493ba6b9f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:51.454621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a6fbba0-3cd1-4645-9e7a-cb2493ba6b9f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:51.693895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-af3f676b-2e4a-40d1-9430-46ec9070ae45 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:51.700474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6a6fbba0-3cd1-4645-9e7a-cb2493ba6b9f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:51.705937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-af3f676b-2e4a-40d1-9430-46ec9070ae45 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:51.718182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6a6fbba0-3cd1-4645-9e7a-cb2493ba6b9f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:51.721552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af3f676b-2e4a-40d1-9430-46ec9070ae45 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:51.722243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af3f676b-2e4a-40d1-9430-46ec9070ae45 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:51.726184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af3f676b-2e4a-40d1-9430-46ec9070ae45 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:51.727148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af3f676b-2e4a-40d1-9430-46ec9070ae45 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:51.736868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6a6fbba0-3cd1-4645-9e7a-cb2493ba6b9f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:51.740578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af3f676b-2e4a-40d1-9430-46ec9070ae45 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:51.742923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af3f676b-2e4a-40d1-9430-46ec9070ae45 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:51.747248 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6a6fbba0-3cd1-4645-9e7a-cb2493ba6b9f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.303113 Aug 23 17:54:51.749051 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 514/1088] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:51 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:52.062527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-203817e2-02e6-4e3b-b8fa-cc968f7d7f30 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:52.063760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-203817e2-02e6-4e3b-b8fa-cc968f7d7f30 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:52.073731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-203817e2-02e6-4e3b-b8fa-cc968f7d7f30 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:52.074576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-203817e2-02e6-4e3b-b8fa-cc968f7d7f30 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:52.075760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-203817e2-02e6-4e3b-b8fa-cc968f7d7f30 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:52.076997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-203817e2-02e6-4e3b-b8fa-cc968f7d7f30 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:52.077693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-203817e2-02e6-4e3b-b8fa-cc968f7d7f30 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:52.078848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-203817e2-02e6-4e3b-b8fa-cc968f7d7f30 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:52.079636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-af3f676b-2e4a-40d1-9430-46ec9070ae45 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:52.106087 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-af3f676b-2e4a-40d1-9430-46ec9070ae45 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1359 microversion: 2.1 time: 0.418278 Aug 23 17:54:52.106726 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 575/1089] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:51 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1359 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:52.118841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7a9196c5-c1fd-4dad-bafe-2ab5279caf3f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:52.119663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7a9196c5-c1fd-4dad-bafe-2ab5279caf3f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:52.130720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9196c5-c1fd-4dad-bafe-2ab5279caf3f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:52.131628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9196c5-c1fd-4dad-bafe-2ab5279caf3f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:52.132284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9196c5-c1fd-4dad-bafe-2ab5279caf3f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:52.133237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9196c5-c1fd-4dad-bafe-2ab5279caf3f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:52.134216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9196c5-c1fd-4dad-bafe-2ab5279caf3f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:52.134888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9196c5-c1fd-4dad-bafe-2ab5279caf3f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:52.593594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-203817e2-02e6-4e3b-b8fa-cc968f7d7f30 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:52.603129 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-203817e2-02e6-4e3b-b8fa-cc968f7d7f30 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1316 microversion: 2.1 time: 0.546678 Aug 23 17:54:52.617514 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 515/1090] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:52 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1316 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:52.626451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:52.627179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:52.640339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:52.641118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:52.642257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:52.643881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:52.644390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:52.645112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:52.671301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7a9196c5-c1fd-4dad-bafe-2ab5279caf3f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:52.681391 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7a9196c5-c1fd-4dad-bafe-2ab5279caf3f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1313 microversion: 2.1 time: 0.571283 Aug 23 17:54:52.682772 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 576/1091] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:52 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1313 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:52.685644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:52.687375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:52.687917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:52.688562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lazy-loading 'fault' on Instance uuid 69a4f4f5-5f3a-4907-a471-005e1f790e8b {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:54:52.694962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:52.736766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=16 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:52.777023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66245056-8ea2-4474-87bf-803c0dc5d60c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:52.778220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66245056-8ea2-4474-87bf-803c0dc5d60c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:52.786451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66245056-8ea2-4474-87bf-803c0dc5d60c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:52.787199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66245056-8ea2-4474-87bf-803c0dc5d60c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:52.787805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66245056-8ea2-4474-87bf-803c0dc5d60c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:52.788704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66245056-8ea2-4474-87bf-803c0dc5d60c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:52.789316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66245056-8ea2-4474-87bf-803c0dc5d60c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:52.789918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66245056-8ea2-4474-87bf-803c0dc5d60c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:52.801620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd81796ff5b934d218c1b967b8c0f9882', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c5a1c94aed149c489a20be456895034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:52.808182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:52.816195 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-13e01f48-2586-4ce6-add8-a91af7078d45 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 200 len: 1303 microversion: 2.1 time: 0.192138 Aug 23 17:54:52.818401 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 516/1092] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:52 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 1303 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:53.103285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66245056-8ea2-4474-87bf-803c0dc5d60c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:53.115606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66245056-8ea2-4474-87bf-803c0dc5d60c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:53.117152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66245056-8ea2-4474-87bf-803c0dc5d60c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:53.124308 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66245056-8ea2-4474-87bf-803c0dc5d60c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.345663 Aug 23 17:54:53.125837 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 577/1093] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:52 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:54:53.130268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d47db41f-1b08-4f7c-aa0d-dbedc8f2ec5a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:53.130967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d47db41f-1b08-4f7c-aa0d-dbedc8f2ec5a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:53.142388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d47db41f-1b08-4f7c-aa0d-dbedc8f2ec5a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:53.142852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d47db41f-1b08-4f7c-aa0d-dbedc8f2ec5a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:53.143297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d47db41f-1b08-4f7c-aa0d-dbedc8f2ec5a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:53.144017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d47db41f-1b08-4f7c-aa0d-dbedc8f2ec5a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:53.144469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d47db41f-1b08-4f7c-aa0d-dbedc8f2ec5a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:53.148298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d47db41f-1b08-4f7c-aa0d-dbedc8f2ec5a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:53.602335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d47db41f-1b08-4f7c-aa0d-dbedc8f2ec5a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:53.613465 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d47db41f-1b08-4f7c-aa0d-dbedc8f2ec5a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1359 microversion: 2.1 time: 0.487451 Aug 23 17:54:53.618416 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 517/1094] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:53 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1359 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:53.621788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:53.650812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d7eee3a8-3568-4a62-bbc8-8e6b26ec86d8 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:53.651445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d7eee3a8-3568-4a62-bbc8-8e6b26ec86d8 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:53.662595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7eee3a8-3568-4a62-bbc8-8e6b26ec86d8 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:53.664152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7eee3a8-3568-4a62-bbc8-8e6b26ec86d8 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:53.664938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7eee3a8-3568-4a62-bbc8-8e6b26ec86d8 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:53.665864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7eee3a8-3568-4a62-bbc8-8e6b26ec86d8 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:53.666499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7eee3a8-3568-4a62-bbc8-8e6b26ec86d8 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:53.667103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7eee3a8-3568-4a62-bbc8-8e6b26ec86d8 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:53.704484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fe2462ba-57ea-4ce5-8964-1653ef530fca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:53.705367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fe2462ba-57ea-4ce5-8964-1653ef530fca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:53.713942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe2462ba-57ea-4ce5-8964-1653ef530fca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:53.718076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe2462ba-57ea-4ce5-8964-1653ef530fca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:53.718817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe2462ba-57ea-4ce5-8964-1653ef530fca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:53.722509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe2462ba-57ea-4ce5-8964-1653ef530fca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:53.725243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe2462ba-57ea-4ce5-8964-1653ef530fca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:53.726166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe2462ba-57ea-4ce5-8964-1653ef530fca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:53.922366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d7eee3a8-3568-4a62-bbc8-8e6b26ec86d8 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:53.934262 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d7eee3a8-3568-4a62-bbc8-8e6b26ec86d8 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1316 microversion: 2.1 time: 0.312902 Aug 23 17:54:53.938501 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 578/1095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:53 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1316 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:53.957893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97da6f36-a908-4e90-99bc-38e1919ba363 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:53.958593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-97da6f36-a908-4e90-99bc-38e1919ba363 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] [instance: 69a4f4f5-5f3a-4907-a471-005e1f790e8b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:53.978470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97da6f36-a908-4e90-99bc-38e1919ba363 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:53.979551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97da6f36-a908-4e90-99bc-38e1919ba363 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:53.980412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97da6f36-a908-4e90-99bc-38e1919ba363 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:53.981543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97da6f36-a908-4e90-99bc-38e1919ba363 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:53.982262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97da6f36-a908-4e90-99bc-38e1919ba363 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:53.983502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97da6f36-a908-4e90-99bc-38e1919ba363 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:54.006362 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-97da6f36-a908-4e90-99bc-38e1919ba363 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] HTTP exception thrown: Instance 69a4f4f5-5f3a-4907-a471-005e1f790e8b could not be found. Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97da6f36-a908-4e90-99bc-38e1919ba363 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Request method failure captured: Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b HTTP/1.1 Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPBfuKQwdprs3Tli4dXoJZynp5FCB9H1q_O3fpjLaohBvtSQd4rxC9-h4-c6OpBv8JgW7Wm2673yFnfE3qIrrCCl3dW2uZ3BuPRqAEbVfBtcWfVvHZ3SfSaZ6DCQJBUcSIOevCi4uILfiYmtJuyO7QGGgvuutq6HYs9iRO-ut_0-3A Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 5c5a1c94aed149c489a20be456895034 Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersAdminTestJSON-657395626 Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5c5a1c94aed149c489a20be456895034"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c5a1c94aed149c489a20be456895034"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5c5a1c94aed149c489a20be456895034"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5c5a1c94aed149c489a20be456895034"}]}] Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersAdminTestJSON-657395626 Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 5c5a1c94aed149c489a20be456895034 Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersAdminTestJSON-657395626 Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersAdminTestJSON-657395626-project Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: d81796ff5b934d218c1b967b8c0f9882 Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersAdminTestJSON-657395626-project Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 69a4f4f5-5f3a-4907-a471-005e1f790e8b could not be found. Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '69a4f4f5-5f3a-4907-a471-005e1f790e8b'} Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69a4f4f5-5f3a-4907-a471-005e1f790e8b could not be found. Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69a4f4f5-5f3a-4907-a471-005e1f790e8b could not be found. Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:54:54.012479 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:54.016537 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:54:54.016537 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:54:54.016537 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:54:54.016537 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:54:54.016537 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:54:54.016537 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69a4f4f5-5f3a-4907-a471-005e1f790e8b could not be found. Aug 23 17:54:54.016537 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:54:54.018574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97da6f36-a908-4e90-99bc-38e1919ba363 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] Returning 404 to user: Instance 69a4f4f5-5f3a-4907-a471-005e1f790e8b could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:54:54.019559 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-97da6f36-a908-4e90-99bc-38e1919ba363 tempest-ServersAdminTestJSON-657395626 tempest-ServersAdminTestJSON-657395626-project] 10.222.0.61 "GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b" status: 404 len: 111 microversion: 2.1 time: 0.079883 Aug 23 17:54:54.020555 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 579/1096] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:53 2022] GET /compute/v2.1/servers/69a4f4f5-5f3a-4907-a471-005e1f790e8b => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:54:54.043048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fe2462ba-57ea-4ce5-8964-1653ef530fca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:54.054942 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fe2462ba-57ea-4ce5-8964-1653ef530fca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1463 microversion: 2.1 time: 0.355342 Aug 23 17:54:54.056182 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 518/1097] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:53 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1463 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:54.078515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:54.081015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:54.097310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:54.097811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:54.098250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:54.098991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:54.099444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:54.099863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:54.149938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4d06d011-56b4-4c9d-b503-d8b52befd616 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:54.150586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4d06d011-56b4-4c9d-b503-d8b52befd616 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:54.166781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d06d011-56b4-4c9d-b503-d8b52befd616 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:54.167664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d06d011-56b4-4c9d-b503-d8b52befd616 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:54.168277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d06d011-56b4-4c9d-b503-d8b52befd616 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:54.172369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d06d011-56b4-4c9d-b503-d8b52befd616 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:54.186754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d06d011-56b4-4c9d-b503-d8b52befd616 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:54.187423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d06d011-56b4-4c9d-b503-d8b52befd616 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:54.375480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:54.382191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Old instance type m1.heat2, new instance type m1.heat {{(pid=128807) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 17:54:54.402920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:54:54.403344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:54:54.404233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:54:54.405603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:54:54.406174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:54:54.479574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4d06d011-56b4-4c9d-b503-d8b52befd616 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:54.505982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4d06d011-56b4-4c9d-b503-d8b52befd616 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:54.518837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4d06d011-56b4-4c9d-b503-d8b52befd616 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:54.531250 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4d06d011-56b4-4c9d-b503-d8b52befd616 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.383077 Aug 23 17:54:54.534570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 519/1098] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:54 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:54.551814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8a23b2ae-76e6-4bcf-bf0a-1963f8e7de69 req-cb1da73d-04e8-4bf2-ac0d-b8ad6c2ea2b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b3cf3a-784f-48f6-9ee3-1e98f527d4aa", "name": "network-vif-plugged", "status": "completed", "tag": "e7e8c36a-a65f-4586-97ce-22fec636459f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:54.579170 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5028aad2-daee-4da6-be3a-ca4b6708d793 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "POST /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d/action" status: 202 len: 0 microversion: 2.1 time: 0.504786 Aug 23 17:54:54.580090 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 580/1099] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:54:54 2022] POST /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:54:54.599494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ba58d059-c27b-4728-a40d-b5eb1b778fa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:54.600122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ba58d059-c27b-4728-a40d-b5eb1b778fa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:54.604516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8a23b2ae-76e6-4bcf-bf0a-1963f8e7de69 req-cb1da73d-04e8-4bf2-ac0d-b8ad6c2ea2b9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:54.605088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8a23b2ae-76e6-4bcf-bf0a-1963f8e7de69 req-cb1da73d-04e8-4bf2-ac0d-b8ad6c2ea2b9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:54.605481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8a23b2ae-76e6-4bcf-bf0a-1963f8e7de69 req-cb1da73d-04e8-4bf2-ac0d-b8ad6c2ea2b9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:54.621343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba58d059-c27b-4728-a40d-b5eb1b778fa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:54.633486 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8a23b2ae-76e6-4bcf-bf0a-1963f8e7de69 req-cb1da73d-04e8-4bf2-ac0d-b8ad6c2ea2b9 service nova] Creating event network-vif-plugged:e7e8c36a-a65f-4586-97ce-22fec636459f for instance 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa on n-h2-850468-16 Aug 23 17:54:54.635713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba58d059-c27b-4728-a40d-b5eb1b778fa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:54.640691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba58d059-c27b-4728-a40d-b5eb1b778fa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:54.644283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba58d059-c27b-4728-a40d-b5eb1b778fa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:54.644946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba58d059-c27b-4728-a40d-b5eb1b778fa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:54.645565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba58d059-c27b-4728-a40d-b5eb1b778fa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:54.676235 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8a23b2ae-76e6-4bcf-bf0a-1963f8e7de69 req-cb1da73d-04e8-4bf2-ac0d-b8ad6c2ea2b9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139543 Aug 23 17:54:54.678254 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 520/1100] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:54.698030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00c219bc-2a25-4d53-bd33-dc719fe19f56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:54.700862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-00c219bc-2a25-4d53-bd33-dc719fe19f56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:54.718292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00c219bc-2a25-4d53-bd33-dc719fe19f56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:54.720180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00c219bc-2a25-4d53-bd33-dc719fe19f56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:54.722166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00c219bc-2a25-4d53-bd33-dc719fe19f56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:54.725226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00c219bc-2a25-4d53-bd33-dc719fe19f56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:54.726310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00c219bc-2a25-4d53-bd33-dc719fe19f56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:54.729226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00c219bc-2a25-4d53-bd33-dc719fe19f56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:55.100932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ba58d059-c27b-4728-a40d-b5eb1b778fa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:55.121952 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ba58d059-c27b-4728-a40d-b5eb1b778fa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1472 microversion: 2.1 time: 0.537704 Aug 23 17:54:55.125685 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 581/1101] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:54 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1472 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:55.130491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-00c219bc-2a25-4d53-bd33-dc719fe19f56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:55.138198 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-00c219bc-2a25-4d53-bd33-dc719fe19f56 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1359 microversion: 2.1 time: 0.457647 Aug 23 17:54:55.149869 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 521/1102] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:54 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1359 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:55.155370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4dfb10c9-aeea-4088-b245-523523ea4b57 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:55.156056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4dfb10c9-aeea-4088-b245-523523ea4b57 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:55.176474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4dfb10c9-aeea-4088-b245-523523ea4b57 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:55.176891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4dfb10c9-aeea-4088-b245-523523ea4b57 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:55.177328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4dfb10c9-aeea-4088-b245-523523ea4b57 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:55.178045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4dfb10c9-aeea-4088-b245-523523ea4b57 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:55.178493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4dfb10c9-aeea-4088-b245-523523ea4b57 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:55.178938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4dfb10c9-aeea-4088-b245-523523ea4b57 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:55.361148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4dfb10c9-aeea-4088-b245-523523ea4b57 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:55.370515 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4dfb10c9-aeea-4088-b245-523523ea4b57 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1316 microversion: 2.1 time: 0.219274 Aug 23 17:54:55.371173 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 522/1103] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:55 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1316 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:55.381088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-1084979376", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "23eba81b-4095-440f-9de1-ccc65be55345"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:55.452961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] validate_networks() for [('23eba81b-4095-440f-9de1-ccc65be55345', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:54:55.557362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c627a0c5-5d53-4e54-a6b4-d1904a43fbff tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:55.557973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c627a0c5-5d53-4e54-a6b4-d1904a43fbff tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:55.567682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c627a0c5-5d53-4e54-a6b4-d1904a43fbff tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:55.572388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c627a0c5-5d53-4e54-a6b4-d1904a43fbff tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:55.573107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c627a0c5-5d53-4e54-a6b4-d1904a43fbff tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:55.574072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c627a0c5-5d53-4e54-a6b4-d1904a43fbff tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:55.575727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c627a0c5-5d53-4e54-a6b4-d1904a43fbff tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:55.582681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c627a0c5-5d53-4e54-a6b4-d1904a43fbff tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:55.968520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c627a0c5-5d53-4e54-a6b4-d1904a43fbff tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:55.982284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c627a0c5-5d53-4e54-a6b4-d1904a43fbff tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:55.984796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c627a0c5-5d53-4e54-a6b4-d1904a43fbff tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:55.986910 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c627a0c5-5d53-4e54-a6b4-d1904a43fbff tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1567 microversion: 2.25 time: 0.433314 Aug 23 17:54:55.988163 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 523/1104] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:55 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1567 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:54:56.145046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dfe8f136-d126-4235-9594-08f746c1ce41 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:56.145823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dfe8f136-d126-4235-9594-08f746c1ce41 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:56.157615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfe8f136-d126-4235-9594-08f746c1ce41 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:56.158278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfe8f136-d126-4235-9594-08f746c1ce41 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:56.158847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfe8f136-d126-4235-9594-08f746c1ce41 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:56.159691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfe8f136-d126-4235-9594-08f746c1ce41 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:56.160248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfe8f136-d126-4235-9594-08f746c1ce41 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:56.161438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfe8f136-d126-4235-9594-08f746c1ce41 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:56.221536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:54:56.222103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:54:56.222902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:54:56.223576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:54:56.224080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:54:56.247504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:56.249070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:56.250036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:56.250974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:56.251669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:56.252266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:56.282257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Getting quotas for project 97827eb64dfd4e6e8adb0cb27df60f0a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:56.290090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Getting quotas for user 9d51f46cd65a4722afb17a02357ef8bb and project 97827eb64dfd4e6e8adb0cb27df60f0a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:56.318294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Going to run 2 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:54:56.323968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: ed0f5323-e9ef-48c9-91fa-3b500fc05057] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:54:56.369273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=ed0f5323-e9ef-48c9-91fa-3b500fc05057,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:54:56.434511 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4777c3fb-32cd-4dae-adc9-949136c2fc84 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.306402 Aug 23 17:54:56.435523 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 582/1105] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:54:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:54:56.440361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-23cf4177-f33d-45fd-ab86-51ee30c0875a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:56.440982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-23cf4177-f33d-45fd-ab86-51ee30c0875a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:56.448111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23cf4177-f33d-45fd-ab86-51ee30c0875a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:56.448598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23cf4177-f33d-45fd-ab86-51ee30c0875a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:56.449034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23cf4177-f33d-45fd-ab86-51ee30c0875a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:56.449742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23cf4177-f33d-45fd-ab86-51ee30c0875a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:56.450379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23cf4177-f33d-45fd-ab86-51ee30c0875a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:56.451045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23cf4177-f33d-45fd-ab86-51ee30c0875a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:56.502833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dfe8f136-d126-4235-9594-08f746c1ce41 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:56.510644 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dfe8f136-d126-4235-9594-08f746c1ce41 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1472 microversion: 2.1 time: 0.369474 Aug 23 17:54:56.513150 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 524/1106] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:56 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1472 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:56.519155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1efaa4af-49aa-4a80-ad0d-b8a2fadc50f4 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:56.521577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1efaa4af-49aa-4a80-ad0d-b8a2fadc50f4 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:56.529108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1efaa4af-49aa-4a80-ad0d-b8a2fadc50f4 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:56.530988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1efaa4af-49aa-4a80-ad0d-b8a2fadc50f4 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:56.531735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1efaa4af-49aa-4a80-ad0d-b8a2fadc50f4 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:56.532669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1efaa4af-49aa-4a80-ad0d-b8a2fadc50f4 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:56.533351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1efaa4af-49aa-4a80-ad0d-b8a2fadc50f4 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:56.533954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1efaa4af-49aa-4a80-ad0d-b8a2fadc50f4 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:56.767279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1efaa4af-49aa-4a80-ad0d-b8a2fadc50f4 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:56.776841 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1efaa4af-49aa-4a80-ad0d-b8a2fadc50f4 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1316 microversion: 2.1 time: 0.260559 Aug 23 17:54:56.777700 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 525/1107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:56 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1316 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:56.785685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d487b85b-898c-4ffc-b97a-30154dc18181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:56.792141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d487b85b-898c-4ffc-b97a-30154dc18181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:56.793469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d487b85b-898c-4ffc-b97a-30154dc18181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Searching by: {'deleted': False, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:54:56.819991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d487b85b-898c-4ffc-b97a-30154dc18181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:56.820839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d487b85b-898c-4ffc-b97a-30154dc18181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:56.821493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d487b85b-898c-4ffc-b97a-30154dc18181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:56.823539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d487b85b-898c-4ffc-b97a-30154dc18181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:56.824672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d487b85b-898c-4ffc-b97a-30154dc18181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:56.825341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d487b85b-898c-4ffc-b97a-30154dc18181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:56.921327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-23cf4177-f33d-45fd-ab86-51ee30c0875a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:56.929025 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d487b85b-898c-4ffc-b97a-30154dc18181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 677 microversion: 2.1 time: 0.149403 Aug 23 17:54:56.930127 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 526/1108] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 17:54:56 2022] GET /compute/v2.1/servers => generated 677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:56.939378 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-23cf4177-f33d-45fd-ab86-51ee30c0875a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1359 microversion: 2.1 time: 0.502310 Aug 23 17:54:56.940014 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 583/1109] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:56 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1359 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:56.942690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8334cbfa-aaad-478f-9fb8-c28d853e1aff req-d31b5db4-bcb2-4bf2-9148-75dad4442758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d824a1-8074-4d3e-9bbc-acc08f561753", "name": "network-vif-plugged", "status": "completed", "tag": "d1dc2eca-8039-40a2-99c0-5e25a2603b1d"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:56.949807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aecda81c-f33f-4a2a-9ff2-a54925ccdf28 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:56.950715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aecda81c-f33f-4a2a-9ff2-a54925ccdf28 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:56.981355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8334cbfa-aaad-478f-9fb8-c28d853e1aff req-d31b5db4-bcb2-4bf2-9148-75dad4442758 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:56.981917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8334cbfa-aaad-478f-9fb8-c28d853e1aff req-d31b5db4-bcb2-4bf2-9148-75dad4442758 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:56.984492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8334cbfa-aaad-478f-9fb8-c28d853e1aff req-d31b5db4-bcb2-4bf2-9148-75dad4442758 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:57.004349 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8334cbfa-aaad-478f-9fb8-c28d853e1aff req-d31b5db4-bcb2-4bf2-9148-75dad4442758 service nova] Creating event network-vif-plugged:d1dc2eca-8039-40a2-99c0-5e25a2603b1d for instance c4d824a1-8074-4d3e-9bbc-acc08f561753 on n-h1-850468-16 Aug 23 17:54:57.010401 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8334cbfa-aaad-478f-9fb8-c28d853e1aff req-d31b5db4-bcb2-4bf2-9148-75dad4442758 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078072 Aug 23 17:54:57.011337 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 527/1110] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:57.017668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2dfc7bee-fb35-435c-b929-7a5f494ee833 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:57.018887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2dfc7bee-fb35-435c-b929-7a5f494ee833 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:57.025401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2dfc7bee-fb35-435c-b929-7a5f494ee833 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:57.026246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2dfc7bee-fb35-435c-b929-7a5f494ee833 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:57.026960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2dfc7bee-fb35-435c-b929-7a5f494ee833 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:57.031768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2dfc7bee-fb35-435c-b929-7a5f494ee833 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:57.033132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2dfc7bee-fb35-435c-b929-7a5f494ee833 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:57.036090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2dfc7bee-fb35-435c-b929-7a5f494ee833 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:57.077041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aecda81c-f33f-4a2a-9ff2-a54925ccdf28 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:57.085803 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aecda81c-f33f-4a2a-9ff2-a54925ccdf28 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1220 microversion: 2.1 time: 0.141211 Aug 23 17:54:57.087077 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 584/1111] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:56 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1220 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:57.225907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2dfc7bee-fb35-435c-b929-7a5f494ee833 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:57.236539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2dfc7bee-fb35-435c-b929-7a5f494ee833 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:57.242005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2dfc7bee-fb35-435c-b929-7a5f494ee833 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:57.248950 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2dfc7bee-fb35-435c-b929-7a5f494ee833 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1542 microversion: 2.25 time: 0.235366 Aug 23 17:54:57.249479 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 528/1112] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:57 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1542 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:57.270866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d3731be2-dab2-425b-9b67-cf5d45f3091f tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '.version_select at 0x7f27ec958670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:57.277635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d3731be2-dab2-425b-9b67-cf5d45f3091f tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:57.278084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d3731be2-dab2-425b-9b67-cf5d45f3091f tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:57.278517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d3731be2-dab2-425b-9b67-cf5d45f3091f tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:57.310063 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d3731be2-dab2-425b-9b67-cf5d45f3091f tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 2813 microversion: 2.25 time: 0.042974 Aug 23 17:54:57.311706 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 585/1113] 10.222.0.61 () {60 vars in 1184 bytes} [Tue Aug 23 17:54:57 2022] GET /compute/v2.1/os-migrations => generated 2813 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:57.332486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-20d398fe-0bca-49df-b482-0bd1d9ef381b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:57.333782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-20d398fe-0bca-49df-b482-0bd1d9ef381b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:57.342343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20d398fe-0bca-49df-b482-0bd1d9ef381b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:57.343710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20d398fe-0bca-49df-b482-0bd1d9ef381b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:57.344503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20d398fe-0bca-49df-b482-0bd1d9ef381b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:57.345715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20d398fe-0bca-49df-b482-0bd1d9ef381b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:57.346426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20d398fe-0bca-49df-b482-0bd1d9ef381b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:57.347107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20d398fe-0bca-49df-b482-0bd1d9ef381b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:57.537660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e770cc7-533c-4f98-b05b-8cbbdf0af24f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:57.538519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2e770cc7-533c-4f98-b05b-8cbbdf0af24f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:57.550516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e770cc7-533c-4f98-b05b-8cbbdf0af24f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:57.551065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e770cc7-533c-4f98-b05b-8cbbdf0af24f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:57.551518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e770cc7-533c-4f98-b05b-8cbbdf0af24f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:57.552248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e770cc7-533c-4f98-b05b-8cbbdf0af24f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:57.552710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e770cc7-533c-4f98-b05b-8cbbdf0af24f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:57.553132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e770cc7-533c-4f98-b05b-8cbbdf0af24f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:57.579218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-20d398fe-0bca-49df-b482-0bd1d9ef381b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid 21266578-6a91-43ab-9daf-38e646ac90c4 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:54:57.625338 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-20d398fe-0bca-49df-b482-0bd1d9ef381b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 2037 microversion: 2.25 time: 0.300240 Aug 23 17:54:57.627092 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 529/1114] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:54:57 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 2037 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:54:57.669522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6e8162a6-60cc-4955-a32b-fe2e90eac1b7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Action: 'create', calling method: .version_select at 0x7f27ec80d700>, body: {"keypair": {"name": "tempest-keypair-1275180690", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFGvz4VTKMTx8NuTC03Dr+sJKjm6XzIQm/+3er83OfwPVpYNUItXYuoavbZ9TEaTfhDYp022tqScYGuuOItPhbKDNhKUo/o6r5eP5Fy7GCjhxk4aeARdkhb6t7dqW+Uqw=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:54:57.699374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-6e8162a6-60cc-4955-a32b-fe2e90eac1b7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Getting quotas for project a847d523b7944595aa39244f15b37665. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:54:57.706927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-6e8162a6-60cc-4955-a32b-fe2e90eac1b7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Getting quotas for user bb8758f075834ca59962ab82f042ec34 and project a847d523b7944595aa39244f15b37665. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:54:57.738340 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6e8162a6-60cc-4955-a32b-fe2e90eac1b7 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.25 time: 0.075611 Aug 23 17:54:57.739493 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 530/1115] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Aug 23 17:54:57 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 78 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 17:54:57.782056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2e770cc7-533c-4f98-b05b-8cbbdf0af24f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:57.792794 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e770cc7-533c-4f98-b05b-8cbbdf0af24f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1472 microversion: 2.1 time: 0.258249 Aug 23 17:54:57.800358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-be531f12-edef-4c7d-9970-1437cc4f475e tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:57.801215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-be531f12-edef-4c7d-9970-1437cc4f475e tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:57.807324 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 586/1116] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:57 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1472 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:57.827257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be531f12-edef-4c7d-9970-1437cc4f475e tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:57.827810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be531f12-edef-4c7d-9970-1437cc4f475e tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:57.828315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be531f12-edef-4c7d-9970-1437cc4f475e tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:57.829472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be531f12-edef-4c7d-9970-1437cc4f475e tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:57.830029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be531f12-edef-4c7d-9970-1437cc4f475e tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:57.830456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be531f12-edef-4c7d-9970-1437cc4f475e tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:57.970629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2a676178-6149-45fc-8638-058f64b14f33 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:57.971595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2a676178-6149-45fc-8638-058f64b14f33 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:57.987564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a676178-6149-45fc-8638-058f64b14f33 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:57.989532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a676178-6149-45fc-8638-058f64b14f33 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:57.990061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a676178-6149-45fc-8638-058f64b14f33 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:57.992930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a676178-6149-45fc-8638-058f64b14f33 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:57.993628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a676178-6149-45fc-8638-058f64b14f33 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:57.995309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a676178-6149-45fc-8638-058f64b14f33 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:58.214782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2a676178-6149-45fc-8638-058f64b14f33 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:58.232448 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2a676178-6149-45fc-8638-058f64b14f33 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1542 microversion: 2.1 time: 0.274836 Aug 23 17:54:58.242601 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 587/1117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:57 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1542 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:54:58.243985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a53e5b98-c133-4729-aca7-157fad75f648 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:58.244603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a53e5b98-c133-4729-aca7-157fad75f648 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:58.255635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a53e5b98-c133-4729-aca7-157fad75f648 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:58.256140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a53e5b98-c133-4729-aca7-157fad75f648 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:58.256583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a53e5b98-c133-4729-aca7-157fad75f648 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:58.257301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a53e5b98-c133-4729-aca7-157fad75f648 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:58.257762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a53e5b98-c133-4729-aca7-157fad75f648 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:58.258190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a53e5b98-c133-4729-aca7-157fad75f648 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:58.362107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a53e5b98-c133-4729-aca7-157fad75f648 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:58.372592 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a53e5b98-c133-4729-aca7-157fad75f648 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1224 microversion: 2.1 time: 0.137334 Aug 23 17:54:58.376224 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 588/1118] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:58 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1224 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:58.387564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-53f592bf-d97b-4a1e-8677-06ce17a9001a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:58.390270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-53f592bf-d97b-4a1e-8677-06ce17a9001a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:58.409812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53f592bf-d97b-4a1e-8677-06ce17a9001a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:58.409812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53f592bf-d97b-4a1e-8677-06ce17a9001a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:58.409812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53f592bf-d97b-4a1e-8677-06ce17a9001a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:58.409812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53f592bf-d97b-4a1e-8677-06ce17a9001a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:58.409812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53f592bf-d97b-4a1e-8677-06ce17a9001a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:58.410330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53f592bf-d97b-4a1e-8677-06ce17a9001a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:58.465175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-be531f12-edef-4c7d-9970-1437cc4f475e tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:58.480809 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-be531f12-edef-4c7d-9970-1437cc4f475e tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1316 microversion: 2.1 time: 0.683810 Aug 23 17:54:58.491144 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 531/1119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:57 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1316 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:58.573353 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-53f592bf-d97b-4a1e-8677-06ce17a9001a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.195820 Aug 23 17:54:58.587850 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 589/1120] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 17:54:58 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-interface => generated 284 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:54:58.821270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-14c0a0b5-fcd5-4cd5-890e-e8ee78858e21 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:58.822516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-14c0a0b5-fcd5-4cd5-890e-e8ee78858e21 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:58.851503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c0a0b5-fcd5-4cd5-890e-e8ee78858e21 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:58.854928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c0a0b5-fcd5-4cd5-890e-e8ee78858e21 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:58.855619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c0a0b5-fcd5-4cd5-890e-e8ee78858e21 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:58.861297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c0a0b5-fcd5-4cd5-890e-e8ee78858e21 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:58.865504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c0a0b5-fcd5-4cd5-890e-e8ee78858e21 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:58.866231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14c0a0b5-fcd5-4cd5-890e-e8ee78858e21 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:59.397673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d148d54c-16e7-4c29-9fcb-80c8557f605f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:59.399196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d148d54c-16e7-4c29-9fcb-80c8557f605f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:59.416534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d148d54c-16e7-4c29-9fcb-80c8557f605f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:59.417404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d148d54c-16e7-4c29-9fcb-80c8557f605f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:59.418196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d148d54c-16e7-4c29-9fcb-80c8557f605f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:59.419374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d148d54c-16e7-4c29-9fcb-80c8557f605f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:59.422699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d148d54c-16e7-4c29-9fcb-80c8557f605f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:59.423560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d148d54c-16e7-4c29-9fcb-80c8557f605f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:59.606923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d148d54c-16e7-4c29-9fcb-80c8557f605f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:59.641643 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d148d54c-16e7-4c29-9fcb-80c8557f605f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1272 microversion: 2.1 time: 0.248093 Aug 23 17:54:59.642249 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 590/1121] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:59 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1272 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:54:59.655300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1db9fd89-04db-48b2-91cf-572bcb08574a tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:54:59.657717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1db9fd89-04db-48b2-91cf-572bcb08574a tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:54:59.669684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:54:59.674779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1db9fd89-04db-48b2-91cf-572bcb08574a tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:59.677542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1db9fd89-04db-48b2-91cf-572bcb08574a tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:59.680069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1db9fd89-04db-48b2-91cf-572bcb08574a tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:59.680857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1db9fd89-04db-48b2-91cf-572bcb08574a tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:54:59.683447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1db9fd89-04db-48b2-91cf-572bcb08574a tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:54:59.683944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1db9fd89-04db-48b2-91cf-572bcb08574a tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:54:59.711117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-14c0a0b5-fcd5-4cd5-890e-e8ee78858e21 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:54:59.721233 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-14c0a0b5-fcd5-4cd5-890e-e8ee78858e21 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1472 microversion: 2.1 time: 0.907800 Aug 23 17:54:59.721817 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 532/1122] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:58 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1472 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:00.509097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1db9fd89-04db-48b2-91cf-572bcb08574a tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:00.520051 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1db9fd89-04db-48b2-91cf-572bcb08574a tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1503 microversion: 2.1 time: 0.876673 Aug 23 17:55:00.520742 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 591/1123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:54:59 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1503 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:00.541478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c9d3e8ef-d731-4d4a-a03d-d35981812130 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:00.541971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c9d3e8ef-d731-4d4a-a03d-d35981812130 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:00.549378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9d3e8ef-d731-4d4a-a03d-d35981812130 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:00.549982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9d3e8ef-d731-4d4a-a03d-d35981812130 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:00.550524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9d3e8ef-d731-4d4a-a03d-d35981812130 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:00.551332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9d3e8ef-d731-4d4a-a03d-d35981812130 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:00.551866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9d3e8ef-d731-4d4a-a03d-d35981812130 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:00.552485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9d3e8ef-d731-4d4a-a03d-d35981812130 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:00.631899 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c9d3e8ef-d731-4d4a-a03d-d35981812130 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.094223 Aug 23 17:55:00.645572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff374a4a-b56c-4d64-b27e-916089511c47 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:00.646088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff374a4a-b56c-4d64-b27e-916089511c47 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:00.650326 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 533/1124] 10.222.0.61 () {58 vars in 1296 bytes} [Tue Aug 23 17:55:00 2022] DELETE /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753/os-server-password => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:55:00.652790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff374a4a-b56c-4d64-b27e-916089511c47 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:00.653282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff374a4a-b56c-4d64-b27e-916089511c47 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:00.653958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff374a4a-b56c-4d64-b27e-916089511c47 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:00.654947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff374a4a-b56c-4d64-b27e-916089511c47 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:00.655418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff374a4a-b56c-4d64-b27e-916089511c47 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:00.655838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff374a4a-b56c-4d64-b27e-916089511c47 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:00.667199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-43d35e71-5f38-4928-a244-9dacd2ab6eef tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:00.668050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-43d35e71-5f38-4928-a244-9dacd2ab6eef tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:00.674621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d35e71-5f38-4928-a244-9dacd2ab6eef tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:00.675358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d35e71-5f38-4928-a244-9dacd2ab6eef tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:00.675992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d35e71-5f38-4928-a244-9dacd2ab6eef tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:00.676867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d35e71-5f38-4928-a244-9dacd2ab6eef tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:00.677486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d35e71-5f38-4928-a244-9dacd2ab6eef tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:00.678073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d35e71-5f38-4928-a244-9dacd2ab6eef tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:00.710059 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff374a4a-b56c-4d64-b27e-916089511c47 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.069122 Aug 23 17:55:00.720364 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 592/1125] 10.222.0.61 () {58 vars in 1293 bytes} [Tue Aug 23 17:55:00 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753/os-server-password => generated 16 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:55:00.727926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-68b59dca-d557-4c5d-a3d5-cfcff49ebbcb tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:00.728660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-68b59dca-d557-4c5d-a3d5-cfcff49ebbcb tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:00.738638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68b59dca-d557-4c5d-a3d5-cfcff49ebbcb tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:00.739187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68b59dca-d557-4c5d-a3d5-cfcff49ebbcb tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:00.739634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68b59dca-d557-4c5d-a3d5-cfcff49ebbcb tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:00.740637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68b59dca-d557-4c5d-a3d5-cfcff49ebbcb tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:00.741438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68b59dca-d557-4c5d-a3d5-cfcff49ebbcb tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:00.742351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68b59dca-d557-4c5d-a3d5-cfcff49ebbcb tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:00.747186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:00.772433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-68b59dca-d557-4c5d-a3d5-cfcff49ebbcb tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:55:00.784520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-43d35e71-5f38-4928-a244-9dacd2ab6eef tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:00.793400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:00.805118 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-43d35e71-5f38-4928-a244-9dacd2ab6eef tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1278 microversion: 2.1 time: 0.141593 Aug 23 17:55:00.811713 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 534/1126] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:00 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1278 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:00.823717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc1cd422-7d24-4e64-938a-799c0fc15512 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:00.824637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc1cd422-7d24-4e64-938a-799c0fc15512 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:00.833474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1cd422-7d24-4e64-938a-799c0fc15512 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:00.834319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1cd422-7d24-4e64-938a-799c0fc15512 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:00.835047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1cd422-7d24-4e64-938a-799c0fc15512 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:00.837303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1cd422-7d24-4e64-938a-799c0fc15512 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:00.838251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1cd422-7d24-4e64-938a-799c0fc15512 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:00.838938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc1cd422-7d24-4e64-938a-799c0fc15512 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:00.909027 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-68b59dca-d557-4c5d-a3d5-cfcff49ebbcb tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 204 len: 0 microversion: 2.1 time: 0.185264 Aug 23 17:55:00.912569 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 593/1127] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:55:00 2022] DELETE /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:55:00.926599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-298146e5-7790-4677-a1c3-bdb236dad3b2 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:00.927533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-298146e5-7790-4677-a1c3-bdb236dad3b2 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:00.934913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-298146e5-7790-4677-a1c3-bdb236dad3b2 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:00.937045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-298146e5-7790-4677-a1c3-bdb236dad3b2 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:00.938197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-298146e5-7790-4677-a1c3-bdb236dad3b2 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:00.939953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-298146e5-7790-4677-a1c3-bdb236dad3b2 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:00.940723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-298146e5-7790-4677-a1c3-bdb236dad3b2 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:00.941225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-298146e5-7790-4677-a1c3-bdb236dad3b2 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:01.148379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-298146e5-7790-4677-a1c3-bdb236dad3b2 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:01.158162 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-298146e5-7790-4677-a1c3-bdb236dad3b2 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1509 microversion: 2.1 time: 0.240084 Aug 23 17:55:01.170566 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 594/1128] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:00 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1509 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:01.174968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-d6f3dd4a-f68d-437f-a661-eb43dc8be26d req-e38bb0b2-d1c6-4ea9-a4e6-748847fe609f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28b3cf3a-784f-48f6-9ee3-1e98f527d4aa", "tag": "e7e8c36a-a65f-4586-97ce-22fec636459f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:01.189034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d6f3dd4a-f68d-437f-a661-eb43dc8be26d req-e38bb0b2-d1c6-4ea9-a4e6-748847fe609f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:01.189937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d6f3dd4a-f68d-437f-a661-eb43dc8be26d req-e38bb0b2-d1c6-4ea9-a4e6-748847fe609f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:01.190679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d6f3dd4a-f68d-437f-a661-eb43dc8be26d req-e38bb0b2-d1c6-4ea9-a4e6-748847fe609f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:01.207462 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-d6f3dd4a-f68d-437f-a661-eb43dc8be26d req-e38bb0b2-d1c6-4ea9-a4e6-748847fe609f service nova] Creating event network-changed:e7e8c36a-a65f-4586-97ce-22fec636459f for instance 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa on n-h2-850468-16 Aug 23 17:55:01.216468 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-d6f3dd4a-f68d-437f-a661-eb43dc8be26d req-e38bb0b2-d1c6-4ea9-a4e6-748847fe609f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054243 Aug 23 17:55:01.217570 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 595/1129] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:01.341849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc1cd422-7d24-4e64-938a-799c0fc15512 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:01.365136 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc1cd422-7d24-4e64-938a-799c0fc15512 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1472 microversion: 2.1 time: 0.551606 Aug 23 17:55:01.366254 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 535/1130] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:00 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1472 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:01.829567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9d1c8e62-e804-49ea-8aa3-6087f26bb03f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:01.830340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9d1c8e62-e804-49ea-8aa3-6087f26bb03f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:01.844867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d1c8e62-e804-49ea-8aa3-6087f26bb03f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:01.845616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d1c8e62-e804-49ea-8aa3-6087f26bb03f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:01.846224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d1c8e62-e804-49ea-8aa3-6087f26bb03f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:01.847688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d1c8e62-e804-49ea-8aa3-6087f26bb03f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:01.849950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d1c8e62-e804-49ea-8aa3-6087f26bb03f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:01.851452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d1c8e62-e804-49ea-8aa3-6087f26bb03f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:01.976878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9d1c8e62-e804-49ea-8aa3-6087f26bb03f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:01.989349 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9d1c8e62-e804-49ea-8aa3-6087f26bb03f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1278 microversion: 2.1 time: 0.164854 Aug 23 17:55:01.991395 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 596/1131] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:01 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1278 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:02.182532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-62ad455a-d304-4e3e-ac6f-d5064bdbef49 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:02.183347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-62ad455a-d304-4e3e-ac6f-d5064bdbef49 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:02.196830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62ad455a-d304-4e3e-ac6f-d5064bdbef49 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:02.203809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62ad455a-d304-4e3e-ac6f-d5064bdbef49 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:02.206060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62ad455a-d304-4e3e-ac6f-d5064bdbef49 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:02.214302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62ad455a-d304-4e3e-ac6f-d5064bdbef49 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:02.220765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62ad455a-d304-4e3e-ac6f-d5064bdbef49 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:02.221910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62ad455a-d304-4e3e-ac6f-d5064bdbef49 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:02.389617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-713e8d82-baa1-4822-895b-c905daa4ef82 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:02.390815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-713e8d82-baa1-4822-895b-c905daa4ef82 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:02.402532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-713e8d82-baa1-4822-895b-c905daa4ef82 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:02.403050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-713e8d82-baa1-4822-895b-c905daa4ef82 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:02.403493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-713e8d82-baa1-4822-895b-c905daa4ef82 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:02.404990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-713e8d82-baa1-4822-895b-c905daa4ef82 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:02.405423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-713e8d82-baa1-4822-895b-c905daa4ef82 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:02.405857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-713e8d82-baa1-4822-895b-c905daa4ef82 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:03.007924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-713e8d82-baa1-4822-895b-c905daa4ef82 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:03.047549 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-713e8d82-baa1-4822-895b-c905daa4ef82 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.661011 Aug 23 17:55:03.062316 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 597/1132] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:02 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:03.070585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a4ea33e7-2185-4941-98a0-61913d81d930 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:03.071482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a4ea33e7-2185-4941-98a0-61913d81d930 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:03.078858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4ea33e7-2185-4941-98a0-61913d81d930 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:03.079577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4ea33e7-2185-4941-98a0-61913d81d930 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:03.081285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4ea33e7-2185-4941-98a0-61913d81d930 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:03.081285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4ea33e7-2185-4941-98a0-61913d81d930 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:03.082503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4ea33e7-2185-4941-98a0-61913d81d930 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:03.083198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4ea33e7-2185-4941-98a0-61913d81d930 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:03.157577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-62ad455a-d304-4e3e-ac6f-d5064bdbef49 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:03.169299 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-62ad455a-d304-4e3e-ac6f-d5064bdbef49 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1509 microversion: 2.1 time: 0.990666 Aug 23 17:55:03.170436 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 536/1133] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:02 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1509 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:03.178903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-778268824", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "18890100-9652-4122-9a4a-c466e7188bca"}], "security_groups": [{"name": "tempest-securitygroup--2101622818"}], "key_name": "tempest-keypair-1275180690", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:03.406636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] validate_networks() for [('18890100-9652-4122-9a4a-c466e7188bca', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:55:03.673725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a4ea33e7-2185-4941-98a0-61913d81d930 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:03.697550 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a4ea33e7-2185-4941-98a0-61913d81d930 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.633227 Aug 23 17:55:03.712863 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 598/1134] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:03 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:03.910108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-a288574b-6ad0-46ba-903b-31210b3e4df8 req-f1fe3ef3-1267-43b3-8f63-71f0062b6eef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed0f5323-e9ef-48c9-91fa-3b500fc05057", "tag": "75e1d424-c713-4dc8-9bfb-fb5f98f20ce3"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:03.942574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a288574b-6ad0-46ba-903b-31210b3e4df8 req-f1fe3ef3-1267-43b3-8f63-71f0062b6eef service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:03.943763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a288574b-6ad0-46ba-903b-31210b3e4df8 req-f1fe3ef3-1267-43b3-8f63-71f0062b6eef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:03.944433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a288574b-6ad0-46ba-903b-31210b3e4df8 req-f1fe3ef3-1267-43b3-8f63-71f0062b6eef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:03.985775 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-a288574b-6ad0-46ba-903b-31210b3e4df8 req-f1fe3ef3-1267-43b3-8f63-71f0062b6eef service nova] Creating event network-changed:75e1d424-c713-4dc8-9bfb-fb5f98f20ce3 for instance ed0f5323-e9ef-48c9-91fa-3b500fc05057 on n-h2-850468-16 Aug 23 17:55:03.992188 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-a288574b-6ad0-46ba-903b-31210b3e4df8 req-f1fe3ef3-1267-43b3-8f63-71f0062b6eef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094644 Aug 23 17:55:03.993534 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 599/1135] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:04.069501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ff94de0-922a-4602-a2f6-5b7df80ff6c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:04.070298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9ff94de0-922a-4602-a2f6-5b7df80ff6c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:04.077318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ff94de0-922a-4602-a2f6-5b7df80ff6c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:04.078128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ff94de0-922a-4602-a2f6-5b7df80ff6c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:04.078679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ff94de0-922a-4602-a2f6-5b7df80ff6c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:04.079464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ff94de0-922a-4602-a2f6-5b7df80ff6c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:04.079989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ff94de0-922a-4602-a2f6-5b7df80ff6c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:04.080482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ff94de0-922a-4602-a2f6-5b7df80ff6c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:04.130101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:55:04.130528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:55:04.131041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:55:04.131449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:55:04.131853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:55:04.143156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:04.143987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:04.144612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:04.145579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:04.146183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:04.146789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:04.172044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Getting quotas for project a847d523b7944595aa39244f15b37665. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:55:04.180202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Getting quotas for user bb8758f075834ca59962ab82f042ec34 and project a847d523b7944595aa39244f15b37665. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:55:04.202297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:55:04.205949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:55:04.298765 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fade92d5-f68f-477e-ab95-c2c3ed50bd11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.124660 Aug 23 17:55:04.299849 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 537/1136] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 17:55:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 1129 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 17:55:04.306613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b50cb7a5-a764-4dd1-80fc-c1e4f993a5d5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:04.307840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b50cb7a5-a764-4dd1-80fc-c1e4f993a5d5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:04.322942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b50cb7a5-a764-4dd1-80fc-c1e4f993a5d5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:04.324500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b50cb7a5-a764-4dd1-80fc-c1e4f993a5d5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:04.325192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b50cb7a5-a764-4dd1-80fc-c1e4f993a5d5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:04.326671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b50cb7a5-a764-4dd1-80fc-c1e4f993a5d5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:04.327360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b50cb7a5-a764-4dd1-80fc-c1e4f993a5d5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:04.328032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b50cb7a5-a764-4dd1-80fc-c1e4f993a5d5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:04.881670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b50cb7a5-a764-4dd1-80fc-c1e4f993a5d5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:04.890103 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b50cb7a5-a764-4dd1-80fc-c1e4f993a5d5 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1509 microversion: 2.1 time: 0.588882 Aug 23 17:55:04.890713 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 538/1137] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:04 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1509 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:04.903988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-81a9c545-c639-46e0-961e-b45f67809ffc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:04.909188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-81a9c545-c639-46e0-961e-b45f67809ffc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:05.025672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9ff94de0-922a-4602-a2f6-5b7df80ff6c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:05.033911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-81a9c545-c639-46e0-961e-b45f67809ffc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:05.041721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-81a9c545-c639-46e0-961e-b45f67809ffc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:05.043286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-81a9c545-c639-46e0-961e-b45f67809ffc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:05.044415 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-81a9c545-c639-46e0-961e-b45f67809ffc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1285 microversion: 2.25 time: 0.146940 Aug 23 17:55:05.056866 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 539/1138] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:04 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:55:05.056866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-53decfef-90a2-45b9-9db0-4b372ebfcb9f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:05.056866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-53decfef-90a2-45b9-9db0-4b372ebfcb9f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:05.076800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53decfef-90a2-45b9-9db0-4b372ebfcb9f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:05.077318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53decfef-90a2-45b9-9db0-4b372ebfcb9f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:05.077872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53decfef-90a2-45b9-9db0-4b372ebfcb9f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:05.078646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53decfef-90a2-45b9-9db0-4b372ebfcb9f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:05.081277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53decfef-90a2-45b9-9db0-4b372ebfcb9f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:05.083085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53decfef-90a2-45b9-9db0-4b372ebfcb9f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:05.084965 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9ff94de0-922a-4602-a2f6-5b7df80ff6c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 1.019513 Aug 23 17:55:05.089384 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 600/1139] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:04 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 1025 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:05.119179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f27718e0-2b43-42c1-b185-c2108de1f5c1 req-bd340655-30db-49ab-8370-2da9105280a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4d824a1-8074-4d3e-9bbc-acc08f561753", "name": "network-vif-deleted", "tag": "d1dc2eca-8039-40a2-99c0-5e25a2603b1d"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:05.150187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f27718e0-2b43-42c1-b185-c2108de1f5c1 req-bd340655-30db-49ab-8370-2da9105280a2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:05.154857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f27718e0-2b43-42c1-b185-c2108de1f5c1 req-bd340655-30db-49ab-8370-2da9105280a2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:05.155698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f27718e0-2b43-42c1-b185-c2108de1f5c1 req-bd340655-30db-49ab-8370-2da9105280a2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:05.168354 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f27718e0-2b43-42c1-b185-c2108de1f5c1 req-bd340655-30db-49ab-8370-2da9105280a2 service nova] Creating event network-vif-deleted:d1dc2eca-8039-40a2-99c0-5e25a2603b1d for instance c4d824a1-8074-4d3e-9bbc-acc08f561753 on n-h1-850468-16 Aug 23 17:55:05.202237 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f27718e0-2b43-42c1-b185-c2108de1f5c1 req-bd340655-30db-49ab-8370-2da9105280a2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107327 Aug 23 17:55:05.205068 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 601/1140] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:05.302567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-53decfef-90a2-45b9-9db0-4b372ebfcb9f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:05.313560 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-53decfef-90a2-45b9-9db0-4b372ebfcb9f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.261903 Aug 23 17:55:05.314437 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 540/1141] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:05 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:05.915460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:05.916165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:05.934032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:05.934811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:05.935897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:05.936886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:05.937448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:05.937971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:06.000715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:06.006480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:06.007768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:06.010245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lazy-loading 'fault' on Instance uuid c4d824a1-8074-4d3e-9bbc-acc08f561753 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:55:06.076349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4aa74006-6acd-4acf-8496-5cc44c9a498e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:06.078295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4aa74006-6acd-4acf-8496-5cc44c9a498e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:06.088921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa74006-6acd-4acf-8496-5cc44c9a498e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:06.089508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f9cab3e3fbc4251aeb3cedf6dfa38de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f14225f216754bad9f6532b176593449', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:06.091257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa74006-6acd-4acf-8496-5cc44c9a498e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:06.091924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa74006-6acd-4acf-8496-5cc44c9a498e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:06.094053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa74006-6acd-4acf-8496-5cc44c9a498e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:06.094752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa74006-6acd-4acf-8496-5cc44c9a498e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:06.095477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa74006-6acd-4acf-8496-5cc44c9a498e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:06.099011 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6392595c-5e37-40f8-8ffa-f1d77080a43b tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 200 len: 1306 microversion: 2.1 time: 0.187700 Aug 23 17:55:06.112851 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 602/1142] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:05 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 1306 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:06.180338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8411f5a0-2938-407d-9c81-14052ae0ddb0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:06.180947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8411f5a0-2938-407d-9c81-14052ae0ddb0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:06.187712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8411f5a0-2938-407d-9c81-14052ae0ddb0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:06.188203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8411f5a0-2938-407d-9c81-14052ae0ddb0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:06.188640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8411f5a0-2938-407d-9c81-14052ae0ddb0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:06.189347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8411f5a0-2938-407d-9c81-14052ae0ddb0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:06.189794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8411f5a0-2938-407d-9c81-14052ae0ddb0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:06.190212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8411f5a0-2938-407d-9c81-14052ae0ddb0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:06.242559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4aa74006-6acd-4acf-8496-5cc44c9a498e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:06.257362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4aa74006-6acd-4acf-8496-5cc44c9a498e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:06.259429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4aa74006-6acd-4acf-8496-5cc44c9a498e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:06.261269 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4aa74006-6acd-4acf-8496-5cc44c9a498e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1281 microversion: 2.25 time: 0.191409 Aug 23 17:55:06.262316 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 541/1143] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:06 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1281 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:55:06.270405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:06.335924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bda83c46-4c4d-49ef-860c-3a7968ca4a89 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:06.336843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bda83c46-4c4d-49ef-860c-3a7968ca4a89 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:06.346671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bda83c46-4c4d-49ef-860c-3a7968ca4a89 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:06.349559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bda83c46-4c4d-49ef-860c-3a7968ca4a89 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:06.350174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bda83c46-4c4d-49ef-860c-3a7968ca4a89 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:06.352487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bda83c46-4c4d-49ef-860c-3a7968ca4a89 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:06.352954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bda83c46-4c4d-49ef-860c-3a7968ca4a89 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:06.353382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bda83c46-4c4d-49ef-860c-3a7968ca4a89 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:06.392841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8411f5a0-2938-407d-9c81-14052ae0ddb0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:06.401105 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8411f5a0-2938-407d-9c81-14052ae0ddb0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.224415 Aug 23 17:55:06.402858 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 603/1144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:06 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:06.588209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bda83c46-4c4d-49ef-860c-3a7968ca4a89 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:06.598217 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bda83c46-4c4d-49ef-860c-3a7968ca4a89 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.266268 Aug 23 17:55:06.598865 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 542/1145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:06 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:07.123881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66117fa4-678a-496e-a694-654d7b448990 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:07.125119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66117fa4-678a-496e-a694-654d7b448990 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] [instance: c4d824a1-8074-4d3e-9bbc-acc08f561753] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:07.128263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:07.134752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66117fa4-678a-496e-a694-654d7b448990 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:07.135245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66117fa4-678a-496e-a694-654d7b448990 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:07.135680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66117fa4-678a-496e-a694-654d7b448990 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:07.137119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66117fa4-678a-496e-a694-654d7b448990 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:07.137739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66117fa4-678a-496e-a694-654d7b448990 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:07.138366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66117fa4-678a-496e-a694-654d7b448990 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:07.155791 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-66117fa4-678a-496e-a694-654d7b448990 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] HTTP exception thrown: Instance c4d824a1-8074-4d3e-9bbc-acc08f561753 could not be found. Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66117fa4-678a-496e-a694-654d7b448990 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Request method failure captured: Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 HTTP/1.1 Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRRZHK6zxaafXhvQc0n4lGEWrD35wnJoFVMPX5fOokYrgz7tFwCwXfBAAlSYVExfwc4mNngvrHK7-aynRNcUP9QS43klZPy1SSlhWGF4UwyzdatF1fgD5UHI0vNjffMdsrMdVFhZzqP9GC1VKahj4u4YBx8KZQmKlhZ5oud3FoIhVkI Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: f14225f216754bad9f6532b176593449 Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerPasswordTestJSON-278111215 Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f14225f216754bad9f6532b176593449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f14225f216754bad9f6532b176593449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f14225f216754bad9f6532b176593449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f14225f216754bad9f6532b176593449"}]}] Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerPasswordTestJSON-278111215 Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: f14225f216754bad9f6532b176593449 Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerPasswordTestJSON-278111215 Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerPasswordTestJSON-278111215-project Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 8f9cab3e3fbc4251aeb3cedf6dfa38de Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerPasswordTestJSON-278111215-project Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance c4d824a1-8074-4d3e-9bbc-acc08f561753 could not be found. Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'c4d824a1-8074-4d3e-9bbc-acc08f561753'} Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4d824a1-8074-4d3e-9bbc-acc08f561753 could not be found. Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4d824a1-8074-4d3e-9bbc-acc08f561753 could not be found. Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:07.157863 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:07.162626 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:07.162626 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:07.162626 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:07.162626 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:55:07.162626 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:55:07.162626 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4d824a1-8074-4d3e-9bbc-acc08f561753 could not be found. Aug 23 17:55:07.162626 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:07.164189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66117fa4-678a-496e-a694-654d7b448990 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] Returning 404 to user: Instance c4d824a1-8074-4d3e-9bbc-acc08f561753 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:07.165407 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66117fa4-678a-496e-a694-654d7b448990 tempest-ServerPasswordTestJSON-278111215 tempest-ServerPasswordTestJSON-278111215-project] 10.222.0.61 "GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753" status: 404 len: 111 microversion: 2.1 time: 0.046853 Aug 23 17:55:07.166605 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 604/1146] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:07 2022] GET /compute/v2.1/servers/c4d824a1-8074-4d3e-9bbc-acc08f561753 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:55:07.262090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4562f10e-26a8-43e7-a8a0-2a0398eb3d5d req-89c735fc-fd1c-4702-9ad1-fbc6c3641530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a9618a4e-13d0-4135-9700-f51ea58c7b2a", "tag": "a605fa68-187d-4064-83ac-b17332a2d0a2"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:07.273375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4562f10e-26a8-43e7-a8a0-2a0398eb3d5d req-89c735fc-fd1c-4702-9ad1-fbc6c3641530 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:07.274033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4562f10e-26a8-43e7-a8a0-2a0398eb3d5d req-89c735fc-fd1c-4702-9ad1-fbc6c3641530 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:07.274654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4562f10e-26a8-43e7-a8a0-2a0398eb3d5d req-89c735fc-fd1c-4702-9ad1-fbc6c3641530 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:07.286444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-65573ce1-e2c5-4bf4-9960-0922f662910e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:07.287328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-65573ce1-e2c5-4bf4-9960-0922f662910e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:07.297835 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4562f10e-26a8-43e7-a8a0-2a0398eb3d5d req-89c735fc-fd1c-4702-9ad1-fbc6c3641530 service nova] Creating event network-changed:a605fa68-187d-4064-83ac-b17332a2d0a2 for instance a9618a4e-13d0-4135-9700-f51ea58c7b2a on n-h1-850468-16 Aug 23 17:55:07.300095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65573ce1-e2c5-4bf4-9960-0922f662910e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:07.300741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65573ce1-e2c5-4bf4-9960-0922f662910e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:07.301327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65573ce1-e2c5-4bf4-9960-0922f662910e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:07.302386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65573ce1-e2c5-4bf4-9960-0922f662910e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:07.302875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65573ce1-e2c5-4bf4-9960-0922f662910e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:07.303300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65573ce1-e2c5-4bf4-9960-0922f662910e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:07.325689 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4562f10e-26a8-43e7-a8a0-2a0398eb3d5d req-89c735fc-fd1c-4702-9ad1-fbc6c3641530 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071267 Aug 23 17:55:07.328355 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 543/1147] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:07.430592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-65573ce1-e2c5-4bf4-9960-0922f662910e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:07.434256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5105df8f-b94d-488d-9199-85b42ceedce9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:07.436917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5105df8f-b94d-488d-9199-85b42ceedce9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:07.446587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-65573ce1-e2c5-4bf4-9960-0922f662910e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:07.447771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5105df8f-b94d-488d-9199-85b42ceedce9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:07.448270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5105df8f-b94d-488d-9199-85b42ceedce9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:07.449418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5105df8f-b94d-488d-9199-85b42ceedce9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:07.449711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-65573ce1-e2c5-4bf4-9960-0922f662910e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:07.450168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5105df8f-b94d-488d-9199-85b42ceedce9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:07.450661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5105df8f-b94d-488d-9199-85b42ceedce9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:07.452491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5105df8f-b94d-488d-9199-85b42ceedce9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:07.454149 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-65573ce1-e2c5-4bf4-9960-0922f662910e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1281 microversion: 2.25 time: 0.170848 Aug 23 17:55:07.455962 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 605/1148] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:07 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1281 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:55:07.621503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1e3e36c7-2397-4ec7-9235-3d6dce24e337 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:07.622125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1e3e36c7-2397-4ec7-9235-3d6dce24e337 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:07.636793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e3e36c7-2397-4ec7-9235-3d6dce24e337 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:07.637515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e3e36c7-2397-4ec7-9235-3d6dce24e337 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:07.638110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e3e36c7-2397-4ec7-9235-3d6dce24e337 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:07.645982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e3e36c7-2397-4ec7-9235-3d6dce24e337 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:07.646770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e3e36c7-2397-4ec7-9235-3d6dce24e337 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:07.647441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e3e36c7-2397-4ec7-9235-3d6dce24e337 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:07.800713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5105df8f-b94d-488d-9199-85b42ceedce9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:07.811270 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5105df8f-b94d-488d-9199-85b42ceedce9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.389854 Aug 23 17:55:07.812667 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 544/1149] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:07 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:07.932490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1e3e36c7-2397-4ec7-9235-3d6dce24e337 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:07.941729 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1e3e36c7-2397-4ec7-9235-3d6dce24e337 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.324874 Aug 23 17:55:07.943059 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 606/1150] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:07 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:08.250728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1820107411", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "b06bcefd-d9c8-46b3-8f56-9e68315ff33e"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:08.310072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] validate_networks() for [('b06bcefd-d9c8-46b3-8f56-9e68315ff33e', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:55:08.481541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b133a50b-ba24-4db3-9d47-3c808b47464f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:08.483119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b133a50b-ba24-4db3-9d47-3c808b47464f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:08.496183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b133a50b-ba24-4db3-9d47-3c808b47464f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:08.496682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b133a50b-ba24-4db3-9d47-3c808b47464f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:08.497114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b133a50b-ba24-4db3-9d47-3c808b47464f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:08.498834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b133a50b-ba24-4db3-9d47-3c808b47464f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:08.499311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b133a50b-ba24-4db3-9d47-3c808b47464f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:08.499742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b133a50b-ba24-4db3-9d47-3c808b47464f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:08.678873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b133a50b-ba24-4db3-9d47-3c808b47464f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:08.691166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b133a50b-ba24-4db3-9d47-3c808b47464f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:08.693483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b133a50b-ba24-4db3-9d47-3c808b47464f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:08.694702 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b133a50b-ba24-4db3-9d47-3c808b47464f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1337 microversion: 2.25 time: 0.218179 Aug 23 17:55:08.695486 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 607/1151] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:08 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1337 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:55:08.833050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-af595400-dc28-44b4-afc0-f37b4300ab30 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:08.833699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-af595400-dc28-44b4-afc0-f37b4300ab30 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:08.839695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af595400-dc28-44b4-afc0-f37b4300ab30 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:08.840184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af595400-dc28-44b4-afc0-f37b4300ab30 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:08.840932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af595400-dc28-44b4-afc0-f37b4300ab30 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:08.841646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af595400-dc28-44b4-afc0-f37b4300ab30 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:08.842455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af595400-dc28-44b4-afc0-f37b4300ab30 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:08.843024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af595400-dc28-44b4-afc0-f37b4300ab30 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:08.910300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:55:08.910843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:55:08.911328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:55:08.911771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:55:08.912189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:55:08.922229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:08.922756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:08.923200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:08.923957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:08.924651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:08.925315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:08.944929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:08.950502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Getting quotas for project fbb6fbb08d9d4edc88ccf65f8b3e1df1. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:55:08.957602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Getting quotas for user 4440b850f8974643bd22fc84ddd265ee and project fbb6fbb08d9d4edc88ccf65f8b3e1df1. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:55:08.981463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:55:08.984219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:55:09.065691 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5d8e99f6-5f8e-45b3-aff4-83bcf328c421 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.965209 Aug 23 17:55:09.067192 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 545/1152] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:55:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:55:09.084256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-16f38c22-1215-416a-b132-525fecae21d7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:09.085180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-16f38c22-1215-416a-b132-525fecae21d7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:09.105225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16f38c22-1215-416a-b132-525fecae21d7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:09.106019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16f38c22-1215-416a-b132-525fecae21d7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:09.106665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16f38c22-1215-416a-b132-525fecae21d7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:09.108640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16f38c22-1215-416a-b132-525fecae21d7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:09.110198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16f38c22-1215-416a-b132-525fecae21d7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:09.110927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16f38c22-1215-416a-b132-525fecae21d7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:09.176088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-af595400-dc28-44b4-afc0-f37b4300ab30 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:09.184186 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-af595400-dc28-44b4-afc0-f37b4300ab30 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.354964 Aug 23 17:55:09.194855 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 608/1153] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:08 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:09.201532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66c4ffa8-8777-4458-9a82-d3e8d4e6b595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:09.203006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66c4ffa8-8777-4458-9a82-d3e8d4e6b595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:09.383671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66c4ffa8-8777-4458-9a82-d3e8d4e6b595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:09.394908 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66c4ffa8-8777-4458-9a82-d3e8d4e6b595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1225 microversion: 2.1 time: 0.203681 Aug 23 17:55:09.397945 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 609/1154] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:09 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1225 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:09.456500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-16f38c22-1215-416a-b132-525fecae21d7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:09.472445 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-16f38c22-1215-416a-b132-525fecae21d7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.399518 Aug 23 17:55:09.473088 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 546/1155] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:09 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:09.720295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e73ef3cd-711f-47af-9aae-f9ef2ecc462c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:09.720908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e73ef3cd-711f-47af-9aae-f9ef2ecc462c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:09.729895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e73ef3cd-711f-47af-9aae-f9ef2ecc462c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:09.732911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e73ef3cd-711f-47af-9aae-f9ef2ecc462c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:09.741118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e73ef3cd-711f-47af-9aae-f9ef2ecc462c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:09.741898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e73ef3cd-711f-47af-9aae-f9ef2ecc462c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:09.742382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e73ef3cd-711f-47af-9aae-f9ef2ecc462c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:09.742855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e73ef3cd-711f-47af-9aae-f9ef2ecc462c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:10.206165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-216e337a-a533-4918-8b64-ef49c9b623f9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:10.207255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-216e337a-a533-4918-8b64-ef49c9b623f9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:10.220529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-216e337a-a533-4918-8b64-ef49c9b623f9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:10.221670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-216e337a-a533-4918-8b64-ef49c9b623f9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:10.222283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-216e337a-a533-4918-8b64-ef49c9b623f9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:10.223789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-216e337a-a533-4918-8b64-ef49c9b623f9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:10.226930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-216e337a-a533-4918-8b64-ef49c9b623f9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:10.227991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-216e337a-a533-4918-8b64-ef49c9b623f9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:10.492479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e73ef3cd-711f-47af-9aae-f9ef2ecc462c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:10.512558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e73ef3cd-711f-47af-9aae-f9ef2ecc462c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:10.522856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e73ef3cd-711f-47af-9aae-f9ef2ecc462c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:10.524023 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e73ef3cd-711f-47af-9aae-f9ef2ecc462c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1343 microversion: 2.25 time: 0.807736 Aug 23 17:55:10.524957 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 610/1156] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:09 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1343 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:55:10.532669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-33481d4d-77d2-4170-a527-38efb1176811 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:10.533289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-33481d4d-77d2-4170-a527-38efb1176811 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:10.552861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33481d4d-77d2-4170-a527-38efb1176811 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:10.553369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33481d4d-77d2-4170-a527-38efb1176811 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:10.554000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33481d4d-77d2-4170-a527-38efb1176811 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:10.555097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33481d4d-77d2-4170-a527-38efb1176811 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:10.555716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33481d4d-77d2-4170-a527-38efb1176811 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:10.556328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33481d4d-77d2-4170-a527-38efb1176811 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:10.556633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-216e337a-a533-4918-8b64-ef49c9b623f9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:10.574321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-216e337a-a533-4918-8b64-ef49c9b623f9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.370768 Aug 23 17:55:10.580203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:10.595347 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 547/1157] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:10 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:10.605716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6eee0019-cf04-48ba-b6e9-f04718eec8e9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:10.606570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6eee0019-cf04-48ba-b6e9-f04718eec8e9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:10.630258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6eee0019-cf04-48ba-b6e9-f04718eec8e9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:10.630823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6eee0019-cf04-48ba-b6e9-f04718eec8e9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:10.631272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6eee0019-cf04-48ba-b6e9-f04718eec8e9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:10.631992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6eee0019-cf04-48ba-b6e9-f04718eec8e9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:10.632450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6eee0019-cf04-48ba-b6e9-f04718eec8e9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:10.632883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6eee0019-cf04-48ba-b6e9-f04718eec8e9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:10.726258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-33481d4d-77d2-4170-a527-38efb1176811 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:10.742591 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-33481d4d-77d2-4170-a527-38efb1176811 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1277 microversion: 2.1 time: 0.216311 Aug 23 17:55:10.743457 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 611/1158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:10 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:10.899555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6eee0019-cf04-48ba-b6e9-f04718eec8e9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:10.921736 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6eee0019-cf04-48ba-b6e9-f04718eec8e9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.323754 Aug 23 17:55:10.922597 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 548/1159] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:10 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:11.551585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1505eb86-135d-4eba-8926-f9117083cce0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:11.552205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1505eb86-135d-4eba-8926-f9117083cce0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:11.562599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1505eb86-135d-4eba-8926-f9117083cce0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:11.563102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1505eb86-135d-4eba-8926-f9117083cce0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:11.563547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1505eb86-135d-4eba-8926-f9117083cce0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:11.564270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1505eb86-135d-4eba-8926-f9117083cce0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:11.564733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1505eb86-135d-4eba-8926-f9117083cce0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:11.565168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1505eb86-135d-4eba-8926-f9117083cce0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:11.601284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ec9dc5d0-6712-415d-813e-a3c373070beb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:11.602043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ec9dc5d0-6712-415d-813e-a3c373070beb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:11.621666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9dc5d0-6712-415d-813e-a3c373070beb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:11.623896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9dc5d0-6712-415d-813e-a3c373070beb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:11.624978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9dc5d0-6712-415d-813e-a3c373070beb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:11.627466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9dc5d0-6712-415d-813e-a3c373070beb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:11.629875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9dc5d0-6712-415d-813e-a3c373070beb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:11.630614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9dc5d0-6712-415d-813e-a3c373070beb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:12.080488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1505eb86-135d-4eba-8926-f9117083cce0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:12.095172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1505eb86-135d-4eba-8926-f9117083cce0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:12.096839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1505eb86-135d-4eba-8926-f9117083cce0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:12.097992 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1505eb86-135d-4eba-8926-f9117083cce0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1411 microversion: 2.25 time: 0.550410 Aug 23 17:55:12.108718 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 612/1160] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:11 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1411 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:55:12.146756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3da0a89a-f053-444d-8e75-c8b8af3d95ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:12.148356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3da0a89a-f053-444d-8e75-c8b8af3d95ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:12.155238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3da0a89a-f053-444d-8e75-c8b8af3d95ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:12.155999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3da0a89a-f053-444d-8e75-c8b8af3d95ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:12.156608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3da0a89a-f053-444d-8e75-c8b8af3d95ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:12.157664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3da0a89a-f053-444d-8e75-c8b8af3d95ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:12.158283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3da0a89a-f053-444d-8e75-c8b8af3d95ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:12.159140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3da0a89a-f053-444d-8e75-c8b8af3d95ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:12.374925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3da0a89a-f053-444d-8e75-c8b8af3d95ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:12.384850 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3da0a89a-f053-444d-8e75-c8b8af3d95ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1283 microversion: 2.1 time: 0.272849 Aug 23 17:55:12.399825 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 613/1161] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:12 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1283 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:12.405208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-14fc60d2-772f-4013-98e0-dcd1fdc8b320 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:12.410450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-14fc60d2-772f-4013-98e0-dcd1fdc8b320 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:12.426613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ec9dc5d0-6712-415d-813e-a3c373070beb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:12.427845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14fc60d2-772f-4013-98e0-dcd1fdc8b320 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:12.428349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14fc60d2-772f-4013-98e0-dcd1fdc8b320 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:12.428788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14fc60d2-772f-4013-98e0-dcd1fdc8b320 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:12.429502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14fc60d2-772f-4013-98e0-dcd1fdc8b320 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:12.430277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14fc60d2-772f-4013-98e0-dcd1fdc8b320 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:12.431049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14fc60d2-772f-4013-98e0-dcd1fdc8b320 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:12.443513 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ec9dc5d0-6712-415d-813e-a3c373070beb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.847126 Aug 23 17:55:12.452833 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 549/1162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:11 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:12.549815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-e596f183-6b21-4e73-b24e-c6f08c4688f3 req-d7315495-143f-4799-a134-da6effd97524 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480827c0-1bbc-4e3f-9176-aebec4fc597b", "tag": "eec4fd61-f043-4080-a007-9c202b65aefc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:12.562489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e596f183-6b21-4e73-b24e-c6f08c4688f3 req-d7315495-143f-4799-a134-da6effd97524 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:12.563442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e596f183-6b21-4e73-b24e-c6f08c4688f3 req-d7315495-143f-4799-a134-da6effd97524 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:12.564057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e596f183-6b21-4e73-b24e-c6f08c4688f3 req-d7315495-143f-4799-a134-da6effd97524 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:12.578458 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-e596f183-6b21-4e73-b24e-c6f08c4688f3 req-d7315495-143f-4799-a134-da6effd97524 service nova] Creating event network-changed:eec4fd61-f043-4080-a007-9c202b65aefc for instance 480827c0-1bbc-4e3f-9176-aebec4fc597b on n-h2-850468-16 Aug 23 17:55:12.596890 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-e596f183-6b21-4e73-b24e-c6f08c4688f3 req-d7315495-143f-4799-a134-da6effd97524 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050922 Aug 23 17:55:12.596890 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 550/1163] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:12.805289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-14fc60d2-772f-4013-98e0-dcd1fdc8b320 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:12.820133 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-14fc60d2-772f-4013-98e0-dcd1fdc8b320 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.418810 Aug 23 17:55:12.821459 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 614/1164] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:12 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:13.139090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b0e7fed0-708e-48fd-8c2c-a702d588721e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:13.141079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b0e7fed0-708e-48fd-8c2c-a702d588721e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:13.154795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0e7fed0-708e-48fd-8c2c-a702d588721e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:13.155719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0e7fed0-708e-48fd-8c2c-a702d588721e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:13.157183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0e7fed0-708e-48fd-8c2c-a702d588721e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:13.158671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0e7fed0-708e-48fd-8c2c-a702d588721e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:13.159384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0e7fed0-708e-48fd-8c2c-a702d588721e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:13.159986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0e7fed0-708e-48fd-8c2c-a702d588721e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:13.410666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-50adaa24-2788-472f-a6d1-f88244d0736a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:13.412541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-50adaa24-2788-472f-a6d1-f88244d0736a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:13.429466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-50adaa24-2788-472f-a6d1-f88244d0736a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:13.430327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-50adaa24-2788-472f-a6d1-f88244d0736a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:13.434040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-50adaa24-2788-472f-a6d1-f88244d0736a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:13.435174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-50adaa24-2788-472f-a6d1-f88244d0736a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:13.435871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-50adaa24-2788-472f-a6d1-f88244d0736a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:13.438160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-50adaa24-2788-472f-a6d1-f88244d0736a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:13.462881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b0e7fed0-708e-48fd-8c2c-a702d588721e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:13.478670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b0e7fed0-708e-48fd-8c2c-a702d588721e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:13.480952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b0e7fed0-708e-48fd-8c2c-a702d588721e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:13.483142 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b0e7fed0-708e-48fd-8c2c-a702d588721e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1411 microversion: 2.25 time: 0.351177 Aug 23 17:55:13.484716 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 551/1165] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:13 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1411 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:55:13.495816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b2b6b50d-25bd-485a-99b7-77da9e986f75 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:13.497488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b2b6b50d-25bd-485a-99b7-77da9e986f75 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:13.507336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2b6b50d-25bd-485a-99b7-77da9e986f75 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:13.508207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2b6b50d-25bd-485a-99b7-77da9e986f75 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:13.508863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2b6b50d-25bd-485a-99b7-77da9e986f75 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:13.509833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2b6b50d-25bd-485a-99b7-77da9e986f75 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:13.511076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2b6b50d-25bd-485a-99b7-77da9e986f75 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:13.511910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2b6b50d-25bd-485a-99b7-77da9e986f75 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:13.831353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b2b6b50d-25bd-485a-99b7-77da9e986f75 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:13.856617 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b2b6b50d-25bd-485a-99b7-77da9e986f75 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.369273 Aug 23 17:55:13.866235 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 552/1166] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:13 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:13.888706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eea43090-3fd6-4a6b-9422-3884a4c12721 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:13.893810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eea43090-3fd6-4a6b-9422-3884a4c12721 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:13.910491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eea43090-3fd6-4a6b-9422-3884a4c12721 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:13.911641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eea43090-3fd6-4a6b-9422-3884a4c12721 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:13.912402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eea43090-3fd6-4a6b-9422-3884a4c12721 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:13.913899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eea43090-3fd6-4a6b-9422-3884a4c12721 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:13.914436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eea43090-3fd6-4a6b-9422-3884a4c12721 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:13.915173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eea43090-3fd6-4a6b-9422-3884a4c12721 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:14.139761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-50adaa24-2788-472f-a6d1-f88244d0736a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:14.141944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eea43090-3fd6-4a6b-9422-3884a4c12721 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:14.147931 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-50adaa24-2788-472f-a6d1-f88244d0736a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1325 microversion: 2.1 time: 0.744550 Aug 23 17:55:14.149745 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 615/1167] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:13 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1325 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:14.159385 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eea43090-3fd6-4a6b-9422-3884a4c12721 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.291401 Aug 23 17:55:14.168641 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 553/1168] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:13 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:14.510465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-305ed1f7-d7e4-402c-be07-ed1fa06632e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:14.512090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-305ed1f7-d7e4-402c-be07-ed1fa06632e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:14.520912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-305ed1f7-d7e4-402c-be07-ed1fa06632e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:14.521563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-305ed1f7-d7e4-402c-be07-ed1fa06632e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:14.522128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-305ed1f7-d7e4-402c-be07-ed1fa06632e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:14.523022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-305ed1f7-d7e4-402c-be07-ed1fa06632e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:14.523586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-305ed1f7-d7e4-402c-be07-ed1fa06632e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:14.524272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-305ed1f7-d7e4-402c-be07-ed1fa06632e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:14.633570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-2087c31a-a3c3-4e4c-9f40-342fb005cf1c req-30f87297-a913-49c8-9e0e-fece0cc5df1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0f5323-e9ef-48c9-91fa-3b500fc05057", "name": "network-vif-plugged", "status": "completed", "tag": "75e1d424-c713-4dc8-9bfb-fb5f98f20ce3"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:14.649826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2087c31a-a3c3-4e4c-9f40-342fb005cf1c req-30f87297-a913-49c8-9e0e-fece0cc5df1f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:14.650471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2087c31a-a3c3-4e4c-9f40-342fb005cf1c req-30f87297-a913-49c8-9e0e-fece0cc5df1f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:14.651452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2087c31a-a3c3-4e4c-9f40-342fb005cf1c req-30f87297-a913-49c8-9e0e-fece0cc5df1f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:14.663872 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-2087c31a-a3c3-4e4c-9f40-342fb005cf1c req-30f87297-a913-49c8-9e0e-fece0cc5df1f service nova] Creating event network-vif-plugged:75e1d424-c713-4dc8-9bfb-fb5f98f20ce3 for instance ed0f5323-e9ef-48c9-91fa-3b500fc05057 on n-h2-850468-16 Aug 23 17:55:14.670913 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-2087c31a-a3c3-4e4c-9f40-342fb005cf1c req-30f87297-a913-49c8-9e0e-fece0cc5df1f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042258 Aug 23 17:55:14.672115 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 554/1169] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:14.851802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-305ed1f7-d7e4-402c-be07-ed1fa06632e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:14.863713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-305ed1f7-d7e4-402c-be07-ed1fa06632e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:14.865491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-305ed1f7-d7e4-402c-be07-ed1fa06632e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:14.867814 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-305ed1f7-d7e4-402c-be07-ed1fa06632e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1411 microversion: 2.25 time: 0.361287 Aug 23 17:55:14.868846 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 616/1170] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:14 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1411 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:55:14.897981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-645a01b4-291e-4689-a827-b5a1f445f6f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:14.898851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-645a01b4-291e-4689-a827-b5a1f445f6f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:14.905497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-645a01b4-291e-4689-a827-b5a1f445f6f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:14.905987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-645a01b4-291e-4689-a827-b5a1f445f6f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:14.906420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-645a01b4-291e-4689-a827-b5a1f445f6f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:14.907468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-645a01b4-291e-4689-a827-b5a1f445f6f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:14.908237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-645a01b4-291e-4689-a827-b5a1f445f6f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:14.908342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-645a01b4-291e-4689-a827-b5a1f445f6f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:14.959367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-7559064d-c34d-4861-a000-f0fcd6359795 req-d7eb0ec2-3c16-43bb-8394-4d6b06186e8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61806701-e6ae-4bc0-abca-408ea9c3d186", "tag": "54c8eec2-ca60-4b8a-b3b7-cc13ced8964c"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:14.989088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7559064d-c34d-4861-a000-f0fcd6359795 req-d7eb0ec2-3c16-43bb-8394-4d6b06186e8c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:14.990077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7559064d-c34d-4861-a000-f0fcd6359795 req-d7eb0ec2-3c16-43bb-8394-4d6b06186e8c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:14.990659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7559064d-c34d-4861-a000-f0fcd6359795 req-d7eb0ec2-3c16-43bb-8394-4d6b06186e8c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:15.009096 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-7559064d-c34d-4861-a000-f0fcd6359795 req-d7eb0ec2-3c16-43bb-8394-4d6b06186e8c service nova] Creating event network-changed:54c8eec2-ca60-4b8a-b3b7-cc13ced8964c for instance 61806701-e6ae-4bc0-abca-408ea9c3d186 on n-h1-850468-16 Aug 23 17:55:15.017934 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-7559064d-c34d-4861-a000-f0fcd6359795 req-d7eb0ec2-3c16-43bb-8394-4d6b06186e8c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061310 Aug 23 17:55:15.031581 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 617/1171] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:15.100014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-645a01b4-291e-4689-a827-b5a1f445f6f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:15.103768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:15.110035 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-645a01b4-291e-4689-a827-b5a1f445f6f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.216258 Aug 23 17:55:15.111355 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 555/1172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:14 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:15.184209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-432740a4-a0a7-48dc-934f-fa7b6666fc7e tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:15.191289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-432740a4-a0a7-48dc-934f-fa7b6666fc7e tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:15.192671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fe65c3bf-aa46-4c63-a9a0-6da699318bdd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:15.193387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe65c3bf-aa46-4c63-a9a0-6da699318bdd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:15.219650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-432740a4-a0a7-48dc-934f-fa7b6666fc7e tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:15.220068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-432740a4-a0a7-48dc-934f-fa7b6666fc7e tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:15.220512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-432740a4-a0a7-48dc-934f-fa7b6666fc7e tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:15.221236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-432740a4-a0a7-48dc-934f-fa7b6666fc7e tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:15.221683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-432740a4-a0a7-48dc-934f-fa7b6666fc7e tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:15.223263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe65c3bf-aa46-4c63-a9a0-6da699318bdd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:15.223962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe65c3bf-aa46-4c63-a9a0-6da699318bdd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:15.224422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe65c3bf-aa46-4c63-a9a0-6da699318bdd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:15.225156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe65c3bf-aa46-4c63-a9a0-6da699318bdd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:15.225611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe65c3bf-aa46-4c63-a9a0-6da699318bdd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:15.226034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe65c3bf-aa46-4c63-a9a0-6da699318bdd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:15.226814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-432740a4-a0a7-48dc-934f-fa7b6666fc7e tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:15.482611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-432740a4-a0a7-48dc-934f-fa7b6666fc7e tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:15.486282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fe65c3bf-aa46-4c63-a9a0-6da699318bdd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:15.494053 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-432740a4-a0a7-48dc-934f-fa7b6666fc7e tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.316697 Aug 23 17:55:15.495258 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 556/1173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:15 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:15.504646 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fe65c3bf-aa46-4c63-a9a0-6da699318bdd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1325 microversion: 2.1 time: 0.333395 Aug 23 17:55:15.506236 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 618/1174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:15 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1325 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:15.892369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03bea726-ffac-4e9e-99d5-f9f8fa0cd4fb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:15.893176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-03bea726-ffac-4e9e-99d5-f9f8fa0cd4fb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:15.900175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03bea726-ffac-4e9e-99d5-f9f8fa0cd4fb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:15.900659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03bea726-ffac-4e9e-99d5-f9f8fa0cd4fb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:15.901402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03bea726-ffac-4e9e-99d5-f9f8fa0cd4fb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:15.902268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03bea726-ffac-4e9e-99d5-f9f8fa0cd4fb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:15.902749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03bea726-ffac-4e9e-99d5-f9f8fa0cd4fb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:15.903167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03bea726-ffac-4e9e-99d5-f9f8fa0cd4fb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:16.048856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-03bea726-ffac-4e9e-99d5-f9f8fa0cd4fb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:16.060966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-03bea726-ffac-4e9e-99d5-f9f8fa0cd4fb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:16.062843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-03bea726-ffac-4e9e-99d5-f9f8fa0cd4fb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:16.064121 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-03bea726-ffac-4e9e-99d5-f9f8fa0cd4fb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1411 microversion: 2.25 time: 0.176869 Aug 23 17:55:16.064764 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 557/1175] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:15 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1411 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:55:16.132668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49e8c359-9d25-44f7-abdb-6c990ced2422 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:16.133874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49e8c359-9d25-44f7-abdb-6c990ced2422 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:16.142133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e8c359-9d25-44f7-abdb-6c990ced2422 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:16.142811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e8c359-9d25-44f7-abdb-6c990ced2422 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:16.143644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e8c359-9d25-44f7-abdb-6c990ced2422 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:16.144258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e8c359-9d25-44f7-abdb-6c990ced2422 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:16.144831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e8c359-9d25-44f7-abdb-6c990ced2422 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:16.145359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e8c359-9d25-44f7-abdb-6c990ced2422 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:16.324816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-49e8c359-9d25-44f7-abdb-6c990ced2422 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:16.337986 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49e8c359-9d25-44f7-abdb-6c990ced2422 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.209966 Aug 23 17:55:16.353474 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 619/1176] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:16 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:16.517363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cb3c940d-ec57-448e-9229-b571b837a2d1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:16.518974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cb3c940d-ec57-448e-9229-b571b837a2d1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:16.527107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb3c940d-ec57-448e-9229-b571b837a2d1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:16.527970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb3c940d-ec57-448e-9229-b571b837a2d1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:16.528117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a7836d34-0337-4e8d-b68c-f21ec831f655 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:16.529513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a7836d34-0337-4e8d-b68c-f21ec831f655 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:16.529814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb3c940d-ec57-448e-9229-b571b837a2d1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:16.530746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb3c940d-ec57-448e-9229-b571b837a2d1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:16.531364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb3c940d-ec57-448e-9229-b571b837a2d1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:16.531955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb3c940d-ec57-448e-9229-b571b837a2d1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:16.538988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7836d34-0337-4e8d-b68c-f21ec831f655 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:16.539796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7836d34-0337-4e8d-b68c-f21ec831f655 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:16.540689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7836d34-0337-4e8d-b68c-f21ec831f655 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:16.541932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7836d34-0337-4e8d-b68c-f21ec831f655 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:16.542665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7836d34-0337-4e8d-b68c-f21ec831f655 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:16.543354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7836d34-0337-4e8d-b68c-f21ec831f655 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:16.684640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cb3c940d-ec57-448e-9229-b571b837a2d1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:16.693057 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cb3c940d-ec57-448e-9229-b571b837a2d1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.180241 Aug 23 17:55:16.693656 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 558/1177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:16 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:16.698518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-0695b777-60e7-47c6-b026-d55a0e01c894 req-f97a8be4-d62f-433a-a3c0-82038d410217 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9618a4e-13d0-4135-9700-f51ea58c7b2a", "name": "network-vif-plugged", "status": "completed", "tag": "a605fa68-187d-4064-83ac-b17332a2d0a2"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:16.709152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0695b777-60e7-47c6-b026-d55a0e01c894 req-f97a8be4-d62f-433a-a3c0-82038d410217 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:16.709643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0695b777-60e7-47c6-b026-d55a0e01c894 req-f97a8be4-d62f-433a-a3c0-82038d410217 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:16.710134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0695b777-60e7-47c6-b026-d55a0e01c894 req-f97a8be4-d62f-433a-a3c0-82038d410217 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:16.723255 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-0695b777-60e7-47c6-b026-d55a0e01c894 req-f97a8be4-d62f-433a-a3c0-82038d410217 service nova] Creating event network-vif-plugged:a605fa68-187d-4064-83ac-b17332a2d0a2 for instance a9618a4e-13d0-4135-9700-f51ea58c7b2a on n-h1-850468-16 Aug 23 17:55:16.728244 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-0695b777-60e7-47c6-b026-d55a0e01c894 req-f97a8be4-d62f-433a-a3c0-82038d410217 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033309 Aug 23 17:55:16.728859 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 559/1178] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:17.077169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a7836d34-0337-4e8d-b68c-f21ec831f655 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:17.085200 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a7836d34-0337-4e8d-b68c-f21ec831f655 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1325 microversion: 2.1 time: 0.561336 Aug 23 17:55:17.086740 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 620/1179] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:16 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1325 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:17.088875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-32c1ac19-5675-4774-8e42-2801229749e2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:17.089836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-32c1ac19-5675-4774-8e42-2801229749e2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:17.097295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32c1ac19-5675-4774-8e42-2801229749e2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:17.098018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32c1ac19-5675-4774-8e42-2801229749e2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:17.098669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32c1ac19-5675-4774-8e42-2801229749e2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:17.099507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32c1ac19-5675-4774-8e42-2801229749e2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:17.100028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32c1ac19-5675-4774-8e42-2801229749e2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:17.100526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32c1ac19-5675-4774-8e42-2801229749e2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:17.321582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-32c1ac19-5675-4774-8e42-2801229749e2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:17.330313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-32c1ac19-5675-4774-8e42-2801229749e2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:17.331893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-32c1ac19-5675-4774-8e42-2801229749e2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:17.333011 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-32c1ac19-5675-4774-8e42-2801229749e2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1411 microversion: 2.25 time: 0.249375 Aug 23 17:55:17.333573 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 560/1180] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:17 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1411 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:55:17.360580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fb1ec984-89fd-4d59-958b-2ade616f7d3e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:17.361198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fb1ec984-89fd-4d59-958b-2ade616f7d3e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:17.368189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb1ec984-89fd-4d59-958b-2ade616f7d3e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:17.368679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb1ec984-89fd-4d59-958b-2ade616f7d3e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:17.369150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb1ec984-89fd-4d59-958b-2ade616f7d3e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:17.369834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb1ec984-89fd-4d59-958b-2ade616f7d3e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:17.370293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb1ec984-89fd-4d59-958b-2ade616f7d3e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:17.370752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb1ec984-89fd-4d59-958b-2ade616f7d3e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:17.507562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fb1ec984-89fd-4d59-958b-2ade616f7d3e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:17.517174 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fb1ec984-89fd-4d59-958b-2ade616f7d3e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.160888 Aug 23 17:55:17.517836 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 621/1181] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:17 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:17.715723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5c7c910-e391-4c80-857d-c4c2babf49fc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:17.717925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e5c7c910-e391-4c80-857d-c4c2babf49fc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:17.724117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c7c910-e391-4c80-857d-c4c2babf49fc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:17.724598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c7c910-e391-4c80-857d-c4c2babf49fc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:17.725030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c7c910-e391-4c80-857d-c4c2babf49fc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:17.725727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c7c910-e391-4c80-857d-c4c2babf49fc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:17.726355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c7c910-e391-4c80-857d-c4c2babf49fc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:17.726857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c7c910-e391-4c80-857d-c4c2babf49fc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:17.882882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e5c7c910-e391-4c80-857d-c4c2babf49fc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:17.893012 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e5c7c910-e391-4c80-857d-c4c2babf49fc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.181546 Aug 23 17:55:17.906175 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 561/1182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:17 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:18.108265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-828c1d63-0829-49de-a136-95912656a94a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:18.109249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-828c1d63-0829-49de-a136-95912656a94a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:18.117075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-828c1d63-0829-49de-a136-95912656a94a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:18.117576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-828c1d63-0829-49de-a136-95912656a94a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:18.118020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-828c1d63-0829-49de-a136-95912656a94a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:18.118948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-828c1d63-0829-49de-a136-95912656a94a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:18.119412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-828c1d63-0829-49de-a136-95912656a94a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:18.120050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-828c1d63-0829-49de-a136-95912656a94a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:18.340890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-828c1d63-0829-49de-a136-95912656a94a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:18.349199 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-828c1d63-0829-49de-a136-95912656a94a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1325 microversion: 2.1 time: 0.246631 Aug 23 17:55:18.349832 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 622/1183] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:18 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1325 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:18.356047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef302ad8-32c1-4bb7-bd15-77662761d2a4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:18.357791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef302ad8-32c1-4bb7-bd15-77662761d2a4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:18.364670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef302ad8-32c1-4bb7-bd15-77662761d2a4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:18.365157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef302ad8-32c1-4bb7-bd15-77662761d2a4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:18.365695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef302ad8-32c1-4bb7-bd15-77662761d2a4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:18.366457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef302ad8-32c1-4bb7-bd15-77662761d2a4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:18.367239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef302ad8-32c1-4bb7-bd15-77662761d2a4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:18.367727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef302ad8-32c1-4bb7-bd15-77662761d2a4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:18.503349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef302ad8-32c1-4bb7-bd15-77662761d2a4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:18.512761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef302ad8-32c1-4bb7-bd15-77662761d2a4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:18.515143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef302ad8-32c1-4bb7-bd15-77662761d2a4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:18.516324 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef302ad8-32c1-4bb7-bd15-77662761d2a4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1411 microversion: 2.25 time: 0.164519 Aug 23 17:55:18.517109 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 562/1184] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:18 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1411 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:55:18.540759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1a3388fa-cdd8-4e82-b209-7f494d481c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:18.542179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1a3388fa-cdd8-4e82-b209-7f494d481c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:18.550617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a3388fa-cdd8-4e82-b209-7f494d481c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:18.551206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a3388fa-cdd8-4e82-b209-7f494d481c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:18.551871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a3388fa-cdd8-4e82-b209-7f494d481c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:18.552592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a3388fa-cdd8-4e82-b209-7f494d481c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:18.553053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a3388fa-cdd8-4e82-b209-7f494d481c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:18.553488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a3388fa-cdd8-4e82-b209-7f494d481c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:18.914131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-70429f43-1f44-4fc0-8e2c-22365cb28ad4 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:18.914711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-70429f43-1f44-4fc0-8e2c-22365cb28ad4 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:18.921034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70429f43-1f44-4fc0-8e2c-22365cb28ad4 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:18.921524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70429f43-1f44-4fc0-8e2c-22365cb28ad4 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:18.921962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70429f43-1f44-4fc0-8e2c-22365cb28ad4 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:18.922696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70429f43-1f44-4fc0-8e2c-22365cb28ad4 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:18.923158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70429f43-1f44-4fc0-8e2c-22365cb28ad4 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:18.923594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70429f43-1f44-4fc0-8e2c-22365cb28ad4 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:18.938803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:18.975256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=18 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:18.983133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1a3388fa-cdd8-4e82-b209-7f494d481c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:18.991306 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1a3388fa-cdd8-4e82-b209-7f494d481c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.455340 Aug 23 17:55:18.992129 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 623/1185] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:18 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:19.069612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-70429f43-1f44-4fc0-8e2c-22365cb28ad4 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:19.078752 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-70429f43-1f44-4fc0-8e2c-22365cb28ad4 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.168520 Aug 23 17:55:19.079433 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 563/1186] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:18 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:19.371366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c2fe9d05-9991-40e2-977c-b22bc28aa0bb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:19.372072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c2fe9d05-9991-40e2-977c-b22bc28aa0bb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:19.378784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2fe9d05-9991-40e2-977c-b22bc28aa0bb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:19.379332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2fe9d05-9991-40e2-977c-b22bc28aa0bb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:19.379767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2fe9d05-9991-40e2-977c-b22bc28aa0bb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:19.380450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2fe9d05-9991-40e2-977c-b22bc28aa0bb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:19.380901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2fe9d05-9991-40e2-977c-b22bc28aa0bb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:19.381560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2fe9d05-9991-40e2-977c-b22bc28aa0bb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:19.398883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:19.539868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-90a3c49c-cc9e-4da6-8cdf-13d88eb1b4c5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:19.540477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-90a3c49c-cc9e-4da6-8cdf-13d88eb1b4c5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:19.549104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90a3c49c-cc9e-4da6-8cdf-13d88eb1b4c5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:19.549690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90a3c49c-cc9e-4da6-8cdf-13d88eb1b4c5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:19.550493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90a3c49c-cc9e-4da6-8cdf-13d88eb1b4c5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:19.554532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90a3c49c-cc9e-4da6-8cdf-13d88eb1b4c5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:19.554890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90a3c49c-cc9e-4da6-8cdf-13d88eb1b4c5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:19.556169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90a3c49c-cc9e-4da6-8cdf-13d88eb1b4c5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:19.570062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c2fe9d05-9991-40e2-977c-b22bc28aa0bb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:19.579966 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c2fe9d05-9991-40e2-977c-b22bc28aa0bb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1325 microversion: 2.1 time: 0.212312 Aug 23 17:55:19.580566 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 624/1187] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:19 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1325 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:19.804443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-90a3c49c-cc9e-4da6-8cdf-13d88eb1b4c5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:19.813612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-90a3c49c-cc9e-4da6-8cdf-13d88eb1b4c5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:19.815405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-90a3c49c-cc9e-4da6-8cdf-13d88eb1b4c5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:19.816668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-90a3c49c-cc9e-4da6-8cdf-13d88eb1b4c5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1411 microversion: 2.25 time: 0.280685 Aug 23 17:55:19.817460 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 564/1188] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:19 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1411 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:55:20.012974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a4021ee-bfc8-47ca-a3b6-6b8281be8b74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:20.014060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6a4021ee-bfc8-47ca-a3b6-6b8281be8b74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:20.021082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a4021ee-bfc8-47ca-a3b6-6b8281be8b74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:20.021841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a4021ee-bfc8-47ca-a3b6-6b8281be8b74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:20.022477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a4021ee-bfc8-47ca-a3b6-6b8281be8b74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:20.023403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a4021ee-bfc8-47ca-a3b6-6b8281be8b74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:20.024021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a4021ee-bfc8-47ca-a3b6-6b8281be8b74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:20.024613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a4021ee-bfc8-47ca-a3b6-6b8281be8b74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:20.079267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-41abd624-637f-4751-b364-0289fadae7bf req-3f96ff92-e738-4b3b-976b-b525a20e48c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480827c0-1bbc-4e3f-9176-aebec4fc597b", "name": "network-vif-plugged", "status": "completed", "tag": "eec4fd61-f043-4080-a007-9c202b65aefc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:20.091842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-41abd624-637f-4751-b364-0289fadae7bf req-3f96ff92-e738-4b3b-976b-b525a20e48c7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:20.092806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-41abd624-637f-4751-b364-0289fadae7bf req-3f96ff92-e738-4b3b-976b-b525a20e48c7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:20.093399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-41abd624-637f-4751-b364-0289fadae7bf req-3f96ff92-e738-4b3b-976b-b525a20e48c7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:20.113886 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-41abd624-637f-4751-b364-0289fadae7bf req-3f96ff92-e738-4b3b-976b-b525a20e48c7 service nova] Creating event network-vif-plugged:eec4fd61-f043-4080-a007-9c202b65aefc for instance 480827c0-1bbc-4e3f-9176-aebec4fc597b on n-h2-850468-16 Aug 23 17:55:20.121654 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-41abd624-637f-4751-b364-0289fadae7bf req-3f96ff92-e738-4b3b-976b-b525a20e48c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046846 Aug 23 17:55:20.125071 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 565/1189] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:20.136031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1a834446-e147-4c66-8772-fce306d316f0 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:20.137369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1a834446-e147-4c66-8772-fce306d316f0 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:20.146728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a834446-e147-4c66-8772-fce306d316f0 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:20.147588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a834446-e147-4c66-8772-fce306d316f0 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:20.148784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a834446-e147-4c66-8772-fce306d316f0 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:20.149984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a834446-e147-4c66-8772-fce306d316f0 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:20.150654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a834446-e147-4c66-8772-fce306d316f0 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:20.151266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a834446-e147-4c66-8772-fce306d316f0 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:20.286032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a4021ee-bfc8-47ca-a3b6-6b8281be8b74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:20.298568 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a4021ee-bfc8-47ca-a3b6-6b8281be8b74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.289476 Aug 23 17:55:20.299165 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 625/1190] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:20 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:20.443282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1a834446-e147-4c66-8772-fce306d316f0 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:20.453075 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1a834446-e147-4c66-8772-fce306d316f0 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1320 microversion: 2.1 time: 0.326118 Aug 23 17:55:20.455769 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 566/1191] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:20 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1320 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:20.601562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed67b053-7558-41e2-b41b-2d13fa4b7c5d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:20.602388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ed67b053-7558-41e2-b41b-2d13fa4b7c5d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:20.609931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed67b053-7558-41e2-b41b-2d13fa4b7c5d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:20.610425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed67b053-7558-41e2-b41b-2d13fa4b7c5d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:20.610895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed67b053-7558-41e2-b41b-2d13fa4b7c5d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:20.612159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed67b053-7558-41e2-b41b-2d13fa4b7c5d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:20.612899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed67b053-7558-41e2-b41b-2d13fa4b7c5d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:20.613477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed67b053-7558-41e2-b41b-2d13fa4b7c5d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:20.773252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ed67b053-7558-41e2-b41b-2d13fa4b7c5d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:20.782367 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ed67b053-7558-41e2-b41b-2d13fa4b7c5d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1325 microversion: 2.1 time: 0.184771 Aug 23 17:55:20.782985 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 626/1192] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:20 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1325 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:20.841591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-782cbd2d-8340-40d2-858b-caa2ab014dcf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:20.842896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-782cbd2d-8340-40d2-858b-caa2ab014dcf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:20.850404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-782cbd2d-8340-40d2-858b-caa2ab014dcf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:20.850971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-782cbd2d-8340-40d2-858b-caa2ab014dcf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:20.851414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-782cbd2d-8340-40d2-858b-caa2ab014dcf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:20.852450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-782cbd2d-8340-40d2-858b-caa2ab014dcf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:20.852915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-782cbd2d-8340-40d2-858b-caa2ab014dcf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:20.853968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-782cbd2d-8340-40d2-858b-caa2ab014dcf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:21.083190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-782cbd2d-8340-40d2-858b-caa2ab014dcf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:21.093888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-782cbd2d-8340-40d2-858b-caa2ab014dcf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:21.096539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-782cbd2d-8340-40d2-858b-caa2ab014dcf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:21.098100 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-782cbd2d-8340-40d2-858b-caa2ab014dcf tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1411 microversion: 2.25 time: 0.261208 Aug 23 17:55:21.111401 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 567/1193] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:20 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1411 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:55:21.322901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fdbf98e5-1e5f-43e8-a728-353218556f4d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:21.323775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fdbf98e5-1e5f-43e8-a728-353218556f4d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:21.331971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbf98e5-1e5f-43e8-a728-353218556f4d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:21.332662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbf98e5-1e5f-43e8-a728-353218556f4d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:21.336170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbf98e5-1e5f-43e8-a728-353218556f4d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:21.343987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbf98e5-1e5f-43e8-a728-353218556f4d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:21.344676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbf98e5-1e5f-43e8-a728-353218556f4d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:21.345276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbf98e5-1e5f-43e8-a728-353218556f4d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:21.478260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-069da63a-b802-4253-9963-3628424cf1b7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:21.478947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-069da63a-b802-4253-9963-3628424cf1b7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:21.488033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-069da63a-b802-4253-9963-3628424cf1b7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:21.488776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-069da63a-b802-4253-9963-3628424cf1b7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:21.489402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-069da63a-b802-4253-9963-3628424cf1b7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:21.490358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-069da63a-b802-4253-9963-3628424cf1b7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:21.491137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-069da63a-b802-4253-9963-3628424cf1b7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:21.491902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-069da63a-b802-4253-9963-3628424cf1b7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:21.511139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fdbf98e5-1e5f-43e8-a728-353218556f4d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:21.525475 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fdbf98e5-1e5f-43e8-a728-353218556f4d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.204576 Aug 23 17:55:21.529634 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 627/1194] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:21 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:21.661508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-069da63a-b802-4253-9963-3628424cf1b7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:21.701225 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-069da63a-b802-4253-9963-3628424cf1b7 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 200 len: 1508 microversion: 2.1 time: 0.227094 Aug 23 17:55:21.701830 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 568/1195] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:21 2022] GET /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 1508 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:21.722683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-30da775e-f194-40d4-ab8f-305ecb577982 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:21.723385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-30da775e-f194-40d4-ab8f-305ecb577982 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: ed0f5323-e9ef-48c9-91fa-3b500fc05057] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:21.735744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30da775e-f194-40d4-ab8f-305ecb577982 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:21.736239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30da775e-f194-40d4-ab8f-305ecb577982 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:21.736677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30da775e-f194-40d4-ab8f-305ecb577982 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:21.737388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30da775e-f194-40d4-ab8f-305ecb577982 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:21.737846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30da775e-f194-40d4-ab8f-305ecb577982 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:21.738273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30da775e-f194-40d4-ab8f-305ecb577982 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:21.876948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-1713487322", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:21.900446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-30da775e-f194-40d4-ab8f-305ecb577982 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:21.902976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:21.909949 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-30da775e-f194-40d4-ab8f-305ecb577982 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/ed0f5323-e9ef-48c9-91fa-3b500fc05057" status: 200 len: 1508 microversion: 2.1 time: 0.192127 Aug 23 17:55:21.910817 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 628/1196] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:21 2022] GET /compute/v2.1/servers/ed0f5323-e9ef-48c9-91fa-3b500fc05057 => generated 1508 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:21.918344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-08746508-8368-45ba-bd89-4944beb52d64 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:21.918983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-08746508-8368-45ba-bd89-4944beb52d64 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:21.929902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08746508-8368-45ba-bd89-4944beb52d64 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:21.930458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08746508-8368-45ba-bd89-4944beb52d64 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:21.931046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08746508-8368-45ba-bd89-4944beb52d64 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:21.931821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08746508-8368-45ba-bd89-4944beb52d64 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:21.932347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08746508-8368-45ba-bd89-4944beb52d64 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:21.932836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08746508-8368-45ba-bd89-4944beb52d64 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:21.941788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] validate_networks() for [('f6ed42ee-5917-4a15-baa0-4c5ffe752291', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:55:22.092340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-08746508-8368-45ba-bd89-4944beb52d64 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:22.100546 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-08746508-8368-45ba-bd89-4944beb52d64 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1325 microversion: 2.1 time: 0.188463 Aug 23 17:55:22.101231 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 629/1197] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:21 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1325 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:22.118225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ea9c9aee-4cd2-40ff-ab1b-62098bf34763 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:22.118806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ea9c9aee-4cd2-40ff-ab1b-62098bf34763 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: ed0f5323-e9ef-48c9-91fa-3b500fc05057] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:22.125666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea9c9aee-4cd2-40ff-ab1b-62098bf34763 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.126316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea9c9aee-4cd2-40ff-ab1b-62098bf34763 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.126850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea9c9aee-4cd2-40ff-ab1b-62098bf34763 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:22.127639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea9c9aee-4cd2-40ff-ab1b-62098bf34763 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.128168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea9c9aee-4cd2-40ff-ab1b-62098bf34763 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.128670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea9c9aee-4cd2-40ff-ab1b-62098bf34763 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:22.164214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ea9c9aee-4cd2-40ff-ab1b-62098bf34763 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: ed0f5323-e9ef-48c9-91fa-3b500fc05057] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:55:22.300857 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ea9c9aee-4cd2-40ff-ab1b-62098bf34763 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ed0f5323-e9ef-48c9-91fa-3b500fc05057" status: 204 len: 0 microversion: 2.1 time: 0.196174 Aug 23 17:55:22.304534 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 630/1198] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:55:22 2022] DELETE /compute/v2.1/servers/ed0f5323-e9ef-48c9-91fa-3b500fc05057 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:55:22.316424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-06725b7c-5332-4887-a1ac-ff8604f838e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:22.317137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-06725b7c-5332-4887-a1ac-ff8604f838e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:22.325776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06725b7c-5332-4887-a1ac-ff8604f838e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.326356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06725b7c-5332-4887-a1ac-ff8604f838e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.326793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06725b7c-5332-4887-a1ac-ff8604f838e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:22.327810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06725b7c-5332-4887-a1ac-ff8604f838e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.328064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06725b7c-5332-4887-a1ac-ff8604f838e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.328634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06725b7c-5332-4887-a1ac-ff8604f838e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:22.533171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-06725b7c-5332-4887-a1ac-ff8604f838e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:22.543061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-06725b7c-5332-4887-a1ac-ff8604f838e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:22.546578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-06725b7c-5332-4887-a1ac-ff8604f838e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:22.547928 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-06725b7c-5332-4887-a1ac-ff8604f838e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1607 microversion: 2.25 time: 0.242138 Aug 23 17:55:22.557799 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 631/1199] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:55:22 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1607 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:55:22.564178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95e91b7b-e9a3-42ad-8eea-d72a88e36db1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:22.564938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-95e91b7b-e9a3-42ad-8eea-d72a88e36db1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:22.576703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95e91b7b-e9a3-42ad-8eea-d72a88e36db1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.578188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95e91b7b-e9a3-42ad-8eea-d72a88e36db1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.578188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95e91b7b-e9a3-42ad-8eea-d72a88e36db1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:22.579469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95e91b7b-e9a3-42ad-8eea-d72a88e36db1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.580130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95e91b7b-e9a3-42ad-8eea-d72a88e36db1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.580634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95e91b7b-e9a3-42ad-8eea-d72a88e36db1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:22.617594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-95e91b7b-e9a3-42ad-8eea-d72a88e36db1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a9618a4e-13d0-4135-9700-f51ea58c7b2a] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:55:22.694695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:22.699100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:55:22.699453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:55:22.699723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:55:22.700956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:55:22.701379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:55:22.711528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.712022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.712473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:22.713343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.713853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.714288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:22.719202 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-95e91b7b-e9a3-42ad-8eea-d72a88e36db1 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a" status: 204 len: 0 microversion: 2.1 time: 0.159574 Aug 23 17:55:22.719905 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 632/1200] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:55:22 2022] DELETE /compute/v2.1/servers/a9618a4e-13d0-4135-9700-f51ea58c7b2a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:55:22.727208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a4b2ccc7-3ecb-4c83-8398-680447d48a57 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:22.728573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a4b2ccc7-3ecb-4c83-8398-680447d48a57 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:22.737367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4b2ccc7-3ecb-4c83-8398-680447d48a57 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.738125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4b2ccc7-3ecb-4c83-8398-680447d48a57 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.738837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4b2ccc7-3ecb-4c83-8398-680447d48a57 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:22.739914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4b2ccc7-3ecb-4c83-8398-680447d48a57 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.740638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4b2ccc7-3ecb-4c83-8398-680447d48a57 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.741328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4b2ccc7-3ecb-4c83-8398-680447d48a57 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:22.741947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Getting quotas for project e6e4c52fe92040e9b532db25ee92d308. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:55:22.749567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Getting quotas for user 6efa870487f347eb9886ec8ba62360f8 and project e6e4c52fe92040e9b532db25ee92d308. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:55:22.768526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:55:22.772184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:55:22.840676 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c85c10a1-76b4-4bf7-9e51-6770d72d053b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.117523 Aug 23 17:55:22.842327 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 569/1201] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:55:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 17:55:22.848140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51a3f0c0-8716-4704-b2bd-c8bb1cbb22bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:22.849112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51a3f0c0-8716-4704-b2bd-c8bb1cbb22bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:22.860197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51a3f0c0-8716-4704-b2bd-c8bb1cbb22bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.860546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51a3f0c0-8716-4704-b2bd-c8bb1cbb22bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.860992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51a3f0c0-8716-4704-b2bd-c8bb1cbb22bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:22.861927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51a3f0c0-8716-4704-b2bd-c8bb1cbb22bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.862388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51a3f0c0-8716-4704-b2bd-c8bb1cbb22bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.862865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51a3f0c0-8716-4704-b2bd-c8bb1cbb22bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:22.942450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a4b2ccc7-3ecb-4c83-8398-680447d48a57 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:22.964715 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51a3f0c0-8716-4704-b2bd-c8bb1cbb22bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-interface" status: 200 len: 285 microversion: 2.25 time: 0.121058 Aug 23 17:55:22.965563 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 570/1202] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Aug 23 17:55:22 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-interface => generated 285 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:55:22.966894 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a4b2ccc7-3ecb-4c83-8398-680447d48a57 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.238033 Aug 23 17:55:22.969731 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 633/1203] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:22 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:22.970925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-9c6eb9df-3056-497e-ae39-6ee84cd036bf req-99329da5-4870-427f-9c73-92556d1a4537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61806701-e6ae-4bc0-abca-408ea9c3d186", "name": "network-vif-plugged", "status": "completed", "tag": "54c8eec2-ca60-4b8a-b3b7-cc13ced8964c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:22.981478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-220961bb-e125-4ef8-9324-69dbb30609f2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:22.987427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-220961bb-e125-4ef8-9324-69dbb30609f2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:22.989424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9c6eb9df-3056-497e-ae39-6ee84cd036bf req-99329da5-4870-427f-9c73-92556d1a4537 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:22.990122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9c6eb9df-3056-497e-ae39-6ee84cd036bf req-99329da5-4870-427f-9c73-92556d1a4537 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:22.990981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9c6eb9df-3056-497e-ae39-6ee84cd036bf req-99329da5-4870-427f-9c73-92556d1a4537 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:23.005053 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-9c6eb9df-3056-497e-ae39-6ee84cd036bf req-99329da5-4870-427f-9c73-92556d1a4537 service nova] Creating event network-vif-plugged:54c8eec2-ca60-4b8a-b3b7-cc13ced8964c for instance 61806701-e6ae-4bc0-abca-408ea9c3d186 on n-h1-850468-16 Aug 23 17:55:23.010968 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-9c6eb9df-3056-497e-ae39-6ee84cd036bf req-99329da5-4870-427f-9c73-92556d1a4537 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043422 Aug 23 17:55:23.011968 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 571/1204] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:23.020252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-453564840", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "23eba81b-4095-440f-9de1-ccc65be55345"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:23.105491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-220961bb-e125-4ef8-9324-69dbb30609f2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:23.116834 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-220961bb-e125-4ef8-9324-69dbb30609f2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1214 microversion: 2.1 time: 0.145806 Aug 23 17:55:23.118483 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 634/1205] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:22 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:23.125215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-babdca41-3ecf-4b18-abda-3832f5359d29 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:23.126455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-babdca41-3ecf-4b18-abda-3832f5359d29 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:23.129550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] validate_networks() for [('23eba81b-4095-440f-9de1-ccc65be55345', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:55:23.136760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-babdca41-3ecf-4b18-abda-3832f5359d29 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:23.137486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-babdca41-3ecf-4b18-abda-3832f5359d29 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:23.138107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-babdca41-3ecf-4b18-abda-3832f5359d29 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:23.139178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-babdca41-3ecf-4b18-abda-3832f5359d29 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:23.140003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-babdca41-3ecf-4b18-abda-3832f5359d29 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:23.140794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-babdca41-3ecf-4b18-abda-3832f5359d29 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:23.330820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-babdca41-3ecf-4b18-abda-3832f5359d29 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:23.339330 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-babdca41-3ecf-4b18-abda-3832f5359d29 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1325 microversion: 2.1 time: 0.219284 Aug 23 17:55:23.353934 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 635/1206] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:23 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1325 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:23.992998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ce0d55a-c11f-4329-b00c-9b7652719ee7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:23.994571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9ce0d55a-c11f-4329-b00c-9b7652719ee7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:24.002483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ce0d55a-c11f-4329-b00c-9b7652719ee7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:24.003092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ce0d55a-c11f-4329-b00c-9b7652719ee7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:24.003588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ce0d55a-c11f-4329-b00c-9b7652719ee7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:24.004536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ce0d55a-c11f-4329-b00c-9b7652719ee7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:24.005055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ce0d55a-c11f-4329-b00c-9b7652719ee7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:24.005546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ce0d55a-c11f-4329-b00c-9b7652719ee7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:24.012381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:55:24.012889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:55:24.013285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:55:24.013689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:55:24.014099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:55:24.025765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:24.026249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:24.030646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:24.031726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:24.032515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:24.033114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:24.073178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Getting quotas for project 97827eb64dfd4e6e8adb0cb27df60f0a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:55:24.080009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Getting quotas for user 9d51f46cd65a4722afb17a02357ef8bb and project 97827eb64dfd4e6e8adb0cb27df60f0a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:55:24.100600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Going to run 2 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:55:24.103500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a3d726c6-9bae-4276-b8e2-5eafe4270dce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:55:24.157715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=a3d726c6-9bae-4276-b8e2-5eafe4270dce,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:55:24.194949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9ce0d55a-c11f-4329-b00c-9b7652719ee7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:24.207187 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9ce0d55a-c11f-4329-b00c-9b7652719ee7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.219651 Aug 23 17:55:24.209196 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 636/1207] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:23 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:24.233788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f23e7fe9-3aed-4651-adb0-f5d2b9cbee89 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:24.235456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f23e7fe9-3aed-4651-adb0-f5d2b9cbee89 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:24.240006 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-048d70dc-4729-4033-8269-a5d6d94ae708 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.225845 Aug 23 17:55:24.240621 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 572/1208] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:55:23 2022] POST /compute/v2.1/servers => generated 32 bytes in 1228 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 23 17:55:24.249010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8396cb5-e5cb-4f58-acfc-a83a585c4237 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:24.254125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8396cb5-e5cb-4f58-acfc-a83a585c4237 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:24.254978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8396cb5-e5cb-4f58-acfc-a83a585c4237 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Searching by: {'deleted': False, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:55:24.266108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f23e7fe9-3aed-4651-adb0-f5d2b9cbee89 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:24.271184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f23e7fe9-3aed-4651-adb0-f5d2b9cbee89 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:24.271888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f23e7fe9-3aed-4651-adb0-f5d2b9cbee89 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:24.272830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f23e7fe9-3aed-4651-adb0-f5d2b9cbee89 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:24.273507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f23e7fe9-3aed-4651-adb0-f5d2b9cbee89 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:24.275046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8396cb5-e5cb-4f58-acfc-a83a585c4237 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:24.275288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f23e7fe9-3aed-4651-adb0-f5d2b9cbee89 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:24.275566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8396cb5-e5cb-4f58-acfc-a83a585c4237 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:24.275986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8396cb5-e5cb-4f58-acfc-a83a585c4237 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:24.276733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8396cb5-e5cb-4f58-acfc-a83a585c4237 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:24.277350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8396cb5-e5cb-4f58-acfc-a83a585c4237 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:24.277924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8396cb5-e5cb-4f58-acfc-a83a585c4237 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:24.307485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-b8396cb5-e5cb-4f58-acfc-a83a585c4237 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:55:24.382062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f23e7fe9-3aed-4651-adb0-f5d2b9cbee89 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:24.392063 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f23e7fe9-3aed-4651-adb0-f5d2b9cbee89 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1266 microversion: 2.1 time: 0.162055 Aug 23 17:55:24.394128 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8396cb5-e5cb-4f58-acfc-a83a585c4237 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1335 microversion: 2.1 time: 0.149139 Aug 23 17:55:24.402961 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 573/1209] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 17:55:24 2022] GET /compute/v2.1/servers => generated 1335 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:24.411119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e8e7ec93-7857-420f-adb7-25ec4b8e281c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:24.411582 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 637/1210] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:24 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:24.414780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e8e7ec93-7857-420f-adb7-25ec4b8e281c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:24.420665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-727b6856-ce60-4f91-b104-c5c571e99b24 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:24.421279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-727b6856-ce60-4f91-b104-c5c571e99b24 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:24.429434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:24.438858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8e7ec93-7857-420f-adb7-25ec4b8e281c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:24.440581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8e7ec93-7857-420f-adb7-25ec4b8e281c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:24.441040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8e7ec93-7857-420f-adb7-25ec4b8e281c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:24.441769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8e7ec93-7857-420f-adb7-25ec4b8e281c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:24.442231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8e7ec93-7857-420f-adb7-25ec4b8e281c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:24.442697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8e7ec93-7857-420f-adb7-25ec4b8e281c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:24.530252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-727b6856-ce60-4f91-b104-c5c571e99b24 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:24.546303 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-727b6856-ce60-4f91-b104-c5c571e99b24 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1217 microversion: 2.1 time: 0.133060 Aug 23 17:55:24.559200 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 638/1211] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:24 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1217 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:24.783929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8e7ec93-7857-420f-adb7-25ec4b8e281c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:24.795453 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e8e7ec93-7857-420f-adb7-25ec4b8e281c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1325 microversion: 2.1 time: 0.389236 Aug 23 17:55:24.796788 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 574/1212] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:24 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1325 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:25.232785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-20aa9410-55f6-4ad4-9299-9f5d2eada23f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:25.233605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-20aa9410-55f6-4ad4-9299-9f5d2eada23f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:25.274122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20aa9410-55f6-4ad4-9299-9f5d2eada23f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:25.279400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20aa9410-55f6-4ad4-9299-9f5d2eada23f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:25.282699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20aa9410-55f6-4ad4-9299-9f5d2eada23f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:25.286778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20aa9410-55f6-4ad4-9299-9f5d2eada23f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:25.287564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20aa9410-55f6-4ad4-9299-9f5d2eada23f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:25.288281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20aa9410-55f6-4ad4-9299-9f5d2eada23f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:25.424634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2e7f04ee-5c40-4bee-b553-ad9836d4c8dd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:25.425323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2e7f04ee-5c40-4bee-b553-ad9836d4c8dd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:25.440358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e7f04ee-5c40-4bee-b553-ad9836d4c8dd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:25.440867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e7f04ee-5c40-4bee-b553-ad9836d4c8dd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:25.443661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e7f04ee-5c40-4bee-b553-ad9836d4c8dd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:25.444464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e7f04ee-5c40-4bee-b553-ad9836d4c8dd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:25.444947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e7f04ee-5c40-4bee-b553-ad9836d4c8dd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:25.445387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e7f04ee-5c40-4bee-b553-ad9836d4c8dd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:25.648476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2e7f04ee-5c40-4bee-b553-ad9836d4c8dd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:25.652270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:25.660626 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2e7f04ee-5c40-4bee-b553-ad9836d4c8dd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1272 microversion: 2.1 time: 0.241426 Aug 23 17:55:25.663455 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 575/1213] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:25 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:25.679422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4134f112-8803-4ecb-9f21-b5beb0bd8599 req-ea027370-4444-4532-ab70-44cc63551258 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480827c0-1bbc-4e3f-9176-aebec4fc597b", "tag": "eec4fd61-f043-4080-a007-9c202b65aefc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:25.684318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20aa9410-55f6-4ad4-9299-9f5d2eada23f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:25.703123 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-20aa9410-55f6-4ad4-9299-9f5d2eada23f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1477 microversion: 2.1 time: 0.472602 Aug 23 17:55:25.719012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4134f112-8803-4ecb-9f21-b5beb0bd8599 req-ea027370-4444-4532-ab70-44cc63551258 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:25.720558 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 639/1214] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:25 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1477 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:25.730764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4134f112-8803-4ecb-9f21-b5beb0bd8599 req-ea027370-4444-4532-ab70-44cc63551258 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:25.732183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4134f112-8803-4ecb-9f21-b5beb0bd8599 req-ea027370-4444-4532-ab70-44cc63551258 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:25.733408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ca3f2d00-7b38-4eb1-9367-ecbda568f929 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:25.734874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ca3f2d00-7b38-4eb1-9367-ecbda568f929 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:25.754846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca3f2d00-7b38-4eb1-9367-ecbda568f929 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:25.755654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca3f2d00-7b38-4eb1-9367-ecbda568f929 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:25.755781 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4134f112-8803-4ecb-9f21-b5beb0bd8599 req-ea027370-4444-4532-ab70-44cc63551258 service nova] Creating event network-changed:eec4fd61-f043-4080-a007-9c202b65aefc for instance 480827c0-1bbc-4e3f-9176-aebec4fc597b on n-h2-850468-16 Aug 23 17:55:25.757722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca3f2d00-7b38-4eb1-9367-ecbda568f929 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:25.761119 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4134f112-8803-4ecb-9f21-b5beb0bd8599 req-ea027370-4444-4532-ab70-44cc63551258 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095347 Aug 23 17:55:25.762348 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 576/1215] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:25.762497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca3f2d00-7b38-4eb1-9367-ecbda568f929 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:25.763816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca3f2d00-7b38-4eb1-9367-ecbda568f929 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:25.764632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca3f2d00-7b38-4eb1-9367-ecbda568f929 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:25.818053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-89f549aa-bfbc-4db5-a75e-46da9a77b4de tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:25.820161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-89f549aa-bfbc-4db5-a75e-46da9a77b4de tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:25.832830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89f549aa-bfbc-4db5-a75e-46da9a77b4de tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:25.835659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89f549aa-bfbc-4db5-a75e-46da9a77b4de tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:25.837768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89f549aa-bfbc-4db5-a75e-46da9a77b4de tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:25.840201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89f549aa-bfbc-4db5-a75e-46da9a77b4de tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:25.841858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89f549aa-bfbc-4db5-a75e-46da9a77b4de tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:25.844335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89f549aa-bfbc-4db5-a75e-46da9a77b4de tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:26.049383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ca3f2d00-7b38-4eb1-9367-ecbda568f929 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:26.064009 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ca3f2d00-7b38-4eb1-9367-ecbda568f929 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1213 microversion: 2.1 time: 0.337435 Aug 23 17:55:26.084107 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 640/1216] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:25 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1213 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:26.689369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d19d6a2-a02f-4dff-81f5-f4a262db6016 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:26.690872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d19d6a2-a02f-4dff-81f5-f4a262db6016 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:26.708568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d19d6a2-a02f-4dff-81f5-f4a262db6016 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:26.709481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d19d6a2-a02f-4dff-81f5-f4a262db6016 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:26.709934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d19d6a2-a02f-4dff-81f5-f4a262db6016 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:26.710721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d19d6a2-a02f-4dff-81f5-f4a262db6016 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:26.711424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d19d6a2-a02f-4dff-81f5-f4a262db6016 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:26.712116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d19d6a2-a02f-4dff-81f5-f4a262db6016 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:26.817995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-89f549aa-bfbc-4db5-a75e-46da9a77b4de tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:26.833032 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-89f549aa-bfbc-4db5-a75e-46da9a77b4de tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1325 microversion: 2.1 time: 1.019036 Aug 23 17:55:26.833587 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 577/1217] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:25 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1325 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:26.852432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d541fd59-f8f0-4f17-9d00-3b20028569c3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:26.853357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d541fd59-f8f0-4f17-9d00-3b20028569c3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:26.863087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d541fd59-f8f0-4f17-9d00-3b20028569c3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:26.868914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d541fd59-f8f0-4f17-9d00-3b20028569c3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:26.870921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d541fd59-f8f0-4f17-9d00-3b20028569c3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:26.873504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d541fd59-f8f0-4f17-9d00-3b20028569c3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:26.874570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d541fd59-f8f0-4f17-9d00-3b20028569c3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:26.876743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d541fd59-f8f0-4f17-9d00-3b20028569c3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:27.384512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d541fd59-f8f0-4f17-9d00-3b20028569c3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:27.408011 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d541fd59-f8f0-4f17-9d00-3b20028569c3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1476 microversion: 2.1 time: 0.570787 Aug 23 17:55:27.409199 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 578/1218] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:26 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1476 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:27.414107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-814bfcdd-2dc9-4478-9f80-ee7524635ac6 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:27.415013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-814bfcdd-2dc9-4478-9f80-ee7524635ac6 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:27.428478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-814bfcdd-2dc9-4478-9f80-ee7524635ac6 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:27.429250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-814bfcdd-2dc9-4478-9f80-ee7524635ac6 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:27.429950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-814bfcdd-2dc9-4478-9f80-ee7524635ac6 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:27.430929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-814bfcdd-2dc9-4478-9f80-ee7524635ac6 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:27.431691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-814bfcdd-2dc9-4478-9f80-ee7524635ac6 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:27.432353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-814bfcdd-2dc9-4478-9f80-ee7524635ac6 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:27.626637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-814bfcdd-2dc9-4478-9f80-ee7524635ac6 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:27.648469 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-814bfcdd-2dc9-4478-9f80-ee7524635ac6 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1287 microversion: 2.1 time: 0.237919 Aug 23 17:55:27.664860 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 579/1219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:27 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1287 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:27.687684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7d19d6a2-a02f-4dff-81f5-f4a262db6016 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:27.703373 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d19d6a2-a02f-4dff-81f5-f4a262db6016 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1272 microversion: 2.1 time: 1.019751 Aug 23 17:55:27.706470 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 641/1220] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:26 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1272 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:27.711927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-b6239f1e-34f1-4bf5-ba3f-81dcad83d382 req-c54e1c83-6921-46a7-8157-3d522ef234cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a9618a4e-13d0-4135-9700-f51ea58c7b2a", "name": "network-vif-deleted", "tag": "a605fa68-187d-4064-83ac-b17332a2d0a2"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:27.730714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b6239f1e-34f1-4bf5-ba3f-81dcad83d382 req-c54e1c83-6921-46a7-8157-3d522ef234cc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:27.732558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b6239f1e-34f1-4bf5-ba3f-81dcad83d382 req-c54e1c83-6921-46a7-8157-3d522ef234cc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:27.733076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b6239f1e-34f1-4bf5-ba3f-81dcad83d382 req-c54e1c83-6921-46a7-8157-3d522ef234cc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:27.749562 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b6239f1e-34f1-4bf5-ba3f-81dcad83d382 req-c54e1c83-6921-46a7-8157-3d522ef234cc service nova] Creating event network-vif-deleted:a605fa68-187d-4064-83ac-b17332a2d0a2 for instance a9618a4e-13d0-4135-9700-f51ea58c7b2a on n-h1-850468-16 Aug 23 17:55:27.755242 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-b6239f1e-34f1-4bf5-ba3f-81dcad83d382 req-c54e1c83-6921-46a7-8157-3d522ef234cc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047310 Aug 23 17:55:27.756517 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 580/1221] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:55:27.790990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-257664a3-910e-4fef-8a97-ef0899376133 req-d446fed6-98f8-4816-b133-cc9cec0439b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed0f5323-e9ef-48c9-91fa-3b500fc05057", "name": "network-vif-deleted", "tag": "75e1d424-c713-4dc8-9bfb-fb5f98f20ce3"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:27.821249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-257664a3-910e-4fef-8a97-ef0899376133 req-d446fed6-98f8-4816-b133-cc9cec0439b3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:27.821653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-257664a3-910e-4fef-8a97-ef0899376133 req-d446fed6-98f8-4816-b133-cc9cec0439b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:27.822097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-257664a3-910e-4fef-8a97-ef0899376133 req-d446fed6-98f8-4816-b133-cc9cec0439b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:27.835752 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-257664a3-910e-4fef-8a97-ef0899376133 req-d446fed6-98f8-4816-b133-cc9cec0439b3 service nova] Creating event network-vif-deleted:75e1d424-c713-4dc8-9bfb-fb5f98f20ce3 for instance ed0f5323-e9ef-48c9-91fa-3b500fc05057 on n-h2-850468-16 Aug 23 17:55:27.844293 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-257664a3-910e-4fef-8a97-ef0899376133 req-d446fed6-98f8-4816-b133-cc9cec0439b3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056825 Aug 23 17:55:27.848337 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 642/1222] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:55:27.858524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-935720ce-8620-4618-a3c2-9f93fe2ec18a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:27.859573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-935720ce-8620-4618-a3c2-9f93fe2ec18a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:27.866705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-935720ce-8620-4618-a3c2-9f93fe2ec18a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:27.867242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-935720ce-8620-4618-a3c2-9f93fe2ec18a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:27.868110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-935720ce-8620-4618-a3c2-9f93fe2ec18a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:27.869634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-935720ce-8620-4618-a3c2-9f93fe2ec18a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:27.870315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-935720ce-8620-4618-a3c2-9f93fe2ec18a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:27.871017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-935720ce-8620-4618-a3c2-9f93fe2ec18a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:28.437483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f33c6bd1-a5e2-4769-9618-6dc58d08b591 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:28.438744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f33c6bd1-a5e2-4769-9618-6dc58d08b591 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:28.457634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f33c6bd1-a5e2-4769-9618-6dc58d08b591 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:28.458408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f33c6bd1-a5e2-4769-9618-6dc58d08b591 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:28.462125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-935720ce-8620-4618-a3c2-9f93fe2ec18a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:28.462780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f33c6bd1-a5e2-4769-9618-6dc58d08b591 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:28.464181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f33c6bd1-a5e2-4769-9618-6dc58d08b591 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:28.464657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f33c6bd1-a5e2-4769-9618-6dc58d08b591 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:28.465085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f33c6bd1-a5e2-4769-9618-6dc58d08b591 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:28.470452 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-935720ce-8620-4618-a3c2-9f93fe2ec18a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1522 microversion: 2.1 time: 0.616517 Aug 23 17:55:28.474149 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 581/1223] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:27 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1522 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:28.495047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5d4f59cc-7fee-40a0-be01-eadd076c49f0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:28.495671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5d4f59cc-7fee-40a0-be01-eadd076c49f0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:28.519994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d4f59cc-7fee-40a0-be01-eadd076c49f0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:28.522177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d4f59cc-7fee-40a0-be01-eadd076c49f0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:28.522816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d4f59cc-7fee-40a0-be01-eadd076c49f0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:28.524628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d4f59cc-7fee-40a0-be01-eadd076c49f0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:28.525293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d4f59cc-7fee-40a0-be01-eadd076c49f0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:28.525880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d4f59cc-7fee-40a0-be01-eadd076c49f0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:28.765891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f33c6bd1-a5e2-4769-9618-6dc58d08b591 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:28.776425 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f33c6bd1-a5e2-4769-9618-6dc58d08b591 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1476 microversion: 2.1 time: 0.348223 Aug 23 17:55:28.777109 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 643/1224] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:28 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1476 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:28.783269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b73c97b-f7f4-44ef-81d4-3f3c6fb0b532 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:28.784524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7b73c97b-f7f4-44ef-81d4-3f3c6fb0b532 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:28.790490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b73c97b-f7f4-44ef-81d4-3f3c6fb0b532 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:28.791222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b73c97b-f7f4-44ef-81d4-3f3c6fb0b532 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:28.791707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b73c97b-f7f4-44ef-81d4-3f3c6fb0b532 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:28.792566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b73c97b-f7f4-44ef-81d4-3f3c6fb0b532 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:28.793529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b73c97b-f7f4-44ef-81d4-3f3c6fb0b532 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:28.794738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b73c97b-f7f4-44ef-81d4-3f3c6fb0b532 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:28.895970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7b73c97b-f7f4-44ef-81d4-3f3c6fb0b532 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:28.899134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:28.907761 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7b73c97b-f7f4-44ef-81d4-3f3c6fb0b532 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1275 microversion: 2.1 time: 0.129326 Aug 23 17:55:28.909950 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 644/1225] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:28 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1275 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:28.917502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf5e1d1a-b1e2-4218-9660-25972d59ce1c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:28.918614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf5e1d1a-b1e2-4218-9660-25972d59ce1c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:28.927871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf5e1d1a-b1e2-4218-9660-25972d59ce1c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:28.929636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf5e1d1a-b1e2-4218-9660-25972d59ce1c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:28.930870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf5e1d1a-b1e2-4218-9660-25972d59ce1c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:28.932230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf5e1d1a-b1e2-4218-9660-25972d59ce1c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:28.932915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf5e1d1a-b1e2-4218-9660-25972d59ce1c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:28.933708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf5e1d1a-b1e2-4218-9660-25972d59ce1c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:28.952026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5d4f59cc-7fee-40a0-be01-eadd076c49f0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:28.966321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5d4f59cc-7fee-40a0-be01-eadd076c49f0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1522 microversion: 2.1 time: 0.475051 Aug 23 17:55:28.979054 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 582/1226] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:28 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:29.004442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a37bbb82-a002-4d88-b0ed-82e62ed296d9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1388820950", "metadata": {"": ""}}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a37bbb82-a002-4d88-b0ed-82e62ed296d9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action HTTP/1.1 Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 107 Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1388820950", "metadata": {"": ""}}} Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '61806701-e6ae-4bc0-abca-408ea9c3d186', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1388820950', 'metadata': {'': ''}}}} Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'': ''} Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:55:29.019394 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a37bbb82-a002-4d88-b0ed-82e62ed296d9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a37bbb82-a002-4d88-b0ed-82e62ed296d9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action" status: 400 len: 170 microversion: 2.1 time: 0.023891 Aug 23 17:55:29.025870 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 583/1227] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Aug 23 17:55:28 2022] POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action => generated 170 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:55:29.032560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c53a5863-4235-4ca8-8633-1839219416e9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:29.033332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c53a5863-4235-4ca8-8633-1839219416e9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:29.046082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c53a5863-4235-4ca8-8633-1839219416e9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:29.046963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c53a5863-4235-4ca8-8633-1839219416e9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:29.047622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c53a5863-4235-4ca8-8633-1839219416e9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:29.048585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c53a5863-4235-4ca8-8633-1839219416e9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:29.049260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c53a5863-4235-4ca8-8633-1839219416e9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:29.050179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c53a5863-4235-4ca8-8633-1839219416e9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:29.275558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf5e1d1a-b1e2-4218-9660-25972d59ce1c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:29.287805 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf5e1d1a-b1e2-4218-9660-25972d59ce1c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.376523 Aug 23 17:55:29.288757 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 645/1228] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:28 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:29.626034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c53a5863-4235-4ca8-8633-1839219416e9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:29.634612 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c53a5863-4235-4ca8-8633-1839219416e9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1522 microversion: 2.1 time: 0.605988 Aug 23 17:55:29.635180 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 584/1229] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:29 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1522 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:29.656247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c33f232-0a19-4d1d-aa05-7498e527a02f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:29.656867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5c33f232-0a19-4d1d-aa05-7498e527a02f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:29.662886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c33f232-0a19-4d1d-aa05-7498e527a02f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:29.663317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c33f232-0a19-4d1d-aa05-7498e527a02f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:29.663751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c33f232-0a19-4d1d-aa05-7498e527a02f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:29.664451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c33f232-0a19-4d1d-aa05-7498e527a02f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:29.664911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c33f232-0a19-4d1d-aa05-7498e527a02f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:29.665340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c33f232-0a19-4d1d-aa05-7498e527a02f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:29.800614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b468f55a-1b7f-40e3-a83c-91be6b132141 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:29.801725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b468f55a-1b7f-40e3-a83c-91be6b132141 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:29.808519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b468f55a-1b7f-40e3-a83c-91be6b132141 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:29.809090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b468f55a-1b7f-40e3-a83c-91be6b132141 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:29.809933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b468f55a-1b7f-40e3-a83c-91be6b132141 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:29.810913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b468f55a-1b7f-40e3-a83c-91be6b132141 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:29.811725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b468f55a-1b7f-40e3-a83c-91be6b132141 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:29.812160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b468f55a-1b7f-40e3-a83c-91be6b132141 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:29.909901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5c33f232-0a19-4d1d-aa05-7498e527a02f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:29.920650 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5c33f232-0a19-4d1d-aa05-7498e527a02f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1522 microversion: 2.1 time: 0.268397 Aug 23 17:55:29.936104 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 646/1230] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:29 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:29.944609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9aa9514c-9816-4603-97c2-b399aff4d899 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:29.945839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9aa9514c-9816-4603-97c2-b399aff4d899 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:29.952959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9aa9514c-9816-4603-97c2-b399aff4d899 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:29.953907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9aa9514c-9816-4603-97c2-b399aff4d899 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:29.954382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9aa9514c-9816-4603-97c2-b399aff4d899 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:29.955354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9aa9514c-9816-4603-97c2-b399aff4d899 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:29.956024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9aa9514c-9816-4603-97c2-b399aff4d899 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:29.956683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9aa9514c-9816-4603-97c2-b399aff4d899 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:30.212887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9aa9514c-9816-4603-97c2-b399aff4d899 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:30.223879 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9aa9514c-9816-4603-97c2-b399aff4d899 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.286376 Aug 23 17:55:30.224264 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 647/1231] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:29 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:30.229635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-081fd2f1-f9af-4afc-9a93-2295c1e03827 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1483267893", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-081fd2f1-f9af-4afc-9a93-2295c1e03827 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action HTTP/1.1 Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 619 Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1483267893", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '61806701-e6ae-4bc0-abca-408ea9c3d186', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1483267893', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:55:30.234477 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 17:55:30.238222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:30.241758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-081fd2f1-f9af-4afc-9a93-2295c1e03827 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:30.243035 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-081fd2f1-f9af-4afc-9a93-2295c1e03827 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action" status: 400 len: 938 microversion: 2.1 time: 0.016937 Aug 23 17:55:30.244394 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 648/1232] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Aug 23 17:55:30 2022] POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action => generated 938 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:55:30.249406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-e043ef81-1385-432c-9370-33c791a46a52 req-2a31b194-d4da-45e2-b16e-cd50c7120d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "856ac0cb-cfb2-43f5-9e4f-df662c38f02d", "name": "network-vif-unplugged", "status": "completed", "tag": "a3f7e262-db57-4792-9f23-2fbc005cd02a"}, {"name": "network-changed", "server_uuid": "856ac0cb-cfb2-43f5-9e4f-df662c38f02d", "tag": "a3f7e262-db57-4792-9f23-2fbc005cd02a"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:30.262088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e043ef81-1385-432c-9370-33c791a46a52 req-2a31b194-d4da-45e2-b16e-cd50c7120d66 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:30.263615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e043ef81-1385-432c-9370-33c791a46a52 req-2a31b194-d4da-45e2-b16e-cd50c7120d66 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:30.264270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e043ef81-1385-432c-9370-33c791a46a52 req-2a31b194-d4da-45e2-b16e-cd50c7120d66 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:30.278965 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-e043ef81-1385-432c-9370-33c791a46a52 req-2a31b194-d4da-45e2-b16e-cd50c7120d66 service nova] Creating event network-vif-unplugged:a3f7e262-db57-4792-9f23-2fbc005cd02a for instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d on n-h2-850468-16 Aug 23 17:55:30.279893 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-e043ef81-1385-432c-9370-33c791a46a52 req-2a31b194-d4da-45e2-b16e-cd50c7120d66 service nova] Creating event network-changed:a3f7e262-db57-4792-9f23-2fbc005cd02a for instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d on n-h2-850468-16 Aug 23 17:55:30.280283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b468f55a-1b7f-40e3-a83c-91be6b132141 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:30.288487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-e043ef81-1385-432c-9370-33c791a46a52 req-2a31b194-d4da-45e2-b16e-cd50c7120d66 service nova] Instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 17:55:30.290617 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b468f55a-1b7f-40e3-a83c-91be6b132141 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1476 microversion: 2.1 time: 0.496382 Aug 23 17:55:30.291626 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 585/1233] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:29 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1476 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:30.298975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-afa839cd-b023-4e1f-9273-fb2abcb97d0c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:30.301021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-afa839cd-b023-4e1f-9273-fb2abcb97d0c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:30.312860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-afa839cd-b023-4e1f-9273-fb2abcb97d0c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:30.314188 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-e043ef81-1385-432c-9370-33c791a46a52 req-2a31b194-d4da-45e2-b16e-cd50c7120d66 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.068196 Aug 23 17:55:30.314709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-afa839cd-b023-4e1f-9273-fb2abcb97d0c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:30.315241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-afa839cd-b023-4e1f-9273-fb2abcb97d0c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:30.315658 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 649/1234] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:30.316446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-afa839cd-b023-4e1f-9273-fb2abcb97d0c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:30.317704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-afa839cd-b023-4e1f-9273-fb2abcb97d0c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:30.318358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-afa839cd-b023-4e1f-9273-fb2abcb97d0c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:30.320957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-42488bcd-582f-45a9-99b6-7d3f55bb52ad tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:30.321663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-42488bcd-582f-45a9-99b6-7d3f55bb52ad tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:30.329096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42488bcd-582f-45a9-99b6-7d3f55bb52ad tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:30.329999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42488bcd-582f-45a9-99b6-7d3f55bb52ad tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:30.330647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42488bcd-582f-45a9-99b6-7d3f55bb52ad tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:30.331597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42488bcd-582f-45a9-99b6-7d3f55bb52ad tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:30.332274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42488bcd-582f-45a9-99b6-7d3f55bb52ad tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:30.333178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42488bcd-582f-45a9-99b6-7d3f55bb52ad tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:30.631769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-42488bcd-582f-45a9-99b6-7d3f55bb52ad tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:30.643959 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-42488bcd-582f-45a9-99b6-7d3f55bb52ad tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.327056 Aug 23 17:55:30.644537 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 650/1235] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:30 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:30.649499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-efb37193-be0f-453a-86f0-86f8ecc72102 req-d4c17e56-40a2-4680-98c8-0de1288c3b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d726c6-9bae-4276-b8e2-5eafe4270dce", "tag": "1785d3da-8025-402c-a9ab-f4a42d7ab796"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:30.659236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-efb37193-be0f-453a-86f0-86f8ecc72102 req-d4c17e56-40a2-4680-98c8-0de1288c3b5b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:30.659713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-efb37193-be0f-453a-86f0-86f8ecc72102 req-d4c17e56-40a2-4680-98c8-0de1288c3b5b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:30.660143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-efb37193-be0f-453a-86f0-86f8ecc72102 req-d4c17e56-40a2-4680-98c8-0de1288c3b5b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:30.671761 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-efb37193-be0f-453a-86f0-86f8ecc72102 req-d4c17e56-40a2-4680-98c8-0de1288c3b5b service nova] Creating event network-changed:1785d3da-8025-402c-a9ab-f4a42d7ab796 for instance a3d726c6-9bae-4276-b8e2-5eafe4270dce on n-h1-850468-16 Aug 23 17:55:30.676829 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-efb37193-be0f-453a-86f0-86f8ecc72102 req-d4c17e56-40a2-4680-98c8-0de1288c3b5b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030747 Aug 23 17:55:30.677620 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 651/1236] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:31.139150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-afa839cd-b023-4e1f-9273-fb2abcb97d0c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:31.147315 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-afa839cd-b023-4e1f-9273-fb2abcb97d0c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1522 microversion: 2.1 time: 0.854658 Aug 23 17:55:31.147900 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 586/1237] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:30 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1522 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:31.172329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d8140c9a-de81-4a99-99ca-62cd9e740877 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:31.173029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d8140c9a-de81-4a99-99ca-62cd9e740877 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:31.179612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8140c9a-de81-4a99-99ca-62cd9e740877 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.180199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8140c9a-de81-4a99-99ca-62cd9e740877 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.180716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8140c9a-de81-4a99-99ca-62cd9e740877 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.181509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8140c9a-de81-4a99-99ca-62cd9e740877 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.182027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8140c9a-de81-4a99-99ca-62cd9e740877 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.182655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8140c9a-de81-4a99-99ca-62cd9e740877 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.246730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bb0041a5-7b5f-4b82-98ea-23cc72a710c9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:31.248244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bb0041a5-7b5f-4b82-98ea-23cc72a710c9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:31.254627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb0041a5-7b5f-4b82-98ea-23cc72a710c9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.255468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb0041a5-7b5f-4b82-98ea-23cc72a710c9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.256265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb0041a5-7b5f-4b82-98ea-23cc72a710c9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.257183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb0041a5-7b5f-4b82-98ea-23cc72a710c9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.257787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb0041a5-7b5f-4b82-98ea-23cc72a710c9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.258451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb0041a5-7b5f-4b82-98ea-23cc72a710c9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.346309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d8140c9a-de81-4a99-99ca-62cd9e740877 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:31.381633 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d8140c9a-de81-4a99-99ca-62cd9e740877 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1522 microversion: 2.1 time: 0.215028 Aug 23 17:55:31.382331 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 652/1238] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:31 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:31.387265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e9ad81d8-02b4-472b-a1de-f4b48909a99f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:31.390865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e9ad81d8-02b4-472b-a1de-f4b48909a99f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:31.399170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9ad81d8-02b4-472b-a1de-f4b48909a99f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.399668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9ad81d8-02b4-472b-a1de-f4b48909a99f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.400105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9ad81d8-02b4-472b-a1de-f4b48909a99f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.400819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9ad81d8-02b4-472b-a1de-f4b48909a99f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.401273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9ad81d8-02b4-472b-a1de-f4b48909a99f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.401702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9ad81d8-02b4-472b-a1de-f4b48909a99f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.554041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e9ad81d8-02b4-472b-a1de-f4b48909a99f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:31.564322 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e9ad81d8-02b4-472b-a1de-f4b48909a99f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1476 microversion: 2.1 time: 0.180705 Aug 23 17:55:31.564910 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 653/1239] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:31 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1476 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:31.571951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-67f4564e-8570-47db-b56d-0b4405ea9de7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-67f4564e-8570-47db-b56d-0b4405ea9de7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action HTTP/1.1 Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 285 Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '61806701-e6ae-4bc0-abca-408ea9c3d186', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['createImage']: Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:31.578072 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 17:55:31.582240 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:31.584951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-67f4564e-8570-47db-b56d-0b4405ea9de7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:31.585789 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-67f4564e-8570-47db-b56d-0b4405ea9de7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action" status: 400 len: 619 microversion: 2.1 time: 0.019938 Aug 23 17:55:31.586380 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 654/1240] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Aug 23 17:55:31 2022] POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action => generated 619 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:55:31.594919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b1829258-436c-4fe6-8141-8b994d906999 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:31.595689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b1829258-436c-4fe6-8141-8b994d906999 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:31.602364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1829258-436c-4fe6-8141-8b994d906999 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.603024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1829258-436c-4fe6-8141-8b994d906999 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.603540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1829258-436c-4fe6-8141-8b994d906999 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.604322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1829258-436c-4fe6-8141-8b994d906999 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.604855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1829258-436c-4fe6-8141-8b994d906999 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.605380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1829258-436c-4fe6-8141-8b994d906999 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.703087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bb0041a5-7b5f-4b82-98ea-23cc72a710c9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:31.711321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bb0041a5-7b5f-4b82-98ea-23cc72a710c9 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.468544 Aug 23 17:55:31.712574 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 587/1241] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:31 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:31.723871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a034cd68-7639-4fd6-a991-dfc1a431b947 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:31.725109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a034cd68-7639-4fd6-a991-dfc1a431b947 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:31.732334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a034cd68-7639-4fd6-a991-dfc1a431b947 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.732998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a034cd68-7639-4fd6-a991-dfc1a431b947 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.733439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a034cd68-7639-4fd6-a991-dfc1a431b947 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.734352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a034cd68-7639-4fd6-a991-dfc1a431b947 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.734999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a034cd68-7639-4fd6-a991-dfc1a431b947 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.735436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a034cd68-7639-4fd6-a991-dfc1a431b947 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.751135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b1829258-436c-4fe6-8141-8b994d906999 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:31.759776 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b1829258-436c-4fe6-8141-8b994d906999 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1522 microversion: 2.1 time: 0.168628 Aug 23 17:55:31.760715 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 655/1242] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:31 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:31.782087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-69f71a6a-caa6-41b0-9859-16e1327d274e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:31.782739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-69f71a6a-caa6-41b0-9859-16e1327d274e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:31.788831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69f71a6a-caa6-41b0-9859-16e1327d274e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.789173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69f71a6a-caa6-41b0-9859-16e1327d274e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.789609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69f71a6a-caa6-41b0-9859-16e1327d274e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.790307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69f71a6a-caa6-41b0-9859-16e1327d274e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.790786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69f71a6a-caa6-41b0-9859-16e1327d274e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.791212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69f71a6a-caa6-41b0-9859-16e1327d274e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.930098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-69f71a6a-caa6-41b0-9859-16e1327d274e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:31.939141 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-69f71a6a-caa6-41b0-9859-16e1327d274e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1522 microversion: 2.1 time: 0.161574 Aug 23 17:55:31.939715 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 656/1243] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:31 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:31.960388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c0bfdac-9a22-4d6e-bf8c-a35532cdb8ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1262671507"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:31.962662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0c0bfdac-9a22-4d6e-bf8c-a35532cdb8ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:31.969917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c0bfdac-9a22-4d6e-bf8c-a35532cdb8ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.970398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c0bfdac-9a22-4d6e-bf8c-a35532cdb8ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.970863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c0bfdac-9a22-4d6e-bf8c-a35532cdb8ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:31.971558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c0bfdac-9a22-4d6e-bf8c-a35532cdb8ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:31.972008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c0bfdac-9a22-4d6e-bf8c-a35532cdb8ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:31.972426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c0bfdac-9a22-4d6e-bf8c-a35532cdb8ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:32.027566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a034cd68-7639-4fd6-a991-dfc1a431b947 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:32.037064 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a034cd68-7639-4fd6-a991-dfc1a431b947 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.321736 Aug 23 17:55:32.037955 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 588/1244] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:31 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:32.170931 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c0bfdac-9a22-4d6e-bf8c-a35532cdb8ed tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action" status: 202 len: 0 microversion: 2.1 time: 0.214419 Aug 23 17:55:32.171577 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 657/1245] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:55:31 2022] POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action => generated 0 bytes in 216 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Aug 23 17:55:32.182000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-92f2108d-08ef-4b0b-9e16-4fba61064fcd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-471889350"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:32.184924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-92f2108d-08ef-4b0b-9e16-4fba61064fcd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:32.191057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92f2108d-08ef-4b0b-9e16-4fba61064fcd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:32.191536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92f2108d-08ef-4b0b-9e16-4fba61064fcd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:32.191971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92f2108d-08ef-4b0b-9e16-4fba61064fcd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:32.192662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92f2108d-08ef-4b0b-9e16-4fba61064fcd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:32.193108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92f2108d-08ef-4b0b-9e16-4fba61064fcd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:32.193527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92f2108d-08ef-4b0b-9e16-4fba61064fcd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:32.225784 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-92f2108d-08ef-4b0b-9e16-4fba61064fcd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] HTTP exception thrown: Cannot 'createImage' instance 61806701-e6ae-4bc0-abca-408ea9c3d186 while it is in task_state image_snapshot_pending Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-92f2108d-08ef-4b0b-9e16-4fba61064fcd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action HTTP/1.1 Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 84 Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-471889350"}} Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: exception: Cannot 'createImage' instance 61806701-e6ae-4bc0-abca-408ea9c3d186 while it is in task_state image_snapshot_pending Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '61806701-e6ae-4bc0-abca-408ea9c3d186', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-471889350'}}} Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1346, in _action_create_image Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 152, in inner Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1351, in _action_create_image Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 17:55:32.227370 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 61806701-e6ae-4bc0-abca-408ea9c3d186 while it is in task_state image_snapshot_pending Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 61806701-e6ae-4bc0-abca-408ea9c3d186 while it is in task_state image_snapshot_pending Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-92f2108d-08ef-4b0b-9e16-4fba61064fcd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 409 to user: Cannot 'createImage' instance 61806701-e6ae-4bc0-abca-408ea9c3d186 while it is in task_state image_snapshot_pending {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-92f2108d-08ef-4b0b-9e16-4fba61064fcd tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action" status: 409 len: 167 microversion: 2.1 time: 0.050681 Aug 23 17:55:32.233131 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 589/1246] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:55:32 2022] POST /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186/action => generated 167 bytes in 52 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:55:32.239870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-071895c8-af06-4cda-8b20-fb5343b0f61f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '.version_select at 0x7f27eca3ad30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:32.352463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-606ddc8c-6d8c-416d-938d-f89e788a8b97 req-9ee526c2-4282-472a-97dc-74f6db3d433d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "200e6dde-d9fa-47e0-af4d-2e5be2dba21c", "tag": "c59e7672-d57f-4008-9989-09790fe3f71c"}, {"name": "network-changed", "server_uuid": "102daea4-8648-4efc-8b9a-cd590f4b7084", "tag": "ca07d8bc-63b0-4443-bd7b-855d80bfede8"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:32.352627 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-071895c8-af06-4cda-8b20-fb5343b0f61f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "DELETE /compute/v2.1/images/bf5b7606-d00f-4358-afa2-23589f58f04c" status: 204 len: 0 microversion: 2.1 time: 0.117671 Aug 23 17:55:32.353094 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 658/1247] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:32 2022] DELETE /compute/v2.1/images/bf5b7606-d00f-4358-afa2-23589f58f04c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:55:32.362167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-70a8ae30-9d32-41a5-8350-0d77b9de85e0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:32.362920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-70a8ae30-9d32-41a5-8350-0d77b9de85e0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:32.363570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-606ddc8c-6d8c-416d-938d-f89e788a8b97 req-9ee526c2-4282-472a-97dc-74f6db3d433d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:32.364049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-606ddc8c-6d8c-416d-938d-f89e788a8b97 req-9ee526c2-4282-472a-97dc-74f6db3d433d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:32.364485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-606ddc8c-6d8c-416d-938d-f89e788a8b97 req-9ee526c2-4282-472a-97dc-74f6db3d433d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:32.369896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70a8ae30-9d32-41a5-8350-0d77b9de85e0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:32.370385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70a8ae30-9d32-41a5-8350-0d77b9de85e0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:32.370860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70a8ae30-9d32-41a5-8350-0d77b9de85e0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:32.371563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70a8ae30-9d32-41a5-8350-0d77b9de85e0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:32.372769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70a8ae30-9d32-41a5-8350-0d77b9de85e0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:32.373277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70a8ae30-9d32-41a5-8350-0d77b9de85e0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:32.377383 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-606ddc8c-6d8c-416d-938d-f89e788a8b97 req-9ee526c2-4282-472a-97dc-74f6db3d433d service nova] Creating event network-changed:c59e7672-d57f-4008-9989-09790fe3f71c for instance 200e6dde-d9fa-47e0-af4d-2e5be2dba21c on n-h2-850468-16 Aug 23 17:55:32.377892 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-606ddc8c-6d8c-416d-938d-f89e788a8b97 req-9ee526c2-4282-472a-97dc-74f6db3d433d service nova] Creating event network-changed:ca07d8bc-63b0-4443-bd7b-855d80bfede8 for instance 102daea4-8648-4efc-8b9a-cd590f4b7084 on n-h2-850468-16 Aug 23 17:55:32.384066 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-606ddc8c-6d8c-416d-938d-f89e788a8b97 req-9ee526c2-4282-472a-97dc-74f6db3d433d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035419 Aug 23 17:55:32.384595 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 590/1248] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:55:32.505062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-70a8ae30-9d32-41a5-8350-0d77b9de85e0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:32.512879 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-70a8ae30-9d32-41a5-8350-0d77b9de85e0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1542 microversion: 2.1 time: 0.154667 Aug 23 17:55:32.513446 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 659/1249] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:32 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1542 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:32.585245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f830e361-4794-4868-832c-c047cefc99af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:32.585940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f830e361-4794-4868-832c-c047cefc99af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:32.592908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f830e361-4794-4868-832c-c047cefc99af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:32.593385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f830e361-4794-4868-832c-c047cefc99af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:32.593816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f830e361-4794-4868-832c-c047cefc99af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:32.594503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f830e361-4794-4868-832c-c047cefc99af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:32.594975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f830e361-4794-4868-832c-c047cefc99af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:32.595391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f830e361-4794-4868-832c-c047cefc99af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:32.732145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f830e361-4794-4868-832c-c047cefc99af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:32.734221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9d6ea286-d476-4882-9008-a5de177fec2f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:32.734869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9d6ea286-d476-4882-9008-a5de177fec2f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:32.739898 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f830e361-4794-4868-832c-c047cefc99af tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1474 microversion: 2.1 time: 0.159294 Aug 23 17:55:32.740502 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 591/1250] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:32 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1474 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:32.740788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d6ea286-d476-4882-9008-a5de177fec2f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:32.741272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d6ea286-d476-4882-9008-a5de177fec2f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:32.741704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d6ea286-d476-4882-9008-a5de177fec2f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:32.742394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d6ea286-d476-4882-9008-a5de177fec2f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:32.742952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d6ea286-d476-4882-9008-a5de177fec2f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:32.743373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d6ea286-d476-4882-9008-a5de177fec2f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:32.873085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9d6ea286-d476-4882-9008-a5de177fec2f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:32.880730 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9d6ea286-d476-4882-9008-a5de177fec2f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.150887 Aug 23 17:55:32.881295 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 660/1251] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:32 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:33.059147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1704f4f0-f6b6-4338-a438-ad26e1ec2243 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:33.060414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1704f4f0-f6b6-4338-a438-ad26e1ec2243 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:33.066478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1704f4f0-f6b6-4338-a438-ad26e1ec2243 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:33.066995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1704f4f0-f6b6-4338-a438-ad26e1ec2243 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:33.067429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1704f4f0-f6b6-4338-a438-ad26e1ec2243 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:33.068121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1704f4f0-f6b6-4338-a438-ad26e1ec2243 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:33.068576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1704f4f0-f6b6-4338-a438-ad26e1ec2243 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:33.069006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1704f4f0-f6b6-4338-a438-ad26e1ec2243 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:33.197616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1704f4f0-f6b6-4338-a438-ad26e1ec2243 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:33.206000 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1704f4f0-f6b6-4338-a438-ad26e1ec2243 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.150875 Aug 23 17:55:33.206583 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 592/1252] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:33 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:33.533795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c0b3b54b-0c44-4cff-a70b-c0f30e773582 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:33.534935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c0b3b54b-0c44-4cff-a70b-c0f30e773582 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:33.542108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0b3b54b-0c44-4cff-a70b-c0f30e773582 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:33.542731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0b3b54b-0c44-4cff-a70b-c0f30e773582 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:33.543243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0b3b54b-0c44-4cff-a70b-c0f30e773582 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:33.544249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0b3b54b-0c44-4cff-a70b-c0f30e773582 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:33.544861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0b3b54b-0c44-4cff-a70b-c0f30e773582 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:33.545362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0b3b54b-0c44-4cff-a70b-c0f30e773582 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:33.729087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c0b3b54b-0c44-4cff-a70b-c0f30e773582 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:33.737300 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c0b3b54b-0c44-4cff-a70b-c0f30e773582 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1534 microversion: 2.1 time: 0.207546 Aug 23 17:55:33.737864 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 661/1253] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:33 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1534 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:33.760668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7835449-d12d-4dc1-b891-acb26224ca0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:33.761907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d7835449-d12d-4dc1-b891-acb26224ca0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:33.768607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7835449-d12d-4dc1-b891-acb26224ca0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:33.769104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7835449-d12d-4dc1-b891-acb26224ca0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:33.769539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7835449-d12d-4dc1-b891-acb26224ca0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:33.770424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7835449-d12d-4dc1-b891-acb26224ca0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:33.771432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7835449-d12d-4dc1-b891-acb26224ca0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:33.772038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7835449-d12d-4dc1-b891-acb26224ca0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:33.902150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ddbc464-27c8-45fd-a23e-f7d78b81b812 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:33.902804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8ddbc464-27c8-45fd-a23e-f7d78b81b812 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:33.909261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ddbc464-27c8-45fd-a23e-f7d78b81b812 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:33.909742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ddbc464-27c8-45fd-a23e-f7d78b81b812 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:33.910356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ddbc464-27c8-45fd-a23e-f7d78b81b812 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:33.911087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ddbc464-27c8-45fd-a23e-f7d78b81b812 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:33.911543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ddbc464-27c8-45fd-a23e-f7d78b81b812 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:33.912101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ddbc464-27c8-45fd-a23e-f7d78b81b812 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:33.967165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7835449-d12d-4dc1-b891-acb26224ca0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:33.975104 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7835449-d12d-4dc1-b891-acb26224ca0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1474 microversion: 2.1 time: 0.218230 Aug 23 17:55:33.980222 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 593/1254] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:33 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1474 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:34.117011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8ddbc464-27c8-45fd-a23e-f7d78b81b812 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:34.125060 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8ddbc464-27c8-45fd-a23e-f7d78b81b812 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.227729 Aug 23 17:55:34.125640 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 662/1255] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:33 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:34.227537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d63d20e5-8b63-444d-9262-a478dc9e770d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:34.228173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d63d20e5-8b63-444d-9262-a478dc9e770d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:34.230136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=12 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:34.236924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d63d20e5-8b63-444d-9262-a478dc9e770d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:34.237369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d63d20e5-8b63-444d-9262-a478dc9e770d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:34.237801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d63d20e5-8b63-444d-9262-a478dc9e770d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:34.238492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d63d20e5-8b63-444d-9262-a478dc9e770d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:34.238962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d63d20e5-8b63-444d-9262-a478dc9e770d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:34.239382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d63d20e5-8b63-444d-9262-a478dc9e770d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:34.291762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:34.367941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d63d20e5-8b63-444d-9262-a478dc9e770d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:34.375931 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d63d20e5-8b63-444d-9262-a478dc9e770d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.152254 Aug 23 17:55:34.376760 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 594/1256] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:34 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:34.759635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8a00e813-e5a0-4085-aff2-662bcafc27c8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:34.760150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8a00e813-e5a0-4085-aff2-662bcafc27c8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:34.763695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:34.769551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a00e813-e5a0-4085-aff2-662bcafc27c8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:34.770035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a00e813-e5a0-4085-aff2-662bcafc27c8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:34.770468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a00e813-e5a0-4085-aff2-662bcafc27c8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:34.771206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a00e813-e5a0-4085-aff2-662bcafc27c8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:34.771636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a00e813-e5a0-4085-aff2-662bcafc27c8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:34.772058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a00e813-e5a0-4085-aff2-662bcafc27c8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:34.913030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8a00e813-e5a0-4085-aff2-662bcafc27c8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:34.921069 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8a00e813-e5a0-4085-aff2-662bcafc27c8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1534 microversion: 2.1 time: 0.165336 Aug 23 17:55:34.921631 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 663/1257] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:34 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1534 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:34.996491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-40cbe969-4e33-4beb-aec5-4061592d91ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:34.997720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-40cbe969-4e33-4beb-aec5-4061592d91ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:35.004547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cbe969-4e33-4beb-aec5-4061592d91ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:35.005032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cbe969-4e33-4beb-aec5-4061592d91ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:35.005581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cbe969-4e33-4beb-aec5-4061592d91ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:35.006276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cbe969-4e33-4beb-aec5-4061592d91ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:35.006765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cbe969-4e33-4beb-aec5-4061592d91ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:35.007192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cbe969-4e33-4beb-aec5-4061592d91ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:35.027089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:35.145337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-15bf5d9d-f080-4a7c-9b63-212d379dc30d tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:35.145956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-15bf5d9d-f080-4a7c-9b63-212d379dc30d tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:35.152884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15bf5d9d-f080-4a7c-9b63-212d379dc30d tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:35.154167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15bf5d9d-f080-4a7c-9b63-212d379dc30d tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:35.155017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15bf5d9d-f080-4a7c-9b63-212d379dc30d tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:35.155818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15bf5d9d-f080-4a7c-9b63-212d379dc30d tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:35.156492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15bf5d9d-f080-4a7c-9b63-212d379dc30d tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:35.157003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15bf5d9d-f080-4a7c-9b63-212d379dc30d tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:35.161405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:35.294503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-15bf5d9d-f080-4a7c-9b63-212d379dc30d tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:35.302846 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-15bf5d9d-f080-4a7c-9b63-212d379dc30d tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.160964 Aug 23 17:55:35.310586 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 664/1258] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:35 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:35.396805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1b7c4f31-17c1-4547-b001-4694d186c272 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:35.397420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1b7c4f31-17c1-4547-b001-4694d186c272 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:35.406667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b7c4f31-17c1-4547-b001-4694d186c272 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:35.407195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b7c4f31-17c1-4547-b001-4694d186c272 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:35.407637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b7c4f31-17c1-4547-b001-4694d186c272 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:35.408368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b7c4f31-17c1-4547-b001-4694d186c272 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:35.408829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b7c4f31-17c1-4547-b001-4694d186c272 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:35.409254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b7c4f31-17c1-4547-b001-4694d186c272 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:35.426068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-40cbe969-4e33-4beb-aec5-4061592d91ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:35.434577 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-40cbe969-4e33-4beb-aec5-4061592d91ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1474 microversion: 2.1 time: 0.441891 Aug 23 17:55:35.444899 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 595/1259] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:34 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1474 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:35.546900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1b7c4f31-17c1-4547-b001-4694d186c272 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:35.555271 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1b7c4f31-17c1-4547-b001-4694d186c272 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.162371 Aug 23 17:55:35.556282 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 665/1260] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:35 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:35.942682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3980e777-4506-488d-a217-c0d2e2f437d0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:35.943405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3980e777-4506-488d-a217-c0d2e2f437d0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:35.954316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3980e777-4506-488d-a217-c0d2e2f437d0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:35.956694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3980e777-4506-488d-a217-c0d2e2f437d0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:35.957197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3980e777-4506-488d-a217-c0d2e2f437d0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:35.957965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3980e777-4506-488d-a217-c0d2e2f437d0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:35.961248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3980e777-4506-488d-a217-c0d2e2f437d0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:35.961705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3980e777-4506-488d-a217-c0d2e2f437d0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:36.167368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3980e777-4506-488d-a217-c0d2e2f437d0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:36.175650 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3980e777-4506-488d-a217-c0d2e2f437d0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1534 microversion: 2.1 time: 0.237209 Aug 23 17:55:36.176208 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 596/1261] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:35 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1534 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:36.323837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-120ea111-af46-499c-b0ee-d6f25d03fb55 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:36.324454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-120ea111-af46-499c-b0ee-d6f25d03fb55 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:36.332133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-120ea111-af46-499c-b0ee-d6f25d03fb55 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:36.332618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-120ea111-af46-499c-b0ee-d6f25d03fb55 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:36.333059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-120ea111-af46-499c-b0ee-d6f25d03fb55 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:36.333786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-120ea111-af46-499c-b0ee-d6f25d03fb55 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:36.334248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-120ea111-af46-499c-b0ee-d6f25d03fb55 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:36.334715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-120ea111-af46-499c-b0ee-d6f25d03fb55 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:36.457050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7e6c2da-01dc-471a-9a76-eb4eece2c54a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:36.458009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d7e6c2da-01dc-471a-9a76-eb4eece2c54a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:36.463380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-120ea111-af46-499c-b0ee-d6f25d03fb55 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:36.464434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7e6c2da-01dc-471a-9a76-eb4eece2c54a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:36.464928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7e6c2da-01dc-471a-9a76-eb4eece2c54a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:36.465647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7e6c2da-01dc-471a-9a76-eb4eece2c54a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:36.466571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7e6c2da-01dc-471a-9a76-eb4eece2c54a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:36.467206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7e6c2da-01dc-471a-9a76-eb4eece2c54a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:36.467639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7e6c2da-01dc-471a-9a76-eb4eece2c54a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:36.472145 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-120ea111-af46-499c-b0ee-d6f25d03fb55 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.152114 Aug 23 17:55:36.473262 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 666/1262] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:36 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:36.579341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e98b247d-d690-4d61-b204-57e28e02c388 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:36.580069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e98b247d-d690-4d61-b204-57e28e02c388 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:36.586042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e98b247d-d690-4d61-b204-57e28e02c388 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:36.586571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e98b247d-d690-4d61-b204-57e28e02c388 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:36.586997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e98b247d-d690-4d61-b204-57e28e02c388 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:36.587704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e98b247d-d690-4d61-b204-57e28e02c388 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:36.588705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e98b247d-d690-4d61-b204-57e28e02c388 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:36.588705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e98b247d-d690-4d61-b204-57e28e02c388 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:36.620656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7e6c2da-01dc-471a-9a76-eb4eece2c54a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:36.629942 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7e6c2da-01dc-471a-9a76-eb4eece2c54a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1471 microversion: 2.1 time: 0.176695 Aug 23 17:55:36.631162 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 597/1263] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:36 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:36.652147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e701970f-2452-4cff-b6e1-f44801d8bd8d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:36.652704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e701970f-2452-4cff-b6e1-f44801d8bd8d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:36.659451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e701970f-2452-4cff-b6e1-f44801d8bd8d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:36.659950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e701970f-2452-4cff-b6e1-f44801d8bd8d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:36.660402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e701970f-2452-4cff-b6e1-f44801d8bd8d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:36.661197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e701970f-2452-4cff-b6e1-f44801d8bd8d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:36.661715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e701970f-2452-4cff-b6e1-f44801d8bd8d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:36.662091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e701970f-2452-4cff-b6e1-f44801d8bd8d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:36.731871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e98b247d-d690-4d61-b204-57e28e02c388 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:36.736605 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e701970f-2452-4cff-b6e1-f44801d8bd8d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "POST /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d/action" status: 204 len: 0 microversion: 2.1 time: 0.088886 Aug 23 17:55:36.737623 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 598/1264] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:55:36 2022] POST /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d/action => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 17:55:36.743591 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e98b247d-d690-4d61-b204-57e28e02c388 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.170074 Aug 23 17:55:36.750625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-da54a322-047a-4969-80dc-9fbbb0066985 req-8cf9586a-359b-406c-a076-92c60ed8213e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d726c6-9bae-4276-b8e2-5eafe4270dce", "name": "network-vif-plugged", "status": "completed", "tag": "1785d3da-8025-402c-a9ab-f4a42d7ab796"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:36.757677 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 667/1265] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:36 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:36.760848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-da54a322-047a-4969-80dc-9fbbb0066985 req-8cf9586a-359b-406c-a076-92c60ed8213e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:36.761334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-da54a322-047a-4969-80dc-9fbbb0066985 req-8cf9586a-359b-406c-a076-92c60ed8213e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:36.761966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-da54a322-047a-4969-80dc-9fbbb0066985 req-8cf9586a-359b-406c-a076-92c60ed8213e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:36.763529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6aae33d9-9862-476d-b037-c059803790de tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:36.764353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6aae33d9-9862-476d-b037-c059803790de tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:36.772030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aae33d9-9862-476d-b037-c059803790de tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:36.772534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aae33d9-9862-476d-b037-c059803790de tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:36.772975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aae33d9-9862-476d-b037-c059803790de tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:36.773737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aae33d9-9862-476d-b037-c059803790de tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:36.774203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aae33d9-9862-476d-b037-c059803790de tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:36.774832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aae33d9-9862-476d-b037-c059803790de tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:36.784485 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-da54a322-047a-4969-80dc-9fbbb0066985 req-8cf9586a-359b-406c-a076-92c60ed8213e service nova] Creating event network-vif-plugged:1785d3da-8025-402c-a9ab-f4a42d7ab796 for instance a3d726c6-9bae-4276-b8e2-5eafe4270dce on n-h1-850468-16 Aug 23 17:55:36.802216 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-da54a322-047a-4969-80dc-9fbbb0066985 req-8cf9586a-359b-406c-a076-92c60ed8213e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063167 Aug 23 17:55:36.804429 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 599/1266] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:37.039971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6aae33d9-9862-476d-b037-c059803790de tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:37.048444 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6aae33d9-9862-476d-b037-c059803790de tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1471 microversion: 2.1 time: 0.289395 Aug 23 17:55:37.049007 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 668/1267] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:36 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1471 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:37.197984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8efc2516-f0be-46af-94a8-0b2f145e21fb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:37.198710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8efc2516-f0be-46af-94a8-0b2f145e21fb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:37.205115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8efc2516-f0be-46af-94a8-0b2f145e21fb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:37.205588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8efc2516-f0be-46af-94a8-0b2f145e21fb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:37.206017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8efc2516-f0be-46af-94a8-0b2f145e21fb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:37.206742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8efc2516-f0be-46af-94a8-0b2f145e21fb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:37.207190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8efc2516-f0be-46af-94a8-0b2f145e21fb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:37.207637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8efc2516-f0be-46af-94a8-0b2f145e21fb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:37.348646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8efc2516-f0be-46af-94a8-0b2f145e21fb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:37.357513 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8efc2516-f0be-46af-94a8-0b2f145e21fb tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1540 microversion: 2.1 time: 0.164237 Aug 23 17:55:37.358095 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 600/1268] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:37 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1540 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:37.493112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-071e17f0-17b2-476f-a85d-b8dcce604f45 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:37.493727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-071e17f0-17b2-476f-a85d-b8dcce604f45 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:37.501147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-071e17f0-17b2-476f-a85d-b8dcce604f45 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:37.501621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-071e17f0-17b2-476f-a85d-b8dcce604f45 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:37.502056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-071e17f0-17b2-476f-a85d-b8dcce604f45 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:37.502773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-071e17f0-17b2-476f-a85d-b8dcce604f45 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:37.503226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-071e17f0-17b2-476f-a85d-b8dcce604f45 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:37.503644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-071e17f0-17b2-476f-a85d-b8dcce604f45 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:37.630597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-071e17f0-17b2-476f-a85d-b8dcce604f45 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:37.639327 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-071e17f0-17b2-476f-a85d-b8dcce604f45 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.150034 Aug 23 17:55:37.639884 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 669/1269] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:37 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:37.765927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9146edc8-e4dd-4bd7-afaf-d6c9e19e5683 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:37.766652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9146edc8-e4dd-4bd7-afaf-d6c9e19e5683 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:37.772716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9146edc8-e4dd-4bd7-afaf-d6c9e19e5683 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:37.773197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9146edc8-e4dd-4bd7-afaf-d6c9e19e5683 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:37.773659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9146edc8-e4dd-4bd7-afaf-d6c9e19e5683 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:37.774344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9146edc8-e4dd-4bd7-afaf-d6c9e19e5683 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:37.774821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9146edc8-e4dd-4bd7-afaf-d6c9e19e5683 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:37.775241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9146edc8-e4dd-4bd7-afaf-d6c9e19e5683 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:37.906376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9146edc8-e4dd-4bd7-afaf-d6c9e19e5683 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:37.914694 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9146edc8-e4dd-4bd7-afaf-d6c9e19e5683 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.153646 Aug 23 17:55:37.916052 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 601/1270] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:37 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:38.069983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-add0024c-bbe9-42cc-83f4-b39baa507f74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:38.070656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-add0024c-bbe9-42cc-83f4-b39baa507f74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:38.078675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-add0024c-bbe9-42cc-83f4-b39baa507f74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:38.079668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-add0024c-bbe9-42cc-83f4-b39baa507f74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:38.080112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-add0024c-bbe9-42cc-83f4-b39baa507f74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:38.080916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-add0024c-bbe9-42cc-83f4-b39baa507f74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:38.081379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-add0024c-bbe9-42cc-83f4-b39baa507f74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:38.081830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-add0024c-bbe9-42cc-83f4-b39baa507f74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:38.255264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-add0024c-bbe9-42cc-83f4-b39baa507f74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:38.264076 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-add0024c-bbe9-42cc-83f4-b39baa507f74 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1471 microversion: 2.1 time: 0.197960 Aug 23 17:55:38.264648 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 670/1271] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:38 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1471 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:38.379374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-37a6c66a-cc96-48d6-88a0-160bc13070c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:38.379991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-37a6c66a-cc96-48d6-88a0-160bc13070c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:38.387185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37a6c66a-cc96-48d6-88a0-160bc13070c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:38.389203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37a6c66a-cc96-48d6-88a0-160bc13070c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:38.389355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37a6c66a-cc96-48d6-88a0-160bc13070c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:38.389944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37a6c66a-cc96-48d6-88a0-160bc13070c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:38.390395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37a6c66a-cc96-48d6-88a0-160bc13070c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:38.391284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37a6c66a-cc96-48d6-88a0-160bc13070c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:38.536741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-37a6c66a-cc96-48d6-88a0-160bc13070c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:38.547420 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-37a6c66a-cc96-48d6-88a0-160bc13070c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1540 microversion: 2.1 time: 0.172606 Aug 23 17:55:38.558650 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 602/1272] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:38 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1540 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:38.660250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45b97e41-8eab-47ce-b30f-62257131df13 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:38.660865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-45b97e41-8eab-47ce-b30f-62257131df13 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:38.667845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45b97e41-8eab-47ce-b30f-62257131df13 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:38.668345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45b97e41-8eab-47ce-b30f-62257131df13 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:38.668972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45b97e41-8eab-47ce-b30f-62257131df13 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:38.669813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45b97e41-8eab-47ce-b30f-62257131df13 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:38.670280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45b97e41-8eab-47ce-b30f-62257131df13 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:38.670736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45b97e41-8eab-47ce-b30f-62257131df13 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:38.814064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-45b97e41-8eab-47ce-b30f-62257131df13 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:38.824281 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-45b97e41-8eab-47ce-b30f-62257131df13 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.167531 Aug 23 17:55:38.825717 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 671/1273] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:38 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:38.844299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-cd9465a7-968f-435a-9036-208f1278418d req-f0692dcd-4f07-4682-ad48-73c23d4cdf05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "856ac0cb-cfb2-43f5-9e4f-df662c38f02d", "name": "network-vif-plugged", "status": "completed", "tag": "a3f7e262-db57-4792-9f23-2fbc005cd02a"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:38.854405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cd9465a7-968f-435a-9036-208f1278418d req-f0692dcd-4f07-4682-ad48-73c23d4cdf05 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:38.854872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cd9465a7-968f-435a-9036-208f1278418d req-f0692dcd-4f07-4682-ad48-73c23d4cdf05 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:38.855315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cd9465a7-968f-435a-9036-208f1278418d req-f0692dcd-4f07-4682-ad48-73c23d4cdf05 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:38.877748 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-cd9465a7-968f-435a-9036-208f1278418d req-f0692dcd-4f07-4682-ad48-73c23d4cdf05 service nova] Creating event network-vif-plugged:a3f7e262-db57-4792-9f23-2fbc005cd02a for instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d on n-h2-850468-16 Aug 23 17:55:38.884858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-cd9465a7-968f-435a-9036-208f1278418d req-f0692dcd-4f07-4682-ad48-73c23d4cdf05 service nova] Instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 17:55:38.897322 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-cd9465a7-968f-435a-9036-208f1278418d req-f0692dcd-4f07-4682-ad48-73c23d4cdf05 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058711 Aug 23 17:55:38.898025 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 603/1274] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:38.936220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d89b1ba4-834b-4584-aeea-62786fd3208b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:38.936809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d89b1ba4-834b-4584-aeea-62786fd3208b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:38.943288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d89b1ba4-834b-4584-aeea-62786fd3208b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:38.943959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d89b1ba4-834b-4584-aeea-62786fd3208b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:38.944582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d89b1ba4-834b-4584-aeea-62786fd3208b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:38.945442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d89b1ba4-834b-4584-aeea-62786fd3208b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:38.946264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d89b1ba4-834b-4584-aeea-62786fd3208b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:38.947047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d89b1ba4-834b-4584-aeea-62786fd3208b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:39.071818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d453a17-4f31-44c6-9b73-c81f0edc5d70 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:39.072438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7d453a17-4f31-44c6-9b73-c81f0edc5d70 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:39.079201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d453a17-4f31-44c6-9b73-c81f0edc5d70 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:39.079701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d453a17-4f31-44c6-9b73-c81f0edc5d70 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:39.080172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d453a17-4f31-44c6-9b73-c81f0edc5d70 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:39.080877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d453a17-4f31-44c6-9b73-c81f0edc5d70 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:39.081332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d453a17-4f31-44c6-9b73-c81f0edc5d70 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:39.081759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d453a17-4f31-44c6-9b73-c81f0edc5d70 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:39.085236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d89b1ba4-834b-4584-aeea-62786fd3208b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:39.093999 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d89b1ba4-834b-4584-aeea-62786fd3208b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.162238 Aug 23 17:55:39.094775 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 672/1275] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:38 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:39.108400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7d453a17-4f31-44c6-9b73-c81f0edc5d70 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:55:39.191206 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7d453a17-4f31-44c6-9b73-c81f0edc5d70 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "DELETE /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 204 len: 0 microversion: 2.1 time: 0.123245 Aug 23 17:55:39.191813 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 604/1276] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:55:39 2022] DELETE /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 17:55:39.203725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8056718-d8c5-47b0-80ce-c4ca773db12f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:39.204350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c8056718-d8c5-47b0-80ce-c4ca773db12f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:39.211299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8056718-d8c5-47b0-80ce-c4ca773db12f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:39.211786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8056718-d8c5-47b0-80ce-c4ca773db12f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:39.212219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8056718-d8c5-47b0-80ce-c4ca773db12f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:39.212915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8056718-d8c5-47b0-80ce-c4ca773db12f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:39.213367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8056718-d8c5-47b0-80ce-c4ca773db12f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:39.213788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8056718-d8c5-47b0-80ce-c4ca773db12f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:39.288084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f55fc3a-4afa-4a3b-bf16-7dd889277ef1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:39.288790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f55fc3a-4afa-4a3b-bf16-7dd889277ef1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:39.295586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f55fc3a-4afa-4a3b-bf16-7dd889277ef1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:39.296285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f55fc3a-4afa-4a3b-bf16-7dd889277ef1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:39.296877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f55fc3a-4afa-4a3b-bf16-7dd889277ef1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:39.297799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f55fc3a-4afa-4a3b-bf16-7dd889277ef1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:39.298405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f55fc3a-4afa-4a3b-bf16-7dd889277ef1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:39.299137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f55fc3a-4afa-4a3b-bf16-7dd889277ef1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:39.371439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c8056718-d8c5-47b0-80ce-c4ca773db12f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:39.382670 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c8056718-d8c5-47b0-80ce-c4ca773db12f tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1712 microversion: 2.1 time: 0.185681 Aug 23 17:55:39.383440 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 673/1277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:39 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1712 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:39.454079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f55fc3a-4afa-4a3b-bf16-7dd889277ef1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:39.462089 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f55fc3a-4afa-4a3b-bf16-7dd889277ef1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1471 microversion: 2.1 time: 0.180348 Aug 23 17:55:39.462670 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 605/1278] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:39 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1471 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:39.572052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-04df32a4-17cc-4e84-bbe8-1312ee33a649 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:39.572699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-04df32a4-17cc-4e84-bbe8-1312ee33a649 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:39.579640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04df32a4-17cc-4e84-bbe8-1312ee33a649 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:39.580128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04df32a4-17cc-4e84-bbe8-1312ee33a649 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:39.580568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04df32a4-17cc-4e84-bbe8-1312ee33a649 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:39.581267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04df32a4-17cc-4e84-bbe8-1312ee33a649 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:39.581730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04df32a4-17cc-4e84-bbe8-1312ee33a649 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:39.582152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04df32a4-17cc-4e84-bbe8-1312ee33a649 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:39.716798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-04df32a4-17cc-4e84-bbe8-1312ee33a649 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:39.724682 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-04df32a4-17cc-4e84-bbe8-1312ee33a649 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1540 microversion: 2.1 time: 0.157077 Aug 23 17:55:39.725249 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 674/1279] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:39 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1540 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:39.846516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-69087082-09f6-4182-a99d-7d05a4fd6a51 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:39.847149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-69087082-09f6-4182-a99d-7d05a4fd6a51 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:39.853186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69087082-09f6-4182-a99d-7d05a4fd6a51 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:39.853695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69087082-09f6-4182-a99d-7d05a4fd6a51 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:39.854128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69087082-09f6-4182-a99d-7d05a4fd6a51 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:39.854844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69087082-09f6-4182-a99d-7d05a4fd6a51 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:39.855307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69087082-09f6-4182-a99d-7d05a4fd6a51 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:39.855760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69087082-09f6-4182-a99d-7d05a4fd6a51 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:39.996616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-69087082-09f6-4182-a99d-7d05a4fd6a51 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:40.004375 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-69087082-09f6-4182-a99d-7d05a4fd6a51 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.161763 Aug 23 17:55:40.004936 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 606/1280] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:39 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:40.117095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a06c6dbb-8730-480f-b834-e033ec02b9c8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:40.117704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a06c6dbb-8730-480f-b834-e033ec02b9c8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:40.124331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a06c6dbb-8730-480f-b834-e033ec02b9c8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:40.124815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a06c6dbb-8730-480f-b834-e033ec02b9c8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:40.125280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a06c6dbb-8730-480f-b834-e033ec02b9c8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:40.125985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a06c6dbb-8730-480f-b834-e033ec02b9c8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:40.126438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a06c6dbb-8730-480f-b834-e033ec02b9c8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:40.126900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a06c6dbb-8730-480f-b834-e033ec02b9c8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:40.263195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a06c6dbb-8730-480f-b834-e033ec02b9c8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:40.270824 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a06c6dbb-8730-480f-b834-e033ec02b9c8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.157855 Aug 23 17:55:40.271390 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 675/1281] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:40 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:40.404887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a33588e6-57ca-4eb4-9e63-7305851f2e0a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:40.405504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a33588e6-57ca-4eb4-9e63-7305851f2e0a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:40.411992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a33588e6-57ca-4eb4-9e63-7305851f2e0a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:40.412482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a33588e6-57ca-4eb4-9e63-7305851f2e0a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:40.412925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a33588e6-57ca-4eb4-9e63-7305851f2e0a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:40.413628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a33588e6-57ca-4eb4-9e63-7305851f2e0a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:40.414085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a33588e6-57ca-4eb4-9e63-7305851f2e0a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:40.414514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a33588e6-57ca-4eb4-9e63-7305851f2e0a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:40.485038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-60a97815-b065-4856-a538-5ae15274b6b4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:40.486156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-60a97815-b065-4856-a538-5ae15274b6b4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:40.492423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60a97815-b065-4856-a538-5ae15274b6b4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:40.493024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60a97815-b065-4856-a538-5ae15274b6b4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:40.493533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60a97815-b065-4856-a538-5ae15274b6b4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:40.494379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60a97815-b065-4856-a538-5ae15274b6b4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:40.495082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60a97815-b065-4856-a538-5ae15274b6b4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:40.495541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60a97815-b065-4856-a538-5ae15274b6b4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:40.556490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a33588e6-57ca-4eb4-9e63-7305851f2e0a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:40.567994 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a33588e6-57ca-4eb4-9e63-7305851f2e0a tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1712 microversion: 2.1 time: 0.167250 Aug 23 17:55:40.569676 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 607/1282] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:40 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1712 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:40.645379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-60a97815-b065-4856-a538-5ae15274b6b4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:40.653811 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-60a97815-b065-4856-a538-5ae15274b6b4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1463 microversion: 2.1 time: 0.173670 Aug 23 17:55:40.654481 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 676/1283] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:40 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1463 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:40.674235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f66117b-6925-4730-9f77-d1a33cba979e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:40.674912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7f66117b-6925-4730-9f77-d1a33cba979e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:40.680823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f66117b-6925-4730-9f77-d1a33cba979e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:40.681311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f66117b-6925-4730-9f77-d1a33cba979e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:40.681748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f66117b-6925-4730-9f77-d1a33cba979e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:40.682447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f66117b-6925-4730-9f77-d1a33cba979e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:40.682931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f66117b-6925-4730-9f77-d1a33cba979e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:40.683357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f66117b-6925-4730-9f77-d1a33cba979e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:40.749166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-55dccc1b-9f38-43a0-b388-601a15375724 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:40.750248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-55dccc1b-9f38-43a0-b388-601a15375724 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:40.758726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55dccc1b-9f38-43a0-b388-601a15375724 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:40.759486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55dccc1b-9f38-43a0-b388-601a15375724 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:40.759994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55dccc1b-9f38-43a0-b388-601a15375724 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:40.760784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55dccc1b-9f38-43a0-b388-601a15375724 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:40.761339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55dccc1b-9f38-43a0-b388-601a15375724 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:40.762195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55dccc1b-9f38-43a0-b388-601a15375724 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:40.828551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7f66117b-6925-4730-9f77-d1a33cba979e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:40.843670 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7f66117b-6925-4730-9f77-d1a33cba979e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1463 microversion: 2.1 time: 0.173200 Aug 23 17:55:40.845303 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 608/1284] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:40 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1463 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:40.868676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a9363399-a587-4eec-8de6-59e1a0665c33 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Action: 'create', calling method: .version_select at 0x7f27ec6fba60>, body: {"keypair": {"name": "tempest-keypair-539964646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGaFaXmmUGvb3SkflxNlylspsUa4j65Nfbm0ZAfhqriPNk82g5SQMFrSsLnYXXdBgPUhPYfq5lp+Sutc2nCE2v9qdfenG2w7WB1BPduVxEE8CkWJoz+fgK3ZjslvJux7DA=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:40.885667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a9363399-a587-4eec-8de6-59e1a0665c33 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Getting quotas for project 88baf37ceb1342e3bc666ba96b4988ee. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:55:40.891325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a9363399-a587-4eec-8de6-59e1a0665c33 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Getting quotas for user 8d66dd8a72974b1791fa449fb91c3282 and project 88baf37ceb1342e3bc666ba96b4988ee. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:55:40.916995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-55dccc1b-9f38-43a0-b388-601a15375724 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:40.917471 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a9363399-a587-4eec-8de6-59e1a0665c33 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.052518 Aug 23 17:55:40.918188 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 609/1285] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:55:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:55:40.924205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3a02c701-2916-4ddd-856e-ea9e44b846fd req-9881df38-1233-4c92-9279-ae9cf8973d65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61806701-e6ae-4bc0-abca-408ea9c3d186", "name": "network-vif-plugged", "status": "completed", "tag": "54c8eec2-ca60-4b8a-b3b7-cc13ced8964c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:40.931845 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-55dccc1b-9f38-43a0-b388-601a15375724 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1540 microversion: 2.1 time: 0.190105 Aug 23 17:55:40.936288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3a02c701-2916-4ddd-856e-ea9e44b846fd req-9881df38-1233-4c92-9279-ae9cf8973d65 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:40.937080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3a02c701-2916-4ddd-856e-ea9e44b846fd req-9881df38-1233-4c92-9279-ae9cf8973d65 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:40.937760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3a02c701-2916-4ddd-856e-ea9e44b846fd req-9881df38-1233-4c92-9279-ae9cf8973d65 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:40.946606 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 677/1286] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:40 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1540 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:40.951408 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3a02c701-2916-4ddd-856e-ea9e44b846fd req-9881df38-1233-4c92-9279-ae9cf8973d65 service nova] Creating event network-vif-plugged:54c8eec2-ca60-4b8a-b3b7-cc13ced8964c for instance 61806701-e6ae-4bc0-abca-408ea9c3d186 on n-h1-850468-16 Aug 23 17:55:40.957085 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3a02c701-2916-4ddd-856e-ea9e44b846fd req-9881df38-1233-4c92-9279-ae9cf8973d65 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036251 Aug 23 17:55:40.959478 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 610/1287] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:41.026189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-24cefe2f-38ba-49ec-a4a7-f7dc06943bd2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:41.026832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-24cefe2f-38ba-49ec-a4a7-f7dc06943bd2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:41.033972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24cefe2f-38ba-49ec-a4a7-f7dc06943bd2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:41.034758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24cefe2f-38ba-49ec-a4a7-f7dc06943bd2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:41.035198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24cefe2f-38ba-49ec-a4a7-f7dc06943bd2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:41.036303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24cefe2f-38ba-49ec-a4a7-f7dc06943bd2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:41.036930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24cefe2f-38ba-49ec-a4a7-f7dc06943bd2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:41.039279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24cefe2f-38ba-49ec-a4a7-f7dc06943bd2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:41.193079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-24cefe2f-38ba-49ec-a4a7-f7dc06943bd2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:41.202142 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-24cefe2f-38ba-49ec-a4a7-f7dc06943bd2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.179818 Aug 23 17:55:41.215731 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 678/1288] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:41 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:41.292142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa70ccd8-95c3-47a7-b31b-a36b55b2baf4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:41.292895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa70ccd8-95c3-47a7-b31b-a36b55b2baf4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:41.299812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa70ccd8-95c3-47a7-b31b-a36b55b2baf4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:41.300563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa70ccd8-95c3-47a7-b31b-a36b55b2baf4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:41.301175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa70ccd8-95c3-47a7-b31b-a36b55b2baf4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:41.302039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa70ccd8-95c3-47a7-b31b-a36b55b2baf4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:41.302711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa70ccd8-95c3-47a7-b31b-a36b55b2baf4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:41.303342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa70ccd8-95c3-47a7-b31b-a36b55b2baf4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:41.475037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa70ccd8-95c3-47a7-b31b-a36b55b2baf4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:41.483071 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa70ccd8-95c3-47a7-b31b-a36b55b2baf4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.195144 Aug 23 17:55:41.483837 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 611/1289] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:41 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:41.590949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e67e60fc-f8d6-441a-afd2-43833a853c4c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:41.591565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e67e60fc-f8d6-441a-afd2-43833a853c4c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:41.597617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e67e60fc-f8d6-441a-afd2-43833a853c4c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:41.598108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e67e60fc-f8d6-441a-afd2-43833a853c4c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:41.598560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e67e60fc-f8d6-441a-afd2-43833a853c4c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:41.599270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e67e60fc-f8d6-441a-afd2-43833a853c4c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:41.599727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e67e60fc-f8d6-441a-afd2-43833a853c4c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:41.600154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e67e60fc-f8d6-441a-afd2-43833a853c4c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:41.812553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e67e60fc-f8d6-441a-afd2-43833a853c4c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:41.820605 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e67e60fc-f8d6-441a-afd2-43833a853c4c tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1712 microversion: 2.1 time: 0.233985 Aug 23 17:55:41.821167 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 679/1290] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:41 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1712 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:41.954661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8bdcf54-6570-41ab-ae83-3eff72d19a37 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:41.955824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8bdcf54-6570-41ab-ae83-3eff72d19a37 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:41.962870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8bdcf54-6570-41ab-ae83-3eff72d19a37 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:41.963544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8bdcf54-6570-41ab-ae83-3eff72d19a37 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:41.964297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8bdcf54-6570-41ab-ae83-3eff72d19a37 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:41.965673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8bdcf54-6570-41ab-ae83-3eff72d19a37 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:41.966654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8bdcf54-6570-41ab-ae83-3eff72d19a37 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:41.967293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8bdcf54-6570-41ab-ae83-3eff72d19a37 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:41.991817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:42.140084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8bdcf54-6570-41ab-ae83-3eff72d19a37 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:42.150440 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8bdcf54-6570-41ab-ae83-3eff72d19a37 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1535 microversion: 2.1 time: 0.200341 Aug 23 17:55:42.151164 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 612/1291] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:41 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1535 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:42.223129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fe3e9b49-ba39-47fd-8adb-1463bbe136d2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:42.223739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe3e9b49-ba39-47fd-8adb-1463bbe136d2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:42.229696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe3e9b49-ba39-47fd-8adb-1463bbe136d2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:42.230174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe3e9b49-ba39-47fd-8adb-1463bbe136d2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:42.230630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe3e9b49-ba39-47fd-8adb-1463bbe136d2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:42.232063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe3e9b49-ba39-47fd-8adb-1463bbe136d2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:42.232729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe3e9b49-ba39-47fd-8adb-1463bbe136d2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:42.233138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe3e9b49-ba39-47fd-8adb-1463bbe136d2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:42.400570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1264243b-7215-40ce-8da3-caaffa490d8b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Calling method '.version_select at 0x7f27ec665550>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:42.405078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1264243b-7215-40ce-8da3-caaffa490d8b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:42.405575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1264243b-7215-40ce-8da3-caaffa490d8b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:42.406007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1264243b-7215-40ce-8da3-caaffa490d8b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:42.416530 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1264243b-7215-40ce-8da3-caaffa490d8b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 2362 microversion: 2.1 time: 0.019621 Aug 23 17:55:42.417112 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 613/1292] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 17:55:42 2022] GET /compute/v2.1/os-migrations => generated 2362 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:42.424513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fe3e9b49-ba39-47fd-8adb-1463bbe136d2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:42.426776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:42.433507 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fe3e9b49-ba39-47fd-8adb-1463bbe136d2 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.214348 Aug 23 17:55:42.434175 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 680/1293] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:42 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:42.441546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3273cc18-79c3-4003-98e4-9a79f2d5b23c tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:42.448690 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3273cc18-79c3-4003-98e4-9a79f2d5b23c tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.010884 Aug 23 17:55:42.449212 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 614/1294] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:55:42 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:42.460673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e8cb2416-56dd-4917-95c5-2b2b5ced1f42 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1582437662", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:42.463598 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:55:42.463598 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:55:42.467460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:42.479646 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e8cb2416-56dd-4917-95c5-2b2b5ced1f42 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.022711 Aug 23 17:55:42.480228 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 681/1295] 10.222.0.61 () {60 vars in 1146 bytes} [Tue Aug 23 17:55:42 2022] POST /compute/v2.1/flavors => generated 499 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:42.492008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f25b024-0821-4ab3-95a6-9886f0140cd3 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:42.501559 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f25b024-0821-4ab3-95a6-9886f0140cd3 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.013155 Aug 23 17:55:42.502117 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 615/1296] 10.222.0.61 () {58 vars in 1182 bytes} [Tue Aug 23 17:55:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:55:42.505109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e1ec3ca4-bc6d-4610-962e-ee82dc12e709 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:42.506152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e1ec3ca4-bc6d-4610-962e-ee82dc12e709 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:42.513901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ca4-bc6d-4610-962e-ee82dc12e709 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:42.515136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ca4-bc6d-4610-962e-ee82dc12e709 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:42.515798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ca4-bc6d-4610-962e-ee82dc12e709 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:42.516589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ca4-bc6d-4610-962e-ee82dc12e709 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:42.517129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ca4-bc6d-4610-962e-ee82dc12e709 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:42.517632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1ec3ca4-bc6d-4610-962e-ee82dc12e709 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:42.623388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-868204255", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "5057de9f-3674-4924-b6f0-ea0a3f562291"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:42.681561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:55:42.863362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e1ec3ca4-bc6d-4610-962e-ee82dc12e709 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:42.871605 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e1ec3ca4-bc6d-4610-962e-ee82dc12e709 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.371643 Aug 23 17:55:42.872321 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 682/1297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:42 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:42.877061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec9767af-7f08-4ece-ad13-9d3bd5d55ebd tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:42.877690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ec9767af-7f08-4ece-ad13-9d3bd5d55ebd tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:42.884041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec9767af-7f08-4ece-ad13-9d3bd5d55ebd tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:42.884555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec9767af-7f08-4ece-ad13-9d3bd5d55ebd tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:42.884985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec9767af-7f08-4ece-ad13-9d3bd5d55ebd tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:42.885672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec9767af-7f08-4ece-ad13-9d3bd5d55ebd tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:42.886117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec9767af-7f08-4ece-ad13-9d3bd5d55ebd tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:42.886534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec9767af-7f08-4ece-ad13-9d3bd5d55ebd tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:42.909130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:55:42.909674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:55:42.910285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:55:42.910792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:55:42.911303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:55:42.920211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:42.920780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:42.921284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:42.922078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:42.922626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:42.923118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:42.935287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:42.943944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Getting quotas for project 88baf37ceb1342e3bc666ba96b4988ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:55:42.949460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Getting quotas for user 8d66dd8a72974b1791fa449fb91c3282 and project 88baf37ceb1342e3bc666ba96b4988ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:55:42.961976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:55:42.964338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:55:43.011078 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-722b0de9-dde5-454b-b0ab-761ce6277e0e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.392350 Aug 23 17:55:43.011886 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 616/1298] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:55:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:55:43.017328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec9767af-7f08-4ece-ad13-9d3bd5d55ebd tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:43.022994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a7f44f5c-7d21-48fd-838e-a2455516d56f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:43.023601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a7f44f5c-7d21-48fd-838e-a2455516d56f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:43.027372 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec9767af-7f08-4ece-ad13-9d3bd5d55ebd tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1712 microversion: 2.1 time: 0.152993 Aug 23 17:55:43.029052 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 683/1299] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:42 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1712 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:43.080717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a7f44f5c-7d21-48fd-838e-a2455516d56f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:43.087898 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a7f44f5c-7d21-48fd-838e-a2455516d56f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1278 microversion: 2.1 time: 0.068808 Aug 23 17:55:43.088457 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 617/1300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:43 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1278 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:43.174173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e7c24d34-f1d8-4dc0-a88a-1d55aca10d3e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:43.174759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e7c24d34-f1d8-4dc0-a88a-1d55aca10d3e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:43.181051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7c24d34-f1d8-4dc0-a88a-1d55aca10d3e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:43.181541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7c24d34-f1d8-4dc0-a88a-1d55aca10d3e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:43.182001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7c24d34-f1d8-4dc0-a88a-1d55aca10d3e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:43.182741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7c24d34-f1d8-4dc0-a88a-1d55aca10d3e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:43.183203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7c24d34-f1d8-4dc0-a88a-1d55aca10d3e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:43.183661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7c24d34-f1d8-4dc0-a88a-1d55aca10d3e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:43.323472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e7c24d34-f1d8-4dc0-a88a-1d55aca10d3e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:43.332596 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e7c24d34-f1d8-4dc0-a88a-1d55aca10d3e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1522 microversion: 2.1 time: 0.163083 Aug 23 17:55:43.333165 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 684/1301] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:43 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:43.354047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7119e6a-2daa-419c-a5c9-4c919e6d4059 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:43.354491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c7119e6a-2daa-419c-a5c9-4c919e6d4059 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:43.361232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7119e6a-2daa-419c-a5c9-4c919e6d4059 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:43.361728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7119e6a-2daa-419c-a5c9-4c919e6d4059 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:43.362169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7119e6a-2daa-419c-a5c9-4c919e6d4059 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:43.362931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7119e6a-2daa-419c-a5c9-4c919e6d4059 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:43.363391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7119e6a-2daa-419c-a5c9-4c919e6d4059 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:43.363822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7119e6a-2daa-419c-a5c9-4c919e6d4059 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:43.390417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c7119e6a-2daa-419c-a5c9-4c919e6d4059 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:55:43.456381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9d411f09-4e77-4fb5-966c-2cb92028ec72 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:43.457477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9d411f09-4e77-4fb5-966c-2cb92028ec72 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:43.464705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d411f09-4e77-4fb5-966c-2cb92028ec72 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:43.465212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d411f09-4e77-4fb5-966c-2cb92028ec72 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:43.466219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d411f09-4e77-4fb5-966c-2cb92028ec72 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:43.467203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d411f09-4e77-4fb5-966c-2cb92028ec72 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:43.467658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d411f09-4e77-4fb5-966c-2cb92028ec72 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:43.468107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d411f09-4e77-4fb5-966c-2cb92028ec72 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:43.478959 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c7119e6a-2daa-419c-a5c9-4c919e6d4059 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "DELETE /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 204 len: 0 microversion: 2.1 time: 0.128559 Aug 23 17:55:43.479968 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 618/1302] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:55:43 2022] DELETE /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:55:43.489580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6db01421-17e5-44be-83c9-fdb8647962ca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:43.490282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6db01421-17e5-44be-83c9-fdb8647962ca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:43.496341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6db01421-17e5-44be-83c9-fdb8647962ca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:43.497694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6db01421-17e5-44be-83c9-fdb8647962ca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:43.498143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6db01421-17e5-44be-83c9-fdb8647962ca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:43.498873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6db01421-17e5-44be-83c9-fdb8647962ca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:43.499328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6db01421-17e5-44be-83c9-fdb8647962ca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:43.499750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6db01421-17e5-44be-83c9-fdb8647962ca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:43.611723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9d411f09-4e77-4fb5-966c-2cb92028ec72 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:43.622791 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9d411f09-4e77-4fb5-966c-2cb92028ec72 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.170411 Aug 23 17:55:43.623486 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 685/1303] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:43 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:43.647922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6db01421-17e5-44be-83c9-fdb8647962ca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:43.656649 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6db01421-17e5-44be-83c9-fdb8647962ca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1528 microversion: 2.1 time: 0.171894 Aug 23 17:55:43.657217 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 619/1304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:43 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1528 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:43.893529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b764d948-2df7-481b-ba0b-d8e0c51eeeb4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:43.894452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b764d948-2df7-481b-ba0b-d8e0c51eeeb4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:43.901813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b764d948-2df7-481b-ba0b-d8e0c51eeeb4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:43.902310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b764d948-2df7-481b-ba0b-d8e0c51eeeb4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:43.902799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b764d948-2df7-481b-ba0b-d8e0c51eeeb4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:43.903559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b764d948-2df7-481b-ba0b-d8e0c51eeeb4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:43.904060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b764d948-2df7-481b-ba0b-d8e0c51eeeb4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:43.904497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b764d948-2df7-481b-ba0b-d8e0c51eeeb4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:44.042045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-23d78786-512e-49df-ad14-52a66711efc5 req-efbd191c-b43c-42ea-a625-1cdd7312b1ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200e6dde-d9fa-47e0-af4d-2e5be2dba21c", "name": "network-vif-plugged", "status": "completed", "tag": "c59e7672-d57f-4008-9989-09790fe3f71c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:44.054232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b764d948-2df7-481b-ba0b-d8e0c51eeeb4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:44.063107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-23d78786-512e-49df-ad14-52a66711efc5 req-efbd191c-b43c-42ea-a625-1cdd7312b1ea service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:44.063873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-23d78786-512e-49df-ad14-52a66711efc5 req-efbd191c-b43c-42ea-a625-1cdd7312b1ea service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:44.064534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-23d78786-512e-49df-ad14-52a66711efc5 req-efbd191c-b43c-42ea-a625-1cdd7312b1ea service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:44.064731 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b764d948-2df7-481b-ba0b-d8e0c51eeeb4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.175381 Aug 23 17:55:44.065633 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 686/1305] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:43 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:44.070143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7be7b2ec-e4ca-433f-9f81-fd034621b9aa tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:44.070787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7be7b2ec-e4ca-433f-9f81-fd034621b9aa tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:44.078162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7be7b2ec-e4ca-433f-9f81-fd034621b9aa tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:44.078691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7be7b2ec-e4ca-433f-9f81-fd034621b9aa tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:44.079150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7be7b2ec-e4ca-433f-9f81-fd034621b9aa tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:44.079869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7be7b2ec-e4ca-433f-9f81-fd034621b9aa tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:44.080333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7be7b2ec-e4ca-433f-9f81-fd034621b9aa tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:44.080765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7be7b2ec-e4ca-433f-9f81-fd034621b9aa tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:44.090895 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-23d78786-512e-49df-ad14-52a66711efc5 req-efbd191c-b43c-42ea-a625-1cdd7312b1ea service nova] Creating event network-vif-plugged:c59e7672-d57f-4008-9989-09790fe3f71c for instance 200e6dde-d9fa-47e0-af4d-2e5be2dba21c on n-h2-850468-16 Aug 23 17:55:44.098371 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-23d78786-512e-49df-ad14-52a66711efc5 req-efbd191c-b43c-42ea-a625-1cdd7312b1ea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063241 Aug 23 17:55:44.100072 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 620/1306] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:44.112867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0711b59d-e28a-490c-9915-08708da14810 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:44.113993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0711b59d-e28a-490c-9915-08708da14810 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:44.131049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0711b59d-e28a-490c-9915-08708da14810 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:44.131557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0711b59d-e28a-490c-9915-08708da14810 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:44.132055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0711b59d-e28a-490c-9915-08708da14810 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:44.133005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0711b59d-e28a-490c-9915-08708da14810 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:44.133469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0711b59d-e28a-490c-9915-08708da14810 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:44.133899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0711b59d-e28a-490c-9915-08708da14810 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:44.305655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0711b59d-e28a-490c-9915-08708da14810 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:44.315446 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0711b59d-e28a-490c-9915-08708da14810 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1274 microversion: 2.1 time: 0.209570 Aug 23 17:55:44.316448 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 621/1307] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:44 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:44.535862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7be7b2ec-e4ca-433f-9f81-fd034621b9aa tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:44.546802 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7be7b2ec-e4ca-433f-9f81-fd034621b9aa tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1712 microversion: 2.1 time: 0.480042 Aug 23 17:55:44.560221 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 687/1308] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:44 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1712 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:44.644360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-13bc0138-33cc-44fc-b6d3-776f04352001 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:44.645247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-13bc0138-33cc-44fc-b6d3-776f04352001 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:44.651733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13bc0138-33cc-44fc-b6d3-776f04352001 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:44.651919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13bc0138-33cc-44fc-b6d3-776f04352001 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:44.652366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13bc0138-33cc-44fc-b6d3-776f04352001 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:44.653148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13bc0138-33cc-44fc-b6d3-776f04352001 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:44.653955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13bc0138-33cc-44fc-b6d3-776f04352001 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:44.654395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13bc0138-33cc-44fc-b6d3-776f04352001 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:44.678387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-26850f1a-1344-4620-b177-cdbe08a0d01a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:44.679169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-26850f1a-1344-4620-b177-cdbe08a0d01a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:44.685894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26850f1a-1344-4620-b177-cdbe08a0d01a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:44.686472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26850f1a-1344-4620-b177-cdbe08a0d01a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:44.687024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26850f1a-1344-4620-b177-cdbe08a0d01a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:44.687736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26850f1a-1344-4620-b177-cdbe08a0d01a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:44.688194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26850f1a-1344-4620-b177-cdbe08a0d01a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:44.688629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26850f1a-1344-4620-b177-cdbe08a0d01a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:44.828325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-26850f1a-1344-4620-b177-cdbe08a0d01a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:44.837785 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-26850f1a-1344-4620-b177-cdbe08a0d01a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1528 microversion: 2.1 time: 0.164370 Aug 23 17:55:44.838370 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 688/1309] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:44 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1528 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:44.907210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-13bc0138-33cc-44fc-b6d3-776f04352001 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:44.915080 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-13bc0138-33cc-44fc-b6d3-776f04352001 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.274450 Aug 23 17:55:44.915771 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 622/1310] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:44 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:45.086788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ff65466-82c2-4183-b0d5-63d21ad03d0e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:45.087403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2ff65466-82c2-4183-b0d5-63d21ad03d0e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:45.096443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff65466-82c2-4183-b0d5-63d21ad03d0e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:45.097228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff65466-82c2-4183-b0d5-63d21ad03d0e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:45.098475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff65466-82c2-4183-b0d5-63d21ad03d0e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:45.099312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff65466-82c2-4183-b0d5-63d21ad03d0e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:45.099778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff65466-82c2-4183-b0d5-63d21ad03d0e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:45.100316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff65466-82c2-4183-b0d5-63d21ad03d0e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:45.260881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2ff65466-82c2-4183-b0d5-63d21ad03d0e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:45.269650 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2ff65466-82c2-4183-b0d5-63d21ad03d0e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1314 microversion: 2.1 time: 0.188189 Aug 23 17:55:45.270353 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 689/1311] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:45 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:45.336799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-587d02e5-6359-4f7f-b08c-8e08c61830c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:45.337361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-587d02e5-6359-4f7f-b08c-8e08c61830c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:45.344121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-587d02e5-6359-4f7f-b08c-8e08c61830c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:45.344601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-587d02e5-6359-4f7f-b08c-8e08c61830c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:45.345032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-587d02e5-6359-4f7f-b08c-8e08c61830c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:45.345717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-587d02e5-6359-4f7f-b08c-8e08c61830c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:45.346164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-587d02e5-6359-4f7f-b08c-8e08c61830c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:45.346605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-587d02e5-6359-4f7f-b08c-8e08c61830c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:45.413158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-587d02e5-6359-4f7f-b08c-8e08c61830c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:45.428356 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-587d02e5-6359-4f7f-b08c-8e08c61830c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1330 microversion: 2.1 time: 0.095329 Aug 23 17:55:45.428946 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 623/1312] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:45 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1330 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:45.479359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-46e60222-ee70-4aa0-a7a9-1bb0b56d5505 req-d5b5432d-5a22-455a-a5b5-bf4730a26440 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "482c06a7-2b1f-4a6e-8b62-b702d32c4c3f", "name": "network-vif-deleted", "tag": "61e068c3-e07e-47db-a508-2528903c28f7"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:45.493861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-46e60222-ee70-4aa0-a7a9-1bb0b56d5505 req-d5b5432d-5a22-455a-a5b5-bf4730a26440 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:45.494431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-46e60222-ee70-4aa0-a7a9-1bb0b56d5505 req-d5b5432d-5a22-455a-a5b5-bf4730a26440 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:45.494954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-46e60222-ee70-4aa0-a7a9-1bb0b56d5505 req-d5b5432d-5a22-455a-a5b5-bf4730a26440 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:45.515288 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-46e60222-ee70-4aa0-a7a9-1bb0b56d5505 req-d5b5432d-5a22-455a-a5b5-bf4730a26440 service nova] Creating event network-vif-deleted:61e068c3-e07e-47db-a508-2528903c28f7 for instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f on n-h2-850468-16 Aug 23 17:55:45.523614 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-46e60222-ee70-4aa0-a7a9-1bb0b56d5505 req-d5b5432d-5a22-455a-a5b5-bf4730a26440 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053344 Aug 23 17:55:45.524240 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 690/1313] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:45.570753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f9d31cff-5fe8-4db2-a898-312e338d0f56 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:45.571391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f9d31cff-5fe8-4db2-a898-312e338d0f56 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:45.579585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9d31cff-5fe8-4db2-a898-312e338d0f56 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:45.579818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9d31cff-5fe8-4db2-a898-312e338d0f56 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:45.580260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9d31cff-5fe8-4db2-a898-312e338d0f56 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:45.581123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9d31cff-5fe8-4db2-a898-312e338d0f56 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:45.581766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9d31cff-5fe8-4db2-a898-312e338d0f56 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:45.582648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9d31cff-5fe8-4db2-a898-312e338d0f56 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:45.767391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f9d31cff-5fe8-4db2-a898-312e338d0f56 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df1d56f4fa244d49829c18545cde4308', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d19cb17d3014429a4eda825eb937161', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:45.779230 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f9d31cff-5fe8-4db2-a898-312e338d0f56 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 200 len: 1645 microversion: 2.1 time: 0.213707 Aug 23 17:55:45.782370 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 624/1314] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:45 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 1645 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:45.863447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e760526e-39fd-4e91-8f59-69ef5f802628 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:45.864242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e760526e-39fd-4e91-8f59-69ef5f802628 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:45.879286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e760526e-39fd-4e91-8f59-69ef5f802628 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:45.880274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e760526e-39fd-4e91-8f59-69ef5f802628 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:45.891116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e760526e-39fd-4e91-8f59-69ef5f802628 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:45.893573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e760526e-39fd-4e91-8f59-69ef5f802628 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:45.894066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e760526e-39fd-4e91-8f59-69ef5f802628 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:45.896648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e760526e-39fd-4e91-8f59-69ef5f802628 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:45.937056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a9107a30-d473-4afd-98cf-6bcc588b995f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:45.937811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a9107a30-d473-4afd-98cf-6bcc588b995f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:45.972332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9107a30-d473-4afd-98cf-6bcc588b995f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:45.979366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9107a30-d473-4afd-98cf-6bcc588b995f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:45.982567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9107a30-d473-4afd-98cf-6bcc588b995f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:45.985107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9107a30-d473-4afd-98cf-6bcc588b995f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:45.987144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9107a30-d473-4afd-98cf-6bcc588b995f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:45.988291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9107a30-d473-4afd-98cf-6bcc588b995f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:46.254556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e760526e-39fd-4e91-8f59-69ef5f802628 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:46.281657 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e760526e-39fd-4e91-8f59-69ef5f802628 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1528 microversion: 2.1 time: 0.421019 Aug 23 17:55:46.296942 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 691/1315] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:45 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1528 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:46.302723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b65a8441-848f-4034-85ee-56d47e2ccff9 req-23bd5bc2-eb24-48f5-884b-ec420e31f8b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61806701-e6ae-4bc0-abca-408ea9c3d186", "name": "network-vif-unplugged", "status": "completed", "tag": "54c8eec2-ca60-4b8a-b3b7-cc13ced8964c"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:46.316364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b65a8441-848f-4034-85ee-56d47e2ccff9 req-23bd5bc2-eb24-48f5-884b-ec420e31f8b3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:46.317395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b65a8441-848f-4034-85ee-56d47e2ccff9 req-23bd5bc2-eb24-48f5-884b-ec420e31f8b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:46.318013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b65a8441-848f-4034-85ee-56d47e2ccff9 req-23bd5bc2-eb24-48f5-884b-ec420e31f8b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:46.344813 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b65a8441-848f-4034-85ee-56d47e2ccff9 req-23bd5bc2-eb24-48f5-884b-ec420e31f8b3 service nova] Creating event network-vif-unplugged:54c8eec2-ca60-4b8a-b3b7-cc13ced8964c for instance 61806701-e6ae-4bc0-abca-408ea9c3d186 on n-h1-850468-16 Aug 23 17:55:46.407117 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b65a8441-848f-4034-85ee-56d47e2ccff9 req-23bd5bc2-eb24-48f5-884b-ec420e31f8b3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.106239 Aug 23 17:55:46.411742 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 692/1316] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:46.430990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9195368c-c1e9-486e-96e5-749494850ed2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:46.435717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9195368c-c1e9-486e-96e5-749494850ed2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:46.457587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9195368c-c1e9-486e-96e5-749494850ed2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:46.459114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9195368c-c1e9-486e-96e5-749494850ed2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:46.460020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9195368c-c1e9-486e-96e5-749494850ed2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:46.461389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9195368c-c1e9-486e-96e5-749494850ed2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:46.463359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9195368c-c1e9-486e-96e5-749494850ed2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:46.464229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9195368c-c1e9-486e-96e5-749494850ed2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:46.557109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a9107a30-d473-4afd-98cf-6bcc588b995f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:46.570323 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a9107a30-d473-4afd-98cf-6bcc588b995f tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.635753 Aug 23 17:55:46.570975 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 625/1317] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:45 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:46.600205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51bef1ea-b0af-438c-be9e-a475a59fb7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:46.601025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51bef1ea-b0af-438c-be9e-a475a59fb7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:46.621579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51bef1ea-b0af-438c-be9e-a475a59fb7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:46.622891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51bef1ea-b0af-438c-be9e-a475a59fb7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:46.623454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51bef1ea-b0af-438c-be9e-a475a59fb7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:46.624323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51bef1ea-b0af-438c-be9e-a475a59fb7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:46.624883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51bef1ea-b0af-438c-be9e-a475a59fb7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:46.625408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51bef1ea-b0af-438c-be9e-a475a59fb7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:46.701330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9195368c-c1e9-486e-96e5-749494850ed2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:46.717307 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9195368c-c1e9-486e-96e5-749494850ed2 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1500 microversion: 2.1 time: 0.300760 Aug 23 17:55:46.719288 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 693/1318] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:46 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1500 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:46.726911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-cf44d23e-4e85-43d3-8798-aa3b404440ff req-08be6829-f0f1-4cef-a0d2-bf08991c26c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61806701-e6ae-4bc0-abca-408ea9c3d186", "name": "network-vif-deleted", "tag": "54c8eec2-ca60-4b8a-b3b7-cc13ced8964c"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:46.758502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cf44d23e-4e85-43d3-8798-aa3b404440ff req-08be6829-f0f1-4cef-a0d2-bf08991c26c6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:46.759030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cf44d23e-4e85-43d3-8798-aa3b404440ff req-08be6829-f0f1-4cef-a0d2-bf08991c26c6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:46.759455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cf44d23e-4e85-43d3-8798-aa3b404440ff req-08be6829-f0f1-4cef-a0d2-bf08991c26c6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:46.776657 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-cf44d23e-4e85-43d3-8798-aa3b404440ff req-08be6829-f0f1-4cef-a0d2-bf08991c26c6 service nova] Creating event network-vif-deleted:54c8eec2-ca60-4b8a-b3b7-cc13ced8964c for instance 61806701-e6ae-4bc0-abca-408ea9c3d186 on n-h1-850468-16 Aug 23 17:55:46.791126 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-cf44d23e-4e85-43d3-8798-aa3b404440ff req-08be6829-f0f1-4cef-a0d2-bf08991c26c6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065986 Aug 23 17:55:46.792941 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 694/1319] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:46.808713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3486a944-53c0-4aca-866c-6c1351a0f7e3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:46.813459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3486a944-53c0-4aca-866c-6c1351a0f7e3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:46.825603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3486a944-53c0-4aca-866c-6c1351a0f7e3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:46.826613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3486a944-53c0-4aca-866c-6c1351a0f7e3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:46.827073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3486a944-53c0-4aca-866c-6c1351a0f7e3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:46.828322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3486a944-53c0-4aca-866c-6c1351a0f7e3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:46.828997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3486a944-53c0-4aca-866c-6c1351a0f7e3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:46.830265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3486a944-53c0-4aca-866c-6c1351a0f7e3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:46.875714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-3486a944-53c0-4aca-866c-6c1351a0f7e3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lazy-loading 'flavor' on Instance uuid 200e6dde-d9fa-47e0-af4d-2e5be2dba21c {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:55:47.030282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-51bef1ea-b0af-438c-be9e-a475a59fb7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:47.044185 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51bef1ea-b0af-438c-be9e-a475a59fb7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1336 microversion: 2.1 time: 0.454618 Aug 23 17:55:47.060279 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 626/1320] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:46 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1336 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:47.066314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f39447f4-7e3a-4f47-b838-632aa783e4f3 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:47.066960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f39447f4-7e3a-4f47-b838-632aa783e4f3 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:47.070358 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3486a944-53c0-4aca-866c-6c1351a0f7e3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "POST /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c/action" status: 200 len: 32 microversion: 2.1 time: 0.275326 Aug 23 17:55:47.071339 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 695/1321] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:55:46 2022] POST /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c/action => generated 32 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:55:47.078285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f39447f4-7e3a-4f47-b838-632aa783e4f3 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.079203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f39447f4-7e3a-4f47-b838-632aa783e4f3 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.079695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f39447f4-7e3a-4f47-b838-632aa783e4f3 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.080427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f39447f4-7e3a-4f47-b838-632aa783e4f3 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.081080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f39447f4-7e3a-4f47-b838-632aa783e4f3 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.081683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f39447f4-7e3a-4f47-b838-632aa783e4f3 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.082102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-30bb90d8-4795-46b0-8a43-b07d0171ec9d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:47.082851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-30bb90d8-4795-46b0-8a43-b07d0171ec9d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:47.097700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30bb90d8-4795-46b0-8a43-b07d0171ec9d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.098235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30bb90d8-4795-46b0-8a43-b07d0171ec9d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.098647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30bb90d8-4795-46b0-8a43-b07d0171ec9d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.099095 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-f39447f4-7e3a-4f47-b838-632aa783e4f3 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] HTTP exception thrown: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f39447f4-7e3a-4f47-b838-632aa783e4f3 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Request method failure captured: Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f HTTP/1.1 Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROiKqy4O3eY6m-u5rpRzvxIkYDZFgKs6vksiHLr1hSTRq5CnOAZPqehW-6tZ4F2yyK7iKKUN1KyywB_Qtiqt0glYn5v4EiIykhjQn0GVfTiJAPuar4bEWbmKt_Z8MU4IkJ_wlrIIFULOg5E5Mbrs6DzKRZvrwwrI4KCC2iynjHAVTk Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}] Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: df1d56f4fa244d49829c18545cde4308 Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '482c06a7-2b1f-4a6e-8b62-b702d32c4c3f'} Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.101092 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:47.106436 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.106436 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:47.106436 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:47.106436 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:47.106436 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:55:47.106436 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:55:47.106436 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:47.106436 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.107228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30bb90d8-4795-46b0-8a43-b07d0171ec9d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.107228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30bb90d8-4795-46b0-8a43-b07d0171ec9d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.107228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30bb90d8-4795-46b0-8a43-b07d0171ec9d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.108486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f39447f4-7e3a-4f47-b838-632aa783e4f3 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Returning 404 to user: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:47.109693 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f39447f4-7e3a-4f47-b838-632aa783e4f3 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 404 len: 111 microversion: 2.1 time: 0.047572 Aug 23 17:55:47.113173 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 627/1322] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:47 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:55:47.118848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-338091fc-1e95-4ff7-8fdd-a03cedd750cf tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:47.119863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-338091fc-1e95-4ff7-8fdd-a03cedd750cf tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:47.126934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-338091fc-1e95-4ff7-8fdd-a03cedd750cf tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.127700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-338091fc-1e95-4ff7-8fdd-a03cedd750cf tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.128101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-338091fc-1e95-4ff7-8fdd-a03cedd750cf tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.128975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-338091fc-1e95-4ff7-8fdd-a03cedd750cf tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.129667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-338091fc-1e95-4ff7-8fdd-a03cedd750cf tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.130318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-338091fc-1e95-4ff7-8fdd-a03cedd750cf tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.147361 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-338091fc-1e95-4ff7-8fdd-a03cedd750cf tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] HTTP exception thrown: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-338091fc-1e95-4ff7-8fdd-a03cedd750cf tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Request method failure captured: Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a HTTP/1.1 Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROiKqy4O3eY6m-u5rpRzvxIkYDZFgKs6vksiHLr1hSTRq5CnOAZPqehW-6tZ4F2yyK7iKKUN1KyywB_Qtiqt0glYn5v4EiIykhjQn0GVfTiJAPuar4bEWbmKt_Z8MU4IkJ_wlrIIFULOg5E5Mbrs6DzKRZvrwwrI4KCC2iynjHAVTk Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}] Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: df1d56f4fa244d49829c18545cde4308 Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f1684439-72b6-4fff-9624-39abf5a9552a'} Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:55:47.149450 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:55:47.154046 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:47.154046 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.154046 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:47.154046 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.154046 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:47.154046 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:47.154046 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:47.154046 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:55:47.154046 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:55:47.154046 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:47.154046 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.156337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-338091fc-1e95-4ff7-8fdd-a03cedd750cf tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Returning 404 to user: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:47.158069 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-338091fc-1e95-4ff7-8fdd-a03cedd750cf tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 404 len: 111 microversion: 2.1 time: 0.043259 Aug 23 17:55:47.158904 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 628/1323] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:55:47 2022] DELETE /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:55:47.170020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93195da0-78fb-4917-a054-2c8f7a6403d8 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:47.171118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-93195da0-78fb-4917-a054-2c8f7a6403d8 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:47.178196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93195da0-78fb-4917-a054-2c8f7a6403d8 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.179151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93195da0-78fb-4917-a054-2c8f7a6403d8 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.179816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93195da0-78fb-4917-a054-2c8f7a6403d8 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.181056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93195da0-78fb-4917-a054-2c8f7a6403d8 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.181736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93195da0-78fb-4917-a054-2c8f7a6403d8 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.182381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93195da0-78fb-4917-a054-2c8f7a6403d8 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.226233 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-93195da0-78fb-4917-a054-2c8f7a6403d8 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] HTTP exception thrown: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93195da0-78fb-4917-a054-2c8f7a6403d8 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Request method failure captured: Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a HTTP/1.1 Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBROiKqy4O3eY6m-u5rpRzvxIkYDZFgKs6vksiHLr1hSTRq5CnOAZPqehW-6tZ4F2yyK7iKKUN1KyywB_Qtiqt0glYn5v4EiIykhjQn0GVfTiJAPuar4bEWbmKt_Z8MU4IkJ_wlrIIFULOg5E5Mbrs6DzKRZvrwwrI4KCC2iynjHAVTk Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}] Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: df1d56f4fa244d49829c18545cde4308 Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f1684439-72b6-4fff-9624-39abf5a9552a'} Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.233379 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:47.237445 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.237445 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:47.237445 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:47.237445 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:47.237445 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:55:47.237445 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:55:47.237445 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:47.237445 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:55:47.239677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93195da0-78fb-4917-a054-2c8f7a6403d8 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Returning 404 to user: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:47.240773 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93195da0-78fb-4917-a054-2c8f7a6403d8 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 404 len: 111 microversion: 2.1 time: 0.075599 Aug 23 17:55:47.241548 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 629/1324] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:47 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:55:47.251666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48a026d9-08e5-46dc-b377-f461fb481374 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '.version_select at 0x7f27ec71a1f0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:47.285045 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48a026d9-08e5-46dc-b377-f461fb481374 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110049289" status: 202 len: 0 microversion: 2.1 time: 0.037079 Aug 23 17:55:47.286312 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 630/1325] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 17:55:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2110049289 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:55:47.304061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:47.305607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:47.312976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.313852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.314573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.315554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.316254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.317525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.352941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-30bb90d8-4795-46b0-8a43-b07d0171ec9d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:47.364949 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-30bb90d8-4795-46b0-8a43-b07d0171ec9d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.287394 Aug 23 17:55:47.367178 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 696/1326] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:47 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:47.380059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.380924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.381614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.382177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lazy-loading 'fault' on Instance uuid 61806701-e6ae-4bc0-abca-408ea9c3d186 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:55:47.495759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:47.508766 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4a40d343-a705-4314-b32a-d22df5252ad9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 200 len: 1315 microversion: 2.1 time: 0.209445 Aug 23 17:55:47.510338 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 631/1327] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:47 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:47.596613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4451bef3-fb96-4fcb-8f65-12efd32e39ea tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:47.597648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4451bef3-fb96-4fcb-8f65-12efd32e39ea tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:47.608871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4451bef3-fb96-4fcb-8f65-12efd32e39ea tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.612180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4451bef3-fb96-4fcb-8f65-12efd32e39ea tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.613671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4451bef3-fb96-4fcb-8f65-12efd32e39ea tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.614690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4451bef3-fb96-4fcb-8f65-12efd32e39ea tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:47.616550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4451bef3-fb96-4fcb-8f65-12efd32e39ea tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:47.618860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4451bef3-fb96-4fcb-8f65-12efd32e39ea tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:47.879668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4451bef3-fb96-4fcb-8f65-12efd32e39ea tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:47.888477 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4451bef3-fb96-4fcb-8f65-12efd32e39ea tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.295956 Aug 23 17:55:47.889327 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 697/1328] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:47 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:48.066379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6705bf1c-9371-4115-9976-8cecf3fb7c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:48.066861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6705bf1c-9371-4115-9976-8cecf3fb7c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:48.076088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6705bf1c-9371-4115-9976-8cecf3fb7c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.076875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6705bf1c-9371-4115-9976-8cecf3fb7c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.077510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6705bf1c-9371-4115-9976-8cecf3fb7c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.079279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6705bf1c-9371-4115-9976-8cecf3fb7c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.080132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6705bf1c-9371-4115-9976-8cecf3fb7c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.080775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6705bf1c-9371-4115-9976-8cecf3fb7c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.253367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-90a5d9b3-c120-4ba3-a0bf-3e3cc120ba5d tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:48.254286 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:55:48.254286 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:55:48.275647 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-90a5d9b3-c120-4ba3-a0bf-3e3cc120ba5d tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/714181290" status: 202 len: 0 microversion: 2.1 time: 0.026010 Aug 23 17:55:48.276237 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 698/1329] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Aug 23 17:55:48 2022] DELETE /compute/v2.1/flavors/714181290 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:55:48.286068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a9b71667-faaa-4ada-b633-56049855234d tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:48.310019 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a9b71667-faaa-4ada-b633-56049855234d tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5895 microversion: 2.1 time: 0.027877 Aug 23 17:55:48.325786 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 699/1330] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:55:48 2022] GET /compute/v2.1/flavors/detail => generated 5895 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:48.331058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-627a6e93-490e-46f0-99f5-87ca752de1dc tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:48.347674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6705bf1c-9371-4115-9976-8cecf3fb7c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:48.350218 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-627a6e93-490e-46f0-99f5-87ca752de1dc tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1839114851" status: 202 len: 0 microversion: 2.1 time: 0.022652 Aug 23 17:55:48.351274 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 700/1331] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:55:48 2022] DELETE /compute/v2.1/flavors/1839114851 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:55:48.356783 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6705bf1c-9371-4115-9976-8cecf3fb7c23 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1378 microversion: 2.1 time: 0.295235 Aug 23 17:55:48.357438 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 632/1332] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:48 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1378 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:48.360269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a94216e2-9229-48ce-a75d-d2322ba2454b tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:48.382951 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a94216e2-9229-48ce-a75d-d2322ba2454b tempest-ServersWithSpecificFlavorTestJSON-2120596916 tempest-ServersWithSpecificFlavorTestJSON-2120596916-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5480 microversion: 2.1 time: 0.027317 Aug 23 17:55:48.384005 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 701/1333] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:55:48 2022] GET /compute/v2.1/flavors/detail => generated 5480 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:48.408379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8cd7fcd7-82f8-4e22-842b-f3c4d204228a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:48.409054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8cd7fcd7-82f8-4e22-842b-f3c4d204228a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:48.409182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77199405-6005-4d1a-8577-c00558516b0e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:48.409807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-77199405-6005-4d1a-8577-c00558516b0e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:48.415918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd7fcd7-82f8-4e22-842b-f3c4d204228a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.416668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd7fcd7-82f8-4e22-842b-f3c4d204228a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.416904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77199405-6005-4d1a-8577-c00558516b0e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.417406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77199405-6005-4d1a-8577-c00558516b0e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.417630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd7fcd7-82f8-4e22-842b-f3c4d204228a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.417908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77199405-6005-4d1a-8577-c00558516b0e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.418720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77199405-6005-4d1a-8577-c00558516b0e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.419072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd7fcd7-82f8-4e22-842b-f3c4d204228a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.419199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77199405-6005-4d1a-8577-c00558516b0e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.419606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77199405-6005-4d1a-8577-c00558516b0e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.419974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd7fcd7-82f8-4e22-842b-f3c4d204228a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.420564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd7fcd7-82f8-4e22-842b-f3c4d204228a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.435790 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-77199405-6005-4d1a-8577-c00558516b0e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] HTTP exception thrown: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77199405-6005-4d1a-8577-c00558516b0e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Request method failure captured: Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f HTTP/1.1 Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBROiKqy4O3eY6m-u5rpRzvxIkYDZFgKs6vksiHLr1hSTRq5CnOAZPqehW-6tZ4F2yyK7iKKUN1KyywB_Qtiqt0glYn5v4EiIykhjQn0GVfTiJAPuar4bEWbmKt_Z8MU4IkJ_wlrIIFULOg5E5Mbrs6DzKRZvrwwrI4KCC2iynjHAVTk Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}] Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: df1d56f4fa244d49829c18545cde4308 Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '482c06a7-2b1f-4a6e-8b62-b702d32c4c3f'} Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:55:48.437514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77199405-6005-4d1a-8577-c00558516b0e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Returning 404 to user: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:48.442134 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-77199405-6005-4d1a-8577-c00558516b0e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "DELETE /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 404 len: 111 microversion: 2.1 time: 0.033693 Aug 23 17:55:48.443508 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 702/1334] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:55:48 2022] DELETE /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 17:55:48.448879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2cff7604-709a-42f1-ac3f-f44ac3b0497e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:48.450632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2cff7604-709a-42f1-ac3f-f44ac3b0497e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:48.457861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cff7604-709a-42f1-ac3f-f44ac3b0497e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.458361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cff7604-709a-42f1-ac3f-f44ac3b0497e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.458831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cff7604-709a-42f1-ac3f-f44ac3b0497e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.459554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cff7604-709a-42f1-ac3f-f44ac3b0497e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.460013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cff7604-709a-42f1-ac3f-f44ac3b0497e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.460441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cff7604-709a-42f1-ac3f-f44ac3b0497e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.464908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:48.476064 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2cff7604-709a-42f1-ac3f-f44ac3b0497e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] HTTP exception thrown: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2cff7604-709a-42f1-ac3f-f44ac3b0497e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Request method failure captured: Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f HTTP/1.1 Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBROiKqy4O3eY6m-u5rpRzvxIkYDZFgKs6vksiHLr1hSTRq5CnOAZPqehW-6tZ4F2yyK7iKKUN1KyywB_Qtiqt0glYn5v4EiIykhjQn0GVfTiJAPuar4bEWbmKt_Z8MU4IkJ_wlrIIFULOg5E5Mbrs6DzKRZvrwwrI4KCC2iynjHAVTk Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}] Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: df1d56f4fa244d49829c18545cde4308 Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '482c06a7-2b1f-4a6e-8b62-b702d32c4c3f'} Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.477693 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:48.482329 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.482329 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.482329 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:48.482329 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:48.482329 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:55:48.482329 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:55:48.482329 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. Aug 23 17:55:48.482329 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.482329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2cff7604-709a-42f1-ac3f-f44ac3b0497e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Returning 404 to user: Instance 482c06a7-2b1f-4a6e-8b62-b702d32c4c3f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:48.482329 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2cff7604-709a-42f1-ac3f-f44ac3b0497e tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f" status: 404 len: 111 microversion: 2.1 time: 0.035063 Aug 23 17:55:48.483164 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 703/1335] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:48 2022] GET /compute/v2.1/servers/482c06a7-2b1f-4a6e-8b62-b702d32c4c3f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:55:48.487567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd34b16a-ac76-48bf-afd9-6a04b1669822 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:48.488083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd34b16a-ac76-48bf-afd9-6a04b1669822 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:48.496062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd34b16a-ac76-48bf-afd9-6a04b1669822 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.497111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd34b16a-ac76-48bf-afd9-6a04b1669822 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.497573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd34b16a-ac76-48bf-afd9-6a04b1669822 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.498534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd34b16a-ac76-48bf-afd9-6a04b1669822 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.499056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd34b16a-ac76-48bf-afd9-6a04b1669822 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.499486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd34b16a-ac76-48bf-afd9-6a04b1669822 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.523455 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-bd34b16a-ac76-48bf-afd9-6a04b1669822 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] HTTP exception thrown: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd34b16a-ac76-48bf-afd9-6a04b1669822 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Request method failure captured: Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a HTTP/1.1 Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBROiKqy4O3eY6m-u5rpRzvxIkYDZFgKs6vksiHLr1hSTRq5CnOAZPqehW-6tZ4F2yyK7iKKUN1KyywB_Qtiqt0glYn5v4EiIykhjQn0GVfTiJAPuar4bEWbmKt_Z8MU4IkJ_wlrIIFULOg5E5Mbrs6DzKRZvrwwrI4KCC2iynjHAVTk Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}] Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: df1d56f4fa244d49829c18545cde4308 Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f1684439-72b6-4fff-9624-39abf5a9552a'} Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:55:48.525453 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd34b16a-ac76-48bf-afd9-6a04b1669822 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Returning 404 to user: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd34b16a-ac76-48bf-afd9-6a04b1669822 tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 404 len: 111 microversion: 2.1 time: 0.042778 Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 704/1336] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:55:48 2022] DELETE /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-be47be7f-c206-4ea1-a81a-e65677d46fa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:48.534211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-be47be7f-c206-4ea1-a81a-e65677d46fa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:48.540169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be47be7f-c206-4ea1-a81a-e65677d46fa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.540668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be47be7f-c206-4ea1-a81a-e65677d46fa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.541111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be47be7f-c206-4ea1-a81a-e65677d46fa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.541836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be47be7f-c206-4ea1-a81a-e65677d46fa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.542296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be47be7f-c206-4ea1-a81a-e65677d46fa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.543136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be47be7f-c206-4ea1-a81a-e65677d46fa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.558137 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-be47be7f-c206-4ea1-a81a-e65677d46fa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] HTTP exception thrown: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-be47be7f-c206-4ea1-a81a-e65677d46fa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 HTTP/1.1 Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '61806701-e6ae-4bc0-abca-408ea9c3d186'} Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.560205 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:48.564538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.564538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.564538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:48.564538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:48.564538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:55:48.564538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:55:48.564538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:55:48.564538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.564538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-be47be7f-c206-4ea1-a81a-e65677d46fa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 404 to user: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:48.564538 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-be47be7f-c206-4ea1-a81a-e65677d46fa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 404 len: 111 microversion: 2.1 time: 0.032554 Aug 23 17:55:48.569322 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 705/1337] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:48 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:55:48.574323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-26f75f9d-b997-470e-a66d-ed56343fae4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:48.575308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-26f75f9d-b997-470e-a66d-ed56343fae4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] [instance: f1684439-72b6-4fff-9624-39abf5a9552a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:48.581576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26f75f9d-b997-470e-a66d-ed56343fae4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.582085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26f75f9d-b997-470e-a66d-ed56343fae4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.582570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26f75f9d-b997-470e-a66d-ed56343fae4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.583409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26f75f9d-b997-470e-a66d-ed56343fae4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.584145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26f75f9d-b997-470e-a66d-ed56343fae4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.584751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26f75f9d-b997-470e-a66d-ed56343fae4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.600538 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-26f75f9d-b997-470e-a66d-ed56343fae4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] HTTP exception thrown: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-26f75f9d-b997-470e-a66d-ed56343fae4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Request method failure captured: Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a HTTP/1.1 Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBROiKqy4O3eY6m-u5rpRzvxIkYDZFgKs6vksiHLr1hSTRq5CnOAZPqehW-6tZ4F2yyK7iKKUN1KyywB_Qtiqt0glYn5v4EiIykhjQn0GVfTiJAPuar4bEWbmKt_Z8MU4IkJ_wlrIIFULOg5E5Mbrs6DzKRZvrwwrI4KCC2iynjHAVTk Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1d19cb17d3014429a4eda825eb937161"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1d19cb17d3014429a4eda825eb937161"}]}] Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 1d19cb17d3014429a4eda825eb937161 Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427 Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: df1d56f4fa244d49829c18545cde4308 Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-494221427-project Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f1684439-72b6-4fff-9624-39abf5a9552a'} Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.602162 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:48.607887 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.607887 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:48.607887 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:48.607887 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:48.607887 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:55:48.607887 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:55:48.607887 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. Aug 23 17:55:48.607887 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:48.607887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-26f75f9d-b997-470e-a66d-ed56343fae4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] Returning 404 to user: Instance f1684439-72b6-4fff-9624-39abf5a9552a could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:48.607887 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-26f75f9d-b997-470e-a66d-ed56343fae4d tempest-ServersWithSpecificFlavorTestJSON-494221427 tempest-ServersWithSpecificFlavorTestJSON-494221427-project] 10.222.0.61 "GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a" status: 404 len: 111 microversion: 2.1 time: 0.033253 Aug 23 17:55:48.607887 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 706/1338] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:48 2022] GET /compute/v2.1/servers/f1684439-72b6-4fff-9624-39abf5a9552a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:55:48.610745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ceed8db-2d05-4383-b470-c69b8cd9dab4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Action: 'create', calling method: .version_select at 0x7f27ec9143a0>, body: {"keypair": {"name": "tempest-keypair-339161931", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLM3Q3YeYYPYCZSp1uRyIn5vGP1/6DhNAJ7no++paHvPIw8y+fwfUrx6bio6lDgo57ObXGVM2yAmBtpLuyHF9pIn/BDuspdj2PigJeqV/nxNoTo85EAw89stlnJ1o+rPLg=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:48.627187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-9ceed8db-2d05-4383-b470-c69b8cd9dab4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Getting quotas for project fbb6fbb08d9d4edc88ccf65f8b3e1df1. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:55:48.632228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-9ceed8db-2d05-4383-b470-c69b8cd9dab4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Getting quotas for user 4440b850f8974643bd22fc84ddd265ee and project fbb6fbb08d9d4edc88ccf65f8b3e1df1. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:55:48.659495 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9ceed8db-2d05-4383-b470-c69b8cd9dab4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053640 Aug 23 17:55:48.660219 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 707/1339] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:55:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:48.789238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8cd7fcd7-82f8-4e22-842b-f3c4d204228a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:48.806376 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8cd7fcd7-82f8-4e22-842b-f3c4d204228a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.411890 Aug 23 17:55:48.808378 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 633/1340] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:48 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:48.911360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bfc93e65-d855-4d35-b62c-aef84cdbbc26 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:48.912422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bfc93e65-d855-4d35-b62c-aef84cdbbc26 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:48.920744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bfc93e65-d855-4d35-b62c-aef84cdbbc26 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.921540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bfc93e65-d855-4d35-b62c-aef84cdbbc26 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.922177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bfc93e65-d855-4d35-b62c-aef84cdbbc26 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.923383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bfc93e65-d855-4d35-b62c-aef84cdbbc26 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.924015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bfc93e65-d855-4d35-b62c-aef84cdbbc26 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.924658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bfc93e65-d855-4d35-b62c-aef84cdbbc26 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.948150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-e4ab7369-7367-4bda-85b4-094461ffb457 req-0839109e-3cda-41d4-848f-f6f3723038c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102daea4-8648-4efc-8b9a-cd590f4b7084", "name": "network-vif-plugged", "status": "completed", "tag": "ca07d8bc-63b0-4443-bd7b-855d80bfede8"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:48.970842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e4ab7369-7367-4bda-85b4-094461ffb457 req-0839109e-3cda-41d4-848f-f6f3723038c3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:48.971695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e4ab7369-7367-4bda-85b4-094461ffb457 req-0839109e-3cda-41d4-848f-f6f3723038c3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:48.972287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e4ab7369-7367-4bda-85b4-094461ffb457 req-0839109e-3cda-41d4-848f-f6f3723038c3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:48.996002 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-e4ab7369-7367-4bda-85b4-094461ffb457 req-0839109e-3cda-41d4-848f-f6f3723038c3 service nova] Creating event network-vif-plugged:ca07d8bc-63b0-4443-bd7b-855d80bfede8 for instance 102daea4-8648-4efc-8b9a-cd590f4b7084 on n-h2-850468-16 Aug 23 17:55:49.007061 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-e4ab7369-7367-4bda-85b4-094461ffb457 req-0839109e-3cda-41d4-848f-f6f3723038c3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063246 Aug 23 17:55:49.007974 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 634/1341] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:49.165992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bfc93e65-d855-4d35-b62c-aef84cdbbc26 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:49.176360 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bfc93e65-d855-4d35-b62c-aef84cdbbc26 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.270090 Aug 23 17:55:49.178710 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 708/1342] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:48 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:49.380232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-386df553-8f80-446d-b4a4-32385d7191b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:49.381539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-386df553-8f80-446d-b4a4-32385d7191b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:49.395633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-386df553-8f80-446d-b4a4-32385d7191b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:49.396123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-386df553-8f80-446d-b4a4-32385d7191b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:49.396786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-386df553-8f80-446d-b4a4-32385d7191b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:49.397505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-386df553-8f80-446d-b4a4-32385d7191b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:49.397997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-386df553-8f80-446d-b4a4-32385d7191b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:49.398443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-386df553-8f80-446d-b4a4-32385d7191b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:49.431128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:49.436575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ed5f154e-86d0-407a-860c-408fb5ec0efb req-ada4ab79-adb0-45db-805c-92b7487ae5da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c329be5-120a-4bfd-ba7d-12c0ed0c4814", "tag": "777bb24b-a6b8-45cd-9bb8-2263c15bf327"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:49.449183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed5f154e-86d0-407a-860c-408fb5ec0efb req-ada4ab79-adb0-45db-805c-92b7487ae5da service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:49.451101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed5f154e-86d0-407a-860c-408fb5ec0efb req-ada4ab79-adb0-45db-805c-92b7487ae5da service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:49.451757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed5f154e-86d0-407a-860c-408fb5ec0efb req-ada4ab79-adb0-45db-805c-92b7487ae5da service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:49.467873 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ed5f154e-86d0-407a-860c-408fb5ec0efb req-ada4ab79-adb0-45db-805c-92b7487ae5da service nova] Creating event network-changed:777bb24b-a6b8-45cd-9bb8-2263c15bf327 for instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 on n-h1-850468-16 Aug 23 17:55:49.473242 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ed5f154e-86d0-407a-860c-408fb5ec0efb req-ada4ab79-adb0-45db-805c-92b7487ae5da service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041097 Aug 23 17:55:49.474705 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 709/1343] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:55:49.675634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-386df553-8f80-446d-b4a4-32385d7191b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:49.683429 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-386df553-8f80-446d-b4a4-32385d7191b7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1378 microversion: 2.1 time: 0.308848 Aug 23 17:55:49.686585 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 635/1344] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:49 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1378 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:49.833551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0763522b-1523-4f73-b78a-9a08094bddfa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:49.834840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0763522b-1523-4f73-b78a-9a08094bddfa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:49.845366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0763522b-1523-4f73-b78a-9a08094bddfa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:49.846727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0763522b-1523-4f73-b78a-9a08094bddfa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:49.847349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0763522b-1523-4f73-b78a-9a08094bddfa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:49.848240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0763522b-1523-4f73-b78a-9a08094bddfa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:49.848865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0763522b-1523-4f73-b78a-9a08094bddfa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:49.849804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0763522b-1523-4f73-b78a-9a08094bddfa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:50.153136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0763522b-1523-4f73-b78a-9a08094bddfa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:50.160875 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0763522b-1523-4f73-b78a-9a08094bddfa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.334186 Aug 23 17:55:50.161441 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 710/1345] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:49 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:50.198192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-934f2ad2-038c-476c-a18f-9e01434fd5cc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:50.198828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-934f2ad2-038c-476c-a18f-9e01434fd5cc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:50.207656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-934f2ad2-038c-476c-a18f-9e01434fd5cc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:50.208161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-934f2ad2-038c-476c-a18f-9e01434fd5cc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:50.208595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-934f2ad2-038c-476c-a18f-9e01434fd5cc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:50.209292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-934f2ad2-038c-476c-a18f-9e01434fd5cc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:50.209737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-934f2ad2-038c-476c-a18f-9e01434fd5cc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:50.210156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-934f2ad2-038c-476c-a18f-9e01434fd5cc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:50.355291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-934f2ad2-038c-476c-a18f-9e01434fd5cc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:50.364408 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-934f2ad2-038c-476c-a18f-9e01434fd5cc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1317 microversion: 2.1 time: 0.170815 Aug 23 17:55:50.365222 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 636/1346] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:50 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1317 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:50.705687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fddcf8d7-6ba3-4906-9369-52335e45c0ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:50.706302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fddcf8d7-6ba3-4906-9369-52335e45c0ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:50.712561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fddcf8d7-6ba3-4906-9369-52335e45c0ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:50.713047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fddcf8d7-6ba3-4906-9369-52335e45c0ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:50.713540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fddcf8d7-6ba3-4906-9369-52335e45c0ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:50.714291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fddcf8d7-6ba3-4906-9369-52335e45c0ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:50.714787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fddcf8d7-6ba3-4906-9369-52335e45c0ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:50.715228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fddcf8d7-6ba3-4906-9369-52335e45c0ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:50.936480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fddcf8d7-6ba3-4906-9369-52335e45c0ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:50.947519 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fddcf8d7-6ba3-4906-9369-52335e45c0ca tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1378 microversion: 2.1 time: 0.247235 Aug 23 17:55:50.948670 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 711/1347] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:50 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1378 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:51.183243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-19ea575d-58d9-408f-a259-6c29f3579eea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:51.183863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-19ea575d-58d9-408f-a259-6c29f3579eea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:51.195350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19ea575d-58d9-408f-a259-6c29f3579eea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:51.199320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19ea575d-58d9-408f-a259-6c29f3579eea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:51.199782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19ea575d-58d9-408f-a259-6c29f3579eea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:51.201200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19ea575d-58d9-408f-a259-6c29f3579eea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:51.201781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19ea575d-58d9-408f-a259-6c29f3579eea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:51.202217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19ea575d-58d9-408f-a259-6c29f3579eea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:51.332834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1995150242", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:51.416496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] validate_networks() for [('b06bcefd-d9c8-46b3-8f56-9e68315ff33e', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:55:51.452300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-19ea575d-58d9-408f-a259-6c29f3579eea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:51.460384 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-19ea575d-58d9-408f-a259-6c29f3579eea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.280977 Aug 23 17:55:51.460973 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 637/1348] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:51 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:51.466090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c92b0223-2140-44b8-ac42-4d83e5658dbc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:51.466834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c92b0223-2140-44b8-ac42-4d83e5658dbc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:51.473063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c92b0223-2140-44b8-ac42-4d83e5658dbc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:51.473770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c92b0223-2140-44b8-ac42-4d83e5658dbc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:51.474395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c92b0223-2140-44b8-ac42-4d83e5658dbc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:51.475134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c92b0223-2140-44b8-ac42-4d83e5658dbc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:51.475758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c92b0223-2140-44b8-ac42-4d83e5658dbc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:51.476360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c92b0223-2140-44b8-ac42-4d83e5658dbc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:51.774980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c92b0223-2140-44b8-ac42-4d83e5658dbc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:51.788723 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c92b0223-2140-44b8-ac42-4d83e5658dbc tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1505 microversion: 2.1 time: 0.326267 Aug 23 17:55:51.789821 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 638/1349] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:51 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1505 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:51.811293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fc6ca120-c0e3-4ff3-a5a1-ee8920de4cff tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:51.812221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fc6ca120-c0e3-4ff3-a5a1-ee8920de4cff tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a3d726c6-9bae-4276-b8e2-5eafe4270dce] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:51.822928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc6ca120-c0e3-4ff3-a5a1-ee8920de4cff tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:51.823579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc6ca120-c0e3-4ff3-a5a1-ee8920de4cff tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:51.824573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc6ca120-c0e3-4ff3-a5a1-ee8920de4cff tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:51.827229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc6ca120-c0e3-4ff3-a5a1-ee8920de4cff tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:51.827933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc6ca120-c0e3-4ff3-a5a1-ee8920de4cff tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:51.828617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc6ca120-c0e3-4ff3-a5a1-ee8920de4cff tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:51.837121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:55:51.837588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:55:51.838027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:55:51.838445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:55:51.839063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:55:51.859464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:51.859945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:51.860379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:51.861105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:51.861558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:51.861981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:51.884787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Getting quotas for project fbb6fbb08d9d4edc88ccf65f8b3e1df1. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:55:51.894200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Getting quotas for user 4440b850f8974643bd22fc84ddd265ee and project fbb6fbb08d9d4edc88ccf65f8b3e1df1. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:55:51.908600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:55:51.911445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:55:51.971557 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1037cf93-7535-420b-a5d4-cd477d81d119 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.642865 Aug 23 17:55:51.972675 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 712/1350] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:55:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 17:55:51.977520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1779c586-c18f-4e35-88c3-b249888b6593 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:51.978974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1779c586-c18f-4e35-88c3-b249888b6593 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:51.986320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=89,nova_api:DELETE=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:51.988595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1779c586-c18f-4e35-88c3-b249888b6593 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:52.003408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1779c586-c18f-4e35-88c3-b249888b6593 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:52.007095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1779c586-c18f-4e35-88c3-b249888b6593 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:52.007926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1779c586-c18f-4e35-88c3-b249888b6593 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:52.008411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1779c586-c18f-4e35-88c3-b249888b6593 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:52.008848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1779c586-c18f-4e35-88c3-b249888b6593 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:52.071769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fc6ca120-c0e3-4ff3-a5a1-ee8920de4cff tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:52.082163 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fc6ca120-c0e3-4ff3-a5a1-ee8920de4cff tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce" status: 200 len: 1504 microversion: 2.1 time: 0.275142 Aug 23 17:55:52.083363 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 639/1351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:51 2022] GET /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce => generated 1504 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:52.088273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3158e61b-f900-418a-b59d-21ca767d523a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:52.089103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3158e61b-f900-418a-b59d-21ca767d523a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:52.163414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1779c586-c18f-4e35-88c3-b249888b6593 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:52.177523 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1779c586-c18f-4e35-88c3-b249888b6593 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1378 microversion: 2.1 time: 0.203597 Aug 23 17:55:52.178100 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 713/1352] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:51 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1378 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:52.189914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-42e4fa37-962c-4b82-a4bd-22968817e17b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:52.190750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-42e4fa37-962c-4b82-a4bd-22968817e17b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a3d726c6-9bae-4276-b8e2-5eafe4270dce] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:52.198647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42e4fa37-962c-4b82-a4bd-22968817e17b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:52.199150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42e4fa37-962c-4b82-a4bd-22968817e17b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:52.199590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42e4fa37-962c-4b82-a4bd-22968817e17b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:52.201053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42e4fa37-962c-4b82-a4bd-22968817e17b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:52.201569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42e4fa37-962c-4b82-a4bd-22968817e17b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:52.202001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42e4fa37-962c-4b82-a4bd-22968817e17b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:52.241558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-42e4fa37-962c-4b82-a4bd-22968817e17b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a3d726c6-9bae-4276-b8e2-5eafe4270dce] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:55:52.243414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3158e61b-f900-418a-b59d-21ca767d523a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:52.266203 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3158e61b-f900-418a-b59d-21ca767d523a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1225 microversion: 2.1 time: 0.180653 Aug 23 17:55:52.267545 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 640/1353] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:52 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1225 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:52.360212 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-42e4fa37-962c-4b82-a4bd-22968817e17b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce" status: 204 len: 0 microversion: 2.1 time: 0.179899 Aug 23 17:55:52.361040 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 714/1354] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:55:52 2022] DELETE /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:55:52.370922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ecaa2d26-807d-40ef-a373-0fb654ec700a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:52.371640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ecaa2d26-807d-40ef-a373-0fb654ec700a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:52.379920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecaa2d26-807d-40ef-a373-0fb654ec700a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:52.380439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecaa2d26-807d-40ef-a373-0fb654ec700a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:52.381051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecaa2d26-807d-40ef-a373-0fb654ec700a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:52.382011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecaa2d26-807d-40ef-a373-0fb654ec700a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:52.382786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecaa2d26-807d-40ef-a373-0fb654ec700a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:52.383437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecaa2d26-807d-40ef-a373-0fb654ec700a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:52.461695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ecaa2d26-807d-40ef-a373-0fb654ec700a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:55:52.484127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-da71773f-7939-479f-a0de-df919ca04204 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:52.485341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-da71773f-7939-479f-a0de-df919ca04204 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:52.500437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da71773f-7939-479f-a0de-df919ca04204 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:52.502093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da71773f-7939-479f-a0de-df919ca04204 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:52.503072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da71773f-7939-479f-a0de-df919ca04204 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:52.504954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da71773f-7939-479f-a0de-df919ca04204 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:52.505673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da71773f-7939-479f-a0de-df919ca04204 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:52.512232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da71773f-7939-479f-a0de-df919ca04204 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:52.658308 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ecaa2d26-807d-40ef-a373-0fb654ec700a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "DELETE /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 204 len: 0 microversion: 2.1 time: 0.289968 Aug 23 17:55:52.661369 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 641/1355] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:55:52 2022] DELETE /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 17:55:52.677138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-45960918-4bc6-44ce-98b1-af3e42d81736 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:52.677863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-45960918-4bc6-44ce-98b1-af3e42d81736 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a3d726c6-9bae-4276-b8e2-5eafe4270dce] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:52.704745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45960918-4bc6-44ce-98b1-af3e42d81736 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:52.707135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45960918-4bc6-44ce-98b1-af3e42d81736 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:52.708013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45960918-4bc6-44ce-98b1-af3e42d81736 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:52.709111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45960918-4bc6-44ce-98b1-af3e42d81736 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:52.710983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45960918-4bc6-44ce-98b1-af3e42d81736 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:52.711972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45960918-4bc6-44ce-98b1-af3e42d81736 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:52.777769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-da71773f-7939-479f-a0de-df919ca04204 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:52.787613 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-da71773f-7939-479f-a0de-df919ca04204 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.309520 Aug 23 17:55:52.788403 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 715/1356] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:52 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:52.930981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:53.060740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45960918-4bc6-44ce-98b1-af3e42d81736 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:53.069237 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-45960918-4bc6-44ce-98b1-af3e42d81736 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce" status: 200 len: 1510 microversion: 2.1 time: 0.396718 Aug 23 17:55:53.070083 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 642/1357] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:52 2022] GET /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce => generated 1510 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:53.218296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93c25ece-83b0-43a2-9409-964ed9310309 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:53.219084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-93c25ece-83b0-43a2-9409-964ed9310309 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:53.225288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93c25ece-83b0-43a2-9409-964ed9310309 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:53.225847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93c25ece-83b0-43a2-9409-964ed9310309 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:53.226355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93c25ece-83b0-43a2-9409-964ed9310309 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:53.227179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93c25ece-83b0-43a2-9409-964ed9310309 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:53.227707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93c25ece-83b0-43a2-9409-964ed9310309 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:53.228208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93c25ece-83b0-43a2-9409-964ed9310309 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:53.304545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dcfd856a-300f-4912-a8aa-aeb793fe8e08 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:53.305917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dcfd856a-300f-4912-a8aa-aeb793fe8e08 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:53.314631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcfd856a-300f-4912-a8aa-aeb793fe8e08 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:53.315212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcfd856a-300f-4912-a8aa-aeb793fe8e08 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:53.316185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcfd856a-300f-4912-a8aa-aeb793fe8e08 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:53.316903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcfd856a-300f-4912-a8aa-aeb793fe8e08 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:53.317354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcfd856a-300f-4912-a8aa-aeb793fe8e08 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:53.317952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcfd856a-300f-4912-a8aa-aeb793fe8e08 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:53.377416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-93c25ece-83b0-43a2-9409-964ed9310309 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:53.385170 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93c25ece-83b0-43a2-9409-964ed9310309 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1378 microversion: 2.1 time: 0.171810 Aug 23 17:55:53.385736 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 716/1358] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:53 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1378 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:53.429263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dcfd856a-300f-4912-a8aa-aeb793fe8e08 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:53.438488 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dcfd856a-300f-4912-a8aa-aeb793fe8e08 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1229 microversion: 2.1 time: 0.138200 Aug 23 17:55:53.439280 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 643/1359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:53 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1229 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:53.808690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7884302d-0ffe-423e-954f-9f907ba679f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:53.809307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7884302d-0ffe-423e-954f-9f907ba679f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:53.816873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7884302d-0ffe-423e-954f-9f907ba679f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:53.817361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7884302d-0ffe-423e-954f-9f907ba679f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:53.817800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7884302d-0ffe-423e-954f-9f907ba679f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:53.818503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7884302d-0ffe-423e-954f-9f907ba679f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:53.818997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7884302d-0ffe-423e-954f-9f907ba679f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:53.819427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7884302d-0ffe-423e-954f-9f907ba679f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:53.960229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7884302d-0ffe-423e-954f-9f907ba679f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:53.969119 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7884302d-0ffe-423e-954f-9f907ba679f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.164396 Aug 23 17:55:53.969696 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 717/1360] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:53 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:54.092733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-91998d0f-6b0a-4d80-8d9b-0326f1e2e181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:54.093691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-91998d0f-6b0a-4d80-8d9b-0326f1e2e181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a3d726c6-9bae-4276-b8e2-5eafe4270dce] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:54.101872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91998d0f-6b0a-4d80-8d9b-0326f1e2e181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:54.102442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91998d0f-6b0a-4d80-8d9b-0326f1e2e181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:54.102941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91998d0f-6b0a-4d80-8d9b-0326f1e2e181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:54.103841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91998d0f-6b0a-4d80-8d9b-0326f1e2e181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:54.104290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91998d0f-6b0a-4d80-8d9b-0326f1e2e181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:54.104913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91998d0f-6b0a-4d80-8d9b-0326f1e2e181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:54.361857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-91998d0f-6b0a-4d80-8d9b-0326f1e2e181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:54.373363 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-91998d0f-6b0a-4d80-8d9b-0326f1e2e181 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce" status: 200 len: 1510 microversion: 2.1 time: 0.286738 Aug 23 17:55:54.374049 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 644/1361] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:54 2022] GET /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce => generated 1510 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:54.408292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-71171dee-83a9-4658-b3d6-26dd2cf842f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:54.409553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-71171dee-83a9-4658-b3d6-26dd2cf842f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:54.417798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-71171dee-83a9-4658-b3d6-26dd2cf842f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:54.424090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-71171dee-83a9-4658-b3d6-26dd2cf842f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:54.424789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-71171dee-83a9-4658-b3d6-26dd2cf842f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:54.425716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-71171dee-83a9-4658-b3d6-26dd2cf842f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:54.426381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-71171dee-83a9-4658-b3d6-26dd2cf842f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:54.427019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-71171dee-83a9-4658-b3d6-26dd2cf842f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:54.459758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e653b8fb-06a9-4ff8-9afd-25d7903c0657 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:54.460314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e653b8fb-06a9-4ff8-9afd-25d7903c0657 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:54.468513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e653b8fb-06a9-4ff8-9afd-25d7903c0657 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:54.469350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e653b8fb-06a9-4ff8-9afd-25d7903c0657 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:54.470295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e653b8fb-06a9-4ff8-9afd-25d7903c0657 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:54.471245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e653b8fb-06a9-4ff8-9afd-25d7903c0657 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:54.472864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e653b8fb-06a9-4ff8-9afd-25d7903c0657 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:54.473513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e653b8fb-06a9-4ff8-9afd-25d7903c0657 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:54.618097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e653b8fb-06a9-4ff8-9afd-25d7903c0657 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:54.635013 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e653b8fb-06a9-4ff8-9afd-25d7903c0657 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1221 microversion: 2.1 time: 0.174663 Aug 23 17:55:54.636130 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 645/1362] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:54 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1221 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:54.989546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac35aab6-1629-4acb-a95e-49ba8c208121 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:54.990257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac35aab6-1629-4acb-a95e-49ba8c208121 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:55.006639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac35aab6-1629-4acb-a95e-49ba8c208121 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:55.007414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac35aab6-1629-4acb-a95e-49ba8c208121 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:55.008042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac35aab6-1629-4acb-a95e-49ba8c208121 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:55.008930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac35aab6-1629-4acb-a95e-49ba8c208121 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:55.009547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac35aab6-1629-4acb-a95e-49ba8c208121 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:55.010132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac35aab6-1629-4acb-a95e-49ba8c208121 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:55.084644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-71171dee-83a9-4658-b3d6-26dd2cf842f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:55.098695 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-71171dee-83a9-4658-b3d6-26dd2cf842f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1378 microversion: 2.1 time: 0.695415 Aug 23 17:55:55.099290 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 718/1363] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:54 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1378 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:55.373623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac35aab6-1629-4acb-a95e-49ba8c208121 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:55.374818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-6e1707c3-f83c-4f8b-acb4-5066e5395d24 req-690023f1-dc2b-4713-ad73-f550c4e57ed2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d726c6-9bae-4276-b8e2-5eafe4270dce", "name": "network-vif-deleted", "tag": "1785d3da-8025-402c-a9ab-f4a42d7ab796"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:55.385585 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac35aab6-1629-4acb-a95e-49ba8c208121 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.399400 Aug 23 17:55:55.396144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6e1707c3-f83c-4f8b-acb4-5066e5395d24 req-690023f1-dc2b-4713-ad73-f550c4e57ed2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:55.396634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6e1707c3-f83c-4f8b-acb4-5066e5395d24 req-690023f1-dc2b-4713-ad73-f550c4e57ed2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:55.397070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6e1707c3-f83c-4f8b-acb4-5066e5395d24 req-690023f1-dc2b-4713-ad73-f550c4e57ed2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:55.406446 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 646/1364] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:54 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:55.411812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e4bc95ca-4246-421d-8c38-b7152806f501 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:55.412020 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-6e1707c3-f83c-4f8b-acb4-5066e5395d24 req-690023f1-dc2b-4713-ad73-f550c4e57ed2 service nova] Creating event network-vif-deleted:1785d3da-8025-402c-a9ab-f4a42d7ab796 for instance a3d726c6-9bae-4276-b8e2-5eafe4270dce on n-h1-850468-16 Aug 23 17:55:55.413895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e4bc95ca-4246-421d-8c38-b7152806f501 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a3d726c6-9bae-4276-b8e2-5eafe4270dce] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:55.428165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4bc95ca-4246-421d-8c38-b7152806f501 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:55.429263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4bc95ca-4246-421d-8c38-b7152806f501 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:55.429912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4bc95ca-4246-421d-8c38-b7152806f501 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:55.431091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4bc95ca-4246-421d-8c38-b7152806f501 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:55.434583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4bc95ca-4246-421d-8c38-b7152806f501 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:55.437686 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-6e1707c3-f83c-4f8b-acb4-5066e5395d24 req-690023f1-dc2b-4713-ad73-f550c4e57ed2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066956 Aug 23 17:55:55.438597 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 719/1365] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:55:55.444385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4bc95ca-4246-421d-8c38-b7152806f501 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:55.658617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-754d3fed-6e54-482d-acfb-5c5edfd3ae2e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:55.659334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-754d3fed-6e54-482d-acfb-5c5edfd3ae2e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:55.666015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-754d3fed-6e54-482d-acfb-5c5edfd3ae2e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:55.666513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-754d3fed-6e54-482d-acfb-5c5edfd3ae2e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:55.666986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-754d3fed-6e54-482d-acfb-5c5edfd3ae2e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:55.667697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-754d3fed-6e54-482d-acfb-5c5edfd3ae2e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:55.668155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-754d3fed-6e54-482d-acfb-5c5edfd3ae2e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:55.668584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-754d3fed-6e54-482d-acfb-5c5edfd3ae2e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:55.732424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e4bc95ca-4246-421d-8c38-b7152806f501 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:55.743099 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e4bc95ca-4246-421d-8c38-b7152806f501 tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce" status: 200 len: 1468 microversion: 2.1 time: 0.334819 Aug 23 17:55:55.743540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-754d3fed-6e54-482d-acfb-5c5edfd3ae2e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:55.744819 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 647/1366] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:55 2022] GET /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce => generated 1468 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:55.754253 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-754d3fed-6e54-482d-acfb-5c5edfd3ae2e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1285 microversion: 2.1 time: 0.100201 Aug 23 17:55:55.755852 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 720/1367] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:55 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:56.123182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-de2868a0-fd23-4f8d-bd31-e41e03ce0abe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:56.123903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-de2868a0-fd23-4f8d-bd31-e41e03ce0abe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:56.130240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de2868a0-fd23-4f8d-bd31-e41e03ce0abe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:56.130760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de2868a0-fd23-4f8d-bd31-e41e03ce0abe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:56.131195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de2868a0-fd23-4f8d-bd31-e41e03ce0abe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:56.131961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de2868a0-fd23-4f8d-bd31-e41e03ce0abe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:56.132411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de2868a0-fd23-4f8d-bd31-e41e03ce0abe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:56.132831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de2868a0-fd23-4f8d-bd31-e41e03ce0abe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:56.407345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2fa74c24-3426-476d-bf74-842481520726 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:56.407996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2fa74c24-3426-476d-bf74-842481520726 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:56.414882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fa74c24-3426-476d-bf74-842481520726 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:56.415463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fa74c24-3426-476d-bf74-842481520726 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:56.415863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fa74c24-3426-476d-bf74-842481520726 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:56.416579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fa74c24-3426-476d-bf74-842481520726 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:56.417041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fa74c24-3426-476d-bf74-842481520726 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:56.417475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fa74c24-3426-476d-bf74-842481520726 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:56.622412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2fa74c24-3426-476d-bf74-842481520726 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:56.636510 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2fa74c24-3426-476d-bf74-842481520726 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.232448 Aug 23 17:55:56.638971 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 721/1368] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:56 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:56.716867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-de2868a0-fd23-4f8d-bd31-e41e03ce0abe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:56.730866 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-de2868a0-fd23-4f8d-bd31-e41e03ce0abe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1378 microversion: 2.1 time: 0.611008 Aug 23 17:55:56.733101 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 648/1369] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:56 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1378 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:56.769200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-feabf428-0bc6-462a-bd23-319ffd702c4b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:56.770008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-feabf428-0bc6-462a-bd23-319ffd702c4b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: a3d726c6-9bae-4276-b8e2-5eafe4270dce] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:56.782775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-feabf428-0bc6-462a-bd23-319ffd702c4b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:56.783580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-feabf428-0bc6-462a-bd23-319ffd702c4b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:56.784891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-feabf428-0bc6-462a-bd23-319ffd702c4b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:56.785856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-feabf428-0bc6-462a-bd23-319ffd702c4b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:56.786621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-feabf428-0bc6-462a-bd23-319ffd702c4b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:56.787333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-feabf428-0bc6-462a-bd23-319ffd702c4b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:56.790367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-39b5d970-9f88-4b0f-b339-ed9521130424 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:56.791030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-39b5d970-9f88-4b0f-b339-ed9521130424 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:56.810718 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-feabf428-0bc6-462a-bd23-319ffd702c4b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] HTTP exception thrown: Instance a3d726c6-9bae-4276-b8e2-5eafe4270dce could not be found. Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-feabf428-0bc6-462a-bd23-319ffd702c4b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Request method failure captured: Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce HTTP/1.1 Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRRumRc5mF1Hnz_oDUaxznWWGS-0yNSR1VDS6X5wIj0-TKehTjwFr1Xb6ivaA-dVed_vv8G6JtqkuLmR8l3t3yLs5Hj6WJ5ZYZIBl__JU2ULiZ920vZmINLkAZVvlkFPEkz4xPMYHIRK-dS94tdhSV7-8zprbQo7dQrrLyPstAlvOWI Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 97827eb64dfd4e6e8adb0cb27df60f0a Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-MultipleCreateTestJSON-1227721587 Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_97827eb64dfd4e6e8adb0cb27df60f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/97827eb64dfd4e6e8adb0cb27df60f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/97827eb64dfd4e6e8adb0cb27df60f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/97827eb64dfd4e6e8adb0cb27df60f0a"}]}] Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-MultipleCreateTestJSON-1227721587 Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 97827eb64dfd4e6e8adb0cb27df60f0a Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1227721587 Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-MultipleCreateTestJSON-1227721587-project Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 9d51f46cd65a4722afb17a02357ef8bb Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-MultipleCreateTestJSON-1227721587-project Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance a3d726c6-9bae-4276-b8e2-5eafe4270dce could not be found. Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'a3d726c6-9bae-4276-b8e2-5eafe4270dce'} Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d726c6-9bae-4276-b8e2-5eafe4270dce could not be found. Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d726c6-9bae-4276-b8e2-5eafe4270dce could not be found. Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:56.813166 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:56.818634 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:56.818634 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:56.818634 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:56.818634 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:55:56.818634 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:55:56.818634 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d726c6-9bae-4276-b8e2-5eafe4270dce could not be found. Aug 23 17:55:56.818634 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:56.818634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-feabf428-0bc6-462a-bd23-319ffd702c4b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Returning 404 to user: Instance a3d726c6-9bae-4276-b8e2-5eafe4270dce could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:56.818634 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-feabf428-0bc6-462a-bd23-319ffd702c4b tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce" status: 404 len: 111 microversion: 2.1 time: 0.054703 Aug 23 17:55:56.820633 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 722/1370] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:56 2022] GET /compute/v2.1/servers/a3d726c6-9bae-4276-b8e2-5eafe4270dce => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:55:56.823719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39b5d970-9f88-4b0f-b339-ed9521130424 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:56.824339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39b5d970-9f88-4b0f-b339-ed9521130424 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:56.824657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39b5d970-9f88-4b0f-b339-ed9521130424 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:56.830068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39b5d970-9f88-4b0f-b339-ed9521130424 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:56.831169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39b5d970-9f88-4b0f-b339-ed9521130424 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:56.831549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39b5d970-9f88-4b0f-b339-ed9521130424 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:56.835380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3bf3936e-173b-43d6-92f7-e6d1b311dbdb tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:56.836037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3bf3936e-173b-43d6-92f7-e6d1b311dbdb tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:56.856839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bf3936e-173b-43d6-92f7-e6d1b311dbdb tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:56.857500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bf3936e-173b-43d6-92f7-e6d1b311dbdb tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:56.858015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bf3936e-173b-43d6-92f7-e6d1b311dbdb tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:56.861228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bf3936e-173b-43d6-92f7-e6d1b311dbdb tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:56.862461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bf3936e-173b-43d6-92f7-e6d1b311dbdb tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:56.863125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bf3936e-173b-43d6-92f7-e6d1b311dbdb tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:56.991008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3bf3936e-173b-43d6-92f7-e6d1b311dbdb tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:57.002187 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3bf3936e-173b-43d6-92f7-e6d1b311dbdb tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1469 microversion: 2.1 time: 0.178714 Aug 23 17:55:57.019303 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 723/1371] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:56 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1469 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:57.027178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-be63590e-dc6a-4bfe-a329-eafe3e1d949e req-de66cc28-bd8f-4db1-b41d-84e3d2535ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c329be5-120a-4bfd-ba7d-12c0ed0c4814", "name": "network-vif-plugged", "status": "completed", "tag": "777bb24b-a6b8-45cd-9bb8-2263c15bf327"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:57.042302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-be63590e-dc6a-4bfe-a329-eafe3e1d949e req-de66cc28-bd8f-4db1-b41d-84e3d2535ead service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:57.043024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-be63590e-dc6a-4bfe-a329-eafe3e1d949e req-de66cc28-bd8f-4db1-b41d-84e3d2535ead service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:57.043625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-be63590e-dc6a-4bfe-a329-eafe3e1d949e req-de66cc28-bd8f-4db1-b41d-84e3d2535ead service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:57.050593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-39b5d970-9f88-4b0f-b339-ed9521130424 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:57.068150 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-39b5d970-9f88-4b0f-b339-ed9521130424 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1283 microversion: 2.1 time: 0.286209 Aug 23 17:55:57.068799 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 649/1372] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:56 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1283 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:57.079441 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-be63590e-dc6a-4bfe-a329-eafe3e1d949e req-de66cc28-bd8f-4db1-b41d-84e3d2535ead service nova] Creating event network-vif-plugged:777bb24b-a6b8-45cd-9bb8-2263c15bf327 for instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 on n-h1-850468-16 Aug 23 17:55:57.085584 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-be63590e-dc6a-4bfe-a329-eafe3e1d949e req-de66cc28-bd8f-4db1-b41d-84e3d2535ead service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064866 Aug 23 17:55:57.086923 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 724/1373] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:57.169535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6912ff3e-9a5f-438b-866f-a35d8be247d3 req-36ad7652-42ff-4dfc-81f3-864a3ae95f6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "102daea4-8648-4efc-8b9a-cd590f4b7084", "name": "network-vif-deleted", "tag": "ca07d8bc-63b0-4443-bd7b-855d80bfede8"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:57.208946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6912ff3e-9a5f-438b-866f-a35d8be247d3 req-36ad7652-42ff-4dfc-81f3-864a3ae95f6c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:57.210961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6912ff3e-9a5f-438b-866f-a35d8be247d3 req-36ad7652-42ff-4dfc-81f3-864a3ae95f6c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:57.211595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6912ff3e-9a5f-438b-866f-a35d8be247d3 req-36ad7652-42ff-4dfc-81f3-864a3ae95f6c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:57.246509 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6912ff3e-9a5f-438b-866f-a35d8be247d3 req-36ad7652-42ff-4dfc-81f3-864a3ae95f6c service nova] Creating event network-vif-deleted:ca07d8bc-63b0-4443-bd7b-855d80bfede8 for instance 102daea4-8648-4efc-8b9a-cd590f4b7084 on n-h2-850468-16 Aug 23 17:55:57.260159 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6912ff3e-9a5f-438b-866f-a35d8be247d3 req-36ad7652-42ff-4dfc-81f3-864a3ae95f6c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096465 Aug 23 17:55:57.264331 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 650/1374] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:55:57.660490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6004be80-1070-43e7-8a58-66c8bd294dee tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:57.661198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6004be80-1070-43e7-8a58-66c8bd294dee tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:57.668507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6004be80-1070-43e7-8a58-66c8bd294dee tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:57.669832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6004be80-1070-43e7-8a58-66c8bd294dee tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:57.670293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6004be80-1070-43e7-8a58-66c8bd294dee tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:57.671236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6004be80-1070-43e7-8a58-66c8bd294dee tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:57.671700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6004be80-1070-43e7-8a58-66c8bd294dee tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:57.672182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6004be80-1070-43e7-8a58-66c8bd294dee tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:57.677877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:57.754327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cb257f78-81da-4173-a204-70e4d18e7c22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:57.759920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cb257f78-81da-4173-a204-70e4d18e7c22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:57.763721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:57.773114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb257f78-81da-4173-a204-70e4d18e7c22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:57.773957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb257f78-81da-4173-a204-70e4d18e7c22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:57.774708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb257f78-81da-4173-a204-70e4d18e7c22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:57.775876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb257f78-81da-4173-a204-70e4d18e7c22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:57.776550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb257f78-81da-4173-a204-70e4d18e7c22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:57.777552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb257f78-81da-4173-a204-70e4d18e7c22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:57.851457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6004be80-1070-43e7-8a58-66c8bd294dee tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:57.861907 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6004be80-1070-43e7-8a58-66c8bd294dee tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.205620 Aug 23 17:55:57.862498 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 725/1375] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:57 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:58.025389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:58.026004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:58.038794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:58.039630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:58.040469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:58.041200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:58.041687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:58.042871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:58.080486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:58.081229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:58.082232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:58.082889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lazy-loading 'fault' on Instance uuid 102daea4-8648-4efc-8b9a-cd590f4b7084 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:55:58.127746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cb257f78-81da-4173-a204-70e4d18e7c22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:58.130942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d51f46cd65a4722afb17a02357ef8bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97827eb64dfd4e6e8adb0cb27df60f0a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:58.135938 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cb257f78-81da-4173-a204-70e4d18e7c22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1378 microversion: 2.1 time: 0.386130 Aug 23 17:55:58.136831 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 651/1376] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:57 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1378 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:58.142531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0248e7a8-b035-42dc-9ebe-6d0454ec56c6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:58.143168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0248e7a8-b035-42dc-9ebe-6d0454ec56c6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:58.149140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0248e7a8-b035-42dc-9ebe-6d0454ec56c6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:58.149398 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d1277b6-f9b0-4f71-b07c-94b797c2737a tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 200 len: 1307 microversion: 2.1 time: 0.127789 Aug 23 17:55:58.150002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0248e7a8-b035-42dc-9ebe-6d0454ec56c6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:58.150431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0248e7a8-b035-42dc-9ebe-6d0454ec56c6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:58.150584 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 726/1377] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:58 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 1307 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:55:58.151440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0248e7a8-b035-42dc-9ebe-6d0454ec56c6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:58.153056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0248e7a8-b035-42dc-9ebe-6d0454ec56c6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:58.153570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0248e7a8-b035-42dc-9ebe-6d0454ec56c6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:58.156398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:55:58.459339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0248e7a8-b035-42dc-9ebe-6d0454ec56c6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:58.469441 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0248e7a8-b035-42dc-9ebe-6d0454ec56c6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1325 microversion: 2.1 time: 0.331321 Aug 23 17:55:58.470323 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 652/1378] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:58 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1325 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:58.882642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-55a76798-3799-42a3-8a5a-e4f02eae89b1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:58.883815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-55a76798-3799-42a3-8a5a-e4f02eae89b1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:58.917240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55a76798-3799-42a3-8a5a-e4f02eae89b1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:58.917757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55a76798-3799-42a3-8a5a-e4f02eae89b1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:58.920562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55a76798-3799-42a3-8a5a-e4f02eae89b1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:58.921969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55a76798-3799-42a3-8a5a-e4f02eae89b1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:58.922708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55a76798-3799-42a3-8a5a-e4f02eae89b1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:58.923411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55a76798-3799-42a3-8a5a-e4f02eae89b1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:59.133838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-55a76798-3799-42a3-8a5a-e4f02eae89b1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:59.143947 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-55a76798-3799-42a3-8a5a-e4f02eae89b1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.264899 Aug 23 17:55:59.152883 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 727/1379] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:58 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:59.169566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c0c7dee5-8782-4a41-aa24-b13eaac93f91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:59.170636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c0c7dee5-8782-4a41-aa24-b13eaac93f91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:59.181984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5acf95f9-9366-4b70-abc6-ee03e8abee3c tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:59.184165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0c7dee5-8782-4a41-aa24-b13eaac93f91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:59.184977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0c7dee5-8782-4a41-aa24-b13eaac93f91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:59.195434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5acf95f9-9366-4b70-abc6-ee03e8abee3c tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] [instance: 102daea4-8648-4efc-8b9a-cd590f4b7084] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:59.196233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0c7dee5-8782-4a41-aa24-b13eaac93f91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:59.199176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0c7dee5-8782-4a41-aa24-b13eaac93f91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:59.199756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0c7dee5-8782-4a41-aa24-b13eaac93f91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:59.200747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0c7dee5-8782-4a41-aa24-b13eaac93f91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:59.213456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5acf95f9-9366-4b70-abc6-ee03e8abee3c tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:59.214050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5acf95f9-9366-4b70-abc6-ee03e8abee3c tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:59.214775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5acf95f9-9366-4b70-abc6-ee03e8abee3c tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:59.216494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5acf95f9-9366-4b70-abc6-ee03e8abee3c tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:59.217070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5acf95f9-9366-4b70-abc6-ee03e8abee3c tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:59.217766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5acf95f9-9366-4b70-abc6-ee03e8abee3c tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:59.246739 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-5acf95f9-9366-4b70-abc6-ee03e8abee3c tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] HTTP exception thrown: Instance 102daea4-8648-4efc-8b9a-cd590f4b7084 could not be found. Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5acf95f9-9366-4b70-abc6-ee03e8abee3c tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Request method failure captured: Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 HTTP/1.1 Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRRumRc5mF1Hnz_oDUaxznWWGS-0yNSR1VDS6X5wIj0-TKehTjwFr1Xb6ivaA-dVed_vv8G6JtqkuLmR8l3t3yLs5Hj6WJ5ZYZIBl__JU2ULiZ920vZmINLkAZVvlkFPEkz4xPMYHIRK-dS94tdhSV7-8zprbQo7dQrrLyPstAlvOWI Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 97827eb64dfd4e6e8adb0cb27df60f0a Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-MultipleCreateTestJSON-1227721587 Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_97827eb64dfd4e6e8adb0cb27df60f0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/97827eb64dfd4e6e8adb0cb27df60f0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/97827eb64dfd4e6e8adb0cb27df60f0a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/97827eb64dfd4e6e8adb0cb27df60f0a"}]}] Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-MultipleCreateTestJSON-1227721587 Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 97827eb64dfd4e6e8adb0cb27df60f0a Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-MultipleCreateTestJSON-1227721587 Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-MultipleCreateTestJSON-1227721587-project Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 9d51f46cd65a4722afb17a02357ef8bb Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-MultipleCreateTestJSON-1227721587-project Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 102daea4-8648-4efc-8b9a-cd590f4b7084 could not be found. Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '102daea4-8648-4efc-8b9a-cd590f4b7084'} Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 102daea4-8648-4efc-8b9a-cd590f4b7084 could not be found. Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 102daea4-8648-4efc-8b9a-cd590f4b7084 could not be found. Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:55:59.250956 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:59.256446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:55:59.256446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:55:59.256446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:55:59.256446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:55:59.256446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:55:59.256446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 102daea4-8648-4efc-8b9a-cd590f4b7084 could not be found. Aug 23 17:55:59.256446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:55:59.263224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5acf95f9-9366-4b70-abc6-ee03e8abee3c tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] Returning 404 to user: Instance 102daea4-8648-4efc-8b9a-cd590f4b7084 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:55:59.264609 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5acf95f9-9366-4b70-abc6-ee03e8abee3c tempest-MultipleCreateTestJSON-1227721587 tempest-MultipleCreateTestJSON-1227721587-project] 10.222.0.61 "GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084" status: 404 len: 111 microversion: 2.1 time: 0.090127 Aug 23 17:55:59.265385 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 728/1380] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:59 2022] GET /compute/v2.1/servers/102daea4-8648-4efc-8b9a-cd590f4b7084 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:55:59.297506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-0e224239-1c08-4a1d-a32d-aeabeaa4b813 req-981fc2b4-0457-4fb6-801d-e083859c29e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dff523f-5032-42ec-abcb-2266d1aee875", "tag": "d44e5ac7-af43-486c-8d73-1db70e5d0340"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:55:59.308162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0e224239-1c08-4a1d-a32d-aeabeaa4b813 req-981fc2b4-0457-4fb6-801d-e083859c29e4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:59.308720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0e224239-1c08-4a1d-a32d-aeabeaa4b813 req-981fc2b4-0457-4fb6-801d-e083859c29e4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:59.309239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0e224239-1c08-4a1d-a32d-aeabeaa4b813 req-981fc2b4-0457-4fb6-801d-e083859c29e4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:59.322422 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-0e224239-1c08-4a1d-a32d-aeabeaa4b813 req-981fc2b4-0457-4fb6-801d-e083859c29e4 service nova] Creating event network-changed:d44e5ac7-af43-486c-8d73-1db70e5d0340 for instance 9dff523f-5032-42ec-abcb-2266d1aee875 on n-h2-850468-16 Aug 23 17:55:59.329083 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-0e224239-1c08-4a1d-a32d-aeabeaa4b813 req-981fc2b4-0457-4fb6-801d-e083859c29e4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035752 Aug 23 17:55:59.330279 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 729/1381] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:55:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:55:59.492362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2c7a3de1-7cb6-41d3-86d0-cfb1e30f00c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:59.493225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2c7a3de1-7cb6-41d3-86d0-cfb1e30f00c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:59.502451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c7a3de1-7cb6-41d3-86d0-cfb1e30f00c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:59.502451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c7a3de1-7cb6-41d3-86d0-cfb1e30f00c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:59.502451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c7a3de1-7cb6-41d3-86d0-cfb1e30f00c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:59.503679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c7a3de1-7cb6-41d3-86d0-cfb1e30f00c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:59.504336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c7a3de1-7cb6-41d3-86d0-cfb1e30f00c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:59.505438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c7a3de1-7cb6-41d3-86d0-cfb1e30f00c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:59.777344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2c7a3de1-7cb6-41d3-86d0-cfb1e30f00c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:59.786717 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2c7a3de1-7cb6-41d3-86d0-cfb1e30f00c4 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1325 microversion: 2.1 time: 0.299415 Aug 23 17:55:59.796613 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 730/1382] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:59 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1325 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:59.843198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c0c7dee5-8782-4a41-aa24-b13eaac93f91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:55:59.859377 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c0c7dee5-8782-4a41-aa24-b13eaac93f91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1528 microversion: 2.1 time: 0.696515 Aug 23 17:55:59.863573 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 653/1383] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:59 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1528 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:55:59.881908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b64d4994-f67b-4ae9-bc5e-7263c3360aa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:55:59.882776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b64d4994-f67b-4ae9-bc5e-7263c3360aa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:55:59.890002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b64d4994-f67b-4ae9-bc5e-7263c3360aa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:59.890839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b64d4994-f67b-4ae9-bc5e-7263c3360aa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:59.891442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b64d4994-f67b-4ae9-bc5e-7263c3360aa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:55:59.892156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b64d4994-f67b-4ae9-bc5e-7263c3360aa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:55:59.893401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b64d4994-f67b-4ae9-bc5e-7263c3360aa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:55:59.894090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b64d4994-f67b-4ae9-bc5e-7263c3360aa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:00.170843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6bf32371-0018-47a1-865c-ff53f5338f2c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:00.172728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6bf32371-0018-47a1-865c-ff53f5338f2c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:00.182971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6bf32371-0018-47a1-865c-ff53f5338f2c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:00.183590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6bf32371-0018-47a1-865c-ff53f5338f2c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:00.184093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6bf32371-0018-47a1-865c-ff53f5338f2c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:00.185882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6bf32371-0018-47a1-865c-ff53f5338f2c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:00.186576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6bf32371-0018-47a1-865c-ff53f5338f2c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:00.187203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6bf32371-0018-47a1-865c-ff53f5338f2c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:00.213422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b64d4994-f67b-4ae9-bc5e-7263c3360aa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:00.224432 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b64d4994-f67b-4ae9-bc5e-7263c3360aa8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1528 microversion: 2.1 time: 0.346285 Aug 23 17:56:00.225960 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 731/1384] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:55:59 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1528 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:00.257305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d7be96c-ab71-4f7c-9518-e2495b9f88d3 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:00.258384 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:00.258384 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:00.286783 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2d7be96c-ab71-4f7c-9518-e2495b9f88d3 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/5057de9f-3674-4924-b6f0-ea0a3f562291" status: 202 len: 0 microversion: 2.1 time: 0.043892 Aug 23 17:56:00.287764 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 732/1385] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:56:00 2022] DELETE /compute/v2.1/flavors/5057de9f-3674-4924-b6f0-ea0a3f562291 => generated 0 bytes in 46 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:56:00.297635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9a80db0-10ee-4a3c-99f4-30f5e933d42a tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:00.319806 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d9a80db0-10ee-4a3c-99f4-30f5e933d42a tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026242 Aug 23 17:56:00.320481 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 733/1386] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:56:00 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:00.343064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:00.345968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:00.352524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:00.353009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:00.353442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:00.354160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:00.354623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:00.355238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:00.366115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6bf32371-0018-47a1-865c-ff53f5338f2c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:00.376381 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6bf32371-0018-47a1-865c-ff53f5338f2c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.212417 Aug 23 17:56:00.378409 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 654/1387] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:00 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:00.386054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:00.393320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Old instance type tempest-test_resize_flavor_-1582437662, new instance type m1.heat {{(pid=128807) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 17:56:00.399822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:56:00.400243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:56:00.400742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:56:00.401149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:56:00.401558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:56:00.470972 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bb5f04a8-f000-456c-be69-d074e47d4120 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "POST /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814/action" status: 202 len: 0 microversion: 2.1 time: 0.133374 Aug 23 17:56:00.472291 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 734/1388] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:56:00 2022] POST /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:56:00.484673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-01f77aaa-d7ba-40cb-9e3a-f9301508cac5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:00.485827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-01f77aaa-d7ba-40cb-9e3a-f9301508cac5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:00.493893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01f77aaa-d7ba-40cb-9e3a-f9301508cac5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:00.494826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01f77aaa-d7ba-40cb-9e3a-f9301508cac5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:00.495607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01f77aaa-d7ba-40cb-9e3a-f9301508cac5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:00.496515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01f77aaa-d7ba-40cb-9e3a-f9301508cac5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:00.498175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01f77aaa-d7ba-40cb-9e3a-f9301508cac5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:00.499800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01f77aaa-d7ba-40cb-9e3a-f9301508cac5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:00.758698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-01f77aaa-d7ba-40cb-9e3a-f9301508cac5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:00.772212 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-01f77aaa-d7ba-40cb-9e3a-f9301508cac5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1537 microversion: 2.1 time: 0.292160 Aug 23 17:56:00.786698 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 655/1389] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:00 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1537 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:00.810910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ed17fe0-7a66-4559-8c0c-aeda6a51f345 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:00.811790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1ed17fe0-7a66-4559-8c0c-aeda6a51f345 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:00.826863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ed17fe0-7a66-4559-8c0c-aeda6a51f345 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:00.828468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ed17fe0-7a66-4559-8c0c-aeda6a51f345 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:00.829616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ed17fe0-7a66-4559-8c0c-aeda6a51f345 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:00.830385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ed17fe0-7a66-4559-8c0c-aeda6a51f345 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:00.831546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ed17fe0-7a66-4559-8c0c-aeda6a51f345 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:00.833954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ed17fe0-7a66-4559-8c0c-aeda6a51f345 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:01.232028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1ed17fe0-7a66-4559-8c0c-aeda6a51f345 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:01.242830 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1ed17fe0-7a66-4559-8c0c-aeda6a51f345 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1325 microversion: 2.1 time: 0.437880 Aug 23 17:56:01.244386 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 735/1390] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:00 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1325 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:01.399585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-67bbea93-0204-4544-aa6d-344ab865a6a0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:01.400603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-67bbea93-0204-4544-aa6d-344ab865a6a0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:01.418507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67bbea93-0204-4544-aa6d-344ab865a6a0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:01.422615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67bbea93-0204-4544-aa6d-344ab865a6a0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:01.424176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67bbea93-0204-4544-aa6d-344ab865a6a0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:01.425540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67bbea93-0204-4544-aa6d-344ab865a6a0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:01.426135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67bbea93-0204-4544-aa6d-344ab865a6a0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:01.426592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67bbea93-0204-4544-aa6d-344ab865a6a0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:01.653407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-67bbea93-0204-4544-aa6d-344ab865a6a0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:01.667021 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-67bbea93-0204-4544-aa6d-344ab865a6a0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.269820 Aug 23 17:56:01.668174 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 656/1391] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:01 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:01.807609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0bfbd4a5-6977-4b2a-a191-a3d40a06b749 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:01.813455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0bfbd4a5-6977-4b2a-a191-a3d40a06b749 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:01.833925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bfbd4a5-6977-4b2a-a191-a3d40a06b749 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:01.834610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bfbd4a5-6977-4b2a-a191-a3d40a06b749 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:01.834946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bfbd4a5-6977-4b2a-a191-a3d40a06b749 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:01.835732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bfbd4a5-6977-4b2a-a191-a3d40a06b749 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:01.836185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bfbd4a5-6977-4b2a-a191-a3d40a06b749 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:01.836609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bfbd4a5-6977-4b2a-a191-a3d40a06b749 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:01.875010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:01.901522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=10 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:02.203503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0bfbd4a5-6977-4b2a-a191-a3d40a06b749 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:02.213029 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0bfbd4a5-6977-4b2a-a191-a3d40a06b749 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1537 microversion: 2.1 time: 0.420733 Aug 23 17:56:02.233047 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 736/1392] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:01 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1537 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:02.263229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=14 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:02.269268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-007ff46f-55fe-408d-bb29-84950cbd7c3d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:02.270000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-007ff46f-55fe-408d-bb29-84950cbd7c3d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:02.281810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-007ff46f-55fe-408d-bb29-84950cbd7c3d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:02.282307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-007ff46f-55fe-408d-bb29-84950cbd7c3d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:02.282766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-007ff46f-55fe-408d-bb29-84950cbd7c3d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:02.283473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-007ff46f-55fe-408d-bb29-84950cbd7c3d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:02.288193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-007ff46f-55fe-408d-bb29-84950cbd7c3d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:02.288843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-007ff46f-55fe-408d-bb29-84950cbd7c3d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:02.692112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-57518206-325f-4ca3-9931-1fba834562a8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:02.693572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-57518206-325f-4ca3-9931-1fba834562a8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:02.708535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57518206-325f-4ca3-9931-1fba834562a8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:02.712177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57518206-325f-4ca3-9931-1fba834562a8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:02.713029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57518206-325f-4ca3-9931-1fba834562a8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:02.714229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57518206-325f-4ca3-9931-1fba834562a8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:02.719135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57518206-325f-4ca3-9931-1fba834562a8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:02.723126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57518206-325f-4ca3-9931-1fba834562a8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:03.071674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-007ff46f-55fe-408d-bb29-84950cbd7c3d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:03.086320 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-007ff46f-55fe-408d-bb29-84950cbd7c3d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1325 microversion: 2.1 time: 0.824545 Aug 23 17:56:03.086949 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 657/1393] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:02 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1325 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:03.242431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-08497995-026a-4fc0-abca-b30792f3d7d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:03.243705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-08497995-026a-4fc0-abca-b30792f3d7d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:03.258088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08497995-026a-4fc0-abca-b30792f3d7d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:03.258635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08497995-026a-4fc0-abca-b30792f3d7d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:03.260993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08497995-026a-4fc0-abca-b30792f3d7d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:03.261685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08497995-026a-4fc0-abca-b30792f3d7d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:03.265682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08497995-026a-4fc0-abca-b30792f3d7d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:03.265682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08497995-026a-4fc0-abca-b30792f3d7d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:03.357173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-57518206-325f-4ca3-9931-1fba834562a8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:03.366102 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-57518206-325f-4ca3-9931-1fba834562a8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.680159 Aug 23 17:56:03.366720 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 737/1394] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:02 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:03.609603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-08497995-026a-4fc0-abca-b30792f3d7d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:03.625381 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-08497995-026a-4fc0-abca-b30792f3d7d1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1537 microversion: 2.1 time: 0.393101 Aug 23 17:56:03.626602 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 658/1395] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:03 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1537 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:03.904373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3546454e-ed16-45d3-b837-1202c570e546 tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1332410075", "ram": 512, "vcpus": 1, "disk": 10, "id": 495273343, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:03.908093 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:03.908093 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:03.935870 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3546454e-ed16-45d3-b837-1202c570e546 tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.155559 Aug 23 17:56:03.936097 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 738/1396] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:56:03 2022] POST /compute/v2.1/flavors => generated 413 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:03.948041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fbcfb2ee-6a56-4808-9c63-7cb050728a6e tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:03.950823 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:03.950823 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:03.983556 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fbcfb2ee-6a56-4808-9c63-7cb050728a6e tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/495273343/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039122 Aug 23 17:56:03.984494 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 659/1397] 10.222.0.61 () {60 vars in 1221 bytes} [Tue Aug 23 17:56:03 2022] POST /compute/v2.1/flavors/495273343/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:56:04.108175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5cba5f10-c08b-47f5-b032-963131ef3bad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:04.108900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5cba5f10-c08b-47f5-b032-963131ef3bad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:04.115782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cba5f10-c08b-47f5-b032-963131ef3bad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:04.116823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cba5f10-c08b-47f5-b032-963131ef3bad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:04.116823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cba5f10-c08b-47f5-b032-963131ef3bad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:04.117372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cba5f10-c08b-47f5-b032-963131ef3bad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:04.117826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cba5f10-c08b-47f5-b032-963131ef3bad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:04.118248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cba5f10-c08b-47f5-b032-963131ef3bad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:04.159609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-37fd19aa-daf1-47a2-81ee-5fb8769b18fb tempest-FlavorsExtraSpecsTestJSON-1461788079 tempest-FlavorsExtraSpecsTestJSON-1461788079-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:04.191510 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-37fd19aa-daf1-47a2-81ee-5fb8769b18fb tempest-FlavorsExtraSpecsTestJSON-1461788079 tempest-FlavorsExtraSpecsTestJSON-1461788079-project] 10.222.0.61 "GET /compute/v2.1/flavors/495273343/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.199360 Aug 23 17:56:04.200598 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 739/1398] 10.222.0.61 () {58 vars in 1200 bytes} [Tue Aug 23 17:56:03 2022] GET /compute/v2.1/flavors/495273343/os-extra_specs => generated 66 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:56:04.209620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1a9d5db5-7267-4292-a511-f1d64006a969 tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:04.213032 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:04.213032 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:04.253446 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1a9d5db5-7267-4292-a511-f1d64006a969 tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/495273343/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.051383 Aug 23 17:56:04.254650 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 740/1399] 10.222.0.61 () {60 vars in 1221 bytes} [Tue Aug 23 17:56:04 2022] POST /compute/v2.1/flavors/495273343/os-extra_specs => generated 66 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:56:04.267775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2a4cd459-4a90-4098-8cf6-91841e919c16 tempest-FlavorsExtraSpecsTestJSON-1461788079 tempest-FlavorsExtraSpecsTestJSON-1461788079-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:04.279794 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2a4cd459-4a90-4098-8cf6-91841e919c16 tempest-FlavorsExtraSpecsTestJSON-1461788079 tempest-FlavorsExtraSpecsTestJSON-1461788079-project] 10.222.0.61 "GET /compute/v2.1/flavors/495273343/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.018631 Aug 23 17:56:04.280919 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 741/1400] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Aug 23 17:56:04 2022] GET /compute/v2.1/flavors/495273343/os-extra_specs/hw:numa_nodes => generated 22 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:56:04.292449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c1bd8ed8-6c06-449e-806e-5ea45230fe1f tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:04.328243 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c1bd8ed8-6c06-449e-806e-5ea45230fe1f tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors/495273343/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.039587 Aug 23 17:56:04.328890 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 742/1401] 10.222.0.61 () {60 vars in 1221 bytes} [Tue Aug 23 17:56:04 2022] POST /compute/v2.1/flavors/495273343/os-extra_specs => generated 66 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 17:56:04.338418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e563f80e-ff4c-4cac-a869-755ce4bf3c67 tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:04.347558 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e563f80e-ff4c-4cac-a869-755ce4bf3c67 tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/495273343/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.012823 Aug 23 17:56:04.348512 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 743/1402] 10.222.0.61 () {58 vars in 1200 bytes} [Tue Aug 23 17:56:04 2022] GET /compute/v2.1/flavors/495273343/os-extra_specs => generated 66 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:56:04.358728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-00bcb8d8-a097-4159-b774-d6b4922c1064 tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:04.362472 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:04.362472 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:04.380758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:04.438012 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-00bcb8d8-a097-4159-b774-d6b4922c1064 tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/495273343/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.078838 Aug 23 17:56:04.442774 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 744/1403] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 17:56:04 2022] PUT /compute/v2.1/flavors/495273343/os-extra_specs/hw:numa_nodes => generated 22 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:56:04.444702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5cba5f10-c08b-47f5-b032-963131ef3bad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:04.446133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc56ee5e-2006-415d-b76f-c4edf2bb6a0a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:04.447646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc56ee5e-2006-415d-b76f-c4edf2bb6a0a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:04.453650 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5cba5f10-c08b-47f5-b032-963131ef3bad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1325 microversion: 2.1 time: 0.349535 Aug 23 17:56:04.458520 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 660/1404] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:04 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1325 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:04.459759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc56ee5e-2006-415d-b76f-c4edf2bb6a0a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:04.459759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc56ee5e-2006-415d-b76f-c4edf2bb6a0a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:04.460136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc56ee5e-2006-415d-b76f-c4edf2bb6a0a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:04.461060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc56ee5e-2006-415d-b76f-c4edf2bb6a0a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:04.461562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc56ee5e-2006-415d-b76f-c4edf2bb6a0a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:04.461993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc56ee5e-2006-415d-b76f-c4edf2bb6a0a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:04.464550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8dfffc61-d29b-470d-ade8-b5a678d50edd tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:04.477460 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8dfffc61-d29b-470d-ade8-b5a678d50edd tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/495273343/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017677 Aug 23 17:56:04.478357 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 661/1405] 10.222.0.61 () {58 vars in 1200 bytes} [Tue Aug 23 17:56:04 2022] GET /compute/v2.1/flavors/495273343/os-extra_specs => generated 66 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:56:04.488928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1a3b8330-5baa-4ff6-86c6-71e1f7810a7f tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:04.490045 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:04.490045 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:04.537779 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1a3b8330-5baa-4ff6-86c6-71e1f7810a7f tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/495273343/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.053193 Aug 23 17:56:04.539292 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 662/1406] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 17:56:04 2022] DELETE /compute/v2.1/flavors/495273343/os-extra_specs/hw:numa_nodes => generated 0 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 17:56:04.548313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-478ee69c-4b2a-4e5a-b6c0-ff0fd4609cfe tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:04.597679 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-478ee69c-4b2a-4e5a-b6c0-ff0fd4609cfe tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/495273343/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.054326 Aug 23 17:56:04.602831 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 663/1407] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 17:56:04 2022] DELETE /compute/v2.1/flavors/495273343/os-extra_specs/hw:cpu_policy => generated 0 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Aug 23 17:56:04.608284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d15b46ca-1328-4810-b19e-1e8133fcd73c tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:04.617156 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d15b46ca-1328-4810-b19e-1e8133fcd73c tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/495273343/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012899 Aug 23 17:56:04.624484 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 664/1408] 10.222.0.61 () {58 vars in 1200 bytes} [Tue Aug 23 17:56:04 2022] GET /compute/v2.1/flavors/495273343/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:56:04.631503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-36d445d9-d82c-4c63-b5ab-8579581cd733 tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:04.632276 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:04.632276 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:04.656070 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-36d445d9-d82c-4c63-b5ab-8579581cd733 tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/495273343" status: 202 len: 0 microversion: 2.1 time: 0.030248 Aug 23 17:56:04.656975 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 665/1409] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Aug 23 17:56:04 2022] DELETE /compute/v2.1/flavors/495273343 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:56:04.662964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d51d4b37-93da-471c-9417-35dd4da1c072 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:04.663906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d51d4b37-93da-471c-9417-35dd4da1c072 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:04.670625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bc56ee5e-2006-415d-b76f-c4edf2bb6a0a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:04.671271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d51d4b37-93da-471c-9417-35dd4da1c072 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:04.671760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d51d4b37-93da-471c-9417-35dd4da1c072 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:04.672193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d51d4b37-93da-471c-9417-35dd4da1c072 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:04.672898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d51d4b37-93da-471c-9417-35dd4da1c072 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:04.673354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d51d4b37-93da-471c-9417-35dd4da1c072 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:04.673766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d51d4b37-93da-471c-9417-35dd4da1c072 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:04.680292 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc56ee5e-2006-415d-b76f-c4edf2bb6a0a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.239603 Aug 23 17:56:04.681448 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 745/1410] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:04 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:04.686851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1f2f72a6-0786-40a5-88f8-c0800b6d3fac tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:04.708755 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1f2f72a6-0786-40a5-88f8-c0800b6d3fac tempest-FlavorsExtraSpecsTestJSON-1266985865 tempest-FlavorsExtraSpecsTestJSON-1266985865-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.026026 Aug 23 17:56:04.709617 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 746/1411] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:56:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:04.937724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d51d4b37-93da-471c-9417-35dd4da1c072 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:04.948156 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d51d4b37-93da-471c-9417-35dd4da1c072 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.289873 Aug 23 17:56:04.949112 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 666/1412] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:04 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:05.486492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7bb5b82c-8cb6-4598-949e-13ab9b61c29c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e32d4c9b-b3da-481a-bd65-4ec41b65ad21"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:05.491412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-969ec904-b6ad-42ab-90b2-a5fdb2269fb9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:05.492646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-969ec904-b6ad-42ab-90b2-a5fdb2269fb9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:05.497106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7bb5b82c-8cb6-4598-949e-13ab9b61c29c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:05.503773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-969ec904-b6ad-42ab-90b2-a5fdb2269fb9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:05.506737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-969ec904-b6ad-42ab-90b2-a5fdb2269fb9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:05.508101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7bb5b82c-8cb6-4598-949e-13ab9b61c29c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:05.509091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-969ec904-b6ad-42ab-90b2-a5fdb2269fb9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:05.510055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-969ec904-b6ad-42ab-90b2-a5fdb2269fb9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:05.511021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7bb5b82c-8cb6-4598-949e-13ab9b61c29c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:05.511721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7bb5b82c-8cb6-4598-949e-13ab9b61c29c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:05.512961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7bb5b82c-8cb6-4598-949e-13ab9b61c29c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:05.513484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7bb5b82c-8cb6-4598-949e-13ab9b61c29c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:05.513823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7bb5b82c-8cb6-4598-949e-13ab9b61c29c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:05.517919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-969ec904-b6ad-42ab-90b2-a5fdb2269fb9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:05.518473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-969ec904-b6ad-42ab-90b2-a5fdb2269fb9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:05.738080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-969ec904-b6ad-42ab-90b2-a5fdb2269fb9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:05.747669 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-969ec904-b6ad-42ab-90b2-a5fdb2269fb9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1325 microversion: 2.1 time: 0.269415 Aug 23 17:56:05.748163 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 747/1413] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:05 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1325 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:05.753596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1053f9e0-ac93-4d1a-a04d-0e4a28df4782 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:05.754411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1053f9e0-ac93-4d1a-a04d-0e4a28df4782 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:05.761251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1053f9e0-ac93-4d1a-a04d-0e4a28df4782 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:05.761737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1053f9e0-ac93-4d1a-a04d-0e4a28df4782 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:05.764150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1053f9e0-ac93-4d1a-a04d-0e4a28df4782 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:05.773775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1053f9e0-ac93-4d1a-a04d-0e4a28df4782 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:05.774817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1053f9e0-ac93-4d1a-a04d-0e4a28df4782 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:05.775317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1053f9e0-ac93-4d1a-a04d-0e4a28df4782 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:05.958631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1053f9e0-ac93-4d1a-a04d-0e4a28df4782 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:05.971529 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1053f9e0-ac93-4d1a-a04d-0e4a28df4782 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.221695 Aug 23 17:56:05.972246 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 748/1414] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:05 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:05.976927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c4d80cb6-5436-4238-976b-17a6e18cc32c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:05.977537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c4d80cb6-5436-4238-976b-17a6e18cc32c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:05.983347 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7bb5b82c-8cb6-4598-949e-13ab9b61c29c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "POST /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.502672 Aug 23 17:56:05.983983 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 667/1415] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 17:56:05 2022] POST /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments => generated 194 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:05.995676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4d80cb6-5436-4238-976b-17a6e18cc32c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:05.997497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4d80cb6-5436-4238-976b-17a6e18cc32c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:05.998460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4d80cb6-5436-4238-976b-17a6e18cc32c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:05.999615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4d80cb6-5436-4238-976b-17a6e18cc32c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:06.002406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4d80cb6-5436-4238-976b-17a6e18cc32c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:06.002935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4d80cb6-5436-4238-976b-17a6e18cc32c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:06.224381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c4d80cb6-5436-4238-976b-17a6e18cc32c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:06.232659 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c4d80cb6-5436-4238-976b-17a6e18cc32c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.259105 Aug 23 17:56:06.233505 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 749/1416] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:05 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:06.723760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-49156b84-65b2-4e25-ae67-7fcb37f3beef req-14d2fda8-300b-4b44-b9cf-41701b15a1da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dff523f-5032-42ec-abcb-2266d1aee875", "name": "network-vif-plugged", "status": "completed", "tag": "d44e5ac7-af43-486c-8d73-1db70e5d0340"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:06.743885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-49156b84-65b2-4e25-ae67-7fcb37f3beef req-14d2fda8-300b-4b44-b9cf-41701b15a1da service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:06.744374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-49156b84-65b2-4e25-ae67-7fcb37f3beef req-14d2fda8-300b-4b44-b9cf-41701b15a1da service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:06.745016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-49156b84-65b2-4e25-ae67-7fcb37f3beef req-14d2fda8-300b-4b44-b9cf-41701b15a1da service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:06.757198 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-49156b84-65b2-4e25-ae67-7fcb37f3beef req-14d2fda8-300b-4b44-b9cf-41701b15a1da service nova] Creating event network-vif-plugged:d44e5ac7-af43-486c-8d73-1db70e5d0340 for instance 9dff523f-5032-42ec-abcb-2266d1aee875 on n-h2-850468-16 Aug 23 17:56:06.765550 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-49156b84-65b2-4e25-ae67-7fcb37f3beef req-14d2fda8-300b-4b44-b9cf-41701b15a1da service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046427 Aug 23 17:56:06.777163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07fa66fd-de25-43e7-9954-ce16489571d7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:06.777163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07fa66fd-de25-43e7-9954-ce16489571d7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:06.782476 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 668/1417] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:06.784396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07fa66fd-de25-43e7-9954-ce16489571d7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:06.786593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07fa66fd-de25-43e7-9954-ce16489571d7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:06.787368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07fa66fd-de25-43e7-9954-ce16489571d7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:06.788221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07fa66fd-de25-43e7-9954-ce16489571d7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:06.788696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07fa66fd-de25-43e7-9954-ce16489571d7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:06.789142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07fa66fd-de25-43e7-9954-ce16489571d7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:07.021662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1099940140", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": "none"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:07.078157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-07fa66fd-de25-43e7-9954-ce16489571d7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:07.091586 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-07fa66fd-de25-43e7-9954-ce16489571d7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1325 microversion: 2.1 time: 0.322530 Aug 23 17:56:07.092274 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 750/1418] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:06 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1325 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:07.105056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:56:07.105056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:56:07.105056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:56:07.105056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:56:07.105056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:56:07.112505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-058ce09a-6e65-4ece-b4bb-e29b544e79c9 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:07.113509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-058ce09a-6e65-4ece-b4bb-e29b544e79c9 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:07.120226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-058ce09a-6e65-4ece-b4bb-e29b544e79c9 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:07.120721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-058ce09a-6e65-4ece-b4bb-e29b544e79c9 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:07.121160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-058ce09a-6e65-4ece-b4bb-e29b544e79c9 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:07.122070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-058ce09a-6e65-4ece-b4bb-e29b544e79c9 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:07.122557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-058ce09a-6e65-4ece-b4bb-e29b544e79c9 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:07.122993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-058ce09a-6e65-4ece-b4bb-e29b544e79c9 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:07.133286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:07.133948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:07.134462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:07.135341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:07.135910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:07.136419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:07.143064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:07.157371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Getting quotas for project 926d2ad9800d41eb81071b27bce06c65. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:56:07.162371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Getting quotas for user b27854e33223429ab8652c8187618305 and project 926d2ad9800d41eb81071b27bce06c65. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:56:07.182715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:56:07.185734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:56:07.268417 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3c3aed20-9c61-4e52-bd4e-77510887b795 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.429452 Aug 23 17:56:07.270031 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 669/1419] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 17:56:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 432 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 23 17:56:07.275132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f93021ab-b231-4492-81d0-bc13c8053add tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:07.276136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f93021ab-b231-4492-81d0-bc13c8053add tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:07.285066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f93021ab-b231-4492-81d0-bc13c8053add tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:07.286148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f93021ab-b231-4492-81d0-bc13c8053add tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:07.286914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f93021ab-b231-4492-81d0-bc13c8053add tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:07.287804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f93021ab-b231-4492-81d0-bc13c8053add tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:07.288668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f93021ab-b231-4492-81d0-bc13c8053add tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:07.289325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f93021ab-b231-4492-81d0-bc13c8053add tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:07.307240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-058ce09a-6e65-4ece-b4bb-e29b544e79c9 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:07.320416 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-058ce09a-6e65-4ece-b4bb-e29b544e79c9 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.211875 Aug 23 17:56:07.321738 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 751/1420] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:07 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:07.336116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-13fb04c9-3c33-4c48-bf2c-5427793a3c38 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:07.336756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-13fb04c9-3c33-4c48-bf2c-5427793a3c38 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:07.420541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-13fb04c9-3c33-4c48-bf2c-5427793a3c38 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:07.431503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-13fb04c9-3c33-4c48-bf2c-5427793a3c38 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:07.433725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-13fb04c9-3c33-4c48-bf2c-5427793a3c38 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:07.436031 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-13fb04c9-3c33-4c48-bf2c-5427793a3c38 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1278 microversion: 2.54 time: 0.112940 Aug 23 17:56:07.448283 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 752/1421] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:07 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1278 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:07.506066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f93021ab-b231-4492-81d0-bc13c8053add tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:07.515253 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f93021ab-b231-4492-81d0-bc13c8053add tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.243787 Aug 23 17:56:07.529690 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 670/1422] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:07 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:08.113909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6bb32415-bca3-4b65-bb73-fc58d3b81048 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:08.115309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6bb32415-bca3-4b65-bb73-fc58d3b81048 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:08.131639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bb32415-bca3-4b65-bb73-fc58d3b81048 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:08.132458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bb32415-bca3-4b65-bb73-fc58d3b81048 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:08.133210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bb32415-bca3-4b65-bb73-fc58d3b81048 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:08.133924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bb32415-bca3-4b65-bb73-fc58d3b81048 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:08.138825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bb32415-bca3-4b65-bb73-fc58d3b81048 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:08.139389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bb32415-bca3-4b65-bb73-fc58d3b81048 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:08.379971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd99b4da-0766-47b5-a5d3-a170270beee0 tempest-FlavorsV255TestJSON-5436875 tempest-FlavorsV255TestJSON-5436875-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-223953281", "id": 1448291026, "os-flavor-access:is_public": "True"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:08.383203 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:08.383203 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:08.402826 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd99b4da-0766-47b5-a5d3-a170270beee0 tempest-FlavorsV255TestJSON-5436875 tempest-FlavorsV255TestJSON-5436875-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 448 microversion: 2.55 time: 0.188671 Aug 23 17:56:08.405159 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 671/1423] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 17:56:08 2022] POST /compute/v2.1/flavors => generated 448 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 17:56:08.411778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-21760bfa-80c3-46f6-af2a-29a7ef6d9c09 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:08.412618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-21760bfa-80c3-46f6-af2a-29a7ef6d9c09 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:08.422667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21760bfa-80c3-46f6-af2a-29a7ef6d9c09 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:08.423345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21760bfa-80c3-46f6-af2a-29a7ef6d9c09 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:08.423849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21760bfa-80c3-46f6-af2a-29a7ef6d9c09 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:08.424759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21760bfa-80c3-46f6-af2a-29a7ef6d9c09 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:08.425380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21760bfa-80c3-46f6-af2a-29a7ef6d9c09 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:08.425969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21760bfa-80c3-46f6-af2a-29a7ef6d9c09 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:08.575795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6bb32415-bca3-4b65-bb73-fc58d3b81048 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:08.586392 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6bb32415-bca3-4b65-bb73-fc58d3b81048 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1325 microversion: 2.1 time: 0.477585 Aug 23 17:56:08.587376 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 753/1424] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:08 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1325 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:08.595776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-21760bfa-80c3-46f6-af2a-29a7ef6d9c09 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:08.606013 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-21760bfa-80c3-46f6-af2a-29a7ef6d9c09 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.198812 Aug 23 17:56:08.619299 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 672/1425] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:08 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:08.626388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e26051fd-05e3-4dda-9a85-a8ed2a6776a8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:08.627326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e26051fd-05e3-4dda-9a85-a8ed2a6776a8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:08.634190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e26051fd-05e3-4dda-9a85-a8ed2a6776a8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:08.634919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e26051fd-05e3-4dda-9a85-a8ed2a6776a8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:08.635658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e26051fd-05e3-4dda-9a85-a8ed2a6776a8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:08.637195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e26051fd-05e3-4dda-9a85-a8ed2a6776a8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:08.638459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e26051fd-05e3-4dda-9a85-a8ed2a6776a8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:08.639346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e26051fd-05e3-4dda-9a85-a8ed2a6776a8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:08.769383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d76730ab-dcd2-4122-af5e-c386ae755e25 tempest-FlavorsV255TestJSON-450598698 tempest-FlavorsV255TestJSON-450598698-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:08.778767 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d76730ab-dcd2-4122-af5e-c386ae755e25 tempest-FlavorsV255TestJSON-450598698 tempest-FlavorsV255TestJSON-450598698-project] 10.222.0.61 "GET /compute/v2.1/flavors/1448291026" status: 200 len: 448 microversion: 2.55 time: 0.189209 Aug 23 17:56:08.786961 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 754/1426] 10.222.0.61 () {60 vars in 1199 bytes} [Tue Aug 23 17:56:08 2022] GET /compute/v2.1/flavors/1448291026 => generated 448 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:56:08.792278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dad941ad-ba0f-486a-af53-c36c50e15140 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:08.793269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dad941ad-ba0f-486a-af53-c36c50e15140 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:08.800701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dad941ad-ba0f-486a-af53-c36c50e15140 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:08.801461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dad941ad-ba0f-486a-af53-c36c50e15140 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:08.802104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dad941ad-ba0f-486a-af53-c36c50e15140 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:08.803049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dad941ad-ba0f-486a-af53-c36c50e15140 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:08.803706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dad941ad-ba0f-486a-af53-c36c50e15140 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:08.804312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dad941ad-ba0f-486a-af53-c36c50e15140 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:08.948406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dad941ad-ba0f-486a-af53-c36c50e15140 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:08.950935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e26051fd-05e3-4dda-9a85-a8ed2a6776a8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:08.957779 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dad941ad-ba0f-486a-af53-c36c50e15140 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.169312 Aug 23 17:56:08.958497 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 755/1427] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:08 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:08.964045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2a640766-71c2-4eef-9101-1f2d4bc937bc tempest-FlavorsV255TestJSON-5436875 tempest-FlavorsV255TestJSON-5436875-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:08.968682 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:08.968682 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:08.972392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e26051fd-05e3-4dda-9a85-a8ed2a6776a8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:08.973915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e26051fd-05e3-4dda-9a85-a8ed2a6776a8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:08.975333 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e26051fd-05e3-4dda-9a85-a8ed2a6776a8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1330 microversion: 2.54 time: 0.354983 Aug 23 17:56:08.980015 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 673/1428] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:08 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1330 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:08.998313 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2a640766-71c2-4eef-9101-1f2d4bc937bc tempest-FlavorsV255TestJSON-5436875 tempest-FlavorsV255TestJSON-5436875-project-admin] 10.222.0.61 "PUT /compute/v2.1/flavors/1448291026" status: 200 len: 449 microversion: 2.55 time: 0.038198 Aug 23 17:56:08.998948 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 756/1429] 10.222.0.61 () {62 vars in 1219 bytes} [Tue Aug 23 17:56:08 2022] PUT /compute/v2.1/flavors/1448291026 => generated 449 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:56:09.011193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3446dc42-fae7-4892-8b6a-2f9c5ccda07f tempest-FlavorsV255TestJSON-450598698 tempest-FlavorsV255TestJSON-450598698-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:09.036506 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3446dc42-fae7-4892-8b6a-2f9c5ccda07f tempest-FlavorsV255TestJSON-450598698 tempest-FlavorsV255TestJSON-450598698-project] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5724 microversion: 2.55 time: 0.028949 Aug 23 17:56:09.037409 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 674/1430] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Aug 23 17:56:09 2022] GET /compute/v2.1/flavors/detail => generated 5724 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:09.056755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-64b5c796-8901-45a4-aedb-24e8806a7060 tempest-FlavorsV255TestJSON-450598698 tempest-FlavorsV255TestJSON-450598698-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:09.079139 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-64b5c796-8901-45a4-aedb-24e8806a7060 tempest-FlavorsV255TestJSON-450598698 tempest-FlavorsV255TestJSON-450598698-project] 10.222.0.61 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.55 time: 0.026204 Aug 23 17:56:09.079899 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 757/1431] 10.222.0.61 () {60 vars in 1166 bytes} [Tue Aug 23 17:56:09 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:09.096969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5f5354b-a78d-480c-a2fd-4b03b769f30b tempest-FlavorsV255TestJSON-5436875 tempest-FlavorsV255TestJSON-5436875-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:09.097734 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:09.097734 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:09.117817 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e5f5354b-a78d-480c-a2fd-4b03b769f30b tempest-FlavorsV255TestJSON-5436875 tempest-FlavorsV255TestJSON-5436875-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1448291026" status: 202 len: 0 microversion: 2.55 time: 0.024525 Aug 23 17:56:09.123078 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 675/1432] 10.222.0.61 () {60 vars in 1202 bytes} [Tue Aug 23 17:56:09 2022] DELETE /compute/v2.1/flavors/1448291026 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:56:09.128402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-61c7fa16-5b92-4571-944b-b7c954996632 tempest-FlavorsV255TestJSON-5436875 tempest-FlavorsV255TestJSON-5436875-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:09.149498 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-61c7fa16-5b92-4571-944b-b7c954996632 tempest-FlavorsV255TestJSON-5436875 tempest-FlavorsV255TestJSON-5436875-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 5285 microversion: 2.55 time: 0.024844 Aug 23 17:56:09.150612 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 758/1433] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Aug 23 17:56:09 2022] GET /compute/v2.1/flavors/detail => generated 5285 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:09.610024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7dd79349-f9d5-426a-a322-142bb52558c7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:09.611619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7dd79349-f9d5-426a-a322-142bb52558c7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:09.620914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dd79349-f9d5-426a-a322-142bb52558c7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:09.621879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dd79349-f9d5-426a-a322-142bb52558c7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:09.622722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dd79349-f9d5-426a-a322-142bb52558c7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:09.623543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dd79349-f9d5-426a-a322-142bb52558c7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:09.625498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dd79349-f9d5-426a-a322-142bb52558c7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:09.625498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dd79349-f9d5-426a-a322-142bb52558c7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:09.630418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-54c0f789-21a2-4f4e-aa73-0ce34e3eac3d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:09.631290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-54c0f789-21a2-4f4e-aa73-0ce34e3eac3d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:09.638093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54c0f789-21a2-4f4e-aa73-0ce34e3eac3d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:09.638871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54c0f789-21a2-4f4e-aa73-0ce34e3eac3d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:09.639478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54c0f789-21a2-4f4e-aa73-0ce34e3eac3d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:09.640422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54c0f789-21a2-4f4e-aa73-0ce34e3eac3d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:09.641098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54c0f789-21a2-4f4e-aa73-0ce34e3eac3d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:09.641698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54c0f789-21a2-4f4e-aa73-0ce34e3eac3d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:09.789672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-54c0f789-21a2-4f4e-aa73-0ce34e3eac3d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:09.800233 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-54c0f789-21a2-4f4e-aa73-0ce34e3eac3d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.173334 Aug 23 17:56:09.801346 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 759/1434] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:09 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:09.870337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7dd79349-f9d5-426a-a322-142bb52558c7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:09.880247 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7dd79349-f9d5-426a-a322-142bb52558c7 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1522 microversion: 2.1 time: 0.274719 Aug 23 17:56:09.880832 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 676/1435] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:09 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:09.907037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0ddae255-a234-4d0c-910e-e0d009f4333a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:09.907649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0ddae255-a234-4d0c-910e-e0d009f4333a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:09.913746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ddae255-a234-4d0c-910e-e0d009f4333a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:09.914368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ddae255-a234-4d0c-910e-e0d009f4333a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:09.914837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ddae255-a234-4d0c-910e-e0d009f4333a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:09.915547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ddae255-a234-4d0c-910e-e0d009f4333a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:09.916002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ddae255-a234-4d0c-910e-e0d009f4333a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:09.916419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ddae255-a234-4d0c-910e-e0d009f4333a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:09.980186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-81658849-7fbd-43f6-8c45-c43a78f6e7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:09.981630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-81658849-7fbd-43f6-8c45-c43a78f6e7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:09.984267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=80,nova_api:SAVEPOINT=3,nova_api:INSERT=6,nova_api:RELEASE=3,nova_api:DELETE=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:10.000858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81658849-7fbd-43f6-8c45-c43a78f6e7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:10.001370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81658849-7fbd-43f6-8c45-c43a78f6e7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:10.005068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81658849-7fbd-43f6-8c45-c43a78f6e7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:10.005841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81658849-7fbd-43f6-8c45-c43a78f6e7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:10.009192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81658849-7fbd-43f6-8c45-c43a78f6e7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:10.009651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81658849-7fbd-43f6-8c45-c43a78f6e7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:10.113934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0ddae255-a234-4d0c-910e-e0d009f4333a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:10.126900 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0ddae255-a234-4d0c-910e-e0d009f4333a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1522 microversion: 2.1 time: 0.224899 Aug 23 17:56:10.128156 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 760/1436] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:09 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:10.133429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dd77a025-84f2-4492-80cd-dcc0703199f6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:10.134737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dd77a025-84f2-4492-80cd-dcc0703199f6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:10.150091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd77a025-84f2-4492-80cd-dcc0703199f6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:10.153461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd77a025-84f2-4492-80cd-dcc0703199f6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:10.154132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd77a025-84f2-4492-80cd-dcc0703199f6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:10.155115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd77a025-84f2-4492-80cd-dcc0703199f6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:10.155887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd77a025-84f2-4492-80cd-dcc0703199f6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:10.156582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd77a025-84f2-4492-80cd-dcc0703199f6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:10.214705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-81658849-7fbd-43f6-8c45-c43a78f6e7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:10.221127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:10.225103 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-81658849-7fbd-43f6-8c45-c43a78f6e7fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.249626 Aug 23 17:56:10.226516 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 677/1437] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:09 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:10.231732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b2911d35-66f6-4067-a38f-e33cdee2f9be tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1270689082"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:10.234207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b2911d35-66f6-4067-a38f-e33cdee2f9be tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:10.242271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2911d35-66f6-4067-a38f-e33cdee2f9be tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:10.242964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2911d35-66f6-4067-a38f-e33cdee2f9be tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:10.243771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2911d35-66f6-4067-a38f-e33cdee2f9be tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:10.244681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2911d35-66f6-4067-a38f-e33cdee2f9be tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:10.245324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2911d35-66f6-4067-a38f-e33cdee2f9be tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:10.246136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2911d35-66f6-4067-a38f-e33cdee2f9be tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:10.296442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dd77a025-84f2-4492-80cd-dcc0703199f6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:10.307341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dd77a025-84f2-4492-80cd-dcc0703199f6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:10.310137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dd77a025-84f2-4492-80cd-dcc0703199f6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:10.311916 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dd77a025-84f2-4492-80cd-dcc0703199f6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1336 microversion: 2.54 time: 0.182358 Aug 23 17:56:10.312839 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 761/1438] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:10 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1336 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:10.494177 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b2911d35-66f6-4067-a38f-e33cdee2f9be tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "POST /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875/action" status: 202 len: 0 microversion: 2.1 time: 0.266097 Aug 23 17:56:10.495600 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 678/1439] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:56:10 2022] POST /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 17:56:10.507299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-10873d65-6f57-4c6e-bf32-2bf3268f3491 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '.version_select at 0x7f27ecaddb80>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:10.667269 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-10873d65-6f57-4c6e-bf32-2bf3268f3491 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "DELETE /compute/v2.1/images/394bba62-caa8-4807-b158-d1abd5c4bbcc" status: 204 len: 0 microversion: 2.1 time: 0.163047 Aug 23 17:56:10.667911 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 762/1440] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:10 2022] DELETE /compute/v2.1/images/394bba62-caa8-4807-b158-d1abd5c4bbcc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 17:56:10.677697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3091af0e-5dea-4b7f-b65f-a51488af77ba tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '.version_select at 0x7f27ec6ff550>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:10.703958 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-3091af0e-5dea-4b7f-b65f-a51488af77ba tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] HTTP exception thrown: Image not found. Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3091af0e-5dea-4b7f-b65f-a51488af77ba tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/images/394bba62-caa8-4807-b158-d1abd5c4bbcc HTTP/1.1 Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '394bba62-caa8-4807-b158-d1abd5c4bbcc'} Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 394bba62-caa8-4807-b158-d1abd5c4bbcc Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 17:56:10.731173 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 394bba62-caa8-4807-b158-d1abd5c4bbcc could not be found. Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 17:56:10.737413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:10.744534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3091af0e-5dea-4b7f-b65f-a51488af77ba tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:10.744534 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3091af0e-5dea-4b7f-b65f-a51488af77ba tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/images/394bba62-caa8-4807-b158-d1abd5c4bbcc" status: 404 len: 62 microversion: 2.1 time: 0.069790 Aug 23 17:56:10.744534 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 679/1441] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:56:10 2022] GET /compute/v2.1/images/394bba62-caa8-4807-b158-d1abd5c4bbcc => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:56:10.751781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-62032a56-76bf-45b1-8e51-b8bae7c9094c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:10.752540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-62032a56-76bf-45b1-8e51-b8bae7c9094c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:10.759167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62032a56-76bf-45b1-8e51-b8bae7c9094c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:10.759784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62032a56-76bf-45b1-8e51-b8bae7c9094c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:10.760323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62032a56-76bf-45b1-8e51-b8bae7c9094c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:10.761466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62032a56-76bf-45b1-8e51-b8bae7c9094c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:10.762055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62032a56-76bf-45b1-8e51-b8bae7c9094c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:10.763199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62032a56-76bf-45b1-8e51-b8bae7c9094c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:10.825351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a5d3d839-7e4a-4451-9b1d-7bbb004a2caf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:10.826226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a5d3d839-7e4a-4451-9b1d-7bbb004a2caf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:10.835233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5d3d839-7e4a-4451-9b1d-7bbb004a2caf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:10.835945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5d3d839-7e4a-4451-9b1d-7bbb004a2caf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:10.836631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5d3d839-7e4a-4451-9b1d-7bbb004a2caf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:10.837866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5d3d839-7e4a-4451-9b1d-7bbb004a2caf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:10.838427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5d3d839-7e4a-4451-9b1d-7bbb004a2caf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:10.839265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5d3d839-7e4a-4451-9b1d-7bbb004a2caf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:10.923449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-62032a56-76bf-45b1-8e51-b8bae7c9094c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:10.932344 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-62032a56-76bf-45b1-8e51-b8bae7c9094c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1534 microversion: 2.1 time: 0.184541 Aug 23 17:56:10.933914 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 763/1442] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:10 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1534 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:11.011273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a5d3d839-7e4a-4451-9b1d-7bbb004a2caf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:11.019662 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a5d3d839-7e4a-4451-9b1d-7bbb004a2caf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.201866 Aug 23 17:56:11.020248 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 680/1443] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:10 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:11.245168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c5949b7b-02b6-48af-a716-cd5953a676ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:11.246630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c5949b7b-02b6-48af-a716-cd5953a676ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:11.255318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5949b7b-02b6-48af-a716-cd5953a676ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:11.256070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5949b7b-02b6-48af-a716-cd5953a676ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:11.256815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5949b7b-02b6-48af-a716-cd5953a676ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:11.257795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5949b7b-02b6-48af-a716-cd5953a676ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:11.258362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5949b7b-02b6-48af-a716-cd5953a676ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:11.258941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5949b7b-02b6-48af-a716-cd5953a676ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:11.337812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db3dd8b7-6b48-424e-894f-36099956e2e4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:11.338751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-db3dd8b7-6b48-424e-894f-36099956e2e4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:11.346611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db3dd8b7-6b48-424e-894f-36099956e2e4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:11.347619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db3dd8b7-6b48-424e-894f-36099956e2e4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:11.348292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db3dd8b7-6b48-424e-894f-36099956e2e4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:11.349268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db3dd8b7-6b48-424e-894f-36099956e2e4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:11.349928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db3dd8b7-6b48-424e-894f-36099956e2e4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:11.350599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db3dd8b7-6b48-424e-894f-36099956e2e4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:11.443071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c5949b7b-02b6-48af-a716-cd5953a676ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:11.452870 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c5949b7b-02b6-48af-a716-cd5953a676ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.211562 Aug 23 17:56:11.463380 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 764/1444] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:11 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:11.481147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-db3dd8b7-6b48-424e-894f-36099956e2e4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:11.493021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-db3dd8b7-6b48-424e-894f-36099956e2e4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:11.497184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-db3dd8b7-6b48-424e-894f-36099956e2e4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:11.500835 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-db3dd8b7-6b48-424e-894f-36099956e2e4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1336 microversion: 2.54 time: 0.166872 Aug 23 17:56:11.502869 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 681/1445] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:11 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1336 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:56:11.955465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f41f6626-a587-484e-96e4-c4c6208205f3 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:11.956089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f41f6626-a587-484e-96e4-c4c6208205f3 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:11.962121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f41f6626-a587-484e-96e4-c4c6208205f3 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:11.962635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f41f6626-a587-484e-96e4-c4c6208205f3 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:11.963287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f41f6626-a587-484e-96e4-c4c6208205f3 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:11.964124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f41f6626-a587-484e-96e4-c4c6208205f3 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:11.964589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f41f6626-a587-484e-96e4-c4c6208205f3 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:11.965017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f41f6626-a587-484e-96e4-c4c6208205f3 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:12.044655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9a25fef5-5094-4f24-bb71-ce6d1bca6c64 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.046322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9a25fef5-5094-4f24-bb71-ce6d1bca6c64 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:12.054111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a25fef5-5094-4f24-bb71-ce6d1bca6c64 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:12.054666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a25fef5-5094-4f24-bb71-ce6d1bca6c64 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:12.055165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a25fef5-5094-4f24-bb71-ce6d1bca6c64 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:12.056165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a25fef5-5094-4f24-bb71-ce6d1bca6c64 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:12.056855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a25fef5-5094-4f24-bb71-ce6d1bca6c64 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:12.057526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a25fef5-5094-4f24-bb71-ce6d1bca6c64 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:12.160119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f41f6626-a587-484e-96e4-c4c6208205f3 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:12.164534 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f41f6626-a587-484e-96e4-c4c6208205f3 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1534 microversion: 2.1 time: 0.212993 Aug 23 17:56:12.165248 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 765/1446] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:11 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1534 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:12.217736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9a25fef5-5094-4f24-bb71-ce6d1bca6c64 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:12.225603 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9a25fef5-5094-4f24-bb71-ce6d1bca6c64 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.187771 Aug 23 17:56:12.226254 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 682/1447] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:12.394722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3307971c-eafd-49f6-85df-be0a8656ff20 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Calling method '.version_select at 0x7f27ecaa7a60>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.397218 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:12.397218 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:12.398254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3307971c-eafd-49f6-85df-be0a8656ff20 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:12.398765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3307971c-eafd-49f6-85df-be0a8656ff20 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:12.399197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3307971c-eafd-49f6-85df-be0a8656ff20 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:12.399925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3307971c-eafd-49f6-85df-be0a8656ff20 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:12.400375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3307971c-eafd-49f6-85df-be0a8656ff20 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:12.400796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3307971c-eafd-49f6-85df-be0a8656ff20 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:12.423722 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3307971c-eafd-49f6-85df-be0a8656ff20 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 200 len: 381 microversion: 2.1 time: 0.146049 Aug 23 17:56:12.424277 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 766/1448] 10.222.0.61 () {58 vars in 1128 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/os-hosts => generated 381 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:12.475422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3c11502f-5e18-4c3c-80e8-643393149ba9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.476133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3c11502f-5e18-4c3c-80e8-643393149ba9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:12.482460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c11502f-5e18-4c3c-80e8-643393149ba9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:12.483037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c11502f-5e18-4c3c-80e8-643393149ba9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:12.483551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c11502f-5e18-4c3c-80e8-643393149ba9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:12.484363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c11502f-5e18-4c3c-80e8-643393149ba9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:12.484881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c11502f-5e18-4c3c-80e8-643393149ba9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:12.485379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c11502f-5e18-4c3c-80e8-643393149ba9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:12.544643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8131344f-a9a6-45b2-8971-23d0ae65638c tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Calling method '.version_select at 0x7f27ec7b9b80>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.547464 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:12.547464 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:12.551546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8131344f-a9a6-45b2-8971-23d0ae65638c tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '495a4b7aad7e4b20a01fffe4746f3f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ebfe61024043d0ad8de0a6d4387d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8131344f-a9a6-45b2-8971-23d0ae65638c tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Request method failure captured: Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRS7_8CaiImetvOFg_GqCFN0TzQyLLA3LeJkRP595zrUHZdDuRjpp_Y9E99UVoye_INCua9_3hRzdO7bGLIxiEL6kCAyLTZ9u22GKH2fjupv9im-hUXQD50usRIJbrBpqC3OQUY4NnJSf_DPXZsNxMGeKdAMNmJEqg_KGb2Oem9WsBQ Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 08ebfe61024043d0ad8de0a6d4387d75 Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08ebfe61024043d0ad8de0a6d4387d75"}]}] Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 08ebfe61024043d0ad8de0a6d4387d75 Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-HostsAdminNegativeTestJSON-246413929-project Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 495a4b7aad7e4b20a01fffe4746f3f97 Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246413929-project Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: action_args: {} Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.553780 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.569863 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.569863 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.569863 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.569863 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:56:12.569863 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:56:12.569863 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Aug 23 17:56:12.569863 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.569863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8131344f-a9a6-45b2-8971-23d0ae65638c tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.569863 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8131344f-a9a6-45b2-8971-23d0ae65638c tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] 10.222.0.61 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.123850 Aug 23 17:56:12.569863 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 683/1449] 10.222.0.61 () {58 vars in 1128 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 136 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:56:12.572799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c201e76d-73c3-4d37-9114-70146a6d719b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.573420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c201e76d-73c3-4d37-9114-70146a6d719b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:12.580339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c201e76d-73c3-4d37-9114-70146a6d719b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:12.580825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c201e76d-73c3-4d37-9114-70146a6d719b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:12.581269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c201e76d-73c3-4d37-9114-70146a6d719b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:12.581969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c201e76d-73c3-4d37-9114-70146a6d719b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:12.582428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c201e76d-73c3-4d37-9114-70146a6d719b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:12.582890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c201e76d-73c3-4d37-9114-70146a6d719b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:12.648377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3c11502f-5e18-4c3c-80e8-643393149ba9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:12.654139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c201e76d-73c3-4d37-9114-70146a6d719b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:12.657210 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3c11502f-5e18-4c3c-80e8-643393149ba9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.185601 Aug 23 17:56:12.657794 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 767/1450] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:12.662531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed6857ba-5182-4a6c-a08b-4bc465747f27 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Calling method '.version_select at 0x7f27ecaa7d30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.662792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c201e76d-73c3-4d37-9114-70146a6d719b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:12.663336 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:12.663336 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:12.664402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ed6857ba-5182-4a6c-a08b-4bc465747f27 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '495a4b7aad7e4b20a01fffe4746f3f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ebfe61024043d0ad8de0a6d4387d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:12.664643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c201e76d-73c3-4d37-9114-70146a6d719b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:12.665871 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c201e76d-73c3-4d37-9114-70146a6d719b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1336 microversion: 2.54 time: 0.097903 Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed6857ba-5182-4a6c-a08b-4bc465747f27 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Request method failure captured: Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-hosts/n-d-850468-16/reboot HTTP/1.1 Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRS7_8CaiImetvOFg_GqCFN0TzQyLLA3LeJkRP595zrUHZdDuRjpp_Y9E99UVoye_INCua9_3hRzdO7bGLIxiEL6kCAyLTZ9u22GKH2fjupv9im-hUXQD50usRIJbrBpqC3OQUY4NnJSf_DPXZsNxMGeKdAMNmJEqg_KGb2Oem9WsBQ Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 08ebfe61024043d0ad8de0a6d4387d75 Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08ebfe61024043d0ad8de0a6d4387d75"}]}] Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 08ebfe61024043d0ad8de0a6d4387d75 Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HostsAdminNegativeTestJSON-246413929-project Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 495a4b7aad7e4b20a01fffe4746f3f97 Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246413929-project Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'n-d-850468-16'} Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.666347 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.672830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.672830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.672830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:56:12.672830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:56:12.672830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Aug 23 17:56:12.672830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.673327 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 684/1451] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1336 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:12.673411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed6857ba-5182-4a6c-a08b-4bc465747f27 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.673411 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ed6857ba-5182-4a6c-a08b-4bc465747f27 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-d-850468-16/reboot" status: 403 len: 111 microversion: 2.1 time: 0.009071 Aug 23 17:56:12.673411 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 768/1452] 10.222.0.61 () {58 vars in 1191 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/os-hosts/n-d-850468-16/reboot => generated 111 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:56:12.678745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b31e70a0-3db6-4784-8dc9-e2efa9338612 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Calling method '.version_select at 0x7f27ec819940>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.679598 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:reboot": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:12.679598 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:12.687797 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b31e70a0-3db6-4784-8dc9-e2efa9338612 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b31e70a0-3db6-4784-8dc9-e2efa9338612 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Request method failure captured: Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRS8SqsS1YduBio6hNoWAeT-c0tu0ODQIiO2hPxnsThaGuYQJfbkU62bJ60tyBfz-8aKqIZPf3MiN0--5x2PKTYo2j_BBMjvFFuUfVkYOuWOe69JEOmACvOxAl1YzaJQqZj7X9U1_ES60KMtceQqcgeN3_0shYL5RByqFGdK8KKL7QI Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}] Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: ce7d8f40d4594542b2f4ac7653cca393 Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'nonexistent_hostname'} Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.689471 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b31e70a0-3db6-4784-8dc9-e2efa9338612 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b31e70a0-3db6-4784-8dc9-e2efa9338612 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.015650 Aug 23 17:56:12.694635 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 685/1453] 10.222.0.61 () {58 vars in 1212 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:56:12.700617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-adb3a7f2-f107-4de4-b1e7-33e5dd651e3b tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Calling method '.version_select at 0x7f27ecb5fca0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.701410 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:12.701410 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:12.702483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-adb3a7f2-f107-4de4-b1e7-33e5dd651e3b tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '495a4b7aad7e4b20a01fffe4746f3f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ebfe61024043d0ad8de0a6d4387d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-adb3a7f2-f107-4de4-b1e7-33e5dd651e3b tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Request method failure captured: Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-hosts/n-d-850468-16 HTTP/1.1 Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRS7_8CaiImetvOFg_GqCFN0TzQyLLA3LeJkRP595zrUHZdDuRjpp_Y9E99UVoye_INCua9_3hRzdO7bGLIxiEL6kCAyLTZ9u22GKH2fjupv9im-hUXQD50usRIJbrBpqC3OQUY4NnJSf_DPXZsNxMGeKdAMNmJEqg_KGb2Oem9WsBQ Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 08ebfe61024043d0ad8de0a6d4387d75 Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08ebfe61024043d0ad8de0a6d4387d75"}]}] Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 08ebfe61024043d0ad8de0a6d4387d75 Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HostsAdminNegativeTestJSON-246413929-project Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 495a4b7aad7e4b20a01fffe4746f3f97 Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246413929-project Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'n-d-850468-16'} Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.704055 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.708897 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.708897 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.708897 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:56:12.708897 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:56:12.708897 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Aug 23 17:56:12.708897 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.708897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-adb3a7f2-f107-4de4-b1e7-33e5dd651e3b tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.708897 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-adb3a7f2-f107-4de4-b1e7-33e5dd651e3b tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-d-850468-16" status: 403 len: 109 microversion: 2.1 time: 0.009202 Aug 23 17:56:12.708897 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 769/1454] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/os-hosts/n-d-850468-16 => generated 109 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:56:12.713921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9c00ba49-0f14-40b1-ad3d-a1679ac6e015 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Calling method '.version_select at 0x7f27ec7b9e50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.714763 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:12.714763 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:12.721738 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-9c00ba49-0f14-40b1-ad3d-a1679ac6e015 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9c00ba49-0f14-40b1-ad3d-a1679ac6e015 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Request method failure captured: Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRS8SqsS1YduBio6hNoWAeT-c0tu0ODQIiO2hPxnsThaGuYQJfbkU62bJ60tyBfz-8aKqIZPf3MiN0--5x2PKTYo2j_BBMjvFFuUfVkYOuWOe69JEOmACvOxAl1YzaJQqZj7X9U1_ES60KMtceQqcgeN3_0shYL5RByqFGdK8KKL7QI Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}] Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: ce7d8f40d4594542b2f4ac7653cca393 Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'nonexistent_hostname'} Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.723299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.728028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.728028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.728028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.728028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:12.728028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:12.728028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.728028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.728028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9c00ba49-0f14-40b1-ad3d-a1679ac6e015 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.728028 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9c00ba49-0f14-40b1-ad3d-a1679ac6e015 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.014213 Aug 23 17:56:12.728028 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 686/1455] 10.222.0.61 () {58 vars in 1191 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:56:12.734678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a8e0ab2b-f91a-44dc-9d44-7d4e08ae1c9c tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Calling method '.version_select at 0x7f27ecb5fa60>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.735460 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:12.735460 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:12.736521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a8e0ab2b-f91a-44dc-9d44-7d4e08ae1c9c tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '495a4b7aad7e4b20a01fffe4746f3f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ebfe61024043d0ad8de0a6d4387d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a8e0ab2b-f91a-44dc-9d44-7d4e08ae1c9c tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Request method failure captured: Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-hosts/n-d-850468-16/shutdown HTTP/1.1 Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRS7_8CaiImetvOFg_GqCFN0TzQyLLA3LeJkRP595zrUHZdDuRjpp_Y9E99UVoye_INCua9_3hRzdO7bGLIxiEL6kCAyLTZ9u22GKH2fjupv9im-hUXQD50usRIJbrBpqC3OQUY4NnJSf_DPXZsNxMGeKdAMNmJEqg_KGb2Oem9WsBQ Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 08ebfe61024043d0ad8de0a6d4387d75 Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08ebfe61024043d0ad8de0a6d4387d75"}]}] Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 08ebfe61024043d0ad8de0a6d4387d75 Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HostsAdminNegativeTestJSON-246413929-project Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 495a4b7aad7e4b20a01fffe4746f3f97 Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246413929-project Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'n-d-850468-16'} Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.738079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.742963 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.742963 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.742963 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:56:12.742963 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:56:12.742963 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Aug 23 17:56:12.742963 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.742963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a8e0ab2b-f91a-44dc-9d44-7d4e08ae1c9c tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.742963 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a8e0ab2b-f91a-44dc-9d44-7d4e08ae1c9c tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-d-850468-16/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.009410 Aug 23 17:56:12.742963 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 770/1456] 10.222.0.61 () {58 vars in 1197 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/os-hosts/n-d-850468-16/shutdown => generated 113 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:56:12.748560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-89d86277-dbec-44cb-9e1a-3ffe66e6cd83 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Calling method '.version_select at 0x7f27ec819ee0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.749374 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:shutdown": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:12.749374 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:12.756989 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-89d86277-dbec-44cb-9e1a-3ffe66e6cd83 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-89d86277-dbec-44cb-9e1a-3ffe66e6cd83 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Request method failure captured: Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRS8SqsS1YduBio6hNoWAeT-c0tu0ODQIiO2hPxnsThaGuYQJfbkU62bJ60tyBfz-8aKqIZPf3MiN0--5x2PKTYo2j_BBMjvFFuUfVkYOuWOe69JEOmACvOxAl1YzaJQqZj7X9U1_ES60KMtceQqcgeN3_0shYL5RByqFGdK8KKL7QI Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}] Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: ce7d8f40d4594542b2f4ac7653cca393 Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'nonexistent_hostname'} Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.758693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-89d86277-dbec-44cb-9e1a-3ffe66e6cd83 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-89d86277-dbec-44cb-9e1a-3ffe66e6cd83 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.015369 Aug 23 17:56:12.764160 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 687/1457] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:56:12.769992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ad9847d5-e16d-43e9-b937-030fc1a9b8b1 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Calling method '.version_select at 0x7f27ecaa7d30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.770994 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:12.770994 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:12.772065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ad9847d5-e16d-43e9-b937-030fc1a9b8b1 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '495a4b7aad7e4b20a01fffe4746f3f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ebfe61024043d0ad8de0a6d4387d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ad9847d5-e16d-43e9-b937-030fc1a9b8b1 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Request method failure captured: Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-hosts/n-d-850468-16/startup HTTP/1.1 Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRS7_8CaiImetvOFg_GqCFN0TzQyLLA3LeJkRP595zrUHZdDuRjpp_Y9E99UVoye_INCua9_3hRzdO7bGLIxiEL6kCAyLTZ9u22GKH2fjupv9im-hUXQD50usRIJbrBpqC3OQUY4NnJSf_DPXZsNxMGeKdAMNmJEqg_KGb2Oem9WsBQ Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 08ebfe61024043d0ad8de0a6d4387d75 Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08ebfe61024043d0ad8de0a6d4387d75"}]}] Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 08ebfe61024043d0ad8de0a6d4387d75 Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HostsAdminNegativeTestJSON-246413929-project Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 495a4b7aad7e4b20a01fffe4746f3f97 Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246413929-project Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'n-d-850468-16'} Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.773654 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.778403 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.778403 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.778403 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:56:12.778403 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:56:12.778403 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Aug 23 17:56:12.778403 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.778403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ad9847d5-e16d-43e9-b937-030fc1a9b8b1 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.778403 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ad9847d5-e16d-43e9-b937-030fc1a9b8b1 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] 10.222.0.61 "GET /compute/v2.1/os-hosts/n-d-850468-16/startup" status: 403 len: 110 microversion: 2.1 time: 0.008888 Aug 23 17:56:12.778403 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 771/1458] 10.222.0.61 () {58 vars in 1194 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/os-hosts/n-d-850468-16/startup => generated 110 bytes in 10 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:56:12.784777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5b3e754e-5ab0-4a67-b32d-a0cc30379e9e tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Calling method '.version_select at 0x7f27ec80da60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:12.785565 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:start": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:12.785565 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:12.793817 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-5b3e754e-5ab0-4a67-b32d-a0cc30379e9e tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5b3e754e-5ab0-4a67-b32d-a0cc30379e9e tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Request method failure captured: Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRS8SqsS1YduBio6hNoWAeT-c0tu0ODQIiO2hPxnsThaGuYQJfbkU62bJ60tyBfz-8aKqIZPf3MiN0--5x2PKTYo2j_BBMjvFFuUfVkYOuWOe69JEOmACvOxAl1YzaJQqZj7X9U1_ES60KMtceQqcgeN3_0shYL5RByqFGdK8KKL7QI Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}] Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: ce7d8f40d4594542b2f4ac7653cca393 Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'nonexistent_hostname'} Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.795622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5b3e754e-5ab0-4a67-b32d-a0cc30379e9e tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5b3e754e-5ab0-4a67-b32d-a0cc30379e9e tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.015834 Aug 23 17:56:12.801948 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 688/1459] 10.222.0.61 () {58 vars in 1215 bytes} [Tue Aug 23 17:56:12 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:56:12.806271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b2575304-299f-45ef-9612-0c89c965a7db tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec8f5550>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b2575304-299f-45ef-9612-0c89c965a7db tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Request method failure captured: Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: request: PUT /compute/v2.1/os-hosts/n-d-850468-16 HTTP/1.1 Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 51 Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRS8SqsS1YduBio6hNoWAeT-c0tu0ODQIiO2hPxnsThaGuYQJfbkU62bJ60tyBfz-8aKqIZPf3MiN0--5x2PKTYo2j_BBMjvFFuUfVkYOuWOe69JEOmACvOxAl1YzaJQqZj7X9U1_ES60KMtceQqcgeN3_0shYL5RByqFGdK8KKL7QI Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}] Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: ce7d8f40d4594542b2f4ac7653cca393 Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: {"status": "enable", "maintenance_mode": "invalid"} Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'n-d-850468-16', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'disable', Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'Enable', Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'Disable', Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance: Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'invalid' Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:56:12.810141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b2575304-299f-45ef-9612-0c89c965a7db tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b2575304-299f-45ef-9612-0c89c965a7db tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-hosts/n-d-850468-16" status: 400 len: 199 microversion: 2.1 time: 0.008959 Aug 23 17:56:12.815264 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 772/1460] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Aug 23 17:56:12 2022] PUT /compute/v2.1/os-hosts/n-d-850468-16 => generated 199 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 17:56:12.820374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-208c8ac1-813b-409b-9b40-76aff47339ac tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Action: 'update', calling method: .version_select at 0x7f27ecd46310>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-208c8ac1-813b-409b-9b40-76aff47339ac tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Request method failure captured: Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: request: PUT /compute/v2.1/os-hosts/n-d-850468-16 HTTP/1.1 Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 51 Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRS8SqsS1YduBio6hNoWAeT-c0tu0ODQIiO2hPxnsThaGuYQJfbkU62bJ60tyBfz-8aKqIZPf3MiN0--5x2PKTYo2j_BBMjvFFuUfVkYOuWOe69JEOmACvOxAl1YzaJQqZj7X9U1_ES60KMtceQqcgeN3_0shYL5RByqFGdK8KKL7QI Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}] Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: ce7d8f40d4594542b2f4ac7653cca393 Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: {"status": "invalid", "maintenance_mode": "enable"} Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'n-d-850468-16', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'disable', Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'Enable', Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'Disable', Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance: Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'invalid' Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:56:12.824182 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-208c8ac1-813b-409b-9b40-76aff47339ac tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-208c8ac1-813b-409b-9b40-76aff47339ac tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-hosts/n-d-850468-16" status: 400 len: 189 microversion: 2.1 time: 0.009355 Aug 23 17:56:12.829876 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 689/1461] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Aug 23 17:56:12 2022] PUT /compute/v2.1/os-hosts/n-d-850468-16 => generated 189 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 17:56:12.838203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e16cb84-b495-4307-8f30-1db7567b6f30 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Action: 'update', calling method: .version_select at 0x7f27ec9d2ee0>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:12.841477 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hosts:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:12.841477 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:12.842679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2e16cb84-b495-4307-8f30-1db7567b6f30 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '495a4b7aad7e4b20a01fffe4746f3f97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08ebfe61024043d0ad8de0a6d4387d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e16cb84-b495-4307-8f30-1db7567b6f30 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Request method failure captured: Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: request: PUT /compute/v2.1/os-hosts/n-d-850468-16 HTTP/1.1 Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 50 Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRS7_8CaiImetvOFg_GqCFN0TzQyLLA3LeJkRP595zrUHZdDuRjpp_Y9E99UVoye_INCua9_3hRzdO7bGLIxiEL6kCAyLTZ9u22GKH2fjupv9im-hUXQD50usRIJbrBpqC3OQUY4NnJSf_DPXZsNxMGeKdAMNmJEqg_KGb2Oem9WsBQ Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 08ebfe61024043d0ad8de0a6d4387d75 Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/08ebfe61024043d0ad8de0a6d4387d75"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/08ebfe61024043d0ad8de0a6d4387d75"}]}] Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 08ebfe61024043d0ad8de0a6d4387d75 Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-246413929 Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HostsAdminNegativeTestJSON-246413929-project Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 495a4b7aad7e4b20a01fffe4746f3f97 Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-246413929-project Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: {"status": "enable", "maintenance_mode": "enable"} Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'n-d-850468-16', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 23 17:56:12.844265 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.849058 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.849058 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.849058 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.849058 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.849058 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.849058 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:56:12.849058 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:56:12.849058 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Aug 23 17:56:12.849058 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.849058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e16cb84-b495-4307-8f30-1db7567b6f30 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.849058 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e16cb84-b495-4307-8f30-1db7567b6f30 tempest-HostsAdminNegativeTestJSON-246413929 tempest-HostsAdminNegativeTestJSON-246413929-project] 10.222.0.61 "PUT /compute/v2.1/os-hosts/n-d-850468-16" status: 403 len: 111 microversion: 2.1 time: 0.011074 Aug 23 17:56:12.849058 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 773/1462] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Aug 23 17:56:12 2022] PUT /compute/v2.1/os-hosts/n-d-850468-16 => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:56:12.854325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6f08b5cf-c11d-4bd9-9d91-b9de0e83d6c5 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec7b9430>, body: {"status": null, "maintenance_mode": null} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6f08b5cf-c11d-4bd9-9d91-b9de0e83d6c5 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Request method failure captured: Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: request: PUT /compute/v2.1/os-hosts/n-d-850468-16 HTTP/1.1 Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 42 Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRS8SqsS1YduBio6hNoWAeT-c0tu0ODQIiO2hPxnsThaGuYQJfbkU62bJ60tyBfz-8aKqIZPf3MiN0--5x2PKTYo2j_BBMjvFFuUfVkYOuWOe69JEOmACvOxAl1YzaJQqZj7X9U1_ES60KMtceQqcgeN3_0shYL5RByqFGdK8KKL7QI Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}] Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: ce7d8f40d4594542b2f4ac7653cca393 Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: {"status": null, "maintenance_mode": null} Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'n-d-850468-16', 'body': {'status': None, 'maintenance_mode': None}} Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'disable', Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'Enable', Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'Disable', Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'ENABLE', Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'DISABLE'], Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'type': 'string'} Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance: Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi None Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 17:56:12.858691 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6f08b5cf-c11d-4bd9-9d91-b9de0e83d6c5 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6f08b5cf-c11d-4bd9-9d91-b9de0e83d6c5 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-hosts/n-d-850468-16" status: 400 len: 127 microversion: 2.1 time: 0.009267 Aug 23 17:56:12.864545 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 690/1463] 10.222.0.61 () {60 vars in 1190 bytes} [Tue Aug 23 17:56:12 2022] PUT /compute/v2.1/os-hosts/n-d-850468-16 => generated 127 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:56:12.869507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-553de8f5-1129-4cea-9946-385366588e19 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Action: 'update', calling method: .version_select at 0x7f27ecb25e50>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:12.873520 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.hosts [None req-553de8f5-1129-4cea-9946-385366588e19 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Enabling host nonexistent_hostname. Aug 23 17:56:12.881715 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-553de8f5-1129-4cea-9946-385366588e19 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-553de8f5-1129-4cea-9946-385366588e19 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Request method failure captured: Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 50 Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRS8SqsS1YduBio6hNoWAeT-c0tu0ODQIiO2hPxnsThaGuYQJfbkU62bJ60tyBfz-8aKqIZPf3MiN0--5x2PKTYo2j_BBMjvFFuUfVkYOuWOe69JEOmACvOxAl1YzaJQqZj7X9U1_ES60KMtceQqcgeN3_0shYL5RByqFGdK8KKL7QI Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d5e0e2231404a119288638f5ba5592f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d5e0e2231404a119288638f5ba5592f"}]}] Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 2d5e0e2231404a119288638f5ba5592f Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-583333111 Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: ce7d8f40d4594542b2f4ac7653cca393 Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-HostsAdminNegativeTestJSON-583333111-project-admin Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: {"status": "enable", "maintenance_mode": "enable"} Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: exception: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5985, in targeted Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.883708 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-553de8f5-1129-4cea-9946-385366588e19 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-553de8f5-1129-4cea-9946-385366588e19 tempest-HostsAdminNegativeTestJSON-583333111 tempest-HostsAdminNegativeTestJSON-583333111-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.019155 Aug 23 17:56:12.888712 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 774/1464] 10.222.0.61 () {60 vars in 1211 bytes} [Tue Aug 23 17:56:12 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 17:56:13.187525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcf31a2e-0837-4eca-8dd1-89905a17beaf tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:13.188173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fcf31a2e-0837-4eca-8dd1-89905a17beaf tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:13.194156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcf31a2e-0837-4eca-8dd1-89905a17beaf tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:13.194681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcf31a2e-0837-4eca-8dd1-89905a17beaf tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:13.195123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcf31a2e-0837-4eca-8dd1-89905a17beaf tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:13.195826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcf31a2e-0837-4eca-8dd1-89905a17beaf tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:13.196281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcf31a2e-0837-4eca-8dd1-89905a17beaf tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:13.196708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcf31a2e-0837-4eca-8dd1-89905a17beaf tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:13.247882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ed2ab41-f179-48b8-850b-6d13ebaa879f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:13.248501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2ed2ab41-f179-48b8-850b-6d13ebaa879f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:13.255361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ed2ab41-f179-48b8-850b-6d13ebaa879f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:13.255855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ed2ab41-f179-48b8-850b-6d13ebaa879f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:13.256298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ed2ab41-f179-48b8-850b-6d13ebaa879f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:13.257182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ed2ab41-f179-48b8-850b-6d13ebaa879f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:13.257818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ed2ab41-f179-48b8-850b-6d13ebaa879f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:13.258249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ed2ab41-f179-48b8-850b-6d13ebaa879f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:13.349529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fcf31a2e-0837-4eca-8dd1-89905a17beaf tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:13.359092 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fcf31a2e-0837-4eca-8dd1-89905a17beaf tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1534 microversion: 2.1 time: 0.176452 Aug 23 17:56:13.359825 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 691/1465] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:13 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1534 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:13.487558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2ed2ab41-f179-48b8-850b-6d13ebaa879f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:13.504117 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2ed2ab41-f179-48b8-850b-6d13ebaa879f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.260234 Aug 23 17:56:13.504623 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 775/1466] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:13 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:13.680243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-11083faf-9576-41bc-819e-895510f247d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:13.681017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-11083faf-9576-41bc-819e-895510f247d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:13.689063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11083faf-9576-41bc-819e-895510f247d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:13.689647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11083faf-9576-41bc-819e-895510f247d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:13.690255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11083faf-9576-41bc-819e-895510f247d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:13.690978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d87214d8-ddb9-4d59-8380-05adf01bb8e6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:13.691094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11083faf-9576-41bc-819e-895510f247d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:13.691578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11083faf-9576-41bc-819e-895510f247d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:13.691677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d87214d8-ddb9-4d59-8380-05adf01bb8e6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:13.692140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11083faf-9576-41bc-819e-895510f247d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:13.701679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d87214d8-ddb9-4d59-8380-05adf01bb8e6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:13.702674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d87214d8-ddb9-4d59-8380-05adf01bb8e6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:13.703180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d87214d8-ddb9-4d59-8380-05adf01bb8e6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:13.703951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d87214d8-ddb9-4d59-8380-05adf01bb8e6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:13.704422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d87214d8-ddb9-4d59-8380-05adf01bb8e6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:13.704922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d87214d8-ddb9-4d59-8380-05adf01bb8e6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:13.781554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d87214d8-ddb9-4d59-8380-05adf01bb8e6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:13.791555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d87214d8-ddb9-4d59-8380-05adf01bb8e6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:13.793454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d87214d8-ddb9-4d59-8380-05adf01bb8e6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:13.794996 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d87214d8-ddb9-4d59-8380-05adf01bb8e6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1357 microversion: 2.54 time: 0.109453 Aug 23 17:56:13.795590 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 776/1467] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:13 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1357 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:13.821554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4f42c27f-791e-4701-917d-801ad00cf71c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Action: 'create', calling method: .version_select at 0x7f27ecb258b0>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-565264260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDE2YR8PNAPZR++Ft15SUeS6KK0MyHmFcloihAYQT7aWEiu9E1UAb2EM49n07xmh6OHE99jwWJiRrlFTJu2/BlBp+f3UAAEHdESlgFokm2GaZxLCjmi6c9bcF8N0DH54Sg=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:13.837609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-11083faf-9576-41bc-819e-895510f247d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:13.838379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4f42c27f-791e-4701-917d-801ad00cf71c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Getting quotas for project 926d2ad9800d41eb81071b27bce06c65. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:56:13.843878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4f42c27f-791e-4701-917d-801ad00cf71c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Getting quotas for user b27854e33223429ab8652c8187618305 and project 926d2ad9800d41eb81071b27bce06c65. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:56:13.847833 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-11083faf-9576-41bc-819e-895510f247d6 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.171605 Aug 23 17:56:13.848715 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 692/1468] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:13 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:13.869638 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4f42c27f-791e-4701-917d-801ad00cf71c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.54 time: 0.052518 Aug 23 17:56:13.870695 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 777/1469] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Aug 23 17:56:13 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 23 17:56:13.882128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-565264260", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:13.885071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:13.891737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:13.892230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:13.892672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:13.893376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:13.893836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:13.894265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:13.978677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:56:13.979256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:56:13.979740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:56:13.980481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:56:13.981453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:56:14.072571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:14.081381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:14.082464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:14.083236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:14.084204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:14.085798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:14.086243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:14.123185 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e2353cb4-5afb-4931-afad-f91070e19ff3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "POST /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f/action" status: 202 len: 1139 microversion: 2.54 time: 0.244785 Aug 23 17:56:14.134523 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 693/1470] 10.222.0.61 () {62 vars in 1320 bytes} [Tue Aug 23 17:56:13 2022] POST /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f/action => generated 1139 bytes in 246 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 23 17:56:14.146684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b97ee1e2-a51c-4287-9cdc-9309be733fc2 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:14.147333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b97ee1e2-a51c-4287-9cdc-9309be733fc2 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:14.154100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b97ee1e2-a51c-4287-9cdc-9309be733fc2 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:14.154559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b97ee1e2-a51c-4287-9cdc-9309be733fc2 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:14.155346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b97ee1e2-a51c-4287-9cdc-9309be733fc2 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:14.156134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b97ee1e2-a51c-4287-9cdc-9309be733fc2 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:14.156597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b97ee1e2-a51c-4287-9cdc-9309be733fc2 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:14.157030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b97ee1e2-a51c-4287-9cdc-9309be733fc2 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:14.246952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b97ee1e2-a51c-4287-9cdc-9309be733fc2 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:14.259570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b97ee1e2-a51c-4287-9cdc-9309be733fc2 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:14.261746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b97ee1e2-a51c-4287-9cdc-9309be733fc2 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:14.263800 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b97ee1e2-a51c-4287-9cdc-9309be733fc2 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.121498 Aug 23 17:56:14.264397 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 778/1471] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:14 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:14.381752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5de9fcf9-01fb-41d5-8400-8d7353d88366 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:14.382791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5de9fcf9-01fb-41d5-8400-8d7353d88366 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:14.392025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5de9fcf9-01fb-41d5-8400-8d7353d88366 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:14.393208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5de9fcf9-01fb-41d5-8400-8d7353d88366 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:14.393882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5de9fcf9-01fb-41d5-8400-8d7353d88366 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:14.395207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5de9fcf9-01fb-41d5-8400-8d7353d88366 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:14.395911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5de9fcf9-01fb-41d5-8400-8d7353d88366 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:14.396413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5de9fcf9-01fb-41d5-8400-8d7353d88366 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:14.525751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed354ce9-2f8c-415e-920a-74bf05d58671 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:14.529520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ed354ce9-2f8c-415e-920a-74bf05d58671 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:14.539839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed354ce9-2f8c-415e-920a-74bf05d58671 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:14.540343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed354ce9-2f8c-415e-920a-74bf05d58671 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:14.540868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed354ce9-2f8c-415e-920a-74bf05d58671 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:14.541769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed354ce9-2f8c-415e-920a-74bf05d58671 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:14.542390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed354ce9-2f8c-415e-920a-74bf05d58671 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:14.542860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed354ce9-2f8c-415e-920a-74bf05d58671 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:14.551454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5de9fcf9-01fb-41d5-8400-8d7353d88366 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:14.561963 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5de9fcf9-01fb-41d5-8400-8d7353d88366 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1540 microversion: 2.1 time: 0.184362 Aug 23 17:56:14.562660 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 694/1472] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:14 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1540 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:14.714702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ed354ce9-2f8c-415e-920a-74bf05d58671 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:14.718920 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ed354ce9-2f8c-415e-920a-74bf05d58671 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.197767 Aug 23 17:56:14.719690 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 779/1473] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:14 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:14.868416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f958f02-9b9c-467a-a1e8-a1d2d9c12867 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:14.869033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8f958f02-9b9c-467a-a1e8-a1d2d9c12867 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:14.875633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f958f02-9b9c-467a-a1e8-a1d2d9c12867 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:14.876124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f958f02-9b9c-467a-a1e8-a1d2d9c12867 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:14.876564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f958f02-9b9c-467a-a1e8-a1d2d9c12867 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:14.877345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f958f02-9b9c-467a-a1e8-a1d2d9c12867 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:14.877770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f958f02-9b9c-467a-a1e8-a1d2d9c12867 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:14.878161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f958f02-9b9c-467a-a1e8-a1d2d9c12867 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:15.051231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8f958f02-9b9c-467a-a1e8-a1d2d9c12867 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:15.061779 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f958f02-9b9c-467a-a1e8-a1d2d9c12867 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.197089 Aug 23 17:56:15.062741 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 695/1474] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:14 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:15.289583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6dc632c0-01e2-4261-b79e-8d00ae7836d3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:15.290195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6dc632c0-01e2-4261-b79e-8d00ae7836d3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:15.297603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dc632c0-01e2-4261-b79e-8d00ae7836d3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:15.298086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dc632c0-01e2-4261-b79e-8d00ae7836d3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:15.298516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dc632c0-01e2-4261-b79e-8d00ae7836d3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:15.299365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dc632c0-01e2-4261-b79e-8d00ae7836d3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:15.299822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dc632c0-01e2-4261-b79e-8d00ae7836d3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:15.300252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dc632c0-01e2-4261-b79e-8d00ae7836d3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:15.382362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6dc632c0-01e2-4261-b79e-8d00ae7836d3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:15.393765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6dc632c0-01e2-4261-b79e-8d00ae7836d3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:15.395533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6dc632c0-01e2-4261-b79e-8d00ae7836d3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:15.397041 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6dc632c0-01e2-4261-b79e-8d00ae7836d3 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.111745 Aug 23 17:56:15.397763 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 780/1475] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:15 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:15.584532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b20bf454-5865-4b96-900a-69c7f9fd2063 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:15.585822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b20bf454-5865-4b96-900a-69c7f9fd2063 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:15.592818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b20bf454-5865-4b96-900a-69c7f9fd2063 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:15.593309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b20bf454-5865-4b96-900a-69c7f9fd2063 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:15.593857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b20bf454-5865-4b96-900a-69c7f9fd2063 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:15.594861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b20bf454-5865-4b96-900a-69c7f9fd2063 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:15.595327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b20bf454-5865-4b96-900a-69c7f9fd2063 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:15.595758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b20bf454-5865-4b96-900a-69c7f9fd2063 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:15.748628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e18f0c64-e83c-4a80-884c-87a7057e4635 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:15.749371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e18f0c64-e83c-4a80-884c-87a7057e4635 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:15.769721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f0c64-e83c-4a80-884c-87a7057e4635 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:15.770465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f0c64-e83c-4a80-884c-87a7057e4635 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:15.770956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f0c64-e83c-4a80-884c-87a7057e4635 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:15.773709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f0c64-e83c-4a80-884c-87a7057e4635 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:15.773709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f0c64-e83c-4a80-884c-87a7057e4635 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:15.775199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f0c64-e83c-4a80-884c-87a7057e4635 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:15.805132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b20bf454-5865-4b96-900a-69c7f9fd2063 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:15.819339 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b20bf454-5865-4b96-900a-69c7f9fd2063 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1540 microversion: 2.1 time: 0.238922 Aug 23 17:56:15.821355 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 696/1476] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:15 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1540 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:15.982776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e18f0c64-e83c-4a80-884c-87a7057e4635 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:15.992708 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e18f0c64-e83c-4a80-884c-87a7057e4635 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.255559 Aug 23 17:56:15.993906 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 781/1477] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:15 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:16.083570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-540c9efd-e8f5-4c2a-94aa-dda57efeea59 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:16.084315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-540c9efd-e8f5-4c2a-94aa-dda57efeea59 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:16.085321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f5f67849-3bac-4d32-94e4-e08dd6d2b58b tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Action: 'create', calling method: .version_select at 0x7f27ec81fca0>, body: {"keypair": {"name": "tempest-keypair-814040318", "type": "ssh", "user_id": "f8c74461a01945b1bed88907222562f6", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG7oWI0d+QnywW/4LDszI82dI65MRRlXOEUrihmPUpDHiFUHsPEMK7b5ZNMth/DOCBJVIzLRoKGbs1oA0nuNyBirvWf6oGSqi2Pc2kbI6IuBphlSOIoRF+PWeWrHKkihVw=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:16.091603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-540c9efd-e8f5-4c2a-94aa-dda57efeea59 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:16.092179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-540c9efd-e8f5-4c2a-94aa-dda57efeea59 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:16.092686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-540c9efd-e8f5-4c2a-94aa-dda57efeea59 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:16.093477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-540c9efd-e8f5-4c2a-94aa-dda57efeea59 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:16.094301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-540c9efd-e8f5-4c2a-94aa-dda57efeea59 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:16.094774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-540c9efd-e8f5-4c2a-94aa-dda57efeea59 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:16.101687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f5f67849-3bac-4d32-94e4-e08dd6d2b58b tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Getting quotas for project 7b86328093e74fd1bcf41be4ef39ca70. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:56:16.106981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f5f67849-3bac-4d32-94e4-e08dd6d2b58b tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Getting quotas for user 55f7c1393144409295ada0e908428b9c and project 7b86328093e74fd1bcf41be4ef39ca70. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:56:16.133867 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f5f67849-3bac-4d32-94e4-e08dd6d2b58b tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.199249 Aug 23 17:56:16.142720 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 697/1478] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Aug 23 17:56:15 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 201 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 23 17:56:16.148440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bcfa3bab-17d0-4483-b5ae-3dec8c3f12b7 tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Action: 'create', calling method: .version_select at 0x7f27ec8451f0>, body: {"keypair": {"name": "tempest-keypair-1355466091", "type": "ssh", "user_id": "f8c74461a01945b1bed88907222562f6", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOPja1LL7rdUZyzAbz8O9H6/SH2EkSGO/em8YuLcs/k4QnUU/75ZVSzSadfXb+8sNQX94qVn3lF4bYRyIzacbaaissiVI8jZ16t4qi2LoMrj/PmIiH0pfLCkKGusjR4Ag=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:16.165781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-bcfa3bab-17d0-4483-b5ae-3dec8c3f12b7 tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Getting quotas for project 7b86328093e74fd1bcf41be4ef39ca70. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:56:16.171661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-bcfa3bab-17d0-4483-b5ae-3dec8c3f12b7 tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Getting quotas for user 55f7c1393144409295ada0e908428b9c and project 7b86328093e74fd1bcf41be4ef39ca70. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:56:16.201521 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bcfa3bab-17d0-4483-b5ae-3dec8c3f12b7 tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.057533 Aug 23 17:56:16.202326 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 698/1479] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Aug 23 17:56:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 59 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 23 17:56:16.213033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f55f61f8-a34d-4e42-9685-0f772951b6ea tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Calling method '.version_select at 0x7f27ec75ab80>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:16.225046 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f55f61f8-a34d-4e42-9685-0f772951b6ea tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-814040318?user_id=f8c74461a01945b1bed88907222562f6" status: 200 len: 512 microversion: 2.10 time: 0.016041 Aug 23 17:56:16.226505 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 699/1480] 10.222.0.61 () {60 vars in 1337 bytes} [Tue Aug 23 17:56:16 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-814040318?user_id=f8c74461a01945b1bed88907222562f6 => generated 512 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 17:56:16.242666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b3af1c4e-b6ee-4dc9-b7e9-9f23ae28f04e tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Action: 'create', calling method: .version_select at 0x7f27ec6ff040>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-212944509", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA5JmcFyTKVAKfWb984QZRf56MVqbr/81nqQRmVRT5jEyDaU++ViHC3rkuqS1wsU0+PIiqTPJh//rcmeReLJ03dhGoHUtcGuSn3fPcJ/wX4dEJUfPt+o5OppylLwHtYLjA=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:16.250124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-540c9efd-e8f5-4c2a-94aa-dda57efeea59 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:16.253649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:16.259845 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-540c9efd-e8f5-4c2a-94aa-dda57efeea59 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.180280 Aug 23 17:56:16.273383 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 782/1481] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:16 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:16.274592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-b3af1c4e-b6ee-4dc9-b7e9-9f23ae28f04e tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Getting quotas for project 7b86328093e74fd1bcf41be4ef39ca70. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:56:16.274592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-b3af1c4e-b6ee-4dc9-b7e9-9f23ae28f04e tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Getting quotas for user 55f7c1393144409295ada0e908428b9c and project 7b86328093e74fd1bcf41be4ef39ca70. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:56:16.295713 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b3af1c4e-b6ee-4dc9-b7e9-9f23ae28f04e tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.057799 Aug 23 17:56:16.296807 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 700/1482] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Aug 23 17:56:16 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 23 17:56:16.308913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93baf9ab-7543-467d-9cb7-8207ae182a58 tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Calling method '.version_select at 0x7f27ecadd1f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:16.314631 n-d-850468-16 devstack@n-api.service[128807]: WARNING oslo_db.sqlalchemy.utils [None req-93baf9ab-7543-467d-9cb7-8207ae182a58 tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Aug 23 17:56:16.322062 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93baf9ab-7543-467d-9cb7-8207ae182a58 tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] 10.222.0.61 "GET /compute/v2.1/os-keypairs?user_id=f8c74461a01945b1bed88907222562f6" status: 200 len: 725 microversion: 2.10 time: 0.017777 Aug 23 17:56:16.322872 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 783/1483] 10.222.0.61 () {60 vars in 1259 bytes} [Tue Aug 23 17:56:16 2022] GET /compute/v2.1/os-keypairs?user_id=f8c74461a01945b1bed88907222562f6 => generated 725 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:56:16.335736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-feb53d71-d6cc-440a-9e7d-4480ec0c569b tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Calling method '.version_select at 0x7f27ec819dc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:16.357915 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-feb53d71-d6cc-440a-9e7d-4480ec0c569b tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-212944509" status: 204 len: 0 microversion: 2.10 time: 0.027718 Aug 23 17:56:16.358507 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 701/1484] 10.222.0.61 () {60 vars in 1322 bytes} [Tue Aug 23 17:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-212944509 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:56:16.366757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25e5667c-92cb-4dd1-b6c2-3f1756ce1934 tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Calling method '.version_select at 0x7f27ecb80160>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:16.387983 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-25e5667c-92cb-4dd1-b6c2-3f1756ce1934 tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355466091?user_id=f8c74461a01945b1bed88907222562f6" status: 204 len: 0 microversion: 2.10 time: 0.024329 Aug 23 17:56:16.388570 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 784/1485] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 17:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355466091?user_id=f8c74461a01945b1bed88907222562f6 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:56:16.396952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-17cd0d8a-295d-4a8e-bd4d-91484261f3c3 tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] Calling method '.version_select at 0x7f27ec82d5e0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:16.419966 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-17cd0d8a-295d-4a8e-bd4d-91484261f3c3 tempest-KeyPairsV210TestJSON-792980725 tempest-KeyPairsV210TestJSON-792980725-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-814040318?user_id=f8c74461a01945b1bed88907222562f6" status: 204 len: 0 microversion: 2.10 time: 0.026630 Aug 23 17:56:16.421236 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 702/1486] 10.222.0.61 () {60 vars in 1340 bytes} [Tue Aug 23 17:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-814040318?user_id=f8c74461a01945b1bed88907222562f6 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:56:16.427418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a16fa5f9-f1f5-466d-a44d-508aa5a1c593 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:16.428208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a16fa5f9-f1f5-466d-a44d-508aa5a1c593 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:16.435514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a16fa5f9-f1f5-466d-a44d-508aa5a1c593 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:16.435990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a16fa5f9-f1f5-466d-a44d-508aa5a1c593 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:16.436552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a16fa5f9-f1f5-466d-a44d-508aa5a1c593 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:16.437485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a16fa5f9-f1f5-466d-a44d-508aa5a1c593 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:16.438089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a16fa5f9-f1f5-466d-a44d-508aa5a1c593 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:16.438521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a16fa5f9-f1f5-466d-a44d-508aa5a1c593 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:16.512132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a16fa5f9-f1f5-466d-a44d-508aa5a1c593 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:16.520552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a16fa5f9-f1f5-466d-a44d-508aa5a1c593 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:16.522052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a16fa5f9-f1f5-466d-a44d-508aa5a1c593 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:16.523244 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a16fa5f9-f1f5-466d-a44d-508aa5a1c593 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.102088 Aug 23 17:56:16.523799 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 785/1487] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:16 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:56:16.721327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-a2a0bff5-6987-477b-b322-75a61b573e68 req-8524ff96-feeb-436b-bfcf-93dc8a46de5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dff523f-5032-42ec-abcb-2266d1aee875", "name": "network-vif-plugged", "status": "completed", "tag": "d44e5ac7-af43-486c-8d73-1db70e5d0340"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:16.731377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a2a0bff5-6987-477b-b322-75a61b573e68 req-8524ff96-feeb-436b-bfcf-93dc8a46de5a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:16.732146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a2a0bff5-6987-477b-b322-75a61b573e68 req-8524ff96-feeb-436b-bfcf-93dc8a46de5a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:16.732999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a2a0bff5-6987-477b-b322-75a61b573e68 req-8524ff96-feeb-436b-bfcf-93dc8a46de5a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:16.745362 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-a2a0bff5-6987-477b-b322-75a61b573e68 req-8524ff96-feeb-436b-bfcf-93dc8a46de5a service nova] Creating event network-vif-plugged:d44e5ac7-af43-486c-8d73-1db70e5d0340 for instance 9dff523f-5032-42ec-abcb-2266d1aee875 on n-h2-850468-16 Aug 23 17:56:16.750788 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-a2a0bff5-6987-477b-b322-75a61b573e68 req-8524ff96-feeb-436b-bfcf-93dc8a46de5a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033517 Aug 23 17:56:16.751742 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 703/1488] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:16.844423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ac18aac9-466a-4cb7-8cbb-6a401409e014 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:16.845208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ac18aac9-466a-4cb7-8cbb-6a401409e014 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:16.854571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac18aac9-466a-4cb7-8cbb-6a401409e014 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:16.857314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac18aac9-466a-4cb7-8cbb-6a401409e014 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:16.857832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac18aac9-466a-4cb7-8cbb-6a401409e014 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:16.858582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac18aac9-466a-4cb7-8cbb-6a401409e014 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:16.859040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac18aac9-466a-4cb7-8cbb-6a401409e014 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:16.859462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac18aac9-466a-4cb7-8cbb-6a401409e014 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:17.019208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a768f5d5-e1cd-41e3-9312-e4d0044d63f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:17.019908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a768f5d5-e1cd-41e3-9312-e4d0044d63f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:17.026108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a768f5d5-e1cd-41e3-9312-e4d0044d63f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:17.026621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a768f5d5-e1cd-41e3-9312-e4d0044d63f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:17.027055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a768f5d5-e1cd-41e3-9312-e4d0044d63f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:17.028329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a768f5d5-e1cd-41e3-9312-e4d0044d63f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:17.028847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a768f5d5-e1cd-41e3-9312-e4d0044d63f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:17.029267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a768f5d5-e1cd-41e3-9312-e4d0044d63f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:17.063953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ac18aac9-466a-4cb7-8cbb-6a401409e014 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:17.072250 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ac18aac9-466a-4cb7-8cbb-6a401409e014 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1540 microversion: 2.1 time: 0.232972 Aug 23 17:56:17.073133 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 786/1489] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:16 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1540 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:17.146448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:17.233432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a768f5d5-e1cd-41e3-9312-e4d0044d63f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:17.241225 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a768f5d5-e1cd-41e3-9312-e4d0044d63f3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.226867 Aug 23 17:56:17.241795 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 704/1490] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:17 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:17.281995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-876cd1f3-eb2c-4200-a2d7-b1dd0a55d1c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:17.282914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-876cd1f3-eb2c-4200-a2d7-b1dd0a55d1c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:17.287079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SAVEPOINT=2,nova_api:RELEASE=2,nova_api:UPDATE=2,nova_api:SELECT=92,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:17.292016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-876cd1f3-eb2c-4200-a2d7-b1dd0a55d1c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:17.292588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-876cd1f3-eb2c-4200-a2d7-b1dd0a55d1c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:17.293285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-876cd1f3-eb2c-4200-a2d7-b1dd0a55d1c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:17.294118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-876cd1f3-eb2c-4200-a2d7-b1dd0a55d1c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:17.294572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-876cd1f3-eb2c-4200-a2d7-b1dd0a55d1c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:17.295005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-876cd1f3-eb2c-4200-a2d7-b1dd0a55d1c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:17.433821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-876cd1f3-eb2c-4200-a2d7-b1dd0a55d1c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:17.442446 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-876cd1f3-eb2c-4200-a2d7-b1dd0a55d1c5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.165588 Aug 23 17:56:17.443094 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 787/1491] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:17 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:17.547323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8c6bae73-adbd-497a-a5cc-b67c7f5869d5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:17.547936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8c6bae73-adbd-497a-a5cc-b67c7f5869d5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:17.554436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c6bae73-adbd-497a-a5cc-b67c7f5869d5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:17.555181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c6bae73-adbd-497a-a5cc-b67c7f5869d5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:17.555819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c6bae73-adbd-497a-a5cc-b67c7f5869d5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:17.556822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c6bae73-adbd-497a-a5cc-b67c7f5869d5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:17.557281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c6bae73-adbd-497a-a5cc-b67c7f5869d5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:17.557723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c6bae73-adbd-497a-a5cc-b67c7f5869d5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:17.576078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:17.636784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8c6bae73-adbd-497a-a5cc-b67c7f5869d5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:17.645711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8c6bae73-adbd-497a-a5cc-b67c7f5869d5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:17.647599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8c6bae73-adbd-497a-a5cc-b67c7f5869d5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:17.648777 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8c6bae73-adbd-497a-a5cc-b67c7f5869d5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.106445 Aug 23 17:56:17.649327 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 705/1492] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:17 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:18.093735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-efe0fb36-609a-496c-a658-157544ac7604 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:18.094764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-efe0fb36-609a-496c-a658-157544ac7604 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:18.101362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efe0fb36-609a-496c-a658-157544ac7604 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:18.101846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efe0fb36-609a-496c-a658-157544ac7604 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:18.102410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efe0fb36-609a-496c-a658-157544ac7604 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:18.103327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efe0fb36-609a-496c-a658-157544ac7604 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:18.103782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efe0fb36-609a-496c-a658-157544ac7604 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:18.104214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efe0fb36-609a-496c-a658-157544ac7604 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:18.250106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-efe0fb36-609a-496c-a658-157544ac7604 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:18.258244 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-efe0fb36-609a-496c-a658-157544ac7604 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1540 microversion: 2.1 time: 0.168892 Aug 23 17:56:18.263422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-977d79e7-f686-4a29-af7f-554ede0b1c2d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:18.264039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-977d79e7-f686-4a29-af7f-554ede0b1c2d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:18.267706 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 788/1493] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:18 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1540 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:18.276385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-977d79e7-f686-4a29-af7f-554ede0b1c2d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:18.276907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-977d79e7-f686-4a29-af7f-554ede0b1c2d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:18.278041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-977d79e7-f686-4a29-af7f-554ede0b1c2d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:18.278951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-977d79e7-f686-4a29-af7f-554ede0b1c2d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:18.279418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-977d79e7-f686-4a29-af7f-554ede0b1c2d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:18.279852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-977d79e7-f686-4a29-af7f-554ede0b1c2d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:18.415418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-977d79e7-f686-4a29-af7f-554ede0b1c2d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:18.424001 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-977d79e7-f686-4a29-af7f-554ede0b1c2d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.164449 Aug 23 17:56:18.424575 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 706/1494] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:18 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:18.463648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2280556a-a69c-4164-a503-215647ebf514 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:18.464384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2280556a-a69c-4164-a503-215647ebf514 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:18.470838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2280556a-a69c-4164-a503-215647ebf514 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:18.471319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2280556a-a69c-4164-a503-215647ebf514 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:18.471762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2280556a-a69c-4164-a503-215647ebf514 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:18.472463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2280556a-a69c-4164-a503-215647ebf514 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:18.472915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2280556a-a69c-4164-a503-215647ebf514 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:18.473342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2280556a-a69c-4164-a503-215647ebf514 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:18.611193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2280556a-a69c-4164-a503-215647ebf514 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:18.620893 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2280556a-a69c-4164-a503-215647ebf514 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.160678 Aug 23 17:56:18.623163 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 789/1495] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:18 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:18.672984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0aef2d56-25ae-41e2-9e45-b05774bc256a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:18.673542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0aef2d56-25ae-41e2-9e45-b05774bc256a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:18.679629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aef2d56-25ae-41e2-9e45-b05774bc256a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:18.679942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aef2d56-25ae-41e2-9e45-b05774bc256a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:18.680376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aef2d56-25ae-41e2-9e45-b05774bc256a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:18.681066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aef2d56-25ae-41e2-9e45-b05774bc256a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:18.681512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aef2d56-25ae-41e2-9e45-b05774bc256a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:18.681933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aef2d56-25ae-41e2-9e45-b05774bc256a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:18.747593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0aef2d56-25ae-41e2-9e45-b05774bc256a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:18.758283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0aef2d56-25ae-41e2-9e45-b05774bc256a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:18.759826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0aef2d56-25ae-41e2-9e45-b05774bc256a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:18.761005 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0aef2d56-25ae-41e2-9e45-b05774bc256a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.092617 Aug 23 17:56:18.761570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 707/1496] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:18 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:19.288475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a06ac59d-7be9-47c1-b19d-34f7635effa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:19.289958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a06ac59d-7be9-47c1-b19d-34f7635effa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:19.297966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a06ac59d-7be9-47c1-b19d-34f7635effa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:19.298560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a06ac59d-7be9-47c1-b19d-34f7635effa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:19.299078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a06ac59d-7be9-47c1-b19d-34f7635effa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:19.299880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a06ac59d-7be9-47c1-b19d-34f7635effa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:19.300131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0af7fa05-5b2b-4b24-bd8e-12f978dbeba4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "dfe2be37-7017-4b1f-97f2-849c75f8c943"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:19.300581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a06ac59d-7be9-47c1-b19d-34f7635effa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:19.300966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a06ac59d-7be9-47c1-b19d-34f7635effa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:19.303550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0af7fa05-5b2b-4b24-bd8e-12f978dbeba4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:19.309726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0af7fa05-5b2b-4b24-bd8e-12f978dbeba4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:19.310418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0af7fa05-5b2b-4b24-bd8e-12f978dbeba4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:19.310929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0af7fa05-5b2b-4b24-bd8e-12f978dbeba4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:19.311789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0af7fa05-5b2b-4b24-bd8e-12f978dbeba4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:19.312257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0af7fa05-5b2b-4b24-bd8e-12f978dbeba4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:19.312688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0af7fa05-5b2b-4b24-bd8e-12f978dbeba4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:19.452869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a06ac59d-7be9-47c1-b19d-34f7635effa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:19.461727 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a06ac59d-7be9-47c1-b19d-34f7635effa2 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1540 microversion: 2.1 time: 0.177333 Aug 23 17:56:19.474800 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 708/1497] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:19 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1540 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:19.482658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a54961c5-f01a-4ddf-8dac-885430e190cf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:19.483716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a54961c5-f01a-4ddf-8dac-885430e190cf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:19.490737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a54961c5-f01a-4ddf-8dac-885430e190cf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:19.491304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a54961c5-f01a-4ddf-8dac-885430e190cf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:19.491857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a54961c5-f01a-4ddf-8dac-885430e190cf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:19.492818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a54961c5-f01a-4ddf-8dac-885430e190cf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:19.493349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a54961c5-f01a-4ddf-8dac-885430e190cf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:19.493987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a54961c5-f01a-4ddf-8dac-885430e190cf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:19.640869 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-0af7fa05-5b2b-4b24-bd8e-12f978dbeba4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] HTTP exception thrown: Volume dfe2be37-7017-4b1f-97f2-849c75f8c943 could not be found. Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0af7fa05-5b2b-4b24-bd8e-12f978dbeba4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Request method failure captured: Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: request: PUT /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments/e32d4c9b-b3da-481a-bd65-4ec41b65ad21 HTTP/1.1 Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 74 Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQyjMKpZzVfPp6VId2PIXqQz5XbD9QwPoWnE2lIYGnmaPICNeVFGxcCB9NWk7RdAHdynqvirl1Isshv5HzqsjPpXsMrlkDOmGmfNfEwZKInp2CnYuFRWXjnC6ubw29tR0ulXbAYMeN8aNTAu51CQqKomqyKdkohVpbeSpGZiE262Y8 Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 5b732cfa2c474f428d487d2ad9d1cdb8 Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-VolumesAdminNegativeTest-1508814780 Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5b732cfa2c474f428d487d2ad9d1cdb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b732cfa2c474f428d487d2ad9d1cdb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5b732cfa2c474f428d487d2ad9d1cdb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b732cfa2c474f428d487d2ad9d1cdb8"}]}] Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-VolumesAdminNegativeTest-1508814780 Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 5b732cfa2c474f428d487d2ad9d1cdb8 Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1508814780 Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-VolumesAdminNegativeTest-1508814780-project-admin Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 60b0c1017e4845a3a409dea6e5c0e0d3 Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-VolumesAdminNegativeTest-1508814780-project-admin Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: {"volumeAttachment": {"volumeId": "dfe2be37-7017-4b1f-97f2-849c75f8c943"}} Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: exception: Volume dfe2be37-7017-4b1f-97f2-849c75f8c943 could not be found. Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': '13c4d28d-309a-4458-9d1e-91ac80454833', 'id': 'e32d4c9b-b3da-481a-bd65-4ec41b65ad21', 'body': {'volumeAttachment': {'volumeId': 'dfe2be37-7017-4b1f-97f2-849c75f8c943'}}} Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume dfe2be37-7017-4b1f-97f2-849c75f8c943 could not be found. (HTTP 404) (Request-ID: req-f40ced48-bd03-4cf4-9b7e-a20003dc3806) Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 17:56:19.644752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume dfe2be37-7017-4b1f-97f2-849c75f8c943 could not be found. Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume dfe2be37-7017-4b1f-97f2-849c75f8c943 could not be found. Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume dfe2be37-7017-4b1f-97f2-849c75f8c943 could not be found. Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0af7fa05-5b2b-4b24-bd8e-12f978dbeba4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Returning 400 to user: Volume dfe2be37-7017-4b1f-97f2-849c75f8c943 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:19.649492 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0af7fa05-5b2b-4b24-bd8e-12f978dbeba4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] 10.222.0.61 "PUT /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments/e32d4c9b-b3da-481a-bd65-4ec41b65ad21" status: 400 len: 107 microversion: 2.1 time: 0.598584 Aug 23 17:56:19.654296 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 790/1498] 10.222.0.61 () {60 vars in 1433 bytes} [Tue Aug 23 17:56:19 2022] PUT /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments/e32d4c9b-b3da-481a-bd65-4ec41b65ad21 => generated 107 bytes in 602 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 17:56:19.657098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b211f51-f9f1-479d-90a4-683f58ac1288 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:19.657791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b211f51-f9f1-479d-90a4-683f58ac1288 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:19.664399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b211f51-f9f1-479d-90a4-683f58ac1288 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:19.664893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b211f51-f9f1-479d-90a4-683f58ac1288 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:19.665335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b211f51-f9f1-479d-90a4-683f58ac1288 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:19.666045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b211f51-f9f1-479d-90a4-683f58ac1288 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:19.666702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b211f51-f9f1-479d-90a4-683f58ac1288 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:19.667310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b211f51-f9f1-479d-90a4-683f58ac1288 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:19.683198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a54961c5-f01a-4ddf-8dac-885430e190cf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:19.696652 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a54961c5-f01a-4ddf-8dac-885430e190cf tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.220108 Aug 23 17:56:19.697438 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 709/1499] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:19 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:19.732301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9c54fb1c-1aa1-4a80-b331-0ef4af2d156c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:19.733756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9c54fb1c-1aa1-4a80-b331-0ef4af2d156c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:19.740994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c54fb1c-1aa1-4a80-b331-0ef4af2d156c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:19.741490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c54fb1c-1aa1-4a80-b331-0ef4af2d156c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:19.741937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c54fb1c-1aa1-4a80-b331-0ef4af2d156c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:19.742676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c54fb1c-1aa1-4a80-b331-0ef4af2d156c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:19.743141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c54fb1c-1aa1-4a80-b331-0ef4af2d156c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:19.743572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c54fb1c-1aa1-4a80-b331-0ef4af2d156c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:19.830067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3b211f51-f9f1-479d-90a4-683f58ac1288 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:19.840552 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3b211f51-f9f1-479d-90a4-683f58ac1288 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.189306 Aug 23 17:56:19.841179 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 791/1500] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:19 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:19.854461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c14864d4-5987-4178-a8f7-c83d0db989c9 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:19.855331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c14864d4-5987-4178-a8f7-c83d0db989c9 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:19.862401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c14864d4-5987-4178-a8f7-c83d0db989c9 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:19.863005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c14864d4-5987-4178-a8f7-c83d0db989c9 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:19.863448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c14864d4-5987-4178-a8f7-c83d0db989c9 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:19.864513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c14864d4-5987-4178-a8f7-c83d0db989c9 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:19.864935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c14864d4-5987-4178-a8f7-c83d0db989c9 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:19.865437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c14864d4-5987-4178-a8f7-c83d0db989c9 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:19.893180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-9c54fb1c-1aa1-4a80-b331-0ef4af2d156c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lazy-loading 'services' on Instance uuid 13c4d28d-309a-4458-9d1e-91ac80454833 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:56:19.938707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c14864d4-5987-4178-a8f7-c83d0db989c9 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:19.948538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c14864d4-5987-4178-a8f7-c83d0db989c9 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:19.951702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c14864d4-5987-4178-a8f7-c83d0db989c9 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:19.953127 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c14864d4-5987-4178-a8f7-c83d0db989c9 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.105325 Aug 23 17:56:19.955654 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 792/1501] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:19 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:20.016877 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9c54fb1c-1aa1-4a80-b331-0ef4af2d156c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "DELETE /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments/e32d4c9b-b3da-481a-bd65-4ec41b65ad21" status: 202 len: 0 microversion: 2.1 time: 0.290284 Aug 23 17:56:20.017590 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 710/1502] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 17:56:19 2022] DELETE /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments/e32d4c9b-b3da-481a-bd65-4ec41b65ad21 => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:56:20.026999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-daae6062-a97b-4f86-aeac-41de210d3c42 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:20.029868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-daae6062-a97b-4f86-aeac-41de210d3c42 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:20.036748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-daae6062-a97b-4f86-aeac-41de210d3c42 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:20.037240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-daae6062-a97b-4f86-aeac-41de210d3c42 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:20.037681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-daae6062-a97b-4f86-aeac-41de210d3c42 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:20.039474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-daae6062-a97b-4f86-aeac-41de210d3c42 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:20.039975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-daae6062-a97b-4f86-aeac-41de210d3c42 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:20.040834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-daae6062-a97b-4f86-aeac-41de210d3c42 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:20.078330 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-daae6062-a97b-4f86-aeac-41de210d3c42 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055570 Aug 23 17:56:20.079042 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 793/1503] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 17:56:20 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:20.489641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f053f40e-41c8-4abe-bbcb-d6ac35fa0960 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:20.490262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f053f40e-41c8-4abe-bbcb-d6ac35fa0960 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:20.492349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:20.499239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f053f40e-41c8-4abe-bbcb-d6ac35fa0960 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:20.499731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f053f40e-41c8-4abe-bbcb-d6ac35fa0960 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:20.500165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f053f40e-41c8-4abe-bbcb-d6ac35fa0960 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:20.500869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f053f40e-41c8-4abe-bbcb-d6ac35fa0960 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:20.501319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f053f40e-41c8-4abe-bbcb-d6ac35fa0960 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:20.501813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f053f40e-41c8-4abe-bbcb-d6ac35fa0960 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:20.660843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f053f40e-41c8-4abe-bbcb-d6ac35fa0960 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:20.671536 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f053f40e-41c8-4abe-bbcb-d6ac35fa0960 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1540 microversion: 2.1 time: 0.186306 Aug 23 17:56:20.672092 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 711/1504] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:20 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1540 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:20.723653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07069b2b-2ecb-4ec2-b68d-aa84e9b8b3c3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:20.724473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07069b2b-2ecb-4ec2-b68d-aa84e9b8b3c3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:20.737468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07069b2b-2ecb-4ec2-b68d-aa84e9b8b3c3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:20.739576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07069b2b-2ecb-4ec2-b68d-aa84e9b8b3c3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:20.740965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07069b2b-2ecb-4ec2-b68d-aa84e9b8b3c3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:20.742827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07069b2b-2ecb-4ec2-b68d-aa84e9b8b3c3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:20.743388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07069b2b-2ecb-4ec2-b68d-aa84e9b8b3c3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:20.743896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07069b2b-2ecb-4ec2-b68d-aa84e9b8b3c3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:20.862832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f5e56f9-dc91-43dd-9561-9c6641d1a0e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:20.863258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8f5e56f9-dc91-43dd-9561-9c6641d1a0e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:20.875585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f5e56f9-dc91-43dd-9561-9c6641d1a0e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:20.876218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f5e56f9-dc91-43dd-9561-9c6641d1a0e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:20.878905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f5e56f9-dc91-43dd-9561-9c6641d1a0e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:20.879821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f5e56f9-dc91-43dd-9561-9c6641d1a0e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:20.880384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f5e56f9-dc91-43dd-9561-9c6641d1a0e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:20.880893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f5e56f9-dc91-43dd-9561-9c6641d1a0e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:20.943555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-07069b2b-2ecb-4ec2-b68d-aa84e9b8b3c3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:20.954934 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-07069b2b-2ecb-4ec2-b68d-aa84e9b8b3c3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.235068 Aug 23 17:56:20.955912 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 794/1505] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:20 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:20.979012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2f022660-5aa4-4956-8980-1dc505d3ea6c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:20.981438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2f022660-5aa4-4956-8980-1dc505d3ea6c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:20.989262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f022660-5aa4-4956-8980-1dc505d3ea6c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:20.990076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f022660-5aa4-4956-8980-1dc505d3ea6c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:20.991063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f022660-5aa4-4956-8980-1dc505d3ea6c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:20.992563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f022660-5aa4-4956-8980-1dc505d3ea6c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:20.993320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f022660-5aa4-4956-8980-1dc505d3ea6c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:20.994097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f022660-5aa4-4956-8980-1dc505d3ea6c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:21.076995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2f022660-5aa4-4956-8980-1dc505d3ea6c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:21.087159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2f022660-5aa4-4956-8980-1dc505d3ea6c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:21.091019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2f022660-5aa4-4956-8980-1dc505d3ea6c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:21.093784 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2f022660-5aa4-4956-8980-1dc505d3ea6c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.119107 Aug 23 17:56:21.095382 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 795/1506] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:20 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:56:21.114006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8b204af4-ffc0-44bb-8b8e-6908d19215e8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:21.116695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8b204af4-ffc0-44bb-8b8e-6908d19215e8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:21.127312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b204af4-ffc0-44bb-8b8e-6908d19215e8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:21.128792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b204af4-ffc0-44bb-8b8e-6908d19215e8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:21.129449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b204af4-ffc0-44bb-8b8e-6908d19215e8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:21.131439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b204af4-ffc0-44bb-8b8e-6908d19215e8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:21.133391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b204af4-ffc0-44bb-8b8e-6908d19215e8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:21.134050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b204af4-ffc0-44bb-8b8e-6908d19215e8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:21.144574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8f5e56f9-dc91-43dd-9561-9c6641d1a0e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:21.169664 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f5e56f9-dc91-43dd-9561-9c6641d1a0e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.307144 Aug 23 17:56:21.176709 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 712/1507] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:20 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:21.191415 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8b204af4-ffc0-44bb-8b8e-6908d19215e8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083048 Aug 23 17:56:21.192447 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 796/1508] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 17:56:21 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:21.693359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3d5f2c81-4cd3-4020-a917-2a996c37282d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:21.694472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3d5f2c81-4cd3-4020-a917-2a996c37282d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:21.702350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d5f2c81-4cd3-4020-a917-2a996c37282d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:21.703003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d5f2c81-4cd3-4020-a917-2a996c37282d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:21.703288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d5f2c81-4cd3-4020-a917-2a996c37282d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:21.703991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d5f2c81-4cd3-4020-a917-2a996c37282d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:21.704435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d5f2c81-4cd3-4020-a917-2a996c37282d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:21.704857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d5f2c81-4cd3-4020-a917-2a996c37282d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:21.853766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3d5f2c81-4cd3-4020-a917-2a996c37282d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:21.863782 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3d5f2c81-4cd3-4020-a917-2a996c37282d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1522 microversion: 2.1 time: 0.175168 Aug 23 17:56:21.864514 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 713/1509] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:21 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:21.884845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8cf0d98c-ee75-4754-af3a-cb5a29cc61f9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:21.885392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8cf0d98c-ee75-4754-af3a-cb5a29cc61f9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:21.893995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8cf0d98c-ee75-4754-af3a-cb5a29cc61f9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:21.894766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8cf0d98c-ee75-4754-af3a-cb5a29cc61f9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:21.895205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8cf0d98c-ee75-4754-af3a-cb5a29cc61f9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:21.895916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8cf0d98c-ee75-4754-af3a-cb5a29cc61f9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:21.896368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8cf0d98c-ee75-4754-af3a-cb5a29cc61f9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:21.896923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8cf0d98c-ee75-4754-af3a-cb5a29cc61f9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:21.924563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8cf0d98c-ee75-4754-af3a-cb5a29cc61f9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:56:21.981712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a4994b28-cc3a-46d3-8e6d-321a50851d47 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:21.983330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a4994b28-cc3a-46d3-8e6d-321a50851d47 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:21.994420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4994b28-cc3a-46d3-8e6d-321a50851d47 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:21.995737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4994b28-cc3a-46d3-8e6d-321a50851d47 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:21.998022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4994b28-cc3a-46d3-8e6d-321a50851d47 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:21.999335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4994b28-cc3a-46d3-8e6d-321a50851d47 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.000067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4994b28-cc3a-46d3-8e6d-321a50851d47 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.000672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4994b28-cc3a-46d3-8e6d-321a50851d47 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.019402 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8cf0d98c-ee75-4754-af3a-cb5a29cc61f9 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 204 len: 0 microversion: 2.1 time: 0.137514 Aug 23 17:56:22.020476 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 797/1510] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:56:21 2022] DELETE /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:56:22.035063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c476a76-100a-44b4-90cc-8c78bdef4f53 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:22.036038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0c476a76-100a-44b4-90cc-8c78bdef4f53 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:22.045380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c476a76-100a-44b4-90cc-8c78bdef4f53 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.045883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c476a76-100a-44b4-90cc-8c78bdef4f53 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.046384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c476a76-100a-44b4-90cc-8c78bdef4f53 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.051471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c476a76-100a-44b4-90cc-8c78bdef4f53 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.052308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c476a76-100a-44b4-90cc-8c78bdef4f53 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.052940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c476a76-100a-44b4-90cc-8c78bdef4f53 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.192628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a4994b28-cc3a-46d3-8e6d-321a50851d47 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:22.202053 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a4994b28-cc3a-46d3-8e6d-321a50851d47 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.227728 Aug 23 17:56:22.203326 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 714/1511] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:21 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:22.208616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-45d315d2-7974-4161-aad6-3bbce31b3b1e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:22.209420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-45d315d2-7974-4161-aad6-3bbce31b3b1e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:22.216462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45d315d2-7974-4161-aad6-3bbce31b3b1e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.217029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45d315d2-7974-4161-aad6-3bbce31b3b1e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.217541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45d315d2-7974-4161-aad6-3bbce31b3b1e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.218362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45d315d2-7974-4161-aad6-3bbce31b3b1e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.218951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45d315d2-7974-4161-aad6-3bbce31b3b1e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.219626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45d315d2-7974-4161-aad6-3bbce31b3b1e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.235635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0c476a76-100a-44b4-90cc-8c78bdef4f53 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:22.247504 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c476a76-100a-44b4-90cc-8c78bdef4f53 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1528 microversion: 2.1 time: 0.222371 Aug 23 17:56:22.248632 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 798/1512] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:22 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1528 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:22.254290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cdded0ac-316f-44a2-b28c-5ea7640ff2fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:22.255231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cdded0ac-316f-44a2-b28c-5ea7640ff2fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:22.263615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cdded0ac-316f-44a2-b28c-5ea7640ff2fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.264344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cdded0ac-316f-44a2-b28c-5ea7640ff2fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.264954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cdded0ac-316f-44a2-b28c-5ea7640ff2fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.266001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cdded0ac-316f-44a2-b28c-5ea7640ff2fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.266742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cdded0ac-316f-44a2-b28c-5ea7640ff2fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.267720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cdded0ac-316f-44a2-b28c-5ea7640ff2fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.291768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45d315d2-7974-4161-aad6-3bbce31b3b1e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:22.302440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45d315d2-7974-4161-aad6-3bbce31b3b1e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:22.304069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45d315d2-7974-4161-aad6-3bbce31b3b1e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:22.307620 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-45d315d2-7974-4161-aad6-3bbce31b3b1e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.103078 Aug 23 17:56:22.309593 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 715/1513] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:22 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:22.408042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:22.411849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cdded0ac-316f-44a2-b28c-5ea7640ff2fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:22.421632 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cdded0ac-316f-44a2-b28c-5ea7640ff2fb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.171740 Aug 23 17:56:22.434327 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 799/1514] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:22 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:22.439394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-815575b6-0ffc-42be-a6eb-1881bcad9e19 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:22.442878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-815575b6-0ffc-42be-a6eb-1881bcad9e19 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:22.446691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2db7c728-6ab4-40e8-a1a1-e6afa3fb243c tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:22.449907 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:22.449907 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:22.450301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-815575b6-0ffc-42be-a6eb-1881bcad9e19 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.450734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-815575b6-0ffc-42be-a6eb-1881bcad9e19 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.451167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2db7c728-6ab4-40e8-a1a1-e6afa3fb243c tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.451279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-815575b6-0ffc-42be-a6eb-1881bcad9e19 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.451661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2db7c728-6ab4-40e8-a1a1-e6afa3fb243c tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.451913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-815575b6-0ffc-42be-a6eb-1881bcad9e19 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.452319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2db7c728-6ab4-40e8-a1a1-e6afa3fb243c tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.452475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-815575b6-0ffc-42be-a6eb-1881bcad9e19 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.452845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-815575b6-0ffc-42be-a6eb-1881bcad9e19 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.453075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2db7c728-6ab4-40e8-a1a1-e6afa3fb243c tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.453541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2db7c728-6ab4-40e8-a1a1-e6afa3fb243c tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.453967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2db7c728-6ab4-40e8-a1a1-e6afa3fb243c tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.455923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:22.479779 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2db7c728-6ab4-40e8-a1a1-e6afa3fb243c tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.170392 Aug 23 17:56:22.480381 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 716/1515] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:56:22 2022] GET /compute/v2.1/os-services => generated 949 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:22.492697 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-815575b6-0ffc-42be-a6eb-1881bcad9e19 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057118 Aug 23 17:56:22.493453 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 800/1516] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 17:56:22 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:22.493581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-24f26792-8538-4f1b-b55b-8c275ff4f999 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:22.496071 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:22.496071 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:22.498078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24f26792-8538-4f1b-b55b-8c275ff4f999 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.498788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24f26792-8538-4f1b-b55b-8c275ff4f999 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.499327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24f26792-8538-4f1b-b55b-8c275ff4f999 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.500059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24f26792-8538-4f1b-b55b-8c275ff4f999 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.500507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24f26792-8538-4f1b-b55b-8c275ff4f999 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.501210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24f26792-8538-4f1b-b55b-8c275ff4f999 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.525497 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-24f26792-8538-4f1b-b55b-8c275ff4f999 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.035794 Aug 23 17:56:22.526097 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 717/1517] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Aug 23 17:56:22 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 949 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:56:22.542869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d8c11cd9-2f27-4ef1-8b98-7349f4e71fe1 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:22.547723 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:22.547723 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:22.548909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8c11cd9-2f27-4ef1-8b98-7349f4e71fe1 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.549396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8c11cd9-2f27-4ef1-8b98-7349f4e71fe1 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.549837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8c11cd9-2f27-4ef1-8b98-7349f4e71fe1 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.550623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8c11cd9-2f27-4ef1-8b98-7349f4e71fe1 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.551082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8c11cd9-2f27-4ef1-8b98-7349f4e71fe1 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.551504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8c11cd9-2f27-4ef1-8b98-7349f4e71fe1 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.578209 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d8c11cd9-2f27-4ef1-8b98-7349f4e71fe1 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.041120 Aug 23 17:56:22.579021 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 801/1518] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:56:22 2022] GET /compute/v2.1/os-services => generated 949 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:22.591528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83dd2efb-211f-4c56-8adb-b55fb3eb977f tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:22.594114 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:22.594114 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:22.595346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83dd2efb-211f-4c56-8adb-b55fb3eb977f tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.595826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83dd2efb-211f-4c56-8adb-b55fb3eb977f tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.596261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83dd2efb-211f-4c56-8adb-b55fb3eb977f tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.596993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83dd2efb-211f-4c56-8adb-b55fb3eb977f tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.597443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83dd2efb-211f-4c56-8adb-b55fb3eb977f tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.597859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83dd2efb-211f-4c56-8adb-b55fb3eb977f tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.623033 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-83dd2efb-211f-4c56-8adb-b55fb3eb977f tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=n-d-850468-16&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.035688 Aug 23 17:56:22.623649 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 718/1519] 10.222.0.61 () {58 vars in 1196 bytes} [Tue Aug 23 17:56:22 2022] GET /compute/v2.1/os-services?host=n-d-850468-16&binary=xxx => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:56:22.636119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a99d3ba5-76a3-4412-ad3a-69782b1f11a6 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:22.638755 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:22.638755 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:22.640032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99d3ba5-76a3-4412-ad3a-69782b1f11a6 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.640592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99d3ba5-76a3-4412-ad3a-69782b1f11a6 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.641100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99d3ba5-76a3-4412-ad3a-69782b1f11a6 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.641912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99d3ba5-76a3-4412-ad3a-69782b1f11a6 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.642460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99d3ba5-76a3-4412-ad3a-69782b1f11a6 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.642990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99d3ba5-76a3-4412-ad3a-69782b1f11a6 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.667127 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a99d3ba5-76a3-4412-ad3a-69782b1f11a6 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.035148 Aug 23 17:56:22.667718 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 802/1520] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:56:22 2022] GET /compute/v2.1/os-services => generated 949 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:22.679918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-beb65d2b-0a59-4289-9642-fb58b283ce39 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:22.682481 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:22.682481 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:22.683821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beb65d2b-0a59-4289-9642-fb58b283ce39 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.684522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beb65d2b-0a59-4289-9642-fb58b283ce39 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.685054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beb65d2b-0a59-4289-9642-fb58b283ce39 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.685808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beb65d2b-0a59-4289-9642-fb58b283ce39 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:22.686267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beb65d2b-0a59-4289-9642-fb58b283ce39 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:22.686745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beb65d2b-0a59-4289-9642-fb58b283ce39 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:22.711572 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-beb65d2b-0a59-4289-9642-fb58b283ce39 tempest-ServicesAdminNegativeTestJSON-376122884 tempest-ServicesAdminNegativeTestJSON-376122884-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.035444 Aug 23 17:56:22.712185 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 719/1521] 10.222.0.61 () {58 vars in 1198 bytes} [Tue Aug 23 17:56:22 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:56:22.829523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93181755-8016-4e37-84f9-d41be7c7cc05 tempest-ServicesAdminNegativeTestJSON-546591300 tempest-ServicesAdminNegativeTestJSON-546591300-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:22.832008 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:22.832008 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:22.833118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-93181755-8016-4e37-84f9-d41be7c7cc05 tempest-ServicesAdminNegativeTestJSON-546591300 tempest-ServicesAdminNegativeTestJSON-546591300-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '44330c243ade4519a48ee6d7539a05eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d58f565511485a9f8cf4644d412dc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93181755-8016-4e37-84f9-d41be7c7cc05 tempest-ServicesAdminNegativeTestJSON-546591300 tempest-ServicesAdminNegativeTestJSON-546591300-project] Request method failure captured: Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRTFkGApzTYR83Z784wdHScW87QN5VdRKl-pudRJTLh99AQ__KTFyz6w1DIQeJGXYQkgSEF8G37kPWkQNXf668BnmMPC5dygCoMFsUK8tRqVfynUp0ax-XDGNxJk5X8FFMV5GZ9z8vQI-_5OfN9YaKbtFA9nOgWXpiDppWFfWoqghnc Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2d58f565511485a9f8cf4644d412dc1 Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-546591300 Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2d58f565511485a9f8cf4644d412dc1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2d58f565511485a9f8cf4644d412dc1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2d58f565511485a9f8cf4644d412dc1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2d58f565511485a9f8cf4644d412dc1"}]}] Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-546591300 Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2d58f565511485a9f8cf4644d412dc1 Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-546591300 Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServicesAdminNegativeTestJSON-546591300-project Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 44330c243ade4519a48ee6d7539a05eb Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-546591300-project Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: action_args: {} Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 23 17:56:22.835186 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:22.840771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:22.840771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:22.840771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:22.840771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:22.840771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:22.840771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 17:56:22.840771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 17:56:22.840771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 23 17:56:22.840771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:22.840771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93181755-8016-4e37-84f9-d41be7c7cc05 tempest-ServicesAdminNegativeTestJSON-546591300 tempest-ServicesAdminNegativeTestJSON-546591300-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:22.840771 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93181755-8016-4e37-84f9-d41be7c7cc05 tempest-ServicesAdminNegativeTestJSON-546591300 tempest-ServicesAdminNegativeTestJSON-546591300-project] 10.222.0.61 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.115693 Aug 23 17:56:22.842113 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 803/1522] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 17:56:22 2022] GET /compute/v2.1/os-services => generated 112 bytes in 122 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:56:23.226995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-da68b667-268e-42d6-ae51-5efc5029b17f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:23.227891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-da68b667-268e-42d6-ae51-5efc5029b17f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:23.234990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da68b667-268e-42d6-ae51-5efc5029b17f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:23.235478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da68b667-268e-42d6-ae51-5efc5029b17f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:23.235911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da68b667-268e-42d6-ae51-5efc5029b17f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:23.236620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da68b667-268e-42d6-ae51-5efc5029b17f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:23.237130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da68b667-268e-42d6-ae51-5efc5029b17f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:23.237738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da68b667-268e-42d6-ae51-5efc5029b17f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:23.272758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dca1c7ee-03fe-4a76-981d-a954f4a032e8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:23.273755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dca1c7ee-03fe-4a76-981d-a954f4a032e8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:23.283000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dca1c7ee-03fe-4a76-981d-a954f4a032e8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:23.283497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dca1c7ee-03fe-4a76-981d-a954f4a032e8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:23.283937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dca1c7ee-03fe-4a76-981d-a954f4a032e8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:23.284653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dca1c7ee-03fe-4a76-981d-a954f4a032e8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:23.285106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dca1c7ee-03fe-4a76-981d-a954f4a032e8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:23.285525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dca1c7ee-03fe-4a76-981d-a954f4a032e8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:23.395402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-da68b667-268e-42d6-ae51-5efc5029b17f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:23.405600 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-da68b667-268e-42d6-ae51-5efc5029b17f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1506 microversion: 2.1 time: 0.182368 Aug 23 17:56:23.406403 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 720/1523] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:23 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1506 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:23.411296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a24fca47-7a72-4f03-887b-dd7e49808b67 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:23.411911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a24fca47-7a72-4f03-887b-dd7e49808b67 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:23.417796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a24fca47-7a72-4f03-887b-dd7e49808b67 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:23.418570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a24fca47-7a72-4f03-887b-dd7e49808b67 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:23.419076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a24fca47-7a72-4f03-887b-dd7e49808b67 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:23.419784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a24fca47-7a72-4f03-887b-dd7e49808b67 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:23.420432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a24fca47-7a72-4f03-887b-dd7e49808b67 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:23.421503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a24fca47-7a72-4f03-887b-dd7e49808b67 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:23.503453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a24fca47-7a72-4f03-887b-dd7e49808b67 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:23.512839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a24fca47-7a72-4f03-887b-dd7e49808b67 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:23.514522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a24fca47-7a72-4f03-887b-dd7e49808b67 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:23.515796 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a24fca47-7a72-4f03-887b-dd7e49808b67 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.108531 Aug 23 17:56:23.516440 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 721/1524] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:23 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:23.520982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-15b4d644-eb79-4a24-9749-36321bcae7db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:23.521730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-15b4d644-eb79-4a24-9749-36321bcae7db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:23.528725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15b4d644-eb79-4a24-9749-36321bcae7db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:23.529317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15b4d644-eb79-4a24-9749-36321bcae7db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:23.529827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15b4d644-eb79-4a24-9749-36321bcae7db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:23.530637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15b4d644-eb79-4a24-9749-36321bcae7db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:23.531159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15b4d644-eb79-4a24-9749-36321bcae7db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:23.531653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15b4d644-eb79-4a24-9749-36321bcae7db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:23.575535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dca1c7ee-03fe-4a76-981d-a954f4a032e8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:23.585141 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dca1c7ee-03fe-4a76-981d-a954f4a032e8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1528 microversion: 2.1 time: 0.317199 Aug 23 17:56:23.586055 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 804/1525] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:23 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1528 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:23.597086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-42bd1694-7f5a-41cf-8763-caab5ad0ae45 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:23.600702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-42bd1694-7f5a-41cf-8763-caab5ad0ae45 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:23.611679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42bd1694-7f5a-41cf-8763-caab5ad0ae45 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:23.612175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42bd1694-7f5a-41cf-8763-caab5ad0ae45 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:23.612679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42bd1694-7f5a-41cf-8763-caab5ad0ae45 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:23.620092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42bd1694-7f5a-41cf-8763-caab5ad0ae45 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:23.620719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42bd1694-7f5a-41cf-8763-caab5ad0ae45 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:23.621254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42bd1694-7f5a-41cf-8763-caab5ad0ae45 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:23.683925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-15b4d644-eb79-4a24-9749-36321bcae7db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:23.686018 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-42bd1694-7f5a-41cf-8763-caab5ad0ae45 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098795 Aug 23 17:56:23.686937 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 805/1526] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 17:56:23 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:23.693578 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-15b4d644-eb79-4a24-9749-36321bcae7db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.176052 Aug 23 17:56:23.694149 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 722/1527] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:23 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:24.427183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ecf951a-d2fb-4907-9dd5-6d3bb443ed17 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:24.428618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2ecf951a-d2fb-4907-9dd5-6d3bb443ed17 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:24.431322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:24.439449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecf951a-d2fb-4907-9dd5-6d3bb443ed17 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:24.439944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecf951a-d2fb-4907-9dd5-6d3bb443ed17 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:24.440383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecf951a-d2fb-4907-9dd5-6d3bb443ed17 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:24.441098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecf951a-d2fb-4907-9dd5-6d3bb443ed17 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:24.441552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecf951a-d2fb-4907-9dd5-6d3bb443ed17 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:24.441976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecf951a-d2fb-4907-9dd5-6d3bb443ed17 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:24.539343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7f7600b-b830-4418-a237-88e39d265e07 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:24.540768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d7f7600b-b830-4418-a237-88e39d265e07 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:24.550082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7f7600b-b830-4418-a237-88e39d265e07 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:24.550642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7f7600b-b830-4418-a237-88e39d265e07 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:24.551042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7f7600b-b830-4418-a237-88e39d265e07 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:24.551756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7f7600b-b830-4418-a237-88e39d265e07 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:24.552352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7f7600b-b830-4418-a237-88e39d265e07 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:24.552992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7f7600b-b830-4418-a237-88e39d265e07 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:24.613168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2ecf951a-d2fb-4907-9dd5-6d3bb443ed17 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:24.622158 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2ecf951a-d2fb-4907-9dd5-6d3bb443ed17 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1486 microversion: 2.1 time: 0.198562 Aug 23 17:56:24.624293 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 806/1528] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:24 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1486 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:24.629311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-31aae49f-75d4-47c7-af83-03f8ba4beb59 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:24.630234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-31aae49f-75d4-47c7-af83-03f8ba4beb59 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:24.638404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31aae49f-75d4-47c7-af83-03f8ba4beb59 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:24.639154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31aae49f-75d4-47c7-af83-03f8ba4beb59 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:24.639820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31aae49f-75d4-47c7-af83-03f8ba4beb59 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:24.640811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31aae49f-75d4-47c7-af83-03f8ba4beb59 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:24.641484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31aae49f-75d4-47c7-af83-03f8ba4beb59 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:24.642127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31aae49f-75d4-47c7-af83-03f8ba4beb59 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:24.667120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7f7600b-b830-4418-a237-88e39d265e07 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:24.678373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7f7600b-b830-4418-a237-88e39d265e07 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:24.681190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7f7600b-b830-4418-a237-88e39d265e07 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:24.686907 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7f7600b-b830-4418-a237-88e39d265e07 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.147758 Aug 23 17:56:24.687852 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 723/1529] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:24 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:56:24.716485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6c0c2b14-84de-4c5c-911e-917660c3e1a0 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:24.718953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6c0c2b14-84de-4c5c-911e-917660c3e1a0 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:24.738929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c0c2b14-84de-4c5c-911e-917660c3e1a0 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:24.739430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c0c2b14-84de-4c5c-911e-917660c3e1a0 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:24.739877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c0c2b14-84de-4c5c-911e-917660c3e1a0 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:24.745678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c0c2b14-84de-4c5c-911e-917660c3e1a0 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:24.746523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c0c2b14-84de-4c5c-911e-917660c3e1a0 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:24.747199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c0c2b14-84de-4c5c-911e-917660c3e1a0 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:24.754032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:24.805837 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6c0c2b14-84de-4c5c-911e-917660c3e1a0 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103986 Aug 23 17:56:24.806211 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 724/1530] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 17:56:24 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:24.814946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-919d108a-9c21-4f04-967f-3582bed142a4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:24.815849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-919d108a-9c21-4f04-967f-3582bed142a4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:24.823465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-919d108a-9c21-4f04-967f-3582bed142a4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:24.824270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-919d108a-9c21-4f04-967f-3582bed142a4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:24.825133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-919d108a-9c21-4f04-967f-3582bed142a4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:24.826573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-919d108a-9c21-4f04-967f-3582bed142a4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:24.827237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-919d108a-9c21-4f04-967f-3582bed142a4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:24.827883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-919d108a-9c21-4f04-967f-3582bed142a4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:24.830281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-31aae49f-75d4-47c7-af83-03f8ba4beb59 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:24.841506 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-31aae49f-75d4-47c7-af83-03f8ba4beb59 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1528 microversion: 2.1 time: 0.215027 Aug 23 17:56:24.842379 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 807/1531] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:24 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1528 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:24.849169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-355865804", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:24.912281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] validate_networks() for [('f6ed42ee-5917-4a15-baa0-4c5ffe752291', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:56:25.101792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-919d108a-9c21-4f04-967f-3582bed142a4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:25.114769 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-919d108a-9c21-4f04-967f-3582bed142a4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.306445 Aug 23 17:56:25.115876 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 725/1532] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:24 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:25.400832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:56:25.401263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:56:25.402030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:56:25.403048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:56:25.403470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:56:25.415466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:25.415982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:25.416421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:25.417160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:25.417679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:25.418823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:25.439980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Getting quotas for project e6e4c52fe92040e9b532db25ee92d308. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:56:25.444710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Getting quotas for user 6efa870487f347eb9886ec8ba62360f8 and project e6e4c52fe92040e9b532db25ee92d308. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:56:25.457023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:56:25.459274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:56:25.507610 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e24380b6-fcfe-4eb1-ac30-b44528fc2a91 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.663948 Aug 23 17:56:25.508644 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 808/1533] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:56:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:56:25.520163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d1bd8a1-ac59-4113-aa85-cdc0bf242c63 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:25.521022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8d1bd8a1-ac59-4113-aa85-cdc0bf242c63 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:25.646483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8d1bd8a1-ac59-4113-aa85-cdc0bf242c63 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:25.658464 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8d1bd8a1-ac59-4113-aa85-cdc0bf242c63 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1213 microversion: 2.1 time: 0.142199 Aug 23 17:56:25.659097 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 726/1534] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:25 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1213 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:25.729285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7b1f13ed-8de3-4fa4-8761-a526eb51bffe tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:25.730132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7b1f13ed-8de3-4fa4-8761-a526eb51bffe tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:25.753675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b1f13ed-8de3-4fa4-8761-a526eb51bffe tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:25.754274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b1f13ed-8de3-4fa4-8761-a526eb51bffe tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:25.759850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b1f13ed-8de3-4fa4-8761-a526eb51bffe tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:25.760850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b1f13ed-8de3-4fa4-8761-a526eb51bffe tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:25.761355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b1f13ed-8de3-4fa4-8761-a526eb51bffe tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:25.762687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b1f13ed-8de3-4fa4-8761-a526eb51bffe tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:25.894122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7b1f13ed-8de3-4fa4-8761-a526eb51bffe tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:25.906504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7b1f13ed-8de3-4fa4-8761-a526eb51bffe tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:25.908090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7b1f13ed-8de3-4fa4-8761-a526eb51bffe tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:25.910392 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7b1f13ed-8de3-4fa4-8761-a526eb51bffe tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.199197 Aug 23 17:56:25.911452 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 727/1535] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:25 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:25.917346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-240f76d1-8ec9-488f-aac0-efa72a964a5c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:25.923371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-dee1a0a5-ed8f-46b3-a24d-f35cef30a933 req-bcc644b0-6908-4f5f-ad2c-26c31a410119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dff523f-5032-42ec-abcb-2266d1aee875", "name": "network-vif-deleted", "tag": "d44e5ac7-af43-486c-8d73-1db70e5d0340"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:25.929381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-240f76d1-8ec9-488f-aac0-efa72a964a5c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:25.940725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dee1a0a5-ed8f-46b3-a24d-f35cef30a933 req-bcc644b0-6908-4f5f-ad2c-26c31a410119 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:25.941463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dee1a0a5-ed8f-46b3-a24d-f35cef30a933 req-bcc644b0-6908-4f5f-ad2c-26c31a410119 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:25.942249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dee1a0a5-ed8f-46b3-a24d-f35cef30a933 req-bcc644b0-6908-4f5f-ad2c-26c31a410119 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:25.952344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-240f76d1-8ec9-488f-aac0-efa72a964a5c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:25.955127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-240f76d1-8ec9-488f-aac0-efa72a964a5c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:25.956027 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-dee1a0a5-ed8f-46b3-a24d-f35cef30a933 req-bcc644b0-6908-4f5f-ad2c-26c31a410119 service nova] Creating event network-vif-deleted:d44e5ac7-af43-486c-8d73-1db70e5d0340 for instance 9dff523f-5032-42ec-abcb-2266d1aee875 on n-h2-850468-16 Aug 23 17:56:25.960423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-240f76d1-8ec9-488f-aac0-efa72a964a5c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:25.961409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-240f76d1-8ec9-488f-aac0-efa72a964a5c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:25.962134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-240f76d1-8ec9-488f-aac0-efa72a964a5c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:25.962649 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-dee1a0a5-ed8f-46b3-a24d-f35cef30a933 req-bcc644b0-6908-4f5f-ad2c-26c31a410119 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.260643 Aug 23 17:56:25.962778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-240f76d1-8ec9-488f-aac0-efa72a964a5c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:25.964114 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 809/1536] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:25.971425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:25.972429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:25.979931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:25.980479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:25.981435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:25.982240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:25.982748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:25.983196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:26.019838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:26.020336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:26.020783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:26.021255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lazy-loading 'fault' on Instance uuid 9dff523f-5032-42ec-abcb-2266d1aee875 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:56:26.025357 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-240f76d1-8ec9-488f-aac0-efa72a964a5c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.112537 Aug 23 17:56:26.028182 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 728/1537] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 17:56:25 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833/os-volume_attachments => generated 25 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:56:26.111126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:26.123182 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-896da2ac-fc58-4052-a2d0-2901514621b8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 200 len: 1315 microversion: 2.1 time: 0.155870 Aug 23 17:56:26.124898 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 810/1538] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:25 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:26.174453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-94f4d076-fcff-4cfd-a271-d7163f6ebb6d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:26.175429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-94f4d076-fcff-4cfd-a271-d7163f6ebb6d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:26.186911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94f4d076-fcff-4cfd-a271-d7163f6ebb6d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:26.187406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94f4d076-fcff-4cfd-a271-d7163f6ebb6d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:26.187850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94f4d076-fcff-4cfd-a271-d7163f6ebb6d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:26.194122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94f4d076-fcff-4cfd-a271-d7163f6ebb6d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:26.194704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94f4d076-fcff-4cfd-a271-d7163f6ebb6d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:26.195158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94f4d076-fcff-4cfd-a271-d7163f6ebb6d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:26.315829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1972434991", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "4550622a-cff7-419e-a835-665a217cd811"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:26.374232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] validate_networks() for [('4550622a-cff7-419e-a835-665a217cd811', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:56:26.462493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-94f4d076-fcff-4cfd-a271-d7163f6ebb6d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:26.471650 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-94f4d076-fcff-4cfd-a271-d7163f6ebb6d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.322938 Aug 23 17:56:26.472245 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 729/1539] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:26 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:26.681840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2668bcff-b03d-48e2-9c2b-ba67153815bd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:26.682492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2668bcff-b03d-48e2-9c2b-ba67153815bd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:26.694923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2668bcff-b03d-48e2-9c2b-ba67153815bd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:26.695646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2668bcff-b03d-48e2-9c2b-ba67153815bd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:26.696328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2668bcff-b03d-48e2-9c2b-ba67153815bd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:26.697634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2668bcff-b03d-48e2-9c2b-ba67153815bd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:26.703691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2668bcff-b03d-48e2-9c2b-ba67153815bd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:26.705792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2668bcff-b03d-48e2-9c2b-ba67153815bd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:26.827791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2668bcff-b03d-48e2-9c2b-ba67153815bd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:26.835556 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2668bcff-b03d-48e2-9c2b-ba67153815bd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1265 microversion: 2.1 time: 0.159019 Aug 23 17:56:26.836137 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 730/1540] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:26 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:26.937389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d156f357-71fe-4a50-9c85-2bae92385de6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:26.938618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d156f357-71fe-4a50-9c85-2bae92385de6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:26.946638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d156f357-71fe-4a50-9c85-2bae92385de6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:26.947130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d156f357-71fe-4a50-9c85-2bae92385de6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:26.947561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d156f357-71fe-4a50-9c85-2bae92385de6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:26.948291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d156f357-71fe-4a50-9c85-2bae92385de6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:26.948737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d156f357-71fe-4a50-9c85-2bae92385de6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:26.949710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d156f357-71fe-4a50-9c85-2bae92385de6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:27.009464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:56:27.009973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:56:27.010659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:56:27.011200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:56:27.011759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:56:27.021346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:27.022178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:27.022913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:27.023986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:27.024712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:27.025365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:27.041812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d156f357-71fe-4a50-9c85-2bae92385de6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:27.048484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Getting quotas for project d60b8676313b4607b015755341be1331. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:56:27.053198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d156f357-71fe-4a50-9c85-2bae92385de6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:27.054515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Getting quotas for user d4e792ec8c584ba489b976f62f409d94 and project d60b8676313b4607b015755341be1331. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:56:27.055009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d156f357-71fe-4a50-9c85-2bae92385de6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:27.056225 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d156f357-71fe-4a50-9c85-2bae92385de6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.124459 Aug 23 17:56:27.057303 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 731/1541] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:26 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:27.073843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:56:27.077741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:56:27.136371 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-28718f0a-e421-4f58-998c-2b90dc7b8993 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825734 Aug 23 17:56:27.143614 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 811/1542] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:56:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 17:56:27.155998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d2e4e30a-0320-42c1-bce1-f34de957bca0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:27.157232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d2e4e30a-0320-42c1-bce1-f34de957bca0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:27.159082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ea69f54d-72cc-4fc0-86fe-758dcc38e184 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:27.161193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ea69f54d-72cc-4fc0-86fe-758dcc38e184 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:27.164713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2e4e30a-0320-42c1-bce1-f34de957bca0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:27.165845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2e4e30a-0320-42c1-bce1-f34de957bca0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:27.166714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2e4e30a-0320-42c1-bce1-f34de957bca0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:27.167647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2e4e30a-0320-42c1-bce1-f34de957bca0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:27.168975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2e4e30a-0320-42c1-bce1-f34de957bca0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:27.169549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2e4e30a-0320-42c1-bce1-f34de957bca0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:27.189276 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-d2e4e30a-0320-42c1-bce1-f34de957bca0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] HTTP exception thrown: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d2e4e30a-0320-42c1-bce1-f34de957bca0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 HTTP/1.1 Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '9dff523f-5032-42ec-abcb-2266d1aee875'} Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:27.191292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:27.196448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:27.196448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:27.196448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:27.196448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:27.196448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:27.196448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:27.196448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:56:27.196448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:27.196448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d2e4e30a-0320-42c1-bce1-f34de957bca0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 404 to user: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:27.197949 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d2e4e30a-0320-42c1-bce1-f34de957bca0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 404 len: 111 microversion: 2.1 time: 0.048973 Aug 23 17:56:27.198840 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 812/1543] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:27 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 17:56:27.248056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ea69f54d-72cc-4fc0-86fe-758dcc38e184 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:27.257090 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ea69f54d-72cc-4fc0-86fe-758dcc38e184 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1218 microversion: 2.1 time: 0.110257 Aug 23 17:56:27.258106 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 732/1544] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:27 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:27.404757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-799900812", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:27.476175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] validate_networks() for [('b06bcefd-d9c8-46b3-8f56-9e68315ff33e', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:56:27.498282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-714c4861-66f6-4f6f-bd01-eb2861ce99c2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:27.499948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-714c4861-66f6-4f6f-bd01-eb2861ce99c2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:27.508968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714c4861-66f6-4f6f-bd01-eb2861ce99c2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:27.510530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714c4861-66f6-4f6f-bd01-eb2861ce99c2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:27.511354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714c4861-66f6-4f6f-bd01-eb2861ce99c2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:27.514006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714c4861-66f6-4f6f-bd01-eb2861ce99c2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:27.515079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714c4861-66f6-4f6f-bd01-eb2861ce99c2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:27.516019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714c4861-66f6-4f6f-bd01-eb2861ce99c2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:27.877977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-714c4861-66f6-4f6f-bd01-eb2861ce99c2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:27.886834 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-714c4861-66f6-4f6f-bd01-eb2861ce99c2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.396272 Aug 23 17:56:27.889513 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 733/1545] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:27 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:27.907774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bace8a9c-ddff-4be4-903d-c134898676f6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:27.908530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bace8a9c-ddff-4be4-903d-c134898676f6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:27.922219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bace8a9c-ddff-4be4-903d-c134898676f6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:27.922736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bace8a9c-ddff-4be4-903d-c134898676f6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:27.923519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bace8a9c-ddff-4be4-903d-c134898676f6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:27.924415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bace8a9c-ddff-4be4-903d-c134898676f6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:27.925055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bace8a9c-ddff-4be4-903d-c134898676f6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:27.925487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bace8a9c-ddff-4be4-903d-c134898676f6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:28.387113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bace8a9c-ddff-4be4-903d-c134898676f6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:28.407531 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bace8a9c-ddff-4be4-903d-c134898676f6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1271 microversion: 2.1 time: 0.514277 Aug 23 17:56:28.408119 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 734/1546] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:27 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1271 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:28.423651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-be854d0f-d6ea-4fd8-bae7-d9e9f3a2b31b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:28.426143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-be854d0f-d6ea-4fd8-bae7-d9e9f3a2b31b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:28.442951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be854d0f-d6ea-4fd8-bae7-d9e9f3a2b31b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:28.444500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be854d0f-d6ea-4fd8-bae7-d9e9f3a2b31b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:28.445166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be854d0f-d6ea-4fd8-bae7-d9e9f3a2b31b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:28.447578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be854d0f-d6ea-4fd8-bae7-d9e9f3a2b31b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:28.448052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be854d0f-d6ea-4fd8-bae7-d9e9f3a2b31b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:28.448487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be854d0f-d6ea-4fd8-bae7-d9e9f3a2b31b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:28.512326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:56:28.513419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:56:28.520607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:56:28.521080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:56:28.521513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:56:28.537199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:28.537699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:28.538153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:28.538924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:28.539387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:28.539822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:28.562494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Getting quotas for project fbb6fbb08d9d4edc88ccf65f8b3e1df1. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:56:28.567800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Getting quotas for user 4440b850f8974643bd22fc84ddd265ee and project fbb6fbb08d9d4edc88ccf65f8b3e1df1. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:56:28.575175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-be854d0f-d6ea-4fd8-bae7-d9e9f3a2b31b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:28.591806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:28.592115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-be854d0f-d6ea-4fd8-bae7-d9e9f3a2b31b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:28.594354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-be854d0f-d6ea-4fd8-bae7-d9e9f3a2b31b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:28.597674 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-be854d0f-d6ea-4fd8-bae7-d9e9f3a2b31b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.186700 Aug 23 17:56:28.598263 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 735/1547] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:28 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:28.598577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:56:28.601043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:56:28.604029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-78877b4a-a6c9-4e54-9bb8-f0f1703b0399 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:28.604982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-78877b4a-a6c9-4e54-9bb8-f0f1703b0399 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:28.612953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78877b4a-a6c9-4e54-9bb8-f0f1703b0399 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:28.613684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78877b4a-a6c9-4e54-9bb8-f0f1703b0399 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:28.614271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78877b4a-a6c9-4e54-9bb8-f0f1703b0399 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:28.616133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78877b4a-a6c9-4e54-9bb8-f0f1703b0399 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:28.616760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78877b4a-a6c9-4e54-9bb8-f0f1703b0399 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:28.617496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78877b4a-a6c9-4e54-9bb8-f0f1703b0399 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:28.712035 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7edd263d-daea-4b2a-b99a-f2d7ce9e5344 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.317645 Aug 23 17:56:28.712692 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 813/1548] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:56:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1321 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:56:28.726372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f0a06c1a-c23e-445c-87b0-952c81b0adff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:28.732492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f0a06c1a-c23e-445c-87b0-952c81b0adff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:28.755001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-78877b4a-a6c9-4e54-9bb8-f0f1703b0399 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:28.763661 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-78877b4a-a6c9-4e54-9bb8-f0f1703b0399 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1270 microversion: 2.1 time: 0.163808 Aug 23 17:56:28.764431 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 736/1549] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:28 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1270 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:28.845696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f0a06c1a-c23e-445c-87b0-952c81b0adff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:28.854145 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f0a06c1a-c23e-445c-87b0-952c81b0adff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1224 microversion: 2.1 time: 0.131629 Aug 23 17:56:28.867885 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 814/1550] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:28 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1224 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:28.912785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5cec3ec5-882a-4853-990f-8a206fe6c7f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:28.914247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5cec3ec5-882a-4853-990f-8a206fe6c7f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:28.939200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cec3ec5-882a-4853-990f-8a206fe6c7f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:28.939934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cec3ec5-882a-4853-990f-8a206fe6c7f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:28.944442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cec3ec5-882a-4853-990f-8a206fe6c7f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:28.947406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cec3ec5-882a-4853-990f-8a206fe6c7f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:28.948210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cec3ec5-882a-4853-990f-8a206fe6c7f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:28.950977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cec3ec5-882a-4853-990f-8a206fe6c7f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:29.184425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-78f1d6f5-044e-4905-8e5c-5979fccf6c79 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:29.186037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-78f1d6f5-044e-4905-8e5c-5979fccf6c79 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:29.194834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f1d6f5-044e-4905-8e5c-5979fccf6c79 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:29.196642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f1d6f5-044e-4905-8e5c-5979fccf6c79 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:29.197315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f1d6f5-044e-4905-8e5c-5979fccf6c79 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:29.198519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f1d6f5-044e-4905-8e5c-5979fccf6c79 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:29.199873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f1d6f5-044e-4905-8e5c-5979fccf6c79 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:29.201097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f1d6f5-044e-4905-8e5c-5979fccf6c79 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:29.457456 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-78f1d6f5-044e-4905-8e5c-5979fccf6c79 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1813 microversion: 2.1 time: 0.276638 Aug 23 17:56:29.476933 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 815/1551] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:29 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1813 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:29.491851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e3ba3ef-4583-472f-9b7b-394719e45986 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:29.493375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2e3ba3ef-4583-472f-9b7b-394719e45986 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:29.505132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e3ba3ef-4583-472f-9b7b-394719e45986 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:29.514304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e3ba3ef-4583-472f-9b7b-394719e45986 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:29.515679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e3ba3ef-4583-472f-9b7b-394719e45986 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:29.516697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e3ba3ef-4583-472f-9b7b-394719e45986 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:29.517397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e3ba3ef-4583-472f-9b7b-394719e45986 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:29.518073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e3ba3ef-4583-472f-9b7b-394719e45986 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:29.652809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5cec3ec5-882a-4853-990f-8a206fe6c7f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:29.671291 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5cec3ec5-882a-4853-990f-8a206fe6c7f8 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.763220 Aug 23 17:56:29.686608 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 737/1552] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:28 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:29.700889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-988e6184-2b7a-49bb-9d32-8997e9bf9a2c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:29.703694 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:29.703694 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:56:29.704907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-988e6184-2b7a-49bb-9d32-8997e9bf9a2c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:29.705400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-988e6184-2b7a-49bb-9d32-8997e9bf9a2c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:29.705840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-988e6184-2b7a-49bb-9d32-8997e9bf9a2c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:29.711676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-988e6184-2b7a-49bb-9d32-8997e9bf9a2c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:29.712729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-988e6184-2b7a-49bb-9d32-8997e9bf9a2c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:29.713459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-988e6184-2b7a-49bb-9d32-8997e9bf9a2c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:29.781507 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-988e6184-2b7a-49bb-9d32-8997e9bf9a2c tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.093455 Aug 23 17:56:29.790724 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 738/1553] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Aug 23 17:56:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:29.798319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b2723338-b56c-4f4a-a499-465772cf58e5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:29.799585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b2723338-b56c-4f4a-a499-465772cf58e5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:29.808923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2723338-b56c-4f4a-a499-465772cf58e5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:29.809775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2723338-b56c-4f4a-a499-465772cf58e5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:29.811301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2723338-b56c-4f4a-a499-465772cf58e5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:29.812276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2723338-b56c-4f4a-a499-465772cf58e5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:29.812978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2723338-b56c-4f4a-a499-465772cf58e5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:29.813729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2723338-b56c-4f4a-a499-465772cf58e5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:29.915215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2e3ba3ef-4583-472f-9b7b-394719e45986 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:29.924019 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e3ba3ef-4583-472f-9b7b-394719e45986 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1313 microversion: 2.1 time: 0.442820 Aug 23 17:56:29.924601 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 816/1554] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:29 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:29.937506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-34177d1c-691b-4bb7-b7f1-281b3c21a5f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:29.940822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-34177d1c-691b-4bb7-b7f1-281b3c21a5f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:29.955103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34177d1c-691b-4bb7-b7f1-281b3c21a5f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:29.955464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b2723338-b56c-4f4a-a499-465772cf58e5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:29.956725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34177d1c-691b-4bb7-b7f1-281b3c21a5f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:29.958194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34177d1c-691b-4bb7-b7f1-281b3c21a5f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:29.959285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34177d1c-691b-4bb7-b7f1-281b3c21a5f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:29.960219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34177d1c-691b-4bb7-b7f1-281b3c21a5f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:29.960912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34177d1c-691b-4bb7-b7f1-281b3c21a5f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:29.970342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b2723338-b56c-4f4a-a499-465772cf58e5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:29.979503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b2723338-b56c-4f4a-a499-465772cf58e5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:30.002431 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b2723338-b56c-4f4a-a499-465772cf58e5 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.209530 Aug 23 17:56:30.006746 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 739/1555] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:29 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:30.012165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-36705fed-17fa-4040-b6c4-6e67572c6385 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:30.023162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-36705fed-17fa-4040-b6c4-6e67572c6385 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:30.036101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36705fed-17fa-4040-b6c4-6e67572c6385 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:30.036873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36705fed-17fa-4040-b6c4-6e67572c6385 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:30.037465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36705fed-17fa-4040-b6c4-6e67572c6385 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:30.038382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36705fed-17fa-4040-b6c4-6e67572c6385 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:30.039032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36705fed-17fa-4040-b6c4-6e67572c6385 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:30.039725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36705fed-17fa-4040-b6c4-6e67572c6385 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:30.113923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-34177d1c-691b-4bb7-b7f1-281b3c21a5f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:30.127137 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-34177d1c-691b-4bb7-b7f1-281b3c21a5f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1276 microversion: 2.1 time: 0.197150 Aug 23 17:56:30.141804 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 817/1556] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:29 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1276 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:30.320150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-36705fed-17fa-4040-b6c4-6e67572c6385 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:30.330565 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-36705fed-17fa-4040-b6c4-6e67572c6385 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1220 microversion: 2.1 time: 0.322635 Aug 23 17:56:30.336250 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 740/1557] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:30 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1220 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:30.694212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a1d02cb2-c7a3-4985-b41f-981c89cd82c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:30.695671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a1d02cb2-c7a3-4985-b41f-981c89cd82c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:30.704847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1d02cb2-c7a3-4985-b41f-981c89cd82c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:30.709623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1d02cb2-c7a3-4985-b41f-981c89cd82c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:30.710271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1d02cb2-c7a3-4985-b41f-981c89cd82c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:30.713430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1d02cb2-c7a3-4985-b41f-981c89cd82c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:30.714584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1d02cb2-c7a3-4985-b41f-981c89cd82c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:30.716113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1d02cb2-c7a3-4985-b41f-981c89cd82c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:30.945070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f525563-c051-4b79-b16f-ecb14a472396 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:30.945971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5f525563-c051-4b79-b16f-ecb14a472396 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:30.956787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f525563-c051-4b79-b16f-ecb14a472396 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:30.957437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f525563-c051-4b79-b16f-ecb14a472396 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:30.957703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f525563-c051-4b79-b16f-ecb14a472396 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:30.971594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f525563-c051-4b79-b16f-ecb14a472396 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:30.972077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f525563-c051-4b79-b16f-ecb14a472396 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:30.972694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f525563-c051-4b79-b16f-ecb14a472396 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:31.155982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a1d02cb2-c7a3-4985-b41f-981c89cd82c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:31.167872 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a1d02cb2-c7a3-4985-b41f-981c89cd82c0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 0.478556 Aug 23 17:56:31.170746 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 818/1558] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:30 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:31.176284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec04ea32-7289-406c-a88e-9929ecb1bcae tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:31.177216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ec04ea32-7289-406c-a88e-9929ecb1bcae tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:31.187078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec04ea32-7289-406c-a88e-9929ecb1bcae tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:31.188390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec04ea32-7289-406c-a88e-9929ecb1bcae tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:31.189515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec04ea32-7289-406c-a88e-9929ecb1bcae tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:31.192426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec04ea32-7289-406c-a88e-9929ecb1bcae tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:31.193235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec04ea32-7289-406c-a88e-9929ecb1bcae tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:31.194309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec04ea32-7289-406c-a88e-9929ecb1bcae tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:31.461068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec04ea32-7289-406c-a88e-9929ecb1bcae tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:31.475493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec04ea32-7289-406c-a88e-9929ecb1bcae tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:31.476976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec04ea32-7289-406c-a88e-9929ecb1bcae tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:31.478179 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec04ea32-7289-406c-a88e-9929ecb1bcae tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.306211 Aug 23 17:56:31.491774 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 819/1559] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:31 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:31.516071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cb26a092-fc48-45eb-a987-b2948b6446ce tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:31.516849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cb26a092-fc48-45eb-a987-b2948b6446ce tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:31.546569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb26a092-fc48-45eb-a987-b2948b6446ce tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:31.547078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb26a092-fc48-45eb-a987-b2948b6446ce tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:31.547526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb26a092-fc48-45eb-a987-b2948b6446ce tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:31.548251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb26a092-fc48-45eb-a987-b2948b6446ce tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:31.548801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb26a092-fc48-45eb-a987-b2948b6446ce tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:31.549129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb26a092-fc48-45eb-a987-b2948b6446ce tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:31.712634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f525563-c051-4b79-b16f-ecb14a472396 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:31.722818 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5f525563-c051-4b79-b16f-ecb14a472396 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1313 microversion: 2.1 time: 0.781448 Aug 23 17:56:31.723409 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 741/1560] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:30 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1313 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:31.739050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c43aaf58-cb2f-4982-9e1e-de50af01d8ff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:31.739739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c43aaf58-cb2f-4982-9e1e-de50af01d8ff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:31.756817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c43aaf58-cb2f-4982-9e1e-de50af01d8ff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:31.757709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c43aaf58-cb2f-4982-9e1e-de50af01d8ff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:31.758702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c43aaf58-cb2f-4982-9e1e-de50af01d8ff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:31.759606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c43aaf58-cb2f-4982-9e1e-de50af01d8ff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:31.764024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c43aaf58-cb2f-4982-9e1e-de50af01d8ff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:31.764667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c43aaf58-cb2f-4982-9e1e-de50af01d8ff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:31.957471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c43aaf58-cb2f-4982-9e1e-de50af01d8ff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:31.998903 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c43aaf58-cb2f-4982-9e1e-de50af01d8ff tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1276 microversion: 2.1 time: 0.274209 Aug 23 17:56:31.999985 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 742/1561] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:31 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1276 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:32.005814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-908cc8fa-2b02-4d36-bbca-3e7c780cad81 req-f579fda7-1c41-4bf1-9565-28a47c470fef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3ba76a3-5838-410f-897c-e2edf5812436", "tag": "140e9847-1506-4a90-b25a-8c4d7b6f71c4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:32.022022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-908cc8fa-2b02-4d36-bbca-3e7c780cad81 req-f579fda7-1c41-4bf1-9565-28a47c470fef service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:32.022819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-908cc8fa-2b02-4d36-bbca-3e7c780cad81 req-f579fda7-1c41-4bf1-9565-28a47c470fef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:32.023441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-908cc8fa-2b02-4d36-bbca-3e7c780cad81 req-f579fda7-1c41-4bf1-9565-28a47c470fef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:32.039193 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-908cc8fa-2b02-4d36-bbca-3e7c780cad81 req-f579fda7-1c41-4bf1-9565-28a47c470fef service nova] Creating event network-changed:140e9847-1506-4a90-b25a-8c4d7b6f71c4 for instance c3ba76a3-5838-410f-897c-e2edf5812436 on n-h2-850468-16 Aug 23 17:56:32.046267 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-908cc8fa-2b02-4d36-bbca-3e7c780cad81 req-f579fda7-1c41-4bf1-9565-28a47c470fef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044562 Aug 23 17:56:32.047611 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 743/1562] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:32.096474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cb26a092-fc48-45eb-a987-b2948b6446ce tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:32.108017 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cb26a092-fc48-45eb-a987-b2948b6446ce tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.614672 Aug 23 17:56:32.108553 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 820/1563] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:31 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:32.190748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4ed3ccb3-8dab-406b-b0e9-b3d259cadde9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:32.191504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4ed3ccb3-8dab-406b-b0e9-b3d259cadde9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:32.212239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ed3ccb3-8dab-406b-b0e9-b3d259cadde9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:32.212732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ed3ccb3-8dab-406b-b0e9-b3d259cadde9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:32.213353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ed3ccb3-8dab-406b-b0e9-b3d259cadde9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:32.214076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ed3ccb3-8dab-406b-b0e9-b3d259cadde9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:32.214527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ed3ccb3-8dab-406b-b0e9-b3d259cadde9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:32.216008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ed3ccb3-8dab-406b-b0e9-b3d259cadde9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:32.252488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:32.502716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a9851d01-80b0-44e7-8fd5-1e922af85c6e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:32.503381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a9851d01-80b0-44e7-8fd5-1e922af85c6e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:32.515328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9851d01-80b0-44e7-8fd5-1e922af85c6e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:32.516068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9851d01-80b0-44e7-8fd5-1e922af85c6e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:32.518744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9851d01-80b0-44e7-8fd5-1e922af85c6e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:32.520105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9851d01-80b0-44e7-8fd5-1e922af85c6e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:32.520750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9851d01-80b0-44e7-8fd5-1e922af85c6e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:32.522274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9851d01-80b0-44e7-8fd5-1e922af85c6e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:32.765527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a9851d01-80b0-44e7-8fd5-1e922af85c6e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:32.776543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a9851d01-80b0-44e7-8fd5-1e922af85c6e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:32.786920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a9851d01-80b0-44e7-8fd5-1e922af85c6e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:32.788690 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a9851d01-80b0-44e7-8fd5-1e922af85c6e tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.290150 Aug 23 17:56:32.789498 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 821/1564] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:32 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:56:32.808142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a39f1110-e81f-417b-ba74-3976820ae5fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:32.809181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a39f1110-e81f-417b-ba74-3976820ae5fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:32.821506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a39f1110-e81f-417b-ba74-3976820ae5fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:32.822130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a39f1110-e81f-417b-ba74-3976820ae5fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:32.822756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a39f1110-e81f-417b-ba74-3976820ae5fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:32.824106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a39f1110-e81f-417b-ba74-3976820ae5fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:32.824719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a39f1110-e81f-417b-ba74-3976820ae5fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:32.825263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a39f1110-e81f-417b-ba74-3976820ae5fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:33.094525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a39f1110-e81f-417b-ba74-3976820ae5fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:33.102762 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a39f1110-e81f-417b-ba74-3976820ae5fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1313 microversion: 2.1 time: 0.311799 Aug 23 17:56:33.104010 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 822/1565] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:32 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:33.110434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1b05f4ac-cccf-4763-b87d-a7c134c2359a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d292ec21-45ad-4406-8d79-35c914c8ea58", "device": "/dev/xvdb"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:33.116356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1b05f4ac-cccf-4763-b87d-a7c134c2359a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:33.132213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b05f4ac-cccf-4763-b87d-a7c134c2359a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:33.132996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b05f4ac-cccf-4763-b87d-a7c134c2359a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:33.133603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b05f4ac-cccf-4763-b87d-a7c134c2359a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:33.134505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b05f4ac-cccf-4763-b87d-a7c134c2359a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:33.135171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b05f4ac-cccf-4763-b87d-a7c134c2359a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:33.135773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b05f4ac-cccf-4763-b87d-a7c134c2359a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:33.144252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:33.221869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4ed3ccb3-8dab-406b-b0e9-b3d259cadde9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:33.262860 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4ed3ccb3-8dab-406b-b0e9-b3d259cadde9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1542 microversion: 2.1 time: 1.076471 Aug 23 17:56:33.282591 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 744/1566] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:32 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1542 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:33.301239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-850eeeb6-e614-49b6-857b-5bc45a9db7c0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:33.302731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-850eeeb6-e614-49b6-857b-5bc45a9db7c0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:33.313036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-850eeeb6-e614-49b6-857b-5bc45a9db7c0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:33.316408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-850eeeb6-e614-49b6-857b-5bc45a9db7c0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:33.318833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-850eeeb6-e614-49b6-857b-5bc45a9db7c0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:33.319893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-850eeeb6-e614-49b6-857b-5bc45a9db7c0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:33.322757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-850eeeb6-e614-49b6-857b-5bc45a9db7c0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:33.322757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-850eeeb6-e614-49b6-857b-5bc45a9db7c0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:33.517274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-850eeeb6-e614-49b6-857b-5bc45a9db7c0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:33.531089 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-850eeeb6-e614-49b6-857b-5bc45a9db7c0 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1282 microversion: 2.1 time: 0.241642 Aug 23 17:56:33.532011 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 745/1567] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:33 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1282 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:33.540010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f9be4e3-cd6e-4c34-8e20-e91246ca4db8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:33.541508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f9be4e3-cd6e-4c34-8e20-e91246ca4db8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:33.550204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f9be4e3-cd6e-4c34-8e20-e91246ca4db8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:33.550796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f9be4e3-cd6e-4c34-8e20-e91246ca4db8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:33.551744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f9be4e3-cd6e-4c34-8e20-e91246ca4db8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:33.552675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f9be4e3-cd6e-4c34-8e20-e91246ca4db8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:33.553392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f9be4e3-cd6e-4c34-8e20-e91246ca4db8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:33.554757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f9be4e3-cd6e-4c34-8e20-e91246ca4db8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:33.657153 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1b05f4ac-cccf-4763-b87d-a7c134c2359a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "POST /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.551543 Aug 23 17:56:33.663609 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 823/1568] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 17:56:33 2022] POST /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments => generated 194 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:33.818142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-378a2d05-5a5b-49ae-a74d-f2d167a048f1 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:33.819216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-378a2d05-5a5b-49ae-a74d-f2d167a048f1 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:33.826808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-378a2d05-5a5b-49ae-a74d-f2d167a048f1 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:33.827311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-378a2d05-5a5b-49ae-a74d-f2d167a048f1 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:33.827763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-378a2d05-5a5b-49ae-a74d-f2d167a048f1 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:33.828497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-378a2d05-5a5b-49ae-a74d-f2d167a048f1 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:33.829232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-378a2d05-5a5b-49ae-a74d-f2d167a048f1 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:33.829675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-378a2d05-5a5b-49ae-a74d-f2d167a048f1 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:34.091910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-378a2d05-5a5b-49ae-a74d-f2d167a048f1 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:34.101511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-378a2d05-5a5b-49ae-a74d-f2d167a048f1 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:34.103965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-378a2d05-5a5b-49ae-a74d-f2d167a048f1 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:34.106131 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-378a2d05-5a5b-49ae-a74d-f2d167a048f1 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.292905 Aug 23 17:56:34.119615 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 824/1569] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:33 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:56:34.143131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8a495691-1bda-4a6e-b018-df16765f895c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:34.144258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8a495691-1bda-4a6e-b018-df16765f895c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:34.160300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a495691-1bda-4a6e-b018-df16765f895c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:34.160808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a495691-1bda-4a6e-b018-df16765f895c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:34.161256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a495691-1bda-4a6e-b018-df16765f895c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:34.161980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a495691-1bda-4a6e-b018-df16765f895c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:34.162486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a495691-1bda-4a6e-b018-df16765f895c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:34.162944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a495691-1bda-4a6e-b018-df16765f895c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:34.362617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f9be4e3-cd6e-4c34-8e20-e91246ca4db8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:34.375127 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f9be4e3-cd6e-4c34-8e20-e91246ca4db8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.837743 Aug 23 17:56:34.376102 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 746/1570] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:33 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:34.388539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f23fb932-d0f9-4873-a9fa-3f2bf376647e req-d2e76a6e-7a33-4d5b-802c-0dd2e3105348 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceea6924-e172-4a5c-bb82-b77a6255ec6c", "tag": "27f162ab-9c0c-4c70-8eed-864adf0c88f8"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:34.407177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f23fb932-d0f9-4873-a9fa-3f2bf376647e req-d2e76a6e-7a33-4d5b-802c-0dd2e3105348 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:34.407658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f23fb932-d0f9-4873-a9fa-3f2bf376647e req-d2e76a6e-7a33-4d5b-802c-0dd2e3105348 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:34.408082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f23fb932-d0f9-4873-a9fa-3f2bf376647e req-d2e76a6e-7a33-4d5b-802c-0dd2e3105348 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:34.429614 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f23fb932-d0f9-4873-a9fa-3f2bf376647e req-d2e76a6e-7a33-4d5b-802c-0dd2e3105348 service nova] Creating event network-changed:27f162ab-9c0c-4c70-8eed-864adf0c88f8 for instance ceea6924-e172-4a5c-bb82-b77a6255ec6c on n-h2-850468-16 Aug 23 17:56:34.448751 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f23fb932-d0f9-4873-a9fa-3f2bf376647e req-d2e76a6e-7a33-4d5b-802c-0dd2e3105348 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071097 Aug 23 17:56:34.454423 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 747/1571] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:34.460085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ab8c6b98-de9a-4c66-9f14-2f6c77aec79c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:34.467256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab8c6b98-de9a-4c66-9f14-2f6c77aec79c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:34.483149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab8c6b98-de9a-4c66-9f14-2f6c77aec79c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:34.483658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab8c6b98-de9a-4c66-9f14-2f6c77aec79c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:34.484112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab8c6b98-de9a-4c66-9f14-2f6c77aec79c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:34.484839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab8c6b98-de9a-4c66-9f14-2f6c77aec79c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:34.485300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab8c6b98-de9a-4c66-9f14-2f6c77aec79c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:34.485731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab8c6b98-de9a-4c66-9f14-2f6c77aec79c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:34.742627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8a495691-1bda-4a6e-b018-df16765f895c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:34.758911 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8a495691-1bda-4a6e-b018-df16765f895c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1313 microversion: 2.1 time: 0.628297 Aug 23 17:56:34.773405 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 825/1572] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:34 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1313 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:34.779273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2c358b43-b8a5-48bf-b77a-84e2e198aa86 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:34.787858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2c358b43-b8a5-48bf-b77a-84e2e198aa86 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:34.815658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c358b43-b8a5-48bf-b77a-84e2e198aa86 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:34.818193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c358b43-b8a5-48bf-b77a-84e2e198aa86 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:34.818727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c358b43-b8a5-48bf-b77a-84e2e198aa86 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:34.819500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c358b43-b8a5-48bf-b77a-84e2e198aa86 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:34.819979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c358b43-b8a5-48bf-b77a-84e2e198aa86 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:34.820417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c358b43-b8a5-48bf-b77a-84e2e198aa86 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:34.915781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ab8c6b98-de9a-4c66-9f14-2f6c77aec79c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:34.924555 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ab8c6b98-de9a-4c66-9f14-2f6c77aec79c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1541 microversion: 2.1 time: 0.468556 Aug 23 17:56:34.925444 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 748/1573] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:34 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1541 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:35.159584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa963f01-b32e-4ab0-8b17-8c48822944aa tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:35.160800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa963f01-b32e-4ab0-8b17-8c48822944aa tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:35.177442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa963f01-b32e-4ab0-8b17-8c48822944aa tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:35.178321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa963f01-b32e-4ab0-8b17-8c48822944aa tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:35.179179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa963f01-b32e-4ab0-8b17-8c48822944aa tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:35.180156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa963f01-b32e-4ab0-8b17-8c48822944aa tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:35.180566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa963f01-b32e-4ab0-8b17-8c48822944aa tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:35.180987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa963f01-b32e-4ab0-8b17-8c48822944aa tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:35.189311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2c358b43-b8a5-48bf-b77a-84e2e198aa86 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:35.196801 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2c358b43-b8a5-48bf-b77a-84e2e198aa86 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.421994 Aug 23 17:56:35.201012 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 826/1574] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:34 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:35.322165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa963f01-b32e-4ab0-8b17-8c48822944aa tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:35.338317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa963f01-b32e-4ab0-8b17-8c48822944aa tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:35.339184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa963f01-b32e-4ab0-8b17-8c48822944aa tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:35.340729 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa963f01-b32e-4ab0-8b17-8c48822944aa tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.184895 Aug 23 17:56:35.343832 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 749/1575] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:35 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:56:35.400915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-873d54d8-49c2-4a02-b105-d36ea91048c8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:35.402450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-873d54d8-49c2-4a02-b105-d36ea91048c8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:35.415392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-873d54d8-49c2-4a02-b105-d36ea91048c8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:35.416804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-873d54d8-49c2-4a02-b105-d36ea91048c8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:35.419710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-873d54d8-49c2-4a02-b105-d36ea91048c8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:35.420768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-873d54d8-49c2-4a02-b105-d36ea91048c8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:35.423127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-873d54d8-49c2-4a02-b105-d36ea91048c8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:35.423817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-873d54d8-49c2-4a02-b105-d36ea91048c8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:35.446139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1293698946", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "4af2b4ce-48be-4835-a763-a9afa8d42aed"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:35.517815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] validate_networks() for [('4af2b4ce-48be-4835-a763-a9afa8d42aed', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:56:35.646101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-873d54d8-49c2-4a02-b105-d36ea91048c8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:35.654484 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-873d54d8-49c2-4a02-b105-d36ea91048c8 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.258741 Aug 23 17:56:35.656013 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 750/1576] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:35 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:35.797672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2034fd11-9b65-49c0-9d08-cb9c28c69fde tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:35.798447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2034fd11-9b65-49c0-9d08-cb9c28c69fde tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:35.804801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2034fd11-9b65-49c0-9d08-cb9c28c69fde tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:35.805548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2034fd11-9b65-49c0-9d08-cb9c28c69fde tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:35.806157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2034fd11-9b65-49c0-9d08-cb9c28c69fde tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:35.807076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2034fd11-9b65-49c0-9d08-cb9c28c69fde tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:35.807698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2034fd11-9b65-49c0-9d08-cb9c28c69fde tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:35.808994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2034fd11-9b65-49c0-9d08-cb9c28c69fde tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:35.989795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2034fd11-9b65-49c0-9d08-cb9c28c69fde tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:35.998728 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2034fd11-9b65-49c0-9d08-cb9c28c69fde tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1313 microversion: 2.1 time: 0.204973 Aug 23 17:56:36.000004 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 751/1577] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:35 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:36.013881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6ec5bcd8-dd60-45ac-843a-7845597b9c91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:36.014666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6ec5bcd8-dd60-45ac-843a-7845597b9c91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:36.025248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ec5bcd8-dd60-45ac-843a-7845597b9c91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:36.026110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ec5bcd8-dd60-45ac-843a-7845597b9c91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:36.026816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ec5bcd8-dd60-45ac-843a-7845597b9c91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:36.028029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ec5bcd8-dd60-45ac-843a-7845597b9c91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:36.028803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ec5bcd8-dd60-45ac-843a-7845597b9c91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:36.029626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ec5bcd8-dd60-45ac-843a-7845597b9c91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:36.213725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6ec5bcd8-dd60-45ac-843a-7845597b9c91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:36.229121 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6ec5bcd8-dd60-45ac-843a-7845597b9c91 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1473 microversion: 2.1 time: 0.227791 Aug 23 17:56:36.229714 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 752/1578] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:36 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1473 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:36.246753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d8cc785b-c59f-4b8b-8484-efef604d8203 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:36.247695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d8cc785b-c59f-4b8b-8484-efef604d8203 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:36.253948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cc785b-c59f-4b8b-8484-efef604d8203 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:36.254679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cc785b-c59f-4b8b-8484-efef604d8203 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:36.255302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cc785b-c59f-4b8b-8484-efef604d8203 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:36.256187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cc785b-c59f-4b8b-8484-efef604d8203 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:36.256799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cc785b-c59f-4b8b-8484-efef604d8203 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:36.257388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cc785b-c59f-4b8b-8484-efef604d8203 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:36.339509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:56:36.340003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:56:36.340859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:56:36.341373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:56:36.342032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:56:36.359515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:36.361069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:36.363953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:36.365057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:36.365761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:36.366433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:36.430035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Getting quotas for project e7b882a8b2644f1dac937ffcfd1ce14b. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:56:36.435996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Getting quotas for user 2b5f2c622daa43968a1a23cad5c91a49 and project e7b882a8b2644f1dac937ffcfd1ce14b. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:56:36.452912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:56:36.456351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:56:36.471934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d8cc785b-c59f-4b8b-8484-efef604d8203 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:36.480737 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d8cc785b-c59f-4b8b-8484-efef604d8203 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.249168 Aug 23 17:56:36.481673 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 753/1579] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:36 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:36.517992 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7197a630-d943-4839-949b-59a3e01f3ca2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.139398 Aug 23 17:56:36.519282 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 827/1580] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:56:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 1141 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:56:36.524958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f5b7291b-30ec-43e0-aa5b-d01fe2794e31 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:36.526472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f5b7291b-30ec-43e0-aa5b-d01fe2794e31 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:36.535231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f5b7291b-30ec-43e0-aa5b-d01fe2794e31 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:36.536015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f5b7291b-30ec-43e0-aa5b-d01fe2794e31 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:36.536664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f5b7291b-30ec-43e0-aa5b-d01fe2794e31 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:36.537650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f5b7291b-30ec-43e0-aa5b-d01fe2794e31 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:36.538511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f5b7291b-30ec-43e0-aa5b-d01fe2794e31 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:36.539335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f5b7291b-30ec-43e0-aa5b-d01fe2794e31 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:36.614898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-659ef824-be1a-4f43-a51a-e853979685ec req-9ebf8e96-6eb8-4e70-bab2-ea56894939ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14c2986a-4a33-4e1e-b560-1540016afc00", "tag": "c8c7df85-eb37-4532-b885-4761d737198f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:36.621815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:36.635913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-659ef824-be1a-4f43-a51a-e853979685ec req-9ebf8e96-6eb8-4e70-bab2-ea56894939ff service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:36.637279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-659ef824-be1a-4f43-a51a-e853979685ec req-9ebf8e96-6eb8-4e70-bab2-ea56894939ff service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:36.638480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-659ef824-be1a-4f43-a51a-e853979685ec req-9ebf8e96-6eb8-4e70-bab2-ea56894939ff service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:36.650762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f5b7291b-30ec-43e0-aa5b-d01fe2794e31 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:36.662839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f5b7291b-30ec-43e0-aa5b-d01fe2794e31 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:36.663599 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-659ef824-be1a-4f43-a51a-e853979685ec req-9ebf8e96-6eb8-4e70-bab2-ea56894939ff service nova] Creating event network-changed:c8c7df85-eb37-4532-b885-4761d737198f for instance 14c2986a-4a33-4e1e-b560-1540016afc00 on n-h1-850468-16 Aug 23 17:56:36.664911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f5b7291b-30ec-43e0-aa5b-d01fe2794e31 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:36.667032 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f5b7291b-30ec-43e0-aa5b-d01fe2794e31 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.146386 Aug 23 17:56:36.668844 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 828/1581] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:36 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:36.679280 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-659ef824-be1a-4f43-a51a-e853979685ec req-9ebf8e96-6eb8-4e70-bab2-ea56894939ff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180475 Aug 23 17:56:36.681706 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 754/1582] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:36.689767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-087f1b8e-2246-49e9-815b-81751d5f8421 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:36.690420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-087f1b8e-2246-49e9-815b-81751d5f8421 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:36.695045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e296b903-52d8-45d2-8044-c683a9659c0e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:36.695933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e296b903-52d8-45d2-8044-c683a9659c0e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:36.704522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e296b903-52d8-45d2-8044-c683a9659c0e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:36.705153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e296b903-52d8-45d2-8044-c683a9659c0e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:36.705698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e296b903-52d8-45d2-8044-c683a9659c0e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:36.706699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e296b903-52d8-45d2-8044-c683a9659c0e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:36.707178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e296b903-52d8-45d2-8044-c683a9659c0e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:36.707857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e296b903-52d8-45d2-8044-c683a9659c0e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:36.776415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-087f1b8e-2246-49e9-815b-81751d5f8421 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:36.796799 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-087f1b8e-2246-49e9-815b-81751d5f8421 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1224 microversion: 2.1 time: 0.125315 Aug 23 17:56:36.801566 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 829/1583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:36 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1224 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:36.912660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e296b903-52d8-45d2-8044-c683a9659c0e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:36.923056 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e296b903-52d8-45d2-8044-c683a9659c0e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.238444 Aug 23 17:56:36.924659 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 755/1584] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:36 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:37.020938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-07732e31-eafc-421c-8b00-8f153368ed4a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:37.021827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-07732e31-eafc-421c-8b00-8f153368ed4a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:37.030508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07732e31-eafc-421c-8b00-8f153368ed4a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.031043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07732e31-eafc-421c-8b00-8f153368ed4a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.036215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07732e31-eafc-421c-8b00-8f153368ed4a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:37.037035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07732e31-eafc-421c-8b00-8f153368ed4a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.044749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07732e31-eafc-421c-8b00-8f153368ed4a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.045784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07732e31-eafc-421c-8b00-8f153368ed4a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:37.088592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-113b8ade-7376-4ce1-a644-e64c76291881 req-e45bab70-4f80-4568-8650-94e718cca1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c329be5-120a-4bfd-ba7d-12c0ed0c4814", "name": "network-vif-unplugged", "status": "completed", "tag": "777bb24b-a6b8-45cd-9bb8-2263c15bf327"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:37.107644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-113b8ade-7376-4ce1-a644-e64c76291881 req-e45bab70-4f80-4568-8650-94e718cca1b0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.108463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-113b8ade-7376-4ce1-a644-e64c76291881 req-e45bab70-4f80-4568-8650-94e718cca1b0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.108899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-113b8ade-7376-4ce1-a644-e64c76291881 req-e45bab70-4f80-4568-8650-94e718cca1b0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:37.157066 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-113b8ade-7376-4ce1-a644-e64c76291881 req-e45bab70-4f80-4568-8650-94e718cca1b0 service nova] Creating event network-vif-unplugged:777bb24b-a6b8-45cd-9bb8-2263c15bf327 for instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 on n-h1-850468-16 Aug 23 17:56:37.196340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-113b8ade-7376-4ce1-a644-e64c76291881 req-e45bab70-4f80-4568-8650-94e718cca1b0 service nova] Instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 17:56:37.210525 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-113b8ade-7376-4ce1-a644-e64c76291881 req-e45bab70-4f80-4568-8650-94e718cca1b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.213318 Aug 23 17:56:37.214365 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 830/1585] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:37.253781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8adab816-c3a7-4a0c-b10c-177f331381e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:37.254148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=22 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:37.254758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8adab816-c3a7-4a0c-b10c-177f331381e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:37.261936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8adab816-c3a7-4a0c-b10c-177f331381e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.263277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8adab816-c3a7-4a0c-b10c-177f331381e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.263911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8adab816-c3a7-4a0c-b10c-177f331381e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:37.264972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8adab816-c3a7-4a0c-b10c-177f331381e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.265877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8adab816-c3a7-4a0c-b10c-177f331381e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.266479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8adab816-c3a7-4a0c-b10c-177f331381e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:37.347485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-07732e31-eafc-421c-8b00-8f153368ed4a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:37.360953 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-07732e31-eafc-421c-8b00-8f153368ed4a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1313 microversion: 2.1 time: 0.345151 Aug 23 17:56:37.375731 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 756/1586] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:37 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1313 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:37.468035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8adab816-c3a7-4a0c-b10c-177f331381e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:37.478391 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8adab816-c3a7-4a0c-b10c-177f331381e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1473 microversion: 2.1 time: 0.229145 Aug 23 17:56:37.479032 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 831/1587] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:37 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1473 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:37.509469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c97f3d84-3e01-4aef-b223-96010eea25fc tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:37.510372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c97f3d84-3e01-4aef-b223-96010eea25fc tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:37.518872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c97f3d84-3e01-4aef-b223-96010eea25fc tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.519513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c97f3d84-3e01-4aef-b223-96010eea25fc tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.519861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c97f3d84-3e01-4aef-b223-96010eea25fc tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:37.520679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c97f3d84-3e01-4aef-b223-96010eea25fc tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.521146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c97f3d84-3e01-4aef-b223-96010eea25fc tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.521580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c97f3d84-3e01-4aef-b223-96010eea25fc tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:37.697619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-183fb4c2-0e60-49f6-86fe-9dba187c080a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:37.698244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-183fb4c2-0e60-49f6-86fe-9dba187c080a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:37.709977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-183fb4c2-0e60-49f6-86fe-9dba187c080a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.710867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-183fb4c2-0e60-49f6-86fe-9dba187c080a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.711475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-183fb4c2-0e60-49f6-86fe-9dba187c080a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:37.712462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-183fb4c2-0e60-49f6-86fe-9dba187c080a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.713082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-183fb4c2-0e60-49f6-86fe-9dba187c080a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.713673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-183fb4c2-0e60-49f6-86fe-9dba187c080a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:37.823729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-183fb4c2-0e60-49f6-86fe-9dba187c080a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:37.838193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-183fb4c2-0e60-49f6-86fe-9dba187c080a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:37.840209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-183fb4c2-0e60-49f6-86fe-9dba187c080a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:37.841932 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-183fb4c2-0e60-49f6-86fe-9dba187c080a tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.151204 Aug 23 17:56:37.842789 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 832/1588] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:37 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:37.848143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf48ca33-606b-4fa7-b697-a2b3c77ab22e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:37.849036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf48ca33-606b-4fa7-b697-a2b3c77ab22e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:37.860883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf48ca33-606b-4fa7-b697-a2b3c77ab22e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.861732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf48ca33-606b-4fa7-b697-a2b3c77ab22e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.862400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf48ca33-606b-4fa7-b697-a2b3c77ab22e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:37.863450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf48ca33-606b-4fa7-b697-a2b3c77ab22e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.864284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf48ca33-606b-4fa7-b697-a2b3c77ab22e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.864954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf48ca33-606b-4fa7-b697-a2b3c77ab22e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:37.866605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c97f3d84-3e01-4aef-b223-96010eea25fc tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:37.877622 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c97f3d84-3e01-4aef-b223-96010eea25fc tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.377505 Aug 23 17:56:37.878437 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 757/1589] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:37 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:37.945039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-948420af-837a-4b82-a263-9c58e80bdeba tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:37.945916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-948420af-837a-4b82-a263-9c58e80bdeba tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:37.950104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf48ca33-606b-4fa7-b697-a2b3c77ab22e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:37.963313 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf48ca33-606b-4fa7-b697-a2b3c77ab22e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1276 microversion: 2.1 time: 0.118942 Aug 23 17:56:37.964172 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 833/1590] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:37 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:37.971241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-948420af-837a-4b82-a263-9c58e80bdeba tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.971743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-948420af-837a-4b82-a263-9c58e80bdeba tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.972178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-948420af-837a-4b82-a263-9c58e80bdeba tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:37.972908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-948420af-837a-4b82-a263-9c58e80bdeba tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:37.973359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-948420af-837a-4b82-a263-9c58e80bdeba tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:37.973784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-948420af-837a-4b82-a263-9c58e80bdeba tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:38.341971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-948420af-837a-4b82-a263-9c58e80bdeba tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:38.350572 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-948420af-837a-4b82-a263-9c58e80bdeba tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.409309 Aug 23 17:56:38.351232 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 758/1591] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:37 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:38.388618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d8f8592f-7966-4845-b591-9915bbfe14ba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:38.390021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d8f8592f-7966-4845-b591-9915bbfe14ba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:38.396262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8f8592f-7966-4845-b591-9915bbfe14ba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:38.396765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8f8592f-7966-4845-b591-9915bbfe14ba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:38.397209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8f8592f-7966-4845-b591-9915bbfe14ba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:38.397992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8f8592f-7966-4845-b591-9915bbfe14ba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:38.398457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8f8592f-7966-4845-b591-9915bbfe14ba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:38.398943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8f8592f-7966-4845-b591-9915bbfe14ba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:38.501675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d5ef14b5-6e8b-4b5b-ab28-48098bedcfcd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:38.502299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d5ef14b5-6e8b-4b5b-ab28-48098bedcfcd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:38.515166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5ef14b5-6e8b-4b5b-ab28-48098bedcfcd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:38.515793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5ef14b5-6e8b-4b5b-ab28-48098bedcfcd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:38.516105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5ef14b5-6e8b-4b5b-ab28-48098bedcfcd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:38.518815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5ef14b5-6e8b-4b5b-ab28-48098bedcfcd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:38.519303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5ef14b5-6e8b-4b5b-ab28-48098bedcfcd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:38.519755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5ef14b5-6e8b-4b5b-ab28-48098bedcfcd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:38.734446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d8f8592f-7966-4845-b591-9915bbfe14ba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:38.743578 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d8f8592f-7966-4845-b591-9915bbfe14ba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1313 microversion: 2.1 time: 0.359725 Aug 23 17:56:38.744161 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 834/1592] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:38 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:38.842297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5ef14b5-6e8b-4b5b-ab28-48098bedcfcd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:38.854452 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d5ef14b5-6e8b-4b5b-ab28-48098bedcfcd tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1473 microversion: 2.1 time: 0.354855 Aug 23 17:56:38.856493 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 759/1593] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:38 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1473 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:38.873109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ef088377-da67-4256-a950-6cff9ebb1fb6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:38.873891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ef088377-da67-4256-a950-6cff9ebb1fb6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:38.885570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef088377-da67-4256-a950-6cff9ebb1fb6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:38.886087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef088377-da67-4256-a950-6cff9ebb1fb6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:38.889860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef088377-da67-4256-a950-6cff9ebb1fb6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:38.890957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef088377-da67-4256-a950-6cff9ebb1fb6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:38.891654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef088377-da67-4256-a950-6cff9ebb1fb6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:38.892261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef088377-da67-4256-a950-6cff9ebb1fb6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:38.904342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c060f9f-059e-428e-9250-bbc00f2cc840 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:38.905370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4c060f9f-059e-428e-9250-bbc00f2cc840 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:38.913753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c060f9f-059e-428e-9250-bbc00f2cc840 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:38.914720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c060f9f-059e-428e-9250-bbc00f2cc840 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:38.915530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c060f9f-059e-428e-9250-bbc00f2cc840 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:38.917344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c060f9f-059e-428e-9250-bbc00f2cc840 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:38.920804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c060f9f-059e-428e-9250-bbc00f2cc840 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:38.921816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c060f9f-059e-428e-9250-bbc00f2cc840 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:39.025132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ef088377-da67-4256-a950-6cff9ebb1fb6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:39.043927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ef088377-da67-4256-a950-6cff9ebb1fb6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:39.045452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ef088377-da67-4256-a950-6cff9ebb1fb6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:39.046668 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ef088377-da67-4256-a950-6cff9ebb1fb6 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.181946 Aug 23 17:56:39.047233 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 835/1594] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:38 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:39.054889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ee9b12af-a75a-41e2-8dda-e8c601c39842 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:39.055582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ee9b12af-a75a-41e2-8dda-e8c601c39842 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:39.066925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee9b12af-a75a-41e2-8dda-e8c601c39842 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:39.072103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee9b12af-a75a-41e2-8dda-e8c601c39842 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:39.072630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee9b12af-a75a-41e2-8dda-e8c601c39842 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:39.073447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee9b12af-a75a-41e2-8dda-e8c601c39842 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:39.075096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee9b12af-a75a-41e2-8dda-e8c601c39842 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:39.078386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee9b12af-a75a-41e2-8dda-e8c601c39842 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:39.108150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4c060f9f-059e-428e-9250-bbc00f2cc840 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:39.119663 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4c060f9f-059e-428e-9250-bbc00f2cc840 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.221506 Aug 23 17:56:39.139669 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 760/1595] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:38 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:39.216038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ee9b12af-a75a-41e2-8dda-e8c601c39842 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:39.227270 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ee9b12af-a75a-41e2-8dda-e8c601c39842 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1284 microversion: 2.1 time: 0.177252 Aug 23 17:56:39.247738 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 836/1596] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:39 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1284 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:39.375603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-71ac6381-564e-4bbc-ad28-cfb45e2e2640 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:39.376315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-71ac6381-564e-4bbc-ad28-cfb45e2e2640 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:39.382807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71ac6381-564e-4bbc-ad28-cfb45e2e2640 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:39.383604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71ac6381-564e-4bbc-ad28-cfb45e2e2640 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:39.384040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71ac6381-564e-4bbc-ad28-cfb45e2e2640 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:39.384928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71ac6381-564e-4bbc-ad28-cfb45e2e2640 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:39.386118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71ac6381-564e-4bbc-ad28-cfb45e2e2640 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:39.387460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71ac6381-564e-4bbc-ad28-cfb45e2e2640 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:39.559333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-71ac6381-564e-4bbc-ad28-cfb45e2e2640 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:39.570656 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-71ac6381-564e-4bbc-ad28-cfb45e2e2640 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.201473 Aug 23 17:56:39.574789 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 761/1597] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:39 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:39.769102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c06490c9-fe36-4daf-98e9-6643d79cfc27 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:39.769709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c06490c9-fe36-4daf-98e9-6643d79cfc27 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:39.776569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06490c9-fe36-4daf-98e9-6643d79cfc27 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:39.777708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06490c9-fe36-4daf-98e9-6643d79cfc27 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:39.778227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06490c9-fe36-4daf-98e9-6643d79cfc27 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:39.778968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06490c9-fe36-4daf-98e9-6643d79cfc27 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:39.779421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06490c9-fe36-4daf-98e9-6643d79cfc27 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:39.779843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06490c9-fe36-4daf-98e9-6643d79cfc27 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:39.876393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-37466a64-2582-41fd-af59-7c6cd1f74ae1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:39.877295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-37466a64-2582-41fd-af59-7c6cd1f74ae1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:39.879449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=10 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:39.888314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37466a64-2582-41fd-af59-7c6cd1f74ae1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:39.889077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37466a64-2582-41fd-af59-7c6cd1f74ae1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:39.889675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37466a64-2582-41fd-af59-7c6cd1f74ae1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:39.890576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37466a64-2582-41fd-af59-7c6cd1f74ae1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:39.891182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37466a64-2582-41fd-af59-7c6cd1f74ae1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:39.891757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37466a64-2582-41fd-af59-7c6cd1f74ae1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:39.897298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:39.932233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c06490c9-fe36-4daf-98e9-6643d79cfc27 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:39.940760 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c06490c9-fe36-4daf-98e9-6643d79cfc27 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1313 microversion: 2.1 time: 0.175416 Aug 23 17:56:39.941339 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 837/1598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:39 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:40.040387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-37466a64-2582-41fd-af59-7c6cd1f74ae1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:40.048564 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-37466a64-2582-41fd-af59-7c6cd1f74ae1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1470 microversion: 2.1 time: 0.176371 Aug 23 17:56:40.049167 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 762/1599] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:39 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1470 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:40.069811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:40.070355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:40.071534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5accc529-30ed-4017-b5df-1534b26627bb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:40.072340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5accc529-30ed-4017-b5df-1534b26627bb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:40.077040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.077528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.077967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.078702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.079165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.079323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5accc529-30ed-4017-b5df-1534b26627bb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.079594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.079826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5accc529-30ed-4017-b5df-1534b26627bb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.080274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5accc529-30ed-4017-b5df-1534b26627bb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.080978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5accc529-30ed-4017-b5df-1534b26627bb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.081434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5accc529-30ed-4017-b5df-1534b26627bb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.081896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5accc529-30ed-4017-b5df-1534b26627bb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.122712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.123117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.123562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.124303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.124761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.125188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.151645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Getting quotas for project 88baf37ceb1342e3bc666ba96b4988ee. Resources: {'cores', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:56:40.153740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5accc529-30ed-4017-b5df-1534b26627bb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:40.159499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Getting quotas for user 8d66dd8a72974b1791fa449fb91c3282 and project 88baf37ceb1342e3bc666ba96b4988ee. Resources: {'cores', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:56:40.162375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5accc529-30ed-4017-b5df-1534b26627bb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:40.163943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5accc529-30ed-4017-b5df-1534b26627bb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:40.165120 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5accc529-30ed-4017-b5df-1534b26627bb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.097744 Aug 23 17:56:40.165674 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 763/1600] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:40 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:56:40.171032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd7a7cb7-0f08-48a8-ac51-09e162c5abca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:40.171784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cd7a7cb7-0f08-48a8-ac51-09e162c5abca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:40.177675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd7a7cb7-0f08-48a8-ac51-09e162c5abca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.178165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd7a7cb7-0f08-48a8-ac51-09e162c5abca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.178634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd7a7cb7-0f08-48a8-ac51-09e162c5abca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.179360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd7a7cb7-0f08-48a8-ac51-09e162c5abca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.179817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd7a7cb7-0f08-48a8-ac51-09e162c5abca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.180510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd7a7cb7-0f08-48a8-ac51-09e162c5abca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.229386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:40.310814 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fdbaf0a4-23b9-4814-86bf-266589964467 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "POST /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814/action" status: 202 len: 0 microversion: 2.1 time: 0.244688 Aug 23 17:56:40.311445 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 838/1601] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:56:40 2022] POST /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:56:40.316637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f4504082-86e3-4daf-a1fc-8a61bf780111 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:40.320126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f4504082-86e3-4daf-a1fc-8a61bf780111 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:40.323837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4504082-86e3-4daf-a1fc-8a61bf780111 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.324445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4504082-86e3-4daf-a1fc-8a61bf780111 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.325007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4504082-86e3-4daf-a1fc-8a61bf780111 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.325826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4504082-86e3-4daf-a1fc-8a61bf780111 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.326379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4504082-86e3-4daf-a1fc-8a61bf780111 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.326943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4504082-86e3-4daf-a1fc-8a61bf780111 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.337986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cd7a7cb7-0f08-48a8-ac51-09e162c5abca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:40.357223 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd7a7cb7-0f08-48a8-ac51-09e162c5abca tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.190316 Aug 23 17:56:40.370888 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 764/1602] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:40 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:40.370888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0af6405d-1edb-4e1a-98bb-c16b5393d925 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:40.370888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0af6405d-1edb-4e1a-98bb-c16b5393d925 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:40.370888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0af6405d-1edb-4e1a-98bb-c16b5393d925 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.370888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0af6405d-1edb-4e1a-98bb-c16b5393d925 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.371551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0af6405d-1edb-4e1a-98bb-c16b5393d925 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.371914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0af6405d-1edb-4e1a-98bb-c16b5393d925 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.372368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0af6405d-1edb-4e1a-98bb-c16b5393d925 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.373029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0af6405d-1edb-4e1a-98bb-c16b5393d925 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.423091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f4504082-86e3-4daf-a1fc-8a61bf780111 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:40.431416 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f4504082-86e3-4daf-a1fc-8a61bf780111 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1284 microversion: 2.1 time: 0.118770 Aug 23 17:56:40.432018 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 839/1603] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:40 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:40.510621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0af6405d-1edb-4e1a-98bb-c16b5393d925 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:40.519004 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0af6405d-1edb-4e1a-98bb-c16b5393d925 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1469 microversion: 2.1 time: 0.159736 Aug 23 17:56:40.519569 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 765/1604] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:40 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:40.593291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66c3f173-8ee5-472d-8e85-a86e812f1dad tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:40.593837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66c3f173-8ee5-472d-8e85-a86e812f1dad tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:40.599752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c3f173-8ee5-472d-8e85-a86e812f1dad tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.600235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c3f173-8ee5-472d-8e85-a86e812f1dad tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.600669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c3f173-8ee5-472d-8e85-a86e812f1dad tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.601391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c3f173-8ee5-472d-8e85-a86e812f1dad tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.601845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c3f173-8ee5-472d-8e85-a86e812f1dad tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.602265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c3f173-8ee5-472d-8e85-a86e812f1dad tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.727974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66c3f173-8ee5-472d-8e85-a86e812f1dad tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:40.735891 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66c3f173-8ee5-472d-8e85-a86e812f1dad tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.147526 Aug 23 17:56:40.736464 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 840/1605] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:40 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:40.961905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-718eb32e-5496-4035-83a0-b930db0e9795 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:40.962516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-718eb32e-5496-4035-83a0-b930db0e9795 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:40.970094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-718eb32e-5496-4035-83a0-b930db0e9795 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.970608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-718eb32e-5496-4035-83a0-b930db0e9795 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.971047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-718eb32e-5496-4035-83a0-b930db0e9795 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:40.971744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-718eb32e-5496-4035-83a0-b930db0e9795 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:40.972188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-718eb32e-5496-4035-83a0-b930db0e9795 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:40.972609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-718eb32e-5496-4035-83a0-b930db0e9795 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:41.049835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ed998418-2d1b-46fb-8c93-117fc17d8a87 req-6ed10282-c611-4d13-81cd-e452a6f88bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c329be5-120a-4bfd-ba7d-12c0ed0c4814", "name": "network-vif-plugged", "status": "completed", "tag": "777bb24b-a6b8-45cd-9bb8-2263c15bf327"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:41.061145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed998418-2d1b-46fb-8c93-117fc17d8a87 req-6ed10282-c611-4d13-81cd-e452a6f88bfd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:41.061898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed998418-2d1b-46fb-8c93-117fc17d8a87 req-6ed10282-c611-4d13-81cd-e452a6f88bfd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:41.062482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed998418-2d1b-46fb-8c93-117fc17d8a87 req-6ed10282-c611-4d13-81cd-e452a6f88bfd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:41.078875 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ed998418-2d1b-46fb-8c93-117fc17d8a87 req-6ed10282-c611-4d13-81cd-e452a6f88bfd service nova] Creating event network-vif-plugged:777bb24b-a6b8-45cd-9bb8-2263c15bf327 for instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 on n-h1-850468-16 Aug 23 17:56:41.085242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-ed998418-2d1b-46fb-8c93-117fc17d8a87 req-6ed10282-c611-4d13-81cd-e452a6f88bfd service nova] Instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 17:56:41.092542 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ed998418-2d1b-46fb-8c93-117fc17d8a87 req-6ed10282-c611-4d13-81cd-e452a6f88bfd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046250 Aug 23 17:56:41.093606 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 841/1606] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:41.116388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-718eb32e-5496-4035-83a0-b930db0e9795 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:41.124994 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-718eb32e-5496-4035-83a0-b930db0e9795 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1313 microversion: 2.1 time: 0.166897 Aug 23 17:56:41.125623 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 766/1607] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:40 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:41.191891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e2eeac5-e99b-45d1-ac7b-1dbaf815bb6d tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:41.192594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4e2eeac5-e99b-45d1-ac7b-1dbaf815bb6d tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:41.200216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e2eeac5-e99b-45d1-ac7b-1dbaf815bb6d tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:41.200391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e2eeac5-e99b-45d1-ac7b-1dbaf815bb6d tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:41.200739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e2eeac5-e99b-45d1-ac7b-1dbaf815bb6d tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:41.201441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e2eeac5-e99b-45d1-ac7b-1dbaf815bb6d tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:41.201909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e2eeac5-e99b-45d1-ac7b-1dbaf815bb6d tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:41.202330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e2eeac5-e99b-45d1-ac7b-1dbaf815bb6d tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:41.270064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e2eeac5-e99b-45d1-ac7b-1dbaf815bb6d tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:41.281528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e2eeac5-e99b-45d1-ac7b-1dbaf815bb6d tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:41.283045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e2eeac5-e99b-45d1-ac7b-1dbaf815bb6d tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:41.284205 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e2eeac5-e99b-45d1-ac7b-1dbaf815bb6d tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.096803 Aug 23 17:56:41.284765 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 842/1608] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:41 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:41.378279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-15d8c4f1-3d9f-472b-9138-45d1f4a8933f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:41.379394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-15d8c4f1-3d9f-472b-9138-45d1f4a8933f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:41.386072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15d8c4f1-3d9f-472b-9138-45d1f4a8933f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:41.387198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15d8c4f1-3d9f-472b-9138-45d1f4a8933f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:41.387640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15d8c4f1-3d9f-472b-9138-45d1f4a8933f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:41.388353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15d8c4f1-3d9f-472b-9138-45d1f4a8933f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:41.388807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15d8c4f1-3d9f-472b-9138-45d1f4a8933f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:41.389236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15d8c4f1-3d9f-472b-9138-45d1f4a8933f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:41.454003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7f9bf905-6f64-4adc-ae01-5f6b4aadf6e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:41.454767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7f9bf905-6f64-4adc-ae01-5f6b4aadf6e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:41.463134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f9bf905-6f64-4adc-ae01-5f6b4aadf6e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:41.463766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f9bf905-6f64-4adc-ae01-5f6b4aadf6e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:41.464199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f9bf905-6f64-4adc-ae01-5f6b4aadf6e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:41.466564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f9bf905-6f64-4adc-ae01-5f6b4aadf6e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:41.467024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f9bf905-6f64-4adc-ae01-5f6b4aadf6e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:41.467453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f9bf905-6f64-4adc-ae01-5f6b4aadf6e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:41.534901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-15d8c4f1-3d9f-472b-9138-45d1f4a8933f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:41.544800 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-15d8c4f1-3d9f-472b-9138-45d1f4a8933f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.170336 Aug 23 17:56:41.545394 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 767/1609] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:41 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:41.549074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7f9bf905-6f64-4adc-ae01-5f6b4aadf6e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:41.550085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c89a9c28-5db4-4124-9c90-534e40a172ce tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:41.550901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c89a9c28-5db4-4124-9c90-534e40a172ce tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:41.556985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c89a9c28-5db4-4124-9c90-534e40a172ce tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:41.557368 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7f9bf905-6f64-4adc-ae01-5f6b4aadf6e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1284 microversion: 2.1 time: 0.109323 Aug 23 17:56:41.557481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c89a9c28-5db4-4124-9c90-534e40a172ce tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:41.557892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c89a9c28-5db4-4124-9c90-534e40a172ce tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:41.558736 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 843/1610] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:41 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:41.559153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c89a9c28-5db4-4124-9c90-534e40a172ce tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:41.559802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c89a9c28-5db4-4124-9c90-534e40a172ce tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:41.560232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c89a9c28-5db4-4124-9c90-534e40a172ce tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:41.691562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c89a9c28-5db4-4124-9c90-534e40a172ce tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:41.700161 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c89a9c28-5db4-4124-9c90-534e40a172ce tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1469 microversion: 2.1 time: 0.153521 Aug 23 17:56:41.700728 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 768/1611] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:41 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:41.756536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9071a38-371b-457c-900f-4b7bec886944 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:41.757302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d9071a38-371b-457c-900f-4b7bec886944 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:41.763822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9071a38-371b-457c-900f-4b7bec886944 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:41.764302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9071a38-371b-457c-900f-4b7bec886944 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:41.764736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9071a38-371b-457c-900f-4b7bec886944 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:41.765426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9071a38-371b-457c-900f-4b7bec886944 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:41.765878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9071a38-371b-457c-900f-4b7bec886944 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:41.766309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9071a38-371b-457c-900f-4b7bec886944 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:41.894577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d9071a38-371b-457c-900f-4b7bec886944 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:41.902254 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d9071a38-371b-457c-900f-4b7bec886944 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.149559 Aug 23 17:56:41.902850 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 844/1612] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:41 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:42.147728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b7e4ab2-6d25-4376-a2a1-40812879b931 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:42.149022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b7e4ab2-6d25-4376-a2a1-40812879b931 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:42.157019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7e4ab2-6d25-4376-a2a1-40812879b931 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:42.157512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7e4ab2-6d25-4376-a2a1-40812879b931 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:42.157951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7e4ab2-6d25-4376-a2a1-40812879b931 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:42.158699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7e4ab2-6d25-4376-a2a1-40812879b931 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:42.159162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7e4ab2-6d25-4376-a2a1-40812879b931 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:42.159588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7e4ab2-6d25-4376-a2a1-40812879b931 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:42.308774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ecac2914-6482-403f-86af-fa35323c336b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:42.309564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ecac2914-6482-403f-86af-fa35323c336b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:42.313345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:42.319264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecac2914-6482-403f-86af-fa35323c336b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:42.319752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecac2914-6482-403f-86af-fa35323c336b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:42.320190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecac2914-6482-403f-86af-fa35323c336b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:42.320897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecac2914-6482-403f-86af-fa35323c336b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:42.321354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecac2914-6482-403f-86af-fa35323c336b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:42.321780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecac2914-6482-403f-86af-fa35323c336b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:42.389901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ecac2914-6482-403f-86af-fa35323c336b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:42.398318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ecac2914-6482-403f-86af-fa35323c336b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:42.399780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ecac2914-6482-403f-86af-fa35323c336b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:42.400937 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ecac2914-6482-403f-86af-fa35323c336b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1408 microversion: 2.54 time: 0.096716 Aug 23 17:56:42.405587 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 845/1613] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:42 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1408 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:56:42.499143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b7e4ab2-6d25-4376-a2a1-40812879b931 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:42.507725 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b7e4ab2-6d25-4376-a2a1-40812879b931 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1313 microversion: 2.1 time: 0.364677 Aug 23 17:56:42.508427 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 769/1614] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:42 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1313 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:42.565214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d74ec1ce-4cb9-4a50-a5a1-bc67132d7a1c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:42.565831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d74ec1ce-4cb9-4a50-a5a1-bc67132d7a1c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:42.571825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d74ec1ce-4cb9-4a50-a5a1-bc67132d7a1c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:42.572309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d74ec1ce-4cb9-4a50-a5a1-bc67132d7a1c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:42.572748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d74ec1ce-4cb9-4a50-a5a1-bc67132d7a1c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:42.573594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d74ec1ce-4cb9-4a50-a5a1-bc67132d7a1c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:42.574052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d74ec1ce-4cb9-4a50-a5a1-bc67132d7a1c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:42.574483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d74ec1ce-4cb9-4a50-a5a1-bc67132d7a1c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:42.579076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c59ed4b-2183-40ce-b72e-dace0578f160 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:42.579753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1c59ed4b-2183-40ce-b72e-dace0578f160 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:42.587241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c59ed4b-2183-40ce-b72e-dace0578f160 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:42.587747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c59ed4b-2183-40ce-b72e-dace0578f160 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:42.588183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c59ed4b-2183-40ce-b72e-dace0578f160 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:42.589187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c59ed4b-2183-40ce-b72e-dace0578f160 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:42.591240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c59ed4b-2183-40ce-b72e-dace0578f160 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:42.591941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c59ed4b-2183-40ce-b72e-dace0578f160 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:42.705727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c59ed4b-2183-40ce-b72e-dace0578f160 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:42.718019 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c59ed4b-2183-40ce-b72e-dace0578f160 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1282 microversion: 2.1 time: 0.142960 Aug 23 17:56:42.718634 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 770/1615] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:42 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1282 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:42.723193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c413c32-7532-4174-a80d-8e33bbdad58f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:42.723803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1c413c32-7532-4174-a80d-8e33bbdad58f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:42.730692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c413c32-7532-4174-a80d-8e33bbdad58f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:42.731241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c413c32-7532-4174-a80d-8e33bbdad58f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:42.731734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c413c32-7532-4174-a80d-8e33bbdad58f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:42.735146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d74ec1ce-4cb9-4a50-a5a1-bc67132d7a1c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:42.735314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c413c32-7532-4174-a80d-8e33bbdad58f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:42.735780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c413c32-7532-4174-a80d-8e33bbdad58f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:42.736641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c413c32-7532-4174-a80d-8e33bbdad58f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:42.743837 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d74ec1ce-4cb9-4a50-a5a1-bc67132d7a1c tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.182376 Aug 23 17:56:42.744663 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 846/1616] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:42 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:42.923763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b7591a11-1fa5-47f8-a942-6af35877a940 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:42.924531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b7591a11-1fa5-47f8-a942-6af35877a940 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:42.930594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7591a11-1fa5-47f8-a942-6af35877a940 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:42.931151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7591a11-1fa5-47f8-a942-6af35877a940 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:42.931651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7591a11-1fa5-47f8-a942-6af35877a940 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:42.932432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7591a11-1fa5-47f8-a942-6af35877a940 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:42.932954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7591a11-1fa5-47f8-a942-6af35877a940 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:42.934574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7591a11-1fa5-47f8-a942-6af35877a940 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:43.041953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c413c32-7532-4174-a80d-8e33bbdad58f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:43.052579 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c413c32-7532-4174-a80d-8e33bbdad58f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1469 microversion: 2.1 time: 0.332870 Aug 23 17:56:43.053163 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 771/1617] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:42 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1469 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:43.072045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b7591a11-1fa5-47f8-a942-6af35877a940 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:43.080252 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b7591a11-1fa5-47f8-a942-6af35877a940 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.160389 Aug 23 17:56:43.080817 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 847/1618] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:42 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:43.116507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-57e24c4e-3ac0-4d95-b8f8-548045df0b6d req-f30127f5-1c29-40e1-b970-f737443519e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ba76a3-5838-410f-897c-e2edf5812436", "name": "network-vif-plugged", "status": "completed", "tag": "140e9847-1506-4a90-b25a-8c4d7b6f71c4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:43.126341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-57e24c4e-3ac0-4d95-b8f8-548045df0b6d req-f30127f5-1c29-40e1-b970-f737443519e9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:43.126859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-57e24c4e-3ac0-4d95-b8f8-548045df0b6d req-f30127f5-1c29-40e1-b970-f737443519e9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:43.127294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-57e24c4e-3ac0-4d95-b8f8-548045df0b6d req-f30127f5-1c29-40e1-b970-f737443519e9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:43.138780 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-57e24c4e-3ac0-4d95-b8f8-548045df0b6d req-f30127f5-1c29-40e1-b970-f737443519e9 service nova] Creating event network-vif-plugged:140e9847-1506-4a90-b25a-8c4d7b6f71c4 for instance c3ba76a3-5838-410f-897c-e2edf5812436 on n-h2-850468-16 Aug 23 17:56:43.144010 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-57e24c4e-3ac0-4d95-b8f8-548045df0b6d req-f30127f5-1c29-40e1-b970-f737443519e9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031168 Aug 23 17:56:43.144651 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 772/1619] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:43.425087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0dd2309b-e1d5-480f-9ca3-9afbde179e09 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:43.425706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0dd2309b-e1d5-480f-9ca3-9afbde179e09 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:43.435536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0dd2309b-e1d5-480f-9ca3-9afbde179e09 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:43.439894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0dd2309b-e1d5-480f-9ca3-9afbde179e09 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:43.440556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0dd2309b-e1d5-480f-9ca3-9afbde179e09 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:43.442058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0dd2309b-e1d5-480f-9ca3-9afbde179e09 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:43.442587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0dd2309b-e1d5-480f-9ca3-9afbde179e09 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:43.443033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0dd2309b-e1d5-480f-9ca3-9afbde179e09 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:43.532072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-074e9184-ef23-46c3-bca2-e6f2f79daef5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:43.533472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-074e9184-ef23-46c3-bca2-e6f2f79daef5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:43.540169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-074e9184-ef23-46c3-bca2-e6f2f79daef5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:43.540736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-074e9184-ef23-46c3-bca2-e6f2f79daef5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:43.541351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-074e9184-ef23-46c3-bca2-e6f2f79daef5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:43.542135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-074e9184-ef23-46c3-bca2-e6f2f79daef5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:43.543350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-074e9184-ef23-46c3-bca2-e6f2f79daef5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:43.543905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-074e9184-ef23-46c3-bca2-e6f2f79daef5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:43.557337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0dd2309b-e1d5-480f-9ca3-9afbde179e09 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:43.575769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0dd2309b-e1d5-480f-9ca3-9afbde179e09 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:43.581588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0dd2309b-e1d5-480f-9ca3-9afbde179e09 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:43.583759 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0dd2309b-e1d5-480f-9ca3-9afbde179e09 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1414 microversion: 2.54 time: 0.162637 Aug 23 17:56:43.584333 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 848/1620] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:43 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1414 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:43.742340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc940dba-1025-4a53-8b9e-cd37da286825 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:43.743754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc940dba-1025-4a53-8b9e-cd37da286825 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:43.753441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc940dba-1025-4a53-8b9e-cd37da286825 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:43.754032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc940dba-1025-4a53-8b9e-cd37da286825 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:43.754477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc940dba-1025-4a53-8b9e-cd37da286825 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:43.755359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc940dba-1025-4a53-8b9e-cd37da286825 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:43.756191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc940dba-1025-4a53-8b9e-cd37da286825 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:43.756344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc940dba-1025-4a53-8b9e-cd37da286825 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:43.846148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-074e9184-ef23-46c3-bca2-e6f2f79daef5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:43.854124 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-074e9184-ef23-46c3-bca2-e6f2f79daef5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1313 microversion: 2.1 time: 0.327897 Aug 23 17:56:43.868776 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 773/1621] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:43 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1313 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:43.876776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-60249a8c-5bd2-4c9b-8f12-b3c93cda6b83 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:43.877720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-60249a8c-5bd2-4c9b-8f12-b3c93cda6b83 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:43.885275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60249a8c-5bd2-4c9b-8f12-b3c93cda6b83 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:43.885770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60249a8c-5bd2-4c9b-8f12-b3c93cda6b83 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:43.886307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60249a8c-5bd2-4c9b-8f12-b3c93cda6b83 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:43.887830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60249a8c-5bd2-4c9b-8f12-b3c93cda6b83 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:43.888291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60249a8c-5bd2-4c9b-8f12-b3c93cda6b83 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:43.888722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60249a8c-5bd2-4c9b-8f12-b3c93cda6b83 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:43.972677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bc940dba-1025-4a53-8b9e-cd37da286825 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:43.982067 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc940dba-1025-4a53-8b9e-cd37da286825 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1324 microversion: 2.1 time: 0.246734 Aug 23 17:56:43.982690 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 849/1622] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:43 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1324 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:44.073448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0811ca7b-e963-4d64-b497-1194957991db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:44.074930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0811ca7b-e963-4d64-b497-1194957991db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:44.081573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0811ca7b-e963-4d64-b497-1194957991db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:44.082071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0811ca7b-e963-4d64-b497-1194957991db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:44.082514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0811ca7b-e963-4d64-b497-1194957991db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:44.083254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0811ca7b-e963-4d64-b497-1194957991db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:44.083915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0811ca7b-e963-4d64-b497-1194957991db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:44.084346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0811ca7b-e963-4d64-b497-1194957991db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:44.106414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-60249a8c-5bd2-4c9b-8f12-b3c93cda6b83 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:44.115320 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-60249a8c-5bd2-4c9b-8f12-b3c93cda6b83 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.245207 Aug 23 17:56:44.116187 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 774/1623] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:43 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:44.122250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c50cc7cc-0f08-419d-abef-390b0cf95397 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:44.123157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c50cc7cc-0f08-419d-abef-390b0cf95397 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:44.138370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c50cc7cc-0f08-419d-abef-390b0cf95397 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:44.138965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c50cc7cc-0f08-419d-abef-390b0cf95397 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:44.139397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c50cc7cc-0f08-419d-abef-390b0cf95397 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:44.140117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c50cc7cc-0f08-419d-abef-390b0cf95397 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:44.140757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c50cc7cc-0f08-419d-abef-390b0cf95397 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:44.141060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c50cc7cc-0f08-419d-abef-390b0cf95397 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:44.264329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0811ca7b-e963-4d64-b497-1194957991db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:44.272409 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0811ca7b-e963-4d64-b497-1194957991db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1469 microversion: 2.1 time: 0.203015 Aug 23 17:56:44.284048 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 850/1624] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:44 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1469 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:44.377016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c50cc7cc-0f08-419d-abef-390b0cf95397 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:44.384812 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c50cc7cc-0f08-419d-abef-390b0cf95397 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.267619 Aug 23 17:56:44.385394 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 775/1625] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:44 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:44.609288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9e3ad281-79d5-4562-a84a-325cee086aeb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:44.609901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9e3ad281-79d5-4562-a84a-325cee086aeb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:44.618555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e3ad281-79d5-4562-a84a-325cee086aeb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:44.619045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e3ad281-79d5-4562-a84a-325cee086aeb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:44.619731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e3ad281-79d5-4562-a84a-325cee086aeb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:44.620495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e3ad281-79d5-4562-a84a-325cee086aeb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:44.621322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e3ad281-79d5-4562-a84a-325cee086aeb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:44.622053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e3ad281-79d5-4562-a84a-325cee086aeb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:44.695858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9e3ad281-79d5-4562-a84a-325cee086aeb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:44.705286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9e3ad281-79d5-4562-a84a-325cee086aeb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:44.706825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9e3ad281-79d5-4562-a84a-325cee086aeb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:44.707409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-d5289ac6-5744-485c-b5c5-a50334f77092 req-61581571-c775-429d-9f01-7a1257fe2767 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153fb085-12d0-4155-a1f7-9e954d51e9c5", "tag": "071d181a-b17b-447a-b61e-a9731c7217ec"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:44.707990 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9e3ad281-79d5-4562-a84a-325cee086aeb tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1414 microversion: 2.54 time: 0.103729 Aug 23 17:56:44.708689 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 851/1626] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:44 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1414 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:44.720733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d5289ac6-5744-485c-b5c5-a50334f77092 req-61581571-c775-429d-9f01-7a1257fe2767 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:44.721213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d5289ac6-5744-485c-b5c5-a50334f77092 req-61581571-c775-429d-9f01-7a1257fe2767 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:44.721648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d5289ac6-5744-485c-b5c5-a50334f77092 req-61581571-c775-429d-9f01-7a1257fe2767 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:44.733914 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-d5289ac6-5744-485c-b5c5-a50334f77092 req-61581571-c775-429d-9f01-7a1257fe2767 service nova] Creating event network-changed:071d181a-b17b-447a-b61e-a9731c7217ec for instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 on n-h2-850468-16 Aug 23 17:56:44.739184 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-d5289ac6-5744-485c-b5c5-a50334f77092 req-61581571-c775-429d-9f01-7a1257fe2767 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046058 Aug 23 17:56:44.739992 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 776/1627] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:56:44.876745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-125e2ca2-03e0-4f00-a8ba-34f3660112c1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:44.877504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-125e2ca2-03e0-4f00-a8ba-34f3660112c1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:44.883526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125e2ca2-03e0-4f00-a8ba-34f3660112c1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:44.884007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125e2ca2-03e0-4f00-a8ba-34f3660112c1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:44.884444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125e2ca2-03e0-4f00-a8ba-34f3660112c1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:44.885142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125e2ca2-03e0-4f00-a8ba-34f3660112c1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:44.885595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125e2ca2-03e0-4f00-a8ba-34f3660112c1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:44.886091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-125e2ca2-03e0-4f00-a8ba-34f3660112c1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:45.007493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2f1ce1d0-79f2-4fae-9b98-e59cd81cbcdd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:45.008598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2f1ce1d0-79f2-4fae-9b98-e59cd81cbcdd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:45.017475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f1ce1d0-79f2-4fae-9b98-e59cd81cbcdd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:45.018272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f1ce1d0-79f2-4fae-9b98-e59cd81cbcdd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:45.018986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f1ce1d0-79f2-4fae-9b98-e59cd81cbcdd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:45.020198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f1ce1d0-79f2-4fae-9b98-e59cd81cbcdd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:45.021011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f1ce1d0-79f2-4fae-9b98-e59cd81cbcdd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:45.021663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f1ce1d0-79f2-4fae-9b98-e59cd81cbcdd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:45.032964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-125e2ca2-03e0-4f00-a8ba-34f3660112c1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:45.043296 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-125e2ca2-03e0-4f00-a8ba-34f3660112c1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1313 microversion: 2.1 time: 0.170630 Aug 23 17:56:45.044389 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 852/1628] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:44 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:45.137878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-509e8e49-95ff-4106-8a31-b44f5723df7a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:45.138709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-509e8e49-95ff-4106-8a31-b44f5723df7a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:45.146502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-509e8e49-95ff-4106-8a31-b44f5723df7a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:45.147221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-509e8e49-95ff-4106-8a31-b44f5723df7a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:45.147920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-509e8e49-95ff-4106-8a31-b44f5723df7a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:45.149153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-509e8e49-95ff-4106-8a31-b44f5723df7a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:45.149723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-509e8e49-95ff-4106-8a31-b44f5723df7a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:45.150447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-509e8e49-95ff-4106-8a31-b44f5723df7a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:45.269639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2f1ce1d0-79f2-4fae-9b98-e59cd81cbcdd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:45.278642 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2f1ce1d0-79f2-4fae-9b98-e59cd81cbcdd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1324 microversion: 2.1 time: 0.275793 Aug 23 17:56:45.279811 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 777/1629] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:45 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1324 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:45.289220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-509e8e49-95ff-4106-8a31-b44f5723df7a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:45.296207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-67660bfd-63ba-436a-a210-759503eacf8a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:45.296935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-67660bfd-63ba-436a-a210-759503eacf8a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:45.297905 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-509e8e49-95ff-4106-8a31-b44f5723df7a tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.164056 Aug 23 17:56:45.298483 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 853/1630] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:45 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:45.303117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67660bfd-63ba-436a-a210-759503eacf8a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:45.303606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67660bfd-63ba-436a-a210-759503eacf8a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:45.304047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67660bfd-63ba-436a-a210-759503eacf8a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:45.304750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67660bfd-63ba-436a-a210-759503eacf8a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:45.305203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67660bfd-63ba-436a-a210-759503eacf8a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:45.305627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67660bfd-63ba-436a-a210-759503eacf8a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:45.408054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e0d77b82-f92f-423e-83d1-e162650da884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:45.408962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e0d77b82-f92f-423e-83d1-e162650da884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:45.415146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0d77b82-f92f-423e-83d1-e162650da884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:45.415631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0d77b82-f92f-423e-83d1-e162650da884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:45.416063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0d77b82-f92f-423e-83d1-e162650da884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:45.416757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0d77b82-f92f-423e-83d1-e162650da884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:45.417208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0d77b82-f92f-423e-83d1-e162650da884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:45.418305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0d77b82-f92f-423e-83d1-e162650da884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:45.433434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:45.446333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-67660bfd-63ba-436a-a210-759503eacf8a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:45.455258 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-67660bfd-63ba-436a-a210-759503eacf8a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1469 microversion: 2.1 time: 0.163075 Aug 23 17:56:45.456417 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 778/1631] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:45 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:45.565378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e0d77b82-f92f-423e-83d1-e162650da884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:45.573086 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e0d77b82-f92f-423e-83d1-e162650da884 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.168976 Aug 23 17:56:45.573710 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 854/1632] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:45 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:45.740929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5af86466-f8bb-47c1-9c18-556ad879d948 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:45.741591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5af86466-f8bb-47c1-9c18-556ad879d948 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:45.752101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5af86466-f8bb-47c1-9c18-556ad879d948 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:45.752826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5af86466-f8bb-47c1-9c18-556ad879d948 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:45.753273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5af86466-f8bb-47c1-9c18-556ad879d948 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:45.754604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5af86466-f8bb-47c1-9c18-556ad879d948 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:45.755367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5af86466-f8bb-47c1-9c18-556ad879d948 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:45.756220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5af86466-f8bb-47c1-9c18-556ad879d948 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:45.846615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5af86466-f8bb-47c1-9c18-556ad879d948 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:45.855114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5af86466-f8bb-47c1-9c18-556ad879d948 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:45.856626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5af86466-f8bb-47c1-9c18-556ad879d948 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:45.858010 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5af86466-f8bb-47c1-9c18-556ad879d948 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1414 microversion: 2.54 time: 0.125111 Aug 23 17:56:45.858925 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 779/1633] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:45 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1414 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:45.935673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-5bf7c53f-1fdf-45f5-822c-3de5cb23ea40 req-94bb569b-32cf-4911-b041-56ff2088695e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceea6924-e172-4a5c-bb82-b77a6255ec6c", "name": "network-vif-plugged", "status": "completed", "tag": "27f162ab-9c0c-4c70-8eed-864adf0c88f8"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:45.947049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5bf7c53f-1fdf-45f5-822c-3de5cb23ea40 req-94bb569b-32cf-4911-b041-56ff2088695e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:45.947767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5bf7c53f-1fdf-45f5-822c-3de5cb23ea40 req-94bb569b-32cf-4911-b041-56ff2088695e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:45.948205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5bf7c53f-1fdf-45f5-822c-3de5cb23ea40 req-94bb569b-32cf-4911-b041-56ff2088695e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:45.960292 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5bf7c53f-1fdf-45f5-822c-3de5cb23ea40 req-94bb569b-32cf-4911-b041-56ff2088695e service nova] Creating event network-vif-plugged:27f162ab-9c0c-4c70-8eed-864adf0c88f8 for instance ceea6924-e172-4a5c-bb82-b77a6255ec6c on n-h2-850468-16 Aug 23 17:56:45.965971 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-5bf7c53f-1fdf-45f5-822c-3de5cb23ea40 req-94bb569b-32cf-4911-b041-56ff2088695e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034242 Aug 23 17:56:45.966781 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 855/1634] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:56:46.064201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48a0930c-e5d9-4c85-a29e-58c19a2eafa1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:46.064815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-48a0930c-e5d9-4c85-a29e-58c19a2eafa1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:46.071704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48a0930c-e5d9-4c85-a29e-58c19a2eafa1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.072194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48a0930c-e5d9-4c85-a29e-58c19a2eafa1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.072638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48a0930c-e5d9-4c85-a29e-58c19a2eafa1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.073345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48a0930c-e5d9-4c85-a29e-58c19a2eafa1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.073890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48a0930c-e5d9-4c85-a29e-58c19a2eafa1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.074268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48a0930c-e5d9-4c85-a29e-58c19a2eafa1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.078956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:46.301304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ce154d2f-a130-4491-971b-7dccc0417611 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:46.302009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ce154d2f-a130-4491-971b-7dccc0417611 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:46.308279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce154d2f-a130-4491-971b-7dccc0417611 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.308776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce154d2f-a130-4491-971b-7dccc0417611 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.309285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce154d2f-a130-4491-971b-7dccc0417611 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.310003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce154d2f-a130-4491-971b-7dccc0417611 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.310461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce154d2f-a130-4491-971b-7dccc0417611 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.310921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce154d2f-a130-4491-971b-7dccc0417611 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.344913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-48a0930c-e5d9-4c85-a29e-58c19a2eafa1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:46.353125 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48a0930c-e5d9-4c85-a29e-58c19a2eafa1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1500 microversion: 2.1 time: 0.292761 Aug 23 17:56:46.363189 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 780/1635] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:46 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1500 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:46.372078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-56de6609-7e30-49d9-9fbd-9700056fc595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:46.372694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-56de6609-7e30-49d9-9fbd-9700056fc595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:46.378685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56de6609-7e30-49d9-9fbd-9700056fc595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.379171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56de6609-7e30-49d9-9fbd-9700056fc595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.379610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56de6609-7e30-49d9-9fbd-9700056fc595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.380307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56de6609-7e30-49d9-9fbd-9700056fc595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.380755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56de6609-7e30-49d9-9fbd-9700056fc595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.381195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56de6609-7e30-49d9-9fbd-9700056fc595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.459492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ce154d2f-a130-4491-971b-7dccc0417611 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:46.468304 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ce154d2f-a130-4491-971b-7dccc0417611 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1324 microversion: 2.1 time: 0.171657 Aug 23 17:56:46.468878 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 856/1636] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:46 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1324 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:46.475444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5dd78e55-f379-4dbb-80d1-1e2453431a0f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:46.477629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5dd78e55-f379-4dbb-80d1-1e2453431a0f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:46.484896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5dd78e55-f379-4dbb-80d1-1e2453431a0f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.485381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5dd78e55-f379-4dbb-80d1-1e2453431a0f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.485822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5dd78e55-f379-4dbb-80d1-1e2453431a0f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.486525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5dd78e55-f379-4dbb-80d1-1e2453431a0f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.486998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5dd78e55-f379-4dbb-80d1-1e2453431a0f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.487425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5dd78e55-f379-4dbb-80d1-1e2453431a0f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.510797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-5dd78e55-f379-4dbb-80d1-1e2453431a0f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lazy-loading 'flavor' on Instance uuid c3ba76a3-5838-410f-897c-e2edf5812436 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:56:46.516782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-56de6609-7e30-49d9-9fbd-9700056fc595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:46.524692 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-56de6609-7e30-49d9-9fbd-9700056fc595 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.157193 Aug 23 17:56:46.525272 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 781/1637] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:46 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:46.529957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-54aaa772-36dd-425d-8e14-d514fab1082e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:46.530612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-54aaa772-36dd-425d-8e14-d514fab1082e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:46.536466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54aaa772-36dd-425d-8e14-d514fab1082e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.536811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54aaa772-36dd-425d-8e14-d514fab1082e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.537246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54aaa772-36dd-425d-8e14-d514fab1082e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.537944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54aaa772-36dd-425d-8e14-d514fab1082e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.538396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54aaa772-36dd-425d-8e14-d514fab1082e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.538881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54aaa772-36dd-425d-8e14-d514fab1082e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.613126 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5dd78e55-f379-4dbb-80d1-1e2453431a0f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "POST /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436/action" status: 200 len: 32 microversion: 2.1 time: 0.142348 Aug 23 17:56:46.613942 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 857/1638] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:56:46 2022] POST /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436/action => generated 32 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:56:46.626315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8f2bab15-1093-4d60-97b5-a306c4c22cdb tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:46.628231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8f2bab15-1093-4d60-97b5-a306c4c22cdb tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:46.639482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f2bab15-1093-4d60-97b5-a306c4c22cdb tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.639985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f2bab15-1093-4d60-97b5-a306c4c22cdb tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.640431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f2bab15-1093-4d60-97b5-a306c4c22cdb tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.641155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f2bab15-1093-4d60-97b5-a306c4c22cdb tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.641610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f2bab15-1093-4d60-97b5-a306c4c22cdb tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.642331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f2bab15-1093-4d60-97b5-a306c4c22cdb tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.743612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-54aaa772-36dd-425d-8e14-d514fab1082e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:46.753113 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-54aaa772-36dd-425d-8e14-d514fab1082e tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1469 microversion: 2.1 time: 0.226765 Aug 23 17:56:46.753699 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 782/1639] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:46 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1469 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:46.758137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2aa86e8a-24e2-4be8-8c29-23df5e3ecd36 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:46.758765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2aa86e8a-24e2-4be8-8c29-23df5e3ecd36 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:46.765332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aa86e8a-24e2-4be8-8c29-23df5e3ecd36 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.765832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aa86e8a-24e2-4be8-8c29-23df5e3ecd36 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.766278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aa86e8a-24e2-4be8-8c29-23df5e3ecd36 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.767003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aa86e8a-24e2-4be8-8c29-23df5e3ecd36 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.768319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aa86e8a-24e2-4be8-8c29-23df5e3ecd36 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.768979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aa86e8a-24e2-4be8-8c29-23df5e3ecd36 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.784432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=28 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:46.804265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8f2bab15-1093-4d60-97b5-a306c4c22cdb tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:46.824206 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8f2bab15-1093-4d60-97b5-a306c4c22cdb tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.203927 Aug 23 17:56:46.825405 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 858/1640] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:46 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:46.880938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-22e167f4-2798-4b1f-b75c-17a165ef6844 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:46.881658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-22e167f4-2798-4b1f-b75c-17a165ef6844 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:46.889109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22e167f4-2798-4b1f-b75c-17a165ef6844 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.889598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22e167f4-2798-4b1f-b75c-17a165ef6844 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.890038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22e167f4-2798-4b1f-b75c-17a165ef6844 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.890855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22e167f4-2798-4b1f-b75c-17a165ef6844 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:46.891314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22e167f4-2798-4b1f-b75c-17a165ef6844 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:46.891740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22e167f4-2798-4b1f-b75c-17a165ef6844 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:46.922679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2aa86e8a-24e2-4be8-8c29-23df5e3ecd36 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:46.931871 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2aa86e8a-24e2-4be8-8c29-23df5e3ecd36 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.177168 Aug 23 17:56:46.933095 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 783/1641] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:46 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:46.961268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22e167f4-2798-4b1f-b75c-17a165ef6844 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:46.971769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22e167f4-2798-4b1f-b75c-17a165ef6844 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:46.973269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22e167f4-2798-4b1f-b75c-17a165ef6844 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:46.974445 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-22e167f4-2798-4b1f-b75c-17a165ef6844 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1414 microversion: 2.54 time: 0.097520 Aug 23 17:56:46.975241 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 859/1642] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:46 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1414 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:56:47.488872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-195c295e-0c15-45a3-9dfd-8b4bd327f436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:47.489483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-195c295e-0c15-45a3-9dfd-8b4bd327f436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:47.496307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-195c295e-0c15-45a3-9dfd-8b4bd327f436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:47.497121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-195c295e-0c15-45a3-9dfd-8b4bd327f436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:47.497543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-195c295e-0c15-45a3-9dfd-8b4bd327f436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:47.498233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-195c295e-0c15-45a3-9dfd-8b4bd327f436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:47.498715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-195c295e-0c15-45a3-9dfd-8b4bd327f436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:47.499137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-195c295e-0c15-45a3-9dfd-8b4bd327f436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:47.547699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0e7bf66a-29d1-42a6-8654-cae089e480f8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:47.548221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0e7bf66a-29d1-42a6-8654-cae089e480f8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:47.554405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7bf66a-29d1-42a6-8654-cae089e480f8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:47.554921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7bf66a-29d1-42a6-8654-cae089e480f8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:47.555356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7bf66a-29d1-42a6-8654-cae089e480f8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:47.556047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7bf66a-29d1-42a6-8654-cae089e480f8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:47.556494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7bf66a-29d1-42a6-8654-cae089e480f8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:47.556915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7bf66a-29d1-42a6-8654-cae089e480f8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:47.630909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-195c295e-0c15-45a3-9dfd-8b4bd327f436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:47.638836 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-195c295e-0c15-45a3-9dfd-8b4bd327f436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1324 microversion: 2.1 time: 0.153751 Aug 23 17:56:47.639413 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 784/1643] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:47 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1324 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:47.692557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0e7bf66a-29d1-42a6-8654-cae089e480f8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:47.700558 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0e7bf66a-29d1-42a6-8654-cae089e480f8 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.156754 Aug 23 17:56:47.701111 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 860/1644] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:47 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:47.774486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-15d00241-abf7-4f7c-8d19-5ca9421012f7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:47.775130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-15d00241-abf7-4f7c-8d19-5ca9421012f7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:47.782704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15d00241-abf7-4f7c-8d19-5ca9421012f7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:47.783196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15d00241-abf7-4f7c-8d19-5ca9421012f7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:47.783641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15d00241-abf7-4f7c-8d19-5ca9421012f7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:47.784344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15d00241-abf7-4f7c-8d19-5ca9421012f7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:47.784802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15d00241-abf7-4f7c-8d19-5ca9421012f7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:47.785232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15d00241-abf7-4f7c-8d19-5ca9421012f7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:47.852501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c2f5bb79-5898-49bf-ad38-d043effa5254 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:47.853030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c2f5bb79-5898-49bf-ad38-d043effa5254 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:47.859792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2f5bb79-5898-49bf-ad38-d043effa5254 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:47.860276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2f5bb79-5898-49bf-ad38-d043effa5254 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:47.860711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2f5bb79-5898-49bf-ad38-d043effa5254 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:47.861414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2f5bb79-5898-49bf-ad38-d043effa5254 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:47.861867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2f5bb79-5898-49bf-ad38-d043effa5254 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:47.862297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2f5bb79-5898-49bf-ad38-d043effa5254 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:47.920918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-15d00241-abf7-4f7c-8d19-5ca9421012f7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:47.928947 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-15d00241-abf7-4f7c-8d19-5ca9421012f7 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1469 microversion: 2.1 time: 0.158353 Aug 23 17:56:47.929649 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 785/1645] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:47 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:47.953688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-74648bbe-85b3-418c-924a-88d9dcbb36e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:47.954299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-74648bbe-85b3-418c-924a-88d9dcbb36e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:47.960269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74648bbe-85b3-418c-924a-88d9dcbb36e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:47.961389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74648bbe-85b3-418c-924a-88d9dcbb36e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:47.961833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74648bbe-85b3-418c-924a-88d9dcbb36e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:47.962554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74648bbe-85b3-418c-924a-88d9dcbb36e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:47.963020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74648bbe-85b3-418c-924a-88d9dcbb36e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:47.963449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74648bbe-85b3-418c-924a-88d9dcbb36e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:48.002350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c2f5bb79-5898-49bf-ad38-d043effa5254 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:48.010067 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c2f5bb79-5898-49bf-ad38-d043effa5254 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.161726 Aug 23 17:56:48.010686 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 861/1646] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:47 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:48.015642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2a4495fd-2e5c-4777-86da-eaa83725e25d req-00521b3e-edc2-4448-b3cc-d54967157518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c2986a-4a33-4e1e-b560-1540016afc00", "name": "network-vif-plugged", "status": "completed", "tag": "c8c7df85-eb37-4532-b885-4761d737198f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:48.025262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2a4495fd-2e5c-4777-86da-eaa83725e25d req-00521b3e-edc2-4448-b3cc-d54967157518 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:48.025737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2a4495fd-2e5c-4777-86da-eaa83725e25d req-00521b3e-edc2-4448-b3cc-d54967157518 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:48.026171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2a4495fd-2e5c-4777-86da-eaa83725e25d req-00521b3e-edc2-4448-b3cc-d54967157518 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:48.037497 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2a4495fd-2e5c-4777-86da-eaa83725e25d req-00521b3e-edc2-4448-b3cc-d54967157518 service nova] Creating event network-vif-plugged:c8c7df85-eb37-4532-b885-4761d737198f for instance 14c2986a-4a33-4e1e-b560-1540016afc00 on n-h1-850468-16 Aug 23 17:56:48.043395 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2a4495fd-2e5c-4777-86da-eaa83725e25d req-00521b3e-edc2-4448-b3cc-d54967157518 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030222 Aug 23 17:56:48.044013 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 862/1647] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:48.049165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-786adebe-3e0b-44c1-879b-688864d6faff tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:48.049859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-786adebe-3e0b-44c1-879b-688864d6faff tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:48.056158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-786adebe-3e0b-44c1-879b-688864d6faff tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:48.056645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-786adebe-3e0b-44c1-879b-688864d6faff tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:48.057084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-786adebe-3e0b-44c1-879b-688864d6faff tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:48.057783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-786adebe-3e0b-44c1-879b-688864d6faff tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:48.059064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-786adebe-3e0b-44c1-879b-688864d6faff tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:48.059507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-786adebe-3e0b-44c1-879b-688864d6faff tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:48.103978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-74648bbe-85b3-418c-924a-88d9dcbb36e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:48.112957 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-74648bbe-85b3-418c-924a-88d9dcbb36e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.163185 Aug 23 17:56:48.113867 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 786/1648] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:47 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:48.134716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-786adebe-3e0b-44c1-879b-688864d6faff tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:48.143489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-786adebe-3e0b-44c1-879b-688864d6faff tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:48.144996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-786adebe-3e0b-44c1-879b-688864d6faff tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:48.146157 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-786adebe-3e0b-44c1-879b-688864d6faff tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1414 microversion: 2.54 time: 0.101096 Aug 23 17:56:48.146744 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 863/1649] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:48 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1414 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:48.659800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-68e5d3ce-80ba-4786-ab8e-caf2f4a8972a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:48.660413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-68e5d3ce-80ba-4786-ab8e-caf2f4a8972a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:48.666362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68e5d3ce-80ba-4786-ab8e-caf2f4a8972a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:48.666871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68e5d3ce-80ba-4786-ab8e-caf2f4a8972a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:48.667821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68e5d3ce-80ba-4786-ab8e-caf2f4a8972a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:48.668588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68e5d3ce-80ba-4786-ab8e-caf2f4a8972a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:48.669040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68e5d3ce-80ba-4786-ab8e-caf2f4a8972a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:48.669460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68e5d3ce-80ba-4786-ab8e-caf2f4a8972a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:48.721535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-509db424-b460-413f-b2fc-eb8045e26a1f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:48.722157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-509db424-b460-413f-b2fc-eb8045e26a1f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:48.728244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-509db424-b460-413f-b2fc-eb8045e26a1f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:48.728788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-509db424-b460-413f-b2fc-eb8045e26a1f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:48.729274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-509db424-b460-413f-b2fc-eb8045e26a1f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:48.730474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-509db424-b460-413f-b2fc-eb8045e26a1f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:48.730965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-509db424-b460-413f-b2fc-eb8045e26a1f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:48.731390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-509db424-b460-413f-b2fc-eb8045e26a1f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:48.804124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-68e5d3ce-80ba-4786-ab8e-caf2f4a8972a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:48.813486 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-68e5d3ce-80ba-4786-ab8e-caf2f4a8972a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1324 microversion: 2.1 time: 0.157711 Aug 23 17:56:48.814057 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 787/1650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:48 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1324 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:48.870490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-509db424-b460-413f-b2fc-eb8045e26a1f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:48.879225 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-509db424-b460-413f-b2fc-eb8045e26a1f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.161497 Aug 23 17:56:48.879792 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 864/1651] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:48 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:48.950359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f4b3272-5fee-473d-b8b5-6d5b802e8cd9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:48.951272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8f4b3272-5fee-473d-b8b5-6d5b802e8cd9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:48.959016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f4b3272-5fee-473d-b8b5-6d5b802e8cd9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:48.959501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f4b3272-5fee-473d-b8b5-6d5b802e8cd9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:48.960117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f4b3272-5fee-473d-b8b5-6d5b802e8cd9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:48.960830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f4b3272-5fee-473d-b8b5-6d5b802e8cd9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:48.961285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f4b3272-5fee-473d-b8b5-6d5b802e8cd9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:48.962285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f4b3272-5fee-473d-b8b5-6d5b802e8cd9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.031888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1cb6b95f-59b2-4f6f-97cb-c44ae249ab48 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:49.032601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1cb6b95f-59b2-4f6f-97cb-c44ae249ab48 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:49.039470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cb6b95f-59b2-4f6f-97cb-c44ae249ab48 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.040033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cb6b95f-59b2-4f6f-97cb-c44ae249ab48 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.040543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cb6b95f-59b2-4f6f-97cb-c44ae249ab48 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.041312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cb6b95f-59b2-4f6f-97cb-c44ae249ab48 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.041840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cb6b95f-59b2-4f6f-97cb-c44ae249ab48 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.042433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cb6b95f-59b2-4f6f-97cb-c44ae249ab48 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.107509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8f4b3272-5fee-473d-b8b5-6d5b802e8cd9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:49.118448 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f4b3272-5fee-473d-b8b5-6d5b802e8cd9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1469 microversion: 2.1 time: 0.173074 Aug 23 17:56:49.120176 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 788/1652] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:48 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1469 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:49.136419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aaf251fd-65fc-40a0-a67a-7450937b6fd1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:49.138473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aaf251fd-65fc-40a0-a67a-7450937b6fd1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:49.145696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaf251fd-65fc-40a0-a67a-7450937b6fd1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.147223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaf251fd-65fc-40a0-a67a-7450937b6fd1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.147941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaf251fd-65fc-40a0-a67a-7450937b6fd1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.148839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaf251fd-65fc-40a0-a67a-7450937b6fd1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.149558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaf251fd-65fc-40a0-a67a-7450937b6fd1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.150175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaf251fd-65fc-40a0-a67a-7450937b6fd1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.252224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1cb6b95f-59b2-4f6f-97cb-c44ae249ab48 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:49.260206 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1cb6b95f-59b2-4f6f-97cb-c44ae249ab48 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.232258 Aug 23 17:56:49.273565 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 865/1653] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:49 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:49.279255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a2884016-5c6c-4fcc-9881-ae4640a9df3b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:49.280095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a2884016-5c6c-4fcc-9881-ae4640a9df3b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:49.285895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2884016-5c6c-4fcc-9881-ae4640a9df3b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.286378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2884016-5c6c-4fcc-9881-ae4640a9df3b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.286934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2884016-5c6c-4fcc-9881-ae4640a9df3b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.287638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2884016-5c6c-4fcc-9881-ae4640a9df3b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.288091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2884016-5c6c-4fcc-9881-ae4640a9df3b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.288694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2884016-5c6c-4fcc-9881-ae4640a9df3b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.309143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aaf251fd-65fc-40a0-a67a-7450937b6fd1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:49.316846 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aaf251fd-65fc-40a0-a67a-7450937b6fd1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.185035 Aug 23 17:56:49.317415 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 789/1654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:49 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:49.353154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a2884016-5c6c-4fcc-9881-ae4640a9df3b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:49.362135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a2884016-5c6c-4fcc-9881-ae4640a9df3b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:49.363666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a2884016-5c6c-4fcc-9881-ae4640a9df3b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:49.364820 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a2884016-5c6c-4fcc-9881-ae4640a9df3b tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1399 microversion: 2.54 time: 0.089980 Aug 23 17:56:49.365375 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 866/1655] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:49 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1399 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:49.387104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-79bd24da-aa67-489c-b64b-19ab1b4e625c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '.version_select at 0x7f27ec8e3670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:49.406300 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-79bd24da-aa67-489c-b64b-19ab1b4e625c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-565264260" status: 204 len: 0 microversion: 2.54 time: 0.023003 Aug 23 17:56:49.406905 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 790/1656] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Aug 23 17:56:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-565264260 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:56:49.421797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eeeb080c-dd56-48e9-80fd-98cf840608f4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:49.422302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eeeb080c-dd56-48e9-80fd-98cf840608f4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:49.428255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eeeb080c-dd56-48e9-80fd-98cf840608f4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.428741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eeeb080c-dd56-48e9-80fd-98cf840608f4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.429181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eeeb080c-dd56-48e9-80fd-98cf840608f4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.429878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eeeb080c-dd56-48e9-80fd-98cf840608f4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.430345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eeeb080c-dd56-48e9-80fd-98cf840608f4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.430808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eeeb080c-dd56-48e9-80fd-98cf840608f4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.455804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eeeb080c-dd56-48e9-80fd-98cf840608f4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:56:49.537981 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eeeb080c-dd56-48e9-80fd-98cf840608f4 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 204 len: 0 microversion: 2.54 time: 0.119901 Aug 23 17:56:49.538606 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 867/1657] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:56:49 2022] DELETE /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:56:49.547629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5668efec-335d-493e-903e-d145756741b8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:49.548246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5668efec-335d-493e-903e-d145756741b8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:49.555995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5668efec-335d-493e-903e-d145756741b8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.556488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5668efec-335d-493e-903e-d145756741b8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.556929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5668efec-335d-493e-903e-d145756741b8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.557632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5668efec-335d-493e-903e-d145756741b8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.558716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5668efec-335d-493e-903e-d145756741b8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.559271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5668efec-335d-493e-903e-d145756741b8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.637758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5668efec-335d-493e-903e-d145756741b8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:49.646268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5668efec-335d-493e-903e-d145756741b8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:49.647912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5668efec-335d-493e-903e-d145756741b8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:49.648986 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5668efec-335d-493e-903e-d145756741b8 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1405 microversion: 2.54 time: 0.106368 Aug 23 17:56:49.649569 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 791/1658] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:49 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1405 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:56:49.835009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a493aab8-efb2-47c2-9779-7b4742202172 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:49.835714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a493aab8-efb2-47c2-9779-7b4742202172 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:49.841965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a493aab8-efb2-47c2-9779-7b4742202172 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.842441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a493aab8-efb2-47c2-9779-7b4742202172 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.842907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a493aab8-efb2-47c2-9779-7b4742202172 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.843596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a493aab8-efb2-47c2-9779-7b4742202172 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.844048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a493aab8-efb2-47c2-9779-7b4742202172 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.844472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a493aab8-efb2-47c2-9779-7b4742202172 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.900364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cf2f7dc5-0f17-4333-8085-2be40c81d23d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:49.900967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cf2f7dc5-0f17-4333-8085-2be40c81d23d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:49.908706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf2f7dc5-0f17-4333-8085-2be40c81d23d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.909202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf2f7dc5-0f17-4333-8085-2be40c81d23d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.909638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf2f7dc5-0f17-4333-8085-2be40c81d23d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.910356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf2f7dc5-0f17-4333-8085-2be40c81d23d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:49.910852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf2f7dc5-0f17-4333-8085-2be40c81d23d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:49.911278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf2f7dc5-0f17-4333-8085-2be40c81d23d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:49.984340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a493aab8-efb2-47c2-9779-7b4742202172 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:49.986839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:49.994012 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a493aab8-efb2-47c2-9779-7b4742202172 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1324 microversion: 2.1 time: 0.163304 Aug 23 17:56:49.994769 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 868/1659] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:49 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1324 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:50.048429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cf2f7dc5-0f17-4333-8085-2be40c81d23d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:50.056081 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cf2f7dc5-0f17-4333-8085-2be40c81d23d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.159580 Aug 23 17:56:50.056642 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 792/1660] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:49 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:50.140641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d0214dd-e41f-4145-a116-df4ad637a163 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:50.141262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d0214dd-e41f-4145-a116-df4ad637a163 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:50.144081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=15 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:50.150014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d0214dd-e41f-4145-a116-df4ad637a163 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:50.150502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d0214dd-e41f-4145-a116-df4ad637a163 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:50.150975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d0214dd-e41f-4145-a116-df4ad637a163 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:50.152188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d0214dd-e41f-4145-a116-df4ad637a163 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:50.152650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d0214dd-e41f-4145-a116-df4ad637a163 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:50.153075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d0214dd-e41f-4145-a116-df4ad637a163 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:50.283617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-02bd437a-245f-4d6e-9fe4-85b7326bfea3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:50.284259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-02bd437a-245f-4d6e-9fe4-85b7326bfea3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:50.291810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02bd437a-245f-4d6e-9fe4-85b7326bfea3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:50.292393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02bd437a-245f-4d6e-9fe4-85b7326bfea3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:50.292973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02bd437a-245f-4d6e-9fe4-85b7326bfea3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:50.293711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02bd437a-245f-4d6e-9fe4-85b7326bfea3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:50.294169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02bd437a-245f-4d6e-9fe4-85b7326bfea3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:50.294628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02bd437a-245f-4d6e-9fe4-85b7326bfea3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:50.299307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4d0214dd-e41f-4145-a116-df4ad637a163 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:50.307089 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d0214dd-e41f-4145-a116-df4ad637a163 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1469 microversion: 2.1 time: 0.170624 Aug 23 17:56:50.307929 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 869/1661] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:50 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1469 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:50.338341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf9d7c1d-82c5-469a-9e7e-7cff33cdd8e1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:50.339089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf9d7c1d-82c5-469a-9e7e-7cff33cdd8e1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:50.345946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf9d7c1d-82c5-469a-9e7e-7cff33cdd8e1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:50.346430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf9d7c1d-82c5-469a-9e7e-7cff33cdd8e1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:50.346909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf9d7c1d-82c5-469a-9e7e-7cff33cdd8e1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:50.347610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf9d7c1d-82c5-469a-9e7e-7cff33cdd8e1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:50.348062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf9d7c1d-82c5-469a-9e7e-7cff33cdd8e1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:50.348684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf9d7c1d-82c5-469a-9e7e-7cff33cdd8e1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:50.427831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-02bd437a-245f-4d6e-9fe4-85b7326bfea3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:50.435732 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-02bd437a-245f-4d6e-9fe4-85b7326bfea3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.157334 Aug 23 17:56:50.436406 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 793/1662] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:50 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:50.481421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf9d7c1d-82c5-469a-9e7e-7cff33cdd8e1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:50.489249 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf9d7c1d-82c5-469a-9e7e-7cff33cdd8e1 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.154924 Aug 23 17:56:50.489818 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 870/1663] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:50 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:50.673039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-65724f3f-9981-498e-996e-aecbbd49035c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:50.673647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-65724f3f-9981-498e-996e-aecbbd49035c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:50.679563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65724f3f-9981-498e-996e-aecbbd49035c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:50.680044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65724f3f-9981-498e-996e-aecbbd49035c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:50.680477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65724f3f-9981-498e-996e-aecbbd49035c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:50.681165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65724f3f-9981-498e-996e-aecbbd49035c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:50.681614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65724f3f-9981-498e-996e-aecbbd49035c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:50.682034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65724f3f-9981-498e-996e-aecbbd49035c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:50.745077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65724f3f-9981-498e-996e-aecbbd49035c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:50.753541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65724f3f-9981-498e-996e-aecbbd49035c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:50.755074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65724f3f-9981-498e-996e-aecbbd49035c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:50.756220 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-65724f3f-9981-498e-996e-aecbbd49035c tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1405 microversion: 2.54 time: 0.087109 Aug 23 17:56:50.756779 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 794/1664] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:50 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1405 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:51.013936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-663024a4-30e4-4767-b646-bc546e9798f2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:51.014562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-663024a4-30e4-4767-b646-bc546e9798f2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:51.020561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-663024a4-30e4-4767-b646-bc546e9798f2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:51.021057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-663024a4-30e4-4767-b646-bc546e9798f2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:51.021496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-663024a4-30e4-4767-b646-bc546e9798f2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:51.022279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-663024a4-30e4-4767-b646-bc546e9798f2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:51.022770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-663024a4-30e4-4767-b646-bc546e9798f2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:51.023206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-663024a4-30e4-4767-b646-bc546e9798f2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:51.079015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7747e7b-4139-4dbf-9d36-0b5e83eb4f22 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:51.080383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c7747e7b-4139-4dbf-9d36-0b5e83eb4f22 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:51.087262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7747e7b-4139-4dbf-9d36-0b5e83eb4f22 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:51.087748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7747e7b-4139-4dbf-9d36-0b5e83eb4f22 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:51.088188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7747e7b-4139-4dbf-9d36-0b5e83eb4f22 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:51.088885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7747e7b-4139-4dbf-9d36-0b5e83eb4f22 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:51.089528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7747e7b-4139-4dbf-9d36-0b5e83eb4f22 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:51.089830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7747e7b-4139-4dbf-9d36-0b5e83eb4f22 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:51.159334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-663024a4-30e4-4767-b646-bc546e9798f2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:51.167025 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-663024a4-30e4-4767-b646-bc546e9798f2 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1324 microversion: 2.1 time: 0.156904 Aug 23 17:56:51.168317 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 871/1665] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:51 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1324 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:51.230091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c7747e7b-4139-4dbf-9d36-0b5e83eb4f22 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:51.237802 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c7747e7b-4139-4dbf-9d36-0b5e83eb4f22 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1324 microversion: 2.1 time: 0.164937 Aug 23 17:56:51.238370 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 795/1666] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:51 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1324 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:51.328365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-461b44a8-c755-45c0-81be-e9a412c399a1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:51.328984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-461b44a8-c755-45c0-81be-e9a412c399a1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:51.335073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-461b44a8-c755-45c0-81be-e9a412c399a1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:51.335562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-461b44a8-c755-45c0-81be-e9a412c399a1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:51.336001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-461b44a8-c755-45c0-81be-e9a412c399a1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:51.336700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-461b44a8-c755-45c0-81be-e9a412c399a1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:51.337157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-461b44a8-c755-45c0-81be-e9a412c399a1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:51.337591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-461b44a8-c755-45c0-81be-e9a412c399a1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:51.456659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dc4d3c0d-ed0a-4d23-a0a6-a17da929e5a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:51.457310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc4d3c0d-ed0a-4d23-a0a6-a17da929e5a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:51.463312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc4d3c0d-ed0a-4d23-a0a6-a17da929e5a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:51.463805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc4d3c0d-ed0a-4d23-a0a6-a17da929e5a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:51.464422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc4d3c0d-ed0a-4d23-a0a6-a17da929e5a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:51.465148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc4d3c0d-ed0a-4d23-a0a6-a17da929e5a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:51.465909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc4d3c0d-ed0a-4d23-a0a6-a17da929e5a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:51.466346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc4d3c0d-ed0a-4d23-a0a6-a17da929e5a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:51.473501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-461b44a8-c755-45c0-81be-e9a412c399a1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:51.481402 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-461b44a8-c755-45c0-81be-e9a412c399a1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1469 microversion: 2.1 time: 0.157616 Aug 23 17:56:51.481973 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 872/1667] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:51 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:51.510930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-372874fa-bef1-4c20-8f17-8090d47c5f87 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:51.513541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-372874fa-bef1-4c20-8f17-8090d47c5f87 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:51.519738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-372874fa-bef1-4c20-8f17-8090d47c5f87 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:51.520219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-372874fa-bef1-4c20-8f17-8090d47c5f87 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:51.520652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-372874fa-bef1-4c20-8f17-8090d47c5f87 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:51.521351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-372874fa-bef1-4c20-8f17-8090d47c5f87 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:51.521801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-372874fa-bef1-4c20-8f17-8090d47c5f87 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:51.522225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-372874fa-bef1-4c20-8f17-8090d47c5f87 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:51.602988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dc4d3c0d-ed0a-4d23-a0a6-a17da929e5a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:51.611787 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dc4d3c0d-ed0a-4d23-a0a6-a17da929e5a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.158935 Aug 23 17:56:51.612368 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 796/1668] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:51 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:51.669750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-372874fa-bef1-4c20-8f17-8090d47c5f87 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:51.681628 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-372874fa-bef1-4c20-8f17-8090d47c5f87 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.174315 Aug 23 17:56:51.682510 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 873/1669] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:51 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:51.779893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-75c92695-0021-4683-bf0c-674e09265746 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:51.780518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-75c92695-0021-4683-bf0c-674e09265746 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:51.786416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75c92695-0021-4683-bf0c-674e09265746 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:51.786934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75c92695-0021-4683-bf0c-674e09265746 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:51.787370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75c92695-0021-4683-bf0c-674e09265746 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:51.788159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75c92695-0021-4683-bf0c-674e09265746 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:51.788616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75c92695-0021-4683-bf0c-674e09265746 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:51.789040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75c92695-0021-4683-bf0c-674e09265746 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:51.859923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-75c92695-0021-4683-bf0c-674e09265746 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:51.862189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:51.870098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-75c92695-0021-4683-bf0c-674e09265746 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:51.872288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-75c92695-0021-4683-bf0c-674e09265746 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:51.873476 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-75c92695-0021-4683-bf0c-674e09265746 tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1405 microversion: 2.54 time: 0.098544 Aug 23 17:56:51.874036 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 797/1670] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:51 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1405 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:56:52.189122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b955d9fd-bf0b-49e7-a843-e16aa7c23998 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:52.189848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b955d9fd-bf0b-49e7-a843-e16aa7c23998 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:52.197099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b955d9fd-bf0b-49e7-a843-e16aa7c23998 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.197660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b955d9fd-bf0b-49e7-a843-e16aa7c23998 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.198164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b955d9fd-bf0b-49e7-a843-e16aa7c23998 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.200289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b955d9fd-bf0b-49e7-a843-e16aa7c23998 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.200829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b955d9fd-bf0b-49e7-a843-e16aa7c23998 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.201456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b955d9fd-bf0b-49e7-a843-e16aa7c23998 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.258983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-07e16ffb-fc10-4047-8ce4-da15593fa52b tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:52.259672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-07e16ffb-fc10-4047-8ce4-da15593fa52b tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:52.267705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07e16ffb-fc10-4047-8ce4-da15593fa52b tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.268453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07e16ffb-fc10-4047-8ce4-da15593fa52b tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.269118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07e16ffb-fc10-4047-8ce4-da15593fa52b tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.269819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07e16ffb-fc10-4047-8ce4-da15593fa52b tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.270418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07e16ffb-fc10-4047-8ce4-da15593fa52b tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.271022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07e16ffb-fc10-4047-8ce4-da15593fa52b tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.409024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b955d9fd-bf0b-49e7-a843-e16aa7c23998 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:52.418412 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b955d9fd-bf0b-49e7-a843-e16aa7c23998 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1324 microversion: 2.1 time: 0.232552 Aug 23 17:56:52.419047 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 874/1671] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:52 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1324 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:52.444657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-07e16ffb-fc10-4047-8ce4-da15593fa52b tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:52.455343 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-07e16ffb-fc10-4047-8ce4-da15593fa52b tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1521 microversion: 2.1 time: 0.200384 Aug 23 17:56:52.465024 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 798/1672] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:52 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:52.485847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-43296d56-083d-4fbc-8567-3a4dcb4c18ae tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:52.486352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-43296d56-083d-4fbc-8567-3a4dcb4c18ae tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:52.493867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43296d56-083d-4fbc-8567-3a4dcb4c18ae tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.494938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43296d56-083d-4fbc-8567-3a4dcb4c18ae tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.495631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43296d56-083d-4fbc-8567-3a4dcb4c18ae tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.497318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43296d56-083d-4fbc-8567-3a4dcb4c18ae tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.497951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43296d56-083d-4fbc-8567-3a4dcb4c18ae tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.498725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43296d56-083d-4fbc-8567-3a4dcb4c18ae tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.503986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51c4da46-508e-4396-80bb-6fa32ca80354 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:52.506136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51c4da46-508e-4396-80bb-6fa32ca80354 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:52.514882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51c4da46-508e-4396-80bb-6fa32ca80354 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.516024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51c4da46-508e-4396-80bb-6fa32ca80354 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.516568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51c4da46-508e-4396-80bb-6fa32ca80354 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.517382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51c4da46-508e-4396-80bb-6fa32ca80354 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.518074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51c4da46-508e-4396-80bb-6fa32ca80354 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.519815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51c4da46-508e-4396-80bb-6fa32ca80354 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.529563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-43296d56-083d-4fbc-8567-3a4dcb4c18ae tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:56:52.620177 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-43296d56-083d-4fbc-8567-3a4dcb4c18ae tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "DELETE /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 204 len: 0 microversion: 2.1 time: 0.137885 Aug 23 17:56:52.621017 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 875/1673] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:56:52 2022] DELETE /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:56:52.630362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-37ed1d87-6852-44f7-a9f2-994a041fd0c1 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:52.631483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-37ed1d87-6852-44f7-a9f2-994a041fd0c1 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:52.638374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-37ed1d87-6852-44f7-a9f2-994a041fd0c1 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.638898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-37ed1d87-6852-44f7-a9f2-994a041fd0c1 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.639335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-37ed1d87-6852-44f7-a9f2-994a041fd0c1 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.640047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-37ed1d87-6852-44f7-a9f2-994a041fd0c1 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.640532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-37ed1d87-6852-44f7-a9f2-994a041fd0c1 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.640956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-37ed1d87-6852-44f7-a9f2-994a041fd0c1 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.663791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-51c4da46-508e-4396-80bb-6fa32ca80354 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:52.671853 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51c4da46-508e-4396-80bb-6fa32ca80354 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1535 microversion: 2.1 time: 0.173599 Aug 23 17:56:52.672512 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 799/1674] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:52 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1535 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:52.677010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-517e1e0c-0817-49ed-8b7f-0e30a65986a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:52.677686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-517e1e0c-0817-49ed-8b7f-0e30a65986a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:52.683634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-517e1e0c-0817-49ed-8b7f-0e30a65986a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.684228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-517e1e0c-0817-49ed-8b7f-0e30a65986a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.684692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-517e1e0c-0817-49ed-8b7f-0e30a65986a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.685489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-517e1e0c-0817-49ed-8b7f-0e30a65986a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.686071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-517e1e0c-0817-49ed-8b7f-0e30a65986a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.686580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-517e1e0c-0817-49ed-8b7f-0e30a65986a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.816646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-37ed1d87-6852-44f7-a9f2-994a041fd0c1 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:52.825101 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-37ed1d87-6852-44f7-a9f2-994a041fd0c1 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1527 microversion: 2.1 time: 0.199490 Aug 23 17:56:52.825714 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 876/1675] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:52 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1527 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:52.830870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-517e1e0c-0817-49ed-8b7f-0e30a65986a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:52.838744 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-517e1e0c-0817-49ed-8b7f-0e30a65986a1 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1318 microversion: 2.1 time: 0.165177 Aug 23 17:56:52.839447 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 800/1676] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:52 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:52.843275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e11c346f-f9db-4236-9028-eade67e74f1d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:52.843883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e11c346f-f9db-4236-9028-eade67e74f1d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:52.849816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e11c346f-f9db-4236-9028-eade67e74f1d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.850295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e11c346f-f9db-4236-9028-eade67e74f1d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.850825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e11c346f-f9db-4236-9028-eade67e74f1d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.851520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e11c346f-f9db-4236-9028-eade67e74f1d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.851966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e11c346f-f9db-4236-9028-eade67e74f1d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.852385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e11c346f-f9db-4236-9028-eade67e74f1d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.896503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:52.897170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:52.905939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.906428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.906930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.907635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.908991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.908991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.953707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:52.954431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:52.955032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:52.955686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lazy-loading 'fault' on Instance uuid 3d6c3be7-797d-4013-a629-dd511aef109f {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:56:52.992191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e11c346f-f9db-4236-9028-eade67e74f1d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:53.012166 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e11c346f-f9db-4236-9028-eade67e74f1d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.172438 Aug 23 17:56:53.012826 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 877/1677] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:52 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:53.016867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:53.029904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:53.032042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b27854e33223429ab8652c8187618305', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '926d2ad9800d41eb81071b27bce06c65', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:53.033755 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c77302b9-1a10-46fa-be62-0ef18c0ca0ab tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 200 len: 1410 microversion: 2.54 time: 0.141283 Aug 23 17:56:53.033955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-7c25fc3b-d45e-4db3-9fc7-3980886a89ee req-d88bcf49-b3cd-420a-8d64-edcf693dd6f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c329be5-120a-4bfd-ba7d-12c0ed0c4814", "name": "network-vif-unplugged", "status": "completed", "tag": "777bb24b-a6b8-45cd-9bb8-2263c15bf327"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:53.034894 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 801/1678] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:52 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 1410 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:56:53.048438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7c25fc3b-d45e-4db3-9fc7-3980886a89ee req-d88bcf49-b3cd-420a-8d64-edcf693dd6f7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:53.049911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7c25fc3b-d45e-4db3-9fc7-3980886a89ee req-d88bcf49-b3cd-420a-8d64-edcf693dd6f7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:53.049911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7c25fc3b-d45e-4db3-9fc7-3980886a89ee req-d88bcf49-b3cd-420a-8d64-edcf693dd6f7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:53.062258 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-7c25fc3b-d45e-4db3-9fc7-3980886a89ee req-d88bcf49-b3cd-420a-8d64-edcf693dd6f7 service nova] Creating event network-vif-unplugged:777bb24b-a6b8-45cd-9bb8-2263c15bf327 for instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 on n-h1-850468-16 Aug 23 17:56:53.069401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-7c25fc3b-d45e-4db3-9fc7-3980886a89ee req-d88bcf49-b3cd-420a-8d64-edcf693dd6f7 service nova] Instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 17:56:53.078816 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-7c25fc3b-d45e-4db3-9fc7-3980886a89ee req-d88bcf49-b3cd-420a-8d64-edcf693dd6f7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049290 Aug 23 17:56:53.079754 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 878/1679] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:56:53.441233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ee000755-1351-4f3d-8c1a-f3885ce32788 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:53.441756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ee000755-1351-4f3d-8c1a-f3885ce32788 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:53.445368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:53.453120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee000755-1351-4f3d-8c1a-f3885ce32788 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:53.453613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee000755-1351-4f3d-8c1a-f3885ce32788 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:53.454075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee000755-1351-4f3d-8c1a-f3885ce32788 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:53.454833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee000755-1351-4f3d-8c1a-f3885ce32788 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:53.455287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee000755-1351-4f3d-8c1a-f3885ce32788 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:53.455713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee000755-1351-4f3d-8c1a-f3885ce32788 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:53.587239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ee000755-1351-4f3d-8c1a-f3885ce32788 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:53.595148 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ee000755-1351-4f3d-8c1a-f3885ce32788 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1324 microversion: 2.1 time: 0.158937 Aug 23 17:56:53.595724 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 802/1680] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:53 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1324 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:53.692864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41f49940-daaf-4e4d-b38d-71895807a2e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:53.693531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-41f49940-daaf-4e4d-b38d-71895807a2e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:53.701373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41f49940-daaf-4e4d-b38d-71895807a2e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:53.701850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41f49940-daaf-4e4d-b38d-71895807a2e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:53.702282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41f49940-daaf-4e4d-b38d-71895807a2e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:53.703007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41f49940-daaf-4e4d-b38d-71895807a2e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:53.703463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41f49940-daaf-4e4d-b38d-71895807a2e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:53.703886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41f49940-daaf-4e4d-b38d-71895807a2e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:53.849250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8899d3cc-6cd3-4989-bac9-d5b225ec783d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:53.850959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8899d3cc-6cd3-4989-bac9-d5b225ec783d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:53.862382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8899d3cc-6cd3-4989-bac9-d5b225ec783d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:53.863337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8899d3cc-6cd3-4989-bac9-d5b225ec783d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:53.863916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8899d3cc-6cd3-4989-bac9-d5b225ec783d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:53.864880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8899d3cc-6cd3-4989-bac9-d5b225ec783d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:53.866261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8899d3cc-6cd3-4989-bac9-d5b225ec783d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:53.866934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8899d3cc-6cd3-4989-bac9-d5b225ec783d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:54.177008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8899d3cc-6cd3-4989-bac9-d5b225ec783d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:54.187431 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8899d3cc-6cd3-4989-bac9-d5b225ec783d tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1527 microversion: 2.1 time: 0.344627 Aug 23 17:56:54.208415 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 803/1681] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:53 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1527 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:54.219213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9d1b2473-473d-4c17-9413-d1a954e3678e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:54.219741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9d1b2473-473d-4c17-9413-d1a954e3678e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:54.235155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d1b2473-473d-4c17-9413-d1a954e3678e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:54.236866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d1b2473-473d-4c17-9413-d1a954e3678e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:54.236866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d1b2473-473d-4c17-9413-d1a954e3678e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:54.237203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d1b2473-473d-4c17-9413-d1a954e3678e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:54.237475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d1b2473-473d-4c17-9413-d1a954e3678e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:54.238420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d1b2473-473d-4c17-9413-d1a954e3678e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:54.345990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41f49940-daaf-4e4d-b38d-71895807a2e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:54.360461 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-41f49940-daaf-4e4d-b38d-71895807a2e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1535 microversion: 2.1 time: 0.669225 Aug 23 17:56:54.363431 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 879/1682] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:53 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1535 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:54.372993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6b834b90-e8e4-407a-9f4b-a8f3f668bcd5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:54.373610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6b834b90-e8e4-407a-9f4b-a8f3f668bcd5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:54.381882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b834b90-e8e4-407a-9f4b-a8f3f668bcd5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:54.382598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b834b90-e8e4-407a-9f4b-a8f3f668bcd5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:54.383283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b834b90-e8e4-407a-9f4b-a8f3f668bcd5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:54.384171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b834b90-e8e4-407a-9f4b-a8f3f668bcd5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:54.384781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b834b90-e8e4-407a-9f4b-a8f3f668bcd5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:54.385380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b834b90-e8e4-407a-9f4b-a8f3f668bcd5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:54.563873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9d1b2473-473d-4c17-9413-d1a954e3678e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:54.573207 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9d1b2473-473d-4c17-9413-d1a954e3678e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1507 microversion: 2.1 time: 0.363643 Aug 23 17:56:54.574357 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 804/1683] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:54 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1507 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:54.580054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-284bd81b-24cd-4f82-9b2d-2dae11a70fde tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:54.581158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-284bd81b-24cd-4f82-9b2d-2dae11a70fde tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] [instance: 3d6c3be7-797d-4013-a629-dd511aef109f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:54.588424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-284bd81b-24cd-4f82-9b2d-2dae11a70fde tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:54.589194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-284bd81b-24cd-4f82-9b2d-2dae11a70fde tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:54.590816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-284bd81b-24cd-4f82-9b2d-2dae11a70fde tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:54.592218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-284bd81b-24cd-4f82-9b2d-2dae11a70fde tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:54.592218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-284bd81b-24cd-4f82-9b2d-2dae11a70fde tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:54.592448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-284bd81b-24cd-4f82-9b2d-2dae11a70fde tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:54.610375 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-284bd81b-24cd-4f82-9b2d-2dae11a70fde tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] HTTP exception thrown: Instance 3d6c3be7-797d-4013-a629-dd511aef109f could not be found. Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-284bd81b-24cd-4f82-9b2d-2dae11a70fde tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Request method failure captured: Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f HTTP/1.1 Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRS2INkG8fm28lbHN3QrRf7evQrq-lVl_VhnG20f4wPeGu3bbTB2bf768Uwwrl7AFcdcC1N5paj7gSvU_UIw_fXNF0bIYI4pXVhi6mMVShVm0yM-vh2F3xaDaTrhGPOZcpFgtpNqDA-fkun4AG-eonGKvEX-SXBKEVE3EMkTPqAOHm8 Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.54 Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 926d2ad9800d41eb81071b27bce06c65 Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerShowV254Test-1505953490 Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_926d2ad9800d41eb81071b27bce06c65"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/926d2ad9800d41eb81071b27bce06c65"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/926d2ad9800d41eb81071b27bce06c65"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/926d2ad9800d41eb81071b27bce06c65"}]}] Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerShowV254Test-1505953490 Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 926d2ad9800d41eb81071b27bce06c65 Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerShowV254Test-1505953490 Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerShowV254Test-1505953490-project Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b27854e33223429ab8652c8187618305 Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerShowV254Test-1505953490-project Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 3d6c3be7-797d-4013-a629-dd511aef109f could not be found. Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '3d6c3be7-797d-4013-a629-dd511aef109f'} Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d6c3be7-797d-4013-a629-dd511aef109f could not be found. Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d6c3be7-797d-4013-a629-dd511aef109f could not be found. Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:54.618333 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:54.625331 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:54.625331 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:54.625331 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:54.625331 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:54.625331 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:54.625331 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d6c3be7-797d-4013-a629-dd511aef109f could not be found. Aug 23 17:56:54.625331 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:54.627008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-284bd81b-24cd-4f82-9b2d-2dae11a70fde tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] Returning 404 to user: Instance 3d6c3be7-797d-4013-a629-dd511aef109f could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:54.635542 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-284bd81b-24cd-4f82-9b2d-2dae11a70fde tempest-ServerShowV254Test-1505953490 tempest-ServerShowV254Test-1505953490-project] 10.222.0.61 "GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f" status: 404 len: 111 microversion: 2.54 time: 0.059479 Aug 23 17:56:54.636840 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 805/1684] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:56:54 2022] GET /compute/v2.1/servers/3d6c3be7-797d-4013-a629-dd511aef109f => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:56:54.658460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-987a2488-8770-4852-b7b6-1d48421bd1e0 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:54.659125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6b834b90-e8e4-407a-9f4b-a8f3f668bcd5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:54.659308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-987a2488-8770-4852-b7b6-1d48421bd1e0 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:54.671513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-987a2488-8770-4852-b7b6-1d48421bd1e0 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:54.672009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-987a2488-8770-4852-b7b6-1d48421bd1e0 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:54.672454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-987a2488-8770-4852-b7b6-1d48421bd1e0 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:54.673500 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6b834b90-e8e4-407a-9f4b-a8f3f668bcd5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.308297 Aug 23 17:56:54.673880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-987a2488-8770-4852-b7b6-1d48421bd1e0 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:54.674372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-987a2488-8770-4852-b7b6-1d48421bd1e0 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:54.674808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-987a2488-8770-4852-b7b6-1d48421bd1e0 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:54.675728 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 880/1685] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:54 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:54.683101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c3f93db-ff14-4885-b368-c71c18a594cc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:54.683716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c3f93db-ff14-4885-b368-c71c18a594cc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:54.703827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c3f93db-ff14-4885-b368-c71c18a594cc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:54.705772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c3f93db-ff14-4885-b368-c71c18a594cc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:54.708104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c3f93db-ff14-4885-b368-c71c18a594cc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:54.708798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c3f93db-ff14-4885-b368-c71c18a594cc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:54.709269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c3f93db-ff14-4885-b368-c71c18a594cc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:54.709708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c3f93db-ff14-4885-b368-c71c18a594cc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:54.857683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c3f93db-ff14-4885-b368-c71c18a594cc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:54.867297 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c3f93db-ff14-4885-b368-c71c18a594cc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1324 microversion: 2.1 time: 0.188484 Aug 23 17:56:54.881499 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 881/1686] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:54 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1324 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:55.030229 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-987a2488-8770-4852-b7b6-1d48421bd1e0 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1859 microversion: 2.1 time: 0.392090 Aug 23 17:56:55.031714 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 806/1687] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:54 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1859 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:55.054920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-930d0177-c0be-4f61-aff0-79a106a8cff2 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-16", "block_migration": true, "disk_over_commit": false}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:55.057526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-930d0177-c0be-4f61-aff0-79a106a8cff2 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:55.074200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-930d0177-c0be-4f61-aff0-79a106a8cff2 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:55.074730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-930d0177-c0be-4f61-aff0-79a106a8cff2 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:55.075370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-930d0177-c0be-4f61-aff0-79a106a8cff2 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:55.076256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-930d0177-c0be-4f61-aff0-79a106a8cff2 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:55.076886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-930d0177-c0be-4f61-aff0-79a106a8cff2 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:55.077482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-930d0177-c0be-4f61-aff0-79a106a8cff2 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:55.101351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-46962985-f3f1-4c7e-aee5-d52703804056 req-fdcdefd3-950f-4864-94f6-6fa4dc167a41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153fb085-12d0-4155-a1f7-9e954d51e9c5", "name": "network-vif-plugged", "status": "completed", "tag": "071d181a-b17b-447a-b61e-a9731c7217ec"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:55.117501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-46962985-f3f1-4c7e-aee5-d52703804056 req-fdcdefd3-950f-4864-94f6-6fa4dc167a41 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:55.118865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-46962985-f3f1-4c7e-aee5-d52703804056 req-fdcdefd3-950f-4864-94f6-6fa4dc167a41 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:55.119540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-46962985-f3f1-4c7e-aee5-d52703804056 req-fdcdefd3-950f-4864-94f6-6fa4dc167a41 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:55.128766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-930d0177-c0be-4f61-aff0-79a106a8cff2 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lazy-loading 'flavor' on Instance uuid 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:56:55.146450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-930d0177-c0be-4f61-aff0-79a106a8cff2 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Going to try to live migrate instance to n-h1-850468-16 {{(pid=128807) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 17:56:55.153403 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-46962985-f3f1-4c7e-aee5-d52703804056 req-fdcdefd3-950f-4864-94f6-6fa4dc167a41 service nova] Creating event network-vif-plugged:071d181a-b17b-447a-b61e-a9731c7217ec for instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 on n-h2-850468-16 Aug 23 17:56:55.169705 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-46962985-f3f1-4c7e-aee5-d52703804056 req-fdcdefd3-950f-4864-94f6-6fa4dc167a41 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069691 Aug 23 17:56:55.173368 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 807/1688] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:56:55.209985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5d6cffbe-8116-49b0-a7cd-8ea1c5a63550 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:55.210975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5d6cffbe-8116-49b0-a7cd-8ea1c5a63550 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:55.222503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:55.224725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d6cffbe-8116-49b0-a7cd-8ea1c5a63550 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:55.225235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d6cffbe-8116-49b0-a7cd-8ea1c5a63550 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:55.237419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d6cffbe-8116-49b0-a7cd-8ea1c5a63550 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:55.238319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d6cffbe-8116-49b0-a7cd-8ea1c5a63550 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:55.248165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d6cffbe-8116-49b0-a7cd-8ea1c5a63550 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:55.248392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d6cffbe-8116-49b0-a7cd-8ea1c5a63550 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:55.395976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5d6cffbe-8116-49b0-a7cd-8ea1c5a63550 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:55.404810 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5d6cffbe-8116-49b0-a7cd-8ea1c5a63550 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1485 microversion: 2.1 time: 0.199518 Aug 23 17:56:55.410861 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 808/1689] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:55 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1485 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:55.418452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-02bef53b-6e65-4867-9ddd-78d26e27383a req-c357db63-76fb-470f-9b49-ae1d308a7c05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14c2986a-4a33-4e1e-b560-1540016afc00", "name": "network-vif-deleted", "tag": "c8c7df85-eb37-4532-b885-4761d737198f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:55.429925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-02bef53b-6e65-4867-9ddd-78d26e27383a req-c357db63-76fb-470f-9b49-ae1d308a7c05 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:55.430684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-02bef53b-6e65-4867-9ddd-78d26e27383a req-c357db63-76fb-470f-9b49-ae1d308a7c05 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:55.431403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-02bef53b-6e65-4867-9ddd-78d26e27383a req-c357db63-76fb-470f-9b49-ae1d308a7c05 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:55.445049 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-02bef53b-6e65-4867-9ddd-78d26e27383a req-c357db63-76fb-470f-9b49-ae1d308a7c05 service nova] Creating event network-vif-deleted:c8c7df85-eb37-4532-b885-4761d737198f for instance 14c2986a-4a33-4e1e-b560-1540016afc00 on n-h1-850468-16 Aug 23 17:56:55.451528 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-02bef53b-6e65-4867-9ddd-78d26e27383a req-c357db63-76fb-470f-9b49-ae1d308a7c05 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039195 Aug 23 17:56:55.452382 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 809/1690] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:56:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:55.459441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6bd422c6-136d-49f6-90ef-60d16c7eb278 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:55.460408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6bd422c6-136d-49f6-90ef-60d16c7eb278 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:55.469540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6bd422c6-136d-49f6-90ef-60d16c7eb278 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:55.470443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6bd422c6-136d-49f6-90ef-60d16c7eb278 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:55.471123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6bd422c6-136d-49f6-90ef-60d16c7eb278 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:55.472613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6bd422c6-136d-49f6-90ef-60d16c7eb278 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:55.473276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6bd422c6-136d-49f6-90ef-60d16c7eb278 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:55.474054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6bd422c6-136d-49f6-90ef-60d16c7eb278 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:55.705442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6bd422c6-136d-49f6-90ef-60d16c7eb278 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:55.719556 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6bd422c6-136d-49f6-90ef-60d16c7eb278 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1535 microversion: 2.1 time: 0.265805 Aug 23 17:56:55.733596 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 810/1691] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:55 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1535 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:55.738945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3a96dbd5-e2fb-4a06-9399-b300992d139f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:55.739724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3a96dbd5-e2fb-4a06-9399-b300992d139f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:55.746803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a96dbd5-e2fb-4a06-9399-b300992d139f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:55.747774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a96dbd5-e2fb-4a06-9399-b300992d139f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:55.751519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a96dbd5-e2fb-4a06-9399-b300992d139f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:55.752855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a96dbd5-e2fb-4a06-9399-b300992d139f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:55.754115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a96dbd5-e2fb-4a06-9399-b300992d139f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:55.754568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a96dbd5-e2fb-4a06-9399-b300992d139f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:55.961175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3a96dbd5-e2fb-4a06-9399-b300992d139f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:55.970772 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3a96dbd5-e2fb-4a06-9399-b300992d139f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.235571 Aug 23 17:56:55.972043 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 811/1692] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:55 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:55.977314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c3dc4e0b-c0ea-4c2b-b203-d83412250309 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:55.978312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c3dc4e0b-c0ea-4c2b-b203-d83412250309 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:55.986059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3dc4e0b-c0ea-4c2b-b203-d83412250309 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:55.986977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3dc4e0b-c0ea-4c2b-b203-d83412250309 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:55.987705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3dc4e0b-c0ea-4c2b-b203-d83412250309 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:55.988698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3dc4e0b-c0ea-4c2b-b203-d83412250309 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:55.989419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3dc4e0b-c0ea-4c2b-b203-d83412250309 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:55.990079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3dc4e0b-c0ea-4c2b-b203-d83412250309 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:56.211685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c3dc4e0b-c0ea-4c2b-b203-d83412250309 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:56.225220 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c3dc4e0b-c0ea-4c2b-b203-d83412250309 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1324 microversion: 2.1 time: 0.251842 Aug 23 17:56:56.225984 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 812/1693] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:55 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1324 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:56.428515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2b1c4d00-5c77-4186-92d0-1d82c9a9f443 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:56.429132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2b1c4d00-5c77-4186-92d0-1d82c9a9f443 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:56.437385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b1c4d00-5c77-4186-92d0-1d82c9a9f443 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:56.438195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b1c4d00-5c77-4186-92d0-1d82c9a9f443 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:56.438659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b1c4d00-5c77-4186-92d0-1d82c9a9f443 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:56.439409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b1c4d00-5c77-4186-92d0-1d82c9a9f443 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:56.439823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b1c4d00-5c77-4186-92d0-1d82c9a9f443 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:56.440241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b1c4d00-5c77-4186-92d0-1d82c9a9f443 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:56.770087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2b1c4d00-5c77-4186-92d0-1d82c9a9f443 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:56.778441 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2b1c4d00-5c77-4186-92d0-1d82c9a9f443 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1485 microversion: 2.1 time: 0.353912 Aug 23 17:56:56.779264 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 813/1694] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:56 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1485 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:56:56.783996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0bc9b447-08de-4d0c-b9c6-789e9eae788f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:56.784863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0bc9b447-08de-4d0c-b9c6-789e9eae788f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:56.790767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bc9b447-08de-4d0c-b9c6-789e9eae788f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:56.791361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bc9b447-08de-4d0c-b9c6-789e9eae788f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:56.791799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bc9b447-08de-4d0c-b9c6-789e9eae788f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:56.793094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bc9b447-08de-4d0c-b9c6-789e9eae788f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:56.793816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bc9b447-08de-4d0c-b9c6-789e9eae788f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:56.794251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bc9b447-08de-4d0c-b9c6-789e9eae788f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:57.016922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0bc9b447-08de-4d0c-b9c6-789e9eae788f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:57.018117 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0bc9b447-08de-4d0c-b9c6-789e9eae788f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1535 microversion: 2.1 time: 0.237838 Aug 23 17:56:57.029909 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 814/1695] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:56 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1535 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:57.029909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1ade6668-c5f2-49a2-a690-a82bdf6f985e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:57.029909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1ade6668-c5f2-49a2-a690-a82bdf6f985e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:57.030741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ade6668-c5f2-49a2-a690-a82bdf6f985e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:57.031486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ade6668-c5f2-49a2-a690-a82bdf6f985e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:57.032140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ade6668-c5f2-49a2-a690-a82bdf6f985e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:57.033063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ade6668-c5f2-49a2-a690-a82bdf6f985e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:57.033749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ade6668-c5f2-49a2-a690-a82bdf6f985e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:57.034933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ade6668-c5f2-49a2-a690-a82bdf6f985e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:57.239534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1ade6668-c5f2-49a2-a690-a82bdf6f985e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:57.247413 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1ade6668-c5f2-49a2-a690-a82bdf6f985e tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.227443 Aug 23 17:56:57.247981 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 815/1696] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:57 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:57.252489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-354c9347-e60a-40f8-b2e0-71e9bf82c7a4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "7a9f7f6f-86bd-43f7-8f9a-bf4e6a6aeeab"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:57.255280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-354c9347-e60a-40f8-b2e0-71e9bf82c7a4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:57.264682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-354c9347-e60a-40f8-b2e0-71e9bf82c7a4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:57.265268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-354c9347-e60a-40f8-b2e0-71e9bf82c7a4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:57.265719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-354c9347-e60a-40f8-b2e0-71e9bf82c7a4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:57.266433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-354c9347-e60a-40f8-b2e0-71e9bf82c7a4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:57.266935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-354c9347-e60a-40f8-b2e0-71e9bf82c7a4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:57.267365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-354c9347-e60a-40f8-b2e0-71e9bf82c7a4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:57.269920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:57.339275 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-354c9347-e60a-40f8-b2e0-71e9bf82c7a4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] HTTP exception thrown: Volume 41fdef26-5273-42a0-b8e6-ff0542ac9a55 could not be found. Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-354c9347-e60a-40f8-b2e0-71e9bf82c7a4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Request method failure captured: Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: request: PUT /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c/os-volume_attachments/41fdef26-5273-42a0-b8e6-ff0542ac9a55 HTTP/1.1 Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 74 Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRQyjMKpZzVfPp6VId2PIXqQz5XbD9QwPoWnE2lIYGnmaPICNeVFGxcCB9NWk7RdAHdynqvirl1Isshv5HzqsjPpXsMrlkDOmGmfNfEwZKInp2CnYuFRWXjnC6ubw29tR0ulXbAYMeN8aNTAu51CQqKomqyKdkohVpbeSpGZiE262Y8 Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 5b732cfa2c474f428d487d2ad9d1cdb8 Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-VolumesAdminNegativeTest-1508814780 Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5b732cfa2c474f428d487d2ad9d1cdb8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b732cfa2c474f428d487d2ad9d1cdb8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5b732cfa2c474f428d487d2ad9d1cdb8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5b732cfa2c474f428d487d2ad9d1cdb8"}]}] Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-VolumesAdminNegativeTest-1508814780 Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 5b732cfa2c474f428d487d2ad9d1cdb8 Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1508814780 Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-VolumesAdminNegativeTest-1508814780-project-admin Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 60b0c1017e4845a3a409dea6e5c0e0d3 Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-VolumesAdminNegativeTest-1508814780-project-admin Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: {"volumeAttachment": {"volumeId": "7a9f7f6f-86bd-43f7-8f9a-bf4e6a6aeeab"}} Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: exception: Volume 41fdef26-5273-42a0-b8e6-ff0542ac9a55 could not be found. Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'server_id': 'ceea6924-e172-4a5c-bb82-b77a6255ec6c', 'id': '41fdef26-5273-42a0-b8e6-ff0542ac9a55', 'body': {'volumeAttachment': {'volumeId': '7a9f7f6f-86bd-43f7-8f9a-bf4e6a6aeeab'}}} Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 41fdef26-5273-42a0-b8e6-ff0542ac9a55 could not be found. (HTTP 404) (Request-ID: req-596c9331-4671-4b79-90e4-c90f6f2edd51) Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 17:56:57.345000 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 41fdef26-5273-42a0-b8e6-ff0542ac9a55 could not be found. Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 41fdef26-5273-42a0-b8e6-ff0542ac9a55 could not be found. Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 41fdef26-5273-42a0-b8e6-ff0542ac9a55 could not be found. Aug 23 17:56:57.350414 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:56:57.355729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-354c9347-e60a-40f8-b2e0-71e9bf82c7a4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] Returning 404 to user: Volume 41fdef26-5273-42a0-b8e6-ff0542ac9a55 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:57.356765 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-354c9347-e60a-40f8-b2e0-71e9bf82c7a4 tempest-VolumesAdminNegativeTest-1508814780 tempest-VolumesAdminNegativeTest-1508814780-project-admin] 10.222.0.61 "PUT /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c/os-volume_attachments/41fdef26-5273-42a0-b8e6-ff0542ac9a55" status: 404 len: 109 microversion: 2.1 time: 0.107847 Aug 23 17:56:57.361850 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 816/1697] 10.222.0.61 () {60 vars in 1433 bytes} [Tue Aug 23 17:56:57 2022] PUT /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c/os-volume_attachments/41fdef26-5273-42a0-b8e6-ff0542ac9a55 => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:56:57.528883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-26b734f0-5394-40a4-b53b-04f3dba8a868 tempest-ComputeTenantNetworksTest-1821559912 tempest-ComputeTenantNetworksTest-1821559912-project] Calling method '.version_select at 0x7f27ec6ff790>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:57.800030 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-26b734f0-5394-40a4-b53b-04f3dba8a868 tempest-ComputeTenantNetworksTest-1821559912 tempest-ComputeTenantNetworksTest-1821559912-project] 10.222.0.61 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 307 microversion: 2.1 time: 0.436959 Aug 23 17:56:57.801375 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 817/1698] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Aug 23 17:56:57 2022] GET /compute/v2.1/os-tenant-networks => generated 307 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:57.811454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-590f1419-24b1-436c-86ff-270ded5a46f8 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:57.812482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-590f1419-24b1-436c-86ff-270ded5a46f8 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:57.829382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-590f1419-24b1-436c-86ff-270ded5a46f8 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:57.829962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-590f1419-24b1-436c-86ff-270ded5a46f8 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:57.830478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-590f1419-24b1-436c-86ff-270ded5a46f8 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:57.832292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-590f1419-24b1-436c-86ff-270ded5a46f8 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:57.832969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-590f1419-24b1-436c-86ff-270ded5a46f8 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:57.833982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-590f1419-24b1-436c-86ff-270ded5a46f8 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:58.082700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-590f1419-24b1-436c-86ff-270ded5a46f8 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:58.091010 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-590f1419-24b1-436c-86ff-270ded5a46f8 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1520 microversion: 2.1 time: 0.287965 Aug 23 17:56:58.091583 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 818/1699] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:57 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1520 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:58.096210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:58.096826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:58.103368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:58.104115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:58.104627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:58.105696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:58.106377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:58.106851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:58.144042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:58.144769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:58.145431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:58.146241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lazy-loading 'fault' on Instance uuid 14c2986a-4a33-4e1e-b560-1540016afc00 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:56:58.203575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4440b850f8974643bd22fc84ddd265ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbb6fbb08d9d4edc88ccf65f8b3e1df1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:58.213166 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bcf646e0-6333-4ca6-b31c-7a7d85ba377f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 200 len: 1314 microversion: 2.1 time: 0.120516 Aug 23 17:56:58.213902 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 819/1700] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:58 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 1314 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:58.233694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9788ae50-2008-461e-a1d1-7436a9fc5bd4 tempest-ComputeTenantNetworksTest-1821559912 tempest-ComputeTenantNetworksTest-1821559912-project] Calling method '.version_select at 0x7f27ec665d30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:58.308633 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-930d0177-c0be-4f61-aff0-79a106a8cff2 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/action" status: 202 len: 0 microversion: 2.1 time: 3.256881 Aug 23 17:56:58.309532 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 882/1701] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:56:55 2022] POST /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/action => generated 0 bytes in 3259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:56:58.315541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-59edca19-0d60-4b51-9cf4-6cbfede4816d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:58.316528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-59edca19-0d60-4b51-9cf4-6cbfede4816d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:58.326097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59edca19-0d60-4b51-9cf4-6cbfede4816d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:58.326954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59edca19-0d60-4b51-9cf4-6cbfede4816d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:58.327722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59edca19-0d60-4b51-9cf4-6cbfede4816d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:58.328678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59edca19-0d60-4b51-9cf4-6cbfede4816d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:58.329722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59edca19-0d60-4b51-9cf4-6cbfede4816d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:58.330378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59edca19-0d60-4b51-9cf4-6cbfede4816d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:58.373456 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9788ae50-2008-461e-a1d1-7436a9fc5bd4 tempest-ComputeTenantNetworksTest-1821559912 tempest-ComputeTenantNetworksTest-1821559912-project] 10.222.0.61 "GET /compute/v2.1/os-tenant-networks/e8d51f95-5b2e-40b9-8e34-90d399ee6a0b" status: 200 len: 138 microversion: 2.1 time: 0.157655 Aug 23 17:56:58.374047 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 820/1702] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 17:56:58 2022] GET /compute/v2.1/os-tenant-networks/e8d51f95-5b2e-40b9-8e34-90d399ee6a0b => generated 138 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:56:58.378691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6b2a0c1-a155-4a4f-90bb-850b56b7be74 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Action: 'create', calling method: .version_select at 0x7f27ec5fe9d0>, body: {"pool": null} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:56:58.571338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-59edca19-0d60-4b51-9cf4-6cbfede4816d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:58.591773 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-59edca19-0d60-4b51-9cf4-6cbfede4816d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1528 microversion: 2.1 time: 0.280879 Aug 23 17:56:58.592533 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 883/1703] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:58 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1528 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:58.614576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96dd2c2f-b184-468a-84f8-17aa770531dc tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:58.618316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-96dd2c2f-b184-468a-84f8-17aa770531dc tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:58.646974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96dd2c2f-b184-468a-84f8-17aa770531dc tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:58.649614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96dd2c2f-b184-468a-84f8-17aa770531dc tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:58.650100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96dd2c2f-b184-468a-84f8-17aa770531dc tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:58.650862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96dd2c2f-b184-468a-84f8-17aa770531dc tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:58.651331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96dd2c2f-b184-468a-84f8-17aa770531dc tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:58.651800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96dd2c2f-b184-468a-84f8-17aa770531dc tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:59.154942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-96dd2c2f-b184-468a-84f8-17aa770531dc tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:59.166969 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-96dd2c2f-b184-468a-84f8-17aa770531dc tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.573310 Aug 23 17:56:59.171987 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 884/1704] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:58 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:59.176944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d605547-c738-42cf-8ad9-651f5a0a4afb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:59.185406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d605547-c738-42cf-8ad9-651f5a0a4afb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:59.204962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d605547-c738-42cf-8ad9-651f5a0a4afb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:59.205566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d605547-c738-42cf-8ad9-651f5a0a4afb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:59.206190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d605547-c738-42cf-8ad9-651f5a0a4afb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:59.207562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d605547-c738-42cf-8ad9-651f5a0a4afb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:59.208180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d605547-c738-42cf-8ad9-651f5a0a4afb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:59.208711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d605547-c738-42cf-8ad9-651f5a0a4afb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:59.408605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6d605547-c738-42cf-8ad9-651f5a0a4afb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:59.420464 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d605547-c738-42cf-8ad9-651f5a0a4afb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.247177 Aug 23 17:56:59.422963 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 885/1705] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:59 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:59.428813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-015a3c19-7736-41a1-aadc-656927660759 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:59.429629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-015a3c19-7736-41a1-aadc-656927660759 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:59.437499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-015a3c19-7736-41a1-aadc-656927660759 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:59.437987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-015a3c19-7736-41a1-aadc-656927660759 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:59.438422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-015a3c19-7736-41a1-aadc-656927660759 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:59.439162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-015a3c19-7736-41a1-aadc-656927660759 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:59.439610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-015a3c19-7736-41a1-aadc-656927660759 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:59.440035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-015a3c19-7736-41a1-aadc-656927660759 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:59.642210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-015a3c19-7736-41a1-aadc-656927660759 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:56:59.651013 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-015a3c19-7736-41a1-aadc-656927660759 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1528 microversion: 2.1 time: 0.226102 Aug 23 17:56:59.652932 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 886/1706] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:59 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1528 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:56:59.659783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b1ec5ae5-d3a5-435c-8f57-a0f7283ed315 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:59.660606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b1ec5ae5-d3a5-435c-8f57-a0f7283ed315 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 14c2986a-4a33-4e1e-b560-1540016afc00] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:59.668019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1ec5ae5-d3a5-435c-8f57-a0f7283ed315 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:59.668558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1ec5ae5-d3a5-435c-8f57-a0f7283ed315 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:59.669015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1ec5ae5-d3a5-435c-8f57-a0f7283ed315 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:59.669729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1ec5ae5-d3a5-435c-8f57-a0f7283ed315 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:59.670184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1ec5ae5-d3a5-435c-8f57-a0f7283ed315 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:59.670651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1ec5ae5-d3a5-435c-8f57-a0f7283ed315 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:59.705512 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-b1ec5ae5-d3a5-435c-8f57-a0f7283ed315 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] HTTP exception thrown: Instance 14c2986a-4a33-4e1e-b560-1540016afc00 could not be found. Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b1ec5ae5-d3a5-435c-8f57-a0f7283ed315 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 HTTP/1.1 Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 14c2986a-4a33-4e1e-b560-1540016afc00 could not be found. Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '14c2986a-4a33-4e1e-b560-1540016afc00'} Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14c2986a-4a33-4e1e-b560-1540016afc00 could not be found. Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14c2986a-4a33-4e1e-b560-1540016afc00 could not be found. Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.707400 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:59.713215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.713215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.713215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:59.713215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:59.713215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:59.713215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:59.713215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14c2986a-4a33-4e1e-b560-1540016afc00 could not be found. Aug 23 17:56:59.713215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.713215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b1ec5ae5-d3a5-435c-8f57-a0f7283ed315 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 404 to user: Instance 14c2986a-4a33-4e1e-b560-1540016afc00 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:59.713215 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b1ec5ae5-d3a5-435c-8f57-a0f7283ed315 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00" status: 404 len: 111 microversion: 2.1 time: 0.054441 Aug 23 17:56:59.714708 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 887/1707] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:59 2022] GET /compute/v2.1/servers/14c2986a-4a33-4e1e-b560-1540016afc00 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:56:59.720152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1e60d650-2deb-40c3-9bb3-5b961e685580 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:59.725634 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:56:59.725634 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:56:59.737808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:56:59.739015 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-1e60d650-2deb-40c3-9bb3-5b961e685580 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] HTTP exception thrown: Flavor 5057de9f-3674-4924-b6f0-ea0a3f562291 could not be found. Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1e60d650-2deb-40c3-9bb3-5b961e685580 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Request method failure captured: Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/flavors/5057de9f-3674-4924-b6f0-ea0a3f562291 HTTP/1.1 Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQO-LVZbl_Gzw29e74jKC8alEbgkMji6D5rj7swIkiEeMhqOoPMIdgcQMDeUYaFNlT6IYqDJACZgDl7Z_0VO5biA3Sw9u7U877G41XinUbNS9OaVmPbiFSN4nmcUiP0VP6fY-3sLKXnlkzEydsyLMsE7R0-7Jhkhctla1jkZMJv23A Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 069daa30186d4d9e859500618adaf444 Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-MigrationsAdminTest-1496175242 Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_069daa30186d4d9e859500618adaf444"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/069daa30186d4d9e859500618adaf444"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/069daa30186d4d9e859500618adaf444"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/069daa30186d4d9e859500618adaf444"}]}] Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-MigrationsAdminTest-1496175242 Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 069daa30186d4d9e859500618adaf444 Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-MigrationsAdminTest-1496175242 Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-MigrationsAdminTest-1496175242-project-admin Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 1cc67f27fe034d19b33cd71de620fe1c Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-MigrationsAdminTest-1496175242-project-admin Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: exception: Flavor 5057de9f-3674-4924-b6f0-ea0a3f562291 could not be found. Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '5057de9f-3674-4924-b6f0-ea0a3f562291'} Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi flavor.destroy() Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 5057de9f-3674-4924-b6f0-ea0a3f562291 could not be found. Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 5057de9f-3674-4924-b6f0-ea0a3f562291 could not be found. Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.740740 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:59.747351 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.747351 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.747351 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:59.747351 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:59.747351 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:59.747351 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:59.747351 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 5057de9f-3674-4924-b6f0-ea0a3f562291 could not be found. Aug 23 17:56:59.747351 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.747351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1e60d650-2deb-40c3-9bb3-5b961e685580 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Returning 404 to user: Flavor 5057de9f-3674-4924-b6f0-ea0a3f562291 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:59.747351 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1e60d650-2deb-40c3-9bb3-5b961e685580 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/5057de9f-3674-4924-b6f0-ea0a3f562291" status: 404 len: 109 microversion: 2.1 time: 0.025836 Aug 23 17:56:59.747351 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 888/1708] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:56:59 2022] DELETE /compute/v2.1/flavors/5057de9f-3674-4924-b6f0-ea0a3f562291 => generated 109 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:56:59.798263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa206a10-ddf7-447c-9d3b-f7da7002183e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '.version_select at 0x7f27f1c64550>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:59.854356 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-fa206a10-ddf7-447c-9d3b-f7da7002183e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] HTTP exception thrown: Image not found. Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa206a10-ddf7-447c-9d3b-f7da7002183e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/images/394bba62-caa8-4807-b158-d1abd5c4bbcc HTTP/1.1 Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: exception: Image not found. Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '394bba62-caa8-4807-b158-d1abd5c4bbcc'} Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 394bba62-caa8-4807-b158-d1abd5c4bbcc to delete Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 394bba62-caa8-4807-b158-d1abd5c4bbcc could not be found. Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:59.860185 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa206a10-ddf7-447c-9d3b-f7da7002183e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 404 to user: Image not found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fa206a10-ddf7-447c-9d3b-f7da7002183e tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "DELETE /compute/v2.1/images/394bba62-caa8-4807-b158-d1abd5c4bbcc" status: 404 len: 62 microversion: 2.1 time: 0.086565 Aug 23 17:56:59.867964 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 889/1709] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:59 2022] DELETE /compute/v2.1/images/394bba62-caa8-4807-b158-d1abd5c4bbcc => generated 62 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:56:59.877536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c595e52c-e4e7-4ad6-8791-797ba909e6a6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:59.879859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c595e52c-e4e7-4ad6-8791-797ba909e6a6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:59.896349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c595e52c-e4e7-4ad6-8791-797ba909e6a6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:59.897077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c595e52c-e4e7-4ad6-8791-797ba909e6a6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:59.897810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c595e52c-e4e7-4ad6-8791-797ba909e6a6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:59.900985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c595e52c-e4e7-4ad6-8791-797ba909e6a6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:59.902186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c595e52c-e4e7-4ad6-8791-797ba909e6a6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:59.903344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c595e52c-e4e7-4ad6-8791-797ba909e6a6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:59.941365 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-c595e52c-e4e7-4ad6-8791-797ba909e6a6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] HTTP exception thrown: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c595e52c-e4e7-4ad6-8791-797ba909e6a6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 HTTP/1.1 Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '9dff523f-5032-42ec-abcb-2266d1aee875'} Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:56:59.943139 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:56:59.949986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:56:59.949986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.949986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:56:59.949986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.949986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:56:59.949986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:56:59.949986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:56:59.949986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:56:59.949986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:56:59.949986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:56:59.949986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:56:59.954269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c595e52c-e4e7-4ad6-8791-797ba909e6a6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 404 to user: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:56:59.957144 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c595e52c-e4e7-4ad6-8791-797ba909e6a6 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 404 len: 111 microversion: 2.1 time: 0.090478 Aug 23 17:56:59.960986 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 890/1710] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:56:59 2022] DELETE /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:56:59.969764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7150b83b-4a9b-4be3-9a3d-324701c9b43f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:56:59.974868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7150b83b-4a9b-4be3-9a3d-324701c9b43f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 9dff523f-5032-42ec-abcb-2266d1aee875] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:56:59.985955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7150b83b-4a9b-4be3-9a3d-324701c9b43f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:56:59.990878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7150b83b-4a9b-4be3-9a3d-324701c9b43f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:56:59.991459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7150b83b-4a9b-4be3-9a3d-324701c9b43f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:56:59.993204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7150b83b-4a9b-4be3-9a3d-324701c9b43f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:00.002767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7150b83b-4a9b-4be3-9a3d-324701c9b43f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:00.003342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7150b83b-4a9b-4be3-9a3d-324701c9b43f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:00.027733 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-7150b83b-4a9b-4be3-9a3d-324701c9b43f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] HTTP exception thrown: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7150b83b-4a9b-4be3-9a3d-324701c9b43f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 HTTP/1.1 Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '9dff523f-5032-42ec-abcb-2266d1aee875'} Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:00.029569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:00.033938 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:00.033938 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:00.033938 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:00.033938 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:00.033938 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:00.033938 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:00.033938 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. Aug 23 17:57:00.033938 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:00.039709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7150b83b-4a9b-4be3-9a3d-324701c9b43f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 404 to user: Instance 9dff523f-5032-42ec-abcb-2266d1aee875 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:00.040900 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7150b83b-4a9b-4be3-9a3d-324701c9b43f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875" status: 404 len: 111 microversion: 2.1 time: 0.077690 Aug 23 17:57:00.042063 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 891/1711] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:56:59 2022] GET /compute/v2.1/servers/9dff523f-5032-42ec-abcb-2266d1aee875 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:57:00.051453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1029888726", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:00.150289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:57:00.486626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:57:00.487963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:57:00.488676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:57:00.489532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:57:00.490328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:57:00.505979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:00.506899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:00.507515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:00.509219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:00.511862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:00.512689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:00.567320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Getting quotas for project 88baf37ceb1342e3bc666ba96b4988ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:57:00.578025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Getting quotas for user 8d66dd8a72974b1791fa449fb91c3282 and project 88baf37ceb1342e3bc666ba96b4988ee. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:57:00.604350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:57:00.607795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:57:00.689834 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-10df74a0-e7df-4926-8f11-f1f7b5c0c08d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643296 Aug 23 17:57:00.690483 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 892/1712] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:57:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:57:00.701143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-51613eff-5169-4c1f-a580-1b39c0e993b5 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '.version_select at 0x7f27f1bc9dc0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:00.753413 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-51613eff-5169-4c1f-a580-1b39c0e993b5 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-339161931" status: 202 len: 0 microversion: 2.1 time: 0.058506 Aug 23 17:57:00.754159 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 893/1713] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Aug 23 17:57:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-339161931 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:57:00.767898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-08e7f8ef-e64a-4c52-bd95-3c7b739eb5b4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:00.768855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-08e7f8ef-e64a-4c52-bd95-3c7b739eb5b4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:00.797323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08e7f8ef-e64a-4c52-bd95-3c7b739eb5b4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:00.798278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08e7f8ef-e64a-4c52-bd95-3c7b739eb5b4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:00.798955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08e7f8ef-e64a-4c52-bd95-3c7b739eb5b4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:00.801199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08e7f8ef-e64a-4c52-bd95-3c7b739eb5b4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:00.803787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08e7f8ef-e64a-4c52-bd95-3c7b739eb5b4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:00.804660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08e7f8ef-e64a-4c52-bd95-3c7b739eb5b4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:00.906583 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6b2a0c1-a155-4a4f-90bb-850b56b7be74 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.531400 Aug 23 17:57:00.907407 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 821/1714] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Aug 23 17:56:58 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:00.912768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5fe0fa1c-a59b-4fa9-bdf2-8d67fb65448a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:00.914121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5fe0fa1c-a59b-4fa9-bdf2-8d67fb65448a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:00.936937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fe0fa1c-a59b-4fa9-bdf2-8d67fb65448a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:00.937455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fe0fa1c-a59b-4fa9-bdf2-8d67fb65448a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:00.938046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fe0fa1c-a59b-4fa9-bdf2-8d67fb65448a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:00.938802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fe0fa1c-a59b-4fa9-bdf2-8d67fb65448a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:00.939262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fe0fa1c-a59b-4fa9-bdf2-8d67fb65448a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:00.939962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fe0fa1c-a59b-4fa9-bdf2-8d67fb65448a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:01.177591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-08e7f8ef-e64a-4c52-bd95-3c7b739eb5b4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:01.188100 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-08e7f8ef-e64a-4c52-bd95-3c7b739eb5b4 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.433033 Aug 23 17:57:01.188735 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 894/1715] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:00 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:01.206423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4916f05f-e635-40d3-bf2e-8725a1a06369 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:01.215955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4916f05f-e635-40d3-bf2e-8725a1a06369 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:01.380708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4916f05f-e635-40d3-bf2e-8725a1a06369 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:01.402341 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4916f05f-e635-40d3-bf2e-8725a1a06369 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1213 microversion: 2.1 time: 0.210268 Aug 23 17:57:01.406590 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 895/1716] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:01 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1213 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:01.419919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-144c97b2-df04-49a2-9a55-89aea19c782c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:01.423598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-144c97b2-df04-49a2-9a55-89aea19c782c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:01.470515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-144c97b2-df04-49a2-9a55-89aea19c782c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:01.471035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-144c97b2-df04-49a2-9a55-89aea19c782c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:01.471477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-144c97b2-df04-49a2-9a55-89aea19c782c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:01.472195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-144c97b2-df04-49a2-9a55-89aea19c782c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:01.472660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-144c97b2-df04-49a2-9a55-89aea19c782c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:01.473090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-144c97b2-df04-49a2-9a55-89aea19c782c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:01.521558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-144c97b2-df04-49a2-9a55-89aea19c782c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:57:01.626397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5fe0fa1c-a59b-4fa9-bdf2-8d67fb65448a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:01.657068 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5fe0fa1c-a59b-4fa9-bdf2-8d67fb65448a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.745726 Aug 23 17:57:01.659409 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 822/1717] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:00 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:01.681901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1184424938", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "4af2b4ce-48be-4835-a763-a9afa8d42aed"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:01.728235 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-144c97b2-df04-49a2-9a55-89aea19c782c tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 204 len: 0 microversion: 2.1 time: 0.319809 Aug 23 17:57:01.730832 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 896/1718] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:57:01 2022] DELETE /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:57:01.746519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-9dd83bab-9112-4752-9d47-d6499665a4a4 req-2476e296-fd00-4760-ac7d-d7bc34515000 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c329be5-120a-4bfd-ba7d-12c0ed0c4814", "name": "network-vif-plugged", "status": "completed", "tag": "777bb24b-a6b8-45cd-9bb8-2263c15bf327"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:01.770673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] validate_networks() for [('4af2b4ce-48be-4835-a763-a9afa8d42aed', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:57:01.784761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9dd83bab-9112-4752-9d47-d6499665a4a4 req-2476e296-fd00-4760-ac7d-d7bc34515000 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:01.785552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9dd83bab-9112-4752-9d47-d6499665a4a4 req-2476e296-fd00-4760-ac7d-d7bc34515000 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:01.786227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9dd83bab-9112-4752-9d47-d6499665a4a4 req-2476e296-fd00-4760-ac7d-d7bc34515000 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:01.802400 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-9dd83bab-9112-4752-9d47-d6499665a4a4 req-2476e296-fd00-4760-ac7d-d7bc34515000 service nova] Creating event network-vif-plugged:777bb24b-a6b8-45cd-9bb8-2263c15bf327 for instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 on n-h1-850468-16 Aug 23 17:57:01.810791 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-9dd83bab-9112-4752-9d47-d6499665a4a4 req-2476e296-fd00-4760-ac7d-d7bc34515000 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076518 Aug 23 17:57:01.811955 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 897/1719] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:01.835142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4785b936-bbc8-4679-bf93-e6e405b7c700 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:01.836306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4785b936-bbc8-4679-bf93-e6e405b7c700 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:01.855138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4785b936-bbc8-4679-bf93-e6e405b7c700 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:01.856731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4785b936-bbc8-4679-bf93-e6e405b7c700 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:01.858686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4785b936-bbc8-4679-bf93-e6e405b7c700 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:01.859970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4785b936-bbc8-4679-bf93-e6e405b7c700 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:01.862666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4785b936-bbc8-4679-bf93-e6e405b7c700 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:01.864106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4785b936-bbc8-4679-bf93-e6e405b7c700 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:02.068638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4785b936-bbc8-4679-bf93-e6e405b7c700 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:02.093985 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4785b936-bbc8-4679-bf93-e6e405b7c700 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1513 microversion: 2.1 time: 0.279186 Aug 23 17:57:02.099051 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 898/1720] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:01 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1513 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:02.210759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aaed5d6e-9e27-48c3-b6ff-71d4c97fd40d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:02.211536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aaed5d6e-9e27-48c3-b6ff-71d4c97fd40d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:02.226982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aaed5d6e-9e27-48c3-b6ff-71d4c97fd40d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:02.228786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aaed5d6e-9e27-48c3-b6ff-71d4c97fd40d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:02.229609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aaed5d6e-9e27-48c3-b6ff-71d4c97fd40d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:02.232058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aaed5d6e-9e27-48c3-b6ff-71d4c97fd40d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:02.237284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aaed5d6e-9e27-48c3-b6ff-71d4c97fd40d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:02.238213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aaed5d6e-9e27-48c3-b6ff-71d4c97fd40d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:02.507758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aaed5d6e-9e27-48c3-b6ff-71d4c97fd40d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:02.534437 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aaed5d6e-9e27-48c3-b6ff-71d4c97fd40d tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.312234 Aug 23 17:57:02.537278 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 899/1721] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:02 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:02.559778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ce9f7c3-fcfb-4c78-a9e3-cfc4830307f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:02.563127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1ce9f7c3-fcfb-4c78-a9e3-cfc4830307f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:02.573341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce9f7c3-fcfb-4c78-a9e3-cfc4830307f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:02.573920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce9f7c3-fcfb-4c78-a9e3-cfc4830307f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:02.574430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce9f7c3-fcfb-4c78-a9e3-cfc4830307f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:02.575240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce9f7c3-fcfb-4c78-a9e3-cfc4830307f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:02.575635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce9f7c3-fcfb-4c78-a9e3-cfc4830307f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:02.576066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce9f7c3-fcfb-4c78-a9e3-cfc4830307f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:02.677342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1ce9f7c3-fcfb-4c78-a9e3-cfc4830307f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:02.688667 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1ce9f7c3-fcfb-4c78-a9e3-cfc4830307f1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1265 microversion: 2.1 time: 0.149788 Aug 23 17:57:02.689260 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 900/1722] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:02 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:02.695450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-180ebeab-7221-41fc-a9b1-6d58120a1b31 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:02.696767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-180ebeab-7221-41fc-a9b1-6d58120a1b31 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:02.705443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-180ebeab-7221-41fc-a9b1-6d58120a1b31 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:02.705941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-180ebeab-7221-41fc-a9b1-6d58120a1b31 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:02.706385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-180ebeab-7221-41fc-a9b1-6d58120a1b31 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:02.707116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-180ebeab-7221-41fc-a9b1-6d58120a1b31 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:02.707576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-180ebeab-7221-41fc-a9b1-6d58120a1b31 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:02.707999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-180ebeab-7221-41fc-a9b1-6d58120a1b31 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:02.950524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-180ebeab-7221-41fc-a9b1-6d58120a1b31 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:02.977479 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-180ebeab-7221-41fc-a9b1-6d58120a1b31 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.286694 Aug 23 17:57:02.986926 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 901/1723] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:02 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:03.122867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dcae7198-b334-4a28-af3b-405b267f9553 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:03.123459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dcae7198-b334-4a28-af3b-405b267f9553 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:03.138143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcae7198-b334-4a28-af3b-405b267f9553 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:03.138678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcae7198-b334-4a28-af3b-405b267f9553 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:03.139126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcae7198-b334-4a28-af3b-405b267f9553 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:03.139852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcae7198-b334-4a28-af3b-405b267f9553 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:03.140312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcae7198-b334-4a28-af3b-405b267f9553 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:03.140742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcae7198-b334-4a28-af3b-405b267f9553 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:03.326210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:57:03.326816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:57:03.328585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:57:03.329395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:57:03.330171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:57:03.353847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:03.355614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:03.356343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:03.358054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:03.359580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:03.361245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:03.407552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Getting quotas for project e7b882a8b2644f1dac937ffcfd1ce14b. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:57:03.414274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Getting quotas for user 2b5f2c622daa43968a1a23cad5c91a49 and project e7b882a8b2644f1dac937ffcfd1ce14b. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:57:03.430779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dcae7198-b334-4a28-af3b-405b267f9553 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:03.445694 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dcae7198-b334-4a28-af3b-405b267f9553 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1513 microversion: 2.1 time: 0.328206 Aug 23 17:57:03.446429 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 902/1724] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:03 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1513 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:57:03.455397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:57:03.456988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9450a77c-bbed-49da-960c-661cefe60e74 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '.version_select at 0x7f27f1bc95e0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:03.462630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:57:03.505670 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-9450a77c-bbed-49da-960c-661cefe60e74 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] HTTP exception thrown: Image not found. Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9450a77c-bbed-49da-960c-661cefe60e74 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/images/bf5b7606-d00f-4358-afa2-23589f58f04c HTTP/1.1 Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: exception: Image not found. Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'bf5b7606-d00f-4358-afa2-23589f58f04c'} Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image bf5b7606-d00f-4358-afa2-23589f58f04c to delete Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image bf5b7606-d00f-4358-afa2-23589f58f04c could not be found. Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:03.508251 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 17:57:03.516535 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.523229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9450a77c-bbed-49da-960c-661cefe60e74 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 404 to user: Image not found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:03.523229 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9450a77c-bbed-49da-960c-661cefe60e74 tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "DELETE /compute/v2.1/images/bf5b7606-d00f-4358-afa2-23589f58f04c" status: 404 len: 62 microversion: 2.1 time: 0.073148 Aug 23 17:57:03.523229 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 903/1725] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:03 2022] DELETE /compute/v2.1/images/bf5b7606-d00f-4358-afa2-23589f58f04c => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:57:03.537355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-709c86f5-0848-4956-818a-ead895203fad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:03.538016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-709c86f5-0848-4956-818a-ead895203fad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:03.553547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-709c86f5-0848-4956-818a-ead895203fad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:03.554515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-709c86f5-0848-4956-818a-ead895203fad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:03.556773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-709c86f5-0848-4956-818a-ead895203fad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:03.558796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-709c86f5-0848-4956-818a-ead895203fad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:03.561653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-709c86f5-0848-4956-818a-ead895203fad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:03.562344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-709c86f5-0848-4956-818a-ead895203fad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:03.582340 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-709c86f5-0848-4956-818a-ead895203fad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] HTTP exception thrown: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-709c86f5-0848-4956-818a-ead895203fad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 HTTP/1.1 Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '61806701-e6ae-4bc0-abca-408ea9c3d186'} Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:57:03.584807 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-709c86f5-0848-4956-818a-ead895203fad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 404 to user: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-709c86f5-0848-4956-818a-ead895203fad tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "DELETE /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 404 len: 111 microversion: 2.1 time: 0.061180 Aug 23 17:57:03.591476 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 904/1726] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:57:03 2022] DELETE /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:57:03.597636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6828c5f7-ea64-4b4e-8a19-4f08dbe2de01 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:03.598324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6828c5f7-ea64-4b4e-8a19-4f08dbe2de01 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:03.602222 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c9f2f018-3abb-4aa9-a985-a919593ee5b5 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.924818 Aug 23 17:57:03.618900 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 823/1727] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:57:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:57:03.628145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9247a701-72a1-472b-8fd1-2f4d59fdbe5f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:03.632647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9247a701-72a1-472b-8fd1-2f4d59fdbe5f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] [instance: 61806701-e6ae-4bc0-abca-408ea9c3d186] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:03.643870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9247a701-72a1-472b-8fd1-2f4d59fdbe5f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:03.647755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9247a701-72a1-472b-8fd1-2f4d59fdbe5f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:03.648462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9247a701-72a1-472b-8fd1-2f4d59fdbe5f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:03.649323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9247a701-72a1-472b-8fd1-2f4d59fdbe5f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:03.651289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9247a701-72a1-472b-8fd1-2f4d59fdbe5f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:03.652333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9247a701-72a1-472b-8fd1-2f4d59fdbe5f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:03.662270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6828c5f7-ea64-4b4e-8a19-4f08dbe2de01 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:03.666852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6828c5f7-ea64-4b4e-8a19-4f08dbe2de01 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:03.669759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6828c5f7-ea64-4b4e-8a19-4f08dbe2de01 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:03.674870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6828c5f7-ea64-4b4e-8a19-4f08dbe2de01 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:03.675551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6828c5f7-ea64-4b4e-8a19-4f08dbe2de01 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:03.676777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6828c5f7-ea64-4b4e-8a19-4f08dbe2de01 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:03.691150 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-9247a701-72a1-472b-8fd1-2f4d59fdbe5f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] HTTP exception thrown: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9247a701-72a1-472b-8fd1-2f4d59fdbe5f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Request method failure captured: Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 HTTP/1.1 Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRR7V4xuvCQQbMHcgqlYELDHPducq8Ie43RkH2vSGvzLm_FyDc5emjU9maKZ09Gczae3LVt4YMJeIG5W_qwEWMo2srOlQrzDJn5MM2eI9aoqtyrNp96Zcth1yH-6yMz1ZiRB9XXwPLIfR-dQ03o4AnqYYFQNUxRc9yPGST_vwSkLAh0 Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fbb6fbb08d9d4edc88ccf65f8b3e1df1"}]}] Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: fbb6fbb08d9d4edc88ccf65f8b3e1df1 Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055 Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4440b850f8974643bd22fc84ddd265ee Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1732000055-project Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '61806701-e6ae-4bc0-abca-408ea9c3d186'} Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.692721 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:03.697845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.697845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:03.697845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:03.697845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:03.697845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:03.697845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:03.697845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. Aug 23 17:57:03.697845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:03.697845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9247a701-72a1-472b-8fd1-2f4d59fdbe5f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] Returning 404 to user: Instance 61806701-e6ae-4bc0-abca-408ea9c3d186 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:03.697845 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9247a701-72a1-472b-8fd1-2f4d59fdbe5f tempest-ImagesOneServerNegativeTestJSON-1732000055 tempest-ImagesOneServerNegativeTestJSON-1732000055-project] 10.222.0.61 "GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186" status: 404 len: 111 microversion: 2.1 time: 0.074128 Aug 23 17:57:03.702893 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 824/1728] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:03 2022] GET /compute/v2.1/servers/61806701-e6ae-4bc0-abca-408ea9c3d186 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:57:03.716085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-721bedd0-f4d3-42a4-b139-da50f46c22b9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:03.716783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-721bedd0-f4d3-42a4-b139-da50f46c22b9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:03.880202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-721bedd0-f4d3-42a4-b139-da50f46c22b9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:03.889012 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-721bedd0-f4d3-42a4-b139-da50f46c22b9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1224 microversion: 2.1 time: 0.184945 Aug 23 17:57:03.894248 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 825/1729] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:03 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1224 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:03.912150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-11eaa5dd-6019-453c-9ebe-91936ccca668 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:03.915111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-11eaa5dd-6019-453c-9ebe-91936ccca668 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:03.933823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11eaa5dd-6019-453c-9ebe-91936ccca668 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:03.934916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11eaa5dd-6019-453c-9ebe-91936ccca668 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:03.936162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11eaa5dd-6019-453c-9ebe-91936ccca668 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:03.937577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11eaa5dd-6019-453c-9ebe-91936ccca668 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:03.939751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11eaa5dd-6019-453c-9ebe-91936ccca668 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:03.940428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11eaa5dd-6019-453c-9ebe-91936ccca668 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:04.395558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6828c5f7-ea64-4b4e-8a19-4f08dbe2de01 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:04.414720 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6828c5f7-ea64-4b4e-8a19-4f08dbe2de01 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.817806 Aug 23 17:57:04.428732 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 905/1730] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:03 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:04.436818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-11eaa5dd-6019-453c-9ebe-91936ccca668 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:04.439780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b665d3bb-4409-4214-883b-c6a41f6e3da9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:04.440882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b665d3bb-4409-4214-883b-c6a41f6e3da9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:04.449619 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-11eaa5dd-6019-453c-9ebe-91936ccca668 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1313 microversion: 2.1 time: 0.552593 Aug 23 17:57:04.451481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b665d3bb-4409-4214-883b-c6a41f6e3da9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:04.453820 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 826/1731] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:03 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:04.454671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b665d3bb-4409-4214-883b-c6a41f6e3da9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:04.455788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b665d3bb-4409-4214-883b-c6a41f6e3da9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:04.456780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b665d3bb-4409-4214-883b-c6a41f6e3da9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:04.458976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b665d3bb-4409-4214-883b-c6a41f6e3da9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:04.468944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b665d3bb-4409-4214-883b-c6a41f6e3da9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:04.470779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a84a0796-c3b9-492c-9dc1-8e3706ecc0c6 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:04.471392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a84a0796-c3b9-492c-9dc1-8e3706ecc0c6 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:04.474874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:04.484657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a84a0796-c3b9-492c-9dc1-8e3706ecc0c6 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:04.485808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a84a0796-c3b9-492c-9dc1-8e3706ecc0c6 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:04.487222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a84a0796-c3b9-492c-9dc1-8e3706ecc0c6 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:04.488324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a84a0796-c3b9-492c-9dc1-8e3706ecc0c6 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:04.489238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a84a0796-c3b9-492c-9dc1-8e3706ecc0c6 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:04.489843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a84a0796-c3b9-492c-9dc1-8e3706ecc0c6 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:04.951672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a84a0796-c3b9-492c-9dc1-8e3706ecc0c6 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:04.968229 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a84a0796-c3b9-492c-9dc1-8e3706ecc0c6 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1513 microversion: 2.1 time: 0.503886 Aug 23 17:57:04.971188 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 827/1732] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:04 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1513 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:04.973308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b665d3bb-4409-4214-883b-c6a41f6e3da9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:04.991667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6ba30c6-6150-4f7b-8bd4-756b4c722d3f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:04.992397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6ba30c6-6150-4f7b-8bd4-756b4c722d3f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:05.000597 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b665d3bb-4409-4214-883b-c6a41f6e3da9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.581141 Aug 23 17:57:05.005366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6ba30c6-6150-4f7b-8bd4-756b4c722d3f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:05.006300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6ba30c6-6150-4f7b-8bd4-756b4c722d3f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:05.007163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6ba30c6-6150-4f7b-8bd4-756b4c722d3f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:05.008284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6ba30c6-6150-4f7b-8bd4-756b4c722d3f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:05.008942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6ba30c6-6150-4f7b-8bd4-756b4c722d3f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:05.010015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6ba30c6-6150-4f7b-8bd4-756b4c722d3f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:05.019243 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 906/1733] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:04 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:05.117359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b6ba30c6-6150-4f7b-8bd4-756b4c722d3f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:05.128581 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6ba30c6-6150-4f7b-8bd4-756b4c722d3f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1276 microversion: 2.1 time: 0.155226 Aug 23 17:57:05.129553 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 828/1734] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:04 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1276 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:05.402758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b26cd57d-c462-49db-a477-8cfae76301fc req-71d88bf0-a85f-49da-bd1d-3057e232475d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceea6924-e172-4a5c-bb82-b77a6255ec6c", "name": "network-vif-deleted", "tag": "27f162ab-9c0c-4c70-8eed-864adf0c88f8"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:05.420953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b26cd57d-c462-49db-a477-8cfae76301fc req-71d88bf0-a85f-49da-bd1d-3057e232475d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:05.421786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b26cd57d-c462-49db-a477-8cfae76301fc req-71d88bf0-a85f-49da-bd1d-3057e232475d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:05.422391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b26cd57d-c462-49db-a477-8cfae76301fc req-71d88bf0-a85f-49da-bd1d-3057e232475d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:05.438234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-184f20a9-b61a-4193-99a0-ce6a7682c6e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:05.443657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-184f20a9-b61a-4193-99a0-ce6a7682c6e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:05.450980 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b26cd57d-c462-49db-a477-8cfae76301fc req-71d88bf0-a85f-49da-bd1d-3057e232475d service nova] Creating event network-vif-deleted:27f162ab-9c0c-4c70-8eed-864adf0c88f8 for instance ceea6924-e172-4a5c-bb82-b77a6255ec6c on n-h2-850468-16 Aug 23 17:57:05.458014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-184f20a9-b61a-4193-99a0-ce6a7682c6e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:05.460877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-184f20a9-b61a-4193-99a0-ce6a7682c6e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:05.461563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-184f20a9-b61a-4193-99a0-ce6a7682c6e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:05.462464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-184f20a9-b61a-4193-99a0-ce6a7682c6e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:05.465093 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b26cd57d-c462-49db-a477-8cfae76301fc req-71d88bf0-a85f-49da-bd1d-3057e232475d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065929 Aug 23 17:57:05.465723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-184f20a9-b61a-4193-99a0-ce6a7682c6e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:05.466332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-184f20a9-b61a-4193-99a0-ce6a7682c6e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:05.469760 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 907/1735] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:05.484363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-39667a3f-3e31-4008-9f27-44ccc3a1abe9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:05.491390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-39667a3f-3e31-4008-9f27-44ccc3a1abe9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:05.517407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39667a3f-3e31-4008-9f27-44ccc3a1abe9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:05.518257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39667a3f-3e31-4008-9f27-44ccc3a1abe9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:05.518938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39667a3f-3e31-4008-9f27-44ccc3a1abe9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:05.519881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39667a3f-3e31-4008-9f27-44ccc3a1abe9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:05.523184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39667a3f-3e31-4008-9f27-44ccc3a1abe9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:05.526249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39667a3f-3e31-4008-9f27-44ccc3a1abe9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:05.719035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-184f20a9-b61a-4193-99a0-ce6a7682c6e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:05.727939 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-184f20a9-b61a-4193-99a0-ce6a7682c6e6 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.295012 Aug 23 17:57:05.729404 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 829/1736] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:05 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:05.990139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:05.991010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:05.999362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:06.003663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:06.004423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:06.005399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:06.015337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:06.016139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:06.088896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:06.089835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:06.090935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:06.091788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lazy-loading 'fault' on Instance uuid ceea6924-e172-4a5c-bb82-b77a6255ec6c {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:57:06.166534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-39667a3f-3e31-4008-9f27-44ccc3a1abe9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:06.177061 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-39667a3f-3e31-4008-9f27-44ccc3a1abe9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1313 microversion: 2.1 time: 0.701887 Aug 23 17:57:06.178887 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 908/1737] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:05 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1313 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:06.195320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4aad2098-26be-444b-a1e0-ec73a2fd2c6d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:06.195948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4aad2098-26be-444b-a1e0-ec73a2fd2c6d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:06.207546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4aad2098-26be-444b-a1e0-ec73a2fd2c6d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:06.208280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4aad2098-26be-444b-a1e0-ec73a2fd2c6d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:06.208914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4aad2098-26be-444b-a1e0-ec73a2fd2c6d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:06.210088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4aad2098-26be-444b-a1e0-ec73a2fd2c6d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:06.210864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4aad2098-26be-444b-a1e0-ec73a2fd2c6d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:06.211565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4aad2098-26be-444b-a1e0-ec73a2fd2c6d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:06.216098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:06.231023 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a389b3a3-bbbc-4e5e-8b32-1547702bab9d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 200 len: 1308 microversion: 2.1 time: 0.245252 Aug 23 17:57:06.231627 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 830/1738] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:05 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 1308 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:57:06.242943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a492da62-5b29-458c-97bf-1db37e971b1d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:06.242943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a492da62-5b29-458c-97bf-1db37e971b1d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:06.262978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a492da62-5b29-458c-97bf-1db37e971b1d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:06.263562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a492da62-5b29-458c-97bf-1db37e971b1d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:06.264198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a492da62-5b29-458c-97bf-1db37e971b1d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:06.265077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a492da62-5b29-458c-97bf-1db37e971b1d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:06.265710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a492da62-5b29-458c-97bf-1db37e971b1d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:06.266388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a492da62-5b29-458c-97bf-1db37e971b1d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:06.425270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a492da62-5b29-458c-97bf-1db37e971b1d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:06.438147 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a492da62-5b29-458c-97bf-1db37e971b1d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1282 microversion: 2.1 time: 0.205121 Aug 23 17:57:06.466050 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 831/1739] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:06 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1282 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:06.706173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4aad2098-26be-444b-a1e0-ec73a2fd2c6d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:06.719987 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4aad2098-26be-444b-a1e0-ec73a2fd2c6d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.539756 Aug 23 17:57:06.735654 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 909/1740] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:06 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:06.751136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-095e2610-6b3f-44d7-8879-6637ef13175a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:06.752044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-095e2610-6b3f-44d7-8879-6637ef13175a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:06.764609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-095e2610-6b3f-44d7-8879-6637ef13175a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:06.765416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-095e2610-6b3f-44d7-8879-6637ef13175a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:06.766044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-095e2610-6b3f-44d7-8879-6637ef13175a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:06.767801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-095e2610-6b3f-44d7-8879-6637ef13175a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:06.768932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-095e2610-6b3f-44d7-8879-6637ef13175a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:06.769561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-095e2610-6b3f-44d7-8879-6637ef13175a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:06.877506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-45dbcc1a-4b13-41ce-8a72-5bdf0a625f1c req-238acc20-f4c2-43f7-8b94-f88094fb2cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a4ebc8-3d93-4377-beec-accf25eee386", "tag": "67689804-86f0-4754-bb53-ddbce34de8e9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:06.900712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-45dbcc1a-4b13-41ce-8a72-5bdf0a625f1c req-238acc20-f4c2-43f7-8b94-f88094fb2cf4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:06.901899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-45dbcc1a-4b13-41ce-8a72-5bdf0a625f1c req-238acc20-f4c2-43f7-8b94-f88094fb2cf4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:06.907640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-45dbcc1a-4b13-41ce-8a72-5bdf0a625f1c req-238acc20-f4c2-43f7-8b94-f88094fb2cf4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:06.943956 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-45dbcc1a-4b13-41ce-8a72-5bdf0a625f1c req-238acc20-f4c2-43f7-8b94-f88094fb2cf4 service nova] Creating event network-changed:67689804-86f0-4754-bb53-ddbce34de8e9 for instance 13a4ebc8-3d93-4377-beec-accf25eee386 on n-h1-850468-16 Aug 23 17:57:06.959834 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-45dbcc1a-4b13-41ce-8a72-5bdf0a625f1c req-238acc20-f4c2-43f7-8b94-f88094fb2cf4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084156 Aug 23 17:57:06.969871 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 910/1741] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:06.975848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a7104e4a-28c2-44d4-8da4-722bfe8539ef tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:06.982793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a7104e4a-28c2-44d4-8da4-722bfe8539ef tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:06.991590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7104e4a-28c2-44d4-8da4-722bfe8539ef tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:06.992070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7104e4a-28c2-44d4-8da4-722bfe8539ef tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:06.992887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7104e4a-28c2-44d4-8da4-722bfe8539ef tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:06.994707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7104e4a-28c2-44d4-8da4-722bfe8539ef tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:06.996094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7104e4a-28c2-44d4-8da4-722bfe8539ef tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:06.996814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7104e4a-28c2-44d4-8da4-722bfe8539ef tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:07.134447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-095e2610-6b3f-44d7-8879-6637ef13175a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:07.149942 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-095e2610-6b3f-44d7-8879-6637ef13175a tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.403494 Aug 23 17:57:07.151157 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 832/1742] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:06 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:07.198067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5d3f6503-77a2-44a5-a12d-aeb31cb86306 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:07.199780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5d3f6503-77a2-44a5-a12d-aeb31cb86306 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:07.210302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d3f6503-77a2-44a5-a12d-aeb31cb86306 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:07.211437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d3f6503-77a2-44a5-a12d-aeb31cb86306 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:07.221886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d3f6503-77a2-44a5-a12d-aeb31cb86306 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:07.222976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d3f6503-77a2-44a5-a12d-aeb31cb86306 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:07.223628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d3f6503-77a2-44a5-a12d-aeb31cb86306 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:07.224235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d3f6503-77a2-44a5-a12d-aeb31cb86306 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:07.617331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5d3f6503-77a2-44a5-a12d-aeb31cb86306 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:07.630528 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5d3f6503-77a2-44a5-a12d-aeb31cb86306 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1313 microversion: 2.1 time: 0.436244 Aug 23 17:57:07.633150 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 833/1743] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:07 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1313 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:57:07.654470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8dca38b-b7e9-4bc1-aca8-af041b955e7e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:07.657711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8dca38b-b7e9-4bc1-aca8-af041b955e7e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: ceea6924-e172-4a5c-bb82-b77a6255ec6c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:07.679979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8dca38b-b7e9-4bc1-aca8-af041b955e7e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:07.682337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8dca38b-b7e9-4bc1-aca8-af041b955e7e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:07.685905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8dca38b-b7e9-4bc1-aca8-af041b955e7e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:07.688155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8dca38b-b7e9-4bc1-aca8-af041b955e7e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:07.691958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8dca38b-b7e9-4bc1-aca8-af041b955e7e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:07.692631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8dca38b-b7e9-4bc1-aca8-af041b955e7e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:07.716118 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b8dca38b-b7e9-4bc1-aca8-af041b955e7e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] HTTP exception thrown: Instance ceea6924-e172-4a5c-bb82-b77a6255ec6c could not be found. Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8dca38b-b7e9-4bc1-aca8-af041b955e7e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Request method failure captured: Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c HTTP/1.1 Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRQgFHDrahaagDbY5dAYtF0fxXMx-uXx3QD2QlNSmLRc0g2kaPCUB9j2BaIUydi9pevprtNhounzFow_QLpog5tOFnSVyF8VUwY4MNvBhyo9_vDVVjCrn1IsXrapCeJcDfoa5tjhTIcCaehYOiTEVBMtPgmNFjsunxBoPPWV0Cd1BIM Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d60b8676313b4607b015755341be1331 Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-VolumesAdminNegativeTest-1022868579 Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d60b8676313b4607b015755341be1331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d60b8676313b4607b015755341be1331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d60b8676313b4607b015755341be1331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d60b8676313b4607b015755341be1331"}]}] Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-VolumesAdminNegativeTest-1022868579 Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d60b8676313b4607b015755341be1331 Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1022868579 Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-VolumesAdminNegativeTest-1022868579-project Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: d4e792ec8c584ba489b976f62f409d94 Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-VolumesAdminNegativeTest-1022868579-project Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance ceea6924-e172-4a5c-bb82-b77a6255ec6c could not be found. Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'ceea6924-e172-4a5c-bb82-b77a6255ec6c'} Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceea6924-e172-4a5c-bb82-b77a6255ec6c could not be found. Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceea6924-e172-4a5c-bb82-b77a6255ec6c could not be found. Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:07.718962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:07.724049 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:07.724049 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:07.724049 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:07.724049 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:07.724049 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:07.724049 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceea6924-e172-4a5c-bb82-b77a6255ec6c could not be found. Aug 23 17:57:07.724049 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:07.724049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8dca38b-b7e9-4bc1-aca8-af041b955e7e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Returning 404 to user: Instance ceea6924-e172-4a5c-bb82-b77a6255ec6c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:07.724049 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8dca38b-b7e9-4bc1-aca8-af041b955e7e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c" status: 404 len: 111 microversion: 2.1 time: 0.086216 Aug 23 17:57:07.724049 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 834/1744] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:07 2022] GET /compute/v2.1/servers/ceea6924-e172-4a5c-bb82-b77a6255ec6c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:57:07.725872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7a9b8395-6d51-4562-a78d-64962d3bfd98 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:07.727111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7a9b8395-6d51-4562-a78d-64962d3bfd98 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:07.738590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a9b8395-6d51-4562-a78d-64962d3bfd98 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:07.738950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a9b8395-6d51-4562-a78d-64962d3bfd98 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:07.739597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a9b8395-6d51-4562-a78d-64962d3bfd98 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:07.740570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a9b8395-6d51-4562-a78d-64962d3bfd98 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:07.741177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a9b8395-6d51-4562-a78d-64962d3bfd98 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:07.741752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a9b8395-6d51-4562-a78d-64962d3bfd98 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:08.093460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-a7104e4a-28c2-44d4-8da4-722bfe8539ef tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid 480827c0-1bbc-4e3f-9176-aebec4fc597b {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:57:08.107838 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a7104e4a-28c2-44d4-8da4-722bfe8539ef tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 2346 microversion: 2.25 time: 1.136359 Aug 23 17:57:08.108474 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 911/1745] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:06 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 2346 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:08.141073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e8eaf47f-6026-4bc8-a464-524df1715d87 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:08.142000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e8eaf47f-6026-4bc8-a464-524df1715d87 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:08.152713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8eaf47f-6026-4bc8-a464-524df1715d87 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:08.153510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8eaf47f-6026-4bc8-a464-524df1715d87 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:08.155898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8eaf47f-6026-4bc8-a464-524df1715d87 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:08.165774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8eaf47f-6026-4bc8-a464-524df1715d87 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:08.166694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8eaf47f-6026-4bc8-a464-524df1715d87 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:08.168107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8eaf47f-6026-4bc8-a464-524df1715d87 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:08.207607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a9b8395-6d51-4562-a78d-64962d3bfd98 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:08.220009 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7a9b8395-6d51-4562-a78d-64962d3bfd98 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1324 microversion: 2.1 time: 0.497505 Aug 23 17:57:08.220606 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 835/1746] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:07 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1324 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:08.243755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-70f55cc7-d583-4256-90ae-28e33b37b213 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:08.248309 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:57:08.248309 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:57:08.249611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70f55cc7-d583-4256-90ae-28e33b37b213 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:08.259384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70f55cc7-d583-4256-90ae-28e33b37b213 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:08.270619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70f55cc7-d583-4256-90ae-28e33b37b213 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:08.271826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70f55cc7-d583-4256-90ae-28e33b37b213 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:08.272483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70f55cc7-d583-4256-90ae-28e33b37b213 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:08.273719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70f55cc7-d583-4256-90ae-28e33b37b213 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:08.315259 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-70f55cc7-d583-4256-90ae-28e33b37b213 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.092287 Aug 23 17:57:08.324136 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 836/1747] 10.222.0.61 () {60 vars in 1217 bytes} [Tue Aug 23 17:57:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:57:08.329069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0bf0e3c1-a2c8-404e-b800-14fad7b381d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:08.329691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0bf0e3c1-a2c8-404e-b800-14fad7b381d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:08.336124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bf0e3c1-a2c8-404e-b800-14fad7b381d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:08.337036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bf0e3c1-a2c8-404e-b800-14fad7b381d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:08.337666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bf0e3c1-a2c8-404e-b800-14fad7b381d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:08.338625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bf0e3c1-a2c8-404e-b800-14fad7b381d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:08.340119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bf0e3c1-a2c8-404e-b800-14fad7b381d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:08.340986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bf0e3c1-a2c8-404e-b800-14fad7b381d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:08.686728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0bf0e3c1-a2c8-404e-b800-14fad7b381d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:08.696844 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0bf0e3c1-a2c8-404e-b800-14fad7b381d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.371552 Aug 23 17:57:08.703780 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 837/1748] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:08 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:08.711991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2ae939d-3577-465e-9820-5c8149edb44c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:08.714469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f2ae939d-3577-465e-9820-5c8149edb44c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:08.728105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2ae939d-3577-465e-9820-5c8149edb44c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:08.731182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2ae939d-3577-465e-9820-5c8149edb44c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:08.731820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2ae939d-3577-465e-9820-5c8149edb44c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:08.733746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2ae939d-3577-465e-9820-5c8149edb44c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:08.735377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2ae939d-3577-465e-9820-5c8149edb44c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:08.735937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2ae939d-3577-465e-9820-5c8149edb44c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:08.761987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e8eaf47f-6026-4bc8-a464-524df1715d87 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:08.795438 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e8eaf47f-6026-4bc8-a464-524df1715d87 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.659309 Aug 23 17:57:08.811870 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 912/1749] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:08 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:09.063773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f2ae939d-3577-465e-9820-5c8149edb44c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:09.078670 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f2ae939d-3577-465e-9820-5c8149edb44c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1313 microversion: 2.1 time: 0.371832 Aug 23 17:57:09.091284 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 838/1750] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:08 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1313 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:09.242204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dcf3f450-5d29-47ad-b243-07c8e2b2e928 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:09.242876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dcf3f450-5d29-47ad-b243-07c8e2b2e928 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:09.258765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcf3f450-5d29-47ad-b243-07c8e2b2e928 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:09.263875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcf3f450-5d29-47ad-b243-07c8e2b2e928 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:09.266003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcf3f450-5d29-47ad-b243-07c8e2b2e928 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:09.268795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcf3f450-5d29-47ad-b243-07c8e2b2e928 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:09.269478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcf3f450-5d29-47ad-b243-07c8e2b2e928 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:09.270667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcf3f450-5d29-47ad-b243-07c8e2b2e928 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:09.428461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4abb4b8b-7c95-4eb5-9444-b7b14bd1e980 req-d2829cee-78c7-499a-951a-80c4bd23cff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec0ffe29-2542-4e91-8547-9ef18f242ee5", "tag": "d66d999b-a814-47c8-9efe-f2e4faaac265"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:09.441916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4abb4b8b-7c95-4eb5-9444-b7b14bd1e980 req-d2829cee-78c7-499a-951a-80c4bd23cff4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:09.442629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4abb4b8b-7c95-4eb5-9444-b7b14bd1e980 req-d2829cee-78c7-499a-951a-80c4bd23cff4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:09.443179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4abb4b8b-7c95-4eb5-9444-b7b14bd1e980 req-d2829cee-78c7-499a-951a-80c4bd23cff4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:09.447846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:09.461259 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4abb4b8b-7c95-4eb5-9444-b7b14bd1e980 req-d2829cee-78c7-499a-951a-80c4bd23cff4 service nova] Creating event network-changed:d66d999b-a814-47c8-9efe-f2e4faaac265 for instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 on n-h1-850468-16 Aug 23 17:57:09.469993 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4abb4b8b-7c95-4eb5-9444-b7b14bd1e980 req-d2829cee-78c7-499a-951a-80c4bd23cff4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045863 Aug 23 17:57:09.470981 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 839/1751] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:57:09.563399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dcf3f450-5d29-47ad-b243-07c8e2b2e928 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:09.580003 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dcf3f450-5d29-47ad-b243-07c8e2b2e928 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1324 microversion: 2.1 time: 0.342416 Aug 23 17:57:09.580638 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 913/1752] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:09 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1324 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:09.737100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04be25a8-579d-49e9-93c9-f6783463ba86 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:09.738604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-04be25a8-579d-49e9-93c9-f6783463ba86 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:09.756960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04be25a8-579d-49e9-93c9-f6783463ba86 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:09.759213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04be25a8-579d-49e9-93c9-f6783463ba86 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:09.760226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04be25a8-579d-49e9-93c9-f6783463ba86 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:09.762162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04be25a8-579d-49e9-93c9-f6783463ba86 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:09.763814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04be25a8-579d-49e9-93c9-f6783463ba86 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:09.765067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04be25a8-579d-49e9-93c9-f6783463ba86 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:09.821938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-60177606-c54e-4c21-b82d-94bc9b5420a9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:09.822064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-60177606-c54e-4c21-b82d-94bc9b5420a9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:09.838300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60177606-c54e-4c21-b82d-94bc9b5420a9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:09.839631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60177606-c54e-4c21-b82d-94bc9b5420a9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:09.840998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60177606-c54e-4c21-b82d-94bc9b5420a9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:09.841759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60177606-c54e-4c21-b82d-94bc9b5420a9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:09.843278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60177606-c54e-4c21-b82d-94bc9b5420a9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:09.843728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60177606-c54e-4c21-b82d-94bc9b5420a9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:10.000038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-04be25a8-579d-49e9-93c9-f6783463ba86 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:10.009340 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-04be25a8-579d-49e9-93c9-f6783463ba86 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.282574 Aug 23 17:57:10.028625 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 840/1753] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:09 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:10.105993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-781d039a-77b4-44a7-995c-bfae1e99b653 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:10.106935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-781d039a-77b4-44a7-995c-bfae1e99b653 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:10.115890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-781d039a-77b4-44a7-995c-bfae1e99b653 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:10.119531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-781d039a-77b4-44a7-995c-bfae1e99b653 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:10.120865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-781d039a-77b4-44a7-995c-bfae1e99b653 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:10.123184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-781d039a-77b4-44a7-995c-bfae1e99b653 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:10.123961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-781d039a-77b4-44a7-995c-bfae1e99b653 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:10.124714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-781d039a-77b4-44a7-995c-bfae1e99b653 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:10.457354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-781d039a-77b4-44a7-995c-bfae1e99b653 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:10.468543 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-781d039a-77b4-44a7-995c-bfae1e99b653 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1313 microversion: 2.1 time: 0.366968 Aug 23 17:57:10.475752 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 841/1754] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:10 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1313 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:57:10.499575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-60177606-c54e-4c21-b82d-94bc9b5420a9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:10.513370 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-60177606-c54e-4c21-b82d-94bc9b5420a9 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.696866 Aug 23 17:57:10.527487 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 914/1755] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:09 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:10.605635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fa55cbf0-4794-4da1-9a33-8017270068e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:10.606890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fa55cbf0-4794-4da1-9a33-8017270068e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:10.614951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa55cbf0-4794-4da1-9a33-8017270068e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:10.615876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa55cbf0-4794-4da1-9a33-8017270068e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:10.616589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa55cbf0-4794-4da1-9a33-8017270068e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:10.617558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa55cbf0-4794-4da1-9a33-8017270068e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:10.618303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa55cbf0-4794-4da1-9a33-8017270068e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:10.619212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa55cbf0-4794-4da1-9a33-8017270068e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:10.809797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fa55cbf0-4794-4da1-9a33-8017270068e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:10.819448 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fa55cbf0-4794-4da1-9a33-8017270068e9 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1324 microversion: 2.1 time: 0.219812 Aug 23 17:57:10.824571 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 842/1756] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:10 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1324 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:11.034238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5e83b47d-cb87-43b4-a891-cb2088d6aeba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:11.034889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5e83b47d-cb87-43b4-a891-cb2088d6aeba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:11.040700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:11.043757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e83b47d-cb87-43b4-a891-cb2088d6aeba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:11.044492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e83b47d-cb87-43b4-a891-cb2088d6aeba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:11.045291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e83b47d-cb87-43b4-a891-cb2088d6aeba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:11.046229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e83b47d-cb87-43b4-a891-cb2088d6aeba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:11.046948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e83b47d-cb87-43b4-a891-cb2088d6aeba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:11.047597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e83b47d-cb87-43b4-a891-cb2088d6aeba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:11.348924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5e83b47d-cb87-43b4-a891-cb2088d6aeba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:11.368370 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5e83b47d-cb87-43b4-a891-cb2088d6aeba tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.334419 Aug 23 17:57:11.387493 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 915/1757] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:11 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:11.431893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7b96d47b-02e1-4be8-92bc-f72c6d3d0dc4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb4e23b9-9871-400f-9b94-f67631a89549", "device": "/dev/xvdb"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:11.437665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7b96d47b-02e1-4be8-92bc-f72c6d3d0dc4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:11.461886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b96d47b-02e1-4be8-92bc-f72c6d3d0dc4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:11.465873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b96d47b-02e1-4be8-92bc-f72c6d3d0dc4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:11.466535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b96d47b-02e1-4be8-92bc-f72c6d3d0dc4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:11.475827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b96d47b-02e1-4be8-92bc-f72c6d3d0dc4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:11.476425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b96d47b-02e1-4be8-92bc-f72c6d3d0dc4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:11.476868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b96d47b-02e1-4be8-92bc-f72c6d3d0dc4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:11.497606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-351f5b59-6c05-42a8-a358-f0a9101584cc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:11.498596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-351f5b59-6c05-42a8-a358-f0a9101584cc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:11.511463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:11.515414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-351f5b59-6c05-42a8-a358-f0a9101584cc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:11.517251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-351f5b59-6c05-42a8-a358-f0a9101584cc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:11.519910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-351f5b59-6c05-42a8-a358-f0a9101584cc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:11.529836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-351f5b59-6c05-42a8-a358-f0a9101584cc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:11.529836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-351f5b59-6c05-42a8-a358-f0a9101584cc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:11.529836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-351f5b59-6c05-42a8-a358-f0a9101584cc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:11.993023 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7b96d47b-02e1-4be8-92bc-f72c6d3d0dc4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "POST /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 0.566033 Aug 23 17:57:11.996467 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 843/1758] 10.222.0.61 () {62 vars in 1364 bytes} [Tue Aug 23 17:57:11 2022] POST /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments => generated 194 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:57:12.027760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c0629d34-15c7-4b4e-9191-8b75b9bf6e04 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:12.032914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c0629d34-15c7-4b4e-9191-8b75b9bf6e04 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:12.053323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:12.061911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0629d34-15c7-4b4e-9191-8b75b9bf6e04 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:12.063279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0629d34-15c7-4b4e-9191-8b75b9bf6e04 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:12.063735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0629d34-15c7-4b4e-9191-8b75b9bf6e04 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:12.064482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0629d34-15c7-4b4e-9191-8b75b9bf6e04 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:12.079451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0629d34-15c7-4b4e-9191-8b75b9bf6e04 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:12.079451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0629d34-15c7-4b4e-9191-8b75b9bf6e04 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:12.179493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-351f5b59-6c05-42a8-a358-f0a9101584cc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:12.190901 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-351f5b59-6c05-42a8-a358-f0a9101584cc tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1313 microversion: 2.1 time: 0.703573 Aug 23 17:57:12.191842 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 916/1759] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:11 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1313 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:12.198022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-12cf410e-6218-43de-90f7-1ae79100789f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:12.209012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-12cf410e-6218-43de-90f7-1ae79100789f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:12.224718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12cf410e-6218-43de-90f7-1ae79100789f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:12.225468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12cf410e-6218-43de-90f7-1ae79100789f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:12.226186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12cf410e-6218-43de-90f7-1ae79100789f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:12.227136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12cf410e-6218-43de-90f7-1ae79100789f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:12.227846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12cf410e-6218-43de-90f7-1ae79100789f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:12.236254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12cf410e-6218-43de-90f7-1ae79100789f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:12.602916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c0629d34-15c7-4b4e-9191-8b75b9bf6e04 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:12.625644 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c0629d34-15c7-4b4e-9191-8b75b9bf6e04 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.617655 Aug 23 17:57:12.625644 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 844/1760] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:11 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:12.634871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-846c58a8-0cab-4e92-a387-f24bb5d4dcdb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:12.642519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-12cf410e-6218-43de-90f7-1ae79100789f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:12.644165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-846c58a8-0cab-4e92-a387-f24bb5d4dcdb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:12.656111 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-12cf410e-6218-43de-90f7-1ae79100789f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1324 microversion: 2.1 time: 0.462405 Aug 23 17:57:12.666563 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 917/1761] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:12 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1324 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:12.666773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-846c58a8-0cab-4e92-a387-f24bb5d4dcdb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:12.666773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-846c58a8-0cab-4e92-a387-f24bb5d4dcdb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:12.666773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-846c58a8-0cab-4e92-a387-f24bb5d4dcdb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:12.666773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-846c58a8-0cab-4e92-a387-f24bb5d4dcdb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:12.666773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-846c58a8-0cab-4e92-a387-f24bb5d4dcdb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:12.666773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-846c58a8-0cab-4e92-a387-f24bb5d4dcdb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:13.055881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-846c58a8-0cab-4e92-a387-f24bb5d4dcdb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:13.064795 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-846c58a8-0cab-4e92-a387-f24bb5d4dcdb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.439623 Aug 23 17:57:13.068307 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 845/1762] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:12 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:13.231083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b83e51e5-7499-4497-8231-841a1a0451fa tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:13.231803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b83e51e5-7499-4497-8231-841a1a0451fa tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:13.265071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b83e51e5-7499-4497-8231-841a1a0451fa tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:13.265580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b83e51e5-7499-4497-8231-841a1a0451fa tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:13.266033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b83e51e5-7499-4497-8231-841a1a0451fa tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:13.266808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b83e51e5-7499-4497-8231-841a1a0451fa tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:13.271785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b83e51e5-7499-4497-8231-841a1a0451fa tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:13.276882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b83e51e5-7499-4497-8231-841a1a0451fa tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:13.649967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bde29bf3-1022-404a-992a-5c4cf3ed07a5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:13.650634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bde29bf3-1022-404a-992a-5c4cf3ed07a5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:13.659736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b83e51e5-7499-4497-8231-841a1a0451fa tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:13.665077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bde29bf3-1022-404a-992a-5c4cf3ed07a5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:13.665601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bde29bf3-1022-404a-992a-5c4cf3ed07a5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:13.666080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bde29bf3-1022-404a-992a-5c4cf3ed07a5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:13.667398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bde29bf3-1022-404a-992a-5c4cf3ed07a5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:13.669838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bde29bf3-1022-404a-992a-5c4cf3ed07a5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:13.670464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bde29bf3-1022-404a-992a-5c4cf3ed07a5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:13.690591 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b83e51e5-7499-4497-8231-841a1a0451fa tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1313 microversion: 2.1 time: 0.479634 Aug 23 17:57:13.691213 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 918/1763] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:13 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1313 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:13.709062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1e65746-4ea4-4d1f-a1ae-0c2e93d51b7a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:13.710109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d1e65746-4ea4-4d1f-a1ae-0c2e93d51b7a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:13.728215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e65746-4ea4-4d1f-a1ae-0c2e93d51b7a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:13.731713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e65746-4ea4-4d1f-a1ae-0c2e93d51b7a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:13.732811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e65746-4ea4-4d1f-a1ae-0c2e93d51b7a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:13.738676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e65746-4ea4-4d1f-a1ae-0c2e93d51b7a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:13.739481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e65746-4ea4-4d1f-a1ae-0c2e93d51b7a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:13.740212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e65746-4ea4-4d1f-a1ae-0c2e93d51b7a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:13.888625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:13.975362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bde29bf3-1022-404a-992a-5c4cf3ed07a5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:13.997986 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bde29bf3-1022-404a-992a-5c4cf3ed07a5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.351270 Aug 23 17:57:14.002392 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 846/1764] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:13 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:14.017284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4efc8eba-f7cf-4367-a08e-73b132b7ef71 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:14.019522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4efc8eba-f7cf-4367-a08e-73b132b7ef71 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:14.040094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4efc8eba-f7cf-4367-a08e-73b132b7ef71 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:14.041087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4efc8eba-f7cf-4367-a08e-73b132b7ef71 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:14.043135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4efc8eba-f7cf-4367-a08e-73b132b7ef71 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:14.044015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4efc8eba-f7cf-4367-a08e-73b132b7ef71 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:14.044484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4efc8eba-f7cf-4367-a08e-73b132b7ef71 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:14.047501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4efc8eba-f7cf-4367-a08e-73b132b7ef71 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:14.048640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d1e65746-4ea4-4d1f-a1ae-0c2e93d51b7a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:14.058722 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d1e65746-4ea4-4d1f-a1ae-0c2e93d51b7a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1324 microversion: 2.1 time: 0.363792 Aug 23 17:57:14.060599 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 919/1765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:13 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1324 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:14.087215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dc83751d-1c08-4d25-99e5-2de31a25ce74 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:14.091411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4efc8eba-f7cf-4367-a08e-73b132b7ef71 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:57:14.099918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dc83751d-1c08-4d25-99e5-2de31a25ce74 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:14.114636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc83751d-1c08-4d25-99e5-2de31a25ce74 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:14.116063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc83751d-1c08-4d25-99e5-2de31a25ce74 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:14.116824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc83751d-1c08-4d25-99e5-2de31a25ce74 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:14.118035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc83751d-1c08-4d25-99e5-2de31a25ce74 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:14.118755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc83751d-1c08-4d25-99e5-2de31a25ce74 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:14.119539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc83751d-1c08-4d25-99e5-2de31a25ce74 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:14.311297 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4efc8eba-f7cf-4367-a08e-73b132b7ef71 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "DELETE /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 204 len: 0 microversion: 2.1 time: 0.305418 Aug 23 17:57:14.311693 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 847/1766] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:57:14 2022] DELETE /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:57:14.320033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-210f76fe-2edb-4ecc-956d-6526fee6e0f5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:14.320833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-210f76fe-2edb-4ecc-956d-6526fee6e0f5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:14.336632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-210f76fe-2edb-4ecc-956d-6526fee6e0f5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:14.337591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-210f76fe-2edb-4ecc-956d-6526fee6e0f5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:14.338282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-210f76fe-2edb-4ecc-956d-6526fee6e0f5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:14.339380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-210f76fe-2edb-4ecc-956d-6526fee6e0f5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:14.343149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-210f76fe-2edb-4ecc-956d-6526fee6e0f5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:14.344020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-210f76fe-2edb-4ecc-956d-6526fee6e0f5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:14.456245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dc83751d-1c08-4d25-99e5-2de31a25ce74 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:14.465751 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dc83751d-1c08-4d25-99e5-2de31a25ce74 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.384114 Aug 23 17:57:14.471101 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 920/1767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:14 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:14.657071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-210f76fe-2edb-4ecc-956d-6526fee6e0f5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:14.667105 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-210f76fe-2edb-4ecc-956d-6526fee6e0f5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1682 microversion: 2.1 time: 0.350929 Aug 23 17:57:14.672511 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 848/1768] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:14 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1682 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:57:14.718477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d83a354-3a56-4559-9509-91afa1c0741b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:14.719140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d83a354-3a56-4559-9509-91afa1c0741b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:14.727762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d83a354-3a56-4559-9509-91afa1c0741b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:14.728802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d83a354-3a56-4559-9509-91afa1c0741b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:14.729498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d83a354-3a56-4559-9509-91afa1c0741b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:14.730605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d83a354-3a56-4559-9509-91afa1c0741b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:14.731382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d83a354-3a56-4559-9509-91afa1c0741b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:14.732059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d83a354-3a56-4559-9509-91afa1c0741b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:14.988821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4d83a354-3a56-4559-9509-91afa1c0741b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:15.006581 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d83a354-3a56-4559-9509-91afa1c0741b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1313 microversion: 2.1 time: 0.295265 Aug 23 17:57:15.010054 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 921/1769] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:14 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1313 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:15.023297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-69855de3-1abd-4c4c-a75b-c78c9e98df61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:15.024653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-69855de3-1abd-4c4c-a75b-c78c9e98df61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:15.033765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69855de3-1abd-4c4c-a75b-c78c9e98df61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:15.034492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69855de3-1abd-4c4c-a75b-c78c9e98df61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:15.035196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69855de3-1abd-4c4c-a75b-c78c9e98df61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:15.036140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69855de3-1abd-4c4c-a75b-c78c9e98df61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:15.036942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69855de3-1abd-4c4c-a75b-c78c9e98df61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:15.038058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69855de3-1abd-4c4c-a75b-c78c9e98df61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:15.081892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d047d4f-4edc-4f6d-9b8a-55a4b200298e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:15.083713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d047d4f-4edc-4f6d-9b8a-55a4b200298e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:15.094147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d047d4f-4edc-4f6d-9b8a-55a4b200298e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:15.095500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d047d4f-4edc-4f6d-9b8a-55a4b200298e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:15.096179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d047d4f-4edc-4f6d-9b8a-55a4b200298e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:15.097617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d047d4f-4edc-4f6d-9b8a-55a4b200298e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:15.098470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d047d4f-4edc-4f6d-9b8a-55a4b200298e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:15.099272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d047d4f-4edc-4f6d-9b8a-55a4b200298e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:15.269372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-69855de3-1abd-4c4c-a75b-c78c9e98df61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:15.282002 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-69855de3-1abd-4c4c-a75b-c78c9e98df61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.262577 Aug 23 17:57:15.295833 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 849/1770] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:15 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:15.400973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5d047d4f-4edc-4f6d-9b8a-55a4b200298e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:15.412995 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d047d4f-4edc-4f6d-9b8a-55a4b200298e tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1324 microversion: 2.1 time: 0.333508 Aug 23 17:57:15.413979 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 922/1771] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:15 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1324 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:15.497818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5555d728-7b3c-484f-9ed1-61db5214dbe8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:15.498676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5555d728-7b3c-484f-9ed1-61db5214dbe8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:15.508169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5555d728-7b3c-484f-9ed1-61db5214dbe8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:15.508898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5555d728-7b3c-484f-9ed1-61db5214dbe8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:15.509449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5555d728-7b3c-484f-9ed1-61db5214dbe8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:15.510657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5555d728-7b3c-484f-9ed1-61db5214dbe8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:15.511881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5555d728-7b3c-484f-9ed1-61db5214dbe8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:15.512655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5555d728-7b3c-484f-9ed1-61db5214dbe8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:15.698707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2647db8b-5d42-4467-a9b3-5c69dbd2f76d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:15.699592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2647db8b-5d42-4467-a9b3-5c69dbd2f76d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:15.710565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2647db8b-5d42-4467-a9b3-5c69dbd2f76d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:15.712511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2647db8b-5d42-4467-a9b3-5c69dbd2f76d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:15.717954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2647db8b-5d42-4467-a9b3-5c69dbd2f76d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:15.720068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2647db8b-5d42-4467-a9b3-5c69dbd2f76d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:15.721596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2647db8b-5d42-4467-a9b3-5c69dbd2f76d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:15.724831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2647db8b-5d42-4467-a9b3-5c69dbd2f76d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:15.993248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2647db8b-5d42-4467-a9b3-5c69dbd2f76d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:16.001521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:16.004030 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2647db8b-5d42-4467-a9b3-5c69dbd2f76d tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1682 microversion: 2.1 time: 0.311132 Aug 23 17:57:16.007543 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 923/1772] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:15 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1682 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:16.036432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-069f1c88-556b-4d9a-9316-044b35d9cc62 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:16.037026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-069f1c88-556b-4d9a-9316-044b35d9cc62 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:16.066733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-069f1c88-556b-4d9a-9316-044b35d9cc62 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:16.067371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-069f1c88-556b-4d9a-9316-044b35d9cc62 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:16.067939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-069f1c88-556b-4d9a-9316-044b35d9cc62 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:16.069714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-069f1c88-556b-4d9a-9316-044b35d9cc62 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:16.071601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-069f1c88-556b-4d9a-9316-044b35d9cc62 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:16.074286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-069f1c88-556b-4d9a-9316-044b35d9cc62 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:16.314702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-069f1c88-556b-4d9a-9316-044b35d9cc62 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:16.345461 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-069f1c88-556b-4d9a-9316-044b35d9cc62 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1313 microversion: 2.1 time: 0.312243 Aug 23 17:57:16.349151 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 924/1773] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:16 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:57:16.365946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b666ec50-18d6-4406-80c9-be521c4be0a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:16.368132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b666ec50-18d6-4406-80c9-be521c4be0a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:16.384488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b666ec50-18d6-4406-80c9-be521c4be0a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:16.387356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b666ec50-18d6-4406-80c9-be521c4be0a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:16.388043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b666ec50-18d6-4406-80c9-be521c4be0a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:16.388975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b666ec50-18d6-4406-80c9-be521c4be0a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:16.391061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b666ec50-18d6-4406-80c9-be521c4be0a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:16.393373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b666ec50-18d6-4406-80c9-be521c4be0a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:16.637661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5555d728-7b3c-484f-9ed1-61db5214dbe8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:16.668583 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5555d728-7b3c-484f-9ed1-61db5214dbe8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 1.175215 Aug 23 17:57:16.673364 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 850/1774] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:15 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:16.692860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c3ac2a8c-36eb-4ac8-ab50-17b978ce6699 req-0f3c4ba1-c84e-4291-9a3f-055653341a0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a4ebc8-3d93-4377-beec-accf25eee386", "name": "network-vif-plugged", "status": "completed", "tag": "67689804-86f0-4754-bb53-ddbce34de8e9"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:16.710895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c3ac2a8c-36eb-4ac8-ab50-17b978ce6699 req-0f3c4ba1-c84e-4291-9a3f-055653341a0f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:16.712275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c3ac2a8c-36eb-4ac8-ab50-17b978ce6699 req-0f3c4ba1-c84e-4291-9a3f-055653341a0f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:16.713407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c3ac2a8c-36eb-4ac8-ab50-17b978ce6699 req-0f3c4ba1-c84e-4291-9a3f-055653341a0f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:16.745444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b666ec50-18d6-4406-80c9-be521c4be0a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:16.748937 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c3ac2a8c-36eb-4ac8-ab50-17b978ce6699 req-0f3c4ba1-c84e-4291-9a3f-055653341a0f service nova] Creating event network-vif-plugged:67689804-86f0-4754-bb53-ddbce34de8e9 for instance 13a4ebc8-3d93-4377-beec-accf25eee386 on n-h1-850468-16 Aug 23 17:57:16.758685 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c3ac2a8c-36eb-4ac8-ab50-17b978ce6699 req-0f3c4ba1-c84e-4291-9a3f-055653341a0f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083697 Aug 23 17:57:16.760080 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 851/1775] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:16.767826 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b666ec50-18d6-4406-80c9-be521c4be0a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.416020 Aug 23 17:57:16.768673 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 925/1776] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:16 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:16.771534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9bbc7d49-a6c3-4a48-98dd-2ad6027fd86f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:16.772189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9bbc7d49-a6c3-4a48-98dd-2ad6027fd86f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:16.782131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bbc7d49-a6c3-4a48-98dd-2ad6027fd86f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:16.784347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bbc7d49-a6c3-4a48-98dd-2ad6027fd86f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:16.785215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bbc7d49-a6c3-4a48-98dd-2ad6027fd86f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:16.786714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bbc7d49-a6c3-4a48-98dd-2ad6027fd86f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:16.787931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bbc7d49-a6c3-4a48-98dd-2ad6027fd86f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:16.788645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bbc7d49-a6c3-4a48-98dd-2ad6027fd86f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:17.011875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9bbc7d49-a6c3-4a48-98dd-2ad6027fd86f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:17.033837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-369cf9af-5cb5-4539-9f5a-65b35dca05f3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:17.034781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-369cf9af-5cb5-4539-9f5a-65b35dca05f3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:17.047944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-369cf9af-5cb5-4539-9f5a-65b35dca05f3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:17.048671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-369cf9af-5cb5-4539-9f5a-65b35dca05f3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:17.049129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-369cf9af-5cb5-4539-9f5a-65b35dca05f3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:17.049976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-369cf9af-5cb5-4539-9f5a-65b35dca05f3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:17.050108 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9bbc7d49-a6c3-4a48-98dd-2ad6027fd86f tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1324 microversion: 2.1 time: 0.287286 Aug 23 17:57:17.050561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-369cf9af-5cb5-4539-9f5a-65b35dca05f3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:17.051033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-369cf9af-5cb5-4539-9f5a-65b35dca05f3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:17.069039 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 852/1777] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:16 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1324 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:17.372665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7042959-3a2f-43d2-8251-bd4803f9cc6c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:17.373479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d7042959-3a2f-43d2-8251-bd4803f9cc6c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:17.380131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7042959-3a2f-43d2-8251-bd4803f9cc6c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:17.380985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7042959-3a2f-43d2-8251-bd4803f9cc6c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:17.381671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7042959-3a2f-43d2-8251-bd4803f9cc6c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:17.382789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7042959-3a2f-43d2-8251-bd4803f9cc6c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:17.383533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7042959-3a2f-43d2-8251-bd4803f9cc6c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:17.384201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7042959-3a2f-43d2-8251-bd4803f9cc6c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:17.577890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7042959-3a2f-43d2-8251-bd4803f9cc6c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:17.589967 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7042959-3a2f-43d2-8251-bd4803f9cc6c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1313 microversion: 2.1 time: 0.221115 Aug 23 17:57:17.591150 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 853/1778] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:17 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:57:17.668946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-369cf9af-5cb5-4539-9f5a-65b35dca05f3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:17.680841 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-369cf9af-5cb5-4539-9f5a-65b35dca05f3 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1682 microversion: 2.1 time: 0.651468 Aug 23 17:57:17.681771 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 926/1779] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:17 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1682 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:57:17.705645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e8ad8f2e-e4f3-41e3-b9a9-d305b5dc968b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:17.707109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e8ad8f2e-e4f3-41e3-b9a9-d305b5dc968b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:17.714142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8ad8f2e-e4f3-41e3-b9a9-d305b5dc968b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:17.714973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8ad8f2e-e4f3-41e3-b9a9-d305b5dc968b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:17.715980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8ad8f2e-e4f3-41e3-b9a9-d305b5dc968b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:17.716923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8ad8f2e-e4f3-41e3-b9a9-d305b5dc968b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:17.717562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8ad8f2e-e4f3-41e3-b9a9-d305b5dc968b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:17.718459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8ad8f2e-e4f3-41e3-b9a9-d305b5dc968b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:17.722327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:17.797477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5715825b-4621-4326-90e4-2d338dbe5901 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:17.798761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5715825b-4621-4326-90e4-2d338dbe5901 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:17.805383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5715825b-4621-4326-90e4-2d338dbe5901 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:17.805795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5715825b-4621-4326-90e4-2d338dbe5901 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:17.806429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5715825b-4621-4326-90e4-2d338dbe5901 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:17.807884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5715825b-4621-4326-90e4-2d338dbe5901 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:17.808433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5715825b-4621-4326-90e4-2d338dbe5901 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:17.808969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5715825b-4621-4326-90e4-2d338dbe5901 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:17.974159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8ad8f2e-e4f3-41e3-b9a9-d305b5dc968b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:17.982343 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e8ad8f2e-e4f3-41e3-b9a9-d305b5dc968b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.281772 Aug 23 17:57:17.987252 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 854/1780] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:17 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:17.994458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5715825b-4621-4326-90e4-2d338dbe5901 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:18.008292 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5715825b-4621-4326-90e4-2d338dbe5901 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.214818 Aug 23 17:57:18.012167 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 927/1781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:17 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:18.077154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ee3999d4-4098-4851-92a8-d6608c3e3133 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:18.077783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ee3999d4-4098-4851-92a8-d6608c3e3133 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:18.087971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee3999d4-4098-4851-92a8-d6608c3e3133 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:18.092213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee3999d4-4098-4851-92a8-d6608c3e3133 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:18.093173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee3999d4-4098-4851-92a8-d6608c3e3133 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:18.093902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee3999d4-4098-4851-92a8-d6608c3e3133 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:18.094364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee3999d4-4098-4851-92a8-d6608c3e3133 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:18.096510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee3999d4-4098-4851-92a8-d6608c3e3133 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:18.285275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:18.305327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ee3999d4-4098-4851-92a8-d6608c3e3133 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:18.328782 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ee3999d4-4098-4851-92a8-d6608c3e3133 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1324 microversion: 2.1 time: 0.255227 Aug 23 17:57:18.330578 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 855/1782] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:18 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1324 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:18.622904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a959d4e0-0c8e-42a6-b53b-87565c77d682 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:18.625333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a959d4e0-0c8e-42a6-b53b-87565c77d682 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:18.634814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:18.660457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a959d4e0-0c8e-42a6-b53b-87565c77d682 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:18.661286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a959d4e0-0c8e-42a6-b53b-87565c77d682 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:18.662073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a959d4e0-0c8e-42a6-b53b-87565c77d682 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:18.662840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a959d4e0-0c8e-42a6-b53b-87565c77d682 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:18.664277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a959d4e0-0c8e-42a6-b53b-87565c77d682 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:18.664917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a959d4e0-0c8e-42a6-b53b-87565c77d682 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:18.705010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-99ba4fd2-c26d-441b-980c-5bcc826f259e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:18.705632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-99ba4fd2-c26d-441b-980c-5bcc826f259e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:18.736072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99ba4fd2-c26d-441b-980c-5bcc826f259e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:18.736639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99ba4fd2-c26d-441b-980c-5bcc826f259e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:18.742887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99ba4fd2-c26d-441b-980c-5bcc826f259e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:18.743690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99ba4fd2-c26d-441b-980c-5bcc826f259e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:18.744166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99ba4fd2-c26d-441b-980c-5bcc826f259e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:18.746796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99ba4fd2-c26d-441b-980c-5bcc826f259e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:19.034235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-99ba4fd2-c26d-441b-980c-5bcc826f259e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:19.045417 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-99ba4fd2-c26d-441b-980c-5bcc826f259e tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1682 microversion: 2.1 time: 0.345913 Aug 23 17:57:19.046399 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 856/1783] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:18 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1682 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:19.067463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a959d4e0-0c8e-42a6-b53b-87565c77d682 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:19.077967 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a959d4e0-0c8e-42a6-b53b-87565c77d682 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1313 microversion: 2.1 time: 0.464343 Aug 23 17:57:19.079151 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 928/1784] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:18 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1313 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:19.083852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf9c06bd-f16e-42f3-aa80-3034a3f5e429 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:19.084706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bf9c06bd-f16e-42f3-aa80-3034a3f5e429 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:19.091677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf9c06bd-f16e-42f3-aa80-3034a3f5e429 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:19.092420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf9c06bd-f16e-42f3-aa80-3034a3f5e429 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:19.093029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf9c06bd-f16e-42f3-aa80-3034a3f5e429 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:19.093931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf9c06bd-f16e-42f3-aa80-3034a3f5e429 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:19.094589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf9c06bd-f16e-42f3-aa80-3034a3f5e429 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:19.095189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf9c06bd-f16e-42f3-aa80-3034a3f5e429 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:19.317341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bf9c06bd-f16e-42f3-aa80-3034a3f5e429 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:19.326707 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bf9c06bd-f16e-42f3-aa80-3034a3f5e429 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.246323 Aug 23 17:57:19.343554 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 929/1785] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:19 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:19.357254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f7e4fae2-18cd-4973-9c64-b131e8638e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:19.362109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f7e4fae2-18cd-4973-9c64-b131e8638e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:19.384978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7e4fae2-18cd-4973-9c64-b131e8638e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:19.386068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7e4fae2-18cd-4973-9c64-b131e8638e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:19.392121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7e4fae2-18cd-4973-9c64-b131e8638e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:19.394220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7e4fae2-18cd-4973-9c64-b131e8638e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:19.394734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7e4fae2-18cd-4973-9c64-b131e8638e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:19.395174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7e4fae2-18cd-4973-9c64-b131e8638e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:19.523644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1511204069", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "bd798d5d-0e1e-44ad-b78a-f2240a705fd3"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:19.656301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] validate_networks() for [('bd798d5d-0e1e-44ad-b78a-f2240a705fd3', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:57:19.976570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f7e4fae2-18cd-4973-9c64-b131e8638e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:19.990560 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f7e4fae2-18cd-4973-9c64-b131e8638e24 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.645556 Aug 23 17:57:19.991079 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 930/1786] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:19 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:20.009006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-54a9543b-86b3-4265-b98e-8f4b5aad6acf tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:20.009628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-54a9543b-86b3-4265-b98e-8f4b5aad6acf tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:20.025433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54a9543b-86b3-4265-b98e-8f4b5aad6acf tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:20.027428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54a9543b-86b3-4265-b98e-8f4b5aad6acf tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:20.028060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54a9543b-86b3-4265-b98e-8f4b5aad6acf tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:20.029055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54a9543b-86b3-4265-b98e-8f4b5aad6acf tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:20.030001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54a9543b-86b3-4265-b98e-8f4b5aad6acf tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:20.030930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54a9543b-86b3-4265-b98e-8f4b5aad6acf tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:20.369283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-54a9543b-86b3-4265-b98e-8f4b5aad6acf tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:20.382568 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-54a9543b-86b3-4265-b98e-8f4b5aad6acf tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1324 microversion: 2.1 time: 0.387959 Aug 23 17:57:20.383452 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 931/1787] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:19 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1324 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:20.406526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b31d99ea-f594-4175-9872-18928bd279f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:20.415383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b31d99ea-f594-4175-9872-18928bd279f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:20.426167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b31d99ea-f594-4175-9872-18928bd279f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:20.427984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b31d99ea-f594-4175-9872-18928bd279f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:20.430678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b31d99ea-f594-4175-9872-18928bd279f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:20.431749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b31d99ea-f594-4175-9872-18928bd279f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:20.433084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b31d99ea-f594-4175-9872-18928bd279f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:20.434142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b31d99ea-f594-4175-9872-18928bd279f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:20.496592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:57:20.497125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:57:20.497727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:57:20.498513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:57:20.499913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:57:20.525426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:20.527771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:20.528428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:20.529587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:20.530233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:20.530703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:20.565376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Getting quotas for project e92d43e5375a4245ae1e539f3ecdffdf. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:57:20.569558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b31d99ea-f594-4175-9872-18928bd279f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:20.572580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Getting quotas for user 08aeadb95c7847f3b3f0633d702a5b1f and project e92d43e5375a4245ae1e539f3ecdffdf. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:57:20.584423 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b31d99ea-f594-4175-9872-18928bd279f7 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1615 microversion: 2.1 time: 0.186437 Aug 23 17:57:20.585320 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 932/1788] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:20 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1615 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:20.602933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6664f19b-7c14-47ef-9336-cbc5a7cf76ba tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:20.603865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6664f19b-7c14-47ef-9336-cbc5a7cf76ba tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:20.606481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:57:20.609624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:57:20.622633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6664f19b-7c14-47ef-9336-cbc5a7cf76ba tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:20.626277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6664f19b-7c14-47ef-9336-cbc5a7cf76ba tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:20.626917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6664f19b-7c14-47ef-9336-cbc5a7cf76ba tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:20.634178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6664f19b-7c14-47ef-9336-cbc5a7cf76ba tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:20.635073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6664f19b-7c14-47ef-9336-cbc5a7cf76ba tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:20.636128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6664f19b-7c14-47ef-9336-cbc5a7cf76ba tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:20.711709 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d46a2d05-88d7-4f6d-baa9-a9a19bcf3876 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.663945 Aug 23 17:57:20.712547 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 857/1789] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:57:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:57:20.732521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-24c6519d-6c76-491e-8388-53f96eba86e7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:20.733114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-24c6519d-6c76-491e-8388-53f96eba86e7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:20.763381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24c6519d-6c76-491e-8388-53f96eba86e7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:20.763876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24c6519d-6c76-491e-8388-53f96eba86e7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:20.764320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24c6519d-6c76-491e-8388-53f96eba86e7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:20.765040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24c6519d-6c76-491e-8388-53f96eba86e7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:20.766127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24c6519d-6c76-491e-8388-53f96eba86e7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:20.766591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24c6519d-6c76-491e-8388-53f96eba86e7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:21.153288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6664f19b-7c14-47ef-9336-cbc5a7cf76ba tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:21.164288 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6664f19b-7c14-47ef-9336-cbc5a7cf76ba tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1313 microversion: 2.1 time: 0.576401 Aug 23 17:57:21.165521 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 933/1790] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:20 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1313 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:21.176887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-dde3ae06-1974-4a41-9a4c-4747403c58c9 req-2f265036-4aab-4616-97f7-b8faef58f19f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b3cf3a-784f-48f6-9ee3-1e98f527d4aa", "name": "network-vif-unplugged", "status": "completed", "tag": "e7e8c36a-a65f-4586-97ce-22fec636459f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:21.198612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dde3ae06-1974-4a41-9a4c-4747403c58c9 req-2f265036-4aab-4616-97f7-b8faef58f19f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:21.199732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dde3ae06-1974-4a41-9a4c-4747403c58c9 req-2f265036-4aab-4616-97f7-b8faef58f19f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:21.200430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dde3ae06-1974-4a41-9a4c-4747403c58c9 req-2f265036-4aab-4616-97f7-b8faef58f19f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:21.228537 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-dde3ae06-1974-4a41-9a4c-4747403c58c9 req-2f265036-4aab-4616-97f7-b8faef58f19f service nova] Creating event network-vif-unplugged:e7e8c36a-a65f-4586-97ce-22fec636459f for instance 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa on n-h2-850468-16 Aug 23 17:57:21.235551 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-dde3ae06-1974-4a41-9a4c-4747403c58c9 req-2f265036-4aab-4616-97f7-b8faef58f19f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068493 Aug 23 17:57:21.239711 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 934/1791] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:21.254531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1955711250", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "bd798d5d-0e1e-44ad-b78a-f2240a705fd3"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:21.259315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-24c6519d-6c76-491e-8388-53f96eba86e7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:21.275509 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-24c6519d-6c76-491e-8388-53f96eba86e7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.560530 Aug 23 17:57:21.277881 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 858/1792] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:20 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:21.287590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-66e25885-5407-405d-9877-a51f9b755770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:21.288738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-66e25885-5407-405d-9877-a51f9b755770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:21.298449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66e25885-5407-405d-9877-a51f9b755770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:21.310389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66e25885-5407-405d-9877-a51f9b755770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:21.311537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66e25885-5407-405d-9877-a51f9b755770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:21.313065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66e25885-5407-405d-9877-a51f9b755770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:21.314197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66e25885-5407-405d-9877-a51f9b755770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:21.314980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66e25885-5407-405d-9877-a51f9b755770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:21.394055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] validate_networks() for [('bd798d5d-0e1e-44ad-b78a-f2240a705fd3', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:57:21.619195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-66e25885-5407-405d-9877-a51f9b755770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:21.639383 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-66e25885-5407-405d-9877-a51f9b755770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.359829 Aug 23 17:57:21.640384 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 859/1793] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:21 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:21.650606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-59f98fb0-3d2d-4f02-a6e8-edb2fc3a6184 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:21.652114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-59f98fb0-3d2d-4f02-a6e8-edb2fc3a6184 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:21.659285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59f98fb0-3d2d-4f02-a6e8-edb2fc3a6184 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:21.659879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59f98fb0-3d2d-4f02-a6e8-edb2fc3a6184 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:21.660385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59f98fb0-3d2d-4f02-a6e8-edb2fc3a6184 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:21.661350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59f98fb0-3d2d-4f02-a6e8-edb2fc3a6184 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:21.662018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59f98fb0-3d2d-4f02-a6e8-edb2fc3a6184 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:21.662516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59f98fb0-3d2d-4f02-a6e8-edb2fc3a6184 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:21.852353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-59f98fb0-3d2d-4f02-a6e8-edb2fc3a6184 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:21.866139 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-59f98fb0-3d2d-4f02-a6e8-edb2fc3a6184 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1324 microversion: 2.1 time: 0.224524 Aug 23 17:57:21.867602 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 860/1794] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:21 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1324 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:21.874040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-45a3aaf8-26c8-42f9-aa25-8b865f9cafa5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:21.875042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-45a3aaf8-26c8-42f9-aa25-8b865f9cafa5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:21.882860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a3aaf8-26c8-42f9-aa25-8b865f9cafa5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:21.883763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a3aaf8-26c8-42f9-aa25-8b865f9cafa5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:21.884357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a3aaf8-26c8-42f9-aa25-8b865f9cafa5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:21.885267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a3aaf8-26c8-42f9-aa25-8b865f9cafa5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:21.886709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a3aaf8-26c8-42f9-aa25-8b865f9cafa5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:21.888448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a3aaf8-26c8-42f9-aa25-8b865f9cafa5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:22.006893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45a3aaf8-26c8-42f9-aa25-8b865f9cafa5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd4e792ec8c584ba489b976f62f409d94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd60b8676313b4607b015755341be1331', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:22.016102 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-45a3aaf8-26c8-42f9-aa25-8b865f9cafa5 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 200 len: 1615 microversion: 2.1 time: 0.146912 Aug 23 17:57:22.016683 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 861/1795] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:21 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 1615 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:22.191495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b5f22fc8-8246-4336-b876-1d9ff5ef26ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:22.192120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b5f22fc8-8246-4336-b876-1d9ff5ef26ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:22.204403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5f22fc8-8246-4336-b876-1d9ff5ef26ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:22.204986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5f22fc8-8246-4336-b876-1d9ff5ef26ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:22.205350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5f22fc8-8246-4336-b876-1d9ff5ef26ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:22.206075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5f22fc8-8246-4336-b876-1d9ff5ef26ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:22.206562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5f22fc8-8246-4336-b876-1d9ff5ef26ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:22.206999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5f22fc8-8246-4336-b876-1d9ff5ef26ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:22.535936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b5f22fc8-8246-4336-b876-1d9ff5ef26ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:22.549111 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b5f22fc8-8246-4336-b876-1d9ff5ef26ac tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1462 microversion: 2.1 time: 0.361546 Aug 23 17:57:22.578727 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 862/1796] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:22 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1462 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:57:22.588135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-60b7b087-cbe8-496b-87c0-cf1f8c1005d7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:22.592022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-60b7b087-cbe8-496b-87c0-cf1f8c1005d7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:22.600783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60b7b087-cbe8-496b-87c0-cf1f8c1005d7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:22.601280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60b7b087-cbe8-496b-87c0-cf1f8c1005d7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:22.601714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60b7b087-cbe8-496b-87c0-cf1f8c1005d7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:22.602898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60b7b087-cbe8-496b-87c0-cf1f8c1005d7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:22.622031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60b7b087-cbe8-496b-87c0-cf1f8c1005d7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:22.622726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60b7b087-cbe8-496b-87c0-cf1f8c1005d7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:22.787025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:57:22.787581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:57:22.787843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:57:22.788259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:57:22.788680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:57:22.794958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-60b7b087-cbe8-496b-87c0-cf1f8c1005d7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:22.806599 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-60b7b087-cbe8-496b-87c0-cf1f8c1005d7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.226611 Aug 23 17:57:22.808148 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 863/1797] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:22 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:22.808814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:22.809338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:22.810937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:22.811749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:22.813658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:22.816641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:22.826078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2f30995b-386c-4729-965f-364dc3ce9550 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:22.826914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2f30995b-386c-4729-965f-364dc3ce9550 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:22.833876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f30995b-386c-4729-965f-364dc3ce9550 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:22.834488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f30995b-386c-4729-965f-364dc3ce9550 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:22.835177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f30995b-386c-4729-965f-364dc3ce9550 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:22.835977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f30995b-386c-4729-965f-364dc3ce9550 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:22.836637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f30995b-386c-4729-965f-364dc3ce9550 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:22.837130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f30995b-386c-4729-965f-364dc3ce9550 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:22.859143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Getting quotas for project e92d43e5375a4245ae1e539f3ecdffdf. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:57:22.870487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Getting quotas for user 08aeadb95c7847f3b3f0633d702a5b1f and project e92d43e5375a4245ae1e539f3ecdffdf. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:57:22.906197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:57:22.909426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: f8cfb229-ca34-4883-aa19-33cd91a70dc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:57:23.032960 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5f1bc11c-ac46-49b7-b1ec-490be0e1de79 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.788943 Aug 23 17:57:23.050361 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 935/1798] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:57:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:57:23.061386 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2f30995b-386c-4729-965f-364dc3ce9550 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1615 microversion: 2.1 time: 0.247310 Aug 23 17:57:23.062647 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 864/1799] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:22 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1615 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:23.081675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-45231c5a-bbac-42af-8c46-2d4a7eddf403 req-4e081e61-ff50-4bbb-83f5-a8f808d66524 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0ffe29-2542-4e91-8547-9ef18f242ee5", "name": "network-vif-plugged", "status": "completed", "tag": "d66d999b-a814-47c8-9efe-f2e4faaac265"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:23.083590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-528d79ec-5c87-4fa9-9eea-a29d51c41d38 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:23.084616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-528d79ec-5c87-4fa9-9eea-a29d51c41d38 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:23.099207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-528d79ec-5c87-4fa9-9eea-a29d51c41d38 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:23.100491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-528d79ec-5c87-4fa9-9eea-a29d51c41d38 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:23.101017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-528d79ec-5c87-4fa9-9eea-a29d51c41d38 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:23.102196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-528d79ec-5c87-4fa9-9eea-a29d51c41d38 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:23.103708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-528d79ec-5c87-4fa9-9eea-a29d51c41d38 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:23.107844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-528d79ec-5c87-4fa9-9eea-a29d51c41d38 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:23.175754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-45231c5a-bbac-42af-8c46-2d4a7eddf403 req-4e081e61-ff50-4bbb-83f5-a8f808d66524 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:23.184342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-45231c5a-bbac-42af-8c46-2d4a7eddf403 req-4e081e61-ff50-4bbb-83f5-a8f808d66524 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:23.185967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-45231c5a-bbac-42af-8c46-2d4a7eddf403 req-4e081e61-ff50-4bbb-83f5-a8f808d66524 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:23.219436 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-45231c5a-bbac-42af-8c46-2d4a7eddf403 req-4e081e61-ff50-4bbb-83f5-a8f808d66524 service nova] Creating event network-vif-plugged:d66d999b-a814-47c8-9efe-f2e4faaac265 for instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 on n-h1-850468-16 Aug 23 17:57:23.225791 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-45231c5a-bbac-42af-8c46-2d4a7eddf403 req-4e081e61-ff50-4bbb-83f5-a8f808d66524 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160849 Aug 23 17:57:23.226961 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 865/1800] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:23.233486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c571b3d5-bf04-44ee-a1e3-f4015e6d1436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:23.234254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c571b3d5-bf04-44ee-a1e3-f4015e6d1436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:23.242313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c571b3d5-bf04-44ee-a1e3-f4015e6d1436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:23.243075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c571b3d5-bf04-44ee-a1e3-f4015e6d1436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:23.243554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c571b3d5-bf04-44ee-a1e3-f4015e6d1436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:23.244366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c571b3d5-bf04-44ee-a1e3-f4015e6d1436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:23.245269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c571b3d5-bf04-44ee-a1e3-f4015e6d1436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:23.245934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c571b3d5-bf04-44ee-a1e3-f4015e6d1436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:23.353175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-528d79ec-5c87-4fa9-9eea-a29d51c41d38 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:23.371767 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-528d79ec-5c87-4fa9-9eea-a29d51c41d38 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.320182 Aug 23 17:57:23.372359 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 936/1801] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:23 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:23.382202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8a888bc5-6714-4647-80bc-e1ddd953c41f tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:23.382852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8a888bc5-6714-4647-80bc-e1ddd953c41f tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] [instance: 13c4d28d-309a-4458-9d1e-91ac80454833] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:23.407366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a888bc5-6714-4647-80bc-e1ddd953c41f tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:23.409102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a888bc5-6714-4647-80bc-e1ddd953c41f tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:23.409580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a888bc5-6714-4647-80bc-e1ddd953c41f tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:23.411094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a888bc5-6714-4647-80bc-e1ddd953c41f tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:23.411505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a888bc5-6714-4647-80bc-e1ddd953c41f tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:23.411940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a888bc5-6714-4647-80bc-e1ddd953c41f tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:23.445424 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-8a888bc5-6714-4647-80bc-e1ddd953c41f tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] HTTP exception thrown: Instance 13c4d28d-309a-4458-9d1e-91ac80454833 could not be found. Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8a888bc5-6714-4647-80bc-e1ddd953c41f tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Request method failure captured: Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 HTTP/1.1 Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQgFHDrahaagDbY5dAYtF0fxXMx-uXx3QD2QlNSmLRc0g2kaPCUB9j2BaIUydi9pevprtNhounzFow_QLpog5tOFnSVyF8VUwY4MNvBhyo9_vDVVjCrn1IsXrapCeJcDfoa5tjhTIcCaehYOiTEVBMtPgmNFjsunxBoPPWV0Cd1BIM Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d60b8676313b4607b015755341be1331 Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-VolumesAdminNegativeTest-1022868579 Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d60b8676313b4607b015755341be1331"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d60b8676313b4607b015755341be1331"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d60b8676313b4607b015755341be1331"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d60b8676313b4607b015755341be1331"}]}] Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-VolumesAdminNegativeTest-1022868579 Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d60b8676313b4607b015755341be1331 Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1022868579 Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-VolumesAdminNegativeTest-1022868579-project Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: d4e792ec8c584ba489b976f62f409d94 Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-VolumesAdminNegativeTest-1022868579-project Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 13c4d28d-309a-4458-9d1e-91ac80454833 could not be found. Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '13c4d28d-309a-4458-9d1e-91ac80454833'} Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13c4d28d-309a-4458-9d1e-91ac80454833 could not be found. Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13c4d28d-309a-4458-9d1e-91ac80454833 could not be found. Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:23.448297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:23.454150 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:23.454150 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:23.454150 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:23.454150 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:23.454150 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:23.454150 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13c4d28d-309a-4458-9d1e-91ac80454833 could not be found. Aug 23 17:57:23.454150 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:23.454150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8a888bc5-6714-4647-80bc-e1ddd953c41f tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Returning 404 to user: Instance 13c4d28d-309a-4458-9d1e-91ac80454833 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:23.458970 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8a888bc5-6714-4647-80bc-e1ddd953c41f tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833" status: 404 len: 111 microversion: 2.1 time: 0.078241 Aug 23 17:57:23.458970 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 937/1802] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:23 2022] GET /compute/v2.1/servers/13c4d28d-309a-4458-9d1e-91ac80454833 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:57:23.462337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b8401588-cdca-4b63-919d-874881c3d9a4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:23.463352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b8401588-cdca-4b63-919d-874881c3d9a4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:23.471378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8401588-cdca-4b63-919d-874881c3d9a4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:23.472543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8401588-cdca-4b63-919d-874881c3d9a4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:23.473343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8401588-cdca-4b63-919d-874881c3d9a4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:23.474218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8401588-cdca-4b63-919d-874881c3d9a4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:23.475482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8401588-cdca-4b63-919d-874881c3d9a4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:23.475482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8401588-cdca-4b63-919d-874881c3d9a4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:23.632221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b8401588-cdca-4b63-919d-874881c3d9a4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '1cc67f27fe034d19b33cd71de620fe1c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '069daa30186d4d9e859500618adaf444', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:23.633284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b8401588-cdca-4b63-919d-874881c3d9a4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] flavor_id is None. Assuming migration. {{(pid=128807) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 23 17:57:23.634041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b8401588-cdca-4b63-919d-874881c3d9a4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128807) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 17:57:23.801767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c571b3d5-bf04-44ee-a1e3-f4015e6d1436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:23.817901 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c571b3d5-bf04-44ee-a1e3-f4015e6d1436 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1324 microversion: 2.1 time: 0.588611 Aug 23 17:57:23.818525 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 866/1803] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:23 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1324 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:23.834264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-2143154084", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "451", "networks": [{"uuid": "bd798d5d-0e1e-44ad-b78a-f2240a705fd3"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:23.939445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] validate_networks() for [('bd798d5d-0e1e-44ad-b78a-f2240a705fd3', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:57:24.232817 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b8401588-cdca-4b63-919d-874881c3d9a4 tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386/action" status: 202 len: 0 microversion: 2.1 time: 0.774336 Aug 23 17:57:24.237941 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 938/1804] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:57:23 2022] POST /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386/action => generated 0 bytes in 780 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:57:24.248968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-9e8bda24-dd1c-4ef7-93b4-819161ff7937 req-d93ebc2d-827e-40e6-bbf1-0b0729f8084d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13c4d28d-309a-4458-9d1e-91ac80454833", "name": "network-vif-deleted", "tag": "3fb7efac-faa0-444f-bf74-83a2d19ebc05"}, {"name": "network-changed", "server_uuid": "28b3cf3a-784f-48f6-9ee3-1e98f527d4aa", "tag": "e7e8c36a-a65f-4586-97ce-22fec636459f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:24.264989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9e8bda24-dd1c-4ef7-93b4-819161ff7937 req-d93ebc2d-827e-40e6-bbf1-0b0729f8084d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:24.265481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9e8bda24-dd1c-4ef7-93b4-819161ff7937 req-d93ebc2d-827e-40e6-bbf1-0b0729f8084d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:24.266101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9e8bda24-dd1c-4ef7-93b4-819161ff7937 req-d93ebc2d-827e-40e6-bbf1-0b0729f8084d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:24.289622 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-9e8bda24-dd1c-4ef7-93b4-819161ff7937 req-d93ebc2d-827e-40e6-bbf1-0b0729f8084d service nova] Creating event network-vif-deleted:3fb7efac-faa0-444f-bf74-83a2d19ebc05 for instance 13c4d28d-309a-4458-9d1e-91ac80454833 on n-h1-850468-16 Aug 23 17:57:24.290144 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-9e8bda24-dd1c-4ef7-93b4-819161ff7937 req-d93ebc2d-827e-40e6-bbf1-0b0729f8084d service nova] Creating event network-changed:e7e8c36a-a65f-4586-97ce-22fec636459f for instance 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa on n-h2-850468-16 Aug 23 17:57:24.300519 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-9e8bda24-dd1c-4ef7-93b4-819161ff7937 req-d93ebc2d-827e-40e6-bbf1-0b0729f8084d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.060550 Aug 23 17:57:24.301212 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 939/1805] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:24 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:24.307023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c6d90b8-590a-48fc-918c-a1a1a7297283 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] Calling method '.version_select at 0x7f27f1bdd040>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:24.331734 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c6d90b8-590a-48fc-918c-a1a1a7297283 tempest-VolumesAdminNegativeTest-1022868579 tempest-VolumesAdminNegativeTest-1022868579-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062296527" status: 202 len: 0 microversion: 2.1 time: 0.029203 Aug 23 17:57:24.332347 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 940/1806] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 17:57:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1062296527 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:57:24.337544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3f479c17-316d-43d8-a4ce-e1e1912964ea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:24.338676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3f479c17-316d-43d8-a4ce-e1e1912964ea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:24.348900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f479c17-316d-43d8-a4ce-e1e1912964ea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:24.361875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f479c17-316d-43d8-a4ce-e1e1912964ea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:24.362487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f479c17-316d-43d8-a4ce-e1e1912964ea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:24.363391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f479c17-316d-43d8-a4ce-e1e1912964ea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:24.363976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f479c17-316d-43d8-a4ce-e1e1912964ea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:24.365490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f479c17-316d-43d8-a4ce-e1e1912964ea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:24.635267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3f479c17-316d-43d8-a4ce-e1e1912964ea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:24.661198 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3f479c17-316d-43d8-a4ce-e1e1912964ea tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.327777 Aug 23 17:57:24.663429 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 941/1807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:24 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:24.677298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6ab84b70-5d2a-488b-8533-699b8c9359a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:24.679831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6ab84b70-5d2a-488b-8533-699b8c9359a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:24.699597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ab84b70-5d2a-488b-8533-699b8c9359a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:24.700329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ab84b70-5d2a-488b-8533-699b8c9359a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:24.703726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ab84b70-5d2a-488b-8533-699b8c9359a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:24.704737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ab84b70-5d2a-488b-8533-699b8c9359a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:24.707979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ab84b70-5d2a-488b-8533-699b8c9359a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:24.708671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ab84b70-5d2a-488b-8533-699b8c9359a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:24.729518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:25.306776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:57:25.307391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:57:25.308030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:57:25.308799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:57:25.309355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:57:25.336433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:25.340764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:25.341779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:25.347658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:25.350776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:25.352326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:25.434307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Getting quotas for project e92d43e5375a4245ae1e539f3ecdffdf. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:57:25.457968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Getting quotas for user 08aeadb95c7847f3b3f0633d702a5b1f and project e92d43e5375a4245ae1e539f3ecdffdf. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:57:25.485106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:57:25.488517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:57:25.571371 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa3068c2-e51e-4b2d-b3e8-76feca48d0d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.750424 Aug 23 17:57:25.575506 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 867/1808] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:57:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 1756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:57:25.596839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8cd9f09d-3d28-40e6-9173-390729ef0eb1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:25.597500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8cd9f09d-3d28-40e6-9173-390729ef0eb1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:25.634861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd9f09d-3d28-40e6-9173-390729ef0eb1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:25.636489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd9f09d-3d28-40e6-9173-390729ef0eb1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:25.637281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd9f09d-3d28-40e6-9173-390729ef0eb1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:25.639682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd9f09d-3d28-40e6-9173-390729ef0eb1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:25.641008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd9f09d-3d28-40e6-9173-390729ef0eb1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:25.642161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd9f09d-3d28-40e6-9173-390729ef0eb1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:25.888612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6ab84b70-5d2a-488b-8533-699b8c9359a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:25.902687 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6ab84b70-5d2a-488b-8533-699b8c9359a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1471 microversion: 2.1 time: 1.234290 Aug 23 17:57:25.903434 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 942/1809] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:24 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1471 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:25.943635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-169c5a08-fc04-4b93-8198-1275b62241b1 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:25.944695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-169c5a08-fc04-4b93-8198-1275b62241b1 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:25.956014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-169c5a08-fc04-4b93-8198-1275b62241b1 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:25.956708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-169c5a08-fc04-4b93-8198-1275b62241b1 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:25.957338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-169c5a08-fc04-4b93-8198-1275b62241b1 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:25.958425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-169c5a08-fc04-4b93-8198-1275b62241b1 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:25.959099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-169c5a08-fc04-4b93-8198-1275b62241b1 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:25.959693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-169c5a08-fc04-4b93-8198-1275b62241b1 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:26.102854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8cd9f09d-3d28-40e6-9173-390729ef0eb1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:26.128086 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8cd9f09d-3d28-40e6-9173-390729ef0eb1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.537979 Aug 23 17:57:26.129449 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 868/1810] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:25 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:26.137882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7a70ba04-2a35-4164-9453-6781de906e52 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:26.146814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7a70ba04-2a35-4164-9453-6781de906e52 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:26.373990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a70ba04-2a35-4164-9453-6781de906e52 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:26.383740 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7a70ba04-2a35-4164-9453-6781de906e52 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1221 microversion: 2.1 time: 0.251689 Aug 23 17:57:26.384936 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 869/1811] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:26 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1221 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:26.421709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-39020fec-fd56-4196-b4c2-11333233ac06 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:26.422796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-39020fec-fd56-4196-b4c2-11333233ac06 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:26.440261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39020fec-fd56-4196-b4c2-11333233ac06 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:26.441293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39020fec-fd56-4196-b4c2-11333233ac06 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:26.441973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39020fec-fd56-4196-b4c2-11333233ac06 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:26.447291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39020fec-fd56-4196-b4c2-11333233ac06 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:26.449146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39020fec-fd56-4196-b4c2-11333233ac06 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:26.450898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39020fec-fd56-4196-b4c2-11333233ac06 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:26.608696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-169c5a08-fc04-4b93-8198-1275b62241b1 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:26.622193 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-169c5a08-fc04-4b93-8198-1275b62241b1 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 200 len: 1521 microversion: 2.1 time: 0.696839 Aug 23 17:57:26.623030 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 943/1812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:25 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 1521 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:26.646142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Action: 'action', calling method: .version_select at 0x7f27efbb1160>, body: {"addFloatingIp": {"address": "172.25.9.180"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:26.649217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:26.657241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:26.658847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:26.659501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:26.660449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:26.661066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:26.661668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:26.768131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "refresh_cache-153fb085-12d0-4155-a1f7-9e954d51e9c5" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 17:57:26.768832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquired lock "refresh_cache-153fb085-12d0-4155-a1f7-9e954d51e9c5" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 17:57:27.006110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-39020fec-fd56-4196-b4c2-11333233ac06 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:27.016787 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-39020fec-fd56-4196-b4c2-11333233ac06 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.600824 Aug 23 17:57:27.033460 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 870/1813] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:26 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:27.033460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ec2b33f1-1261-4f62-bf11-5c324ae95392 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:27.033460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ec2b33f1-1261-4f62-bf11-5c324ae95392 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:27.042646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec2b33f1-1261-4f62-bf11-5c324ae95392 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:27.043422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec2b33f1-1261-4f62-bf11-5c324ae95392 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:27.044268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec2b33f1-1261-4f62-bf11-5c324ae95392 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:27.045199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec2b33f1-1261-4f62-bf11-5c324ae95392 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:27.045924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec2b33f1-1261-4f62-bf11-5c324ae95392 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:27.046309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec2b33f1-1261-4f62-bf11-5c324ae95392 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:27.706888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ec2b33f1-1261-4f62-bf11-5c324ae95392 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:27.715243 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ec2b33f1-1261-4f62-bf11-5c324ae95392 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1471 microversion: 2.1 time: 0.690197 Aug 23 17:57:27.719281 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 871/1814] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:27 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1471 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:27.725929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c17b070a-73de-403a-be65-3dde2c775b06 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:27.726890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c17b070a-73de-403a-be65-3dde2c775b06 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:27.733688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c17b070a-73de-403a-be65-3dde2c775b06 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:27.734493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c17b070a-73de-403a-be65-3dde2c775b06 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:27.735063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c17b070a-73de-403a-be65-3dde2c775b06 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:27.737873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c17b070a-73de-403a-be65-3dde2c775b06 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:27.737873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c17b070a-73de-403a-be65-3dde2c775b06 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:27.737873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c17b070a-73de-403a-be65-3dde2c775b06 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:28.005986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-c17b070a-73de-403a-be65-3dde2c775b06 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid 480827c0-1bbc-4e3f-9176-aebec4fc597b {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:57:28.053328 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c17b070a-73de-403a-be65-3dde2c775b06 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 2424 microversion: 2.25 time: 0.332668 Aug 23 17:57:28.055678 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 872/1815] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:27 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 2424 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:28.062442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5b9a95d7-6c89-4639-ad4d-f7645c62e347 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:28.064046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5b9a95d7-6c89-4639-ad4d-f7645c62e347 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:28.072321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b9a95d7-6c89-4639-ad4d-f7645c62e347 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:28.073631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b9a95d7-6c89-4639-ad4d-f7645c62e347 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:28.074809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b9a95d7-6c89-4639-ad4d-f7645c62e347 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:28.076558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b9a95d7-6c89-4639-ad4d-f7645c62e347 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:28.077208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b9a95d7-6c89-4639-ad4d-f7645c62e347 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:28.078331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b9a95d7-6c89-4639-ad4d-f7645c62e347 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:28.095962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:28.406081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5b9a95d7-6c89-4639-ad4d-f7645c62e347 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:28.415541 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5b9a95d7-6c89-4639-ad4d-f7645c62e347 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.358527 Aug 23 17:57:28.427064 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 873/1816] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:28 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:28.437303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-66b24473-4aff-4135-a56c-6df8f5868800 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:28.438071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-66b24473-4aff-4135-a56c-6df8f5868800 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:28.444469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66b24473-4aff-4135-a56c-6df8f5868800 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:28.444965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66b24473-4aff-4135-a56c-6df8f5868800 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:28.445460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66b24473-4aff-4135-a56c-6df8f5868800 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:28.446153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66b24473-4aff-4135-a56c-6df8f5868800 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:28.446645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66b24473-4aff-4135-a56c-6df8f5868800 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:28.447243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66b24473-4aff-4135-a56c-6df8f5868800 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:28.552628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-66b24473-4aff-4135-a56c-6df8f5868800 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:28.570449 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-66b24473-4aff-4135-a56c-6df8f5868800 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1217 microversion: 2.1 time: 0.140465 Aug 23 17:57:28.571103 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 874/1817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:28 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:28.582209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7e8468da-355b-4d1b-aa79-d44eb119b7d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:28.584778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7e8468da-355b-4d1b-aa79-d44eb119b7d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:28.598390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e8468da-355b-4d1b-aa79-d44eb119b7d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:28.599338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e8468da-355b-4d1b-aa79-d44eb119b7d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:28.602114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e8468da-355b-4d1b-aa79-d44eb119b7d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:28.605126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e8468da-355b-4d1b-aa79-d44eb119b7d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:28.605932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e8468da-355b-4d1b-aa79-d44eb119b7d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:28.606779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e8468da-355b-4d1b-aa79-d44eb119b7d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:28.822110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Building network info cache for instance {{(pid=128807) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 17:57:29.024961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7e8468da-355b-4d1b-aa79-d44eb119b7d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:29.034368 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7e8468da-355b-4d1b-aa79-d44eb119b7d0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.457830 Aug 23 17:57:29.055618 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 875/1818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:28 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:29.055618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb306ae4-e7ae-4a23-ab84-431ac4db7195 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-16", "block_migration": "auto"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:29.055618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eb306ae4-e7ae-4a23-ab84-431ac4db7195 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:29.055618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:29.061161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb306ae4-e7ae-4a23-ab84-431ac4db7195 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:29.061694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb306ae4-e7ae-4a23-ab84-431ac4db7195 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:29.062201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb306ae4-e7ae-4a23-ab84-431ac4db7195 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:29.063188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb306ae4-e7ae-4a23-ab84-431ac4db7195 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:29.063728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb306ae4-e7ae-4a23-ab84-431ac4db7195 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:29.064107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb306ae4-e7ae-4a23-ab84-431ac4db7195 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:29.097862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-eb306ae4-e7ae-4a23-ab84-431ac4db7195 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'flavor' on Instance uuid 480827c0-1bbc-4e3f-9176-aebec4fc597b {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:57:29.115360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eb306ae4-e7ae-4a23-ab84-431ac4db7195 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Going to try to live migrate instance to n-h1-850468-16 {{(pid=128808) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 17:57:30.877426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Updating instance_info_cache with network_info: [{"id": "071d181a-b17b-447a-b61e-a9731c7217ec", "address": "fa:16:3e:26:c7:cc", "network": {"id": "4af2b4ce-48be-4835-a763-a9afa8d42aed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1357983366-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7b882a8b2644f1dac937ffcfd1ce14b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap071d181a-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 17:57:30.895664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Releasing lock "refresh_cache-153fb085-12d0-4155-a1f7-9e954d51e9c5" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 17:57:30.896911 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-279c2316-132b-4b0f-9dcb-991e32557fc3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "POST /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5/action" status: 202 len: 0 microversion: 2.1 time: 4.254836 Aug 23 17:57:30.920352 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 944/1819] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:57:26 2022] POST /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5/action => generated 0 bytes in 4277 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 17:57:30.951754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de64a86a-cdb6-4371-8000-0ac39cf77247 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:30.952400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-de64a86a-cdb6-4371-8000-0ac39cf77247 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:30.972863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de64a86a-cdb6-4371-8000-0ac39cf77247 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:30.976216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de64a86a-cdb6-4371-8000-0ac39cf77247 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:30.976710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de64a86a-cdb6-4371-8000-0ac39cf77247 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:30.977592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de64a86a-cdb6-4371-8000-0ac39cf77247 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:30.981558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de64a86a-cdb6-4371-8000-0ac39cf77247 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:30.982242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de64a86a-cdb6-4371-8000-0ac39cf77247 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:31.225653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-de64a86a-cdb6-4371-8000-0ac39cf77247 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:31.233906 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-de64a86a-cdb6-4371-8000-0ac39cf77247 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1471 microversion: 2.1 time: 0.290311 Aug 23 17:57:31.238055 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 945/1820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:30 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1471 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:31.242955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-48eb9430-8e98-46db-813b-dca3f0b9a033 req-2ff571c5-81c4-4a68-a9ee-6895c11b4a4e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153fb085-12d0-4155-a1f7-9e954d51e9c5", "tag": "071d181a-b17b-447a-b61e-a9731c7217ec"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:31.261703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-48eb9430-8e98-46db-813b-dca3f0b9a033 req-2ff571c5-81c4-4a68-a9ee-6895c11b4a4e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:31.263271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-48eb9430-8e98-46db-813b-dca3f0b9a033 req-2ff571c5-81c4-4a68-a9ee-6895c11b4a4e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:31.264119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-48eb9430-8e98-46db-813b-dca3f0b9a033 req-2ff571c5-81c4-4a68-a9ee-6895c11b4a4e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:31.282885 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-48eb9430-8e98-46db-813b-dca3f0b9a033 req-2ff571c5-81c4-4a68-a9ee-6895c11b4a4e service nova] Creating event network-changed:071d181a-b17b-447a-b61e-a9731c7217ec for instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 on n-h2-850468-16 Aug 23 17:57:31.296858 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-48eb9430-8e98-46db-813b-dca3f0b9a033 req-2ff571c5-81c4-4a68-a9ee-6895c11b4a4e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055308 Aug 23 17:57:31.298297 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 946/1821] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:31.305561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7ce827bb-7276-48cd-8a26-ff6037b5ddfd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:31.307547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7ce827bb-7276-48cd-8a26-ff6037b5ddfd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:31.315580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ce827bb-7276-48cd-8a26-ff6037b5ddfd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:31.316480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ce827bb-7276-48cd-8a26-ff6037b5ddfd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:31.317397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ce827bb-7276-48cd-8a26-ff6037b5ddfd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:31.318350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ce827bb-7276-48cd-8a26-ff6037b5ddfd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:31.319088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ce827bb-7276-48cd-8a26-ff6037b5ddfd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:31.319885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ce827bb-7276-48cd-8a26-ff6037b5ddfd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:31.577655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7ce827bb-7276-48cd-8a26-ff6037b5ddfd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:31.599083 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7ce827bb-7276-48cd-8a26-ff6037b5ddfd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.299032 Aug 23 17:57:31.614462 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 947/1822] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:31 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:31.618855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ffbce8cb-4a4c-4385-8175-0c1dea356ce4 req-3b85ca60-3c90-4f7e-8960-d847829c2ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8dfae01d-e966-4410-afe1-fdbb7cd88c9c", "tag": "8758bf38-c27c-4100-bae2-63108556ba54"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:31.650433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ffbce8cb-4a4c-4385-8175-0c1dea356ce4 req-3b85ca60-3c90-4f7e-8960-d847829c2ebc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:31.652429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ffbce8cb-4a4c-4385-8175-0c1dea356ce4 req-3b85ca60-3c90-4f7e-8960-d847829c2ebc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:31.653775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ffbce8cb-4a4c-4385-8175-0c1dea356ce4 req-3b85ca60-3c90-4f7e-8960-d847829c2ebc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:31.671264 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ffbce8cb-4a4c-4385-8175-0c1dea356ce4 req-3b85ca60-3c90-4f7e-8960-d847829c2ebc service nova] Creating event network-changed:8758bf38-c27c-4100-bae2-63108556ba54 for instance 8dfae01d-e966-4410-afe1-fdbb7cd88c9c on n-h2-850468-16 Aug 23 17:57:31.677893 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ffbce8cb-4a4c-4385-8175-0c1dea356ce4 req-3b85ca60-3c90-4f7e-8960-d847829c2ebc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070500 Aug 23 17:57:31.678993 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 948/1823] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:31.685615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-21b2c1ce-7c2a-4e83-a205-21123a28ee5a tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:31.686328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-21b2c1ce-7c2a-4e83-a205-21123a28ee5a tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:31.714686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21b2c1ce-7c2a-4e83-a205-21123a28ee5a tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:31.717265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21b2c1ce-7c2a-4e83-a205-21123a28ee5a tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:31.717869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21b2c1ce-7c2a-4e83-a205-21123a28ee5a tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:31.720065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21b2c1ce-7c2a-4e83-a205-21123a28ee5a tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:31.723317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21b2c1ce-7c2a-4e83-a205-21123a28ee5a tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:31.723954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21b2c1ce-7c2a-4e83-a205-21123a28ee5a tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:31.880910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-21b2c1ce-7c2a-4e83-a205-21123a28ee5a tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:31.890517 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-21b2c1ce-7c2a-4e83-a205-21123a28ee5a tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1291 microversion: 2.1 time: 0.210162 Aug 23 17:57:31.891126 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 949/1824] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:31 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1291 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:31.914005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-817acbf6-11da-4fc5-a4d4-6d7e0e9aba77 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:31.916110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-817acbf6-11da-4fc5-a4d4-6d7e0e9aba77 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:31.932281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-817acbf6-11da-4fc5-a4d4-6d7e0e9aba77 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:31.939017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-817acbf6-11da-4fc5-a4d4-6d7e0e9aba77 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:31.940785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-817acbf6-11da-4fc5-a4d4-6d7e0e9aba77 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:31.942499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-817acbf6-11da-4fc5-a4d4-6d7e0e9aba77 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:31.943216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-817acbf6-11da-4fc5-a4d4-6d7e0e9aba77 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:31.943903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-817acbf6-11da-4fc5-a4d4-6d7e0e9aba77 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:32.138195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-817acbf6-11da-4fc5-a4d4-6d7e0e9aba77 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:32.147093 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-817acbf6-11da-4fc5-a4d4-6d7e0e9aba77 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1486 microversion: 2.1 time: 0.251592 Aug 23 17:57:32.148082 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 950/1825] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:31 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1486 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:32.154066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.180"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:32.156661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:32.163261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:32.163827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:32.164316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:32.165464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:32.165926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:32.166982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:32.199553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "refresh_cache-ec0ffe29-2542-4e91-8547-9ef18f242ee5" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 17:57:32.200541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquired lock "refresh_cache-ec0ffe29-2542-4e91-8547-9ef18f242ee5" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 17:57:32.841909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:32.887900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:34.499733 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eb306ae4-e7ae-4a23-ab84-431ac4db7195 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/action" status: 202 len: 0 microversion: 2.25 time: 5.456828 Aug 23 17:57:34.500681 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 876/1826] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 17:57:29 2022] POST /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/action => generated 0 bytes in 5459 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:57:34.505529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-193a3ccd-9482-491a-90fa-696d9cc4f176 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:34.506074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-193a3ccd-9482-491a-90fa-696d9cc4f176 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:34.523058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-193a3ccd-9482-491a-90fa-696d9cc4f176 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:34.523601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-193a3ccd-9482-491a-90fa-696d9cc4f176 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:34.524061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-193a3ccd-9482-491a-90fa-696d9cc4f176 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:34.524858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-193a3ccd-9482-491a-90fa-696d9cc4f176 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:34.525320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-193a3ccd-9482-491a-90fa-696d9cc4f176 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:34.527240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-193a3ccd-9482-491a-90fa-696d9cc4f176 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:34.667072 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-193a3ccd-9482-491a-90fa-696d9cc4f176 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "POST /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436/action" status: 202 len: 0 microversion: 2.1 time: 0.164370 Aug 23 17:57:34.670311 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 877/1827] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:57:34 2022] POST /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436/action => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:57:34.679535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6228dd7a-5e8f-4d1b-83c7-ef242f66e51c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:34.680864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6228dd7a-5e8f-4d1b-83c7-ef242f66e51c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:34.699371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6228dd7a-5e8f-4d1b-83c7-ef242f66e51c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:34.699811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6228dd7a-5e8f-4d1b-83c7-ef242f66e51c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:34.701501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6228dd7a-5e8f-4d1b-83c7-ef242f66e51c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:34.702835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6228dd7a-5e8f-4d1b-83c7-ef242f66e51c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:34.703305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6228dd7a-5e8f-4d1b-83c7-ef242f66e51c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:34.703735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6228dd7a-5e8f-4d1b-83c7-ef242f66e51c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:34.969808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6228dd7a-5e8f-4d1b-83c7-ef242f66e51c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:34.987566 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6228dd7a-5e8f-4d1b-83c7-ef242f66e51c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1471 microversion: 2.1 time: 0.315922 Aug 23 17:57:34.988479 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 878/1828] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:34 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:35.008871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-50818f4b-034c-4845-bc12-6f3168d8e195 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:35.011109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-50818f4b-034c-4845-bc12-6f3168d8e195 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:35.040884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50818f4b-034c-4845-bc12-6f3168d8e195 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:35.042404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50818f4b-034c-4845-bc12-6f3168d8e195 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:35.042907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50818f4b-034c-4845-bc12-6f3168d8e195 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:35.043668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50818f4b-034c-4845-bc12-6f3168d8e195 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:35.044355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50818f4b-034c-4845-bc12-6f3168d8e195 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:35.045054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50818f4b-034c-4845-bc12-6f3168d8e195 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:35.240994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-50818f4b-034c-4845-bc12-6f3168d8e195 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:35.257712 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-50818f4b-034c-4845-bc12-6f3168d8e195 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.267723 Aug 23 17:57:35.275287 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 879/1829] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:34 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:35.288837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-af8dbfef-c4ba-43da-b99a-6e8253ba4f62 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:35.289450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-af8dbfef-c4ba-43da-b99a-6e8253ba4f62 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:35.302673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af8dbfef-c4ba-43da-b99a-6e8253ba4f62 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:35.303168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af8dbfef-c4ba-43da-b99a-6e8253ba4f62 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:35.303607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af8dbfef-c4ba-43da-b99a-6e8253ba4f62 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:35.310130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af8dbfef-c4ba-43da-b99a-6e8253ba4f62 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:35.310650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af8dbfef-c4ba-43da-b99a-6e8253ba4f62 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:35.311092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af8dbfef-c4ba-43da-b99a-6e8253ba4f62 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:35.390641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:35.515194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-af8dbfef-c4ba-43da-b99a-6e8253ba4f62 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:35.568048 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-af8dbfef-c4ba-43da-b99a-6e8253ba4f62 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1321 microversion: 2.1 time: 0.285131 Aug 23 17:57:35.608355 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 880/1830] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:35 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1321 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:35.625133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f2f1b79f-3af3-4004-ad55-210b5a37ce23 req-3f0103e0-8b76-428b-b914-b92a29fed2b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f8cfb229-ca34-4883-aa19-33cd91a70dc4", "tag": "75495c03-9bac-49c9-af64-a55bedb88c5f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:35.654062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f2f1b79f-3af3-4004-ad55-210b5a37ce23 req-3f0103e0-8b76-428b-b914-b92a29fed2b6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:35.654984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f2f1b79f-3af3-4004-ad55-210b5a37ce23 req-3f0103e0-8b76-428b-b914-b92a29fed2b6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:35.656073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f2f1b79f-3af3-4004-ad55-210b5a37ce23 req-3f0103e0-8b76-428b-b914-b92a29fed2b6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:35.671122 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f2f1b79f-3af3-4004-ad55-210b5a37ce23 req-3f0103e0-8b76-428b-b914-b92a29fed2b6 service nova] Creating event network-changed:75495c03-9bac-49c9-af64-a55bedb88c5f for instance f8cfb229-ca34-4883-aa19-33cd91a70dc4 on n-h1-850468-16 Aug 23 17:57:35.679061 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f2f1b79f-3af3-4004-ad55-210b5a37ce23 req-3f0103e0-8b76-428b-b914-b92a29fed2b6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067160 Aug 23 17:57:35.680020 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 881/1831] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:35.686421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cb16dca6-7a77-4a2e-b2eb-897acaa79eeb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:35.708512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cb16dca6-7a77-4a2e-b2eb-897acaa79eeb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:35.722657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb16dca6-7a77-4a2e-b2eb-897acaa79eeb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:35.723076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb16dca6-7a77-4a2e-b2eb-897acaa79eeb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:35.723521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb16dca6-7a77-4a2e-b2eb-897acaa79eeb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:35.724235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb16dca6-7a77-4a2e-b2eb-897acaa79eeb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:35.724687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb16dca6-7a77-4a2e-b2eb-897acaa79eeb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:35.725117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb16dca6-7a77-4a2e-b2eb-897acaa79eeb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:36.361775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cb16dca6-7a77-4a2e-b2eb-897acaa79eeb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:36.385070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cb16dca6-7a77-4a2e-b2eb-897acaa79eeb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:36.390622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cb16dca6-7a77-4a2e-b2eb-897acaa79eeb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:36.395019 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cb16dca6-7a77-4a2e-b2eb-897acaa79eeb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.712172 Aug 23 17:57:36.396711 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 882/1832] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:35 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:36.410628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-221bf6dc-b741-40fe-a306-e4410b39f278 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:36.411751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-221bf6dc-b741-40fe-a306-e4410b39f278 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:36.420678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=14 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:36.433229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-221bf6dc-b741-40fe-a306-e4410b39f278 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:36.434455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-221bf6dc-b741-40fe-a306-e4410b39f278 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:36.436295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-221bf6dc-b741-40fe-a306-e4410b39f278 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:36.437236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-221bf6dc-b741-40fe-a306-e4410b39f278 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:36.439101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-221bf6dc-b741-40fe-a306-e4410b39f278 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:36.439738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-221bf6dc-b741-40fe-a306-e4410b39f278 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:36.732686 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.network.neutron [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] re-assign floating IP 172.25.9.180 from instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 Aug 23 17:57:36.806578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Building network info cache for instance {{(pid=128807) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 17:57:37.648020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-221bf6dc-b741-40fe-a306-e4410b39f278 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:37.657417 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-221bf6dc-b741-40fe-a306-e4410b39f278 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1494 microversion: 2.1 time: 1.259051 Aug 23 17:57:37.657997 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 883/1833] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:36 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1494 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:37.663579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8052d820-f6dc-474e-a426-d5710cb914a9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:37.664478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8052d820-f6dc-474e-a426-d5710cb914a9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:37.673274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8052d820-f6dc-474e-a426-d5710cb914a9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:37.674126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8052d820-f6dc-474e-a426-d5710cb914a9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:37.674662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8052d820-f6dc-474e-a426-d5710cb914a9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:37.675708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8052d820-f6dc-474e-a426-d5710cb914a9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:37.676273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8052d820-f6dc-474e-a426-d5710cb914a9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:37.676765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8052d820-f6dc-474e-a426-d5710cb914a9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:38.159471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8052d820-f6dc-474e-a426-d5710cb914a9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:38.167990 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8052d820-f6dc-474e-a426-d5710cb914a9 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1476 microversion: 2.1 time: 0.508641 Aug 23 17:57:38.168585 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 884/1834] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:37 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1476 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:38.467283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f475d1b-e606-492f-b4b6-03eb3b29c1d5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:38.467963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5f475d1b-e606-492f-b4b6-03eb3b29c1d5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:38.475576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f475d1b-e606-492f-b4b6-03eb3b29c1d5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:38.476067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f475d1b-e606-492f-b4b6-03eb3b29c1d5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:38.476778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f475d1b-e606-492f-b4b6-03eb3b29c1d5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:38.477699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f475d1b-e606-492f-b4b6-03eb3b29c1d5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:38.478394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f475d1b-e606-492f-b4b6-03eb3b29c1d5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:38.479776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f475d1b-e606-492f-b4b6-03eb3b29c1d5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:38.658707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Updating instance_info_cache with network_info: [{"id": "071d181a-b17b-447a-b61e-a9731c7217ec", "address": "fa:16:3e:26:c7:cc", "network": {"id": "4af2b4ce-48be-4835-a763-a9afa8d42aed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1357983366-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7b882a8b2644f1dac937ffcfd1ce14b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap071d181a-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 17:57:38.680034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Building network info cache for instance {{(pid=128807) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 17:57:38.870433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f475d1b-e606-492f-b4b6-03eb3b29c1d5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:38.882091 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5f475d1b-e606-492f-b4b6-03eb3b29c1d5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.702288 Aug 23 17:57:38.882798 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 885/1835] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:38 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:38.900235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4cf4bd07-c02b-4eb9-b26a-0e4eca682633 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:38.904580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4cf4bd07-c02b-4eb9-b26a-0e4eca682633 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:38.910729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cf4bd07-c02b-4eb9-b26a-0e4eca682633 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:38.911725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cf4bd07-c02b-4eb9-b26a-0e4eca682633 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:38.912441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cf4bd07-c02b-4eb9-b26a-0e4eca682633 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:38.913222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cf4bd07-c02b-4eb9-b26a-0e4eca682633 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:38.913937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cf4bd07-c02b-4eb9-b26a-0e4eca682633 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:38.914897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cf4bd07-c02b-4eb9-b26a-0e4eca682633 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:39.154775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4cf4bd07-c02b-4eb9-b26a-0e4eca682633 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:39.163749 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4cf4bd07-c02b-4eb9-b26a-0e4eca682633 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1321 microversion: 2.1 time: 0.279614 Aug 23 17:57:39.174042 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 886/1836] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:38 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1321 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:39.179466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-bbaf611e-c898-45fe-b022-58d242a81fde req-22f6df28-0b8f-486f-950b-ac1d30e923c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8cfb229-ca34-4883-aa19-33cd91a70dc4", "name": "network-vif-plugged", "status": "completed", "tag": "75495c03-9bac-49c9-af64-a55bedb88c5f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:39.219433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bbaf611e-c898-45fe-b022-58d242a81fde req-22f6df28-0b8f-486f-950b-ac1d30e923c2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:39.220901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bbaf611e-c898-45fe-b022-58d242a81fde req-22f6df28-0b8f-486f-950b-ac1d30e923c2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:39.224247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bbaf611e-c898-45fe-b022-58d242a81fde req-22f6df28-0b8f-486f-950b-ac1d30e923c2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:39.251879 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-bbaf611e-c898-45fe-b022-58d242a81fde req-22f6df28-0b8f-486f-950b-ac1d30e923c2 service nova] Creating event network-vif-plugged:75495c03-9bac-49c9-af64-a55bedb88c5f for instance f8cfb229-ca34-4883-aa19-33cd91a70dc4 on n-h1-850468-16 Aug 23 17:57:39.257076 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-bbaf611e-c898-45fe-b022-58d242a81fde req-22f6df28-0b8f-486f-950b-ac1d30e923c2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091218 Aug 23 17:57:39.261103 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 887/1837] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:39.280494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-80abf11d-d14e-4abe-abc7-7db3fd1e2be8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:39.281978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-80abf11d-d14e-4abe-abc7-7db3fd1e2be8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:39.290106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80abf11d-d14e-4abe-abc7-7db3fd1e2be8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:39.291252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80abf11d-d14e-4abe-abc7-7db3fd1e2be8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:39.292026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80abf11d-d14e-4abe-abc7-7db3fd1e2be8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:39.293547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80abf11d-d14e-4abe-abc7-7db3fd1e2be8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:39.294321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80abf11d-d14e-4abe-abc7-7db3fd1e2be8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:39.294990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80abf11d-d14e-4abe-abc7-7db3fd1e2be8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:39.353056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:39.497729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-80abf11d-d14e-4abe-abc7-7db3fd1e2be8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:39.514865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-80abf11d-d14e-4abe-abc7-7db3fd1e2be8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:39.516376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-80abf11d-d14e-4abe-abc7-7db3fd1e2be8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:39.517557 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-80abf11d-d14e-4abe-abc7-7db3fd1e2be8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.254926 Aug 23 17:57:39.518772 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 888/1838] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:39 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:39.523589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-69f2638a-ae14-46ec-88c7-5e663951d4c2 req-07482f39-678f-415c-98f1-4c67a493c2e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153fb085-12d0-4155-a1f7-9e954d51e9c5", "tag": "071d181a-b17b-447a-b61e-a9731c7217ec"}, {"name": "network-changed", "server_uuid": "ec0ffe29-2542-4e91-8547-9ef18f242ee5", "tag": "d66d999b-a814-47c8-9efe-f2e4faaac265"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:39.536123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-69f2638a-ae14-46ec-88c7-5e663951d4c2 req-07482f39-678f-415c-98f1-4c67a493c2e7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:39.536612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-69f2638a-ae14-46ec-88c7-5e663951d4c2 req-07482f39-678f-415c-98f1-4c67a493c2e7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:39.537107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-69f2638a-ae14-46ec-88c7-5e663951d4c2 req-07482f39-678f-415c-98f1-4c67a493c2e7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:39.554456 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-69f2638a-ae14-46ec-88c7-5e663951d4c2 req-07482f39-678f-415c-98f1-4c67a493c2e7 service nova] Creating event network-changed:071d181a-b17b-447a-b61e-a9731c7217ec for instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 on n-h2-850468-16 Aug 23 17:57:39.554999 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-69f2638a-ae14-46ec-88c7-5e663951d4c2 req-07482f39-678f-415c-98f1-4c67a493c2e7 service nova] Creating event network-changed:d66d999b-a814-47c8-9efe-f2e4faaac265 for instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 on n-h1-850468-16 Aug 23 17:57:39.568048 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-69f2638a-ae14-46ec-88c7-5e663951d4c2 req-07482f39-678f-415c-98f1-4c67a493c2e7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.047854 Aug 23 17:57:39.570407 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 889/1839] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:39.577866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d535cc4b-b36b-4390-991f-2f5dc9e5d90c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:39.578783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d535cc4b-b36b-4390-991f-2f5dc9e5d90c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:39.588827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d535cc4b-b36b-4390-991f-2f5dc9e5d90c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:39.589902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d535cc4b-b36b-4390-991f-2f5dc9e5d90c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:39.590780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d535cc4b-b36b-4390-991f-2f5dc9e5d90c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:39.591528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d535cc4b-b36b-4390-991f-2f5dc9e5d90c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:39.592371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d535cc4b-b36b-4390-991f-2f5dc9e5d90c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:39.593009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d535cc4b-b36b-4390-991f-2f5dc9e5d90c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:39.837311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d535cc4b-b36b-4390-991f-2f5dc9e5d90c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:39.848934 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d535cc4b-b36b-4390-991f-2f5dc9e5d90c tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1494 microversion: 2.1 time: 0.277212 Aug 23 17:57:39.850143 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 890/1840] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:39 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1494 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:39.856197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-a4be1514-3da1-4fa2-b413-acb0d871a9da req-638fca15-5425-4f81-bc6d-3f5f6c5ddf58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a82e2894-222e-4f3a-a8dd-54613738cf3d", "tag": "7513e096-9832-43ff-8d9e-f3ad7b0d0706"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:39.868038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a4be1514-3da1-4fa2-b413-acb0d871a9da req-638fca15-5425-4f81-bc6d-3f5f6c5ddf58 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:39.868528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a4be1514-3da1-4fa2-b413-acb0d871a9da req-638fca15-5425-4f81-bc6d-3f5f6c5ddf58 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:39.868961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a4be1514-3da1-4fa2-b413-acb0d871a9da req-638fca15-5425-4f81-bc6d-3f5f6c5ddf58 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:39.886634 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-a4be1514-3da1-4fa2-b413-acb0d871a9da req-638fca15-5425-4f81-bc6d-3f5f6c5ddf58 service nova] Creating event network-changed:7513e096-9832-43ff-8d9e-f3ad7b0d0706 for instance a82e2894-222e-4f3a-a8dd-54613738cf3d on n-h2-850468-16 Aug 23 17:57:39.892833 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-a4be1514-3da1-4fa2-b413-acb0d871a9da req-638fca15-5425-4f81-bc6d-3f5f6c5ddf58 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041029 Aug 23 17:57:39.893436 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 891/1841] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:39.901927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-246be7c0-eff2-4a50-8fe1-818cee9501d4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:39.902840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-246be7c0-eff2-4a50-8fe1-818cee9501d4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:39.909409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-246be7c0-eff2-4a50-8fe1-818cee9501d4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:39.909902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-246be7c0-eff2-4a50-8fe1-818cee9501d4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:39.910688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-246be7c0-eff2-4a50-8fe1-818cee9501d4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:39.911309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-246be7c0-eff2-4a50-8fe1-818cee9501d4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:39.911765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-246be7c0-eff2-4a50-8fe1-818cee9501d4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:39.912391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-246be7c0-eff2-4a50-8fe1-818cee9501d4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:39.990482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Updating instance_info_cache with network_info: [{"id": "d66d999b-a814-47c8-9efe-f2e4faaac265", "address": "fa:16:3e:44:5c:1b", "network": {"id": "4af2b4ce-48be-4835-a763-a9afa8d42aed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1357983366-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7b882a8b2644f1dac937ffcfd1ce14b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd66d999b-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 17:57:40.005760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Releasing lock "refresh_cache-ec0ffe29-2542-4e91-8547-9ef18f242ee5" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 17:57:40.006949 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-375a13c6-ca44-4ee9-85d7-818eb989772a tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "POST /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5/action" status: 202 len: 0 microversion: 2.1 time: 7.857841 Aug 23 17:57:40.012103 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 951/1842] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:57:32 2022] POST /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5/action => generated 0 bytes in 7863 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 17:57:40.017962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-99bf7c78-7104-4355-b70b-23a7855004be tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:40.018589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-99bf7c78-7104-4355-b70b-23a7855004be tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:40.027394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99bf7c78-7104-4355-b70b-23a7855004be tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:40.029462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99bf7c78-7104-4355-b70b-23a7855004be tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:40.029914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99bf7c78-7104-4355-b70b-23a7855004be tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:40.030795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99bf7c78-7104-4355-b70b-23a7855004be tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:40.031120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99bf7c78-7104-4355-b70b-23a7855004be tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:40.031929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99bf7c78-7104-4355-b70b-23a7855004be tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:40.147838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-246be7c0-eff2-4a50-8fe1-818cee9501d4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:40.159925 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-246be7c0-eff2-4a50-8fe1-818cee9501d4 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1476 microversion: 2.1 time: 0.264558 Aug 23 17:57:40.160711 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 892/1843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:39 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1476 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:40.185056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2f1480b-5265-4a36-849c-2a01b48e6379 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.180"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:40.367587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-99bf7c78-7104-4355-b70b-23a7855004be tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:40.389618 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-99bf7c78-7104-4355-b70b-23a7855004be tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.375628 Aug 23 17:57:40.390965 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 952/1844] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:40 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:40.410511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ccc6535c-7b19-421d-9cf9-190a05ff6445 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:40.411886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ccc6535c-7b19-421d-9cf9-190a05ff6445 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:40.419585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc6535c-7b19-421d-9cf9-190a05ff6445 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:40.420503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc6535c-7b19-421d-9cf9-190a05ff6445 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:40.421043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc6535c-7b19-421d-9cf9-190a05ff6445 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:40.422000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc6535c-7b19-421d-9cf9-190a05ff6445 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:40.422508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc6535c-7b19-421d-9cf9-190a05ff6445 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:40.423935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc6535c-7b19-421d-9cf9-190a05ff6445 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:40.675021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f2f1480b-5265-4a36-849c-2a01b48e6379 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:40.687867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2f1480b-5265-4a36-849c-2a01b48e6379 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:40.688975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2f1480b-5265-4a36-849c-2a01b48e6379 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:40.689661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2f1480b-5265-4a36-849c-2a01b48e6379 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:40.691217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2f1480b-5265-4a36-849c-2a01b48e6379 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:40.692125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2f1480b-5265-4a36-849c-2a01b48e6379 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:40.692925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2f1480b-5265-4a36-849c-2a01b48e6379 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:40.729056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ccc6535c-7b19-421d-9cf9-190a05ff6445 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:40.742933 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ccc6535c-7b19-421d-9cf9-190a05ff6445 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1321 microversion: 2.1 time: 0.337781 Aug 23 17:57:40.743748 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 953/1845] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:40 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:40.754708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf873063-975a-4bfb-aba6-70c4a84ee178 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:40.755478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bf873063-975a-4bfb-aba6-70c4a84ee178 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:40.776384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf873063-975a-4bfb-aba6-70c4a84ee178 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:40.776933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf873063-975a-4bfb-aba6-70c4a84ee178 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:40.777387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf873063-975a-4bfb-aba6-70c4a84ee178 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:40.779929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf873063-975a-4bfb-aba6-70c4a84ee178 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:40.784550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf873063-975a-4bfb-aba6-70c4a84ee178 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:40.785089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf873063-975a-4bfb-aba6-70c4a84ee178 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:41.038485 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-f2f1480b-5265-4a36-849c-2a01b48e6379 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] HTTP exception thrown: Floating IP 172.25.9.180 is not associated with instance 153fb085-12d0-4155-a1f7-9e954d51e9c5. Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2f1480b-5265-4a36-849c-2a01b48e6379 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Request method failure captured: Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5/action HTTP/1.1 Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 49 Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRTT5qTREkpkNCPdk-AWdCDz7Eze_bUOUZoTxPA97pb-_Fn3ivaVXshsMPIryyr9k_9pUqkfpAsRloCcXgTDm5g5QVVbvGASL_JULIA8516e-E7dR8qlaLkKalfaTKCR5xB9-SMbJ06tPwUwLnbDNNEmsRNw9dVyDupUE3r9uy1bclg Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: e7b882a8b2644f1dac937ffcfd1ce14b Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1470360496 Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e7b882a8b2644f1dac937ffcfd1ce14b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e7b882a8b2644f1dac937ffcfd1ce14b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e7b882a8b2644f1dac937ffcfd1ce14b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e7b882a8b2644f1dac937ffcfd1ce14b"}]}] Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1470360496 Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: e7b882a8b2644f1dac937ffcfd1ce14b Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1470360496 Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FloatingIPsAssociationTestJSON-1470360496-project Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2b5f2c622daa43968a1a23cad5c91a49 Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1470360496-project Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: {"removeFloatingIp": {"address": "172.25.9.180"}} Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: exception: Floating IP 172.25.9.180 is not associated with instance 153fb085-12d0-4155-a1f7-9e954d51e9c5. Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '153fb085-12d0-4155-a1f7-9e954d51e9c5', 'body': {'removeFloatingIp': {'address': '172.25.9.180'}}} Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.9.180 is not associated with instance 153fb085-12d0-4155-a1f7-9e954d51e9c5. Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.9.180 is not associated with instance 153fb085-12d0-4155-a1f7-9e954d51e9c5. Aug 23 17:57:41.040909 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:41.046782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2f1480b-5265-4a36-849c-2a01b48e6379 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Returning 409 to user: Floating IP 172.25.9.180 is not associated with instance 153fb085-12d0-4155-a1f7-9e954d51e9c5. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:41.046782 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f2f1480b-5265-4a36-849c-2a01b48e6379 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "POST /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5/action" status: 409 len: 146 microversion: 2.1 time: 0.866506 Aug 23 17:57:41.046782 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 893/1846] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:57:40 2022] POST /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5/action => generated 146 bytes in 868 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:57:41.058084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bdcc06be-fcea-4ca7-9e2d-a393a9d3fbe5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:41.059343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bdcc06be-fcea-4ca7-9e2d-a393a9d3fbe5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:41.066329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdcc06be-fcea-4ca7-9e2d-a393a9d3fbe5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:41.067207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdcc06be-fcea-4ca7-9e2d-a393a9d3fbe5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:41.068112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdcc06be-fcea-4ca7-9e2d-a393a9d3fbe5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:41.069931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdcc06be-fcea-4ca7-9e2d-a393a9d3fbe5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:41.070709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdcc06be-fcea-4ca7-9e2d-a393a9d3fbe5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:41.071610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdcc06be-fcea-4ca7-9e2d-a393a9d3fbe5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:41.279218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bf873063-975a-4bfb-aba6-70c4a84ee178 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:41.304226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bf873063-975a-4bfb-aba6-70c4a84ee178 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:41.315363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bf873063-975a-4bfb-aba6-70c4a84ee178 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:41.318494 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bf873063-975a-4bfb-aba6-70c4a84ee178 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.571212 Aug 23 17:57:41.321168 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 954/1847] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:40 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:41.336627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Action: 'action', calling method: .version_select at 0x7f27efbb1430>, body: {"removeFloatingIp": {"address": "172.25.9.180"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:41.578632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bdcc06be-fcea-4ca7-9e2d-a393a9d3fbe5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:41.591033 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bdcc06be-fcea-4ca7-9e2d-a393a9d3fbe5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1494 microversion: 2.1 time: 0.545372 Aug 23 17:57:41.600167 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 894/1848] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:41 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1494 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:41.609722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-649edf55-4931-4ac0-b072-2f0d7aba0a5a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:41.610559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-649edf55-4931-4ac0-b072-2f0d7aba0a5a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:41.626826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-649edf55-4931-4ac0-b072-2f0d7aba0a5a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:41.627323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-649edf55-4931-4ac0-b072-2f0d7aba0a5a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:41.627756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-649edf55-4931-4ac0-b072-2f0d7aba0a5a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:41.628470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-649edf55-4931-4ac0-b072-2f0d7aba0a5a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:41.629114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-649edf55-4931-4ac0-b072-2f0d7aba0a5a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:41.630405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-649edf55-4931-4ac0-b072-2f0d7aba0a5a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:42.012202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-649edf55-4931-4ac0-b072-2f0d7aba0a5a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:42.023506 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-649edf55-4931-4ac0-b072-2f0d7aba0a5a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1476 microversion: 2.1 time: 0.421340 Aug 23 17:57:42.039435 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 895/1849] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:41 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1476 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:42.046084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-878ae0bc-0876-4053-93f1-1e5c23f62caa req-7a0a5126-29d6-41e9-83ed-969fa682b6ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfae01d-e966-4410-afe1-fdbb7cd88c9c", "name": "network-vif-plugged", "status": "completed", "tag": "8758bf38-c27c-4100-bae2-63108556ba54"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:42.056319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-878ae0bc-0876-4053-93f1-1e5c23f62caa req-7a0a5126-29d6-41e9-83ed-969fa682b6ee service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:42.056933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-878ae0bc-0876-4053-93f1-1e5c23f62caa req-7a0a5126-29d6-41e9-83ed-969fa682b6ee service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:42.057341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-878ae0bc-0876-4053-93f1-1e5c23f62caa req-7a0a5126-29d6-41e9-83ed-969fa682b6ee service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:42.071260 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-878ae0bc-0876-4053-93f1-1e5c23f62caa req-7a0a5126-29d6-41e9-83ed-969fa682b6ee service nova] Creating event network-vif-plugged:8758bf38-c27c-4100-bae2-63108556ba54 for instance 8dfae01d-e966-4410-afe1-fdbb7cd88c9c on n-h2-850468-16 Aug 23 17:57:42.073155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:42.077900 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-878ae0bc-0876-4053-93f1-1e5c23f62caa req-7a0a5126-29d6-41e9-83ed-969fa682b6ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037225 Aug 23 17:57:42.083664 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 896/1850] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:42.086164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:42.087020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:42.087673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:42.090873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b34889f0-52b9-4c0c-9b33-8b3aa16eaee5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:42.091835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b34889f0-52b9-4c0c-9b33-8b3aa16eaee5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:42.091969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:42.093343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:42.094280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:42.099974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b34889f0-52b9-4c0c-9b33-8b3aa16eaee5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:42.100832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b34889f0-52b9-4c0c-9b33-8b3aa16eaee5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:42.101432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b34889f0-52b9-4c0c-9b33-8b3aa16eaee5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:42.102322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b34889f0-52b9-4c0c-9b33-8b3aa16eaee5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:42.102986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b34889f0-52b9-4c0c-9b33-8b3aa16eaee5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:42.105135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b34889f0-52b9-4c0c-9b33-8b3aa16eaee5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:42.467879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b34889f0-52b9-4c0c-9b33-8b3aa16eaee5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:42.483020 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b34889f0-52b9-4c0c-9b33-8b3aa16eaee5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1716 microversion: 2.1 time: 0.396899 Aug 23 17:57:42.487549 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 897/1851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:42 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1716 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:42.505815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8da33de4-51c1-478d-8116-7111f53677a7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:42.507113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8da33de4-51c1-478d-8116-7111f53677a7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:42.516612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8da33de4-51c1-478d-8116-7111f53677a7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:42.517387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8da33de4-51c1-478d-8116-7111f53677a7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:42.518045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8da33de4-51c1-478d-8116-7111f53677a7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:42.518988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8da33de4-51c1-478d-8116-7111f53677a7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:42.519699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8da33de4-51c1-478d-8116-7111f53677a7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:42.520269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8da33de4-51c1-478d-8116-7111f53677a7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:42.711862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "refresh_cache-ec0ffe29-2542-4e91-8547-9ef18f242ee5" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 17:57:42.712807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquired lock "refresh_cache-ec0ffe29-2542-4e91-8547-9ef18f242ee5" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 17:57:42.727643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8da33de4-51c1-478d-8116-7111f53677a7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:42.743096 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8da33de4-51c1-478d-8116-7111f53677a7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1321 microversion: 2.1 time: 0.254253 Aug 23 17:57:42.746361 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 898/1852] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:42 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:42.759284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-873b552c-cca9-4fe8-96a2-bc475a9889ce tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:42.760613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-873b552c-cca9-4fe8-96a2-bc475a9889ce tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:42.768318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-873b552c-cca9-4fe8-96a2-bc475a9889ce tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:42.768958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-873b552c-cca9-4fe8-96a2-bc475a9889ce tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:42.770080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-873b552c-cca9-4fe8-96a2-bc475a9889ce tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:42.771714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-873b552c-cca9-4fe8-96a2-bc475a9889ce tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:42.772415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-873b552c-cca9-4fe8-96a2-bc475a9889ce tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:42.773408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-873b552c-cca9-4fe8-96a2-bc475a9889ce tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:43.012424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-873b552c-cca9-4fe8-96a2-bc475a9889ce tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:43.021976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-873b552c-cca9-4fe8-96a2-bc475a9889ce tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:43.023878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-873b552c-cca9-4fe8-96a2-bc475a9889ce tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:43.026043 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-873b552c-cca9-4fe8-96a2-bc475a9889ce tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.277896 Aug 23 17:57:43.039103 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 899/1853] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:42 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:43.050336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ca6dd858-760b-42e5-bbc3-e932cef82e43 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:43.051867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ca6dd858-760b-42e5-bbc3-e932cef82e43 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:43.059128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca6dd858-760b-42e5-bbc3-e932cef82e43 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:43.059998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca6dd858-760b-42e5-bbc3-e932cef82e43 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:43.060719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca6dd858-760b-42e5-bbc3-e932cef82e43 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:43.061758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca6dd858-760b-42e5-bbc3-e932cef82e43 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:43.062461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca6dd858-760b-42e5-bbc3-e932cef82e43 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:43.063056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca6dd858-760b-42e5-bbc3-e932cef82e43 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:43.373622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ca6dd858-760b-42e5-bbc3-e932cef82e43 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:43.389397 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ca6dd858-760b-42e5-bbc3-e932cef82e43 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1500 microversion: 2.1 time: 0.348212 Aug 23 17:57:43.392737 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 900/1854] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:43 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1500 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:43.426679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b029f9d0-7a0c-4404-9e17-445002d1548c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:43.427586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b029f9d0-7a0c-4404-9e17-445002d1548c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:43.437919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b029f9d0-7a0c-4404-9e17-445002d1548c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:43.438422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b029f9d0-7a0c-4404-9e17-445002d1548c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:43.438893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b029f9d0-7a0c-4404-9e17-445002d1548c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:43.439614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b029f9d0-7a0c-4404-9e17-445002d1548c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:43.440073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b029f9d0-7a0c-4404-9e17-445002d1548c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:43.440503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b029f9d0-7a0c-4404-9e17-445002d1548c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:43.685728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b029f9d0-7a0c-4404-9e17-445002d1548c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:43.698785 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b029f9d0-7a0c-4404-9e17-445002d1548c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1476 microversion: 2.1 time: 0.283961 Aug 23 17:57:43.699404 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 901/1855] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:43 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1476 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:43.713818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-57e5214a-017b-4194-ae44-b76c7ceb1fae tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:43.715166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-57e5214a-017b-4194-ae44-b76c7ceb1fae tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:43.734303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57e5214a-017b-4194-ae44-b76c7ceb1fae tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:43.735116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57e5214a-017b-4194-ae44-b76c7ceb1fae tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:43.735733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57e5214a-017b-4194-ae44-b76c7ceb1fae tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:43.736627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57e5214a-017b-4194-ae44-b76c7ceb1fae tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:43.737240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57e5214a-017b-4194-ae44-b76c7ceb1fae tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:43.737823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57e5214a-017b-4194-ae44-b76c7ceb1fae tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:43.752811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Building network info cache for instance {{(pid=128807) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 17:57:43.783255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-57e5214a-017b-4194-ae44-b76c7ceb1fae tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:57:43.905172 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-57e5214a-017b-4194-ae44-b76c7ceb1fae tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 204 len: 0 microversion: 2.1 time: 0.202371 Aug 23 17:57:43.905952 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 902/1856] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:57:43 2022] DELETE /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:57:43.919254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-680f3d96-a3cd-489c-bc2e-641ff8a8e5a6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:43.921184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-680f3d96-a3cd-489c-bc2e-641ff8a8e5a6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:43.935203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-680f3d96-a3cd-489c-bc2e-641ff8a8e5a6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:43.936167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-680f3d96-a3cd-489c-bc2e-641ff8a8e5a6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:43.936798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-680f3d96-a3cd-489c-bc2e-641ff8a8e5a6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:43.937706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-680f3d96-a3cd-489c-bc2e-641ff8a8e5a6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:43.939807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-680f3d96-a3cd-489c-bc2e-641ff8a8e5a6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:43.940474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-680f3d96-a3cd-489c-bc2e-641ff8a8e5a6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:44.188957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-680f3d96-a3cd-489c-bc2e-641ff8a8e5a6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:44.199555 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-680f3d96-a3cd-489c-bc2e-641ff8a8e5a6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1706 microversion: 2.1 time: 0.292560 Aug 23 17:57:44.202733 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 903/1857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:43 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1706 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:44.210469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d0e6b3fe-6edd-4070-8fbe-fd84167bec89 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:44.211412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d0e6b3fe-6edd-4070-8fbe-fd84167bec89 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:44.221063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0e6b3fe-6edd-4070-8fbe-fd84167bec89 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:44.221647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0e6b3fe-6edd-4070-8fbe-fd84167bec89 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:44.222336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0e6b3fe-6edd-4070-8fbe-fd84167bec89 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:44.223281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0e6b3fe-6edd-4070-8fbe-fd84167bec89 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:44.224227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0e6b3fe-6edd-4070-8fbe-fd84167bec89 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:44.224862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0e6b3fe-6edd-4070-8fbe-fd84167bec89 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:44.426257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d0e6b3fe-6edd-4070-8fbe-fd84167bec89 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:44.437744 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d0e6b3fe-6edd-4070-8fbe-fd84167bec89 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1321 microversion: 2.1 time: 0.233693 Aug 23 17:57:44.442212 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 904/1858] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:44 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:44.455215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3386c351-a8cd-4e10-abd7-ba50d02197e8 req-3d18e7f4-d26b-444c-8d92-4a99f93de22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec0ffe29-2542-4e91-8547-9ef18f242ee5", "tag": "d66d999b-a814-47c8-9efe-f2e4faaac265"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:44.482136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3386c351-a8cd-4e10-abd7-ba50d02197e8 req-3d18e7f4-d26b-444c-8d92-4a99f93de22b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:44.482648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3386c351-a8cd-4e10-abd7-ba50d02197e8 req-3d18e7f4-d26b-444c-8d92-4a99f93de22b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:44.486976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3386c351-a8cd-4e10-abd7-ba50d02197e8 req-3d18e7f4-d26b-444c-8d92-4a99f93de22b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:44.511628 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3386c351-a8cd-4e10-abd7-ba50d02197e8 req-3d18e7f4-d26b-444c-8d92-4a99f93de22b service nova] Creating event network-changed:d66d999b-a814-47c8-9efe-f2e4faaac265 for instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 on n-h1-850468-16 Aug 23 17:57:44.529546 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3386c351-a8cd-4e10-abd7-ba50d02197e8 req-3d18e7f4-d26b-444c-8d92-4a99f93de22b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085169 Aug 23 17:57:44.530479 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 905/1859] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:44.537248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9482d38a-b392-4f88-aca5-92e0d5721fbd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:44.537965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9482d38a-b392-4f88-aca5-92e0d5721fbd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:44.545806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9482d38a-b392-4f88-aca5-92e0d5721fbd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:44.546493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9482d38a-b392-4f88-aca5-92e0d5721fbd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:44.547903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9482d38a-b392-4f88-aca5-92e0d5721fbd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:44.548837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9482d38a-b392-4f88-aca5-92e0d5721fbd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:44.549507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9482d38a-b392-4f88-aca5-92e0d5721fbd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:44.552100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9482d38a-b392-4f88-aca5-92e0d5721fbd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:44.572420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:44.701697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Updating instance_info_cache with network_info: [{"id": "d66d999b-a814-47c8-9efe-f2e4faaac265", "address": "fa:16:3e:44:5c:1b", "network": {"id": "4af2b4ce-48be-4835-a763-a9afa8d42aed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1357983366-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7b882a8b2644f1dac937ffcfd1ce14b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapd66d999b-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 17:57:44.719151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Releasing lock "refresh_cache-ec0ffe29-2542-4e91-8547-9ef18f242ee5" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 17:57:44.721197 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3d9ac1b9-3241-46fc-861c-9babb3a25e75 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "POST /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5/action" status: 202 len: 0 microversion: 2.1 time: 3.396358 Aug 23 17:57:44.723196 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 955/1860] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:57:41 2022] POST /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5/action => generated 0 bytes in 3402 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 17:57:44.732724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0bbe6990-0130-49ad-924a-f321141c75a3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:44.738373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0bbe6990-0130-49ad-924a-f321141c75a3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:44.752558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bbe6990-0130-49ad-924a-f321141c75a3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:44.753623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bbe6990-0130-49ad-924a-f321141c75a3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:44.761991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bbe6990-0130-49ad-924a-f321141c75a3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:44.766781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bbe6990-0130-49ad-924a-f321141c75a3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:44.768053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bbe6990-0130-49ad-924a-f321141c75a3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:44.770152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bbe6990-0130-49ad-924a-f321141c75a3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:44.814410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=4,nova_cell1:UPDATE=3,nova_cell1:RELEASE=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:44.854196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9482d38a-b392-4f88-aca5-92e0d5721fbd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:44.865622 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9482d38a-b392-4f88-aca5-92e0d5721fbd tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.331266 Aug 23 17:57:44.870571 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 906/1861] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:44 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:44.883934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-81407c5c-bdba-4caa-9800-0260cb162943 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '.version_select at 0x7f27ec454e50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:44.908621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81407c5c-bdba-4caa-9800-0260cb162943 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:44.909131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81407c5c-bdba-4caa-9800-0260cb162943 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:44.909586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81407c5c-bdba-4caa-9800-0260cb162943 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:44.924850 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-81407c5c-bdba-4caa-9800-0260cb162943 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 3927 microversion: 2.1 time: 0.053046 Aug 23 17:57:44.925474 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 907/1862] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 17:57:44 2022] GET /compute/v2.1/os-migrations => generated 3927 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:44.937893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c4479821-6ca4-4968-b8c4-f6c736bffdf1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:44.938801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c4479821-6ca4-4968-b8c4-f6c736bffdf1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:44.946991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4479821-6ca4-4968-b8c4-f6c736bffdf1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:44.948709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4479821-6ca4-4968-b8c4-f6c736bffdf1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:44.949425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4479821-6ca4-4968-b8c4-f6c736bffdf1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:44.951238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4479821-6ca4-4968-b8c4-f6c736bffdf1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:44.951930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4479821-6ca4-4968-b8c4-f6c736bffdf1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:44.953156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4479821-6ca4-4968-b8c4-f6c736bffdf1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:45.114247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0bbe6990-0130-49ad-924a-f321141c75a3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:45.131849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0bbe6990-0130-49ad-924a-f321141c75a3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:45.137676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0bbe6990-0130-49ad-924a-f321141c75a3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:45.139053 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0bbe6990-0130-49ad-924a-f321141c75a3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.411082 Aug 23 17:57:45.155320 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 956/1863] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:44 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:45.164153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1dcebbb5-28f1-4e61-a5d2-9f6deea3b7d3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:45.165610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1dcebbb5-28f1-4e61-a5d2-9f6deea3b7d3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:45.175006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1dcebbb5-28f1-4e61-a5d2-9f6deea3b7d3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:45.175538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1dcebbb5-28f1-4e61-a5d2-9f6deea3b7d3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:45.176282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1dcebbb5-28f1-4e61-a5d2-9f6deea3b7d3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:45.176975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1dcebbb5-28f1-4e61-a5d2-9f6deea3b7d3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:45.177480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c4479821-6ca4-4968-b8c4-f6c736bffdf1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:45.177635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1dcebbb5-28f1-4e61-a5d2-9f6deea3b7d3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:45.177907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1dcebbb5-28f1-4e61-a5d2-9f6deea3b7d3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:45.190023 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c4479821-6ca4-4968-b8c4-f6c736bffdf1 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1476 microversion: 2.1 time: 0.263297 Aug 23 17:57:45.201629 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 908/1864] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:44 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1476 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:45.214395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ff7cff42-da9f-45ca-bc53-fafd4997cb01 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:45.215736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ff7cff42-da9f-45ca-bc53-fafd4997cb01 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:45.225430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7cff42-da9f-45ca-bc53-fafd4997cb01 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:45.226425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7cff42-da9f-45ca-bc53-fafd4997cb01 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:45.227143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7cff42-da9f-45ca-bc53-fafd4997cb01 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:45.228119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7cff42-da9f-45ca-bc53-fafd4997cb01 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:45.229366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7cff42-da9f-45ca-bc53-fafd4997cb01 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:45.230029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff7cff42-da9f-45ca-bc53-fafd4997cb01 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:45.236195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1dcebbb5-28f1-4e61-a5d2-9f6deea3b7d3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:57:45.423912 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1dcebbb5-28f1-4e61-a5d2-9f6deea3b7d3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 204 len: 0 microversion: 2.1 time: 0.266577 Aug 23 17:57:45.426275 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 957/1865] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:57:45 2022] DELETE /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:57:45.443251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.180"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:45.450233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:45.464709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:45.465215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:45.467268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:45.467904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:45.468585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:45.468787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:45.508691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "refresh_cache-153fb085-12d0-4155-a1f7-9e954d51e9c5" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 17:57:45.509427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquired lock "refresh_cache-153fb085-12d0-4155-a1f7-9e954d51e9c5" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 17:57:45.739654 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ff7cff42-da9f-45ca-bc53-fafd4997cb01 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1859 microversion: 2.1 time: 0.531548 Aug 23 17:57:45.749486 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 909/1866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:45 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1859 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:45.767894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-90bf0884-6fd0-4dd0-9d41-df37239a5694 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:45.769257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-90bf0884-6fd0-4dd0-9d41-df37239a5694 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:45.780822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90bf0884-6fd0-4dd0-9d41-df37239a5694 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:45.781333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90bf0884-6fd0-4dd0-9d41-df37239a5694 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:45.782804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90bf0884-6fd0-4dd0-9d41-df37239a5694 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:45.783993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90bf0884-6fd0-4dd0-9d41-df37239a5694 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:45.788359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90bf0884-6fd0-4dd0-9d41-df37239a5694 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:45.790254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90bf0884-6fd0-4dd0-9d41-df37239a5694 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:45.997044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-90bf0884-6fd0-4dd0-9d41-df37239a5694 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:46.006565 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-90bf0884-6fd0-4dd0-9d41-df37239a5694 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1321 microversion: 2.1 time: 0.256350 Aug 23 17:57:46.007806 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 910/1867] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:45 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:46.014486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0c0f35de-92d1-4f05-8c52-6f7d1c02720a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:46.015236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0c0f35de-92d1-4f05-8c52-6f7d1c02720a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:46.021891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c0f35de-92d1-4f05-8c52-6f7d1c02720a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:46.022774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c0f35de-92d1-4f05-8c52-6f7d1c02720a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:46.023541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c0f35de-92d1-4f05-8c52-6f7d1c02720a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:46.024422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c0f35de-92d1-4f05-8c52-6f7d1c02720a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:46.025051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c0f35de-92d1-4f05-8c52-6f7d1c02720a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:46.026202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c0f35de-92d1-4f05-8c52-6f7d1c02720a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:46.232396 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0c0f35de-92d1-4f05-8c52-6f7d1c02720a tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1859 microversion: 2.1 time: 0.223366 Aug 23 17:57:46.261164 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 911/1868] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:46 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1859 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:46.272738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00fbf982-bc88-4843-9e4f-10eda0738109 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:46.278698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-00fbf982-bc88-4843-9e4f-10eda0738109 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:46.292716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00fbf982-bc88-4843-9e4f-10eda0738109 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:46.297733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00fbf982-bc88-4843-9e4f-10eda0738109 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:46.299642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00fbf982-bc88-4843-9e4f-10eda0738109 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:46.301973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00fbf982-bc88-4843-9e4f-10eda0738109 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:46.302467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00fbf982-bc88-4843-9e4f-10eda0738109 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:46.302942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00fbf982-bc88-4843-9e4f-10eda0738109 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:46.529921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-00fbf982-bc88-4843-9e4f-10eda0738109 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:46.543675 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-00fbf982-bc88-4843-9e4f-10eda0738109 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.281313 Aug 23 17:57:46.547055 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 912/1869] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:46 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:46.560411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8fc5f89a-a5f5-4519-a35a-9c25968228c0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:46.560411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8fc5f89a-a5f5-4519-a35a-9c25968228c0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:46.569632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fc5f89a-a5f5-4519-a35a-9c25968228c0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:46.570776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fc5f89a-a5f5-4519-a35a-9c25968228c0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:46.576629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fc5f89a-a5f5-4519-a35a-9c25968228c0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:46.577476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fc5f89a-a5f5-4519-a35a-9c25968228c0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:46.578174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fc5f89a-a5f5-4519-a35a-9c25968228c0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:46.578826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fc5f89a-a5f5-4519-a35a-9c25968228c0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:46.835039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8fc5f89a-a5f5-4519-a35a-9c25968228c0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:46.846314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8fc5f89a-a5f5-4519-a35a-9c25968228c0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:46.847967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8fc5f89a-a5f5-4519-a35a-9c25968228c0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:46.849536 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8fc5f89a-a5f5-4519-a35a-9c25968228c0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.298931 Aug 23 17:57:46.850201 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 913/1870] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:46 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:46.855500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a42929f2-ec09-47d9-82ee-7ad58509e092 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:46.856250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a42929f2-ec09-47d9-82ee-7ad58509e092 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:46.862481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a42929f2-ec09-47d9-82ee-7ad58509e092 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:46.863288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a42929f2-ec09-47d9-82ee-7ad58509e092 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:46.863951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a42929f2-ec09-47d9-82ee-7ad58509e092 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:46.864891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a42929f2-ec09-47d9-82ee-7ad58509e092 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:46.865474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a42929f2-ec09-47d9-82ee-7ad58509e092 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:46.866100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a42929f2-ec09-47d9-82ee-7ad58509e092 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:47.098344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Building network info cache for instance {{(pid=128807) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 17:57:47.105230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a42929f2-ec09-47d9-82ee-7ad58509e092 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:47.120561 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a42929f2-ec09-47d9-82ee-7ad58509e092 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1476 microversion: 2.1 time: 0.268955 Aug 23 17:57:47.121421 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 914/1871] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:46 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1476 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:47.147457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e2e3073a-d18c-4a4a-8515-98171fdc620b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:47.147966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e2e3073a-d18c-4a4a-8515-98171fdc620b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:47.162246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2e3073a-d18c-4a4a-8515-98171fdc620b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:47.171691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2e3073a-d18c-4a4a-8515-98171fdc620b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:47.172269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2e3073a-d18c-4a4a-8515-98171fdc620b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:47.173005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2e3073a-d18c-4a4a-8515-98171fdc620b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:47.175194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2e3073a-d18c-4a4a-8515-98171fdc620b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:47.175436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2e3073a-d18c-4a4a-8515-98171fdc620b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:47.319148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-e2e3073a-d18c-4a4a-8515-98171fdc620b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lazy-loading 'services' on Instance uuid 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:57:47.433590 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e2e3073a-d18c-4a4a-8515-98171fdc620b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "DELETE /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments/d292ec21-45ad-4406-8d79-35c914c8ea58" status: 202 len: 0 microversion: 2.1 time: 0.310691 Aug 23 17:57:47.434463 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 915/1872] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 17:57:47 2022] DELETE /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments/d292ec21-45ad-4406-8d79-35c914c8ea58 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:57:47.443302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03a1cbc2-d5fa-48e4-ab1b-6483491d9f50 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:47.445170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-03a1cbc2-d5fa-48e4-ab1b-6483491d9f50 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:47.458721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03a1cbc2-d5fa-48e4-ab1b-6483491d9f50 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:47.458721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03a1cbc2-d5fa-48e4-ab1b-6483491d9f50 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:47.458721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03a1cbc2-d5fa-48e4-ab1b-6483491d9f50 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:47.459221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03a1cbc2-d5fa-48e4-ab1b-6483491d9f50 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:47.460782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03a1cbc2-d5fa-48e4-ab1b-6483491d9f50 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:47.461379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03a1cbc2-d5fa-48e4-ab1b-6483491d9f50 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:47.712355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-03a1cbc2-d5fa-48e4-ab1b-6483491d9f50 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:47.724970 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-03a1cbc2-d5fa-48e4-ab1b-6483491d9f50 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1321 microversion: 2.1 time: 0.288061 Aug 23 17:57:47.726605 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 916/1873] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:47 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:47.736320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-de5e1d1b-4f24-49a4-8799-67764fb2e3ea req-de7c0a7a-1db0-4d32-8053-8a793a1a68df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153fb085-12d0-4155-a1f7-9e954d51e9c5", "tag": "071d181a-b17b-447a-b61e-a9731c7217ec"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:47.751281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-de5e1d1b-4f24-49a4-8799-67764fb2e3ea req-de7c0a7a-1db0-4d32-8053-8a793a1a68df service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:47.752243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-de5e1d1b-4f24-49a4-8799-67764fb2e3ea req-de7c0a7a-1db0-4d32-8053-8a793a1a68df service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:47.752857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-de5e1d1b-4f24-49a4-8799-67764fb2e3ea req-de7c0a7a-1db0-4d32-8053-8a793a1a68df service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:47.771681 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-de5e1d1b-4f24-49a4-8799-67764fb2e3ea req-de7c0a7a-1db0-4d32-8053-8a793a1a68df service nova] Creating event network-changed:071d181a-b17b-447a-b61e-a9731c7217ec for instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 on n-h2-850468-16 Aug 23 17:57:47.781125 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-de5e1d1b-4f24-49a4-8799-67764fb2e3ea req-de7c0a7a-1db0-4d32-8053-8a793a1a68df service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050553 Aug 23 17:57:47.782532 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 917/1874] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:48.131444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-298b8190-9d60-42c2-b2ef-13b9ff5f76b8 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Calling method '.version_select at 0x7f27ec3e31f0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:48.172563 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-298b8190-9d60-42c2-b2ef-13b9ff5f76b8 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] HTTP exception thrown: Image not found. Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-298b8190-9d60-42c2-b2ef-13b9ff5f76b8 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Request method failure captured: Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/images/64f59c36-786d-4189-9ce1-2195cc1cf119/metadata/os_distro HTTP/1.1 Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRUbrxPUXSVSxdWd7-m2iZi4c4rot_PKqeswXcIuPefPZgGqQ0BGQBB2WB9gUYfMvndCbfkoJlMzYVS48zJybzEEmD--nLer3UuAtC0Di87imW6Y9M8riTgfyKHyPxzH0hcZbjNLLaDc9XJmth0-iUkO69bDZlc3DprTKoDy-PzQ9Ec Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 45227ad366594f1c866db77fdc53582a Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45227ad366594f1c866db77fdc53582a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45227ad366594f1c866db77fdc53582a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45227ad366594f1c866db77fdc53582a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45227ad366594f1c866db77fdc53582a"}]}] Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 45227ad366594f1c866db77fdc53582a Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesMetadataNegativeTestJSON-221857660-project Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a8cef5d91a3b451f8ecbfc80a7850ddf Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-221857660-project Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'image_id': '64f59c36-786d-4189-9ce1-2195cc1cf119', 'id': 'os_distro'} Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 64f59c36-786d-4189-9ce1-2195cc1cf119 Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 17:57:48.175037 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 64f59c36-786d-4189-9ce1-2195cc1cf119 could not be found. Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 17:57:48.180538 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:48.187290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-298b8190-9d60-42c2-b2ef-13b9ff5f76b8 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:48.187290 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-298b8190-9d60-42c2-b2ef-13b9ff5f76b8 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] 10.222.0.61 "DELETE /compute/v2.1/images/64f59c36-786d-4189-9ce1-2195cc1cf119/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.402496 Aug 23 17:57:48.187290 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 918/1875] 10.222.0.61 () {58 vars in 1293 bytes} [Tue Aug 23 17:57:47 2022] DELETE /compute/v2.1/images/64f59c36-786d-4189-9ce1-2195cc1cf119/metadata/os_distro => generated 62 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:57:48.208072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5cb4ab59-644e-4333-abdb-03abe48f0446 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:48.213400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5cb4ab59-644e-4333-abdb-03abe48f0446 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:48.248098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cb4ab59-644e-4333-abdb-03abe48f0446 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:48.248602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cb4ab59-644e-4333-abdb-03abe48f0446 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:48.249847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cb4ab59-644e-4333-abdb-03abe48f0446 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:48.250838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cb4ab59-644e-4333-abdb-03abe48f0446 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:48.252768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cb4ab59-644e-4333-abdb-03abe48f0446 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:48.253423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cb4ab59-644e-4333-abdb-03abe48f0446 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:48.329092 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5cb4ab59-644e-4333-abdb-03abe48f0446 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.140439 Aug 23 17:57:48.330265 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 919/1876] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 17:57:48 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments => generated 197 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:48.336108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cca0fa56-3256-47a0-8a8e-8bd7f61c3cf8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:48.337556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cca0fa56-3256-47a0-8a8e-8bd7f61c3cf8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:48.344613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cca0fa56-3256-47a0-8a8e-8bd7f61c3cf8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:48.345320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cca0fa56-3256-47a0-8a8e-8bd7f61c3cf8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:48.345945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cca0fa56-3256-47a0-8a8e-8bd7f61c3cf8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:48.346872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cca0fa56-3256-47a0-8a8e-8bd7f61c3cf8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:48.347498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cca0fa56-3256-47a0-8a8e-8bd7f61c3cf8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:48.348093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cca0fa56-3256-47a0-8a8e-8bd7f61c3cf8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:48.529594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Updating instance_info_cache with network_info: [{"id": "071d181a-b17b-447a-b61e-a9731c7217ec", "address": "fa:16:3e:26:c7:cc", "network": {"id": "4af2b4ce-48be-4835-a763-a9afa8d42aed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1357983366-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7b882a8b2644f1dac937ffcfd1ce14b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap071d181a-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 17:57:48.572002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Releasing lock "refresh_cache-153fb085-12d0-4155-a1f7-9e954d51e9c5" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 17:57:48.575613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cca0fa56-3256-47a0-8a8e-8bd7f61c3cf8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:48.577065 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-af804035-cdfc-4582-ae35-bfe224bdff91 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "POST /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5/action" status: 202 len: 0 microversion: 2.1 time: 3.141624 Aug 23 17:57:48.581558 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 958/1877] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:57:45 2022] POST /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5/action => generated 0 bytes in 3147 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 17:57:48.593138 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cca0fa56-3256-47a0-8a8e-8bd7f61c3cf8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.261532 Aug 23 17:57:48.594143 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 920/1878] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:48 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:48.594298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9bec2061-e098-4340-8080-e0a577d7a48d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:48.599081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9bec2061-e098-4340-8080-e0a577d7a48d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:48.611349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a157cfe8-90d0-4e61-9097-4b6d40452e96 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:48.613963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a157cfe8-90d0-4e61-9097-4b6d40452e96 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:48.624368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bec2061-e098-4340-8080-e0a577d7a48d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:48.627159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bec2061-e098-4340-8080-e0a577d7a48d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:48.628566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bec2061-e098-4340-8080-e0a577d7a48d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:48.630434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a157cfe8-90d0-4e61-9097-4b6d40452e96 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:48.631592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bec2061-e098-4340-8080-e0a577d7a48d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:48.632353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bec2061-e098-4340-8080-e0a577d7a48d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:48.633411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a157cfe8-90d0-4e61-9097-4b6d40452e96 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:48.633976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bec2061-e098-4340-8080-e0a577d7a48d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:48.638414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a157cfe8-90d0-4e61-9097-4b6d40452e96 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:48.640748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a157cfe8-90d0-4e61-9097-4b6d40452e96 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:48.642215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a157cfe8-90d0-4e61-9097-4b6d40452e96 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:48.645057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a157cfe8-90d0-4e61-9097-4b6d40452e96 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:48.893963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9bec2061-e098-4340-8080-e0a577d7a48d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:48.913618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a157cfe8-90d0-4e61-9097-4b6d40452e96 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:48.927650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9bec2061-e098-4340-8080-e0a577d7a48d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:48.933839 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a157cfe8-90d0-4e61-9097-4b6d40452e96 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1476 microversion: 2.1 time: 0.335533 Aug 23 17:57:48.935609 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 921/1879] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:48 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1476 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:48.936262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9bec2061-e098-4340-8080-e0a577d7a48d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:48.939056 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9bec2061-e098-4340-8080-e0a577d7a48d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.354568 Aug 23 17:57:48.956415 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 959/1880] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:48 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:48.961807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b14c91fd-9d5a-40b8-9222-05e20fa1510c tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Calling method '.version_select at 0x7f27ec665d30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:48.966893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86d0e56f-f474-4a5b-94e1-9308e5f03dc1 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '.version_select at 0x7f27f1b38dc0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:48.995208 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b14c91fd-9d5a-40b8-9222-05e20fa1510c tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] HTTP exception thrown: Image not found. Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b14c91fd-9d5a-40b8-9222-05e20fa1510c tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Request method failure captured: Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/images/f8874f26-00a2-4c4d-a590-b521bdd76399/metadata/os_version HTTP/1.1 Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRUbrxPUXSVSxdWd7-m2iZi4c4rot_PKqeswXcIuPefPZgGqQ0BGQBB2WB9gUYfMvndCbfkoJlMzYVS48zJybzEEmD--nLer3UuAtC0Di87imW6Y9M8riTgfyKHyPxzH0hcZbjNLLaDc9XJmth0-iUkO69bDZlc3DprTKoDy-PzQ9Ec Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 45227ad366594f1c866db77fdc53582a Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45227ad366594f1c866db77fdc53582a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45227ad366594f1c866db77fdc53582a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45227ad366594f1c866db77fdc53582a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45227ad366594f1c866db77fdc53582a"}]}] Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 45227ad366594f1c866db77fdc53582a Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesMetadataNegativeTestJSON-221857660-project Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a8cef5d91a3b451f8ecbfc80a7850ddf Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-221857660-project Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'image_id': 'f8874f26-00a2-4c4d-a590-b521bdd76399', 'id': 'os_version'} Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID f8874f26-00a2-4c4d-a590-b521bdd76399 Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 17:57:48.997522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image f8874f26-00a2-4c4d-a590-b521bdd76399 could not be found. Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b14c91fd-9d5a-40b8-9222-05e20fa1510c tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b14c91fd-9d5a-40b8-9222-05e20fa1510c tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] 10.222.0.61 "GET /compute/v2.1/images/f8874f26-00a2-4c4d-a590-b521bdd76399/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.061232 Aug 23 17:57:49.002688 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 922/1881] 10.222.0.61 () {58 vars in 1293 bytes} [Tue Aug 23 17:57:48 2022] GET /compute/v2.1/images/f8874f26-00a2-4c4d-a590-b521bdd76399/metadata/os_version => generated 62 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:57:49.011520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9616493d-b35e-4bd7-b401-1ae78bdeb1aa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:49.012582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9616493d-b35e-4bd7-b401-1ae78bdeb1aa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:49.023425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9616493d-b35e-4bd7-b401-1ae78bdeb1aa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:49.024143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9616493d-b35e-4bd7-b401-1ae78bdeb1aa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:49.024757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9616493d-b35e-4bd7-b401-1ae78bdeb1aa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:49.026888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9616493d-b35e-4bd7-b401-1ae78bdeb1aa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:49.027750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9616493d-b35e-4bd7-b401-1ae78bdeb1aa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:49.028403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9616493d-b35e-4bd7-b401-1ae78bdeb1aa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:49.402259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9616493d-b35e-4bd7-b401-1ae78bdeb1aa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:49.412734 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9616493d-b35e-4bd7-b401-1ae78bdeb1aa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1321 microversion: 2.1 time: 0.411379 Aug 23 17:57:49.413313 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 923/1882] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:49 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1321 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:49.444316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bdd580b7-a7c6-40eb-b718-a80a04b3f053 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Calling method '.version_select at 0x7f27ecb10e50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:49.484409 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-86d0e56f-f474-4a5b-94e1-9308e5f03dc1 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/b4abf8da-3aba-44eb-bf19-2e139e3b18b3" status: 200 len: 184 microversion: 2.1 time: 0.526829 Aug 23 17:57:49.486806 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-bdd580b7-a7c6-40eb-b718-a80a04b3f053 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] HTTP exception thrown: Image not found. Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bdd580b7-a7c6-40eb-b718-a80a04b3f053 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Request method failure captured: Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/images/8c20b5a3-a93a-48d4-9721-f55ff494c389/metadata HTTP/1.1 Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRUbrxPUXSVSxdWd7-m2iZi4c4rot_PKqeswXcIuPefPZgGqQ0BGQBB2WB9gUYfMvndCbfkoJlMzYVS48zJybzEEmD--nLer3UuAtC0Di87imW6Y9M8riTgfyKHyPxzH0hcZbjNLLaDc9XJmth0-iUkO69bDZlc3DprTKoDy-PzQ9Ec Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 45227ad366594f1c866db77fdc53582a Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45227ad366594f1c866db77fdc53582a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45227ad366594f1c866db77fdc53582a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45227ad366594f1c866db77fdc53582a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45227ad366594f1c866db77fdc53582a"}]}] Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 45227ad366594f1c866db77fdc53582a Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesMetadataNegativeTestJSON-221857660-project Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a8cef5d91a3b451f8ecbfc80a7850ddf Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-221857660-project Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'image_id': '8c20b5a3-a93a-48d4-9721-f55ff494c389'} Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 8c20b5a3-a93a-48d4-9721-f55ff494c389 Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 17:57:49.489352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 8c20b5a3-a93a-48d4-9721-f55ff494c389 could not be found. Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.493910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bdd580b7-a7c6-40eb-b718-a80a04b3f053 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:49.502969 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 960/1883] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Aug 23 17:57:48 2022] GET /compute/v2.1/os-floating-ips/b4abf8da-3aba-44eb-bf19-2e139e3b18b3 => generated 184 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:49.502969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-559ad5f8-9b13-4b4c-83d9-73e5ccd60694 req-9e888e78-5e0c-482c-9ee7-c25c5353fa7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a82e2894-222e-4f3a-a8dd-54613738cf3d", "name": "network-vif-plugged", "status": "completed", "tag": "7513e096-9832-43ff-8d9e-f3ad7b0d0706"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:49.503318 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bdd580b7-a7c6-40eb-b718-a80a04b3f053 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] 10.222.0.61 "GET /compute/v2.1/images/8c20b5a3-a93a-48d4-9721-f55ff494c389/metadata" status: 404 len: 62 microversion: 2.1 time: 0.079516 Aug 23 17:57:49.503318 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 924/1884] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Aug 23 17:57:49 2022] GET /compute/v2.1/images/8c20b5a3-a93a-48d4-9721-f55ff494c389/metadata => generated 62 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:57:49.511852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-430fcd54-5317-4b24-977a-28f5b26847af tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:49.512735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:49.514220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-430fcd54-5317-4b24-977a-28f5b26847af tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:49.525141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-430fcd54-5317-4b24-977a-28f5b26847af tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:49.526453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-430fcd54-5317-4b24-977a-28f5b26847af tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:49.527175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-430fcd54-5317-4b24-977a-28f5b26847af tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:49.528663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-430fcd54-5317-4b24-977a-28f5b26847af tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:49.529331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-430fcd54-5317-4b24-977a-28f5b26847af tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:49.529542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-559ad5f8-9b13-4b4c-83d9-73e5ccd60694 req-9e888e78-5e0c-482c-9ee7-c25c5353fa7f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:49.530020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-559ad5f8-9b13-4b4c-83d9-73e5ccd60694 req-9e888e78-5e0c-482c-9ee7-c25c5353fa7f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:49.530669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-559ad5f8-9b13-4b4c-83d9-73e5ccd60694 req-9e888e78-5e0c-482c-9ee7-c25c5353fa7f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:49.531591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-430fcd54-5317-4b24-977a-28f5b26847af tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:49.559268 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-559ad5f8-9b13-4b4c-83d9-73e5ccd60694 req-9e888e78-5e0c-482c-9ee7-c25c5353fa7f service nova] Creating event network-vif-plugged:7513e096-9832-43ff-8d9e-f3ad7b0d0706 for instance a82e2894-222e-4f3a-a8dd-54613738cf3d on n-h2-850468-16 Aug 23 17:57:49.571667 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-430fcd54-5317-4b24-977a-28f5b26847af tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067284 Aug 23 17:57:49.573789 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 925/1885] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 17:57:49 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:49.580174 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-559ad5f8-9b13-4b4c-83d9-73e5ccd60694 req-9e888e78-5e0c-482c-9ee7-c25c5353fa7f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087807 Aug 23 17:57:49.581091 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 961/1886] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:49.587452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.180"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:49.610991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-daaabd34-1fb3-417c-ae3b-8410892c2262 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Action: 'update_all', calling method: .version_select at 0x7f27ec314ee0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:49.656689 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-daaabd34-1fb3-417c-ae3b-8410892c2262 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] HTTP exception thrown: Image not found. Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-daaabd34-1fb3-417c-ae3b-8410892c2262 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Request method failure captured: Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: request: PUT /compute/v2.1/images/ecc85434-1edd-4994-951a-d4fddc9174c1/metadata HTTP/1.1 Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 57 Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRUbrxPUXSVSxdWd7-m2iZi4c4rot_PKqeswXcIuPefPZgGqQ0BGQBB2WB9gUYfMvndCbfkoJlMzYVS48zJybzEEmD--nLer3UuAtC0Di87imW6Y9M8riTgfyKHyPxzH0hcZbjNLLaDc9XJmth0-iUkO69bDZlc3DprTKoDy-PzQ9Ec Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 45227ad366594f1c866db77fdc53582a Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45227ad366594f1c866db77fdc53582a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45227ad366594f1c866db77fdc53582a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45227ad366594f1c866db77fdc53582a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45227ad366594f1c866db77fdc53582a"}]}] Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 45227ad366594f1c866db77fdc53582a Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesMetadataNegativeTestJSON-221857660-project Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a8cef5d91a3b451f8ecbfc80a7850ddf Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-221857660-project Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: exception: Image not found. Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'image_id': 'ecc85434-1edd-4994-951a-d4fddc9174c1', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ecc85434-1edd-4994-951a-d4fddc9174c1 Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 17:57:49.659211 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ecc85434-1edd-4994-951a-d4fddc9174c1 could not be found. Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-daaabd34-1fb3-417c-ae3b-8410892c2262 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Returning 404 to user: Image not found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-daaabd34-1fb3-417c-ae3b-8410892c2262 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] 10.222.0.61 "PUT /compute/v2.1/images/ecc85434-1edd-4994-951a-d4fddc9174c1/metadata" status: 404 len: 62 microversion: 2.1 time: 0.078440 Aug 23 17:57:49.664784 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 962/1887] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:57:49 2022] PUT /compute/v2.1/images/ecc85434-1edd-4994-951a-d4fddc9174c1/metadata => generated 62 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:57:49.676136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-42f83096-7542-4042-a0c0-f84e3e3219d3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:49.676136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-42f83096-7542-4042-a0c0-f84e3e3219d3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:49.680484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42f83096-7542-4042-a0c0-f84e3e3219d3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:49.682025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42f83096-7542-4042-a0c0-f84e3e3219d3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:49.682887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42f83096-7542-4042-a0c0-f84e3e3219d3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:49.684496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42f83096-7542-4042-a0c0-f84e3e3219d3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:49.686527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42f83096-7542-4042-a0c0-f84e3e3219d3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:49.688035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42f83096-7542-4042-a0c0-f84e3e3219d3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:49.814016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:49.820494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:49.823425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:49.824212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:49.824427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:49.825189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:49.825644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:49.826074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:49.944644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-42f83096-7542-4042-a0c0-f84e3e3219d3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:49.954957 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-42f83096-7542-4042-a0c0-f84e3e3219d3 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.292112 Aug 23 17:57:49.955541 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 963/1888] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:49 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:49.961978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0fbf943c-a9b9-454e-8863-f2a3e57d4813 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Action: 'update', calling method: .version_select at 0x7f27f1ac43a0>, body: {"meta": {"os_distro": "alt"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:49.996585 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-0fbf943c-a9b9-454e-8863-f2a3e57d4813 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] HTTP exception thrown: Image not found. Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0fbf943c-a9b9-454e-8863-f2a3e57d4813 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Request method failure captured: Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: request: PUT /compute/v2.1/images/560fcf56-2133-4d88-951e-716ad00ac1b2/metadata/os_distro HTTP/1.1 Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 30 Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRUbrxPUXSVSxdWd7-m2iZi4c4rot_PKqeswXcIuPefPZgGqQ0BGQBB2WB9gUYfMvndCbfkoJlMzYVS48zJybzEEmD--nLer3UuAtC0Di87imW6Y9M8riTgfyKHyPxzH0hcZbjNLLaDc9XJmth0-iUkO69bDZlc3DprTKoDy-PzQ9Ec Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 45227ad366594f1c866db77fdc53582a Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45227ad366594f1c866db77fdc53582a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45227ad366594f1c866db77fdc53582a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45227ad366594f1c866db77fdc53582a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45227ad366594f1c866db77fdc53582a"}]}] Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 45227ad366594f1c866db77fdc53582a Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesMetadataNegativeTestJSON-221857660-project Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a8cef5d91a3b451f8ecbfc80a7850ddf Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-221857660-project Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: {"meta": {"os_distro": "alt"}} Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: exception: Image not found. Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'image_id': '560fcf56-2133-4d88-951e-716ad00ac1b2', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 560fcf56-2133-4d88-951e-716ad00ac1b2 Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 17:57:49.999039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 560fcf56-2133-4d88-951e-716ad00ac1b2 could not be found. Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 17:57:50.006762 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:50.017390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0fbf943c-a9b9-454e-8863-f2a3e57d4813 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Returning 404 to user: Image not found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:50.017821 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0fbf943c-a9b9-454e-8863-f2a3e57d4813 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] 10.222.0.61 "PUT /compute/v2.1/images/560fcf56-2133-4d88-951e-716ad00ac1b2/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.056715 Aug 23 17:57:50.019201 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 964/1889] 10.222.0.61 () {60 vars in 1310 bytes} [Tue Aug 23 17:57:49 2022] PUT /compute/v2.1/images/560fcf56-2133-4d88-951e-716ad00ac1b2/metadata/os_distro => generated 62 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:57:50.031131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-36dc0b4f-192c-40a9-ab15-82b7e75ae25c req-f1f20261-5625-4060-8748-d96ad9aed5d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec0ffe29-2542-4e91-8547-9ef18f242ee5", "name": "network-vif-deleted", "tag": "d66d999b-a814-47c8-9efe-f2e4faaac265"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:50.046841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-36dc0b4f-192c-40a9-ab15-82b7e75ae25c req-f1f20261-5625-4060-8748-d96ad9aed5d3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:50.047602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-36dc0b4f-192c-40a9-ab15-82b7e75ae25c req-f1f20261-5625-4060-8748-d96ad9aed5d3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:50.048273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-36dc0b4f-192c-40a9-ab15-82b7e75ae25c req-f1f20261-5625-4060-8748-d96ad9aed5d3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:50.062644 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-36dc0b4f-192c-40a9-ab15-82b7e75ae25c req-f1f20261-5625-4060-8748-d96ad9aed5d3 service nova] Creating event network-vif-deleted:d66d999b-a814-47c8-9efe-f2e4faaac265 for instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 on n-h1-850468-16 Aug 23 17:57:50.070990 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-36dc0b4f-192c-40a9-ab15-82b7e75ae25c req-f1f20261-5625-4060-8748-d96ad9aed5d3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049568 Aug 23 17:57:50.071576 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 965/1890] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:50.082086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8efa2e02-e8f2-4d88-ab71-51a680ff2f47 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:50.083047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8efa2e02-e8f2-4d88-ab71-51a680ff2f47 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:50.091057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8efa2e02-e8f2-4d88-ab71-51a680ff2f47 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:50.092620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8efa2e02-e8f2-4d88-ab71-51a680ff2f47 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:50.093375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8efa2e02-e8f2-4d88-ab71-51a680ff2f47 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:50.094414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8efa2e02-e8f2-4d88-ab71-51a680ff2f47 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:50.095207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8efa2e02-e8f2-4d88-ab71-51a680ff2f47 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:50.095836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8efa2e02-e8f2-4d88-ab71-51a680ff2f47 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:50.283013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8efa2e02-e8f2-4d88-ab71-51a680ff2f47 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:50.295486 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8efa2e02-e8f2-4d88-ab71-51a680ff2f47 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1476 microversion: 2.1 time: 0.217957 Aug 23 17:57:50.296186 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 966/1891] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:50 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1476 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:50.301123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a21f2823-423d-4881-8f00-ca6fbe2b808b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:50.302246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a21f2823-423d-4881-8f00-ca6fbe2b808b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:50.311616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a21f2823-423d-4881-8f00-ca6fbe2b808b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:50.312602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a21f2823-423d-4881-8f00-ca6fbe2b808b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:50.313560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a21f2823-423d-4881-8f00-ca6fbe2b808b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:50.315319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a21f2823-423d-4881-8f00-ca6fbe2b808b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:50.316015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a21f2823-423d-4881-8f00-ca6fbe2b808b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:50.316668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a21f2823-423d-4881-8f00-ca6fbe2b808b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:50.621114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a21f2823-423d-4881-8f00-ca6fbe2b808b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:50.657527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a21f2823-423d-4881-8f00-ca6fbe2b808b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:50.659656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a21f2823-423d-4881-8f00-ca6fbe2b808b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:50.662568 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a21f2823-423d-4881-8f00-ca6fbe2b808b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.365132 Aug 23 17:57:50.680669 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 967/1892] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:50 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:50.689100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-76c33143-2877-4159-9684-2424fe6bf249 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Action: 'create', calling method: .version_select at 0x7f27f1b38ca0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:50.724504 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-76c33143-2877-4159-9684-2424fe6bf249 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] HTTP exception thrown: Image not found. Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-76c33143-2877-4159-9684-2424fe6bf249 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Request method failure captured: Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/images/c7c2f1c3-c985-4f4a-ba9e-47ffb4f5b4b8/metadata HTTP/1.1 Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 57 Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRUbrxPUXSVSxdWd7-m2iZi4c4rot_PKqeswXcIuPefPZgGqQ0BGQBB2WB9gUYfMvndCbfkoJlMzYVS48zJybzEEmD--nLer3UuAtC0Di87imW6Y9M8riTgfyKHyPxzH0hcZbjNLLaDc9XJmth0-iUkO69bDZlc3DprTKoDy-PzQ9Ec Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 45227ad366594f1c866db77fdc53582a Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_45227ad366594f1c866db77fdc53582a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45227ad366594f1c866db77fdc53582a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/45227ad366594f1c866db77fdc53582a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/45227ad366594f1c866db77fdc53582a"}]}] Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 45227ad366594f1c866db77fdc53582a Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-221857660 Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesMetadataNegativeTestJSON-221857660-project Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a8cef5d91a3b451f8ecbfc80a7850ddf Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-221857660-project Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: exception: Image not found. Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'image_id': 'c7c2f1c3-c985-4f4a-ba9e-47ffb4f5b4b8', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID c7c2f1c3-c985-4f4a-ba9e-47ffb4f5b4b8 Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 17:57:50.727014 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c7c2f1c3-c985-4f4a-ba9e-47ffb4f5b4b8 could not be found. Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:50.733108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-76c33143-2877-4159-9684-2424fe6bf249 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] Returning 404 to user: Image not found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:50.739174 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-76c33143-2877-4159-9684-2424fe6bf249 tempest-ImagesMetadataNegativeTestJSON-221857660 tempest-ImagesMetadataNegativeTestJSON-221857660-project] 10.222.0.61 "POST /compute/v2.1/images/c7c2f1c3-c985-4f4a-ba9e-47ffb4f5b4b8/metadata" status: 404 len: 62 microversion: 2.1 time: 0.050492 Aug 23 17:57:50.739174 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 968/1893] 10.222.0.61 () {60 vars in 1281 bytes} [Tue Aug 23 17:57:50 2022] POST /compute/v2.1/images/c7c2f1c3-c985-4f4a-ba9e-47ffb4f5b4b8/metadata => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 17:57:50.748170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f8e66f07-60d9-4e80-a3cc-1b8c6f8b4e77 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:50.749617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f8e66f07-60d9-4e80-a3cc-1b8c6f8b4e77 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:50.760311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8e66f07-60d9-4e80-a3cc-1b8c6f8b4e77 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:50.761120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8e66f07-60d9-4e80-a3cc-1b8c6f8b4e77 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:50.761872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8e66f07-60d9-4e80-a3cc-1b8c6f8b4e77 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:50.763131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8e66f07-60d9-4e80-a3cc-1b8c6f8b4e77 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:50.763863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8e66f07-60d9-4e80-a3cc-1b8c6f8b4e77 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:50.764484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8e66f07-60d9-4e80-a3cc-1b8c6f8b4e77 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:51.005673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f8e66f07-60d9-4e80-a3cc-1b8c6f8b4e77 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:51.015514 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f8e66f07-60d9-4e80-a3cc-1b8c6f8b4e77 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1321 microversion: 2.1 time: 0.280116 Aug 23 17:57:51.026764 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 969/1894] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:50 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:51.032037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5774bf90-9165-40a4-98bd-b95a52c8a84c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:51.037878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5774bf90-9165-40a4-98bd-b95a52c8a84c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:51.054316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5774bf90-9165-40a4-98bd-b95a52c8a84c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:51.055282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5774bf90-9165-40a4-98bd-b95a52c8a84c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:51.058049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5774bf90-9165-40a4-98bd-b95a52c8a84c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:51.060017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5774bf90-9165-40a4-98bd-b95a52c8a84c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:51.061571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5774bf90-9165-40a4-98bd-b95a52c8a84c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:51.062418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5774bf90-9165-40a4-98bd-b95a52c8a84c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:51.140155 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5774bf90-9165-40a4-98bd-b95a52c8a84c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117279 Aug 23 17:57:51.142584 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 970/1895] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 17:57:51 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:51.153646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d0f93400-e50a-4f65-847c-582fb4df088b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:51.155578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d0f93400-e50a-4f65-847c-582fb4df088b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:51.170103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0f93400-e50a-4f65-847c-582fb4df088b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:51.171783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0f93400-e50a-4f65-847c-582fb4df088b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:51.172367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0f93400-e50a-4f65-847c-582fb4df088b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:51.175700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0f93400-e50a-4f65-847c-582fb4df088b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:51.176446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0f93400-e50a-4f65-847c-582fb4df088b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:51.177126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0f93400-e50a-4f65-847c-582fb4df088b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:51.271831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "refresh_cache-153fb085-12d0-4155-a1f7-9e954d51e9c5" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 17:57:51.272347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquired lock "refresh_cache-153fb085-12d0-4155-a1f7-9e954d51e9c5" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 17:57:51.472733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d0f93400-e50a-4f65-847c-582fb4df088b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:51.483173 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d0f93400-e50a-4f65-847c-582fb4df088b tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1506 microversion: 2.1 time: 0.339349 Aug 23 17:57:51.494784 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 971/1896] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:51 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1506 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:51.501339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-214e25de-ce8d-4d01-96ce-92729ae59c77 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:51.506283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-214e25de-ce8d-4d01-96ce-92729ae59c77 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:51.524777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-214e25de-ce8d-4d01-96ce-92729ae59c77 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:51.529747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-214e25de-ce8d-4d01-96ce-92729ae59c77 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:51.530522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-214e25de-ce8d-4d01-96ce-92729ae59c77 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:51.531568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-214e25de-ce8d-4d01-96ce-92729ae59c77 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:51.532258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-214e25de-ce8d-4d01-96ce-92729ae59c77 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:51.533994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-214e25de-ce8d-4d01-96ce-92729ae59c77 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:51.872768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-214e25de-ce8d-4d01-96ce-92729ae59c77 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:51.885512 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-214e25de-ce8d-4d01-96ce-92729ae59c77 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1476 microversion: 2.1 time: 0.400642 Aug 23 17:57:51.886428 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 972/1897] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:51 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1476 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:51.903921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-404ca6b3-5e56-4c28-a2a0-29c1db0f67b3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:51.905243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-404ca6b3-5e56-4c28-a2a0-29c1db0f67b3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:51.917751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-404ca6b3-5e56-4c28-a2a0-29c1db0f67b3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:51.918501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-404ca6b3-5e56-4c28-a2a0-29c1db0f67b3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:51.919852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-404ca6b3-5e56-4c28-a2a0-29c1db0f67b3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:51.920915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-404ca6b3-5e56-4c28-a2a0-29c1db0f67b3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:51.921546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-404ca6b3-5e56-4c28-a2a0-29c1db0f67b3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:51.922934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-404ca6b3-5e56-4c28-a2a0-29c1db0f67b3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:52.234345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-404ca6b3-5e56-4c28-a2a0-29c1db0f67b3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:52.263179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-404ca6b3-5e56-4c28-a2a0-29c1db0f67b3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:52.266137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-404ca6b3-5e56-4c28-a2a0-29c1db0f67b3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:52.268669 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-404ca6b3-5e56-4c28-a2a0-29c1db0f67b3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.371222 Aug 23 17:57:52.269524 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 973/1898] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:51 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:52.289635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-67a61cc5-ee7c-445a-bd0f-85992d532a2b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:52.290635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-67a61cc5-ee7c-445a-bd0f-85992d532a2b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:52.301923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67a61cc5-ee7c-445a-bd0f-85992d532a2b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:52.304024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67a61cc5-ee7c-445a-bd0f-85992d532a2b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:52.304539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67a61cc5-ee7c-445a-bd0f-85992d532a2b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:52.305293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67a61cc5-ee7c-445a-bd0f-85992d532a2b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:52.307896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67a61cc5-ee7c-445a-bd0f-85992d532a2b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:52.308163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67a61cc5-ee7c-445a-bd0f-85992d532a2b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:52.567135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-67a61cc5-ee7c-445a-bd0f-85992d532a2b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:52.577828 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-67a61cc5-ee7c-445a-bd0f-85992d532a2b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1321 microversion: 2.1 time: 0.305804 Aug 23 17:57:52.578768 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 974/1899] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:52 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:52.583622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-054f7b28-a9b2-4b92-9398-4e021333a3d0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:52.588600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-054f7b28-a9b2-4b92-9398-4e021333a3d0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:52.599299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-054f7b28-a9b2-4b92-9398-4e021333a3d0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:52.600091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-054f7b28-a9b2-4b92-9398-4e021333a3d0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:52.600713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-054f7b28-a9b2-4b92-9398-4e021333a3d0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:52.601580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-054f7b28-a9b2-4b92-9398-4e021333a3d0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:52.602318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-054f7b28-a9b2-4b92-9398-4e021333a3d0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:52.602971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-054f7b28-a9b2-4b92-9398-4e021333a3d0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:52.689741 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-054f7b28-a9b2-4b92-9398-4e021333a3d0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109676 Aug 23 17:57:52.690445 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 975/1900] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 17:57:52 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments => generated 197 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:52.698975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97a77b0e-075c-4546-840e-fcd9f19aebb8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:52.704577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-97a77b0e-075c-4546-840e-fcd9f19aebb8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:52.720705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97a77b0e-075c-4546-840e-fcd9f19aebb8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:52.722514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97a77b0e-075c-4546-840e-fcd9f19aebb8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:52.723185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97a77b0e-075c-4546-840e-fcd9f19aebb8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:52.724079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97a77b0e-075c-4546-840e-fcd9f19aebb8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:52.726199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97a77b0e-075c-4546-840e-fcd9f19aebb8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:52.726830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97a77b0e-075c-4546-840e-fcd9f19aebb8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:52.735724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:52.876886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-97a77b0e-075c-4546-840e-fcd9f19aebb8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:52.890014 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-97a77b0e-075c-4546-840e-fcd9f19aebb8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1464 microversion: 2.1 time: 0.198087 Aug 23 17:57:52.892138 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 976/1901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:52 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1464 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:52.910579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-85af9874-11ec-4fd3-853f-cf46d20d1187 req-0d4583b9-6a85-4385-b7b9-a44d040ea1e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3ba76a3-5838-410f-897c-e2edf5812436", "name": "network-vif-deleted", "tag": "140e9847-1506-4a90-b25a-8c4d7b6f71c4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:52.929429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-85af9874-11ec-4fd3-853f-cf46d20d1187 req-0d4583b9-6a85-4385-b7b9-a44d040ea1e4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:52.930231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-85af9874-11ec-4fd3-853f-cf46d20d1187 req-0d4583b9-6a85-4385-b7b9-a44d040ea1e4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:52.930912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-85af9874-11ec-4fd3-853f-cf46d20d1187 req-0d4583b9-6a85-4385-b7b9-a44d040ea1e4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:52.957083 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-85af9874-11ec-4fd3-853f-cf46d20d1187 req-0d4583b9-6a85-4385-b7b9-a44d040ea1e4 service nova] Creating event network-vif-deleted:140e9847-1506-4a90-b25a-8c4d7b6f71c4 for instance c3ba76a3-5838-410f-897c-e2edf5812436 on n-h2-850468-16 Aug 23 17:57:52.970683 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-85af9874-11ec-4fd3-853f-cf46d20d1187 req-0d4583b9-6a85-4385-b7b9-a44d040ea1e4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072870 Aug 23 17:57:52.972147 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 977/1902] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:52.980426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2b16816c-e804-430f-9fec-0f870917dceb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:52.981594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2b16816c-e804-430f-9fec-0f870917dceb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:52.989862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b16816c-e804-430f-9fec-0f870917dceb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:52.991135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b16816c-e804-430f-9fec-0f870917dceb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:52.991817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b16816c-e804-430f-9fec-0f870917dceb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:52.992953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b16816c-e804-430f-9fec-0f870917dceb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:52.994579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b16816c-e804-430f-9fec-0f870917dceb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:52.995440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b16816c-e804-430f-9fec-0f870917dceb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:53.162198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Building network info cache for instance {{(pid=128808) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 17:57:53.169521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:53.391326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2b16816c-e804-430f-9fec-0f870917dceb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:53.406582 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2b16816c-e804-430f-9fec-0f870917dceb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1476 microversion: 2.1 time: 0.429948 Aug 23 17:57:53.407220 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 978/1903] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:52 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1476 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:53.417232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-be551791-d513-4f0e-96b4-cc22f5d234d8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:53.417860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-be551791-d513-4f0e-96b4-cc22f5d234d8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:53.435330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be551791-d513-4f0e-96b4-cc22f5d234d8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:53.435823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be551791-d513-4f0e-96b4-cc22f5d234d8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:53.436302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be551791-d513-4f0e-96b4-cc22f5d234d8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:53.437151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be551791-d513-4f0e-96b4-cc22f5d234d8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:53.437631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be551791-d513-4f0e-96b4-cc22f5d234d8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:53.438032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be551791-d513-4f0e-96b4-cc22f5d234d8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:53.938456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-be551791-d513-4f0e-96b4-cc22f5d234d8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:53.957229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-be551791-d513-4f0e-96b4-cc22f5d234d8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:53.958758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-be551791-d513-4f0e-96b4-cc22f5d234d8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:53.972078 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-be551791-d513-4f0e-96b4-cc22f5d234d8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.563712 Aug 23 17:57:53.972682 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 979/1904] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:53 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:53.992127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aa324018-e715-43cb-aca4-3cc42b13cd6d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:53.994799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aa324018-e715-43cb-aca4-3cc42b13cd6d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:54.036065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa324018-e715-43cb-aca4-3cc42b13cd6d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.037867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa324018-e715-43cb-aca4-3cc42b13cd6d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.038340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa324018-e715-43cb-aca4-3cc42b13cd6d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.043041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa324018-e715-43cb-aca4-3cc42b13cd6d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.044590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa324018-e715-43cb-aca4-3cc42b13cd6d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.047997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa324018-e715-43cb-aca4-3cc42b13cd6d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.194692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Updating instance_info_cache with network_info: [{"id": "071d181a-b17b-447a-b61e-a9731c7217ec", "address": "fa:16:3e:26:c7:cc", "network": {"id": "4af2b4ce-48be-4835-a763-a9afa8d42aed", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-1357983366-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "e7b882a8b2644f1dac937ffcfd1ce14b", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap071d181a-b1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128808) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 17:57:54.216986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Releasing lock "refresh_cache-153fb085-12d0-4155-a1f7-9e954d51e9c5" {{(pid=128808) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 17:57:54.218191 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5750a147-b2bf-498d-8066-10ff5ab13716 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "POST /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5/action" status: 202 len: 0 microversion: 2.1 time: 4.641002 Aug 23 17:57:54.219041 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 926/1905] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:57:49 2022] POST /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5/action => generated 0 bytes in 4645 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 17:57:54.227071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-76e23983-7774-409b-b655-7faf6a2fb015 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:54.233532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-76e23983-7774-409b-b655-7faf6a2fb015 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:54.252053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e23983-7774-409b-b655-7faf6a2fb015 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.254774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e23983-7774-409b-b655-7faf6a2fb015 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.255444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e23983-7774-409b-b655-7faf6a2fb015 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.262640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e23983-7774-409b-b655-7faf6a2fb015 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.263766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e23983-7774-409b-b655-7faf6a2fb015 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.265001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e23983-7774-409b-b655-7faf6a2fb015 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.396700 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-76e23983-7774-409b-b655-7faf6a2fb015 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173646 Aug 23 17:57:54.399121 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 927/1906] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 17:57:54 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments => generated 197 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:54.412892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:54.413904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:54.429505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.432345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.433131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.435486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.437492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.440385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.522772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.524543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.527629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.528116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lazy-loading 'fault' on Instance uuid c3ba76a3-5838-410f-897c-e2edf5812436 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:57:54.595348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:54.604988 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f68720a-9b32-459c-b517-88a9a535b8c0 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 200 len: 1303 microversion: 2.1 time: 0.203853 Aug 23 17:57:54.609178 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 928/1907] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:54 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 1303 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:54.620596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9dd24450-ea4e-4707-8380-2422cc08bffa tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:54.621372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9dd24450-ea4e-4707-8380-2422cc08bffa tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:54.634336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dd24450-ea4e-4707-8380-2422cc08bffa tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.636470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dd24450-ea4e-4707-8380-2422cc08bffa tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.637625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dd24450-ea4e-4707-8380-2422cc08bffa tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.640537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dd24450-ea4e-4707-8380-2422cc08bffa tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.641297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dd24450-ea4e-4707-8380-2422cc08bffa tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.641900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dd24450-ea4e-4707-8380-2422cc08bffa tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.672587 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-9dd24450-ea4e-4707-8380-2422cc08bffa tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] HTTP exception thrown: Instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 could not be found. Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9dd24450-ea4e-4707-8380-2422cc08bffa tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Request method failure captured: Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 HTTP/1.1 Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRTT5qTREkpkNCPdk-AWdCDz7Eze_bUOUZoTxPA97pb-_Fn3ivaVXshsMPIryyr9k_9pUqkfpAsRloCcXgTDm5g5QVVbvGASL_JULIA8516e-E7dR8qlaLkKalfaTKCR5xB9-SMbJ06tPwUwLnbDNNEmsRNw9dVyDupUE3r9uy1bclg Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: e7b882a8b2644f1dac937ffcfd1ce14b Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1470360496 Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e7b882a8b2644f1dac937ffcfd1ce14b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e7b882a8b2644f1dac937ffcfd1ce14b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e7b882a8b2644f1dac937ffcfd1ce14b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e7b882a8b2644f1dac937ffcfd1ce14b"}]}] Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1470360496 Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: e7b882a8b2644f1dac937ffcfd1ce14b Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1470360496 Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FloatingIPsAssociationTestJSON-1470360496-project Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2b5f2c622daa43968a1a23cad5c91a49 Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1470360496-project Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 could not be found. Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'ec0ffe29-2542-4e91-8547-9ef18f242ee5'} Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 could not be found. Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:57:54.679089 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:57:54.684545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 could not be found. Aug 23 17:57:54.684545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:54.684545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:54.684545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:54.684545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:54.684545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:54.684545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:54.684545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:54.684545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:54.684545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 could not be found. Aug 23 17:57:54.684545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:57:54.686526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9dd24450-ea4e-4707-8380-2422cc08bffa tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Returning 404 to user: Instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:54.687608 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9dd24450-ea4e-4707-8380-2422cc08bffa tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 404 len: 111 microversion: 2.1 time: 0.077409 Aug 23 17:57:54.688652 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 929/1908] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:57:54 2022] DELETE /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:57:54.693456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-19e08f87-be45-4dec-8907-0e5ec8b2557c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:54.694290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-19e08f87-be45-4dec-8907-0e5ec8b2557c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:54.701809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19e08f87-be45-4dec-8907-0e5ec8b2557c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.702515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19e08f87-be45-4dec-8907-0e5ec8b2557c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.703216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19e08f87-be45-4dec-8907-0e5ec8b2557c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.704097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19e08f87-be45-4dec-8907-0e5ec8b2557c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.704707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19e08f87-be45-4dec-8907-0e5ec8b2557c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.705350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19e08f87-be45-4dec-8907-0e5ec8b2557c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.756208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aa324018-e715-43cb-aca4-3cc42b13cd6d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:54.765995 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aa324018-e715-43cb-aca4-3cc42b13cd6d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1512 microversion: 2.1 time: 0.791854 Aug 23 17:57:54.782565 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 980/1909] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:53 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1512 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:54.787680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-73c5080d-eeb7-4503-a0d1-f0b27108d89d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:54.789041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-73c5080d-eeb7-4503-a0d1-f0b27108d89d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: ec0ffe29-2542-4e91-8547-9ef18f242ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:54.805786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73c5080d-eeb7-4503-a0d1-f0b27108d89d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.807342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73c5080d-eeb7-4503-a0d1-f0b27108d89d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.808002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73c5080d-eeb7-4503-a0d1-f0b27108d89d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.808930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73c5080d-eeb7-4503-a0d1-f0b27108d89d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.809577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73c5080d-eeb7-4503-a0d1-f0b27108d89d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.810191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73c5080d-eeb7-4503-a0d1-f0b27108d89d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.840019 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-73c5080d-eeb7-4503-a0d1-f0b27108d89d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] HTTP exception thrown: Instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 could not be found. Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-73c5080d-eeb7-4503-a0d1-f0b27108d89d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Request method failure captured: Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 HTTP/1.1 Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRTT5qTREkpkNCPdk-AWdCDz7Eze_bUOUZoTxPA97pb-_Fn3ivaVXshsMPIryyr9k_9pUqkfpAsRloCcXgTDm5g5QVVbvGASL_JULIA8516e-E7dR8qlaLkKalfaTKCR5xB9-SMbJ06tPwUwLnbDNNEmsRNw9dVyDupUE3r9uy1bclg Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: e7b882a8b2644f1dac937ffcfd1ce14b Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1470360496 Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e7b882a8b2644f1dac937ffcfd1ce14b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e7b882a8b2644f1dac937ffcfd1ce14b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e7b882a8b2644f1dac937ffcfd1ce14b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e7b882a8b2644f1dac937ffcfd1ce14b"}]}] Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1470360496 Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: e7b882a8b2644f1dac937ffcfd1ce14b Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1470360496 Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-FloatingIPsAssociationTestJSON-1470360496-project Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2b5f2c622daa43968a1a23cad5c91a49 Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1470360496-project Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 could not be found. Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'ec0ffe29-2542-4e91-8547-9ef18f242ee5'} Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 could not be found. Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 could not be found. Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:54.843940 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:54.849212 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:54.849212 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:54.849212 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:54.849212 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:54.849212 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:54.849212 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:54.849212 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 could not be found. Aug 23 17:57:54.849212 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:54.854096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-73c5080d-eeb7-4503-a0d1-f0b27108d89d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Returning 404 to user: Instance ec0ffe29-2542-4e91-8547-9ef18f242ee5 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:54.855406 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-73c5080d-eeb7-4503-a0d1-f0b27108d89d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5" status: 404 len: 111 microversion: 2.1 time: 0.082773 Aug 23 17:57:54.857164 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 981/1910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:54 2022] GET /compute/v2.1/servers/ec0ffe29-2542-4e91-8547-9ef18f242ee5 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:57:54.864464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5a638e04-c330-4ce4-8958-f17354716006 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:54.871378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5a638e04-c330-4ce4-8958-f17354716006 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:54.889846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a638e04-c330-4ce4-8958-f17354716006 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.890943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a638e04-c330-4ce4-8958-f17354716006 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.891622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a638e04-c330-4ce4-8958-f17354716006 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:54.892614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a638e04-c330-4ce4-8958-f17354716006 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:54.893286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a638e04-c330-4ce4-8958-f17354716006 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:54.893925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a638e04-c330-4ce4-8958-f17354716006 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:55.023997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-19e08f87-be45-4dec-8907-0e5ec8b2557c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:55.037633 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-19e08f87-be45-4dec-8907-0e5ec8b2557c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1475 microversion: 2.1 time: 0.347082 Aug 23 17:57:55.038943 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 930/1911] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:54 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1475 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:55.062922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5322d31b-0378-497d-ab1d-31a812b3b995 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '.version_select at 0x7f27ec610af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:55.841263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5a638e04-c330-4ce4-8958-f17354716006 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:55.853871 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5a638e04-c330-4ce4-8958-f17354716006 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1512 microversion: 2.1 time: 0.992811 Aug 23 17:57:55.868414 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 982/1912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:54 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1512 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:55.878097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3504ba1e-3103-4a16-8845-7eb86105b1e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:55.878748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3504ba1e-3103-4a16-8845-7eb86105b1e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:55.887168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3504ba1e-3103-4a16-8845-7eb86105b1e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:55.887991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3504ba1e-3103-4a16-8845-7eb86105b1e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:55.889226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3504ba1e-3103-4a16-8845-7eb86105b1e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:55.890128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3504ba1e-3103-4a16-8845-7eb86105b1e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:55.890865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3504ba1e-3103-4a16-8845-7eb86105b1e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:55.891472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3504ba1e-3103-4a16-8845-7eb86105b1e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:56.127650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3504ba1e-3103-4a16-8845-7eb86105b1e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:56.162702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3504ba1e-3103-4a16-8845-7eb86105b1e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:56.167189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3504ba1e-3103-4a16-8845-7eb86105b1e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:56.172719 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3504ba1e-3103-4a16-8845-7eb86105b1e5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.302531 Aug 23 17:57:56.177674 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 983/1913] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:55 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:56.192168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-d71b181a-b232-4db4-9468-991339310e65 req-237ed076-9a80-483c-bd85-cd38719b833b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "153fb085-12d0-4155-a1f7-9e954d51e9c5", "tag": "071d181a-b17b-447a-b61e-a9731c7217ec"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:56.206773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d71b181a-b232-4db4-9468-991339310e65 req-237ed076-9a80-483c-bd85-cd38719b833b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:56.207681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d71b181a-b232-4db4-9468-991339310e65 req-237ed076-9a80-483c-bd85-cd38719b833b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:56.209103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d71b181a-b232-4db4-9468-991339310e65 req-237ed076-9a80-483c-bd85-cd38719b833b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:56.248684 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-d71b181a-b232-4db4-9468-991339310e65 req-237ed076-9a80-483c-bd85-cd38719b833b service nova] Creating event network-changed:071d181a-b17b-447a-b61e-a9731c7217ec for instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 on n-h2-850468-16 Aug 23 17:57:56.253874 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-d71b181a-b232-4db4-9468-991339310e65 req-237ed076-9a80-483c-bd85-cd38719b833b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074061 Aug 23 17:57:56.254878 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 984/1914] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:56.261584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cce3d824-741c-4f52-9ecf-37f66ab0a5d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:56.264026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cce3d824-741c-4f52-9ecf-37f66ab0a5d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:56.271411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cce3d824-741c-4f52-9ecf-37f66ab0a5d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:56.271911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cce3d824-741c-4f52-9ecf-37f66ab0a5d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:56.272347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cce3d824-741c-4f52-9ecf-37f66ab0a5d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:56.273297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cce3d824-741c-4f52-9ecf-37f66ab0a5d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:56.273808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cce3d824-741c-4f52-9ecf-37f66ab0a5d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:56.274241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cce3d824-741c-4f52-9ecf-37f66ab0a5d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:56.308964 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cce3d824-741c-4f52-9ecf-37f66ab0a5d1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052218 Aug 23 17:57:56.314746 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 985/1915] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 17:57:56 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:57:56.319985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d04c06c-8a5c-4cc0-a69e-0fa7517df257 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:56.320521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d04c06c-8a5c-4cc0-a69e-0fa7517df257 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: c3ba76a3-5838-410f-897c-e2edf5812436] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:56.327717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d04c06c-8a5c-4cc0-a69e-0fa7517df257 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:56.328208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d04c06c-8a5c-4cc0-a69e-0fa7517df257 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:56.329112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d04c06c-8a5c-4cc0-a69e-0fa7517df257 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:56.330006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d04c06c-8a5c-4cc0-a69e-0fa7517df257 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:56.330663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d04c06c-8a5c-4cc0-a69e-0fa7517df257 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:56.331254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d04c06c-8a5c-4cc0-a69e-0fa7517df257 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:56.347567 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-7d04c06c-8a5c-4cc0-a69e-0fa7517df257 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] HTTP exception thrown: Instance c3ba76a3-5838-410f-897c-e2edf5812436 could not be found. Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d04c06c-8a5c-4cc0-a69e-0fa7517df257 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Request method failure captured: Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 HTTP/1.1 Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRSJIfRhV-kdvOQ5j9rC0WmSlwrxIQuTT9rI27rt-4xPtE_e40IskAo-AMScO_5vADNqR15INwpp0oY75tIxU8fox4iee0EpKEwYzgbHz45dMfqn5ie0A-s6mC59kC8UPSxdqjWAY-bY2gRuudmFZPIf4z50oYEh4Dy8XXlJlwXjnzY Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: e6e4c52fe92040e9b532db25ee92d308 Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerRescueTestJSON-535501204 Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e6e4c52fe92040e9b532db25ee92d308"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e6e4c52fe92040e9b532db25ee92d308"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e6e4c52fe92040e9b532db25ee92d308"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e6e4c52fe92040e9b532db25ee92d308"}]}] Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerRescueTestJSON-535501204 Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: e6e4c52fe92040e9b532db25ee92d308 Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerRescueTestJSON-535501204 Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerRescueTestJSON-535501204-project Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6efa870487f347eb9886ec8ba62360f8 Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerRescueTestJSON-535501204-project Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance c3ba76a3-5838-410f-897c-e2edf5812436 could not be found. Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'c3ba76a3-5838-410f-897c-e2edf5812436'} Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3ba76a3-5838-410f-897c-e2edf5812436 could not be found. Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3ba76a3-5838-410f-897c-e2edf5812436 could not be found. Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:57:56.349839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:56.357056 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:57:56.357056 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:57:56.357056 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:57:56.357056 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:57:56.357056 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:57:56.357056 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3ba76a3-5838-410f-897c-e2edf5812436 could not be found. Aug 23 17:57:56.357056 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:57:56.359569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d04c06c-8a5c-4cc0-a69e-0fa7517df257 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Returning 404 to user: Instance c3ba76a3-5838-410f-897c-e2edf5812436 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:57:56.360725 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d04c06c-8a5c-4cc0-a69e-0fa7517df257 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436" status: 404 len: 111 microversion: 2.1 time: 0.044991 Aug 23 17:57:56.362178 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 986/1916] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:56 2022] GET /compute/v2.1/servers/c3ba76a3-5838-410f-897c-e2edf5812436 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:57:56.367177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-31bf8d81-e7bf-420b-8c48-b4abdafb4afd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27f1b38820>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:56.450195 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-31bf8d81-e7bf-420b-8c48-b4abdafb4afd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/6039f608-95b5-4680-86ef-f938a472320a" status: 200 len: 662 microversion: 2.1 time: 0.086215 Aug 23 17:57:56.458600 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 987/1917] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:57:56 2022] GET /compute/v2.1/images/6039f608-95b5-4680-86ef-f938a472320a => generated 662 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:56.464474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4df965dc-1c1f-499c-ac9c-d94d6d35ec83 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:56.465103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4df965dc-1c1f-499c-ac9c-d94d6d35ec83 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: f8cfb229-ca34-4883-aa19-33cd91a70dc4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:56.472437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4df965dc-1c1f-499c-ac9c-d94d6d35ec83 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:56.473126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4df965dc-1c1f-499c-ac9c-d94d6d35ec83 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:56.473730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4df965dc-1c1f-499c-ac9c-d94d6d35ec83 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:56.475363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4df965dc-1c1f-499c-ac9c-d94d6d35ec83 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:56.476002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4df965dc-1c1f-499c-ac9c-d94d6d35ec83 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:56.476813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4df965dc-1c1f-499c-ac9c-d94d6d35ec83 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:57.120736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4df965dc-1c1f-499c-ac9c-d94d6d35ec83 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:57.128801 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4df965dc-1c1f-499c-ac9c-d94d6d35ec83 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4" status: 200 len: 1512 microversion: 2.1 time: 0.669082 Aug 23 17:57:57.129378 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 988/1918] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:56 2022] GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4 => generated 1512 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:57.154599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-082d742a-6035-4e46-a030-22621b0038e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:57.155591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-082d742a-6035-4e46-a030-22621b0038e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:57.180984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-082d742a-6035-4e46-a030-22621b0038e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:57.183138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-082d742a-6035-4e46-a030-22621b0038e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:57.185320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-082d742a-6035-4e46-a030-22621b0038e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:57.188059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-082d742a-6035-4e46-a030-22621b0038e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:57.189150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-082d742a-6035-4e46-a030-22621b0038e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:57.190285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-082d742a-6035-4e46-a030-22621b0038e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:57.507207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-082d742a-6035-4e46-a030-22621b0038e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:57.517248 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-082d742a-6035-4e46-a030-22621b0038e3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1475 microversion: 2.1 time: 0.368319 Aug 23 17:57:57.517824 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 989/1919] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:57 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1475 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:57.528725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c446f468-55a2-4c92-b202-835ce6f5905f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:57.532525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c446f468-55a2-4c92-b202-835ce6f5905f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:57.546057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c446f468-55a2-4c92-b202-835ce6f5905f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:57.546487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c446f468-55a2-4c92-b202-835ce6f5905f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:57.547898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c446f468-55a2-4c92-b202-835ce6f5905f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:57.549110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c446f468-55a2-4c92-b202-835ce6f5905f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:57.549880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c446f468-55a2-4c92-b202-835ce6f5905f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:57.550467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c446f468-55a2-4c92-b202-835ce6f5905f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:57.603076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c446f468-55a2-4c92-b202-835ce6f5905f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:57:57.714627 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c446f468-55a2-4c92-b202-835ce6f5905f tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "DELETE /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 204 len: 0 microversion: 2.1 time: 0.192296 Aug 23 17:57:57.717361 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 990/1920] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:57:57 2022] DELETE /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 0 bytes in 198 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:57:57.724643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a51380a8-7f96-4966-bc1a-2925d0312b92 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27f1c51790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:57.781714 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a51380a8-7f96-4966-bc1a-2925d0312b92 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/6039f608-95b5-4680-86ef-f938a472320a" status: 200 len: 662 microversion: 2.1 time: 0.061917 Aug 23 17:57:57.782656 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 991/1921] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:57:57 2022] GET /compute/v2.1/images/6039f608-95b5-4680-86ef-f938a472320a => generated 662 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:57.793155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:57.801817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:57.804111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:57:57.831724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:57.832474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:57.833559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:57.834431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:57.835405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:57.836279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:57.991292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:57:58.069638 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5322d31b-0378-497d-ab1d-31a812b3b995 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/b4abf8da-3aba-44eb-bf19-2e139e3b18b3" status: 202 len: 0 microversion: 2.1 time: 3.029616 Aug 23 17:57:58.070817 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 931/1922] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 17:57:55 2022] DELETE /compute/v2.1/os-floating-ips/b4abf8da-3aba-44eb-bf19-2e139e3b18b3 => generated 0 bytes in 3031 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:57:58.076551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e71d2b2-99d4-43ba-b671-afbaabf55d8a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:58.077168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e71d2b2-99d4-43ba-b671-afbaabf55d8a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:58.091328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e71d2b2-99d4-43ba-b671-afbaabf55d8a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.091827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e71d2b2-99d4-43ba-b671-afbaabf55d8a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.092272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e71d2b2-99d4-43ba-b671-afbaabf55d8a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.093000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e71d2b2-99d4-43ba-b671-afbaabf55d8a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.093450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e71d2b2-99d4-43ba-b671-afbaabf55d8a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.106275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e71d2b2-99d4-43ba-b671-afbaabf55d8a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.129168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:58.139582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.140064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.140706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.346024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8e71d2b2-99d4-43ba-b671-afbaabf55d8a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:58.361109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8e71d2b2-99d4-43ba-b671-afbaabf55d8a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:58.363636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8e71d2b2-99d4-43ba-b671-afbaabf55d8a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:58.365114 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e71d2b2-99d4-43ba-b671-afbaabf55d8a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.292730 Aug 23 17:57:58.365869 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 932/1923] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:58 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:57:58.375443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e95a7f3f-dc0a-4af9-8929-b38f61fe3adb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:58.377161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e95a7f3f-dc0a-4af9-8929-b38f61fe3adb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:58.391752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e95a7f3f-dc0a-4af9-8929-b38f61fe3adb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.392246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e95a7f3f-dc0a-4af9-8929-b38f61fe3adb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.393258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e95a7f3f-dc0a-4af9-8929-b38f61fe3adb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.393529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e95a7f3f-dc0a-4af9-8929-b38f61fe3adb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.394250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e95a7f3f-dc0a-4af9-8929-b38f61fe3adb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.394490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e95a7f3f-dc0a-4af9-8929-b38f61fe3adb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.405266 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9fc8833e-8c62-4492-918b-509255b266cf tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.621325 Aug 23 17:57:58.406201 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 992/1924] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Aug 23 17:57:57 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:58.411950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c25b91bd-93d7-40df-8d2e-41cff3ec9865 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:58.412936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c25b91bd-93d7-40df-8d2e-41cff3ec9865 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:58.421996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c25b91bd-93d7-40df-8d2e-41cff3ec9865 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.422943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c25b91bd-93d7-40df-8d2e-41cff3ec9865 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.423631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c25b91bd-93d7-40df-8d2e-41cff3ec9865 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.424601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c25b91bd-93d7-40df-8d2e-41cff3ec9865 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.425292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c25b91bd-93d7-40df-8d2e-41cff3ec9865 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.426057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c25b91bd-93d7-40df-8d2e-41cff3ec9865 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.460672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c25b91bd-93d7-40df-8d2e-41cff3ec9865 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:57:58.538654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:57:58.613216 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c25b91bd-93d7-40df-8d2e-41cff3ec9865 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "DELETE /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 204 len: 0 microversion: 2.1 time: 0.205379 Aug 23 17:57:58.620335 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 993/1925] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:57:58 2022] DELETE /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:57:58.627535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-0feaf313-043f-434f-a428-6440dc876dbe req-9fa4c762-47b1-4cc4-80b4-87c81bb49deb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a4ebc8-3d93-4377-beec-accf25eee386", "name": "network-vif-unplugged", "status": "completed", "tag": "67689804-86f0-4754-bb53-ddbce34de8e9"}, {"name": "network-changed", "server_uuid": "13a4ebc8-3d93-4377-beec-accf25eee386", "tag": "67689804-86f0-4754-bb53-ddbce34de8e9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:57:58.638115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0feaf313-043f-434f-a428-6440dc876dbe req-9fa4c762-47b1-4cc4-80b4-87c81bb49deb service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.638626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0feaf313-043f-434f-a428-6440dc876dbe req-9fa4c762-47b1-4cc4-80b4-87c81bb49deb service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.639058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0feaf313-043f-434f-a428-6440dc876dbe req-9fa4c762-47b1-4cc4-80b4-87c81bb49deb service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.649412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e95a7f3f-dc0a-4af9-8929-b38f61fe3adb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:58.655842 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-0feaf313-043f-434f-a428-6440dc876dbe req-9fa4c762-47b1-4cc4-80b4-87c81bb49deb service nova] Creating event network-vif-unplugged:67689804-86f0-4754-bb53-ddbce34de8e9 for instance 13a4ebc8-3d93-4377-beec-accf25eee386 on n-h2-850468-16 Aug 23 17:57:58.656361 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-0feaf313-043f-434f-a428-6440dc876dbe req-9fa4c762-47b1-4cc4-80b4-87c81bb49deb service nova] Creating event network-changed:67689804-86f0-4754-bb53-ddbce34de8e9 for instance 13a4ebc8-3d93-4377-beec-accf25eee386 on n-h2-850468-16 Aug 23 17:57:58.663029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-0feaf313-043f-434f-a428-6440dc876dbe req-9fa4c762-47b1-4cc4-80b4-87c81bb49deb service nova] Instance 13a4ebc8-3d93-4377-beec-accf25eee386 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 17:57:58.676689 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-0feaf313-043f-434f-a428-6440dc876dbe req-9fa4c762-47b1-4cc4-80b4-87c81bb49deb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.054793 Aug 23 17:57:58.677544 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e95a7f3f-dc0a-4af9-8929-b38f61fe3adb tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1492 microversion: 2.1 time: 0.305419 Aug 23 17:57:58.677680 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 994/1926] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:58.685495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:58.690845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:58.692910 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 933/1927] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:58 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1492 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:58.698512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7471ade5-7140-4d37-8ceb-4176893be27c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:58.699462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7471ade5-7140-4d37-8ceb-4176893be27c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:58.703379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1511204069', 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:57:58.707656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7471ade5-7140-4d37-8ceb-4176893be27c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.708349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7471ade5-7140-4d37-8ceb-4176893be27c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.708953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7471ade5-7140-4d37-8ceb-4176893be27c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.709855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7471ade5-7140-4d37-8ceb-4176893be27c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.710473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7471ade5-7140-4d37-8ceb-4176893be27c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.711081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7471ade5-7140-4d37-8ceb-4176893be27c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.711216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.711684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.712122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.713419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.713876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.714305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.897516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:57:58.918168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7471ade5-7140-4d37-8ceb-4176893be27c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:58.938341 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7471ade5-7140-4d37-8ceb-4176893be27c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1475 microversion: 2.1 time: 0.236379 Aug 23 17:57:58.939899 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 934/1928] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:58 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1475 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:58.950249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e230b1c9-25a0-4484-801f-d9f1f76b3576 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:58.950896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e230b1c9-25a0-4484-801f-d9f1f76b3576 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:58.964551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e230b1c9-25a0-4484-801f-d9f1f76b3576 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.965092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e230b1c9-25a0-4484-801f-d9f1f76b3576 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.972150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e230b1c9-25a0-4484-801f-d9f1f76b3576 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:58.973447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e230b1c9-25a0-4484-801f-d9f1f76b3576 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:58.974767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e230b1c9-25a0-4484-801f-d9f1f76b3576 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:58.975435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e230b1c9-25a0-4484-801f-d9f1f76b3576 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:59.015970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:59.030515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:59.031644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:59.033766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:59.248216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e230b1c9-25a0-4484-801f-d9f1f76b3576 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:59.260427 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e230b1c9-25a0-4484-801f-d9f1f76b3576 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1526 microversion: 2.1 time: 0.317920 Aug 23 17:57:59.261525 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 935/1929] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:58 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1526 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:59.396590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-170b2839-da4f-4063-a036-bf9ebe1bc140 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:59.397698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-170b2839-da4f-4063-a036-bf9ebe1bc140 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:59.414871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-170b2839-da4f-4063-a036-bf9ebe1bc140 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:59.417203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-170b2839-da4f-4063-a036-bf9ebe1bc140 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:59.417916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-170b2839-da4f-4063-a036-bf9ebe1bc140 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:59.423004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-170b2839-da4f-4063-a036-bf9ebe1bc140 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:59.423555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-170b2839-da4f-4063-a036-bf9ebe1bc140 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:59.424154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-170b2839-da4f-4063-a036-bf9ebe1bc140 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:59.586206 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1100dd9f-1535-45cd-b9ed-02115dfd71fa tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1511204069" status: 200 len: 1515 microversion: 2.1 time: 0.905066 Aug 23 17:57:59.587460 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 995/1930] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 17:57:58 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-1511204069 => generated 1515 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:57:59.592507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b5e7c438-13ff-4493-9e79-3b83630929d1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27f1c5af70>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:59.624333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-170b2839-da4f-4063-a036-bf9ebe1bc140 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:59.644358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-170b2839-da4f-4063-a036-bf9ebe1bc140 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:59.645890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-170b2839-da4f-4063-a036-bf9ebe1bc140 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:59.656693 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-170b2839-da4f-4063-a036-bf9ebe1bc140 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.266356 Aug 23 17:57:59.666877 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b5e7c438-13ff-4493-9e79-3b83630929d1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/8082b5c0-3741-4bc5-bf43-824950536e00" status: 200 len: 661 microversion: 2.1 time: 0.076974 Aug 23 17:57:59.668570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 936/1931] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:57:59 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:57:59.676056 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 996/1932] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:57:59 2022] GET /compute/v2.1/images/8082b5c0-3741-4bc5-bf43-824950536e00 => generated 661 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:59.678754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:59.681929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a21ea456-0623-4230-a54e-83dd8b5b2387 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27f1b38dc0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:59.689214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:57:59.695449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:57:59.711757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:59.714911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:59.718340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:59.727978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:59.728894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:59.731960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:59.761868 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a21ea456-0623-4230-a54e-83dd8b5b2387 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/8082b5c0-3741-4bc5-bf43-824950536e00" status: 200 len: 661 microversion: 2.1 time: 0.084205 Aug 23 17:57:59.762489 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 997/1933] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:57:59 2022] GET /compute/v2.1/images/8082b5c0-3741-4bc5-bf43-824950536e00 => generated 661 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:57:59.788829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e943045-3541-42c0-a821-c5fca20045fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:57:59.790241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2e943045-3541-42c0-a821-c5fca20045fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:57:59.809472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e943045-3541-42c0-a821-c5fca20045fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:59.811105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e943045-3541-42c0-a821-c5fca20045fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:59.811778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e943045-3541-42c0-a821-c5fca20045fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:59.814672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e943045-3541-42c0-a821-c5fca20045fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:57:59.815340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e943045-3541-42c0-a821-c5fca20045fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:57:59.815988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e943045-3541-42c0-a821-c5fca20045fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:57:59.942978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:00.051429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:00.060380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:00.061248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:00.061882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:00.317976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2e943045-3541-42c0-a821-c5fca20045fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:00.325213 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a326b010-22f0-44ae-97e6-e5044e5a98f4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4519 microversion: 2.1 time: 0.654946 Aug 23 17:58:00.326705 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e943045-3541-42c0-a821-c5fca20045fa tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1492 microversion: 2.1 time: 0.551370 Aug 23 17:58:00.327284 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 998/1934] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:57:59 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1492 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:00.328160 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 937/1935] 10.222.0.61 () {58 vars in 1173 bytes} [Tue Aug 23 17:57:59 2022] GET /compute/v2.1/servers/detail?status=active => generated 4519 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:00.331768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7f498412-8851-41c6-ae86-e8c611483a1a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:00.332376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7f498412-8851-41c6-ae86-e8c611483a1a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:00.333725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ddc0d953-5f30-4657-b509-ba86f18843dd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:00.335919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ddc0d953-5f30-4657-b509-ba86f18843dd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:00.345165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddc0d953-5f30-4657-b509-ba86f18843dd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:00.345908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddc0d953-5f30-4657-b509-ba86f18843dd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:00.346961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddc0d953-5f30-4657-b509-ba86f18843dd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:00.347964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddc0d953-5f30-4657-b509-ba86f18843dd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:00.348651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddc0d953-5f30-4657-b509-ba86f18843dd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:00.349323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddc0d953-5f30-4657-b509-ba86f18843dd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:00.352461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f498412-8851-41c6-ae86-e8c611483a1a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:00.353527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f498412-8851-41c6-ae86-e8c611483a1a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:00.356909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f498412-8851-41c6-ae86-e8c611483a1a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:00.357662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f498412-8851-41c6-ae86-e8c611483a1a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:00.358130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f498412-8851-41c6-ae86-e8c611483a1a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:00.358599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f498412-8851-41c6-ae86-e8c611483a1a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:00.559895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ddc0d953-5f30-4657-b509-ba86f18843dd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:00.568776 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ddc0d953-5f30-4657-b509-ba86f18843dd tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1526 microversion: 2.1 time: 0.239127 Aug 23 17:58:00.570480 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 938/1936] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:00 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1526 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:00.575852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:00.581455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:00.582093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.compute.servers [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Removing options 'limit' from query {{(pid=128808) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 23 17:58:00.582944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:00.593456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:00.594035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:00.594570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:00.595395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:00.596188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:00.596700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:00.661121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:00.678107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:00.678872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:00.679339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:00.725471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7f498412-8851-41c6-ae86-e8c611483a1a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:00.735532 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7f498412-8851-41c6-ae86-e8c611483a1a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1475 microversion: 2.1 time: 0.407112 Aug 23 17:58:00.755113 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 999/1937] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:00 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1475 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:00.760640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f00fa3ed-c5ca-4b6c-84d1-2e42443e1061 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:00.761615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f00fa3ed-c5ca-4b6c-84d1-2e42443e1061 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:00.775418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f00fa3ed-c5ca-4b6c-84d1-2e42443e1061 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:00.776247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f00fa3ed-c5ca-4b6c-84d1-2e42443e1061 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:00.776957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f00fa3ed-c5ca-4b6c-84d1-2e42443e1061 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:00.777937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f00fa3ed-c5ca-4b6c-84d1-2e42443e1061 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:00.778990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f00fa3ed-c5ca-4b6c-84d1-2e42443e1061 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:00.779666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f00fa3ed-c5ca-4b6c-84d1-2e42443e1061 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:00.876121 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-92d8ebe3-023f-49b1-9231-16ab7a45dbae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.304445 Aug 23 17:58:00.876751 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 939/1938] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 17:58:00 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:00.902189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7a1c1fb2-0a69-480d-9bd1-58f20bbb6a6c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:00.907150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a1c1fb2-0a69-480d-9bd1-58f20bbb6a6c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:00.907867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7a1c1fb2-0a69-480d-9bd1-58f20bbb6a6c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:00.923800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a1c1fb2-0a69-480d-9bd1-58f20bbb6a6c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:00.924286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a1c1fb2-0a69-480d-9bd1-58f20bbb6a6c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:00.924727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a1c1fb2-0a69-480d-9bd1-58f20bbb6a6c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:00.925510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a1c1fb2-0a69-480d-9bd1-58f20bbb6a6c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:00.925957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a1c1fb2-0a69-480d-9bd1-58f20bbb6a6c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:00.926378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a1c1fb2-0a69-480d-9bd1-58f20bbb6a6c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:01.141020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-7a1c1fb2-0a69-480d-9bd1-58f20bbb6a6c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:01.327859 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7a1c1fb2-0a69-480d-9bd1-58f20bbb6a6c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?status=active" status: 200 len: 1012 microversion: 2.1 time: 0.429688 Aug 23 17:58:01.335646 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 940/1939] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:58:00 2022] GET /compute/v2.1/servers?status=active => generated 1012 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:01.347343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2c73be8f-31bc-45e1-b258-6dea79119fb4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:01.365125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2c73be8f-31bc-45e1-b258-6dea79119fb4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:01.365624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.compute.servers [None req-2c73be8f-31bc-45e1-b258-6dea79119fb4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Removing options 'limit' from query {{(pid=128808) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 23 17:58:01.366490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2c73be8f-31bc-45e1-b258-6dea79119fb4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:01.374872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c73be8f-31bc-45e1-b258-6dea79119fb4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:01.374872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c73be8f-31bc-45e1-b258-6dea79119fb4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:01.376040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c73be8f-31bc-45e1-b258-6dea79119fb4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:01.376977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c73be8f-31bc-45e1-b258-6dea79119fb4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:01.386059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c73be8f-31bc-45e1-b258-6dea79119fb4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:01.387367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c73be8f-31bc-45e1-b258-6dea79119fb4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:01.461786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f00fa3ed-c5ca-4b6c-84d1-2e42443e1061 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:01.476598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-2c73be8f-31bc-45e1-b258-6dea79119fb4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:01.488214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f00fa3ed-c5ca-4b6c-84d1-2e42443e1061 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:01.490262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f00fa3ed-c5ca-4b6c-84d1-2e42443e1061 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:01.491718 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f00fa3ed-c5ca-4b6c-84d1-2e42443e1061 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.735152 Aug 23 17:58:01.492798 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1000/1940] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:00 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:01.502103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8dbe3f92-b7ac-4061-b974-637ca516e1b7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:01.503013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8dbe3f92-b7ac-4061-b974-637ca516e1b7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:01.512834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dbe3f92-b7ac-4061-b974-637ca516e1b7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:01.523266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dbe3f92-b7ac-4061-b974-637ca516e1b7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:01.523986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dbe3f92-b7ac-4061-b974-637ca516e1b7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:01.524970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dbe3f92-b7ac-4061-b974-637ca516e1b7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:01.526045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dbe3f92-b7ac-4061-b974-637ca516e1b7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:01.526754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dbe3f92-b7ac-4061-b974-637ca516e1b7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:01.543586 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2c73be8f-31bc-45e1-b258-6dea79119fb4 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1012 microversion: 2.1 time: 0.201656 Aug 23 17:58:01.544489 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 941/1941] 10.222.0.61 () {58 vars in 1150 bytes} [Tue Aug 23 17:58:01 2022] GET /compute/v2.1/servers?limit=100000 => generated 1012 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:01.550532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9fc93574-c2c7-4a5e-bcf7-7a85bc987213 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec3e3550>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:01.642851 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9fc93574-c2c7-4a5e-bcf7-7a85bc987213 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/436f3deb-9160-4ddf-8dba-5ffe42a4e38f" status: 200 len: 662 microversion: 2.1 time: 0.097140 Aug 23 17:58:01.650739 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 942/1942] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:01 2022] GET /compute/v2.1/images/436f3deb-9160-4ddf-8dba-5ffe42a4e38f => generated 662 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:01.667125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ba3c7ae-2ce5-4fc8-bf2a-30bcf2c7a36e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:01.672595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2ba3c7ae-2ce5-4fc8-bf2a-30bcf2c7a36e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:01.673363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2ba3c7ae-2ce5-4fc8-bf2a-30bcf2c7a36e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:01.678785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ba3c7ae-2ce5-4fc8-bf2a-30bcf2c7a36e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:01.679382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ba3c7ae-2ce5-4fc8-bf2a-30bcf2c7a36e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:01.679946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ba3c7ae-2ce5-4fc8-bf2a-30bcf2c7a36e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:01.680784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ba3c7ae-2ce5-4fc8-bf2a-30bcf2c7a36e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:01.681912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ba3c7ae-2ce5-4fc8-bf2a-30bcf2c7a36e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:01.682439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ba3c7ae-2ce5-4fc8-bf2a-30bcf2c7a36e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:01.756753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-2ba3c7ae-2ce5-4fc8-bf2a-30bcf2c7a36e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:01.781780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:01.801990 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2ba3c7ae-2ce5-4fc8-bf2a-30bcf2c7a36e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1012 microversion: 2.1 time: 0.156854 Aug 23 17:58:01.802985 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 943/1943] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 17:58:01 2022] GET /compute/v2.1/servers => generated 1012 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:01.809892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2d58525d-1369-49bc-bc7f-281161f852bb tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:01.810614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2d58525d-1369-49bc-bc7f-281161f852bb tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:01.819628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d58525d-1369-49bc-bc7f-281161f852bb tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:01.820125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d58525d-1369-49bc-bc7f-281161f852bb tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:01.820624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d58525d-1369-49bc-bc7f-281161f852bb tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:01.821348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d58525d-1369-49bc-bc7f-281161f852bb tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:01.823248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d58525d-1369-49bc-bc7f-281161f852bb tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:01.823930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d58525d-1369-49bc-bc7f-281161f852bb tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:01.930374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8dbe3f92-b7ac-4061-b974-637ca516e1b7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:01.947317 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8dbe3f92-b7ac-4061-b974-637ca516e1b7 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1492 microversion: 2.1 time: 0.452504 Aug 23 17:58:01.961224 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1001/1944] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:01 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1492 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:01.970036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9cf845d5-f198-4c06-a285-350c348c1c92 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec0eeaf0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:02.035487 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9cf845d5-f198-4c06-a285-350c348c1c92 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/436f3deb-9160-4ddf-8dba-5ffe42a4e38f" status: 200 len: 662 microversion: 2.1 time: 0.071020 Aug 23 17:58:02.036286 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1002/1945] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:01 2022] GET /compute/v2.1/images/436f3deb-9160-4ddf-8dba-5ffe42a4e38f => generated 662 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:02.050084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e244ff7-3358-4a63-80be-68bc1cf9165b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:02.051138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4e244ff7-3358-4a63-80be-68bc1cf9165b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:02.063193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2d58525d-1369-49bc-bc7f-281161f852bb tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:02.065489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e244ff7-3358-4a63-80be-68bc1cf9165b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:02.066005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e244ff7-3358-4a63-80be-68bc1cf9165b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:02.070085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e244ff7-3358-4a63-80be-68bc1cf9165b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:02.070983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e244ff7-3358-4a63-80be-68bc1cf9165b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:02.071473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e244ff7-3358-4a63-80be-68bc1cf9165b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:02.071955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e244ff7-3358-4a63-80be-68bc1cf9165b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:02.073911 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2d58525d-1369-49bc-bc7f-281161f852bb tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1526 microversion: 2.1 time: 0.269765 Aug 23 17:58:02.074851 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 944/1946] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:01 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1526 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:02.079462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5db3fdc4-ae9c-4dd0-911f-31067107b628 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:02.087702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5db3fdc4-ae9c-4dd0-911f-31067107b628 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:02.087702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5db3fdc4-ae9c-4dd0-911f-31067107b628 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:02.110766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5db3fdc4-ae9c-4dd0-911f-31067107b628 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:02.111389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5db3fdc4-ae9c-4dd0-911f-31067107b628 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:02.112251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5db3fdc4-ae9c-4dd0-911f-31067107b628 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:02.113079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5db3fdc4-ae9c-4dd0-911f-31067107b628 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:02.113622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5db3fdc4-ae9c-4dd0-911f-31067107b628 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:02.114154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5db3fdc4-ae9c-4dd0-911f-31067107b628 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:02.219703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-5db3fdc4-ae9c-4dd0-911f-31067107b628 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:02.345471 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5db3fdc4-ae9c-4dd0-911f-31067107b628 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.269396 Aug 23 17:58:02.358412 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 945/1947] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:58:02 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:02.363380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1467259411", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:02.401460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e244ff7-3358-4a63-80be-68bc1cf9165b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:02.424852 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e244ff7-3358-4a63-80be-68bc1cf9165b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1473 microversion: 2.1 time: 0.383323 Aug 23 17:58:02.429734 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1003/1948] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:02 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1473 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:02.438228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1a83b1ad-bab7-4ea7-8dc0-cf061b4f1f1c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:02.452648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1a83b1ad-bab7-4ea7-8dc0-cf061b4f1f1c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:02.453933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.compute.servers [None req-1a83b1ad-bab7-4ea7-8dc0-cf061b4f1f1c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Removing options 'limit' from query {{(pid=128807) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 23 17:58:02.454677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1a83b1ad-bab7-4ea7-8dc0-cf061b4f1f1c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:02.475695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a83b1ad-bab7-4ea7-8dc0-cf061b4f1f1c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:02.476204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a83b1ad-bab7-4ea7-8dc0-cf061b4f1f1c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:02.476646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a83b1ad-bab7-4ea7-8dc0-cf061b4f1f1c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:02.477402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a83b1ad-bab7-4ea7-8dc0-cf061b4f1f1c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:02.478441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a83b1ad-bab7-4ea7-8dc0-cf061b4f1f1c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:02.478928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a83b1ad-bab7-4ea7-8dc0-cf061b4f1f1c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:02.479767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:58:02.594449 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1a83b1ad-bab7-4ea7-8dc0-cf061b4f1f1c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.163367 Aug 23 17:58:02.596690 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1004/1949] 10.222.0.61 () {58 vars in 1140 bytes} [Tue Aug 23 17:58:02 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:02.616326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f4a959ea-5dff-47b8-a2e9-273c8b88ff6d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:02.616975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f4a959ea-5dff-47b8-a2e9-273c8b88ff6d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:02.629413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4a959ea-5dff-47b8-a2e9-273c8b88ff6d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:02.630246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4a959ea-5dff-47b8-a2e9-273c8b88ff6d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:02.630727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4a959ea-5dff-47b8-a2e9-273c8b88ff6d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:02.631472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4a959ea-5dff-47b8-a2e9-273c8b88ff6d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:02.632086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4a959ea-5dff-47b8-a2e9-273c8b88ff6d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:02.632532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4a959ea-5dff-47b8-a2e9-273c8b88ff6d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:02.760611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:58:02.761123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:58:02.766282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:58:02.766836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:58:02.767586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:58:02.786746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:02.786986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:02.791443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:02.792374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:02.792857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:02.793300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:02.860836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Getting quotas for project ebd71f6578d64eaba0553c3fcd9c4fd5. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:58:02.874776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Getting quotas for user b3e58be0c76141c582ea59fbf64fddc4 and project ebd71f6578d64eaba0553c3fcd9c4fd5. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:58:02.890001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:58:02.892604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:58:02.957637 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5779de38-af05-4fa4-96e0-7ef4bb8bfd8f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.597843 Aug 23 17:58:02.958480 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 946/1950] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:58:02.964309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2b5bbc48-9f15-4ddc-a73d-f58f1c4a34c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:02.977162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2b5bbc48-9f15-4ddc-a73d-f58f1c4a34c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:02.980627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2b5bbc48-9f15-4ddc-a73d-f58f1c4a34c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-1511204069', 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:02.989855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f4a959ea-5dff-47b8-a2e9-273c8b88ff6d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:03.007712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b5bbc48-9f15-4ddc-a73d-f58f1c4a34c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:03.010809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b5bbc48-9f15-4ddc-a73d-f58f1c4a34c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:03.012332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b5bbc48-9f15-4ddc-a73d-f58f1c4a34c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:03.021048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f4a959ea-5dff-47b8-a2e9-273c8b88ff6d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:03.023613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f4a959ea-5dff-47b8-a2e9-273c8b88ff6d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:03.025934 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f4a959ea-5dff-47b8-a2e9-273c8b88ff6d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.425030 Aug 23 17:58:03.027187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b5bbc48-9f15-4ddc-a73d-f58f1c4a34c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:03.029184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b5bbc48-9f15-4ddc-a73d-f58f1c4a34c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:03.037811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b5bbc48-9f15-4ddc-a73d-f58f1c4a34c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:03.047413 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1005/1951] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:02 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:03.053643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-178f20a6-fb6b-4459-9d66-33e2782a1798 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:03.054253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-178f20a6-fb6b-4459-9d66-33e2782a1798 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:03.076434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-178f20a6-fb6b-4459-9d66-33e2782a1798 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:03.077043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-178f20a6-fb6b-4459-9d66-33e2782a1798 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:03.077531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-178f20a6-fb6b-4459-9d66-33e2782a1798 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:03.078225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-178f20a6-fb6b-4459-9d66-33e2782a1798 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:03.078720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-178f20a6-fb6b-4459-9d66-33e2782a1798 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:03.079172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-178f20a6-fb6b-4459-9d66-33e2782a1798 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:03.344144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-2b5bbc48-9f15-4ddc-a73d-f58f1c4a34c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:03.452301 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2b5bbc48-9f15-4ddc-a73d-f58f1c4a34c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1511204069" status: 200 len: 346 microversion: 2.1 time: 0.492389 Aug 23 17:58:03.459171 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 947/1952] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Aug 23 17:58:02 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-1511204069 => generated 346 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:03.474556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33f63acc-e07a-455a-92a3-d4c626ecec32 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:03.476328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33f63acc-e07a-455a-92a3-d4c626ecec32 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:03.488629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33f63acc-e07a-455a-92a3-d4c626ecec32 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:03.491338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33f63acc-e07a-455a-92a3-d4c626ecec32 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:03.494749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33f63acc-e07a-455a-92a3-d4c626ecec32 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:03.495837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33f63acc-e07a-455a-92a3-d4c626ecec32 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:03.496510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33f63acc-e07a-455a-92a3-d4c626ecec32 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:03.497151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33f63acc-e07a-455a-92a3-d4c626ecec32 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:03.698292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-178f20a6-fb6b-4459-9d66-33e2782a1798 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:03.716964 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-178f20a6-fb6b-4459-9d66-33e2782a1798 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1492 microversion: 2.1 time: 0.668331 Aug 23 17:58:03.717881 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1006/1953] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:03 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1492 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:03.726796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-1575965099", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:03.780763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-33f63acc-e07a-455a-92a3-d4c626ecec32 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:03.794637 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-33f63acc-e07a-455a-92a3-d4c626ecec32 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1526 microversion: 2.1 time: 0.331297 Aug 23 17:58:03.806623 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 948/1954] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:03 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1526 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:03.811000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2d908ab4-e883-4538-9608-ab385acf1139 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:03.811000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2d908ab4-e883-4538-9608-ab385acf1139 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:03.831019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d908ab4-e883-4538-9608-ab385acf1139 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:03.832519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d908ab4-e883-4538-9608-ab385acf1139 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:03.833752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d908ab4-e883-4538-9608-ab385acf1139 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:03.835037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d908ab4-e883-4538-9608-ab385acf1139 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:03.836956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d908ab4-e883-4538-9608-ab385acf1139 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:03.838758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d908ab4-e883-4538-9608-ab385acf1139 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:03.859760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:58:04.217629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:58:04.218316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:58:04.222922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:58:04.223367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:58:04.224008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:58:04.241307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:04.242197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:04.243454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:04.245505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:04.246166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:04.247347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:04.286259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Getting quotas for project ebd71f6578d64eaba0553c3fcd9c4fd5. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:58:04.289207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:04.296126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Getting quotas for user b3e58be0c76141c582ea59fbf64fddc4 and project ebd71f6578d64eaba0553c3fcd9c4fd5. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:58:04.317684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:58:04.323013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:58:04.421747 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-baff2417-75dd-4f85-8005-d10acd309a68 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702878 Aug 23 17:58:04.427086 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1007/1955] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:58:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:58:04.443341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b32f1fbf-9772-4d53-b741-f2feb333c56f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:04.466729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b32f1fbf-9772-4d53-b741-f2feb333c56f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:04.467225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b32f1fbf-9772-4d53-b741-f2feb333c56f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:04.468154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b32f1fbf-9772-4d53-b741-f2feb333c56f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:04.563199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b32f1fbf-9772-4d53-b741-f2feb333c56f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Going to try to stop instance {{(pid=128807) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 17:58:04.659130 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b32f1fbf-9772-4d53-b741-f2feb333c56f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "POST /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c/action" status: 202 len: 0 microversion: 2.1 time: 0.229126 Aug 23 17:58:04.660419 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1008/1956] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:58:04 2022] POST /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:58:04.674394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5fc2bc68-55fc-43a6-a103-595b4a9a2780 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:04.675482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5fc2bc68-55fc-43a6-a103-595b4a9a2780 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:04.691409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2d908ab4-e883-4538-9608-ab385acf1139 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:04.693470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5fc2bc68-55fc-43a6-a103-595b4a9a2780 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:04.695845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5fc2bc68-55fc-43a6-a103-595b4a9a2780 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:04.696451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5fc2bc68-55fc-43a6-a103-595b4a9a2780 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:04.699202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5fc2bc68-55fc-43a6-a103-595b4a9a2780 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:04.700504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5fc2bc68-55fc-43a6-a103-595b4a9a2780 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:04.701056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5fc2bc68-55fc-43a6-a103-595b4a9a2780 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:04.758110 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2d908ab4-e883-4538-9608-ab385acf1139 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1473 microversion: 2.1 time: 0.949575 Aug 23 17:58:04.761616 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 949/1957] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:03 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1473 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:04.799203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-637f90ad-7c78-4d63-bbf4-cfc9b170add1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:04.800919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-637f90ad-7c78-4d63-bbf4-cfc9b170add1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:05.185438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-637f90ad-7c78-4d63-bbf4-cfc9b170add1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:05.198312 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-637f90ad-7c78-4d63-bbf4-cfc9b170add1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1218 microversion: 2.1 time: 0.423742 Aug 23 17:58:05.202691 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 950/1958] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:04 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1218 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:05.229386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ea694525-3fd0-4803-851d-2d7f49cf8f82 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:05.230153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ea694525-3fd0-4803-851d-2d7f49cf8f82 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:05.249767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea694525-3fd0-4803-851d-2d7f49cf8f82 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:05.250730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea694525-3fd0-4803-851d-2d7f49cf8f82 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:05.251420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea694525-3fd0-4803-851d-2d7f49cf8f82 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:05.252541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea694525-3fd0-4803-851d-2d7f49cf8f82 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:05.253248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea694525-3fd0-4803-851d-2d7f49cf8f82 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:05.253924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea694525-3fd0-4803-851d-2d7f49cf8f82 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:05.753017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5fc2bc68-55fc-43a6-a103-595b4a9a2780 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:05.787397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5fc2bc68-55fc-43a6-a103-595b4a9a2780 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:05.789091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5fc2bc68-55fc-43a6-a103-595b4a9a2780 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:05.790424 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5fc2bc68-55fc-43a6-a103-595b4a9a2780 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 1.128585 Aug 23 17:58:05.791907 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1009/1959] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:04 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:05.821561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6823f0c6-bc51-417e-a493-7e85db11a560 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:05.822698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6823f0c6-bc51-417e-a493-7e85db11a560 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:05.839198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6823f0c6-bc51-417e-a493-7e85db11a560 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:05.839700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6823f0c6-bc51-417e-a493-7e85db11a560 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:05.840156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6823f0c6-bc51-417e-a493-7e85db11a560 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:05.841112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6823f0c6-bc51-417e-a493-7e85db11a560 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:05.849102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6823f0c6-bc51-417e-a493-7e85db11a560 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:05.850145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6823f0c6-bc51-417e-a493-7e85db11a560 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:05.901197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ea694525-3fd0-4803-851d-2d7f49cf8f82 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:05.923053 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ea694525-3fd0-4803-851d-2d7f49cf8f82 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.704699 Aug 23 17:58:05.923723 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 951/1960] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:05 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:05.947464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0e3d9969-9672-46f1-b5f2-3d8ff829406d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:05.948801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0e3d9969-9672-46f1-b5f2-3d8ff829406d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:05.962844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e3d9969-9672-46f1-b5f2-3d8ff829406d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:05.963768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e3d9969-9672-46f1-b5f2-3d8ff829406d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:05.964464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e3d9969-9672-46f1-b5f2-3d8ff829406d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:05.965175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e3d9969-9672-46f1-b5f2-3d8ff829406d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:05.965875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e3d9969-9672-46f1-b5f2-3d8ff829406d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:05.966567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e3d9969-9672-46f1-b5f2-3d8ff829406d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:06.208552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6823f0c6-bc51-417e-a493-7e85db11a560 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:06.220948 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6823f0c6-bc51-417e-a493-7e85db11a560 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1492 microversion: 2.1 time: 0.411968 Aug 23 17:58:06.236731 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1010/1961] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:05 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1492 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:06.247079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b92b3908-2bc7-4999-9c21-8e7377856bf1 req-e020294f-3fe5-4b29-97be-a00e3659eae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153fb085-12d0-4155-a1f7-9e954d51e9c5", "name": "network-vif-unplugged", "status": "completed", "tag": "071d181a-b17b-447a-b61e-a9731c7217ec"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:06.283511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b92b3908-2bc7-4999-9c21-8e7377856bf1 req-e020294f-3fe5-4b29-97be-a00e3659eae9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:06.285500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b92b3908-2bc7-4999-9c21-8e7377856bf1 req-e020294f-3fe5-4b29-97be-a00e3659eae9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:06.287117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b92b3908-2bc7-4999-9c21-8e7377856bf1 req-e020294f-3fe5-4b29-97be-a00e3659eae9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:06.314301 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b92b3908-2bc7-4999-9c21-8e7377856bf1 req-e020294f-3fe5-4b29-97be-a00e3659eae9 service nova] Creating event network-vif-unplugged:071d181a-b17b-447a-b61e-a9731c7217ec for instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 on n-h2-850468-16 Aug 23 17:58:06.325433 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b92b3908-2bc7-4999-9c21-8e7377856bf1 req-e020294f-3fe5-4b29-97be-a00e3659eae9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086602 Aug 23 17:58:06.330448 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1011/1962] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:06.350010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7db50175-aa0a-42f0-8442-19be1d14b131 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:06.351559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7db50175-aa0a-42f0-8442-19be1d14b131 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:06.373899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7db50175-aa0a-42f0-8442-19be1d14b131 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:06.375280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7db50175-aa0a-42f0-8442-19be1d14b131 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:06.377715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7db50175-aa0a-42f0-8442-19be1d14b131 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:06.380921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7db50175-aa0a-42f0-8442-19be1d14b131 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:06.381408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7db50175-aa0a-42f0-8442-19be1d14b131 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:06.381846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7db50175-aa0a-42f0-8442-19be1d14b131 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:06.631255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0e3d9969-9672-46f1-b5f2-3d8ff829406d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:06.660853 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0e3d9969-9672-46f1-b5f2-3d8ff829406d tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1526 microversion: 2.1 time: 0.719310 Aug 23 17:58:06.664167 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 952/1963] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:05 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1526 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:06.678312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6d4074c-10b8-4d91-af65-5daf7f2aac87 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:06.679696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6d4074c-10b8-4d91-af65-5daf7f2aac87 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:06.705986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6d4074c-10b8-4d91-af65-5daf7f2aac87 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:06.706987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6d4074c-10b8-4d91-af65-5daf7f2aac87 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:06.708286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6d4074c-10b8-4d91-af65-5daf7f2aac87 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:06.710350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6d4074c-10b8-4d91-af65-5daf7f2aac87 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:06.717625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6d4074c-10b8-4d91-af65-5daf7f2aac87 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:06.720346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6d4074c-10b8-4d91-af65-5daf7f2aac87 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:06.795734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7db50175-aa0a-42f0-8442-19be1d14b131 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:06.805014 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7db50175-aa0a-42f0-8442-19be1d14b131 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1470 microversion: 2.1 time: 0.467825 Aug 23 17:58:06.809685 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1012/1964] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:06 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1470 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:06.820253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41f69d7e-a41d-49ad-82f0-74a6f7ca7f3b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:06.825754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-41f69d7e-a41d-49ad-82f0-74a6f7ca7f3b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:06.834986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41f69d7e-a41d-49ad-82f0-74a6f7ca7f3b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:06.838973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41f69d7e-a41d-49ad-82f0-74a6f7ca7f3b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:06.841505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41f69d7e-a41d-49ad-82f0-74a6f7ca7f3b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:06.843725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41f69d7e-a41d-49ad-82f0-74a6f7ca7f3b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:06.844937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41f69d7e-a41d-49ad-82f0-74a6f7ca7f3b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:06.847466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41f69d7e-a41d-49ad-82f0-74a6f7ca7f3b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:06.865845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6d4074c-10b8-4d91-af65-5daf7f2aac87 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:06.880822 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6d4074c-10b8-4d91-af65-5daf7f2aac87 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1270 microversion: 2.1 time: 0.209174 Aug 23 17:58:06.882339 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 953/1965] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:06 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1270 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:06.890841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:06.895325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a9208560-9d3f-4b7e-af5f-483cec0f3f84 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:06.900297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a9208560-9d3f-4b7e-af5f-483cec0f3f84 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:06.907982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9208560-9d3f-4b7e-af5f-483cec0f3f84 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:06.909333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9208560-9d3f-4b7e-af5f-483cec0f3f84 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:06.910014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9208560-9d3f-4b7e-af5f-483cec0f3f84 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:06.910937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9208560-9d3f-4b7e-af5f-483cec0f3f84 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:06.911562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9208560-9d3f-4b7e-af5f-483cec0f3f84 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:06.912198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9208560-9d3f-4b7e-af5f-483cec0f3f84 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:07.081230 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a9208560-9d3f-4b7e-af5f-483cec0f3f84 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "POST /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386/action" status: 202 len: 0 microversion: 2.1 time: 0.195422 Aug 23 17:58:07.086526 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 954/1966] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:58:06 2022] POST /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:58:07.113168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3254fa93-e2d2-47c4-ae3d-b7a22b7a56bc tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:07.119427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3254fa93-e2d2-47c4-ae3d-b7a22b7a56bc tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:07.148882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3254fa93-e2d2-47c4-ae3d-b7a22b7a56bc tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:07.151531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3254fa93-e2d2-47c4-ae3d-b7a22b7a56bc tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:07.152951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3254fa93-e2d2-47c4-ae3d-b7a22b7a56bc tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:07.154824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3254fa93-e2d2-47c4-ae3d-b7a22b7a56bc tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:07.158050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3254fa93-e2d2-47c4-ae3d-b7a22b7a56bc tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:07.159661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3254fa93-e2d2-47c4-ae3d-b7a22b7a56bc tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:07.389825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41f69d7e-a41d-49ad-82f0-74a6f7ca7f3b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:07.417039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41f69d7e-a41d-49ad-82f0-74a6f7ca7f3b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:07.419114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41f69d7e-a41d-49ad-82f0-74a6f7ca7f3b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:07.428248 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-41f69d7e-a41d-49ad-82f0-74a6f7ca7f3b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.612265 Aug 23 17:58:07.434530 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1013/1967] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:06 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:58:07.454498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-16f78356-cd34-4733-a02e-309e3d2577ed tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:07.455573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-16f78356-cd34-4733-a02e-309e3d2577ed tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:07.471057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16f78356-cd34-4733-a02e-309e3d2577ed tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:07.473828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16f78356-cd34-4733-a02e-309e3d2577ed tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:07.475079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16f78356-cd34-4733-a02e-309e3d2577ed tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:07.481344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16f78356-cd34-4733-a02e-309e3d2577ed tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:07.482109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16f78356-cd34-4733-a02e-309e3d2577ed tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:07.483102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16f78356-cd34-4733-a02e-309e3d2577ed tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:07.931558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3254fa93-e2d2-47c4-ae3d-b7a22b7a56bc tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:07.943636 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3254fa93-e2d2-47c4-ae3d-b7a22b7a56bc tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.855223 Aug 23 17:58:07.959037 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 955/1968] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:07 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:07.969930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:07.975024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:07.987370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:07.988440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:07.989126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:07.990079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:07.990827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:07.991755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:08.054647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:08.055542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:08.057255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:08.057951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lazy-loading 'fault' on Instance uuid 200e6dde-d9fa-47e0-af4d-2e5be2dba21c {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:58:08.168414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:08.177238 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6f26278d-43ca-4010-92a9-2debeedb57b5 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1304 microversion: 2.1 time: 0.216752 Aug 23 17:58:08.181719 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 956/1969] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:07 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1304 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:08.190061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:08.190889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:08.207334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:08.208270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:08.208897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:08.209796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:08.219335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:08.220188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:08.277412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:08.278635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:08.279257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:08.279880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lazy-loading 'fault' on Instance uuid 153fb085-12d0-4155-a1f7-9e954d51e9c5 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:58:08.348031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:08.359787 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c302eb6d-de20-4b24-ac02-80b0d7968cc7 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1314 microversion: 2.1 time: 0.175182 Aug 23 17:58:08.362869 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 957/1970] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:08 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:08.370900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6e0ebf70-0e78-4365-b67d-cffcfc0f2f2d req-f40ed662-7486-44bc-b5fd-5ef9b69c6fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200e6dde-d9fa-47e0-af4d-2e5be2dba21c", "name": "network-vif-deleted", "tag": "c59e7672-d57f-4008-9989-09790fe3f71c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:08.398834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6e0ebf70-0e78-4365-b67d-cffcfc0f2f2d req-f40ed662-7486-44bc-b5fd-5ef9b69c6fc1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:08.402744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-16f78356-cd34-4733-a02e-309e3d2577ed tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:08.412544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6e0ebf70-0e78-4365-b67d-cffcfc0f2f2d req-f40ed662-7486-44bc-b5fd-5ef9b69c6fc1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:08.413639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6e0ebf70-0e78-4365-b67d-cffcfc0f2f2d req-f40ed662-7486-44bc-b5fd-5ef9b69c6fc1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:08.414963 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-16f78356-cd34-4733-a02e-309e3d2577ed tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1469 microversion: 2.1 time: 0.978835 Aug 23 17:58:08.417636 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1014/1971] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:07 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1469 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:08.427115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5b3abef4-410d-40b0-a909-769e1d149ca6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:08.436675 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6e0ebf70-0e78-4365-b67d-cffcfc0f2f2d req-f40ed662-7486-44bc-b5fd-5ef9b69c6fc1 service nova] Creating event network-vif-deleted:c59e7672-d57f-4008-9989-09790fe3f71c for instance 200e6dde-d9fa-47e0-af4d-2e5be2dba21c on n-h2-850468-16 Aug 23 17:58:08.442524 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6e0ebf70-0e78-4365-b67d-cffcfc0f2f2d req-f40ed662-7486-44bc-b5fd-5ef9b69c6fc1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077665 Aug 23 17:58:08.445624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5b3abef4-410d-40b0-a909-769e1d149ca6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:08.447080 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 958/1972] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:08.456517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8ce1688e-d85e-42e0-9d91-abb8f6cafc3b req-1bd604ce-4f71-45c9-91ae-dadf4f56e50e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "200e6dde-d9fa-47e0-af4d-2e5be2dba21c", "name": "network-vif-unplugged", "status": "completed", "tag": "c59e7672-d57f-4008-9989-09790fe3f71c"}, {"server_uuid": "13a4ebc8-3d93-4377-beec-accf25eee386", "name": "network-vif-plugged", "status": "completed", "tag": "67689804-86f0-4754-bb53-ddbce34de8e9"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:08.471487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b3abef4-410d-40b0-a909-769e1d149ca6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:08.472981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b3abef4-410d-40b0-a909-769e1d149ca6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:08.473567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b3abef4-410d-40b0-a909-769e1d149ca6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:08.474381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b3abef4-410d-40b0-a909-769e1d149ca6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:08.475166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b3abef4-410d-40b0-a909-769e1d149ca6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:08.475573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b3abef4-410d-40b0-a909-769e1d149ca6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:08.487568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8ce1688e-d85e-42e0-9d91-abb8f6cafc3b req-1bd604ce-4f71-45c9-91ae-dadf4f56e50e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:08.492298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8ce1688e-d85e-42e0-9d91-abb8f6cafc3b req-1bd604ce-4f71-45c9-91ae-dadf4f56e50e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:08.495725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8ce1688e-d85e-42e0-9d91-abb8f6cafc3b req-1bd604ce-4f71-45c9-91ae-dadf4f56e50e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:08.515279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:08.529047 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8ce1688e-d85e-42e0-9d91-abb8f6cafc3b req-1bd604ce-4f71-45c9-91ae-dadf4f56e50e service nova] Creating event network-vif-unplugged:c59e7672-d57f-4008-9989-09790fe3f71c for instance 200e6dde-d9fa-47e0-af4d-2e5be2dba21c on n-h2-850468-16 Aug 23 17:58:08.529750 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8ce1688e-d85e-42e0-9d91-abb8f6cafc3b req-1bd604ce-4f71-45c9-91ae-dadf4f56e50e service nova] Creating event network-vif-plugged:67689804-86f0-4754-bb53-ddbce34de8e9 for instance 13a4ebc8-3d93-4377-beec-accf25eee386 on n-h2-850468-16 Aug 23 17:58:08.559996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-8ce1688e-d85e-42e0-9d91-abb8f6cafc3b req-1bd604ce-4f71-45c9-91ae-dadf4f56e50e service nova] Instance 13a4ebc8-3d93-4377-beec-accf25eee386 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 17:58:08.594778 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8ce1688e-d85e-42e0-9d91-abb8f6cafc3b req-1bd604ce-4f71-45c9-91ae-dadf4f56e50e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.142592 Aug 23 17:58:08.599057 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 959/1973] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:08.609707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0767682a-6767-4c80-a3f4-ff40f1631d6a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:08.610126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0767682a-6767-4c80-a3f4-ff40f1631d6a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:08.619426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0767682a-6767-4c80-a3f4-ff40f1631d6a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:08.621407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0767682a-6767-4c80-a3f4-ff40f1631d6a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:08.622571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0767682a-6767-4c80-a3f4-ff40f1631d6a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:08.624689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0767682a-6767-4c80-a3f4-ff40f1631d6a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:08.624689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0767682a-6767-4c80-a3f4-ff40f1631d6a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:08.625031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0767682a-6767-4c80-a3f4-ff40f1631d6a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:08.804671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5b3abef4-410d-40b0-a909-769e1d149ca6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:08.817108 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5b3abef4-410d-40b0-a909-769e1d149ca6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1276 microversion: 2.1 time: 0.398053 Aug 23 17:58:08.832387 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1015/1974] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:08 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1276 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:08.968287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c068a84-abdd-4891-9ef3-a6bfed6c2b2c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:08.969648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0c068a84-abdd-4891-9ef3-a6bfed6c2b2c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:08.981949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c068a84-abdd-4891-9ef3-a6bfed6c2b2c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:08.982523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c068a84-abdd-4891-9ef3-a6bfed6c2b2c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:08.983285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c068a84-abdd-4891-9ef3-a6bfed6c2b2c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:08.984127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c068a84-abdd-4891-9ef3-a6bfed6c2b2c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:08.987324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c068a84-abdd-4891-9ef3-a6bfed6c2b2c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:09.003198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c068a84-abdd-4891-9ef3-a6bfed6c2b2c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:09.042803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0767682a-6767-4c80-a3f4-ff40f1631d6a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:09.054739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0767682a-6767-4c80-a3f4-ff40f1631d6a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:09.065761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0767682a-6767-4c80-a3f4-ff40f1631d6a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:09.073112 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0767682a-6767-4c80-a3f4-ff40f1631d6a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.470373 Aug 23 17:58:09.074145 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 960/1975] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:08 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:09.203286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:09.204939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:09.218288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:09.226703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:09.228925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:09.232296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:09.237199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:09.237199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:09.346661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:09.353905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:09.354418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:09.354888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:09.355347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lazy-loading 'fault' on Instance uuid 200e6dde-d9fa-47e0-af4d-2e5be2dba21c {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:58:09.596457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6efa870487f347eb9886ec8ba62360f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e6e4c52fe92040e9b532db25ee92d308', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:09.623705 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-378c0c6b-0594-487f-8f75-d221b68617e8 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 200 len: 1304 microversion: 2.1 time: 0.425170 Aug 23 17:58:09.625000 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 961/1976] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:09 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 1304 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:09.653008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:09.664015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:09.677704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:09.683261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:09.686465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:09.687440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:09.693099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:09.697357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:09.782060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:09.782977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0c068a84-abdd-4891-9ef3-a6bfed6c2b2c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:09.785205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:09.785910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:09.786603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lazy-loading 'fault' on Instance uuid 153fb085-12d0-4155-a1f7-9e954d51e9c5 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:58:09.794876 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c068a84-abdd-4891-9ef3-a6bfed6c2b2c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.828694 Aug 23 17:58:09.795608 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1016/1977] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:08 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:09.812263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-72b8339e-618d-41cc-a16d-f920cae4e284 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:09.813724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-72b8339e-618d-41cc-a16d-f920cae4e284 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:09.828262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72b8339e-618d-41cc-a16d-f920cae4e284 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:09.829220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72b8339e-618d-41cc-a16d-f920cae4e284 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:09.829848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72b8339e-618d-41cc-a16d-f920cae4e284 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:09.834262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72b8339e-618d-41cc-a16d-f920cae4e284 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:09.835038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72b8339e-618d-41cc-a16d-f920cae4e284 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:09.835645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72b8339e-618d-41cc-a16d-f920cae4e284 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:09.891630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2b5f2c622daa43968a1a23cad5c91a49', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e7b882a8b2644f1dac937ffcfd1ce14b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:09.902718 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d94082a8-beef-4964-93ab-118a6307b1c3 tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 200 len: 1314 microversion: 2.1 time: 0.274057 Aug 23 17:58:09.919327 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 962/1978] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:09 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:09.925289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-50fd172a-336c-4491-acf8-d2f52bed2e95 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:09.927639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-50fd172a-336c-4491-acf8-d2f52bed2e95 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:09.937975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50fd172a-336c-4491-acf8-d2f52bed2e95 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:09.938465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50fd172a-336c-4491-acf8-d2f52bed2e95 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:09.938971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50fd172a-336c-4491-acf8-d2f52bed2e95 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:09.939706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50fd172a-336c-4491-acf8-d2f52bed2e95 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:09.940658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50fd172a-336c-4491-acf8-d2f52bed2e95 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:09.942230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50fd172a-336c-4491-acf8-d2f52bed2e95 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:10.191948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-72b8339e-618d-41cc-a16d-f920cae4e284 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:10.215701 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-72b8339e-618d-41cc-a16d-f920cae4e284 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1469 microversion: 2.1 time: 0.414477 Aug 23 17:58:10.218925 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1017/1979] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:09 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1469 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:10.248142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-904976ea-5a85-4ebe-8752-ede67e793393 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:10.252777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-904976ea-5a85-4ebe-8752-ede67e793393 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:10.296788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-904976ea-5a85-4ebe-8752-ede67e793393 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:10.297745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-904976ea-5a85-4ebe-8752-ede67e793393 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:10.299242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-904976ea-5a85-4ebe-8752-ede67e793393 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:10.300537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-904976ea-5a85-4ebe-8752-ede67e793393 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:10.301318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-904976ea-5a85-4ebe-8752-ede67e793393 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:10.301928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-904976ea-5a85-4ebe-8752-ede67e793393 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:10.786472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-904976ea-5a85-4ebe-8752-ede67e793393 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:10.810944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-904976ea-5a85-4ebe-8752-ede67e793393 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:10.812935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-904976ea-5a85-4ebe-8752-ede67e793393 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:10.814758 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-904976ea-5a85-4ebe-8752-ede67e793393 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.594257 Aug 23 17:58:10.830570 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1018/1980] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:10 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:10.833284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-948d3ec3-a948-4adb-991b-e93a89cc5f62 req-46438e57-14af-42da-a1ab-8954bdeceb6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "153fb085-12d0-4155-a1f7-9e954d51e9c5", "name": "network-vif-deleted", "tag": "071d181a-b17b-447a-b61e-a9731c7217ec"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:10.854766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-948d3ec3-a948-4adb-991b-e93a89cc5f62 req-46438e57-14af-42da-a1ab-8954bdeceb6a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:10.855337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-948d3ec3-a948-4adb-991b-e93a89cc5f62 req-46438e57-14af-42da-a1ab-8954bdeceb6a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:10.855865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-948d3ec3-a948-4adb-991b-e93a89cc5f62 req-46438e57-14af-42da-a1ab-8954bdeceb6a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:10.856765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-50fd172a-336c-4491-acf8-d2f52bed2e95 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:10.867534 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-50fd172a-336c-4491-acf8-d2f52bed2e95 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1318 microversion: 2.1 time: 0.946405 Aug 23 17:58:10.873920 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-948d3ec3-a948-4adb-991b-e93a89cc5f62 req-46438e57-14af-42da-a1ab-8954bdeceb6a service nova] Creating event network-vif-deleted:071d181a-b17b-447a-b61e-a9731c7217ec for instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 on n-h2-850468-16 Aug 23 17:58:10.881693 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-948d3ec3-a948-4adb-991b-e93a89cc5f62 req-46438e57-14af-42da-a1ab-8954bdeceb6a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057106 Aug 23 17:58:10.882612 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1019/1981] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:10.883379 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 963/1982] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:09 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1318 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:10.891726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2a3d73c7-8560-40bd-8386-bd1912ea7cba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:10.892371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2a3d73c7-8560-40bd-8386-bd1912ea7cba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:10.901358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a3d73c7-8560-40bd-8386-bd1912ea7cba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:10.901731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a3d73c7-8560-40bd-8386-bd1912ea7cba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:10.902167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a3d73c7-8560-40bd-8386-bd1912ea7cba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:10.902903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a3d73c7-8560-40bd-8386-bd1912ea7cba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:10.903673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a3d73c7-8560-40bd-8386-bd1912ea7cba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:10.904106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a3d73c7-8560-40bd-8386-bd1912ea7cba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:10.906377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ff04d1a-ce0a-4ee0-88e8-8f9c702a2071 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:10.907598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2ff04d1a-ce0a-4ee0-88e8-8f9c702a2071 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] [instance: 200e6dde-d9fa-47e0-af4d-2e5be2dba21c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:10.925356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff04d1a-ce0a-4ee0-88e8-8f9c702a2071 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:10.929553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff04d1a-ce0a-4ee0-88e8-8f9c702a2071 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:10.930860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff04d1a-ce0a-4ee0-88e8-8f9c702a2071 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:10.932815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff04d1a-ce0a-4ee0-88e8-8f9c702a2071 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:10.933364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff04d1a-ce0a-4ee0-88e8-8f9c702a2071 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:10.934739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ff04d1a-ce0a-4ee0-88e8-8f9c702a2071 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:10.953613 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2ff04d1a-ce0a-4ee0-88e8-8f9c702a2071 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] HTTP exception thrown: Instance 200e6dde-d9fa-47e0-af4d-2e5be2dba21c could not be found. Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ff04d1a-ce0a-4ee0-88e8-8f9c702a2071 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Request method failure captured: Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c HTTP/1.1 Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRSJIfRhV-kdvOQ5j9rC0WmSlwrxIQuTT9rI27rt-4xPtE_e40IskAo-AMScO_5vADNqR15INwpp0oY75tIxU8fox4iee0EpKEwYzgbHz45dMfqn5ie0A-s6mC59kC8UPSxdqjWAY-bY2gRuudmFZPIf4z50oYEh4Dy8XXlJlwXjnzY Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: e6e4c52fe92040e9b532db25ee92d308 Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerRescueTestJSON-535501204 Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e6e4c52fe92040e9b532db25ee92d308"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e6e4c52fe92040e9b532db25ee92d308"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e6e4c52fe92040e9b532db25ee92d308"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e6e4c52fe92040e9b532db25ee92d308"}]}] Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerRescueTestJSON-535501204 Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: e6e4c52fe92040e9b532db25ee92d308 Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerRescueTestJSON-535501204 Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerRescueTestJSON-535501204-project Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6efa870487f347eb9886ec8ba62360f8 Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerRescueTestJSON-535501204-project Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 200e6dde-d9fa-47e0-af4d-2e5be2dba21c could not be found. Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '200e6dde-d9fa-47e0-af4d-2e5be2dba21c'} Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 200e6dde-d9fa-47e0-af4d-2e5be2dba21c could not be found. Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 200e6dde-d9fa-47e0-af4d-2e5be2dba21c could not be found. Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:58:10.955417 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:10.960552 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:58:10.960552 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:58:10.960552 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:58:10.960552 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:58:10.960552 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:58:10.960552 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 200e6dde-d9fa-47e0-af4d-2e5be2dba21c could not be found. Aug 23 17:58:10.960552 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:10.960552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ff04d1a-ce0a-4ee0-88e8-8f9c702a2071 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] Returning 404 to user: Instance 200e6dde-d9fa-47e0-af4d-2e5be2dba21c could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:58:10.960552 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2ff04d1a-ce0a-4ee0-88e8-8f9c702a2071 tempest-ServerRescueTestJSON-535501204 tempest-ServerRescueTestJSON-535501204-project] 10.222.0.61 "GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c" status: 404 len: 111 microversion: 2.1 time: 0.073290 Aug 23 17:58:10.960552 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1020/1983] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:10 2022] GET /compute/v2.1/servers/200e6dde-d9fa-47e0-af4d-2e5be2dba21c => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:58:10.966823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a0f13ca7-2f4b-4091-babb-5ec81943d6dc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:10.967440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a0f13ca7-2f4b-4091-babb-5ec81943d6dc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] [instance: 153fb085-12d0-4155-a1f7-9e954d51e9c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:10.973648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0f13ca7-2f4b-4091-babb-5ec81943d6dc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:10.974141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0f13ca7-2f4b-4091-babb-5ec81943d6dc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:10.974609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0f13ca7-2f4b-4091-babb-5ec81943d6dc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:10.975323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0f13ca7-2f4b-4091-babb-5ec81943d6dc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:10.975782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0f13ca7-2f4b-4091-babb-5ec81943d6dc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:10.976206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0f13ca7-2f4b-4091-babb-5ec81943d6dc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:10.994698 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-a0f13ca7-2f4b-4091-babb-5ec81943d6dc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] HTTP exception thrown: Instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 could not be found. Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a0f13ca7-2f4b-4091-babb-5ec81943d6dc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Request method failure captured: Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 HTTP/1.1 Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRTT5qTREkpkNCPdk-AWdCDz7Eze_bUOUZoTxPA97pb-_Fn3ivaVXshsMPIryyr9k_9pUqkfpAsRloCcXgTDm5g5QVVbvGASL_JULIA8516e-E7dR8qlaLkKalfaTKCR5xB9-SMbJ06tPwUwLnbDNNEmsRNw9dVyDupUE3r9uy1bclg Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: e7b882a8b2644f1dac937ffcfd1ce14b Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1470360496 Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e7b882a8b2644f1dac937ffcfd1ce14b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e7b882a8b2644f1dac937ffcfd1ce14b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e7b882a8b2644f1dac937ffcfd1ce14b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e7b882a8b2644f1dac937ffcfd1ce14b"}]}] Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1470360496 Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: e7b882a8b2644f1dac937ffcfd1ce14b Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1470360496 Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-FloatingIPsAssociationTestJSON-1470360496-project Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2b5f2c622daa43968a1a23cad5c91a49 Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1470360496-project Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 could not be found. Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '153fb085-12d0-4155-a1f7-9e954d51e9c5'} Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 could not be found. Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 could not be found. Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:10.998999 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:58:11.003890 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:11.003890 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:58:11.003890 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:58:11.003890 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:58:11.003890 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:58:11.003890 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:58:11.003890 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 could not be found. Aug 23 17:58:11.003890 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:11.003890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a0f13ca7-2f4b-4091-babb-5ec81943d6dc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] Returning 404 to user: Instance 153fb085-12d0-4155-a1f7-9e954d51e9c5 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:58:11.003890 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a0f13ca7-2f4b-4091-babb-5ec81943d6dc tempest-FloatingIPsAssociationTestJSON-1470360496 tempest-FloatingIPsAssociationTestJSON-1470360496-project] 10.222.0.61 "GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5" status: 404 len: 111 microversion: 2.1 time: 0.042237 Aug 23 17:58:11.003890 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1021/1984] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:10 2022] GET /compute/v2.1/servers/153fb085-12d0-4155-a1f7-9e954d51e9c5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:58:11.240113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7c804c4a-f470-40ce-822b-075327023217 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:11.241198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7c804c4a-f470-40ce-822b-075327023217 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:11.250795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c804c4a-f470-40ce-822b-075327023217 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:11.251666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c804c4a-f470-40ce-822b-075327023217 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:11.252334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c804c4a-f470-40ce-822b-075327023217 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:11.256206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c804c4a-f470-40ce-822b-075327023217 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:11.267352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c804c4a-f470-40ce-822b-075327023217 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:11.269909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c804c4a-f470-40ce-822b-075327023217 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:11.363768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2a3d73c7-8560-40bd-8386-bd1912ea7cba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:11.373902 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2a3d73c7-8560-40bd-8386-bd1912ea7cba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.488793 Aug 23 17:58:11.390042 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 964/1985] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:10 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:11.841938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b1804f2b-f52d-434d-9680-fd5ffc33287b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:11.843366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b1804f2b-f52d-434d-9680-fd5ffc33287b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:11.856115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1804f2b-f52d-434d-9680-fd5ffc33287b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:11.857249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1804f2b-f52d-434d-9680-fd5ffc33287b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:11.858413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1804f2b-f52d-434d-9680-fd5ffc33287b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:11.859411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1804f2b-f52d-434d-9680-fd5ffc33287b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:11.860114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1804f2b-f52d-434d-9680-fd5ffc33287b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:11.860795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1804f2b-f52d-434d-9680-fd5ffc33287b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:12.120330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7c804c4a-f470-40ce-822b-075327023217 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:12.135492 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7c804c4a-f470-40ce-822b-075327023217 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1469 microversion: 2.1 time: 0.898183 Aug 23 17:58:12.136831 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1022/1986] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:11 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1469 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:58:12.147529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6f8cd473-5401-4b88-95a1-dc870fc0726f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:12.150242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6f8cd473-5401-4b88-95a1-dc870fc0726f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:12.157676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f8cd473-5401-4b88-95a1-dc870fc0726f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:12.159307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f8cd473-5401-4b88-95a1-dc870fc0726f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:12.160279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f8cd473-5401-4b88-95a1-dc870fc0726f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:12.161886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f8cd473-5401-4b88-95a1-dc870fc0726f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:12.162360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f8cd473-5401-4b88-95a1-dc870fc0726f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:12.162835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f8cd473-5401-4b88-95a1-dc870fc0726f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:12.266233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b1804f2b-f52d-434d-9680-fd5ffc33287b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:12.282306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b1804f2b-f52d-434d-9680-fd5ffc33287b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:12.284512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b1804f2b-f52d-434d-9680-fd5ffc33287b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:12.296639 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b1804f2b-f52d-434d-9680-fd5ffc33287b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.452352 Aug 23 17:58:12.301234 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 965/1987] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:11 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:58:12.411376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-824c1f4f-0ca9-4c93-ac24-81b07197c828 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:12.413837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-824c1f4f-0ca9-4c93-ac24-81b07197c828 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:12.431995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-824c1f4f-0ca9-4c93-ac24-81b07197c828 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:12.433969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-824c1f4f-0ca9-4c93-ac24-81b07197c828 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:12.434498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-824c1f4f-0ca9-4c93-ac24-81b07197c828 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:12.436127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-824c1f4f-0ca9-4c93-ac24-81b07197c828 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:12.436689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-824c1f4f-0ca9-4c93-ac24-81b07197c828 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:12.437344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-824c1f4f-0ca9-4c93-ac24-81b07197c828 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:12.719315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6f8cd473-5401-4b88-95a1-dc870fc0726f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:12.735551 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6f8cd473-5401-4b88-95a1-dc870fc0726f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1318 microversion: 2.1 time: 0.596663 Aug 23 17:58:12.736368 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1023/1988] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:12 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1318 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:12.753449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-dfcb6295-7cc6-43fb-839d-d0c8b966c93f req-1b0fb424-822f-4693-8932-59cba731d0ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480827c0-1bbc-4e3f-9176-aebec4fc597b", "name": "network-vif-unplugged", "status": "completed", "tag": "eec4fd61-f043-4080-a007-9c202b65aefc"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:12.772413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dfcb6295-7cc6-43fb-839d-d0c8b966c93f req-1b0fb424-822f-4693-8932-59cba731d0ad service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:12.773171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dfcb6295-7cc6-43fb-839d-d0c8b966c93f req-1b0fb424-822f-4693-8932-59cba731d0ad service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:12.773616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dfcb6295-7cc6-43fb-839d-d0c8b966c93f req-1b0fb424-822f-4693-8932-59cba731d0ad service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:12.802082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-824c1f4f-0ca9-4c93-ac24-81b07197c828 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:12.811838 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-824c1f4f-0ca9-4c93-ac24-81b07197c828 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.407295 Aug 23 17:58:12.814762 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-dfcb6295-7cc6-43fb-839d-d0c8b966c93f req-1b0fb424-822f-4693-8932-59cba731d0ad service nova] Creating event network-vif-unplugged:eec4fd61-f043-4080-a007-9c202b65aefc for instance 480827c0-1bbc-4e3f-9176-aebec4fc597b on n-h2-850468-16 Aug 23 17:58:12.815256 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 966/1989] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:12 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:12.832677 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-dfcb6295-7cc6-43fb-839d-d0c8b966c93f req-1b0fb424-822f-4693-8932-59cba731d0ad service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.092327 Aug 23 17:58:12.835484 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1024/1990] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:12.904454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f399ee58-2e66-451c-b814-710972af1c09 req-0aa156ac-7a6a-46c6-babf-ecebbbe420b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f47e601-36d6-4b1f-a4bf-8020bf69831c", "tag": "4838606c-edcc-47d0-96e3-cce31a7cb847"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:12.932340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f399ee58-2e66-451c-b814-710972af1c09 req-0aa156ac-7a6a-46c6-babf-ecebbbe420b5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:12.933020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f399ee58-2e66-451c-b814-710972af1c09 req-0aa156ac-7a6a-46c6-babf-ecebbbe420b5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:12.934390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f399ee58-2e66-451c-b814-710972af1c09 req-0aa156ac-7a6a-46c6-babf-ecebbbe420b5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:12.958443 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f399ee58-2e66-451c-b814-710972af1c09 req-0aa156ac-7a6a-46c6-babf-ecebbbe420b5 service nova] Creating event network-changed:4838606c-edcc-47d0-96e3-cce31a7cb847 for instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c on n-h2-850468-16 Aug 23 17:58:12.965203 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f399ee58-2e66-451c-b814-710972af1c09 req-0aa156ac-7a6a-46c6-babf-ecebbbe420b5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064492 Aug 23 17:58:12.968557 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 967/1991] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:13.173158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9019e117-a1e3-4344-a97c-707f264b69fe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:13.176444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9019e117-a1e3-4344-a97c-707f264b69fe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:13.210995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9019e117-a1e3-4344-a97c-707f264b69fe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:13.212853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9019e117-a1e3-4344-a97c-707f264b69fe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:13.213811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9019e117-a1e3-4344-a97c-707f264b69fe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:13.217168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9019e117-a1e3-4344-a97c-707f264b69fe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:13.217962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9019e117-a1e3-4344-a97c-707f264b69fe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:13.219835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9019e117-a1e3-4344-a97c-707f264b69fe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:13.322509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=16 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:13.327874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1dd6f5e1-e865-411c-aabc-7c9e30fe740f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:13.329095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1dd6f5e1-e865-411c-aabc-7c9e30fe740f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:13.343157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd6f5e1-e865-411c-aabc-7c9e30fe740f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:13.345355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd6f5e1-e865-411c-aabc-7c9e30fe740f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:13.346097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd6f5e1-e865-411c-aabc-7c9e30fe740f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:13.349621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd6f5e1-e865-411c-aabc-7c9e30fe740f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:13.350889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd6f5e1-e865-411c-aabc-7c9e30fe740f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:13.352113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd6f5e1-e865-411c-aabc-7c9e30fe740f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:13.709292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1dd6f5e1-e865-411c-aabc-7c9e30fe740f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:13.728583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1dd6f5e1-e865-411c-aabc-7c9e30fe740f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:13.734210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1dd6f5e1-e865-411c-aabc-7c9e30fe740f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:13.736232 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1dd6f5e1-e865-411c-aabc-7c9e30fe740f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.416189 Aug 23 17:58:13.750566 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 968/1992] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:13 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:58:13.751611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9019e117-a1e3-4344-a97c-707f264b69fe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:13.758514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6954033f-674d-40eb-b68d-86ffc7b09af4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:13.761258 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9019e117-a1e3-4344-a97c-707f264b69fe tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1469 microversion: 2.1 time: 0.600440 Aug 23 17:58:13.761781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6954033f-674d-40eb-b68d-86ffc7b09af4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:13.773987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6954033f-674d-40eb-b68d-86ffc7b09af4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:13.775099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6954033f-674d-40eb-b68d-86ffc7b09af4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:13.775542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6954033f-674d-40eb-b68d-86ffc7b09af4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:13.776260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6954033f-674d-40eb-b68d-86ffc7b09af4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:13.776714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6954033f-674d-40eb-b68d-86ffc7b09af4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:13.777137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6954033f-674d-40eb-b68d-86ffc7b09af4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:13.778167 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1025/1993] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:13 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1469 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:13.841566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5b26dd35-597a-4609-87b7-5cbfe125ef95 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:13.842195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5b26dd35-597a-4609-87b7-5cbfe125ef95 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:13.851577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b26dd35-597a-4609-87b7-5cbfe125ef95 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:13.852615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b26dd35-597a-4609-87b7-5cbfe125ef95 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:13.858807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b26dd35-597a-4609-87b7-5cbfe125ef95 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:13.861167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b26dd35-597a-4609-87b7-5cbfe125ef95 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:13.863556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b26dd35-597a-4609-87b7-5cbfe125ef95 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:13.865009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b26dd35-597a-4609-87b7-5cbfe125ef95 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:14.260183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:14.309596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=10 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:14.320204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5b26dd35-597a-4609-87b7-5cbfe125ef95 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:14.330009 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5b26dd35-597a-4609-87b7-5cbfe125ef95 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.494026 Aug 23 17:58:14.335385 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1026/1994] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:13 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:14.594970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6954033f-674d-40eb-b68d-86ffc7b09af4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:14.607014 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6954033f-674d-40eb-b68d-86ffc7b09af4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1318 microversion: 2.1 time: 0.852988 Aug 23 17:58:14.610617 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 969/1995] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:13 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1318 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:58:14.762295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1cf7413b-e531-4216-95e0-4402d8a6dd7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:14.762945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1cf7413b-e531-4216-95e0-4402d8a6dd7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:14.773274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cf7413b-e531-4216-95e0-4402d8a6dd7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:14.775014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cf7413b-e531-4216-95e0-4402d8a6dd7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:14.775858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cf7413b-e531-4216-95e0-4402d8a6dd7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:14.776914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cf7413b-e531-4216-95e0-4402d8a6dd7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:14.777624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cf7413b-e531-4216-95e0-4402d8a6dd7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:14.778267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1cf7413b-e531-4216-95e0-4402d8a6dd7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:14.783594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9dcb4e72-e8c5-4570-897b-54a96012ba22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:14.784205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9dcb4e72-e8c5-4570-897b-54a96012ba22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:14.794174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dcb4e72-e8c5-4570-897b-54a96012ba22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:14.795046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dcb4e72-e8c5-4570-897b-54a96012ba22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:14.798933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dcb4e72-e8c5-4570-897b-54a96012ba22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:14.801034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dcb4e72-e8c5-4570-897b-54a96012ba22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:14.801725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dcb4e72-e8c5-4570-897b-54a96012ba22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:14.802700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dcb4e72-e8c5-4570-897b-54a96012ba22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:15.131237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9dcb4e72-e8c5-4570-897b-54a96012ba22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:15.132754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1cf7413b-e531-4216-95e0-4402d8a6dd7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:15.142499 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9dcb4e72-e8c5-4570-897b-54a96012ba22 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1469 microversion: 2.1 time: 0.363284 Aug 23 17:58:15.153338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1cf7413b-e531-4216-95e0-4402d8a6dd7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:15.159133 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 970/1996] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:14 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1469 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:15.168362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f83a3361-4ccd-4466-bf08-46615c4550f8 req-ae63c9a2-3e7b-4706-bc4c-c89a0d1325bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "480827c0-1bbc-4e3f-9176-aebec4fc597b", "tag": "eec4fd61-f043-4080-a007-9c202b65aefc"}, {"name": "network-changed", "server_uuid": "ce1045a1-9999-4f13-82da-906bf1d0654c", "tag": "52ee230c-5add-4aa2-9df1-e27f64a344ed"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:15.171927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1cf7413b-e531-4216-95e0-4402d8a6dd7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:15.177896 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1cf7413b-e531-4216-95e0-4402d8a6dd7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.419257 Aug 23 17:58:15.186010 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1027/1997] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:14 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:15.207758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=12 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:15.228726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f83a3361-4ccd-4466-bf08-46615c4550f8 req-ae63c9a2-3e7b-4706-bc4c-c89a0d1325bd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:15.233898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f83a3361-4ccd-4466-bf08-46615c4550f8 req-ae63c9a2-3e7b-4706-bc4c-c89a0d1325bd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:15.233898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f83a3361-4ccd-4466-bf08-46615c4550f8 req-ae63c9a2-3e7b-4706-bc4c-c89a0d1325bd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:15.298238 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f83a3361-4ccd-4466-bf08-46615c4550f8 req-ae63c9a2-3e7b-4706-bc4c-c89a0d1325bd service nova] Creating event network-changed:eec4fd61-f043-4080-a007-9c202b65aefc for instance 480827c0-1bbc-4e3f-9176-aebec4fc597b on n-h2-850468-16 Aug 23 17:58:15.301855 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f83a3361-4ccd-4466-bf08-46615c4550f8 req-ae63c9a2-3e7b-4706-bc4c-c89a0d1325bd service nova] Creating event network-changed:52ee230c-5add-4aa2-9df1-e27f64a344ed for instance ce1045a1-9999-4f13-82da-906bf1d0654c on n-h2-850468-16 Aug 23 17:58:15.323958 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f83a3361-4ccd-4466-bf08-46615c4550f8 req-ae63c9a2-3e7b-4706-bc4c-c89a0d1325bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.167426 Aug 23 17:58:15.332365 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 971/1998] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:15 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:15.357600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f40f733c-5b15-4ca6-b8ef-c195fcefd3d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:15.358388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f40f733c-5b15-4ca6-b8ef-c195fcefd3d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:15.366181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f40f733c-5b15-4ca6-b8ef-c195fcefd3d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:15.366977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f40f733c-5b15-4ca6-b8ef-c195fcefd3d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:15.367578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f40f733c-5b15-4ca6-b8ef-c195fcefd3d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:15.369470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f40f733c-5b15-4ca6-b8ef-c195fcefd3d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:15.370634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f40f733c-5b15-4ca6-b8ef-c195fcefd3d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:15.371241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f40f733c-5b15-4ca6-b8ef-c195fcefd3d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:15.637486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b882c69f-30d9-4918-82b1-99ca37fc99ab tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:15.638316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b882c69f-30d9-4918-82b1-99ca37fc99ab tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:15.664772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b882c69f-30d9-4918-82b1-99ca37fc99ab tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:15.667688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b882c69f-30d9-4918-82b1-99ca37fc99ab tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:15.669719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b882c69f-30d9-4918-82b1-99ca37fc99ab tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:15.674991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b882c69f-30d9-4918-82b1-99ca37fc99ab tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:15.676877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b882c69f-30d9-4918-82b1-99ca37fc99ab tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:15.680985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b882c69f-30d9-4918-82b1-99ca37fc99ab tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:16.256668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f40f733c-5b15-4ca6-b8ef-c195fcefd3d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:16.277333 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f40f733c-5b15-4ca6-b8ef-c195fcefd3d0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.922298 Aug 23 17:58:16.281077 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1028/1999] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:15 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:16.294946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-d7aceed9-5384-4ea4-9e76-f775616ff76e req-ce222dd1-afd6-449f-8099-50c380cda335 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a4ebc8-3d93-4377-beec-accf25eee386", "name": "network-vif-unplugged", "status": "completed", "tag": "67689804-86f0-4754-bb53-ddbce34de8e9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:16.324684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d7aceed9-5384-4ea4-9e76-f775616ff76e req-ce222dd1-afd6-449f-8099-50c380cda335 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:16.325174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d7aceed9-5384-4ea4-9e76-f775616ff76e req-ce222dd1-afd6-449f-8099-50c380cda335 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:16.331403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d7aceed9-5384-4ea4-9e76-f775616ff76e req-ce222dd1-afd6-449f-8099-50c380cda335 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:16.366030 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-d7aceed9-5384-4ea4-9e76-f775616ff76e req-ce222dd1-afd6-449f-8099-50c380cda335 service nova] Creating event network-vif-unplugged:67689804-86f0-4754-bb53-ddbce34de8e9 for instance 13a4ebc8-3d93-4377-beec-accf25eee386 on n-h1-850468-16 Aug 23 17:58:16.408293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-d7aceed9-5384-4ea4-9e76-f775616ff76e req-ce222dd1-afd6-449f-8099-50c380cda335 service nova] Instance 13a4ebc8-3d93-4377-beec-accf25eee386 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 17:58:16.448967 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-d7aceed9-5384-4ea4-9e76-f775616ff76e req-ce222dd1-afd6-449f-8099-50c380cda335 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.163727 Aug 23 17:58:16.452163 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1029/2000] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:16.463259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de5675b3-0ad6-4b3f-b1bf-02743c2af98f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:16.465574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-de5675b3-0ad6-4b3f-b1bf-02743c2af98f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:16.486977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de5675b3-0ad6-4b3f-b1bf-02743c2af98f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:16.488465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de5675b3-0ad6-4b3f-b1bf-02743c2af98f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:16.490726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de5675b3-0ad6-4b3f-b1bf-02743c2af98f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:16.492752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de5675b3-0ad6-4b3f-b1bf-02743c2af98f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:16.495175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de5675b3-0ad6-4b3f-b1bf-02743c2af98f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:16.497396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de5675b3-0ad6-4b3f-b1bf-02743c2af98f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:16.580120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b882c69f-30d9-4918-82b1-99ca37fc99ab tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:16.589756 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b882c69f-30d9-4918-82b1-99ca37fc99ab tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1318 microversion: 2.1 time: 0.964015 Aug 23 17:58:16.591372 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 972/2001] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:15 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1318 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:58:16.596666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adc4a95c-1740-44e2-9173-08e6738a7289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:16.600950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-adc4a95c-1740-44e2-9173-08e6738a7289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:16.613519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adc4a95c-1740-44e2-9173-08e6738a7289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:16.624448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adc4a95c-1740-44e2-9173-08e6738a7289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:16.625362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adc4a95c-1740-44e2-9173-08e6738a7289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:16.626371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adc4a95c-1740-44e2-9173-08e6738a7289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:16.634461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adc4a95c-1740-44e2-9173-08e6738a7289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:16.643128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adc4a95c-1740-44e2-9173-08e6738a7289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:17.433201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-adc4a95c-1740-44e2-9173-08e6738a7289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:17.468374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-adc4a95c-1740-44e2-9173-08e6738a7289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:17.477161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-adc4a95c-1740-44e2-9173-08e6738a7289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:17.481187 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-adc4a95c-1740-44e2-9173-08e6738a7289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.888300 Aug 23 17:58:17.487982 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 973/2002] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:16 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:17.505517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-024d20b9-f6e0-4bff-96fc-cc532f52f8d6 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:17.507644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-024d20b9-f6e0-4bff-96fc-cc532f52f8d6 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:17.538065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-024d20b9-f6e0-4bff-96fc-cc532f52f8d6 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:17.538996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-024d20b9-f6e0-4bff-96fc-cc532f52f8d6 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:17.542534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-024d20b9-f6e0-4bff-96fc-cc532f52f8d6 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:17.544105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-024d20b9-f6e0-4bff-96fc-cc532f52f8d6 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:17.548846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-024d20b9-f6e0-4bff-96fc-cc532f52f8d6 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:17.549444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-024d20b9-f6e0-4bff-96fc-cc532f52f8d6 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:17.781481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-de5675b3-0ad6-4b3f-b1bf-02743c2af98f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:17.801141 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-de5675b3-0ad6-4b3f-b1bf-02743c2af98f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1469 microversion: 2.1 time: 1.342192 Aug 23 17:58:17.802062 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1030/2003] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:16 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1469 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:17.814488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ba3c6a70-9445-4e8d-97ef-5ddbe1da911e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:17.815507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ba3c6a70-9445-4e8d-97ef-5ddbe1da911e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:17.833818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba3c6a70-9445-4e8d-97ef-5ddbe1da911e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:17.834689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba3c6a70-9445-4e8d-97ef-5ddbe1da911e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:17.835398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba3c6a70-9445-4e8d-97ef-5ddbe1da911e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:17.836560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba3c6a70-9445-4e8d-97ef-5ddbe1da911e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:17.838266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba3c6a70-9445-4e8d-97ef-5ddbe1da911e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:17.841743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba3c6a70-9445-4e8d-97ef-5ddbe1da911e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:18.080759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-024d20b9-f6e0-4bff-96fc-cc532f52f8d6 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:18.091453 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-024d20b9-f6e0-4bff-96fc-cc532f52f8d6 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.598392 Aug 23 17:58:18.115265 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 974/2004] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:17 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:18.521389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8acbe0d-8543-4590-aa5f-338e9412381b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:18.523268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8acbe0d-8543-4590-aa5f-338e9412381b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:18.538999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8acbe0d-8543-4590-aa5f-338e9412381b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:18.540461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8acbe0d-8543-4590-aa5f-338e9412381b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:18.544927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8acbe0d-8543-4590-aa5f-338e9412381b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:18.546190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8acbe0d-8543-4590-aa5f-338e9412381b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:18.546912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8acbe0d-8543-4590-aa5f-338e9412381b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:18.547566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8acbe0d-8543-4590-aa5f-338e9412381b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:18.588030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ba3c6a70-9445-4e8d-97ef-5ddbe1da911e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:18.607441 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ba3c6a70-9445-4e8d-97ef-5ddbe1da911e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1318 microversion: 2.1 time: 0.800570 Aug 23 17:58:18.610462 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1031/2005] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:17 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1318 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:19.069915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8acbe0d-8543-4590-aa5f-338e9412381b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:19.100665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8acbe0d-8543-4590-aa5f-338e9412381b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:19.106566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8acbe0d-8543-4590-aa5f-338e9412381b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:19.108455 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8acbe0d-8543-4590-aa5f-338e9412381b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.590729 Aug 23 17:58:19.110563 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 975/2006] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:18 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:58:19.125093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f4415d19-6997-45d0-92bf-06d2cacd9132 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:19.126386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f4415d19-6997-45d0-92bf-06d2cacd9132 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:19.141484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4415d19-6997-45d0-92bf-06d2cacd9132 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:19.142247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4415d19-6997-45d0-92bf-06d2cacd9132 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:19.142931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4415d19-6997-45d0-92bf-06d2cacd9132 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:19.143837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4415d19-6997-45d0-92bf-06d2cacd9132 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:19.152135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4415d19-6997-45d0-92bf-06d2cacd9132 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:19.153615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4415d19-6997-45d0-92bf-06d2cacd9132 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:19.192557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-37993a29-e3be-4a95-b0d5-8ef416041817 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:19.194012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-37993a29-e3be-4a95-b0d5-8ef416041817 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:19.217658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-37993a29-e3be-4a95-b0d5-8ef416041817 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:19.219774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-37993a29-e3be-4a95-b0d5-8ef416041817 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:19.220402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-37993a29-e3be-4a95-b0d5-8ef416041817 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:19.221996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-37993a29-e3be-4a95-b0d5-8ef416041817 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:19.223915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-37993a29-e3be-4a95-b0d5-8ef416041817 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:19.226099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-37993a29-e3be-4a95-b0d5-8ef416041817 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:19.540605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f4415d19-6997-45d0-92bf-06d2cacd9132 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:19.544607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:19.551296 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f4415d19-6997-45d0-92bf-06d2cacd9132 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.437274 Aug 23 17:58:19.566216 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 976/2007] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:19 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:58:19.631379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f48fb9a6-c674-4cc0-8c91-4c821ad6bd03 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:19.632456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f48fb9a6-c674-4cc0-8c91-4c821ad6bd03 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:19.641440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f48fb9a6-c674-4cc0-8c91-4c821ad6bd03 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:19.641938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f48fb9a6-c674-4cc0-8c91-4c821ad6bd03 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:19.642379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f48fb9a6-c674-4cc0-8c91-4c821ad6bd03 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:19.643132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f48fb9a6-c674-4cc0-8c91-4c821ad6bd03 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:19.643590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f48fb9a6-c674-4cc0-8c91-4c821ad6bd03 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:19.644015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f48fb9a6-c674-4cc0-8c91-4c821ad6bd03 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:19.956019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-37993a29-e3be-4a95-b0d5-8ef416041817 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:19.969373 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-37993a29-e3be-4a95-b0d5-8ef416041817 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1469 microversion: 2.1 time: 1.146969 Aug 23 17:58:19.970974 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1032/2008] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:18 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1469 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:58:20.147117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b1c07d17-875e-49e0-bab7-b2ab99ffd4c6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:20.148064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b1c07d17-875e-49e0-bab7-b2ab99ffd4c6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:20.158341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1c07d17-875e-49e0-bab7-b2ab99ffd4c6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:20.159234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1c07d17-875e-49e0-bab7-b2ab99ffd4c6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:20.159879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1c07d17-875e-49e0-bab7-b2ab99ffd4c6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:20.160764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1c07d17-875e-49e0-bab7-b2ab99ffd4c6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:20.161450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1c07d17-875e-49e0-bab7-b2ab99ffd4c6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:20.162203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1c07d17-875e-49e0-bab7-b2ab99ffd4c6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:20.169712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:20.208008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f48fb9a6-c674-4cc0-8c91-4c821ad6bd03 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:20.218659 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f48fb9a6-c674-4cc0-8c91-4c821ad6bd03 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1318 microversion: 2.1 time: 0.592980 Aug 23 17:58:20.219242 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 977/2009] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:19 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1318 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:20.324724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c48828ad-4daa-4b3c-8b89-27ef5a05eaba req-eeb59b7e-e028-44fa-84f3-35ff9e358bee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13a4ebc8-3d93-4377-beec-accf25eee386", "tag": "67689804-86f0-4754-bb53-ddbce34de8e9"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:20.347694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c48828ad-4daa-4b3c-8b89-27ef5a05eaba req-eeb59b7e-e028-44fa-84f3-35ff9e358bee service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:20.348475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c48828ad-4daa-4b3c-8b89-27ef5a05eaba req-eeb59b7e-e028-44fa-84f3-35ff9e358bee service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:20.350829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c48828ad-4daa-4b3c-8b89-27ef5a05eaba req-eeb59b7e-e028-44fa-84f3-35ff9e358bee service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:20.372483 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c48828ad-4daa-4b3c-8b89-27ef5a05eaba req-eeb59b7e-e028-44fa-84f3-35ff9e358bee service nova] Creating event network-changed:67689804-86f0-4754-bb53-ddbce34de8e9 for instance 13a4ebc8-3d93-4377-beec-accf25eee386 on n-h1-850468-16 Aug 23 17:58:20.394795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-c48828ad-4daa-4b3c-8b89-27ef5a05eaba req-eeb59b7e-e028-44fa-84f3-35ff9e358bee service nova] Instance 13a4ebc8-3d93-4377-beec-accf25eee386 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 17:58:20.412247 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c48828ad-4daa-4b3c-8b89-27ef5a05eaba req-eeb59b7e-e028-44fa-84f3-35ff9e358bee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091467 Aug 23 17:58:20.414097 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 978/2010] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:58:20.576402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e6a936c7-342b-48b8-b0c7-6b7601694b19 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:20.577403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e6a936c7-342b-48b8-b0c7-6b7601694b19 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:20.592511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6a936c7-342b-48b8-b0c7-6b7601694b19 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:20.593240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6a936c7-342b-48b8-b0c7-6b7601694b19 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:20.597398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6a936c7-342b-48b8-b0c7-6b7601694b19 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:20.598258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6a936c7-342b-48b8-b0c7-6b7601694b19 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:20.598858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6a936c7-342b-48b8-b0c7-6b7601694b19 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:20.606906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6a936c7-342b-48b8-b0c7-6b7601694b19 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:20.893229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e6a936c7-342b-48b8-b0c7-6b7601694b19 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:20.893401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b1c07d17-875e-49e0-bab7-b2ab99ffd4c6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:20.903170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b1c07d17-875e-49e0-bab7-b2ab99ffd4c6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:20.904583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b1c07d17-875e-49e0-bab7-b2ab99ffd4c6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:20.905770 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b1c07d17-875e-49e0-bab7-b2ab99ffd4c6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.775013 Aug 23 17:58:20.905965 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e6a936c7-342b-48b8-b0c7-6b7601694b19 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.336221 Aug 23 17:58:20.906333 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1033/2011] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:20 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:20.907410 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 979/2012] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:20 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:58:20.926222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-db186157-8be1-4fa8-9350-606d77cf6756 req-e3f23e2e-5078-48bf-8451-5ca2500abe22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f47e601-36d6-4b1f-a4bf-8020bf69831c", "name": "network-vif-plugged", "status": "completed", "tag": "4838606c-edcc-47d0-96e3-cce31a7cb847"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:20.936281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-db186157-8be1-4fa8-9350-606d77cf6756 req-e3f23e2e-5078-48bf-8451-5ca2500abe22 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:20.937024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-db186157-8be1-4fa8-9350-606d77cf6756 req-e3f23e2e-5078-48bf-8451-5ca2500abe22 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:20.937657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-db186157-8be1-4fa8-9350-606d77cf6756 req-e3f23e2e-5078-48bf-8451-5ca2500abe22 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:20.953233 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-db186157-8be1-4fa8-9350-606d77cf6756 req-e3f23e2e-5078-48bf-8451-5ca2500abe22 service nova] Creating event network-vif-plugged:4838606c-edcc-47d0-96e3-cce31a7cb847 for instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c on n-h2-850468-16 Aug 23 17:58:20.958703 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-db186157-8be1-4fa8-9350-606d77cf6756 req-e3f23e2e-5078-48bf-8451-5ca2500abe22 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043505 Aug 23 17:58:20.959872 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1034/2013] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:20.991834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae792bf5-0d8a-4b2a-9ee2-17d57a4d102b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:20.992756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae792bf5-0d8a-4b2a-9ee2-17d57a4d102b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:21.002478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae792bf5-0d8a-4b2a-9ee2-17d57a4d102b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:21.003278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae792bf5-0d8a-4b2a-9ee2-17d57a4d102b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:21.003896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae792bf5-0d8a-4b2a-9ee2-17d57a4d102b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:21.006109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae792bf5-0d8a-4b2a-9ee2-17d57a4d102b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:21.006821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae792bf5-0d8a-4b2a-9ee2-17d57a4d102b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:21.007449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae792bf5-0d8a-4b2a-9ee2-17d57a4d102b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:21.243168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c286f1c-6dc6-408d-a54b-bc7d9f8fccfb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:21.244280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5c286f1c-6dc6-408d-a54b-bc7d9f8fccfb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:21.264707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c286f1c-6dc6-408d-a54b-bc7d9f8fccfb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:21.265469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c286f1c-6dc6-408d-a54b-bc7d9f8fccfb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:21.266089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c286f1c-6dc6-408d-a54b-bc7d9f8fccfb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:21.267246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c286f1c-6dc6-408d-a54b-bc7d9f8fccfb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:21.267888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c286f1c-6dc6-408d-a54b-bc7d9f8fccfb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:21.268315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c286f1c-6dc6-408d-a54b-bc7d9f8fccfb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:21.285476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ae792bf5-0d8a-4b2a-9ee2-17d57a4d102b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:21.308505 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae792bf5-0d8a-4b2a-9ee2-17d57a4d102b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1469 microversion: 2.1 time: 0.320466 Aug 23 17:58:21.309100 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 980/2014] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:20 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1469 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:21.928485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-925d255d-695e-4a7f-b404-e93f53bf0289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:21.929411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-925d255d-695e-4a7f-b404-e93f53bf0289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:21.956180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-925d255d-695e-4a7f-b404-e93f53bf0289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:21.957400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-925d255d-695e-4a7f-b404-e93f53bf0289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:21.958029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-925d255d-695e-4a7f-b404-e93f53bf0289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:21.959733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-925d255d-695e-4a7f-b404-e93f53bf0289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:21.960376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-925d255d-695e-4a7f-b404-e93f53bf0289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:21.960976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-925d255d-695e-4a7f-b404-e93f53bf0289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:22.138880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5c286f1c-6dc6-408d-a54b-bc7d9f8fccfb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:22.153953 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5c286f1c-6dc6-408d-a54b-bc7d9f8fccfb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1318 microversion: 2.1 time: 0.916637 Aug 23 17:58:22.154581 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1035/2015] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:21 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1318 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:22.172531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9bd9fe56-d1ad-47d1-b3fd-89f880946cf7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:22.173164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9bd9fe56-d1ad-47d1-b3fd-89f880946cf7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:22.191751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bd9fe56-d1ad-47d1-b3fd-89f880946cf7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:22.195118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bd9fe56-d1ad-47d1-b3fd-89f880946cf7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:22.198716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bd9fe56-d1ad-47d1-b3fd-89f880946cf7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:22.200015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bd9fe56-d1ad-47d1-b3fd-89f880946cf7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:22.202567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bd9fe56-d1ad-47d1-b3fd-89f880946cf7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:22.203200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bd9fe56-d1ad-47d1-b3fd-89f880946cf7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:22.460154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9bd9fe56-d1ad-47d1-b3fd-89f880946cf7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:22.484875 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9bd9fe56-d1ad-47d1-b3fd-89f880946cf7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.327035 Aug 23 17:58:22.485864 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1036/2016] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:22 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:22.492333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de57672e-8bb9-4f6f-afd6-1c1e5d1a9b20 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:22.495815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-de57672e-8bb9-4f6f-afd6-1c1e5d1a9b20 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:22.506520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de57672e-8bb9-4f6f-afd6-1c1e5d1a9b20 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:22.507419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de57672e-8bb9-4f6f-afd6-1c1e5d1a9b20 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:22.508092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de57672e-8bb9-4f6f-afd6-1c1e5d1a9b20 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:22.509223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de57672e-8bb9-4f6f-afd6-1c1e5d1a9b20 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:22.510151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de57672e-8bb9-4f6f-afd6-1c1e5d1a9b20 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:22.510920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de57672e-8bb9-4f6f-afd6-1c1e5d1a9b20 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:22.548430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-925d255d-695e-4a7f-b404-e93f53bf0289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:22.560822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-925d255d-695e-4a7f-b404-e93f53bf0289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:22.562338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-925d255d-695e-4a7f-b404-e93f53bf0289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:22.563565 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-925d255d-695e-4a7f-b404-e93f53bf0289 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.639291 Aug 23 17:58:22.575619 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 981/2017] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:21 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:23.026323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-de57672e-8bb9-4f6f-afd6-1c1e5d1a9b20 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:23.038528 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-de57672e-8bb9-4f6f-afd6-1c1e5d1a9b20 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1469 microversion: 2.1 time: 0.551272 Aug 23 17:58:23.047181 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1037/2018] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:22 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1469 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:23.181387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-25b49171-579a-4dca-83e7-55baa5fda20d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:23.182772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-25b49171-579a-4dca-83e7-55baa5fda20d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:23.190338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25b49171-579a-4dca-83e7-55baa5fda20d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:23.191248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25b49171-579a-4dca-83e7-55baa5fda20d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:23.192012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25b49171-579a-4dca-83e7-55baa5fda20d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:23.193828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25b49171-579a-4dca-83e7-55baa5fda20d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:23.194712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25b49171-579a-4dca-83e7-55baa5fda20d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:23.197073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25b49171-579a-4dca-83e7-55baa5fda20d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:23.510405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-88ada9e1-31fb-4bf6-8df2-70654d99b25f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:23.512307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-88ada9e1-31fb-4bf6-8df2-70654d99b25f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:23.521821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88ada9e1-31fb-4bf6-8df2-70654d99b25f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:23.522586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88ada9e1-31fb-4bf6-8df2-70654d99b25f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:23.524907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88ada9e1-31fb-4bf6-8df2-70654d99b25f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:23.529837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88ada9e1-31fb-4bf6-8df2-70654d99b25f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:23.530658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88ada9e1-31fb-4bf6-8df2-70654d99b25f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:23.531313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88ada9e1-31fb-4bf6-8df2-70654d99b25f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:23.619542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-25b49171-579a-4dca-83e7-55baa5fda20d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:23.665356 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-25b49171-579a-4dca-83e7-55baa5fda20d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1318 microversion: 2.1 time: 0.490587 Aug 23 17:58:23.668315 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 982/2019] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:23 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1318 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:23.703137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5434ab2d-05d0-4abd-8b61-06dd929912c8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:23.705528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5434ab2d-05d0-4abd-8b61-06dd929912c8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:23.733293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5434ab2d-05d0-4abd-8b61-06dd929912c8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:23.734036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5434ab2d-05d0-4abd-8b61-06dd929912c8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:23.736072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5434ab2d-05d0-4abd-8b61-06dd929912c8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:23.737078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5434ab2d-05d0-4abd-8b61-06dd929912c8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:23.740641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5434ab2d-05d0-4abd-8b61-06dd929912c8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:23.746753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5434ab2d-05d0-4abd-8b61-06dd929912c8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:23.910389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-88ada9e1-31fb-4bf6-8df2-70654d99b25f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:23.921558 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-88ada9e1-31fb-4bf6-8df2-70654d99b25f tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.415840 Aug 23 17:58:23.928811 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1038/2020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:23 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:24.001624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5434ab2d-05d0-4abd-8b61-06dd929912c8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:24.018451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5434ab2d-05d0-4abd-8b61-06dd929912c8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:24.020327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5434ab2d-05d0-4abd-8b61-06dd929912c8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:24.021707 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5434ab2d-05d0-4abd-8b61-06dd929912c8 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.352042 Aug 23 17:58:24.022300 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 983/2021] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:23 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:24.072221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-019dc52c-4f4c-4d07-b0e6-ca41c6c94a27 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:24.073048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-019dc52c-4f4c-4d07-b0e6-ca41c6c94a27 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:24.088272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-019dc52c-4f4c-4d07-b0e6-ca41c6c94a27 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:24.088791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-019dc52c-4f4c-4d07-b0e6-ca41c6c94a27 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:24.090996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-019dc52c-4f4c-4d07-b0e6-ca41c6c94a27 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:24.092173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-019dc52c-4f4c-4d07-b0e6-ca41c6c94a27 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:24.093319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-019dc52c-4f4c-4d07-b0e6-ca41c6c94a27 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:24.094177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-019dc52c-4f4c-4d07-b0e6-ca41c6c94a27 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:24.553637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-019dc52c-4f4c-4d07-b0e6-ca41c6c94a27 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:24.564935 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-019dc52c-4f4c-4d07-b0e6-ca41c6c94a27 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1469 microversion: 2.1 time: 0.497060 Aug 23 17:58:24.566201 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1039/2022] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:24 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1469 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:24.695647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-435e9868-ae35-481b-9949-1dae2260be21 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:24.698745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-435e9868-ae35-481b-9949-1dae2260be21 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:24.733242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-435e9868-ae35-481b-9949-1dae2260be21 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:24.735075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-435e9868-ae35-481b-9949-1dae2260be21 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:24.737858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-435e9868-ae35-481b-9949-1dae2260be21 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:24.739879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-435e9868-ae35-481b-9949-1dae2260be21 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:24.742037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-435e9868-ae35-481b-9949-1dae2260be21 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:24.743228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-435e9868-ae35-481b-9949-1dae2260be21 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:24.948648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-747f000d-507c-4b57-884c-c46c9307ab93 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:24.949345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-747f000d-507c-4b57-884c-c46c9307ab93 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:24.963445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-747f000d-507c-4b57-884c-c46c9307ab93 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:24.964167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-747f000d-507c-4b57-884c-c46c9307ab93 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:24.964495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-747f000d-507c-4b57-884c-c46c9307ab93 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:24.966141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-747f000d-507c-4b57-884c-c46c9307ab93 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:24.966634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-747f000d-507c-4b57-884c-c46c9307ab93 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:24.967141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-747f000d-507c-4b57-884c-c46c9307ab93 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:25.301590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-435e9868-ae35-481b-9949-1dae2260be21 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:25.318154 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-435e9868-ae35-481b-9949-1dae2260be21 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1318 microversion: 2.1 time: 0.630186 Aug 23 17:58:25.325395 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 984/2023] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:24 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:25.345777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6b8ab125-267c-4836-8019-dd8571c28314 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:25.345777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6b8ab125-267c-4836-8019-dd8571c28314 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:25.372801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b8ab125-267c-4836-8019-dd8571c28314 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:25.377015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b8ab125-267c-4836-8019-dd8571c28314 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:25.382816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b8ab125-267c-4836-8019-dd8571c28314 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:25.384412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b8ab125-267c-4836-8019-dd8571c28314 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:25.384915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b8ab125-267c-4836-8019-dd8571c28314 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:25.385356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b8ab125-267c-4836-8019-dd8571c28314 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:25.512296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-747f000d-507c-4b57-884c-c46c9307ab93 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:25.522790 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-747f000d-507c-4b57-884c-c46c9307ab93 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1522 microversion: 2.1 time: 0.578099 Aug 23 17:58:25.527195 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1040/2024] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:24 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1522 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:25.590919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6672e75a-22f6-433a-a9db-83ac3f08736d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:25.591561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6672e75a-22f6-433a-a9db-83ac3f08736d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:25.605974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6672e75a-22f6-433a-a9db-83ac3f08736d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:25.608466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6672e75a-22f6-433a-a9db-83ac3f08736d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:25.609180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6672e75a-22f6-433a-a9db-83ac3f08736d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:25.620595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6672e75a-22f6-433a-a9db-83ac3f08736d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:25.635292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6672e75a-22f6-433a-a9db-83ac3f08736d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:25.637495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6672e75a-22f6-433a-a9db-83ac3f08736d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:25.968792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6b8ab125-267c-4836-8019-dd8571c28314 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:26.005250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6b8ab125-267c-4836-8019-dd8571c28314 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:26.009366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6b8ab125-267c-4836-8019-dd8571c28314 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:26.011299 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6b8ab125-267c-4836-8019-dd8571c28314 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.684889 Aug 23 17:58:26.030590 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 985/2025] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:25 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:26.046436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-91b7f49c-319b-4329-bba4-dd439c253ec7 req-70e11e0c-3dc1-42b6-9f98-c1076a444ade service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1045a1-9999-4f13-82da-906bf1d0654c", "name": "network-vif-plugged", "status": "completed", "tag": "52ee230c-5add-4aa2-9df1-e27f64a344ed"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:26.060700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-91b7f49c-319b-4329-bba4-dd439c253ec7 req-70e11e0c-3dc1-42b6-9f98-c1076a444ade service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:26.064124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-91b7f49c-319b-4329-bba4-dd439c253ec7 req-70e11e0c-3dc1-42b6-9f98-c1076a444ade service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:26.064787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-91b7f49c-319b-4329-bba4-dd439c253ec7 req-70e11e0c-3dc1-42b6-9f98-c1076a444ade service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:26.095756 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-91b7f49c-319b-4329-bba4-dd439c253ec7 req-70e11e0c-3dc1-42b6-9f98-c1076a444ade service nova] Creating event network-vif-plugged:52ee230c-5add-4aa2-9df1-e27f64a344ed for instance ce1045a1-9999-4f13-82da-906bf1d0654c on n-h2-850468-16 Aug 23 17:58:26.110186 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-91b7f49c-319b-4329-bba4-dd439c253ec7 req-70e11e0c-3dc1-42b6-9f98-c1076a444ade service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077777 Aug 23 17:58:26.119778 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 986/2026] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:26.256614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6672e75a-22f6-433a-a9db-83ac3f08736d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:26.265495 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6672e75a-22f6-433a-a9db-83ac3f08736d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1469 microversion: 2.1 time: 0.679367 Aug 23 17:58:26.270456 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1041/2027] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:25 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1469 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:26.348038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b492c71-1723-4cd8-bf4d-59edcd5632bd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:26.349119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3b492c71-1723-4cd8-bf4d-59edcd5632bd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:26.368259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b492c71-1723-4cd8-bf4d-59edcd5632bd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:26.371007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b492c71-1723-4cd8-bf4d-59edcd5632bd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:26.371684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b492c71-1723-4cd8-bf4d-59edcd5632bd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:26.372614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b492c71-1723-4cd8-bf4d-59edcd5632bd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:26.375438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b492c71-1723-4cd8-bf4d-59edcd5632bd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:26.379805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b492c71-1723-4cd8-bf4d-59edcd5632bd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:26.542979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-179441f1-c694-4649-8064-4341f6ad0388 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:26.543605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-179441f1-c694-4649-8064-4341f6ad0388 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:26.559021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-179441f1-c694-4649-8064-4341f6ad0388 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:26.559521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-179441f1-c694-4649-8064-4341f6ad0388 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:26.559964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-179441f1-c694-4649-8064-4341f6ad0388 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:26.566399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-179441f1-c694-4649-8064-4341f6ad0388 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:26.566994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-179441f1-c694-4649-8064-4341f6ad0388 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:26.567442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-179441f1-c694-4649-8064-4341f6ad0388 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:26.778637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3b492c71-1723-4cd8-bf4d-59edcd5632bd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:26.795375 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3b492c71-1723-4cd8-bf4d-59edcd5632bd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1318 microversion: 2.1 time: 0.451453 Aug 23 17:58:26.796336 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 987/2028] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:26 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:26.976265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-179441f1-c694-4649-8064-4341f6ad0388 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:26.989547 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-179441f1-c694-4649-8064-4341f6ad0388 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1499 microversion: 2.1 time: 0.450333 Aug 23 17:58:26.990787 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1042/2029] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:26 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1499 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:58:27.011982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-73f5d0f9-a74c-4772-905f-4197c4ae0c8d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:27.018498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73f5d0f9-a74c-4772-905f-4197c4ae0c8d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:27.019996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-73f5d0f9-a74c-4772-905f-4197c4ae0c8d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:27.027432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f5d0f9-a74c-4772-905f-4197c4ae0c8d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:27.028188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f5d0f9-a74c-4772-905f-4197c4ae0c8d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:27.028851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f5d0f9-a74c-4772-905f-4197c4ae0c8d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:27.029893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f5d0f9-a74c-4772-905f-4197c4ae0c8d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:27.030530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f5d0f9-a74c-4772-905f-4197c4ae0c8d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:27.031156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f5d0f9-a74c-4772-905f-4197c4ae0c8d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:27.038409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-64edcb24-4586-44bd-8b77-9cbbb268c76c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:27.039356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-64edcb24-4586-44bd-8b77-9cbbb268c76c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:27.053685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64edcb24-4586-44bd-8b77-9cbbb268c76c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:27.055279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64edcb24-4586-44bd-8b77-9cbbb268c76c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:27.058827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64edcb24-4586-44bd-8b77-9cbbb268c76c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:27.060936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64edcb24-4586-44bd-8b77-9cbbb268c76c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:27.063002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64edcb24-4586-44bd-8b77-9cbbb268c76c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:27.063667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64edcb24-4586-44bd-8b77-9cbbb268c76c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:27.105144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-73f5d0f9-a74c-4772-905f-4197c4ae0c8d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:27.231203 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-73f5d0f9-a74c-4772-905f-4197c4ae0c8d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 346 microversion: 2.1 time: 0.222106 Aug 23 17:58:27.234949 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 988/2030] 10.222.0.61 () {58 vars in 1154 bytes} [Tue Aug 23 17:58:27 2022] GET /compute/v2.1/servers?status=shutoff => generated 346 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:27.249734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-086875f8-5dba-415c-90ac-0d9f26fb9518 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:27.269489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-086875f8-5dba-415c-90ac-0d9f26fb9518 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:27.270464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-086875f8-5dba-415c-90ac-0d9f26fb9518 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:27.272714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-086875f8-5dba-415c-90ac-0d9f26fb9518 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:27.428259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-086875f8-5dba-415c-90ac-0d9f26fb9518 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Going to try to start instance {{(pid=128808) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 17:58:27.543810 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-086875f8-5dba-415c-90ac-0d9f26fb9518 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "POST /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c/action" status: 202 len: 0 microversion: 2.1 time: 0.299526 Aug 23 17:58:27.545378 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 989/2031] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:58:27 2022] POST /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:58:27.572019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1447e2bd-48ca-4c8a-b1f4-b7ceb2f553a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:27.574869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1447e2bd-48ca-4c8a-b1f4-b7ceb2f553a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:27.589536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1447e2bd-48ca-4c8a-b1f4-b7ceb2f553a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:27.590825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1447e2bd-48ca-4c8a-b1f4-b7ceb2f553a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:27.593955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1447e2bd-48ca-4c8a-b1f4-b7ceb2f553a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:27.595198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1447e2bd-48ca-4c8a-b1f4-b7ceb2f553a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:27.595974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1447e2bd-48ca-4c8a-b1f4-b7ceb2f553a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:27.596648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1447e2bd-48ca-4c8a-b1f4-b7ceb2f553a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:27.692928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-64edcb24-4586-44bd-8b77-9cbbb268c76c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:27.704609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-64edcb24-4586-44bd-8b77-9cbbb268c76c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:27.706160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-64edcb24-4586-44bd-8b77-9cbbb268c76c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:27.707497 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-64edcb24-4586-44bd-8b77-9cbbb268c76c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.674232 Aug 23 17:58:27.712786 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1043/2032] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:27 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:58:27.718178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-269656177", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "01db69ea-76ab-43b6-bec6-04f17d268a24"}], "block_device_mapping_v2": [{"uuid": "f577f7f4-8164-49c9-b4f2-413488b3dcbd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:27.849634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] validate_networks() for [('01db69ea-76ab-43b6-bec6-04f17d268a24', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:58:28.438509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1447e2bd-48ca-4c8a-b1f4-b7ceb2f553a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:28.452428 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1447e2bd-48ca-4c8a-b1f4-b7ceb2f553a2 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1462 microversion: 2.1 time: 0.904664 Aug 23 17:58:28.453143 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 990/2033] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:27 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1462 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:28.474219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-addf8f77-0989-472e-b1b7-ed4fa20c4aae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:28.475181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-addf8f77-0989-472e-b1b7-ed4fa20c4aae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:28.483794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-addf8f77-0989-472e-b1b7-ed4fa20c4aae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:28.487089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-addf8f77-0989-472e-b1b7-ed4fa20c4aae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:28.487634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-addf8f77-0989-472e-b1b7-ed4fa20c4aae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:28.488636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-addf8f77-0989-472e-b1b7-ed4fa20c4aae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:28.489179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-addf8f77-0989-472e-b1b7-ed4fa20c4aae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:28.490303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-addf8f77-0989-472e-b1b7-ed4fa20c4aae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:28.814510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-addf8f77-0989-472e-b1b7-ed4fa20c4aae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:28.825987 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-addf8f77-0989-472e-b1b7-ed4fa20c4aae tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1508 microversion: 2.1 time: 0.371538 Aug 23 17:58:28.830228 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 991/2034] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:28 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1508 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:28.847387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-566347d6-8ac8-4f16-ab6a-9dc99e6a0e3c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:28.848515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-566347d6-8ac8-4f16-ab6a-9dc99e6a0e3c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:28.858583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-566347d6-8ac8-4f16-ab6a-9dc99e6a0e3c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:28.859994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-566347d6-8ac8-4f16-ab6a-9dc99e6a0e3c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:28.860181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-566347d6-8ac8-4f16-ab6a-9dc99e6a0e3c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:28.860985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-566347d6-8ac8-4f16-ab6a-9dc99e6a0e3c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:28.862497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-566347d6-8ac8-4f16-ab6a-9dc99e6a0e3c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:28.863165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-566347d6-8ac8-4f16-ab6a-9dc99e6a0e3c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:29.190607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-566347d6-8ac8-4f16-ab6a-9dc99e6a0e3c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:29.201542 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-566347d6-8ac8-4f16-ab6a-9dc99e6a0e3c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1468 microversion: 2.1 time: 0.370046 Aug 23 17:58:29.222243 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 992/2035] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:28 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1468 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:29.229795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1d1a62fb-1fda-4224-b8ad-ba26e993a63b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:29.231915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1d1a62fb-1fda-4224-b8ad-ba26e993a63b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:29.240727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d1a62fb-1fda-4224-b8ad-ba26e993a63b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:29.241224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d1a62fb-1fda-4224-b8ad-ba26e993a63b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:29.241711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d1a62fb-1fda-4224-b8ad-ba26e993a63b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:29.242435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d1a62fb-1fda-4224-b8ad-ba26e993a63b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:29.243856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d1a62fb-1fda-4224-b8ad-ba26e993a63b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:29.244413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d1a62fb-1fda-4224-b8ad-ba26e993a63b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:29.251338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:29.870186 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1d1a62fb-1fda-4224-b8ad-ba26e993a63b tempest-MigrationsAdminTest-1496175242 tempest-MigrationsAdminTest-1496175242-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1615 microversion: 2.1 time: 0.646601 Aug 23 17:58:29.871788 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 993/2036] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:29 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1615 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:29.884846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c50c1900-0758-4209-b056-b414c3aca44e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:29.890188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c50c1900-0758-4209-b056-b414c3aca44e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:29.919131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c50c1900-0758-4209-b056-b414c3aca44e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:29.919651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c50c1900-0758-4209-b056-b414c3aca44e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:29.920595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c50c1900-0758-4209-b056-b414c3aca44e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:29.920832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c50c1900-0758-4209-b056-b414c3aca44e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:29.921289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c50c1900-0758-4209-b056-b414c3aca44e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:29.924300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:58:29.924927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c50c1900-0758-4209-b056-b414c3aca44e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:29.925466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:58:29.926132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:58:29.926769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:58:29.927393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:58:29.949618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:29.950405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:29.951057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:29.952031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:29.952679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:29.953289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:29.999057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Getting quotas for project 5bbd01aaed704a1b8509e754d19a4b8d. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:58:30.004806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Getting quotas for user 0ef389420da8493386a7f8dfb747afab and project 5bbd01aaed704a1b8509e754d19a4b8d. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:58:30.130440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:58:30.132651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f577f7f4-8164-49c9-b4f2-413488b3dcbd',volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:58:30.280857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c50c1900-0758-4209-b056-b414c3aca44e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:30.293034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c50c1900-0758-4209-b056-b414c3aca44e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:30.296002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c50c1900-0758-4209-b056-b414c3aca44e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:30.298001 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c50c1900-0758-4209-b056-b414c3aca44e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.424982 Aug 23 17:58:30.300789 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 994/2037] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:29 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:30.318412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f52ea43-b587-44e6-b896-a4280c813073 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:30.319185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f52ea43-b587-44e6-b896-a4280c813073 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:30.327221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f52ea43-b587-44e6-b896-a4280c813073 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:30.329179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f52ea43-b587-44e6-b896-a4280c813073 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:30.330750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f52ea43-b587-44e6-b896-a4280c813073 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:30.331763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f52ea43-b587-44e6-b896-a4280c813073 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:30.334118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f52ea43-b587-44e6-b896-a4280c813073 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:30.334788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f52ea43-b587-44e6-b896-a4280c813073 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:30.418496 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e723dfa1-863b-4e24-be0b-8e787287b01d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.704059 Aug 23 17:58:30.419792 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1044/2038] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:58:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:58:30.426040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f9ff88a6-7488-4be1-b413-d867051f1a29 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:30.427838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f9ff88a6-7488-4be1-b413-d867051f1a29 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:30.452492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9ff88a6-7488-4be1-b413-d867051f1a29 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:30.453017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9ff88a6-7488-4be1-b413-d867051f1a29 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:30.453471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9ff88a6-7488-4be1-b413-d867051f1a29 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:30.462631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9ff88a6-7488-4be1-b413-d867051f1a29 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:30.463133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9ff88a6-7488-4be1-b413-d867051f1a29 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:30.463586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9ff88a6-7488-4be1-b413-d867051f1a29 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:30.626472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f52ea43-b587-44e6-b896-a4280c813073 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:30.635624 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f52ea43-b587-44e6-b896-a4280c813073 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c" status: 200 len: 1467 microversion: 2.1 time: 0.332059 Aug 23 17:58:30.636297 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 995/2039] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:30 2022] GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c => generated 1467 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:30.644695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4de8374a-489c-41c8-862f-c694e5066663 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:30.645518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4de8374a-489c-41c8-862f-c694e5066663 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:30.652941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4de8374a-489c-41c8-862f-c694e5066663 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:30.653692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4de8374a-489c-41c8-862f-c694e5066663 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:30.654365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4de8374a-489c-41c8-862f-c694e5066663 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:30.655359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4de8374a-489c-41c8-862f-c694e5066663 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:30.656052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4de8374a-489c-41c8-862f-c694e5066663 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:30.656760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4de8374a-489c-41c8-862f-c694e5066663 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:30.697454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4de8374a-489c-41c8-862f-c694e5066663 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:58:30.896390 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4de8374a-489c-41c8-862f-c694e5066663 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "DELETE /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 204 len: 0 microversion: 2.1 time: 0.258871 Aug 23 17:58:30.897957 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 996/2040] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:58:30 2022] DELETE /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:58:30.905078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3474ba14-4c9a-4bf4-adc0-0378263010a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:30.906118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3474ba14-4c9a-4bf4-adc0-0378263010a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:31.125615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3474ba14-4c9a-4bf4-adc0-0378263010a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:31.138213 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3474ba14-4c9a-4bf4-adc0-0378263010a3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1052 microversion: 2.1 time: 0.237600 Aug 23 17:58:31.143150 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 997/2041] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:30 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1052 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:31.151679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-922719bd-49bf-4581-807c-8cf5e604641a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-58622311"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:31.158874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-922719bd-49bf-4581-807c-8cf5e604641a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:31.174821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-922719bd-49bf-4581-807c-8cf5e604641a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:31.181944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-922719bd-49bf-4581-807c-8cf5e604641a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:31.182905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-922719bd-49bf-4581-807c-8cf5e604641a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:31.184149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-922719bd-49bf-4581-807c-8cf5e604641a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:31.185693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-922719bd-49bf-4581-807c-8cf5e604641a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:31.186375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-922719bd-49bf-4581-807c-8cf5e604641a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:31.350053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f9ff88a6-7488-4be1-b413-d867051f1a29 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:31.364653 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f9ff88a6-7488-4be1-b413-d867051f1a29 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1508 microversion: 2.1 time: 0.943423 Aug 23 17:58:31.372380 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1045/2042] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:30 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1508 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:31.385391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-43fdac82-e637-453d-8559-fa58c7ebb3ae req-7d48b97c-fc6e-40e9-a332-7c7f2ad3a38d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a4ebc8-3d93-4377-beec-accf25eee386", "name": "network-vif-plugged", "status": "completed", "tag": "67689804-86f0-4754-bb53-ddbce34de8e9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:31.441225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:31.443930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-43fdac82-e637-453d-8559-fa58c7ebb3ae req-7d48b97c-fc6e-40e9-a332-7c7f2ad3a38d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:31.449757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-43fdac82-e637-453d-8559-fa58c7ebb3ae req-7d48b97c-fc6e-40e9-a332-7c7f2ad3a38d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:31.450880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-43fdac82-e637-453d-8559-fa58c7ebb3ae req-7d48b97c-fc6e-40e9-a332-7c7f2ad3a38d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:31.485443 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-43fdac82-e637-453d-8559-fa58c7ebb3ae req-7d48b97c-fc6e-40e9-a332-7c7f2ad3a38d service nova] Creating event network-vif-plugged:67689804-86f0-4754-bb53-ddbce34de8e9 for instance 13a4ebc8-3d93-4377-beec-accf25eee386 on n-h1-850468-16 Aug 23 17:58:31.494930 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-43fdac82-e637-453d-8559-fa58c7ebb3ae req-7d48b97c-fc6e-40e9-a332-7c7f2ad3a38d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120949 Aug 23 17:58:31.507358 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1046/2043] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:31.513461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ab76507b-3784-4e29-85a8-54f9cb2f2948 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:31.514402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ab76507b-3784-4e29-85a8-54f9cb2f2948 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:31.528537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab76507b-3784-4e29-85a8-54f9cb2f2948 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:31.529375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab76507b-3784-4e29-85a8-54f9cb2f2948 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:31.530004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab76507b-3784-4e29-85a8-54f9cb2f2948 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:31.530965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab76507b-3784-4e29-85a8-54f9cb2f2948 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:31.531666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab76507b-3784-4e29-85a8-54f9cb2f2948 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:31.532266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab76507b-3784-4e29-85a8-54f9cb2f2948 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:31.598070 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-922719bd-49bf-4581-807c-8cf5e604641a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "POST /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c/action" status: 202 len: 0 microversion: 2.1 time: 0.453051 Aug 23 17:58:31.598755 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 998/2044] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:58:31 2022] POST /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c/action => generated 0 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 17:58:31.609985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0bb973c8-2b2e-489c-869d-f0f2a5968836 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:31.610742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0bb973c8-2b2e-489c-869d-f0f2a5968836 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:31.630756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bb973c8-2b2e-489c-869d-f0f2a5968836 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:31.634003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bb973c8-2b2e-489c-869d-f0f2a5968836 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:31.635121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bb973c8-2b2e-489c-869d-f0f2a5968836 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:31.639123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bb973c8-2b2e-489c-869d-f0f2a5968836 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:31.640019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bb973c8-2b2e-489c-869d-f0f2a5968836 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:31.640662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bb973c8-2b2e-489c-869d-f0f2a5968836 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:31.933635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0bb973c8-2b2e-489c-869d-f0f2a5968836 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:31.953913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0bb973c8-2b2e-489c-869d-f0f2a5968836 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:31.959989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0bb973c8-2b2e-489c-869d-f0f2a5968836 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:31.964427 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0bb973c8-2b2e-489c-869d-f0f2a5968836 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.364276 Aug 23 17:58:31.965606 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 999/2045] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:31 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:31.976306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f968ae9f-ffec-4ac5-874d-f6f56bd6670a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec3b44c0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:32.067703 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f968ae9f-ffec-4ac5-874d-f6f56bd6670a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.096383 Aug 23 17:58:32.068859 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1000/2046] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:31 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:32.079054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ab76507b-3784-4e29-85a8-54f9cb2f2948 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:32.098419 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ab76507b-3784-4e29-85a8-54f9cb2f2948 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1468 microversion: 2.1 time: 0.589383 Aug 23 17:58:32.100931 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1047/2047] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:31 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1468 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:32.164269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a334f847-d3a8-4519-904b-0ce062792b79 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:32.165717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a334f847-d3a8-4519-904b-0ce062792b79 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:32.180500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a334f847-d3a8-4519-904b-0ce062792b79 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:32.181070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a334f847-d3a8-4519-904b-0ce062792b79 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:32.185326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a334f847-d3a8-4519-904b-0ce062792b79 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:32.186266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a334f847-d3a8-4519-904b-0ce062792b79 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:32.186906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a334f847-d3a8-4519-904b-0ce062792b79 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:32.188914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a334f847-d3a8-4519-904b-0ce062792b79 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:32.346056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a334f847-d3a8-4519-904b-0ce062792b79 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:32.360104 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a334f847-d3a8-4519-904b-0ce062792b79 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1094 microversion: 2.1 time: 0.201344 Aug 23 17:58:32.362882 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1001/2048] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:32 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1094 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:32.394433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d5531bf-b074-42fc-b311-d1f2424431e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:32.395740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d5531bf-b074-42fc-b311-d1f2424431e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:32.408246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d5531bf-b074-42fc-b311-d1f2424431e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:32.409036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d5531bf-b074-42fc-b311-d1f2424431e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:32.409651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d5531bf-b074-42fc-b311-d1f2424431e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:32.410614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d5531bf-b074-42fc-b311-d1f2424431e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:32.411074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d5531bf-b074-42fc-b311-d1f2424431e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:32.411666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d5531bf-b074-42fc-b311-d1f2424431e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:32.992062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ecc04c18-54a2-4039-bbe1-0a0e86b99fc5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:32.994380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ecc04c18-54a2-4039-bbe1-0a0e86b99fc5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:33.012088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecc04c18-54a2-4039-bbe1-0a0e86b99fc5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:33.012590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecc04c18-54a2-4039-bbe1-0a0e86b99fc5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:33.013026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecc04c18-54a2-4039-bbe1-0a0e86b99fc5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:33.013750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecc04c18-54a2-4039-bbe1-0a0e86b99fc5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:33.014201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecc04c18-54a2-4039-bbe1-0a0e86b99fc5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:33.014659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecc04c18-54a2-4039-bbe1-0a0e86b99fc5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:33.186661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5d5531bf-b074-42fc-b311-d1f2424431e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:33.219002 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d5531bf-b074-42fc-b311-d1f2424431e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1512 microversion: 2.1 time: 0.827693 Aug 23 17:58:33.224301 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1048/2049] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:32 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1512 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:33.238739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4daa9638-a10c-4ac4-a291-a77cfec6acab tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec279e50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:33.365926 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4daa9638-a10c-4ac4-a291-a77cfec6acab tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.140171 Aug 23 17:58:33.366744 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1049/2050] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:33 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:33.385478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c5b26c7d-50b8-467b-9532-0cdb4b11597d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:33.391722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c5b26c7d-50b8-467b-9532-0cdb4b11597d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:33.412604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5b26c7d-50b8-467b-9532-0cdb4b11597d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:33.416822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5b26c7d-50b8-467b-9532-0cdb4b11597d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:33.417699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5b26c7d-50b8-467b-9532-0cdb4b11597d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:33.418893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5b26c7d-50b8-467b-9532-0cdb4b11597d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:33.419531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5b26c7d-50b8-467b-9532-0cdb4b11597d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:33.422082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5b26c7d-50b8-467b-9532-0cdb4b11597d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:33.755995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ecc04c18-54a2-4039-bbe1-0a0e86b99fc5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:33.772305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ecc04c18-54a2-4039-bbe1-0a0e86b99fc5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:33.779671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ecc04c18-54a2-4039-bbe1-0a0e86b99fc5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:33.782832 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ecc04c18-54a2-4039-bbe1-0a0e86b99fc5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 0.793568 Aug 23 17:58:33.790877 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1002/2051] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:32 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:33.810816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac79f65b-0d11-4023-ba6c-c2277bf226d7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:33.825039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac79f65b-0d11-4023-ba6c-c2277bf226d7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:33.825428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.compute.servers [None req-ac79f65b-0d11-4023-ba6c-c2277bf226d7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Removing options 'limit' from query {{(pid=128808) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 23 17:58:33.826266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac79f65b-0d11-4023-ba6c-c2277bf226d7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:33.827758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac79f65b-0d11-4023-ba6c-c2277bf226d7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:33.836891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac79f65b-0d11-4023-ba6c-c2277bf226d7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:33.837631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac79f65b-0d11-4023-ba6c-c2277bf226d7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:33.838822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac79f65b-0d11-4023-ba6c-c2277bf226d7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:33.839511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac79f65b-0d11-4023-ba6c-c2277bf226d7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:33.840126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac79f65b-0d11-4023-ba6c-c2277bf226d7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:33.842114 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac79f65b-0d11-4023-ba6c-c2277bf226d7 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.050189 Aug 23 17:58:33.844449 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1003/2052] 10.222.0.61 () {58 vars in 1140 bytes} [Tue Aug 23 17:58:33 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 17:58:33.859772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ee7b053c-276e-4021-98b3-bdfdddadf2c6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:33.865211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ee7b053c-276e-4021-98b3-bdfdddadf2c6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:33.882340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee7b053c-276e-4021-98b3-bdfdddadf2c6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:33.882868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee7b053c-276e-4021-98b3-bdfdddadf2c6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:33.883351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee7b053c-276e-4021-98b3-bdfdddadf2c6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:33.884080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee7b053c-276e-4021-98b3-bdfdddadf2c6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:33.884540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee7b053c-276e-4021-98b3-bdfdddadf2c6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:33.884976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee7b053c-276e-4021-98b3-bdfdddadf2c6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:34.137652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ee7b053c-276e-4021-98b3-bdfdddadf2c6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:34.162477 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ee7b053c-276e-4021-98b3-bdfdddadf2c6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1168 microversion: 2.1 time: 0.311579 Aug 23 17:58:34.163804 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1004/2053] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:33 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1168 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:34.172064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bd8ea7ff-b5c8-4a30-8b95-1226e7575890 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:34.180730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bd8ea7ff-b5c8-4a30-8b95-1226e7575890 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:34.200214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd8ea7ff-b5c8-4a30-8b95-1226e7575890 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:34.203691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd8ea7ff-b5c8-4a30-8b95-1226e7575890 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:34.206500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd8ea7ff-b5c8-4a30-8b95-1226e7575890 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:34.206500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd8ea7ff-b5c8-4a30-8b95-1226e7575890 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:34.206500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd8ea7ff-b5c8-4a30-8b95-1226e7575890 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:34.214304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd8ea7ff-b5c8-4a30-8b95-1226e7575890 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:34.520715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bd8ea7ff-b5c8-4a30-8b95-1226e7575890 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:34.536068 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bd8ea7ff-b5c8-4a30-8b95-1226e7575890 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1512 microversion: 2.1 time: 0.367819 Aug 23 17:58:34.537277 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1005/2054] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:34 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1512 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:34.546688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-90503b05-d7bd-428d-bc9a-5803d8af9f33 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec492310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:34.641241 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-90503b05-d7bd-428d-bc9a-5803d8af9f33 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.102497 Aug 23 17:58:34.644895 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1006/2055] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:34 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:34.657031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48452dd5-488e-44a1-9d4a-312fee9f93c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:34.658755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-48452dd5-488e-44a1-9d4a-312fee9f93c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: f8cfb229-ca34-4883-aa19-33cd91a70dc4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:34.672227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48452dd5-488e-44a1-9d4a-312fee9f93c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:34.676622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48452dd5-488e-44a1-9d4a-312fee9f93c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:34.679894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48452dd5-488e-44a1-9d4a-312fee9f93c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:34.681909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48452dd5-488e-44a1-9d4a-312fee9f93c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:34.687197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48452dd5-488e-44a1-9d4a-312fee9f93c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:34.687859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48452dd5-488e-44a1-9d4a-312fee9f93c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:35.296329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-48452dd5-488e-44a1-9d4a-312fee9f93c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:35.318359 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48452dd5-488e-44a1-9d4a-312fee9f93c1 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4" status: 200 len: 1512 microversion: 2.1 time: 0.668384 Aug 23 17:58:35.338521 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1007/2056] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:34 2022] GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4 => generated 1512 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:35.344861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-55b5044b-9e15-41ae-b6c3-72656f911090 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:35.345484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-55b5044b-9e15-41ae-b6c3-72656f911090 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:35.367619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55b5044b-9e15-41ae-b6c3-72656f911090 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:35.367619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55b5044b-9e15-41ae-b6c3-72656f911090 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:35.367619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55b5044b-9e15-41ae-b6c3-72656f911090 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:35.367619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55b5044b-9e15-41ae-b6c3-72656f911090 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:35.367619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55b5044b-9e15-41ae-b6c3-72656f911090 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:35.367619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55b5044b-9e15-41ae-b6c3-72656f911090 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:36.146153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c5b26c7d-50b8-467b-9532-0cdb4b11597d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:36.220051 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c5b26c7d-50b8-467b-9532-0cdb4b11597d tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1468 microversion: 2.1 time: 2.848323 Aug 23 17:58:36.247232 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1050/2057] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:33 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1468 bytes in 2879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:36.276179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-966ebb83-6118-4db3-8d0c-5801ed10c770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:36.282097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-966ebb83-6118-4db3-8d0c-5801ed10c770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:36.307344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-966ebb83-6118-4db3-8d0c-5801ed10c770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:36.309605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-966ebb83-6118-4db3-8d0c-5801ed10c770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:36.310764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-966ebb83-6118-4db3-8d0c-5801ed10c770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:36.312499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-966ebb83-6118-4db3-8d0c-5801ed10c770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:36.313610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-966ebb83-6118-4db3-8d0c-5801ed10c770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:36.315018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-966ebb83-6118-4db3-8d0c-5801ed10c770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:36.585544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-966ebb83-6118-4db3-8d0c-5801ed10c770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:36.603648 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-966ebb83-6118-4db3-8d0c-5801ed10c770 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1168 microversion: 2.1 time: 0.353528 Aug 23 17:58:36.604868 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1051/2058] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:36 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1168 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:36.647025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ddc990e0-3bb0-42ba-a7ef-d58b79f0d68c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:36.648240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ddc990e0-3bb0-42ba-a7ef-d58b79f0d68c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:36.666484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddc990e0-3bb0-42ba-a7ef-d58b79f0d68c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:36.667281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddc990e0-3bb0-42ba-a7ef-d58b79f0d68c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:36.668028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddc990e0-3bb0-42ba-a7ef-d58b79f0d68c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:36.668947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddc990e0-3bb0-42ba-a7ef-d58b79f0d68c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:36.672138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddc990e0-3bb0-42ba-a7ef-d58b79f0d68c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:36.675872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddc990e0-3bb0-42ba-a7ef-d58b79f0d68c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:37.060777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:37.070068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ddc990e0-3bb0-42ba-a7ef-d58b79f0d68c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:37.074903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:37.091267 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ddc990e0-3bb0-42ba-a7ef-d58b79f0d68c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1512 microversion: 2.1 time: 0.485008 Aug 23 17:58:37.092069 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1052/2059] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:36 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1512 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:37.113759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-506b0c74-c853-4932-baa3-50b5a7d131ba tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec314820>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:37.228876 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-506b0c74-c853-4932-baa3-50b5a7d131ba tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.119692 Aug 23 17:58:37.230245 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1053/2060] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:37 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:37.247550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2c628742-85f9-43c6-885a-c0cd4915514e req-af445c7a-c245-4b26-bd0e-1b08ce978e3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a4ebc8-3d93-4377-beec-accf25eee386", "name": "network-vif-unplugged", "status": "completed", "tag": "67689804-86f0-4754-bb53-ddbce34de8e9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:37.262733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2c628742-85f9-43c6-885a-c0cd4915514e req-af445c7a-c245-4b26-bd0e-1b08ce978e3f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:37.263776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2c628742-85f9-43c6-885a-c0cd4915514e req-af445c7a-c245-4b26-bd0e-1b08ce978e3f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:37.264467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2c628742-85f9-43c6-885a-c0cd4915514e req-af445c7a-c245-4b26-bd0e-1b08ce978e3f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:37.279677 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2c628742-85f9-43c6-885a-c0cd4915514e req-af445c7a-c245-4b26-bd0e-1b08ce978e3f service nova] Creating event network-vif-unplugged:67689804-86f0-4754-bb53-ddbce34de8e9 for instance 13a4ebc8-3d93-4377-beec-accf25eee386 on n-h1-850468-16 Aug 23 17:58:37.285666 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2c628742-85f9-43c6-885a-c0cd4915514e req-af445c7a-c245-4b26-bd0e-1b08ce978e3f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.053789 Aug 23 17:58:37.286676 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1054/2061] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:37.294038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97d6b573-2b26-4480-ab5e-e47413e878e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:37.308875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-97d6b573-2b26-4480-ab5e-e47413e878e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:37.310467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-97d6b573-2b26-4480-ab5e-e47413e878e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'ip': '172.20.0.9', 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:37.379925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-55b5044b-9e15-41ae-b6c3-72656f911090 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:37.390180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-55b5044b-9e15-41ae-b6c3-72656f911090 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:37.396576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-55b5044b-9e15-41ae-b6c3-72656f911090 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:37.406452 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-55b5044b-9e15-41ae-b6c3-72656f911090 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1814 microversion: 2.25 time: 2.066676 Aug 23 17:58:37.407777 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1008/2062] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:35 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1814 bytes in 2069 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:37.412628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b0822b50-aded-4c7f-ba1d-a316a6aaf4db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:37.413511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b0822b50-aded-4c7f-ba1d-a316a6aaf4db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:37.418253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:37.429596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0822b50-aded-4c7f-ba1d-a316a6aaf4db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:37.431516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0822b50-aded-4c7f-ba1d-a316a6aaf4db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:37.433571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0822b50-aded-4c7f-ba1d-a316a6aaf4db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:37.446596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0822b50-aded-4c7f-ba1d-a316a6aaf4db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:37.448667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0822b50-aded-4c7f-ba1d-a316a6aaf4db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:37.449343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0822b50-aded-4c7f-ba1d-a316a6aaf4db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:38.178031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b0822b50-aded-4c7f-ba1d-a316a6aaf4db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:38.195378 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b0822b50-aded-4c7f-ba1d-a316a6aaf4db tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 200 len: 1426 microversion: 2.1 time: 0.786188 Aug 23 17:58:38.202390 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1009/2063] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:37 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 1426 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:38.223240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dc05daec-a518-41e7-89a1-a86c613f3a17 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:38.223927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc05daec-a518-41e7-89a1-a86c613f3a17 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:38.255713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc05daec-a518-41e7-89a1-a86c613f3a17 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:38.256410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc05daec-a518-41e7-89a1-a86c613f3a17 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:38.256858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc05daec-a518-41e7-89a1-a86c613f3a17 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:38.257588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc05daec-a518-41e7-89a1-a86c613f3a17 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:38.261665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc05daec-a518-41e7-89a1-a86c613f3a17 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:38.262244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc05daec-a518-41e7-89a1-a86c613f3a17 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:38.379150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97d6b573-2b26-4480-ab5e-e47413e878e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:38.380304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97d6b573-2b26-4480-ab5e-e47413e878e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:38.389834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97d6b573-2b26-4480-ab5e-e47413e878e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:38.391332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97d6b573-2b26-4480-ab5e-e47413e878e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:38.392123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97d6b573-2b26-4480-ab5e-e47413e878e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:38.393966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97d6b573-2b26-4480-ab5e-e47413e878e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:38.633895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-97d6b573-2b26-4480-ab5e-e47413e878e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:38.757960 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-97d6b573-2b26-4480-ab5e-e47413e878e3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?ip=172.20.0.9" status: 200 len: 346 microversion: 2.1 time: 1.469607 Aug 23 17:58:38.770048 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1055/2064] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 17:58:37 2022] GET /compute/v2.1/servers?ip=172.20.0.9 => generated 346 bytes in 1483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:38.776024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1d157678-e99f-4d71-887b-f5c931ba6721 req-f07ef049-1f08-4e58-9aaf-7a611f9a5140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13a4ebc8-3d93-4377-beec-accf25eee386", "name": "network-vif-deleted", "tag": "67689804-86f0-4754-bb53-ddbce34de8e9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:38.794813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1d157678-e99f-4d71-887b-f5c931ba6721 req-f07ef049-1f08-4e58-9aaf-7a611f9a5140 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:38.819396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1d157678-e99f-4d71-887b-f5c931ba6721 req-f07ef049-1f08-4e58-9aaf-7a611f9a5140 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:38.820128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1d157678-e99f-4d71-887b-f5c931ba6721 req-f07ef049-1f08-4e58-9aaf-7a611f9a5140 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:38.845303 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1d157678-e99f-4d71-887b-f5c931ba6721 req-f07ef049-1f08-4e58-9aaf-7a611f9a5140 service nova] Creating event network-vif-deleted:67689804-86f0-4754-bb53-ddbce34de8e9 for instance 13a4ebc8-3d93-4377-beec-accf25eee386 on n-h1-850468-16 Aug 23 17:58:38.860101 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1d157678-e99f-4d71-887b-f5c931ba6721 req-f07ef049-1f08-4e58-9aaf-7a611f9a5140 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088494 Aug 23 17:58:38.860715 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1056/2065] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:38.865750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aa98b734-972a-43d1-a961-0ead0e1f0f78 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27f1cbe160>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:38.955229 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aa98b734-972a-43d1-a961-0ead0e1f0f78 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.093283 Aug 23 17:58:38.955811 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1057/2066] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:38 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:38.979754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-76cb0ba1-6950-4d5f-980a-7cbb83b7d5e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:38.987495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-76cb0ba1-6950-4d5f-980a-7cbb83b7d5e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:39.003416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76cb0ba1-6950-4d5f-980a-7cbb83b7d5e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:39.003906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76cb0ba1-6950-4d5f-980a-7cbb83b7d5e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:39.004342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76cb0ba1-6950-4d5f-980a-7cbb83b7d5e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:39.005055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76cb0ba1-6950-4d5f-980a-7cbb83b7d5e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:39.005509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76cb0ba1-6950-4d5f-980a-7cbb83b7d5e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:39.005932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76cb0ba1-6950-4d5f-980a-7cbb83b7d5e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:39.067794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dc05daec-a518-41e7-89a1-a86c613f3a17 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:39.077340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:39.080108 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dc05daec-a518-41e7-89a1-a86c613f3a17 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1210 microversion: 2.1 time: 0.876522 Aug 23 17:58:39.084948 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1010/2067] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:38 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1210 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:39.309985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-826662720", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "ec726746-4384-4f73-ae22-bc4390e9e499"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:39.397144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] validate_networks() for [('ec726746-4384-4f73-ae22-bc4390e9e499', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:58:40.029726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:40.347743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:58:40.349023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:58:40.349757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:58:40.352877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:58:40.354225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:58:40.374426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:40.386225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:40.387085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:40.389372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:40.391166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:40.391833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:40.410298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-76cb0ba1-6950-4d5f-980a-7cbb83b7d5e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:40.424293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-76cb0ba1-6950-4d5f-980a-7cbb83b7d5e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:40.430989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-76cb0ba1-6950-4d5f-980a-7cbb83b7d5e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:40.434472 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-76cb0ba1-6950-4d5f-980a-7cbb83b7d5e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1804 microversion: 2.25 time: 1.467723 Aug 23 17:58:40.451392 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1058/2068] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:38 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1804 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:40.451606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Getting quotas for project 983637b0e15143a5a142f0af748dfcf3. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:58:40.460569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8589c255-d9cd-4662-8b99-330f5f30dd75 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:40.460569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8589c255-d9cd-4662-8b99-330f5f30dd75 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:40.470967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Getting quotas for user f13656fe15cc4a66b37ae18296f9427d and project 983637b0e15143a5a142f0af748dfcf3. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:58:40.483819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8589c255-d9cd-4662-8b99-330f5f30dd75 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:40.484310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8589c255-d9cd-4662-8b99-330f5f30dd75 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:40.484967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8589c255-d9cd-4662-8b99-330f5f30dd75 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:40.485857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8589c255-d9cd-4662-8b99-330f5f30dd75 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:40.486475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8589c255-d9cd-4662-8b99-330f5f30dd75 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:40.487090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8589c255-d9cd-4662-8b99-330f5f30dd75 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:40.495323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:58:40.503527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:58:40.606878 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ba168988-74f9-4af9-9a70-2d4ce77c7415 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.519875 Aug 23 17:58:40.607845 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1011/2069] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 17:58:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1522 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 17:58:40.619995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-38682c67-9b40-4c11-bef1-84b87b2d41b5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:40.620709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-38682c67-9b40-4c11-bef1-84b87b2d41b5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 13a4ebc8-3d93-4377-beec-accf25eee386] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:40.652613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-38682c67-9b40-4c11-bef1-84b87b2d41b5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:40.653560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-38682c67-9b40-4c11-bef1-84b87b2d41b5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:40.654249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-38682c67-9b40-4c11-bef1-84b87b2d41b5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:40.655807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-38682c67-9b40-4c11-bef1-84b87b2d41b5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:40.656507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-38682c67-9b40-4c11-bef1-84b87b2d41b5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:40.657609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-38682c67-9b40-4c11-bef1-84b87b2d41b5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:40.676411 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-38682c67-9b40-4c11-bef1-84b87b2d41b5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] HTTP exception thrown: Instance 13a4ebc8-3d93-4377-beec-accf25eee386 could not be found. Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-38682c67-9b40-4c11-bef1-84b87b2d41b5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Request method failure captured: Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 HTTP/1.1 Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRQNnL7pPBICEUgGCKhDwjbVVRSuVaAtXWumTjnmsrg3qVf8l0kbYPwOJFcBqPBOSs0NAiXBisljD-EBKg3NPAksvMZvBeh5xYb-Tla5cphtO2B5oaodSce24yxDKCHOJ56EgmbjzPjHIIc7DBPMPKJLjJfSkH6JHd7Qii_GYHxmImc Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 88baf37ceb1342e3bc666ba96b4988ee Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-MigrationsAdminTest-353364920 Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_88baf37ceb1342e3bc666ba96b4988ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/88baf37ceb1342e3bc666ba96b4988ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/88baf37ceb1342e3bc666ba96b4988ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/88baf37ceb1342e3bc666ba96b4988ee"}]}] Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-MigrationsAdminTest-353364920 Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 88baf37ceb1342e3bc666ba96b4988ee Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-MigrationsAdminTest-353364920 Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-MigrationsAdminTest-353364920-project Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 8d66dd8a72974b1791fa449fb91c3282 Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-MigrationsAdminTest-353364920-project Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 13a4ebc8-3d93-4377-beec-accf25eee386 could not be found. Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '13a4ebc8-3d93-4377-beec-accf25eee386'} Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13a4ebc8-3d93-4377-beec-accf25eee386 could not be found. Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13a4ebc8-3d93-4377-beec-accf25eee386 could not be found. Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:58:40.679143 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:58:40.687120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:58:40.687120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:58:40.687120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:58:40.687120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:58:40.687120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:58:40.687120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13a4ebc8-3d93-4377-beec-accf25eee386 could not be found. Aug 23 17:58:40.687120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:58:40.690203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-38682c67-9b40-4c11-bef1-84b87b2d41b5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Returning 404 to user: Instance 13a4ebc8-3d93-4377-beec-accf25eee386 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:58:40.691439 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-38682c67-9b40-4c11-bef1-84b87b2d41b5 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386" status: 404 len: 111 microversion: 2.1 time: 0.082588 Aug 23 17:58:40.692624 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1012/2070] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:40 2022] GET /compute/v2.1/servers/13a4ebc8-3d93-4377-beec-accf25eee386 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:58:40.700166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0157a79b-9761-49bf-bbb0-d983fdda7557 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec494670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:40.798078 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0157a79b-9761-49bf-bbb0-d983fdda7557 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.101281 Aug 23 17:58:40.800879 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1013/2071] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:40 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:40.811139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-58ab0b6b-1fe5-49be-ab54-a917050d150c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:40.812965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-58ab0b6b-1fe5-49be-ab54-a917050d150c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:40.825121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58ab0b6b-1fe5-49be-ab54-a917050d150c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:40.826039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58ab0b6b-1fe5-49be-ab54-a917050d150c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:40.826753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58ab0b6b-1fe5-49be-ab54-a917050d150c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:40.827754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58ab0b6b-1fe5-49be-ab54-a917050d150c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:40.828458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58ab0b6b-1fe5-49be-ab54-a917050d150c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:40.830312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58ab0b6b-1fe5-49be-ab54-a917050d150c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:41.319476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-58ab0b6b-1fe5-49be-ab54-a917050d150c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:41.329426 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-58ab0b6b-1fe5-49be-ab54-a917050d150c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1210 microversion: 2.1 time: 0.527175 Aug 23 17:58:41.330859 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1014/2072] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:40 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1210 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:41.394222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-b012e6a7-d4d0-4817-8d4b-987c2e57ace8 req-4c5aef67-f19d-4559-ac87-dcc6b8e51522 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f47e601-36d6-4b1f-a4bf-8020bf69831c", "name": "network-vif-plugged", "status": "completed", "tag": "4838606c-edcc-47d0-96e3-cce31a7cb847"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:41.413749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b012e6a7-d4d0-4817-8d4b-987c2e57ace8 req-4c5aef67-f19d-4559-ac87-dcc6b8e51522 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:41.416757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b012e6a7-d4d0-4817-8d4b-987c2e57ace8 req-4c5aef67-f19d-4559-ac87-dcc6b8e51522 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:41.417651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b012e6a7-d4d0-4817-8d4b-987c2e57ace8 req-4c5aef67-f19d-4559-ac87-dcc6b8e51522 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:41.436170 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b012e6a7-d4d0-4817-8d4b-987c2e57ace8 req-4c5aef67-f19d-4559-ac87-dcc6b8e51522 service nova] Creating event network-vif-plugged:4838606c-edcc-47d0-96e3-cce31a7cb847 for instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c on n-h2-850468-16 Aug 23 17:58:41.444842 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-b012e6a7-d4d0-4817-8d4b-987c2e57ace8 req-4c5aef67-f19d-4559-ac87-dcc6b8e51522 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111925 Aug 23 17:58:41.446719 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1015/2073] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:41.668479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8589c255-d9cd-4662-8b99-330f5f30dd75 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:41.677390 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8589c255-d9cd-4662-8b99-330f5f30dd75 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1512 microversion: 2.1 time: 1.230496 Aug 23 17:58:41.685021 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1059/2074] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:40 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1512 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:41.699121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a8bc7db0-f170-436d-834b-2ef0edb5863d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:41.700169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a8bc7db0-f170-436d-834b-2ef0edb5863d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:41.787471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-34dad640-6a2d-4658-b0f2-14a4a38ba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '.version_select at 0x7f27ec494af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:41.791876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34dad640-6a2d-4658-b0f2-14a4a38ba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:41.795666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34dad640-6a2d-4658-b0f2-14a4a38ba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:41.796277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34dad640-6a2d-4658-b0f2-14a4a38ba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:41.860591 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-34dad640-6a2d-4658-b0f2-14a4a38ba5bd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 3838 microversion: 2.25 time: 0.409545 Aug 23 17:58:41.861738 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1016/2075] 10.222.0.61 () {60 vars in 1184 bytes} [Tue Aug 23 17:58:41 2022] GET /compute/v2.1/os-migrations => generated 3838 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:41.884058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9eca896-aef7-4095-93ff-ea88cf4e3153 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:41.885160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b9eca896-aef7-4095-93ff-ea88cf4e3153 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:41.892053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a8bc7db0-f170-436d-834b-2ef0edb5863d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:41.903313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a8bc7db0-f170-436d-834b-2ef0edb5863d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:41.913220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9eca896-aef7-4095-93ff-ea88cf4e3153 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:41.917549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9eca896-aef7-4095-93ff-ea88cf4e3153 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:41.919465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a8bc7db0-f170-436d-834b-2ef0edb5863d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:41.920404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9eca896-aef7-4095-93ff-ea88cf4e3153 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:41.923080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9eca896-aef7-4095-93ff-ea88cf4e3153 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:41.923224 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a8bc7db0-f170-436d-834b-2ef0edb5863d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1261 microversion: 2.26 time: 0.236602 Aug 23 17:58:41.927152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9eca896-aef7-4095-93ff-ea88cf4e3153 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:41.927311 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1060/2076] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:41 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1261 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:41.927955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9eca896-aef7-4095-93ff-ea88cf4e3153 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:41.948043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-440459ba-b97b-4cd6-98a4-708f045aa666 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:41.950768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-440459ba-b97b-4cd6-98a4-708f045aa666 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: f8cfb229-ca34-4883-aa19-33cd91a70dc4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:41.971759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-440459ba-b97b-4cd6-98a4-708f045aa666 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:41.972265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-440459ba-b97b-4cd6-98a4-708f045aa666 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:41.972769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-440459ba-b97b-4cd6-98a4-708f045aa666 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:41.973714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-440459ba-b97b-4cd6-98a4-708f045aa666 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:41.974507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-440459ba-b97b-4cd6-98a4-708f045aa666 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:41.976274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-440459ba-b97b-4cd6-98a4-708f045aa666 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:42.067707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b9eca896-aef7-4095-93ff-ea88cf4e3153 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:58:42.331600 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b9eca896-aef7-4095-93ff-ea88cf4e3153 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 204 len: 0 microversion: 2.1 time: 0.464937 Aug 23 17:58:42.336053 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1017/2077] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:58:41 2022] DELETE /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:58:42.343785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f8bc2ec1-b907-4d35-b285-80394aea00ac tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec3e3820>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:42.457907 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f8bc2ec1-b907-4d35-b285-80394aea00ac tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.120118 Aug 23 17:58:42.458668 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1018/2078] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:42 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:42.478006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0faeb4ad-8837-49af-b8f2-aeaa51bab32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:42.479204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0faeb4ad-8837-49af-b8f2-aeaa51bab32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:42.488304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0faeb4ad-8837-49af-b8f2-aeaa51bab32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:42.491730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0faeb4ad-8837-49af-b8f2-aeaa51bab32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:42.495578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0faeb4ad-8837-49af-b8f2-aeaa51bab32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:42.498455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0faeb4ad-8837-49af-b8f2-aeaa51bab32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:42.499671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0faeb4ad-8837-49af-b8f2-aeaa51bab32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:42.500309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0faeb4ad-8837-49af-b8f2-aeaa51bab32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:43.178147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-0faeb4ad-8837-49af-b8f2-aeaa51bab32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid 480827c0-1bbc-4e3f-9176-aebec4fc597b {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:58:43.236015 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0faeb4ad-8837-49af-b8f2-aeaa51bab32d tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 2424 microversion: 2.25 time: 0.764796 Aug 23 17:58:43.256057 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1019/2079] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:42 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 2424 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:43.264995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-b0d6d898-0066-4c8c-a689-36820ece2e87 req-21310bab-9ba0-4c98-b5be-09bc7580a6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "017fdc38-466a-4461-aa24-c16b9c7d96ab", "tag": "d386fc31-0829-4584-9e38-6de5ab421b8f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:43.279260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b0d6d898-0066-4c8c-a689-36820ece2e87 req-21310bab-9ba0-4c98-b5be-09bc7580a6c9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:43.280040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b0d6d898-0066-4c8c-a689-36820ece2e87 req-21310bab-9ba0-4c98-b5be-09bc7580a6c9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:43.280670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b0d6d898-0066-4c8c-a689-36820ece2e87 req-21310bab-9ba0-4c98-b5be-09bc7580a6c9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:43.310015 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b0d6d898-0066-4c8c-a689-36820ece2e87 req-21310bab-9ba0-4c98-b5be-09bc7580a6c9 service nova] Creating event network-changed:d386fc31-0829-4584-9e38-6de5ab421b8f for instance 017fdc38-466a-4461-aa24-c16b9c7d96ab on n-h1-850468-16 Aug 23 17:58:43.324573 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-b0d6d898-0066-4c8c-a689-36820ece2e87 req-21310bab-9ba0-4c98-b5be-09bc7580a6c9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067062 Aug 23 17:58:43.328061 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1020/2080] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:43.348877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a1ab6b5-d3c8-4413-ad33-77923a3cb168 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:43.350698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5a1ab6b5-d3c8-4413-ad33-77923a3cb168 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:43.370666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a1ab6b5-d3c8-4413-ad33-77923a3cb168 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:43.371634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a1ab6b5-d3c8-4413-ad33-77923a3cb168 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:43.372300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a1ab6b5-d3c8-4413-ad33-77923a3cb168 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:43.374612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a1ab6b5-d3c8-4413-ad33-77923a3cb168 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:43.375423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a1ab6b5-d3c8-4413-ad33-77923a3cb168 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:43.376033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a1ab6b5-d3c8-4413-ad33-77923a3cb168 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:43.510786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-440459ba-b97b-4cd6-98a4-708f045aa666 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:43.531583 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-440459ba-b97b-4cd6-98a4-708f045aa666 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4" status: 200 len: 1512 microversion: 2.1 time: 1.596815 Aug 23 17:58:43.534613 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1061/2081] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:41 2022] GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4 => generated 1512 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:43.548886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2a52b2e7-cfa1-498b-9d1c-4f361c0199fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:43.549489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2a52b2e7-cfa1-498b-9d1c-4f361c0199fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:43.567265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a52b2e7-cfa1-498b-9d1c-4f361c0199fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:43.571976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a52b2e7-cfa1-498b-9d1c-4f361c0199fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:43.572931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a52b2e7-cfa1-498b-9d1c-4f361c0199fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:43.574714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a52b2e7-cfa1-498b-9d1c-4f361c0199fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:43.575369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a52b2e7-cfa1-498b-9d1c-4f361c0199fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:43.577978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a52b2e7-cfa1-498b-9d1c-4f361c0199fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:43.772107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5a1ab6b5-d3c8-4413-ad33-77923a3cb168 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:43.793309 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a1ab6b5-d3c8-4413-ad33-77923a3cb168 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1534 microversion: 2.1 time: 0.463869 Aug 23 17:58:43.794707 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1021/2082] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:43 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1534 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:43.804257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6592c837-4c0d-4f9a-8791-9c9f2357df0c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:43.807156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6592c837-4c0d-4f9a-8791-9c9f2357df0c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:43.850284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6592c837-4c0d-4f9a-8791-9c9f2357df0c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:43.853754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6592c837-4c0d-4f9a-8791-9c9f2357df0c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:43.856949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6592c837-4c0d-4f9a-8791-9c9f2357df0c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:43.858033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6592c837-4c0d-4f9a-8791-9c9f2357df0c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:43.858789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6592c837-4c0d-4f9a-8791-9c9f2357df0c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:43.866170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6592c837-4c0d-4f9a-8791-9c9f2357df0c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:44.373913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6592c837-4c0d-4f9a-8791-9c9f2357df0c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:44.387838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6592c837-4c0d-4f9a-8791-9c9f2357df0c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:44.389628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6592c837-4c0d-4f9a-8791-9c9f2357df0c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:44.391248 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6592c837-4c0d-4f9a-8791-9c9f2357df0c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1321 microversion: 2.26 time: 0.595171 Aug 23 17:58:44.422612 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1022/2083] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:43 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1321 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:44.428070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-231a3824-a964-4c64-95fd-b1c8ae772e25 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:44.432592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-231a3824-a964-4c64-95fd-b1c8ae772e25 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:44.439661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-231a3824-a964-4c64-95fd-b1c8ae772e25 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:44.440437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-231a3824-a964-4c64-95fd-b1c8ae772e25 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:44.441053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-231a3824-a964-4c64-95fd-b1c8ae772e25 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:44.441941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-231a3824-a964-4c64-95fd-b1c8ae772e25 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:44.442583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-231a3824-a964-4c64-95fd-b1c8ae772e25 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:44.443180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-231a3824-a964-4c64-95fd-b1c8ae772e25 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:44.745857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2a52b2e7-cfa1-498b-9d1c-4f361c0199fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:44.754871 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2a52b2e7-cfa1-498b-9d1c-4f361c0199fd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1210 microversion: 2.1 time: 1.218618 Aug 23 17:58:44.755376 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1062/2084] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:43 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1210 bytes in 1220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:44.780448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0706c59f-9115-4320-aaa3-d8ff1d11dd62 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27eca3ad30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:44.870998 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0706c59f-9115-4320-aaa3-d8ff1d11dd62 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.104569 Aug 23 17:58:44.872151 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1063/2085] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:44 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:44.877052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4314928a-64f4-42f4-b57b-00f66e260269 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:44.877873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4314928a-64f4-42f4-b57b-00f66e260269 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:44.887415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4314928a-64f4-42f4-b57b-00f66e260269 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:44.888200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4314928a-64f4-42f4-b57b-00f66e260269 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:44.888823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4314928a-64f4-42f4-b57b-00f66e260269 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:44.889774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4314928a-64f4-42f4-b57b-00f66e260269 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:44.890417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4314928a-64f4-42f4-b57b-00f66e260269 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:44.891076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4314928a-64f4-42f4-b57b-00f66e260269 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:44.991849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-231a3824-a964-4c64-95fd-b1c8ae772e25 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid 480827c0-1bbc-4e3f-9176-aebec4fc597b {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:58:45.032541 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-231a3824-a964-4c64-95fd-b1c8ae772e25 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 2424 microversion: 2.25 time: 0.608298 Aug 23 17:58:45.033140 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1023/2086] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:44 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 2424 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:45.048243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f3beee0-e0f5-4c07-90af-0ba98cae752a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:45.051816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8f3beee0-e0f5-4c07-90af-0ba98cae752a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:45.071419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f3beee0-e0f5-4c07-90af-0ba98cae752a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:45.071910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f3beee0-e0f5-4c07-90af-0ba98cae752a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:45.085234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f3beee0-e0f5-4c07-90af-0ba98cae752a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:45.086964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f3beee0-e0f5-4c07-90af-0ba98cae752a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:45.087623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f3beee0-e0f5-4c07-90af-0ba98cae752a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:45.088268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f3beee0-e0f5-4c07-90af-0ba98cae752a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:45.357533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8f3beee0-e0f5-4c07-90af-0ba98cae752a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:45.368140 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f3beee0-e0f5-4c07-90af-0ba98cae752a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1492 microversion: 2.1 time: 0.329910 Aug 23 17:58:45.372784 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1024/2087] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:45 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1492 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:45.397327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-edc48ef4-3c68-4fa7-b19c-3aa450585386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:45.397991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-edc48ef4-3c68-4fa7-b19c-3aa450585386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:45.416056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edc48ef4-3c68-4fa7-b19c-3aa450585386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:45.417389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edc48ef4-3c68-4fa7-b19c-3aa450585386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:45.417972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edc48ef4-3c68-4fa7-b19c-3aa450585386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:45.418874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edc48ef4-3c68-4fa7-b19c-3aa450585386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:45.431392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edc48ef4-3c68-4fa7-b19c-3aa450585386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:45.432006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edc48ef4-3c68-4fa7-b19c-3aa450585386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:45.564710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4314928a-64f4-42f4-b57b-00f66e260269 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:45.582254 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4314928a-64f4-42f4-b57b-00f66e260269 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1512 microversion: 2.1 time: 0.708778 Aug 23 17:58:45.587633 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1064/2088] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:44 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1512 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:45.603112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-9fac2460-7320-481b-a600-bfe9909f7403 req-347c06f2-b474-4ad3-9ea2-fabdbe93cd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c329be5-120a-4bfd-ba7d-12c0ed0c4814", "name": "network-vif-deleted", "tag": "777bb24b-a6b8-45cd-9bb8-2263c15bf327"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:45.657512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9fac2460-7320-481b-a600-bfe9909f7403 req-347c06f2-b474-4ad3-9ea2-fabdbe93cd35 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:45.658299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9fac2460-7320-481b-a600-bfe9909f7403 req-347c06f2-b474-4ad3-9ea2-fabdbe93cd35 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:45.658945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9fac2460-7320-481b-a600-bfe9909f7403 req-347c06f2-b474-4ad3-9ea2-fabdbe93cd35 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:45.690413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-edc48ef4-3c68-4fa7-b19c-3aa450585386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lazy-loading 'services' on Instance uuid 480827c0-1bbc-4e3f-9176-aebec4fc597b {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:58:45.691798 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-9fac2460-7320-481b-a600-bfe9909f7403 req-347c06f2-b474-4ad3-9ea2-fabdbe93cd35 service nova] Creating event network-vif-deleted:777bb24b-a6b8-45cd-9bb8-2263c15bf327 for instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 on n-h1-850468-16 Aug 23 17:58:45.704863 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-9fac2460-7320-481b-a600-bfe9909f7403 req-347c06f2-b474-4ad3-9ea2-fabdbe93cd35 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111510 Aug 23 17:58:45.715551 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1065/2089] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:45.755374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cca57e28-2fc5-469c-81ce-9e03ee3b6821 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:45.756541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cca57e28-2fc5-469c-81ce-9e03ee3b6821 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:45.776509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cca57e28-2fc5-469c-81ce-9e03ee3b6821 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:45.783339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cca57e28-2fc5-469c-81ce-9e03ee3b6821 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:45.784818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cca57e28-2fc5-469c-81ce-9e03ee3b6821 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:45.784995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cca57e28-2fc5-469c-81ce-9e03ee3b6821 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:45.785713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cca57e28-2fc5-469c-81ce-9e03ee3b6821 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:45.786379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cca57e28-2fc5-469c-81ce-9e03ee3b6821 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:45.899689 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-edc48ef4-3c68-4fa7-b19c-3aa450585386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "DELETE /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments/bb4e23b9-9871-400f-9b94-f67631a89549" status: 202 len: 0 microversion: 2.25 time: 0.523076 Aug 23 17:58:45.902582 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1025/2090] 10.222.0.61 () {60 vars in 1457 bytes} [Tue Aug 23 17:58:45 2022] DELETE /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments/bb4e23b9-9871-400f-9b94-f67631a89549 => generated 0 bytes in 529 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:58:45.911373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:45.934476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:45.935748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:45.948610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:45.949383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:45.951175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:45.952765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:45.955282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:45.956012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:46.044598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:46.102158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cca57e28-2fc5-469c-81ce-9e03ee3b6821 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:46.119770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cca57e28-2fc5-469c-81ce-9e03ee3b6821 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:46.126569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cca57e28-2fc5-469c-81ce-9e03ee3b6821 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:46.128957 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cca57e28-2fc5-469c-81ce-9e03ee3b6821 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1319 microversion: 2.26 time: 0.411134 Aug 23 17:58:46.138691 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1066/2091] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:45 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1319 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:46.149230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ba3c5c8a-d9ff-45bf-88ea-439cc76c1f50 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:46.150284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ba3c5c8a-d9ff-45bf-88ea-439cc76c1f50 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:46.157306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba3c5c8a-d9ff-45bf-88ea-439cc76c1f50 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:46.158051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba3c5c8a-d9ff-45bf-88ea-439cc76c1f50 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:46.158778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba3c5c8a-d9ff-45bf-88ea-439cc76c1f50 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:46.159723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba3c5c8a-d9ff-45bf-88ea-439cc76c1f50 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:46.160342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba3c5c8a-d9ff-45bf-88ea-439cc76c1f50 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:46.160978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba3c5c8a-d9ff-45bf-88ea-439cc76c1f50 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:46.198901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:46.218656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:46.219454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:46.221833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:46.490261 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9b1e8ec4-1016-45d6-b04e-620a882eb116 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 4519 microversion: 2.1 time: 0.586053 Aug 23 17:58:46.490897 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1026/2092] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 17:58:45 2022] GET /compute/v2.1/servers/detail => generated 4519 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:46.498404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-940e3515-2675-46b5-b6a7-9e10e49a1090 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec4385e0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:46.595804 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-940e3515-2675-46b5-b6a7-9e10e49a1090 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.102941 Aug 23 17:58:46.597465 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1027/2093] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:46 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:46.608682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-27ad6a6b-0909-4c6f-8180-1241bcf72706 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:46.634525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-27ad6a6b-0909-4c6f-8180-1241bcf72706 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:46.649617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27ad6a6b-0909-4c6f-8180-1241bcf72706 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:46.650133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27ad6a6b-0909-4c6f-8180-1241bcf72706 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:46.654495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27ad6a6b-0909-4c6f-8180-1241bcf72706 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:46.655455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27ad6a6b-0909-4c6f-8180-1241bcf72706 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:46.657393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27ad6a6b-0909-4c6f-8180-1241bcf72706 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:46.657873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27ad6a6b-0909-4c6f-8180-1241bcf72706 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:46.765946 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-27ad6a6b-0909-4c6f-8180-1241bcf72706 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.166695 Aug 23 17:58:46.768752 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1028/2094] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 17:58:46 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments => generated 197 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:58:46.782412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:46.784433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:46.807425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:46.809296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:46.810953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:46.812635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:46.813543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:46.825387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:46.979085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:46.980221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:46.980683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:46.984223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lazy-loading 'fault' on Instance uuid 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:58:47.093396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:47.098841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:47.108218 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-25cbee15-bb52-47af-8efa-feb25b157919 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 200 len: 1368 microversion: 2.1 time: 0.336428 Aug 23 17:58:47.110765 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1029/2095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:46 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 1368 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:47.127682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9a0a47d5-e5f0-4567-89e6-cbbfcb5b8dc0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:47.138109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9a0a47d5-e5f0-4567-89e6-cbbfcb5b8dc0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:47.138848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9a0a47d5-e5f0-4567-89e6-cbbfcb5b8dc0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:47.378998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a0a47d5-e5f0-4567-89e6-cbbfcb5b8dc0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:47.379496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a0a47d5-e5f0-4567-89e6-cbbfcb5b8dc0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:47.379943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a0a47d5-e5f0-4567-89e6-cbbfcb5b8dc0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:47.380986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a0a47d5-e5f0-4567-89e6-cbbfcb5b8dc0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:47.381499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a0a47d5-e5f0-4567-89e6-cbbfcb5b8dc0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:47.382058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a0a47d5-e5f0-4567-89e6-cbbfcb5b8dc0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:47.519006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-9a0a47d5-e5f0-4567-89e6-cbbfcb5b8dc0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:47.576080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ba3c5c8a-d9ff-45bf-88ea-439cc76c1f50 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:47.588398 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ba3c5c8a-d9ff-45bf-88ea-439cc76c1f50 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1210 microversion: 2.1 time: 1.448096 Aug 23 17:58:47.588984 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1067/2096] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:46 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1210 bytes in 1449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:47.600374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6997eb44-1d4a-42b7-b80f-7d38b8b7d719 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:47.602923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6997eb44-1d4a-42b7-b80f-7d38b8b7d719 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:47.625981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6997eb44-1d4a-42b7-b80f-7d38b8b7d719 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:47.626765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6997eb44-1d4a-42b7-b80f-7d38b8b7d719 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:47.627392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6997eb44-1d4a-42b7-b80f-7d38b8b7d719 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:47.631951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6997eb44-1d4a-42b7-b80f-7d38b8b7d719 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:47.632438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6997eb44-1d4a-42b7-b80f-7d38b8b7d719 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:47.641249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6997eb44-1d4a-42b7-b80f-7d38b8b7d719 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:47.669349 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9a0a47d5-e5f0-4567-89e6-cbbfcb5b8dc0 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1012 microversion: 2.1 time: 0.558221 Aug 23 17:58:47.678350 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1030/2097] 10.222.0.61 () {58 vars in 1150 bytes} [Tue Aug 23 17:58:47 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1012 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:47.684781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2660d492-714d-43e2-8b26-8fa8169fcd31 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec454dc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:47.741827 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2660d492-714d-43e2-8b26-8fa8169fcd31 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.070183 Aug 23 17:58:47.745330 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1031/2098] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:47 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:47.755382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-367c6af4-9c2a-4467-852c-cef192bfed57 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:47.770503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-367c6af4-9c2a-4467-852c-cef192bfed57 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:47.771511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-367c6af4-9c2a-4467-852c-cef192bfed57 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:47.787483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-367c6af4-9c2a-4467-852c-cef192bfed57 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:47.791343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-367c6af4-9c2a-4467-852c-cef192bfed57 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:47.791639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-367c6af4-9c2a-4467-852c-cef192bfed57 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:47.792856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-367c6af4-9c2a-4467-852c-cef192bfed57 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:47.793213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-367c6af4-9c2a-4467-852c-cef192bfed57 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:47.794209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-367c6af4-9c2a-4467-852c-cef192bfed57 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:48.009557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-367c6af4-9c2a-4467-852c-cef192bfed57 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:48.100026 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-367c6af4-9c2a-4467-852c-cef192bfed57 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1012 microversion: 2.1 time: 0.351604 Aug 23 17:58:48.108429 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1032/2099] 10.222.0.61 () {58 vars in 1212 bytes} [Tue Aug 23 17:58:47 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1012 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:48.113005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6935fd34-015c-4125-a3e5-2d3cab61673c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:48.115989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6935fd34-015c-4125-a3e5-2d3cab61673c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:48.127294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6935fd34-015c-4125-a3e5-2d3cab61673c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:48.127795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6935fd34-015c-4125-a3e5-2d3cab61673c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:48.128244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6935fd34-015c-4125-a3e5-2d3cab61673c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:48.128973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6935fd34-015c-4125-a3e5-2d3cab61673c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:48.134343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6935fd34-015c-4125-a3e5-2d3cab61673c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:48.135039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6935fd34-015c-4125-a3e5-2d3cab61673c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:48.200916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6997eb44-1d4a-42b7-b80f-7d38b8b7d719 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:48.216581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6997eb44-1d4a-42b7-b80f-7d38b8b7d719 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:48.220889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6997eb44-1d4a-42b7-b80f-7d38b8b7d719 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:48.223353 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6997eb44-1d4a-42b7-b80f-7d38b8b7d719 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1361 microversion: 2.26 time: 0.628662 Aug 23 17:58:48.226308 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6935fd34-015c-4125-a3e5-2d3cab61673c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.122705 Aug 23 17:58:48.232027 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1033/2100] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 17:58:48 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments => generated 197 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:58:48.241282 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1068/2101] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:47 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1361 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:48.251166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9826d01f-ca5b-46c2-beaa-9ecfd8f2d92c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:48.258188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e8dd2aa4-fef3-4058-b4b1-27e65c79feb3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:48.259362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e8dd2aa4-fef3-4058-b4b1-27e65c79feb3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 1c329be5-120a-4bfd-ba7d-12c0ed0c4814] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:48.270043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9826d01f-ca5b-46c2-beaa-9ecfd8f2d92c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:48.271131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9826d01f-ca5b-46c2-beaa-9ecfd8f2d92c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:48.291691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9826d01f-ca5b-46c2-beaa-9ecfd8f2d92c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:48.291691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9826d01f-ca5b-46c2-beaa-9ecfd8f2d92c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:48.292019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9826d01f-ca5b-46c2-beaa-9ecfd8f2d92c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:48.292739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9826d01f-ca5b-46c2-beaa-9ecfd8f2d92c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:48.293084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8dd2aa4-fef3-4058-b4b1-27e65c79feb3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:48.293706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8dd2aa4-fef3-4058-b4b1-27e65c79feb3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:48.295261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8dd2aa4-fef3-4058-b4b1-27e65c79feb3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:48.296011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8dd2aa4-fef3-4058-b4b1-27e65c79feb3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:48.296469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8dd2aa4-fef3-4058-b4b1-27e65c79feb3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:48.296894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8dd2aa4-fef3-4058-b4b1-27e65c79feb3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:48.303727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9826d01f-ca5b-46c2-beaa-9ecfd8f2d92c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:48.304186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9826d01f-ca5b-46c2-beaa-9ecfd8f2d92c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:48.335683 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-e8dd2aa4-fef3-4058-b4b1-27e65c79feb3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] HTTP exception thrown: Instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 could not be found. Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e8dd2aa4-fef3-4058-b4b1-27e65c79feb3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Request method failure captured: Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 HTTP/1.1 Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQNnL7pPBICEUgGCKhDwjbVVRSuVaAtXWumTjnmsrg3qVf8l0kbYPwOJFcBqPBOSs0NAiXBisljD-EBKg3NPAksvMZvBeh5xYb-Tla5cphtO2B5oaodSce24yxDKCHOJ56EgmbjzPjHIIc7DBPMPKJLjJfSkH6JHd7Qii_GYHxmImc Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 88baf37ceb1342e3bc666ba96b4988ee Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-MigrationsAdminTest-353364920 Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_88baf37ceb1342e3bc666ba96b4988ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/88baf37ceb1342e3bc666ba96b4988ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/88baf37ceb1342e3bc666ba96b4988ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/88baf37ceb1342e3bc666ba96b4988ee"}]}] Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-MigrationsAdminTest-353364920 Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 88baf37ceb1342e3bc666ba96b4988ee Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-MigrationsAdminTest-353364920 Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-MigrationsAdminTest-353364920-project Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 8d66dd8a72974b1791fa449fb91c3282 Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-MigrationsAdminTest-353364920-project Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 could not be found. Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '1c329be5-120a-4bfd-ba7d-12c0ed0c4814'} Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 could not be found. Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 could not be found. Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:58:48.337572 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:48.343795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:58:48.343795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:58:48.343795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:58:48.343795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:58:48.343795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:58:48.343795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 could not be found. Aug 23 17:58:48.343795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:58:48.343795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e8dd2aa4-fef3-4058-b4b1-27e65c79feb3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Returning 404 to user: Instance 1c329be5-120a-4bfd-ba7d-12c0ed0c4814 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:58:48.343795 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e8dd2aa4-fef3-4058-b4b1-27e65c79feb3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814" status: 404 len: 111 microversion: 2.1 time: 0.095773 Aug 23 17:58:48.354282 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1069/2102] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:48 2022] GET /compute/v2.1/servers/1c329be5-120a-4bfd-ba7d-12c0ed0c4814 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:58:48.359246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-274a3ca7-c662-429b-b42c-42e67d9f8f8f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '.version_select at 0x7f27ec0e59d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:48.422079 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-274a3ca7-c662-429b-b42c-42e67d9f8f8f tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-539964646" status: 202 len: 0 microversion: 2.1 time: 0.066293 Aug 23 17:58:48.427570 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1070/2103] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Aug 23 17:58:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-539964646 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:58:48.498129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-9826d01f-ca5b-46c2-beaa-9ecfd8f2d92c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:48.584670 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9826d01f-ca5b-46c2-beaa-9ecfd8f2d92c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1012 microversion: 2.1 time: 0.351131 Aug 23 17:58:48.586645 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1034/2104] 10.222.0.61 () {58 vars in 1196 bytes} [Tue Aug 23 17:58:48 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1012 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:48.595602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:48.608809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0214bfd0-c707-4eb6-947b-82ed39e7458c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:48.611871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-88ab72c5-6cb9-4282-b219-f9fb0bb6e3d2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:48.612808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-88ab72c5-6cb9-4282-b219-f9fb0bb6e3d2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:48.618959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0214bfd0-c707-4eb6-947b-82ed39e7458c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:48.621928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88ab72c5-6cb9-4282-b219-f9fb0bb6e3d2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:48.623017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88ab72c5-6cb9-4282-b219-f9fb0bb6e3d2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:48.623631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88ab72c5-6cb9-4282-b219-f9fb0bb6e3d2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:48.624086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0214bfd0-c707-4eb6-947b-82ed39e7458c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'name': '1511204069', 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:48.624860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88ab72c5-6cb9-4282-b219-f9fb0bb6e3d2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:48.625674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88ab72c5-6cb9-4282-b219-f9fb0bb6e3d2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:48.626113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88ab72c5-6cb9-4282-b219-f9fb0bb6e3d2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:48.637764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0214bfd0-c707-4eb6-947b-82ed39e7458c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:48.639650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0214bfd0-c707-4eb6-947b-82ed39e7458c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:48.642187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0214bfd0-c707-4eb6-947b-82ed39e7458c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:48.644145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0214bfd0-c707-4eb6-947b-82ed39e7458c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:48.645588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0214bfd0-c707-4eb6-947b-82ed39e7458c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:48.649548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0214bfd0-c707-4eb6-947b-82ed39e7458c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:48.875381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-0214bfd0-c707-4eb6-947b-82ed39e7458c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:48.987783 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0214bfd0-c707-4eb6-947b-82ed39e7458c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?name=1511204069" status: 200 len: 346 microversion: 2.1 time: 0.392900 Aug 23 17:58:48.989137 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1071/2105] 10.222.0.61 () {58 vars in 1156 bytes} [Tue Aug 23 17:58:48 2022] GET /compute/v2.1/servers?name=1511204069 => generated 346 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:48.998026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0ff2c79e-d8aa-49e0-aa64-7637c358228e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec86f3a0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:49.061221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-88ab72c5-6cb9-4282-b219-f9fb0bb6e3d2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:49.063849 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0ff2c79e-d8aa-49e0-aa64-7637c358228e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.073388 Aug 23 17:58:49.073640 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1072/2106] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:48 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:49.078820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c0f6800d-fc7e-4f78-93e7-685445f375fd tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:49.083162 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-88ab72c5-6cb9-4282-b219-f9fb0bb6e3d2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1198 microversion: 2.1 time: 0.477592 Aug 23 17:58:49.089139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c0f6800d-fc7e-4f78-93e7-685445f375fd tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:49.091024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c0f6800d-fc7e-4f78-93e7-685445f375fd tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:49.108061 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1035/2107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:48 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1198 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:49.114566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0f6800d-fc7e-4f78-93e7-685445f375fd tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:49.120091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0f6800d-fc7e-4f78-93e7-685445f375fd tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:49.121132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0f6800d-fc7e-4f78-93e7-685445f375fd tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:49.121689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0f6800d-fc7e-4f78-93e7-685445f375fd tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:49.126024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0f6800d-fc7e-4f78-93e7-685445f375fd tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:49.126703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0f6800d-fc7e-4f78-93e7-685445f375fd tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:49.245365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-53e9d8f7-8fdc-48d1-a1bd-6708febd03fd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:49.247841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-53e9d8f7-8fdc-48d1-a1bd-6708febd03fd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:49.267339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53e9d8f7-8fdc-48d1-a1bd-6708febd03fd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:49.268919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53e9d8f7-8fdc-48d1-a1bd-6708febd03fd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:49.272745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53e9d8f7-8fdc-48d1-a1bd-6708febd03fd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:49.276020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53e9d8f7-8fdc-48d1-a1bd-6708febd03fd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:49.280382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53e9d8f7-8fdc-48d1-a1bd-6708febd03fd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:49.281078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53e9d8f7-8fdc-48d1-a1bd-6708febd03fd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:49.489920 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-53e9d8f7-8fdc-48d1-a1bd-6708febd03fd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.247905 Aug 23 17:58:49.490567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-c0f6800d-fc7e-4f78-93e7-685445f375fd tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:49.493385 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1036/2108] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 17:58:49 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments => generated 197 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 17:58:49.524750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ff04955a-529a-4f0a-ad09-f2a1e5c1bdf4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:49.525294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ff04955a-529a-4f0a-ad09-f2a1e5c1bdf4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:49.552072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff04955a-529a-4f0a-ad09-f2a1e5c1bdf4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:49.553104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff04955a-529a-4f0a-ad09-f2a1e5c1bdf4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:49.554247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff04955a-529a-4f0a-ad09-f2a1e5c1bdf4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:49.558643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff04955a-529a-4f0a-ad09-f2a1e5c1bdf4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:49.559356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff04955a-529a-4f0a-ad09-f2a1e5c1bdf4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:49.560463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff04955a-529a-4f0a-ad09-f2a1e5c1bdf4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:49.627149 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c0f6800d-fc7e-4f78-93e7-685445f375fd tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1012 microversion: 2.1 time: 0.558739 Aug 23 17:58:49.642191 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1073/2109] 10.222.0.61 () {58 vars in 1154 bytes} [Tue Aug 23 17:58:49 2022] GET /compute/v2.1/servers?name=-instance => generated 1012 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:49.654977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cd257b1-d0e5-4a96-b032-341d92b6d65c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:49.661106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0cd257b1-d0e5-4a96-b032-341d92b6d65c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:49.662106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0cd257b1-d0e5-4a96-b032-341d92b6d65c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-151120406', 'deleted': False, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 17:58:49.667795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cd257b1-d0e5-4a96-b032-341d92b6d65c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:49.668524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cd257b1-d0e5-4a96-b032-341d92b6d65c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:49.669136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cd257b1-d0e5-4a96-b032-341d92b6d65c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:49.670123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cd257b1-d0e5-4a96-b032-341d92b6d65c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:49.670860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cd257b1-d0e5-4a96-b032-341d92b6d65c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:49.671468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cd257b1-d0e5-4a96-b032-341d92b6d65c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:49.861884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-0cd257b1-d0e5-4a96-b032-341d92b6d65c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 17:58:49.940438 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0cd257b1-d0e5-4a96-b032-341d92b6d65c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-151120406" status: 200 len: 346 microversion: 2.1 time: 0.289096 Aug 23 17:58:49.941538 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1074/2110] 10.222.0.61 () {58 vars in 1228 bytes} [Tue Aug 23 17:58:49 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-151120406 => generated 346 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:49.960428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5491ae80-9701-4483-8f9b-72cf9c01af48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:49.961854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5491ae80-9701-4483-8f9b-72cf9c01af48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:49.969425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5491ae80-9701-4483-8f9b-72cf9c01af48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:49.970180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5491ae80-9701-4483-8f9b-72cf9c01af48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:49.970886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5491ae80-9701-4483-8f9b-72cf9c01af48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:49.975337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5491ae80-9701-4483-8f9b-72cf9c01af48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:49.976385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5491ae80-9701-4483-8f9b-72cf9c01af48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:49.978397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5491ae80-9701-4483-8f9b-72cf9c01af48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:50.011123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5491ae80-9701-4483-8f9b-72cf9c01af48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:58:50.056414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ff04955a-529a-4f0a-ad09-f2a1e5c1bdf4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:50.057155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:50.067758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ff04955a-529a-4f0a-ad09-f2a1e5c1bdf4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:50.080815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ff04955a-529a-4f0a-ad09-f2a1e5c1bdf4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:50.082487 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ff04955a-529a-4f0a-ad09-f2a1e5c1bdf4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1361 microversion: 2.26 time: 0.581920 Aug 23 17:58:50.083790 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1037/2111] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:49 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1361 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:50.089759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8c2d3072-a6a5-4c05-bd33-9337304931ce tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec69e940>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:50.130236 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5491ae80-9701-4483-8f9b-72cf9c01af48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 204 len: 0 microversion: 2.1 time: 0.172987 Aug 23 17:58:50.134922 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1075/2112] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:58:49 2022] DELETE /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:58:50.139876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b37ff3d-ff6b-40b5-a373-6fb741445190 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:50.141107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b37ff3d-ff6b-40b5-a373-6fb741445190 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:50.150050 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8c2d3072-a6a5-4c05-bd33-9337304931ce tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.064638 Aug 23 17:58:50.150605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b37ff3d-ff6b-40b5-a373-6fb741445190 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:50.151146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b37ff3d-ff6b-40b5-a373-6fb741445190 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:50.151698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b37ff3d-ff6b-40b5-a373-6fb741445190 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:50.153091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b37ff3d-ff6b-40b5-a373-6fb741445190 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:50.153288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b37ff3d-ff6b-40b5-a373-6fb741445190 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:50.153885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b37ff3d-ff6b-40b5-a373-6fb741445190 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:50.160436 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1038/2113] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:50 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:50.167030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9e4d47b8-f97e-44ef-a791-dece2c280515 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:50.168023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9e4d47b8-f97e-44ef-a791-dece2c280515 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:50.180661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e4d47b8-f97e-44ef-a791-dece2c280515 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:50.183237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e4d47b8-f97e-44ef-a791-dece2c280515 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:50.183933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e4d47b8-f97e-44ef-a791-dece2c280515 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:50.184891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e4d47b8-f97e-44ef-a791-dece2c280515 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:50.192747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b37ff3d-ff6b-40b5-a373-6fb741445190 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:58:50.193237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e4d47b8-f97e-44ef-a791-dece2c280515 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:50.193926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e4d47b8-f97e-44ef-a791-dece2c280515 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:50.378746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9e4d47b8-f97e-44ef-a791-dece2c280515 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:50.388420 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9e4d47b8-f97e-44ef-a791-dece2c280515 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1198 microversion: 2.1 time: 0.226188 Aug 23 17:58:50.410590 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1039/2114] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:50 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1198 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:50.418064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-65c82132-8015-4d55-bb1f-35f4327dc885 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:50.419099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-65c82132-8015-4d55-bb1f-35f4327dc885 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:50.420257 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3b37ff3d-ff6b-40b5-a373-6fb741445190 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "DELETE /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 204 len: 0 microversion: 2.1 time: 0.286743 Aug 23 17:58:50.421406 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1076/2115] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:58:50 2022] DELETE /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:58:50.426008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65c82132-8015-4d55-bb1f-35f4327dc885 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:50.426828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65c82132-8015-4d55-bb1f-35f4327dc885 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:50.427494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65c82132-8015-4d55-bb1f-35f4327dc885 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:50.428432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65c82132-8015-4d55-bb1f-35f4327dc885 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:50.429099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65c82132-8015-4d55-bb1f-35f4327dc885 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:50.430531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65c82132-8015-4d55-bb1f-35f4327dc885 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:50.434073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0a3fc110-b2c4-4e64-ba2b-9124af5106e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:50.437605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0a3fc110-b2c4-4e64-ba2b-9124af5106e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:50.457252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a3fc110-b2c4-4e64-ba2b-9124af5106e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:50.458107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a3fc110-b2c4-4e64-ba2b-9124af5106e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:50.459091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a3fc110-b2c4-4e64-ba2b-9124af5106e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:50.459961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a3fc110-b2c4-4e64-ba2b-9124af5106e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:50.462097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a3fc110-b2c4-4e64-ba2b-9124af5106e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:50.464007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a3fc110-b2c4-4e64-ba2b-9124af5106e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:50.910580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65c82132-8015-4d55-bb1f-35f4327dc885 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:50.936090 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-65c82132-8015-4d55-bb1f-35f4327dc885 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1518 microversion: 2.1 time: 0.523000 Aug 23 17:58:50.955033 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1040/2116] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:50 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1518 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:50.981456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb314eb3-e924-46e1-80e7-d4c4a10c53ba tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:50.988356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eb314eb3-e924-46e1-80e7-d4c4a10c53ba tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:51.016960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb314eb3-e924-46e1-80e7-d4c4a10c53ba tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:51.018492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb314eb3-e924-46e1-80e7-d4c4a10c53ba tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:51.019364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb314eb3-e924-46e1-80e7-d4c4a10c53ba tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:51.020302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb314eb3-e924-46e1-80e7-d4c4a10c53ba tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:51.020927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb314eb3-e924-46e1-80e7-d4c4a10c53ba tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:51.021535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb314eb3-e924-46e1-80e7-d4c4a10c53ba tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:51.065797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0a3fc110-b2c4-4e64-ba2b-9124af5106e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:51.095228 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0a3fc110-b2c4-4e64-ba2b-9124af5106e0 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1469 microversion: 2.1 time: 0.668506 Aug 23 17:58:51.109797 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1077/2117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:50 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1469 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:51.165575 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eb314eb3-e924-46e1-80e7-d4c4a10c53ba tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.207348 Aug 23 17:58:51.186573 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1041/2118] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 17:58:50 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments => generated 197 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:58:51.203650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5afaadd4-f62b-4284-8325-7c7d63ebc546 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:51.206327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5afaadd4-f62b-4284-8325-7c7d63ebc546 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:51.240375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5afaadd4-f62b-4284-8325-7c7d63ebc546 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:51.242306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5afaadd4-f62b-4284-8325-7c7d63ebc546 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:51.244795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5afaadd4-f62b-4284-8325-7c7d63ebc546 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:51.246039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5afaadd4-f62b-4284-8325-7c7d63ebc546 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:51.247630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5afaadd4-f62b-4284-8325-7c7d63ebc546 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:51.250796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5afaadd4-f62b-4284-8325-7c7d63ebc546 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:51.381891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-98d67f1c-8c81-4e21-b591-0e566953f42b tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Action: 'create', calling method: .version_select at 0x7f27ec910ee0>, body: {"pool": null} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:51.896001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:52.371337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5afaadd4-f62b-4284-8325-7c7d63ebc546 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:52.384736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5afaadd4-f62b-4284-8325-7c7d63ebc546 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:52.388908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5afaadd4-f62b-4284-8325-7c7d63ebc546 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:52.407082 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5afaadd4-f62b-4284-8325-7c7d63ebc546 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1361 microversion: 2.26 time: 1.215855 Aug 23 17:58:52.407699 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1042/2119] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:51 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1361 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:52.422868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b9accfc-7cc6-4e6a-9fac-5e581235dd49 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec620a60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:52.525952 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b9accfc-7cc6-4e6a-9fac-5e581235dd49 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.114195 Aug 23 17:58:52.526889 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1043/2120] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:52 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:52.542157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-d55bc6fa-7413-46e7-bf67-e495adfd9cc6 req-c5b17edd-0ab3-4e73-9730-3858d90f8e39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b484a7b8-a47c-4124-9238-bfd9e4e296c3", "tag": "1d387a38-8029-4f9c-8631-bfa82f37c800"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:52.608939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d55bc6fa-7413-46e7-bf67-e495adfd9cc6 req-c5b17edd-0ab3-4e73-9730-3858d90f8e39 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:52.609578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d55bc6fa-7413-46e7-bf67-e495adfd9cc6 req-c5b17edd-0ab3-4e73-9730-3858d90f8e39 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:52.609844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d55bc6fa-7413-46e7-bf67-e495adfd9cc6 req-c5b17edd-0ab3-4e73-9730-3858d90f8e39 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:52.657136 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-d55bc6fa-7413-46e7-bf67-e495adfd9cc6 req-c5b17edd-0ab3-4e73-9730-3858d90f8e39 service nova] Creating event network-changed:1d387a38-8029-4f9c-8631-bfa82f37c800 for instance b484a7b8-a47c-4124-9238-bfd9e4e296c3 on n-h2-850468-16 Aug 23 17:58:52.669212 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-d55bc6fa-7413-46e7-bf67-e495adfd9cc6 req-c5b17edd-0ab3-4e73-9730-3858d90f8e39 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138263 Aug 23 17:58:52.673550 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1044/2121] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:52.689018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8250e67b-2943-4440-82be-d876981f47f4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:52.689767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8250e67b-2943-4440-82be-d876981f47f4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:52.718612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8250e67b-2943-4440-82be-d876981f47f4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:52.731676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8250e67b-2943-4440-82be-d876981f47f4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:52.732193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8250e67b-2943-4440-82be-d876981f47f4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:52.733171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8250e67b-2943-4440-82be-d876981f47f4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:52.733805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8250e67b-2943-4440-82be-d876981f47f4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:52.734484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8250e67b-2943-4440-82be-d876981f47f4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:53.228703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8250e67b-2943-4440-82be-d876981f47f4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:53.241619 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8250e67b-2943-4440-82be-d876981f47f4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1198 microversion: 2.1 time: 0.566743 Aug 23 17:58:53.250786 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1045/2122] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:52 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1198 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:53.263224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-50dc7fb6-c342-41fc-9e3e-d16c90ff6793 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:53.271030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-50dc7fb6-c342-41fc-9e3e-d16c90ff6793 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:53.291796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50dc7fb6-c342-41fc-9e3e-d16c90ff6793 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:53.295631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50dc7fb6-c342-41fc-9e3e-d16c90ff6793 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:53.296223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50dc7fb6-c342-41fc-9e3e-d16c90ff6793 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:53.297868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50dc7fb6-c342-41fc-9e3e-d16c90ff6793 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:53.301635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50dc7fb6-c342-41fc-9e3e-d16c90ff6793 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:53.302171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50dc7fb6-c342-41fc-9e3e-d16c90ff6793 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:53.860637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-50dc7fb6-c342-41fc-9e3e-d16c90ff6793 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:53.881399 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-50dc7fb6-c342-41fc-9e3e-d16c90ff6793 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1518 microversion: 2.1 time: 0.629269 Aug 23 17:58:53.895220 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1046/2123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:53 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1518 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:53.901800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d2a22ad6-9790-41c8-85d9-06d01bd9468c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:53.902745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d2a22ad6-9790-41c8-85d9-06d01bd9468c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:53.909902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2a22ad6-9790-41c8-85d9-06d01bd9468c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:53.911289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2a22ad6-9790-41c8-85d9-06d01bd9468c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:53.912395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2a22ad6-9790-41c8-85d9-06d01bd9468c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:53.913325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2a22ad6-9790-41c8-85d9-06d01bd9468c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:53.914820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2a22ad6-9790-41c8-85d9-06d01bd9468c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:53.916043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2a22ad6-9790-41c8-85d9-06d01bd9468c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:54.574227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d2a22ad6-9790-41c8-85d9-06d01bd9468c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:54.584747 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d2a22ad6-9790-41c8-85d9-06d01bd9468c tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1469 microversion: 2.1 time: 0.688296 Aug 23 17:58:54.610639 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1047/2124] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:53 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1469 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:54.637464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-de64fb83-9486-4a1e-9429-564ad5b24e11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:54.640111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-de64fb83-9486-4a1e-9429-564ad5b24e11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:54.668618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de64fb83-9486-4a1e-9429-564ad5b24e11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:54.669132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de64fb83-9486-4a1e-9429-564ad5b24e11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:54.669585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de64fb83-9486-4a1e-9429-564ad5b24e11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:54.670322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de64fb83-9486-4a1e-9429-564ad5b24e11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:54.670811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de64fb83-9486-4a1e-9429-564ad5b24e11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:54.671247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de64fb83-9486-4a1e-9429-564ad5b24e11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:54.777332 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-de64fb83-9486-4a1e-9429-564ad5b24e11 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.164910 Aug 23 17:58:54.780512 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1048/2125] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 17:58:54 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments => generated 197 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:58:54.785384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6abaa7a6-0c23-4092-b2eb-c75fcab12f48 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:54.786011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6abaa7a6-0c23-4092-b2eb-c75fcab12f48 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:54.814103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6abaa7a6-0c23-4092-b2eb-c75fcab12f48 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:54.814679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6abaa7a6-0c23-4092-b2eb-c75fcab12f48 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:54.815126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6abaa7a6-0c23-4092-b2eb-c75fcab12f48 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:54.815852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6abaa7a6-0c23-4092-b2eb-c75fcab12f48 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:54.816317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6abaa7a6-0c23-4092-b2eb-c75fcab12f48 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:54.816750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6abaa7a6-0c23-4092-b2eb-c75fcab12f48 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:54.844987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:55.115470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6abaa7a6-0c23-4092-b2eb-c75fcab12f48 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:55.134464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6abaa7a6-0c23-4092-b2eb-c75fcab12f48 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:55.140522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6abaa7a6-0c23-4092-b2eb-c75fcab12f48 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:55.150045 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6abaa7a6-0c23-4092-b2eb-c75fcab12f48 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1361 microversion: 2.26 time: 0.368338 Aug 23 17:58:55.164982 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1049/2126] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:54 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1361 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:55.176233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b20905f7-5714-4ba1-8e40-b9efba31fc9e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec438af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:55.290701 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b20905f7-5714-4ba1-8e40-b9efba31fc9e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.121568 Aug 23 17:58:55.297692 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1050/2127] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:55 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:55.299511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-446c5bc5-629f-440a-8eb4-7ec55eb66760 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:55.307130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-446c5bc5-629f-440a-8eb4-7ec55eb66760 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:55.333160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-446c5bc5-629f-440a-8eb4-7ec55eb66760 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:55.333696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-446c5bc5-629f-440a-8eb4-7ec55eb66760 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:55.340915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-446c5bc5-629f-440a-8eb4-7ec55eb66760 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:55.341970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-446c5bc5-629f-440a-8eb4-7ec55eb66760 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:55.342468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-446c5bc5-629f-440a-8eb4-7ec55eb66760 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:55.342938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-446c5bc5-629f-440a-8eb4-7ec55eb66760 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:55.733805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-446c5bc5-629f-440a-8eb4-7ec55eb66760 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:55.747172 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-446c5bc5-629f-440a-8eb4-7ec55eb66760 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1198 microversion: 2.1 time: 0.451576 Aug 23 17:58:55.759723 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1051/2128] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:55 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1198 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:55.771663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-65aa5ec1-4217-4aab-9ed6-1703cf91a88c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:55.772615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-65aa5ec1-4217-4aab-9ed6-1703cf91a88c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:55.782364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65aa5ec1-4217-4aab-9ed6-1703cf91a88c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:55.783482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65aa5ec1-4217-4aab-9ed6-1703cf91a88c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:55.784358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65aa5ec1-4217-4aab-9ed6-1703cf91a88c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:55.785460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65aa5ec1-4217-4aab-9ed6-1703cf91a88c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:55.786149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65aa5ec1-4217-4aab-9ed6-1703cf91a88c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:55.786880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65aa5ec1-4217-4aab-9ed6-1703cf91a88c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:56.080073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65aa5ec1-4217-4aab-9ed6-1703cf91a88c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:56.098611 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-65aa5ec1-4217-4aab-9ed6-1703cf91a88c tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1518 microversion: 2.1 time: 0.336154 Aug 23 17:58:56.115582 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1052/2129] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:55 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1518 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:56.137377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:56.138822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:56.154387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:56.156937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:56.157572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:56.159285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:56.161774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:56.163562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:56.198164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=10 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:56.217834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:56.218692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:56.219304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:56.219927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lazy-loading 'fault' on Instance uuid 856ac0cb-cfb2-43f5-9e4f-df662c38f02d {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:58:56.283692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:56.293656 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d4f62897-6671-4ff9-8476-8ae108e765eb tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1303 microversion: 2.1 time: 0.167669 Aug 23 17:58:56.294717 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1053/2130] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:56 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1303 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:56.300839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8f731ef7-ba61-48ed-ad4b-1163aebd60a6 req-aa11d4fc-7e6e-4581-87d7-4d41db07f9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "856ac0cb-cfb2-43f5-9e4f-df662c38f02d", "name": "network-vif-deleted", "tag": "a3f7e262-db57-4792-9f23-2fbc005cd02a"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:56.311425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8f731ef7-ba61-48ed-ad4b-1163aebd60a6 req-aa11d4fc-7e6e-4581-87d7-4d41db07f9aa service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:56.311979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8f731ef7-ba61-48ed-ad4b-1163aebd60a6 req-aa11d4fc-7e6e-4581-87d7-4d41db07f9aa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:56.312414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8f731ef7-ba61-48ed-ad4b-1163aebd60a6 req-aa11d4fc-7e6e-4581-87d7-4d41db07f9aa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:56.328076 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8f731ef7-ba61-48ed-ad4b-1163aebd60a6 req-aa11d4fc-7e6e-4581-87d7-4d41db07f9aa service nova] Creating event network-vif-deleted:a3f7e262-db57-4792-9f23-2fbc005cd02a for instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d on n-h2-850468-16 Aug 23 17:58:56.334663 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8f731ef7-ba61-48ed-ad4b-1163aebd60a6 req-aa11d4fc-7e6e-4581-87d7-4d41db07f9aa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038729 Aug 23 17:58:56.340738 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1054/2131] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:56.348476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3f57ff48-01bf-4690-b2da-d143b741db6c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:56.350917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3f57ff48-01bf-4690-b2da-d143b741db6c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:56.362304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:56.365163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f57ff48-01bf-4690-b2da-d143b741db6c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:56.365938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f57ff48-01bf-4690-b2da-d143b741db6c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:56.366604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f57ff48-01bf-4690-b2da-d143b741db6c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:56.367979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f57ff48-01bf-4690-b2da-d143b741db6c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:56.368750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f57ff48-01bf-4690-b2da-d143b741db6c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:56.369370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f57ff48-01bf-4690-b2da-d143b741db6c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:56.441900 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3f57ff48-01bf-4690-b2da-d143b741db6c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.099528 Aug 23 17:58:56.444357 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1055/2132] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 17:58:56 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b/os-volume_attachments => generated 25 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:56.457835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b88cd246-0fd4-4b9a-b577-3459a7d9861d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:56.461295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b88cd246-0fd4-4b9a-b577-3459a7d9861d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:56.472633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b88cd246-0fd4-4b9a-b577-3459a7d9861d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:56.473009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b88cd246-0fd4-4b9a-b577-3459a7d9861d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:56.475558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b88cd246-0fd4-4b9a-b577-3459a7d9861d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:56.479709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b88cd246-0fd4-4b9a-b577-3459a7d9861d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:56.480364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b88cd246-0fd4-4b9a-b577-3459a7d9861d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:56.480856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b88cd246-0fd4-4b9a-b577-3459a7d9861d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:56.733017 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-98d67f1c-8c81-4e21-b591-0e566953f42b tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.633844 Aug 23 17:58:56.734599 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1078/2133] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Aug 23 17:58:51 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:56.740336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-942225fa-99d8-44e8-8bb6-a5df4fac4fd2 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27f1bcaf70>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:56.880181 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-942225fa-99d8-44e8-8bb6-a5df4fac4fd2 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.144352 Aug 23 17:58:56.880937 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1079/2134] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:56 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:56.905381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b88cd246-0fd4-4b9a-b577-3459a7d9861d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:56.914346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-10980d3d-f8bc-4544-ae7a-0046cdb04dcb tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Calling method '.version_select at 0x7f27f1b38f70>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:56.931599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b88cd246-0fd4-4b9a-b577-3459a7d9861d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:56.934770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b88cd246-0fd4-4b9a-b577-3459a7d9861d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:56.936312 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b88cd246-0fd4-4b9a-b577-3459a7d9861d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1361 microversion: 2.26 time: 0.488181 Aug 23 17:58:56.938666 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1056/2135] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:56 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1361 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:56.944625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-452f34c0-ffe4-45f7-8bff-4d7d87c1939a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:56.948009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-452f34c0-ffe4-45f7-8bff-4d7d87c1939a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:56.956746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-452f34c0-ffe4-45f7-8bff-4d7d87c1939a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:56.957371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-452f34c0-ffe4-45f7-8bff-4d7d87c1939a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:56.958033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-452f34c0-ffe4-45f7-8bff-4d7d87c1939a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:56.958912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-452f34c0-ffe4-45f7-8bff-4d7d87c1939a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:56.960500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-452f34c0-ffe4-45f7-8bff-4d7d87c1939a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:56.966493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-452f34c0-ffe4-45f7-8bff-4d7d87c1939a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:57.248734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-452f34c0-ffe4-45f7-8bff-4d7d87c1939a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:57.258389 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-452f34c0-ffe4-45f7-8bff-4d7d87c1939a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1198 microversion: 2.1 time: 0.318291 Aug 23 17:58:57.259316 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1057/2136] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:56 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1198 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:57.277413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-99d30136-189e-4a3a-8105-b301b88d8141 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:57.278064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-99d30136-189e-4a3a-8105-b301b88d8141 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:57.311307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99d30136-189e-4a3a-8105-b301b88d8141 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:57.312245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99d30136-189e-4a3a-8105-b301b88d8141 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:57.312718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99d30136-189e-4a3a-8105-b301b88d8141 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:57.315636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99d30136-189e-4a3a-8105-b301b88d8141 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:57.316134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99d30136-189e-4a3a-8105-b301b88d8141 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:57.321053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99d30136-189e-4a3a-8105-b301b88d8141 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:57.673156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-99d30136-189e-4a3a-8105-b301b88d8141 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:57.686032 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-99d30136-189e-4a3a-8105-b301b88d8141 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1476 microversion: 2.1 time: 0.424724 Aug 23 17:58:57.687524 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1058/2137] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:57 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1476 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:57.703278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-0faeb938-f824-4893-8d6e-fef8a4e85b03 req-bef9c608-6a76-4e73-b2a1-b1f5fa161b76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a82e2894-222e-4f3a-a8dd-54613738cf3d", "name": "network-vif-deleted", "tag": "7513e096-9832-43ff-8d9e-f3ad7b0d0706"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:58:57.719711 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-10980d3d-f8bc-4544-ae7a-0046cdb04dcb tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/3fee239f-cda2-4388-96dc-f744e4b509c6" status: 200 len: 142 microversion: 2.1 time: 0.834252 Aug 23 17:58:57.720631 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1080/2138] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Aug 23 17:58:56 2022] GET /compute/v2.1/os-floating-ips/3fee239f-cda2-4388-96dc-f744e4b509c6 => generated 142 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:57.728637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:57.730120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:57.735821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0faeb938-f824-4893-8d6e-fef8a4e85b03 req-bef9c608-6a76-4e73-b2a1-b1f5fa161b76 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:57.738626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0faeb938-f824-4893-8d6e-fef8a4e85b03 req-bef9c608-6a76-4e73-b2a1-b1f5fa161b76 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:57.739488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0faeb938-f824-4893-8d6e-fef8a4e85b03 req-bef9c608-6a76-4e73-b2a1-b1f5fa161b76 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:57.753155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:57.755835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:57.757179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:57.761037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:57.763362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:57.763975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:57.776249 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-0faeb938-f824-4893-8d6e-fef8a4e85b03 req-bef9c608-6a76-4e73-b2a1-b1f5fa161b76 service nova] Creating event network-vif-deleted:7513e096-9832-43ff-8d9e-f3ad7b0d0706 for instance a82e2894-222e-4f3a-a8dd-54613738cf3d on n-h2-850468-16 Aug 23 17:58:57.792513 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-0faeb938-f824-4893-8d6e-fef8a4e85b03 req-bef9c608-6a76-4e73-b2a1-b1f5fa161b76 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103052 Aug 23 17:58:57.794624 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1059/2139] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:57.809184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce9beefc-3d1f-4b86-bd35-bdae3b047c50 tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Calling method '.version_select at 0x7f27f1b2f8b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:57.840056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:57.841498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:57.842155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:57.842813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lazy-loading 'fault' on Instance uuid 856ac0cb-cfb2-43f5-9e4f-df662c38f02d {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:58:57.892753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:57.904055 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-638e6902-b4e6-4b52-91a3-3c079bb5cbab tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1303 microversion: 2.1 time: 0.181699 Aug 23 17:58:57.904904 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1081/2140] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:57 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1303 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:57.916203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ccd8d38-4c5e-43f0-bf42-23b80c56514a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec910ca0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:57.981521 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8ccd8d38-4c5e-43f0-bf42-23b80c56514a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1451 microversion: 2.1 time: 0.075213 Aug 23 17:58:57.983301 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1082/2141] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:57 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1451 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:57.988670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-67d6f47a-cf70-40af-bc73-2720d4e81d41 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:57.989483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-67d6f47a-cf70-40af-bc73-2720d4e81d41 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:58.013516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67d6f47a-cf70-40af-bc73-2720d4e81d41 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:58.014362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67d6f47a-cf70-40af-bc73-2720d4e81d41 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:58.015896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67d6f47a-cf70-40af-bc73-2720d4e81d41 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:58.018600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67d6f47a-cf70-40af-bc73-2720d4e81d41 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:58.020720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67d6f47a-cf70-40af-bc73-2720d4e81d41 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:58.023657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67d6f47a-cf70-40af-bc73-2720d4e81d41 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:58.198662 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce9beefc-3d1f-4b86-bd35-bdae3b047c50 tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips" status: 200 len: 145 microversion: 2.1 time: 0.400693 Aug 23 17:58:58.199933 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1060/2142] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Aug 23 17:58:57 2022] GET /compute/v2.1/os-floating-ips => generated 145 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:58:58.213520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-19524a33-0c15-4f44-8e2f-22457be23b87 tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Calling method '.version_select at 0x7f27ec7f5310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:58.259615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-67d6f47a-cf70-40af-bc73-2720d4e81d41 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:58.271233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-67d6f47a-cf70-40af-bc73-2720d4e81d41 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:58.289267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-67d6f47a-cf70-40af-bc73-2720d4e81d41 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:58.293565 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-67d6f47a-cf70-40af-bc73-2720d4e81d41 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1361 microversion: 2.26 time: 0.308861 Aug 23 17:58:58.311859 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1083/2143] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:58:57 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1361 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:58:58.321173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9f669ceb-5a1e-4b1d-9296-2bfd5e1daec6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:58.322211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9f669ceb-5a1e-4b1d-9296-2bfd5e1daec6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:58.328562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f669ceb-5a1e-4b1d-9296-2bfd5e1daec6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:58.329325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f669ceb-5a1e-4b1d-9296-2bfd5e1daec6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:58.329946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f669ceb-5a1e-4b1d-9296-2bfd5e1daec6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:58.330868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f669ceb-5a1e-4b1d-9296-2bfd5e1daec6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:58.331969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f669ceb-5a1e-4b1d-9296-2bfd5e1daec6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:58.332721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f669ceb-5a1e-4b1d-9296-2bfd5e1daec6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:58.436695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=10 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:58:58.536632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9f669ceb-5a1e-4b1d-9296-2bfd5e1daec6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:58.546318 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9f669ceb-5a1e-4b1d-9296-2bfd5e1daec6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1198 microversion: 2.1 time: 0.231956 Aug 23 17:58:58.546318 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1084/2144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:58 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1198 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:58:58.712679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83627dbf-be22-4b9d-a045-f0cce189e5c9 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:58.713727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-83627dbf-be22-4b9d-a045-f0cce189e5c9 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:58.733159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83627dbf-be22-4b9d-a045-f0cce189e5c9 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:58.735272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83627dbf-be22-4b9d-a045-f0cce189e5c9 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:58.737210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83627dbf-be22-4b9d-a045-f0cce189e5c9 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:58.740601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83627dbf-be22-4b9d-a045-f0cce189e5c9 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:58.741644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83627dbf-be22-4b9d-a045-f0cce189e5c9 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:58.743772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83627dbf-be22-4b9d-a045-f0cce189e5c9 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:58.863124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-83627dbf-be22-4b9d-a045-f0cce189e5c9 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:58.878149 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-83627dbf-be22-4b9d-a045-f0cce189e5c9 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1476 microversion: 2.1 time: 0.172891 Aug 23 17:58:58.879683 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1085/2145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:58 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1476 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:58:58.934657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:58.935554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:58:58.943357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:58.944132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:58.944877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:58.946321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:58.947263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:58.948419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:59.031945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:58:59.032439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:58:59.032874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:58:59.033327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lazy-loading 'fault' on Instance uuid 856ac0cb-cfb2-43f5-9e4f-df662c38f02d {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:58:59.158534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:58:59.172711 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c859a15a-31d9-4298-83b3-a59bd8c5ed3b tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 200 len: 1303 microversion: 2.1 time: 0.242432 Aug 23 17:58:59.174725 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1086/2146] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:58:58 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 1303 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:58:59.186034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ba51c11f-305a-478c-8b8b-32cd09b51030 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecb25ca0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:58:59.698769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:00.134121 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-19524a33-0c15-4f44-8e2f-22457be23b87 tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/3fee239f-cda2-4388-96dc-f744e4b509c6" status: 202 len: 0 microversion: 2.1 time: 1.926438 Aug 23 17:59:00.135780 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1061/2147] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 17:58:58 2022] DELETE /compute/v2.1/os-floating-ips/3fee239f-cda2-4388-96dc-f744e4b509c6 => generated 0 bytes in 1929 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 17:59:00.140635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b08456ec-77b1-4021-a220-8717fcfa3a8f tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:00.141974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b08456ec-77b1-4021-a220-8717fcfa3a8f tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:00.153545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b08456ec-77b1-4021-a220-8717fcfa3a8f tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:00.154416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b08456ec-77b1-4021-a220-8717fcfa3a8f tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:00.155068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b08456ec-77b1-4021-a220-8717fcfa3a8f tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:00.156188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b08456ec-77b1-4021-a220-8717fcfa3a8f tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:00.156815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b08456ec-77b1-4021-a220-8717fcfa3a8f tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:00.157414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b08456ec-77b1-4021-a220-8717fcfa3a8f tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:00.553321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b08456ec-77b1-4021-a220-8717fcfa3a8f tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:00.570743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b08456ec-77b1-4021-a220-8717fcfa3a8f tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:00.572594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b08456ec-77b1-4021-a220-8717fcfa3a8f tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:00.579013 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b08456ec-77b1-4021-a220-8717fcfa3a8f tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1361 microversion: 2.26 time: 0.441995 Aug 23 17:59:00.587234 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1062/2148] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:00 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1361 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:00.614972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7d6cfb5-3894-499f-9a2b-5cf1aa9b8dcd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:00.615687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c7d6cfb5-3894-499f-9a2b-5cf1aa9b8dcd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:00.644576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7d6cfb5-3894-499f-9a2b-5cf1aa9b8dcd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:00.645087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7d6cfb5-3894-499f-9a2b-5cf1aa9b8dcd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:00.645530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7d6cfb5-3894-499f-9a2b-5cf1aa9b8dcd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:00.646253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7d6cfb5-3894-499f-9a2b-5cf1aa9b8dcd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:00.668393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7d6cfb5-3894-499f-9a2b-5cf1aa9b8dcd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:00.669223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7d6cfb5-3894-499f-9a2b-5cf1aa9b8dcd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:00.879375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c7d6cfb5-3894-499f-9a2b-5cf1aa9b8dcd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:00.890940 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c7d6cfb5-3894-499f-9a2b-5cf1aa9b8dcd tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1198 microversion: 2.1 time: 0.300101 Aug 23 17:59:00.894332 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1063/2149] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:00 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1198 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:00.921452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:00.922466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:00.936373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:00.938886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:00.939537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:00.940444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:00.944227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:00.944920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:01.062973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:01.068537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:01.069330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:01.073119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lazy-loading 'fault' on Instance uuid a82e2894-222e-4f3a-a8dd-54613738cf3d {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:01.228485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:01.240043 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-40cf9d08-93a4-4fc5-8c3b-f7aacca31964 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 200 len: 1311 microversion: 2.1 time: 0.342770 Aug 23 17:59:01.244032 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1064/2150] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:00 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 1311 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:01.249381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fd9cbb90-ba9f-4e6e-a314-d5fcb59f3eef tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Action: 'create', calling method: .version_select at 0x7f27ec8e3940>, body: {"pool": null} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:03.894958 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fd9cbb90-ba9f-4e6e-a314-d5fcb59f3eef tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.649176 Aug 23 17:59:03.896261 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1065/2151] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Aug 23 17:59:01 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2651 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:03.904122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e7b496d8-1f0a-48b4-87b5-29683370d7d3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:03.905034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e7b496d8-1f0a-48b4-87b5-29683370d7d3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: 856ac0cb-cfb2-43f5-9e4f-df662c38f02d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:03.913283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7b496d8-1f0a-48b4-87b5-29683370d7d3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:03.914596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7b496d8-1f0a-48b4-87b5-29683370d7d3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:03.915225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7b496d8-1f0a-48b4-87b5-29683370d7d3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:03.916129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7b496d8-1f0a-48b4-87b5-29683370d7d3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:03.916782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7b496d8-1f0a-48b4-87b5-29683370d7d3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:03.917565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7b496d8-1f0a-48b4-87b5-29683370d7d3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:03.957435 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-e7b496d8-1f0a-48b4-87b5-29683370d7d3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] HTTP exception thrown: Instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d could not be found. Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e7b496d8-1f0a-48b4-87b5-29683370d7d3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Request method failure captured: Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d HTTP/1.1 Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRQNnL7pPBICEUgGCKhDwjbVVRSuVaAtXWumTjnmsrg3qVf8l0kbYPwOJFcBqPBOSs0NAiXBisljD-EBKg3NPAksvMZvBeh5xYb-Tla5cphtO2B5oaodSce24yxDKCHOJ56EgmbjzPjHIIc7DBPMPKJLjJfSkH6JHd7Qii_GYHxmImc Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 88baf37ceb1342e3bc666ba96b4988ee Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-MigrationsAdminTest-353364920 Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_88baf37ceb1342e3bc666ba96b4988ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/88baf37ceb1342e3bc666ba96b4988ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/88baf37ceb1342e3bc666ba96b4988ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/88baf37ceb1342e3bc666ba96b4988ee"}]}] Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-MigrationsAdminTest-353364920 Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 88baf37ceb1342e3bc666ba96b4988ee Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-MigrationsAdminTest-353364920 Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-MigrationsAdminTest-353364920-project Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 8d66dd8a72974b1791fa449fb91c3282 Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-MigrationsAdminTest-353364920-project Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d could not be found. Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '856ac0cb-cfb2-43f5-9e4f-df662c38f02d'} Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d could not be found. Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d could not be found. Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:03.959481 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:03.966299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:03.966299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:03.966299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:03.966299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:59:03.966299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:59:03.966299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d could not be found. Aug 23 17:59:03.966299 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:03.968179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e7b496d8-1f0a-48b4-87b5-29683370d7d3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Returning 404 to user: Instance 856ac0cb-cfb2-43f5-9e4f-df662c38f02d could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:59:03.969290 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e7b496d8-1f0a-48b4-87b5-29683370d7d3 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d" status: 404 len: 111 microversion: 2.1 time: 0.070190 Aug 23 17:59:03.970425 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1066/2152] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:03 2022] GET /compute/v2.1/servers/856ac0cb-cfb2-43f5-9e4f-df662c38f02d => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:59:03.975723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-43f6f2a8-04bc-4314-a578-ad27998531b1 req-253f76b4-15b9-48f4-ba2d-57e9b0098ccd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017fdc38-466a-4461-aa24-c16b9c7d96ab", "name": "network-vif-plugged", "status": "completed", "tag": "d386fc31-0829-4584-9e38-6de5ab421b8f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:03.987883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-43f6f2a8-04bc-4314-a578-ad27998531b1 req-253f76b4-15b9-48f4-ba2d-57e9b0098ccd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:03.988755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-43f6f2a8-04bc-4314-a578-ad27998531b1 req-253f76b4-15b9-48f4-ba2d-57e9b0098ccd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:03.989445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-43f6f2a8-04bc-4314-a578-ad27998531b1 req-253f76b4-15b9-48f4-ba2d-57e9b0098ccd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:04.011594 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-43f6f2a8-04bc-4314-a578-ad27998531b1 req-253f76b4-15b9-48f4-ba2d-57e9b0098ccd service nova] Creating event network-vif-plugged:d386fc31-0829-4584-9e38-6de5ab421b8f for instance 017fdc38-466a-4461-aa24-c16b9c7d96ab on n-h1-850468-16 Aug 23 17:59:04.018504 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-43f6f2a8-04bc-4314-a578-ad27998531b1 req-253f76b4-15b9-48f4-ba2d-57e9b0098ccd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046275 Aug 23 17:59:04.022415 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1067/2153] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:59:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:04.031658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-df1294cb-a605-4386-b73a-bdff4737afd5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:04.032465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-df1294cb-a605-4386-b73a-bdff4737afd5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:04.040921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df1294cb-a605-4386-b73a-bdff4737afd5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:04.041418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df1294cb-a605-4386-b73a-bdff4737afd5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:04.041864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df1294cb-a605-4386-b73a-bdff4737afd5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:04.042888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df1294cb-a605-4386-b73a-bdff4737afd5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:04.043354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df1294cb-a605-4386-b73a-bdff4737afd5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:04.043781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df1294cb-a605-4386-b73a-bdff4737afd5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:04.283177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-df1294cb-a605-4386-b73a-bdff4737afd5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:04.301322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-df1294cb-a605-4386-b73a-bdff4737afd5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:04.304180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-df1294cb-a605-4386-b73a-bdff4737afd5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:04.306165 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-df1294cb-a605-4386-b73a-bdff4737afd5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1361 microversion: 2.26 time: 0.280358 Aug 23 17:59:04.307537 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1068/2154] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:04 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1361 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:04.312401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f299e60-e453-43a7-8ff7-c7b671048456 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:04.313284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5f299e60-e453-43a7-8ff7-c7b671048456 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:04.321635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f299e60-e453-43a7-8ff7-c7b671048456 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:04.322500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f299e60-e453-43a7-8ff7-c7b671048456 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:04.323422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f299e60-e453-43a7-8ff7-c7b671048456 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:04.324375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f299e60-e453-43a7-8ff7-c7b671048456 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:04.326386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f299e60-e453-43a7-8ff7-c7b671048456 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:04.327069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f299e60-e453-43a7-8ff7-c7b671048456 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:04.579910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f299e60-e453-43a7-8ff7-c7b671048456 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:04.591207 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5f299e60-e453-43a7-8ff7-c7b671048456 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1198 microversion: 2.1 time: 0.281775 Aug 23 17:59:04.594679 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1069/2155] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:04 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1198 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:04.619155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2bcee36f-782d-46c1-8444-5bb2fdd565ba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:04.620494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2bcee36f-782d-46c1-8444-5bb2fdd565ba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: a82e2894-222e-4f3a-a8dd-54613738cf3d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:04.632595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2bcee36f-782d-46c1-8444-5bb2fdd565ba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:04.636145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2bcee36f-782d-46c1-8444-5bb2fdd565ba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:04.636868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2bcee36f-782d-46c1-8444-5bb2fdd565ba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:04.637833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2bcee36f-782d-46c1-8444-5bb2fdd565ba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:04.638514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2bcee36f-782d-46c1-8444-5bb2fdd565ba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:04.639169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2bcee36f-782d-46c1-8444-5bb2fdd565ba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:04.655825 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-2bcee36f-782d-46c1-8444-5bb2fdd565ba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] HTTP exception thrown: Instance a82e2894-222e-4f3a-a8dd-54613738cf3d could not be found. Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2bcee36f-782d-46c1-8444-5bb2fdd565ba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Request method failure captured: Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d HTTP/1.1 Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRT-WrobZdFKNgsioEnHvog9B5Ooc2Kn6myU-JQXXYCvKfE0ykhshBkI1I_rh4CLGPgm-eUxrDIfsLbX0O1BJa1D_lEe1nvfMxeeE0lDIim3rKnMPBRA6pNZfBJ6OVIMfk2iHA3kVpIniQSef8Rk8qBJTtugnfpuLlL4hdwEe3WK8ZY Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: e92d43e5375a4245ae1e539f3ecdffdf Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ListServerFiltersTestJSON-925037762 Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e92d43e5375a4245ae1e539f3ecdffdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e92d43e5375a4245ae1e539f3ecdffdf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e92d43e5375a4245ae1e539f3ecdffdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e92d43e5375a4245ae1e539f3ecdffdf"}]}] Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ListServerFiltersTestJSON-925037762 Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: e92d43e5375a4245ae1e539f3ecdffdf Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-925037762 Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ListServerFiltersTestJSON-925037762-project Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 08aeadb95c7847f3b3f0633d702a5b1f Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ListServerFiltersTestJSON-925037762-project Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance a82e2894-222e-4f3a-a8dd-54613738cf3d could not be found. Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'a82e2894-222e-4f3a-a8dd-54613738cf3d'} Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a82e2894-222e-4f3a-a8dd-54613738cf3d could not be found. Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a82e2894-222e-4f3a-a8dd-54613738cf3d could not be found. Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:04.657492 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:04.662306 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:04.662306 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:04.662306 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:04.662306 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:59:04.662306 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:59:04.662306 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a82e2894-222e-4f3a-a8dd-54613738cf3d could not be found. Aug 23 17:59:04.662306 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:04.662306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2bcee36f-782d-46c1-8444-5bb2fdd565ba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Returning 404 to user: Instance a82e2894-222e-4f3a-a8dd-54613738cf3d could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:59:04.662306 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2bcee36f-782d-46c1-8444-5bb2fdd565ba tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d" status: 404 len: 111 microversion: 2.1 time: 0.065216 Aug 23 17:59:04.664003 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1070/2156] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:04 2022] GET /compute/v2.1/servers/a82e2894-222e-4f3a-a8dd-54613738cf3d => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:59:04.669856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-09c77a5a-62a3-4e3c-8f73-bc6e9fbbcf8e tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Calling method '.version_select at 0x7f27ec951280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:05.574158 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ba51c11f-305a-478c-8b8b-32cd09b51030 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1460 microversion: 2.1 time: 6.397183 Aug 23 17:59:05.575787 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1087/2157] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:58:59 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1460 bytes in 6400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:05.592833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aa00fdf5-cf56-4af4-b2fc-9a4ce9f9e36a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:05.593352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aa00fdf5-cf56-4af4-b2fc-9a4ce9f9e36a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:05.595367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=79,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:05.614823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa00fdf5-cf56-4af4-b2fc-9a4ce9f9e36a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:05.616482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa00fdf5-cf56-4af4-b2fc-9a4ce9f9e36a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:05.617238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa00fdf5-cf56-4af4-b2fc-9a4ce9f9e36a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:05.618171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa00fdf5-cf56-4af4-b2fc-9a4ce9f9e36a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:05.630961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa00fdf5-cf56-4af4-b2fc-9a4ce9f9e36a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:05.630961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa00fdf5-cf56-4af4-b2fc-9a4ce9f9e36a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:05.675931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aa00fdf5-cf56-4af4-b2fc-9a4ce9f9e36a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:59:05.827770 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aa00fdf5-cf56-4af4-b2fc-9a4ce9f9e36a tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 204 len: 0 microversion: 2.1 time: 0.249019 Aug 23 17:59:05.832827 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1088/2158] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:59:05 2022] DELETE /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:59:05.841309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f83b836f-e8b0-4f03-a875-666aa76d9427 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:05.843566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f83b836f-e8b0-4f03-a875-666aa76d9427 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: f8cfb229-ca34-4883-aa19-33cd91a70dc4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:05.858942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83b836f-e8b0-4f03-a875-666aa76d9427 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:05.860224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83b836f-e8b0-4f03-a875-666aa76d9427 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:05.860733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83b836f-e8b0-4f03-a875-666aa76d9427 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:05.862475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83b836f-e8b0-4f03-a875-666aa76d9427 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:05.862983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83b836f-e8b0-4f03-a875-666aa76d9427 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:05.863622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83b836f-e8b0-4f03-a875-666aa76d9427 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:05.928239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f83b836f-e8b0-4f03-a875-666aa76d9427 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: f8cfb229-ca34-4883-aa19-33cd91a70dc4] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:59:06.083329 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f83b836f-e8b0-4f03-a875-666aa76d9427 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4" status: 204 len: 0 microversion: 2.1 time: 0.244476 Aug 23 17:59:06.084296 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1089/2159] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:59:05 2022] DELETE /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:59:06.094504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-602ba3f4-e553-4f13-84f0-f99fd1cd9f93 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:06.095246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-602ba3f4-e553-4f13-84f0-f99fd1cd9f93 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:06.103468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-602ba3f4-e553-4f13-84f0-f99fd1cd9f93 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:06.104036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-602ba3f4-e553-4f13-84f0-f99fd1cd9f93 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:06.104394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-602ba3f4-e553-4f13-84f0-f99fd1cd9f93 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:06.105114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-602ba3f4-e553-4f13-84f0-f99fd1cd9f93 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:06.105570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-602ba3f4-e553-4f13-84f0-f99fd1cd9f93 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:06.105997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-602ba3f4-e553-4f13-84f0-f99fd1cd9f93 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:06.152088 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-09c77a5a-62a3-4e3c-8f73-bc6e9fbbcf8e tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/6c3fd68e-0af7-4652-b721-bed41d551fc7" status: 202 len: 0 microversion: 2.1 time: 1.486119 Aug 23 17:59:06.153148 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1071/2160] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 17:59:04 2022] DELETE /compute/v2.1/os-floating-ips/6c3fd68e-0af7-4652-b721-bed41d551fc7 => generated 0 bytes in 1488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:59:06.158079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f80bc3cc-4237-4b1d-8878-54d9befe09ce tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec6204c0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:06.219438 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f80bc3cc-4237-4b1d-8878-54d9befe09ce tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 200 len: 1460 microversion: 2.1 time: 0.065096 Aug 23 17:59:06.221422 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1072/2161] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:06 2022] GET /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 1460 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:06.233254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-16eb8e32-0f84-4b0b-98b7-8c1ff01e765f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:06.234246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-16eb8e32-0f84-4b0b-98b7-8c1ff01e765f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:06.245456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16eb8e32-0f84-4b0b-98b7-8c1ff01e765f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:06.246140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16eb8e32-0f84-4b0b-98b7-8c1ff01e765f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:06.246798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16eb8e32-0f84-4b0b-98b7-8c1ff01e765f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:06.247678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16eb8e32-0f84-4b0b-98b7-8c1ff01e765f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:06.248650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16eb8e32-0f84-4b0b-98b7-8c1ff01e765f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:06.249197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16eb8e32-0f84-4b0b-98b7-8c1ff01e765f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:06.424692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-16eb8e32-0f84-4b0b-98b7-8c1ff01e765f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:06.436120 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-16eb8e32-0f84-4b0b-98b7-8c1ff01e765f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1381 microversion: 2.1 time: 0.212346 Aug 23 17:59:06.440785 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1073/2162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:06 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1381 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:06.446143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c3cd6c52-067d-4efd-845c-ca895a449606 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:06.446792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c3cd6c52-067d-4efd-845c-ca895a449606 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:06.454269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3cd6c52-067d-4efd-845c-ca895a449606 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:06.454812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3cd6c52-067d-4efd-845c-ca895a449606 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:06.455260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3cd6c52-067d-4efd-845c-ca895a449606 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:06.455973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3cd6c52-067d-4efd-845c-ca895a449606 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:06.456433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3cd6c52-067d-4efd-845c-ca895a449606 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:06.456902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3cd6c52-067d-4efd-845c-ca895a449606 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:06.481632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:06.616467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c3cd6c52-067d-4efd-845c-ca895a449606 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:06.620728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-602ba3f4-e553-4f13-84f0-f99fd1cd9f93 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:06.629093 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c3cd6c52-067d-4efd-845c-ca895a449606 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1469 microversion: 2.1 time: 0.187171 Aug 23 17:59:06.632401 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1074/2163] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:06 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1469 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:06.641271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8fb78311-7cf2-40fd-9ba5-bfa2ab99edbc req-4a9a1beb-bf17-419d-87ec-4aeda17613f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b484a7b8-a47c-4124-9238-bfd9e4e296c3", "name": "network-vif-plugged", "status": "completed", "tag": "1d387a38-8029-4f9c-8631-bfa82f37c800"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:06.642988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-602ba3f4-e553-4f13-84f0-f99fd1cd9f93 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:06.644668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-602ba3f4-e553-4f13-84f0-f99fd1cd9f93 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:06.646523 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-602ba3f4-e553-4f13-84f0-f99fd1cd9f93 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1361 microversion: 2.26 time: 0.560875 Aug 23 17:59:06.651656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8fb78311-7cf2-40fd-9ba5-bfa2ab99edbc req-4a9a1beb-bf17-419d-87ec-4aeda17613f5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:06.652145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8fb78311-7cf2-40fd-9ba5-bfa2ab99edbc req-4a9a1beb-bf17-419d-87ec-4aeda17613f5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:06.652581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8fb78311-7cf2-40fd-9ba5-bfa2ab99edbc req-4a9a1beb-bf17-419d-87ec-4aeda17613f5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:06.652921 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1090/2164] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:06 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1361 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:06.662083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a63051e1-1672-4cf4-9237-a750e3117011 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:06.667081 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8fb78311-7cf2-40fd-9ba5-bfa2ab99edbc req-4a9a1beb-bf17-419d-87ec-4aeda17613f5 service nova] Creating event network-vif-plugged:1d387a38-8029-4f9c-8631-bfa82f37c800 for instance b484a7b8-a47c-4124-9238-bfd9e4e296c3 on n-h2-850468-16 Aug 23 17:59:06.669073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a63051e1-1672-4cf4-9237-a750e3117011 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: f8cfb229-ca34-4883-aa19-33cd91a70dc4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:06.673706 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8fb78311-7cf2-40fd-9ba5-bfa2ab99edbc req-4a9a1beb-bf17-419d-87ec-4aeda17613f5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038889 Aug 23 17:59:06.674602 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1075/2165] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:06.680612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-118732dd-285c-44d4-99a9-f7f49f35c894 tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Calling method '.version_select at 0x7f27ecb10820>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:06.683506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a63051e1-1672-4cf4-9237-a750e3117011 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:06.701033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a63051e1-1672-4cf4-9237-a750e3117011 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:06.701624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a63051e1-1672-4cf4-9237-a750e3117011 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:06.704127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a63051e1-1672-4cf4-9237-a750e3117011 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:06.706457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a63051e1-1672-4cf4-9237-a750e3117011 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:06.707680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a63051e1-1672-4cf4-9237-a750e3117011 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:06.720703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:06.751133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG neutronclient.v2_0.client [None req-118732dd-285c-44d4-99a9-f7f49f35c894 tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6c3fd68e-0af7-4652-b721-bed41d551fc7 could not be found", "detail": ""}} {{(pid=128808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 17:59:06.752049 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-118732dd-285c-44d4-99a9-f7f49f35c894 tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] HTTP exception thrown: Floating IP not found for ID 6c3fd68e-0af7-4652-b721-bed41d551fc7 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-118732dd-285c-44d4-99a9-f7f49f35c894 tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Request method failure captured: Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-floating-ips/6c3fd68e-0af7-4652-b721-bed41d551fc7 HTTP/1.1 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRVa9C5E_Tnzq9sg4l9BU3QsOEXhbR_0YDDkP2jyXSUYYiD3ndNLqrj9KQ7Myjkvlab9hnh9GUC9-vpTjVeObV4Hje7_0Dyk0sxHPsPefFRXKVRFdn4uhCJZJFyT_qAn5whUviKXPKNh-ewgWz-nh3uRwRJRItygFBewhhRwZ5gaTxQ Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: c93d2a81cc1f4fc3b4a94b60ffd3bcf8 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FloatingIPsTestJSON-2065467507 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c93d2a81cc1f4fc3b4a94b60ffd3bcf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c93d2a81cc1f4fc3b4a94b60ffd3bcf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c93d2a81cc1f4fc3b4a94b60ffd3bcf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c93d2a81cc1f4fc3b4a94b60ffd3bcf8"}]}] Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FloatingIPsTestJSON-2065467507 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: c93d2a81cc1f4fc3b4a94b60ffd3bcf8 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2065467507 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FloatingIPsTestJSON-2065467507-project Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 6711256258aa4cc189c78973e18ce384 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FloatingIPsTestJSON-2065467507-project Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: exception: Floating IP not found for ID 6c3fd68e-0af7-4652-b721-bed41d551fc7 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '6c3fd68e-0af7-4652-b721-bed41d551fc7'} Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6c3fd68e-0af7-4652-b721-bed41d551fc7 could not be found Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0a3d3f10-b753-4e7d-907c-189627437600'] Aug 23 17:59:06.754951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6c3fd68e-0af7-4652-b721-bed41d551fc7. Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6c3fd68e-0af7-4652-b721-bed41d551fc7 Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6c3fd68e-0af7-4652-b721-bed41d551fc7 Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-118732dd-285c-44d4-99a9-f7f49f35c894 tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Returning 404 to user: Floating IP not found for ID 6c3fd68e-0af7-4652-b721-bed41d551fc7 {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-118732dd-285c-44d4-99a9-f7f49f35c894 tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/6c3fd68e-0af7-4652-b721-bed41d551fc7" status: 404 len: 111 microversion: 2.1 time: 0.081077 Aug 23 17:59:06.764390 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1076/2166] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Aug 23 17:59:06 2022] GET /compute/v2.1/os-floating-ips/6c3fd68e-0af7-4652-b721-bed41d551fc7 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:59:06.768927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-853c0fc4-c8aa-4aed-91fd-08e9e04d27b7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:06.768927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-853c0fc4-c8aa-4aed-91fd-08e9e04d27b7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:06.777263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-853c0fc4-c8aa-4aed-91fd-08e9e04d27b7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:06.778604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-853c0fc4-c8aa-4aed-91fd-08e9e04d27b7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:06.779256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-853c0fc4-c8aa-4aed-91fd-08e9e04d27b7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:06.780199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-853c0fc4-c8aa-4aed-91fd-08e9e04d27b7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:06.781099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-853c0fc4-c8aa-4aed-91fd-08e9e04d27b7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:06.782041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-853c0fc4-c8aa-4aed-91fd-08e9e04d27b7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:06.971450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-853c0fc4-c8aa-4aed-91fd-08e9e04d27b7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:06.981838 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-853c0fc4-c8aa-4aed-91fd-08e9e04d27b7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c" status: 200 len: 1467 microversion: 2.1 time: 0.221521 Aug 23 17:59:06.982627 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1077/2167] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:06 2022] GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c => generated 1467 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:07.186957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a63051e1-1672-4cf4-9237-a750e3117011 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:07.199215 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a63051e1-1672-4cf4-9237-a750e3117011 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4" status: 200 len: 1518 microversion: 2.1 time: 0.544993 Aug 23 17:59:07.200330 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1091/2168] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:06 2022] GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4 => generated 1518 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:07.204992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86e4d27b-60ac-415e-9447-0d8d49e80ead tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Calling method '.version_select at 0x7f27ecb80820>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:07.212280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-daee85b7-403f-49b9-a2d7-dbb856845814 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:07.212956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-daee85b7-403f-49b9-a2d7-dbb856845814 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:07.219827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daee85b7-403f-49b9-a2d7-dbb856845814 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:07.220728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daee85b7-403f-49b9-a2d7-dbb856845814 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:07.221364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daee85b7-403f-49b9-a2d7-dbb856845814 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:07.222263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daee85b7-403f-49b9-a2d7-dbb856845814 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:07.223003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daee85b7-403f-49b9-a2d7-dbb856845814 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:07.223594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daee85b7-403f-49b9-a2d7-dbb856845814 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:07.276413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-86e4d27b-60ac-415e-9447-0d8d49e80ead tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 6c3fd68e-0af7-4652-b721-bed41d551fc7 could not be found", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 17:59:07.277379 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-86e4d27b-60ac-415e-9447-0d8d49e80ead tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] HTTP exception thrown: Floating IP not found for ID 6c3fd68e-0af7-4652-b721-bed41d551fc7 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86e4d27b-60ac-415e-9447-0d8d49e80ead tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Request method failure captured: Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-floating-ips/6c3fd68e-0af7-4652-b721-bed41d551fc7 HTTP/1.1 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRVa9C5E_Tnzq9sg4l9BU3QsOEXhbR_0YDDkP2jyXSUYYiD3ndNLqrj9KQ7Myjkvlab9hnh9GUC9-vpTjVeObV4Hje7_0Dyk0sxHPsPefFRXKVRFdn4uhCJZJFyT_qAn5whUviKXPKNh-ewgWz-nh3uRwRJRItygFBewhhRwZ5gaTxQ Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: c93d2a81cc1f4fc3b4a94b60ffd3bcf8 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-FloatingIPsTestJSON-2065467507 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c93d2a81cc1f4fc3b4a94b60ffd3bcf8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c93d2a81cc1f4fc3b4a94b60ffd3bcf8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c93d2a81cc1f4fc3b4a94b60ffd3bcf8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c93d2a81cc1f4fc3b4a94b60ffd3bcf8"}]}] Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-FloatingIPsTestJSON-2065467507 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: c93d2a81cc1f4fc3b4a94b60ffd3bcf8 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-FloatingIPsTestJSON-2065467507 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-FloatingIPsTestJSON-2065467507-project Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6711256258aa4cc189c78973e18ce384 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-FloatingIPsTestJSON-2065467507-project Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: exception: Floating IP not found for ID 6c3fd68e-0af7-4652-b721-bed41d551fc7 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '6c3fd68e-0af7-4652-b721-bed41d551fc7'} Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 6c3fd68e-0af7-4652-b721-bed41d551fc7 could not be found Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-33d34ba1-f371-4056-8330-bc2947370d2a'] Aug 23 17:59:07.279604 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 6c3fd68e-0af7-4652-b721-bed41d551fc7. Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 6c3fd68e-0af7-4652-b721-bed41d551fc7 Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 6c3fd68e-0af7-4652-b721-bed41d551fc7 Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86e4d27b-60ac-415e-9447-0d8d49e80ead tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] Returning 404 to user: Floating IP not found for ID 6c3fd68e-0af7-4652-b721-bed41d551fc7 {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-86e4d27b-60ac-415e-9447-0d8d49e80ead tempest-FloatingIPsTestJSON-2065467507 tempest-FloatingIPsTestJSON-2065467507-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/6c3fd68e-0af7-4652-b721-bed41d551fc7" status: 404 len: 111 microversion: 2.1 time: 0.079586 Aug 23 17:59:07.284954 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1092/2169] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 17:59:07 2022] DELETE /compute/v2.1/os-floating-ips/6c3fd68e-0af7-4652-b721-bed41d551fc7 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:59:07.291116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d54be790-853d-4446-9d27-ae5d7f317060 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-685131203"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:07.293929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d54be790-853d-4446-9d27-ae5d7f317060 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:07.317014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d54be790-853d-4446-9d27-ae5d7f317060 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:07.317515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d54be790-853d-4446-9d27-ae5d7f317060 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:07.317949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d54be790-853d-4446-9d27-ae5d7f317060 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:07.318698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d54be790-853d-4446-9d27-ae5d7f317060 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:07.319352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d54be790-853d-4446-9d27-ae5d7f317060 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:07.320864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d54be790-853d-4446-9d27-ae5d7f317060 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:07.527413 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-daee85b7-403f-49b9-a2d7-dbb856845814 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1534 microversion: 2.1 time: 0.543483 Aug 23 17:59:07.542465 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1078/2170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:06 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1534 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:07.558505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8725f9b8-8be0-4748-9b21-59894784979d tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:07.560904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8725f9b8-8be0-4748-9b21-59894784979d tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:07.577710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8725f9b8-8be0-4748-9b21-59894784979d tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:07.579597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8725f9b8-8be0-4748-9b21-59894784979d tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:07.580887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8725f9b8-8be0-4748-9b21-59894784979d tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:07.584573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8725f9b8-8be0-4748-9b21-59894784979d tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:07.586651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8725f9b8-8be0-4748-9b21-59894784979d tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:07.590715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8725f9b8-8be0-4748-9b21-59894784979d tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:07.662651 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d54be790-853d-4446-9d27-ae5d7f317060 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "POST /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c/action" status: 202 len: 0 microversion: 2.1 time: 0.379787 Aug 23 17:59:07.671592 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1093/2171] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:59:07 2022] POST /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 17:59:07.677356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-df85036b-b856-45a2-89c1-967f86c3ce89 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:07.678406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-df85036b-b856-45a2-89c1-967f86c3ce89 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:07.699271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df85036b-b856-45a2-89c1-967f86c3ce89 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:07.702991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df85036b-b856-45a2-89c1-967f86c3ce89 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:07.704277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df85036b-b856-45a2-89c1-967f86c3ce89 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:07.706991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df85036b-b856-45a2-89c1-967f86c3ce89 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:07.708629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df85036b-b856-45a2-89c1-967f86c3ce89 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:07.711425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df85036b-b856-45a2-89c1-967f86c3ce89 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:07.961708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-df85036b-b856-45a2-89c1-967f86c3ce89 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:07.972302 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-df85036b-b856-45a2-89c1-967f86c3ce89 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1469 microversion: 2.1 time: 0.299027 Aug 23 17:59:07.984297 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1094/2172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:07 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1469 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:07.994111 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8725f9b8-8be0-4748-9b21-59894784979d tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1534 microversion: 2.1 time: 0.448542 Aug 23 17:59:07.995855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0a85d75d-5cb5-4b06-803d-8887de3a3d67 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecb5fee0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:07.998775 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1079/2173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:07 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1534 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:08.001704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c91de864-b536-4e3b-98da-4f921b565e4b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:08.002323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c91de864-b536-4e3b-98da-4f921b565e4b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:08.012061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c91de864-b536-4e3b-98da-4f921b565e4b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:08.012620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c91de864-b536-4e3b-98da-4f921b565e4b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:08.012988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c91de864-b536-4e3b-98da-4f921b565e4b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:08.014447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c91de864-b536-4e3b-98da-4f921b565e4b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:08.015131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c91de864-b536-4e3b-98da-4f921b565e4b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:08.015740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c91de864-b536-4e3b-98da-4f921b565e4b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:08.066661 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0a85d75d-5cb5-4b06-803d-8887de3a3d67 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.080777 Aug 23 17:59:08.070604 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1095/2174] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:07 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:08.077856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8993df05-a3fd-4d28-9567-ed9fb84d4146 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:08.080449 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:59:08.080449 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:59:08.081599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8993df05-a3fd-4d28-9567-ed9fb84d4146 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:08.082090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8993df05-a3fd-4d28-9567-ed9fb84d4146 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:08.082534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8993df05-a3fd-4d28-9567-ed9fb84d4146 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:08.083443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8993df05-a3fd-4d28-9567-ed9fb84d4146 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:08.083903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8993df05-a3fd-4d28-9567-ed9fb84d4146 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:08.084330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8993df05-a3fd-4d28-9567-ed9fb84d4146 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:08.129460 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8993df05-a3fd-4d28-9567-ed9fb84d4146 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.056329 Aug 23 17:59:08.132822 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1096/2175] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Aug 23 17:59:08 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:08.152545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-29e1e111-1a7d-40d2-8cf3-3077295b305b tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-850468-16", "block_migration": false, "disk_over_commit": false}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:08.157703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-29e1e111-1a7d-40d2-8cf3-3077295b305b tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:08.175696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29e1e111-1a7d-40d2-8cf3-3077295b305b tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:08.176193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29e1e111-1a7d-40d2-8cf3-3077295b305b tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:08.176630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29e1e111-1a7d-40d2-8cf3-3077295b305b tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:08.185237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29e1e111-1a7d-40d2-8cf3-3077295b305b tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:08.185960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29e1e111-1a7d-40d2-8cf3-3077295b305b tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:08.186405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29e1e111-1a7d-40d2-8cf3-3077295b305b tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:08.225568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-29e1e111-1a7d-40d2-8cf3-3077295b305b tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lazy-loading 'flavor' on Instance uuid 017fdc38-466a-4461-aa24-c16b9c7d96ab {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:08.246315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-29e1e111-1a7d-40d2-8cf3-3077295b305b tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Going to try to live migrate instance to n-h2-850468-16 {{(pid=128807) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 17:59:08.330504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c91de864-b536-4e3b-98da-4f921b565e4b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:08.341469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c91de864-b536-4e3b-98da-4f921b565e4b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:08.345883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c91de864-b536-4e3b-98da-4f921b565e4b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:08.347120 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c91de864-b536-4e3b-98da-4f921b565e4b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1361 microversion: 2.26 time: 0.349187 Aug 23 17:59:08.347861 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1080/2176] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:07 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1361 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:08.362279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-460f6f66-89a0-47ae-b13c-3d4fd46dcf4b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:08.362967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-460f6f66-89a0-47ae-b13c-3d4fd46dcf4b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: f8cfb229-ca34-4883-aa19-33cd91a70dc4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:08.379039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-460f6f66-89a0-47ae-b13c-3d4fd46dcf4b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:08.379573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-460f6f66-89a0-47ae-b13c-3d4fd46dcf4b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:08.380030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-460f6f66-89a0-47ae-b13c-3d4fd46dcf4b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:08.380772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-460f6f66-89a0-47ae-b13c-3d4fd46dcf4b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:08.381313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-460f6f66-89a0-47ae-b13c-3d4fd46dcf4b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:08.381645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-460f6f66-89a0-47ae-b13c-3d4fd46dcf4b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:08.867417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-460f6f66-89a0-47ae-b13c-3d4fd46dcf4b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:08.881537 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-460f6f66-89a0-47ae-b13c-3d4fd46dcf4b tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4" status: 200 len: 1518 microversion: 2.1 time: 0.532766 Aug 23 17:59:08.896961 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1081/2177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:08 2022] GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4 => generated 1518 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:08.993870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-573fb6ba-a9c4-4126-9595-63033224e132 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:08.994623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-573fb6ba-a9c4-4126-9595-63033224e132 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:09.010881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-573fb6ba-a9c4-4126-9595-63033224e132 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:09.011386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-573fb6ba-a9c4-4126-9595-63033224e132 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:09.011876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-573fb6ba-a9c4-4126-9595-63033224e132 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:09.012532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-573fb6ba-a9c4-4126-9595-63033224e132 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:09.013083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-573fb6ba-a9c4-4126-9595-63033224e132 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:09.013518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-573fb6ba-a9c4-4126-9595-63033224e132 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:09.372178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-573fb6ba-a9c4-4126-9595-63033224e132 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d66dd8a72974b1791fa449fb91c3282', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88baf37ceb1342e3bc666ba96b4988ee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:09.382786 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-573fb6ba-a9c4-4126-9595-63033224e132 tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 200 len: 1469 microversion: 2.1 time: 0.392076 Aug 23 17:59:09.386522 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1082/2178] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:08 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 1469 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:09.394530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ed61ebae-5684-49cf-959e-da250c04d610 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec8bcdc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:09.475770 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ed61ebae-5684-49cf-959e-da250c04d610 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.087743 Aug 23 17:59:09.476708 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1083/2179] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:09 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:09.489097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7a01c625-e414-47e5-bdbf-d61342d46326 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:09.489756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7a01c625-e414-47e5-bdbf-d61342d46326 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:09.511930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a01c625-e414-47e5-bdbf-d61342d46326 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:09.512646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a01c625-e414-47e5-bdbf-d61342d46326 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:09.513375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a01c625-e414-47e5-bdbf-d61342d46326 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:09.514267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a01c625-e414-47e5-bdbf-d61342d46326 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:09.516565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a01c625-e414-47e5-bdbf-d61342d46326 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:09.521974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a01c625-e414-47e5-bdbf-d61342d46326 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:09.982730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a01c625-e414-47e5-bdbf-d61342d46326 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:10.004687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a01c625-e414-47e5-bdbf-d61342d46326 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:10.012405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a01c625-e414-47e5-bdbf-d61342d46326 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:10.014898 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7a01c625-e414-47e5-bdbf-d61342d46326 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1545 microversion: 2.26 time: 0.537006 Aug 23 17:59:10.021422 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1084/2180] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:09 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1545 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:10.032795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-866e1e26-c821-4c3b-b06a-728e4cb9fb98 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:10.033727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-866e1e26-c821-4c3b-b06a-728e4cb9fb98 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: f8cfb229-ca34-4883-aa19-33cd91a70dc4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:10.048823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-866e1e26-c821-4c3b-b06a-728e4cb9fb98 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:10.053151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-866e1e26-c821-4c3b-b06a-728e4cb9fb98 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:10.061299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-866e1e26-c821-4c3b-b06a-728e4cb9fb98 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:10.062610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-866e1e26-c821-4c3b-b06a-728e4cb9fb98 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:10.063160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-866e1e26-c821-4c3b-b06a-728e4cb9fb98 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:10.063859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-866e1e26-c821-4c3b-b06a-728e4cb9fb98 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:10.653880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-866e1e26-c821-4c3b-b06a-728e4cb9fb98 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:10.666012 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-866e1e26-c821-4c3b-b06a-728e4cb9fb98 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4" status: 200 len: 1476 microversion: 2.1 time: 0.643093 Aug 23 17:59:10.683468 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1085/2181] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:10 2022] GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4 => generated 1476 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:10.693457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec6ff550>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:10.722650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:10.723351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:10.724208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:10.729285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:10.740117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:10.740619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:10.741059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:10.741805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:10.746065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:10.746603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:10.800998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:10.801871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:10.802636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:10.819117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:10.820333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:10.821257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:10.853233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:10.914282 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [ee013254-ad44-4cb4-b5e8-493e981442a5] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 17:59:11.287680 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-29e1e111-1a7d-40d2-8cf3-3077295b305b tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab/action" status: 202 len: 0 microversion: 2.1 time: 3.146805 Aug 23 17:59:11.290998 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1097/2182] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:59:08 2022] POST /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab/action => generated 0 bytes in 3152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:59:11.297725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1740f7dd-a80c-48e7-ad3c-6c6554f31106 req-b287965f-5646-4468-aeab-cf1c8d0e8dfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4", "name": "network-vif-deleted", "tag": "ee6fb24a-f8ec-4d67-b529-6a7b42386fd6"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:11.316200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1740f7dd-a80c-48e7-ad3c-6c6554f31106 req-b287965f-5646-4468-aeab-cf1c8d0e8dfa service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:11.316601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1740f7dd-a80c-48e7-ad3c-6c6554f31106 req-b287965f-5646-4468-aeab-cf1c8d0e8dfa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:11.317082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1740f7dd-a80c-48e7-ad3c-6c6554f31106 req-b287965f-5646-4468-aeab-cf1c8d0e8dfa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:11.331532 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1740f7dd-a80c-48e7-ad3c-6c6554f31106 req-b287965f-5646-4468-aeab-cf1c8d0e8dfa service nova] Creating event network-vif-deleted:ee6fb24a-f8ec-4d67-b529-6a7b42386fd6 for instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 on n-h1-850468-16 Aug 23 17:59:11.339369 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1740f7dd-a80c-48e7-ad3c-6c6554f31106 req-b287965f-5646-4468-aeab-cf1c8d0e8dfa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046305 Aug 23 17:59:11.340626 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1098/2183] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:11.346882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-e7232ab5-5d8e-4a1a-a57c-79da6f204aa4 req-1d2d7136-745b-4fc3-8699-7343acd77778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f8cfb229-ca34-4883-aa19-33cd91a70dc4", "name": "network-vif-deleted", "tag": "75495c03-9bac-49c9-af64-a55bedb88c5f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:11.359880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e7232ab5-5d8e-4a1a-a57c-79da6f204aa4 req-1d2d7136-745b-4fc3-8699-7343acd77778 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:11.360361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e7232ab5-5d8e-4a1a-a57c-79da6f204aa4 req-1d2d7136-745b-4fc3-8699-7343acd77778 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:11.360841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e7232ab5-5d8e-4a1a-a57c-79da6f204aa4 req-1d2d7136-745b-4fc3-8699-7343acd77778 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:11.377959 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-e7232ab5-5d8e-4a1a-a57c-79da6f204aa4 req-1d2d7136-745b-4fc3-8699-7343acd77778 service nova] Creating event network-vif-deleted:75495c03-9bac-49c9-af64-a55bedb88c5f for instance f8cfb229-ca34-4883-aa19-33cd91a70dc4 on n-h1-850468-16 Aug 23 17:59:11.384355 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-e7232ab5-5d8e-4a1a-a57c-79da6f204aa4 req-1d2d7136-745b-4fc3-8699-7343acd77778 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041936 Aug 23 17:59:11.385580 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1099/2184] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:11.393443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81c39bd8-ea00-47b5-9d7d-e1e869fab3da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:11.394570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-81c39bd8-ea00-47b5-9d7d-e1e869fab3da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] [instance: ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:11.405096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81c39bd8-ea00-47b5-9d7d-e1e869fab3da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:11.406115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81c39bd8-ea00-47b5-9d7d-e1e869fab3da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:11.406720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81c39bd8-ea00-47b5-9d7d-e1e869fab3da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:11.407359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81c39bd8-ea00-47b5-9d7d-e1e869fab3da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:11.408070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81c39bd8-ea00-47b5-9d7d-e1e869fab3da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:11.408648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81c39bd8-ea00-47b5-9d7d-e1e869fab3da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:11.426040 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-81c39bd8-ea00-47b5-9d7d-e1e869fab3da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] HTTP exception thrown: Instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 could not be found. Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81c39bd8-ea00-47b5-9d7d-e1e869fab3da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Request method failure captured: Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 HTTP/1.1 Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRQNnL7pPBICEUgGCKhDwjbVVRSuVaAtXWumTjnmsrg3qVf8l0kbYPwOJFcBqPBOSs0NAiXBisljD-EBKg3NPAksvMZvBeh5xYb-Tla5cphtO2B5oaodSce24yxDKCHOJ56EgmbjzPjHIIc7DBPMPKJLjJfSkH6JHd7Qii_GYHxmImc Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 88baf37ceb1342e3bc666ba96b4988ee Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-MigrationsAdminTest-353364920 Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_88baf37ceb1342e3bc666ba96b4988ee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/88baf37ceb1342e3bc666ba96b4988ee"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/88baf37ceb1342e3bc666ba96b4988ee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/88baf37ceb1342e3bc666ba96b4988ee"}]}] Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-MigrationsAdminTest-353364920 Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 88baf37ceb1342e3bc666ba96b4988ee Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-MigrationsAdminTest-353364920 Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-MigrationsAdminTest-353364920-project Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 8d66dd8a72974b1791fa449fb91c3282 Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-MigrationsAdminTest-353364920-project Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 could not be found. Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4'} Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 could not be found. Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 could not be found. Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:11.427780 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:11.435657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:11.435657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:11.435657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:11.435657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:59:11.435657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:59:11.435657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 could not be found. Aug 23 17:59:11.435657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:11.435657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81c39bd8-ea00-47b5-9d7d-e1e869fab3da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] Returning 404 to user: Instance ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:59:11.435657 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81c39bd8-ea00-47b5-9d7d-e1e869fab3da tempest-MigrationsAdminTest-353364920 tempest-MigrationsAdminTest-353364920-project] 10.222.0.61 "GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4" status: 404 len: 111 microversion: 2.1 time: 0.044383 Aug 23 17:59:11.435657 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1100/2185] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:11 2022] GET /compute/v2.1/servers/ab41a2a0-83ba-4322-b17c-0cf9ba9f06f4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:59:11.437466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-a3ae0947-e278-4cfb-a6c0-e565a9574115 req-d72db7d8-7b6f-45e5-8121-023802bd0bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f47e601-36d6-4b1f-a4bf-8020bf69831c", "name": "network-vif-unplugged", "status": "completed", "tag": "4838606c-edcc-47d0-96e3-cce31a7cb847"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:11.449657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a3ae0947-e278-4cfb-a6c0-e565a9574115 req-d72db7d8-7b6f-45e5-8121-023802bd0bf4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:11.450436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a3ae0947-e278-4cfb-a6c0-e565a9574115 req-d72db7d8-7b6f-45e5-8121-023802bd0bf4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:11.451087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a3ae0947-e278-4cfb-a6c0-e565a9574115 req-d72db7d8-7b6f-45e5-8121-023802bd0bf4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:11.500250 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-a3ae0947-e278-4cfb-a6c0-e565a9574115 req-d72db7d8-7b6f-45e5-8121-023802bd0bf4 service nova] Creating event network-vif-unplugged:4838606c-edcc-47d0-96e3-cce31a7cb847 for instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c on n-h2-850468-16 Aug 23 17:59:11.507667 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-a3ae0947-e278-4cfb-a6c0-e565a9574115 req-d72db7d8-7b6f-45e5-8121-023802bd0bf4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073060 Aug 23 17:59:11.509499 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1101/2186] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:59:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:11.527969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91d37dc7-c03e-4240-97d3-a482a47d3076 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecb74c10>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:11.584972 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-91d37dc7-c03e-4240-97d3-a482a47d3076 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.067053 Aug 23 17:59:11.585924 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1102/2187] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:11 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:11.592041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-06505464-9c12-4f2a-8f86-b7fc0e63e819 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:11.593056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-06505464-9c12-4f2a-8f86-b7fc0e63e819 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:11.600102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06505464-9c12-4f2a-8f86-b7fc0e63e819 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:11.601088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06505464-9c12-4f2a-8f86-b7fc0e63e819 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:11.601730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06505464-9c12-4f2a-8f86-b7fc0e63e819 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:11.602680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06505464-9c12-4f2a-8f86-b7fc0e63e819 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:11.603716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06505464-9c12-4f2a-8f86-b7fc0e63e819 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:11.604335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06505464-9c12-4f2a-8f86-b7fc0e63e819 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:11.927453 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [ee013254-ad44-4cb4-b5e8-493e981442a5] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 34692. Aug 23 17:59:11.936478 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a2b298bb-36f6-4e98-9f27-28be08188b0a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-281832298" status: 201 len: 0 microversion: 2.26 time: 1.251678 Aug 23 17:59:11.943717 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1086/2188] 10.222.0.61 () {62 vars in 1377 bytes} [Tue Aug 23 17:59:10 2022] PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-281832298 => generated 0 bytes in 1259 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Aug 23 17:59:11.958350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00778398-c9d4-4aaa-ac42-efadbffb3e48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:11.959087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-00778398-c9d4-4aaa-ac42-efadbffb3e48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: f8cfb229-ca34-4883-aa19-33cd91a70dc4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:11.976047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00778398-c9d4-4aaa-ac42-efadbffb3e48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:11.976788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00778398-c9d4-4aaa-ac42-efadbffb3e48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:11.977240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00778398-c9d4-4aaa-ac42-efadbffb3e48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:11.977970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00778398-c9d4-4aaa-ac42-efadbffb3e48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:11.978426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00778398-c9d4-4aaa-ac42-efadbffb3e48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:11.978897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00778398-c9d4-4aaa-ac42-efadbffb3e48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:11.994874 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-00778398-c9d4-4aaa-ac42-efadbffb3e48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] HTTP exception thrown: Instance f8cfb229-ca34-4883-aa19-33cd91a70dc4 could not be found. Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00778398-c9d4-4aaa-ac42-efadbffb3e48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Request method failure captured: Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4 HTTP/1.1 Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRT-WrobZdFKNgsioEnHvog9B5Ooc2Kn6myU-JQXXYCvKfE0ykhshBkI1I_rh4CLGPgm-eUxrDIfsLbX0O1BJa1D_lEe1nvfMxeeE0lDIim3rKnMPBRA6pNZfBJ6OVIMfk2iHA3kVpIniQSef8Rk8qBJTtugnfpuLlL4hdwEe3WK8ZY Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: e92d43e5375a4245ae1e539f3ecdffdf Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ListServerFiltersTestJSON-925037762 Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e92d43e5375a4245ae1e539f3ecdffdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e92d43e5375a4245ae1e539f3ecdffdf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e92d43e5375a4245ae1e539f3ecdffdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e92d43e5375a4245ae1e539f3ecdffdf"}]}] Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ListServerFiltersTestJSON-925037762 Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: e92d43e5375a4245ae1e539f3ecdffdf Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-925037762 Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ListServerFiltersTestJSON-925037762-project Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 08aeadb95c7847f3b3f0633d702a5b1f Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ListServerFiltersTestJSON-925037762-project Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance f8cfb229-ca34-4883-aa19-33cd91a70dc4 could not be found. Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f8cfb229-ca34-4883-aa19-33cd91a70dc4'} Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f8cfb229-ca34-4883-aa19-33cd91a70dc4 could not be found. Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f8cfb229-ca34-4883-aa19-33cd91a70dc4 could not be found. Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:11.996429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:12.002425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:12.002425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:12.002425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:12.002425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:59:12.002425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:59:12.002425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f8cfb229-ca34-4883-aa19-33cd91a70dc4 could not be found. Aug 23 17:59:12.002425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:12.002425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00778398-c9d4-4aaa-ac42-efadbffb3e48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Returning 404 to user: Instance f8cfb229-ca34-4883-aa19-33cd91a70dc4 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:59:12.002425 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-00778398-c9d4-4aaa-ac42-efadbffb3e48 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4" status: 404 len: 111 microversion: 2.1 time: 0.051578 Aug 23 17:59:12.002425 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1087/2189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:11 2022] GET /compute/v2.1/servers/f8cfb229-ca34-4883-aa19-33cd91a70dc4 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:59:12.008402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-59d5a1f9-7369-4b48-9aa0-8ece8597c8fa tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec951f70>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:12.017724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59d5a1f9-7369-4b48-9aa0-8ece8597c8fa tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.018218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59d5a1f9-7369-4b48-9aa0-8ece8597c8fa tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.018826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59d5a1f9-7369-4b48-9aa0-8ece8597c8fa tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.036488 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-59d5a1f9-7369-4b48-9aa0-8ece8597c8fa tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-281832298" status: 204 len: 0 microversion: 2.26 time: 0.033027 Aug 23 17:59:12.041756 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1088/2190] 10.222.0.61 () {60 vars in 1358 bytes} [Tue Aug 23 17:59:11 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-281832298 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:59:12.045983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6cfedcc-d3d7-4e44-a7a1-792748d36607 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:12.046564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6cfedcc-d3d7-4e44-a7a1-792748d36607 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:12.055606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6cfedcc-d3d7-4e44-a7a1-792748d36607 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.056546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6cfedcc-d3d7-4e44-a7a1-792748d36607 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.057056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6cfedcc-d3d7-4e44-a7a1-792748d36607 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.057909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6cfedcc-d3d7-4e44-a7a1-792748d36607 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.058816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6cfedcc-d3d7-4e44-a7a1-792748d36607 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.059248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6cfedcc-d3d7-4e44-a7a1-792748d36607 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.091447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6cfedcc-d3d7-4e44-a7a1-792748d36607 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:59:12.261482 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6cfedcc-d3d7-4e44-a7a1-792748d36607 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 204 len: 0 microversion: 2.1 time: 0.220999 Aug 23 17:59:12.265761 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1089/2191] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:59:12 2022] DELETE /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 0 bytes in 224 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:59:12.275762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec82b5e0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:12.295903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.296389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.296882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.297417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:12.305907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.306768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.312111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.313306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.313940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.315170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.412558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-06505464-9c12-4f2a-8f86-b7fc0e63e819 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:12.425798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.426416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.426904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.450566 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-06505464-9c12-4f2a-8f86-b7fc0e63e819 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 0.862245 Aug 23 17:59:12.452971 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1103/2192] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:11 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:12.480422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:12.482184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-03875e63-25fe-4003-b64c-0e61f8c67dff tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:12.483581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-03875e63-25fe-4003-b64c-0e61f8c67dff tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:12.508630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03875e63-25fe-4003-b64c-0e61f8c67dff tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.509732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03875e63-25fe-4003-b64c-0e61f8c67dff tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.510708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03875e63-25fe-4003-b64c-0e61f8c67dff tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.511598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03875e63-25fe-4003-b64c-0e61f8c67dff tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.512243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03875e63-25fe-4003-b64c-0e61f8c67dff tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.513113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03875e63-25fe-4003-b64c-0e61f8c67dff tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.516404 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bfe17d67-b868-44b6-b749-4cf43290010c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.248896 Aug 23 17:59:12.518844 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1090/2193] 10.222.0.61 () {60 vars in 1295 bytes} [Tue Aug 23 17:59:12 2022] DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:59:12.529635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2f995c2f-6869-4435-b1ed-60aaf0d67569 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec87bf70>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:12.548097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f995c2f-6869-4435-b1ed-60aaf0d67569 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.548745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f995c2f-6869-4435-b1ed-60aaf0d67569 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.549466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f995c2f-6869-4435-b1ed-60aaf0d67569 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.553546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1,nova_cell1:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:12.583758 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2f995c2f-6869-4435-b1ed-60aaf0d67569 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags" status: 200 len: 12 microversion: 2.26 time: 0.058456 Aug 23 17:59:12.590156 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1091/2194] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Aug 23 17:59:12 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags => generated 12 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:12.606684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec8459d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:12.639616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.640113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.640555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.641043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:12.656136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.657598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.659074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.661775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.664706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.665418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.736900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.738809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.743359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.763742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.765503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.770129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.811969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:12.830571 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-146ab03d-7e40-4f80-9590-7050c1eaabfc tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-1251755198" status: 201 len: 0 microversion: 2.26 time: 0.238651 Aug 23 17:59:12.833148 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1092/2195] 10.222.0.61 () {62 vars in 1380 bytes} [Tue Aug 23 17:59:12 2022] PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-1251755198 => generated 0 bytes in 241 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 23 17:59:12.841666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ba78ab67-40d8-4458-a19f-62c11d0dbdce tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec4621f0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:12.901471 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ba78ab67-40d8-4458-a19f-62c11d0dbdce tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.066916 Aug 23 17:59:12.903064 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1093/2196] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:12 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:12.907865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bce99e90-f83d-4e42-9b37-854254860787 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec845040>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:12.917132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bce99e90-f83d-4e42-9b37-854254860787 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.917628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bce99e90-f83d-4e42-9b37-854254860787 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.918069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bce99e90-f83d-4e42-9b37-854254860787 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.930153 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bce99e90-f83d-4e42-9b37-854254860787 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags" status: 200 len: 36 microversion: 2.26 time: 0.025999 Aug 23 17:59:12.932301 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1094/2197] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Aug 23 17:59:12 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags => generated 36 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:12.949104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec7f51f0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:12.959711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.960772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.961914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.962933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:12.974563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.976771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.978207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:12.980995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:12.981657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:12.985373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.034940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.035815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.036520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.100602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:13.127425 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7b50d40b-b073-415c-aefc-4d853ba475b5 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-1251755198" status: 204 len: 0 microversion: 2.26 time: 0.188873 Aug 23 17:59:13.128849 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1095/2198] 10.222.0.61 () {60 vars in 1364 bytes} [Tue Aug 23 17:59:12 2022] DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-1251755198 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:59:13.149693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eaa00899-ad8d-48f3-b57a-6ab67fcd12ed tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec462280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:13.162325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eaa00899-ad8d-48f3-b57a-6ab67fcd12ed tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.162927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eaa00899-ad8d-48f3-b57a-6ab67fcd12ed tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.163975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eaa00899-ad8d-48f3-b57a-6ab67fcd12ed tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.185235 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eaa00899-ad8d-48f3-b57a-6ab67fcd12ed tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags" status: 200 len: 12 microversion: 2.26 time: 0.050252 Aug 23 17:59:13.190899 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1096/2199] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Aug 23 17:59:13 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags => generated 12 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:13.217119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec7f59d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:13.237643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.239260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.240690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.243389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:13.243948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-03875e63-25fe-4003-b64c-0e61f8c67dff tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:13.252544 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-03875e63-25fe-4003-b64c-0e61f8c67dff tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1518 microversion: 2.1 time: 0.798209 Aug 23 17:59:13.262925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.264498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.266667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.268710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.270189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.270880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.271181 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1104/2200] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:12 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1518 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:13.332635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.335428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.337204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.373744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:13.425430 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4b25b8c2-fabf-4730-8253-e3ea993af247 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.231591 Aug 23 17:59:13.426844 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1097/2201] 10.222.0.61 () {60 vars in 1295 bytes} [Tue Aug 23 17:59:13 2022] DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:59:13.440220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ecae01f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:13.455822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.456749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.458497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.459237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:13.473937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-12f8e4b3-803e-4d19-aa83-9e407588f496 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:13.474693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-12f8e4b3-803e-4d19-aa83-9e407588f496 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:13.481920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.482839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.483364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.486116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.486684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.487068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12f8e4b3-803e-4d19-aa83-9e407588f496 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.487727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.488429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12f8e4b3-803e-4d19-aa83-9e407588f496 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.494415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12f8e4b3-803e-4d19-aa83-9e407588f496 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.496010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12f8e4b3-803e-4d19-aa83-9e407588f496 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.497683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12f8e4b3-803e-4d19-aa83-9e407588f496 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.498611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12f8e4b3-803e-4d19-aa83-9e407588f496 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.572253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.573389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.575326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.628231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.628722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.629158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.693042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:13.733017 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-91b37fde-80cb-4450-a174-b290db8c0f1e tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-2117758199" status: 201 len: 0 microversion: 2.26 time: 0.300258 Aug 23 17:59:13.735238 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1105/2202] 10.222.0.61 () {62 vars in 1380 bytes} [Tue Aug 23 17:59:13 2022] PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-2117758199 => generated 0 bytes in 303 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 23 17:59:13.750878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ecb809d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:13.771013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.771498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.772075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.772476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:13.783045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.783539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.783992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.784685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.785262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.785940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.815708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.816799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.817445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.829951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.830863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.831530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.865223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:13.887798 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f83a573a-f1d0-4367-99d6-5e560bcf0c7a tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-1116678327" status: 201 len: 0 microversion: 2.26 time: 0.146546 Aug 23 17:59:13.893730 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1106/2203] 10.222.0.61 () {62 vars in 1380 bytes} [Tue Aug 23 17:59:13 2022] PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-1116678327 => generated 0 bytes in 153 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Aug 23 17:59:13.901538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ecae0af0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:13.915353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.916319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.917172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.917951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:13.924836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.925899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.926865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.928634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.929886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.930840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:13.935828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=4,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:13.981509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:13.982338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:13.983024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.011713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:14.036982 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-52184e78-f8e7-48fe-a6e6-458eab90bb40 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.140970 Aug 23 17:59:14.038054 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1107/2204] 10.222.0.61 () {60 vars in 1295 bytes} [Tue Aug 23 17:59:13 2022] DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:59:14.053382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5da3657f-981f-4799-af53-cb6a82899ac4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ed2eea60>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:14.110301 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5da3657f-981f-4799-af53-cb6a82899ac4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.069314 Aug 23 17:59:14.112460 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1108/2205] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:14 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:14.138782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-983f9193-f391-4899-8b5b-88662ce0c267 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ecae0c10>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:14.160378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-983f9193-f391-4899-8b5b-88662ce0c267 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.163075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-983f9193-f391-4899-8b5b-88662ce0c267 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.166701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-983f9193-f391-4899-8b5b-88662ce0c267 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.190574 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-983f9193-f391-4899-8b5b-88662ce0c267 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags" status: 200 len: 12 microversion: 2.26 time: 0.062631 Aug 23 17:59:14.197269 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1109/2206] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Aug 23 17:59:14 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags => generated 12 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:14.202442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec86f550>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:14.222377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.225790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.225790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.228946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:14.242006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.245046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.246014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.247679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.248387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.249996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.330103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-12f8e4b3-803e-4d19-aa83-9e407588f496 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:14.332235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.332844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.333369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.345521 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-12f8e4b3-803e-4d19-aa83-9e407588f496 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 0.875943 Aug 23 17:59:14.348028 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1098/2207] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:13 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:14.361417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:14.378339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-22554dc4-cbda-40df-aebb-143db280e48d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:14.380754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-22554dc4-cbda-40df-aebb-143db280e48d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:14.391235 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e0eba18-60a8-4448-8541-1ebdab0b931b tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.192941 Aug 23 17:59:14.392239 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1110/2208] 10.222.0.61 () {60 vars in 1295 bytes} [Tue Aug 23 17:59:14 2022] DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags => generated 0 bytes in 195 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 17:59:14.400272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22554dc4-cbda-40df-aebb-143db280e48d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.402272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec86f160>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:14.403902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22554dc4-cbda-40df-aebb-143db280e48d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.408216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22554dc4-cbda-40df-aebb-143db280e48d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.411233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22554dc4-cbda-40df-aebb-143db280e48d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.412647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22554dc4-cbda-40df-aebb-143db280e48d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.416328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22554dc4-cbda-40df-aebb-143db280e48d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.438161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.438820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.439396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.440006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:14.452008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.453957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.455203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.456224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.458420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.459778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.518806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.520497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.524485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.545092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.545572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.546011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.608508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:14.665732 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-65a73fc7-fe88-4e63-961e-216d37d78f4c tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-1024290310" status: 201 len: 0 microversion: 2.26 time: 0.267912 Aug 23 17:59:14.674054 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1111/2209] 10.222.0.61 () {62 vars in 1380 bytes} [Tue Aug 23 17:59:14 2022] PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-1024290310 => generated 0 bytes in 273 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 23 17:59:14.682037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ecae0d30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:14.715007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.715757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.716198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.716680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:14.730131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.733552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.737539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.740772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.744884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.746370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.813490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.815695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.816406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.839643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:14.840770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:14.843303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:14.901967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:14.912503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-22554dc4-cbda-40df-aebb-143db280e48d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:14.932982 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-22554dc4-cbda-40df-aebb-143db280e48d tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1518 microversion: 2.1 time: 0.565514 Aug 23 17:59:14.949191 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1099/2210] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:14 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1518 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:14.961565 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc7d430a-eaa6-4c26-a32c-d65cf790ce4d tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-1566377864" status: 201 len: 0 microversion: 2.26 time: 0.284449 Aug 23 17:59:14.964410 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1112/2211] 10.222.0.61 () {62 vars in 1380 bytes} [Tue Aug 23 17:59:14 2022] PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags/tempest-tag-1566377864 => generated 0 bytes in 290 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Aug 23 17:59:14.976131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Action: 'update_all', calling method: .version_select at 0x7f27ec82da60>, body: {"tags": ["tempest-tag-137867890", "tempest-tag-2002031789"]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:15.002030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.002860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.003963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.004493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:15.027006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.029019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.029566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.030307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.030799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.033364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.107222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.107715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.110532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.126183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-121e7c8b-16fa-470e-84ba-c5858c55ab53 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecae0940>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:15.192035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:15.209570 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-121e7c8b-16fa-470e-84ba-c5858c55ab53 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.086887 Aug 23 17:59:15.210929 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1113/2212] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:15 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:15.254971 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a99f3d5-075c-42a3-9b5d-f938efeeb7ae tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags" status: 200 len: 61 microversion: 2.26 time: 0.283538 Aug 23 17:59:15.264802 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1100/2213] 10.222.0.61 () {62 vars in 1312 bytes} [Tue Aug 23 17:59:14 2022] PUT /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags => generated 61 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:15.270598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c88fa01d-63e0-4726-b881-432d726a7d18 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec86f4c0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:15.284032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c88fa01d-63e0-4726-b881-432d726a7d18 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.285020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c88fa01d-63e0-4726-b881-432d726a7d18 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.285642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c88fa01d-63e0-4726-b881-432d726a7d18 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.297985 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c88fa01d-63e0-4726-b881-432d726a7d18 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags" status: 200 len: 61 microversion: 2.26 time: 0.032425 Aug 23 17:59:15.304684 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1114/2214] 10.222.0.61 () {60 vars in 1292 bytes} [Tue Aug 23 17:59:15 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags => generated 61 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:15.311475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '.version_select at 0x7f27ec4621f0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:15.327446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.329540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.336509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.337722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:15.353732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.354226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.354686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.356006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.357337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.359349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.380506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff1c1311-d3d4-4936-8094-9f95e9599d61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:15.384070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff1c1311-d3d4-4936-8094-9f95e9599d61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:15.407633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff1c1311-d3d4-4936-8094-9f95e9599d61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.408190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff1c1311-d3d4-4936-8094-9f95e9599d61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.414901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff1c1311-d3d4-4936-8094-9f95e9599d61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.418568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff1c1311-d3d4-4936-8094-9f95e9599d61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.419541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff1c1311-d3d4-4936-8094-9f95e9599d61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.421326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff1c1311-d3d4-4936-8094-9f95e9599d61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.430228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.430853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.431302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.481037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'flavor' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:15.517544 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c14cd378-876d-4039-ac15-2f21a08b0f79 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags" status: 204 len: 0 microversion: 2.26 time: 0.211079 Aug 23 17:59:15.520030 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1101/2215] 10.222.0.61 () {60 vars in 1295 bytes} [Tue Aug 23 17:59:15 2022] DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3/tags => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 17:59:15.534152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-05932914-c4cf-45c9-9393-0fe131e1cf87 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:15.534803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-05932914-c4cf-45c9-9393-0fe131e1cf87 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:15.542166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:15.559767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05932914-c4cf-45c9-9393-0fe131e1cf87 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.561398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05932914-c4cf-45c9-9393-0fe131e1cf87 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.563161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05932914-c4cf-45c9-9393-0fe131e1cf87 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.568103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05932914-c4cf-45c9-9393-0fe131e1cf87 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:15.570705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05932914-c4cf-45c9-9393-0fe131e1cf87 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:15.571577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05932914-c4cf-45c9-9393-0fe131e1cf87 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:15.729160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-05932914-c4cf-45c9-9393-0fe131e1cf87 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:59:15.994987 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-05932914-c4cf-45c9-9393-0fe131e1cf87 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 204 len: 0 microversion: 2.26 time: 0.468861 Aug 23 17:59:16.003821 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1102/2216] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 17:59:15 2022] DELETE /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 17:59:16.020215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a08d7ec3-3bf3-4b46-8b8c-fb8d4bea74a3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:16.025929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a08d7ec3-3bf3-4b46-8b8c-fb8d4bea74a3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:16.045543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a08d7ec3-3bf3-4b46-8b8c-fb8d4bea74a3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:16.048973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a08d7ec3-3bf3-4b46-8b8c-fb8d4bea74a3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:16.050272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a08d7ec3-3bf3-4b46-8b8c-fb8d4bea74a3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:16.054514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a08d7ec3-3bf3-4b46-8b8c-fb8d4bea74a3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:16.055857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a08d7ec3-3bf3-4b46-8b8c-fb8d4bea74a3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:16.057916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a08d7ec3-3bf3-4b46-8b8c-fb8d4bea74a3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:16.370317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a08d7ec3-3bf3-4b46-8b8c-fb8d4bea74a3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:16.381941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=90,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=3,nova_cell1:RELEASE=1,nova_cell1:DELETE=4,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:16.400760 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a08d7ec3-3bf3-4b46-8b8c-fb8d4bea74a3 tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1476 microversion: 2.1 time: 0.394105 Aug 23 17:59:16.401384 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1103/2217] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:16 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1476 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:16.429479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7a3395b-d83b-4595-be89-f7520b67c2d9 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:16.431761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c7a3395b-d83b-4595-be89-f7520b67c2d9 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:16.467768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7a3395b-d83b-4595-be89-f7520b67c2d9 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:16.468590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7a3395b-d83b-4595-be89-f7520b67c2d9 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:16.469700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7a3395b-d83b-4595-be89-f7520b67c2d9 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:16.473631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7a3395b-d83b-4595-be89-f7520b67c2d9 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:16.475418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7a3395b-d83b-4595-be89-f7520b67c2d9 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:16.478491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7a3395b-d83b-4595-be89-f7520b67c2d9 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:16.533787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff1c1311-d3d4-4936-8094-9f95e9599d61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:16.544907 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff1c1311-d3d4-4936-8094-9f95e9599d61 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 1.180433 Aug 23 17:59:16.551477 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1115/2218] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:15 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:16.573461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4dff630a-58b9-4a89-aba0-45a1535b1386 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecb129d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:16.660977 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4dff630a-58b9-4a89-aba0-45a1535b1386 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.108138 Aug 23 17:59:16.662071 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1116/2219] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:16 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:16.682300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-015e0550-e436-467b-9073-896d647548f5 req-6cc12285-0057-466d-bd47-e6e03dc36ee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8dfae01d-e966-4410-afe1-fdbb7cd88c9c", "name": "network-vif-deleted", "tag": "8758bf38-c27c-4100-bae2-63108556ba54"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:16.728904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-015e0550-e436-467b-9073-896d647548f5 req-6cc12285-0057-466d-bd47-e6e03dc36ee0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:16.729467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-015e0550-e436-467b-9073-896d647548f5 req-6cc12285-0057-466d-bd47-e6e03dc36ee0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:16.735707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-015e0550-e436-467b-9073-896d647548f5 req-6cc12285-0057-466d-bd47-e6e03dc36ee0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:16.784356 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-015e0550-e436-467b-9073-896d647548f5 req-6cc12285-0057-466d-bd47-e6e03dc36ee0 service nova] Creating event network-vif-deleted:8758bf38-c27c-4100-bae2-63108556ba54 for instance 8dfae01d-e966-4410-afe1-fdbb7cd88c9c on n-h2-850468-16 Aug 23 17:59:16.797682 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-015e0550-e436-467b-9073-896d647548f5 req-6cc12285-0057-466d-bd47-e6e03dc36ee0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134104 Aug 23 17:59:16.804619 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1117/2220] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:16.891104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-7c124138-68ae-4f2a-8c88-42a187cc9675 req-73b81608-782c-451d-a33e-f08a9c42e490 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1045a1-9999-4f13-82da-906bf1d0654c", "name": "network-vif-plugged", "status": "completed", "tag": "52ee230c-5add-4aa2-9df1-e27f64a344ed"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:16.924569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7c124138-68ae-4f2a-8c88-42a187cc9675 req-73b81608-782c-451d-a33e-f08a9c42e490 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:16.925096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7c124138-68ae-4f2a-8c88-42a187cc9675 req-73b81608-782c-451d-a33e-f08a9c42e490 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:16.927090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7c124138-68ae-4f2a-8c88-42a187cc9675 req-73b81608-782c-451d-a33e-f08a9c42e490 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:16.958805 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-7c124138-68ae-4f2a-8c88-42a187cc9675 req-73b81608-782c-451d-a33e-f08a9c42e490 service nova] Creating event network-vif-plugged:52ee230c-5add-4aa2-9df1-e27f64a344ed for instance ce1045a1-9999-4f13-82da-906bf1d0654c on n-h2-850468-16 Aug 23 17:59:16.973278 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-7c124138-68ae-4f2a-8c88-42a187cc9675 req-73b81608-782c-451d-a33e-f08a9c42e490 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084980 Aug 23 17:59:16.977718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c7a3395b-d83b-4595-be89-f7520b67c2d9 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:16.983412 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1118/2221] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:59:16.999066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c7a3395b-d83b-4595-be89-f7520b67c2d9 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:17.004992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c7a3395b-d83b-4595-be89-f7520b67c2d9 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:17.013156 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c7a3395b-d83b-4595-be89-f7520b67c2d9 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1551 microversion: 2.26 time: 0.603822 Aug 23 17:59:17.026736 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1104/2222] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:16 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1551 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:17.426332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:17.427092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:17.451714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:17.457737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:17.460677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:17.461493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:17.461980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:17.467887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:17.580647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-71269d35-5fb1-4940-ad2a-f40135144f66 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:17.581955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-71269d35-5fb1-4940-ad2a-f40135144f66 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:17.625530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71269d35-5fb1-4940-ad2a-f40135144f66 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:17.629588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71269d35-5fb1-4940-ad2a-f40135144f66 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:17.637498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71269d35-5fb1-4940-ad2a-f40135144f66 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:17.639550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71269d35-5fb1-4940-ad2a-f40135144f66 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:17.644257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71269d35-5fb1-4940-ad2a-f40135144f66 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:17.653766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71269d35-5fb1-4940-ad2a-f40135144f66 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:17.673266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:17.674012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:17.674437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:17.681868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lazy-loading 'fault' on Instance uuid 8dfae01d-e966-4410-afe1-fdbb7cd88c9c {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:18.026946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-71269d35-5fb1-4940-ad2a-f40135144f66 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:18.053046 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-71269d35-5fb1-4940-ad2a-f40135144f66 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 0.478839 Aug 23 17:59:18.068808 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1105/2223] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:17 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:18.091969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:18.113050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8643b839-3ed1-4787-af26-530272b5b3e1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec845160>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:18.237368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08aeadb95c7847f3b3f0633d702a5b1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e92d43e5375a4245ae1e539f3ecdffdf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:18.237368 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e18f8b22-7d6e-48d5-950b-703abf51a92e tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 200 len: 1311 microversion: 2.1 time: 0.768532 Aug 23 17:59:18.237368 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1119/2224] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:17 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 1311 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:18.240038 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8643b839-3ed1-4787-af26-530272b5b3e1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.122026 Aug 23 17:59:18.240038 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1106/2225] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:18 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:18.241982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5e6d38a3-e4c7-4e8e-adf9-e1216b6d2e10 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:18.241982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5e6d38a3-e4c7-4e8e-adf9-e1216b6d2e10 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:18.254404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e6d38a3-e4c7-4e8e-adf9-e1216b6d2e10 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:18.254404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e6d38a3-e4c7-4e8e-adf9-e1216b6d2e10 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:18.254404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e6d38a3-e4c7-4e8e-adf9-e1216b6d2e10 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:18.258485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e6d38a3-e4c7-4e8e-adf9-e1216b6d2e10 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:18.258485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e6d38a3-e4c7-4e8e-adf9-e1216b6d2e10 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:18.258485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e6d38a3-e4c7-4e8e-adf9-e1216b6d2e10 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:19.019050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1da86e8d-3afd-49cf-b173-374a8c760123 tempest-QuotaClassesAdminTestJSON-1553479843 tempest-QuotaClassesAdminTestJSON-1553479843-project-admin] Calling method '.version_select at 0x7f27ec6ffd30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:19.021754 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:59:19.021754 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:59:19.042573 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1da86e8d-3afd-49cf-b173-374a8c760123 tempest-QuotaClassesAdminTestJSON-1553479843 tempest-QuotaClassesAdminTestJSON-1553479843-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.541651 Aug 23 17:59:19.050978 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1107/2226] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Aug 23 17:59:18 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:19.057285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1af872d6-90b4-45cb-81f3-b9d2ad84c7e8 tempest-QuotaClassesAdminTestJSON-1553479843 tempest-QuotaClassesAdminTestJSON-1553479843-project-admin] Action: 'update', calling method: .version_select at 0x7f27ecd97940>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:19.061005 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:59:19.061005 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:59:19.061240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5e6d38a3-e4c7-4e8e-adf9-e1216b6d2e10 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:19.083299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5e6d38a3-e4c7-4e8e-adf9-e1216b6d2e10 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:19.086245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5e6d38a3-e4c7-4e8e-adf9-e1216b6d2e10 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:19.106366 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5e6d38a3-e4c7-4e8e-adf9-e1216b6d2e10 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1551 microversion: 2.26 time: 0.913637 Aug 23 17:59:19.108206 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1120/2227] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:18 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1551 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:19.123548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-393df608-bad0-4efe-888f-c9b7dbdae6bb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:19.126112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-393df608-bad0-4efe-888f-c9b7dbdae6bb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:19.136275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-393df608-bad0-4efe-888f-c9b7dbdae6bb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:19.136965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-393df608-bad0-4efe-888f-c9b7dbdae6bb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:19.137677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-393df608-bad0-4efe-888f-c9b7dbdae6bb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:19.138643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-393df608-bad0-4efe-888f-c9b7dbdae6bb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:19.139354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-393df608-bad0-4efe-888f-c9b7dbdae6bb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:19.139999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-393df608-bad0-4efe-888f-c9b7dbdae6bb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:19.449060 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1af872d6-90b4-45cb-81f3-b9d2ad84c7e8 tempest-QuotaClassesAdminTestJSON-1553479843 tempest-QuotaClassesAdminTestJSON-1553479843-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 0.396589 Aug 23 17:59:19.450592 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1108/2228] 10.222.0.61 () {60 vars in 1206 bytes} [Tue Aug 23 17:59:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:19.456411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-862cf928-b9a3-4b5b-979b-32b1cc3d50a3 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec81f280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:19.527637 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-862cf928-b9a3-4b5b-979b-32b1cc3d50a3 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.075602 Aug 23 17:59:19.530783 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1109/2229] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:19 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:19.531692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-393df608-bad0-4efe-888f-c9b7dbdae6bb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:19.542758 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-393df608-bad0-4efe-888f-c9b7dbdae6bb tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 0.428591 Aug 23 17:59:19.544221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcbec5ae-b7e8-4245-a5ad-ca60bc16faad tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:19.544702 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1121/2230] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:19 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:19.544849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fcbec5ae-b7e8-4245-a5ad-ca60bc16faad tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] [instance: 8dfae01d-e966-4410-afe1-fdbb7cd88c9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:19.553242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcbec5ae-b7e8-4245-a5ad-ca60bc16faad tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:19.554704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcbec5ae-b7e8-4245-a5ad-ca60bc16faad tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:19.555284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcbec5ae-b7e8-4245-a5ad-ca60bc16faad tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:19.556006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcbec5ae-b7e8-4245-a5ad-ca60bc16faad tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:19.560929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcbec5ae-b7e8-4245-a5ad-ca60bc16faad tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:19.561300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d94edaf-251b-41a8-b8fb-3956af370714 tempest-QuotaClassesAdminTestJSON-1553479843 tempest-QuotaClassesAdminTestJSON-1553479843-project-admin] Calling method '.version_select at 0x7f27ecaa7a60>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:19.561559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcbec5ae-b7e8-4245-a5ad-ca60bc16faad tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:19.562725 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:59:19.562725 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 17:59:19.584735 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-fcbec5ae-b7e8-4245-a5ad-ca60bc16faad tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] HTTP exception thrown: Instance 8dfae01d-e966-4410-afe1-fdbb7cd88c9c could not be found. Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcbec5ae-b7e8-4245-a5ad-ca60bc16faad tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Request method failure captured: Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c HTTP/1.1 Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRT-WrobZdFKNgsioEnHvog9B5Ooc2Kn6myU-JQXXYCvKfE0ykhshBkI1I_rh4CLGPgm-eUxrDIfsLbX0O1BJa1D_lEe1nvfMxeeE0lDIim3rKnMPBRA6pNZfBJ6OVIMfk2iHA3kVpIniQSef8Rk8qBJTtugnfpuLlL4hdwEe3WK8ZY Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: e92d43e5375a4245ae1e539f3ecdffdf Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ListServerFiltersTestJSON-925037762 Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e92d43e5375a4245ae1e539f3ecdffdf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e92d43e5375a4245ae1e539f3ecdffdf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e92d43e5375a4245ae1e539f3ecdffdf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e92d43e5375a4245ae1e539f3ecdffdf"}]}] Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ListServerFiltersTestJSON-925037762 Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: e92d43e5375a4245ae1e539f3ecdffdf Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-925037762 Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ListServerFiltersTestJSON-925037762-project Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 08aeadb95c7847f3b3f0633d702a5b1f Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ListServerFiltersTestJSON-925037762-project Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 8dfae01d-e966-4410-afe1-fdbb7cd88c9c could not be found. Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '8dfae01d-e966-4410-afe1-fdbb7cd88c9c'} Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8dfae01d-e966-4410-afe1-fdbb7cd88c9c could not be found. Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8dfae01d-e966-4410-afe1-fdbb7cd88c9c could not be found. Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:19.587038 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:19.591683 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:19.591683 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:19.591683 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:19.591683 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:59:19.591683 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:59:19.591683 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8dfae01d-e966-4410-afe1-fdbb7cd88c9c could not be found. Aug 23 17:59:19.591683 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 17:59:19.591683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcbec5ae-b7e8-4245-a5ad-ca60bc16faad tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] Returning 404 to user: Instance 8dfae01d-e966-4410-afe1-fdbb7cd88c9c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:59:19.591683 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fcbec5ae-b7e8-4245-a5ad-ca60bc16faad tempest-ListServerFiltersTestJSON-925037762 tempest-ListServerFiltersTestJSON-925037762-project] 10.222.0.61 "GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c" status: 404 len: 111 microversion: 2.1 time: 0.056938 Aug 23 17:59:19.591683 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1110/2231] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:19 2022] GET /compute/v2.1/servers/8dfae01d-e966-4410-afe1-fdbb7cd88c9c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 17:59:19.595566 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d94edaf-251b-41a8-b8fb-3956af370714 tempest-QuotaClassesAdminTestJSON-1553479843 tempest-QuotaClassesAdminTestJSON-1553479843-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.049517 Aug 23 17:59:19.596154 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1122/2232] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Aug 23 17:59:19 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:19.610212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e184b2fb-cb77-4f54-8c1b-c26eeb6baaa7 tempest-QuotaClassesAdminTestJSON-1553479843 tempest-QuotaClassesAdminTestJSON-1553479843-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec7e0f70>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:19.614531 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-quota-class-sets:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 17:59:19.614531 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 17:59:19.811599 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e184b2fb-cb77-4f54-8c1b-c26eeb6baaa7 tempest-QuotaClassesAdminTestJSON-1553479843 tempest-QuotaClassesAdminTestJSON-1553479843-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 0.204586 Aug 23 17:59:19.812755 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1111/2233] 10.222.0.61 () {60 vars in 1206 bytes} [Tue Aug 23 17:59:19 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:20.137864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b5a2a4c4-d565-4daf-a6d1-aba1aa1168c4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:20.139120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b5a2a4c4-d565-4daf-a6d1-aba1aa1168c4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:20.154306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5a2a4c4-d565-4daf-a6d1-aba1aa1168c4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:20.154837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5a2a4c4-d565-4daf-a6d1-aba1aa1168c4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:20.155278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5a2a4c4-d565-4daf-a6d1-aba1aa1168c4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:20.156001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5a2a4c4-d565-4daf-a6d1-aba1aa1168c4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:20.156461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5a2a4c4-d565-4daf-a6d1-aba1aa1168c4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:20.163488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5a2a4c4-d565-4daf-a6d1-aba1aa1168c4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:20.220623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-69aa203b-6fb1-4bea-b917-6949fd18c70c req-668ebfab-c3cd-4248-bfe3-7b73e7736a4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b484a7b8-a47c-4124-9238-bfd9e4e296c3", "name": "network-vif-deleted", "tag": "1d387a38-8029-4f9c-8631-bfa82f37c800"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:20.259689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-69aa203b-6fb1-4bea-b917-6949fd18c70c req-668ebfab-c3cd-4248-bfe3-7b73e7736a4f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:20.261244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-69aa203b-6fb1-4bea-b917-6949fd18c70c req-668ebfab-c3cd-4248-bfe3-7b73e7736a4f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:20.261840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-69aa203b-6fb1-4bea-b917-6949fd18c70c req-668ebfab-c3cd-4248-bfe3-7b73e7736a4f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:20.296127 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-69aa203b-6fb1-4bea-b917-6949fd18c70c req-668ebfab-c3cd-4248-bfe3-7b73e7736a4f service nova] Creating event network-vif-deleted:1d387a38-8029-4f9c-8631-bfa82f37c800 for instance b484a7b8-a47c-4124-9238-bfd9e4e296c3 on n-h2-850468-16 Aug 23 17:59:20.310175 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-69aa203b-6fb1-4bea-b917-6949fd18c70c req-668ebfab-c3cd-4248-bfe3-7b73e7736a4f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103141 Aug 23 17:59:20.311997 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1112/2234] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:59:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:20.378111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b5a2a4c4-d565-4daf-a6d1-aba1aa1168c4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:20.389681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b5a2a4c4-d565-4daf-a6d1-aba1aa1168c4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:20.393657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b5a2a4c4-d565-4daf-a6d1-aba1aa1168c4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:20.397286 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b5a2a4c4-d565-4daf-a6d1-aba1aa1168c4 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1509 microversion: 2.26 time: 0.263901 Aug 23 17:59:20.401379 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1123/2235] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:20 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1509 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:20.547159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b2cef9d-2f56-4e21-863d-86d9b9644790 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec845f70>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:20.575671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83d54657-710c-4759-8f85-b694002f2d96 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:20.578032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-83d54657-710c-4759-8f85-b694002f2d96 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:20.603135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83d54657-710c-4759-8f85-b694002f2d96 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:20.608516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83d54657-710c-4759-8f85-b694002f2d96 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:20.609992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83d54657-710c-4759-8f85-b694002f2d96 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:20.619047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83d54657-710c-4759-8f85-b694002f2d96 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:20.626235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83d54657-710c-4759-8f85-b694002f2d96 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:20.626858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83d54657-710c-4759-8f85-b694002f2d96 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:20.682747 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3b2cef9d-2f56-4e21-863d-86d9b9644790 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.140517 Aug 23 17:59:20.683935 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1113/2236] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:20 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:21.428422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:21.429640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:21.452127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:21.452672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:21.453118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:21.453862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:21.454348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:21.454770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:21.597222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:21.597716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:21.598156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:21.598641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lazy-loading 'fault' on Instance uuid b484a7b8-a47c-4124-9238-bfd9e4e296c3 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 17:59:21.749183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:21.762944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:21.772041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-83d54657-710c-4759-8f85-b694002f2d96 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:21.774806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f13656fe15cc4a66b37ae18296f9427d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '983637b0e15143a5a142f0af748dfcf3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:21.777874 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-10cec0d6-9b22-479a-8202-058b7759b8f1 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 200 len: 1351 microversion: 2.26 time: 0.352829 Aug 23 17:59:21.780441 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1114/2237] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:21 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 1351 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:21.789523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-028a744c-3daa-4e2d-a472-bc611650d1a8 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec845b80>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:21.825826 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-83d54657-710c-4759-8f85-b694002f2d96 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 1.262710 Aug 23 17:59:21.832984 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1124/2238] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:20 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:21.892803 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-028a744c-3daa-4e2d-a472-bc611650d1a8 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.111078 Aug 23 17:59:21.893361 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1115/2239] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:21 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:22.805090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3853927f-879c-444d-989e-b6eb15c058d3 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:22.806362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3853927f-879c-444d-989e-b6eb15c058d3 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] [instance: b484a7b8-a47c-4124-9238-bfd9e4e296c3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:22.822039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3853927f-879c-444d-989e-b6eb15c058d3 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:22.825548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3853927f-879c-444d-989e-b6eb15c058d3 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:22.826995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3853927f-879c-444d-989e-b6eb15c058d3 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:22.830186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3853927f-879c-444d-989e-b6eb15c058d3 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:22.832213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3853927f-879c-444d-989e-b6eb15c058d3 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:22.833577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3853927f-879c-444d-989e-b6eb15c058d3 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:22.850321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=92,nova_cell1:DELETE=2,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:22.855866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a27de998-9d09-4625-b12e-434a173bc619 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:22.857878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a27de998-9d09-4625-b12e-434a173bc619 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:22.877928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a27de998-9d09-4625-b12e-434a173bc619 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:22.885014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a27de998-9d09-4625-b12e-434a173bc619 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:22.885823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a27de998-9d09-4625-b12e-434a173bc619 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:22.887993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a27de998-9d09-4625-b12e-434a173bc619 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:22.889860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a27de998-9d09-4625-b12e-434a173bc619 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:22.890576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a27de998-9d09-4625-b12e-434a173bc619 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:22.934805 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-3853927f-879c-444d-989e-b6eb15c058d3 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] HTTP exception thrown: Instance b484a7b8-a47c-4124-9238-bfd9e4e296c3 could not be found. Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3853927f-879c-444d-989e-b6eb15c058d3 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Request method failure captured: Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 HTTP/1.1 Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRVObKiOoA-k9imZwb2aRfR1n-9Y-ajZq52YSGeOF1TOYlxWF10q4mwZGJZre5dodZltTaLTeI7ILq2Jy-swe4XSeQvzRdHRSJyo6Lhy1wKLiYamZZMVe5R-HI5a1uduFkGWtJt3vIQ61RZBPAMQG-WvgL1aouGAaztyBTprplpR0uc Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.26 Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 983637b0e15143a5a142f0af748dfcf3 Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerTagsTestJSON-2094377652 Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_983637b0e15143a5a142f0af748dfcf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/983637b0e15143a5a142f0af748dfcf3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/983637b0e15143a5a142f0af748dfcf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/983637b0e15143a5a142f0af748dfcf3"}]}] Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerTagsTestJSON-2094377652 Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 983637b0e15143a5a142f0af748dfcf3 Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerTagsTestJSON-2094377652 Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerTagsTestJSON-2094377652-project Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f13656fe15cc4a66b37ae18296f9427d Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerTagsTestJSON-2094377652-project Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance b484a7b8-a47c-4124-9238-bfd9e4e296c3 could not be found. Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'b484a7b8-a47c-4124-9238-bfd9e4e296c3'} Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b484a7b8-a47c-4124-9238-bfd9e4e296c3 could not be found. Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b484a7b8-a47c-4124-9238-bfd9e4e296c3 could not be found. Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 17:59:22.942868 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:22.947623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 17:59:22.947623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 17:59:22.947623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 17:59:22.947623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 17:59:22.947623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 17:59:22.947623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b484a7b8-a47c-4124-9238-bfd9e4e296c3 could not be found. Aug 23 17:59:22.947623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 17:59:22.952693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3853927f-879c-444d-989e-b6eb15c058d3 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] Returning 404 to user: Instance b484a7b8-a47c-4124-9238-bfd9e4e296c3 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 17:59:22.957155 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3853927f-879c-444d-989e-b6eb15c058d3 tempest-ServerTagsTestJSON-2094377652 tempest-ServerTagsTestJSON-2094377652-project] 10.222.0.61 "GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3" status: 404 len: 111 microversion: 2.26 time: 0.159872 Aug 23 17:59:22.965031 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1125/2240] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:22 2022] GET /compute/v2.1/servers/b484a7b8-a47c-4124-9238-bfd9e4e296c3 => generated 111 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 17:59:22.983067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9363abc0-34ac-4939-aa0f-3542434e9a50 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecae0940>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:23.149510 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9363abc0-34ac-4939-aa0f-3542434e9a50 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.182691 Aug 23 17:59:23.151149 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1126/2241] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:22 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:24.041716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a27de998-9d09-4625-b12e-434a173bc619 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:24.052399 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a27de998-9d09-4625-b12e-434a173bc619 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 1.202408 Aug 23 17:59:24.055244 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1116/2242] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:22 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:24.166923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4bfafe46-d4b8-4f69-9d06-e16100f617c2 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecadd4c0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:24.270670 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4bfafe46-d4b8-4f69-9d06-e16100f617c2 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.109999 Aug 23 17:59:24.271535 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1127/2243] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:24 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:25.074932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3809af1-4850-43f6-b936-2300ee944730 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:25.076340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d3809af1-4850-43f6-b936-2300ee944730 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:25.091168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=25,nova_api:INSERT=7 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:25.095004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3809af1-4850-43f6-b936-2300ee944730 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:25.096937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3809af1-4850-43f6-b936-2300ee944730 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:25.097529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3809af1-4850-43f6-b936-2300ee944730 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:25.099882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3809af1-4850-43f6-b936-2300ee944730 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:25.101250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3809af1-4850-43f6-b936-2300ee944730 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:25.102256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3809af1-4850-43f6-b936-2300ee944730 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:25.287670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-69459840-40f7-4649-b290-27b5ad86f4ce tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecb448b0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:25.389270 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-69459840-40f7-4649-b290-27b5ad86f4ce tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.105647 Aug 23 17:59:25.391102 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1128/2244] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:25 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:26.158975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d3809af1-4850-43f6-b936-2300ee944730 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:26.178111 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d3809af1-4850-43f6-b936-2300ee944730 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 1.107619 Aug 23 17:59:26.183002 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1117/2245] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:25 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:26.405254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1007be46-d555-46ce-ad4f-43a16a3be8fa tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27eca11820>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:26.478852 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1007be46-d555-46ce-ad4f-43a16a3be8fa tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.077791 Aug 23 17:59:26.479431 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1129/2246] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:26 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:27.207049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1ec975e8-e2d6-46dc-8f8d-6ccca0f2bf81 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:27.208247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1ec975e8-e2d6-46dc-8f8d-6ccca0f2bf81 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:27.227775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ec975e8-e2d6-46dc-8f8d-6ccca0f2bf81 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:27.231355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ec975e8-e2d6-46dc-8f8d-6ccca0f2bf81 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:27.231964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ec975e8-e2d6-46dc-8f8d-6ccca0f2bf81 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:27.233152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ec975e8-e2d6-46dc-8f8d-6ccca0f2bf81 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:27.239303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ec975e8-e2d6-46dc-8f8d-6ccca0f2bf81 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:27.240713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ec975e8-e2d6-46dc-8f8d-6ccca0f2bf81 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:27.494670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-670256d5-c8cc-4e65-bd07-7dc059e87c6b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec9d2c10>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:27.590151 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-670256d5-c8cc-4e65-bd07-7dc059e87c6b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.098640 Aug 23 17:59:27.591587 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1130/2247] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:27 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:28.608148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc22a3fa-f52b-4e56-a21a-1e89367fc71a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec8f50d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:28.754776 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc22a3fa-f52b-4e56-a21a-1e89367fc71a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.152915 Aug 23 17:59:28.765222 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1131/2248] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:28 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:29.499017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1ec975e8-e2d6-46dc-8f8d-6ccca0f2bf81 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:29.509233 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1ec975e8-e2d6-46dc-8f8d-6ccca0f2bf81 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 2.305873 Aug 23 17:59:29.519124 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1118/2249] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:27 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 2317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:29.767315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:29.773164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4480bb2e-c7e6-458c-9568-3cc994cadf32 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec7b9670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:29.806876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=27,nova_cell0:UPDATE=7 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:29.844337 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4480bb2e-c7e6-458c-9568-3cc994cadf32 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.076131 Aug 23 17:59:29.845213 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1119/2250] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:29 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:30.145747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c6b3dc3f-03c6-4cb3-b3fc-537b41f41ccd tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Calling method '.version_select at 0x7f27ec8c1790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:30.302943 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c6b3dc3f-03c6-4cb3-b3fc-537b41f41ccd tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/9bbc64be59b148e09060178fdb68f25a" status: 200 len: 371 microversion: 2.1 time: 0.542275 Aug 23 17:59:30.304748 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1132/2251] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Aug 23 17:59:29 2022] GET /compute/v2.1/os-quota-sets/9bbc64be59b148e09060178fdb68f25a => generated 371 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:30.320083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8045de33-ee64-4bc6-b192-742d47506ada tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec38ca60>, body: {"quota_set": {"ram": "5120"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:30.547973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8045de33-ee64-4bc6-b192-742d47506ada tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:30.551740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8045de33-ee64-4bc6-b192-742d47506ada tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:30.552404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8045de33-ee64-4bc6-b192-742d47506ada tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:30.553779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8045de33-ee64-4bc6-b192-742d47506ada tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:30.554237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8045de33-ee64-4bc6-b192-742d47506ada tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:30.554710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8045de33-ee64-4bc6-b192-742d47506ada tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:30.557380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a2cba16c-634f-444f-86cf-963102bbb441 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:30.558246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a2cba16c-634f-444f-86cf-963102bbb441 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:30.569584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2cba16c-634f-444f-86cf-963102bbb441 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:30.572905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2cba16c-634f-444f-86cf-963102bbb441 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:30.573814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2cba16c-634f-444f-86cf-963102bbb441 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:30.574821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2cba16c-634f-444f-86cf-963102bbb441 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:30.575695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2cba16c-634f-444f-86cf-963102bbb441 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:30.576614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2cba16c-634f-444f-86cf-963102bbb441 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:30.751454 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8045de33-ee64-4bc6-b192-742d47506ada tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/9bbc64be59b148e09060178fdb68f25a" status: 200 len: 328 microversion: 2.1 time: 0.438106 Aug 23 17:59:30.753234 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1120/2252] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 17:59:30 2022] PUT /compute/v2.1/os-quota-sets/9bbc64be59b148e09060178fdb68f25a => generated 328 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:30.776329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-15ce24af-8c3f-4653-adef-4539e3166cf8 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:30.812812 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-15ce24af-8c3f-4653-adef-4539e3166cf8 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-quota-sets/9bbc64be59b148e09060178fdb68f25a" status: 202 len: 0 microversion: 2.1 time: 0.050752 Aug 23 17:59:30.813575 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1121/2253] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 17:59:30 2022] DELETE /compute/v2.1/os-quota-sets/9bbc64be59b148e09060178fdb68f25a => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 17:59:30.825199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c1ebfc33-dd24-4768-a079-a93fa003e120 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Calling method '.version_select at 0x7f27ec80d310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:31.055338 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c1ebfc33-dd24-4768-a079-a93fa003e120 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/9bbc64be59b148e09060178fdb68f25a" status: 200 len: 371 microversion: 2.1 time: 0.236037 Aug 23 17:59:31.060538 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1122/2254] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Aug 23 17:59:30 2022] GET /compute/v2.1/os-quota-sets/9bbc64be59b148e09060178fdb68f25a => generated 371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:59:31.065737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e16122b6-9b9e-4de6-943a-a3263c3067c7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec7b9790>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:31.241928 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e16122b6-9b9e-4de6-943a-a3263c3067c7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.179113 Aug 23 17:59:31.247036 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1123/2255] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:31 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:31.377249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6b62ef8d-fe6b-4eda-af92-a13848418439 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Calling method '.version_select at 0x7f27f1b2f310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:31.804207 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6b62ef8d-fe6b-4eda-af92-a13848418439 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/fca57d8ee4ef4c9dbb14a511f50c3d19/defaults" status: 200 len: 371 microversion: 2.1 time: 0.433141 Aug 23 17:59:31.806209 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1124/2256] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 17:59:31 2022] GET /compute/v2.1/os-quota-sets/fca57d8ee4ef4c9dbb14a511f50c3d19/defaults => generated 371 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:32.081505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a2cba16c-634f-444f-86cf-963102bbb441 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:32.098930 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a2cba16c-634f-444f-86cf-963102bbb441 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 1.560410 Aug 23 17:59:32.099863 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1133/2257] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:30 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 1562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:32.261137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-962e2489-fd9d-4131-bf79-7350e44e2df0 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec845c10>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:32.360804 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-962e2489-fd9d-4131-bf79-7350e44e2df0 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.104993 Aug 23 17:59:32.361398 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1125/2258] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:32 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:32.383499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0e7b5d19-2360-4273-87c6-ebd6511c04b2 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec8c1dc0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:32.929798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:32.944328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7b5d19-2360-4273-87c6-ebd6511c04b2 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:32.945015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7b5d19-2360-4273-87c6-ebd6511c04b2 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:32.945494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7b5d19-2360-4273-87c6-ebd6511c04b2 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:32.946210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7b5d19-2360-4273-87c6-ebd6511c04b2 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:32.950122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7b5d19-2360-4273-87c6-ebd6511c04b2 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:32.950637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7b5d19-2360-4273-87c6-ebd6511c04b2 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:33.126730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-37be6681-2f2d-422e-8abd-ee616a3869b8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:33.127942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-37be6681-2f2d-422e-8abd-ee616a3869b8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:33.142798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37be6681-2f2d-422e-8abd-ee616a3869b8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:33.145507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37be6681-2f2d-422e-8abd-ee616a3869b8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:33.146126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37be6681-2f2d-422e-8abd-ee616a3869b8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:33.148502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37be6681-2f2d-422e-8abd-ee616a3869b8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:33.150801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37be6681-2f2d-422e-8abd-ee616a3869b8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:33.151467 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0e7b5d19-2360-4273-87c6-ebd6511c04b2 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/d31b968d45e9422f953308c33c4b2c9c" status: 200 len: 328 microversion: 2.1 time: 0.787678 Aug 23 17:59:33.152421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37be6681-2f2d-422e-8abd-ee616a3869b8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:33.159270 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1134/2259] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 17:59:32 2022] PUT /compute/v2.1/os-quota-sets/d31b968d45e9422f953308c33c4b2c9c => generated 328 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:33.171650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-967761bb-1a88-446d-b0b3-2ed9a1f0694f tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Calling method '.version_select at 0x7f27ecadd790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:33.312551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-967761bb-1a88-446d-b0b3-2ed9a1f0694f tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:33.319904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-967761bb-1a88-446d-b0b3-2ed9a1f0694f tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:33.320396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-967761bb-1a88-446d-b0b3-2ed9a1f0694f tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:33.321254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-967761bb-1a88-446d-b0b3-2ed9a1f0694f tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:33.321872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-967761bb-1a88-446d-b0b3-2ed9a1f0694f tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:33.322203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-967761bb-1a88-446d-b0b3-2ed9a1f0694f tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:33.371797 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-967761bb-1a88-446d-b0b3-2ed9a1f0694f tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/d31b968d45e9422f953308c33c4b2c9c/detail" status: 200 len: 916 microversion: 2.1 time: 0.203827 Aug 23 17:59:33.383595 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1135/2260] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 17:59:33 2022] GET /compute/v2.1/os-quota-sets/d31b968d45e9422f953308c33c4b2c9c/detail => generated 916 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:33.388479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e557dce5-8287-4e03-866b-f9eb67a63ad2 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec8f50d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:33.487232 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e557dce5-8287-4e03-866b-f9eb67a63ad2 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.102484 Aug 23 17:59:33.487811 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1136/2261] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:33 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:33.782414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Action: 'update', calling method: .version_select at 0x7f27eca118b0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:33.966339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:33.966910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:33.967359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:33.968121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:33.968666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:33.978488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:34.096117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:34.096807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:34.097521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:34.098636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:34.099569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:34.100087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:34.164712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-37be6681-2f2d-422e-8abd-ee616a3869b8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:34.197831 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-37be6681-2f2d-422e-8abd-ee616a3869b8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 1.069645 Aug 23 17:59:34.200224 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1126/2262] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:33 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:34.273554 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-16a20e13-27d7-403b-8831-cbe60befe646 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/d31b968d45e9422f953308c33c4b2c9c?user_id=c6a3f80cdc1542ec82e0448d0aa129e6" status: 200 len: 328 microversion: 2.1 time: 0.496789 Aug 23 17:59:34.283306 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1137/2263] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 17:59:33 2022] PUT /compute/v2.1/os-quota-sets/d31b968d45e9422f953308c33c4b2c9c?user_id=c6a3f80cdc1542ec82e0448d0aa129e6 => generated 328 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:59:34.290137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-047fb91a-c696-4fe0-b5b8-8280b72d974e tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Calling method '.version_select at 0x7f27ec750af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:34.474176 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-047fb91a-c696-4fe0-b5b8-8280b72d974e tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/d31b968d45e9422f953308c33c4b2c9c?user_id=c6a3f80cdc1542ec82e0448d0aa129e6" status: 200 len: 370 microversion: 2.1 time: 0.188357 Aug 23 17:59:34.478170 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1127/2264] 10.222.0.61 () {58 vars in 1323 bytes} [Tue Aug 23 17:59:34 2022] GET /compute/v2.1/os-quota-sets/d31b968d45e9422f953308c33c4b2c9c?user_id=c6a3f80cdc1542ec82e0448d0aa129e6 => generated 370 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:34.504550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b06aac31-96a2-49ff-ad57-b8401c8090aa tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec933d30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:34.597213 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b06aac31-96a2-49ff-ad57-b8401c8090aa tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.097752 Aug 23 17:59:34.599160 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1138/2265] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:34 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:35.196459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-801329729", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "18890100-9652-4122-9a4a-c466e7188bca"}], "block_device_mapping_v2": [{"uuid": "e8820ad8-37f3-4779-abd3-abd478a7d7fa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:35.228787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-30c283f9-51bf-40ae-a4f8-92a685404774 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:35.229636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-30c283f9-51bf-40ae-a4f8-92a685404774 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:35.249265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30c283f9-51bf-40ae-a4f8-92a685404774 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:35.259706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30c283f9-51bf-40ae-a4f8-92a685404774 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:35.260504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30c283f9-51bf-40ae-a4f8-92a685404774 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:35.267533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30c283f9-51bf-40ae-a4f8-92a685404774 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:35.269404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30c283f9-51bf-40ae-a4f8-92a685404774 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:35.270064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30c283f9-51bf-40ae-a4f8-92a685404774 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:35.396634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] validate_networks() for [('18890100-9652-4122-9a4a-c466e7188bca', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:59:35.875753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-30c283f9-51bf-40ae-a4f8-92a685404774 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:35.902701 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-30c283f9-51bf-40ae-a4f8-92a685404774 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 0.674703 Aug 23 17:59:35.910444 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1139/2266] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:35 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:35.932806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7c958919-ac25-4100-aa82-4140b1f365e8 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Calling method '.version_select at 0x7f27ecae08b0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:36.500309 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7c958919-ac25-4100-aa82-4140b1f365e8 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/fca57d8ee4ef4c9dbb14a511f50c3d19/defaults" status: 200 len: 371 microversion: 2.1 time: 0.585130 Aug 23 17:59:36.500902 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1140/2267] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 17:59:35 2022] GET /compute/v2.1/os-quota-sets/fca57d8ee4ef4c9dbb14a511f50c3d19/defaults => generated 371 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:36.653943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1809469253", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "bd6bcc31-356e-406f-85ed-9a6dbf64ea38"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:36.797049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] validate_networks() for [('bd6bcc31-356e-406f-85ed-9a6dbf64ea38', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:59:37.425103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:59:37.426189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:59:37.426883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:59:37.427510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:59:37.428143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:59:37.449115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:37.449901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:37.450599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:37.451552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:37.452206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:37.452824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:37.494532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Getting quotas for project a847d523b7944595aa39244f15b37665. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:59:37.500814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Getting quotas for user bb8758f075834ca59962ab82f042ec34 and project a847d523b7944595aa39244f15b37665. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:59:37.643353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:59:37.645930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e8820ad8-37f3-4779-abd3-abd478a7d7fa',volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:59:37.975840 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fdc06a71-00f3-4678-8b49-113eb7a73430 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.792923 Aug 23 17:59:37.984772 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1128/2268] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 17:59:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 2804 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 17:59:37.998705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-95208032-32e9-4aa1-a77a-e82aaca0369f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec7f5790>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:38.122040 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-95208032-32e9-4aa1-a77a-e82aaca0369f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.132921 Aug 23 17:59:38.122985 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1129/2269] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:37 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:38.128638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3d396b50-8c35-4465-a2d9-7e8b0ac14aef req-cabbd49c-41f4-44e5-9145-98362e9a49a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017fdc38-466a-4461-aa24-c16b9c7d96ab", "name": "network-vif-unplugged", "status": "completed", "tag": "d386fc31-0829-4584-9e38-6de5ab421b8f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:38.169198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3d396b50-8c35-4465-a2d9-7e8b0ac14aef req-cabbd49c-41f4-44e5-9145-98362e9a49a6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:38.169960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3d396b50-8c35-4465-a2d9-7e8b0ac14aef req-cabbd49c-41f4-44e5-9145-98362e9a49a6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:38.172023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3d396b50-8c35-4465-a2d9-7e8b0ac14aef req-cabbd49c-41f4-44e5-9145-98362e9a49a6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:38.199646 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3d396b50-8c35-4465-a2d9-7e8b0ac14aef req-cabbd49c-41f4-44e5-9145-98362e9a49a6 service nova] Creating event network-vif-unplugged:d386fc31-0829-4584-9e38-6de5ab421b8f for instance 017fdc38-466a-4461-aa24-c16b9c7d96ab on n-h1-850468-16 Aug 23 17:59:38.218915 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3d396b50-8c35-4465-a2d9-7e8b0ac14aef req-cabbd49c-41f4-44e5-9145-98362e9a49a6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.093631 Aug 23 17:59:38.219791 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1130/2270] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:38.231503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-200418cc-1b11-413a-b347-a4ff581a4765 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec819280>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:38.819442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-200418cc-1b11-413a-b347-a4ff581a4765 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:38.822478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-200418cc-1b11-413a-b347-a4ff581a4765 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:38.825698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-200418cc-1b11-413a-b347-a4ff581a4765 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:38.826567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-200418cc-1b11-413a-b347-a4ff581a4765 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:38.827206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-200418cc-1b11-413a-b347-a4ff581a4765 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:38.827814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-200418cc-1b11-413a-b347-a4ff581a4765 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:38.984543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:59:38.987575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:59:38.990280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:59:38.992590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:59:38.993243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:59:39.016818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:39.017592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:39.018480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:39.019769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:39.027422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:39.028847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:39.102016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Getting quotas for project 0c1067637ced47dab01d19a65bfc3dd7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:59:39.127072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Getting quotas for user 78a1cc2772e846e0ac3ca0324ab3cee3 and project 0c1067637ced47dab01d19a65bfc3dd7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:59:39.237954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:59:39.245009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:59:39.357218 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-200418cc-1b11-413a-b347-a4ff581a4765 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/fca57d8ee4ef4c9dbb14a511f50c3d19" status: 200 len: 329 microversion: 2.1 time: 1.133371 Aug 23 17:59:39.358483 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1131/2271] 10.222.0.61 () {60 vars in 1263 bytes} [Tue Aug 23 17:59:38 2022] PUT /compute/v2.1/os-quota-sets/fca57d8ee4ef4c9dbb14a511f50c3d19 => generated 329 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:39.368419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8bf6db19-6e4c-4fa9-9fdb-77e0c0e0c35f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:39.371968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8bf6db19-6e4c-4fa9-9fdb-77e0c0e0c35f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:39.387892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bf6db19-6e4c-4fa9-9fdb-77e0c0e0c35f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:39.388735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bf6db19-6e4c-4fa9-9fdb-77e0c0e0c35f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:39.389736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bf6db19-6e4c-4fa9-9fdb-77e0c0e0c35f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:39.391143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bf6db19-6e4c-4fa9-9fdb-77e0c0e0c35f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:39.394032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bf6db19-6e4c-4fa9-9fdb-77e0c0e0c35f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:39.394783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bf6db19-6e4c-4fa9-9fdb-77e0c0e0c35f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:39.456769 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b3d636cf-24fb-4ca3-9d99-bdbd3f106c50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.935807 Aug 23 17:59:39.458937 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1141/2272] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:59:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2957 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:59:39.494231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f7008eb2-3d8a-4354-a35d-59002c34b743 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:39.495363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f7008eb2-3d8a-4354-a35d-59002c34b743 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:39.525616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7008eb2-3d8a-4354-a35d-59002c34b743 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:39.526109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7008eb2-3d8a-4354-a35d-59002c34b743 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:39.530060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7008eb2-3d8a-4354-a35d-59002c34b743 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:39.538203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7008eb2-3d8a-4354-a35d-59002c34b743 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:39.539160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7008eb2-3d8a-4354-a35d-59002c34b743 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:39.539650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7008eb2-3d8a-4354-a35d-59002c34b743 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:40.343428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8bf6db19-6e4c-4fa9-9fdb-77e0c0e0c35f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:40.363497 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8bf6db19-6e4c-4fa9-9fdb-77e0c0e0c35f tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 0.995702 Aug 23 17:59:40.364329 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1132/2273] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:39 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:40.377046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c42c0aa-2fca-4bb2-afd0-d3ff195f0baf tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec7b9af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:40.505112 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c42c0aa-2fca-4bb2-afd0-d3ff195f0baf tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.138446 Aug 23 17:59:40.505768 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1133/2274] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:40 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:40.521170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d74f7beb-db2a-4fc8-b309-bb04da535514 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec63c4c0>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:40.652680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f7008eb2-3d8a-4354-a35d-59002c34b743 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:40.685575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f7008eb2-3d8a-4354-a35d-59002c34b743 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:40.690309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f7008eb2-3d8a-4354-a35d-59002c34b743 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:40.691868 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f7008eb2-3d8a-4354-a35d-59002c34b743 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1176 microversion: 2.25 time: 1.227506 Aug 23 17:59:40.694270 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1142/2275] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:39 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1176 bytes in 1235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:40.702394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e0bf0c68-5922-4e3b-b1e9-1f7269550eed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:40.709026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e0bf0c68-5922-4e3b-b1e9-1f7269550eed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:40.920383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e0bf0c68-5922-4e3b-b1e9-1f7269550eed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:40.936471 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e0bf0c68-5922-4e3b-b1e9-1f7269550eed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1208 microversion: 2.1 time: 0.236278 Aug 23 17:59:40.939756 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1143/2276] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:40 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1208 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:40.958522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b3d48f71-d477-458c-8ecf-da6aa62a484e req-d1e47e19-35e1-4793-869f-0a8e0a711dfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "017fdc38-466a-4461-aa24-c16b9c7d96ab", "tag": "d386fc31-0829-4584-9e38-6de5ab421b8f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:41.004902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b3d48f71-d477-458c-8ecf-da6aa62a484e req-d1e47e19-35e1-4793-869f-0a8e0a711dfc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:41.008835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b3d48f71-d477-458c-8ecf-da6aa62a484e req-d1e47e19-35e1-4793-869f-0a8e0a711dfc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:41.011842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b3d48f71-d477-458c-8ecf-da6aa62a484e req-d1e47e19-35e1-4793-869f-0a8e0a711dfc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:41.069241 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b3d48f71-d477-458c-8ecf-da6aa62a484e req-d1e47e19-35e1-4793-869f-0a8e0a711dfc service nova] Creating event network-changed:d386fc31-0829-4584-9e38-6de5ab421b8f for instance 017fdc38-466a-4461-aa24-c16b9c7d96ab on n-h1-850468-16 Aug 23 17:59:41.085240 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b3d48f71-d477-458c-8ecf-da6aa62a484e req-d1e47e19-35e1-4793-869f-0a8e0a711dfc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139903 Aug 23 17:59:41.088464 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1144/2277] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:41.363808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d74f7beb-db2a-4fc8-b309-bb04da535514 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:41.367543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d74f7beb-db2a-4fc8-b309-bb04da535514 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:41.368450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d74f7beb-db2a-4fc8-b309-bb04da535514 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:41.372602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d74f7beb-db2a-4fc8-b309-bb04da535514 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:41.376107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d74f7beb-db2a-4fc8-b309-bb04da535514 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:41.407048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-135c9cd8-62a9-4b71-920b-7410a0233cd6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:41.411698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-135c9cd8-62a9-4b71-920b-7410a0233cd6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:41.413410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d74f7beb-db2a-4fc8-b309-bb04da535514 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:41.452539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-135c9cd8-62a9-4b71-920b-7410a0233cd6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:41.456677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-135c9cd8-62a9-4b71-920b-7410a0233cd6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:41.461336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-135c9cd8-62a9-4b71-920b-7410a0233cd6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:41.467290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-135c9cd8-62a9-4b71-920b-7410a0233cd6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:41.468948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-135c9cd8-62a9-4b71-920b-7410a0233cd6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:41.471649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-135c9cd8-62a9-4b71-920b-7410a0233cd6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:41.568342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=18,nova_api:DELETE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:42.319425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-135c9cd8-62a9-4b71-920b-7410a0233cd6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:42.332062 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-135c9cd8-62a9-4b71-920b-7410a0233cd6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 0.947649 Aug 23 17:59:42.337238 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1145/2278] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:41 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:42.338799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-135c9cd8-62a9-4b71-920b-7410a0233cd6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:42.341892 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-135c9cd8-62a9-4b71-920b-7410a0233cd6 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.003523 Aug 23 17:59:42.344486 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1146/2279] 10.222.0.61 () {56 vars in 886 bytes} [Tue Aug 23 17:59:42 2022] GET /compute/ => generated 377 bytes in 6 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 23 17:59:42.359537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d18864fa-4b7d-4308-9edc-d766c36327f5 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec891940>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:42.427214 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d74f7beb-db2a-4fc8-b309-bb04da535514 tempest-QuotasAdminTestJSON-1577908624 tempest-QuotasAdminTestJSON-1577908624-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/fca57d8ee4ef4c9dbb14a511f50c3d19" status: 200 len: 329 microversion: 2.1 time: 1.919907 Aug 23 17:59:42.428182 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1134/2280] 10.222.0.61 () {60 vars in 1263 bytes} [Tue Aug 23 17:59:40 2022] PUT /compute/v2.1/os-quota-sets/fca57d8ee4ef4c9dbb14a511f50c3d19 => generated 329 bytes in 1922 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:42.437784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:42.438183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:42.483709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:42.483948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:42.487069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:42.494502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:42.495907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:42.497507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:42.524554 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d18864fa-4b7d-4308-9edc-d766c36327f5 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.178652 Aug 23 17:59:42.525736 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1147/2281] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:42 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:42.547667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d428e49c-6286-4698-9b57-218ff84a3016 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:42.549811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d428e49c-6286-4698-9b57-218ff84a3016 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:42.603044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d428e49c-6286-4698-9b57-218ff84a3016 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:42.603750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d428e49c-6286-4698-9b57-218ff84a3016 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:42.604346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d428e49c-6286-4698-9b57-218ff84a3016 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:42.605228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d428e49c-6286-4698-9b57-218ff84a3016 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:42.605842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d428e49c-6286-4698-9b57-218ff84a3016 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:42.606411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d428e49c-6286-4698-9b57-218ff84a3016 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:42.891789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:42.927503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:42.933746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:42.937137 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1250 microversion: 2.25 time: 0.506241 Aug 23 17:59:42.941634 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1135/2282] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:42 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1250 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:42.944117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:42.947779 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.003876 Aug 23 17:59:42.950068 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1136/2283] 10.222.0.61 () {54 vars in 1035 bytes} [Tue Aug 23 17:59:42 2022] GET /compute/v2/ => generated 379 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Aug 23 17:59:42.957488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:42.964361 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.007182 Aug 23 17:59:42.981579 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1137/2284] 10.222.0.61 () {54 vars in 1041 bytes} [Tue Aug 23 17:59:42 2022] GET /compute/v2.1/ => generated 388 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:42.993582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:42.995314 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8258cab-fb7e-41b9-ad79-ea9a1e257efc tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.005235 Aug 23 17:59:42.996289 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1138/2285] 10.222.0.61 () {56 vars in 886 bytes} [Tue Aug 23 17:59:42 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 23 17:59:43.336673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d428e49c-6286-4698-9b57-218ff84a3016 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:43.358938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c9b9235f-70d7-4754-82f8-ebf698e763a1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:43.359917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c9b9235f-70d7-4754-82f8-ebf698e763a1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:43.365298 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d428e49c-6286-4698-9b57-218ff84a3016 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1260 microversion: 2.1 time: 0.837158 Aug 23 17:59:43.368762 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1148/2286] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:42 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1260 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:43.379266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9b9235f-70d7-4754-82f8-ebf698e763a1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:43.380029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9b9235f-70d7-4754-82f8-ebf698e763a1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:43.380478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9b9235f-70d7-4754-82f8-ebf698e763a1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:43.381987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9b9235f-70d7-4754-82f8-ebf698e763a1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:43.390474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9b9235f-70d7-4754-82f8-ebf698e763a1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:43.397558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9b9235f-70d7-4754-82f8-ebf698e763a1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:43.542605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-756001d9-33e6-4989-8c57-3bb3fbdb51a2 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecb250d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:43.677413 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-756001d9-33e6-4989-8c57-3bb3fbdb51a2 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.140934 Aug 23 17:59:43.693207 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1149/2287] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:43 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:43.965788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e5be1eb8-6e2e-45ef-b022-68e643fa3d97 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:43.966533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e5be1eb8-6e2e-45ef-b022-68e643fa3d97 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:43.978498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5be1eb8-6e2e-45ef-b022-68e643fa3d97 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:43.981266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5be1eb8-6e2e-45ef-b022-68e643fa3d97 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:43.984125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5be1eb8-6e2e-45ef-b022-68e643fa3d97 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:43.986938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5be1eb8-6e2e-45ef-b022-68e643fa3d97 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:43.987568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5be1eb8-6e2e-45ef-b022-68e643fa3d97 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:43.988177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5be1eb8-6e2e-45ef-b022-68e643fa3d97 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:44.540776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c9b9235f-70d7-4754-82f8-ebf698e763a1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:44.566443 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c9b9235f-70d7-4754-82f8-ebf698e763a1 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 1.202900 Aug 23 17:59:44.568732 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1139/2288] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:43 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:44.589352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dc006910-3346-4445-b81c-08604d5e6cf2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:44.591655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc006910-3346-4445-b81c-08604d5e6cf2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:44.620697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc006910-3346-4445-b81c-08604d5e6cf2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:44.624063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc006910-3346-4445-b81c-08604d5e6cf2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:44.625576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc006910-3346-4445-b81c-08604d5e6cf2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:44.636183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc006910-3346-4445-b81c-08604d5e6cf2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:44.642772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc006910-3346-4445-b81c-08604d5e6cf2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:44.643615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc006910-3346-4445-b81c-08604d5e6cf2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:44.869784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5be1eb8-6e2e-45ef-b022-68e643fa3d97 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:44.890917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5be1eb8-6e2e-45ef-b022-68e643fa3d97 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:44.894433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5be1eb8-6e2e-45ef-b022-68e643fa3d97 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:44.914434 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e5be1eb8-6e2e-45ef-b022-68e643fa3d97 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1250 microversion: 2.25 time: 0.954000 Aug 23 17:59:44.918386 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1150/2289] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:43 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1250 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 17:59:44.940458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-653525f8-e2e1-44aa-9d87-1999dfaebd9c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecb255e0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:45.008572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dc006910-3346-4445-b81c-08604d5e6cf2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:45.019591 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dc006910-3346-4445-b81c-08604d5e6cf2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1266 microversion: 2.1 time: 0.448517 Aug 23 17:59:45.035090 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1140/2290] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:44 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1266 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:45.075447 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-653525f8-e2e1-44aa-9d87-1999dfaebd9c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.155316 Aug 23 17:59:45.078442 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1151/2291] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:44 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:45.591211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c1304a6e-0fba-4e4e-90df-b3450c361d71 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:45.591855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c1304a6e-0fba-4e4e-90df-b3450c361d71 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:45.612222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1304a6e-0fba-4e4e-90df-b3450c361d71 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:45.612747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1304a6e-0fba-4e4e-90df-b3450c361d71 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:45.613197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1304a6e-0fba-4e4e-90df-b3450c361d71 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:45.633861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1304a6e-0fba-4e4e-90df-b3450c361d71 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:45.634422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1304a6e-0fba-4e4e-90df-b3450c361d71 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:45.638753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1304a6e-0fba-4e4e-90df-b3450c361d71 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:45.942583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0e8209e2-da79-4797-93f0-56a6eaca44d4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:45.943201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0e8209e2-da79-4797-93f0-56a6eaca44d4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:45.955837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e8209e2-da79-4797-93f0-56a6eaca44d4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:45.960554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e8209e2-da79-4797-93f0-56a6eaca44d4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:45.962433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e8209e2-da79-4797-93f0-56a6eaca44d4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:45.964048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e8209e2-da79-4797-93f0-56a6eaca44d4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:45.964681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e8209e2-da79-4797-93f0-56a6eaca44d4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:45.968695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e8209e2-da79-4797-93f0-56a6eaca44d4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:45.983523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c1304a6e-0fba-4e4e-90df-b3450c361d71 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:45.996176 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c1304a6e-0fba-4e4e-90df-b3450c361d71 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 0.409700 Aug 23 17:59:45.996781 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1141/2292] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:45 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:46.056133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4ea844ba-2240-4bf0-8892-81f58d863644 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:46.056773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4ea844ba-2240-4bf0-8892-81f58d863644 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:46.063804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ea844ba-2240-4bf0-8892-81f58d863644 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:46.064297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ea844ba-2240-4bf0-8892-81f58d863644 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:46.064736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ea844ba-2240-4bf0-8892-81f58d863644 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:46.065447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ea844ba-2240-4bf0-8892-81f58d863644 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:46.081466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ea844ba-2240-4bf0-8892-81f58d863644 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:46.081933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ea844ba-2240-4bf0-8892-81f58d863644 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:46.347831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4ea844ba-2240-4bf0-8892-81f58d863644 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:46.370896 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4ea844ba-2240-4bf0-8892-81f58d863644 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1266 microversion: 2.1 time: 0.319266 Aug 23 17:59:46.384109 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1142/2293] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:46 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1266 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:46.395035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-621b244a-3424-453d-af3c-13b8f5ae58e0 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec7b9a60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:46.495133 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-621b244a-3424-453d-af3c-13b8f5ae58e0 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.109905 Aug 23 17:59:46.495617 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1143/2294] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:46 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:47.019530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6dfe5c13-e1a3-46e2-885f-1bbfbb7c6279 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:47.020151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6dfe5c13-e1a3-46e2-885f-1bbfbb7c6279 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:47.030197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dfe5c13-e1a3-46e2-885f-1bbfbb7c6279 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:47.030698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dfe5c13-e1a3-46e2-885f-1bbfbb7c6279 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:47.031144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dfe5c13-e1a3-46e2-885f-1bbfbb7c6279 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:47.031860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dfe5c13-e1a3-46e2-885f-1bbfbb7c6279 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:47.032318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dfe5c13-e1a3-46e2-885f-1bbfbb7c6279 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:47.032747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dfe5c13-e1a3-46e2-885f-1bbfbb7c6279 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:47.065398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:47.168543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0e8209e2-da79-4797-93f0-56a6eaca44d4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:47.178389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0e8209e2-da79-4797-93f0-56a6eaca44d4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:47.186196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0e8209e2-da79-4797-93f0-56a6eaca44d4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:47.187987 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0e8209e2-da79-4797-93f0-56a6eaca44d4 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1250 microversion: 2.25 time: 1.250536 Aug 23 17:59:47.192172 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1152/2295] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:45 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1250 bytes in 1255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:47.396489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e5858189-e645-43f0-9b35-bf2037136aaf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:47.397569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e5858189-e645-43f0-9b35-bf2037136aaf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:47.406292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5858189-e645-43f0-9b35-bf2037136aaf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:47.407170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5858189-e645-43f0-9b35-bf2037136aaf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:47.411483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5858189-e645-43f0-9b35-bf2037136aaf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:47.412548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5858189-e645-43f0-9b35-bf2037136aaf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:47.414109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5858189-e645-43f0-9b35-bf2037136aaf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:47.415917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5858189-e645-43f0-9b35-bf2037136aaf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:47.866639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6dfe5c13-e1a3-46e2-885f-1bbfbb7c6279 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:47.885150 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6dfe5c13-e1a3-46e2-885f-1bbfbb7c6279 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 0.870242 Aug 23 17:59:47.889798 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1144/2296] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:47 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:47.913977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6cf910ef-9c4b-49b1-a7a3-92d051055797 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec7b9ca0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:47.970872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5858189-e645-43f0-9b35-bf2037136aaf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:47.980266 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e5858189-e645-43f0-9b35-bf2037136aaf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1266 microversion: 2.1 time: 0.587502 Aug 23 17:59:47.986891 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1153/2297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:47 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1266 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:48.072677 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6cf910ef-9c4b-49b1-a7a3-92d051055797 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.180480 Aug 23 17:59:48.074010 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1145/2298] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:47 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:48.221179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-27b9ca38-3d6f-4724-b1ea-b1e393d2c155 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:48.227629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-27b9ca38-3d6f-4724-b1ea-b1e393d2c155 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:48.238059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27b9ca38-3d6f-4724-b1ea-b1e393d2c155 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:48.243214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27b9ca38-3d6f-4724-b1ea-b1e393d2c155 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:48.247179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27b9ca38-3d6f-4724-b1ea-b1e393d2c155 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:48.248235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27b9ca38-3d6f-4724-b1ea-b1e393d2c155 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:48.248922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27b9ca38-3d6f-4724-b1ea-b1e393d2c155 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:48.249570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27b9ca38-3d6f-4724-b1ea-b1e393d2c155 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:48.630669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-27b9ca38-3d6f-4724-b1ea-b1e393d2c155 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:48.653131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-27b9ca38-3d6f-4724-b1ea-b1e393d2c155 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:48.660515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-27b9ca38-3d6f-4724-b1ea-b1e393d2c155 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:48.671269 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-27b9ca38-3d6f-4724-b1ea-b1e393d2c155 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1250 microversion: 2.25 time: 0.449826 Aug 23 17:59:48.673666 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1154/2299] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:48 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1250 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:48.914996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d7e615e4-6902-405e-833e-e4dadb243da2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:48.917190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d7e615e4-6902-405e-833e-e4dadb243da2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:48.928029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e615e4-6902-405e-833e-e4dadb243da2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:48.930145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e615e4-6902-405e-833e-e4dadb243da2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:48.931414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e615e4-6902-405e-833e-e4dadb243da2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:48.934768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e615e4-6902-405e-833e-e4dadb243da2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:48.937894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e615e4-6902-405e-833e-e4dadb243da2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:48.938782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e615e4-6902-405e-833e-e4dadb243da2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:49.058298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=11 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:49.311118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8cb80b52-e995-4e4e-8d57-43b2bf9eeb6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'create', calling method: .version_select at 0x7f27ec80d700>, body: {"keypair": {"name": "tempest-keypair-1309354575", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAuI4lUmWLyA6Xc0M9JDKFa0YX7l67lIJGQse8BrDQs9hpBDfXtejCswkz8XX2tMORBXXcwvbVziPAoml21xFyW4Us2qT/s19WS1xBIv+BwztpHPz3TAJtuCIezTGXXwTA=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:49.333243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8cb80b52-e995-4e4e-8d57-43b2bf9eeb6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Getting quotas for project ed54655c5a6442d680ee1cb81021ddd2. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:59:49.343015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8cb80b52-e995-4e4e-8d57-43b2bf9eeb6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Getting quotas for user 11cb3b659afa416bb3371795600189fb and project ed54655c5a6442d680ee1cb81021ddd2. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:59:49.388598 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8cb80b52-e995-4e4e-8d57-43b2bf9eeb6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.594714 Aug 23 17:59:49.389837 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1146/2300] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 17:59:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 17:59:49.397950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a233775c-9398-432a-8b42-166b15fe3b84 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:49.399234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a233775c-9398-432a-8b42-166b15fe3b84 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:49.407593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a233775c-9398-432a-8b42-166b15fe3b84 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:49.408544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a233775c-9398-432a-8b42-166b15fe3b84 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:49.409246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a233775c-9398-432a-8b42-166b15fe3b84 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:49.410355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a233775c-9398-432a-8b42-166b15fe3b84 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:49.411049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a233775c-9398-432a-8b42-166b15fe3b84 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:49.411721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a233775c-9398-432a-8b42-166b15fe3b84 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:49.808579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a233775c-9398-432a-8b42-166b15fe3b84 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:49.821838 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a233775c-9398-432a-8b42-166b15fe3b84 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1266 microversion: 2.1 time: 0.428405 Aug 23 17:59:49.824503 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1147/2301] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:49 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1266 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:49.833105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-315fafa1-8f2d-4394-a568-7b84ace5f3b4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec620af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:49.923310 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-315fafa1-8f2d-4394-a568-7b84ace5f3b4 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.097317 Aug 23 17:59:49.924553 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1148/2302] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:49 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:49.932821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5fddee45-db1a-4bfc-88c7-bb78bab4a50d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:49.934515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5fddee45-db1a-4bfc-88c7-bb78bab4a50d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:49.949344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fddee45-db1a-4bfc-88c7-bb78bab4a50d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:49.950480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fddee45-db1a-4bfc-88c7-bb78bab4a50d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:49.951542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fddee45-db1a-4bfc-88c7-bb78bab4a50d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:49.952686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fddee45-db1a-4bfc-88c7-bb78bab4a50d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:49.953382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fddee45-db1a-4bfc-88c7-bb78bab4a50d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:49.954262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fddee45-db1a-4bfc-88c7-bb78bab4a50d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:50.588956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5fddee45-db1a-4bfc-88c7-bb78bab4a50d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:50.603401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5fddee45-db1a-4bfc-88c7-bb78bab4a50d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:50.606524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5fddee45-db1a-4bfc-88c7-bb78bab4a50d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:50.611464 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5fddee45-db1a-4bfc-88c7-bb78bab4a50d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1292 microversion: 2.25 time: 0.685499 Aug 23 17:59:50.612336 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1149/2303] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:49 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1292 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:50.844291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4a98d207-6440-49bb-85a8-6a4f27546425 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:50.845128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4a98d207-6440-49bb-85a8-6a4f27546425 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:50.855804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a98d207-6440-49bb-85a8-6a4f27546425 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:50.863389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a98d207-6440-49bb-85a8-6a4f27546425 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:50.870440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a98d207-6440-49bb-85a8-6a4f27546425 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:50.871498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a98d207-6440-49bb-85a8-6a4f27546425 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:50.872115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a98d207-6440-49bb-85a8-6a4f27546425 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:50.872695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a98d207-6440-49bb-85a8-6a4f27546425 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:50.895811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d7e615e4-6902-405e-833e-e4dadb243da2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:50.908708 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d7e615e4-6902-405e-833e-e4dadb243da2 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 1.999116 Aug 23 17:59:50.939466 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1155/2304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:48 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 2030 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:50.963582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b775f3f4-83b0-4202-9afc-c4f3a2f5cfd3 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecadd280>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:50.985276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=32 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:51.103703 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b775f3f4-83b0-4202-9afc-c4f3a2f5cfd3 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.162096 Aug 23 17:59:51.104576 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1156/2305] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:50 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:51.181266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4a98d207-6440-49bb-85a8-6a4f27546425 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:51.212155 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4a98d207-6440-49bb-85a8-6a4f27546425 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1266 microversion: 2.1 time: 0.372849 Aug 23 17:59:51.212747 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1150/2306] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:50 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1266 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:51.637475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-73136407-efa6-4275-9a7e-ea0f5746b98c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:51.638150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-73136407-efa6-4275-9a7e-ea0f5746b98c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:51.653482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73136407-efa6-4275-9a7e-ea0f5746b98c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:51.655107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73136407-efa6-4275-9a7e-ea0f5746b98c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:51.658176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73136407-efa6-4275-9a7e-ea0f5746b98c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:51.659324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73136407-efa6-4275-9a7e-ea0f5746b98c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:51.660013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73136407-efa6-4275-9a7e-ea0f5746b98c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:51.661253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-73136407-efa6-4275-9a7e-ea0f5746b98c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:51.954308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:51.961205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-549632bd-aa19-476e-83f3-e488942743e4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:51.962060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-549632bd-aa19-476e-83f3-e488942743e4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:51.982325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-549632bd-aa19-476e-83f3-e488942743e4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:51.986260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-549632bd-aa19-476e-83f3-e488942743e4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:51.986746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-549632bd-aa19-476e-83f3-e488942743e4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:51.987847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-549632bd-aa19-476e-83f3-e488942743e4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:51.988451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-549632bd-aa19-476e-83f3-e488942743e4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:52.001574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-549632bd-aa19-476e-83f3-e488942743e4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:52.182951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-73136407-efa6-4275-9a7e-ea0f5746b98c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:52.204166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-73136407-efa6-4275-9a7e-ea0f5746b98c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:52.212349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-73136407-efa6-4275-9a7e-ea0f5746b98c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:52.217290 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-73136407-efa6-4275-9a7e-ea0f5746b98c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1292 microversion: 2.25 time: 0.586665 Aug 23 17:59:52.220202 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1157/2307] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:51 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1292 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:52.236722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b7418a55-f117-4e8e-9f49-24d1dd4f1a5b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec86f4c0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:52.388285 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b7418a55-f117-4e8e-9f49-24d1dd4f1a5b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.166078 Aug 23 17:59:52.400373 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1158/2308] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:52 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:52.425773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d635f0f-6f44-482a-91b8-2ca9a14d8d92 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:52.427026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d635f0f-6f44-482a-91b8-2ca9a14d8d92 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:52.463642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d635f0f-6f44-482a-91b8-2ca9a14d8d92 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:52.471467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d635f0f-6f44-482a-91b8-2ca9a14d8d92 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:52.472382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d635f0f-6f44-482a-91b8-2ca9a14d8d92 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:52.480776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d635f0f-6f44-482a-91b8-2ca9a14d8d92 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:52.482681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d635f0f-6f44-482a-91b8-2ca9a14d8d92 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:52.485900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d635f0f-6f44-482a-91b8-2ca9a14d8d92 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:52.710062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-549632bd-aa19-476e-83f3-e488942743e4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:52.724706 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-549632bd-aa19-476e-83f3-e488942743e4 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 0.770774 Aug 23 17:59:52.743276 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1151/2309] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:51 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:53.246044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-60d82902-374a-4077-adec-c2c376547987 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:53.247433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-60d82902-374a-4077-adec-c2c376547987 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:53.276433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60d82902-374a-4077-adec-c2c376547987 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:53.276949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60d82902-374a-4077-adec-c2c376547987 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:53.284934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60d82902-374a-4077-adec-c2c376547987 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:53.289737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60d82902-374a-4077-adec-c2c376547987 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:53.289920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60d82902-374a-4077-adec-c2c376547987 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:53.290372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60d82902-374a-4077-adec-c2c376547987 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:53.954245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7d635f0f-6f44-482a-91b8-2ca9a14d8d92 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:53.957324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=84 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:53.969768 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d635f0f-6f44-482a-91b8-2ca9a14d8d92 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 1.565204 Aug 23 17:59:53.971371 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1159/2310] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:52 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:53.988718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0d705dd5-649f-4d93-9d28-e0694cd3a8b5 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecb5f550>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:54.093866 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0d705dd5-649f-4d93-9d28-e0694cd3a8b5 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1452 microversion: 2.1 time: 0.117983 Aug 23 17:59:54.095247 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1160/2311] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:53 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1452 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:54.108823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b6d9b6b0-5d2d-4200-be04-19c26a141a9d req-93ff7810-aeac-40b8-b06b-1a1cbfe2b59d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d71f4ec4-18cf-4eae-9e86-4f91f90810f5", "tag": "98910578-3769-44bc-8492-76aab610ddc3"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:54.134626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b6d9b6b0-5d2d-4200-be04-19c26a141a9d req-93ff7810-aeac-40b8-b06b-1a1cbfe2b59d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:54.135369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b6d9b6b0-5d2d-4200-be04-19c26a141a9d req-93ff7810-aeac-40b8-b06b-1a1cbfe2b59d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:54.136961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b6d9b6b0-5d2d-4200-be04-19c26a141a9d req-93ff7810-aeac-40b8-b06b-1a1cbfe2b59d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:54.176771 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b6d9b6b0-5d2d-4200-be04-19c26a141a9d req-93ff7810-aeac-40b8-b06b-1a1cbfe2b59d service nova] Creating event network-changed:98910578-3769-44bc-8492-76aab610ddc3 for instance d71f4ec4-18cf-4eae-9e86-4f91f90810f5 on n-h2-850468-16 Aug 23 17:59:54.202136 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b6d9b6b0-5d2d-4200-be04-19c26a141a9d req-93ff7810-aeac-40b8-b06b-1a1cbfe2b59d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101040 Aug 23 17:59:54.210815 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1161/2312] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:59:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:54.240341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1f207442-92fb-4b65-86ea-e529de875779 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:54.242218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1f207442-92fb-4b65-86ea-e529de875779 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:54.254026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f207442-92fb-4b65-86ea-e529de875779 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:54.261962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f207442-92fb-4b65-86ea-e529de875779 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:54.263001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f207442-92fb-4b65-86ea-e529de875779 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:54.264024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f207442-92fb-4b65-86ea-e529de875779 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:54.264712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f207442-92fb-4b65-86ea-e529de875779 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:54.265371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f207442-92fb-4b65-86ea-e529de875779 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:54.434944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-60d82902-374a-4077-adec-c2c376547987 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:54.468106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-60d82902-374a-4077-adec-c2c376547987 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:54.481671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-60d82902-374a-4077-adec-c2c376547987 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:54.483305 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-60d82902-374a-4077-adec-c2c376547987 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1292 microversion: 2.25 time: 1.241384 Aug 23 17:59:54.484518 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1152/2313] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:53 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1292 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:54.999701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f63eaf41-399a-4a13-929c-5c5161d9f28e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:55.006471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f63eaf41-399a-4a13-929c-5c5161d9f28e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:55.037927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f63eaf41-399a-4a13-929c-5c5161d9f28e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:55.045498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f63eaf41-399a-4a13-929c-5c5161d9f28e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:55.046084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f63eaf41-399a-4a13-929c-5c5161d9f28e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:55.063411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f63eaf41-399a-4a13-929c-5c5161d9f28e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:55.063981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f63eaf41-399a-4a13-929c-5c5161d9f28e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:55.064438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f63eaf41-399a-4a13-929c-5c5161d9f28e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:55.435143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1f207442-92fb-4b65-86ea-e529de875779 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:55.443883 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1f207442-92fb-4b65-86ea-e529de875779 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1391 microversion: 2.1 time: 1.231008 Aug 23 17:59:55.444470 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1162/2314] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:54 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1391 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:55.458202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0bae9d3d-94df-42aa-b758-a3f591888694 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27eca46b80>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:55.520414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f63eaf41-399a-4a13-929c-5c5161d9f28e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:55.544419 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f63eaf41-399a-4a13-929c-5c5161d9f28e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.548500 Aug 23 17:59:55.546071 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1153/2315] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:54 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:55.552146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-613756b1-f88c-421f-a1f6-a1b4abc1ade9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:55.553415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-613756b1-f88c-421f-a1f6-a1b4abc1ade9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:55.566579 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0bae9d3d-94df-42aa-b758-a3f591888694 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1461 microversion: 2.1 time: 0.116951 Aug 23 17:59:55.567343 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1163/2316] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:55 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1461 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:55.581113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-613756b1-f88c-421f-a1f6-a1b4abc1ade9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:55.584850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-613756b1-f88c-421f-a1f6-a1b4abc1ade9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:55.585964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-613756b1-f88c-421f-a1f6-a1b4abc1ade9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:55.587448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ff6b2cf-00ed-4af8-8e88-c6e2a0657acb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec891f70>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:55.592993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-613756b1-f88c-421f-a1f6-a1b4abc1ade9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:55.597808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-613756b1-f88c-421f-a1f6-a1b4abc1ade9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:55.598301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-613756b1-f88c-421f-a1f6-a1b4abc1ade9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:55.653051 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9ff6b2cf-00ed-4af8-8e88-c6e2a0657acb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 200 len: 1461 microversion: 2.1 time: 0.070625 Aug 23 17:59:55.659363 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1164/2317] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:55 2022] GET /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 1461 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:55.671642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d2c95cf0-d07a-4f77-b65d-aa5e854b4b30 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:55.672417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d2c95cf0-d07a-4f77-b65d-aa5e854b4b30 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:55.682068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2c95cf0-d07a-4f77-b65d-aa5e854b4b30 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:55.682742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2c95cf0-d07a-4f77-b65d-aa5e854b4b30 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:55.683429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2c95cf0-d07a-4f77-b65d-aa5e854b4b30 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:55.684916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2c95cf0-d07a-4f77-b65d-aa5e854b4b30 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:55.685704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2c95cf0-d07a-4f77-b65d-aa5e854b4b30 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:55.686567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2c95cf0-d07a-4f77-b65d-aa5e854b4b30 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:56.168777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d2c95cf0-d07a-4f77-b65d-aa5e854b4b30 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:56.177723 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d2c95cf0-d07a-4f77-b65d-aa5e854b4b30 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1481 microversion: 2.1 time: 0.511393 Aug 23 17:59:56.190755 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1165/2318] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:55 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1481 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:56.298873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-613756b1-f88c-421f-a1f6-a1b4abc1ade9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:56.310395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-613756b1-f88c-421f-a1f6-a1b4abc1ade9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:56.319236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-613756b1-f88c-421f-a1f6-a1b4abc1ade9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:56.323771 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-613756b1-f88c-421f-a1f6-a1b4abc1ade9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1292 microversion: 2.25 time: 0.773566 Aug 23 17:59:56.324629 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1154/2319] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:55 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1292 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:56.469596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e28a01d1-3e01-4e6f-ae68-3d89fee157ab tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:56.470942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e28a01d1-3e01-4e6f-ae68-3d89fee157ab tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:56.483965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e28a01d1-3e01-4e6f-ae68-3d89fee157ab tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:56.484797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e28a01d1-3e01-4e6f-ae68-3d89fee157ab tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:56.485443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e28a01d1-3e01-4e6f-ae68-3d89fee157ab tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:56.486507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e28a01d1-3e01-4e6f-ae68-3d89fee157ab tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:56.489121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e28a01d1-3e01-4e6f-ae68-3d89fee157ab tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:56.492146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e28a01d1-3e01-4e6f-ae68-3d89fee157ab tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:56.570739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-96682cef-c212-4922-b577-10e73bb4734f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:56.571598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-96682cef-c212-4922-b577-10e73bb4734f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:56.581905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=15,nova_api:UPDATE=14 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:56.584443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96682cef-c212-4922-b577-10e73bb4734f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:56.586262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96682cef-c212-4922-b577-10e73bb4734f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:56.588781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96682cef-c212-4922-b577-10e73bb4734f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:56.589825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96682cef-c212-4922-b577-10e73bb4734f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:56.592217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96682cef-c212-4922-b577-10e73bb4734f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:56.593130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96682cef-c212-4922-b577-10e73bb4734f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:57.018529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e28a01d1-3e01-4e6f-ae68-3d89fee157ab tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:57.029578 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e28a01d1-3e01-4e6f-ae68-3d89fee157ab tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1381 microversion: 2.1 time: 0.564600 Aug 23 17:59:57.030184 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1166/2320] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:56 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1381 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:57.199987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-96682cef-c212-4922-b577-10e73bb4734f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:57.221449 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-96682cef-c212-4922-b577-10e73bb4734f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.655900 Aug 23 17:59:57.241433 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1155/2321] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:56 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 17:59:57.263281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-435728fa-a166-4552-800a-30690796adb7 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '.version_select at 0x7f27ec8bce50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:57.270036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-435728fa-a166-4552-800a-30690796adb7 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:57.270748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-435728fa-a166-4552-800a-30690796adb7 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:57.275135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-435728fa-a166-4552-800a-30690796adb7 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:57.306302 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-435728fa-a166-4552-800a-30690796adb7 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 2732 microversion: 2.1 time: 0.063422 Aug 23 17:59:57.308813 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1156/2322] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 17:59:57 2022] GET /compute/v2.1/os-migrations => generated 2732 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:57.324109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e3e79f1a-9429-421c-94c9-6ead06c85010 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:57.324734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e3e79f1a-9429-421c-94c9-6ead06c85010 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:57.347857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3e79f1a-9429-421c-94c9-6ead06c85010 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:57.348449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3e79f1a-9429-421c-94c9-6ead06c85010 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:57.351377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3e79f1a-9429-421c-94c9-6ead06c85010 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:57.352433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3e79f1a-9429-421c-94c9-6ead06c85010 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:57.352906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3e79f1a-9429-421c-94c9-6ead06c85010 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:57.353331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3e79f1a-9429-421c-94c9-6ead06c85010 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:57.695071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5070c9ca-ea2a-4df4-9026-6b57bf788992 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec2644c0>, body: {"quota_set": {"ram": "5120"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:57.842616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5070c9ca-ea2a-4df4-9026-6b57bf788992 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:57.843024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5070c9ca-ea2a-4df4-9026-6b57bf788992 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:57.843459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5070c9ca-ea2a-4df4-9026-6b57bf788992 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:57.844298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5070c9ca-ea2a-4df4-9026-6b57bf788992 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:57.844757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5070c9ca-ea2a-4df4-9026-6b57bf788992 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:57.845171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5070c9ca-ea2a-4df4-9026-6b57bf788992 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:57.878323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:57.934714 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5070c9ca-ea2a-4df4-9026-6b57bf788992 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/bb97b995c22e4789925f3ebc4b52fa18" status: 200 len: 240 microversion: 2.36 time: 0.903382 Aug 23 17:59:57.935334 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1167/2323] 10.222.0.61 () {62 vars in 1303 bytes} [Tue Aug 23 17:59:57 2022] PUT /compute/v2.1/os-quota-sets/bb97b995c22e4789925f3ebc4b52fa18 => generated 240 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:59:57.938445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e3e79f1a-9429-421c-94c9-6ead06c85010 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:57.947011 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e3e79f1a-9429-421c-94c9-6ead06c85010 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1468 microversion: 2.1 time: 0.636977 Aug 23 17:59:57.947184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d471306d-8c21-4c27-b675-f73976fade85 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:57.947583 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1157/2324] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:57 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1468 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:57.948032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d471306d-8c21-4c27-b675-f73976fade85 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:57.952577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f75f8b0c-24fd-4561-9b85-1ab341a82f99 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:57.953375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f75f8b0c-24fd-4561-9b85-1ab341a82f99 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:57.957141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d471306d-8c21-4c27-b675-f73976fade85 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:57.957749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d471306d-8c21-4c27-b675-f73976fade85 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:57.959686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d471306d-8c21-4c27-b675-f73976fade85 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:57.960749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f75f8b0c-24fd-4561-9b85-1ab341a82f99 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:57.961552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f75f8b0c-24fd-4561-9b85-1ab341a82f99 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:57.962143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f75f8b0c-24fd-4561-9b85-1ab341a82f99 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:57.962745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d471306d-8c21-4c27-b675-f73976fade85 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:57.963189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f75f8b0c-24fd-4561-9b85-1ab341a82f99 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:57.963443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d471306d-8c21-4c27-b675-f73976fade85 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:57.963945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f75f8b0c-24fd-4561-9b85-1ab341a82f99 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:57.964058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d471306d-8c21-4c27-b675-f73976fade85 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:57.964624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f75f8b0c-24fd-4561-9b85-1ab341a82f99 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:58.207146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f75f8b0c-24fd-4561-9b85-1ab341a82f99 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:58.215235 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d471306d-8c21-4c27-b675-f73976fade85 tempest-LiveMigrationTest-1415023680 tempest-LiveMigrationTest-1415023680-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1534 microversion: 2.1 time: 0.272094 Aug 23 17:59:58.216337 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1168/2325] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:57 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1534 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:58.228375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-5c9e10f3-dba2-4f8d-a005-8e3344f7f3e6 req-1328b6a2-5141-4be5-af42-367ae57da0c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4b43649-db0d-42b6-a207-a8c75fc2a5a8", "tag": "34cfa4d3-ec0b-4ef7-a39c-ad4233274c24"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:58.230052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f75f8b0c-24fd-4561-9b85-1ab341a82f99 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:58.247755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f75f8b0c-24fd-4561-9b85-1ab341a82f99 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:58.251063 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f75f8b0c-24fd-4561-9b85-1ab341a82f99 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1292 microversion: 2.25 time: 0.302136 Aug 23 17:59:58.252888 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1158/2326] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:57 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1292 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 17:59:58.259134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5c9e10f3-dba2-4f8d-a005-8e3344f7f3e6 req-1328b6a2-5141-4be5-af42-367ae57da0c8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:58.259997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5c9e10f3-dba2-4f8d-a005-8e3344f7f3e6 req-1328b6a2-5141-4be5-af42-367ae57da0c8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:58.260806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5c9e10f3-dba2-4f8d-a005-8e3344f7f3e6 req-1328b6a2-5141-4be5-af42-367ae57da0c8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:58.264345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-189051916", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ab5199d4-2532-451f-9ad2-38d9c898fa71"}], "security_groups": [{"name": "tempest-securitygroup--503293715"}], "key_name": "tempest-keypair-1309354575", "user_data": "}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:58.285363 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5c9e10f3-dba2-4f8d-a005-8e3344f7f3e6 req-1328b6a2-5141-4be5-af42-367ae57da0c8 service nova] Creating event network-changed:34cfa4d3-ec0b-4ef7-a39c-ad4233274c24 for instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 on n-h2-850468-16 Aug 23 17:59:58.296190 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-5c9e10f3-dba2-4f8d-a005-8e3344f7f3e6 req-1328b6a2-5141-4be5-af42-367ae57da0c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076284 Aug 23 17:59:58.299512 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1169/2327] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 17:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 17:59:58.307076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd260ef8-b9a8-4ff7-ad61-a7099f8ed54c tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Calling method '.version_select at 0x7f27f1b38a60>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:58.426458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd260ef8-b9a8-4ff7-ad61-a7099f8ed54c tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:58.426982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd260ef8-b9a8-4ff7-ad61-a7099f8ed54c tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:58.428356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd260ef8-b9a8-4ff7-ad61-a7099f8ed54c tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:58.429227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd260ef8-b9a8-4ff7-ad61-a7099f8ed54c tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:58.429690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd260ef8-b9a8-4ff7-ad61-a7099f8ed54c tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:58.430518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd260ef8-b9a8-4ff7-ad61-a7099f8ed54c tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:58.451971 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd260ef8-b9a8-4ff7-ad61-a7099f8ed54c tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/bb97b995c22e4789925f3ebc4b52fa18/detail" status: 200 len: 672 microversion: 2.36 time: 0.150645 Aug 23 17:59:58.453994 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1170/2328] 10.222.0.61 () {60 vars in 1304 bytes} [Tue Aug 23 17:59:58 2022] GET /compute/v2.1/os-quota-sets/bb97b995c22e4789925f3ebc4b52fa18/detail => generated 672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:59:58.459391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d21aef4b-88b4-42c9-93c5-142179669f6d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1953994853"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:58.461780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d21aef4b-88b4-42c9-93c5-142179669f6d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:58.470513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d21aef4b-88b4-42c9-93c5-142179669f6d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:58.471218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d21aef4b-88b4-42c9-93c5-142179669f6d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:58.471830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d21aef4b-88b4-42c9-93c5-142179669f6d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:58.472706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d21aef4b-88b4-42c9-93c5-142179669f6d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:58.473305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d21aef4b-88b4-42c9-93c5-142179669f6d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:58.475145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d21aef4b-88b4-42c9-93c5-142179669f6d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:58.495128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] validate_networks() for [('ab5199d4-2532-451f-9ad2-38d9c898fa71', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 17:59:58.756157 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d21aef4b-88b4-42c9-93c5-142179669f6d tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "POST /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c/action" status: 202 len: 0 microversion: 2.1 time: 0.299840 Aug 23 17:59:58.762740 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1171/2329] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 17:59:58 2022] POST /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 17:59:58.768764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-87885151-5546-444f-8625-3b9db45182f5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:58.769383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-87885151-5546-444f-8625-3b9db45182f5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:58.778785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87885151-5546-444f-8625-3b9db45182f5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:58.778902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87885151-5546-444f-8625-3b9db45182f5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:58.779409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87885151-5546-444f-8625-3b9db45182f5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:58.780284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87885151-5546-444f-8625-3b9db45182f5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:58.780830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87885151-5546-444f-8625-3b9db45182f5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:58.781264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87885151-5546-444f-8625-3b9db45182f5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:58.812247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-87885151-5546-444f-8625-3b9db45182f5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 17:59:58.901335 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-87885151-5546-444f-8625-3b9db45182f5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "DELETE /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 204 len: 0 microversion: 2.1 time: 0.141918 Aug 23 17:59:58.902200 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1172/2330] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 17:59:58 2022] DELETE /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 17:59:58.908030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a3e192ea-282c-4899-b13a-22ee3eb0bcb4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:58.908835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a3e192ea-282c-4899-b13a-22ee3eb0bcb4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:58.915999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e192ea-282c-4899-b13a-22ee3eb0bcb4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:58.916495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e192ea-282c-4899-b13a-22ee3eb0bcb4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:58.916938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e192ea-282c-4899-b13a-22ee3eb0bcb4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:58.917689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e192ea-282c-4899-b13a-22ee3eb0bcb4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:58.918141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e192ea-282c-4899-b13a-22ee3eb0bcb4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:58.918615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e192ea-282c-4899-b13a-22ee3eb0bcb4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:59.083276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a3e192ea-282c-4899-b13a-22ee3eb0bcb4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:59.101104 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a3e192ea-282c-4899-b13a-22ee3eb0bcb4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.188919 Aug 23 17:59:59.101970 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1173/2331] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:58 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:59.106778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec9335e0>, body: {"quota_set": {"ram": "2048"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 17:59:59.353811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=92 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 17:59:59.418417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:59.419017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:59.419455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:59.420427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:59.421043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:59.421954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:59.461387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:59.461387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:59.461827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:59.462507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:59.463001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:59.463433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:59.536041 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93617d0b-c968-4669-b989-c95ce475da83 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/bb97b995c22e4789925f3ebc4b52fa18?user_id=58e396256f6344f89d36bf04ba226e11" status: 200 len: 240 microversion: 2.36 time: 0.432829 Aug 23 17:59:59.537728 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1174/2332] 10.222.0.61 () {62 vars in 1384 bytes} [Tue Aug 23 17:59:59 2022] PUT /compute/v2.1/os-quota-sets/bb97b995c22e4789925f3ebc4b52fa18?user_id=58e396256f6344f89d36bf04ba226e11 => generated 240 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 17:59:59.543694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fb864ca7-2062-47ee-8cd0-8d55f5fcbe9f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec9ec8b0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:59.623984 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fb864ca7-2062-47ee-8cd0-8d55f5fcbe9f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.085032 Aug 23 17:59:59.632602 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1175/2333] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 17:59:59 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:59.639498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9c354596-680a-4615-9bb1-f089a4ffa94c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:59.640125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9c354596-680a-4615-9bb1-f089a4ffa94c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:59.647238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c354596-680a-4615-9bb1-f089a4ffa94c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:59.647736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c354596-680a-4615-9bb1-f089a4ffa94c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:59.648174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c354596-680a-4615-9bb1-f089a4ffa94c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:59.648889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c354596-680a-4615-9bb1-f089a4ffa94c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:59.649813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c354596-680a-4615-9bb1-f089a4ffa94c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:59.650279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c354596-680a-4615-9bb1-f089a4ffa94c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:59.656046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 17:59:59.656478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 17:59:59.656963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 17:59:59.657380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 17:59:59.657799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 17:59:59.672552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:59.673200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:59.675079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:59.675997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:59.678120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:59.681030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:59.732735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Getting quotas for project ed54655c5a6442d680ee1cb81021ddd2. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 17:59:59.748018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Getting quotas for user 11cb3b659afa416bb3371795600189fb and project ed54655c5a6442d680ee1cb81021ddd2. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 17:59:59.765429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 17:59:59.767802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 17:59:59.841151 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8511fd87-19cd-4a9a-9669-de8340606c2a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.576687 Aug 23 17:59:59.857087 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1159/2334] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 17:59:58 2022] POST /compute/v2.1/servers => generated 408 bytes in 1601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 17:59:59.866579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef28a628-74e4-43c8-8c9d-2554c8cb4f96 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 17:59:59.867510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef28a628-74e4-43c8-8c9d-2554c8cb4f96 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 17:59:59.876246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef28a628-74e4-43c8-8c9d-2554c8cb4f96 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:59.876999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef28a628-74e4-43c8-8c9d-2554c8cb4f96 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:59.877598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef28a628-74e4-43c8-8c9d-2554c8cb4f96 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:59.878460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef28a628-74e4-43c8-8c9d-2554c8cb4f96 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 17:59:59.879151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef28a628-74e4-43c8-8c9d-2554c8cb4f96 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 17:59:59.879716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef28a628-74e4-43c8-8c9d-2554c8cb4f96 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 17:59:59.914679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9c354596-680a-4615-9bb1-f089a4ffa94c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 17:59:59.925842 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9c354596-680a-4615-9bb1-f089a4ffa94c tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1387 microversion: 2.1 time: 0.291570 Aug 23 17:59:59.930859 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1176/2335] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 17:59:59 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1387 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 17:59:59.940441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1f1ae675-770a-4685-a9fa-d48ce4a90e50 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] Calling method '.version_select at 0x7f27ed2ee1f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:00.207524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef28a628-74e4-43c8-8c9d-2554c8cb4f96 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:00.218451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef28a628-74e4-43c8-8c9d-2554c8cb4f96 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:00.220631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef28a628-74e4-43c8-8c9d-2554c8cb4f96 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:00.229836 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef28a628-74e4-43c8-8c9d-2554c8cb4f96 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1280 microversion: 2.25 time: 0.370295 Aug 23 18:00:00.242567 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1160/2336] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 17:59:59 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1280 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:00.242567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ea16d02-4788-4ae0-86d0-00dfb8169b01 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:00.242567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8ea16d02-4788-4ae0-86d0-00dfb8169b01 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:00.300889 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1f1ae675-770a-4685-a9fa-d48ce4a90e50 tempest-QuotasAdminTestV236-75234504 tempest-QuotasAdminTestV236-75234504-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/bb97b995c22e4789925f3ebc4b52fa18?user_id=58e396256f6344f89d36bf04ba226e11" status: 200 len: 282 microversion: 2.36 time: 0.368654 Aug 23 18:00:00.308411 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1177/2337] 10.222.0.61 () {60 vars in 1364 bytes} [Tue Aug 23 17:59:59 2022] GET /compute/v2.1/os-quota-sets/bb97b995c22e4789925f3ebc4b52fa18?user_id=58e396256f6344f89d36bf04ba226e11 => generated 282 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:00:00.313520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2b7a4f42-36a8-48fb-b8a1-38df425a1f6c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:00.314154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2b7a4f42-36a8-48fb-b8a1-38df425a1f6c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:00.321476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b7a4f42-36a8-48fb-b8a1-38df425a1f6c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:00.321975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b7a4f42-36a8-48fb-b8a1-38df425a1f6c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:00.322418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b7a4f42-36a8-48fb-b8a1-38df425a1f6c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:00.323183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b7a4f42-36a8-48fb-b8a1-38df425a1f6c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:00.323637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b7a4f42-36a8-48fb-b8a1-38df425a1f6c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:00.324464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b7a4f42-36a8-48fb-b8a1-38df425a1f6c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:00.378055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8ea16d02-4788-4ae0-86d0-00dfb8169b01 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:00.388753 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8ea16d02-4788-4ae0-86d0-00dfb8169b01 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1238 microversion: 2.1 time: 0.156473 Aug 23 18:00:00.389998 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1161/2338] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:00 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1238 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:00.553508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-cf2bc963-8edc-423b-ad72-abb70243d26b req-4d69ee21-4802-4507-80e1-7f220ec1e509 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1045a1-9999-4f13-82da-906bf1d0654c", "name": "network-vif-unplugged", "status": "completed", "tag": "52ee230c-5add-4aa2-9df1-e27f64a344ed"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:00.579070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cf2bc963-8edc-423b-ad72-abb70243d26b req-4d69ee21-4802-4507-80e1-7f220ec1e509 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:00.581405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cf2bc963-8edc-423b-ad72-abb70243d26b req-4d69ee21-4802-4507-80e1-7f220ec1e509 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:00.582339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cf2bc963-8edc-423b-ad72-abb70243d26b req-4d69ee21-4802-4507-80e1-7f220ec1e509 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:00.626505 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-cf2bc963-8edc-423b-ad72-abb70243d26b req-4d69ee21-4802-4507-80e1-7f220ec1e509 service nova] Creating event network-vif-unplugged:52ee230c-5add-4aa2-9df1-e27f64a344ed for instance ce1045a1-9999-4f13-82da-906bf1d0654c on n-h2-850468-16 Aug 23 18:00:00.661782 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-cf2bc963-8edc-423b-ad72-abb70243d26b req-4d69ee21-4802-4507-80e1-7f220ec1e509 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.112494 Aug 23 18:00:00.663077 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1162/2339] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:00:00.668327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7576d707-46ba-414a-ab88-a9768c5112e5 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec60b670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:00.750248 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7576d707-46ba-414a-ab88-a9768c5112e5 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.085949 Aug 23 18:00:00.751152 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1163/2340] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:00 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:00.769800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2b7a4f42-36a8-48fb-b8a1-38df425a1f6c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:00.779415 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2b7a4f42-36a8-48fb-b8a1-38df425a1f6c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.469839 Aug 23 18:00:00.780734 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1178/2341] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:00 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:00.963779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-96ae25e9-28b8-47fa-adea-ce4d7f0fb182 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:00.966156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-96ae25e9-28b8-47fa-adea-ce4d7f0fb182 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:00.984932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96ae25e9-28b8-47fa-adea-ce4d7f0fb182 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:00.985900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96ae25e9-28b8-47fa-adea-ce4d7f0fb182 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:00.988378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96ae25e9-28b8-47fa-adea-ce4d7f0fb182 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:00.991488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96ae25e9-28b8-47fa-adea-ce4d7f0fb182 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:00.992196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96ae25e9-28b8-47fa-adea-ce4d7f0fb182 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:00.993112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96ae25e9-28b8-47fa-adea-ce4d7f0fb182 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:01.203545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-96ae25e9-28b8-47fa-adea-ce4d7f0fb182 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:01.215901 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-96ae25e9-28b8-47fa-adea-ce4d7f0fb182 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1387 microversion: 2.1 time: 0.257980 Aug 23 18:00:01.216718 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1164/2342] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:00 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1387 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:01.254112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aac947c1-757e-48fb-97c3-5403d49f86cd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:01.255600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aac947c1-757e-48fb-97c3-5403d49f86cd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:01.264226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aac947c1-757e-48fb-97c3-5403d49f86cd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:01.265123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aac947c1-757e-48fb-97c3-5403d49f86cd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:01.265776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aac947c1-757e-48fb-97c3-5403d49f86cd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:01.266720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aac947c1-757e-48fb-97c3-5403d49f86cd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:01.267781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aac947c1-757e-48fb-97c3-5403d49f86cd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:01.268397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aac947c1-757e-48fb-97c3-5403d49f86cd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:01.413939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e6e00879-bdbd-4425-a953-3cd3ce870856 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:01.414665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e6e00879-bdbd-4425-a953-3cd3ce870856 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:01.423018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6e00879-bdbd-4425-a953-3cd3ce870856 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:01.430468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6e00879-bdbd-4425-a953-3cd3ce870856 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:01.430945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6e00879-bdbd-4425-a953-3cd3ce870856 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:01.431715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6e00879-bdbd-4425-a953-3cd3ce870856 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:01.432189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6e00879-bdbd-4425-a953-3cd3ce870856 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:01.432627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6e00879-bdbd-4425-a953-3cd3ce870856 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:01.547802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e6e00879-bdbd-4425-a953-3cd3ce870856 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:01.560934 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e6e00879-bdbd-4425-a953-3cd3ce870856 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1290 microversion: 2.1 time: 0.151432 Aug 23 18:00:01.564882 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1165/2343] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:01 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1290 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:01.766967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-12e28f46-0f41-4f62-b12f-d01ace1b734c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec80de50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:01.855211 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-12e28f46-0f41-4f62-b12f-d01ace1b734c tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.093684 Aug 23 18:00:01.855981 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1166/2344] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:01 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:01.861002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-034f9f34-c948-44b9-8292-27e9f19cd1e3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:01.861687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-034f9f34-c948-44b9-8292-27e9f19cd1e3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:01.886025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-034f9f34-c948-44b9-8292-27e9f19cd1e3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:01.886532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-034f9f34-c948-44b9-8292-27e9f19cd1e3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:01.887004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-034f9f34-c948-44b9-8292-27e9f19cd1e3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:01.887722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-034f9f34-c948-44b9-8292-27e9f19cd1e3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:01.888174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-034f9f34-c948-44b9-8292-27e9f19cd1e3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:01.888593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-034f9f34-c948-44b9-8292-27e9f19cd1e3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:02.133940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aac947c1-757e-48fb-97c3-5403d49f86cd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:02.147690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aac947c1-757e-48fb-97c3-5403d49f86cd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:02.149899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aac947c1-757e-48fb-97c3-5403d49f86cd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:02.151139 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aac947c1-757e-48fb-97c3-5403d49f86cd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1280 microversion: 2.25 time: 0.901544 Aug 23 18:00:02.164237 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1179/2345] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:01 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1280 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:02.198528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-034f9f34-c948-44b9-8292-27e9f19cd1e3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:02.208402 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-034f9f34-c948-44b9-8292-27e9f19cd1e3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.351007 Aug 23 18:00:02.218919 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1167/2346] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:01 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:02.237258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-131c978f-18a6-4581-9d0d-7859f31c2fb0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:02.237802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-131c978f-18a6-4581-9d0d-7859f31c2fb0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:02.244802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-131c978f-18a6-4581-9d0d-7859f31c2fb0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:02.245295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-131c978f-18a6-4581-9d0d-7859f31c2fb0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:02.246012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-131c978f-18a6-4581-9d0d-7859f31c2fb0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:02.246756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-131c978f-18a6-4581-9d0d-7859f31c2fb0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:02.247212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-131c978f-18a6-4581-9d0d-7859f31c2fb0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:02.247637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-131c978f-18a6-4581-9d0d-7859f31c2fb0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:02.583297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-915b5e1e-c7f0-41ae-ba9b-ac59ed853293 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:02.585987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-915b5e1e-c7f0-41ae-ba9b-ac59ed853293 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:02.594451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-915b5e1e-c7f0-41ae-ba9b-ac59ed853293 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:02.595229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-915b5e1e-c7f0-41ae-ba9b-ac59ed853293 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:02.595666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-915b5e1e-c7f0-41ae-ba9b-ac59ed853293 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:02.596598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-915b5e1e-c7f0-41ae-ba9b-ac59ed853293 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:02.597288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-915b5e1e-c7f0-41ae-ba9b-ac59ed853293 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:02.597950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-915b5e1e-c7f0-41ae-ba9b-ac59ed853293 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:02.640625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-131c978f-18a6-4581-9d0d-7859f31c2fb0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:02.655006 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-131c978f-18a6-4581-9d0d-7859f31c2fb0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1387 microversion: 2.1 time: 0.421613 Aug 23 18:00:02.655652 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1180/2347] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:02 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1387 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:02.713136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-915b5e1e-c7f0-41ae-ba9b-ac59ed853293 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:02.717724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:02.724949 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-915b5e1e-c7f0-41ae-ba9b-ac59ed853293 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1296 microversion: 2.1 time: 0.144879 Aug 23 18:00:02.725999 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1168/2348] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:02 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1296 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:02.873372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77516fe1-559d-4a3f-ab22-528f66ad3e18 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecb80790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:02.928010 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-77516fe1-559d-4a3f-ab22-528f66ad3e18 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.057691 Aug 23 18:00:02.928010 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1181/2349] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:02 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:03.176021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-21b61256-3bc3-4411-8fc1-8a73bd0376b9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:03.176726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-21b61256-3bc3-4411-8fc1-8a73bd0376b9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:03.188507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21b61256-3bc3-4411-8fc1-8a73bd0376b9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:03.190842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21b61256-3bc3-4411-8fc1-8a73bd0376b9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:03.191532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21b61256-3bc3-4411-8fc1-8a73bd0376b9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:03.192602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21b61256-3bc3-4411-8fc1-8a73bd0376b9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:03.194178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21b61256-3bc3-4411-8fc1-8a73bd0376b9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:03.195252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21b61256-3bc3-4411-8fc1-8a73bd0376b9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:03.230261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7436942e-239d-438a-ac95-f5761455c3b4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:03.231193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7436942e-239d-438a-ac95-f5761455c3b4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:03.244147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7436942e-239d-438a-ac95-f5761455c3b4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:03.244723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7436942e-239d-438a-ac95-f5761455c3b4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:03.246784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7436942e-239d-438a-ac95-f5761455c3b4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:03.248138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7436942e-239d-438a-ac95-f5761455c3b4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:03.248927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7436942e-239d-438a-ac95-f5761455c3b4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:03.250316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7436942e-239d-438a-ac95-f5761455c3b4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:03.261356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:03.403662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-21b61256-3bc3-4411-8fc1-8a73bd0376b9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:03.420234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-21b61256-3bc3-4411-8fc1-8a73bd0376b9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:03.422064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-21b61256-3bc3-4411-8fc1-8a73bd0376b9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:03.423420 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-21b61256-3bc3-4411-8fc1-8a73bd0376b9 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1280 microversion: 2.25 time: 0.251811 Aug 23 18:00:03.424374 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1169/2350] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:03 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1280 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:03.681213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e77360e5-058e-4fba-bcd8-bc0f0d0fb9b3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:03.681946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7436942e-239d-438a-ac95-f5761455c3b4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:03.683149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e77360e5-058e-4fba-bcd8-bc0f0d0fb9b3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:03.695155 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7436942e-239d-438a-ac95-f5761455c3b4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.466825 Aug 23 18:00:03.696714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e77360e5-058e-4fba-bcd8-bc0f0d0fb9b3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:03.697276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e77360e5-058e-4fba-bcd8-bc0f0d0fb9b3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:03.697978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e77360e5-058e-4fba-bcd8-bc0f0d0fb9b3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:03.703714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e77360e5-058e-4fba-bcd8-bc0f0d0fb9b3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:03.704867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e77360e5-058e-4fba-bcd8-bc0f0d0fb9b3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:03.705898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e77360e5-058e-4fba-bcd8-bc0f0d0fb9b3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:03.711999 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1182/2351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:03 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:03.747562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91c360bd-68dc-4be4-818c-fff1206e0868 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:03.748697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-91c360bd-68dc-4be4-818c-fff1206e0868 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:03.755292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91c360bd-68dc-4be4-818c-fff1206e0868 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:03.755871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91c360bd-68dc-4be4-818c-fff1206e0868 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:03.756392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91c360bd-68dc-4be4-818c-fff1206e0868 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:03.757479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91c360bd-68dc-4be4-818c-fff1206e0868 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:03.758149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91c360bd-68dc-4be4-818c-fff1206e0868 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:03.758830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91c360bd-68dc-4be4-818c-fff1206e0868 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:03.950654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e77360e5-058e-4fba-bcd8-bc0f0d0fb9b3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:03.961736 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e77360e5-058e-4fba-bcd8-bc0f0d0fb9b3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1387 microversion: 2.1 time: 0.285682 Aug 23 18:00:03.962356 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1170/2352] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:03 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1387 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:03.979144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8bf27503-b1c2-4657-b712-69068e905b31 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec75a310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:04.039118 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8bf27503-b1c2-4657-b712-69068e905b31 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.070654 Aug 23 18:00:04.048495 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1171/2353] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:03 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:04.452764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-399c0aea-48f9-4a20-9e89-5a2339ad5b33 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:04.454225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-399c0aea-48f9-4a20-9e89-5a2339ad5b33 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:04.469841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-399c0aea-48f9-4a20-9e89-5a2339ad5b33 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:04.470451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-399c0aea-48f9-4a20-9e89-5a2339ad5b33 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:04.471202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-399c0aea-48f9-4a20-9e89-5a2339ad5b33 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:04.476824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-399c0aea-48f9-4a20-9e89-5a2339ad5b33 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:04.478886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-399c0aea-48f9-4a20-9e89-5a2339ad5b33 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:04.479160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-399c0aea-48f9-4a20-9e89-5a2339ad5b33 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:04.607339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-91c360bd-68dc-4be4-818c-fff1206e0868 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:04.623626 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-91c360bd-68dc-4be4-818c-fff1206e0868 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1363 microversion: 2.1 time: 0.880057 Aug 23 18:00:04.624595 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1183/2354] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:03 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1363 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:04.712396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-330da9fa-d687-4375-98dc-6ea614840898 req-95ac4095-4efd-454f-bbff-d5884daf8356 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "017fdc38-466a-4461-aa24-c16b9c7d96ab", "name": "network-vif-deleted", "tag": "d386fc31-0829-4584-9e38-6de5ab421b8f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:04.740768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-330da9fa-d687-4375-98dc-6ea614840898 req-95ac4095-4efd-454f-bbff-d5884daf8356 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:04.741260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-330da9fa-d687-4375-98dc-6ea614840898 req-95ac4095-4efd-454f-bbff-d5884daf8356 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:04.741704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-330da9fa-d687-4375-98dc-6ea614840898 req-95ac4095-4efd-454f-bbff-d5884daf8356 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:04.777585 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-330da9fa-d687-4375-98dc-6ea614840898 req-95ac4095-4efd-454f-bbff-d5884daf8356 service nova] Creating event network-vif-deleted:d386fc31-0829-4584-9e38-6de5ab421b8f for instance 017fdc38-466a-4461-aa24-c16b9c7d96ab on n-h2-850468-16 Aug 23 18:00:04.791417 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-330da9fa-d687-4375-98dc-6ea614840898 req-95ac4095-4efd-454f-bbff-d5884daf8356 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084688 Aug 23 18:00:04.793046 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1184/2355] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:04.799505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-399c0aea-48f9-4a20-9e89-5a2339ad5b33 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:04.805873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c95da9e-0cf7-4698-805c-01105648d572 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:04.810990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-399c0aea-48f9-4a20-9e89-5a2339ad5b33 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:04.812513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-399c0aea-48f9-4a20-9e89-5a2339ad5b33 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:04.813807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5c95da9e-0cf7-4698-805c-01105648d572 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:04.821178 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-399c0aea-48f9-4a20-9e89-5a2339ad5b33 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1280 microversion: 2.25 time: 0.374149 Aug 23 18:00:04.828848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c95da9e-0cf7-4698-805c-01105648d572 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:04.830144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c95da9e-0cf7-4698-805c-01105648d572 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:04.831287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c95da9e-0cf7-4698-805c-01105648d572 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:04.833056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c95da9e-0cf7-4698-805c-01105648d572 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:04.835563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c95da9e-0cf7-4698-805c-01105648d572 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:04.836087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c95da9e-0cf7-4698-805c-01105648d572 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:04.841514 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1172/2356] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:04 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1280 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:00:04.994940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-20fe87b2-7944-4842-a336-bdee0f91d436 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:04.995845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-20fe87b2-7944-4842-a336-bdee0f91d436 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:05.002977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20fe87b2-7944-4842-a336-bdee0f91d436 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:05.003806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20fe87b2-7944-4842-a336-bdee0f91d436 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:05.004503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20fe87b2-7944-4842-a336-bdee0f91d436 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:05.007646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20fe87b2-7944-4842-a336-bdee0f91d436 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:05.010054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20fe87b2-7944-4842-a336-bdee0f91d436 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:05.010769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20fe87b2-7944-4842-a336-bdee0f91d436 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:05.154339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-20fe87b2-7944-4842-a336-bdee0f91d436 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:05.166638 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-20fe87b2-7944-4842-a336-bdee0f91d436 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1345 microversion: 2.1 time: 0.182323 Aug 23 18:00:05.167753 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1173/2357] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:04 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1345 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:05.173057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-46806362-0d8d-40ca-b4c9-bcbb37ce558b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec7e00d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:05.231021 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-46806362-0d8d-40ca-b4c9-bcbb37ce558b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.061699 Aug 23 18:00:05.231913 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1174/2358] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:05 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:05.324451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5c95da9e-0cf7-4698-805c-01105648d572 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:05.341394 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5c95da9e-0cf7-4698-805c-01105648d572 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.545445 Aug 23 18:00:05.341998 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1185/2359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:04 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:05.479774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-23b5912e-5d34-43fd-9d8c-b8f35b65fb20 tempest-SecurityGroupsTestAdminJSON-2013915058 tempest-SecurityGroupsTestAdminJSON-2013915058-project] Action: 'create', calling method: .version_select at 0x7f27ec75ac10>, body: {"security_group": {"name": "tempest-securitygroup-1206299508", "description": "tempest-description-510389063"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:05.643887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-506c445c-f931-4954-ab45-98cf402e3488 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:05.644736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-506c445c-f931-4954-ab45-98cf402e3488 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:05.651299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-506c445c-f931-4954-ab45-98cf402e3488 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:05.652216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-506c445c-f931-4954-ab45-98cf402e3488 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:05.652657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-506c445c-f931-4954-ab45-98cf402e3488 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:05.653678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-506c445c-f931-4954-ab45-98cf402e3488 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:05.654296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-506c445c-f931-4954-ab45-98cf402e3488 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:05.654770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-506c445c-f931-4954-ab45-98cf402e3488 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:05.822834 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-23b5912e-5d34-43fd-9d8c-b8f35b65fb20 tempest-SecurityGroupsTestAdminJSON-2013915058 tempest-SecurityGroupsTestAdminJSON-2013915058-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.589659 Aug 23 18:00:05.823430 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1175/2360] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:00:05 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:05.837380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-53eba94e-6ced-4955-bbbd-04a7660e9a5a tempest-SecurityGroupsTestAdminJSON-2013915058 tempest-SecurityGroupsTestAdminJSON-2013915058-project] Action: 'create', calling method: .version_select at 0x7f27ec81f280>, body: {"security_group": {"name": "tempest-securitygroup-1024022607", "description": "tempest-description-1296852005"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:06.031274 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-53eba94e-6ced-4955-bbbd-04a7660e9a5a tempest-SecurityGroupsTestAdminJSON-2013915058 tempest-SecurityGroupsTestAdminJSON-2013915058-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 221 microversion: 2.1 time: 0.198699 Aug 23 18:00:06.041447 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1176/2361] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:00:05 2022] POST /compute/v2.1/os-security-groups => generated 221 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:06.047236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c3c0b37-7f29-44bb-8c7b-9327b0e758f3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:06.048076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1c3c0b37-7f29-44bb-8c7b-9327b0e758f3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:06.056633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c3c0b37-7f29-44bb-8c7b-9327b0e758f3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:06.057518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c3c0b37-7f29-44bb-8c7b-9327b0e758f3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:06.058164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c3c0b37-7f29-44bb-8c7b-9327b0e758f3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:06.059262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c3c0b37-7f29-44bb-8c7b-9327b0e758f3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:06.060726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-506c445c-f931-4954-ab45-98cf402e3488 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:06.062985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c3c0b37-7f29-44bb-8c7b-9327b0e758f3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:06.064832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c3c0b37-7f29-44bb-8c7b-9327b0e758f3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:06.069531 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-506c445c-f931-4954-ab45-98cf402e3488 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1363 microversion: 2.1 time: 0.429694 Aug 23 18:00:06.082900 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1186/2362] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:05 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1363 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:06.343717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c3c0b37-7f29-44bb-8c7b-9327b0e758f3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:06.356618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c3c0b37-7f29-44bb-8c7b-9327b0e758f3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:06.365460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c3c0b37-7f29-44bb-8c7b-9327b0e758f3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:06.367483 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c3c0b37-7f29-44bb-8c7b-9327b0e758f3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1280 microversion: 2.25 time: 0.324462 Aug 23 18:00:06.370462 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1177/2363] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:06 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1280 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:06.386775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-58ee0a5b-6c32-465d-b2b6-24ae6aaf0d3b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:06.387631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-58ee0a5b-6c32-465d-b2b6-24ae6aaf0d3b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:06.398836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58ee0a5b-6c32-465d-b2b6-24ae6aaf0d3b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:06.400029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58ee0a5b-6c32-465d-b2b6-24ae6aaf0d3b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:06.401548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58ee0a5b-6c32-465d-b2b6-24ae6aaf0d3b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:06.404861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58ee0a5b-6c32-465d-b2b6-24ae6aaf0d3b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:06.405516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58ee0a5b-6c32-465d-b2b6-24ae6aaf0d3b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:06.406214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58ee0a5b-6c32-465d-b2b6-24ae6aaf0d3b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:06.531728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-58ee0a5b-6c32-465d-b2b6-24ae6aaf0d3b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:06.545325 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-58ee0a5b-6c32-465d-b2b6-24ae6aaf0d3b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1183 microversion: 2.1 time: 0.173110 Aug 23 18:00:06.548198 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1178/2364] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:06 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1183 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:06.556314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adb7c896-0ea9-4565-9e25-24324dd62d74 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec60b940>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:06.657660 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-adb7c896-0ea9-4565-9e25-24324dd62d74 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.103188 Aug 23 18:00:06.672004 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1179/2365] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:06 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:06.682480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c87a501a-c13c-4ad1-9b77-a30ae8b89593 tempest-SecurityGroupsTestAdminJSON-2079850279 tempest-SecurityGroupsTestAdminJSON-2079850279-project-admin] Action: 'create', calling method: .version_select at 0x7f27ec933280>, body: {"security_group": {"name": "tempest-securitygroup-102884547", "description": "tempest-description-1285143152"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:06.707124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-054fd6fb-9a07-4834-9f0a-75299acd5d51 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:06.708213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-054fd6fb-9a07-4834-9f0a-75299acd5d51 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:06.720209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-054fd6fb-9a07-4834-9f0a-75299acd5d51 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:06.721486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-054fd6fb-9a07-4834-9f0a-75299acd5d51 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:06.722581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-054fd6fb-9a07-4834-9f0a-75299acd5d51 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:06.723651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-054fd6fb-9a07-4834-9f0a-75299acd5d51 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:06.724976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-054fd6fb-9a07-4834-9f0a-75299acd5d51 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:06.725816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-054fd6fb-9a07-4834-9f0a-75299acd5d51 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:06.921687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-054fd6fb-9a07-4834-9f0a-75299acd5d51 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:06.930252 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-054fd6fb-9a07-4834-9f0a-75299acd5d51 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.256951 Aug 23 18:00:06.930888 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1180/2366] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:06 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:06.935425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4a712e37-1543-4f36-b265-65da8be1d952 req-aac0c514-6668-49b8-85c8-a7ddb69795dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d81bbbc-0ed1-445b-a321-b2175e975725", "tag": "c9a2077a-21a0-4f0d-846d-bbb4743c4fa4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:06.946431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4a712e37-1543-4f36-b265-65da8be1d952 req-aac0c514-6668-49b8-85c8-a7ddb69795dc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:06.947441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4a712e37-1543-4f36-b265-65da8be1d952 req-aac0c514-6668-49b8-85c8-a7ddb69795dc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:06.948111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4a712e37-1543-4f36-b265-65da8be1d952 req-aac0c514-6668-49b8-85c8-a7ddb69795dc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:06.962525 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4a712e37-1543-4f36-b265-65da8be1d952 req-aac0c514-6668-49b8-85c8-a7ddb69795dc service nova] Creating event network-changed:c9a2077a-21a0-4f0d-846d-bbb4743c4fa4 for instance 9d81bbbc-0ed1-445b-a321-b2175e975725 on n-h1-850468-16 Aug 23 18:00:06.968133 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4a712e37-1543-4f36-b265-65da8be1d952 req-aac0c514-6668-49b8-85c8-a7ddb69795dc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036077 Aug 23 18:00:06.968944 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1181/2367] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:07.095406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0500f064-2a41-45a0-9f9b-4ce066f8c63e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:07.096420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0500f064-2a41-45a0-9f9b-4ce066f8c63e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:07.106622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0500f064-2a41-45a0-9f9b-4ce066f8c63e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:07.107373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0500f064-2a41-45a0-9f9b-4ce066f8c63e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:07.108534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0500f064-2a41-45a0-9f9b-4ce066f8c63e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:07.109476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0500f064-2a41-45a0-9f9b-4ce066f8c63e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:07.110049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0500f064-2a41-45a0-9f9b-4ce066f8c63e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:07.110589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0500f064-2a41-45a0-9f9b-4ce066f8c63e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:07.348196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0500f064-2a41-45a0-9f9b-4ce066f8c63e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:07.358177 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0500f064-2a41-45a0-9f9b-4ce066f8c63e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1363 microversion: 2.1 time: 0.271817 Aug 23 18:00:07.359245 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1182/2368] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:07 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:07.421179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-59f3670c-463d-4fc7-a2ef-4e397be442bb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:07.422985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-59f3670c-463d-4fc7-a2ef-4e397be442bb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:07.431935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59f3670c-463d-4fc7-a2ef-4e397be442bb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:07.432762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59f3670c-463d-4fc7-a2ef-4e397be442bb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:07.433426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59f3670c-463d-4fc7-a2ef-4e397be442bb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:07.434385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59f3670c-463d-4fc7-a2ef-4e397be442bb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:07.435076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59f3670c-463d-4fc7-a2ef-4e397be442bb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:07.435891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59f3670c-463d-4fc7-a2ef-4e397be442bb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:07.614433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-59f3670c-463d-4fc7-a2ef-4e397be442bb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:07.625158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-59f3670c-463d-4fc7-a2ef-4e397be442bb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:07.632598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-59f3670c-463d-4fc7-a2ef-4e397be442bb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:07.633774 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-59f3670c-463d-4fc7-a2ef-4e397be442bb tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1280 microversion: 2.25 time: 0.241292 Aug 23 18:00:07.644419 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1183/2369] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:07 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1280 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:00:07.654523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db0bf55b-48f9-4451-be0b-6e54598d3029 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:07.655441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-db0bf55b-48f9-4451-be0b-6e54598d3029 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:07.665096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db0bf55b-48f9-4451-be0b-6e54598d3029 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:07.665969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db0bf55b-48f9-4451-be0b-6e54598d3029 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:07.666619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db0bf55b-48f9-4451-be0b-6e54598d3029 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:07.667530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db0bf55b-48f9-4451-be0b-6e54598d3029 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:07.668243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db0bf55b-48f9-4451-be0b-6e54598d3029 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:07.668855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db0bf55b-48f9-4451-be0b-6e54598d3029 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:07.756106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-db0bf55b-48f9-4451-be0b-6e54598d3029 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:07.768919 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-db0bf55b-48f9-4451-be0b-6e54598d3029 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1183 microversion: 2.1 time: 0.119646 Aug 23 18:00:07.769851 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1184/2370] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:07 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:07.780720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce54464a-16ad-46d6-a82f-a4e2d64ea2ad tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec7508b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:07.862003 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce54464a-16ad-46d6-a82f-a4e2d64ea2ad tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.087644 Aug 23 18:00:07.862602 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1185/2371] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:07 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:07.952798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-60103d4d-ccdd-4c6e-8e91-9ad6f7ae13a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:07.954877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-60103d4d-ccdd-4c6e-8e91-9ad6f7ae13a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:07.967768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60103d4d-ccdd-4c6e-8e91-9ad6f7ae13a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:07.969628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60103d4d-ccdd-4c6e-8e91-9ad6f7ae13a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:07.971012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60103d4d-ccdd-4c6e-8e91-9ad6f7ae13a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:07.972980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60103d4d-ccdd-4c6e-8e91-9ad6f7ae13a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:07.975290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60103d4d-ccdd-4c6e-8e91-9ad6f7ae13a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:07.976517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60103d4d-ccdd-4c6e-8e91-9ad6f7ae13a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:08.252603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-60103d4d-ccdd-4c6e-8e91-9ad6f7ae13a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:08.274054 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-60103d4d-ccdd-4c6e-8e91-9ad6f7ae13a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.325067 Aug 23 18:00:08.275894 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1186/2372] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:07 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:08.290339 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c87a501a-c13c-4ad1-9b77-a30ae8b89593 tempest-SecurityGroupsTestAdminJSON-2079850279 tempest-SecurityGroupsTestAdminJSON-2079850279-project-admin] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.206156 Aug 23 18:00:08.291632 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1187/2373] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:00:06 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:08.303738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8c55289-d685-49e6-a0b5-7cfacabfa360 tempest-SecurityGroupsTestAdminJSON-2079850279 tempest-SecurityGroupsTestAdminJSON-2079850279-project-admin] Action: 'create', calling method: .version_select at 0x7f27ec75a0d0>, body: {"security_group": {"name": "tempest-securitygroup-1774458365", "description": "tempest-description-606008900"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:08.379951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e63d30af-c7a9-428f-b37d-9188321e184a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:08.384833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e63d30af-c7a9-428f-b37d-9188321e184a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:08.410459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e63d30af-c7a9-428f-b37d-9188321e184a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:08.411003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e63d30af-c7a9-428f-b37d-9188321e184a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:08.414781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e63d30af-c7a9-428f-b37d-9188321e184a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:08.419052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e63d30af-c7a9-428f-b37d-9188321e184a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:08.421122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e63d30af-c7a9-428f-b37d-9188321e184a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:08.421814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e63d30af-c7a9-428f-b37d-9188321e184a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:08.757585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e63d30af-c7a9-428f-b37d-9188321e184a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:08.772500 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e63d30af-c7a9-428f-b37d-9188321e184a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1363 microversion: 2.1 time: 0.397177 Aug 23 18:00:08.776145 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1188/2374] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:08 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1363 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:08.800821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f17d6677-c146-4aa8-a690-fcaecffe85e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:08.805573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f17d6677-c146-4aa8-a690-fcaecffe85e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:08.819664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f17d6677-c146-4aa8-a690-fcaecffe85e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:08.820624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f17d6677-c146-4aa8-a690-fcaecffe85e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:08.821295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f17d6677-c146-4aa8-a690-fcaecffe85e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:08.822302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f17d6677-c146-4aa8-a690-fcaecffe85e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:08.823028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f17d6677-c146-4aa8-a690-fcaecffe85e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:08.823670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f17d6677-c146-4aa8-a690-fcaecffe85e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:08.994038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f17d6677-c146-4aa8-a690-fcaecffe85e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:09.007066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f17d6677-c146-4aa8-a690-fcaecffe85e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:09.008802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f17d6677-c146-4aa8-a690-fcaecffe85e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:09.009946 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f17d6677-c146-4aa8-a690-fcaecffe85e3 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1280 microversion: 2.25 time: 0.220684 Aug 23 18:00:09.011119 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1189/2375] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:08 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1280 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:09.029819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-13518a1d-0e8e-4562-be83-55bfff6ddb5d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:09.030453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-13518a1d-0e8e-4562-be83-55bfff6ddb5d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:09.039132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13518a1d-0e8e-4562-be83-55bfff6ddb5d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:09.040106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13518a1d-0e8e-4562-be83-55bfff6ddb5d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:09.040824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13518a1d-0e8e-4562-be83-55bfff6ddb5d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:09.042072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13518a1d-0e8e-4562-be83-55bfff6ddb5d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:09.043358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13518a1d-0e8e-4562-be83-55bfff6ddb5d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:09.044002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13518a1d-0e8e-4562-be83-55bfff6ddb5d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:09.112580 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8c55289-d685-49e6-a0b5-7cfacabfa360 tempest-SecurityGroupsTestAdminJSON-2079850279 tempest-SecurityGroupsTestAdminJSON-2079850279-project-admin] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 0.811887 Aug 23 18:00:09.116444 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1187/2376] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:00:08 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:09.124419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6abdf569-b860-4ffe-a3af-2dac90986cb2 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec7b9940>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:09.149325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-13518a1d-0e8e-4562-be83-55bfff6ddb5d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:09.158290 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-13518a1d-0e8e-4562-be83-55bfff6ddb5d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1183 microversion: 2.1 time: 0.145964 Aug 23 18:00:09.158916 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1190/2377] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:09 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:09.164859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-7551cf6e-40fb-4c27-baf4-0aa3bdc05b86 req-6b38cbb5-bf61-424c-8a5a-de0b02e28c8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f47e601-36d6-4b1f-a4bf-8020bf69831c", "name": "network-vif-plugged", "status": "completed", "tag": "4838606c-edcc-47d0-96e3-cce31a7cb847"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:09.179599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7551cf6e-40fb-4c27-baf4-0aa3bdc05b86 req-6b38cbb5-bf61-424c-8a5a-de0b02e28c8c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:09.180046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7551cf6e-40fb-4c27-baf4-0aa3bdc05b86 req-6b38cbb5-bf61-424c-8a5a-de0b02e28c8c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:09.180480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7551cf6e-40fb-4c27-baf4-0aa3bdc05b86 req-6b38cbb5-bf61-424c-8a5a-de0b02e28c8c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:09.197254 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-7551cf6e-40fb-4c27-baf4-0aa3bdc05b86 req-6b38cbb5-bf61-424c-8a5a-de0b02e28c8c service nova] Creating event network-vif-plugged:4838606c-edcc-47d0-96e3-cce31a7cb847 for instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c on n-h2-850468-16 Aug 23 18:00:09.217920 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-7551cf6e-40fb-4c27-baf4-0aa3bdc05b86 req-6b38cbb5-bf61-424c-8a5a-de0b02e28c8c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057696 Aug 23 18:00:09.218574 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1191/2378] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:09.223492 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6abdf569-b860-4ffe-a3af-2dac90986cb2 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.104833 Aug 23 18:00:09.226599 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1188/2379] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:09 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:09.236139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f63bc475-f347-4f99-b82c-6bb47f10b113 tempest-SecurityGroupsTestAdminJSON-2079850279 tempest-SecurityGroupsTestAdminJSON-2079850279-project-admin] Calling method '.version_select at 0x7f27ec8911f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:09.295694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-97c6f772-d6c1-468d-84b9-b1f120fba2f8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:09.298983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-97c6f772-d6c1-468d-84b9-b1f120fba2f8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:09.313045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c6f772-d6c1-468d-84b9-b1f120fba2f8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:09.313784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c6f772-d6c1-468d-84b9-b1f120fba2f8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:09.316488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c6f772-d6c1-468d-84b9-b1f120fba2f8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:09.319529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c6f772-d6c1-468d-84b9-b1f120fba2f8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:09.322375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c6f772-d6c1-468d-84b9-b1f120fba2f8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:09.323267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c6f772-d6c1-468d-84b9-b1f120fba2f8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:09.475203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=9 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:09.714876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:09.721565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97c6f772-d6c1-468d-84b9-b1f120fba2f8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:09.733199 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-97c6f772-d6c1-468d-84b9-b1f120fba2f8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.441122 Aug 23 18:00:09.734464 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1189/2380] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:09 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:09.802799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eca4ebd1-5759-4872-8ee4-3ae798ee8691 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:09.803626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eca4ebd1-5759-4872-8ee4-3ae798ee8691 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:09.823042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eca4ebd1-5759-4872-8ee4-3ae798ee8691 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:09.826285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eca4ebd1-5759-4872-8ee4-3ae798ee8691 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:09.827176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eca4ebd1-5759-4872-8ee4-3ae798ee8691 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:09.828656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eca4ebd1-5759-4872-8ee4-3ae798ee8691 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:09.831076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eca4ebd1-5759-4872-8ee4-3ae798ee8691 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:09.831686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eca4ebd1-5759-4872-8ee4-3ae798ee8691 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:10.141980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eca4ebd1-5759-4872-8ee4-3ae798ee8691 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:10.153130 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eca4ebd1-5759-4872-8ee4-3ae798ee8691 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1363 microversion: 2.1 time: 0.355494 Aug 23 18:00:10.166945 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1190/2381] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:09 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1363 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:10.173998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-174b9002-7a3c-4f7a-8100-bfe4ebd3ff0d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:10.175256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-174b9002-7a3c-4f7a-8100-bfe4ebd3ff0d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:10.193465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-174b9002-7a3c-4f7a-8100-bfe4ebd3ff0d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:10.194304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-174b9002-7a3c-4f7a-8100-bfe4ebd3ff0d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:10.195096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-174b9002-7a3c-4f7a-8100-bfe4ebd3ff0d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:10.196049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-174b9002-7a3c-4f7a-8100-bfe4ebd3ff0d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:10.197079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-174b9002-7a3c-4f7a-8100-bfe4ebd3ff0d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:10.197950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-174b9002-7a3c-4f7a-8100-bfe4ebd3ff0d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:10.290783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=26 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:10.384666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:10.531001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-174b9002-7a3c-4f7a-8100-bfe4ebd3ff0d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:10.557804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-174b9002-7a3c-4f7a-8100-bfe4ebd3ff0d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:10.561960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-174b9002-7a3c-4f7a-8100-bfe4ebd3ff0d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:10.564257 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-174b9002-7a3c-4f7a-8100-bfe4ebd3ff0d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1280 microversion: 2.25 time: 0.395236 Aug 23 18:00:10.565434 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1191/2382] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:10 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1280 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:10.571614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f20e6243-932c-4ea4-b908-8e83f49613d3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:10.572767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f20e6243-932c-4ea4-b908-8e83f49613d3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:10.585289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f20e6243-932c-4ea4-b908-8e83f49613d3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:10.586810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f20e6243-932c-4ea4-b908-8e83f49613d3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:10.587689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f20e6243-932c-4ea4-b908-8e83f49613d3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:10.589352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f20e6243-932c-4ea4-b908-8e83f49613d3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:10.591369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f20e6243-932c-4ea4-b908-8e83f49613d3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:10.592039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f20e6243-932c-4ea4-b908-8e83f49613d3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:10.678482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f20e6243-932c-4ea4-b908-8e83f49613d3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:10.687873 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f20e6243-932c-4ea4-b908-8e83f49613d3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1183 microversion: 2.1 time: 0.121111 Aug 23 18:00:10.688732 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1192/2383] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:10 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:10.697337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-444a076d-4af6-4ebb-b196-e1bdfe3b3ad9 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec080040>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:10.756343 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-444a076d-4af6-4ebb-b196-e1bdfe3b3ad9 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.065308 Aug 23 18:00:10.757467 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1193/2384] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:10 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:10.762990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-006ce4e3-a91e-494b-9fb3-122027a26b33 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:10.764112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-006ce4e3-a91e-494b-9fb3-122027a26b33 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:10.773564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-006ce4e3-a91e-494b-9fb3-122027a26b33 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:10.774649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-006ce4e3-a91e-494b-9fb3-122027a26b33 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:10.775384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-006ce4e3-a91e-494b-9fb3-122027a26b33 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:10.776726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-006ce4e3-a91e-494b-9fb3-122027a26b33 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:10.777463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-006ce4e3-a91e-494b-9fb3-122027a26b33 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:10.778098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-006ce4e3-a91e-494b-9fb3-122027a26b33 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:11.056085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-006ce4e3-a91e-494b-9fb3-122027a26b33 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:11.066910 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-006ce4e3-a91e-494b-9fb3-122027a26b33 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.306211 Aug 23 18:00:11.087015 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1194/2385] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:10 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:11.180397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ffd5b375-e3d3-47bf-ae70-ca570fd089ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:11.181291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ffd5b375-e3d3-47bf-ae70-ca570fd089ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:11.198655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffd5b375-e3d3-47bf-ae70-ca570fd089ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:11.199745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffd5b375-e3d3-47bf-ae70-ca570fd089ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:11.203201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffd5b375-e3d3-47bf-ae70-ca570fd089ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:11.203201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffd5b375-e3d3-47bf-ae70-ca570fd089ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:11.203201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffd5b375-e3d3-47bf-ae70-ca570fd089ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:11.203672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffd5b375-e3d3-47bf-ae70-ca570fd089ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:11.220983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:11.943823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ffd5b375-e3d3-47bf-ae70-ca570fd089ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:11.956162 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ffd5b375-e3d3-47bf-ae70-ca570fd089ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1363 microversion: 2.1 time: 0.782166 Aug 23 18:00:11.956754 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1195/2386] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:11 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1363 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:11.975833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-b24e216c-3a0e-4921-be83-d1af2bf9c2c5 req-75693cfc-f72f-4035-a0be-200c331fd941 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b43649-db0d-42b6-a207-a8c75fc2a5a8", "name": "network-vif-plugged", "status": "completed", "tag": "34cfa4d3-ec0b-4ef7-a39c-ad4233274c24"}, {"server_uuid": "d71f4ec4-18cf-4eae-9e86-4f91f90810f5", "name": "network-vif-plugged", "status": "completed", "tag": "98910578-3769-44bc-8492-76aab610ddc3"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:11.993006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b24e216c-3a0e-4921-be83-d1af2bf9c2c5 req-75693cfc-f72f-4035-a0be-200c331fd941 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:11.993482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b24e216c-3a0e-4921-be83-d1af2bf9c2c5 req-75693cfc-f72f-4035-a0be-200c331fd941 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:11.994230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b24e216c-3a0e-4921-be83-d1af2bf9c2c5 req-75693cfc-f72f-4035-a0be-200c331fd941 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:12.048676 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b24e216c-3a0e-4921-be83-d1af2bf9c2c5 req-75693cfc-f72f-4035-a0be-200c331fd941 service nova] Creating event network-vif-plugged:34cfa4d3-ec0b-4ef7-a39c-ad4233274c24 for instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 on n-h2-850468-16 Aug 23 18:00:12.051537 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b24e216c-3a0e-4921-be83-d1af2bf9c2c5 req-75693cfc-f72f-4035-a0be-200c331fd941 service nova] Creating event network-vif-plugged:98910578-3769-44bc-8492-76aab610ddc3 for instance d71f4ec4-18cf-4eae-9e86-4f91f90810f5 on n-h2-850468-16 Aug 23 18:00:12.071595 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-b24e216c-3a0e-4921-be83-d1af2bf9c2c5 req-75693cfc-f72f-4035-a0be-200c331fd941 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110186 Aug 23 18:00:12.075294 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1196/2387] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:12.149047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcccea4b-d4cf-4777-b938-216d01388704 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:12.152320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fcccea4b-d4cf-4777-b938-216d01388704 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:12.169031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcccea4b-d4cf-4777-b938-216d01388704 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:12.179474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcccea4b-d4cf-4777-b938-216d01388704 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:12.180358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcccea4b-d4cf-4777-b938-216d01388704 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:12.186650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcccea4b-d4cf-4777-b938-216d01388704 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:12.187505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcccea4b-d4cf-4777-b938-216d01388704 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:12.190097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcccea4b-d4cf-4777-b938-216d01388704 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:12.435409 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f63bc475-f347-4f99-b82c-6bb47f10b113 tempest-SecurityGroupsTestAdminJSON-2079850279 tempest-SecurityGroupsTestAdminJSON-2079850279-project-admin] 10.222.0.61 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 11611 microversion: 2.1 time: 3.215571 Aug 23 18:00:12.436733 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1192/2388] 10.222.0.61 () {58 vars in 1191 bytes} [Tue Aug 23 18:00:09 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 11611 bytes in 3218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:00:12.463643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:12.464667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:12.485295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:12.489146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:12.490648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:12.492897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:12.494644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:12.495230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:12.547640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:12.548283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:12.548737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:12.549195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lazy-loading 'fault' on Instance uuid 017fdc38-466a-4461-aa24-c16b9c7d96ab {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:00:12.597382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fcccea4b-d4cf-4777-b938-216d01388704 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:12.597991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:12.611700 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2ecbc87b-f567-4513-9431-35eae037065d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1188 microversion: 2.1 time: 0.159134 Aug 23 18:00:12.613696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fcccea4b-d4cf-4777-b938-216d01388704 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:12.619768 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1193/2389] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:12 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1188 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:12.625877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3045aced-b80c-4e7a-ae08-c8cbba9e9800 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecadd8b0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:12.638425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fcccea4b-d4cf-4777-b938-216d01388704 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:12.639786 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fcccea4b-d4cf-4777-b938-216d01388704 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1280 microversion: 2.25 time: 0.512394 Aug 23 18:00:12.655229 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1197/2390] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:12 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1280 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:12.676549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2f1c39ab-2644-42cb-aaac-8aeea6a3c7ec tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:12.682404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2f1c39ab-2644-42cb-aaac-8aeea6a3c7ec tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:12.689634 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3045aced-b80c-4e7a-ae08-c8cbba9e9800 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.068470 Aug 23 18:00:12.690898 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1194/2391] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:12 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:12.696580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ca1e487b-46d3-4cd4-a414-e0af9c956bd0 tempest-SecurityGroupsTestAdminJSON-2013915058 tempest-SecurityGroupsTestAdminJSON-2013915058-project] Calling method '.version_select at 0x7f27ec8a7ee0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:12.701229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f1c39ab-2644-42cb-aaac-8aeea6a3c7ec tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:12.701749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f1c39ab-2644-42cb-aaac-8aeea6a3c7ec tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:12.702209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f1c39ab-2644-42cb-aaac-8aeea6a3c7ec tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:12.702977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f1c39ab-2644-42cb-aaac-8aeea6a3c7ec tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:12.705464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f1c39ab-2644-42cb-aaac-8aeea6a3c7ec tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:12.716535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f1c39ab-2644-42cb-aaac-8aeea6a3c7ec tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:12.952647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2f1c39ab-2644-42cb-aaac-8aeea6a3c7ec tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:12.972173 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2f1c39ab-2644-42cb-aaac-8aeea6a3c7ec tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.311953 Aug 23 18:00:12.973158 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1198/2392] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:12 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:12.992920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-082fb571-91b4-4601-ae53-e1fee5a2c12c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:13.000026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-082fb571-91b4-4601-ae53-e1fee5a2c12c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:13.027892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-082fb571-91b4-4601-ae53-e1fee5a2c12c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:13.029574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-082fb571-91b4-4601-ae53-e1fee5a2c12c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:13.030835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-082fb571-91b4-4601-ae53-e1fee5a2c12c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:13.032424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-082fb571-91b4-4601-ae53-e1fee5a2c12c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:13.034071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-082fb571-91b4-4601-ae53-e1fee5a2c12c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:13.035151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-082fb571-91b4-4601-ae53-e1fee5a2c12c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:13.143151 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ca1e487b-46d3-4cd4-a414-e0af9c956bd0 tempest-SecurityGroupsTestAdminJSON-2013915058 tempest-SecurityGroupsTestAdminJSON-2013915058-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1112 microversion: 2.1 time: 0.450948 Aug 23 18:00:13.153170 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1195/2393] 10.222.0.61 () {58 vars in 1191 bytes} [Tue Aug 23 18:00:12 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1112 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:13.170980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95626379-a003-4241-81cd-33573f974138 tempest-SecurityGroupsTestAdminJSON-2079850279 tempest-SecurityGroupsTestAdminJSON-2079850279-project-admin] Calling method '.version_select at 0x7f27ec933040>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:13.555038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-082fb571-91b4-4601-ae53-e1fee5a2c12c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:13.560449 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-95626379-a003-4241-81cd-33573f974138 tempest-SecurityGroupsTestAdminJSON-2079850279 tempest-SecurityGroupsTestAdminJSON-2079850279-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/9a6e36e1-fc72-4ea6-9dd2-226773ac6a5a" status: 202 len: 0 microversion: 2.1 time: 0.395329 Aug 23 18:00:13.565866 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1196/2394] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:00:13 2022] DELETE /compute/v2.1/os-security-groups/9a6e36e1-fc72-4ea6-9dd2-226773ac6a5a => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:00:13.573697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5224eaf8-d420-47c2-b404-b151ff77882f tempest-SecurityGroupsTestAdminJSON-2079850279 tempest-SecurityGroupsTestAdminJSON-2079850279-project-admin] Calling method '.version_select at 0x7f27ec933550>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:13.583936 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-082fb571-91b4-4601-ae53-e1fee5a2c12c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1363 microversion: 2.1 time: 0.606201 Aug 23 18:00:13.593638 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1199/2395] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:12 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1363 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:13.643817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:13.644374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:13.657309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:13.657639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:13.658083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:13.661945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:13.662460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:13.664823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:13.759141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:13.759608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:13.762469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:13.769647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lazy-loading 'fault' on Instance uuid 017fdc38-466a-4461-aa24-c16b9c7d96ab {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:00:13.866809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:13.880957 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8123e1df-44b9-43e0-bfc9-01b2116a64aa tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 200 len: 1188 microversion: 2.1 time: 0.240668 Aug 23 18:00:13.881859 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1200/2396] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:13 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 1188 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:13.887082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a701141b-85de-4638-a758-3d14eb311194 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:13.887687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a701141b-85de-4638-a758-3d14eb311194 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:13.908851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a701141b-85de-4638-a758-3d14eb311194 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:13.909393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a701141b-85de-4638-a758-3d14eb311194 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:13.909833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a701141b-85de-4638-a758-3d14eb311194 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:13.910562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a701141b-85de-4638-a758-3d14eb311194 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:13.911142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a701141b-85de-4638-a758-3d14eb311194 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:13.912413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a701141b-85de-4638-a758-3d14eb311194 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:13.972434 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5224eaf8-d420-47c2-b404-b151ff77882f tempest-SecurityGroupsTestAdminJSON-2079850279 tempest-SecurityGroupsTestAdminJSON-2079850279-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/d5ad458c-37f9-4e37-a71d-65566a0248e9" status: 202 len: 0 microversion: 2.1 time: 0.405151 Aug 23 18:00:13.973317 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1197/2397] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:00:13 2022] DELETE /compute/v2.1/os-security-groups/d5ad458c-37f9-4e37-a71d-65566a0248e9 => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:00:13.982580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ad2798d-15fc-40a8-84e9-fd7a0b9d19cf tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec90d700>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:14.095416 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2ad2798d-15fc-40a8-84e9-fd7a0b9d19cf tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.116669 Aug 23 18:00:14.095983 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1198/2398] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:13 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:14.109167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-54d67707-cebe-4341-b0bc-ce2787c0d394 tempest-SecurityGroupsTestAdminJSON-2013915058 tempest-SecurityGroupsTestAdminJSON-2013915058-project] Calling method '.version_select at 0x7f27ec891820>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:14.487179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a701141b-85de-4638-a758-3d14eb311194 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:14.497060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a701141b-85de-4638-a758-3d14eb311194 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:14.506156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a701141b-85de-4638-a758-3d14eb311194 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:14.507929 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a701141b-85de-4638-a758-3d14eb311194 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1280 microversion: 2.25 time: 0.625051 Aug 23 18:00:14.512425 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1201/2399] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:13 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1280 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:14.531074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2c50afb0-54fd-4839-b0b6-3bb509109b3e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:14.533839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2c50afb0-54fd-4839-b0b6-3bb509109b3e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:14.572562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c50afb0-54fd-4839-b0b6-3bb509109b3e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:14.585885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c50afb0-54fd-4839-b0b6-3bb509109b3e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:14.586383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c50afb0-54fd-4839-b0b6-3bb509109b3e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:14.587175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c50afb0-54fd-4839-b0b6-3bb509109b3e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:14.587671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c50afb0-54fd-4839-b0b6-3bb509109b3e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:14.588093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c50afb0-54fd-4839-b0b6-3bb509109b3e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:14.613006 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-54d67707-cebe-4341-b0bc-ce2787c0d394 tempest-SecurityGroupsTestAdminJSON-2013915058 tempest-SecurityGroupsTestAdminJSON-2013915058-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/1784b552-428f-4652-b8e8-57caef075be3" status: 202 len: 0 microversion: 2.1 time: 0.507648 Aug 23 18:00:14.618186 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1199/2400] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:00:14 2022] DELETE /compute/v2.1/os-security-groups/1784b552-428f-4652-b8e8-57caef075be3 => generated 0 bytes in 513 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:00:14.623210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7c75e220-cb57-42d2-9464-9d2cb8080c57 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:14.623831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7c75e220-cb57-42d2-9464-9d2cb8080c57 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:14.645536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c75e220-cb57-42d2-9464-9d2cb8080c57 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:14.646081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c75e220-cb57-42d2-9464-9d2cb8080c57 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:14.646529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c75e220-cb57-42d2-9464-9d2cb8080c57 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:14.647283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c75e220-cb57-42d2-9464-9d2cb8080c57 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:14.647745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c75e220-cb57-42d2-9464-9d2cb8080c57 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:14.658786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c75e220-cb57-42d2-9464-9d2cb8080c57 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:15.053964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2c50afb0-54fd-4839-b0b6-3bb509109b3e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:15.067095 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2c50afb0-54fd-4839-b0b6-3bb509109b3e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1308 microversion: 2.1 time: 0.553262 Aug 23 18:00:15.067844 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1202/2401] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:14 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1308 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:15.099964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c35cf114-49d4-4381-b3d8-b39af9ef31b0 tempest-SecurityGroupsTestAdminJSON-2013915058 tempest-SecurityGroupsTestAdminJSON-2013915058-project] Calling method '.version_select at 0x7f27ec086670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:15.330269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7c75e220-cb57-42d2-9464-9d2cb8080c57 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:15.342273 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7c75e220-cb57-42d2-9464-9d2cb8080c57 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1363 microversion: 2.1 time: 0.722930 Aug 23 18:00:15.350012 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1200/2402] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:14 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1363 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:15.355049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-734792e2-3da9-4365-b8ed-4ebcf90aa20a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:15.357018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-734792e2-3da9-4365-b8ed-4ebcf90aa20a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 017fdc38-466a-4461-aa24-c16b9c7d96ab] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:15.376573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-734792e2-3da9-4365-b8ed-4ebcf90aa20a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:15.377490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-734792e2-3da9-4365-b8ed-4ebcf90aa20a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:15.380904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-734792e2-3da9-4365-b8ed-4ebcf90aa20a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:15.381959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-734792e2-3da9-4365-b8ed-4ebcf90aa20a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:15.383088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-734792e2-3da9-4365-b8ed-4ebcf90aa20a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:15.384282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-734792e2-3da9-4365-b8ed-4ebcf90aa20a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:15.416415 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-734792e2-3da9-4365-b8ed-4ebcf90aa20a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] HTTP exception thrown: Instance 017fdc38-466a-4461-aa24-c16b9c7d96ab could not be found. Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-734792e2-3da9-4365-b8ed-4ebcf90aa20a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Request method failure captured: Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab HTTP/1.1 Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPX1elqyNQ4auLp1EnHhwwe0OquV4esq_oPU2GgqJPFLYFGAgTS81hhHztTDZGZMFyvI6Cje-7fDA8Q4c9PbVVsfbnEFm_f9R-Rmuv_43mkyGpay-W4P6rIcGCnNV_XeiNFDnbdcwmAaNZXsW4quZfUCluZ-lRR0zovphSc8VT2IXg Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 5bbd01aaed704a1b8509e754d19a4b8d Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-LiveMigrationTest-1735186488 Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5bbd01aaed704a1b8509e754d19a4b8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5bbd01aaed704a1b8509e754d19a4b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5bbd01aaed704a1b8509e754d19a4b8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5bbd01aaed704a1b8509e754d19a4b8d"}]}] Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-LiveMigrationTest-1735186488 Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 5bbd01aaed704a1b8509e754d19a4b8d Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-LiveMigrationTest-1735186488 Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-LiveMigrationTest-1735186488-project Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 0ef389420da8493386a7f8dfb747afab Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-LiveMigrationTest-1735186488-project Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 017fdc38-466a-4461-aa24-c16b9c7d96ab could not be found. Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '017fdc38-466a-4461-aa24-c16b9c7d96ab'} Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 017fdc38-466a-4461-aa24-c16b9c7d96ab could not be found. Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 017fdc38-466a-4461-aa24-c16b9c7d96ab could not be found. Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:00:15.421465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:00:15.425255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:15.425255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:00:15.425255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:00:15.425255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:00:15.425255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:00:15.425255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 017fdc38-466a-4461-aa24-c16b9c7d96ab could not be found. Aug 23 18:00:15.425255 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:00:15.428720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-734792e2-3da9-4365-b8ed-4ebcf90aa20a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Returning 404 to user: Instance 017fdc38-466a-4461-aa24-c16b9c7d96ab could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:00:15.430576 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-734792e2-3da9-4365-b8ed-4ebcf90aa20a tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab" status: 404 len: 111 microversion: 2.1 time: 0.079290 Aug 23 18:00:15.432359 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1201/2403] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:15 2022] GET /compute/v2.1/servers/017fdc38-466a-4461-aa24-c16b9c7d96ab => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:00:15.446807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-566ad8a1-ab5b-41a2-a2fc-26a203da78ed req-a635eb96-8d92-46b4-98d8-36951e47137e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d81bbbc-0ed1-445b-a321-b2175e975725", "name": "network-vif-plugged", "status": "completed", "tag": "c9a2077a-21a0-4f0d-846d-bbb4743c4fa4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:15.469885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-566ad8a1-ab5b-41a2-a2fc-26a203da78ed req-a635eb96-8d92-46b4-98d8-36951e47137e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:15.471073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-566ad8a1-ab5b-41a2-a2fc-26a203da78ed req-a635eb96-8d92-46b4-98d8-36951e47137e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:15.476617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-566ad8a1-ab5b-41a2-a2fc-26a203da78ed req-a635eb96-8d92-46b4-98d8-36951e47137e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:15.502601 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-566ad8a1-ab5b-41a2-a2fc-26a203da78ed req-a635eb96-8d92-46b4-98d8-36951e47137e service nova] Creating event network-vif-plugged:c9a2077a-21a0-4f0d-846d-bbb4743c4fa4 for instance 9d81bbbc-0ed1-445b-a321-b2175e975725 on n-h1-850468-16 Aug 23 18:00:15.518436 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-566ad8a1-ab5b-41a2-a2fc-26a203da78ed req-a635eb96-8d92-46b4-98d8-36951e47137e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079831 Aug 23 18:00:15.521251 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1202/2404] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:15.530875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f2910fa1-bf89-49cf-8192-9339a2cb85ff tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec86fc10>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:15.550330 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c35cf114-49d4-4381-b3d8-b39af9ef31b0 tempest-SecurityGroupsTestAdminJSON-2013915058 tempest-SecurityGroupsTestAdminJSON-2013915058-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/244cf16c-e108-469a-910d-9115a49608cb" status: 202 len: 0 microversion: 2.1 time: 0.457604 Aug 23 18:00:15.557951 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1203/2405] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:00:15 2022] DELETE /compute/v2.1/os-security-groups/244cf16c-e108-469a-910d-9115a49608cb => generated 0 bytes in 464 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:00:15.575588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef3c615f-e4aa-410b-a4b7-6fc398eba712 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:15.577492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef3c615f-e4aa-410b-a4b7-6fc398eba712 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:15.609654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef3c615f-e4aa-410b-a4b7-6fc398eba712 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:15.611162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef3c615f-e4aa-410b-a4b7-6fc398eba712 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:15.613834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef3c615f-e4aa-410b-a4b7-6fc398eba712 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:15.615178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef3c615f-e4aa-410b-a4b7-6fc398eba712 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:15.620633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef3c615f-e4aa-410b-a4b7-6fc398eba712 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:15.621293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef3c615f-e4aa-410b-a4b7-6fc398eba712 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:15.673131 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f2910fa1-bf89-49cf-8192-9339a2cb85ff tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.149468 Aug 23 18:00:15.673836 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1203/2406] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:15 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:16.043797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef3c615f-e4aa-410b-a4b7-6fc398eba712 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:16.061190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef3c615f-e4aa-410b-a4b7-6fc398eba712 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:16.069692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef3c615f-e4aa-410b-a4b7-6fc398eba712 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:16.075113 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef3c615f-e4aa-410b-a4b7-6fc398eba712 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1475 microversion: 2.25 time: 0.510823 Aug 23 18:00:16.096819 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1204/2407] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:15 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1475 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:16.097371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fecd5b9b-0bab-43e6-bc14-b6b40c23a095 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:16.098113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fecd5b9b-0bab-43e6-bc14-b6b40c23a095 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:16.107803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fecd5b9b-0bab-43e6-bc14-b6b40c23a095 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:16.108297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6e01a582-3cf1-443a-ad7f-cc779cc837dd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:16.110929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6e01a582-3cf1-443a-ad7f-cc779cc837dd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:16.112707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fecd5b9b-0bab-43e6-bc14-b6b40c23a095 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:16.116531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fecd5b9b-0bab-43e6-bc14-b6b40c23a095 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:16.119383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fecd5b9b-0bab-43e6-bc14-b6b40c23a095 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:16.121373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fecd5b9b-0bab-43e6-bc14-b6b40c23a095 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:16.124195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fecd5b9b-0bab-43e6-bc14-b6b40c23a095 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:16.139492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e01a582-3cf1-443a-ad7f-cc779cc837dd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:16.143736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e01a582-3cf1-443a-ad7f-cc779cc837dd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:16.144431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e01a582-3cf1-443a-ad7f-cc779cc837dd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:16.145388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e01a582-3cf1-443a-ad7f-cc779cc837dd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:16.151583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e01a582-3cf1-443a-ad7f-cc779cc837dd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:16.152843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e01a582-3cf1-443a-ad7f-cc779cc837dd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:16.844271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-6e01a582-3cf1-443a-ad7f-cc779cc837dd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid d71f4ec4-18cf-4eae-9e86-4f91f90810f5 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:00:16.902109 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6e01a582-3cf1-443a-ad7f-cc779cc837dd tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1969 microversion: 2.25 time: 0.801670 Aug 23 18:00:16.906844 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1205/2408] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:16 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1969 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:16.913210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-91474b8f-3f83-4541-9ac0-48d32d78bc5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:16.914027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-91474b8f-3f83-4541-9ac0-48d32d78bc5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:16.921413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91474b8f-3f83-4541-9ac0-48d32d78bc5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:16.922137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91474b8f-3f83-4541-9ac0-48d32d78bc5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:16.922767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91474b8f-3f83-4541-9ac0-48d32d78bc5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:16.936293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91474b8f-3f83-4541-9ac0-48d32d78bc5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:16.937172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91474b8f-3f83-4541-9ac0-48d32d78bc5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:16.939569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91474b8f-3f83-4541-9ac0-48d32d78bc5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:17.476166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-91474b8f-3f83-4541-9ac0-48d32d78bc5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:17.488986 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-91474b8f-3f83-4541-9ac0-48d32d78bc5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1363 microversion: 2.1 time: 0.580736 Aug 23 18:00:17.490293 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1206/2409] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:16 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1363 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:17.502997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bacdfbca-de28-4d42-978e-2953ee449128 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ecd97670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:17.608914 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bacdfbca-de28-4d42-978e-2953ee449128 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.116510 Aug 23 18:00:17.609509 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1207/2410] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:17 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:17.630702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b47e7a53-c655-4946-94aa-dd6edae24e57 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:17.631637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b47e7a53-c655-4946-94aa-dd6edae24e57 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:17.642106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b47e7a53-c655-4946-94aa-dd6edae24e57 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:17.656650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b47e7a53-c655-4946-94aa-dd6edae24e57 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:17.657353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b47e7a53-c655-4946-94aa-dd6edae24e57 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:17.658585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b47e7a53-c655-4946-94aa-dd6edae24e57 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:17.667297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b47e7a53-c655-4946-94aa-dd6edae24e57 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:17.667760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b47e7a53-c655-4946-94aa-dd6edae24e57 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:17.884420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-b47e7a53-c655-4946-94aa-dd6edae24e57 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid d71f4ec4-18cf-4eae-9e86-4f91f90810f5 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:00:17.900054 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b47e7a53-c655-4946-94aa-dd6edae24e57 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1969 microversion: 2.25 time: 0.286618 Aug 23 18:00:17.901710 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1208/2411] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:17 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1969 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:17.926118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cc1190ae-6946-424e-a62b-492c38294f83 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:17.931194 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:00:17.931194 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:00:17.936262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc1190ae-6946-424e-a62b-492c38294f83 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:17.939817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc1190ae-6946-424e-a62b-492c38294f83 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:17.940450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc1190ae-6946-424e-a62b-492c38294f83 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:17.941481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc1190ae-6946-424e-a62b-492c38294f83 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:17.943554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc1190ae-6946-424e-a62b-492c38294f83 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:17.944892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc1190ae-6946-424e-a62b-492c38294f83 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:17.984044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:18.024449 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cc1190ae-6946-424e-a62b-492c38294f83 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 426 microversion: 2.25 time: 0.104091 Aug 23 18:00:18.031655 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1209/2412] 10.222.0.61 () {60 vars in 1217 bytes} [Tue Aug 23 18:00:17 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 426 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:00:18.032313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fecd5b9b-0bab-43e6-bc14-b6b40c23a095 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:18.045704 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fecd5b9b-0bab-43e6-bc14-b6b40c23a095 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1486 microversion: 2.1 time: 1.961388 Aug 23 18:00:18.046649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2407e7f2-68d0-4ab2-a7f2-4744028ceeac tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-850468-16", "block_migration": "auto"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:18.050846 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1204/2413] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:16 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1486 bytes in 1967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:18.071132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2407e7f2-68d0-4ab2-a7f2-4744028ceeac tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:18.074804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-69906803-ca54-4610-9623-83d41865d9e8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:18.080114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-69906803-ca54-4610-9623-83d41865d9e8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:18.085742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2407e7f2-68d0-4ab2-a7f2-4744028ceeac tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:18.086724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2407e7f2-68d0-4ab2-a7f2-4744028ceeac tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:18.088330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2407e7f2-68d0-4ab2-a7f2-4744028ceeac tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:18.092014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2407e7f2-68d0-4ab2-a7f2-4744028ceeac tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:18.093913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2407e7f2-68d0-4ab2-a7f2-4744028ceeac tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:18.094033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:18.094571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2407e7f2-68d0-4ab2-a7f2-4744028ceeac tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:18.112992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69906803-ca54-4610-9623-83d41865d9e8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:18.113665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69906803-ca54-4610-9623-83d41865d9e8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:18.119153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69906803-ca54-4610-9623-83d41865d9e8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:18.123859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69906803-ca54-4610-9623-83d41865d9e8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:18.125699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69906803-ca54-4610-9623-83d41865d9e8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:18.127928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69906803-ca54-4610-9623-83d41865d9e8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:18.179165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-2407e7f2-68d0-4ab2-a7f2-4744028ceeac tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'flavor' on Instance uuid d71f4ec4-18cf-4eae-9e86-4f91f90810f5 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:00:18.236177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2407e7f2-68d0-4ab2-a7f2-4744028ceeac tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Going to try to live migrate instance to n-h1-850468-16 {{(pid=128808) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 18:00:18.513373 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-69906803-ca54-4610-9623-83d41865d9e8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "POST /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8/action" status: 202 len: 0 microversion: 2.1 time: 0.435352 Aug 23 18:00:18.519173 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1205/2414] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:00:18 2022] POST /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:00:18.550975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e11b61d6-5c9d-472f-b334-5e8ce83f532c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:18.559702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e11b61d6-5c9d-472f-b334-5e8ce83f532c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:18.596187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e11b61d6-5c9d-472f-b334-5e8ce83f532c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:18.602086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e11b61d6-5c9d-472f-b334-5e8ce83f532c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:18.606121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e11b61d6-5c9d-472f-b334-5e8ce83f532c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:18.608185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e11b61d6-5c9d-472f-b334-5e8ce83f532c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:18.616325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e11b61d6-5c9d-472f-b334-5e8ce83f532c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:18.619603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e11b61d6-5c9d-472f-b334-5e8ce83f532c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:19.697316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e11b61d6-5c9d-472f-b334-5e8ce83f532c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:19.707909 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e11b61d6-5c9d-472f-b334-5e8ce83f532c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1363 microversion: 2.1 time: 1.181993 Aug 23 18:00:19.715684 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1206/2415] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:18 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1363 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:19.728348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66745b00-a6ce-44c8-b56b-7c06cd0c2960 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:19.729182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66745b00-a6ce-44c8-b56b-7c06cd0c2960 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:19.746056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66745b00-a6ce-44c8-b56b-7c06cd0c2960 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:19.746923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66745b00-a6ce-44c8-b56b-7c06cd0c2960 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:19.747530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66745b00-a6ce-44c8-b56b-7c06cd0c2960 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:19.748401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66745b00-a6ce-44c8-b56b-7c06cd0c2960 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:19.749007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66745b00-a6ce-44c8-b56b-7c06cd0c2960 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:19.749583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66745b00-a6ce-44c8-b56b-7c06cd0c2960 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:20.285847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66745b00-a6ce-44c8-b56b-7c06cd0c2960 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:20.305095 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66745b00-a6ce-44c8-b56b-7c06cd0c2960 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 200 len: 1471 microversion: 2.1 time: 0.587637 Aug 23 18:00:20.325969 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1207/2416] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:19 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 1471 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:20.331399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e8a7510a-9968-40aa-91ea-6a299b21580a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27eca46a60>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:20.415856 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e8a7510a-9968-40aa-91ea-6a299b21580a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.088644 Aug 23 18:00:20.418204 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1208/2417] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:20 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:20.430109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f76b4fb4-c534-46b2-b332-0cb1aa2fdf4b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-372318857"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:20.438840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f76b4fb4-c534-46b2-b332-0cb1aa2fdf4b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:20.456652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f76b4fb4-c534-46b2-b332-0cb1aa2fdf4b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:20.459284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f76b4fb4-c534-46b2-b332-0cb1aa2fdf4b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:20.460869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f76b4fb4-c534-46b2-b332-0cb1aa2fdf4b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:20.463210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f76b4fb4-c534-46b2-b332-0cb1aa2fdf4b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:20.464001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f76b4fb4-c534-46b2-b332-0cb1aa2fdf4b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:20.464804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f76b4fb4-c534-46b2-b332-0cb1aa2fdf4b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:20.805515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:20.967975 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f76b4fb4-c534-46b2-b332-0cb1aa2fdf4b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "POST /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8/action" status: 202 len: 0 microversion: 2.1 time: 0.547644 Aug 23 18:00:20.968726 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1209/2418] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:00:20 2022] POST /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8/action => generated 0 bytes in 549 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 18:00:20.999550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9d8108a-a0c1-44c3-87e5-99130bb9ba44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:21.002755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d9d8108a-a0c1-44c3-87e5-99130bb9ba44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:21.016089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9d8108a-a0c1-44c3-87e5-99130bb9ba44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:21.019462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9d8108a-a0c1-44c3-87e5-99130bb9ba44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:21.020118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9d8108a-a0c1-44c3-87e5-99130bb9ba44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:21.023669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9d8108a-a0c1-44c3-87e5-99130bb9ba44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:21.025325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9d8108a-a0c1-44c3-87e5-99130bb9ba44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:21.025945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9d8108a-a0c1-44c3-87e5-99130bb9ba44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:21.326951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d9d8108a-a0c1-44c3-87e5-99130bb9ba44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:21.335795 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d9d8108a-a0c1-44c3-87e5-99130bb9ba44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1550 microversion: 2.1 time: 0.353350 Aug 23 18:00:21.336607 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1210/2419] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:20 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1550 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:21.362411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-15fc4f41-bae2-402b-9337-e9772f9b2b59 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27eca46b80>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:21.481522 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-15fc4f41-bae2-402b-9337-e9772f9b2b59 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 0.143816 Aug 23 18:00:21.490165 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1211/2420] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:21 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:21.512497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e9451ab-9a85-473c-8a82-8b4c1d1712fe tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:21.513013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e9451ab-9a85-473c-8a82-8b4c1d1712fe tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:21.537304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e9451ab-9a85-473c-8a82-8b4c1d1712fe tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:21.537815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e9451ab-9a85-473c-8a82-8b4c1d1712fe tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:21.538252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e9451ab-9a85-473c-8a82-8b4c1d1712fe tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:21.544422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e9451ab-9a85-473c-8a82-8b4c1d1712fe tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:21.544422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e9451ab-9a85-473c-8a82-8b4c1d1712fe tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:21.544422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e9451ab-9a85-473c-8a82-8b4c1d1712fe tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:21.756055 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e9451ab-9a85-473c-8a82-8b4c1d1712fe tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.263823 Aug 23 18:00:21.765281 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1212/2421] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:00:21 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/os-interface => generated 284 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:21.772989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-450cde2e-525e-47e6-b4fe-f7424a21e5bb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec891d30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:21.850074 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-450cde2e-525e-47e6-b4fe-f7424a21e5bb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.082838 Aug 23 18:00:21.851986 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1213/2422] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:21 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:22.369086 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2407e7f2-68d0-4ab2-a7f2-4744028ceeac tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5/action" status: 202 len: 0 microversion: 2.25 time: 4.326351 Aug 23 18:00:22.373760 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1210/2423] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 18:00:18 2022] POST /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5/action => generated 0 bytes in 4332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:00:22.378462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-888dc414-747b-46f9-a7e5-7e85a118540a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:22.379249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-888dc414-747b-46f9-a7e5-7e85a118540a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:22.397895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-888dc414-747b-46f9-a7e5-7e85a118540a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:22.398511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-888dc414-747b-46f9-a7e5-7e85a118540a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:22.399006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-888dc414-747b-46f9-a7e5-7e85a118540a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:22.399851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-888dc414-747b-46f9-a7e5-7e85a118540a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:22.434300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-888dc414-747b-46f9-a7e5-7e85a118540a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:22.435288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-888dc414-747b-46f9-a7e5-7e85a118540a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:22.497758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-28ede175-3e25-4421-a082-47f5b916bb5f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec09d310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:22.630746 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-28ede175-3e25-4421-a082-47f5b916bb5f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 0.137754 Aug 23 18:00:22.643254 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1211/2424] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:22 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:22.866028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fd781019-11ee-4bc9-af49-202b8934c33a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec080940>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:22.969789 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fd781019-11ee-4bc9-af49-202b8934c33a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.107985 Aug 23 18:00:22.980560 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1212/2425] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:22 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:23.518300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-888dc414-747b-46f9-a7e5-7e85a118540a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:23.529693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-888dc414-747b-46f9-a7e5-7e85a118540a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:23.541080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-888dc414-747b-46f9-a7e5-7e85a118540a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:23.542683 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-888dc414-747b-46f9-a7e5-7e85a118540a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 1.168777 Aug 23 18:00:23.543786 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1214/2426] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:22 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:23.657289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d2a5ea16-73ce-4e8a-86b1-9c63d56ead48 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec075040>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:23.778427 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d2a5ea16-73ce-4e8a-86b1-9c63d56ead48 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 0.125028 Aug 23 18:00:23.785524 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1213/2427] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:23 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:23.785734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8a9692ba-6ee5-4858-a6fa-15b88be4ac57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:23.785734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8a9692ba-6ee5-4858-a6fa-15b88be4ac57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:23.803445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a9692ba-6ee5-4858-a6fa-15b88be4ac57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:23.803957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a9692ba-6ee5-4858-a6fa-15b88be4ac57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:23.804500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a9692ba-6ee5-4858-a6fa-15b88be4ac57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:23.814853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a9692ba-6ee5-4858-a6fa-15b88be4ac57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:23.818098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a9692ba-6ee5-4858-a6fa-15b88be4ac57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:23.822799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a9692ba-6ee5-4858-a6fa-15b88be4ac57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:23.915349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8a9692ba-6ee5-4858-a6fa-15b88be4ac57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:00:23.985166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd379fe1-6b4e-43ed-854d-3e6cb524b4c0 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec09aa60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:24.088933 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd379fe1-6b4e-43ed-854d-3e6cb524b4c0 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.107415 Aug 23 18:00:24.089861 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1214/2428] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:23 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:24.126228 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8a9692ba-6ee5-4858-a6fa-15b88be4ac57 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "DELETE /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 204 len: 0 microversion: 2.1 time: 0.348239 Aug 23 18:00:24.126822 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1215/2429] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:00:23 2022] DELETE /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:00:24.134935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-35588259-d731-4549-b25b-61b8b0be0345 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:24.136970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-35588259-d731-4549-b25b-61b8b0be0345 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:24.170294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35588259-d731-4549-b25b-61b8b0be0345 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:24.171449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35588259-d731-4549-b25b-61b8b0be0345 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:24.175028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35588259-d731-4549-b25b-61b8b0be0345 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:24.179111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35588259-d731-4549-b25b-61b8b0be0345 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:24.182867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35588259-d731-4549-b25b-61b8b0be0345 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:24.183952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35588259-d731-4549-b25b-61b8b0be0345 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:24.722940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-35588259-d731-4549-b25b-61b8b0be0345 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:24.736410 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-35588259-d731-4549-b25b-61b8b0be0345 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1666 microversion: 2.1 time: 0.605366 Aug 23 18:00:24.737333 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1215/2430] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:24 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1666 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:24.747046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-25dbdd95-6ee9-400b-ad2f-fe79e2e18f85 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:24.753952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-25dbdd95-6ee9-400b-ad2f-fe79e2e18f85 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:24.777425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25dbdd95-6ee9-400b-ad2f-fe79e2e18f85 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:24.778838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25dbdd95-6ee9-400b-ad2f-fe79e2e18f85 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:24.779473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25dbdd95-6ee9-400b-ad2f-fe79e2e18f85 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:24.780446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25dbdd95-6ee9-400b-ad2f-fe79e2e18f85 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:24.780836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25dbdd95-6ee9-400b-ad2f-fe79e2e18f85 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:24.781289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25dbdd95-6ee9-400b-ad2f-fe79e2e18f85 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:24.784285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:25.119670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-1655261672", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:25.228095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:00:25.701363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:00:25.701455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:00:25.701877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:00:25.703549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:00:25.703986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:00:25.726464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:25.727197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:25.727646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:25.728392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:25.728854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:25.729339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:25.773859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Getting quotas for project f1d6312984574cb09fab8d466302085c. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:00:25.780647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Getting quotas for user a8900a55d4d34136a7728f35ea9e340c and project f1d6312984574cb09fab8d466302085c. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:00:25.817882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:00:25.820644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:00:25.977811 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ad617505-b96d-4daf-b46d-f751cf13efc7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.444545 Aug 23 18:00:25.986752 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1216/2431] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:00:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1454 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:00:26.015113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bdb48e67-6fec-4747-84ce-38839af0429b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ecae0f70>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:26.030640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-25dbdd95-6ee9-400b-ad2f-fe79e2e18f85 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:26.080492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-25dbdd95-6ee9-400b-ad2f-fe79e2e18f85 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:26.088522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-25dbdd95-6ee9-400b-ad2f-fe79e2e18f85 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:26.098255 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-25dbdd95-6ee9-400b-ad2f-fe79e2e18f85 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 1.359317 Aug 23 18:00:26.100082 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1216/2432] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:24 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:26.115695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-33f5caf3-3af7-4894-befc-b566e96ea22d req-1762ca7a-2d0f-46c0-b6d5-7b31560bef52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d81bbbc-0ed1-445b-a321-b2175e975725", "tag": "c9a2077a-21a0-4f0d-846d-bbb4743c4fa4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:26.149731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-33f5caf3-3af7-4894-befc-b566e96ea22d req-1762ca7a-2d0f-46c0-b6d5-7b31560bef52 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:26.153975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-33f5caf3-3af7-4894-befc-b566e96ea22d req-1762ca7a-2d0f-46c0-b6d5-7b31560bef52 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:26.154628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-33f5caf3-3af7-4894-befc-b566e96ea22d req-1762ca7a-2d0f-46c0-b6d5-7b31560bef52 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:26.161861 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bdb48e67-6fec-4747-84ce-38839af0429b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 0.172997 Aug 23 18:00:26.163395 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1217/2433] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:25 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:26.175684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-46c0a6a6-048c-4012-9644-82726b29282a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec303af0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:26.198336 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-33f5caf3-3af7-4894-befc-b566e96ea22d req-1762ca7a-2d0f-46c0-b6d5-7b31560bef52 service nova] Creating event network-changed:c9a2077a-21a0-4f0d-846d-bbb4743c4fa4 for instance 9d81bbbc-0ed1-445b-a321-b2175e975725 on n-h1-850468-16 Aug 23 18:00:26.234921 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-33f5caf3-3af7-4894-befc-b566e96ea22d req-1762ca7a-2d0f-46c0-b6d5-7b31560bef52 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132878 Aug 23 18:00:26.235699 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1217/2434] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:26.261040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-18cc06d3-7a6f-46f4-b3f1-73decc1dbf2d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:26.275599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-18cc06d3-7a6f-46f4-b3f1-73decc1dbf2d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:26.289634 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-46c0a6a6-048c-4012-9644-82726b29282a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.124851 Aug 23 18:00:26.290566 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1218/2435] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:26 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:26.298477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18cc06d3-7a6f-46f4-b3f1-73decc1dbf2d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:26.300576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18cc06d3-7a6f-46f4-b3f1-73decc1dbf2d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:26.302834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18cc06d3-7a6f-46f4-b3f1-73decc1dbf2d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:26.305709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18cc06d3-7a6f-46f4-b3f1-73decc1dbf2d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:26.311211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18cc06d3-7a6f-46f4-b3f1-73decc1dbf2d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:26.312688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a88af5e-7a43-48f2-a9db-bbda828ea5af tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:26.313217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18cc06d3-7a6f-46f4-b3f1-73decc1dbf2d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:26.315071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a88af5e-7a43-48f2-a9db-bbda828ea5af tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:26.749193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a88af5e-7a43-48f2-a9db-bbda828ea5af tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:26.762404 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a88af5e-7a43-48f2-a9db-bbda828ea5af tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1214 microversion: 2.1 time: 0.469767 Aug 23 18:00:26.764907 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1219/2436] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:26 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1214 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:27.098048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-18cc06d3-7a6f-46f4-b3f1-73decc1dbf2d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:27.120686 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-18cc06d3-7a6f-46f4-b3f1-73decc1dbf2d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1666 microversion: 2.1 time: 0.878463 Aug 23 18:00:27.128602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b5e62123-474a-460e-9fac-ed03e48ab25e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:27.130089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b5e62123-474a-460e-9fac-ed03e48ab25e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:27.130348 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1218/2437] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:26 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1666 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:27.141099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5e62123-474a-460e-9fac-ed03e48ab25e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:27.141693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5e62123-474a-460e-9fac-ed03e48ab25e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:27.142245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5e62123-474a-460e-9fac-ed03e48ab25e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:27.143164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5e62123-474a-460e-9fac-ed03e48ab25e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:27.143697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5e62123-474a-460e-9fac-ed03e48ab25e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:27.144421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5e62123-474a-460e-9fac-ed03e48ab25e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:27.185450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7d9aa1a-4f91-4c1e-81d8-e667be79ca8e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ed0e00d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:27.282407 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c7d9aa1a-4f91-4c1e-81d8-e667be79ca8e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 0.108568 Aug 23 18:00:27.285130 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1219/2438] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:27 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:27.310503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-61938639-6049-4de9-a384-3f5da8e9561a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec075a60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:27.415493 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-61938639-6049-4de9-a384-3f5da8e9561a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.112031 Aug 23 18:00:27.418646 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1220/2439] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:27 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:27.798091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b5f4692e-cfe9-4ba3-981a-fc642472a451 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:27.800507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b5f4692e-cfe9-4ba3-981a-fc642472a451 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:27.827292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5f4692e-cfe9-4ba3-981a-fc642472a451 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:27.828381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5f4692e-cfe9-4ba3-981a-fc642472a451 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:27.830699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5f4692e-cfe9-4ba3-981a-fc642472a451 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:27.834652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5f4692e-cfe9-4ba3-981a-fc642472a451 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:27.839108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5f4692e-cfe9-4ba3-981a-fc642472a451 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:27.841836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5f4692e-cfe9-4ba3-981a-fc642472a451 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:27.965869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:28.041740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b5f4692e-cfe9-4ba3-981a-fc642472a451 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:28.056042 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b5f4692e-cfe9-4ba3-981a-fc642472a451 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1266 microversion: 2.1 time: 0.274128 Aug 23 18:00:28.059746 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1221/2440] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:27 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:28.153836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1d427c41-a035-4e1f-bb7e-a65f60c9dd53 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:28.154467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1d427c41-a035-4e1f-bb7e-a65f60c9dd53 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:28.171584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d427c41-a035-4e1f-bb7e-a65f60c9dd53 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:28.187587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d427c41-a035-4e1f-bb7e-a65f60c9dd53 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:28.195248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d427c41-a035-4e1f-bb7e-a65f60c9dd53 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:28.198024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d427c41-a035-4e1f-bb7e-a65f60c9dd53 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:28.202320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d427c41-a035-4e1f-bb7e-a65f60c9dd53 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:28.204366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d427c41-a035-4e1f-bb7e-a65f60c9dd53 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:28.577003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d427c41-a035-4e1f-bb7e-a65f60c9dd53 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:28.597521 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1d427c41-a035-4e1f-bb7e-a65f60c9dd53 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1599 microversion: 2.1 time: 0.446901 Aug 23 18:00:28.619283 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1222/2441] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:28 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1599 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:28.650914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce97aef9-694c-4413-a0cf-c3a7aaab3f00 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec7504c0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:28.685565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b5e62123-474a-460e-9fac-ed03e48ab25e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:28.701069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b5e62123-474a-460e-9fac-ed03e48ab25e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:28.710965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b5e62123-474a-460e-9fac-ed03e48ab25e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:28.727431 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b5e62123-474a-460e-9fac-ed03e48ab25e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 1.600654 Aug 23 18:00:28.731296 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1220/2442] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:27 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 1608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:28.748807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a08fbb26-dd70-4ca5-a675-00a7815bd7c6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27dfd6fe50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:29.111103 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce97aef9-694c-4413-a0cf-c3a7aaab3f00 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 0.490778 Aug 23 18:00:29.112461 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1223/2443] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:28 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:29.141461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8cf414c6-3c41-4bc0-8ed1-289413ee8fc6 req-c7b07689-f5d9-4f33-9387-543683b4f718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28b3cf3a-784f-48f6-9ee3-1e98f527d4aa", "name": "network-vif-deleted", "tag": "e7e8c36a-a65f-4586-97ce-22fec636459f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:29.177440 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a08fbb26-dd70-4ca5-a675-00a7815bd7c6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1453 microversion: 2.1 time: 0.443791 Aug 23 18:00:29.182461 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1221/2444] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:28 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1453 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:29.221525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8cf414c6-3c41-4bc0-8ed1-289413ee8fc6 req-c7b07689-f5d9-4f33-9387-543683b4f718 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:29.222589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c0ff1a53-9317-4019-bdcf-f9646f6c2931 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:29.224015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c0ff1a53-9317-4019-bdcf-f9646f6c2931 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:29.228034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8cf414c6-3c41-4bc0-8ed1-289413ee8fc6 req-c7b07689-f5d9-4f33-9387-543683b4f718 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:29.234277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8cf414c6-3c41-4bc0-8ed1-289413ee8fc6 req-c7b07689-f5d9-4f33-9387-543683b4f718 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:29.270794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0ff1a53-9317-4019-bdcf-f9646f6c2931 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:29.271461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0ff1a53-9317-4019-bdcf-f9646f6c2931 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:29.271924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0ff1a53-9317-4019-bdcf-f9646f6c2931 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:29.279751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0ff1a53-9317-4019-bdcf-f9646f6c2931 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:29.280314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0ff1a53-9317-4019-bdcf-f9646f6c2931 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:29.289720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0ff1a53-9317-4019-bdcf-f9646f6c2931 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:29.313498 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8cf414c6-3c41-4bc0-8ed1-289413ee8fc6 req-c7b07689-f5d9-4f33-9387-543683b4f718 service nova] Creating event network-vif-deleted:e7e8c36a-a65f-4586-97ce-22fec636459f for instance 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa on n-h1-850468-16 Aug 23 18:00:29.343242 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8cf414c6-3c41-4bc0-8ed1-289413ee8fc6 req-c7b07689-f5d9-4f33-9387-543683b4f718 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225305 Aug 23 18:00:29.350224 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1224/2445] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:29.624549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:29.625971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:29.648625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:29.650910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:29.651457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:29.652261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:29.656867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:29.660333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:29.755669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c0ff1a53-9317-4019-bdcf-f9646f6c2931 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:29.794420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:29.794978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:29.799617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:29.800143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lazy-loading 'fault' on Instance uuid 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:00:29.808498 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c0ff1a53-9317-4019-bdcf-f9646f6c2931 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1284 microversion: 2.1 time: 0.622040 Aug 23 18:00:29.811215 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1222/2446] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:29 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1284 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:29.849888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6759e5d3-d485-4c79-ab2d-95e523ab0d88 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:29.853883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6759e5d3-d485-4c79-ab2d-95e523ab0d88 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:29.890169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6759e5d3-d485-4c79-ab2d-95e523ab0d88 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:29.892163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6759e5d3-d485-4c79-ab2d-95e523ab0d88 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:29.894099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6759e5d3-d485-4c79-ab2d-95e523ab0d88 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:29.898118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6759e5d3-d485-4c79-ab2d-95e523ab0d88 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:29.900254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6759e5d3-d485-4c79-ab2d-95e523ab0d88 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:29.900974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6759e5d3-d485-4c79-ab2d-95e523ab0d88 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:30.538671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6759e5d3-d485-4c79-ab2d-95e523ab0d88 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:30.559978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6759e5d3-d485-4c79-ab2d-95e523ab0d88 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:30.563118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6759e5d3-d485-4c79-ab2d-95e523ab0d88 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:30.581630 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6759e5d3-d485-4c79-ab2d-95e523ab0d88 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.755142 Aug 23 18:00:30.603158 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1223/2447] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:29 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:30.621523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-99a14924-da48-4102-a34a-51e2b627225c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfd6faf0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:31.067250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:31.081176 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dfb959ee-029e-4b26-8315-386c8a1c201d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 200 len: 1324 microversion: 2.1 time: 1.462250 Aug 23 18:00:31.089787 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1225/2448] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:29 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 1324 bytes in 1474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:31.103606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3f44963a-89e4-4f1b-81ec-9b3cb9d41e37 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec845820>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:35.752006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:36.755386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:39.233782 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-99a14924-da48-4102-a34a-51e2b627225c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 8.629015 Aug 23 18:00:39.237124 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1224/2449] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:30 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 8633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:39.247166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-557333e3-5eb0-487d-9c11-3d786adddf3b req-df10cd85-aad4-4320-827f-05b7c980fe66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b43649-db0d-42b6-a207-a8c75fc2a5a8", "name": "network-vif-plugged", "status": "completed", "tag": "34cfa4d3-ec0b-4ef7-a39c-ad4233274c24"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:39.261721 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3f44963a-89e4-4f1b-81ec-9b3cb9d41e37 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1462 microversion: 2.1 time: 8.169940 Aug 23 18:00:39.264380 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1226/2450] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:31 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1462 bytes in 8173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:39.281557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-59aed366-edb4-4fcc-a583-f32c84c46450 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:39.283522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-59aed366-edb4-4fcc-a583-f32c84c46450 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:39.295924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-557333e3-5eb0-487d-9c11-3d786adddf3b req-df10cd85-aad4-4320-827f-05b7c980fe66 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:39.296963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-557333e3-5eb0-487d-9c11-3d786adddf3b req-df10cd85-aad4-4320-827f-05b7c980fe66 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:39.297571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-557333e3-5eb0-487d-9c11-3d786adddf3b req-df10cd85-aad4-4320-827f-05b7c980fe66 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:39.302518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59aed366-edb4-4fcc-a583-f32c84c46450 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:39.304973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59aed366-edb4-4fcc-a583-f32c84c46450 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:39.305650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59aed366-edb4-4fcc-a583-f32c84c46450 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:39.307860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59aed366-edb4-4fcc-a583-f32c84c46450 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:39.310631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59aed366-edb4-4fcc-a583-f32c84c46450 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:39.313313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59aed366-edb4-4fcc-a583-f32c84c46450 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:39.324287 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-557333e3-5eb0-487d-9c11-3d786adddf3b req-df10cd85-aad4-4320-827f-05b7c980fe66 service nova] Creating event network-vif-plugged:34cfa4d3-ec0b-4ef7-a39c-ad4233274c24 for instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 on n-h2-850468-16 Aug 23 18:00:39.339696 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-557333e3-5eb0-487d-9c11-3d786adddf3b req-df10cd85-aad4-4320-827f-05b7c980fe66 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100677 Aug 23 18:00:39.340837 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1225/2451] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:39.355955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-879d9b3e-3201-4783-b10d-0594a3ef544a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:39.360315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-879d9b3e-3201-4783-b10d-0594a3ef544a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:39.375234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-879d9b3e-3201-4783-b10d-0594a3ef544a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:39.375962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-879d9b3e-3201-4783-b10d-0594a3ef544a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:39.376567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-879d9b3e-3201-4783-b10d-0594a3ef544a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:39.377444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-879d9b3e-3201-4783-b10d-0594a3ef544a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:39.381721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-879d9b3e-3201-4783-b10d-0594a3ef544a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:39.386148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-879d9b3e-3201-4783-b10d-0594a3ef544a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:39.538845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-59aed366-edb4-4fcc-a583-f32c84c46450 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:39.548407 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-59aed366-edb4-4fcc-a583-f32c84c46450 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1314 microversion: 2.1 time: 0.281624 Aug 23 18:00:39.549267 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1227/2452] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:39 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:39.554888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6114e4b5-4f9e-4c18-9e7c-7c10d0c954e0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:39.555702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6114e4b5-4f9e-4c18-9e7c-7c10d0c954e0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:39.562163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6114e4b5-4f9e-4c18-9e7c-7c10d0c954e0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:39.562704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6114e4b5-4f9e-4c18-9e7c-7c10d0c954e0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:39.563114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6114e4b5-4f9e-4c18-9e7c-7c10d0c954e0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:39.563825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6114e4b5-4f9e-4c18-9e7c-7c10d0c954e0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:39.564274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6114e4b5-4f9e-4c18-9e7c-7c10d0c954e0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:39.564692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6114e4b5-4f9e-4c18-9e7c-7c10d0c954e0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:39.582004 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-6114e4b5-4f9e-4c18-9e7c-7c10d0c954e0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] HTTP exception thrown: Instance 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa could not be found. Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6114e4b5-4f9e-4c18-9e7c-7c10d0c954e0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Request method failure captured: Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa HTTP/1.1 Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPX1elqyNQ4auLp1EnHhwwe0OquV4esq_oPU2GgqJPFLYFGAgTS81hhHztTDZGZMFyvI6Cje-7fDA8Q4c9PbVVsfbnEFm_f9R-Rmuv_43mkyGpay-W4P6rIcGCnNV_XeiNFDnbdcwmAaNZXsW4quZfUCluZ-lRR0zovphSc8VT2IXg Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 5bbd01aaed704a1b8509e754d19a4b8d Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-LiveMigrationTest-1735186488 Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5bbd01aaed704a1b8509e754d19a4b8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5bbd01aaed704a1b8509e754d19a4b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5bbd01aaed704a1b8509e754d19a4b8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5bbd01aaed704a1b8509e754d19a4b8d"}]}] Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-LiveMigrationTest-1735186488 Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 5bbd01aaed704a1b8509e754d19a4b8d Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-LiveMigrationTest-1735186488 Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-LiveMigrationTest-1735186488-project Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 0ef389420da8493386a7f8dfb747afab Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-LiveMigrationTest-1735186488-project Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa could not be found. Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '28b3cf3a-784f-48f6-9ee3-1e98f527d4aa'} Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa could not be found. Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa could not be found. Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:00:39.584264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:39.588546 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:39.588546 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:00:39.588546 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:00:39.588546 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:00:39.588546 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:00:39.588546 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa could not be found. Aug 23 18:00:39.588546 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:39.588546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6114e4b5-4f9e-4c18-9e7c-7c10d0c954e0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Returning 404 to user: Instance 28b3cf3a-784f-48f6-9ee3-1e98f527d4aa could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:00:39.588546 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6114e4b5-4f9e-4c18-9e7c-7c10d0c954e0 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa" status: 404 len: 111 microversion: 2.1 time: 0.035210 Aug 23 18:00:39.588546 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1228/2453] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:39 2022] GET /compute/v2.1/servers/28b3cf3a-784f-48f6-9ee3-1e98f527d4aa => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:00:39.596807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-09b73983-7ca2-4ee4-b9d4-605402f36bd8 req-4e21eb9d-8899-4f67-93ef-5f6481ad7c9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "76eee58f-0ee8-4ac2-934a-e1415e982b89", "tag": "e42e73af-2684-41c7-833c-db9401c4b0d5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:39.609980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-09b73983-7ca2-4ee4-b9d4-605402f36bd8 req-4e21eb9d-8899-4f67-93ef-5f6481ad7c9e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:39.610789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-09b73983-7ca2-4ee4-b9d4-605402f36bd8 req-4e21eb9d-8899-4f67-93ef-5f6481ad7c9e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:39.612184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-09b73983-7ca2-4ee4-b9d4-605402f36bd8 req-4e21eb9d-8899-4f67-93ef-5f6481ad7c9e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:39.645679 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-09b73983-7ca2-4ee4-b9d4-605402f36bd8 req-4e21eb9d-8899-4f67-93ef-5f6481ad7c9e service nova] Creating event network-changed:e42e73af-2684-41c7-833c-db9401c4b0d5 for instance 76eee58f-0ee8-4ac2-934a-e1415e982b89 on n-h1-850468-16 Aug 23 18:00:39.652119 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-09b73983-7ca2-4ee4-b9d4-605402f36bd8 req-4e21eb9d-8899-4f67-93ef-5f6481ad7c9e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064626 Aug 23 18:00:39.652722 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1229/2454] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:39.658802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-43312381-f34a-4371-b317-06159173f3f0 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec8e3dc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:39.708934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-879d9b3e-3201-4783-b10d-0594a3ef544a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:39.720609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-879d9b3e-3201-4783-b10d-0594a3ef544a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:39.736008 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-43312381-f34a-4371-b317-06159173f3f0 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 200 len: 1462 microversion: 2.1 time: 0.082074 Aug 23 18:00:39.736864 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1230/2455] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:39 2022] GET /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 1462 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:39.738381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-879d9b3e-3201-4783-b10d-0594a3ef544a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:39.743064 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-879d9b3e-3201-4783-b10d-0594a3ef544a tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.395776 Aug 23 18:00:39.745374 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1226/2456] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:39 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:39.751780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6e13d650-3ebf-48f0-ba8b-b1d9e4968ee3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '.version_select at 0x7f27ec075430>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:39.758487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77340619-01e2-446f-bfad-c72d1e2346cc tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:39.759331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-77340619-01e2-446f-bfad-c72d1e2346cc tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:39.773705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77340619-01e2-446f-bfad-c72d1e2346cc tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:39.774761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77340619-01e2-446f-bfad-c72d1e2346cc tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:39.776550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77340619-01e2-446f-bfad-c72d1e2346cc tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:39.779366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77340619-01e2-446f-bfad-c72d1e2346cc tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:39.780001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77340619-01e2-446f-bfad-c72d1e2346cc tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:39.781490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77340619-01e2-446f-bfad-c72d1e2346cc tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:39.795420 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6e13d650-3ebf-48f0-ba8b-b1d9e4968ee3 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-155021394" status: 202 len: 0 microversion: 2.1 time: 0.057213 Aug 23 18:00:39.796340 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1231/2457] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Aug 23 18:00:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-155021394 => generated 0 bytes in 59 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:00:40.141314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-77340619-01e2-446f-bfad-c72d1e2346cc tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:40.173992 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-77340619-01e2-446f-bfad-c72d1e2346cc tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c" status: 200 len: 1480 microversion: 2.1 time: 0.423671 Aug 23 18:00:40.174921 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1227/2458] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:39 2022] GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c => generated 1480 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:40.253636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-999c674a-7900-4e49-951b-4255f9d54573 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec075ee0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:40.321369 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-999c674a-7900-4e49-951b-4255f9d54573 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 0.072602 Aug 23 18:00:40.322933 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1232/2459] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:40 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:40.570458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9d8a7fb-2d94-4a33-a0a4-f6d8b4f3e25d tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:40.571694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d9d8a7fb-2d94-4a33-a0a4-f6d8b4f3e25d tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:40.580698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9d8a7fb-2d94-4a33-a0a4-f6d8b4f3e25d tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:40.581521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9d8a7fb-2d94-4a33-a0a4-f6d8b4f3e25d tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:40.582159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9d8a7fb-2d94-4a33-a0a4-f6d8b4f3e25d tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:40.583175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9d8a7fb-2d94-4a33-a0a4-f6d8b4f3e25d tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:40.583856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9d8a7fb-2d94-4a33-a0a4-f6d8b4f3e25d tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:40.584731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9d8a7fb-2d94-4a33-a0a4-f6d8b4f3e25d tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:40.744975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e26b27a-7b14-451f-a269-90383cce0f6b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:40.745760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e26b27a-7b14-451f-a269-90383cce0f6b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:40.753985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e26b27a-7b14-451f-a269-90383cce0f6b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:40.754522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e26b27a-7b14-451f-a269-90383cce0f6b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:40.755184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e26b27a-7b14-451f-a269-90383cce0f6b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:40.756191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e26b27a-7b14-451f-a269-90383cce0f6b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:40.756803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e26b27a-7b14-451f-a269-90383cce0f6b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:40.757372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e26b27a-7b14-451f-a269-90383cce0f6b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:40.792140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e26b27a-7b14-451f-a269-90383cce0f6b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:00:40.908063 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e26b27a-7b14-451f-a269-90383cce0f6b tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "DELETE /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 204 len: 0 microversion: 2.1 time: 0.166562 Aug 23 18:00:40.909343 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1233/2460] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:00:40 2022] DELETE /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:00:40.917666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7a6d9e76-7752-436d-98cb-65eda6145d7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:40.918785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7a6d9e76-7752-436d-98cb-65eda6145d7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:40.925722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a6d9e76-7752-436d-98cb-65eda6145d7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:40.927221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a6d9e76-7752-436d-98cb-65eda6145d7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:40.927928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a6d9e76-7752-436d-98cb-65eda6145d7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:40.929114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a6d9e76-7752-436d-98cb-65eda6145d7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:40.929941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a6d9e76-7752-436d-98cb-65eda6145d7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:40.930729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a6d9e76-7752-436d-98cb-65eda6145d7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:41.111845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a6d9e76-7752-436d-98cb-65eda6145d7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:41.130574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a6d9e76-7752-436d-98cb-65eda6145d7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:41.138966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a6d9e76-7752-436d-98cb-65eda6145d7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:41.141789 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7a6d9e76-7752-436d-98cb-65eda6145d7e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.230277 Aug 23 18:00:41.159112 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1234/2461] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:40 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:41.184501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a3ee992b-febb-4795-b06a-f513b6eb3823 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:41.185729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a3ee992b-febb-4795-b06a-f513b6eb3823 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:41.199815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3ee992b-febb-4795-b06a-f513b6eb3823 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:41.200674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3ee992b-febb-4795-b06a-f513b6eb3823 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:41.201222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3ee992b-febb-4795-b06a-f513b6eb3823 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:41.202571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3ee992b-febb-4795-b06a-f513b6eb3823 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:41.204025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3ee992b-febb-4795-b06a-f513b6eb3823 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:41.204756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3ee992b-febb-4795-b06a-f513b6eb3823 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:41.387622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d9d8a7fb-2d94-4a33-a0a4-f6d8b4f3e25d tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:41.404708 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d9d8a7fb-2d94-4a33-a0a4-f6d8b4f3e25d tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1314 microversion: 2.1 time: 0.838885 Aug 23 18:00:41.406512 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1228/2462] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:40 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1314 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:41.417119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83bda512-4329-47c5-8efd-e191e263f572 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:41.418125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-83bda512-4329-47c5-8efd-e191e263f572 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:41.429277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83bda512-4329-47c5-8efd-e191e263f572 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:41.430151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83bda512-4329-47c5-8efd-e191e263f572 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:41.430866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83bda512-4329-47c5-8efd-e191e263f572 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:41.431850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83bda512-4329-47c5-8efd-e191e263f572 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:41.433144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83bda512-4329-47c5-8efd-e191e263f572 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:41.433996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83bda512-4329-47c5-8efd-e191e263f572 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:41.770956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a3ee992b-febb-4795-b06a-f513b6eb3823 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:41.800776 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a3ee992b-febb-4795-b06a-f513b6eb3823 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1485 microversion: 2.1 time: 0.639306 Aug 23 18:00:41.800776 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1235/2463] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:41 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1485 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:41.805879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7cbd581-846e-4fb5-8cf0-bcf87d4b1ee3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec80d310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:41.899588 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7cbd581-846e-4fb5-8cf0-bcf87d4b1ee3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 0.099213 Aug 23 18:00:41.908928 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1236/2464] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:41 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:41.948677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-83bda512-4329-47c5-8efd-e191e263f572 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:41.984993 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-83bda512-4329-47c5-8efd-e191e263f572 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c" status: 200 len: 1467 microversion: 2.1 time: 0.576903 Aug 23 18:00:42.002887 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1229/2465] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:41 2022] GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c => generated 1467 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:42.014737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-57be62ba-c7cc-4334-8df8-38f1ec1f757b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec0800d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:42.173735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dd051115-77f0-42b2-aa92-8c70bbebc187 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:42.175772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dd051115-77f0-42b2-aa92-8c70bbebc187 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:42.189261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd051115-77f0-42b2-aa92-8c70bbebc187 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:42.197905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd051115-77f0-42b2-aa92-8c70bbebc187 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:42.198498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd051115-77f0-42b2-aa92-8c70bbebc187 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:42.199899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd051115-77f0-42b2-aa92-8c70bbebc187 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:42.200612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd051115-77f0-42b2-aa92-8c70bbebc187 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:42.201253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd051115-77f0-42b2-aa92-8c70bbebc187 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:42.217867 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-57be62ba-c7cc-4334-8df8-38f1ec1f757b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images?changes-since=2022-08-23T17%3A58%3A00Z" status: 200 len: 1901 microversion: 2.1 time: 0.209705 Aug 23 18:00:42.219126 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1237/2466] 10.222.0.61 () {58 vars in 1199 bytes} [Tue Aug 23 18:00:42 2022] GET /compute/v2.1/images?changes-since=2022-08-23T17%3A58%3A00Z => generated 1901 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:42.236469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a5dd1900-8550-45b7-8a0b-5aae52360cb7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec845af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:42.341390 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a5dd1900-8550-45b7-8a0b-5aae52360cb7 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2084209155" status: 200 len: 485 microversion: 2.1 time: 0.109122 Aug 23 18:00:42.342700 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1238/2467] 10.222.0.61 () {58 vars in 1231 bytes} [Tue Aug 23 18:00:42 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2084209155 => generated 485 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:42.361010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1b63b004-9954-4df5-81a7-b20eef58151b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec03d8b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:42.497853 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1b63b004-9954-4df5-81a7-b20eef58151b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images?server=1f47e601-36d6-4b1f-a4bf-8020bf69831c" status: 200 len: 956 microversion: 2.1 time: 0.143634 Aug 23 18:00:42.499194 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1239/2468] 10.222.0.61 () {58 vars in 1209 bytes} [Tue Aug 23 18:00:42 2022] GET /compute/v2.1/images?server=1f47e601-36d6-4b1f-a4bf-8020bf69831c => generated 956 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:42.507974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-56f8c4ae-fd2b-485f-9b60-36748c13d23f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:42.509157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-56f8c4ae-fd2b-485f-9b60-36748c13d23f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:42.520876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56f8c4ae-fd2b-485f-9b60-36748c13d23f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:42.522202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56f8c4ae-fd2b-485f-9b60-36748c13d23f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:42.523412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56f8c4ae-fd2b-485f-9b60-36748c13d23f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:42.524813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56f8c4ae-fd2b-485f-9b60-36748c13d23f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:42.525599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56f8c4ae-fd2b-485f-9b60-36748c13d23f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:42.526432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56f8c4ae-fd2b-485f-9b60-36748c13d23f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:42.604456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dd051115-77f0-42b2-aa92-8c70bbebc187 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:42.617565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dd051115-77f0-42b2-aa92-8c70bbebc187 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:42.627404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dd051115-77f0-42b2-aa92-8c70bbebc187 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:42.628647 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dd051115-77f0-42b2-aa92-8c70bbebc187 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.462975 Aug 23 18:00:42.630786 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1230/2469] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:42 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:00:42.639350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1a0867d1-0cc5-4eeb-92f3-0effab93629e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27dfd7be50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:42.731321 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1a0867d1-0cc5-4eeb-92f3-0effab93629e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fv2.1%2Fservers%2Fce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 484 microversion: 2.1 time: 0.098304 Aug 23 18:00:42.742627 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1231/2470] 10.222.0.61 () {58 vars in 1317 bytes} [Tue Aug 23 18:00:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fv2.1%2Fservers%2Fce1045a1-9999-4f13-82da-906bf1d0654c => generated 484 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:42.748264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b1eb963c-7d39-456e-ba1b-9ba5ecbdf9f6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec9e9040>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:42.845376 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b1eb963c-7d39-456e-ba1b-9ba5ecbdf9f6 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fservers%2Fce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 484 microversion: 2.1 time: 0.101064 Aug 23 18:00:42.854860 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1232/2471] 10.222.0.61 () {58 vars in 1303 bytes} [Tue Aug 23 18:00:42 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fservers%2Fce1045a1-9999-4f13-82da-906bf1d0654c => generated 484 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:42.860157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f545fd1d-d272-4478-9b22-ad7ccb50da1d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:42.861068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f545fd1d-d272-4478-9b22-ad7ccb50da1d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:42.868006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f545fd1d-d272-4478-9b22-ad7ccb50da1d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:42.869207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f545fd1d-d272-4478-9b22-ad7ccb50da1d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:42.869834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f545fd1d-d272-4478-9b22-ad7ccb50da1d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:42.870779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f545fd1d-d272-4478-9b22-ad7ccb50da1d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:42.871428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f545fd1d-d272-4478-9b22-ad7ccb50da1d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:42.872040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f545fd1d-d272-4478-9b22-ad7ccb50da1d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:42.958422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-56f8c4ae-fd2b-485f-9b60-36748c13d23f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:42.974612 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-56f8c4ae-fd2b-485f-9b60-36748c13d23f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1314 microversion: 2.1 time: 0.472608 Aug 23 18:00:42.989284 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1240/2472] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:42 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1314 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:42.995770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-444de892-fb35-43ea-9a5b-aea1f1c489fc tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec75a0d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:43.199299 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-444de892-fb35-43ea-9a5b-aea1f1c489fc tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3279 microversion: 2.1 time: 0.208115 Aug 23 18:00:43.210507 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1241/2473] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Aug 23 18:00:42 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3279 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:43.218381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cbe05a7f-6836-4963-a1d5-5734003cf060 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec60baf0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:43.283544 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cbe05a7f-6836-4963-a1d5-5734003cf060 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 0.071538 Aug 23 18:00:43.284710 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1242/2474] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:43 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:43.290079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e507ab03-32fb-4953-a44f-42d58b72be32 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec7f5c10>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:43.388487 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e507ab03-32fb-4953-a44f-42d58b72be32 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1428 microversion: 2.1 time: 0.102184 Aug 23 18:00:43.405985 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1243/2475] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Aug 23 18:00:43 2022] GET /compute/v2.1/images?type=snapshot => generated 1428 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:43.413833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-195647e2-0005-44eb-b106-c26f67c86bc9 req-d6683b82-f9e6-44c7-9bfe-6389f313980c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f47e601-36d6-4b1f-a4bf-8020bf69831c", "name": "network-vif-unplugged", "status": "completed", "tag": "4838606c-edcc-47d0-96e3-cce31a7cb847"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:43.427234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-195647e2-0005-44eb-b106-c26f67c86bc9 req-d6683b82-f9e6-44c7-9bfe-6389f313980c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:43.428304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-195647e2-0005-44eb-b106-c26f67c86bc9 req-d6683b82-f9e6-44c7-9bfe-6389f313980c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:43.428988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-195647e2-0005-44eb-b106-c26f67c86bc9 req-d6683b82-f9e6-44c7-9bfe-6389f313980c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:43.446718 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-195647e2-0005-44eb-b106-c26f67c86bc9 req-d6683b82-f9e6-44c7-9bfe-6389f313980c service nova] Creating event network-vif-unplugged:4838606c-edcc-47d0-96e3-cce31a7cb847 for instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c on n-h2-850468-16 Aug 23 18:00:43.452804 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-195647e2-0005-44eb-b106-c26f67c86bc9 req-d6683b82-f9e6-44c7-9bfe-6389f313980c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045418 Aug 23 18:00:43.454942 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1244/2476] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:43.465158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c96f2fd8-b9f0-4b61-8e2d-e8107a4a4fdb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec075c10>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:43.536665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f545fd1d-d272-4478-9b22-ad7ccb50da1d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:43.559898 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f545fd1d-d272-4478-9b22-ad7ccb50da1d tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1485 microversion: 2.1 time: 0.703572 Aug 23 18:00:43.564913 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1233/2477] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:42 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1485 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:43.642267 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c96f2fd8-b9f0-4b61-8e2d-e8107a4a4fdb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.185538 Aug 23 18:00:43.642885 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1245/2478] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 18:00:43 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:43.658134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ecc56983-8e79-4395-ace3-622a913cd5b5 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27dfd7b670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:43.667258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a215d945-1aac-48ff-8e4a-20c798739321 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:43.668024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a215d945-1aac-48ff-8e4a-20c798739321 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:43.676282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a215d945-1aac-48ff-8e4a-20c798739321 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:43.676785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a215d945-1aac-48ff-8e4a-20c798739321 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:43.677233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a215d945-1aac-48ff-8e4a-20c798739321 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:43.677947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a215d945-1aac-48ff-8e4a-20c798739321 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:43.678407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a215d945-1aac-48ff-8e4a-20c798739321 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:43.678863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a215d945-1aac-48ff-8e4a-20c798739321 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:43.835362 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ecc56983-8e79-4395-ace3-622a913cd5b5 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/detail?changes-since=2022-08-23T17%3A57%3A54Z" status: 200 len: 6326 microversion: 2.1 time: 0.182339 Aug 23 18:00:43.854802 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1234/2479] 10.222.0.61 () {58 vars in 1220 bytes} [Tue Aug 23 18:00:43 2022] GET /compute/v2.1/images/detail?changes-since=2022-08-23T17%3A57%3A54Z => generated 6326 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:43.884908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9bc02889-3feb-4c4b-a034-837d8b244462 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27f1af4550>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:44.012312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a215d945-1aac-48ff-8e4a-20c798739321 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:44.029396 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9bc02889-3feb-4c4b-a034-837d8b244462 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2084209155" status: 200 len: 665 microversion: 2.1 time: 0.169483 Aug 23 18:00:44.041580 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1235/2480] 10.222.0.61 () {58 vars in 1252 bytes} [Tue Aug 23 18:00:43 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2084209155 => generated 665 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:44.041806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a215d945-1aac-48ff-8e4a-20c798739321 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:44.048321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a215d945-1aac-48ff-8e4a-20c798739321 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:44.056837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-84effe57-7bd1-44f3-a14f-018a6b8f5475 req-7f991d74-c095-41e3-9229-a03c7b8bde7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cdfabf0c-2561-40d0-9f96-f81d60908fec", "name": "network-vif-deleted", "tag": "cf4c929b-222c-42c4-b117-5dea5790b383"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:44.057653 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a215d945-1aac-48ff-8e4a-20c798739321 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.392829 Aug 23 18:00:44.059397 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1246/2481] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:43 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:44.080280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-84effe57-7bd1-44f3-a14f-018a6b8f5475 req-7f991d74-c095-41e3-9229-a03c7b8bde7a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:44.080990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-84effe57-7bd1-44f3-a14f-018a6b8f5475 req-7f991d74-c095-41e3-9229-a03c7b8bde7a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:44.081593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-84effe57-7bd1-44f3-a14f-018a6b8f5475 req-7f991d74-c095-41e3-9229-a03c7b8bde7a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:44.093175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-31887676-d361-4010-8c8c-4db4a19d1fd7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:44.093860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-31887676-d361-4010-8c8c-4db4a19d1fd7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:44.096675 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-84effe57-7bd1-44f3-a14f-018a6b8f5475 req-7f991d74-c095-41e3-9229-a03c7b8bde7a service nova] Creating event network-vif-deleted:cf4c929b-222c-42c4-b117-5dea5790b383 for instance cdfabf0c-2561-40d0-9f96-f81d60908fec on n-h1-850468-16 Aug 23 18:00:44.109304 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-84effe57-7bd1-44f3-a14f-018a6b8f5475 req-7f991d74-c095-41e3-9229-a03c7b8bde7a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073637 Aug 23 18:00:44.110629 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1236/2482] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:44.116139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31887676-d361-4010-8c8c-4db4a19d1fd7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:44.116647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31887676-d361-4010-8c8c-4db4a19d1fd7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:44.117095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31887676-d361-4010-8c8c-4db4a19d1fd7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:44.117830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31887676-d361-4010-8c8c-4db4a19d1fd7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:44.118277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31887676-d361-4010-8c8c-4db4a19d1fd7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:44.119765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-48b182c6-0e4a-4963-af83-2d524e19849b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27f1af4940>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:44.123575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31887676-d361-4010-8c8c-4db4a19d1fd7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:44.226528 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-48b182c6-0e4a-4963-af83-2d524e19849b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fv2.1%2Fservers%2Fce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1464 microversion: 2.1 time: 0.109754 Aug 23 18:00:44.236061 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1237/2483] 10.222.0.61 () {58 vars in 1338 bytes} [Tue Aug 23 18:00:44 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fv2.1%2Fservers%2Fce1045a1-9999-4f13-82da-906bf1d0654c => generated 1464 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:44.249292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e284579e-cf37-484c-a426-cd529d91c67b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27eca76790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:44.331092 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e284579e-cf37-484c-a426-cd529d91c67b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fservers%2Fce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1464 microversion: 2.1 time: 0.092302 Aug 23 18:00:44.331776 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1238/2484] 10.222.0.61 () {58 vars in 1324 bytes} [Tue Aug 23 18:00:44 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.61%2Fcompute%2Fservers%2Fce1045a1-9999-4f13-82da-906bf1d0654c => generated 1464 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:44.339349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf387667-f031-4ba5-a628-ee0b5905024b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfd7b790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:44.412713 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bf387667-f031-4ba5-a628-ee0b5905024b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 0.078564 Aug 23 18:00:44.413299 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1239/2485] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:44 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:44.424499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7ed6f4a7-ed5e-46a5-94ca-1bf3bf0af32a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27f1af4430>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:44.479659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-31887676-d361-4010-8c8c-4db4a19d1fd7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:44.492164 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-31887676-d361-4010-8c8c-4db4a19d1fd7 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1314 microversion: 2.1 time: 0.411709 Aug 23 18:00:44.493387 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1247/2486] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:44 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1314 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:44.582017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:44.583271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:44.600367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:44.601312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:44.601956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:44.602918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:44.603621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:44.604255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:44.620180 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7ed6f4a7-ed5e-46a5-94ca-1bf3bf0af32a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7101 microversion: 2.1 time: 0.205414 Aug 23 18:00:44.624448 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1240/2487] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Aug 23 18:00:44 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7101 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:44.644970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b942971c-ad07-4940-94dc-70758e74cbd2 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27f1c64430>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:44.661792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:44.663219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:44.663921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:44.664545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lazy-loading 'fault' on Instance uuid cdfabf0c-2561-40d0-9f96-f81d60908fec {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:00:44.745763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:44.748105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:44.765574 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b942971c-ad07-4940-94dc-70758e74cbd2 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4368 microversion: 2.1 time: 0.126582 Aug 23 18:00:44.768694 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1241/2488] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Aug 23 18:00:44 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4368 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:44.796147 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6394a231-8ad9-4801-9c66-f760a1c98b86 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 200 len: 1301 microversion: 2.1 time: 0.212653 Aug 23 18:00:44.797212 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1248/2489] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:44 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 1301 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:44.799125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-199c4133-7d77-4b7a-ad19-a3efa08fda88 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27f1af4ee0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:44.903167 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-199c4133-7d77-4b7a-ad19-a3efa08fda88 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/126e0038-c91e-4894-b027-98e76f88a186" status: 200 len: 784 microversion: 2.1 time: 0.121482 Aug 23 18:00:44.913071 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1242/2490] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:44 2022] GET /compute/v2.1/images/126e0038-c91e-4894-b027-98e76f88a186 => generated 784 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:44.919923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7e3f4351-6235-4746-ab98-c2f24b151879 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec03ddc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:45.007459 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7e3f4351-6235-4746-ab98-c2f24b151879 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.092386 Aug 23 18:00:45.012996 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1249/2491] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Aug 23 18:00:44 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:45.030123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e98a218c-bdeb-4507-8104-271fc8759320 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27dfd7b4c0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:45.086019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fe691db1-4d38-4147-b1ff-7e1b15410221 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:45.086622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fe691db1-4d38-4147-b1ff-7e1b15410221 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:45.108869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe691db1-4d38-4147-b1ff-7e1b15410221 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:45.109386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe691db1-4d38-4147-b1ff-7e1b15410221 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:45.109823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe691db1-4d38-4147-b1ff-7e1b15410221 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:45.110758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe691db1-4d38-4147-b1ff-7e1b15410221 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:45.111368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe691db1-4d38-4147-b1ff-7e1b15410221 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:45.111981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe691db1-4d38-4147-b1ff-7e1b15410221 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:45.419346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fe691db1-4d38-4147-b1ff-7e1b15410221 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:45.441118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fe691db1-4d38-4147-b1ff-7e1b15410221 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:45.448265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fe691db1-4d38-4147-b1ff-7e1b15410221 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:45.450227 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fe691db1-4d38-4147-b1ff-7e1b15410221 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.368880 Aug 23 18:00:45.465601 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1250/2492] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:45 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:00:45.476689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03852400-a4f8-4cb0-81cb-5befffae3f07 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec60b3a0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:46.487548 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e98a218c-bdeb-4507-8104-271fc8759320 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "DELETE /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc" status: 204 len: 0 microversion: 2.1 time: 1.460417 Aug 23 18:00:46.493510 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1243/2493] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:45 2022] DELETE /compute/v2.1/images/ec008bee-235c-4859-a6a7-21d0e23501cc => generated 0 bytes in 1463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:00:46.536504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2108a6b8-51fa-42ba-a1eb-d6189dec2ad1 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:46.541670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2108a6b8-51fa-42ba-a1eb-d6189dec2ad1 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:46.574894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2108a6b8-51fa-42ba-a1eb-d6189dec2ad1 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:46.584197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2108a6b8-51fa-42ba-a1eb-d6189dec2ad1 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:46.585304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2108a6b8-51fa-42ba-a1eb-d6189dec2ad1 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:46.586645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2108a6b8-51fa-42ba-a1eb-d6189dec2ad1 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:46.587892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2108a6b8-51fa-42ba-a1eb-d6189dec2ad1 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:46.588668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2108a6b8-51fa-42ba-a1eb-d6189dec2ad1 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:46.608341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:46.989657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2108a6b8-51fa-42ba-a1eb-d6189dec2ad1 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:46.998087 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2108a6b8-51fa-42ba-a1eb-d6189dec2ad1 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1314 microversion: 2.1 time: 0.502938 Aug 23 18:00:47.003893 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1244/2494] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:46 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1314 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:47.018690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-0de2f4e4-859f-4111-bbee-380dd4b03142 req-1e35d15d-cc7f-453e-a8a1-f50d3c475dd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76eee58f-0ee8-4ac2-934a-e1415e982b89", "name": "network-vif-plugged", "status": "completed", "tag": "e42e73af-2684-41c7-833c-db9401c4b0d5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:47.032918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0de2f4e4-859f-4111-bbee-380dd4b03142 req-1e35d15d-cc7f-453e-a8a1-f50d3c475dd9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:47.033715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0de2f4e4-859f-4111-bbee-380dd4b03142 req-1e35d15d-cc7f-453e-a8a1-f50d3c475dd9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:47.034368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0de2f4e4-859f-4111-bbee-380dd4b03142 req-1e35d15d-cc7f-453e-a8a1-f50d3c475dd9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:47.051409 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-0de2f4e4-859f-4111-bbee-380dd4b03142 req-1e35d15d-cc7f-453e-a8a1-f50d3c475dd9 service nova] Creating event network-vif-plugged:e42e73af-2684-41c7-833c-db9401c4b0d5 for instance 76eee58f-0ee8-4ac2-934a-e1415e982b89 on n-h1-850468-16 Aug 23 18:00:47.058316 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-0de2f4e4-859f-4111-bbee-380dd4b03142 req-1e35d15d-cc7f-453e-a8a1-f50d3c475dd9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049413 Aug 23 18:00:47.060282 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1245/2495] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:47.068356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa471f5e-ce05-454c-9f84-37d7af2a2fe8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:47.069545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fa471f5e-ce05-454c-9f84-37d7af2a2fe8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: cdfabf0c-2561-40d0-9f96-f81d60908fec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:47.077133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa471f5e-ce05-454c-9f84-37d7af2a2fe8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:47.078107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa471f5e-ce05-454c-9f84-37d7af2a2fe8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:47.078920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa471f5e-ce05-454c-9f84-37d7af2a2fe8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:47.084344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa471f5e-ce05-454c-9f84-37d7af2a2fe8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:47.086054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa471f5e-ce05-454c-9f84-37d7af2a2fe8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:47.086739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa471f5e-ce05-454c-9f84-37d7af2a2fe8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:47.104428 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-fa471f5e-ce05-454c-9f84-37d7af2a2fe8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] HTTP exception thrown: Instance cdfabf0c-2561-40d0-9f96-f81d60908fec could not be found. Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa471f5e-ce05-454c-9f84-37d7af2a2fe8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Request method failure captured: Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec HTTP/1.1 Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRPX1elqyNQ4auLp1EnHhwwe0OquV4esq_oPU2GgqJPFLYFGAgTS81hhHztTDZGZMFyvI6Cje-7fDA8Q4c9PbVVsfbnEFm_f9R-Rmuv_43mkyGpay-W4P6rIcGCnNV_XeiNFDnbdcwmAaNZXsW4quZfUCluZ-lRR0zovphSc8VT2IXg Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 5bbd01aaed704a1b8509e754d19a4b8d Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-LiveMigrationTest-1735186488 Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5bbd01aaed704a1b8509e754d19a4b8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5bbd01aaed704a1b8509e754d19a4b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5bbd01aaed704a1b8509e754d19a4b8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5bbd01aaed704a1b8509e754d19a4b8d"}]}] Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-LiveMigrationTest-1735186488 Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 5bbd01aaed704a1b8509e754d19a4b8d Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-LiveMigrationTest-1735186488 Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-LiveMigrationTest-1735186488-project Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 0ef389420da8493386a7f8dfb747afab Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-LiveMigrationTest-1735186488-project Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance cdfabf0c-2561-40d0-9f96-f81d60908fec could not be found. Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'cdfabf0c-2561-40d0-9f96-f81d60908fec'} Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cdfabf0c-2561-40d0-9f96-f81d60908fec could not be found. Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cdfabf0c-2561-40d0-9f96-f81d60908fec could not be found. Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:00:47.106840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:00:47.111215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:47.111215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:00:47.111215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:00:47.111215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:00:47.111215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:00:47.111215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cdfabf0c-2561-40d0-9f96-f81d60908fec could not be found. Aug 23 18:00:47.111215 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:00:47.111215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa471f5e-ce05-454c-9f84-37d7af2a2fe8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Returning 404 to user: Instance cdfabf0c-2561-40d0-9f96-f81d60908fec could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:00:47.114315 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fa471f5e-ce05-454c-9f84-37d7af2a2fe8 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec" status: 404 len: 111 microversion: 2.1 time: 0.051260 Aug 23 18:00:47.116017 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1246/2496] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:47 2022] GET /compute/v2.1/servers/cdfabf0c-2561-40d0-9f96-f81d60908fec => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:00:47.121464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9880b38e-e957-4b39-8427-80ea0b5e63e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:47.122486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9880b38e-e957-4b39-8427-80ea0b5e63e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:47.130165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9880b38e-e957-4b39-8427-80ea0b5e63e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:47.131043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9880b38e-e957-4b39-8427-80ea0b5e63e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:47.132086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9880b38e-e957-4b39-8427-80ea0b5e63e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:47.133089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9880b38e-e957-4b39-8427-80ea0b5e63e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:47.133610 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-03852400-a4f8-4cb0-81cb-5befffae3f07 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 1.666558 Aug 23 18:00:47.134288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9880b38e-e957-4b39-8427-80ea0b5e63e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:47.134960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9880b38e-e957-4b39-8427-80ea0b5e63e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:47.141200 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1251/2497] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:45 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:47.159187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-10fb50c3-5a6a-466f-870f-e461b451a757 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec3a03a0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:47.497623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9880b38e-e957-4b39-8427-80ea0b5e63e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:47.512448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9880b38e-e957-4b39-8427-80ea0b5e63e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:47.516986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9880b38e-e957-4b39-8427-80ea0b5e63e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:47.522579 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9880b38e-e957-4b39-8427-80ea0b5e63e6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.402577 Aug 23 18:00:47.530693 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1247/2498] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:47 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:47.536226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25f6ee91-599d-4357-b31f-841dd8524a64 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:47.537314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-25f6ee91-599d-4357-b31f-841dd8524a64 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:47.543666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25f6ee91-599d-4357-b31f-841dd8524a64 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:47.544325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25f6ee91-599d-4357-b31f-841dd8524a64 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:47.544945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25f6ee91-599d-4357-b31f-841dd8524a64 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:47.545795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25f6ee91-599d-4357-b31f-841dd8524a64 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:47.546475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25f6ee91-599d-4357-b31f-841dd8524a64 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:47.547077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25f6ee91-599d-4357-b31f-841dd8524a64 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:47.583195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-25f6ee91-599d-4357-b31f-841dd8524a64 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:00:47.726610 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-25f6ee91-599d-4357-b31f-841dd8524a64 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 204 len: 0 microversion: 2.1 time: 0.193526 Aug 23 18:00:47.727541 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1248/2499] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:00:47 2022] DELETE /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:00:47.737805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b14bb97a-9bee-46a1-88c6-1a06b3d83796 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:47.740055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b14bb97a-9bee-46a1-88c6-1a06b3d83796 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:47.750028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b14bb97a-9bee-46a1-88c6-1a06b3d83796 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:47.752859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b14bb97a-9bee-46a1-88c6-1a06b3d83796 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:47.753367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b14bb97a-9bee-46a1-88c6-1a06b3d83796 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:47.754729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b14bb97a-9bee-46a1-88c6-1a06b3d83796 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:47.755565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b14bb97a-9bee-46a1-88c6-1a06b3d83796 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:47.755654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b14bb97a-9bee-46a1-88c6-1a06b3d83796 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:48.166840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b14bb97a-9bee-46a1-88c6-1a06b3d83796 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:48.177619 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b14bb97a-9bee-46a1-88c6-1a06b3d83796 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1501 microversion: 2.1 time: 0.444859 Aug 23 18:00:48.178232 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1249/2500] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:47 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1501 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:48.187557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b8bf514-e9e5-41f4-bc91-f9c633aec014 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:48.187557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4b8bf514-e9e5-41f4-bc91-f9c633aec014 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:48.192845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b8bf514-e9e5-41f4-bc91-f9c633aec014 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:48.193539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b8bf514-e9e5-41f4-bc91-f9c633aec014 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:48.194262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b8bf514-e9e5-41f4-bc91-f9c633aec014 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:48.195370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b8bf514-e9e5-41f4-bc91-f9c633aec014 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:48.196040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b8bf514-e9e5-41f4-bc91-f9c633aec014 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:48.196674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b8bf514-e9e5-41f4-bc91-f9c633aec014 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:48.453794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4b8bf514-e9e5-41f4-bc91-f9c633aec014 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:48.467137 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b8bf514-e9e5-41f4-bc91-f9c633aec014 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1314 microversion: 2.1 time: 0.286422 Aug 23 18:00:48.468267 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1250/2501] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:48 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:48.482894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-890a7ca9-aad9-4ef4-aa6a-61d0486451f4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27f1af4820>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:48.623219 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-10fb50c3-5a6a-466f-870f-e461b451a757 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "DELETE /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9" status: 204 len: 0 microversion: 2.1 time: 1.480903 Aug 23 18:00:48.624450 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1252/2502] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:47 2022] DELETE /compute/v2.1/images/783f88eb-f09e-42a0-b25c-01eee86b35a9 => generated 0 bytes in 1483 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:00:48.639381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bb99e624-aeb3-41ec-9c3d-a983c9c9838c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:48.642341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bb99e624-aeb3-41ec-9c3d-a983c9c9838c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:48.644521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=60,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:48.663313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb99e624-aeb3-41ec-9c3d-a983c9c9838c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:48.663817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb99e624-aeb3-41ec-9c3d-a983c9c9838c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:48.666552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb99e624-aeb3-41ec-9c3d-a983c9c9838c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:48.667541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb99e624-aeb3-41ec-9c3d-a983c9c9838c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:48.669962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb99e624-aeb3-41ec-9c3d-a983c9c9838c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:48.672861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb99e624-aeb3-41ec-9c3d-a983c9c9838c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:48.963419 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-890a7ca9-aad9-4ef4-aa6a-61d0486451f4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1413 microversion: 2.1 time: 0.493777 Aug 23 18:00:48.972270 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1251/2503] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:48 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1413 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:49.003637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-efa3e4ed-4fe3-415d-b037-ed26f7e6fcba tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27dfd6f040>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:49.277808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bb99e624-aeb3-41ec-9c3d-a983c9c9838c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:49.293104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bb99e624-aeb3-41ec-9c3d-a983c9c9838c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:49.295561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bb99e624-aeb3-41ec-9c3d-a983c9c9838c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:49.297276 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bb99e624-aeb3-41ec-9c3d-a983c9c9838c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.671468 Aug 23 18:00:49.298592 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1253/2504] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:48 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:49.333091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7408c659-3d7c-4917-9c9b-99f433cae1ae req-3e348de4-fd7c-4e42-a569-bb5b37dbaff3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71f4ec4-18cf-4eae-9e86-4f91f90810f5", "name": "network-vif-unplugged", "status": "completed", "tag": "98910578-3769-44bc-8492-76aab610ddc3"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:49.364816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7408c659-3d7c-4917-9c9b-99f433cae1ae req-3e348de4-fd7c-4e42-a569-bb5b37dbaff3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:49.367235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7408c659-3d7c-4917-9c9b-99f433cae1ae req-3e348de4-fd7c-4e42-a569-bb5b37dbaff3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:49.369147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7408c659-3d7c-4917-9c9b-99f433cae1ae req-3e348de4-fd7c-4e42-a569-bb5b37dbaff3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:49.398011 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7408c659-3d7c-4917-9c9b-99f433cae1ae req-3e348de4-fd7c-4e42-a569-bb5b37dbaff3 service nova] Creating event network-vif-unplugged:98910578-3769-44bc-8492-76aab610ddc3 for instance d71f4ec4-18cf-4eae-9e86-4f91f90810f5 on n-h2-850468-16 Aug 23 18:00:49.417502 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7408c659-3d7c-4917-9c9b-99f433cae1ae req-3e348de4-fd7c-4e42-a569-bb5b37dbaff3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.115599 Aug 23 18:00:49.418319 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1254/2505] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:49.436484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-67b64058-7d2c-4e8a-afc6-13ff14fe40e5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:49.437803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-67b64058-7d2c-4e8a-afc6-13ff14fe40e5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:49.453981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67b64058-7d2c-4e8a-afc6-13ff14fe40e5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:49.454478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67b64058-7d2c-4e8a-afc6-13ff14fe40e5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:49.454949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67b64058-7d2c-4e8a-afc6-13ff14fe40e5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:49.455670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67b64058-7d2c-4e8a-afc6-13ff14fe40e5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:49.456119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67b64058-7d2c-4e8a-afc6-13ff14fe40e5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:49.456538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67b64058-7d2c-4e8a-afc6-13ff14fe40e5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:49.935381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-67b64058-7d2c-4e8a-afc6-13ff14fe40e5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:49.944307 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-67b64058-7d2c-4e8a-afc6-13ff14fe40e5 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1501 microversion: 2.1 time: 0.523054 Aug 23 18:00:49.951656 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1255/2506] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:49 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1501 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:49.959287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae3c830d-9e25-4efe-b2a0-de33e77c2af6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:49.960052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae3c830d-9e25-4efe-b2a0-de33e77c2af6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:49.968778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae3c830d-9e25-4efe-b2a0-de33e77c2af6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:49.969582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae3c830d-9e25-4efe-b2a0-de33e77c2af6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:49.970308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae3c830d-9e25-4efe-b2a0-de33e77c2af6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:49.973256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae3c830d-9e25-4efe-b2a0-de33e77c2af6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:49.974218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae3c830d-9e25-4efe-b2a0-de33e77c2af6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:49.976943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae3c830d-9e25-4efe-b2a0-de33e77c2af6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:50.013690 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-efa3e4ed-4fe3-415d-b037-ed26f7e6fcba tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "DELETE /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d" status: 204 len: 0 microversion: 2.1 time: 1.026537 Aug 23 18:00:50.016323 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1252/2507] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:48 2022] DELETE /compute/v2.1/images/fc4cae76-85a4-4d00-bf51-1c6448aa871d => generated 0 bytes in 1043 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:00:50.025777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-398b4a46-e514-4d26-894b-fcb423f685ea tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfd7bc10>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:50.095188 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-398b4a46-e514-4d26-894b-fcb423f685ea tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1422 microversion: 2.1 time: 0.077276 Aug 23 18:00:50.096186 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1253/2508] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:50 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1422 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:50.104098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a639ab0-096b-49fd-9543-8a2b17bf7f6e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:50.104857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6a639ab0-096b-49fd-9543-8a2b17bf7f6e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:50.114103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:50.117076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a639ab0-096b-49fd-9543-8a2b17bf7f6e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:50.117593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a639ab0-096b-49fd-9543-8a2b17bf7f6e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:50.119539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a639ab0-096b-49fd-9543-8a2b17bf7f6e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:50.120476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a639ab0-096b-49fd-9543-8a2b17bf7f6e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:50.121699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a639ab0-096b-49fd-9543-8a2b17bf7f6e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:50.123245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a639ab0-096b-49fd-9543-8a2b17bf7f6e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:50.236620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ae3c830d-9e25-4efe-b2a0-de33e77c2af6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:50.249103 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae3c830d-9e25-4efe-b2a0-de33e77c2af6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1464 microversion: 2.1 time: 0.295634 Aug 23 18:00:50.251283 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1256/2509] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:49 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1464 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:50.252195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6a639ab0-096b-49fd-9543-8a2b17bf7f6e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:00:50.268409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f30c301-1947-4f48-b38e-2e20953d338c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec024ca0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:50.345592 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f30c301-1947-4f48-b38e-2e20953d338c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 200 len: 1422 microversion: 2.1 time: 0.092190 Aug 23 18:00:50.346509 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1257/2510] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:00:50 2022] GET /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 1422 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:50.394491 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a639ab0-096b-49fd-9543-8a2b17bf7f6e tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 204 len: 0 microversion: 2.1 time: 0.296130 Aug 23 18:00:50.396718 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1254/2511] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:00:50 2022] DELETE /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:00:50.414463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a25c69e-d46b-4d6d-a30a-456a729d0069 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:50.416087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6a25c69e-d46b-4d6d-a30a-456a729d0069 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:50.434961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a25c69e-d46b-4d6d-a30a-456a729d0069 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:50.437280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a25c69e-d46b-4d6d-a30a-456a729d0069 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:50.439998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a25c69e-d46b-4d6d-a30a-456a729d0069 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:50.443028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a25c69e-d46b-4d6d-a30a-456a729d0069 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:50.443744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a25c69e-d46b-4d6d-a30a-456a729d0069 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:50.444393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a25c69e-d46b-4d6d-a30a-456a729d0069 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:50.753083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a25c69e-d46b-4d6d-a30a-456a729d0069 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:50.764761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a25c69e-d46b-4d6d-a30a-456a729d0069 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:50.767360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a25c69e-d46b-4d6d-a30a-456a729d0069 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:50.769164 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a25c69e-d46b-4d6d-a30a-456a729d0069 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.370265 Aug 23 18:00:50.788173 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1255/2512] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:50 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:50.796036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cd71e09e-288e-415f-954b-54f747084e15 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfd7b8b0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:50.839269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa58999b-224c-4a4a-af28-b9c39a5730d0 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Calling method '.version_select at 0x7f27ec09d790>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:50.854398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa58999b-224c-4a4a-af28-b9c39a5730d0 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:50.855416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa58999b-224c-4a4a-af28-b9c39a5730d0 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:50.856011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa58999b-224c-4a4a-af28-b9c39a5730d0 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:50.874132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa58999b-224c-4a4a-af28-b9c39a5730d0 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:50.875008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa58999b-224c-4a4a-af28-b9c39a5730d0 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:50.877723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa58999b-224c-4a4a-af28-b9c39a5730d0 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:50.931948 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa58999b-224c-4a4a-af28-b9c39a5730d0 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage/f1d6312984574cb09fab8d466302085c?start=2022-08-22T18%3A00%3A50.266965&end=2022-08-24T18%3A00%3A50.266965" status: 200 len: 695 microversion: 2.1 time: 0.573167 Aug 23 18:00:50.931948 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1258/2513] 10.222.0.61 () {58 vars in 1412 bytes} [Tue Aug 23 18:00:50 2022] GET /compute/v2.1/os-simple-tenant-usage/f1d6312984574cb09fab8d466302085c?start=2022-08-22T18%3A00%3A50.266965&end=2022-08-24T18%3A00%3A50.266965 => generated 695 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:50.931948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-88edb0ca-a214-43c3-8995-7ed9928b3308 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:50.931948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-88edb0ca-a214-43c3-8995-7ed9928b3308 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:50.954473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88edb0ca-a214-43c3-8995-7ed9928b3308 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:50.957316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88edb0ca-a214-43c3-8995-7ed9928b3308 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:50.958420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88edb0ca-a214-43c3-8995-7ed9928b3308 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:50.961724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88edb0ca-a214-43c3-8995-7ed9928b3308 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:50.962404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88edb0ca-a214-43c3-8995-7ed9928b3308 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:50.963413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88edb0ca-a214-43c3-8995-7ed9928b3308 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.448700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-88edb0ca-a214-43c3-8995-7ed9928b3308 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:51.459792 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-88edb0ca-a214-43c3-8995-7ed9928b3308 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1474 microversion: 2.1 time: 0.536478 Aug 23 18:00:51.460337 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1259/2514] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:50 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1474 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:51.476006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-cb667c7c-cfe0-42f0-9e49-9660a56fc8f0 req-3bd4dbd4-a885-4054-b4bc-b48b68d82f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1e4da944-47f7-4b06-9249-260dcdd68610", "name": "network-vif-deleted", "tag": "b3bc7d2d-b6b3-4cc1-9f85-2099cfcc50c4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:51.499435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cb667c7c-cfe0-42f0-9e49-9660a56fc8f0 req-3bd4dbd4-a885-4054-b4bc-b48b68d82f5a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.499915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cb667c7c-cfe0-42f0-9e49-9660a56fc8f0 req-3bd4dbd4-a885-4054-b4bc-b48b68d82f5a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.500355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cb667c7c-cfe0-42f0-9e49-9660a56fc8f0 req-3bd4dbd4-a885-4054-b4bc-b48b68d82f5a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.517222 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-cb667c7c-cfe0-42f0-9e49-9660a56fc8f0 req-3bd4dbd4-a885-4054-b4bc-b48b68d82f5a service nova] Creating event network-vif-deleted:b3bc7d2d-b6b3-4cc1-9f85-2099cfcc50c4 for instance 1e4da944-47f7-4b06-9249-260dcdd68610 on n-h1-850468-16 Aug 23 18:00:51.532802 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-cb667c7c-cfe0-42f0-9e49-9660a56fc8f0 req-3bd4dbd4-a885-4054-b4bc-b48b68d82f5a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068920 Aug 23 18:00:51.533805 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1260/2515] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:51.541499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-95328c0d-5d0f-4c34-bf66-ed21e6e5133b tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '.version_select at 0x7f27ec7f5550>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:51.558842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95328c0d-5d0f-4c34-bf66-ed21e6e5133b tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.559344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95328c0d-5d0f-4c34-bf66-ed21e6e5133b tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.559848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95328c0d-5d0f-4c34-bf66-ed21e6e5133b tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.574894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95328c0d-5d0f-4c34-bf66-ed21e6e5133b tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.575769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95328c0d-5d0f-4c34-bf66-ed21e6e5133b tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.576880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95328c0d-5d0f-4c34-bf66-ed21e6e5133b tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.591466 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-95328c0d-5d0f-4c34-bf66-ed21e6e5133b tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage/f1d6312984574cb09fab8d466302085c?start=2022-08-22T18%3A00%3A50.266965&end=2022-08-24T18%3A00%3A50.266965" status: 200 len: 695 microversion: 2.1 time: 0.055947 Aug 23 18:00:51.593235 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1261/2516] 10.222.0.61 () {58 vars in 1412 bytes} [Tue Aug 23 18:00:51 2022] GET /compute/v2.1/os-simple-tenant-usage/f1d6312984574cb09fab8d466302085c?start=2022-08-22T18%3A00%3A50.266965&end=2022-08-24T18%3A00%3A50.266965 => generated 695 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:51.599100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:51.600073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:51.607454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.608205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.608856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.609987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.610748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.611544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.682136 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cd71e09e-288e-415f-954b-54f747084e15 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 204 len: 0 microversion: 2.1 time: 0.882038 Aug 23 18:00:51.687584 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1256/2517] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:50 2022] DELETE /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 0 bytes in 899 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:00:51.695525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.696012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.696442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.697075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lazy-loading 'fault' on Instance uuid 1e4da944-47f7-4b06-9249-260dcdd68610 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:00:51.697675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-42f71160-3792-4872-9b5f-08bd6f60b779 req-d37a9fff-618a-4ac8-965c-13298632306d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d71f4ec4-18cf-4eae-9e86-4f91f90810f5", "tag": "98910578-3769-44bc-8492-76aab610ddc3"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:51.712860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-42f71160-3792-4872-9b5f-08bd6f60b779 req-d37a9fff-618a-4ac8-965c-13298632306d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.713543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-42f71160-3792-4872-9b5f-08bd6f60b779 req-d37a9fff-618a-4ac8-965c-13298632306d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.714048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-42f71160-3792-4872-9b5f-08bd6f60b779 req-d37a9fff-618a-4ac8-965c-13298632306d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.730136 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-42f71160-3792-4872-9b5f-08bd6f60b779 req-d37a9fff-618a-4ac8-965c-13298632306d service nova] Creating event network-changed:98910578-3769-44bc-8492-76aab610ddc3 for instance d71f4ec4-18cf-4eae-9e86-4f91f90810f5 on n-h2-850468-16 Aug 23 18:00:51.736372 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-42f71160-3792-4872-9b5f-08bd6f60b779 req-d37a9fff-618a-4ac8-965c-13298632306d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046900 Aug 23 18:00:51.736993 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1257/2518] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:51.745657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-20955bf1-9091-46e5-8e4d-b882e6bff5f4 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Calling method '.version_select at 0x7f27ec914430>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:51.761081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20955bf1-9091-46e5-8e4d-b882e6bff5f4 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.761884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20955bf1-9091-46e5-8e4d-b882e6bff5f4 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.762798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20955bf1-9091-46e5-8e4d-b882e6bff5f4 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.777868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0ef389420da8493386a7f8dfb747afab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bbd01aaed704a1b8509e754d19a4b8d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:51.783578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20955bf1-9091-46e5-8e4d-b882e6bff5f4 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.784656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20955bf1-9091-46e5-8e4d-b882e6bff5f4 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.790323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20955bf1-9091-46e5-8e4d-b882e6bff5f4 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.790773 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eb74df7c-42e9-4b1a-aa1f-fcac23121b09 tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 200 len: 1301 microversion: 2.1 time: 0.195719 Aug 23 18:00:51.792003 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1262/2519] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:51 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 1301 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:51.798436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a87102e1-734e-4f64-8150-d25f067fc241 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:51.799193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a87102e1-734e-4f64-8150-d25f067fc241 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:51.810572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a87102e1-734e-4f64-8150-d25f067fc241 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.811220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a87102e1-734e-4f64-8150-d25f067fc241 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.811805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a87102e1-734e-4f64-8150-d25f067fc241 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.812764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a87102e1-734e-4f64-8150-d25f067fc241 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.813374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a87102e1-734e-4f64-8150-d25f067fc241 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.814002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a87102e1-734e-4f64-8150-d25f067fc241 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.846865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a87102e1-734e-4f64-8150-d25f067fc241 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:00:51.946524 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-20955bf1-9091-46e5-8e4d-b882e6bff5f4 tempest-TenantUsagesTestJSON-2009282948 tempest-TenantUsagesTestJSON-2009282948-project-admin] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-22T18%3A00%3A50.266965&end=2022-08-24T18%3A00%3A50.266965&detailed=1" status: 200 len: 27219 microversion: 2.1 time: 0.205422 Aug 23 18:00:51.947534 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1258/2520] 10.222.0.61 () {58 vars in 1335 bytes} [Tue Aug 23 18:00:51 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-22T18%3A00%3A50.266965&end=2022-08-24T18%3A00%3A50.266965&detailed=1 => generated 27219 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:00:51.962574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-75799993-e207-4706-b8cb-cd56d01d388d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:51.963570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-75799993-e207-4706-b8cb-cd56d01d388d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:51.983985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75799993-e207-4706-b8cb-cd56d01d388d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.985445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75799993-e207-4706-b8cb-cd56d01d388d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.987417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75799993-e207-4706-b8cb-cd56d01d388d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:51.990451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75799993-e207-4706-b8cb-cd56d01d388d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:51.994507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75799993-e207-4706-b8cb-cd56d01d388d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:51.994880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75799993-e207-4706-b8cb-cd56d01d388d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:52.013352 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a87102e1-734e-4f64-8150-d25f067fc241 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 204 len: 0 microversion: 2.1 time: 0.219624 Aug 23 18:00:52.016475 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1263/2521] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:00:51 2022] DELETE /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:00:52.032525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c2448a6f-d5b4-4114-a9ef-2f013a4c09d6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:52.033190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c2448a6f-d5b4-4114-a9ef-2f013a4c09d6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:52.045916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2448a6f-d5b4-4114-a9ef-2f013a4c09d6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:52.046407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2448a6f-d5b4-4114-a9ef-2f013a4c09d6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:52.048800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2448a6f-d5b4-4114-a9ef-2f013a4c09d6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:52.050037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2448a6f-d5b4-4114-a9ef-2f013a4c09d6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:52.051976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2448a6f-d5b4-4114-a9ef-2f013a4c09d6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:52.052896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2448a6f-d5b4-4114-a9ef-2f013a4c09d6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:52.087077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c2448a6f-d5b4-4114-a9ef-2f013a4c09d6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:00:52.213342 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c2448a6f-d5b4-4114-a9ef-2f013a4c09d6 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "DELETE /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 204 len: 0 microversion: 2.1 time: 0.195038 Aug 23 18:00:52.214421 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1264/2522] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:00:52 2022] DELETE /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:00:52.229895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0d9a0f55-532d-489b-b375-dfc0f6f2b1b3 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:52.231696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0d9a0f55-532d-489b-b375-dfc0f6f2b1b3 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:52.247667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d9a0f55-532d-489b-b375-dfc0f6f2b1b3 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:52.250740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d9a0f55-532d-489b-b375-dfc0f6f2b1b3 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:52.251254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d9a0f55-532d-489b-b375-dfc0f6f2b1b3 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:52.254793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d9a0f55-532d-489b-b375-dfc0f6f2b1b3 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:52.255537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d9a0f55-532d-489b-b375-dfc0f6f2b1b3 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:52.260712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d9a0f55-532d-489b-b375-dfc0f6f2b1b3 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:52.287231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-75799993-e207-4706-b8cb-cd56d01d388d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:52.297233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-75799993-e207-4706-b8cb-cd56d01d388d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:52.299222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-75799993-e207-4706-b8cb-cd56d01d388d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:52.300580 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-75799993-e207-4706-b8cb-cd56d01d388d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.346934 Aug 23 18:00:52.312552 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1259/2523] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:51 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:52.318161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-448953737", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "bd6bcc31-356e-406f-85ed-9a6dbf64ea38"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:52.379711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] validate_networks() for [('bd6bcc31-356e-406f-85ed-9a6dbf64ea38', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:00:52.802592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0d9a0f55-532d-489b-b375-dfc0f6f2b1b3 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:52.811850 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0d9a0f55-532d-489b-b375-dfc0f6f2b1b3 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1470 microversion: 2.1 time: 0.592488 Aug 23 18:00:52.812848 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1265/2524] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:52 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1470 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:52.818396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-474ce88c-9a7c-421a-82ef-e2a0d513185f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:52.819039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-474ce88c-9a7c-421a-82ef-e2a0d513185f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:52.825968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-474ce88c-9a7c-421a-82ef-e2a0d513185f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:52.826665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-474ce88c-9a7c-421a-82ef-e2a0d513185f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:52.827297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-474ce88c-9a7c-421a-82ef-e2a0d513185f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:52.828006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-474ce88c-9a7c-421a-82ef-e2a0d513185f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:52.828604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-474ce88c-9a7c-421a-82ef-e2a0d513185f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:52.829197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-474ce88c-9a7c-421a-82ef-e2a0d513185f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:53.073050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-474ce88c-9a7c-421a-82ef-e2a0d513185f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:53.089274 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-474ce88c-9a7c-421a-82ef-e2a0d513185f tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1474 microversion: 2.1 time: 0.274956 Aug 23 18:00:53.092051 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1266/2525] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:52 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1474 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:53.100463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8959d486-b5e6-4339-bbe9-b43611ce48db tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:53.102372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8959d486-b5e6-4339-bbe9-b43611ce48db tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] [instance: 1e4da944-47f7-4b06-9249-260dcdd68610] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:53.110364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8959d486-b5e6-4339-bbe9-b43611ce48db tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:53.111286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8959d486-b5e6-4339-bbe9-b43611ce48db tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:53.112532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8959d486-b5e6-4339-bbe9-b43611ce48db tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:53.116464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8959d486-b5e6-4339-bbe9-b43611ce48db tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:53.117086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8959d486-b5e6-4339-bbe9-b43611ce48db tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:53.117534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8959d486-b5e6-4339-bbe9-b43611ce48db tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:53.152541 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8959d486-b5e6-4339-bbe9-b43611ce48db tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] HTTP exception thrown: Instance 1e4da944-47f7-4b06-9249-260dcdd68610 could not be found. Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8959d486-b5e6-4339-bbe9-b43611ce48db tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Request method failure captured: Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 HTTP/1.1 Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRPX1elqyNQ4auLp1EnHhwwe0OquV4esq_oPU2GgqJPFLYFGAgTS81hhHztTDZGZMFyvI6Cje-7fDA8Q4c9PbVVsfbnEFm_f9R-Rmuv_43mkyGpay-W4P6rIcGCnNV_XeiNFDnbdcwmAaNZXsW4quZfUCluZ-lRR0zovphSc8VT2IXg Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 5bbd01aaed704a1b8509e754d19a4b8d Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-LiveMigrationTest-1735186488 Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5bbd01aaed704a1b8509e754d19a4b8d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5bbd01aaed704a1b8509e754d19a4b8d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5bbd01aaed704a1b8509e754d19a4b8d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5bbd01aaed704a1b8509e754d19a4b8d"}]}] Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-LiveMigrationTest-1735186488 Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 5bbd01aaed704a1b8509e754d19a4b8d Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-LiveMigrationTest-1735186488 Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-LiveMigrationTest-1735186488-project Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 0ef389420da8493386a7f8dfb747afab Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-LiveMigrationTest-1735186488-project Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 1e4da944-47f7-4b06-9249-260dcdd68610 could not be found. Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '1e4da944-47f7-4b06-9249-260dcdd68610'} Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1e4da944-47f7-4b06-9249-260dcdd68610 could not be found. Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1e4da944-47f7-4b06-9249-260dcdd68610 could not be found. Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:00:53.155962 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:53.159841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:53.159841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:00:53.159841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:00:53.159841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:00:53.159841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:00:53.159841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1e4da944-47f7-4b06-9249-260dcdd68610 could not be found. Aug 23 18:00:53.159841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:53.159841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8959d486-b5e6-4339-bbe9-b43611ce48db tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] Returning 404 to user: Instance 1e4da944-47f7-4b06-9249-260dcdd68610 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:00:53.159841 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8959d486-b5e6-4339-bbe9-b43611ce48db tempest-LiveMigrationTest-1735186488 tempest-LiveMigrationTest-1735186488-project] 10.222.0.61 "GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610" status: 404 len: 111 microversion: 2.1 time: 0.066469 Aug 23 18:00:53.170353 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1267/2526] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:53 2022] GET /compute/v2.1/servers/1e4da944-47f7-4b06-9249-260dcdd68610 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:00:53.283994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-b598dc59-5e12-406a-8873-42850ea12218 req-48abb22e-a509-4dff-bcf0-fce7410cd4f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b43649-db0d-42b6-a207-a8c75fc2a5a8", "name": "network-vif-unplugged", "status": "completed", "tag": "34cfa4d3-ec0b-4ef7-a39c-ad4233274c24"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:53.312583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b598dc59-5e12-406a-8873-42850ea12218 req-48abb22e-a509-4dff-bcf0-fce7410cd4f0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:53.313381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b598dc59-5e12-406a-8873-42850ea12218 req-48abb22e-a509-4dff-bcf0-fce7410cd4f0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:53.314107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b598dc59-5e12-406a-8873-42850ea12218 req-48abb22e-a509-4dff-bcf0-fce7410cd4f0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:53.330916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:00:53.331484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:00:53.331623 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b598dc59-5e12-406a-8873-42850ea12218 req-48abb22e-a509-4dff-bcf0-fce7410cd4f0 service nova] Creating event network-vif-unplugged:34cfa4d3-ec0b-4ef7-a39c-ad4233274c24 for instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 on n-h2-850468-16 Aug 23 18:00:53.333366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:00:53.334220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:00:53.337683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:00:53.351904 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-b598dc59-5e12-406a-8873-42850ea12218 req-48abb22e-a509-4dff-bcf0-fce7410cd4f0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072383 Aug 23 18:00:53.352715 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1268/2527] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:53.358958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:53.362284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:53.363378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:53.364357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:53.365557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-311424e0-a385-47e1-a770-4a559a86ec95 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:53.366223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:53.367139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-311424e0-a385-47e1-a770-4a559a86ec95 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:53.367809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:53.383862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311424e0-a385-47e1-a770-4a559a86ec95 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:53.384529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311424e0-a385-47e1-a770-4a559a86ec95 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:53.386205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311424e0-a385-47e1-a770-4a559a86ec95 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:53.388854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311424e0-a385-47e1-a770-4a559a86ec95 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:53.389530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311424e0-a385-47e1-a770-4a559a86ec95 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:53.391989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311424e0-a385-47e1-a770-4a559a86ec95 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:53.420495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Getting quotas for project 0c1067637ced47dab01d19a65bfc3dd7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:00:53.436265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Getting quotas for user 78a1cc2772e846e0ac3ca0324ab3cee3 and project 0c1067637ced47dab01d19a65bfc3dd7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:00:53.471591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:00:53.477078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:00:53.597608 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e75d7b1-a357-42ef-a342-352e812abf11 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281354 Aug 23 18:00:53.600419 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1260/2528] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:00:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1287 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:00:53.642615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8f9503ba-e065-44e7-8baa-284418f6ca56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:53.643420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8f9503ba-e065-44e7-8baa-284418f6ca56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:53.751929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8f9503ba-e065-44e7-8baa-284418f6ca56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:53.766035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-311424e0-a385-47e1-a770-4a559a86ec95 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:53.767299 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8f9503ba-e065-44e7-8baa-284418f6ca56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1207 microversion: 2.1 time: 0.144275 Aug 23 18:00:53.769238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:53.771928 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1261/2529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:53 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1207 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:53.796575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-311424e0-a385-47e1-a770-4a559a86ec95 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:53.798002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-311424e0-a385-47e1-a770-4a559a86ec95 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:53.799211 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-311424e0-a385-47e1-a770-4a559a86ec95 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.444386 Aug 23 18:00:53.799950 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1269/2530] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:53 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:53.833215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dbf96624-8d90-4702-9626-1537e882fe79 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:53.833838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dbf96624-8d90-4702-9626-1537e882fe79 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:53.841512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbf96624-8d90-4702-9626-1537e882fe79 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:53.842058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbf96624-8d90-4702-9626-1537e882fe79 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:53.842502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbf96624-8d90-4702-9626-1537e882fe79 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:53.851532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbf96624-8d90-4702-9626-1537e882fe79 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:53.852059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbf96624-8d90-4702-9626-1537e882fe79 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:53.852551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbf96624-8d90-4702-9626-1537e882fe79 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:54.113104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4b21a886-ff3b-4f12-bd3a-461f630c0acd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:54.115080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4b21a886-ff3b-4f12-bd3a-461f630c0acd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:54.129423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b21a886-ff3b-4f12-bd3a-461f630c0acd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:54.131030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b21a886-ff3b-4f12-bd3a-461f630c0acd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:54.133185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b21a886-ff3b-4f12-bd3a-461f630c0acd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:54.134976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b21a886-ff3b-4f12-bd3a-461f630c0acd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:54.136713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b21a886-ff3b-4f12-bd3a-461f630c0acd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:54.137156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b21a886-ff3b-4f12-bd3a-461f630c0acd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:54.305411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dbf96624-8d90-4702-9626-1537e882fe79 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:54.323995 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dbf96624-8d90-4702-9626-1537e882fe79 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1470 microversion: 2.1 time: 0.493632 Aug 23 18:00:54.325606 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1262/2531] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:53 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1470 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:54.644173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b21a886-ff3b-4f12-bd3a-461f630c0acd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:54.656079 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4b21a886-ff3b-4f12-bd3a-461f630c0acd tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1474 microversion: 2.1 time: 0.546320 Aug 23 18:00:54.658357 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1270/2532] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:54 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1474 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:54.794195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-849fa113-3e06-4b5c-87a0-2ff777666ec6 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:54.795552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-849fa113-3e06-4b5c-87a0-2ff777666ec6 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:54.804053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-849fa113-3e06-4b5c-87a0-2ff777666ec6 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:54.804857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-849fa113-3e06-4b5c-87a0-2ff777666ec6 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:54.805533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-849fa113-3e06-4b5c-87a0-2ff777666ec6 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:54.806464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-849fa113-3e06-4b5c-87a0-2ff777666ec6 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:54.807161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-849fa113-3e06-4b5c-87a0-2ff777666ec6 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:54.807814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-849fa113-3e06-4b5c-87a0-2ff777666ec6 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:54.825157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-920baa12-4ca1-45ad-9234-8eddcfdd6ee2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:54.826019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-920baa12-4ca1-45ad-9234-8eddcfdd6ee2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:54.832330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-920baa12-4ca1-45ad-9234-8eddcfdd6ee2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:54.833031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-920baa12-4ca1-45ad-9234-8eddcfdd6ee2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:54.833632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-920baa12-4ca1-45ad-9234-8eddcfdd6ee2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:54.834512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-920baa12-4ca1-45ad-9234-8eddcfdd6ee2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:54.835317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-920baa12-4ca1-45ad-9234-8eddcfdd6ee2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:54.835908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-920baa12-4ca1-45ad-9234-8eddcfdd6ee2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:55.013776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-849fa113-3e06-4b5c-87a0-2ff777666ec6 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:55.063683 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-849fa113-3e06-4b5c-87a0-2ff777666ec6 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1259 microversion: 2.1 time: 0.250838 Aug 23 18:00:55.079199 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1263/2533] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:54 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1259 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:55.352959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-920baa12-4ca1-45ad-9234-8eddcfdd6ee2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:55.369907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-920baa12-4ca1-45ad-9234-8eddcfdd6ee2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:55.372079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-920baa12-4ca1-45ad-9234-8eddcfdd6ee2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:55.375348 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-920baa12-4ca1-45ad-9234-8eddcfdd6ee2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.553939 Aug 23 18:00:55.377330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-023d8032-522a-469e-8aa3-292f90f7ba4e tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:55.380917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-023d8032-522a-469e-8aa3-292f90f7ba4e tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:55.388273 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1271/2534] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:54 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:00:55.429964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-023d8032-522a-469e-8aa3-292f90f7ba4e tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:55.434231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-023d8032-522a-469e-8aa3-292f90f7ba4e tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:55.436758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-023d8032-522a-469e-8aa3-292f90f7ba4e tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:55.437887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-023d8032-522a-469e-8aa3-292f90f7ba4e tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:55.443189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-023d8032-522a-469e-8aa3-292f90f7ba4e tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:55.444263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-023d8032-522a-469e-8aa3-292f90f7ba4e tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:55.681237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-35f64875-dd2d-4f64-a7c9-32e2e8b141d1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:55.682013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-35f64875-dd2d-4f64-a7c9-32e2e8b141d1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:55.695185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35f64875-dd2d-4f64-a7c9-32e2e8b141d1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:55.696028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35f64875-dd2d-4f64-a7c9-32e2e8b141d1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:55.696693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35f64875-dd2d-4f64-a7c9-32e2e8b141d1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:55.697987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35f64875-dd2d-4f64-a7c9-32e2e8b141d1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:55.698675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35f64875-dd2d-4f64-a7c9-32e2e8b141d1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:55.700046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35f64875-dd2d-4f64-a7c9-32e2e8b141d1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:55.774336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-023d8032-522a-469e-8aa3-292f90f7ba4e tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:55.783894 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-023d8032-522a-469e-8aa3-292f90f7ba4e tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1428 microversion: 2.1 time: 0.434790 Aug 23 18:00:55.789863 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1264/2535] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:55 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1428 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:55.854581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-86b1f98c-9d88-44df-b732-bae7dd7296f1 req-dfe7cdd8-3c93-4b6f-870c-99807de6af8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "76eee58f-0ee8-4ac2-934a-e1415e982b89", "name": "network-vif-deleted", "tag": "e42e73af-2684-41c7-833c-db9401c4b0d5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:55.880679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-86b1f98c-9d88-44df-b732-bae7dd7296f1 req-dfe7cdd8-3c93-4b6f-870c-99807de6af8d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:55.882293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-86b1f98c-9d88-44df-b732-bae7dd7296f1 req-dfe7cdd8-3c93-4b6f-870c-99807de6af8d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:55.882873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-86b1f98c-9d88-44df-b732-bae7dd7296f1 req-dfe7cdd8-3c93-4b6f-870c-99807de6af8d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:55.909595 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-86b1f98c-9d88-44df-b732-bae7dd7296f1 req-dfe7cdd8-3c93-4b6f-870c-99807de6af8d service nova] Creating event network-vif-deleted:e42e73af-2684-41c7-833c-db9401c4b0d5 for instance 76eee58f-0ee8-4ac2-934a-e1415e982b89 on n-h1-850468-16 Aug 23 18:00:55.921495 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-86b1f98c-9d88-44df-b732-bae7dd7296f1 req-dfe7cdd8-3c93-4b6f-870c-99807de6af8d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071243 Aug 23 18:00:55.924278 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1265/2536] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:56.092420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-380e2cba-ee47-47b0-8d40-da4c34bda9bb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:56.093315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-380e2cba-ee47-47b0-8d40-da4c34bda9bb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:56.105251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-380e2cba-ee47-47b0-8d40-da4c34bda9bb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:56.107672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-380e2cba-ee47-47b0-8d40-da4c34bda9bb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:56.109103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-380e2cba-ee47-47b0-8d40-da4c34bda9bb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:56.111477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-380e2cba-ee47-47b0-8d40-da4c34bda9bb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:56.118032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-380e2cba-ee47-47b0-8d40-da4c34bda9bb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:56.119812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-380e2cba-ee47-47b0-8d40-da4c34bda9bb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:56.167632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:00:56.458349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-35f64875-dd2d-4f64-a7c9-32e2e8b141d1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:56.475708 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-35f64875-dd2d-4f64-a7c9-32e2e8b141d1 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1474 microversion: 2.1 time: 0.799762 Aug 23 18:00:56.477077 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1272/2537] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:55 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1474 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:56.485273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c0e55f58-9f04-4494-aed0-01d4f67ad0aa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:56.490329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c0e55f58-9f04-4494-aed0-01d4f67ad0aa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:56.496087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-380e2cba-ee47-47b0-8d40-da4c34bda9bb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:56.520948 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-380e2cba-ee47-47b0-8d40-da4c34bda9bb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1265 microversion: 2.1 time: 0.433316 Aug 23 18:00:56.523256 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1266/2538] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:56 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1265 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:56.529003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0e55f58-9f04-4494-aed0-01d4f67ad0aa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:56.530936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0e55f58-9f04-4494-aed0-01d4f67ad0aa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:56.533369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0e55f58-9f04-4494-aed0-01d4f67ad0aa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:56.534224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0e55f58-9f04-4494-aed0-01d4f67ad0aa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:56.540920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0e55f58-9f04-4494-aed0-01d4f67ad0aa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:56.541539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0e55f58-9f04-4494-aed0-01d4f67ad0aa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:56.820021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:56.821903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:56.834802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:56.841703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:56.843078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:56.850509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:56.851730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:56.852388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:56.979272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:56.982463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:56.983296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:56.984807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lazy-loading 'fault' on Instance uuid 76eee58f-0ee8-4ac2-934a-e1415e982b89 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:00:57.713387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c0e55f58-9f04-4494-aed0-01d4f67ad0aa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:57.729078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c0e55f58-9f04-4494-aed0-01d4f67ad0aa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:57.737167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c0e55f58-9f04-4494-aed0-01d4f67ad0aa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:57.742337 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c0e55f58-9f04-4494-aed0-01d4f67ad0aa tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 1.261857 Aug 23 18:00:57.764059 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1273/2539] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:56 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 1286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:57.772002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-d6d16063-2850-4867-9ae4-c5dc6d7be9be req-18bcec85-8e94-4302-a77d-7146a9c709ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce1045a1-9999-4f13-82da-906bf1d0654c", "name": "network-vif-deleted", "tag": "52ee230c-5add-4aa2-9df1-e27f64a344ed"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:57.782432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d6d16063-2850-4867-9ae4-c5dc6d7be9be req-18bcec85-8e94-4302-a77d-7146a9c709ad service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:57.783317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d6d16063-2850-4867-9ae4-c5dc6d7be9be req-18bcec85-8e94-4302-a77d-7146a9c709ad service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:57.783997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d6d16063-2850-4867-9ae4-c5dc6d7be9be req-18bcec85-8e94-4302-a77d-7146a9c709ad service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:57.800518 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-d6d16063-2850-4867-9ae4-c5dc6d7be9be req-18bcec85-8e94-4302-a77d-7146a9c709ad service nova] Creating event network-vif-deleted:52ee230c-5add-4aa2-9df1-e27f64a344ed for instance ce1045a1-9999-4f13-82da-906bf1d0654c on n-h2-850468-16 Aug 23 18:00:57.811318 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-d6d16063-2850-4867-9ae4-c5dc6d7be9be req-18bcec85-8e94-4302-a77d-7146a9c709ad service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045291 Aug 23 18:00:57.812517 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1274/2540] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:00:57.825765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:57.826834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:57.840829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:57.841304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:57.841768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:57.844696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:57.845178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:57.845620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:57.913744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:57.914182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:57.914641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:57.915104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lazy-loading 'fault' on Instance uuid ce1045a1-9999-4f13-82da-906bf1d0654c {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:00:58.017875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:58.027009 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eb3d8d9c-30ca-4b77-81c7-6d2a4185b801 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 200 len: 1308 microversion: 2.1 time: 0.212725 Aug 23 18:00:58.031163 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1275/2541] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:57 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 1308 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:58.034626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a8900a55d4d34136a7728f35ea9e340c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1d6312984574cb09fab8d466302085c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:58.043710 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7ee9e73a-2523-47c9-9191-b2232fcd3e6f tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 200 len: 1304 microversion: 2.1 time: 1.228462 Aug 23 18:00:58.047592 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1267/2542] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:56 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 1304 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:00:58.051529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-19f0a422-d0b2-47be-94e2-42d6ff67be54 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:58.052342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-19f0a422-d0b2-47be-94e2-42d6ff67be54 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:58.058512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19f0a422-d0b2-47be-94e2-42d6ff67be54 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:58.059438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19f0a422-d0b2-47be-94e2-42d6ff67be54 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:58.060016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19f0a422-d0b2-47be-94e2-42d6ff67be54 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:58.060854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19f0a422-d0b2-47be-94e2-42d6ff67be54 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:58.061470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19f0a422-d0b2-47be-94e2-42d6ff67be54 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:58.062052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19f0a422-d0b2-47be-94e2-42d6ff67be54 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:58.082523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-95245220-9fc8-4e0c-a71e-5d85106992ba req-4d66a77c-edcb-4d8f-9d84-07c3c6ac8058 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4b43649-db0d-42b6-a207-a8c75fc2a5a8", "name": "network-vif-deleted", "tag": "34cfa4d3-ec0b-4ef7-a39c-ad4233274c24"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:00:58.118264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-95245220-9fc8-4e0c-a71e-5d85106992ba req-4d66a77c-edcb-4d8f-9d84-07c3c6ac8058 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:58.121301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-95245220-9fc8-4e0c-a71e-5d85106992ba req-4d66a77c-edcb-4d8f-9d84-07c3c6ac8058 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:58.123767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-95245220-9fc8-4e0c-a71e-5d85106992ba req-4d66a77c-edcb-4d8f-9d84-07c3c6ac8058 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:58.172219 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-95245220-9fc8-4e0c-a71e-5d85106992ba req-4d66a77c-edcb-4d8f-9d84-07c3c6ac8058 service nova] Creating event network-vif-deleted:34cfa4d3-ec0b-4ef7-a39c-ad4233274c24 for instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 on n-h2-850468-16 Aug 23 18:00:58.178810 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-95245220-9fc8-4e0c-a71e-5d85106992ba req-4d66a77c-edcb-4d8f-9d84-07c3c6ac8058 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099919 Aug 23 18:00:58.179947 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1268/2543] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:00:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:00:58.241887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-19f0a422-d0b2-47be-94e2-42d6ff67be54 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:58.263564 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-19f0a422-d0b2-47be-94e2-42d6ff67be54 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1265 microversion: 2.1 time: 0.216530 Aug 23 18:00:58.264739 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1276/2544] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:58 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:58.774176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa6919a9-8caa-4a43-b0c3-894673897d56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:58.776652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fa6919a9-8caa-4a43-b0c3-894673897d56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:58.786528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa6919a9-8caa-4a43-b0c3-894673897d56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:58.787150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa6919a9-8caa-4a43-b0c3-894673897d56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:58.788092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa6919a9-8caa-4a43-b0c3-894673897d56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:58.789075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa6919a9-8caa-4a43-b0c3-894673897d56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:58.789986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa6919a9-8caa-4a43-b0c3-894673897d56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:58.790284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa6919a9-8caa-4a43-b0c3-894673897d56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:59.053949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eba47518-193f-48e6-896a-5e608300b1ed tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:59.054601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eba47518-193f-48e6-896a-5e608300b1ed tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: ce1045a1-9999-4f13-82da-906bf1d0654c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:59.068820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eba47518-193f-48e6-896a-5e608300b1ed tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:59.069327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eba47518-193f-48e6-896a-5e608300b1ed tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:59.069777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eba47518-193f-48e6-896a-5e608300b1ed tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:59.070505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eba47518-193f-48e6-896a-5e608300b1ed tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:59.070991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eba47518-193f-48e6-896a-5e608300b1ed tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:59.071422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eba47518-193f-48e6-896a-5e608300b1ed tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:59.094983 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-eba47518-193f-48e6-896a-5e608300b1ed tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] HTTP exception thrown: Instance ce1045a1-9999-4f13-82da-906bf1d0654c could not be found. Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eba47518-193f-48e6-896a-5e608300b1ed tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Request method failure captured: Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c HTTP/1.1 Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRUhB30xAa0oCz5mdzlXlGlwCqD0YVYSuEdCMwFPfJraK9950NrdRElaHSLN6w5baf2FDYGpG-nUlrzvR11FEWE5SaP3hx4IVk75y_z0TQZMPElPSivlA8f0TaNQvhe_M5ppTNYxXaFYuEG_rz0iRvB16rzM_nVjEhy-92GDnZxJbk0 Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ebd71f6578d64eaba0553c3fcd9c4fd5 Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ListImageFiltersTestJSON-459532654 Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ebd71f6578d64eaba0553c3fcd9c4fd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ebd71f6578d64eaba0553c3fcd9c4fd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ebd71f6578d64eaba0553c3fcd9c4fd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ebd71f6578d64eaba0553c3fcd9c4fd5"}]}] Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ListImageFiltersTestJSON-459532654 Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ebd71f6578d64eaba0553c3fcd9c4fd5 Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-459532654 Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ListImageFiltersTestJSON-459532654-project Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b3e58be0c76141c582ea59fbf64fddc4 Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ListImageFiltersTestJSON-459532654-project Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance ce1045a1-9999-4f13-82da-906bf1d0654c could not be found. Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'ce1045a1-9999-4f13-82da-906bf1d0654c'} Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce1045a1-9999-4f13-82da-906bf1d0654c could not be found. Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce1045a1-9999-4f13-82da-906bf1d0654c could not be found. Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:00:59.097145 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:59.103186 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:59.103186 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:00:59.103186 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:00:59.103186 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:00:59.103186 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:00:59.103186 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce1045a1-9999-4f13-82da-906bf1d0654c could not be found. Aug 23 18:00:59.103186 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:59.103186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eba47518-193f-48e6-896a-5e608300b1ed tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Returning 404 to user: Instance ce1045a1-9999-4f13-82da-906bf1d0654c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:00:59.103186 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eba47518-193f-48e6-896a-5e608300b1ed tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c" status: 404 len: 111 microversion: 2.1 time: 0.050595 Aug 23 18:00:59.103186 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1277/2545] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:59 2022] GET /compute/v2.1/servers/ce1045a1-9999-4f13-82da-906bf1d0654c => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:00:59.105801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a7ea1a4b-fc67-4ac1-8e18-cc101072c683 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:59.106433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a7ea1a4b-fc67-4ac1-8e18-cc101072c683 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] [instance: 76eee58f-0ee8-4ac2-934a-e1415e982b89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:59.116745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7ea1a4b-fc67-4ac1-8e18-cc101072c683 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:59.117614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7ea1a4b-fc67-4ac1-8e18-cc101072c683 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:59.118069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7ea1a4b-fc67-4ac1-8e18-cc101072c683 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:59.119052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7ea1a4b-fc67-4ac1-8e18-cc101072c683 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:59.119527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7ea1a4b-fc67-4ac1-8e18-cc101072c683 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:59.119970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7ea1a4b-fc67-4ac1-8e18-cc101072c683 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:59.150005 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-a7ea1a4b-fc67-4ac1-8e18-cc101072c683 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] HTTP exception thrown: Instance 76eee58f-0ee8-4ac2-934a-e1415e982b89 could not be found. Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a7ea1a4b-fc67-4ac1-8e18-cc101072c683 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Request method failure captured: Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 HTTP/1.1 Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRW1nHnqmnGbmhZW8T40DWYFsVlwa_obnLYgjnanLyGRpjfflATz5MmVTRLrDOJE6Nf3Fu6fX6-CwPvtUSxaIc7wXdE-g5XffLcIGmlyomcFHkMZLjGxUnx_gxsHdx4M4VGTmPYhnxLMplYLR9_fp0hs7RcGTnMhaeynlTWI2OyUvqU Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: f1d6312984574cb09fab8d466302085c Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TenantUsagesTestJSON-1637071169 Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f1d6312984574cb09fab8d466302085c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f1d6312984574cb09fab8d466302085c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f1d6312984574cb09fab8d466302085c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f1d6312984574cb09fab8d466302085c"}]}] Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TenantUsagesTestJSON-1637071169 Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: f1d6312984574cb09fab8d466302085c Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TenantUsagesTestJSON-1637071169 Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TenantUsagesTestJSON-1637071169-project Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a8900a55d4d34136a7728f35ea9e340c Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TenantUsagesTestJSON-1637071169-project Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 76eee58f-0ee8-4ac2-934a-e1415e982b89 could not be found. Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '76eee58f-0ee8-4ac2-934a-e1415e982b89'} Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 76eee58f-0ee8-4ac2-934a-e1415e982b89 could not be found. Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 76eee58f-0ee8-4ac2-934a-e1415e982b89 could not be found. Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:00:59.152508 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:59.156667 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:00:59.156667 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:00:59.156667 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:00:59.156667 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:00:59.156667 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:00:59.156667 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 76eee58f-0ee8-4ac2-934a-e1415e982b89 could not be found. Aug 23 18:00:59.156667 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:00:59.158818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a7ea1a4b-fc67-4ac1-8e18-cc101072c683 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] Returning 404 to user: Instance 76eee58f-0ee8-4ac2-934a-e1415e982b89 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:00:59.161540 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a7ea1a4b-fc67-4ac1-8e18-cc101072c683 tempest-TenantUsagesTestJSON-1637071169 tempest-TenantUsagesTestJSON-1637071169-project] 10.222.0.61 "GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89" status: 404 len: 111 microversion: 2.1 time: 0.058730 Aug 23 18:00:59.174602 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1278/2546] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:59 2022] GET /compute/v2.1/servers/76eee58f-0ee8-4ac2-934a-e1415e982b89 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:00:59.184264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a902b9ea-9bbb-4c41-a8ef-d33712d78eff tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:59.185034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a902b9ea-9bbb-4c41-a8ef-d33712d78eff tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:59.198865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a902b9ea-9bbb-4c41-a8ef-d33712d78eff tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:59.200139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a902b9ea-9bbb-4c41-a8ef-d33712d78eff tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:59.200785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a902b9ea-9bbb-4c41-a8ef-d33712d78eff tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:59.201503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a902b9ea-9bbb-4c41-a8ef-d33712d78eff tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:59.204427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a902b9ea-9bbb-4c41-a8ef-d33712d78eff tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:59.204527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a902b9ea-9bbb-4c41-a8ef-d33712d78eff tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:59.247594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a902b9ea-9bbb-4c41-a8ef-d33712d78eff tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:00:59.289213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fa6919a9-8caa-4a43-b0c3-894673897d56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:59.307302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fa6919a9-8caa-4a43-b0c3-894673897d56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:59.312544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fa6919a9-8caa-4a43-b0c3-894673897d56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:59.313764 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fa6919a9-8caa-4a43-b0c3-894673897d56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.547092 Aug 23 18:00:59.330955 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1269/2547] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:00:58 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:00:59.341908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e54e16a-b93f-4c5c-b439-136d4138159f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:59.342655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e54e16a-b93f-4c5c-b439-136d4138159f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:59.359796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e54e16a-b93f-4c5c-b439-136d4138159f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:59.360290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e54e16a-b93f-4c5c-b439-136d4138159f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:59.367037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e54e16a-b93f-4c5c-b439-136d4138159f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:59.371031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e54e16a-b93f-4c5c-b439-136d4138159f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:59.371529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e54e16a-b93f-4c5c-b439-136d4138159f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:59.371978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e54e16a-b93f-4c5c-b439-136d4138159f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:59.445221 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a902b9ea-9bbb-4c41-a8ef-d33712d78eff tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c" status: 204 len: 0 microversion: 2.1 time: 0.268672 Aug 23 18:00:59.446486 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1279/2548] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:00:59 2022] DELETE /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:00:59.457853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-24ea2933-6818-4b0b-86f7-9202c5718abb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:00:59.459503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-24ea2933-6818-4b0b-86f7-9202c5718abb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:00:59.468971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24ea2933-6818-4b0b-86f7-9202c5718abb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:59.470002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24ea2933-6818-4b0b-86f7-9202c5718abb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:59.470757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24ea2933-6818-4b0b-86f7-9202c5718abb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:59.471630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24ea2933-6818-4b0b-86f7-9202c5718abb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:00:59.473481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24ea2933-6818-4b0b-86f7-9202c5718abb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:00:59.474293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24ea2933-6818-4b0b-86f7-9202c5718abb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:00:59.793368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-24ea2933-6818-4b0b-86f7-9202c5718abb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:59.807558 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-24ea2933-6818-4b0b-86f7-9202c5718abb tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c" status: 200 len: 1473 microversion: 2.1 time: 0.354614 Aug 23 18:00:59.809128 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1280/2549] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:59 2022] GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c => generated 1473 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:00:59.952597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7e54e16a-b93f-4c5c-b439-136d4138159f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:00:59.967651 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e54e16a-b93f-4c5c-b439-136d4138159f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1307 microversion: 2.1 time: 0.642116 Aug 23 18:00:59.969795 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1270/2550] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:00:59 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1307 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:00.349033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-293c93e3-089c-4af1-8314-b25268cf5a2d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:00.352127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-293c93e3-089c-4af1-8314-b25268cf5a2d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:00.368093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-293c93e3-089c-4af1-8314-b25268cf5a2d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:00.372843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-293c93e3-089c-4af1-8314-b25268cf5a2d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:00.373308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-293c93e3-089c-4af1-8314-b25268cf5a2d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:00.374064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-293c93e3-089c-4af1-8314-b25268cf5a2d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:00.378394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-293c93e3-089c-4af1-8314-b25268cf5a2d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:00.379145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-293c93e3-089c-4af1-8314-b25268cf5a2d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:00.836546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b81b334c-05b3-41f1-a09e-d316ed20d37b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:00.837164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b81b334c-05b3-41f1-a09e-d316ed20d37b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:00.847907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b81b334c-05b3-41f1-a09e-d316ed20d37b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:00.855184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b81b334c-05b3-41f1-a09e-d316ed20d37b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:00.855999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b81b334c-05b3-41f1-a09e-d316ed20d37b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:00.858008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b81b334c-05b3-41f1-a09e-d316ed20d37b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:00.858707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b81b334c-05b3-41f1-a09e-d316ed20d37b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:00.859793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b81b334c-05b3-41f1-a09e-d316ed20d37b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:00.862273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-293c93e3-089c-4af1-8314-b25268cf5a2d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:00.875668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-293c93e3-089c-4af1-8314-b25268cf5a2d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:00.883743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-293c93e3-089c-4af1-8314-b25268cf5a2d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:00.887659 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-293c93e3-089c-4af1-8314-b25268cf5a2d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.547256 Aug 23 18:01:00.890634 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1281/2551] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:00 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:00.990588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c4668e69-9278-4a1b-865b-fe7ba4e77e60 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:00.991474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c4668e69-9278-4a1b-865b-fe7ba4e77e60 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:01.001556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4668e69-9278-4a1b-865b-fe7ba4e77e60 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:01.007470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4668e69-9278-4a1b-865b-fe7ba4e77e60 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:01.008089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4668e69-9278-4a1b-865b-fe7ba4e77e60 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:01.008986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4668e69-9278-4a1b-865b-fe7ba4e77e60 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:01.009752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4668e69-9278-4a1b-865b-fe7ba4e77e60 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:01.010463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4668e69-9278-4a1b-865b-fe7ba4e77e60 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:01.575118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:01.681713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b81b334c-05b3-41f1-a09e-d316ed20d37b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:01.690775 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b81b334c-05b3-41f1-a09e-d316ed20d37b tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c" status: 200 len: 1473 microversion: 2.1 time: 0.858907 Aug 23 18:01:01.691849 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1271/2552] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:00 2022] GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c => generated 1473 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:01.718909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-88053cd1-84b6-46b9-9cfd-96e76ecace8e req-f68143f1-2037-4f11-8be6-b995741de18d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2", "tag": "6d753232-30bd-45f2-b47d-0a1c92879f78"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:01.736644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-88053cd1-84b6-46b9-9cfd-96e76ecace8e req-f68143f1-2037-4f11-8be6-b995741de18d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:01.737687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-88053cd1-84b6-46b9-9cfd-96e76ecace8e req-f68143f1-2037-4f11-8be6-b995741de18d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:01.739812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-88053cd1-84b6-46b9-9cfd-96e76ecace8e req-f68143f1-2037-4f11-8be6-b995741de18d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:01.756030 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-88053cd1-84b6-46b9-9cfd-96e76ecace8e req-f68143f1-2037-4f11-8be6-b995741de18d service nova] Creating event network-changed:6d753232-30bd-45f2-b47d-0a1c92879f78 for instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 on n-h1-850468-16 Aug 23 18:01:01.762520 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-88053cd1-84b6-46b9-9cfd-96e76ecace8e req-f68143f1-2037-4f11-8be6-b995741de18d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054497 Aug 23 18:01:01.764047 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1272/2553] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:01.914710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c4668e69-9278-4a1b-865b-fe7ba4e77e60 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:01.915433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f8aab39c-b156-4e85-a80b-0052ae6e08d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:01.916255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f8aab39c-b156-4e85-a80b-0052ae6e08d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:01.938075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8aab39c-b156-4e85-a80b-0052ae6e08d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:01.939785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8aab39c-b156-4e85-a80b-0052ae6e08d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:01.942334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8aab39c-b156-4e85-a80b-0052ae6e08d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:01.943531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8aab39c-b156-4e85-a80b-0052ae6e08d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:01.945030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8aab39c-b156-4e85-a80b-0052ae6e08d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:01.947844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8aab39c-b156-4e85-a80b-0052ae6e08d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:01.960987 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c4668e69-9278-4a1b-865b-fe7ba4e77e60 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1307 microversion: 2.1 time: 0.975125 Aug 23 18:01:01.963974 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1282/2554] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:00 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1307 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:02.554997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f8aab39c-b156-4e85-a80b-0052ae6e08d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:02.565756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f8aab39c-b156-4e85-a80b-0052ae6e08d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:02.569973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f8aab39c-b156-4e85-a80b-0052ae6e08d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:02.571733 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f8aab39c-b156-4e85-a80b-0052ae6e08d5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.661337 Aug 23 18:01:02.573244 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1273/2555] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:01 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:02.716187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2910fb4f-3d90-4101-b30d-fa3fa89a2d6a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:02.718100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2910fb4f-3d90-4101-b30d-fa3fa89a2d6a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:02.728987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2910fb4f-3d90-4101-b30d-fa3fa89a2d6a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:02.729763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2910fb4f-3d90-4101-b30d-fa3fa89a2d6a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:02.730465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2910fb4f-3d90-4101-b30d-fa3fa89a2d6a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:02.734831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2910fb4f-3d90-4101-b30d-fa3fa89a2d6a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:02.736126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2910fb4f-3d90-4101-b30d-fa3fa89a2d6a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:02.736905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2910fb4f-3d90-4101-b30d-fa3fa89a2d6a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:02.985691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d99c7e69-fa0a-49d0-b57c-acd04f9a73fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:02.986458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d99c7e69-fa0a-49d0-b57c-acd04f9a73fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:03.007265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d99c7e69-fa0a-49d0-b57c-acd04f9a73fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:03.007874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d99c7e69-fa0a-49d0-b57c-acd04f9a73fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:03.009006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d99c7e69-fa0a-49d0-b57c-acd04f9a73fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:03.011900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d99c7e69-fa0a-49d0-b57c-acd04f9a73fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:03.014344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d99c7e69-fa0a-49d0-b57c-acd04f9a73fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:03.014993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d99c7e69-fa0a-49d0-b57c-acd04f9a73fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:03.300861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d99c7e69-fa0a-49d0-b57c-acd04f9a73fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:03.311761 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d99c7e69-fa0a-49d0-b57c-acd04f9a73fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1307 microversion: 2.1 time: 0.330195 Aug 23 18:01:03.325667 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1274/2556] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:02 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1307 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:03.530673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2910fb4f-3d90-4101-b30d-fa3fa89a2d6a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b3e58be0c76141c582ea59fbf64fddc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebd71f6578d64eaba0553c3fcd9c4fd5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:03.581084 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2910fb4f-3d90-4101-b30d-fa3fa89a2d6a tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c" status: 200 len: 1473 microversion: 2.1 time: 0.868583 Aug 23 18:01:03.587788 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1283/2557] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:02 2022] GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c => generated 1473 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:03.598602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d7e8f225-7809-4b27-b0ea-4777a4d88b56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:03.599436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d7e8f225-7809-4b27-b0ea-4777a4d88b56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:03.611659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:03.614901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e8f225-7809-4b27-b0ea-4777a4d88b56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:03.625508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e8f225-7809-4b27-b0ea-4777a4d88b56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:03.628028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e8f225-7809-4b27-b0ea-4777a4d88b56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:03.629632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e8f225-7809-4b27-b0ea-4777a4d88b56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:03.631472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e8f225-7809-4b27-b0ea-4777a4d88b56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:03.632163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e8f225-7809-4b27-b0ea-4777a4d88b56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:03.757393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:03.964706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-1e6518ca-00d2-4717-9c1f-89e5501731b7 req-70c1a16a-2783-42c9-ba9a-a8c4a084d987 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f47e601-36d6-4b1f-a4bf-8020bf69831c", "name": "network-vif-deleted", "tag": "4838606c-edcc-47d0-96e3-cce31a7cb847"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:03.997267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1e6518ca-00d2-4717-9c1f-89e5501731b7 req-70c1a16a-2783-42c9-ba9a-a8c4a084d987 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:04.003196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1e6518ca-00d2-4717-9c1f-89e5501731b7 req-70c1a16a-2783-42c9-ba9a-a8c4a084d987 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:04.005053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1e6518ca-00d2-4717-9c1f-89e5501731b7 req-70c1a16a-2783-42c9-ba9a-a8c4a084d987 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:04.040816 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-1e6518ca-00d2-4717-9c1f-89e5501731b7 req-70c1a16a-2783-42c9-ba9a-a8c4a084d987 service nova] Creating event network-vif-deleted:4838606c-edcc-47d0-96e3-cce31a7cb847 for instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c on n-h2-850468-16 Aug 23 18:01:04.064544 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-1e6518ca-00d2-4717-9c1f-89e5501731b7 req-70c1a16a-2783-42c9-ba9a-a8c4a084d987 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107774 Aug 23 18:01:04.071635 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1284/2558] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:04.338942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c9138039-bff9-4cb6-810e-56ba08a3a3a9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:04.339597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c9138039-bff9-4cb6-810e-56ba08a3a3a9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:04.352671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9138039-bff9-4cb6-810e-56ba08a3a3a9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:04.353173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9138039-bff9-4cb6-810e-56ba08a3a3a9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:04.353821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9138039-bff9-4cb6-810e-56ba08a3a3a9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:04.354532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9138039-bff9-4cb6-810e-56ba08a3a3a9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:04.355020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9138039-bff9-4cb6-810e-56ba08a3a3a9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:04.355462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9138039-bff9-4cb6-810e-56ba08a3a3a9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:04.420047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d7e8f225-7809-4b27-b0ea-4777a4d88b56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:04.453794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d7e8f225-7809-4b27-b0ea-4777a4d88b56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:04.461256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d7e8f225-7809-4b27-b0ea-4777a4d88b56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:04.465015 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d7e8f225-7809-4b27-b0ea-4777a4d88b56 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.870019 Aug 23 18:01:04.485244 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1275/2559] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:03 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:04.611890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf11c574-84b1-4034-913c-301881e35203 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:04.621906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bf11c574-84b1-4034-913c-301881e35203 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] [instance: 1f47e601-36d6-4b1f-a4bf-8020bf69831c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:04.667559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf11c574-84b1-4034-913c-301881e35203 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:04.672721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf11c574-84b1-4034-913c-301881e35203 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:04.673500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf11c574-84b1-4034-913c-301881e35203 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:04.677756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf11c574-84b1-4034-913c-301881e35203 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:04.679757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf11c574-84b1-4034-913c-301881e35203 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:04.680578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf11c574-84b1-4034-913c-301881e35203 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:04.717511 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-bf11c574-84b1-4034-913c-301881e35203 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] HTTP exception thrown: Instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c could not be found. Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf11c574-84b1-4034-913c-301881e35203 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Request method failure captured: Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c HTTP/1.1 Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRUhB30xAa0oCz5mdzlXlGlwCqD0YVYSuEdCMwFPfJraK9950NrdRElaHSLN6w5baf2FDYGpG-nUlrzvR11FEWE5SaP3hx4IVk75y_z0TQZMPElPSivlA8f0TaNQvhe_M5ppTNYxXaFYuEG_rz0iRvB16rzM_nVjEhy-92GDnZxJbk0 Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ebd71f6578d64eaba0553c3fcd9c4fd5 Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ListImageFiltersTestJSON-459532654 Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ebd71f6578d64eaba0553c3fcd9c4fd5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ebd71f6578d64eaba0553c3fcd9c4fd5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ebd71f6578d64eaba0553c3fcd9c4fd5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ebd71f6578d64eaba0553c3fcd9c4fd5"}]}] Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ListImageFiltersTestJSON-459532654 Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ebd71f6578d64eaba0553c3fcd9c4fd5 Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-459532654 Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ListImageFiltersTestJSON-459532654-project Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: b3e58be0c76141c582ea59fbf64fddc4 Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ListImageFiltersTestJSON-459532654-project Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c could not be found. Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '1f47e601-36d6-4b1f-a4bf-8020bf69831c'} Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c could not be found. Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c could not be found. Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:04.720323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:04.726294 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:04.726294 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:04.726294 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:04.726294 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:01:04.726294 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:01:04.726294 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c could not be found. Aug 23 18:01:04.726294 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:04.743454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf11c574-84b1-4034-913c-301881e35203 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Returning 404 to user: Instance 1f47e601-36d6-4b1f-a4bf-8020bf69831c could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:01:04.744745 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bf11c574-84b1-4034-913c-301881e35203 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c" status: 404 len: 111 microversion: 2.1 time: 0.139344 Aug 23 18:01:04.745576 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1276/2560] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:04 2022] GET /compute/v2.1/servers/1f47e601-36d6-4b1f-a4bf-8020bf69831c => generated 111 bytes in 141 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:01:04.762072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7a023135-7e9a-4ed4-9443-17557b060fb9 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec8c1d30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:04.915608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c9138039-bff9-4cb6-810e-56ba08a3a3a9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:04.930496 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c9138039-bff9-4cb6-810e-56ba08a3a3a9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1307 microversion: 2.1 time: 0.595560 Aug 23 18:01:04.932694 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1285/2561] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:04 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1307 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:05.501728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3997a398-a373-4c73-b831-209f5bbedec0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:05.502355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3997a398-a373-4c73-b831-209f5bbedec0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:05.518755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3997a398-a373-4c73-b831-209f5bbedec0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:05.520952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3997a398-a373-4c73-b831-209f5bbedec0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:05.521371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3997a398-a373-4c73-b831-209f5bbedec0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:05.522168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3997a398-a373-4c73-b831-209f5bbedec0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:05.522648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3997a398-a373-4c73-b831-209f5bbedec0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:05.523067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3997a398-a373-4c73-b831-209f5bbedec0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:05.633354 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7a023135-7e9a-4ed4-9443-17557b060fb9 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "DELETE /compute/v2.1/images/436f3deb-9160-4ddf-8dba-5ffe42a4e38f" status: 204 len: 0 microversion: 2.1 time: 0.882677 Aug 23 18:01:05.635160 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1277/2562] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:04 2022] DELETE /compute/v2.1/images/436f3deb-9160-4ddf-8dba-5ffe42a4e38f => generated 0 bytes in 885 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:01:05.644650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0edcca19-99b1-4191-82e3-dcceb34566ef tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27dfcc8670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:06.191549 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0edcca19-99b1-4191-82e3-dcceb34566ef tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "DELETE /compute/v2.1/images/8082b5c0-3741-4bc5-bf43-824950536e00" status: 204 len: 0 microversion: 2.1 time: 0.550860 Aug 23 18:01:06.195571 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1278/2563] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:05 2022] DELETE /compute/v2.1/images/8082b5c0-3741-4bc5-bf43-824950536e00 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:01:06.200552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c06d6c42-ac29-446a-97ba-852536a43700 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:06.201492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c06d6c42-ac29-446a-97ba-852536a43700 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:06.213263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06d6c42-ac29-446a-97ba-852536a43700 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:06.213814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06d6c42-ac29-446a-97ba-852536a43700 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:06.215865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06d6c42-ac29-446a-97ba-852536a43700 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:06.217164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06d6c42-ac29-446a-97ba-852536a43700 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:06.217786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06d6c42-ac29-446a-97ba-852536a43700 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:06.218933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c06d6c42-ac29-446a-97ba-852536a43700 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:06.219405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3997a398-a373-4c73-b831-209f5bbedec0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:06.235034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3997a398-a373-4c73-b831-209f5bbedec0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:06.237940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3997a398-a373-4c73-b831-209f5bbedec0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:06.240696 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3997a398-a373-4c73-b831-209f5bbedec0 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1485 microversion: 2.25 time: 0.745868 Aug 23 18:01:06.241869 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1286/2564] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:05 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1485 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:06.248560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e8e0a6ca-c1a4-4c29-8ed8-dfffc19af022 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] Calling method '.version_select at 0x7f27ec05fca0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:06.520814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c06d6c42-ac29-446a-97ba-852536a43700 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:06.533737 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c06d6c42-ac29-446a-97ba-852536a43700 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1307 microversion: 2.1 time: 0.339006 Aug 23 18:01:06.535391 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1279/2565] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:06 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1307 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:06.590900 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e8e0a6ca-c1a4-4c29-8ed8-dfffc19af022 tempest-ListImageFiltersTestJSON-459532654 tempest-ListImageFiltersTestJSON-459532654-project] 10.222.0.61 "DELETE /compute/v2.1/images/6039f608-95b5-4680-86ef-f938a472320a" status: 204 len: 0 microversion: 2.1 time: 0.347156 Aug 23 18:01:06.595161 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1287/2566] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:06 2022] DELETE /compute/v2.1/images/6039f608-95b5-4680-86ef-f938a472320a => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:01:07.237960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-13e3eb41-3521-4c9b-90cc-c6061a13ece4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684-project-admin] Calling method '.version_select at 0x7f27ec8c1160>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:07.238960 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:01:07.238960 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:01:07.240134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13e3eb41-3521-4c9b-90cc-c6061a13ece4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:07.240641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13e3eb41-3521-4c9b-90cc-c6061a13ece4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:07.241081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13e3eb41-3521-4c9b-90cc-c6061a13ece4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:07.265914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-05ebc64a-62f0-4e46-a29a-ee6ab16b91c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:07.266900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-05ebc64a-62f0-4e46-a29a-ee6ab16b91c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:07.284500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05ebc64a-62f0-4e46-a29a-ee6ab16b91c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:07.287883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05ebc64a-62f0-4e46-a29a-ee6ab16b91c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:07.288628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05ebc64a-62f0-4e46-a29a-ee6ab16b91c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:07.291426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05ebc64a-62f0-4e46-a29a-ee6ab16b91c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:07.294518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05ebc64a-62f0-4e46-a29a-ee6ab16b91c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:07.296672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13e3eb41-3521-4c9b-90cc-c6061a13ece4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:07.297468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05ebc64a-62f0-4e46-a29a-ee6ab16b91c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:07.304461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13e3eb41-3521-4c9b-90cc-c6061a13ece4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:07.305285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13e3eb41-3521-4c9b-90cc-c6061a13ece4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:07.341422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13e3eb41-3521-4c9b-90cc-c6061a13ece4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:07.349518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13e3eb41-3521-4c9b-90cc-c6061a13ece4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:07.350118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13e3eb41-3521-4c9b-90cc-c6061a13ece4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:07.373940 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-13e3eb41-3521-4c9b-90cc-c6061a13ece4 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684 tempest-PortsAdminExtendedAttrsIpV6TestJSON-1915066684-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.400368 Aug 23 18:01:07.375366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:07.379359 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1280/2567] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 18:01:06 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:07.556121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6dcbe8a4-21c3-4a50-9d4b-a350cd212aa4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:07.556743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6dcbe8a4-21c3-4a50-9d4b-a350cd212aa4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:07.576151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dcbe8a4-21c3-4a50-9d4b-a350cd212aa4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:07.576916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dcbe8a4-21c3-4a50-9d4b-a350cd212aa4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:07.577521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dcbe8a4-21c3-4a50-9d4b-a350cd212aa4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:07.578411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dcbe8a4-21c3-4a50-9d4b-a350cd212aa4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:07.579048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dcbe8a4-21c3-4a50-9d4b-a350cd212aa4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:07.579669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dcbe8a4-21c3-4a50-9d4b-a350cd212aa4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:07.793569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6dcbe8a4-21c3-4a50-9d4b-a350cd212aa4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:07.855838 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6dcbe8a4-21c3-4a50-9d4b-a350cd212aa4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1307 microversion: 2.1 time: 0.284647 Aug 23 18:01:07.874863 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1281/2568] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:07 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1307 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:08.181694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-05ebc64a-62f0-4e46-a29a-ee6ab16b91c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:08.224100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-05ebc64a-62f0-4e46-a29a-ee6ab16b91c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:08.227776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-05ebc64a-62f0-4e46-a29a-ee6ab16b91c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:08.236659 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-05ebc64a-62f0-4e46-a29a-ee6ab16b91c1 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1475 microversion: 2.25 time: 0.971712 Aug 23 18:01:08.247190 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1288/2569] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:07 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1475 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:01:08.278406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d178fb7-f3d9-440b-9e50-eb8c4a9cac49 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '.version_select at 0x7f27dfd341f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:08.293733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d178fb7-f3d9-440b-9e50-eb8c4a9cac49 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:08.294506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d178fb7-f3d9-440b-9e50-eb8c4a9cac49 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:08.296092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d178fb7-f3d9-440b-9e50-eb8c4a9cac49 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:08.313685 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d178fb7-f3d9-440b-9e50-eb8c4a9cac49 tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/os-migrations" status: 200 len: 1714 microversion: 2.25 time: 0.046265 Aug 23 18:01:08.317348 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1282/2570] 10.222.0.61 () {60 vars in 1184 bytes} [Tue Aug 23 18:01:08 2022] GET /compute/v2.1/os-migrations => generated 1714 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:08.334127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e0d034cf-070c-4a0a-86a3-f619c0fe2d5b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:08.335991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e0d034cf-070c-4a0a-86a3-f619c0fe2d5b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:08.353509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0d034cf-070c-4a0a-86a3-f619c0fe2d5b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:08.354005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0d034cf-070c-4a0a-86a3-f619c0fe2d5b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:08.354440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0d034cf-070c-4a0a-86a3-f619c0fe2d5b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:08.358445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0d034cf-070c-4a0a-86a3-f619c0fe2d5b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:08.359924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0d034cf-070c-4a0a-86a3-f619c0fe2d5b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:08.360521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0d034cf-070c-4a0a-86a3-f619c0fe2d5b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:08.901182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a7902b22-dd20-4790-9b57-3af5a6908e41 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:08.901989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a7902b22-dd20-4790-9b57-3af5a6908e41 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:08.910369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7902b22-dd20-4790-9b57-3af5a6908e41 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:08.911245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7902b22-dd20-4790-9b57-3af5a6908e41 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:08.912784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7902b22-dd20-4790-9b57-3af5a6908e41 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:08.913689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7902b22-dd20-4790-9b57-3af5a6908e41 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:08.914466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7902b22-dd20-4790-9b57-3af5a6908e41 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:08.915284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7902b22-dd20-4790-9b57-3af5a6908e41 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:09.460859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-e0d034cf-070c-4a0a-86a3-f619c0fe2d5b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] Lazy-loading 'services' on Instance uuid d71f4ec4-18cf-4eae-9e86-4f91f90810f5 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:01:09.482129 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e0d034cf-070c-4a0a-86a3-f619c0fe2d5b tempest-LiveAutoBlockMigrationV225Test-1774992696 tempest-LiveAutoBlockMigrationV225Test-1774992696-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1969 microversion: 2.25 time: 1.154467 Aug 23 18:01:09.483480 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1289/2571] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:08 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1969 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:09.577782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f74a406a-d501-4a78-a3cf-6c69d367e9f8 tempest-ListImageFiltersNegativeTestJSON-412217115 tempest-ListImageFiltersNegativeTestJSON-412217115-project] Calling method '.version_select at 0x7f27dfabba60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:09.611889 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-f74a406a-d501-4a78-a3cf-6c69d367e9f8 tempest-ListImageFiltersNegativeTestJSON-412217115 tempest-ListImageFiltersNegativeTestJSON-412217115-project] HTTP exception thrown: Image not found. Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f74a406a-d501-4a78-a3cf-6c69d367e9f8 tempest-ListImageFiltersNegativeTestJSON-412217115 tempest-ListImageFiltersNegativeTestJSON-412217115-project] Request method failure captured: Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/images/03515355-efbe-4258-aa35-b997831bb6a5 HTTP/1.1 Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXlH0gUG7bD1FRIvIp1bKfPqXnSgUQwMDD83RWHuGP1izNqYUWM5WhgCeRf7L8D68J1SP36vFN5N03hZf88knT8CYadedl6HVLLPk_LTxYjg4cW6HKC_Ylzy9hLy5cLejzkNlCECmflkAbfEz7bc8h_6iVP2Q5K8q9zLL9m8nf8kko Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 8c73290b694a49b49d814c1996ba9612 Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-412217115 Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8c73290b694a49b49d814c1996ba9612"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8c73290b694a49b49d814c1996ba9612"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8c73290b694a49b49d814c1996ba9612"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8c73290b694a49b49d814c1996ba9612"}]}] Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-412217115 Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 8c73290b694a49b49d814c1996ba9612 Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-412217115 Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ListImageFiltersNegativeTestJSON-412217115-project Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 8e1f4314298040c9a091eb6f22a8b15f Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-412217115-project Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '03515355-efbe-4258-aa35-b997831bb6a5'} Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 03515355-efbe-4258-aa35-b997831bb6a5 Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 18:01:09.615465 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 03515355-efbe-4258-aa35-b997831bb6a5 could not be found. Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:09.619841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f74a406a-d501-4a78-a3cf-6c69d367e9f8 tempest-ListImageFiltersNegativeTestJSON-412217115 tempest-ListImageFiltersNegativeTestJSON-412217115-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:01:09.629454 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f74a406a-d501-4a78-a3cf-6c69d367e9f8 tempest-ListImageFiltersNegativeTestJSON-412217115 tempest-ListImageFiltersNegativeTestJSON-412217115-project] 10.222.0.61 "GET /compute/v2.1/images/03515355-efbe-4258-aa35-b997831bb6a5" status: 404 len: 62 microversion: 2.1 time: 0.137048 Aug 23 18:01:09.629454 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1290/2572] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:01:09 2022] GET /compute/v2.1/images/03515355-efbe-4258-aa35-b997831bb6a5 => generated 62 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:01:09.633389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6913710-42c2-4fc1-b408-57559927ca44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:09.634796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6913710-42c2-4fc1-b408-57559927ca44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:09.643149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6913710-42c2-4fc1-b408-57559927ca44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:09.643876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6913710-42c2-4fc1-b408-57559927ca44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:09.644435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6913710-42c2-4fc1-b408-57559927ca44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:09.645405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6913710-42c2-4fc1-b408-57559927ca44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:09.646222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6913710-42c2-4fc1-b408-57559927ca44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:09.646794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6913710-42c2-4fc1-b408-57559927ca44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:09.699438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6913710-42c2-4fc1-b408-57559927ca44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:01:09.816630 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6913710-42c2-4fc1-b408-57559927ca44 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 204 len: 0 microversion: 2.25 time: 0.192037 Aug 23 18:01:09.817346 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1291/2573] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:01:09 2022] DELETE /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:01:09.833750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef8788f1-4fc1-46a1-bbd3-800e122090db tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:09.833750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef8788f1-4fc1-46a1-bbd3-800e122090db tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:09.838643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:09.841740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef8788f1-4fc1-46a1-bbd3-800e122090db tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:09.842979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef8788f1-4fc1-46a1-bbd3-800e122090db tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:09.843854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef8788f1-4fc1-46a1-bbd3-800e122090db tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:09.844856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef8788f1-4fc1-46a1-bbd3-800e122090db tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:09.846066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef8788f1-4fc1-46a1-bbd3-800e122090db tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:09.846908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef8788f1-4fc1-46a1-bbd3-800e122090db tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:09.987406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a7902b22-dd20-4790-9b57-3af5a6908e41 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:09.997807 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a7902b22-dd20-4790-9b57-3af5a6908e41 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1307 microversion: 2.1 time: 1.100377 Aug 23 18:01:10.013576 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1283/2574] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:08 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1307 bytes in 1114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:10.142509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-cf10bc46-3207-42c4-a7a3-74eee37fda86 req-0f96c31d-7202-4979-9439-298ea96618f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2", "name": "network-vif-plugged", "status": "completed", "tag": "6d753232-30bd-45f2-b47d-0a1c92879f78"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:10.176256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cf10bc46-3207-42c4-a7a3-74eee37fda86 req-0f96c31d-7202-4979-9439-298ea96618f9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:10.176586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cf10bc46-3207-42c4-a7a3-74eee37fda86 req-0f96c31d-7202-4979-9439-298ea96618f9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:10.177386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cf10bc46-3207-42c4-a7a3-74eee37fda86 req-0f96c31d-7202-4979-9439-298ea96618f9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:10.222432 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-cf10bc46-3207-42c4-a7a3-74eee37fda86 req-0f96c31d-7202-4979-9439-298ea96618f9 service nova] Creating event network-vif-plugged:6d753232-30bd-45f2-b47d-0a1c92879f78 for instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 on n-h1-850468-16 Aug 23 18:01:10.234019 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-cf10bc46-3207-42c4-a7a3-74eee37fda86 req-0f96c31d-7202-4979-9439-298ea96618f9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095698 Aug 23 18:01:10.240350 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1284/2575] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:10.337134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef8788f1-4fc1-46a1-bbd3-800e122090db tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:10.365294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef8788f1-4fc1-46a1-bbd3-800e122090db tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:10.367009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef8788f1-4fc1-46a1-bbd3-800e122090db tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:10.372497 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef8788f1-4fc1-46a1-bbd3-800e122090db tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1481 microversion: 2.25 time: 0.548459 Aug 23 18:01:10.376522 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1292/2576] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:09 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1481 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:11.026711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-071271e0-e5af-476a-9d8d-03ad61612892 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:11.027579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-071271e0-e5af-476a-9d8d-03ad61612892 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:11.035912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-071271e0-e5af-476a-9d8d-03ad61612892 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:11.037331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-071271e0-e5af-476a-9d8d-03ad61612892 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:11.037917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-071271e0-e5af-476a-9d8d-03ad61612892 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:11.038779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-071271e0-e5af-476a-9d8d-03ad61612892 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:11.039348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-071271e0-e5af-476a-9d8d-03ad61612892 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:11.039884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-071271e0-e5af-476a-9d8d-03ad61612892 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:11.403846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5e85850c-f1cd-46f0-8a3f-27aebfd2059c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:11.404666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5e85850c-f1cd-46f0-8a3f-27aebfd2059c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:11.418417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e85850c-f1cd-46f0-8a3f-27aebfd2059c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:11.418944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e85850c-f1cd-46f0-8a3f-27aebfd2059c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:11.419390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e85850c-f1cd-46f0-8a3f-27aebfd2059c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:11.420374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e85850c-f1cd-46f0-8a3f-27aebfd2059c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:11.420862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e85850c-f1cd-46f0-8a3f-27aebfd2059c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:11.421346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e85850c-f1cd-46f0-8a3f-27aebfd2059c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:11.476727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-071271e0-e5af-476a-9d8d-03ad61612892 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:11.502493 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-071271e0-e5af-476a-9d8d-03ad61612892 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1307 microversion: 2.1 time: 0.477241 Aug 23 18:01:11.505282 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1285/2577] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:11 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1307 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:11.752745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5e85850c-f1cd-46f0-8a3f-27aebfd2059c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:11.780396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5e85850c-f1cd-46f0-8a3f-27aebfd2059c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:11.782167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5e85850c-f1cd-46f0-8a3f-27aebfd2059c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:11.783565 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5e85850c-f1cd-46f0-8a3f-27aebfd2059c tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1481 microversion: 2.25 time: 0.383741 Aug 23 18:01:11.784119 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1293/2578] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:11 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1481 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:01:12.073394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-9c027c06-0a0a-4e63-917b-589f80d292b3 req-de7746cf-3980-489c-a295-20bcf1bc24df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d71f4ec4-18cf-4eae-9e86-4f91f90810f5", "name": "network-vif-deleted", "tag": "98910578-3769-44bc-8492-76aab610ddc3"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:12.102724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9c027c06-0a0a-4e63-917b-589f80d292b3 req-de7746cf-3980-489c-a295-20bcf1bc24df service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:12.103386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9c027c06-0a0a-4e63-917b-589f80d292b3 req-de7746cf-3980-489c-a295-20bcf1bc24df service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:12.103951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9c027c06-0a0a-4e63-917b-589f80d292b3 req-de7746cf-3980-489c-a295-20bcf1bc24df service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:12.160765 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-9c027c06-0a0a-4e63-917b-589f80d292b3 req-de7746cf-3980-489c-a295-20bcf1bc24df service nova] Creating event network-vif-deleted:98910578-3769-44bc-8492-76aab610ddc3 for instance d71f4ec4-18cf-4eae-9e86-4f91f90810f5 on n-h1-850468-16 Aug 23 18:01:12.176658 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-9c027c06-0a0a-4e63-917b-589f80d292b3 req-de7746cf-3980-489c-a295-20bcf1bc24df service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107577 Aug 23 18:01:12.181789 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1286/2579] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:12.528477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac0947b2-cd62-4e40-a81b-429319b40b2a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:12.529094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac0947b2-cd62-4e40-a81b-429319b40b2a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:12.548484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac0947b2-cd62-4e40-a81b-429319b40b2a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:12.552327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac0947b2-cd62-4e40-a81b-429319b40b2a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:12.553223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac0947b2-cd62-4e40-a81b-429319b40b2a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:12.554116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac0947b2-cd62-4e40-a81b-429319b40b2a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:12.556330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac0947b2-cd62-4e40-a81b-429319b40b2a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:12.557800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac0947b2-cd62-4e40-a81b-429319b40b2a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:12.809932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ea3157b4-105b-4d90-a0bd-a03763b1c1a6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:12.810962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ea3157b4-105b-4d90-a0bd-a03763b1c1a6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:12.830009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3157b4-105b-4d90-a0bd-a03763b1c1a6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:12.836017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3157b4-105b-4d90-a0bd-a03763b1c1a6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:12.836637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3157b4-105b-4d90-a0bd-a03763b1c1a6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:12.837836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3157b4-105b-4d90-a0bd-a03763b1c1a6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:12.843109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3157b4-105b-4d90-a0bd-a03763b1c1a6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:12.843704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3157b4-105b-4d90-a0bd-a03763b1c1a6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:13.045378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ea3157b4-105b-4d90-a0bd-a03763b1c1a6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:13.059993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ea3157b4-105b-4d90-a0bd-a03763b1c1a6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:13.061512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ea3157b4-105b-4d90-a0bd-a03763b1c1a6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:13.073675 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ea3157b4-105b-4d90-a0bd-a03763b1c1a6 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1265 microversion: 2.25 time: 0.268269 Aug 23 18:01:13.094083 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1287/2580] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:12 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:13.560708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac0947b2-cd62-4e40-a81b-429319b40b2a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:13.588966 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac0947b2-cd62-4e40-a81b-429319b40b2a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1485 microversion: 2.1 time: 1.061195 Aug 23 18:01:13.592617 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1294/2581] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:12 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1485 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:13.611892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bb47a080-bed4-4622-ae15-0f87812a16e5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:13.622973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb47a080-bed4-4622-ae15-0f87812a16e5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:13.623640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb47a080-bed4-4622-ae15-0f87812a16e5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:13.624255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb47a080-bed4-4622-ae15-0f87812a16e5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:13.698465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bb47a080-bed4-4622-ae15-0f87812a16e5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Going to try to stop instance {{(pid=128807) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 18:01:13.718066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:13.815036 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bb47a080-bed4-4622-ae15-0f87812a16e5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "POST /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2/action" status: 202 len: 0 microversion: 2.1 time: 0.206696 Aug 23 18:01:13.827957 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1288/2582] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:01:13 2022] POST /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:01:13.839091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-896393d9-78a4-4663-ae69-5ddc6eb48a58 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:13.839932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-896393d9-78a4-4663-ae69-5ddc6eb48a58 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:13.854006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-896393d9-78a4-4663-ae69-5ddc6eb48a58 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:13.855111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-896393d9-78a4-4663-ae69-5ddc6eb48a58 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:13.856098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-896393d9-78a4-4663-ae69-5ddc6eb48a58 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:13.856854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-896393d9-78a4-4663-ae69-5ddc6eb48a58 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:13.861184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-896393d9-78a4-4663-ae69-5ddc6eb48a58 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:13.862448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-896393d9-78a4-4663-ae69-5ddc6eb48a58 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:14.105461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-804a67eb-7779-4ce0-ae78-ac9ca031ac20 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:14.106170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-804a67eb-7779-4ce0-ae78-ac9ca031ac20 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:14.129883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-804a67eb-7779-4ce0-ae78-ac9ca031ac20 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:14.130441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-804a67eb-7779-4ce0-ae78-ac9ca031ac20 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:14.130927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-804a67eb-7779-4ce0-ae78-ac9ca031ac20 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:14.131643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-804a67eb-7779-4ce0-ae78-ac9ca031ac20 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:14.136478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-804a67eb-7779-4ce0-ae78-ac9ca031ac20 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:14.136939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-804a67eb-7779-4ce0-ae78-ac9ca031ac20 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:14.449002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-896393d9-78a4-4663-ae69-5ddc6eb48a58 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:14.467032 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-896393d9-78a4-4663-ae69-5ddc6eb48a58 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.633900 Aug 23 18:01:14.470896 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1295/2583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:13 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:14.803173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-804a67eb-7779-4ce0-ae78-ac9ca031ac20 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:14.822516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-804a67eb-7779-4ce0-ae78-ac9ca031ac20 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:14.824139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-804a67eb-7779-4ce0-ae78-ac9ca031ac20 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:14.825467 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-804a67eb-7779-4ce0-ae78-ac9ca031ac20 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1265 microversion: 2.25 time: 0.728885 Aug 23 18:01:14.828967 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1289/2584] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:14 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1265 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:01:15.499263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6517d367-ef43-4eb7-b5ff-41830791bf90 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:15.500049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6517d367-ef43-4eb7-b5ff-41830791bf90 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:15.515803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6517d367-ef43-4eb7-b5ff-41830791bf90 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:15.519547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6517d367-ef43-4eb7-b5ff-41830791bf90 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:15.520405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6517d367-ef43-4eb7-b5ff-41830791bf90 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:15.522117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6517d367-ef43-4eb7-b5ff-41830791bf90 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:15.526211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6517d367-ef43-4eb7-b5ff-41830791bf90 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:15.527786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6517d367-ef43-4eb7-b5ff-41830791bf90 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:15.856440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4daff353-2424-458b-8fad-caa22ca45386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:15.857062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4daff353-2424-458b-8fad-caa22ca45386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:15.877821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4daff353-2424-458b-8fad-caa22ca45386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:15.883285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4daff353-2424-458b-8fad-caa22ca45386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:15.883871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4daff353-2424-458b-8fad-caa22ca45386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:15.884650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4daff353-2424-458b-8fad-caa22ca45386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:15.887579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4daff353-2424-458b-8fad-caa22ca45386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:15.888071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4daff353-2424-458b-8fad-caa22ca45386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:16.197169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4daff353-2424-458b-8fad-caa22ca45386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:16.211256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4daff353-2424-458b-8fad-caa22ca45386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:16.214758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4daff353-2424-458b-8fad-caa22ca45386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:16.219258 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4daff353-2424-458b-8fad-caa22ca45386 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1265 microversion: 2.25 time: 0.367028 Aug 23 18:01:16.222239 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1290/2585] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:15 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1265 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:16.300931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6517d367-ef43-4eb7-b5ff-41830791bf90 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:16.320255 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6517d367-ef43-4eb7-b5ff-41830791bf90 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.827296 Aug 23 18:01:16.321127 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1296/2586] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:15 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:17.244435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9fbc6623-6bb3-41be-95a1-484ed67de740 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:17.245206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9fbc6623-6bb3-41be-95a1-484ed67de740 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:17.257417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fbc6623-6bb3-41be-95a1-484ed67de740 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:17.257921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fbc6623-6bb3-41be-95a1-484ed67de740 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:17.258356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fbc6623-6bb3-41be-95a1-484ed67de740 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:17.259300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fbc6623-6bb3-41be-95a1-484ed67de740 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:17.259983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fbc6623-6bb3-41be-95a1-484ed67de740 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:17.260565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fbc6623-6bb3-41be-95a1-484ed67de740 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:17.353732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ada43b42-5fb4-4e2e-92d9-20f1d24728bf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:17.354914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ada43b42-5fb4-4e2e-92d9-20f1d24728bf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:17.385101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ada43b42-5fb4-4e2e-92d9-20f1d24728bf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:17.394376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ada43b42-5fb4-4e2e-92d9-20f1d24728bf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:17.396416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ada43b42-5fb4-4e2e-92d9-20f1d24728bf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:17.397205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ada43b42-5fb4-4e2e-92d9-20f1d24728bf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:17.397688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ada43b42-5fb4-4e2e-92d9-20f1d24728bf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:17.398297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ada43b42-5fb4-4e2e-92d9-20f1d24728bf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:17.618472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9fbc6623-6bb3-41be-95a1-484ed67de740 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:17.634141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9fbc6623-6bb3-41be-95a1-484ed67de740 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:17.638075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9fbc6623-6bb3-41be-95a1-484ed67de740 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:17.642681 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9fbc6623-6bb3-41be-95a1-484ed67de740 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1265 microversion: 2.25 time: 0.401964 Aug 23 18:01:17.644684 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1291/2587] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:17 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1265 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:17.925186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ada43b42-5fb4-4e2e-92d9-20f1d24728bf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:17.933512 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ada43b42-5fb4-4e2e-92d9-20f1d24728bf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.585495 Aug 23 18:01:17.946781 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1297/2588] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:17 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:18.665235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-641194f6-cda9-457b-8f94-15dbea66cc4e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:18.667173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-641194f6-cda9-457b-8f94-15dbea66cc4e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:18.691726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641194f6-cda9-457b-8f94-15dbea66cc4e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:18.692415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641194f6-cda9-457b-8f94-15dbea66cc4e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:18.693048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641194f6-cda9-457b-8f94-15dbea66cc4e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:18.694142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641194f6-cda9-457b-8f94-15dbea66cc4e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:18.694813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641194f6-cda9-457b-8f94-15dbea66cc4e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:18.695412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641194f6-cda9-457b-8f94-15dbea66cc4e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:18.881569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-641194f6-cda9-457b-8f94-15dbea66cc4e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:18.898490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48a5d81a-32a8-442f-89f2-31d3dbf4de5f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'create', calling method: .version_select at 0x7f27dfa8f820>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-522506950", "description": "tempest-description-946669700"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:18.906103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-641194f6-cda9-457b-8f94-15dbea66cc4e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:18.907645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-641194f6-cda9-457b-8f94-15dbea66cc4e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:18.908797 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-641194f6-cda9-457b-8f94-15dbea66cc4e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1265 microversion: 2.25 time: 0.247590 Aug 23 18:01:18.916506 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1292/2589] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:18 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:18.959983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93cdc735-8ca2-4ddd-9bc1-e85398a1035a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:18.961465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-93cdc735-8ca2-4ddd-9bc1-e85398a1035a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:18.977517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93cdc735-8ca2-4ddd-9bc1-e85398a1035a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:18.978904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93cdc735-8ca2-4ddd-9bc1-e85398a1035a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:18.979888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93cdc735-8ca2-4ddd-9bc1-e85398a1035a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:18.981260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93cdc735-8ca2-4ddd-9bc1-e85398a1035a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:18.983438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93cdc735-8ca2-4ddd-9bc1-e85398a1035a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:18.984610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93cdc735-8ca2-4ddd-9bc1-e85398a1035a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:19.284988 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48a5d81a-32a8-442f-89f2-31d3dbf4de5f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.602131 Aug 23 18:01:19.286969 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1298/2590] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:01:18 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:19.307496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d209cf78-76e5-444d-a325-a998a2aac654 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'create', calling method: .version_select at 0x7f27dfa8f160>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-396324189", "description": "tempest-description-358337827"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:19.542199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-93cdc735-8ca2-4ddd-9bc1-e85398a1035a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:19.558908 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93cdc735-8ca2-4ddd-9bc1-e85398a1035a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.602771 Aug 23 18:01:19.561774 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1293/2591] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:18 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:19.940099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b40ba0f1-98f6-4cea-a81c-3569eb629068 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:19.942096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b40ba0f1-98f6-4cea-a81c-3569eb629068 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:19.958940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b40ba0f1-98f6-4cea-a81c-3569eb629068 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:19.960287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b40ba0f1-98f6-4cea-a81c-3569eb629068 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:19.967737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b40ba0f1-98f6-4cea-a81c-3569eb629068 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:19.968763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b40ba0f1-98f6-4cea-a81c-3569eb629068 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:19.969394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b40ba0f1-98f6-4cea-a81c-3569eb629068 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:19.970884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b40ba0f1-98f6-4cea-a81c-3569eb629068 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:20.185968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b40ba0f1-98f6-4cea-a81c-3569eb629068 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:20.198033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b40ba0f1-98f6-4cea-a81c-3569eb629068 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:20.212024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b40ba0f1-98f6-4cea-a81c-3569eb629068 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:20.218232 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b40ba0f1-98f6-4cea-a81c-3569eb629068 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 200 len: 1265 microversion: 2.25 time: 0.287005 Aug 23 18:01:20.233724 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1294/2592] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:19 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 1265 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:20.436932 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d209cf78-76e5-444d-a325-a998a2aac654 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.134232 Aug 23 18:01:20.438081 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1299/2593] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:01:19 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:20.586346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-977abd00-cde3-46ad-b300-e03af3903813 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:20.586995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-977abd00-cde3-46ad-b300-e03af3903813 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:20.603768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:20.605334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-977abd00-cde3-46ad-b300-e03af3903813 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:20.605836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-977abd00-cde3-46ad-b300-e03af3903813 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:20.606292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-977abd00-cde3-46ad-b300-e03af3903813 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:20.607058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-977abd00-cde3-46ad-b300-e03af3903813 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:20.627114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-977abd00-cde3-46ad-b300-e03af3903813 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:20.627628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-977abd00-cde3-46ad-b300-e03af3903813 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:20.752978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1819033286", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "8328d7a4-3299-4bee-8d7d-1c2326f33fb2"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:20.865488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] validate_networks() for [('8328d7a4-3299-4bee-8d7d-1c2326f33fb2', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:01:21.441639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-977abd00-cde3-46ad-b300-e03af3903813 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:21.450230 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-977abd00-cde3-46ad-b300-e03af3903813 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.872330 Aug 23 18:01:21.462196 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1295/2594] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:20 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:21.486819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c4b70dbb-d690-4fe5-a901-da3b2f9ac355 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:21.488087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c4b70dbb-d690-4fe5-a901-da3b2f9ac355 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: d71f4ec4-18cf-4eae-9e86-4f91f90810f5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:21.528386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4b70dbb-d690-4fe5-a901-da3b2f9ac355 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:21.545093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4b70dbb-d690-4fe5-a901-da3b2f9ac355 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:21.545558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4b70dbb-d690-4fe5-a901-da3b2f9ac355 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:21.547706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4b70dbb-d690-4fe5-a901-da3b2f9ac355 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:21.549077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4b70dbb-d690-4fe5-a901-da3b2f9ac355 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:21.551163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4b70dbb-d690-4fe5-a901-da3b2f9ac355 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:21.569387 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-c4b70dbb-d690-4fe5-a901-da3b2f9ac355 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] HTTP exception thrown: Instance d71f4ec4-18cf-4eae-9e86-4f91f90810f5 could not be found. Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c4b70dbb-d690-4fe5-a901-da3b2f9ac355 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Request method failure captured: Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 HTTP/1.1 Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRP8_MSBeCvyoczJoDOjyK9PVKMQv_FFzBJiC7Rbq488aZTAXcY393dxSu7bla41fBTKtiI_qjDXAeOFiFtyITkcLMLbvFAvzdzRa5BLDDiiwRSAJYHSPwfaYu3XkXu71Havzq4MQ9cg7o9HNRktxA1oTHaPXN_AGgKh5gSuQoQsPqI Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.25 Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a847d523b7944595aa39244f15b37665 Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-807887112 Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a847d523b7944595aa39244f15b37665"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a847d523b7944595aa39244f15b37665"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a847d523b7944595aa39244f15b37665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a847d523b7944595aa39244f15b37665"}]}] Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-807887112 Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a847d523b7944595aa39244f15b37665 Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-807887112 Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-LiveAutoBlockMigrationV225Test-807887112-project Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: bb8758f075834ca59962ab82f042ec34 Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-807887112-project Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance d71f4ec4-18cf-4eae-9e86-4f91f90810f5 could not be found. Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'd71f4ec4-18cf-4eae-9e86-4f91f90810f5'} Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d71f4ec4-18cf-4eae-9e86-4f91f90810f5 could not be found. Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d71f4ec4-18cf-4eae-9e86-4f91f90810f5 could not be found. Aug 23 18:01:21.572079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:21.576315 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:21.576315 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:21.576315 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:21.576315 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:21.576315 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:21.576315 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:01:21.576315 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:01:21.576315 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d71f4ec4-18cf-4eae-9e86-4f91f90810f5 could not be found. Aug 23 18:01:21.576315 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:21.578981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c4b70dbb-d690-4fe5-a901-da3b2f9ac355 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Returning 404 to user: Instance d71f4ec4-18cf-4eae-9e86-4f91f90810f5 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:01:21.580972 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c4b70dbb-d690-4fe5-a901-da3b2f9ac355 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5" status: 404 len: 111 microversion: 2.25 time: 0.107682 Aug 23 18:01:21.582300 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1296/2595] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:21 2022] GET /compute/v2.1/servers/d71f4ec4-18cf-4eae-9e86-4f91f90810f5 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:01:22.202393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:01:22.202837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:01:22.204341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:01:22.204341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:01:22.204341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:01:22.232734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:22.235675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:22.238705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:22.239739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:22.242677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:22.244117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:22.317778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Getting quotas for project 10967ccfae5f43258e54fef325e5a0b2. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:01:22.335870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Getting quotas for user db5f64cd07c1440f9b484294ef350aa8 and project 10967ccfae5f43258e54fef325e5a0b2. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:01:22.405722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:01:22.414602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:01:22.489280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49a5b570-dbae-497b-b09e-635b3948bdb3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:22.490067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49a5b570-dbae-497b-b09e-635b3948bdb3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:22.512554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a5b570-dbae-497b-b09e-635b3948bdb3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:22.516901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a5b570-dbae-497b-b09e-635b3948bdb3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:22.517563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a5b570-dbae-497b-b09e-635b3948bdb3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:22.523648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a5b570-dbae-497b-b09e-635b3948bdb3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:22.527054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a5b570-dbae-497b-b09e-635b3948bdb3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:22.532155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a5b570-dbae-497b-b09e-635b3948bdb3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:22.581335 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0859d31a-0401-47e8-83be-b51531ede029 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.832442 Aug 23 18:01:22.582107 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1300/2596] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:01:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1834 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:01:22.605004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bd9fce9f-f221-403a-8c09-aaa3a2156129 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:22.612041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bd9fce9f-f221-403a-8c09-aaa3a2156129 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:22.919350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bd9fce9f-f221-403a-8c09-aaa3a2156129 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:22.941974 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bd9fce9f-f221-403a-8c09-aaa3a2156129 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1216 microversion: 2.1 time: 0.347181 Aug 23 18:01:22.944413 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1301/2597] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:22 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1216 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:23.734195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-49a5b570-dbae-497b-b09e-635b3948bdb3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:23.752354 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49a5b570-dbae-497b-b09e-635b3948bdb3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 1.268559 Aug 23 18:01:23.766807 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1297/2598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:22 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:23.963547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4adfd642-c14d-4967-8672-1df766942518 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:23.964176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4adfd642-c14d-4967-8672-1df766942518 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:24.192502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4adfd642-c14d-4967-8672-1df766942518 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:24.212289 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4adfd642-c14d-4967-8672-1df766942518 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1216 microversion: 2.1 time: 0.250608 Aug 23 18:01:24.239500 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1302/2599] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:23 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1216 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:24.773551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3cfb999b-6048-47da-8cab-c91a759e347b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:24.774966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3cfb999b-6048-47da-8cab-c91a759e347b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:24.792171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3cfb999b-6048-47da-8cab-c91a759e347b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:24.793031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3cfb999b-6048-47da-8cab-c91a759e347b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:24.796112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3cfb999b-6048-47da-8cab-c91a759e347b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:24.797172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3cfb999b-6048-47da-8cab-c91a759e347b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:24.799293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3cfb999b-6048-47da-8cab-c91a759e347b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:24.800559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3cfb999b-6048-47da-8cab-c91a759e347b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:25.263816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c2e0c054-f8d7-4f46-bbbc-5d8b440b3aee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:25.265085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c2e0c054-f8d7-4f46-bbbc-5d8b440b3aee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:25.283873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2e0c054-f8d7-4f46-bbbc-5d8b440b3aee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:25.285260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2e0c054-f8d7-4f46-bbbc-5d8b440b3aee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:25.285904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2e0c054-f8d7-4f46-bbbc-5d8b440b3aee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:25.286881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2e0c054-f8d7-4f46-bbbc-5d8b440b3aee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:25.287494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2e0c054-f8d7-4f46-bbbc-5d8b440b3aee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:25.291049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2e0c054-f8d7-4f46-bbbc-5d8b440b3aee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:25.476681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3cfb999b-6048-47da-8cab-c91a759e347b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:25.485662 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3cfb999b-6048-47da-8cab-c91a759e347b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.715829 Aug 23 18:01:25.497337 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1298/2600] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:24 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:25.698247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-36170131", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:25.767827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:01:26.030632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c2e0c054-f8d7-4f46-bbbc-5d8b440b3aee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:26.043933 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c2e0c054-f8d7-4f46-bbbc-5d8b440b3aee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1276 microversion: 2.1 time: 0.783725 Aug 23 18:01:26.046596 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1303/2601] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:25 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1276 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:26.456953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:01:26.459053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:01:26.460215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:01:26.461266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:01:26.461920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:01:26.490038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:26.490938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:26.491594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:26.492549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:26.493245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:26.494655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:26.523747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a1091960-9389-486b-a158-42202b72a82c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:26.524378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a1091960-9389-486b-a158-42202b72a82c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:26.545421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1091960-9389-486b-a158-42202b72a82c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:26.546567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1091960-9389-486b-a158-42202b72a82c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:26.548187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:01:26.553180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1091960-9389-486b-a158-42202b72a82c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:26.554087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1091960-9389-486b-a158-42202b72a82c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:26.557388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1091960-9389-486b-a158-42202b72a82c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:26.557388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1091960-9389-486b-a158-42202b72a82c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:26.557544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:01:26.592611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:01:26.594935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:01:26.694130 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-42134035-a26a-4c7e-83f5-d516ded46bda tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.194881 Aug 23 18:01:26.696071 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1299/2602] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:01:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1198 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:01:26.714510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-52459533-45b7-48e7-b57d-672e598ab157 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:26.718707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-52459533-45b7-48e7-b57d-672e598ab157 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:26.989020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a1091960-9389-486b-a158-42202b72a82c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:27.000879 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a1091960-9389-486b-a158-42202b72a82c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.480000 Aug 23 18:01:27.007386 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1304/2603] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:26 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:27.012293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-52459533-45b7-48e7-b57d-672e598ab157 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:27.024455 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-52459533-45b7-48e7-b57d-672e598ab157 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1215 microversion: 2.1 time: 0.320310 Aug 23 18:01:27.026464 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1300/2604] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:26 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1215 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:27.068512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcc12c90-ad5c-4837-ab18-f97e8523f39f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:27.069425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fcc12c90-ad5c-4837-ab18-f97e8523f39f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:27.079051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcc12c90-ad5c-4837-ab18-f97e8523f39f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:27.082459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcc12c90-ad5c-4837-ab18-f97e8523f39f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:27.083165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcc12c90-ad5c-4837-ab18-f97e8523f39f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:27.088337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcc12c90-ad5c-4837-ab18-f97e8523f39f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:27.090203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcc12c90-ad5c-4837-ab18-f97e8523f39f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:27.091098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcc12c90-ad5c-4837-ab18-f97e8523f39f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:27.386129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fcc12c90-ad5c-4837-ab18-f97e8523f39f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:27.398410 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fcc12c90-ad5c-4837-ab18-f97e8523f39f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1274 microversion: 2.1 time: 0.335224 Aug 23 18:01:27.408572 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1305/2605] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:27 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1274 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:27.723726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8fe691bd-b094-4612-8e95-5b69652dcc6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:27.725089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8fe691bd-b094-4612-8e95-5b69652dcc6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:27.740831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8fe691bd-b094-4612-8e95-5b69652dcc6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:27.742683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8fe691bd-b094-4612-8e95-5b69652dcc6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:27.744807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8fe691bd-b094-4612-8e95-5b69652dcc6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:27.748498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8fe691bd-b094-4612-8e95-5b69652dcc6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:27.751104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8fe691bd-b094-4612-8e95-5b69652dcc6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:27.751999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8fe691bd-b094-4612-8e95-5b69652dcc6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:28.031721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-807fde8d-1658-46d0-8a21-29f19c687daf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:28.032330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-807fde8d-1658-46d0-8a21-29f19c687daf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:28.045727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-807fde8d-1658-46d0-8a21-29f19c687daf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:28.046459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-807fde8d-1658-46d0-8a21-29f19c687daf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:28.049340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-807fde8d-1658-46d0-8a21-29f19c687daf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:28.051307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-807fde8d-1658-46d0-8a21-29f19c687daf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:28.051940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-807fde8d-1658-46d0-8a21-29f19c687daf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:28.052676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-807fde8d-1658-46d0-8a21-29f19c687daf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:29.064711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-807fde8d-1658-46d0-8a21-29f19c687daf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:29.079971 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-807fde8d-1658-46d0-8a21-29f19c687daf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 1.051928 Aug 23 18:01:29.094618 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1306/2606] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:28 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:29.115132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd3a872a-b8d1-40dd-9121-4c753f1087c3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:29.116054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cd3a872a-b8d1-40dd-9121-4c753f1087c3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:29.127429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd3a872a-b8d1-40dd-9121-4c753f1087c3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:29.128091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd3a872a-b8d1-40dd-9121-4c753f1087c3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:29.129390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd3a872a-b8d1-40dd-9121-4c753f1087c3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:29.135537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd3a872a-b8d1-40dd-9121-4c753f1087c3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:29.136435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd3a872a-b8d1-40dd-9121-4c753f1087c3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:29.136877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd3a872a-b8d1-40dd-9121-4c753f1087c3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:29.297544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cd3a872a-b8d1-40dd-9121-4c753f1087c3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:29.306860 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd3a872a-b8d1-40dd-9121-4c753f1087c3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1273 microversion: 2.1 time: 0.210763 Aug 23 18:01:29.316088 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1307/2607] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:29 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1273 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:29.321719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5929ce7d-8235-47a5-ac2b-7511f3b015d2 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:29.322342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5929ce7d-8235-47a5-ac2b-7511f3b015d2 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:29.342234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5929ce7d-8235-47a5-ac2b-7511f3b015d2 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:29.348999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5929ce7d-8235-47a5-ac2b-7511f3b015d2 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:29.349640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5929ce7d-8235-47a5-ac2b-7511f3b015d2 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:29.350566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5929ce7d-8235-47a5-ac2b-7511f3b015d2 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:29.354182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5929ce7d-8235-47a5-ac2b-7511f3b015d2 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:29.354835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5929ce7d-8235-47a5-ac2b-7511f3b015d2 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:29.393065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:29.646259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8fe691bd-b094-4612-8e95-5b69652dcc6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:29.657196 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8fe691bd-b094-4612-8e95-5b69652dcc6d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 1.937077 Aug 23 18:01:29.665425 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1301/2608] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:27 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 1947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:29.688913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e1f86be-494e-418e-a3fa-7b280a8b7d39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:29.689764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e1f86be-494e-418e-a3fa-7b280a8b7d39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:29.703632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e1f86be-494e-418e-a3fa-7b280a8b7d39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:29.705516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e1f86be-494e-418e-a3fa-7b280a8b7d39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:29.706709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e1f86be-494e-418e-a3fa-7b280a8b7d39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:29.707915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e1f86be-494e-418e-a3fa-7b280a8b7d39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:29.708912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e1f86be-494e-418e-a3fa-7b280a8b7d39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:29.710901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5929ce7d-8235-47a5-ac2b-7511f3b015d2 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:29.723402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e1f86be-494e-418e-a3fa-7b280a8b7d39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:29.723632 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5929ce7d-8235-47a5-ac2b-7511f3b015d2 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1316 microversion: 2.1 time: 0.405741 Aug 23 18:01:29.724070 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1308/2609] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:29 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1316 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:29.763187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-30165646-5fa4-4bd1-994e-0a5452ea0d1f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:29.763774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-30165646-5fa4-4bd1-994e-0a5452ea0d1f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:29.782034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30165646-5fa4-4bd1-994e-0a5452ea0d1f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:29.782522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30165646-5fa4-4bd1-994e-0a5452ea0d1f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:29.782980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30165646-5fa4-4bd1-994e-0a5452ea0d1f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:29.783679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30165646-5fa4-4bd1-994e-0a5452ea0d1f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:29.791331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30165646-5fa4-4bd1-994e-0a5452ea0d1f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:29.791848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30165646-5fa4-4bd1-994e-0a5452ea0d1f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:29.852828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-30165646-5fa4-4bd1-994e-0a5452ea0d1f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:01:29.992010 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-30165646-5fa4-4bd1-994e-0a5452ea0d1f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "DELETE /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 204 len: 0 microversion: 2.25 time: 0.233924 Aug 23 18:01:29.996575 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1309/2610] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:01:29 2022] DELETE /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 18:01:30.005481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c737bf80-3958-4782-bdc1-18e5514db493 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:30.006440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c737bf80-3958-4782-bdc1-18e5514db493 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:30.013428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c737bf80-3958-4782-bdc1-18e5514db493 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:30.014404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c737bf80-3958-4782-bdc1-18e5514db493 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:30.015065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c737bf80-3958-4782-bdc1-18e5514db493 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:30.016192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c737bf80-3958-4782-bdc1-18e5514db493 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:30.018187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c737bf80-3958-4782-bdc1-18e5514db493 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:30.018861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c737bf80-3958-4782-bdc1-18e5514db493 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:30.239737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c737bf80-3958-4782-bdc1-18e5514db493 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:30.253714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c737bf80-3958-4782-bdc1-18e5514db493 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:30.255635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c737bf80-3958-4782-bdc1-18e5514db493 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:30.256727 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c737bf80-3958-4782-bdc1-18e5514db493 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1732 microversion: 2.25 time: 0.258747 Aug 23 18:01:30.257567 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1310/2611] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:29 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1732 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:30.264359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2f84edd0-ff65-40f7-a225-94ef0a9a8fed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:30.265201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2f84edd0-ff65-40f7-a225-94ef0a9a8fed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:30.290658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f84edd0-ff65-40f7-a225-94ef0a9a8fed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:30.291180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f84edd0-ff65-40f7-a225-94ef0a9a8fed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:30.291631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f84edd0-ff65-40f7-a225-94ef0a9a8fed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:30.292847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f84edd0-ff65-40f7-a225-94ef0a9a8fed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:30.294421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f84edd0-ff65-40f7-a225-94ef0a9a8fed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:30.296474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f84edd0-ff65-40f7-a225-94ef0a9a8fed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:30.303881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e1f86be-494e-418e-a3fa-7b280a8b7d39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:30.330092 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e1f86be-494e-418e-a3fa-7b280a8b7d39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.642604 Aug 23 18:01:30.344929 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1302/2612] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:29 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:30.361224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-745f6eb2-9e06-4eb2-a011-217039e80bbc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:30.365404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-745f6eb2-9e06-4eb2-a011-217039e80bbc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:30.382777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-745f6eb2-9e06-4eb2-a011-217039e80bbc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:30.383419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-745f6eb2-9e06-4eb2-a011-217039e80bbc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:30.384064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-745f6eb2-9e06-4eb2-a011-217039e80bbc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:30.387394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-745f6eb2-9e06-4eb2-a011-217039e80bbc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:30.387993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-745f6eb2-9e06-4eb2-a011-217039e80bbc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:30.388532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-745f6eb2-9e06-4eb2-a011-217039e80bbc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:30.548506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2f84edd0-ff65-40f7-a225-94ef0a9a8fed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:30.555674 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2f84edd0-ff65-40f7-a225-94ef0a9a8fed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.296649 Aug 23 18:01:30.556426 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1311/2613] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:30 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:30.561735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3234519e-a2a7-4f85-81e3-a02c87be3000 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:30.562674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3234519e-a2a7-4f85-81e3-a02c87be3000 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:30.569536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3234519e-a2a7-4f85-81e3-a02c87be3000 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:30.570359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3234519e-a2a7-4f85-81e3-a02c87be3000 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:30.571042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3234519e-a2a7-4f85-81e3-a02c87be3000 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:30.572001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3234519e-a2a7-4f85-81e3-a02c87be3000 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:30.572661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3234519e-a2a7-4f85-81e3-a02c87be3000 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:30.573283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3234519e-a2a7-4f85-81e3-a02c87be3000 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:30.605930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-745f6eb2-9e06-4eb2-a011-217039e80bbc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:30.643752 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-745f6eb2-9e06-4eb2-a011-217039e80bbc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1273 microversion: 2.1 time: 0.291229 Aug 23 18:01:30.645127 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1303/2614] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:30 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1273 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:30.749034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4ba25529-6b59-47dd-8c6f-905f0fc05a4d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:30.749886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4ba25529-6b59-47dd-8c6f-905f0fc05a4d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:30.757204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ba25529-6b59-47dd-8c6f-905f0fc05a4d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:30.767482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ba25529-6b59-47dd-8c6f-905f0fc05a4d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:30.770186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ba25529-6b59-47dd-8c6f-905f0fc05a4d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:30.772336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ba25529-6b59-47dd-8c6f-905f0fc05a4d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:30.774991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ba25529-6b59-47dd-8c6f-905f0fc05a4d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:30.777449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ba25529-6b59-47dd-8c6f-905f0fc05a4d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:30.973509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3234519e-a2a7-4f85-81e3-a02c87be3000 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:30.987156 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3234519e-a2a7-4f85-81e3-a02c87be3000 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.429065 Aug 23 18:01:30.990271 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1312/2615] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:30 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:31.011561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4869e0e8-b465-49d9-8853-2baedec15af8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-231255646"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:31.038896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4869e0e8-b465-49d9-8853-2baedec15af8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:31.065287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4869e0e8-b465-49d9-8853-2baedec15af8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:31.068997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4869e0e8-b465-49d9-8853-2baedec15af8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:31.070049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4869e0e8-b465-49d9-8853-2baedec15af8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:31.076182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4869e0e8-b465-49d9-8853-2baedec15af8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:31.084762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4869e0e8-b465-49d9-8853-2baedec15af8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:31.085333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4869e0e8-b465-49d9-8853-2baedec15af8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:31.305222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ba25529-6b59-47dd-8c6f-905f0fc05a4d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:31.317422 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4ba25529-6b59-47dd-8c6f-905f0fc05a4d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1316 microversion: 2.1 time: 0.573491 Aug 23 18:01:31.318227 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1304/2616] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:30 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1316 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:31.336526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-594bc4f6-8d49-4e8b-8300-ad7c97e1de2b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:31.337146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-594bc4f6-8d49-4e8b-8300-ad7c97e1de2b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:31.354496 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4869e0e8-b465-49d9-8853-2baedec15af8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.348034 Aug 23 18:01:31.355926 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1313/2617] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:01:31 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 23 18:01:31.358612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-594bc4f6-8d49-4e8b-8300-ad7c97e1de2b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:31.359893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-594bc4f6-8d49-4e8b-8300-ad7c97e1de2b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:31.362226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-594bc4f6-8d49-4e8b-8300-ad7c97e1de2b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:31.363368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-594bc4f6-8d49-4e8b-8300-ad7c97e1de2b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:31.365792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-594bc4f6-8d49-4e8b-8300-ad7c97e1de2b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:31.366404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-594bc4f6-8d49-4e8b-8300-ad7c97e1de2b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:31.584861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93be0fb9-d8a6-4c93-9086-d86028e93eae tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:31.585689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-93be0fb9-d8a6-4c93-9086-d86028e93eae tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:31.598262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93be0fb9-d8a6-4c93-9086-d86028e93eae tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:31.598993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93be0fb9-d8a6-4c93-9086-d86028e93eae tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:31.599720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93be0fb9-d8a6-4c93-9086-d86028e93eae tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:31.600607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93be0fb9-d8a6-4c93-9086-d86028e93eae tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:31.601217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93be0fb9-d8a6-4c93-9086-d86028e93eae tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:31.601786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93be0fb9-d8a6-4c93-9086-d86028e93eae tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:31.999917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-594bc4f6-8d49-4e8b-8300-ad7c97e1de2b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:32.008930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-594bc4f6-8d49-4e8b-8300-ad7c97e1de2b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:32.010420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-594bc4f6-8d49-4e8b-8300-ad7c97e1de2b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:32.011605 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-594bc4f6-8d49-4e8b-8300-ad7c97e1de2b tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1732 microversion: 2.25 time: 0.679187 Aug 23 18:01:32.012354 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1305/2618] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:31 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1732 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:32.032298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf4f911b-78b8-43d6-af7a-c61192bf53a7 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:32.032921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf4f911b-78b8-43d6-af7a-c61192bf53a7 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:32.039873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4f911b-78b8-43d6-af7a-c61192bf53a7 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:32.042614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4f911b-78b8-43d6-af7a-c61192bf53a7 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:32.042614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4f911b-78b8-43d6-af7a-c61192bf53a7 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:32.042614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4f911b-78b8-43d6-af7a-c61192bf53a7 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:32.042614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4f911b-78b8-43d6-af7a-c61192bf53a7 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:32.042614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4f911b-78b8-43d6-af7a-c61192bf53a7 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:32.121896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93be0fb9-d8a6-4c93-9086-d86028e93eae tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:32.152897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf4f911b-78b8-43d6-af7a-c61192bf53a7 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:32.153637 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93be0fb9-d8a6-4c93-9086-d86028e93eae tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.574826 Aug 23 18:01:32.156481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:32.162893 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf4f911b-78b8-43d6-af7a-c61192bf53a7 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1273 microversion: 2.1 time: 0.135142 Aug 23 18:01:32.172803 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1314/2619] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:31 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:32.186310 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1306/2620] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:32 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:32.338998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d0917df4-8802-4b82-9b65-4a0665f0d9b0 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:32.340166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d0917df4-8802-4b82-9b65-4a0665f0d9b0 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:32.347645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:32.359435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0917df4-8802-4b82-9b65-4a0665f0d9b0 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:32.361015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0917df4-8802-4b82-9b65-4a0665f0d9b0 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:32.364719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0917df4-8802-4b82-9b65-4a0665f0d9b0 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:32.365763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0917df4-8802-4b82-9b65-4a0665f0d9b0 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:32.367140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0917df4-8802-4b82-9b65-4a0665f0d9b0 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:32.369018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0917df4-8802-4b82-9b65-4a0665f0d9b0 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:32.812453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56ba9c1b-94d7-44be-8347-36f8ec4868bb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Action: 'create', calling method: .version_select at 0x7f27dfd15d30>, body: {"keypair": {"name": "tempest-keypair-723560221", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNbHfPnh1XUEgsUpe5OYq+X6WDGbfxXL+bIj4/TF3IbhOkPkzYl1HmPS7kxuvhFF0g/i0lvKOozZM1amtsVuowbLzpmpzofOyXZCSDS9osJpCINEswiGlyNXJxRuPzBeXQ=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:32.848048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-56ba9c1b-94d7-44be-8347-36f8ec4868bb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Getting quotas for project 76feccd8ed314c7b9a6c7b031ad5affe. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:01:32.854785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-56ba9c1b-94d7-44be-8347-36f8ec4868bb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Getting quotas for user dca9686ab24246c5b0193976300dd07b and project 76feccd8ed314c7b9a6c7b031ad5affe. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:01:32.900113 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-56ba9c1b-94d7-44be-8347-36f8ec4868bb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.351267 Aug 23 18:01:32.900902 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1307/2621] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:01:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:32.913640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d0917df4-8802-4b82-9b65-4a0665f0d9b0 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:32.926353 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d0917df4-8802-4b82-9b65-4a0665f0d9b0 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1316 microversion: 2.1 time: 0.591859 Aug 23 18:01:32.941043 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1315/2622] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:32 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1316 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:33.019723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-47dbe36a-0876-43f0-9d2b-36ec4a3c6b51 req-4181ff05-ff18-44ed-9a5c-e17879840513 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcce231c-02f5-4c4f-b217-a265e0be63e4", "tag": "149f6379-8609-4e86-9e62-c07c4cb88a1c"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:33.041061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5c8e42e4-7ac8-4840-8314-5835dd64d42e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:33.041675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5c8e42e4-7ac8-4840-8314-5835dd64d42e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:33.055934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-47dbe36a-0876-43f0-9d2b-36ec4a3c6b51 req-4181ff05-ff18-44ed-9a5c-e17879840513 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:33.056412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-47dbe36a-0876-43f0-9d2b-36ec4a3c6b51 req-4181ff05-ff18-44ed-9a5c-e17879840513 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:33.059188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c8e42e4-7ac8-4840-8314-5835dd64d42e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:33.061572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-47dbe36a-0876-43f0-9d2b-36ec4a3c6b51 req-4181ff05-ff18-44ed-9a5c-e17879840513 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:33.068751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c8e42e4-7ac8-4840-8314-5835dd64d42e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:33.070037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c8e42e4-7ac8-4840-8314-5835dd64d42e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:33.072069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c8e42e4-7ac8-4840-8314-5835dd64d42e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:33.073042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c8e42e4-7ac8-4840-8314-5835dd64d42e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:33.074124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c8e42e4-7ac8-4840-8314-5835dd64d42e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:33.106892 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-47dbe36a-0876-43f0-9d2b-36ec4a3c6b51 req-4181ff05-ff18-44ed-9a5c-e17879840513 service nova] Creating event network-changed:149f6379-8609-4e86-9e62-c07c4cb88a1c for instance fcce231c-02f5-4c4f-b217-a265e0be63e4 on n-h2-850468-16 Aug 23 18:01:33.122889 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-47dbe36a-0876-43f0-9d2b-36ec4a3c6b51 req-4181ff05-ff18-44ed-9a5c-e17879840513 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110863 Aug 23 18:01:33.123571 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1308/2623] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:33.177550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2f9fbc87-0491-4d16-88dd-b668e2d04612 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:33.178252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2f9fbc87-0491-4d16-88dd-b668e2d04612 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:33.192651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f9fbc87-0491-4d16-88dd-b668e2d04612 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:33.193145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f9fbc87-0491-4d16-88dd-b668e2d04612 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:33.193580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f9fbc87-0491-4d16-88dd-b668e2d04612 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:33.194295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f9fbc87-0491-4d16-88dd-b668e2d04612 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:33.194805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f9fbc87-0491-4d16-88dd-b668e2d04612 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:33.195229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f9fbc87-0491-4d16-88dd-b668e2d04612 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:33.316924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5c8e42e4-7ac8-4840-8314-5835dd64d42e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:33.329769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5c8e42e4-7ac8-4840-8314-5835dd64d42e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:33.333254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5c8e42e4-7ac8-4840-8314-5835dd64d42e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:33.335682 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5c8e42e4-7ac8-4840-8314-5835dd64d42e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1664 microversion: 2.25 time: 0.298735 Aug 23 18:01:33.364735 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1316/2624] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:33 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1664 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:33.372081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7966e517-0d3b-4733-aa00-8ad1053b1981 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:33.372954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7966e517-0d3b-4733-aa00-8ad1053b1981 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:33.381608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7966e517-0d3b-4733-aa00-8ad1053b1981 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:33.382479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7966e517-0d3b-4733-aa00-8ad1053b1981 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:33.383190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7966e517-0d3b-4733-aa00-8ad1053b1981 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:33.384116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7966e517-0d3b-4733-aa00-8ad1053b1981 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:33.384769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7966e517-0d3b-4733-aa00-8ad1053b1981 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:33.385447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7966e517-0d3b-4733-aa00-8ad1053b1981 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:33.785727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7966e517-0d3b-4733-aa00-8ad1053b1981 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:33.796129 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7966e517-0d3b-4733-aa00-8ad1053b1981 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1315 microversion: 2.1 time: 0.428926 Aug 23 18:01:33.798985 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1317/2625] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:33 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1315 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:34.008123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2f9fbc87-0491-4d16-88dd-b668e2d04612 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:34.022263 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2f9fbc87-0491-4d16-88dd-b668e2d04612 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.848189 Aug 23 18:01:34.035450 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1309/2626] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:33 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 864 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:34.046025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4804d453-c372-4374-9eb8-b744db1fa737 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:34.046692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4804d453-c372-4374-9eb8-b744db1fa737 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:34.053938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4804d453-c372-4374-9eb8-b744db1fa737 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:34.054446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4804d453-c372-4374-9eb8-b744db1fa737 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:34.054988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4804d453-c372-4374-9eb8-b744db1fa737 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:34.056188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4804d453-c372-4374-9eb8-b744db1fa737 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:34.056660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4804d453-c372-4374-9eb8-b744db1fa737 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:34.057093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4804d453-c372-4374-9eb8-b744db1fa737 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:34.208888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=10 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:34.226153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-b12008b7-d4da-4298-9b39-739a87ed2c82 req-ac4855fb-6578-4c15-b357-8b067a8a3954 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "480827c0-1bbc-4e3f-9176-aebec4fc597b", "name": "network-vif-deleted", "tag": "eec4fd61-f043-4080-a007-9c202b65aefc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:34.246731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b12008b7-d4da-4298-9b39-739a87ed2c82 req-ac4855fb-6578-4c15-b357-8b067a8a3954 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:34.246731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b12008b7-d4da-4298-9b39-739a87ed2c82 req-ac4855fb-6578-4c15-b357-8b067a8a3954 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:34.246731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b12008b7-d4da-4298-9b39-739a87ed2c82 req-ac4855fb-6578-4c15-b357-8b067a8a3954 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:34.275016 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b12008b7-d4da-4298-9b39-739a87ed2c82 req-ac4855fb-6578-4c15-b357-8b067a8a3954 service nova] Creating event network-vif-deleted:eec4fd61-f043-4080-a007-9c202b65aefc for instance 480827c0-1bbc-4e3f-9176-aebec4fc597b on n-h1-850468-16 Aug 23 18:01:34.285846 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-b12008b7-d4da-4298-9b39-739a87ed2c82 req-ac4855fb-6578-4c15-b357-8b067a8a3954 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.484092 Aug 23 18:01:34.288875 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1318/2627] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:34.299046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4804d453-c372-4374-9eb8-b744db1fa737 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:34.313652 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4804d453-c372-4374-9eb8-b744db1fa737 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1316 microversion: 2.1 time: 0.272399 Aug 23 18:01:34.317110 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1310/2628] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:34 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1316 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:34.374005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:34.375615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:34.384197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:34.385029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:34.385768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:34.387318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:34.388102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:34.388806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:34.438593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:34.440759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:34.441514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:34.442628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lazy-loading 'fault' on Instance uuid 480827c0-1bbc-4e3f-9176-aebec4fc597b {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:01:34.810600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:34.819647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e6ff4ed-be41-4c8d-953c-143c3c43cbb9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:34.820544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2e6ff4ed-be41-4c8d-953c-143c3c43cbb9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:34.821487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:34.824071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:34.825727 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4ff80905-8a39-4de7-8ec8-e4495b398afd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 200 len: 1375 microversion: 2.25 time: 0.457155 Aug 23 18:01:34.827745 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1319/2629] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:34 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 1375 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:34.844904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e6ff4ed-be41-4c8d-953c-143c3c43cbb9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:34.846956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e6ff4ed-be41-4c8d-953c-143c3c43cbb9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:34.848167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e6ff4ed-be41-4c8d-953c-143c3c43cbb9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:34.855756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e6ff4ed-be41-4c8d-953c-143c3c43cbb9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:34.856462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e6ff4ed-be41-4c8d-953c-143c3c43cbb9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:34.860671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e6ff4ed-be41-4c8d-953c-143c3c43cbb9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:35.061588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-15ac538a-247f-47bc-abcd-57d6c3164c82 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:35.065141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-15ac538a-247f-47bc-abcd-57d6c3164c82 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:35.087806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15ac538a-247f-47bc-abcd-57d6c3164c82 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:35.088283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15ac538a-247f-47bc-abcd-57d6c3164c82 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:35.088730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15ac538a-247f-47bc-abcd-57d6c3164c82 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:35.090822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15ac538a-247f-47bc-abcd-57d6c3164c82 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:35.092313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15ac538a-247f-47bc-abcd-57d6c3164c82 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:35.096101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15ac538a-247f-47bc-abcd-57d6c3164c82 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:35.372730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2e6ff4ed-be41-4c8d-953c-143c3c43cbb9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:35.386455 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e6ff4ed-be41-4c8d-953c-143c3c43cbb9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1315 microversion: 2.1 time: 0.571195 Aug 23 18:01:35.387309 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1311/2630] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:34 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1315 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:35.395317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d55aff2b-fc10-4574-902a-4987639cada9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:35.396108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d55aff2b-fc10-4574-902a-4987639cada9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:35.406292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d55aff2b-fc10-4574-902a-4987639cada9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:35.406742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d55aff2b-fc10-4574-902a-4987639cada9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:35.408336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d55aff2b-fc10-4574-902a-4987639cada9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:35.408336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d55aff2b-fc10-4574-902a-4987639cada9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:35.409359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d55aff2b-fc10-4574-902a-4987639cada9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:35.410239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d55aff2b-fc10-4574-902a-4987639cada9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:35.438077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-15ac538a-247f-47bc-abcd-57d6c3164c82 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:35.448184 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-15ac538a-247f-47bc-abcd-57d6c3164c82 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.405346 Aug 23 18:01:35.452960 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1320/2631] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:35 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:35.725564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-56068e68-fbc9-4329-8be0-ef63da72a451 req-1e17231c-0a01-49f4-a790-50ccbfa567bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8feaf703-5072-4321-b05e-dfebaaa5c573", "tag": "37148738-a43c-4c4b-a015-de86f9ba132b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:35.742682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-56068e68-fbc9-4329-8be0-ef63da72a451 req-1e17231c-0a01-49f4-a790-50ccbfa567bd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:35.743164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-56068e68-fbc9-4329-8be0-ef63da72a451 req-1e17231c-0a01-49f4-a790-50ccbfa567bd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:35.743683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-56068e68-fbc9-4329-8be0-ef63da72a451 req-1e17231c-0a01-49f4-a790-50ccbfa567bd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:35.773397 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-56068e68-fbc9-4329-8be0-ef63da72a451 req-1e17231c-0a01-49f4-a790-50ccbfa567bd service nova] Creating event network-changed:37148738-a43c-4c4b-a015-de86f9ba132b for instance 8feaf703-5072-4321-b05e-dfebaaa5c573 on n-h2-850468-16 Aug 23 18:01:35.779165 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-56068e68-fbc9-4329-8be0-ef63da72a451 req-1e17231c-0a01-49f4-a790-50ccbfa567bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057370 Aug 23 18:01:35.780342 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1321/2632] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:01:35.787002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d55aff2b-fc10-4574-902a-4987639cada9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:35.798693 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d55aff2b-fc10-4574-902a-4987639cada9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1316 microversion: 2.1 time: 0.409474 Aug 23 18:01:35.800700 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1312/2633] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:35 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:35.857334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-976631e3-ed17-4651-8553-4415a5e6599e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:35.858084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-976631e3-ed17-4651-8553-4415a5e6599e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 480827c0-1bbc-4e3f-9176-aebec4fc597b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:35.868148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-976631e3-ed17-4651-8553-4415a5e6599e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:35.868937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-976631e3-ed17-4651-8553-4415a5e6599e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:35.869573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-976631e3-ed17-4651-8553-4415a5e6599e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:35.870626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-976631e3-ed17-4651-8553-4415a5e6599e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:35.871275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-976631e3-ed17-4651-8553-4415a5e6599e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:35.879705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-976631e3-ed17-4651-8553-4415a5e6599e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:35.907466 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-976631e3-ed17-4651-8553-4415a5e6599e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] HTTP exception thrown: Instance 480827c0-1bbc-4e3f-9176-aebec4fc597b could not be found. Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-976631e3-ed17-4651-8553-4415a5e6599e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Request method failure captured: Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b HTTP/1.1 Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRP8_MSBeCvyoczJoDOjyK9PVKMQv_FFzBJiC7Rbq488aZTAXcY393dxSu7bla41fBTKtiI_qjDXAeOFiFtyITkcLMLbvFAvzdzRa5BLDDiiwRSAJYHSPwfaYu3XkXu71Havzq4MQ9cg7o9HNRktxA1oTHaPXN_AGgKh5gSuQoQsPqI Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.25 Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a847d523b7944595aa39244f15b37665 Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-807887112 Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a847d523b7944595aa39244f15b37665"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a847d523b7944595aa39244f15b37665"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a847d523b7944595aa39244f15b37665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a847d523b7944595aa39244f15b37665"}]}] Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-807887112 Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a847d523b7944595aa39244f15b37665 Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-807887112 Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-LiveAutoBlockMigrationV225Test-807887112-project Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: bb8758f075834ca59962ab82f042ec34 Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-807887112-project Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 480827c0-1bbc-4e3f-9176-aebec4fc597b could not be found. Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '480827c0-1bbc-4e3f-9176-aebec4fc597b'} Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 480827c0-1bbc-4e3f-9176-aebec4fc597b could not be found. Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 480827c0-1bbc-4e3f-9176-aebec4fc597b could not be found. Aug 23 18:01:35.913731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:35.917729 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:35.917729 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:35.917729 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:35.917729 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:35.917729 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:35.917729 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:01:35.917729 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:01:35.917729 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 480827c0-1bbc-4e3f-9176-aebec4fc597b could not be found. Aug 23 18:01:35.917729 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:35.919229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-976631e3-ed17-4651-8553-4415a5e6599e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Returning 404 to user: Instance 480827c0-1bbc-4e3f-9176-aebec4fc597b could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:01:35.921005 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-976631e3-ed17-4651-8553-4415a5e6599e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b" status: 404 len: 111 microversion: 2.25 time: 0.074900 Aug 23 18:01:35.921749 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1322/2634] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:35 2022] GET /compute/v2.1/servers/480827c0-1bbc-4e3f-9176-aebec4fc597b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:01:35.934093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-246b54e4-c184-404e-8a4d-3645ec9a765d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '.version_select at 0x7f27dfd7b1f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:35.966692 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-246b54e4-c184-404e-8a4d-3645ec9a765d tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275180690" status: 204 len: 0 microversion: 2.25 time: 0.039809 Aug 23 18:01:35.967724 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1313/2635] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 18:01:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1275180690 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:01:36.412108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-66be0c6c-7f66-45cc-a7f4-80453c54389f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:36.412717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-66be0c6c-7f66-45cc-a7f4-80453c54389f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:36.432778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66be0c6c-7f66-45cc-a7f4-80453c54389f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:36.433557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66be0c6c-7f66-45cc-a7f4-80453c54389f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:36.433996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66be0c6c-7f66-45cc-a7f4-80453c54389f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:36.435062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66be0c6c-7f66-45cc-a7f4-80453c54389f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:36.436309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66be0c6c-7f66-45cc-a7f4-80453c54389f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:36.437461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66be0c6c-7f66-45cc-a7f4-80453c54389f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:36.479478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a840995a-285a-4dae-81b3-0c2f1e3ade0e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:36.480409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a840995a-285a-4dae-81b3-0c2f1e3ade0e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:36.505958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a840995a-285a-4dae-81b3-0c2f1e3ade0e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:36.506754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a840995a-285a-4dae-81b3-0c2f1e3ade0e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:36.507502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a840995a-285a-4dae-81b3-0c2f1e3ade0e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:36.509716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a840995a-285a-4dae-81b3-0c2f1e3ade0e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:36.510458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a840995a-285a-4dae-81b3-0c2f1e3ade0e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:36.511104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a840995a-285a-4dae-81b3-0c2f1e3ade0e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:36.547495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:36.846620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a840995a-285a-4dae-81b3-0c2f1e3ade0e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:36.855741 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a840995a-285a-4dae-81b3-0c2f1e3ade0e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.385857 Aug 23 18:01:36.869604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-66be0c6c-7f66-45cc-a7f4-80453c54389f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:36.873707 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1314/2636] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:36 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:36.875459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:36.881657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c550e4e7-a455-4be5-9372-41b7fe39e794 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:36.882604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c550e4e7-a455-4be5-9372-41b7fe39e794 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:36.890224 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-66be0c6c-7f66-45cc-a7f4-80453c54389f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1315 microversion: 2.1 time: 0.482397 Aug 23 18:01:36.892261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c550e4e7-a455-4be5-9372-41b7fe39e794 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:36.894908 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1323/2637] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:36 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1315 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:36.895898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c550e4e7-a455-4be5-9372-41b7fe39e794 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:36.897348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c550e4e7-a455-4be5-9372-41b7fe39e794 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:36.899351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c550e4e7-a455-4be5-9372-41b7fe39e794 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:36.900024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c550e4e7-a455-4be5-9372-41b7fe39e794 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:36.900784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c550e4e7-a455-4be5-9372-41b7fe39e794 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:37.010959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-790429735", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "556ca85c-3127-4690-9c69-c43262b239f4"}], "security_groups": [{"name": "tempest-securitygroup--864869983"}], "key_name": "tempest-keypair-723560221", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:37.175509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] validate_networks() for [('556ca85c-3127-4690-9c69-c43262b239f4', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:01:37.641136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Getting quotas for project 76feccd8ed314c7b9a6c7b031ad5affe. Resources: dict_keys(['metadata_items']) {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:01:37.649669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Getting quotas for user dca9686ab24246c5b0193976300dd07b and project 76feccd8ed314c7b9a6c7b031ad5affe. Resources: dict_keys(['metadata_items']) {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:01:37.659898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c550e4e7-a455-4be5-9372-41b7fe39e794 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:37.666929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:01:37.668659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:01:37.669967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:01:37.671175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:01:37.671824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:01:37.671933 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c550e4e7-a455-4be5-9372-41b7fe39e794 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1316 microversion: 2.1 time: 0.796712 Aug 23 18:01:37.675623 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1315/2638] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:36 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1316 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:37.699175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:37.699922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:37.700756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:37.702120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:37.702832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:37.703894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:37.723125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:37.733131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Getting quotas for project 76feccd8ed314c7b9a6c7b031ad5affe. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:01:37.741985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Getting quotas for user dca9686ab24246c5b0193976300dd07b and project 76feccd8ed314c7b9a6c7b031ad5affe. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:01:37.759850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:01:37.762906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:01:37.833667 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8677622f-632d-4eea-a798-e8e7c4634b71 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.827572 Aug 23 18:01:37.835512 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1324/2639] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:01:37 2022] POST /compute/v2.1/servers => generated 408 bytes in 830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:01:37.848375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-64e9e4ee-5248-4bab-9228-ef062255c06b tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:37.849021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-64e9e4ee-5248-4bab-9228-ef062255c06b tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:37.883770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d68a65f3-95ce-4508-be56-8a84fe0d7b3b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:37.884396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d68a65f3-95ce-4508-be56-8a84fe0d7b3b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:37.893058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d68a65f3-95ce-4508-be56-8a84fe0d7b3b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:37.898697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d68a65f3-95ce-4508-be56-8a84fe0d7b3b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:37.899985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d68a65f3-95ce-4508-be56-8a84fe0d7b3b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:37.901142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d68a65f3-95ce-4508-be56-8a84fe0d7b3b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:37.905796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d68a65f3-95ce-4508-be56-8a84fe0d7b3b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:37.906275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d68a65f3-95ce-4508-be56-8a84fe0d7b3b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:38.212294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d68a65f3-95ce-4508-be56-8a84fe0d7b3b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:38.227970 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d68a65f3-95ce-4508-be56-8a84fe0d7b3b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.348002 Aug 23 18:01:38.228884 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1325/2640] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:37 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:38.235308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-418b146b-783e-47d0-984b-b3b36cfc3b56 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:38.236288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-418b146b-783e-47d0-984b-b3b36cfc3b56 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:38.256165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-418b146b-783e-47d0-984b-b3b36cfc3b56 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:38.257207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-418b146b-783e-47d0-984b-b3b36cfc3b56 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:38.257966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-418b146b-783e-47d0-984b-b3b36cfc3b56 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:38.258877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-418b146b-783e-47d0-984b-b3b36cfc3b56 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:38.259499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-418b146b-783e-47d0-984b-b3b36cfc3b56 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:38.260227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-418b146b-783e-47d0-984b-b3b36cfc3b56 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:38.512405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-64e9e4ee-5248-4bab-9228-ef062255c06b tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:38.515288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-418b146b-783e-47d0-984b-b3b36cfc3b56 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:38.523686 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-64e9e4ee-5248-4bab-9228-ef062255c06b tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1276 microversion: 2.1 time: 0.680236 Aug 23 18:01:38.524317 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1316/2641] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:37 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1276 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:38.524828 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-418b146b-783e-47d0-984b-b3b36cfc3b56 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1315 microversion: 2.1 time: 0.294240 Aug 23 18:01:38.534965 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1326/2642] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:38 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:38.696541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4cf1df0f-7276-4790-b799-9877dc08fa8f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:38.696997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4cf1df0f-7276-4790-b799-9877dc08fa8f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:38.704582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-814a6bd0-df6f-49e6-ac36-3835b5aee111 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:38.710441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-814a6bd0-df6f-49e6-ac36-3835b5aee111 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:38.724822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cf1df0f-7276-4790-b799-9877dc08fa8f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:38.730777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cf1df0f-7276-4790-b799-9877dc08fa8f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:38.731532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cf1df0f-7276-4790-b799-9877dc08fa8f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:38.732146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-814a6bd0-df6f-49e6-ac36-3835b5aee111 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:38.732616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cf1df0f-7276-4790-b799-9877dc08fa8f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:38.733227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cf1df0f-7276-4790-b799-9877dc08fa8f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:38.733830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cf1df0f-7276-4790-b799-9877dc08fa8f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:38.733951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-814a6bd0-df6f-49e6-ac36-3835b5aee111 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:38.735193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-814a6bd0-df6f-49e6-ac36-3835b5aee111 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:38.736033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-814a6bd0-df6f-49e6-ac36-3835b5aee111 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:38.738115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-814a6bd0-df6f-49e6-ac36-3835b5aee111 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:38.738700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-814a6bd0-df6f-49e6-ac36-3835b5aee111 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:38.788225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4cf1df0f-7276-4790-b799-9877dc08fa8f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:01:38.994118 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4cf1df0f-7276-4790-b799-9877dc08fa8f tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "DELETE /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 204 len: 0 microversion: 2.25 time: 0.316986 Aug 23 18:01:38.995170 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1327/2643] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:01:38 2022] DELETE /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:01:39.005102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f78c18f-59e7-4ede-a021-62e4b338eaf2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:39.006070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5f78c18f-59e7-4ede-a021-62e4b338eaf2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:39.015692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f78c18f-59e7-4ede-a021-62e4b338eaf2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:39.016480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f78c18f-59e7-4ede-a021-62e4b338eaf2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:39.017298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f78c18f-59e7-4ede-a021-62e4b338eaf2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:39.019904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f78c18f-59e7-4ede-a021-62e4b338eaf2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:39.020705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f78c18f-59e7-4ede-a021-62e4b338eaf2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:39.021171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f78c18f-59e7-4ede-a021-62e4b338eaf2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:39.119492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-814a6bd0-df6f-49e6-ac36-3835b5aee111 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:39.133170 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-814a6bd0-df6f-49e6-ac36-3835b5aee111 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1316 microversion: 2.1 time: 0.436971 Aug 23 18:01:39.134209 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1317/2644] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:38 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1316 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:39.218831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f78c18f-59e7-4ede-a021-62e4b338eaf2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:39.233173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f78c18f-59e7-4ede-a021-62e4b338eaf2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:39.239143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f78c18f-59e7-4ede-a021-62e4b338eaf2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:39.240918 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5f78c18f-59e7-4ede-a021-62e4b338eaf2 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1548 microversion: 2.25 time: 0.241628 Aug 23 18:01:39.248551 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1328/2645] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:38 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1548 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:39.255946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dc592e63-5b9e-4dd7-ab79-bd5297bb401c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:39.257546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dc592e63-5b9e-4dd7-ab79-bd5297bb401c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:39.271286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc592e63-5b9e-4dd7-ab79-bd5297bb401c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:39.275066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc592e63-5b9e-4dd7-ab79-bd5297bb401c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:39.275793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc592e63-5b9e-4dd7-ab79-bd5297bb401c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:39.277561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc592e63-5b9e-4dd7-ab79-bd5297bb401c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:39.278207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc592e63-5b9e-4dd7-ab79-bd5297bb401c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:39.279763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc592e63-5b9e-4dd7-ab79-bd5297bb401c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:39.558504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5b566ba9-fd5f-4b05-a3fa-924daf659dc1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:39.563614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5b566ba9-fd5f-4b05-a3fa-924daf659dc1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:39.575638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dc592e63-5b9e-4dd7-ab79-bd5297bb401c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:39.578317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b566ba9-fd5f-4b05-a3fa-924daf659dc1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:39.578836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b566ba9-fd5f-4b05-a3fa-924daf659dc1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:39.579285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b566ba9-fd5f-4b05-a3fa-924daf659dc1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:39.579991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b566ba9-fd5f-4b05-a3fa-924daf659dc1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:39.587561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b566ba9-fd5f-4b05-a3fa-924daf659dc1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:39.588036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b566ba9-fd5f-4b05-a3fa-924daf659dc1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:39.604683 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dc592e63-5b9e-4dd7-ab79-bd5297bb401c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.352708 Aug 23 18:01:39.607458 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1318/2646] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:39 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:39.618721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d65437c-6683-450d-ac6f-2dc0145b000a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:39.619872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d65437c-6683-450d-ac6f-2dc0145b000a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:39.640044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d65437c-6683-450d-ac6f-2dc0145b000a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:39.640908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d65437c-6683-450d-ac6f-2dc0145b000a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:39.642626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d65437c-6683-450d-ac6f-2dc0145b000a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:39.643807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d65437c-6683-450d-ac6f-2dc0145b000a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:39.644657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d65437c-6683-450d-ac6f-2dc0145b000a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:39.645387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d65437c-6683-450d-ac6f-2dc0145b000a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:39.732855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5d65437c-6683-450d-ac6f-2dc0145b000a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:39.744547 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d65437c-6683-450d-ac6f-2dc0145b000a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1328 microversion: 2.1 time: 0.135721 Aug 23 18:01:39.745659 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1319/2647] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:39 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1328 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:40.176279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-e70df0df-eea9-476c-bb76-2432af5dbd97 req-f125b4b6-db78-43e2-b224-46fc663ed1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d81bbbc-0ed1-445b-a321-b2175e975725", "name": "network-vif-plugged", "status": "completed", "tag": "c9a2077a-21a0-4f0d-846d-bbb4743c4fa4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:40.195659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e70df0df-eea9-476c-bb76-2432af5dbd97 req-f125b4b6-db78-43e2-b224-46fc663ed1e5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:40.196326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e70df0df-eea9-476c-bb76-2432af5dbd97 req-f125b4b6-db78-43e2-b224-46fc663ed1e5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:40.196939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e70df0df-eea9-476c-bb76-2432af5dbd97 req-f125b4b6-db78-43e2-b224-46fc663ed1e5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:40.218117 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-e70df0df-eea9-476c-bb76-2432af5dbd97 req-f125b4b6-db78-43e2-b224-46fc663ed1e5 service nova] Creating event network-vif-plugged:c9a2077a-21a0-4f0d-846d-bbb4743c4fa4 for instance 9d81bbbc-0ed1-445b-a321-b2175e975725 on n-h1-850468-16 Aug 23 18:01:40.232624 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-e70df0df-eea9-476c-bb76-2432af5dbd97 req-f125b4b6-db78-43e2-b224-46fc663ed1e5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.402468 Aug 23 18:01:40.233500 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1320/2648] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:01:40.254670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fe4fea3b-a165-43c8-a338-5b9738c01b9e tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:40.259268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe4fea3b-a165-43c8-a338-5b9738c01b9e tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:40.270291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe4fea3b-a165-43c8-a338-5b9738c01b9e tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:40.270291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe4fea3b-a165-43c8-a338-5b9738c01b9e tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:40.270480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe4fea3b-a165-43c8-a338-5b9738c01b9e tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:40.271229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe4fea3b-a165-43c8-a338-5b9738c01b9e tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:40.271695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe4fea3b-a165-43c8-a338-5b9738c01b9e tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:40.272124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe4fea3b-a165-43c8-a338-5b9738c01b9e tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:40.283118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5b566ba9-fd5f-4b05-a3fa-924daf659dc1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:40.300411 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5b566ba9-fd5f-4b05-a3fa-924daf659dc1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1315 microversion: 2.1 time: 0.756207 Aug 23 18:01:40.304215 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1329/2649] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:39 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1315 bytes in 760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:40.310890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7552d56b-ec5d-43c8-8aa6-abecd223bc38 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:40.311706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7552d56b-ec5d-43c8-8aa6-abecd223bc38 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:40.330028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7552d56b-ec5d-43c8-8aa6-abecd223bc38 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:40.338379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7552d56b-ec5d-43c8-8aa6-abecd223bc38 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:40.339030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7552d56b-ec5d-43c8-8aa6-abecd223bc38 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:40.340983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7552d56b-ec5d-43c8-8aa6-abecd223bc38 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:40.341675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7552d56b-ec5d-43c8-8aa6-abecd223bc38 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:40.342337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7552d56b-ec5d-43c8-8aa6-abecd223bc38 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:40.571343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fe4fea3b-a165-43c8-a338-5b9738c01b9e tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:40.589382 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fe4fea3b-a165-43c8-a338-5b9738c01b9e tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1316 microversion: 2.1 time: 0.354502 Aug 23 18:01:40.591800 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1321/2650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:40 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:40.634875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cfd09e9d-b45d-4c3c-a431-644ebad20d63 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:40.636565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cfd09e9d-b45d-4c3c-a431-644ebad20d63 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:40.663362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfd09e9d-b45d-4c3c-a431-644ebad20d63 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:40.665287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfd09e9d-b45d-4c3c-a431-644ebad20d63 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:40.667011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfd09e9d-b45d-4c3c-a431-644ebad20d63 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:40.668359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfd09e9d-b45d-4c3c-a431-644ebad20d63 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:40.669155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfd09e9d-b45d-4c3c-a431-644ebad20d63 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:40.669795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfd09e9d-b45d-4c3c-a431-644ebad20d63 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:40.676972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7552d56b-ec5d-43c8-8aa6-abecd223bc38 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:40.686656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7552d56b-ec5d-43c8-8aa6-abecd223bc38 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:40.688931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7552d56b-ec5d-43c8-8aa6-abecd223bc38 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:40.691395 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7552d56b-ec5d-43c8-8aa6-abecd223bc38 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1548 microversion: 2.25 time: 0.386150 Aug 23 18:01:40.692406 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1330/2651] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:40 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1548 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:40.771488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5c3d4dec-0ecf-49e6-a9a2-331a98f6c721 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:40.772480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5c3d4dec-0ecf-49e6-a9a2-331a98f6c721 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:40.796178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c3d4dec-0ecf-49e6-a9a2-331a98f6c721 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:40.797166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c3d4dec-0ecf-49e6-a9a2-331a98f6c721 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:40.798011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c3d4dec-0ecf-49e6-a9a2-331a98f6c721 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:40.798967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c3d4dec-0ecf-49e6-a9a2-331a98f6c721 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:40.800161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c3d4dec-0ecf-49e6-a9a2-331a98f6c721 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:40.800926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c3d4dec-0ecf-49e6-a9a2-331a98f6c721 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:40.900683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5c3d4dec-0ecf-49e6-a9a2-331a98f6c721 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:40.913924 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5c3d4dec-0ecf-49e6-a9a2-331a98f6c721 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1334 microversion: 2.1 time: 0.146951 Aug 23 18:01:40.916740 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1331/2652] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:40 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1334 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:40.944120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4829cd38-728c-46b6-9ff6-93a3248632e8 req-dddbf31a-090b-4f31-8ba1-12a88ae3543e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "21266578-6a91-43ab-9daf-38e646ac90c4", "name": "network-vif-deleted", "tag": "3a03ba29-b382-4f61-bc36-18987e4b2089"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:40.968951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4829cd38-728c-46b6-9ff6-93a3248632e8 req-dddbf31a-090b-4f31-8ba1-12a88ae3543e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:40.969667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4829cd38-728c-46b6-9ff6-93a3248632e8 req-dddbf31a-090b-4f31-8ba1-12a88ae3543e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:40.970150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4829cd38-728c-46b6-9ff6-93a3248632e8 req-dddbf31a-090b-4f31-8ba1-12a88ae3543e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:40.989405 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4829cd38-728c-46b6-9ff6-93a3248632e8 req-dddbf31a-090b-4f31-8ba1-12a88ae3543e service nova] Creating event network-vif-deleted:3a03ba29-b382-4f61-bc36-18987e4b2089 for instance 21266578-6a91-43ab-9daf-38e646ac90c4 on n-h1-850468-16 Aug 23 18:01:40.995146 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4829cd38-728c-46b6-9ff6-93a3248632e8 req-dddbf31a-090b-4f31-8ba1-12a88ae3543e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076143 Aug 23 18:01:40.995867 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1332/2653] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:41.153039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cfd09e9d-b45d-4c3c-a431-644ebad20d63 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:41.165152 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cfd09e9d-b45d-4c3c-a431-644ebad20d63 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.534196 Aug 23 18:01:41.185661 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1322/2654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:40 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:41.322770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-20ad3d0e-8dcd-48d8-8de4-8105f1a8ebce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:41.323468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-20ad3d0e-8dcd-48d8-8de4-8105f1a8ebce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:41.352432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20ad3d0e-8dcd-48d8-8de4-8105f1a8ebce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:41.353586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20ad3d0e-8dcd-48d8-8de4-8105f1a8ebce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:41.356144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20ad3d0e-8dcd-48d8-8de4-8105f1a8ebce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:41.357488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20ad3d0e-8dcd-48d8-8de4-8105f1a8ebce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:41.358396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20ad3d0e-8dcd-48d8-8de4-8105f1a8ebce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:41.359140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20ad3d0e-8dcd-48d8-8de4-8105f1a8ebce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:41.616168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8a035cef-c9b2-4938-9bd0-ef248b82dd89 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:41.617143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8a035cef-c9b2-4938-9bd0-ef248b82dd89 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:41.635816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a035cef-c9b2-4938-9bd0-ef248b82dd89 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:41.636813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a035cef-c9b2-4938-9bd0-ef248b82dd89 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:41.637466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a035cef-c9b2-4938-9bd0-ef248b82dd89 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:41.638400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a035cef-c9b2-4938-9bd0-ef248b82dd89 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:41.639107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a035cef-c9b2-4938-9bd0-ef248b82dd89 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:41.639881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a035cef-c9b2-4938-9bd0-ef248b82dd89 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:41.663839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-20ad3d0e-8dcd-48d8-8de4-8105f1a8ebce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:41.673548 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-20ad3d0e-8dcd-48d8-8de4-8105f1a8ebce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1315 microversion: 2.1 time: 0.355157 Aug 23 18:01:41.685981 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1333/2655] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:41 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1315 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:41.722299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:41.723374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:41.748688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:41.749550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:41.750179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:41.750935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:41.751388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:41.751985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:41.811825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:41.812245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:41.812660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:41.820272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lazy-loading 'fault' on Instance uuid 21266578-6a91-43ab-9daf-38e646ac90c4 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:01:41.913568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:41.942748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:41.948732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:41.951943 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa51a2ec-c111-4c0a-b3e9-ffb57e5536bd tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 200 len: 1352 microversion: 2.25 time: 0.234148 Aug 23 18:01:41.953017 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1334/2656] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:41 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 1352 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:41.964561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d8cfd20a-bb26-476c-929a-47f17a2b5856 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:41.965815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d8cfd20a-bb26-476c-929a-47f17a2b5856 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:41.976816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cfd20a-bb26-476c-929a-47f17a2b5856 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:41.977932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cfd20a-bb26-476c-929a-47f17a2b5856 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:41.978532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cfd20a-bb26-476c-929a-47f17a2b5856 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:41.980756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cfd20a-bb26-476c-929a-47f17a2b5856 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:41.981330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cfd20a-bb26-476c-929a-47f17a2b5856 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:41.983656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cfd20a-bb26-476c-929a-47f17a2b5856 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:42.052552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8a035cef-c9b2-4938-9bd0-ef248b82dd89 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:42.071616 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8a035cef-c9b2-4938-9bd0-ef248b82dd89 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1316 microversion: 2.1 time: 0.459191 Aug 23 18:01:42.072524 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1323/2657] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:41 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1316 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:42.090312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d8cfd20a-bb26-476c-929a-47f17a2b5856 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:42.100282 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d8cfd20a-bb26-476c-929a-47f17a2b5856 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1334 microversion: 2.1 time: 0.145922 Aug 23 18:01:42.108638 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1335/2658] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:41 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1334 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:42.190979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e8025fe9-9438-4314-b013-2af47f88fe1e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:42.192439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e8025fe9-9438-4314-b013-2af47f88fe1e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:42.212082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8025fe9-9438-4314-b013-2af47f88fe1e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:42.213512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8025fe9-9438-4314-b013-2af47f88fe1e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:42.214858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8025fe9-9438-4314-b013-2af47f88fe1e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:42.220747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8025fe9-9438-4314-b013-2af47f88fe1e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:42.222337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8025fe9-9438-4314-b013-2af47f88fe1e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:42.223031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8025fe9-9438-4314-b013-2af47f88fe1e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:42.255042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-616de228-6fc7-458e-bf4b-e1fee0584939 req-86207f7b-2f6b-40f2-8ed0-c8142d59a4aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcce231c-02f5-4c4f-b217-a265e0be63e4", "name": "network-vif-plugged", "status": "completed", "tag": "149f6379-8609-4e86-9e62-c07c4cb88a1c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:42.273857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-616de228-6fc7-458e-bf4b-e1fee0584939 req-86207f7b-2f6b-40f2-8ed0-c8142d59a4aa service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:42.274374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-616de228-6fc7-458e-bf4b-e1fee0584939 req-86207f7b-2f6b-40f2-8ed0-c8142d59a4aa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:42.274844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-616de228-6fc7-458e-bf4b-e1fee0584939 req-86207f7b-2f6b-40f2-8ed0-c8142d59a4aa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:42.324549 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-616de228-6fc7-458e-bf4b-e1fee0584939 req-86207f7b-2f6b-40f2-8ed0-c8142d59a4aa service nova] Creating event network-vif-plugged:149f6379-8609-4e86-9e62-c07c4cb88a1c for instance fcce231c-02f5-4c4f-b217-a265e0be63e4 on n-h2-850468-16 Aug 23 18:01:42.339744 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-616de228-6fc7-458e-bf4b-e1fee0584939 req-86207f7b-2f6b-40f2-8ed0-c8142d59a4aa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091047 Aug 23 18:01:42.345313 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1336/2659] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:42.705346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a5e34ba-d2fb-4461-bd10-959aab9f5531 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:42.706778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6a5e34ba-d2fb-4461-bd10-959aab9f5531 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:42.721441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a5e34ba-d2fb-4461-bd10-959aab9f5531 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:42.723962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a5e34ba-d2fb-4461-bd10-959aab9f5531 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:42.725138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a5e34ba-d2fb-4461-bd10-959aab9f5531 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:42.727323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a5e34ba-d2fb-4461-bd10-959aab9f5531 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:42.728249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a5e34ba-d2fb-4461-bd10-959aab9f5531 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:42.730800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a5e34ba-d2fb-4461-bd10-959aab9f5531 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:42.737794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e8025fe9-9438-4314-b013-2af47f88fe1e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:42.750675 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e8025fe9-9438-4314-b013-2af47f88fe1e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.565814 Aug 23 18:01:42.751548 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1324/2660] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:42 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:42.985637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc71ab92-6d17-4840-8b69-6200fe1060a5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:42.986711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fc71ab92-6d17-4840-8b69-6200fe1060a5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: 21266578-6a91-43ab-9daf-38e646ac90c4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:42.995951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc71ab92-6d17-4840-8b69-6200fe1060a5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:42.996819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc71ab92-6d17-4840-8b69-6200fe1060a5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:42.997489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc71ab92-6d17-4840-8b69-6200fe1060a5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:42.997918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6a5e34ba-d2fb-4461-bd10-959aab9f5531 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:42.998217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc71ab92-6d17-4840-8b69-6200fe1060a5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:42.998680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc71ab92-6d17-4840-8b69-6200fe1060a5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:42.999585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc71ab92-6d17-4840-8b69-6200fe1060a5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:43.006424 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6a5e34ba-d2fb-4461-bd10-959aab9f5531 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1315 microversion: 2.1 time: 0.305796 Aug 23 18:01:43.018651 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-fc71ab92-6d17-4840-8b69-6200fe1060a5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] HTTP exception thrown: Instance 21266578-6a91-43ab-9daf-38e646ac90c4 could not be found. Aug 23 18:01:43.018998 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1337/2661] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:42 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc71ab92-6d17-4840-8b69-6200fe1060a5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Request method failure captured: Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 HTTP/1.1 Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRP8_MSBeCvyoczJoDOjyK9PVKMQv_FFzBJiC7Rbq488aZTAXcY393dxSu7bla41fBTKtiI_qjDXAeOFiFtyITkcLMLbvFAvzdzRa5BLDDiiwRSAJYHSPwfaYu3XkXu71Havzq4MQ9cg7o9HNRktxA1oTHaPXN_AGgKh5gSuQoQsPqI Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.25 Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a847d523b7944595aa39244f15b37665 Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-807887112 Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a847d523b7944595aa39244f15b37665"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a847d523b7944595aa39244f15b37665"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a847d523b7944595aa39244f15b37665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a847d523b7944595aa39244f15b37665"}]}] Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-807887112 Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a847d523b7944595aa39244f15b37665 Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-807887112 Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-LiveAutoBlockMigrationV225Test-807887112-project Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: bb8758f075834ca59962ab82f042ec34 Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-807887112-project Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 21266578-6a91-43ab-9daf-38e646ac90c4 could not be found. Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '21266578-6a91-43ab-9daf-38e646ac90c4'} Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 21266578-6a91-43ab-9daf-38e646ac90c4 could not be found. Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 21266578-6a91-43ab-9daf-38e646ac90c4 could not be found. Aug 23 18:01:43.022049 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:43.026219 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:43.026219 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:43.026219 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:43.026219 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:43.026219 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:43.026219 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:01:43.026219 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:01:43.026219 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 21266578-6a91-43ab-9daf-38e646ac90c4 could not be found. Aug 23 18:01:43.026219 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:43.031599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc71ab92-6d17-4840-8b69-6200fe1060a5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Returning 404 to user: Instance 21266578-6a91-43ab-9daf-38e646ac90c4 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:01:43.033106 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fc71ab92-6d17-4840-8b69-6200fe1060a5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4" status: 404 len: 111 microversion: 2.25 time: 0.051393 Aug 23 18:01:43.037516 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1325/2662] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:42 2022] GET /compute/v2.1/servers/21266578-6a91-43ab-9daf-38e646ac90c4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:01:43.042503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-160cdb72-336c-4356-a3e6-6676bbcb0cb5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:43.043264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-160cdb72-336c-4356-a3e6-6676bbcb0cb5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:43.058150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-160cdb72-336c-4356-a3e6-6676bbcb0cb5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:43.058806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-160cdb72-336c-4356-a3e6-6676bbcb0cb5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:43.059173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-160cdb72-336c-4356-a3e6-6676bbcb0cb5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:43.060191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-160cdb72-336c-4356-a3e6-6676bbcb0cb5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:43.060700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-160cdb72-336c-4356-a3e6-6676bbcb0cb5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:43.069317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-160cdb72-336c-4356-a3e6-6676bbcb0cb5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:43.094188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-da5efb0d-6776-4f2e-9982-37f48cb71bfb tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:43.095653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-da5efb0d-6776-4f2e-9982-37f48cb71bfb tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:43.102850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5efb0d-6776-4f2e-9982-37f48cb71bfb tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:43.103658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5efb0d-6776-4f2e-9982-37f48cb71bfb tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:43.104778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5efb0d-6776-4f2e-9982-37f48cb71bfb tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:43.105715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5efb0d-6776-4f2e-9982-37f48cb71bfb tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:43.106407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5efb0d-6776-4f2e-9982-37f48cb71bfb tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:43.107613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5efb0d-6776-4f2e-9982-37f48cb71bfb tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:43.142689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-160cdb72-336c-4356-a3e6-6676bbcb0cb5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:01:43.250982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:43.320771 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-160cdb72-336c-4356-a3e6-6676bbcb0cb5 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 204 len: 0 microversion: 2.25 time: 0.278795 Aug 23 18:01:43.326686 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1338/2663] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:01:43 2022] DELETE /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:01:43.336300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8fedd95f-3548-49c0-bce3-722fa72ae117 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:43.338827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8fedd95f-3548-49c0-bce3-722fa72ae117 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:43.350460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fedd95f-3548-49c0-bce3-722fa72ae117 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:43.351336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fedd95f-3548-49c0-bce3-722fa72ae117 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:43.352291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fedd95f-3548-49c0-bce3-722fa72ae117 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:43.353561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fedd95f-3548-49c0-bce3-722fa72ae117 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:43.354315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fedd95f-3548-49c0-bce3-722fa72ae117 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:43.355801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fedd95f-3548-49c0-bce3-722fa72ae117 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:43.576062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-da5efb0d-6776-4f2e-9982-37f48cb71bfb tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:43.601545 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-da5efb0d-6776-4f2e-9982-37f48cb71bfb tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1316 microversion: 2.1 time: 0.509923 Aug 23 18:01:43.604763 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1326/2664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:43 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1316 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:43.629521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6c8b2dea-5eaf-4742-8e2f-5e154d2ab500 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:43.635625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6c8b2dea-5eaf-4742-8e2f-5e154d2ab500 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:43.664633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c8b2dea-5eaf-4742-8e2f-5e154d2ab500 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:43.668260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c8b2dea-5eaf-4742-8e2f-5e154d2ab500 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:43.671646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c8b2dea-5eaf-4742-8e2f-5e154d2ab500 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:43.676351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c8b2dea-5eaf-4742-8e2f-5e154d2ab500 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:43.677482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c8b2dea-5eaf-4742-8e2f-5e154d2ab500 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:43.680610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c8b2dea-5eaf-4742-8e2f-5e154d2ab500 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:43.722507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8fedd95f-3548-49c0-bce3-722fa72ae117 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:43.743623 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8fedd95f-3548-49c0-bce3-722fa72ae117 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1401 microversion: 2.1 time: 0.414457 Aug 23 18:01:43.761880 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1339/2665] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:43 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1401 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:43.789939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a36b748d-6e6c-4191-9415-74d37c9e2a15 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:43.792610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a36b748d-6e6c-4191-9415-74d37c9e2a15 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:43.822683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a36b748d-6e6c-4191-9415-74d37c9e2a15 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:43.823674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a36b748d-6e6c-4191-9415-74d37c9e2a15 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:43.824934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a36b748d-6e6c-4191-9415-74d37c9e2a15 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:43.831718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a36b748d-6e6c-4191-9415-74d37c9e2a15 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:43.833136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a36b748d-6e6c-4191-9415-74d37c9e2a15 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:43.836454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a36b748d-6e6c-4191-9415-74d37c9e2a15 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:44.241484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c8b2dea-5eaf-4742-8e2f-5e154d2ab500 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:44.296819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c8b2dea-5eaf-4742-8e2f-5e154d2ab500 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:44.300520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c8b2dea-5eaf-4742-8e2f-5e154d2ab500 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:44.305022 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6c8b2dea-5eaf-4742-8e2f-5e154d2ab500 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1563 microversion: 2.25 time: 0.698884 Aug 23 18:01:44.306262 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1327/2666] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:43 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1563 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:44.322487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d8a1131-8ac3-48ba-a39c-cfb5c5821e4d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:44.327234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d8a1131-8ac3-48ba-a39c-cfb5c5821e4d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:44.346132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d8a1131-8ac3-48ba-a39c-cfb5c5821e4d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:44.349614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d8a1131-8ac3-48ba-a39c-cfb5c5821e4d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:44.351016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d8a1131-8ac3-48ba-a39c-cfb5c5821e4d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:44.353424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d8a1131-8ac3-48ba-a39c-cfb5c5821e4d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:44.355385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d8a1131-8ac3-48ba-a39c-cfb5c5821e4d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:44.357391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d8a1131-8ac3-48ba-a39c-cfb5c5821e4d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:44.415384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:44.439894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a36b748d-6e6c-4191-9415-74d37c9e2a15 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:44.451120 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a36b748d-6e6c-4191-9415-74d37c9e2a15 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1495 microversion: 2.1 time: 0.683038 Aug 23 18:01:44.468720 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1340/2667] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:43 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1495 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:44.697465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5881f8b7-63a4-41d6-984f-cbca71d5f006 req-594245a9-42f3-4354-8a90-93e0492d160f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311dc663-0ec5-4c69-8684-8404750c745e", "tag": "971907ed-8899-4e44-b7e5-cddccbc9dc07"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:44.725371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5881f8b7-63a4-41d6-984f-cbca71d5f006 req-594245a9-42f3-4354-8a90-93e0492d160f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:44.728635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5881f8b7-63a4-41d6-984f-cbca71d5f006 req-594245a9-42f3-4354-8a90-93e0492d160f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:44.729852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5881f8b7-63a4-41d6-984f-cbca71d5f006 req-594245a9-42f3-4354-8a90-93e0492d160f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:44.787980 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5881f8b7-63a4-41d6-984f-cbca71d5f006 req-594245a9-42f3-4354-8a90-93e0492d160f service nova] Creating event network-changed:971907ed-8899-4e44-b7e5-cddccbc9dc07 for instance 311dc663-0ec5-4c69-8684-8404750c745e on n-h1-850468-16 Aug 23 18:01:44.802305 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5881f8b7-63a4-41d6-984f-cbca71d5f006 req-594245a9-42f3-4354-8a90-93e0492d160f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327616 Aug 23 18:01:44.804008 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1341/2668] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:44.810278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-28795e34-542f-4d35-8325-56056622963a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:44.811405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-28795e34-542f-4d35-8325-56056622963a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:44.823523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28795e34-542f-4d35-8325-56056622963a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:44.824306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28795e34-542f-4d35-8325-56056622963a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:44.824859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28795e34-542f-4d35-8325-56056622963a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:44.826474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28795e34-542f-4d35-8325-56056622963a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:44.827739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28795e34-542f-4d35-8325-56056622963a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:44.828514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28795e34-542f-4d35-8325-56056622963a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:45.213407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-28795e34-542f-4d35-8325-56056622963a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:45.226792 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-28795e34-542f-4d35-8325-56056622963a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1505 microversion: 2.1 time: 0.421058 Aug 23 18:01:45.228004 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1342/2669] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:44 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1505 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:45.232908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c1fbda44-3f0a-45da-8e11-10487bf6ed90 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:45.233773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c1fbda44-3f0a-45da-8e11-10487bf6ed90 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:45.265683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1fbda44-3f0a-45da-8e11-10487bf6ed90 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:45.267146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1fbda44-3f0a-45da-8e11-10487bf6ed90 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:45.274265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1fbda44-3f0a-45da-8e11-10487bf6ed90 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:45.276028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1fbda44-3f0a-45da-8e11-10487bf6ed90 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:45.276671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1fbda44-3f0a-45da-8e11-10487bf6ed90 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:45.277871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1fbda44-3f0a-45da-8e11-10487bf6ed90 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:45.524053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5d8a1131-8ac3-48ba-a39c-cfb5c5821e4d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:45.533358 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d8a1131-8ac3-48ba-a39c-cfb5c5821e4d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1315 microversion: 2.1 time: 1.225200 Aug 23 18:01:45.538420 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1328/2670] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:44 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1315 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:45.551624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cb02dc31-0c7c-4bdc-bc11-9e9caaca778d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-522506950"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:45.554237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cb02dc31-0c7c-4bdc-bc11-9e9caaca778d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:45.577418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb02dc31-0c7c-4bdc-bc11-9e9caaca778d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:45.583682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb02dc31-0c7c-4bdc-bc11-9e9caaca778d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:45.590672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb02dc31-0c7c-4bdc-bc11-9e9caaca778d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:45.591994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb02dc31-0c7c-4bdc-bc11-9e9caaca778d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:45.594130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb02dc31-0c7c-4bdc-bc11-9e9caaca778d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:45.594831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb02dc31-0c7c-4bdc-bc11-9e9caaca778d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:46.620727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c1fbda44-3f0a-45da-8e11-10487bf6ed90 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:46.641452 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c1fbda44-3f0a-45da-8e11-10487bf6ed90 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1401 microversion: 2.1 time: 1.412156 Aug 23 18:01:46.642303 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1343/2671] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:45 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1401 bytes in 1414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:46.649770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-69d5b271-06a8-4cda-86ec-741ea071d99e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:46.650675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-69d5b271-06a8-4cda-86ec-741ea071d99e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:46.670617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69d5b271-06a8-4cda-86ec-741ea071d99e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:46.673784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69d5b271-06a8-4cda-86ec-741ea071d99e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:46.674604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69d5b271-06a8-4cda-86ec-741ea071d99e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:46.677581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69d5b271-06a8-4cda-86ec-741ea071d99e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:46.678931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69d5b271-06a8-4cda-86ec-741ea071d99e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:46.679549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69d5b271-06a8-4cda-86ec-741ea071d99e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:46.768414 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.network.security_group_api [None req-cb02dc31-0c7c-4bdc-bc11-9e9caaca778d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Adding security group 40e17e25-c205-43d5-93fc-eba22730b287 to port 149f6379-8609-4e86-9e62-c07c4cb88a1c Aug 23 18:01:47.394220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-69d5b271-06a8-4cda-86ec-741ea071d99e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:47.406682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-69d5b271-06a8-4cda-86ec-741ea071d99e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:47.410232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-69d5b271-06a8-4cda-86ec-741ea071d99e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'bb8758f075834ca59962ab82f042ec34', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a847d523b7944595aa39244f15b37665', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:47.411824 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-69d5b271-06a8-4cda-86ec-741ea071d99e tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 200 len: 1563 microversion: 2.25 time: 0.767748 Aug 23 18:01:47.416954 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1344/2672] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:46 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 1563 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:01:47.426740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5139814d-420d-48c0-b127-12afb04bf59c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:47.428630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5139814d-420d-48c0-b127-12afb04bf59c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:47.443293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5139814d-420d-48c0-b127-12afb04bf59c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:47.444483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5139814d-420d-48c0-b127-12afb04bf59c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:47.445848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5139814d-420d-48c0-b127-12afb04bf59c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:47.448061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5139814d-420d-48c0-b127-12afb04bf59c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:47.450237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5139814d-420d-48c0-b127-12afb04bf59c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:47.450923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5139814d-420d-48c0-b127-12afb04bf59c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:47.717782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:47.754497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=10 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:47.912362 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cb02dc31-0c7c-4bdc-bc11-9e9caaca778d tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4/action" status: 202 len: 0 microversion: 2.1 time: 2.371624 Aug 23 18:01:47.913704 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1329/2673] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:01:45 2022] POST /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4/action => generated 0 bytes in 2374 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:01:47.919884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1b0f8c0c-2ffc-459d-93ec-62789afd4e76 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:47.921669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1b0f8c0c-2ffc-459d-93ec-62789afd4e76 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:47.936562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:47.968984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c0c-2ffc-459d-93ec-62789afd4e76 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:47.969959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c0c-2ffc-459d-93ec-62789afd4e76 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:47.970514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c0c-2ffc-459d-93ec-62789afd4e76 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:47.973218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c0c-2ffc-459d-93ec-62789afd4e76 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:47.975083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c0c-2ffc-459d-93ec-62789afd4e76 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:47.977030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b0f8c0c-2ffc-459d-93ec-62789afd4e76 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:48.004526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5139814d-420d-48c0-b127-12afb04bf59c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:48.019979 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5139814d-420d-48c0-b127-12afb04bf59c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 200 len: 1472 microversion: 2.1 time: 0.601686 Aug 23 18:01:48.023695 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1345/2674] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:47 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 1472 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:48.032953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7839a2b3-a305-4f38-a6de-89ca03f9866a req-dc415b59-727f-4baa-ac89-4591fe924114 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9504575-e074-4aad-871d-bcb9db7a22e3", "name": "network-vif-deleted", "tag": "039de3f2-8782-4e97-9d10-be32f83014de"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:48.046691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7839a2b3-a305-4f38-a6de-89ca03f9866a req-dc415b59-727f-4baa-ac89-4591fe924114 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:48.047382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7839a2b3-a305-4f38-a6de-89ca03f9866a req-dc415b59-727f-4baa-ac89-4591fe924114 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:48.048817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7839a2b3-a305-4f38-a6de-89ca03f9866a req-dc415b59-727f-4baa-ac89-4591fe924114 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:48.081059 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7839a2b3-a305-4f38-a6de-89ca03f9866a req-dc415b59-727f-4baa-ac89-4591fe924114 service nova] Creating event network-vif-deleted:039de3f2-8782-4e97-9d10-be32f83014de for instance b9504575-e074-4aad-871d-bcb9db7a22e3 on n-h2-850468-16 Aug 23 18:01:48.090831 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7839a2b3-a305-4f38-a6de-89ca03f9866a req-dc415b59-727f-4baa-ac89-4591fe924114 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063884 Aug 23 18:01:48.092931 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1346/2675] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:48.105437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce785237-d15e-4dcd-82d2-c61030856fb1 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:48.107007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ce785237-d15e-4dcd-82d2-c61030856fb1 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:48.115157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce785237-d15e-4dcd-82d2-c61030856fb1 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:48.115891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce785237-d15e-4dcd-82d2-c61030856fb1 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:48.116510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce785237-d15e-4dcd-82d2-c61030856fb1 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:48.117643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce785237-d15e-4dcd-82d2-c61030856fb1 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:48.118249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce785237-d15e-4dcd-82d2-c61030856fb1 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:48.118874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce785237-d15e-4dcd-82d2-c61030856fb1 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:48.360367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1b0f8c0c-2ffc-459d-93ec-62789afd4e76 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:48.378861 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1b0f8c0c-2ffc-459d-93ec-62789afd4e76 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1315 microversion: 2.1 time: 0.463580 Aug 23 18:01:48.395865 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1330/2676] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:47 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:48.411371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-466d2ad0-8247-4c03-8e70-626d45312a00 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-396324189"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:48.412279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-466d2ad0-8247-4c03-8e70-626d45312a00 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:48.432892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-466d2ad0-8247-4c03-8e70-626d45312a00 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:48.434150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-466d2ad0-8247-4c03-8e70-626d45312a00 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:48.435093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-466d2ad0-8247-4c03-8e70-626d45312a00 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:48.436466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-466d2ad0-8247-4c03-8e70-626d45312a00 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:48.442288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-466d2ad0-8247-4c03-8e70-626d45312a00 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:48.444351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-466d2ad0-8247-4c03-8e70-626d45312a00 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:48.529140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=14 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:01:48.737977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ce785237-d15e-4dcd-82d2-c61030856fb1 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:48.761597 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce785237-d15e-4dcd-82d2-c61030856fb1 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1401 microversion: 2.1 time: 0.665491 Aug 23 18:01:48.763609 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1347/2677] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:48 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1401 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:48.771242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3d653d97-4bf0-4e61-b8d7-18c8d3494def tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-184495134"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:48.774300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3d653d97-4bf0-4e61-b8d7-18c8d3494def tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:48.785660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d653d97-4bf0-4e61-b8d7-18c8d3494def tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:48.787553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d653d97-4bf0-4e61-b8d7-18c8d3494def tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:48.788211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d653d97-4bf0-4e61-b8d7-18c8d3494def tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:48.789213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d653d97-4bf0-4e61-b8d7-18c8d3494def tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:48.789832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d653d97-4bf0-4e61-b8d7-18c8d3494def tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:48.790430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d653d97-4bf0-4e61-b8d7-18c8d3494def tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:48.818863 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.network.security_group_api [None req-466d2ad0-8247-4c03-8e70-626d45312a00 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Adding security group 1c2afb06-d171-448b-9dc3-c1dfe0d947e5 to port 149f6379-8609-4e86-9e62-c07c4cb88a1c Aug 23 18:01:49.124665 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3d653d97-4bf0-4e61-b8d7-18c8d3494def tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "POST /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2/action" status: 202 len: 0 microversion: 2.1 time: 0.359336 Aug 23 18:01:49.145609 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1348/2678] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:01:48 2022] POST /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 18:01:49.160159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0ab0b60e-7d69-47ba-9291-511a42726e77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:49.161639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0ab0b60e-7d69-47ba-9291-511a42726e77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] [instance: b9504575-e074-4aad-871d-bcb9db7a22e3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:49.199220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ab0b60e-7d69-47ba-9291-511a42726e77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:49.199752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ab0b60e-7d69-47ba-9291-511a42726e77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:49.208893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ab0b60e-7d69-47ba-9291-511a42726e77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:49.210266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ab0b60e-7d69-47ba-9291-511a42726e77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:49.210953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ab0b60e-7d69-47ba-9291-511a42726e77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:49.216332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ab0b60e-7d69-47ba-9291-511a42726e77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:49.260608 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-0ab0b60e-7d69-47ba-9291-511a42726e77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] HTTP exception thrown: Instance b9504575-e074-4aad-871d-bcb9db7a22e3 could not be found. Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0ab0b60e-7d69-47ba-9291-511a42726e77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Request method failure captured: Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 HTTP/1.1 Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRP8_MSBeCvyoczJoDOjyK9PVKMQv_FFzBJiC7Rbq488aZTAXcY393dxSu7bla41fBTKtiI_qjDXAeOFiFtyITkcLMLbvFAvzdzRa5BLDDiiwRSAJYHSPwfaYu3XkXu71Havzq4MQ9cg7o9HNRktxA1oTHaPXN_AGgKh5gSuQoQsPqI Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.25 Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a847d523b7944595aa39244f15b37665 Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-807887112 Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a847d523b7944595aa39244f15b37665"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a847d523b7944595aa39244f15b37665"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a847d523b7944595aa39244f15b37665"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a847d523b7944595aa39244f15b37665"}]}] Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-807887112 Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a847d523b7944595aa39244f15b37665 Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-807887112 Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-LiveAutoBlockMigrationV225Test-807887112-project Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: bb8758f075834ca59962ab82f042ec34 Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-807887112-project Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance b9504575-e074-4aad-871d-bcb9db7a22e3 could not be found. Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'b9504575-e074-4aad-871d-bcb9db7a22e3'} Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9504575-e074-4aad-871d-bcb9db7a22e3 could not be found. Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9504575-e074-4aad-871d-bcb9db7a22e3 could not be found. Aug 23 18:01:49.263669 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:49.268504 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:49.268504 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:49.268504 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:49.268504 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:49.268504 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:49.268504 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:01:49.268504 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:01:49.268504 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9504575-e074-4aad-871d-bcb9db7a22e3 could not be found. Aug 23 18:01:49.268504 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:01:49.268504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0ab0b60e-7d69-47ba-9291-511a42726e77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] Returning 404 to user: Instance b9504575-e074-4aad-871d-bcb9db7a22e3 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:01:49.268504 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0ab0b60e-7d69-47ba-9291-511a42726e77 tempest-LiveAutoBlockMigrationV225Test-807887112 tempest-LiveAutoBlockMigrationV225Test-807887112-project] 10.222.0.61 "GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3" status: 404 len: 111 microversion: 2.25 time: 0.117601 Aug 23 18:01:49.268504 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1349/2679] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:01:49 2022] GET /compute/v2.1/servers/b9504575-e074-4aad-871d-bcb9db7a22e3 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:01:49.279600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-9844aa74-8cad-41e1-80fa-dd33e0c01f17 req-841190a0-82f4-4819-9760-882dfb8c4b3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feaf703-5072-4321-b05e-dfebaaa5c573", "name": "network-vif-plugged", "status": "completed", "tag": "37148738-a43c-4c4b-a015-de86f9ba132b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:49.300614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9844aa74-8cad-41e1-80fa-dd33e0c01f17 req-841190a0-82f4-4819-9760-882dfb8c4b3b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:49.301098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9844aa74-8cad-41e1-80fa-dd33e0c01f17 req-841190a0-82f4-4819-9760-882dfb8c4b3b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:49.301526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9844aa74-8cad-41e1-80fa-dd33e0c01f17 req-841190a0-82f4-4819-9760-882dfb8c4b3b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:49.323233 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-9844aa74-8cad-41e1-80fa-dd33e0c01f17 req-841190a0-82f4-4819-9760-882dfb8c4b3b service nova] Creating event network-vif-plugged:37148738-a43c-4c4b-a015-de86f9ba132b for instance 8feaf703-5072-4321-b05e-dfebaaa5c573 on n-h2-850468-16 Aug 23 18:01:49.346638 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-9844aa74-8cad-41e1-80fa-dd33e0c01f17 req-841190a0-82f4-4819-9760-882dfb8c4b3b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079129 Aug 23 18:01:49.347239 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1350/2680] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:49.363872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c288ad7-2f03-46b9-8f48-c84373214724 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfa92af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:49.450829 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4c288ad7-2f03-46b9-8f48-c84373214724 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.102098 Aug 23 18:01:49.451405 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1351/2681] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:01:49 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:49.463015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f18f99aa-ab5a-46d5-8b3b-cca64a675686 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:49.463782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f18f99aa-ab5a-46d5-8b3b-cca64a675686 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:49.484427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f18f99aa-ab5a-46d5-8b3b-cca64a675686 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:49.485686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f18f99aa-ab5a-46d5-8b3b-cca64a675686 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:49.486303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f18f99aa-ab5a-46d5-8b3b-cca64a675686 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:49.487951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f18f99aa-ab5a-46d5-8b3b-cca64a675686 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:49.488766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f18f99aa-ab5a-46d5-8b3b-cca64a675686 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:49.489437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f18f99aa-ab5a-46d5-8b3b-cca64a675686 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:50.108243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f18f99aa-ab5a-46d5-8b3b-cca64a675686 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:50.134780 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f18f99aa-ab5a-46d5-8b3b-cca64a675686 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1315 microversion: 2.1 time: 0.677005 Aug 23 18:01:50.151117 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1352/2682] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:49 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1315 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:50.168584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5c993820-b797-4b1a-91ac-20bdd6d1d98a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:50.169544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5c993820-b797-4b1a-91ac-20bdd6d1d98a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:50.190377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c993820-b797-4b1a-91ac-20bdd6d1d98a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:50.191304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c993820-b797-4b1a-91ac-20bdd6d1d98a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:50.191944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c993820-b797-4b1a-91ac-20bdd6d1d98a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:50.192869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c993820-b797-4b1a-91ac-20bdd6d1d98a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:50.193944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c993820-b797-4b1a-91ac-20bdd6d1d98a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:50.194584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c993820-b797-4b1a-91ac-20bdd6d1d98a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:50.645866 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-466d2ad0-8247-4c03-8e70-626d45312a00 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4/action" status: 202 len: 0 microversion: 2.1 time: 2.247537 Aug 23 18:01:50.647539 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1331/2683] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:01:48 2022] POST /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4/action => generated 0 bytes in 2251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:01:50.660487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f3e3476f-b62c-4744-a124-6bb3df4e00f2 req-c063a6e4-1cc5-4e84-8c03-f4cf5477525b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcce231c-02f5-4c4f-b217-a265e0be63e4", "tag": "149f6379-8609-4e86-9e62-c07c4cb88a1c"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:50.693615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f3e3476f-b62c-4744-a124-6bb3df4e00f2 req-c063a6e4-1cc5-4e84-8c03-f4cf5477525b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:50.695207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f3e3476f-b62c-4744-a124-6bb3df4e00f2 req-c063a6e4-1cc5-4e84-8c03-f4cf5477525b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:50.696512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f3e3476f-b62c-4744-a124-6bb3df4e00f2 req-c063a6e4-1cc5-4e84-8c03-f4cf5477525b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:50.728863 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f3e3476f-b62c-4744-a124-6bb3df4e00f2 req-c063a6e4-1cc5-4e84-8c03-f4cf5477525b service nova] Creating event network-changed:149f6379-8609-4e86-9e62-c07c4cb88a1c for instance fcce231c-02f5-4c4f-b217-a265e0be63e4 on n-h2-850468-16 Aug 23 18:01:50.743952 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f3e3476f-b62c-4744-a124-6bb3df4e00f2 req-c063a6e4-1cc5-4e84-8c03-f4cf5477525b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090232 Aug 23 18:01:50.744841 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1332/2684] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:50.756884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed21f534-d5c7-4ba4-9db6-92b6ef2b1c68 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfcc8430>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:50.822708 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ed21f534-d5c7-4ba4-9db6-92b6ef2b1c68 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.071377 Aug 23 18:01:50.823479 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1333/2685] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:01:50 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:50.838809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b1b0c72f-f797-41a3-a0fc-b6c35b52cb33 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:50.843282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b1b0c72f-f797-41a3-a0fc-b6c35b52cb33 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:50.859901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1b0c72f-f797-41a3-a0fc-b6c35b52cb33 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:50.863618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1b0c72f-f797-41a3-a0fc-b6c35b52cb33 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:50.864518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1b0c72f-f797-41a3-a0fc-b6c35b52cb33 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:50.866050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1b0c72f-f797-41a3-a0fc-b6c35b52cb33 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:50.868570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1b0c72f-f797-41a3-a0fc-b6c35b52cb33 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:50.870446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1b0c72f-f797-41a3-a0fc-b6c35b52cb33 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:51.043761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5c993820-b797-4b1a-91ac-20bdd6d1d98a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:51.055065 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5c993820-b797-4b1a-91ac-20bdd6d1d98a tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1401 microversion: 2.1 time: 0.901946 Aug 23 18:01:51.055675 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1353/2686] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:50 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1401 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:51.159413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-82820acf-c4f9-4bda-9189-befa875d78be tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:51.160934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-82820acf-c4f9-4bda-9189-befa875d78be tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:51.176965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82820acf-c4f9-4bda-9189-befa875d78be tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:51.180762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82820acf-c4f9-4bda-9189-befa875d78be tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:51.182681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82820acf-c4f9-4bda-9189-befa875d78be tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:51.185780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82820acf-c4f9-4bda-9189-befa875d78be tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:51.188758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82820acf-c4f9-4bda-9189-befa875d78be tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:51.190814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82820acf-c4f9-4bda-9189-befa875d78be tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:51.323445 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b1b0c72f-f797-41a3-a0fc-b6c35b52cb33 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.498788 Aug 23 18:01:51.324039 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1334/2687] 10.222.0.61 () {58 vars in 1293 bytes} [Tue Aug 23 18:01:50 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4/os-security-groups => generated 1155 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:51.340874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-63b8d9b0-2fcd-4ac2-ad8f-4152b18bb81f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'create', calling method: .version_select at 0x7f27dfcd7af0>, body: {"security_group": {"name": " tempest-securitygroup -1515931974 ", "description": "tempest-description-1747018299"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:51.737524 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-63b8d9b0-2fcd-4ac2-ad8f-4152b18bb81f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 224 microversion: 2.1 time: 0.401158 Aug 23 18:01:51.740679 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1335/2688] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:01:51 2022] POST /compute/v2.1/os-security-groups => generated 224 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:51.757770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b6f3a38-e524-42c2-8465-436e5bf5d094 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27dfcc8160>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:51.868374 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b6f3a38-e524-42c2-8465-436e5bf5d094 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/b7e9f136-21df-459d-b64c-f008c07221f1" status: 200 len: 224 microversion: 2.1 time: 0.118831 Aug 23 18:01:51.869331 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1336/2689] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 18:01:51 2022] GET /compute/v2.1/os-security-groups/b7e9f136-21df-459d-b64c-f008c07221f1 => generated 224 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:51.874476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-279ef901-0a99-483e-a2ad-5e08667006e6 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27f1af4820>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:51.964207 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-279ef901-0a99-483e-a2ad-5e08667006e6 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.093621 Aug 23 18:01:51.965750 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1337/2690] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:01:51 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:51.985110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86dbfb72-af05-44cb-a4fe-7cc5454211c9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27dfcc8430>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:52.380790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-82820acf-c4f9-4bda-9189-befa875d78be tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:52.417638 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-82820acf-c4f9-4bda-9189-befa875d78be tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1315 microversion: 2.1 time: 1.263583 Aug 23 18:01:52.419411 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1354/2691] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:51 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1315 bytes in 1266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:52.428870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6faaa47c-7e86-4795-b997-28a92c5944a6 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:52.429987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6faaa47c-7e86-4795-b997-28a92c5944a6 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:52.444113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6faaa47c-7e86-4795-b997-28a92c5944a6 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:52.445874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6faaa47c-7e86-4795-b997-28a92c5944a6 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:52.447336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6faaa47c-7e86-4795-b997-28a92c5944a6 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:52.448464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6faaa47c-7e86-4795-b997-28a92c5944a6 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:52.449487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6faaa47c-7e86-4795-b997-28a92c5944a6 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:52.450167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6faaa47c-7e86-4795-b997-28a92c5944a6 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:52.546940 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-86dbfb72-af05-44cb-a4fe-7cc5454211c9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/b7e9f136-21df-459d-b64c-f008c07221f1" status: 202 len: 0 microversion: 2.1 time: 0.578826 Aug 23 18:01:52.547757 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1338/2692] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:01:51 2022] DELETE /compute/v2.1/os-security-groups/b7e9f136-21df-459d-b64c-f008c07221f1 => generated 0 bytes in 581 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:01:52.576696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-699731dc-5e87-46e6-8878-f5ef484435f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27dfce65e0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:52.662458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-699731dc-5e87-46e6-8878-f5ef484435f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:01:52.663380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.security_group_api [None req-699731dc-5e87-46e6-8878-f5ef484435f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Neutron security group b7e9f136-21df-459d-b64c-f008c07221f1 not found {{(pid=128807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:01:52.664075 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-699731dc-5e87-46e6-8878-f5ef484435f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:01:52.664075 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-de296e5c-7e60-418e-b75f-bd07456260b4'] Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-699731dc-5e87-46e6-8878-f5ef484435f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-security-groups/b7e9f136-21df-459d-b64c-f008c07221f1 HTTP/1.1 Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: exception: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-de296e5c-7e60-418e-b75f-bd07456260b4'] Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'b7e9f136-21df-459d-b64c-f008c07221f1'} Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:01:52.666503 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de296e5c-7e60-418e-b75f-bd07456260b4'] Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de296e5c-7e60-418e-b75f-bd07456260b4'] Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de296e5c-7e60-418e-b75f-bd07456260b4'] Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-de296e5c-7e60-418e-b75f-bd07456260b4'] Aug 23 18:01:52.670671 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:01:52.673198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-699731dc-5e87-46e6-8878-f5ef484435f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:01:52.673198 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-de296e5c-7e60-418e-b75f-bd07456260b4'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:01:52.673198 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-699731dc-5e87-46e6-8878-f5ef484435f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/b7e9f136-21df-459d-b64c-f008c07221f1" status: 404 len: 194 microversion: 2.1 time: 0.119755 Aug 23 18:01:52.673198 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1339/2693] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 18:01:52 2022] GET /compute/v2.1/os-security-groups/b7e9f136-21df-459d-b64c-f008c07221f1 => generated 194 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:01:52.685926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-79099d2e-b361-4e3a-8d91-3d91fc4e7b7f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'create', calling method: .version_select at 0x7f27dfca75e0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-256376691", "description": "tempest-description-1693280434"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:53.235230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6faaa47c-7e86-4795-b997-28a92c5944a6 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:53.247380 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6faaa47c-7e86-4795-b997-28a92c5944a6 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1401 microversion: 2.1 time: 0.824422 Aug 23 18:01:53.248532 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1355/2694] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:52 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1401 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:53.257196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-24d719ea-18e5-40ef-a605-67c168b083da req-74fbcc7d-848d-49ab-b79a-483bbd562891 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fcce231c-02f5-4c4f-b217-a265e0be63e4", "tag": "149f6379-8609-4e86-9e62-c07c4cb88a1c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:53.287703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-24d719ea-18e5-40ef-a605-67c168b083da req-74fbcc7d-848d-49ab-b79a-483bbd562891 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:53.289235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-24d719ea-18e5-40ef-a605-67c168b083da req-74fbcc7d-848d-49ab-b79a-483bbd562891 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:53.290965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-24d719ea-18e5-40ef-a605-67c168b083da req-74fbcc7d-848d-49ab-b79a-483bbd562891 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:53.324618 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-79099d2e-b361-4e3a-8d91-3d91fc4e7b7f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.644644 Aug 23 18:01:53.326084 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1340/2695] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:01:52 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:53.331832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bb78d0c2-9d7a-4ad7-9689-9a53fab92787 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfcc8e50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:53.333826 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-24d719ea-18e5-40ef-a605-67c168b083da req-74fbcc7d-848d-49ab-b79a-483bbd562891 service nova] Creating event network-changed:149f6379-8609-4e86-9e62-c07c4cb88a1c for instance fcce231c-02f5-4c4f-b217-a265e0be63e4 on n-h2-850468-16 Aug 23 18:01:53.342991 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-24d719ea-18e5-40ef-a605-67c168b083da req-74fbcc7d-848d-49ab-b79a-483bbd562891 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092798 Aug 23 18:01:53.344459 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1356/2696] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:53.360906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c024eb31-b5c5-47ff-9c80-0e66ecc5c61f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'create', calling method: .version_select at 0x7f27dfa32d30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-367567089", "description": "tempest-description-622010106"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:53.432508 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bb78d0c2-9d7a-4ad7-9689-9a53fab92787 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.104959 Aug 23 18:01:53.434379 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1341/2697] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:01:53 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:53.449113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a8cab030-71f8-4dc4-9740-815944a7e76a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:53.450801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a8cab030-71f8-4dc4-9740-815944a7e76a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:53.463699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8cab030-71f8-4dc4-9740-815944a7e76a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:53.464477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8cab030-71f8-4dc4-9740-815944a7e76a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:53.465109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8cab030-71f8-4dc4-9740-815944a7e76a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:53.467391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8cab030-71f8-4dc4-9740-815944a7e76a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:53.468055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8cab030-71f8-4dc4-9740-815944a7e76a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:53.471943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8cab030-71f8-4dc4-9740-815944a7e76a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:53.802416 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c024eb31-b5c5-47ff-9c80-0e66ecc5c61f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.456469 Aug 23 18:01:53.803698 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1357/2698] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:01:53 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:53.825179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e89edcd4-f6dc-4153-bd68-111a77a8aeb5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'create', calling method: .version_select at 0x7f27dfa4d550>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1673308804", "description": "tempest-description-809461842"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:53.993255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a8cab030-71f8-4dc4-9740-815944a7e76a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:54.006400 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a8cab030-71f8-4dc4-9740-815944a7e76a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1465 microversion: 2.1 time: 0.569682 Aug 23 18:01:54.008055 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1342/2699] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:53 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1465 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:54.354385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-042dd07b-206c-496a-b39d-6ff5ef39b829 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:54.356293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-042dd07b-206c-496a-b39d-6ff5ef39b829 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:54.359754 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e89edcd4-f6dc-4153-bd68-111a77a8aeb5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.546482 Aug 23 18:01:54.360618 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1358/2700] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:01:53 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:01:54.373321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-135cfa0c-9120-4763-bcfe-beaad76d2747 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:54.375439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-135cfa0c-9120-4763-bcfe-beaad76d2747 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:54.385355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-042dd07b-206c-496a-b39d-6ff5ef39b829 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:54.387497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-042dd07b-206c-496a-b39d-6ff5ef39b829 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:54.390179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-042dd07b-206c-496a-b39d-6ff5ef39b829 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:54.391112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-042dd07b-206c-496a-b39d-6ff5ef39b829 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:54.391695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-042dd07b-206c-496a-b39d-6ff5ef39b829 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:54.394292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-042dd07b-206c-496a-b39d-6ff5ef39b829 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:54.397458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-135cfa0c-9120-4763-bcfe-beaad76d2747 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:54.398868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-135cfa0c-9120-4763-bcfe-beaad76d2747 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:54.399419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-135cfa0c-9120-4763-bcfe-beaad76d2747 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:54.401672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-135cfa0c-9120-4763-bcfe-beaad76d2747 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:54.403328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-135cfa0c-9120-4763-bcfe-beaad76d2747 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:54.404862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-135cfa0c-9120-4763-bcfe-beaad76d2747 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:54.824086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-135cfa0c-9120-4763-bcfe-beaad76d2747 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:54.843599 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-135cfa0c-9120-4763-bcfe-beaad76d2747 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1401 microversion: 2.1 time: 0.477421 Aug 23 18:01:54.847559 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1359/2701] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:54 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1401 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:54.874827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b1c3df16-b282-499b-a956-b0673f18b4d1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27dfa27700>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:55.855082 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-042dd07b-206c-496a-b39d-6ff5ef39b829 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1618 microversion: 2.1 time: 1.819878 Aug 23 18:01:55.856630 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1343/2702] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:54 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1618 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:01:55.867149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de86ffd8-4d41-4cc7-ada2-0022359748fd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfc41670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:55.950623 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-de86ffd8-4d41-4cc7-ada2-0022359748fd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.091415 Aug 23 18:01:55.951316 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1344/2703] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:01:55 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:55.964750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-122fc2f0-e6f1-4b51-968a-5ea257136c2d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:55.968242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-122fc2f0-e6f1-4b51-968a-5ea257136c2d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:01:55.985630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-122fc2f0-e6f1-4b51-968a-5ea257136c2d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:55.986846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-122fc2f0-e6f1-4b51-968a-5ea257136c2d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:55.987426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-122fc2f0-e6f1-4b51-968a-5ea257136c2d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:55.993044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-122fc2f0-e6f1-4b51-968a-5ea257136c2d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:55.994225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-122fc2f0-e6f1-4b51-968a-5ea257136c2d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:55.995945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-122fc2f0-e6f1-4b51-968a-5ea257136c2d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:56.358811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-122fc2f0-e6f1-4b51-968a-5ea257136c2d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:01:56.375100 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-122fc2f0-e6f1-4b51-968a-5ea257136c2d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1401 microversion: 2.1 time: 0.418979 Aug 23 18:01:56.378854 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1345/2704] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:01:55 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1401 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:56.386004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d0fb98f7-de7c-4821-aef4-4a463ad8167c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Action: 'create', calling method: .version_select at 0x7f27dfc41d30>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1335730921", "policies": ["affinity"]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:56.415330 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b1c3df16-b282-499b-a956-b0673f18b4d1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 1.566355 Aug 23 18:01:56.415929 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1360/2705] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Aug 23 18:01:54 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 1568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:01:56.428531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d0fb98f7-de7c-4821-aef4-4a463ad8167c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:01:56.435053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3d995bbe-9fc2-46a6-a5eb-d09d3a9546c0 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27df9ce0d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:56.452863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d0fb98f7-de7c-4821-aef4-4a463ad8167c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:01:56.625357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d0fb98f7-de7c-4821-aef4-4a463ad8167c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:01:56.654885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d0fb98f7-de7c-4821-aef4-4a463ad8167c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:01:56.692496 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d0fb98f7-de7c-4821-aef4-4a463ad8167c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.312170 Aug 23 18:01:56.696560 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1346/2706] 10.222.0.61 () {60 vars in 1174 bytes} [Tue Aug 23 18:01:56 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:56.709131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f9be2334-64d5-4c9f-8b2a-d4f5cc3f5cf8 req-f381883a-d1de-49db-94a1-3e6a1a9dafc0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2", "name": "network-vif-plugged", "status": "completed", "tag": "6d753232-30bd-45f2-b47d-0a1c92879f78"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:01:56.734825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f9be2334-64d5-4c9f-8b2a-d4f5cc3f5cf8 req-f381883a-d1de-49db-94a1-3e6a1a9dafc0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:01:56.738232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f9be2334-64d5-4c9f-8b2a-d4f5cc3f5cf8 req-f381883a-d1de-49db-94a1-3e6a1a9dafc0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:01:56.738927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f9be2334-64d5-4c9f-8b2a-d4f5cc3f5cf8 req-f381883a-d1de-49db-94a1-3e6a1a9dafc0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:01:56.778570 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f9be2334-64d5-4c9f-8b2a-d4f5cc3f5cf8 req-f381883a-d1de-49db-94a1-3e6a1a9dafc0 service nova] Creating event network-vif-plugged:6d753232-30bd-45f2-b47d-0a1c92879f78 for instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 on n-h1-850468-16 Aug 23 18:01:56.797829 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f9be2334-64d5-4c9f-8b2a-d4f5cc3f5cf8 req-f381883a-d1de-49db-94a1-3e6a1a9dafc0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098007 Aug 23 18:01:56.802943 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1347/2707] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:01:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:01:56.966990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9849bcbc-87a0-46ec-b95c-4b7414227d17 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfc41af0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:01:57.541064 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3d995bbe-9fc2-46a6-a5eb-d09d3a9546c0 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/e19ef6db-cf4c-43ce-8d5a-4ad469d7252a" status: 202 len: 0 microversion: 2.1 time: 1.111491 Aug 23 18:01:57.543287 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1361/2708] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:01:56 2022] DELETE /compute/v2.1/os-security-groups/e19ef6db-cf4c-43ce-8d5a-4ad469d7252a => generated 0 bytes in 1118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:01:57.558835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-432639718", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "f3fd203c-3106-428b-98a7-57b3a8c52974"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:04.829903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=94,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:05.973650 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9849bcbc-87a0-46ec-b95c-4b7414227d17 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 9.011839 Aug 23 18:02:05.987213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:02:05.994671 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1348/2709] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:01:56 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 9034 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:06.000984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1d62667-6c31-49ed-a4a0-10e112dfdf59 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:06.006823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d1d62667-6c31-49ed-a4a0-10e112dfdf59 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:06.031105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1d62667-6c31-49ed-a4a0-10e112dfdf59 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:06.038551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1d62667-6c31-49ed-a4a0-10e112dfdf59 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:06.039107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1d62667-6c31-49ed-a4a0-10e112dfdf59 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:06.039887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1d62667-6c31-49ed-a4a0-10e112dfdf59 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:06.040368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1d62667-6c31-49ed-a4a0-10e112dfdf59 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:06.040806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1d62667-6c31-49ed-a4a0-10e112dfdf59 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:06.300971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d1d62667-6c31-49ed-a4a0-10e112dfdf59 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:06.309296 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d1d62667-6c31-49ed-a4a0-10e112dfdf59 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1401 microversion: 2.1 time: 0.313552 Aug 23 18:02:06.313824 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1349/2710] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:05 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1401 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:06.320947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-865b3106-0bb9-433f-8633-5076da54f696 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27dfc410d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:06.378457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-865b3106-0bb9-433f-8633-5076da54f696 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:02:06.379431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.security_group_api [None req-865b3106-0bb9-433f-8633-5076da54f696 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Neutron security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a not found {{(pid=128807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:02:06.379976 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-865b3106-0bb9-433f-8633-5076da54f696 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:02:06.379976 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-9e1ba587-4d6d-4c56-9492-5858b4cf34cd'] Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-865b3106-0bb9-433f-8633-5076da54f696 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-security-groups/e19ef6db-cf4c-43ce-8d5a-4ad469d7252a HTTP/1.1 Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: exception: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-9e1ba587-4d6d-4c56-9492-5858b4cf34cd'] Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'e19ef6db-cf4c-43ce-8d5a-4ad469d7252a'} Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:02:06.382097 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e1ba587-4d6d-4c56-9492-5858b4cf34cd'] Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e1ba587-4d6d-4c56-9492-5858b4cf34cd'] Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e1ba587-4d6d-4c56-9492-5858b4cf34cd'] Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9e1ba587-4d6d-4c56-9492-5858b4cf34cd'] Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-865b3106-0bb9-433f-8633-5076da54f696 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-9e1ba587-4d6d-4c56-9492-5858b4cf34cd'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-865b3106-0bb9-433f-8633-5076da54f696 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/e19ef6db-cf4c-43ce-8d5a-4ad469d7252a" status: 404 len: 194 microversion: 2.1 time: 0.068791 Aug 23 18:02:06.386758 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1350/2711] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 18:02:06 2022] GET /compute/v2.1/os-security-groups/e19ef6db-cf4c-43ce-8d5a-4ad469d7252a => generated 194 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:02:06.393697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1a8bd2bd-e476-46ca-909a-c775c6d3c068 req-8e631a8e-2918-496d-822b-40f12b533673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311dc663-0ec5-4c69-8684-8404750c745e", "name": "network-vif-plugged", "status": "completed", "tag": "971907ed-8899-4e44-b7e5-cddccbc9dc07"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:06.421157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1a8bd2bd-e476-46ca-909a-c775c6d3c068 req-8e631a8e-2918-496d-822b-40f12b533673 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:06.421918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1a8bd2bd-e476-46ca-909a-c775c6d3c068 req-8e631a8e-2918-496d-822b-40f12b533673 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:06.422525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1a8bd2bd-e476-46ca-909a-c775c6d3c068 req-8e631a8e-2918-496d-822b-40f12b533673 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:06.461366 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1a8bd2bd-e476-46ca-909a-c775c6d3c068 req-8e631a8e-2918-496d-822b-40f12b533673 service nova] Creating event network-vif-plugged:971907ed-8899-4e44-b7e5-cddccbc9dc07 for instance 311dc663-0ec5-4c69-8684-8404750c745e on n-h1-850468-16 Aug 23 18:02:06.500888 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1a8bd2bd-e476-46ca-909a-c775c6d3c068 req-8e631a8e-2918-496d-822b-40f12b533673 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114392 Aug 23 18:02:06.509736 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1351/2712] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:06.525054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-69be53fb-c5c8-4f30-ba06-a1eaeb9cdd4b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:06.534493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-69be53fb-c5c8-4f30-ba06-a1eaeb9cdd4b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:06.553070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69be53fb-c5c8-4f30-ba06-a1eaeb9cdd4b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:06.555492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69be53fb-c5c8-4f30-ba06-a1eaeb9cdd4b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:06.559434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69be53fb-c5c8-4f30-ba06-a1eaeb9cdd4b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:06.561723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69be53fb-c5c8-4f30-ba06-a1eaeb9cdd4b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:06.562384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69be53fb-c5c8-4f30-ba06-a1eaeb9cdd4b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:06.567615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69be53fb-c5c8-4f30-ba06-a1eaeb9cdd4b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:06.674973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:07.094443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:02:07.095604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:02:07.096891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:02:07.097708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:02:07.098328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:02:07.161639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:07.162218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:07.162693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:07.163619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:07.164342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:07.165840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:07.194935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:07.207732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:07.209505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:07.249495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Going to run 2 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:02:07.253065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: e1adfb52-d290-451a-89bf-4d63824150c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:02:07.303346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128808) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 23 18:02:07.315601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-69be53fb-c5c8-4f30-ba06-a1eaeb9cdd4b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:07.333051 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-69be53fb-c5c8-4f30-ba06-a1eaeb9cdd4b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1682 microversion: 2.1 time: 0.817773 Aug 23 18:02:07.335533 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1352/2713] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:06 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1682 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:07.348579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f8bc39eb-6e96-45da-8f20-2b2ff5c01b92 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27dfc41e50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:07.368233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:07.375594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:07.453041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:07.470121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:07.526367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=e1adfb52-d290-451a-89bf-4d63824150c5,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:02:07.678505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:07.697864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:07.779823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:07.793792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:07.873809 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f7bdea0e-1c89-4e0d-8c8e-422b3dfa6d15 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 10.328878 Aug 23 18:02:07.880592 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1362/2714] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:01:57 2022] POST /compute/v2.1/servers => generated 32 bytes in 10336 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 23 18:02:07.905844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ec836fc9-f736-4548-a658-65668da613cf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfa12b80>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:08.021140 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ec836fc9-f736-4548-a658-65668da613cf tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.137884 Aug 23 18:02:08.021756 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1363/2715] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:07 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:08.026475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f8980e3a-99cb-4641-aab3-8e608a39d863 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:08.028765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f8980e3a-99cb-4641-aab3-8e608a39d863 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:08.040924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8980e3a-99cb-4641-aab3-8e608a39d863 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:08.042161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8980e3a-99cb-4641-aab3-8e608a39d863 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:08.044279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8980e3a-99cb-4641-aab3-8e608a39d863 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:08.045238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8980e3a-99cb-4641-aab3-8e608a39d863 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:08.045730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8980e3a-99cb-4641-aab3-8e608a39d863 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:08.046270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8980e3a-99cb-4641-aab3-8e608a39d863 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:08.073084 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f8bc39eb-6e96-45da-8f20-2b2ff5c01b92 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/914761a1-46cb-47a7-9e29-ca39a6e0d322" status: 202 len: 0 microversion: 2.1 time: 0.736226 Aug 23 18:02:08.073924 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1353/2716] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:02:07 2022] DELETE /compute/v2.1/os-security-groups/914761a1-46cb-47a7-9e29-ca39a6e0d322 => generated 0 bytes in 738 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:02:08.080820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6dcf29ba-6792-4e2f-86a6-1c9f1fbb465d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:08.096578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6dcf29ba-6792-4e2f-86a6-1c9f1fbb465d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:08.103834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6dcf29ba-6792-4e2f-86a6-1c9f1fbb465d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Searching by: {'deleted': False, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:02:08.193182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dcf29ba-6792-4e2f-86a6-1c9f1fbb465d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:08.194355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dcf29ba-6792-4e2f-86a6-1c9f1fbb465d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:08.197098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dcf29ba-6792-4e2f-86a6-1c9f1fbb465d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:08.198329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dcf29ba-6792-4e2f-86a6-1c9f1fbb465d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:08.200653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dcf29ba-6792-4e2f-86a6-1c9f1fbb465d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:08.201847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dcf29ba-6792-4e2f-86a6-1c9f1fbb465d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:08.278290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-6dcf29ba-6792-4e2f-86a6-1c9f1fbb465d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:02:08.443450 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6dcf29ba-6792-4e2f-86a6-1c9f1fbb465d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1000 microversion: 2.1 time: 0.368169 Aug 23 18:02:08.456442 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1354/2717] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 18:02:08 2022] GET /compute/v2.1/servers => generated 1000 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:08.471273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-280e6c84-c31d-4f18-b01d-856789ce942f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27eca11790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:08.689073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-280e6c84-c31d-4f18-b01d-856789ce942f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:02:08.689874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.security_group_api [None req-280e6c84-c31d-4f18-b01d-856789ce942f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Neutron security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 not found {{(pid=128807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:02:08.690590 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-280e6c84-c31d-4f18-b01d-856789ce942f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:02:08.690590 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-3c043bcf-1795-4904-9bd6-4a23442307e5'] Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-280e6c84-c31d-4f18-b01d-856789ce942f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-security-groups/914761a1-46cb-47a7-9e29-ca39a6e0d322 HTTP/1.1 Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: exception: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-3c043bcf-1795-4904-9bd6-4a23442307e5'] Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '914761a1-46cb-47a7-9e29-ca39a6e0d322'} Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:02:08.693529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c043bcf-1795-4904-9bd6-4a23442307e5'] Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c043bcf-1795-4904-9bd6-4a23442307e5'] Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c043bcf-1795-4904-9bd6-4a23442307e5'] Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-3c043bcf-1795-4904-9bd6-4a23442307e5'] Aug 23 18:02:08.697384 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:08.708765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-280e6c84-c31d-4f18-b01d-856789ce942f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:02:08.708765 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-3c043bcf-1795-4904-9bd6-4a23442307e5'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:02:08.712454 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-280e6c84-c31d-4f18-b01d-856789ce942f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/914761a1-46cb-47a7-9e29-ca39a6e0d322" status: 404 len: 194 microversion: 2.1 time: 0.252460 Aug 23 18:02:08.714959 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1355/2718] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 18:02:08 2022] GET /compute/v2.1/os-security-groups/914761a1-46cb-47a7-9e29-ca39a6e0d322 => generated 194 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:02:08.727929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-82b7a6c8-d4db-4114-92a8-6eb5fd7e0c5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:08.731433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-82b7a6c8-d4db-4114-92a8-6eb5fd7e0c5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:08.774294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82b7a6c8-d4db-4114-92a8-6eb5fd7e0c5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:08.775095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82b7a6c8-d4db-4114-92a8-6eb5fd7e0c5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:08.776072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82b7a6c8-d4db-4114-92a8-6eb5fd7e0c5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:08.779104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82b7a6c8-d4db-4114-92a8-6eb5fd7e0c5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:08.779775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82b7a6c8-d4db-4114-92a8-6eb5fd7e0c5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:08.782283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82b7a6c8-d4db-4114-92a8-6eb5fd7e0c5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:09.362432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-82b7a6c8-d4db-4114-92a8-6eb5fd7e0c5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:09.376526 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-82b7a6c8-d4db-4114-92a8-6eb5fd7e0c5e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.659928 Aug 23 18:02:09.378475 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1356/2719] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:08 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:09.384398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3059c0fd-8718-4c6d-aff6-313aa34b2830 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:09.385698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3059c0fd-8718-4c6d-aff6-313aa34b2830 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:09.527370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f8980e3a-99cb-4641-aab3-8e608a39d863 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:09.540838 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f8980e3a-99cb-4641-aab3-8e608a39d863 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1588 microversion: 2.1 time: 1.516915 Aug 23 18:02:09.542160 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1364/2720] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:08 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1588 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:09.554412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e88e02f6-481e-4586-b4a1-1923589d352b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27dfa028b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:09.789365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3059c0fd-8718-4c6d-aff6-313aa34b2830 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:09.804455 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3059c0fd-8718-4c6d-aff6-313aa34b2830 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1218 microversion: 2.1 time: 0.424634 Aug 23 18:02:09.807965 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1357/2721] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:09 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1218 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:09.823541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-818c30d3-b093-42dd-afb1-fd6f7089a354 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfcab670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:09.930104 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-818c30d3-b093-42dd-afb1-fd6f7089a354 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.116318 Aug 23 18:02:09.945127 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1358/2722] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:09 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:09.989045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b1282b91-4764-4e64-8944-190949e88552 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-2017582897"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:09.996456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b1282b91-4764-4e64-8944-190949e88552 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:10.011845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1282b91-4764-4e64-8944-190949e88552 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:10.013338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1282b91-4764-4e64-8944-190949e88552 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:10.014048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1282b91-4764-4e64-8944-190949e88552 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:10.015352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1282b91-4764-4e64-8944-190949e88552 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:10.015990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1282b91-4764-4e64-8944-190949e88552 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:10.016600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1282b91-4764-4e64-8944-190949e88552 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:10.476015 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b1282b91-4764-4e64-8944-190949e88552 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.527673 Aug 23 18:02:10.481725 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1359/2723] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:02:09 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 23 18:02:10.511092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6ef02ae2-a408-4394-b863-646dd1a56327 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:10.513349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6ef02ae2-a408-4394-b863-646dd1a56327 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:10.538898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ef02ae2-a408-4394-b863-646dd1a56327 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:10.540995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ef02ae2-a408-4394-b863-646dd1a56327 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:10.541716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ef02ae2-a408-4394-b863-646dd1a56327 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:10.544163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ef02ae2-a408-4394-b863-646dd1a56327 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:10.545204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ef02ae2-a408-4394-b863-646dd1a56327 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:10.546090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ef02ae2-a408-4394-b863-646dd1a56327 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:10.584796 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e88e02f6-481e-4586-b4a1-1923589d352b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538" status: 202 len: 0 microversion: 2.1 time: 1.040900 Aug 23 18:02:10.586203 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1365/2724] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:02:09 2022] DELETE /compute/v2.1/os-security-groups/7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:02:10.595031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a389552-eae4-451c-9cb1-e1a88f6f7eef tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27dfa02700>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:10.691567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG neutronclient.v2_0.client [None req-6a389552-eae4-451c-9cb1-e1a88f6f7eef tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist", "detail": ""}} {{(pid=128808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:02:10.692220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.security_group_api [None req-6a389552-eae4-451c-9cb1-e1a88f6f7eef tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Neutron security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 not found {{(pid=128808) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:02:10.695120 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-6a389552-eae4-451c-9cb1-e1a88f6f7eef tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:02:10.695120 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-4744c365-9046-413b-b463-76a28d172776'] Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a389552-eae4-451c-9cb1-e1a88f6f7eef tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-security-groups/7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 HTTP/1.1 Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: exception: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-4744c365-9046-413b-b463-76a28d172776'] Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538'} Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:02:10.706101 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4744c365-9046-413b-b463-76a28d172776'] Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4744c365-9046-413b-b463-76a28d172776'] Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4744c365-9046-413b-b463-76a28d172776'] Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4744c365-9046-413b-b463-76a28d172776'] Aug 23 18:02:10.710451 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:10.714474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a389552-eae4-451c-9cb1-e1a88f6f7eef tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:02:10.714474 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-4744c365-9046-413b-b463-76a28d172776'] {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:02:10.715796 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6a389552-eae4-451c-9cb1-e1a88f6f7eef tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538" status: 404 len: 194 microversion: 2.1 time: 0.124336 Aug 23 18:02:10.721008 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1366/2725] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 18:02:10 2022] GET /compute/v2.1/os-security-groups/7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 => generated 194 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:02:10.744410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6383924d-7ba4-4441-8f7e-2b371d742975 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27dfa92a60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:10.914774 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6ef02ae2-a408-4394-b863-646dd1a56327 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.433712 Aug 23 18:02:10.915699 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1360/2726] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:02:10 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e/os-interface => generated 284 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:10.929651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2c26d1ec-c294-4ac5-bf6b-da2f529f9901 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:10.930820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2c26d1ec-c294-4ac5-bf6b-da2f529f9901 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:10.945755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c26d1ec-c294-4ac5-bf6b-da2f529f9901 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:10.946987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c26d1ec-c294-4ac5-bf6b-da2f529f9901 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:10.947442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c26d1ec-c294-4ac5-bf6b-da2f529f9901 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:10.948170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c26d1ec-c294-4ac5-bf6b-da2f529f9901 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:10.948629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c26d1ec-c294-4ac5-bf6b-da2f529f9901 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:10.953861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c26d1ec-c294-4ac5-bf6b-da2f529f9901 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:11.362609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2c26d1ec-c294-4ac5-bf6b-da2f529f9901 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:11.392993 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2c26d1ec-c294-4ac5-bf6b-da2f529f9901 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1270 microversion: 2.1 time: 0.473769 Aug 23 18:02:11.398352 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1361/2727] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:10 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1270 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:11.438658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49cc7e3e-fc70-4b10-98f0-c7172a55db61 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfcd7dc0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:11.537637 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49cc7e3e-fc70-4b10-98f0-c7172a55db61 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.134136 Aug 23 18:02:11.539431 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1362/2728] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:11 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:11.558316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f2a70dcf-98d5-4a57-9d74-06cc537d9e01 req-04eaa456-eff6-4a4c-9b65-4e2cdf250a47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d81bbbc-0ed1-445b-a321-b2175e975725", "name": "network-vif-unplugged", "status": "completed", "tag": "c9a2077a-21a0-4f0d-846d-bbb4743c4fa4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:11.615494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f2a70dcf-98d5-4a57-9d74-06cc537d9e01 req-04eaa456-eff6-4a4c-9b65-4e2cdf250a47 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:11.616115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f2a70dcf-98d5-4a57-9d74-06cc537d9e01 req-04eaa456-eff6-4a4c-9b65-4e2cdf250a47 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:11.616558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f2a70dcf-98d5-4a57-9d74-06cc537d9e01 req-04eaa456-eff6-4a4c-9b65-4e2cdf250a47 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:11.667449 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6383924d-7ba4-4441-8f7e-2b371d742975 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.923307 Aug 23 18:02:11.667449 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1367/2729] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Aug 23 18:02:10 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:11.672104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9ffb92a-0182-4f14-99f9-bc85a8e58274 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'create', calling method: .version_select at 0x7f27dfa5bd30>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1941188730", "description": "tempest-description-1283713426"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:11.672787 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f2a70dcf-98d5-4a57-9d74-06cc537d9e01 req-04eaa456-eff6-4a4c-9b65-4e2cdf250a47 service nova] Creating event network-vif-unplugged:c9a2077a-21a0-4f0d-846d-bbb4743c4fa4 for instance 9d81bbbc-0ed1-445b-a321-b2175e975725 on n-h1-850468-16 Aug 23 18:02:11.709952 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f2a70dcf-98d5-4a57-9d74-06cc537d9e01 req-04eaa456-eff6-4a4c-9b65-4e2cdf250a47 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.161380 Aug 23 18:02:11.714583 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1363/2730] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:12.418186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2840bf7e-672f-42ad-a33d-fe59a50eecf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:12.418915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2840bf7e-672f-42ad-a33d-fe59a50eecf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:12.440055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2840bf7e-672f-42ad-a33d-fe59a50eecf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:12.443464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2840bf7e-672f-42ad-a33d-fe59a50eecf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:12.444310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2840bf7e-672f-42ad-a33d-fe59a50eecf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:12.448295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2840bf7e-672f-42ad-a33d-fe59a50eecf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:12.448769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2840bf7e-672f-42ad-a33d-fe59a50eecf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:12.452324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2840bf7e-672f-42ad-a33d-fe59a50eecf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:12.529549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:12.849407 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b9ffb92a-0182-4f14-99f9-bc85a8e58274 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 1.181838 Aug 23 18:02:12.851575 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1368/2731] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:02:11 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:02:12.856801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-39fdd119-bb7e-4dc9-8172-3458fe913125 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec05fdc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:12.932387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2840bf7e-672f-42ad-a33d-fe59a50eecf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:12.949069 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2840bf7e-672f-42ad-a33d-fe59a50eecf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1276 microversion: 2.1 time: 0.535109 Aug 23 18:02:12.967176 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-39fdd119-bb7e-4dc9-8172-3458fe913125 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.114204 Aug 23 18:02:12.967739 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1364/2732] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:12 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1276 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:12.968552 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1369/2733] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:12 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:12.980100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-75a9afbc-9363-458f-b663-ee6e429d52af tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'create', calling method: .version_select at 0x7f27dfca7af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1351673955", "description": "tempest-description-645520515"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:13.971909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1272a5ce-c4dc-4adf-8695-e42efabffc7b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:13.972688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1272a5ce-c4dc-4adf-8695-e42efabffc7b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:13.991925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1272a5ce-c4dc-4adf-8695-e42efabffc7b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:13.992814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1272a5ce-c4dc-4adf-8695-e42efabffc7b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:13.993441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1272a5ce-c4dc-4adf-8695-e42efabffc7b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:13.994526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1272a5ce-c4dc-4adf-8695-e42efabffc7b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:13.995329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1272a5ce-c4dc-4adf-8695-e42efabffc7b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:13.996426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1272a5ce-c4dc-4adf-8695-e42efabffc7b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:14.010068 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-75a9afbc-9363-458f-b663-ee6e429d52af tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 1.033817 Aug 23 18:02:14.011245 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1365/2734] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:02:12 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:14.015956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1a58e8f9-4934-4fd7-8b0b-4ae3548e4c30 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfc76700>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:14.132517 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1a58e8f9-4934-4fd7-8b0b-4ae3548e4c30 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.119811 Aug 23 18:02:14.134297 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1366/2735] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:14 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:14.295429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1638018873", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "8328d7a4-3299-4bee-8d7d-1c2326f33fb2"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:14.348399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1272a5ce-c4dc-4adf-8695-e42efabffc7b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:14.369041 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1272a5ce-c4dc-4adf-8695-e42efabffc7b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1276 microversion: 2.1 time: 0.401404 Aug 23 18:02:14.373881 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1370/2736] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:13 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1276 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:14.415719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] validate_networks() for [('8328d7a4-3299-4bee-8d7d-1c2326f33fb2', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:02:15.154428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b9f953d-c07c-4a22-be2d-e7186ad63409 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfa5b310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:15.287633 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b9f953d-c07c-4a22-be2d-e7186ad63409 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.138326 Aug 23 18:02:15.288906 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1371/2737] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:15 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:15.401040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f655ee4f-6122-4208-b42f-5c9dcf9e9321 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:15.404795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f655ee4f-6122-4208-b42f-5c9dcf9e9321 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:15.443537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f655ee4f-6122-4208-b42f-5c9dcf9e9321 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:15.444102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f655ee4f-6122-4208-b42f-5c9dcf9e9321 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:15.444871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f655ee4f-6122-4208-b42f-5c9dcf9e9321 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:15.447174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f655ee4f-6122-4208-b42f-5c9dcf9e9321 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:15.448050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f655ee4f-6122-4208-b42f-5c9dcf9e9321 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:15.448829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f655ee4f-6122-4208-b42f-5c9dcf9e9321 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:15.644603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f655ee4f-6122-4208-b42f-5c9dcf9e9321 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:15.653085 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f655ee4f-6122-4208-b42f-5c9dcf9e9321 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1276 microversion: 2.1 time: 0.262806 Aug 23 18:02:15.666903 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1372/2738] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:15 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1276 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:15.672191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-08ee9cf9-a445-4b43-bb40-0989a44d52c8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:15.676998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-08ee9cf9-a445-4b43-bb40-0989a44d52c8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:15.691443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08ee9cf9-a445-4b43-bb40-0989a44d52c8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:15.692175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08ee9cf9-a445-4b43-bb40-0989a44d52c8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:15.692957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08ee9cf9-a445-4b43-bb40-0989a44d52c8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:15.696481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08ee9cf9-a445-4b43-bb40-0989a44d52c8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:15.697122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08ee9cf9-a445-4b43-bb40-0989a44d52c8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:15.697736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08ee9cf9-a445-4b43-bb40-0989a44d52c8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:16.312684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-08ee9cf9-a445-4b43-bb40-0989a44d52c8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:16.330668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-08ee9cf9-a445-4b43-bb40-0989a44d52c8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1588 microversion: 2.1 time: 0.658560 Aug 23 18:02:16.335154 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1373/2739] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:15 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1588 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:16.353886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5489a34c-67d3-4733-af7c-0a243ab4fa5b req-28eeff57-6418-4c0f-a791-e1b81c7dc2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "311dc663-0ec5-4c69-8684-8404750c745e", "tag": "971907ed-8899-4e44-b7e5-cddccbc9dc07"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:16.357500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:02:16.358005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:02:16.358386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:02:16.358936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:02:16.360190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:02:16.396176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:16.397373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:16.398925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:16.399943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:16.401314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:16.402417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5489a34c-67d3-4733-af7c-0a243ab4fa5b req-28eeff57-6418-4c0f-a791-e1b81c7dc2c1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:16.403455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:16.405795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5489a34c-67d3-4733-af7c-0a243ab4fa5b req-28eeff57-6418-4c0f-a791-e1b81c7dc2c1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:16.409291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5489a34c-67d3-4733-af7c-0a243ab4fa5b req-28eeff57-6418-4c0f-a791-e1b81c7dc2c1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:16.436380 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5489a34c-67d3-4733-af7c-0a243ab4fa5b req-28eeff57-6418-4c0f-a791-e1b81c7dc2c1 service nova] Creating event network-changed:971907ed-8899-4e44-b7e5-cddccbc9dc07 for instance 311dc663-0ec5-4c69-8684-8404750c745e on n-h1-850468-16 Aug 23 18:02:16.444307 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5489a34c-67d3-4733-af7c-0a243ab4fa5b req-28eeff57-6418-4c0f-a791-e1b81c7dc2c1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107522 Aug 23 18:02:16.445954 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1374/2740] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:16.453221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-305adfbf-bcae-46ea-b385-7565bc36beb4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec75aca0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:16.491540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Getting quotas for project 10967ccfae5f43258e54fef325e5a0b2. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:16.508212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Getting quotas for user db5f64cd07c1440f9b484294ef350aa8 and project 10967ccfae5f43258e54fef325e5a0b2. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:16.549776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:02:16.555523 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-305adfbf-bcae-46ea-b385-7565bc36beb4 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.107191 Aug 23 18:02:16.556347 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1375/2741] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:16 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:16.560297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:02:16.681912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b3a4b1cd-652b-4e30-b556-38871d2bb0c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:16.689429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b3a4b1cd-652b-4e30-b556-38871d2bb0c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:16.689872 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-78c61be1-7fd3-4a96-a54c-0e1560dda948 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.394611 Aug 23 18:02:16.691260 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1367/2742] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:02:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:02:16.701983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-94de11f4-d6c8-45f7-87f4-ae43d89b7eaf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:16.707204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-94de11f4-d6c8-45f7-87f4-ae43d89b7eaf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:16.711475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3a4b1cd-652b-4e30-b556-38871d2bb0c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:16.714524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3a4b1cd-652b-4e30-b556-38871d2bb0c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:16.717391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3a4b1cd-652b-4e30-b556-38871d2bb0c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:16.720875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3a4b1cd-652b-4e30-b556-38871d2bb0c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:16.722856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3a4b1cd-652b-4e30-b556-38871d2bb0c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:16.724924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3a4b1cd-652b-4e30-b556-38871d2bb0c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:17.103089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-94de11f4-d6c8-45f7-87f4-ae43d89b7eaf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:17.138034 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-94de11f4-d6c8-45f7-87f4-ae43d89b7eaf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1216 microversion: 2.1 time: 0.437833 Aug 23 18:02:17.140732 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1368/2743] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:16 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1216 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:17.181028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:17.582261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e13e56f5-ee8d-470e-9072-f4811d29d23e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfc760d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:17.641475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b3a4b1cd-652b-4e30-b556-38871d2bb0c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:17.651327 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b3a4b1cd-652b-4e30-b556-38871d2bb0c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1318 microversion: 2.1 time: 0.973524 Aug 23 18:02:17.665188 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1376/2744] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:16 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1318 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:17.704231 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e13e56f5-ee8d-470e-9072-f4811d29d23e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1413 microversion: 2.1 time: 0.137044 Aug 23 18:02:17.714765 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1369/2745] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:17 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1413 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:18.166040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ffdce5ff-5a9c-460e-a169-3bc728e3c7d3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:18.168223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ffdce5ff-5a9c-460e-a169-3bc728e3c7d3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:18.171470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=22 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:18.178454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffdce5ff-5a9c-460e-a169-3bc728e3c7d3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:18.184785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffdce5ff-5a9c-460e-a169-3bc728e3c7d3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:18.185486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffdce5ff-5a9c-460e-a169-3bc728e3c7d3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:18.186437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffdce5ff-5a9c-460e-a169-3bc728e3c7d3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:18.191383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffdce5ff-5a9c-460e-a169-3bc728e3c7d3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:18.192458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffdce5ff-5a9c-460e-a169-3bc728e3c7d3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:18.433881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ffdce5ff-5a9c-460e-a169-3bc728e3c7d3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:18.443632 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ffdce5ff-5a9c-460e-a169-3bc728e3c7d3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1220 microversion: 2.1 time: 0.281480 Aug 23 18:02:18.444235 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1377/2746] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:18 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1220 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:18.674517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-24ec8ad5-030a-474b-bc01-27ca6f456edc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:18.675291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-24ec8ad5-030a-474b-bc01-27ca6f456edc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:18.677735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=5 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:18.683527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24ec8ad5-030a-474b-bc01-27ca6f456edc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:18.684349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24ec8ad5-030a-474b-bc01-27ca6f456edc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:18.685019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24ec8ad5-030a-474b-bc01-27ca6f456edc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:18.685996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24ec8ad5-030a-474b-bc01-27ca6f456edc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:18.686715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24ec8ad5-030a-474b-bc01-27ca6f456edc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:18.687371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24ec8ad5-030a-474b-bc01-27ca6f456edc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:18.722522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fd7c4660-d4fa-4ec8-a49e-2a8f0ead34a8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfa821f0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:18.803531 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fd7c4660-d4fa-4ec8-a49e-2a8f0ead34a8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1422 microversion: 2.1 time: 0.086153 Aug 23 18:02:18.813542 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1378/2747] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:18 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1422 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:02:18.820443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-66eaadfa-b6a3-42b2-8c96-5cc2fa803b1f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec024ee0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:18.886457 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-66eaadfa-b6a3-42b2-8c96-5cc2fa803b1f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 200 len: 1422 microversion: 2.1 time: 0.070862 Aug 23 18:02:18.896029 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1379/2748] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:18 2022] GET /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 1422 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:18.918209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-65025fd8-348e-4814-8e92-a073f2b71e16 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfa828b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:19.315192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-24ec8ad5-030a-474b-bc01-27ca6f456edc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:19.326229 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-24ec8ad5-030a-474b-bc01-27ca6f456edc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1318 microversion: 2.1 time: 0.657093 Aug 23 18:02:19.330082 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1370/2749] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:18 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1318 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:19.467206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ac6773f6-7d4e-4555-bf87-8d2ab513fcee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:19.467835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ac6773f6-7d4e-4555-bf87-8d2ab513fcee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:19.477760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac6773f6-7d4e-4555-bf87-8d2ab513fcee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:19.478274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac6773f6-7d4e-4555-bf87-8d2ab513fcee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:19.478754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac6773f6-7d4e-4555-bf87-8d2ab513fcee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:19.481751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac6773f6-7d4e-4555-bf87-8d2ab513fcee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:19.482276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac6773f6-7d4e-4555-bf87-8d2ab513fcee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:19.486422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac6773f6-7d4e-4555-bf87-8d2ab513fcee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:20.107512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ac6773f6-7d4e-4555-bf87-8d2ab513fcee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:20.123452 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ac6773f6-7d4e-4555-bf87-8d2ab513fcee tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1276 microversion: 2.1 time: 0.656824 Aug 23 18:02:20.124619 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1371/2750] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:19 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1276 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:20.244614 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-65025fd8-348e-4814-8e92-a073f2b71e16 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 204 len: 0 microversion: 2.1 time: 1.346366 Aug 23 18:02:20.252464 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1380/2751] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:18 2022] DELETE /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 0 bytes in 1349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:02:20.256973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf0ec885-c327-4985-8c42-461dea7cd5e7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:20.257479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bf0ec885-c327-4985-8c42-461dea7cd5e7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:20.274255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf0ec885-c327-4985-8c42-461dea7cd5e7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:20.278977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf0ec885-c327-4985-8c42-461dea7cd5e7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:20.279554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf0ec885-c327-4985-8c42-461dea7cd5e7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:20.280326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf0ec885-c327-4985-8c42-461dea7cd5e7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:20.280873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf0ec885-c327-4985-8c42-461dea7cd5e7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:20.300850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf0ec885-c327-4985-8c42-461dea7cd5e7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:20.356004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc8f6f20-b9b6-4c8f-a3f1-8b00d148dbf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:20.356821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc8f6f20-b9b6-4c8f-a3f1-8b00d148dbf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:20.388265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc8f6f20-b9b6-4c8f-a3f1-8b00d148dbf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:20.393993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc8f6f20-b9b6-4c8f-a3f1-8b00d148dbf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:20.394900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc8f6f20-b9b6-4c8f-a3f1-8b00d148dbf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:20.396015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc8f6f20-b9b6-4c8f-a3f1-8b00d148dbf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:20.396533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bf0ec885-c327-4985-8c42-461dea7cd5e7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:02:20.396838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc8f6f20-b9b6-4c8f-a3f1-8b00d148dbf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:20.398722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc8f6f20-b9b6-4c8f-a3f1-8b00d148dbf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:20.626426 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bf0ec885-c327-4985-8c42-461dea7cd5e7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 204 len: 0 microversion: 2.1 time: 0.372435 Aug 23 18:02:20.626426 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1372/2752] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:02:20 2022] DELETE /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:02:20.647713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ea53848b-acf6-4278-bdf7-b6f6765daa17 req-38d05450-bee5-4381-9871-3659edc7b2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d81bbbc-0ed1-445b-a321-b2175e975725", "name": "network-vif-plugged", "status": "completed", "tag": "c9a2077a-21a0-4f0d-846d-bbb4743c4fa4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:20.668344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ea53848b-acf6-4278-bdf7-b6f6765daa17 req-38d05450-bee5-4381-9871-3659edc7b2a2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:20.668839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ea53848b-acf6-4278-bdf7-b6f6765daa17 req-38d05450-bee5-4381-9871-3659edc7b2a2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:20.669277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ea53848b-acf6-4278-bdf7-b6f6765daa17 req-38d05450-bee5-4381-9871-3659edc7b2a2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:20.698068 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ea53848b-acf6-4278-bdf7-b6f6765daa17 req-38d05450-bee5-4381-9871-3659edc7b2a2 service nova] Creating event network-vif-plugged:c9a2077a-21a0-4f0d-846d-bbb4743c4fa4 for instance 9d81bbbc-0ed1-445b-a321-b2175e975725 on n-h1-850468-16 Aug 23 18:02:20.708950 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ea53848b-acf6-4278-bdf7-b6f6765daa17 req-38d05450-bee5-4381-9871-3659edc7b2a2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071995 Aug 23 18:02:20.715867 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1373/2753] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:20.856146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-782065266", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "bd6bcc31-356e-406f-85ed-9a6dbf64ea38"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:20.965761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] validate_networks() for [('bd6bcc31-356e-406f-85ed-9a6dbf64ea38', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:02:21.158437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc8f6f20-b9b6-4c8f-a3f1-8b00d148dbf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:21.174411 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc8f6f20-b9b6-4c8f-a3f1-8b00d148dbf0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1318 microversion: 2.1 time: 0.829276 Aug 23 18:02:21.174411 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1381/2754] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:20 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1318 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:21.186736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-14c5e1e2-5fb9-47b3-b496-59a710a620f4 req-f332fc7b-efb9-418a-81d2-b5abc1f7b740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1adfb52-d290-451a-89bf-4d63824150c5", "tag": "877ab05b-84d2-46a6-a689-4dfd4bb855ca"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:21.246616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-14c5e1e2-5fb9-47b3-b496-59a710a620f4 req-f332fc7b-efb9-418a-81d2-b5abc1f7b740 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:21.257589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-14c5e1e2-5fb9-47b3-b496-59a710a620f4 req-f332fc7b-efb9-418a-81d2-b5abc1f7b740 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:21.263928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-14c5e1e2-5fb9-47b3-b496-59a710a620f4 req-f332fc7b-efb9-418a-81d2-b5abc1f7b740 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:21.365009 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-14c5e1e2-5fb9-47b3-b496-59a710a620f4 req-f332fc7b-efb9-418a-81d2-b5abc1f7b740 service nova] Creating event network-changed:877ab05b-84d2-46a6-a689-4dfd4bb855ca for instance e1adfb52-d290-451a-89bf-4d63824150c5 on n-h2-850468-16 Aug 23 18:02:21.382405 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-14c5e1e2-5fb9-47b3-b496-59a710a620f4 req-f332fc7b-efb9-418a-81d2-b5abc1f7b740 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.203398 Aug 23 18:02:21.384611 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1382/2755] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:21.401691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-35817de3-f5ca-4573-bf9d-753d4f6c31e9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:21.403357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-35817de3-f5ca-4573-bf9d-753d4f6c31e9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:21.424845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35817de3-f5ca-4573-bf9d-753d4f6c31e9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:21.428298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35817de3-f5ca-4573-bf9d-753d4f6c31e9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:21.429048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35817de3-f5ca-4573-bf9d-753d4f6c31e9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:21.431439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35817de3-f5ca-4573-bf9d-753d4f6c31e9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:21.433462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35817de3-f5ca-4573-bf9d-753d4f6c31e9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:21.436097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35817de3-f5ca-4573-bf9d-753d4f6c31e9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:21.651116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-35817de3-f5ca-4573-bf9d-753d4f6c31e9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:21.676899 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-35817de3-f5ca-4573-bf9d-753d4f6c31e9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1274 microversion: 2.1 time: 0.286484 Aug 23 18:02:21.677652 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1383/2756] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:21 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1274 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:22.469148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e73e3a8a-aa68-419d-b3a0-4f5756d19564 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Calling method '.version_select at 0x7f27ec080d30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:22.602928 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e73e3a8a-aa68-419d-b3a0-4f5756d19564 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7" status: 200 len: 371 microversion: 2.1 time: 0.576066 Aug 23 18:02:22.603516 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1384/2757] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Aug 23 18:02:22 2022] GET /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7 => generated 371 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:22.615858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-daa93594-e606-4944-9002-f1bde1bad606 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:22.616794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-daa93594-e606-4944-9002-f1bde1bad606 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:22.629655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daa93594-e606-4944-9002-f1bde1bad606 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:22.635716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daa93594-e606-4944-9002-f1bde1bad606 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:22.636573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daa93594-e606-4944-9002-f1bde1bad606 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:22.637505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daa93594-e606-4944-9002-f1bde1bad606 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:22.638112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daa93594-e606-4944-9002-f1bde1bad606 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:22.641268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daa93594-e606-4944-9002-f1bde1bad606 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:23.074874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-daa93594-e606-4944-9002-f1bde1bad606 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:23.086479 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-daa93594-e606-4944-9002-f1bde1bad606 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1318 microversion: 2.1 time: 0.480898 Aug 23 18:02:23.092288 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1385/2758] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:22 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1318 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:23.108052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-505d2f5e-8f56-40b9-89ae-0728a26ee8f7 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec7f59d0>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:23.291585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-505d2f5e-8f56-40b9-89ae-0728a26ee8f7 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:23.294356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-505d2f5e-8f56-40b9-89ae-0728a26ee8f7 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:23.294971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-505d2f5e-8f56-40b9-89ae-0728a26ee8f7 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:23.297875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-505d2f5e-8f56-40b9-89ae-0728a26ee8f7 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:23.300330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-505d2f5e-8f56-40b9-89ae-0728a26ee8f7 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:23.300787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-505d2f5e-8f56-40b9-89ae-0728a26ee8f7 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:23.475134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:23.477544 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-505d2f5e-8f56-40b9-89ae-0728a26ee8f7 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7" status: 200 len: 328 microversion: 2.1 time: 0.384025 Aug 23 18:02:23.481963 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1386/2759] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 18:02:23 2022] PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7 => generated 328 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:23.491139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c147f5d0-00e2-4b2c-9e80-8dd4033ff64b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:23.493262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c147f5d0-00e2-4b2c-9e80-8dd4033ff64b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:23.507757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c147f5d0-00e2-4b2c-9e80-8dd4033ff64b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:23.508441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c147f5d0-00e2-4b2c-9e80-8dd4033ff64b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:23.509008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c147f5d0-00e2-4b2c-9e80-8dd4033ff64b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:23.510056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c147f5d0-00e2-4b2c-9e80-8dd4033ff64b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:23.510896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c147f5d0-00e2-4b2c-9e80-8dd4033ff64b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:23.511445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c147f5d0-00e2-4b2c-9e80-8dd4033ff64b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:23.947760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c147f5d0-00e2-4b2c-9e80-8dd4033ff64b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:23.967966 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c147f5d0-00e2-4b2c-9e80-8dd4033ff64b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1316 microversion: 2.1 time: 0.484702 Aug 23 18:02:23.975018 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1387/2760] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:23 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1316 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:23.981985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-46f09eae-f845-4b41-ae2e-2b8514c767c2 req-c799c6a3-bae3-4c9c-8925-c13ce0e06d16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dda3e215-afdf-4d78-bd76-d27e7491c589", "tag": "94e5ded1-138f-4678-b2ef-0b8a6f4c59ca"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:23.995033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-46f09eae-f845-4b41-ae2e-2b8514c767c2 req-c799c6a3-bae3-4c9c-8925-c13ce0e06d16 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:23.996089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-46f09eae-f845-4b41-ae2e-2b8514c767c2 req-c799c6a3-bae3-4c9c-8925-c13ce0e06d16 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:23.997688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-46f09eae-f845-4b41-ae2e-2b8514c767c2 req-c799c6a3-bae3-4c9c-8925-c13ce0e06d16 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:24.029282 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-46f09eae-f845-4b41-ae2e-2b8514c767c2 req-c799c6a3-bae3-4c9c-8925-c13ce0e06d16 service nova] Creating event network-changed:94e5ded1-138f-4678-b2ef-0b8a6f4c59ca for instance dda3e215-afdf-4d78-bd76-d27e7491c589 on n-h2-850468-16 Aug 23 18:02:24.037112 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-46f09eae-f845-4b41-ae2e-2b8514c767c2 req-c799c6a3-bae3-4c9c-8925-c13ce0e06d16 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059513 Aug 23 18:02:24.038317 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1388/2761] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:24.137870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2042547961", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:24.239558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:02:24.591861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:02:24.593889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:02:24.594697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:02:24.595571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:02:24.596379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:02:24.627244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:24.627859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:24.631960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:24.656539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:24.657218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:24.658212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:24.724480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Getting quotas for project 0c1067637ced47dab01d19a65bfc3dd7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:24.740618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Getting quotas for user 78a1cc2772e846e0ac3ca0324ab3cee3 and project 0c1067637ced47dab01d19a65bfc3dd7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:24.790958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:02:24.793564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:02:24.931514 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d36fda62-93f2-4143-ac50-b855e79b622c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.079760 Aug 23 18:02:24.945086 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1374/2762] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:02:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 4095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:02:24.999048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-263ad692-47c5-4a0f-83f9-7e24d1affd65 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:25.002459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-263ad692-47c5-4a0f-83f9-7e24d1affd65 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:25.059805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-263ad692-47c5-4a0f-83f9-7e24d1affd65 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:25.060343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-263ad692-47c5-4a0f-83f9-7e24d1affd65 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:25.061049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-263ad692-47c5-4a0f-83f9-7e24d1affd65 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:25.064938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-263ad692-47c5-4a0f-83f9-7e24d1affd65 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:25.067958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-263ad692-47c5-4a0f-83f9-7e24d1affd65 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:25.068836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-263ad692-47c5-4a0f-83f9-7e24d1affd65 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:25.429240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:02:25.434126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:02:25.447836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:02:25.448415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:02:25.448847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:02:25.468946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:25.470140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:25.471093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:25.472126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:25.473044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:25.473767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:25.504631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Getting quotas for project 2560a3899cef4bb4914d26ef6c5ccac7. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:25.512864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Getting quotas for user 707f421c56754147809eb7382a1872b2 and project 2560a3899cef4bb4914d26ef6c5ccac7. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:25.552372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.utils [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] cores quota exceeded for 2560a3899cef4bb4914d26ef6c5ccac7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128808) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 23 18:02:25.553666 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Request method failure captured: Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 145 Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRYsxIkA8Sawlv3aIr_hZFNmjh9zUtGAZxGHexVOGdB82C8D_pT3vOHgVnuTtG0grnDFd9ePewO6bKkq1Of-T3S-U6vXj4XY2PaZprTiKlVN3fWv0QxvsyoH-fZaBwYIvUV7pt3FNiirfTm7T2AsJBm2XLdpHz22eFirfyN-XFf3qQg Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2560a3899cef4bb4914d26ef6c5ccac7 Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-QuotasAdminNegativeTest-1232737843 Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2560a3899cef4bb4914d26ef6c5ccac7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2560a3899cef4bb4914d26ef6c5ccac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2560a3899cef4bb4914d26ef6c5ccac7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2560a3899cef4bb4914d26ef6c5ccac7"}]}] Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-QuotasAdminNegativeTest-1232737843 Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2560a3899cef4bb4914d26ef6c5ccac7 Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1232737843 Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-QuotasAdminNegativeTest-1232737843-project Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 707f421c56754147809eb7382a1872b2 Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-QuotasAdminNegativeTest-1232737843-project Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2042547961", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2042547961', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452'}}} Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 18:02:25.564934 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Aug 23 18:02:25.569903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:25.574450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:02:25.575723 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-69d55cc6-dcc8-4fad-8ed5-75f63902fb8b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.535804 Aug 23 18:02:25.576816 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1389/2763] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:02:24 2022] POST /compute/v2.1/servers => generated 111 bytes in 1538 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:02:25.581978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-286c8289-02da-4e31-be41-81ee80a87fc2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:25.583696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-286c8289-02da-4e31-be41-81ee80a87fc2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:25.773170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-286c8289-02da-4e31-be41-81ee80a87fc2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:25.786591 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-286c8289-02da-4e31-be41-81ee80a87fc2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1207 microversion: 2.1 time: 0.208486 Aug 23 18:02:25.795345 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1390/2764] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:25 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1207 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:25.827462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e61d4037-b281-4bed-8f74-dfbe2dc64243 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:25.828085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e61d4037-b281-4bed-8f74-dfbe2dc64243 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:25.864204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e61d4037-b281-4bed-8f74-dfbe2dc64243 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:25.864800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e61d4037-b281-4bed-8f74-dfbe2dc64243 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:25.865264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e61d4037-b281-4bed-8f74-dfbe2dc64243 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:25.866028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e61d4037-b281-4bed-8f74-dfbe2dc64243 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:25.866490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e61d4037-b281-4bed-8f74-dfbe2dc64243 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:25.867030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e61d4037-b281-4bed-8f74-dfbe2dc64243 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:25.871629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-263ad692-47c5-4a0f-83f9-7e24d1affd65 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:25.885748 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-263ad692-47c5-4a0f-83f9-7e24d1affd65 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1318 microversion: 2.1 time: 0.937576 Aug 23 18:02:25.903607 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1375/2765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:24 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1318 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:25.908961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-815c868a-aeec-408a-81cc-39068cb10347 req-9b128df1-3e48-455e-9502-36f554b5d50c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264db24e-173d-46bb-8f6c-8a86eee0a70c", "tag": "ef77fd36-df98-4b26-8ab3-e446ba4d3c6d"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:25.934337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-815c868a-aeec-408a-81cc-39068cb10347 req-9b128df1-3e48-455e-9502-36f554b5d50c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:25.935117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-815c868a-aeec-408a-81cc-39068cb10347 req-9b128df1-3e48-455e-9502-36f554b5d50c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:25.937956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-815c868a-aeec-408a-81cc-39068cb10347 req-9b128df1-3e48-455e-9502-36f554b5d50c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:26.477407 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-815c868a-aeec-408a-81cc-39068cb10347 req-9b128df1-3e48-455e-9502-36f554b5d50c service nova] Creating event network-changed:ef77fd36-df98-4b26-8ab3-e446ba4d3c6d for instance 264db24e-173d-46bb-8f6c-8a86eee0a70c on n-h1-850468-16 Aug 23 18:02:26.491029 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-815c868a-aeec-408a-81cc-39068cb10347 req-9b128df1-3e48-455e-9502-36f554b5d50c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.585721 Aug 23 18:02:26.492206 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1376/2766] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:26.504550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49715143-3501-43e8-86d5-a3b6b868f001 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Action: 'update', calling method: .version_select at 0x7f27dfc3b280>, body: {"quota_set": {"cores": 20}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:26.697421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49715143-3501-43e8-86d5-a3b6b868f001 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:26.697999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49715143-3501-43e8-86d5-a3b6b868f001 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:26.698507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49715143-3501-43e8-86d5-a3b6b868f001 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:26.699375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49715143-3501-43e8-86d5-a3b6b868f001 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:26.700018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49715143-3501-43e8-86d5-a3b6b868f001 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:26.700634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49715143-3501-43e8-86d5-a3b6b868f001 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:26.752648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e61d4037-b281-4bed-8f74-dfbe2dc64243 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:26.772223 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e61d4037-b281-4bed-8f74-dfbe2dc64243 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1316 microversion: 2.1 time: 0.952016 Aug 23 18:02:26.774329 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1391/2767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:25 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1316 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:26.789874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-ee519be0-240e-4cb4-88aa-3345cdb4022a req-c9da2280-a9c8-4bcc-97b4-2aa0b165d29a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2", "name": "network-vif-deleted", "tag": "6d753232-30bd-45f2-b47d-0a1c92879f78"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:26.818265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ee519be0-240e-4cb4-88aa-3345cdb4022a req-c9da2280-a9c8-4bcc-97b4-2aa0b165d29a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:26.823663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ee519be0-240e-4cb4-88aa-3345cdb4022a req-c9da2280-a9c8-4bcc-97b4-2aa0b165d29a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:26.824411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ee519be0-240e-4cb4-88aa-3345cdb4022a req-c9da2280-a9c8-4bcc-97b4-2aa0b165d29a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:26.847389 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-ee519be0-240e-4cb4-88aa-3345cdb4022a req-c9da2280-a9c8-4bcc-97b4-2aa0b165d29a service nova] Creating event network-vif-deleted:6d753232-30bd-45f2-b47d-0a1c92879f78 for instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 on n-h1-850468-16 Aug 23 18:02:26.857221 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49715143-3501-43e8-86d5-a3b6b868f001 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7" status: 200 len: 329 microversion: 2.1 time: 0.359415 Aug 23 18:02:26.858531 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1377/2768] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 18:02:26 2022] PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7 => generated 329 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:26.864620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3ab8caa4-a9e4-4c33-b1a6-0407e169f5cb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:26.871427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3ab8caa4-a9e4-4c33-b1a6-0407e169f5cb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:26.878212 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-ee519be0-240e-4cb4-88aa-3345cdb4022a req-c9da2280-a9c8-4bcc-97b4-2aa0b165d29a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097793 Aug 23 18:02:26.879246 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1392/2769] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:26.887011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ab8caa4-a9e4-4c33-b1a6-0407e169f5cb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:26.889569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ab8caa4-a9e4-4c33-b1a6-0407e169f5cb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:26.890171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ab8caa4-a9e4-4c33-b1a6-0407e169f5cb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:26.892657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bdc97955-e509-4172-a2af-cecc739e0336 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Calling method '.version_select at 0x7f27dfa4de50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:26.892841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ab8caa4-a9e4-4c33-b1a6-0407e169f5cb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:26.893216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ab8caa4-a9e4-4c33-b1a6-0407e169f5cb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:26.894976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ab8caa4-a9e4-4c33-b1a6-0407e169f5cb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:27.030049 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bdc97955-e509-4172-a2af-cecc739e0336 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7" status: 200 len: 371 microversion: 2.1 time: 0.145016 Aug 23 18:02:27.030990 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1393/2770] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Aug 23 18:02:26 2022] GET /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7 => generated 371 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:27.042768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f11a9f43-27bb-4f92-a939-e496418674ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:27.043771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f11a9f43-27bb-4f92-a939-e496418674ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:27.068674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f11a9f43-27bb-4f92-a939-e496418674ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:27.069519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f11a9f43-27bb-4f92-a939-e496418674ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:27.070181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f11a9f43-27bb-4f92-a939-e496418674ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:27.071115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f11a9f43-27bb-4f92-a939-e496418674ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:27.071862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f11a9f43-27bb-4f92-a939-e496418674ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:27.072477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f11a9f43-27bb-4f92-a939-e496418674ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:27.122026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3ab8caa4-a9e4-4c33-b1a6-0407e169f5cb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:27.145864 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3ab8caa4-a9e4-4c33-b1a6-0407e169f5cb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1259 microversion: 2.1 time: 0.273304 Aug 23 18:02:27.155512 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1378/2771] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:26 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1259 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:27.171824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bb2060c8-dbab-468b-a6f9-a28a4c0f5e5e tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Action: 'update', calling method: .version_select at 0x7f27f1af4430>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:27.291987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb2060c8-dbab-468b-a6f9-a28a4c0f5e5e tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:27.293565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb2060c8-dbab-468b-a6f9-a28a4c0f5e5e tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:27.296249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb2060c8-dbab-468b-a6f9-a28a4c0f5e5e tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:27.297272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb2060c8-dbab-468b-a6f9-a28a4c0f5e5e tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:27.302026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb2060c8-dbab-468b-a6f9-a28a4c0f5e5e tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:27.303527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb2060c8-dbab-468b-a6f9-a28a4c0f5e5e tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:27.448450 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bb2060c8-dbab-468b-a6f9-a28a4c0f5e5e tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7" status: 200 len: 328 microversion: 2.1 time: 0.291686 Aug 23 18:02:27.449964 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1379/2772] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 18:02:27 2022] PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7 => generated 328 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:27.536074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-195858927", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:27.664135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:02:27.872930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f11a9f43-27bb-4f92-a939-e496418674ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:27.886066 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f11a9f43-27bb-4f92-a939-e496418674ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1318 microversion: 2.1 time: 0.853822 Aug 23 18:02:27.888003 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1394/2773] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:27 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1318 bytes in 856 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:27.903683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-15a4beb1-2538-4d98-848a-87fbcc4653d4 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:27.904553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-15a4beb1-2538-4d98-848a-87fbcc4653d4 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:27.915811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15a4beb1-2538-4d98-848a-87fbcc4653d4 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:27.918290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15a4beb1-2538-4d98-848a-87fbcc4653d4 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:27.920037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15a4beb1-2538-4d98-848a-87fbcc4653d4 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:27.920942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15a4beb1-2538-4d98-848a-87fbcc4653d4 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:27.922564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15a4beb1-2538-4d98-848a-87fbcc4653d4 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:27.924086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15a4beb1-2538-4d98-848a-87fbcc4653d4 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:28.197340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-15a4beb1-2538-4d98-848a-87fbcc4653d4 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:28.209617 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-15a4beb1-2538-4d98-848a-87fbcc4653d4 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1316 microversion: 2.1 time: 0.318598 Aug 23 18:02:28.225519 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1395/2774] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:27 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:28.231552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d478778a-d0bd-4583-acac-f913986ad07b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:28.232246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d478778a-d0bd-4583-acac-f913986ad07b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:28.239800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d478778a-d0bd-4583-acac-f913986ad07b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:28.240513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d478778a-d0bd-4583-acac-f913986ad07b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:28.241032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d478778a-d0bd-4583-acac-f913986ad07b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:28.241846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d478778a-d0bd-4583-acac-f913986ad07b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:28.242384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d478778a-d0bd-4583-acac-f913986ad07b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:28.242941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d478778a-d0bd-4583-acac-f913986ad07b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:28.286005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:02:28.286497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:02:28.287135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:02:28.287600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:02:28.288032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:02:28.298705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:28.299206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:28.299655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:28.300411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:28.300877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:28.301491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:28.332972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Getting quotas for project 2560a3899cef4bb4914d26ef6c5ccac7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:28.343772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Getting quotas for user 707f421c56754147809eb7382a1872b2 and project 2560a3899cef4bb4914d26ef6c5ccac7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:28.353087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d478778a-d0bd-4583-acac-f913986ad07b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:28.361171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.utils [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] instances quota exceeded for 2560a3899cef4bb4914d26ef6c5ccac7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128807) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 23 18:02:28.362133 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 23 18:02:28.363381 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d478778a-d0bd-4583-acac-f913986ad07b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1259 microversion: 2.1 time: 0.136331 Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Request method failure captured: Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 144 Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRYsxIkA8Sawlv3aIr_hZFNmjh9zUtGAZxGHexVOGdB82C8D_pT3vOHgVnuTtG0grnDFd9ePewO6bKkq1Of-T3S-U6vXj4XY2PaZprTiKlVN3fWv0QxvsyoH-fZaBwYIvUV7pt3FNiirfTm7T2AsJBm2XLdpHz22eFirfyN-XFf3qQg Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 2560a3899cef4bb4914d26ef6c5ccac7 Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-QuotasAdminNegativeTest-1232737843 Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2560a3899cef4bb4914d26ef6c5ccac7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2560a3899cef4bb4914d26ef6c5ccac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2560a3899cef4bb4914d26ef6c5ccac7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2560a3899cef4bb4914d26ef6c5ccac7"}]}] Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-QuotasAdminNegativeTest-1232737843 Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 2560a3899cef4bb4914d26ef6c5ccac7 Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1232737843 Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-QuotasAdminNegativeTest-1232737843-project Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 707f421c56754147809eb7382a1872b2 Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-QuotasAdminNegativeTest-1232737843-project Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-195858927", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-195858927', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452'}}} Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 18:02:28.365954 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:02:28.369522 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-615bff8c-503f-4f92-94ef-0e4fd5ec7f9b tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 0.838084 Aug 23 18:02:28.375013 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1380/2775] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:02:27 2022] POST /compute/v2.1/servers => generated 119 bytes in 843 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:02:28.377705 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1396/2776] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:28 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:28.377949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2929b38e-0ee7-4967-aa5e-118a8aed832c tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Action: 'update', calling method: .version_select at 0x7f27eca76280>, body: {"quota_set": {"instances": 10}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:28.484307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2929b38e-0ee7-4967-aa5e-118a8aed832c tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:28.485033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2929b38e-0ee7-4967-aa5e-118a8aed832c tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:28.486671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2929b38e-0ee7-4967-aa5e-118a8aed832c tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:28.487854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2929b38e-0ee7-4967-aa5e-118a8aed832c tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:28.488591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2929b38e-0ee7-4967-aa5e-118a8aed832c tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:28.489294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2929b38e-0ee7-4967-aa5e-118a8aed832c tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:28.609493 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2929b38e-0ee7-4967-aa5e-118a8aed832c tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7" status: 200 len: 329 microversion: 2.1 time: 0.235260 Aug 23 18:02:28.611633 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1381/2777] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 18:02:28 2022] PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7 => generated 329 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:28.641246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-429d54be-3f55-4ec4-aa73-b49a6e7f0173 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Calling method '.version_select at 0x7f27ec0243a0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:28.774719 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-429d54be-3f55-4ec4-aa73-b49a6e7f0173 tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7" status: 200 len: 371 microversion: 2.1 time: 0.150156 Aug 23 18:02:28.784941 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1397/2778] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Aug 23 18:02:28 2022] GET /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7 => generated 371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:28.788957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-442a6948-6f4a-4953-bc8d-58886e7b233a tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec90d310>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:28.899313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-442a6948-6f4a-4953-bc8d-58886e7b233a tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:28.900392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-442a6948-6f4a-4953-bc8d-58886e7b233a tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:28.901208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-442a6948-6f4a-4953-bc8d-58886e7b233a tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:28.916650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa69ccf7-9101-4d21-a376-02f75e0febaf tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:28.919364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa69ccf7-9101-4d21-a376-02f75e0febaf tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:28.919493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-442a6948-6f4a-4953-bc8d-58886e7b233a tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:28.922559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-442a6948-6f4a-4953-bc8d-58886e7b233a tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:28.923859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-442a6948-6f4a-4953-bc8d-58886e7b233a tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:28.930325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa69ccf7-9101-4d21-a376-02f75e0febaf tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:28.932316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa69ccf7-9101-4d21-a376-02f75e0febaf tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:28.932982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa69ccf7-9101-4d21-a376-02f75e0febaf tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:28.934039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa69ccf7-9101-4d21-a376-02f75e0febaf tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:28.935123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa69ccf7-9101-4d21-a376-02f75e0febaf tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:28.941109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa69ccf7-9101-4d21-a376-02f75e0febaf tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:29.001603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3,nova_api:INSERT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:29.042175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:29.095418 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-442a6948-6f4a-4953-bc8d-58886e7b233a tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7" status: 200 len: 325 microversion: 2.1 time: 0.312611 Aug 23 18:02:29.096089 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1382/2779] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 18:02:28 2022] PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7 => generated 325 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:29.299589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e49d2fda-2b35-489f-8377-ad6d5298b1de tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:29.307067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e49d2fda-2b35-489f-8377-ad6d5298b1de tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:29.366314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e49d2fda-2b35-489f-8377-ad6d5298b1de tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:29.367268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e49d2fda-2b35-489f-8377-ad6d5298b1de tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:29.368776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e49d2fda-2b35-489f-8377-ad6d5298b1de tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:29.370149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e49d2fda-2b35-489f-8377-ad6d5298b1de tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:29.378029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e49d2fda-2b35-489f-8377-ad6d5298b1de tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:29.386975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e49d2fda-2b35-489f-8377-ad6d5298b1de tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:29.911193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa69ccf7-9101-4d21-a376-02f75e0febaf tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:29.924014 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa69ccf7-9101-4d21-a376-02f75e0febaf tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1318 microversion: 2.1 time: 1.011838 Aug 23 18:02:29.927798 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1398/2780] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:28 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1318 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:02:29.941895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1638735312", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:29.963956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e49d2fda-2b35-489f-8377-ad6d5298b1de tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:29.988454 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e49d2fda-2b35-489f-8377-ad6d5298b1de tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1316 microversion: 2.1 time: 0.758810 Aug 23 18:02:30.005623 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1383/2781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:29 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1316 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:30.022172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a6ef745-f51b-4db8-a65c-edcca0f7c875 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:30.043324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a6ef745-f51b-4db8-a65c-edcca0f7c875 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:30.062355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a6ef745-f51b-4db8-a65c-edcca0f7c875 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:30.065904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a6ef745-f51b-4db8-a65c-edcca0f7c875 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:30.066696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a6ef745-f51b-4db8-a65c-edcca0f7c875 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:30.081394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a6ef745-f51b-4db8-a65c-edcca0f7c875 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:30.084272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a6ef745-f51b-4db8-a65c-edcca0f7c875 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:30.085573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a6ef745-f51b-4db8-a65c-edcca0f7c875 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:30.134829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:02:30.277856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a6ef745-f51b-4db8-a65c-edcca0f7c875 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:30.292668 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a6ef745-f51b-4db8-a65c-edcca0f7c875 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1265 microversion: 2.1 time: 0.282693 Aug 23 18:02:30.294063 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1384/2782] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:30 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1265 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:30.896373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:02:30.896809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:02:30.897502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:02:30.898091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:02:30.898720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:02:30.914369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:30.916731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:30.919313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:30.920811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:30.923955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:30.924609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:30.949691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-103f8615-83a8-4bf1-86f6-25a0c899c6bc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:30.951450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-103f8615-83a8-4bf1-86f6-25a0c899c6bc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:30.976172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Getting quotas for project 2560a3899cef4bb4914d26ef6c5ccac7. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:30.983192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-103f8615-83a8-4bf1-86f6-25a0c899c6bc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:30.984205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-103f8615-83a8-4bf1-86f6-25a0c899c6bc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:30.988290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-103f8615-83a8-4bf1-86f6-25a0c899c6bc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:30.993230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Getting quotas for user 707f421c56754147809eb7382a1872b2 and project 2560a3899cef4bb4914d26ef6c5ccac7. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:30.995076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-103f8615-83a8-4bf1-86f6-25a0c899c6bc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:31.000040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-103f8615-83a8-4bf1-86f6-25a0c899c6bc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:31.012385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-103f8615-83a8-4bf1-86f6-25a0c899c6bc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:31.052311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.utils [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] ram quota exceeded for 2560a3899cef4bb4914d26ef6c5ccac7, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=128808) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Aug 23 18:02:31.053138 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Request method failure captured: Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 145 Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRYsxIkA8Sawlv3aIr_hZFNmjh9zUtGAZxGHexVOGdB82C8D_pT3vOHgVnuTtG0grnDFd9ePewO6bKkq1Of-T3S-U6vXj4XY2PaZprTiKlVN3fWv0QxvsyoH-fZaBwYIvUV7pt3FNiirfTm7T2AsJBm2XLdpHz22eFirfyN-XFf3qQg Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2560a3899cef4bb4914d26ef6c5ccac7 Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-QuotasAdminNegativeTest-1232737843 Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2560a3899cef4bb4914d26ef6c5ccac7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2560a3899cef4bb4914d26ef6c5ccac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2560a3899cef4bb4914d26ef6c5ccac7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2560a3899cef4bb4914d26ef6c5ccac7"}]}] Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-QuotasAdminNegativeTest-1232737843 Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2560a3899cef4bb4914d26ef6c5ccac7 Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1232737843 Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-QuotasAdminNegativeTest-1232737843-project Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 707f421c56754147809eb7382a1872b2 Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-QuotasAdminNegativeTest-1232737843-project Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-1638735312", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-1638735312', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452'}}} Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 18:02:31.055551 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1720, in _create_instance Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1349, in _provision_instances Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Aug 23 18:02:31.060053 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:31.064422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:02:31.065518 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-feb79302-6529-4398-be41-ab7534fd0da1 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 1.135979 Aug 23 18:02:31.075208 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1399/2783] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:02:29 2022] POST /compute/v2.1/servers => generated 110 bytes in 1146 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:02:31.089903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac8e7de0-2aaa-4ad4-84ec-26c40749f52c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:31.091267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac8e7de0-2aaa-4ad4-84ec-26c40749f52c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:31.108469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac8e7de0-2aaa-4ad4-84ec-26c40749f52c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:31.114634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac8e7de0-2aaa-4ad4-84ec-26c40749f52c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:31.115446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac8e7de0-2aaa-4ad4-84ec-26c40749f52c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:31.116407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac8e7de0-2aaa-4ad4-84ec-26c40749f52c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:31.119839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac8e7de0-2aaa-4ad4-84ec-26c40749f52c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:31.120973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac8e7de0-2aaa-4ad4-84ec-26c40749f52c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:31.607334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac8e7de0-2aaa-4ad4-84ec-26c40749f52c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:31.621886 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac8e7de0-2aaa-4ad4-84ec-26c40749f52c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1316 microversion: 2.1 time: 0.545095 Aug 23 18:02:31.634176 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1400/2784] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:31 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1316 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:31.640954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-98b57258-a4cf-478b-8ddb-2418e879a71b tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Action: 'update', calling method: .version_select at 0x7f27dfa82700>, body: {"quota_set": {"ram": 51200}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:31.917957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-103f8615-83a8-4bf1-86f6-25a0c899c6bc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:31.931388 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-103f8615-83a8-4bf1-86f6-25a0c899c6bc tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1318 microversion: 2.1 time: 0.984637 Aug 23 18:02:31.934301 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1385/2785] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:30 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1318 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:31.947019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-046c2730-503d-4aff-affb-294ffe614e8e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:31.951254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-046c2730-503d-4aff-affb-294ffe614e8e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:31.968586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-046c2730-503d-4aff-affb-294ffe614e8e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:31.969368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-046c2730-503d-4aff-affb-294ffe614e8e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:31.970563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-046c2730-503d-4aff-affb-294ffe614e8e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:31.971488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-046c2730-503d-4aff-affb-294ffe614e8e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:31.972236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-046c2730-503d-4aff-affb-294ffe614e8e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:31.972830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-046c2730-503d-4aff-affb-294ffe614e8e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:32.092034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98b57258-a4cf-478b-8ddb-2418e879a71b tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:32.103399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98b57258-a4cf-478b-8ddb-2418e879a71b tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:32.109282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98b57258-a4cf-478b-8ddb-2418e879a71b tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:32.113344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98b57258-a4cf-478b-8ddb-2418e879a71b tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:32.117009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98b57258-a4cf-478b-8ddb-2418e879a71b tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:32.122253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98b57258-a4cf-478b-8ddb-2418e879a71b tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:32.151631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-046c2730-503d-4aff-affb-294ffe614e8e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:32.164807 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-046c2730-503d-4aff-affb-294ffe614e8e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1265 microversion: 2.1 time: 0.227857 Aug 23 18:02:32.168410 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1386/2786] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:31 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:32.406003 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-98b57258-a4cf-478b-8ddb-2418e879a71b tempest-QuotasAdminNegativeTest-1335409838 tempest-QuotasAdminNegativeTest-1335409838-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7" status: 200 len: 329 microversion: 2.1 time: 0.770159 Aug 23 18:02:32.408009 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1401/2787] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 18:02:31 2022] PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7 => generated 329 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:32.420454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a05878f-29a3-47ea-a129-4296f94d17e6 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Action: 'update', calling method: .version_select at 0x7f27ec891a60>, body: {"quota_set": {"ram": 0}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:32.430404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a05878f-29a3-47ea-a129-4296f94d17e6 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '707f421c56754147809eb7382a1872b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2560a3899cef4bb4914d26ef6c5ccac7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a05878f-29a3-47ea-a129-4296f94d17e6 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Request method failure captured: Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: request: PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7 HTTP/1.1 Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 25 Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRYsxIkA8Sawlv3aIr_hZFNmjh9zUtGAZxGHexVOGdB82C8D_pT3vOHgVnuTtG0grnDFd9ePewO6bKkq1Of-T3S-U6vXj4XY2PaZprTiKlVN3fWv0QxvsyoH-fZaBwYIvUV7pt3FNiirfTm7T2AsJBm2XLdpHz22eFirfyN-XFf3qQg Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 2560a3899cef4bb4914d26ef6c5ccac7 Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-QuotasAdminNegativeTest-1232737843 Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2560a3899cef4bb4914d26ef6c5ccac7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2560a3899cef4bb4914d26ef6c5ccac7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2560a3899cef4bb4914d26ef6c5ccac7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2560a3899cef4bb4914d26ef6c5ccac7"}]}] Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-QuotasAdminNegativeTest-1232737843 Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 2560a3899cef4bb4914d26ef6c5ccac7 Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-1232737843 Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-QuotasAdminNegativeTest-1232737843-project Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 707f421c56754147809eb7382a1872b2 Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-QuotasAdminNegativeTest-1232737843-project Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: {"quota_set": {"ram": 0}} Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2560a3899cef4bb4914d26ef6c5ccac7', 'body': {'quota_set': {'ram': 0}}} Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 18:02:32.441309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a05878f-29a3-47ea-a129-4296f94d17e6 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a05878f-29a3-47ea-a129-4296f94d17e6 tempest-QuotasAdminNegativeTest-1232737843 tempest-QuotasAdminNegativeTest-1232737843-project] 10.222.0.61 "PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7" status: 403 len: 116 microversion: 2.1 time: 0.027001 Aug 23 18:02:32.445533 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1387/2788] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 18:02:32 2022] PUT /compute/v2.1/os-quota-sets/2560a3899cef4bb4914d26ef6c5ccac7 => generated 116 bytes in 29 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:02:32.591637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f793d6a0-07c1-4321-a939-b9b965d876f3 req-b4b695c9-17a5-4066-946f-4903b03c2322 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1adfb52-d290-451a-89bf-4d63824150c5", "name": "network-vif-plugged", "status": "completed", "tag": "877ab05b-84d2-46a6-a689-4dfd4bb855ca"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:32.612006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f793d6a0-07c1-4321-a939-b9b965d876f3 req-b4b695c9-17a5-4066-946f-4903b03c2322 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:32.612501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f793d6a0-07c1-4321-a939-b9b965d876f3 req-b4b695c9-17a5-4066-946f-4903b03c2322 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:32.637814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f793d6a0-07c1-4321-a939-b9b965d876f3 req-b4b695c9-17a5-4066-946f-4903b03c2322 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:32.646889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f22baf54-c84d-4753-965f-3a3ae746b7f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:32.647520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f22baf54-c84d-4753-965f-3a3ae746b7f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:32.663256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f22baf54-c84d-4753-965f-3a3ae746b7f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:32.664270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f22baf54-c84d-4753-965f-3a3ae746b7f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:32.666304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f22baf54-c84d-4753-965f-3a3ae746b7f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:32.669707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f22baf54-c84d-4753-965f-3a3ae746b7f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:32.670462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f22baf54-c84d-4753-965f-3a3ae746b7f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:32.674711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f22baf54-c84d-4753-965f-3a3ae746b7f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:32.694060 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f793d6a0-07c1-4321-a939-b9b965d876f3 req-b4b695c9-17a5-4066-946f-4903b03c2322 service nova] Creating event network-vif-plugged:877ab05b-84d2-46a6-a689-4dfd4bb855ca for instance e1adfb52-d290-451a-89bf-4d63824150c5 on n-h2-850468-16 Aug 23 18:02:32.721617 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f793d6a0-07c1-4321-a939-b9b965d876f3 req-b4b695c9-17a5-4066-946f-4903b03c2322 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129692 Aug 23 18:02:32.722918 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1402/2789] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:32.962418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fb47228a-1910-4e7c-89b6-d265f60a15d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:32.964944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fb47228a-1910-4e7c-89b6-d265f60a15d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:32.996200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb47228a-1910-4e7c-89b6-d265f60a15d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:33.002373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb47228a-1910-4e7c-89b6-d265f60a15d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:33.003012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb47228a-1910-4e7c-89b6-d265f60a15d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:33.006389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb47228a-1910-4e7c-89b6-d265f60a15d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:33.009620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb47228a-1910-4e7c-89b6-d265f60a15d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:33.011591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb47228a-1910-4e7c-89b6-d265f60a15d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:33.703690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb47228a-1910-4e7c-89b6-d265f60a15d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:33.727819 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fb47228a-1910-4e7c-89b6-d265f60a15d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1318 microversion: 2.1 time: 0.777134 Aug 23 18:02:33.729134 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1403/2790] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:32 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1318 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:33.741308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-820da6f7-8efc-4146-8b83-10914d9dd43a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:33.742469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-820da6f7-8efc-4146-8b83-10914d9dd43a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:33.758626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820da6f7-8efc-4146-8b83-10914d9dd43a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:33.760653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820da6f7-8efc-4146-8b83-10914d9dd43a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:33.762318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820da6f7-8efc-4146-8b83-10914d9dd43a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:33.765481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820da6f7-8efc-4146-8b83-10914d9dd43a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:33.766188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820da6f7-8efc-4146-8b83-10914d9dd43a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:33.767096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-820da6f7-8efc-4146-8b83-10914d9dd43a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:33.885324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f22baf54-c84d-4753-965f-3a3ae746b7f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:33.901628 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f22baf54-c84d-4753-965f-3a3ae746b7f8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1316 microversion: 2.1 time: 1.257942 Aug 23 18:02:33.916437 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1388/2791] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:32 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1316 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:34.383795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-820da6f7-8efc-4146-8b83-10914d9dd43a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:34.411623 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-820da6f7-8efc-4146-8b83-10914d9dd43a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1307 microversion: 2.1 time: 0.678941 Aug 23 18:02:34.412973 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1404/2792] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:33 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1307 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:34.750320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9d764f58-a058-4625-ab01-8e1969ebcb7a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:34.752655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9d764f58-a058-4625-ab01-8e1969ebcb7a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:34.773675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d764f58-a058-4625-ab01-8e1969ebcb7a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:34.774175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d764f58-a058-4625-ab01-8e1969ebcb7a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:34.782779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d764f58-a058-4625-ab01-8e1969ebcb7a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:34.783705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d764f58-a058-4625-ab01-8e1969ebcb7a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:34.784672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d764f58-a058-4625-ab01-8e1969ebcb7a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:34.785128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d764f58-a058-4625-ab01-8e1969ebcb7a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:34.883581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8fe62180-d517-4064-a17d-683185f6337a req-15bfa5e5-be8b-4326-bd76-b357ee48968a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264db24e-173d-46bb-8f6c-8a86eee0a70c", "name": "network-vif-plugged", "status": "completed", "tag": "ef77fd36-df98-4b26-8ab3-e446ba4d3c6d"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:34.918628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8fe62180-d517-4064-a17d-683185f6337a req-15bfa5e5-be8b-4326-bd76-b357ee48968a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:34.920616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8fe62180-d517-4064-a17d-683185f6337a req-15bfa5e5-be8b-4326-bd76-b357ee48968a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:34.921437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8fe62180-d517-4064-a17d-683185f6337a req-15bfa5e5-be8b-4326-bd76-b357ee48968a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:34.970979 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8fe62180-d517-4064-a17d-683185f6337a req-15bfa5e5-be8b-4326-bd76-b357ee48968a service nova] Creating event network-vif-plugged:ef77fd36-df98-4b26-8ab3-e446ba4d3c6d for instance 264db24e-173d-46bb-8f6c-8a86eee0a70c on n-h1-850468-16 Aug 23 18:02:34.993214 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8fe62180-d517-4064-a17d-683185f6337a req-15bfa5e5-be8b-4326-bd76-b357ee48968a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114999 Aug 23 18:02:35.002386 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1405/2793] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:35.010048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-49341328-4bc4-4e13-8b43-4b461d3ae57a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:35.014777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-49341328-4bc4-4e13-8b43-4b461d3ae57a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:35.032795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49341328-4bc4-4e13-8b43-4b461d3ae57a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:35.033692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49341328-4bc4-4e13-8b43-4b461d3ae57a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:35.034315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49341328-4bc4-4e13-8b43-4b461d3ae57a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:35.035360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49341328-4bc4-4e13-8b43-4b461d3ae57a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:35.038065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49341328-4bc4-4e13-8b43-4b461d3ae57a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:35.043076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49341328-4bc4-4e13-8b43-4b461d3ae57a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:35.350137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9d764f58-a058-4625-ab01-8e1969ebcb7a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:35.370987 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9d764f58-a058-4625-ab01-8e1969ebcb7a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1318 microversion: 2.1 time: 0.621543 Aug 23 18:02:35.374835 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1389/2794] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:34 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:35.435834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ad643d1f-a52c-4ad8-8f5a-6b29768f1bdb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:35.436899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ad643d1f-a52c-4ad8-8f5a-6b29768f1bdb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:35.459131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad643d1f-a52c-4ad8-8f5a-6b29768f1bdb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:35.460025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad643d1f-a52c-4ad8-8f5a-6b29768f1bdb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:35.460788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad643d1f-a52c-4ad8-8f5a-6b29768f1bdb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:35.462821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad643d1f-a52c-4ad8-8f5a-6b29768f1bdb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:35.463520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad643d1f-a52c-4ad8-8f5a-6b29768f1bdb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:35.464171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad643d1f-a52c-4ad8-8f5a-6b29768f1bdb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:35.496449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:35.803423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-49341328-4bc4-4e13-8b43-4b461d3ae57a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:35.821050 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-49341328-4bc4-4e13-8b43-4b461d3ae57a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1316 microversion: 2.1 time: 0.816475 Aug 23 18:02:35.822414 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1406/2795] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:35 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1316 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:35.987262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5969782e-19d7-4ba9-9e61-4a9c7661c0e9 req-36179551-e6d4-45c3-ac13-a8d35ef655b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "769e5a46-b0fd-49a3-bffa-1538728a67cc", "tag": "4df03a69-a606-4878-8aa1-164f4e89e488"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:36.017653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5969782e-19d7-4ba9-9e61-4a9c7661c0e9 req-36179551-e6d4-45c3-ac13-a8d35ef655b5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:36.018526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5969782e-19d7-4ba9-9e61-4a9c7661c0e9 req-36179551-e6d4-45c3-ac13-a8d35ef655b5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:36.019209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5969782e-19d7-4ba9-9e61-4a9c7661c0e9 req-36179551-e6d4-45c3-ac13-a8d35ef655b5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:36.036194 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5969782e-19d7-4ba9-9e61-4a9c7661c0e9 req-36179551-e6d4-45c3-ac13-a8d35ef655b5 service nova] Creating event network-changed:4df03a69-a606-4878-8aa1-164f4e89e488 for instance 769e5a46-b0fd-49a3-bffa-1538728a67cc on n-h1-850468-16 Aug 23 18:02:36.046636 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5969782e-19d7-4ba9-9e61-4a9c7661c0e9 req-36179551-e6d4-45c3-ac13-a8d35ef655b5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064057 Aug 23 18:02:36.047997 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1407/2796] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:36.192347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ad643d1f-a52c-4ad8-8f5a-6b29768f1bdb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:36.212596 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ad643d1f-a52c-4ad8-8f5a-6b29768f1bdb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1307 microversion: 2.1 time: 0.777817 Aug 23 18:02:36.214520 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1390/2797] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:35 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1307 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:02:36.399777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e57fe754-4a55-4015-b6df-58498631b2c9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:36.400858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e57fe754-4a55-4015-b6df-58498631b2c9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:36.418102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e57fe754-4a55-4015-b6df-58498631b2c9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:36.418664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e57fe754-4a55-4015-b6df-58498631b2c9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:36.419113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e57fe754-4a55-4015-b6df-58498631b2c9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:36.419835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e57fe754-4a55-4015-b6df-58498631b2c9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:36.430456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e57fe754-4a55-4015-b6df-58498631b2c9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:36.430629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e57fe754-4a55-4015-b6df-58498631b2c9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:36.844952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b2000877-a61a-471f-bb16-1bf7fcd9c330 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:36.846248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b2000877-a61a-471f-bb16-1bf7fcd9c330 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:36.858410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2000877-a61a-471f-bb16-1bf7fcd9c330 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:36.858944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2000877-a61a-471f-bb16-1bf7fcd9c330 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:36.867356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2000877-a61a-471f-bb16-1bf7fcd9c330 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:36.868491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2000877-a61a-471f-bb16-1bf7fcd9c330 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:36.869238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2000877-a61a-471f-bb16-1bf7fcd9c330 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:36.876779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2000877-a61a-471f-bb16-1bf7fcd9c330 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:37.185432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e57fe754-4a55-4015-b6df-58498631b2c9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:37.195560 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e57fe754-4a55-4015-b6df-58498631b2c9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1318 microversion: 2.1 time: 0.803733 Aug 23 18:02:37.196134 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1408/2798] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:36 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1318 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:37.208637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b2000877-a61a-471f-bb16-1bf7fcd9c330 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:37.218422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-cafb4b1b-3f28-491f-ba29-aca28e622d67 req-f00524bc-9caa-46b1-bb13-85eb8c8ac171 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda3e215-afdf-4d78-bd76-d27e7491c589", "name": "network-vif-plugged", "status": "completed", "tag": "94e5ded1-138f-4678-b2ef-0b8a6f4c59ca"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:37.249757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cafb4b1b-3f28-491f-ba29-aca28e622d67 req-f00524bc-9caa-46b1-bb13-85eb8c8ac171 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:37.253369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cafb4b1b-3f28-491f-ba29-aca28e622d67 req-f00524bc-9caa-46b1-bb13-85eb8c8ac171 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:37.253873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cafb4b1b-3f28-491f-ba29-aca28e622d67 req-f00524bc-9caa-46b1-bb13-85eb8c8ac171 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:37.275695 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b2000877-a61a-471f-bb16-1bf7fcd9c330 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1316 microversion: 2.1 time: 0.418410 Aug 23 18:02:37.279284 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1391/2799] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:36 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1316 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:02:37.290344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8714e54b-a340-4b24-a66d-be4a14ca756e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:37.294870 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-cafb4b1b-3f28-491f-ba29-aca28e622d67 req-f00524bc-9caa-46b1-bb13-85eb8c8ac171 service nova] Creating event network-vif-plugged:94e5ded1-138f-4678-b2ef-0b8a6f4c59ca for instance dda3e215-afdf-4d78-bd76-d27e7491c589 on n-h2-850468-16 Aug 23 18:02:37.297129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8714e54b-a340-4b24-a66d-be4a14ca756e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:37.310638 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-cafb4b1b-3f28-491f-ba29-aca28e622d67 req-f00524bc-9caa-46b1-bb13-85eb8c8ac171 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098598 Aug 23 18:02:37.315199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8714e54b-a340-4b24-a66d-be4a14ca756e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:37.317463 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1409/2800] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:37.321284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8714e54b-a340-4b24-a66d-be4a14ca756e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:37.321849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8714e54b-a340-4b24-a66d-be4a14ca756e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:37.323952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8714e54b-a340-4b24-a66d-be4a14ca756e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:37.325272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8714e54b-a340-4b24-a66d-be4a14ca756e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:37.334269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8714e54b-a340-4b24-a66d-be4a14ca756e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:37.880688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8714e54b-a340-4b24-a66d-be4a14ca756e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:37.893682 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8714e54b-a340-4b24-a66d-be4a14ca756e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1307 microversion: 2.1 time: 0.612705 Aug 23 18:02:37.896395 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1392/2801] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:37 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1307 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:38.219106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8dfc8331-2f1e-41e1-a6cb-c41cf9c8e951 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:38.219868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8dfc8331-2f1e-41e1-a6cb-c41cf9c8e951 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:38.229723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfc8331-2f1e-41e1-a6cb-c41cf9c8e951 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:38.231319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfc8331-2f1e-41e1-a6cb-c41cf9c8e951 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:38.232242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfc8331-2f1e-41e1-a6cb-c41cf9c8e951 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:38.233012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfc8331-2f1e-41e1-a6cb-c41cf9c8e951 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:38.234008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfc8331-2f1e-41e1-a6cb-c41cf9c8e951 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:38.235183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfc8331-2f1e-41e1-a6cb-c41cf9c8e951 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:38.300857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9bb2e03d-8faa-4c16-8927-e46b1aeb8063 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:38.301988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9bb2e03d-8faa-4c16-8927-e46b1aeb8063 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:38.323199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bb2e03d-8faa-4c16-8927-e46b1aeb8063 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:38.324732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bb2e03d-8faa-4c16-8927-e46b1aeb8063 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:38.325348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bb2e03d-8faa-4c16-8927-e46b1aeb8063 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:38.326291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bb2e03d-8faa-4c16-8927-e46b1aeb8063 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:38.326936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bb2e03d-8faa-4c16-8927-e46b1aeb8063 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:38.327524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bb2e03d-8faa-4c16-8927-e46b1aeb8063 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:38.530731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8dfc8331-2f1e-41e1-a6cb-c41cf9c8e951 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:38.544667 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8dfc8331-2f1e-41e1-a6cb-c41cf9c8e951 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1318 microversion: 2.1 time: 0.331040 Aug 23 18:02:38.545964 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1410/2802] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:38 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:38.915612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1088f787-a74e-4087-8434-37474d8f4f5d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:38.916247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1088f787-a74e-4087-8434-37474d8f4f5d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:38.931090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1088f787-a74e-4087-8434-37474d8f4f5d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:38.931596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1088f787-a74e-4087-8434-37474d8f4f5d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:38.932042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1088f787-a74e-4087-8434-37474d8f4f5d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:38.932786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1088f787-a74e-4087-8434-37474d8f4f5d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:38.934660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1088f787-a74e-4087-8434-37474d8f4f5d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:38.936815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1088f787-a74e-4087-8434-37474d8f4f5d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:38.951992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=16 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:39.038807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9bb2e03d-8faa-4c16-8927-e46b1aeb8063 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:39.055336 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9bb2e03d-8faa-4c16-8927-e46b1aeb8063 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1504 microversion: 2.1 time: 0.754495 Aug 23 18:02:39.073597 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1393/2803] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:38 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1504 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:39.079371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-235d9464-c35d-4318-8d2e-04faf4c7d828 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1941188730"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:39.080223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-235d9464-c35d-4318-8d2e-04faf4c7d828 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:39.082353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=54 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:39.088617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-235d9464-c35d-4318-8d2e-04faf4c7d828 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:39.096489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-235d9464-c35d-4318-8d2e-04faf4c7d828 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:39.097531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-235d9464-c35d-4318-8d2e-04faf4c7d828 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:39.098437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-235d9464-c35d-4318-8d2e-04faf4c7d828 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:39.099173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-235d9464-c35d-4318-8d2e-04faf4c7d828 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:39.099758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-235d9464-c35d-4318-8d2e-04faf4c7d828 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:39.184213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1088f787-a74e-4087-8434-37474d8f4f5d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:39.195100 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1088f787-a74e-4087-8434-37474d8f4f5d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1307 microversion: 2.1 time: 0.283121 Aug 23 18:02:39.195703 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1411/2804] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:38 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1307 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:02:39.515747 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.network.security_group_api [None req-235d9464-c35d-4318-8d2e-04faf4c7d828 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Adding security group 1d23a33e-35e3-4b78-9245-49023246e6dd to port ef77fd36-df98-4b26-8ab3-e446ba4d3c6d Aug 23 18:02:39.570827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4aa8f0c4-efa5-4969-95b1-4b8100ee80d5 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:39.572029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4aa8f0c4-efa5-4969-95b1-4b8100ee80d5 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:39.580284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa8f0c4-efa5-4969-95b1-4b8100ee80d5 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:39.581125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa8f0c4-efa5-4969-95b1-4b8100ee80d5 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:39.581766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa8f0c4-efa5-4969-95b1-4b8100ee80d5 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:39.582748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa8f0c4-efa5-4969-95b1-4b8100ee80d5 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:39.583464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa8f0c4-efa5-4969-95b1-4b8100ee80d5 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:39.584090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa8f0c4-efa5-4969-95b1-4b8100ee80d5 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:39.867893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4aa8f0c4-efa5-4969-95b1-4b8100ee80d5 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:39.877651 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4aa8f0c4-efa5-4969-95b1-4b8100ee80d5 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1468 microversion: 2.1 time: 0.314716 Aug 23 18:02:39.879986 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1412/2805] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:39 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1468 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:40.372990 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-235d9464-c35d-4318-8d2e-04faf4c7d828 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c/action" status: 202 len: 0 microversion: 2.1 time: 1.298126 Aug 23 18:02:40.373582 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1394/2806] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:02:39 2022] POST /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c/action => generated 0 bytes in 1299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:02:40.378353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-139376337", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:40.386012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-052e9e27-c631-42d7-bdb5-61327c6b96a2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:40.387016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-052e9e27-c631-42d7-bdb5-61327c6b96a2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: e1adfb52-d290-451a-89bf-4d63824150c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:40.394385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-052e9e27-c631-42d7-bdb5-61327c6b96a2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:40.395423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-052e9e27-c631-42d7-bdb5-61327c6b96a2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:40.396136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-052e9e27-c631-42d7-bdb5-61327c6b96a2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:40.397093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-052e9e27-c631-42d7-bdb5-61327c6b96a2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:40.397767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-052e9e27-c631-42d7-bdb5-61327c6b96a2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:40.398497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-052e9e27-c631-42d7-bdb5-61327c6b96a2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:40.480712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:02:40.799602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:02:40.800319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:02:40.800401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:02:40.801426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:02:40.802057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:02:40.815993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:40.817078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:40.817809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:40.819056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:40.819292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-052e9e27-c631-42d7-bdb5-61327c6b96a2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:40.819883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:40.820494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:40.838111 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-052e9e27-c631-42d7-bdb5-61327c6b96a2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5" status: 200 len: 1468 microversion: 2.1 time: 0.461970 Aug 23 18:02:40.839371 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1395/2807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:40 2022] GET /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5 => generated 1468 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:40.850484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c3d05f54-1d8e-4811-96d2-c7af48251778 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:40.853482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c3d05f54-1d8e-4811-96d2-c7af48251778 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:40.868980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3d05f54-1d8e-4811-96d2-c7af48251778 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:40.869984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3d05f54-1d8e-4811-96d2-c7af48251778 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:40.870938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3d05f54-1d8e-4811-96d2-c7af48251778 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:40.871934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3d05f54-1d8e-4811-96d2-c7af48251778 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:40.872612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3d05f54-1d8e-4811-96d2-c7af48251778 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:40.873290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3d05f54-1d8e-4811-96d2-c7af48251778 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:40.873409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Getting quotas for project 57bb1f989bf346ab9daefe20a2e9a0b3. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:40.876587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:40.888069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Getting quotas for user 845f5cca36ea458480b56e3b48f73454 and project 57bb1f989bf346ab9daefe20a2e9a0b3. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:40.927130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:02:40.929811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:02:41.023324 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f69d4810-2db4-4804-86b2-e9a42e6f01ea tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.141366 Aug 23 18:02:41.024599 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1413/2808] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:02:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 1143 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:02:41.035770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d15668e9-c4d8-473d-9525-e8dbd73a2ae5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27dfa82ca0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:41.181661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG neutronclient.v2_0.client [None req-d15668e9-c4d8-473d-9525-e8dbd73a2ae5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 1d23a33e-35e3-4b78-9245-49023246e6dd in use.", "detail": ""}} {{(pid=128808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:02:41.183289 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-d15668e9-c4d8-473d-9525-e8dbd73a2ae5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Security Group 1d23a33e-35e3-4b78-9245-49023246e6dd in use. Aug 23 18:02:41.183289 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-d9bf0e39-db07-4939-8a9c-e28f12bbbe3e'] Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d15668e9-c4d8-473d-9525-e8dbd73a2ae5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/os-security-groups/1d23a33e-35e3-4b78-9245-49023246e6dd HTTP/1.1 Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: exception: Security Group 1d23a33e-35e3-4b78-9245-49023246e6dd in use. Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-d9bf0e39-db07-4939-8a9c-e28f12bbbe3e'] Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '1d23a33e-35e3-4b78-9245-49023246e6dd'} Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:02:41.186327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 1d23a33e-35e3-4b78-9245-49023246e6dd in use. Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9bf0e39-db07-4939-8a9c-e28f12bbbe3e'] Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 1d23a33e-35e3-4b78-9245-49023246e6dd in use. Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9bf0e39-db07-4939-8a9c-e28f12bbbe3e'] Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 1d23a33e-35e3-4b78-9245-49023246e6dd in use. Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9bf0e39-db07-4939-8a9c-e28f12bbbe3e'] Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 1d23a33e-35e3-4b78-9245-49023246e6dd in use. Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-d9bf0e39-db07-4939-8a9c-e28f12bbbe3e'] Aug 23 18:02:41.191117 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:41.198417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d15668e9-c4d8-473d-9525-e8dbd73a2ae5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 400 to user: Security Group 1d23a33e-35e3-4b78-9245-49023246e6dd in use. Aug 23 18:02:41.198417 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-d9bf0e39-db07-4939-8a9c-e28f12bbbe3e'] {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:02:41.199652 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d15668e9-c4d8-473d-9525-e8dbd73a2ae5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/1d23a33e-35e3-4b78-9245-49023246e6dd" status: 400 len: 185 microversion: 2.1 time: 0.173663 Aug 23 18:02:41.200436 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1414/2809] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:02:41 2022] DELETE /compute/v2.1/os-security-groups/1d23a33e-35e3-4b78-9245-49023246e6dd => generated 185 bytes in 175 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:02:41.209460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-46b9e118-062f-471b-9b41-1b0f93df8aa2 req-0212b22d-772c-4748-9af1-1c9040f59827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264db24e-173d-46bb-8f6c-8a86eee0a70c", "tag": "ef77fd36-df98-4b26-8ab3-e446ba4d3c6d"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:41.225867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-46b9e118-062f-471b-9b41-1b0f93df8aa2 req-0212b22d-772c-4748-9af1-1c9040f59827 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:41.230264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-46b9e118-062f-471b-9b41-1b0f93df8aa2 req-0212b22d-772c-4748-9af1-1c9040f59827 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:41.231099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-46b9e118-062f-471b-9b41-1b0f93df8aa2 req-0212b22d-772c-4748-9af1-1c9040f59827 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:41.248858 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-46b9e118-062f-471b-9b41-1b0f93df8aa2 req-0212b22d-772c-4748-9af1-1c9040f59827 service nova] Creating event network-changed:ef77fd36-df98-4b26-8ab3-e446ba4d3c6d for instance 264db24e-173d-46bb-8f6c-8a86eee0a70c on n-h1-850468-16 Aug 23 18:02:41.260403 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-46b9e118-062f-471b-9b41-1b0f93df8aa2 req-0212b22d-772c-4748-9af1-1c9040f59827 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054502 Aug 23 18:02:41.262129 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1415/2810] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:41.272913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:41.281264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:41.283066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Searching by: {'reservation_id': 'r-284tlbvu', 'deleted': False, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:02:41.289429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:41.290095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:41.290724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:41.292071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:41.292549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:41.293143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:41.337138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c3d05f54-1d8e-4811-96d2-c7af48251778 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:41.345935 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c3d05f54-1d8e-4811-96d2-c7af48251778 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1307 microversion: 2.1 time: 0.505254 Aug 23 18:02:41.361681 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1396/2811] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:40 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1307 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:41.361777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2b975e68-289d-4272-82c8-f516015abea4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:41.364351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2b975e68-289d-4272-82c8-f516015abea4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:41.480348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:02:41.530245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2b975e68-289d-4272-82c8-f516015abea4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:41.540993 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2b975e68-289d-4272-82c8-f516015abea4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1221 microversion: 2.1 time: 0.188313 Aug 23 18:02:41.550066 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1397/2812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:41 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1221 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:41.573974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff9f1bb9-1640-4315-b6a4-cc28b581febf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:41.589081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff9f1bb9-1640-4315-b6a4-cc28b581febf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:41.615088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff9f1bb9-1640-4315-b6a4-cc28b581febf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:41.616362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff9f1bb9-1640-4315-b6a4-cc28b581febf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:41.617379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff9f1bb9-1640-4315-b6a4-cc28b581febf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:41.620482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff9f1bb9-1640-4315-b6a4-cc28b581febf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:41.621444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff9f1bb9-1640-4315-b6a4-cc28b581febf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:41.623678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff9f1bb9-1640-4315-b6a4-cc28b581febf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:41.626398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:41.659888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:41.660140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:41.676384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:41.822125 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff9f1bb9-1640-4315-b6a4-cc28b581febf tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c/action" status: 202 len: 0 microversion: 2.1 time: 0.274211 Aug 23 18:02:41.823747 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1398/2813] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:02:41 2022] POST /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c/action => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:02:41.833667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3f637b46-bd5c-4507-ad95-b43f9072ab0b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:41.834750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3f637b46-bd5c-4507-ad95-b43f9072ab0b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:41.844030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f637b46-bd5c-4507-ad95-b43f9072ab0b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:41.845603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f637b46-bd5c-4507-ad95-b43f9072ab0b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:41.846278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f637b46-bd5c-4507-ad95-b43f9072ab0b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:41.847265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f637b46-bd5c-4507-ad95-b43f9072ab0b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:41.848080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f637b46-bd5c-4507-ad95-b43f9072ab0b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:41.849090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f637b46-bd5c-4507-ad95-b43f9072ab0b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:42.142178 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b7cc434-ee79-4649-a938-2cf659e0e4df tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?reservation_id=r-284tlbvu" status: 200 len: 2929 microversion: 2.1 time: 0.877930 Aug 23 18:02:42.142994 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1416/2814] 10.222.0.61 () {58 vars in 1197 bytes} [Tue Aug 23 18:02:41 2022] GET /compute/v2.1/servers/detail?reservation_id=r-284tlbvu => generated 2929 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:42.181840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4544550a-6814-482e-8722-e09edee7e341 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:42.203039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.compute.server_groups [None req-4544550a-6814-482e-8722-e09edee7e341 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Querying cell 410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) for 2 instances {{(pid=128808) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 23 18:02:42.205593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4544550a-6814-482e-8722-e09edee7e341 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:42.206281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4544550a-6814-482e-8722-e09edee7e341 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:42.206907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4544550a-6814-482e-8722-e09edee7e341 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:42.217369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3f637b46-bd5c-4507-ad95-b43f9072ab0b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:42.238182 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3f637b46-bd5c-4507-ad95-b43f9072ab0b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1575 microversion: 2.1 time: 0.408958 Aug 23 18:02:42.258983 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1399/2815] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:41 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1575 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:42.277770 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4544550a-6814-482e-8722-e09edee7e341 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/f3fd203c-3106-428b-98a7-57b3a8c52974" status: 200 len: 266 microversion: 2.1 time: 0.102369 Aug 23 18:02:42.278757 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1417/2816] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 18:02:42 2022] GET /compute/v2.1/os-server-groups/f3fd203c-3106-428b-98a7-57b3a8c52974 => generated 266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:02:42.290255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a600774b-e2f5-40c2-aa08-6849215e55cd tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:42.290902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a600774b-e2f5-40c2-aa08-6849215e55cd tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:42.306352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a600774b-e2f5-40c2-aa08-6849215e55cd tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:42.313943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a600774b-e2f5-40c2-aa08-6849215e55cd tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:42.314817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a600774b-e2f5-40c2-aa08-6849215e55cd tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:42.315694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a600774b-e2f5-40c2-aa08-6849215e55cd tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:42.316540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a600774b-e2f5-40c2-aa08-6849215e55cd tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:42.317462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a600774b-e2f5-40c2-aa08-6849215e55cd tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:42.374389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-35006975-d675-458f-bd0e-4ab86aad9708 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:42.379458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-35006975-d675-458f-bd0e-4ab86aad9708 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:42.400450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35006975-d675-458f-bd0e-4ab86aad9708 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:42.405442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35006975-d675-458f-bd0e-4ab86aad9708 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:42.407469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35006975-d675-458f-bd0e-4ab86aad9708 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:42.416555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35006975-d675-458f-bd0e-4ab86aad9708 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:42.418410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35006975-d675-458f-bd0e-4ab86aad9708 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:42.418558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35006975-d675-458f-bd0e-4ab86aad9708 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:42.895234 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a600774b-e2f5-40c2-aa08-6849215e55cd tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1621 microversion: 2.1 time: 0.604982 Aug 23 18:02:42.900163 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1400/2817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:42 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1621 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:42.911023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f2c969f0-2927-48bc-9b82-937f1b8daeac tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:42.911758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f2c969f0-2927-48bc-9b82-937f1b8daeac tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:42.927823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c969f0-2927-48bc-9b82-937f1b8daeac tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:42.930651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c969f0-2927-48bc-9b82-937f1b8daeac tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:42.931940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c969f0-2927-48bc-9b82-937f1b8daeac tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:42.934771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c969f0-2927-48bc-9b82-937f1b8daeac tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:42.935507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c969f0-2927-48bc-9b82-937f1b8daeac tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:42.937030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c969f0-2927-48bc-9b82-937f1b8daeac tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:42.952292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-35006975-d675-458f-bd0e-4ab86aad9708 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:42.968022 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-35006975-d675-458f-bd0e-4ab86aad9708 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1307 microversion: 2.1 time: 0.600945 Aug 23 18:02:42.972678 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1418/2818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:42 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1307 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:02:42.986722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac7d8f10-fc05-4674-aae0-e8e1e6589b38 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:42.991114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac7d8f10-fc05-4674-aae0-e8e1e6589b38 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] [instance: e1adfb52-d290-451a-89bf-4d63824150c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:43.005788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7d8f10-fc05-4674-aae0-e8e1e6589b38 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:43.007467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7d8f10-fc05-4674-aae0-e8e1e6589b38 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:43.008396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7d8f10-fc05-4674-aae0-e8e1e6589b38 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:43.009810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7d8f10-fc05-4674-aae0-e8e1e6589b38 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:43.011545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7d8f10-fc05-4674-aae0-e8e1e6589b38 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:43.012553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7d8f10-fc05-4674-aae0-e8e1e6589b38 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:43.156346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f2c969f0-2927-48bc-9b82-937f1b8daeac tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:43.169580 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f2c969f0-2927-48bc-9b82-937f1b8daeac tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1273 microversion: 2.1 time: 0.267781 Aug 23 18:02:43.175581 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1401/2819] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:42 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1273 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:43.281045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fbbf5f48-1bf9-41be-9ca5-4d64b4e2137c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:43.282085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fbbf5f48-1bf9-41be-9ca5-4d64b4e2137c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:43.290145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbbf5f48-1bf9-41be-9ca5-4d64b4e2137c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:43.293079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbbf5f48-1bf9-41be-9ca5-4d64b4e2137c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:43.293792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbbf5f48-1bf9-41be-9ca5-4d64b4e2137c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:43.298687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbbf5f48-1bf9-41be-9ca5-4d64b4e2137c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:43.299417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbbf5f48-1bf9-41be-9ca5-4d64b4e2137c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:43.300064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbbf5f48-1bf9-41be-9ca5-4d64b4e2137c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:43.477841 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac7d8f10-fc05-4674-aae0-e8e1e6589b38 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5" status: 200 len: 1621 microversion: 2.1 time: 0.503724 Aug 23 18:02:43.486988 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1419/2820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:42 2022] GET /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5 => generated 1621 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:43.508802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-699d595a-ce35-48b5-9127-3df738050cd0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Action: 'create', calling method: .version_select at 0x7f27dfa92160>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1786925883", "policies": ["anti-affinity"]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:43.552675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-699d595a-ce35-48b5-9127-3df738050cd0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:43.565353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-699d595a-ce35-48b5-9127-3df738050cd0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:43.651002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-699d595a-ce35-48b5-9127-3df738050cd0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:43.662936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-699d595a-ce35-48b5-9127-3df738050cd0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:43.679125 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-699d595a-ce35-48b5-9127-3df738050cd0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.174419 Aug 23 18:02:43.680132 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1420/2821] 10.222.0.61 () {60 vars in 1174 bytes} [Tue Aug 23 18:02:43 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:02:44.002229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8dfee035-4482-40c3-9ea5-6c5dd93525b1 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:44.005094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8dfee035-4482-40c3-9ea5-6c5dd93525b1 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:44.020345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfee035-4482-40c3-9ea5-6c5dd93525b1 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:44.022752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfee035-4482-40c3-9ea5-6c5dd93525b1 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:44.023528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfee035-4482-40c3-9ea5-6c5dd93525b1 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:44.027523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfee035-4482-40c3-9ea5-6c5dd93525b1 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:44.028197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfee035-4482-40c3-9ea5-6c5dd93525b1 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:44.030314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfee035-4482-40c3-9ea5-6c5dd93525b1 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:44.301702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fbbf5f48-1bf9-41be-9ca5-4d64b4e2137c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:44.318639 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fbbf5f48-1bf9-41be-9ca5-4d64b4e2137c tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1575 microversion: 2.1 time: 1.039040 Aug 23 18:02:44.320108 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1402/2822] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:43 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1575 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:44.335670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-582836935", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "251f1c1a-dc2e-49fe-afa8-4dae7e69d420"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:44.433712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:02:44.567862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8dfee035-4482-40c3-9ea5-6c5dd93525b1 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:44.574177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:44.581538 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8dfee035-4482-40c3-9ea5-6c5dd93525b1 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1307 microversion: 2.1 time: 0.589401 Aug 23 18:02:44.598872 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1421/2823] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:43 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1307 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:02:44.606186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-20da14eb-c709-48a5-a96a-c5688c15e0d0 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:44.606186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-20da14eb-c709-48a5-a96a-c5688c15e0d0 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:44.629596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20da14eb-c709-48a5-a96a-c5688c15e0d0 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:44.630103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20da14eb-c709-48a5-a96a-c5688c15e0d0 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:44.630577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20da14eb-c709-48a5-a96a-c5688c15e0d0 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:44.631463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20da14eb-c709-48a5-a96a-c5688c15e0d0 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:44.632001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20da14eb-c709-48a5-a96a-c5688c15e0d0 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:44.632440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20da14eb-c709-48a5-a96a-c5688c15e0d0 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:44.764248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-20da14eb-c709-48a5-a96a-c5688c15e0d0 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:44.777996 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-20da14eb-c709-48a5-a96a-c5688c15e0d0 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1279 microversion: 2.1 time: 0.178053 Aug 23 18:02:44.778782 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1422/2824] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:44 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:45.349538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-41fe230f-df1f-41ea-bce2-b9659b1615fe tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:45.350418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-41fe230f-df1f-41ea-bce2-b9659b1615fe tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:45.368713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:02:45.369641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:02:45.370280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:02:45.371211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:02:45.371311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:02:45.379901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-41fe230f-df1f-41ea-bce2-b9659b1615fe tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:45.380399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-41fe230f-df1f-41ea-bce2-b9659b1615fe tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:45.380842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-41fe230f-df1f-41ea-bce2-b9659b1615fe tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:45.381567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-41fe230f-df1f-41ea-bce2-b9659b1615fe tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:45.382024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-41fe230f-df1f-41ea-bce2-b9659b1615fe tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:45.382455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-41fe230f-df1f-41ea-bce2-b9659b1615fe tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:45.455020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:45.455852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:45.456467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:45.457432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:45.458064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:45.458836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:45.502434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:45.508381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:45.544479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Going to run 2 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:02:45.548329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 115be13c-aace-4476-be96-7ae226d6fe10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:02:45.644180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=128807) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Aug 23 18:02:45.674899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:45.682978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:45.748392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:45.756332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:45.763481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-41fe230f-df1f-41ea-bce2-b9659b1615fe tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:45.774662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=115be13c-aace-4476-be96-7ae226d6fe10,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:02:45.777676 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-41fe230f-df1f-41ea-bce2-b9659b1615fe tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1575 microversion: 2.1 time: 0.432012 Aug 23 18:02:45.778292 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1423/2825] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:45 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1575 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:45.795373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-95b9979b-d9a2-4fec-950d-580057080cad tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:45.796189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-95b9979b-d9a2-4fec-950d-580057080cad tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:45.802992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95b9979b-d9a2-4fec-950d-580057080cad tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:45.803652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95b9979b-d9a2-4fec-950d-580057080cad tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:45.804248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95b9979b-d9a2-4fec-950d-580057080cad tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:45.805145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95b9979b-d9a2-4fec-950d-580057080cad tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:45.805758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95b9979b-d9a2-4fec-950d-580057080cad tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:45.806338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95b9979b-d9a2-4fec-950d-580057080cad tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:45.834919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:45.849451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:45.863296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:45.916971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:02:45.925565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'server_group_members'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:02:45.991675 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fb2fce57-5a54-45a5-a6d8-d531a14619e6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.669021 Aug 23 18:02:45.995192 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1403/2826] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:02:44 2022] POST /compute/v2.1/servers => generated 32 bytes in 1671 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Aug 23 18:02:46.005120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e13f8750-8560-40e7-9dfb-b0900740ab42 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:46.005760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e13f8750-8560-40e7-9dfb-b0900740ab42 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:46.014087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e13f8750-8560-40e7-9dfb-b0900740ab42 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:46.014293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e13f8750-8560-40e7-9dfb-b0900740ab42 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:46.014734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e13f8750-8560-40e7-9dfb-b0900740ab42 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:46.016585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e13f8750-8560-40e7-9dfb-b0900740ab42 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:46.017721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e13f8750-8560-40e7-9dfb-b0900740ab42 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:46.018174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e13f8750-8560-40e7-9dfb-b0900740ab42 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:46.095753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-95b9979b-d9a2-4fec-950d-580057080cad tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:46.105973 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-95b9979b-d9a2-4fec-950d-580057080cad tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1307 microversion: 2.1 time: 0.314226 Aug 23 18:02:46.106584 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1424/2827] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:45 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1307 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:46.120566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3873129-8220-46dd-ad1a-b216d04a758d tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:46.121190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f3873129-8220-46dd-ad1a-b216d04a758d tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:46.134233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3873129-8220-46dd-ad1a-b216d04a758d tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:46.140392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3873129-8220-46dd-ad1a-b216d04a758d tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:46.141494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3873129-8220-46dd-ad1a-b216d04a758d tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:46.142269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3873129-8220-46dd-ad1a-b216d04a758d tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:46.142772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3873129-8220-46dd-ad1a-b216d04a758d tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:46.149348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3873129-8220-46dd-ad1a-b216d04a758d tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:46.286336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f3873129-8220-46dd-ad1a-b216d04a758d tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:46.299904 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f3873129-8220-46dd-ad1a-b216d04a758d tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1279 microversion: 2.1 time: 0.192222 Aug 23 18:02:46.312555 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1425/2828] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:46 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1279 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:46.317917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-55ad1922-a93e-465c-9053-aa13a20dc767 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:46.333818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-55ad1922-a93e-465c-9053-aa13a20dc767 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:46.334500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-55ad1922-a93e-465c-9053-aa13a20dc767 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Searching by: {'deleted': False, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:02:46.346486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e13f8750-8560-40e7-9dfb-b0900740ab42 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:46.357016 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e13f8750-8560-40e7-9dfb-b0900740ab42 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.363031 Aug 23 18:02:46.357604 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1404/2829] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:45 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:46.381680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55ad1922-a93e-465c-9053-aa13a20dc767 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:46.382040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aa7bf3d7-da8b-44d2-8b2b-3434617cda6c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-289166344"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:46.390103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aa7bf3d7-da8b-44d2-8b2b-3434617cda6c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:46.398700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55ad1922-a93e-465c-9053-aa13a20dc767 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:46.400224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55ad1922-a93e-465c-9053-aa13a20dc767 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:46.401207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55ad1922-a93e-465c-9053-aa13a20dc767 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:46.402084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55ad1922-a93e-465c-9053-aa13a20dc767 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:46.405167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55ad1922-a93e-465c-9053-aa13a20dc767 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:46.405800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa7bf3d7-da8b-44d2-8b2b-3434617cda6c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:46.406303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa7bf3d7-da8b-44d2-8b2b-3434617cda6c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:46.414633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa7bf3d7-da8b-44d2-8b2b-3434617cda6c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:46.415430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa7bf3d7-da8b-44d2-8b2b-3434617cda6c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:46.415858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa7bf3d7-da8b-44d2-8b2b-3434617cda6c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:46.416437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa7bf3d7-da8b-44d2-8b2b-3434617cda6c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:46.465237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-55ad1922-a93e-465c-9053-aa13a20dc767 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:02:46.537186 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-55ad1922-a93e-465c-9053-aa13a20dc767 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1660 microversion: 2.1 time: 0.231111 Aug 23 18:02:46.543147 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1426/2830] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 18:02:46 2022] GET /compute/v2.1/servers => generated 1660 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:46.556409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-88a18bbb-31f8-49f0-9487-deebc4d4a81a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:46.557431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-88a18bbb-31f8-49f0-9487-deebc4d4a81a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:46.795704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-88a18bbb-31f8-49f0-9487-deebc4d4a81a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:46.808376 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-88a18bbb-31f8-49f0-9487-deebc4d4a81a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1218 microversion: 2.1 time: 0.255006 Aug 23 18:02:46.810160 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1427/2831] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:46 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1218 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:02:46.827525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5c002e96-52f9-450a-8cbf-fd2b6aa8eb27 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:46.829486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5c002e96-52f9-450a-8cbf-fd2b6aa8eb27 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:46.847265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c002e96-52f9-450a-8cbf-fd2b6aa8eb27 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:46.849141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c002e96-52f9-450a-8cbf-fd2b6aa8eb27 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:46.850958 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aa7bf3d7-da8b-44d2-8b2b-3434617cda6c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.475249 Aug 23 18:02:46.851095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c002e96-52f9-450a-8cbf-fd2b6aa8eb27 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:46.856065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c002e96-52f9-450a-8cbf-fd2b6aa8eb27 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:46.856065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c002e96-52f9-450a-8cbf-fd2b6aa8eb27 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:46.857537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c002e96-52f9-450a-8cbf-fd2b6aa8eb27 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:46.861500 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1405/2832] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:02:46 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 488 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Aug 23 18:02:46.869061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9bef418d-6edc-40d6-89c1-cc082ff008a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:46.869769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9bef418d-6edc-40d6-89c1-cc082ff008a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:46.888182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bef418d-6edc-40d6-89c1-cc082ff008a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:46.895654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bef418d-6edc-40d6-89c1-cc082ff008a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:46.899942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bef418d-6edc-40d6-89c1-cc082ff008a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:46.900948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bef418d-6edc-40d6-89c1-cc082ff008a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:46.902394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bef418d-6edc-40d6-89c1-cc082ff008a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:46.903857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bef418d-6edc-40d6-89c1-cc082ff008a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:47.389401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5c002e96-52f9-450a-8cbf-fd2b6aa8eb27 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:47.405219 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5c002e96-52f9-450a-8cbf-fd2b6aa8eb27 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1580 microversion: 2.1 time: 0.593152 Aug 23 18:02:47.406397 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1428/2833] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:46 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1580 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:47.415072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-cb51db8d-f281-45d9-a04e-91194a993f1f req-e4edfd43-60d7-4272-ba5f-fb3872352513 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769e5a46-b0fd-49a3-bffa-1538728a67cc", "name": "network-vif-plugged", "status": "completed", "tag": "4df03a69-a606-4878-8aa1-164f4e89e488"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:47.428144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cb51db8d-f281-45d9-a04e-91194a993f1f req-e4edfd43-60d7-4272-ba5f-fb3872352513 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:47.428989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cb51db8d-f281-45d9-a04e-91194a993f1f req-e4edfd43-60d7-4272-ba5f-fb3872352513 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:47.440998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cb51db8d-f281-45d9-a04e-91194a993f1f req-e4edfd43-60d7-4272-ba5f-fb3872352513 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:47.445796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9bef418d-6edc-40d6-89c1-cc082ff008a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:47.449739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:47.457661 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9bef418d-6edc-40d6-89c1-cc082ff008a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.592775 Aug 23 18:02:47.474578 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1406/2834] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:46 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:47.474814 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-cb51db8d-f281-45d9-a04e-91194a993f1f req-e4edfd43-60d7-4272-ba5f-fb3872352513 service nova] Creating event network-vif-plugged:4df03a69-a606-4878-8aa1-164f4e89e488 for instance 769e5a46-b0fd-49a3-bffa-1538728a67cc on n-h1-850468-16 Aug 23 18:02:47.477193 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-cb51db8d-f281-45d9-a04e-91194a993f1f req-e4edfd43-60d7-4272-ba5f-fb3872352513 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068321 Aug 23 18:02:47.478953 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1429/2835] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:47.481480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b5c330a9-1cdc-40de-b56f-9455b297acb5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:47.484334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b5c330a9-1cdc-40de-b56f-9455b297acb5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:47.495568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-86db4a5a-7419-4ec4-a467-d272672ec4fb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:47.497015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-86db4a5a-7419-4ec4-a467-d272672ec4fb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:47.504955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86db4a5a-7419-4ec4-a467-d272672ec4fb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:47.507318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86db4a5a-7419-4ec4-a467-d272672ec4fb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:47.508480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86db4a5a-7419-4ec4-a467-d272672ec4fb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:47.510173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86db4a5a-7419-4ec4-a467-d272672ec4fb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:47.511092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86db4a5a-7419-4ec4-a467-d272672ec4fb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:47.511687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86db4a5a-7419-4ec4-a467-d272672ec4fb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:47.513215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5c330a9-1cdc-40de-b56f-9455b297acb5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:47.513215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5c330a9-1cdc-40de-b56f-9455b297acb5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:47.515562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5c330a9-1cdc-40de-b56f-9455b297acb5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:47.518588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5c330a9-1cdc-40de-b56f-9455b297acb5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:47.519941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5c330a9-1cdc-40de-b56f-9455b297acb5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:47.520571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5c330a9-1cdc-40de-b56f-9455b297acb5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:47.750736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-86db4a5a-7419-4ec4-a467-d272672ec4fb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:47.761233 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-86db4a5a-7419-4ec4-a467-d272672ec4fb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1321 microversion: 2.1 time: 0.280807 Aug 23 18:02:47.761725 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1430/2836] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:47 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1321 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:47.830353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f8e84aea-aba7-4657-9be4-257ccd64c358 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:47.831061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f8e84aea-aba7-4657-9be4-257ccd64c358 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:47.850292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8e84aea-aba7-4657-9be4-257ccd64c358 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:47.851423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8e84aea-aba7-4657-9be4-257ccd64c358 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:47.853136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8e84aea-aba7-4657-9be4-257ccd64c358 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:47.854781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8e84aea-aba7-4657-9be4-257ccd64c358 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:47.857293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8e84aea-aba7-4657-9be4-257ccd64c358 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:47.860279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8e84aea-aba7-4657-9be4-257ccd64c358 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:47.935806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f8e84aea-aba7-4657-9be4-257ccd64c358 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:47.949505 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f8e84aea-aba7-4657-9be4-257ccd64c358 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1214 microversion: 2.1 time: 0.123493 Aug 23 18:02:47.950765 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1431/2837] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:47 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1214 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:48.095957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b5c330a9-1cdc-40de-b56f-9455b297acb5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:48.107787 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b5c330a9-1cdc-40de-b56f-9455b297acb5 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1307 microversion: 2.1 time: 0.641521 Aug 23 18:02:48.108388 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1407/2838] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:47 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1307 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:48.432935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-02e5f5b9-d404-4784-bd96-04cf136df2e5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:48.432935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-02e5f5b9-d404-4784-bd96-04cf136df2e5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:48.439829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02e5f5b9-d404-4784-bd96-04cf136df2e5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:48.440535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02e5f5b9-d404-4784-bd96-04cf136df2e5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:48.441169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02e5f5b9-d404-4784-bd96-04cf136df2e5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:48.442045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02e5f5b9-d404-4784-bd96-04cf136df2e5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:48.442682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02e5f5b9-d404-4784-bd96-04cf136df2e5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:48.443275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02e5f5b9-d404-4784-bd96-04cf136df2e5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:48.488128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-62989b91-ee7e-4698-805c-0854b841a0bc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:48.488688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-62989b91-ee7e-4698-805c-0854b841a0bc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:48.499697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62989b91-ee7e-4698-805c-0854b841a0bc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:48.500257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62989b91-ee7e-4698-805c-0854b841a0bc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:48.502911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62989b91-ee7e-4698-805c-0854b841a0bc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:48.503656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62989b91-ee7e-4698-805c-0854b841a0bc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:48.504127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62989b91-ee7e-4698-805c-0854b841a0bc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:48.504563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62989b91-ee7e-4698-805c-0854b841a0bc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:48.635266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-02e5f5b9-d404-4784-bd96-04cf136df2e5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:48.650107 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-02e5f5b9-d404-4784-bd96-04cf136df2e5 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1573 microversion: 2.1 time: 0.221545 Aug 23 18:02:48.653565 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1432/2839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:48 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1573 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:48.679455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-09e57b26-7fdb-4b63-b27e-c5905a0b3fc9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1351673955"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:48.680756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-09e57b26-7fdb-4b63-b27e-c5905a0b3fc9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:48.690402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09e57b26-7fdb-4b63-b27e-c5905a0b3fc9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:48.691102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09e57b26-7fdb-4b63-b27e-c5905a0b3fc9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:48.691771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09e57b26-7fdb-4b63-b27e-c5905a0b3fc9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:48.692673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09e57b26-7fdb-4b63-b27e-c5905a0b3fc9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:48.693150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09e57b26-7fdb-4b63-b27e-c5905a0b3fc9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:48.693596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09e57b26-7fdb-4b63-b27e-c5905a0b3fc9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:48.887713 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.network.security_group_api [None req-09e57b26-7fdb-4b63-b27e-c5905a0b3fc9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Adding security group 2b653ae9-b74b-41d7-a31b-e188aa03c959 to port ef77fd36-df98-4b26-8ab3-e446ba4d3c6d Aug 23 18:02:49.345081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-62989b91-ee7e-4698-805c-0854b841a0bc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:49.361084 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-62989b91-ee7e-4698-805c-0854b841a0bc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.876037 Aug 23 18:02:49.386768 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1408/2840] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:48 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 896 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:49.396329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f4c2bdd1-47e5-42e3-a721-9e0f060093d6 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:49.397631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f4c2bdd1-47e5-42e3-a721-9e0f060093d6 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:49.410702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4c2bdd1-47e5-42e3-a721-9e0f060093d6 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:49.411741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4c2bdd1-47e5-42e3-a721-9e0f060093d6 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:49.412620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4c2bdd1-47e5-42e3-a721-9e0f060093d6 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:49.414718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4c2bdd1-47e5-42e3-a721-9e0f060093d6 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:49.416616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4c2bdd1-47e5-42e3-a721-9e0f060093d6 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:49.417643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4c2bdd1-47e5-42e3-a721-9e0f060093d6 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:49.853090 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-09e57b26-7fdb-4b63-b27e-c5905a0b3fc9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c/action" status: 202 len: 0 microversion: 2.1 time: 1.178235 Aug 23 18:02:49.857490 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1433/2841] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:02:48 2022] POST /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c/action => generated 0 bytes in 1185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:02:49.871581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eeca3ced-454c-44da-8def-b1b278ec0a47 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:49.874440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eeca3ced-454c-44da-8def-b1b278ec0a47 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:49.901467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eeca3ced-454c-44da-8def-b1b278ec0a47 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:49.905242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eeca3ced-454c-44da-8def-b1b278ec0a47 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:49.906066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eeca3ced-454c-44da-8def-b1b278ec0a47 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:49.909096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eeca3ced-454c-44da-8def-b1b278ec0a47 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:49.910915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eeca3ced-454c-44da-8def-b1b278ec0a47 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:49.911731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eeca3ced-454c-44da-8def-b1b278ec0a47 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:50.124322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eeca3ced-454c-44da-8def-b1b278ec0a47 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:50.139820 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eeca3ced-454c-44da-8def-b1b278ec0a47 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1276 microversion: 2.1 time: 0.277400 Aug 23 18:02:50.147436 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1434/2842] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:49 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1276 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:50.162989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d77f17c5-417d-41c9-a780-4096f3fd7584 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:50.163623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d77f17c5-417d-41c9-a780-4096f3fd7584 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:50.176276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d77f17c5-417d-41c9-a780-4096f3fd7584 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:50.177194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d77f17c5-417d-41c9-a780-4096f3fd7584 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:50.177853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d77f17c5-417d-41c9-a780-4096f3fd7584 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:50.178730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d77f17c5-417d-41c9-a780-4096f3fd7584 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:50.179445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d77f17c5-417d-41c9-a780-4096f3fd7584 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:50.180123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d77f17c5-417d-41c9-a780-4096f3fd7584 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:50.202281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f4c2bdd1-47e5-42e3-a721-9e0f060093d6 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:50.213131 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f4c2bdd1-47e5-42e3-a721-9e0f060093d6 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1321 microversion: 2.1 time: 0.824575 Aug 23 18:02:50.237857 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1409/2843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:49 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1321 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:50.249482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-94c53895-52de-4a33-9e87-02173234997e req-0225fe80-5498-42ad-b39d-4c8f18f6e7e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d81bbbc-0ed1-445b-a321-b2175e975725", "name": "network-vif-unplugged", "status": "completed", "tag": "c9a2077a-21a0-4f0d-846d-bbb4743c4fa4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:50.276979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-94c53895-52de-4a33-9e87-02173234997e req-0225fe80-5498-42ad-b39d-4c8f18f6e7e9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:50.278150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-94c53895-52de-4a33-9e87-02173234997e req-0225fe80-5498-42ad-b39d-4c8f18f6e7e9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:50.284175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-94c53895-52de-4a33-9e87-02173234997e req-0225fe80-5498-42ad-b39d-4c8f18f6e7e9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:50.302712 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-94c53895-52de-4a33-9e87-02173234997e req-0225fe80-5498-42ad-b39d-4c8f18f6e7e9 service nova] Creating event network-vif-unplugged:c9a2077a-21a0-4f0d-846d-bbb4743c4fa4 for instance 9d81bbbc-0ed1-445b-a321-b2175e975725 on n-h1-850468-16 Aug 23 18:02:50.321389 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-94c53895-52de-4a33-9e87-02173234997e req-0225fe80-5498-42ad-b39d-4c8f18f6e7e9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.079701 Aug 23 18:02:50.324395 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1410/2844] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:50.334640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cb039ef-6927-40ba-911a-3a0d64dfaa69 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27ecb744c0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:50.406215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d77f17c5-417d-41c9-a780-4096f3fd7584 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:50.415429 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d77f17c5-417d-41c9-a780-4096f3fd7584 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1307 microversion: 2.1 time: 0.266331 Aug 23 18:02:50.416369 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1435/2845] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:50 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1307 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:50.433878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-2a373035-c62d-4807-af71-b255ed9f4ab1 req-f2f7b631-2a01-47c4-8ae8-b0dce5b7f907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "264db24e-173d-46bb-8f6c-8a86eee0a70c", "tag": "ef77fd36-df98-4b26-8ab3-e446ba4d3c6d"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:50.446424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2a373035-c62d-4807-af71-b255ed9f4ab1 req-f2f7b631-2a01-47c4-8ae8-b0dce5b7f907 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:50.447020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2a373035-c62d-4807-af71-b255ed9f4ab1 req-f2f7b631-2a01-47c4-8ae8-b0dce5b7f907 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:50.447528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2a373035-c62d-4807-af71-b255ed9f4ab1 req-f2f7b631-2a01-47c4-8ae8-b0dce5b7f907 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:50.460138 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-2a373035-c62d-4807-af71-b255ed9f4ab1 req-f2f7b631-2a01-47c4-8ae8-b0dce5b7f907 service nova] Creating event network-changed:ef77fd36-df98-4b26-8ab3-e446ba4d3c6d for instance 264db24e-173d-46bb-8f6c-8a86eee0a70c on n-h1-850468-16 Aug 23 18:02:50.465152 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-2a373035-c62d-4807-af71-b255ed9f4ab1 req-f2f7b631-2a01-47c4-8ae8-b0dce5b7f907 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035957 Aug 23 18:02:50.466261 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1436/2846] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:50.472800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-97651c21-a041-4f2c-8a8b-0cd986bb6926 req-d8e9b55d-1034-4f7d-a27c-02e83f5ee671 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36016e6f-16b3-47fe-8f99-dcc878c83e34", "tag": "c6a1d58c-1f7a-400a-b17a-eaceccb995f5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:50.482488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-97651c21-a041-4f2c-8a8b-0cd986bb6926 req-d8e9b55d-1034-4f7d-a27c-02e83f5ee671 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:50.483087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-97651c21-a041-4f2c-8a8b-0cd986bb6926 req-d8e9b55d-1034-4f7d-a27c-02e83f5ee671 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:50.483588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-97651c21-a041-4f2c-8a8b-0cd986bb6926 req-d8e9b55d-1034-4f7d-a27c-02e83f5ee671 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:50.496347 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-97651c21-a041-4f2c-8a8b-0cd986bb6926 req-d8e9b55d-1034-4f7d-a27c-02e83f5ee671 service nova] Creating event network-changed:c6a1d58c-1f7a-400a-b17a-eaceccb995f5 for instance 36016e6f-16b3-47fe-8f99-dcc878c83e34 on n-h2-850468-16 Aug 23 18:02:50.501627 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-97651c21-a041-4f2c-8a8b-0cd986bb6926 req-d8e9b55d-1034-4f7d-a27c-02e83f5ee671 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033957 Aug 23 18:02:50.502463 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1437/2847] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:50.508171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d47e85be-562e-428c-9840-501157ba1f64 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:50.509976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d47e85be-562e-428c-9840-501157ba1f64 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:50.516665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d47e85be-562e-428c-9840-501157ba1f64 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:50.517244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d47e85be-562e-428c-9840-501157ba1f64 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:50.517814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d47e85be-562e-428c-9840-501157ba1f64 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:50.518624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d47e85be-562e-428c-9840-501157ba1f64 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:50.519287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d47e85be-562e-428c-9840-501157ba1f64 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:50.519801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d47e85be-562e-428c-9840-501157ba1f64 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:50.816814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d47e85be-562e-428c-9840-501157ba1f64 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:50.826639 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d47e85be-562e-428c-9840-501157ba1f64 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.322822 Aug 23 18:02:50.828198 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1438/2848] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:50 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:51.125497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-0cb039ef-6927-40ba-911a-3a0d64dfaa69 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 2b653ae9-b74b-41d7-a31b-e188aa03c959 in use.", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:02:51.126444 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-0cb039ef-6927-40ba-911a-3a0d64dfaa69 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Security Group 2b653ae9-b74b-41d7-a31b-e188aa03c959 in use. Aug 23 18:02:51.126444 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-b1111493-599d-4f51-b7e8-03f709891fd9'] Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cb039ef-6927-40ba-911a-3a0d64dfaa69 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-security-groups/2b653ae9-b74b-41d7-a31b-e188aa03c959 HTTP/1.1 Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: exception: Security Group 2b653ae9-b74b-41d7-a31b-e188aa03c959 in use. Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-b1111493-599d-4f51-b7e8-03f709891fd9'] Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2b653ae9-b74b-41d7-a31b-e188aa03c959'} Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:02:51.128702 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 2b653ae9-b74b-41d7-a31b-e188aa03c959 in use. Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1111493-599d-4f51-b7e8-03f709891fd9'] Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 2b653ae9-b74b-41d7-a31b-e188aa03c959 in use. Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1111493-599d-4f51-b7e8-03f709891fd9'] Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 2b653ae9-b74b-41d7-a31b-e188aa03c959 in use. Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1111493-599d-4f51-b7e8-03f709891fd9'] Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 2b653ae9-b74b-41d7-a31b-e188aa03c959 in use. Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b1111493-599d-4f51-b7e8-03f709891fd9'] Aug 23 18:02:51.132824 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:51.140923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cb039ef-6927-40ba-911a-3a0d64dfaa69 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 400 to user: Security Group 2b653ae9-b74b-41d7-a31b-e188aa03c959 in use. Aug 23 18:02:51.140923 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-b1111493-599d-4f51-b7e8-03f709891fd9'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:02:51.141814 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0cb039ef-6927-40ba-911a-3a0d64dfaa69 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/2b653ae9-b74b-41d7-a31b-e188aa03c959" status: 400 len: 185 microversion: 2.1 time: 0.815833 Aug 23 18:02:51.142729 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1411/2849] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:02:50 2022] DELETE /compute/v2.1/os-security-groups/2b653ae9-b74b-41d7-a31b-e188aa03c959 => generated 185 bytes in 817 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:02:51.150703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-555031ee-bb1c-4153-b344-1f8cf2f64570 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:51.151300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-555031ee-bb1c-4153-b344-1f8cf2f64570 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:51.163310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3035b254-ac83-412c-a138-9ab37dac4517 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:51.164060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3035b254-ac83-412c-a138-9ab37dac4517 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:51.165263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-555031ee-bb1c-4153-b344-1f8cf2f64570 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.165839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-555031ee-bb1c-4153-b344-1f8cf2f64570 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.166292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-555031ee-bb1c-4153-b344-1f8cf2f64570 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.167064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-555031ee-bb1c-4153-b344-1f8cf2f64570 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.167530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-555031ee-bb1c-4153-b344-1f8cf2f64570 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.167966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-555031ee-bb1c-4153-b344-1f8cf2f64570 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.180878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3035b254-ac83-412c-a138-9ab37dac4517 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.181995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3035b254-ac83-412c-a138-9ab37dac4517 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.182805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3035b254-ac83-412c-a138-9ab37dac4517 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.183816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3035b254-ac83-412c-a138-9ab37dac4517 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.184519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3035b254-ac83-412c-a138-9ab37dac4517 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.186345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3035b254-ac83-412c-a138-9ab37dac4517 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.199339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-555031ee-bb1c-4153-b344-1f8cf2f64570 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:02:51.268489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:51.306000 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-555031ee-bb1c-4153-b344-1f8cf2f64570 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 204 len: 0 microversion: 2.1 time: 0.158900 Aug 23 18:02:51.310298 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1439/2850] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:02:51 2022] DELETE /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:02:51.317443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-07343e21-3cc7-4797-9fae-0542be72550b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:51.318585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-07343e21-3cc7-4797-9fae-0542be72550b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:51.326939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07343e21-3cc7-4797-9fae-0542be72550b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.327701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07343e21-3cc7-4797-9fae-0542be72550b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.329958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07343e21-3cc7-4797-9fae-0542be72550b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.331346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07343e21-3cc7-4797-9fae-0542be72550b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.332100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07343e21-3cc7-4797-9fae-0542be72550b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.332998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07343e21-3cc7-4797-9fae-0542be72550b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.401145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3035b254-ac83-412c-a138-9ab37dac4517 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:51.411674 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3035b254-ac83-412c-a138-9ab37dac4517 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1276 microversion: 2.1 time: 0.252836 Aug 23 18:02:51.412642 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1412/2851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:51 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1276 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:51.417574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a6725d95-01f1-49f5-b7ab-3a273d6ab8ac tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:51.418276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a6725d95-01f1-49f5-b7ab-3a273d6ab8ac tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:51.425727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6725d95-01f1-49f5-b7ab-3a273d6ab8ac tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.426376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6725d95-01f1-49f5-b7ab-3a273d6ab8ac tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.426724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6725d95-01f1-49f5-b7ab-3a273d6ab8ac tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.427456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6725d95-01f1-49f5-b7ab-3a273d6ab8ac tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.427948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6725d95-01f1-49f5-b7ab-3a273d6ab8ac tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.428560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6725d95-01f1-49f5-b7ab-3a273d6ab8ac tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.522257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-07343e21-3cc7-4797-9fae-0542be72550b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:51.531246 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-07343e21-3cc7-4797-9fae-0542be72550b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1321 microversion: 2.1 time: 0.219069 Aug 23 18:02:51.532638 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1440/2852] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:51 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:51.537465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f5480f7-d8f8-4476-b439-c4b95a46d0c8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:51.538105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4f5480f7-d8f8-4476-b439-c4b95a46d0c8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:51.541440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:51.545245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f5480f7-d8f8-4476-b439-c4b95a46d0c8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.545798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f5480f7-d8f8-4476-b439-c4b95a46d0c8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.546430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f5480f7-d8f8-4476-b439-c4b95a46d0c8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.547435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f5480f7-d8f8-4476-b439-c4b95a46d0c8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.548121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f5480f7-d8f8-4476-b439-c4b95a46d0c8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.548684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f5480f7-d8f8-4476-b439-c4b95a46d0c8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.711705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4f5480f7-d8f8-4476-b439-c4b95a46d0c8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:51.722308 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4f5480f7-d8f8-4476-b439-c4b95a46d0c8 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1486 microversion: 2.1 time: 0.188651 Aug 23 18:02:51.723011 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1441/2853] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:51 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1486 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:51.742716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc9d4af1-8026-4288-86c4-f05a64d72b56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:51.743263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc9d4af1-8026-4288-86c4-f05a64d72b56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:51.750031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc9d4af1-8026-4288-86c4-f05a64d72b56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.751101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc9d4af1-8026-4288-86c4-f05a64d72b56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.751718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc9d4af1-8026-4288-86c4-f05a64d72b56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.752434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc9d4af1-8026-4288-86c4-f05a64d72b56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.752894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc9d4af1-8026-4288-86c4-f05a64d72b56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.753323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc9d4af1-8026-4288-86c4-f05a64d72b56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.779887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-bc9d4af1-8026-4288-86c4-f05a64d72b56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lazy-loading 'flavor' on Instance uuid 769e5a46-b0fd-49a3-bffa-1538728a67cc {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:02:51.859482 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc9d4af1-8026-4288-86c4-f05a64d72b56 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "POST /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc/action" status: 202 len: 0 microversion: 2.1 time: 0.118765 Aug 23 18:02:51.863964 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1442/2854] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:02:51 2022] POST /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:02:51.870768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ced8c843-bb14-4ab5-9f72-bcf5ab2a7c77 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:51.871808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ced8c843-bb14-4ab5-9f72-bcf5ab2a7c77 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:51.881682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ced8c843-bb14-4ab5-9f72-bcf5ab2a7c77 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.882326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ced8c843-bb14-4ab5-9f72-bcf5ab2a7c77 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.882870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ced8c843-bb14-4ab5-9f72-bcf5ab2a7c77 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:51.883839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ced8c843-bb14-4ab5-9f72-bcf5ab2a7c77 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:51.884618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ced8c843-bb14-4ab5-9f72-bcf5ab2a7c77 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:51.885745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ced8c843-bb14-4ab5-9f72-bcf5ab2a7c77 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:52.045501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ced8c843-bb14-4ab5-9f72-bcf5ab2a7c77 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:52.058047 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ced8c843-bb14-4ab5-9f72-bcf5ab2a7c77 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1687 microversion: 2.1 time: 0.191829 Aug 23 18:02:52.070825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a6725d95-01f1-49f5-b7ab-3a273d6ab8ac tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:52.072786 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1443/2855] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:51 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1687 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:52.080683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93aa8bd9-bc40-4f15-9e19-bc632c9f3ca2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:52.082629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-93aa8bd9-bc40-4f15-9e19-bc632c9f3ca2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:52.094810 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a6725d95-01f1-49f5-b7ab-3a273d6ab8ac tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1648 microversion: 2.1 time: 0.672807 Aug 23 18:02:52.094810 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1413/2856] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:51 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1648 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:52.095033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93aa8bd9-bc40-4f15-9e19-bc632c9f3ca2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:52.095033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93aa8bd9-bc40-4f15-9e19-bc632c9f3ca2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:52.095033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93aa8bd9-bc40-4f15-9e19-bc632c9f3ca2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:52.095033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93aa8bd9-bc40-4f15-9e19-bc632c9f3ca2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:52.095033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93aa8bd9-bc40-4f15-9e19-bc632c9f3ca2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:52.095033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93aa8bd9-bc40-4f15-9e19-bc632c9f3ca2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:52.263646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93aa8bd9-bc40-4f15-9e19-bc632c9f3ca2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:52.279779 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93aa8bd9-bc40-4f15-9e19-bc632c9f3ca2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1494 microversion: 2.1 time: 0.203712 Aug 23 18:02:52.281042 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1444/2857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:52 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1494 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:52.436635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0fd2c610-f5e9-4c46-a237-84678a472b0d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:52.437272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0fd2c610-f5e9-4c46-a237-84678a472b0d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:52.451001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fd2c610-f5e9-4c46-a237-84678a472b0d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:52.451526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fd2c610-f5e9-4c46-a237-84678a472b0d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:52.451967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fd2c610-f5e9-4c46-a237-84678a472b0d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:52.452693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fd2c610-f5e9-4c46-a237-84678a472b0d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:52.453149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fd2c610-f5e9-4c46-a237-84678a472b0d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:52.453665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fd2c610-f5e9-4c46-a237-84678a472b0d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:52.563687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bbcbd47a-3fc0-454b-97c2-d993975c32cd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:52.564621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bbcbd47a-3fc0-454b-97c2-d993975c32cd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:52.604205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbcbd47a-3fc0-454b-97c2-d993975c32cd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:52.606392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbcbd47a-3fc0-454b-97c2-d993975c32cd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:52.607050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbcbd47a-3fc0-454b-97c2-d993975c32cd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:52.607690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbcbd47a-3fc0-454b-97c2-d993975c32cd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:52.613824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbcbd47a-3fc0-454b-97c2-d993975c32cd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:52.614311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbcbd47a-3fc0-454b-97c2-d993975c32cd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:53.270522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bbcbd47a-3fc0-454b-97c2-d993975c32cd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:53.286392 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bbcbd47a-3fc0-454b-97c2-d993975c32cd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1321 microversion: 2.1 time: 0.732275 Aug 23 18:02:53.289107 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1445/2858] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:52 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1321 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:53.309257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a3f35f4-f6bc-43d9-8380-66832ba064e3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:53.310212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8a3f35f4-f6bc-43d9-8380-66832ba064e3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:53.319187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0fd2c610-f5e9-4c46-a237-84678a472b0d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:53.327119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a3f35f4-f6bc-43d9-8380-66832ba064e3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:53.327770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a3f35f4-f6bc-43d9-8380-66832ba064e3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:53.328051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a3f35f4-f6bc-43d9-8380-66832ba064e3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:53.331645 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0fd2c610-f5e9-4c46-a237-84678a472b0d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1318 microversion: 2.1 time: 0.897238 Aug 23 18:02:53.331967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a3f35f4-f6bc-43d9-8380-66832ba064e3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:53.332466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a3f35f4-f6bc-43d9-8380-66832ba064e3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:53.332922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a3f35f4-f6bc-43d9-8380-66832ba064e3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:53.336426 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1414/2859] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:52 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1318 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:53.361469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a18ed043-17aa-439c-8cec-06e34e8f0655 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:53.363241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a18ed043-17aa-439c-8cec-06e34e8f0655 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:53.379929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a18ed043-17aa-439c-8cec-06e34e8f0655 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:53.381719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a18ed043-17aa-439c-8cec-06e34e8f0655 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:53.383194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a18ed043-17aa-439c-8cec-06e34e8f0655 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:53.385641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a18ed043-17aa-439c-8cec-06e34e8f0655 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:53.386337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a18ed043-17aa-439c-8cec-06e34e8f0655 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:53.391555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a18ed043-17aa-439c-8cec-06e34e8f0655 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:53.731239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8a3f35f4-f6bc-43d9-8380-66832ba064e3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:53.744326 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8a3f35f4-f6bc-43d9-8380-66832ba064e3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1687 microversion: 2.1 time: 0.451854 Aug 23 18:02:53.744812 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1446/2860] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:53 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1687 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:53.761111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ab3d249f-6fb1-499b-a4a3-fb5b95f83238 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:53.761999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab3d249f-6fb1-499b-a4a3-fb5b95f83238 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:53.790660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab3d249f-6fb1-499b-a4a3-fb5b95f83238 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:53.791436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab3d249f-6fb1-499b-a4a3-fb5b95f83238 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:53.791981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab3d249f-6fb1-499b-a4a3-fb5b95f83238 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:53.792821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab3d249f-6fb1-499b-a4a3-fb5b95f83238 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:53.793167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab3d249f-6fb1-499b-a4a3-fb5b95f83238 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:53.793605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab3d249f-6fb1-499b-a4a3-fb5b95f83238 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:53.977407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a18ed043-17aa-439c-8cec-06e34e8f0655 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:53.994303 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a18ed043-17aa-439c-8cec-06e34e8f0655 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1648 microversion: 2.1 time: 0.655463 Aug 23 18:02:54.007115 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1415/2861] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:53 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1648 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:54.198163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ab3d249f-6fb1-499b-a4a3-fb5b95f83238 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:54.219451 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ab3d249f-6fb1-499b-a4a3-fb5b95f83238 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1494 microversion: 2.1 time: 0.469794 Aug 23 18:02:54.228049 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1447/2862] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:53 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1494 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:54.308391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d2867bb-cb71-45a7-8b81-ad11d1d3508b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:54.310062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d2867bb-cb71-45a7-8b81-ad11d1d3508b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:54.319664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d2867bb-cb71-45a7-8b81-ad11d1d3508b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:54.320854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d2867bb-cb71-45a7-8b81-ad11d1d3508b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:54.321472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d2867bb-cb71-45a7-8b81-ad11d1d3508b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:54.322494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d2867bb-cb71-45a7-8b81-ad11d1d3508b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:54.323217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d2867bb-cb71-45a7-8b81-ad11d1d3508b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:54.323958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d2867bb-cb71-45a7-8b81-ad11d1d3508b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:54.357868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce5a6212-4beb-4efb-8fe6-af9c5e48a54c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:54.358489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ce5a6212-4beb-4efb-8fe6-af9c5e48a54c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:54.368495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce5a6212-4beb-4efb-8fe6-af9c5e48a54c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:54.369804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce5a6212-4beb-4efb-8fe6-af9c5e48a54c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:54.370249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce5a6212-4beb-4efb-8fe6-af9c5e48a54c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:54.371096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce5a6212-4beb-4efb-8fe6-af9c5e48a54c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:54.371839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce5a6212-4beb-4efb-8fe6-af9c5e48a54c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:54.372421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce5a6212-4beb-4efb-8fe6-af9c5e48a54c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:54.602522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ce5a6212-4beb-4efb-8fe6-af9c5e48a54c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:54.612885 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce5a6212-4beb-4efb-8fe6-af9c5e48a54c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1318 microversion: 2.1 time: 0.259402 Aug 23 18:02:54.624665 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1448/2863] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:54 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1318 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:02:54.765938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f9c9223-3be8-4158-b9dc-2914fe4e231c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:54.766852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8f9c9223-3be8-4158-b9dc-2914fe4e231c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:54.774571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f9c9223-3be8-4158-b9dc-2914fe4e231c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:54.775314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f9c9223-3be8-4158-b9dc-2914fe4e231c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:54.775758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f9c9223-3be8-4158-b9dc-2914fe4e231c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:54.776471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f9c9223-3be8-4158-b9dc-2914fe4e231c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:54.777107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f9c9223-3be8-4158-b9dc-2914fe4e231c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:54.777689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f9c9223-3be8-4158-b9dc-2914fe4e231c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:54.794140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4d2867bb-cb71-45a7-8b81-ad11d1d3508b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:54.810008 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d2867bb-cb71-45a7-8b81-ad11d1d3508b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1321 microversion: 2.1 time: 0.505489 Aug 23 18:02:54.822574 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1416/2864] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:54 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1321 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:54.960997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-8e1c4f5b-8f50-4c3c-bf34-fdb869a9d869 req-f0f56d53-f53a-4d93-93bd-b23db3b59548 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d81bbbc-0ed1-445b-a321-b2175e975725", "name": "network-vif-plugged", "status": "completed", "tag": "c9a2077a-21a0-4f0d-846d-bbb4743c4fa4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:54.985161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8e1c4f5b-8f50-4c3c-bf34-fdb869a9d869 req-f0f56d53-f53a-4d93-93bd-b23db3b59548 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:54.985823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8e1c4f5b-8f50-4c3c-bf34-fdb869a9d869 req-f0f56d53-f53a-4d93-93bd-b23db3b59548 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:54.986236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8e1c4f5b-8f50-4c3c-bf34-fdb869a9d869 req-f0f56d53-f53a-4d93-93bd-b23db3b59548 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:55.013086 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-8e1c4f5b-8f50-4c3c-bf34-fdb869a9d869 req-f0f56d53-f53a-4d93-93bd-b23db3b59548 service nova] Creating event network-vif-plugged:c9a2077a-21a0-4f0d-846d-bbb4743c4fa4 for instance 9d81bbbc-0ed1-445b-a321-b2175e975725 on n-h1-850468-16 Aug 23 18:02:55.022773 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-8e1c4f5b-8f50-4c3c-bf34-fdb869a9d869 req-f0f56d53-f53a-4d93-93bd-b23db3b59548 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064689 Aug 23 18:02:55.024124 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1417/2865] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:55.037998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b373856e-99f2-4ec6-95c4-fb965baf57e3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:55.041474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b373856e-99f2-4ec6-95c4-fb965baf57e3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:55.051811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b373856e-99f2-4ec6-95c4-fb965baf57e3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:55.052954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b373856e-99f2-4ec6-95c4-fb965baf57e3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:55.053594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b373856e-99f2-4ec6-95c4-fb965baf57e3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:55.054589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b373856e-99f2-4ec6-95c4-fb965baf57e3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:55.055219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b373856e-99f2-4ec6-95c4-fb965baf57e3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:55.056450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b373856e-99f2-4ec6-95c4-fb965baf57e3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:55.075597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8f9c9223-3be8-4158-b9dc-2914fe4e231c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:55.094952 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f9c9223-3be8-4158-b9dc-2914fe4e231c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1687 microversion: 2.1 time: 0.332963 Aug 23 18:02:55.098820 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1449/2866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:54 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1687 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:02:55.242872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dd50a1d2-3943-4b3d-97c1-2de7e715f64a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:55.243722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dd50a1d2-3943-4b3d-97c1-2de7e715f64a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:55.271671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d2-3943-4b3d-97c1-2de7e715f64a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:55.272329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d2-3943-4b3d-97c1-2de7e715f64a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:55.273168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d2-3943-4b3d-97c1-2de7e715f64a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:55.275564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d2-3943-4b3d-97c1-2de7e715f64a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:55.278668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d2-3943-4b3d-97c1-2de7e715f64a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:55.280722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd50a1d2-3943-4b3d-97c1-2de7e715f64a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:55.300988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b373856e-99f2-4ec6-95c4-fb965baf57e3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:55.315536 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b373856e-99f2-4ec6-95c4-fb965baf57e3 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 200 len: 1468 microversion: 2.1 time: 0.283620 Aug 23 18:02:55.318060 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1418/2867] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:55 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 1468 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:55.426231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-8f7e0019-44db-430e-b509-85ba42c445d7 req-604a963d-6c2b-49f4-8e6c-d533feae8d74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "264db24e-173d-46bb-8f6c-8a86eee0a70c", "name": "network-vif-deleted", "tag": "ef77fd36-df98-4b26-8ab3-e446ba4d3c6d"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:55.465695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8f7e0019-44db-430e-b509-85ba42c445d7 req-604a963d-6c2b-49f4-8e6c-d533feae8d74 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:55.478905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8f7e0019-44db-430e-b509-85ba42c445d7 req-604a963d-6c2b-49f4-8e6c-d533feae8d74 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:55.486988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8f7e0019-44db-430e-b509-85ba42c445d7 req-604a963d-6c2b-49f4-8e6c-d533feae8d74 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:55.496840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:55.532962 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-8f7e0019-44db-430e-b509-85ba42c445d7 req-604a963d-6c2b-49f4-8e6c-d533feae8d74 service nova] Creating event network-vif-deleted:ef77fd36-df98-4b26-8ab3-e446ba4d3c6d for instance 264db24e-173d-46bb-8f6c-8a86eee0a70c on n-h1-850468-16 Aug 23 18:02:55.553626 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-8f7e0019-44db-430e-b509-85ba42c445d7 req-604a963d-6c2b-49f4-8e6c-d533feae8d74 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134307 Aug 23 18:02:55.556821 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1419/2868] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:55.646844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-02177e71-4b02-456b-971e-52c922bfe60d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:55.649125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-02177e71-4b02-456b-971e-52c922bfe60d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:55.670420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02177e71-4b02-456b-971e-52c922bfe60d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:55.671057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02177e71-4b02-456b-971e-52c922bfe60d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:55.672577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02177e71-4b02-456b-971e-52c922bfe60d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:55.674168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02177e71-4b02-456b-971e-52c922bfe60d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:55.675535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02177e71-4b02-456b-971e-52c922bfe60d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:55.676075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02177e71-4b02-456b-971e-52c922bfe60d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:55.902309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dd50a1d2-3943-4b3d-97c1-2de7e715f64a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:55.923554 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dd50a1d2-3943-4b3d-97c1-2de7e715f64a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 200 len: 1477 microversion: 2.1 time: 0.684821 Aug 23 18:02:55.928189 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1450/2869] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:55 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 1477 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:02:55.942248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-055f39cf-9376-455a-9dc3-cfa08e8fe14b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:55.943216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-055f39cf-9376-455a-9dc3-cfa08e8fe14b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:55.951299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=24 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:55.958792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-055f39cf-9376-455a-9dc3-cfa08e8fe14b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:55.959656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-055f39cf-9376-455a-9dc3-cfa08e8fe14b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:55.962302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-055f39cf-9376-455a-9dc3-cfa08e8fe14b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:55.963468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-055f39cf-9376-455a-9dc3-cfa08e8fe14b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:55.967698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-055f39cf-9376-455a-9dc3-cfa08e8fe14b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:55.968459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-055f39cf-9376-455a-9dc3-cfa08e8fe14b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:56.300951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-055f39cf-9376-455a-9dc3-cfa08e8fe14b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:56.311078 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-055f39cf-9376-455a-9dc3-cfa08e8fe14b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1321 microversion: 2.1 time: 0.379874 Aug 23 18:02:56.312140 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1451/2870] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:55 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1321 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:56.317600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e2a2d781-13c0-41b2-b640-664349a2fc0f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1263718158"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:56.320068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e2a2d781-13c0-41b2-b640-664349a2fc0f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:56.327092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2a2d781-13c0-41b2-b640-664349a2fc0f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:56.327593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2a2d781-13c0-41b2-b640-664349a2fc0f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:56.328043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2a2d781-13c0-41b2-b640-664349a2fc0f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:56.329992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2a2d781-13c0-41b2-b640-664349a2fc0f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:56.330803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2a2d781-13c0-41b2-b640-664349a2fc0f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:56.331423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2a2d781-13c0-41b2-b640-664349a2fc0f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:56.428134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=14 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:56.660451 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e2a2d781-13c0-41b2-b640-664349a2fc0f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "POST /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc/action" status: 202 len: 0 microversion: 2.1 time: 0.342824 Aug 23 18:02:56.660744 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1452/2871] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:02:56 2022] POST /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc/action => generated 0 bytes in 348 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 18:02:56.661611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-02177e71-4b02-456b-971e-52c922bfe60d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:56.675485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33bb6a12-c5de-4e76-8585-f973b87edffc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:56.676764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33bb6a12-c5de-4e76-8585-f973b87edffc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:56.678816 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-02177e71-4b02-456b-971e-52c922bfe60d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1318 microversion: 2.1 time: 1.038939 Aug 23 18:02:56.693724 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1420/2872] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:55 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1318 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:56.693724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e15dc85b-ce01-49b6-804a-4940d52c5202 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:56.693724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e15dc85b-ce01-49b6-804a-4940d52c5202 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:56.694162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33bb6a12-c5de-4e76-8585-f973b87edffc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:56.695561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33bb6a12-c5de-4e76-8585-f973b87edffc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:56.698392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33bb6a12-c5de-4e76-8585-f973b87edffc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:56.698392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33bb6a12-c5de-4e76-8585-f973b87edffc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:56.699251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33bb6a12-c5de-4e76-8585-f973b87edffc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:56.699379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33bb6a12-c5de-4e76-8585-f973b87edffc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:56.708185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15dc85b-ce01-49b6-804a-4940d52c5202 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:56.710394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15dc85b-ce01-49b6-804a-4940d52c5202 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:56.712148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15dc85b-ce01-49b6-804a-4940d52c5202 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:56.715244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15dc85b-ce01-49b6-804a-4940d52c5202 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:56.716011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15dc85b-ce01-49b6-804a-4940d52c5202 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:56.716460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15dc85b-ce01-49b6-804a-4940d52c5202 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:56.754383 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-e15dc85b-ce01-49b6-804a-4940d52c5202 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:56.755362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e15dc85b-ce01-49b6-804a-4940d52c5202 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c HTTP/1.1 Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '264db24e-173d-46bb-8f6c-8a86eee0a70c'} Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:56.757986 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:56.762136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:56.762136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:56.762136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:56.762136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:02:56.762136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:02:56.762136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:56.762136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:56.764674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e15dc85b-ce01-49b6-804a-4940d52c5202 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:02:56.767972 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e15dc85b-ce01-49b6-804a-4940d52c5202 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 404 len: 111 microversion: 2.1 time: 0.084811 Aug 23 18:02:56.770449 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1421/2873] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:56 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:02:56.782705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-be0fe702-a146-406f-82d9-4a9674992796 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec914ee0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:56.830424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=54 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:02:56.907589 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-be0fe702-a146-406f-82d9-4a9674992796 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1440 microversion: 2.1 time: 0.133832 Aug 23 18:02:56.908385 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1422/2874] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:56 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1440 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:56.919609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-213ceea5-5251-4a6c-ab54-c282ddfdf71b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27ec8f53a0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:57.055936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-33bb6a12-c5de-4e76-8585-f973b87edffc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:57.065486 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-33bb6a12-c5de-4e76-8585-f973b87edffc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1687 microversion: 2.1 time: 0.403374 Aug 23 18:02:57.066399 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1453/2875] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:56 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1687 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:57.360665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-31fca6b2-422d-4e6e-8caf-ecf6c566279a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:57.363151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-31fca6b2-422d-4e6e-8caf-ecf6c566279a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:57.401325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31fca6b2-422d-4e6e-8caf-ecf6c566279a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:57.402075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31fca6b2-422d-4e6e-8caf-ecf6c566279a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:57.409429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31fca6b2-422d-4e6e-8caf-ecf6c566279a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:57.419142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31fca6b2-422d-4e6e-8caf-ecf6c566279a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:57.419784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31fca6b2-422d-4e6e-8caf-ecf6c566279a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:57.422881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31fca6b2-422d-4e6e-8caf-ecf6c566279a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:57.666388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-31fca6b2-422d-4e6e-8caf-ecf6c566279a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:57.676855 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-31fca6b2-422d-4e6e-8caf-ecf6c566279a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1321 microversion: 2.1 time: 0.337852 Aug 23 18:02:57.677858 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1454/2876] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:57 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1321 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:57.683849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-b50ca48a-e0a6-4e74-9eea-e9e14863a9ac req-b58df1fb-6e05-4487-8f47-cb3c7354a723 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "115be13c-aace-4476-be96-7ae226d6fe10", "tag": "f371eefc-d9b1-4401-a319-ec95d61fbeaa"}, {"name": "network-changed", "server_uuid": "ba643625-f7fc-4d86-b706-fd5957739f37", "tag": "c752bba4-1778-4a12-9bcd-7ca38827dfc6"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:57.704462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b50ca48a-e0a6-4e74-9eea-e9e14863a9ac req-b58df1fb-6e05-4487-8f47-cb3c7354a723 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:57.705470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b50ca48a-e0a6-4e74-9eea-e9e14863a9ac req-b58df1fb-6e05-4487-8f47-cb3c7354a723 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:57.706410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b50ca48a-e0a6-4e74-9eea-e9e14863a9ac req-b58df1fb-6e05-4487-8f47-cb3c7354a723 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:57.726265 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b50ca48a-e0a6-4e74-9eea-e9e14863a9ac req-b58df1fb-6e05-4487-8f47-cb3c7354a723 service nova] Creating event network-changed:f371eefc-d9b1-4401-a319-ec95d61fbeaa for instance 115be13c-aace-4476-be96-7ae226d6fe10 on n-h1-850468-16 Aug 23 18:02:57.726810 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b50ca48a-e0a6-4e74-9eea-e9e14863a9ac req-b58df1fb-6e05-4487-8f47-cb3c7354a723 service nova] Creating event network-changed:c752bba4-1778-4a12-9bcd-7ca38827dfc6 for instance ba643625-f7fc-4d86-b706-fd5957739f37 on n-h2-850468-16 Aug 23 18:02:57.741928 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-b50ca48a-e0a6-4e74-9eea-e9e14863a9ac req-b58df1fb-6e05-4487-8f47-cb3c7354a723 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.062336 Aug 23 18:02:57.743249 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1455/2877] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:57.751475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b1d53938-1b6b-422e-aeda-c4355eb320ce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:57.752799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b1d53938-1b6b-422e-aeda-c4355eb320ce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:57.760052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1d53938-1b6b-422e-aeda-c4355eb320ce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:57.760995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1d53938-1b6b-422e-aeda-c4355eb320ce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:57.761625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1d53938-1b6b-422e-aeda-c4355eb320ce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:57.762532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1d53938-1b6b-422e-aeda-c4355eb320ce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:57.763165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1d53938-1b6b-422e-aeda-c4355eb320ce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:57.763751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1d53938-1b6b-422e-aeda-c4355eb320ce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:57.878677 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-213ceea5-5251-4a6c-ab54-c282ddfdf71b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/1d23a33e-35e3-4b78-9245-49023246e6dd" status: 202 len: 0 microversion: 2.1 time: 0.968292 Aug 23 18:02:57.879639 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1423/2878] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:02:56 2022] DELETE /compute/v2.1/os-security-groups/1d23a33e-35e3-4b78-9245-49023246e6dd => generated 0 bytes in 970 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:02:57.888057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97ad63e0-3696-4a50-8d0d-8a32d023c419 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27ecdf4d30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:57.987603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b1d53938-1b6b-422e-aeda-c4355eb320ce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:57.998031 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b1d53938-1b6b-422e-aeda-c4355eb320ce tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1318 microversion: 2.1 time: 0.253021 Aug 23 18:02:57.998831 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1456/2879] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:57 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:58.007487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-251ae4cd-61fe-4b55-a9ec-ba514f47eceb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec9515e0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:58.079796 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-251ae4cd-61fe-4b55-a9ec-ba514f47eceb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1440 microversion: 2.1 time: 0.078152 Aug 23 18:02:58.081922 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1457/2880] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:57 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1440 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:58.086849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7eba0454-e161-433f-838e-4d1e5eb8f643 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:58.087823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7eba0454-e161-433f-838e-4d1e5eb8f643 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:58.094765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eba0454-e161-433f-838e-4d1e5eb8f643 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:58.095516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eba0454-e161-433f-838e-4d1e5eb8f643 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:58.096134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eba0454-e161-433f-838e-4d1e5eb8f643 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:58.097219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eba0454-e161-433f-838e-4d1e5eb8f643 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:58.097875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eba0454-e161-433f-838e-4d1e5eb8f643 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:58.098496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eba0454-e161-433f-838e-4d1e5eb8f643 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:58.284758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7eba0454-e161-433f-838e-4d1e5eb8f643 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:58.298358 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7eba0454-e161-433f-838e-4d1e5eb8f643 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1682 microversion: 2.1 time: 0.215071 Aug 23 18:02:58.309712 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1458/2881] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:58 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1682 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:58.400653 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-97ad63e0-3696-4a50-8d0d-8a32d023c419 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/2b653ae9-b74b-41d7-a31b-e188aa03c959" status: 202 len: 0 microversion: 2.1 time: 0.516857 Aug 23 18:02:58.401603 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1424/2882] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:02:57 2022] DELETE /compute/v2.1/os-security-groups/2b653ae9-b74b-41d7-a31b-e188aa03c959 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:02:58.417063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-847841f0-8178-40fc-a271-1933cb411a77 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'create', calling method: .version_select at 0x7f27ecb109d0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1157043497", "description": "tempest-description-1462011804"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:58.639052 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-847841f0-8178-40fc-a271-1933cb411a77 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.226712 Aug 23 18:02:58.640041 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1459/2883] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:02:58 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:58.653795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3e9fe949-1f3e-49da-8ac2-13517bbb90d7 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Action: 'update', calling method: .version_select at 0x7f27ed2eea60>, body: {"security_group": {"name": "tempest-sg-hth-1808928158", "description": "tempest-description-hth-1284324425"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:58.703909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9e9e6b27-6fba-4537-acf3-cf18ca7b1ca7 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:58.704772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9e9e6b27-6fba-4537-acf3-cf18ca7b1ca7 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:58.718961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e9e6b27-6fba-4537-acf3-cf18ca7b1ca7 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:58.719548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e9e6b27-6fba-4537-acf3-cf18ca7b1ca7 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:58.721104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e9e6b27-6fba-4537-acf3-cf18ca7b1ca7 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:58.721886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e9e6b27-6fba-4537-acf3-cf18ca7b1ca7 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:58.722960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e9e6b27-6fba-4537-acf3-cf18ca7b1ca7 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:58.725528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e9e6b27-6fba-4537-acf3-cf18ca7b1ca7 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:59.011267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9e9e6b27-6fba-4537-acf3-cf18ca7b1ca7 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:59.022862 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9e9e6b27-6fba-4537-acf3-cf18ca7b1ca7 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1321 microversion: 2.1 time: 0.323284 Aug 23 18:02:59.023926 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1460/2884] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:58 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1321 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:59.044810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-917f1211-84a4-47c8-90ab-884b7c70c1f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:59.045773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-917f1211-84a4-47c8-90ab-884b7c70c1f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:59.055607 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3e9fe949-1f3e-49da-8ac2-13517bbb90d7 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "PUT /compute/v2.1/os-security-groups/1197e6de-8b6a-488d-a64c-fadfa1bf27e0" status: 200 len: 218 microversion: 2.1 time: 0.407156 Aug 23 18:02:59.056217 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1425/2885] 10.222.0.61 () {60 vars in 1290 bytes} [Tue Aug 23 18:02:58 2022] PUT /compute/v2.1/os-security-groups/1197e6de-8b6a-488d-a64c-fadfa1bf27e0 => generated 218 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:59.079873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b0364b08-984f-49a6-8b18-8cdd96c63f23 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27dfc2e670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:59.089385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-917f1211-84a4-47c8-90ab-884b7c70c1f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:59.093037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-917f1211-84a4-47c8-90ab-884b7c70c1f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:59.096381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-917f1211-84a4-47c8-90ab-884b7c70c1f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:59.100701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-917f1211-84a4-47c8-90ab-884b7c70c1f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:59.103689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-917f1211-84a4-47c8-90ab-884b7c70c1f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:59.104321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-917f1211-84a4-47c8-90ab-884b7c70c1f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:59.259508 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b0364b08-984f-49a6-8b18-8cdd96c63f23 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/1197e6de-8b6a-488d-a64c-fadfa1bf27e0" status: 200 len: 218 microversion: 2.1 time: 0.193000 Aug 23 18:02:59.260455 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1426/2886] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 18:02:59 2022] GET /compute/v2.1/os-security-groups/1197e6de-8b6a-488d-a64c-fadfa1bf27e0 => generated 218 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:59.285646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-36d4ad52-d1a7-4891-9b30-dbd17b46bde2 req-32dab33f-eb6b-405e-8125-60a19d2b08c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36016e6f-16b3-47fe-8f99-dcc878c83e34", "name": "network-vif-plugged", "status": "completed", "tag": "c6a1d58c-1f7a-400a-b17a-eaceccb995f5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:02:59.302975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-36d4ad52-d1a7-4891-9b30-dbd17b46bde2 req-32dab33f-eb6b-405e-8125-60a19d2b08c7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:59.304798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-36d4ad52-d1a7-4891-9b30-dbd17b46bde2 req-32dab33f-eb6b-405e-8125-60a19d2b08c7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:59.305559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-36d4ad52-d1a7-4891-9b30-dbd17b46bde2 req-32dab33f-eb6b-405e-8125-60a19d2b08c7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:59.326998 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-36d4ad52-d1a7-4891-9b30-dbd17b46bde2 req-32dab33f-eb6b-405e-8125-60a19d2b08c7 service nova] Creating event network-vif-plugged:c6a1d58c-1f7a-400a-b17a-eaceccb995f5 for instance 36016e6f-16b3-47fe-8f99-dcc878c83e34 on n-h2-850468-16 Aug 23 18:02:59.341518 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-36d4ad52-d1a7-4891-9b30-dbd17b46bde2 req-32dab33f-eb6b-405e-8125-60a19d2b08c7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065779 Aug 23 18:02:59.343498 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1427/2887] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:02:59.351402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-28fb242b-3824-40d1-9c52-ae29c8a2ec17 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec90dca0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:59.405054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-917f1211-84a4-47c8-90ab-884b7c70c1f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:59.420910 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-917f1211-84a4-47c8-90ab-884b7c70c1f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1318 microversion: 2.1 time: 0.379904 Aug 23 18:02:59.421620 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1461/2888] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:59 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1318 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:59.435820 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-28fb242b-3824-40d1-9c52-ae29c8a2ec17 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1440 microversion: 2.1 time: 0.090738 Aug 23 18:02:59.444424 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1428/2889] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:02:59 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1440 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:59.446354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-90304048-177f-4bc2-82b1-3670008b5fab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:59.447164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-90304048-177f-4bc2-82b1-3670008b5fab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:59.450243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f347372f-36fd-4dbe-83f1-09acd5f04d74 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27ec05f670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:59.456151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90304048-177f-4bc2-82b1-3670008b5fab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:59.456630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90304048-177f-4bc2-82b1-3670008b5fab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:59.457084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90304048-177f-4bc2-82b1-3670008b5fab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:59.457918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90304048-177f-4bc2-82b1-3670008b5fab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:59.458663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90304048-177f-4bc2-82b1-3670008b5fab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:59.459237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90304048-177f-4bc2-82b1-3670008b5fab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:59.783361 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f347372f-36fd-4dbe-83f1-09acd5f04d74 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/1197e6de-8b6a-488d-a64c-fadfa1bf27e0" status: 202 len: 0 microversion: 2.1 time: 0.350843 Aug 23 18:02:59.784636 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1462/2890] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:02:59 2022] DELETE /compute/v2.1/os-security-groups/1197e6de-8b6a-488d-a64c-fadfa1bf27e0 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:02:59.795458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc7b3c37-97ec-4183-898b-939672fbc137 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:59.796489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc7b3c37-97ec-4183-898b-939672fbc137 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:59.819998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7b3c37-97ec-4183-898b-939672fbc137 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:59.820702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-90304048-177f-4bc2-82b1-3670008b5fab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:02:59.823052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7b3c37-97ec-4183-898b-939672fbc137 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:59.824855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7b3c37-97ec-4183-898b-939672fbc137 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:59.829015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7b3c37-97ec-4183-898b-939672fbc137 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:59.834451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7b3c37-97ec-4183-898b-939672fbc137 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:59.835026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7b3c37-97ec-4183-898b-939672fbc137 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:59.836743 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-90304048-177f-4bc2-82b1-3670008b5fab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1682 microversion: 2.1 time: 0.391749 Aug 23 18:02:59.837368 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1429/2891] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:59 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1682 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:02:59.897962 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-bc7b3c37-97ec-4183-898b-939672fbc137 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc7b3c37-97ec-4183-898b-939672fbc137 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c HTTP/1.1 Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '264db24e-173d-46bb-8f6c-8a86eee0a70c'} Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:02:59.902243 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:02:59.906021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:59.906021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:59.906021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:59.906021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:59.906021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:59.906021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:59.906021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:59.906021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:02:59.906021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:02:59.906021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:59.906021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:02:59.909058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc7b3c37-97ec-4183-898b-939672fbc137 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:02:59.910143 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc7b3c37-97ec-4183-898b-939672fbc137 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 404 len: 111 microversion: 2.1 time: 0.121833 Aug 23 18:02:59.917222 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1463/2892] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:02:59 2022] DELETE /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 111 bytes in 128 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:02:59.933077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0ef47741-68a5-46df-9c1c-f6bd22653ef1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:02:59.934111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0ef47741-68a5-46df-9c1c-f6bd22653ef1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: 264db24e-173d-46bb-8f6c-8a86eee0a70c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:02:59.942250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ef47741-68a5-46df-9c1c-f6bd22653ef1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:59.943324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ef47741-68a5-46df-9c1c-f6bd22653ef1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:59.943971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ef47741-68a5-46df-9c1c-f6bd22653ef1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:59.944890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ef47741-68a5-46df-9c1c-f6bd22653ef1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:02:59.945534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ef47741-68a5-46df-9c1c-f6bd22653ef1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:02:59.946147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ef47741-68a5-46df-9c1c-f6bd22653ef1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:02:59.966788 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-0ef47741-68a5-46df-9c1c-f6bd22653ef1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0ef47741-68a5-46df-9c1c-f6bd22653ef1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c HTTP/1.1 Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '264db24e-173d-46bb-8f6c-8a86eee0a70c'} Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:02:59.968497 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:59.972864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:02:59.972864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:02:59.972864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:02:59.972864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:02:59.972864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:02:59.972864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. Aug 23 18:02:59.972864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:02:59.972864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0ef47741-68a5-46df-9c1c-f6bd22653ef1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Instance 264db24e-173d-46bb-8f6c-8a86eee0a70c could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:02:59.972864 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0ef47741-68a5-46df-9c1c-f6bd22653ef1 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c" status: 404 len: 111 microversion: 2.1 time: 0.042526 Aug 23 18:02:59.972864 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1430/2893] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:02:59 2022] GET /compute/v2.1/servers/264db24e-173d-46bb-8f6c-8a86eee0a70c => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:02:59.980379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3f3637b8-a3ff-4d86-b208-036a1303cd5b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27ec82dee0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG neutronclient.v2_0.client [None req-3f3637b8-a3ff-4d86-b208-036a1303cd5b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 2b653ae9-b74b-41d7-a31b-e188aa03c959 does not exist", "detail": ""}} {{(pid=128808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.security_group_api [None req-3f3637b8-a3ff-4d86-b208-036a1303cd5b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Neutron security group 2b653ae9-b74b-41d7-a31b-e188aa03c959 not found {{(pid=128808) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-3f3637b8-a3ff-4d86-b208-036a1303cd5b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Security group 2b653ae9-b74b-41d7-a31b-e188aa03c959 does not exist Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-ca738fbf-3b49-4154-8010-5990ece9142f'] Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3f3637b8-a3ff-4d86-b208-036a1303cd5b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/os-security-groups/2b653ae9-b74b-41d7-a31b-e188aa03c959 HTTP/1.1 Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: exception: Security group 2b653ae9-b74b-41d7-a31b-e188aa03c959 does not exist Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-ca738fbf-3b49-4154-8010-5990ece9142f'] Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '2b653ae9-b74b-41d7-a31b-e188aa03c959'} Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:03:00.019790 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 2b653ae9-b74b-41d7-a31b-e188aa03c959 does not exist Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca738fbf-3b49-4154-8010-5990ece9142f'] Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 2b653ae9-b74b-41d7-a31b-e188aa03c959 does not exist Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca738fbf-3b49-4154-8010-5990ece9142f'] Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 2b653ae9-b74b-41d7-a31b-e188aa03c959 does not exist Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca738fbf-3b49-4154-8010-5990ece9142f'] Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 2b653ae9-b74b-41d7-a31b-e188aa03c959 does not exist Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ca738fbf-3b49-4154-8010-5990ece9142f'] Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3f3637b8-a3ff-4d86-b208-036a1303cd5b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Security group 2b653ae9-b74b-41d7-a31b-e188aa03c959 does not exist Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-ca738fbf-3b49-4154-8010-5990ece9142f'] {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3f3637b8-a3ff-4d86-b208-036a1303cd5b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/2b653ae9-b74b-41d7-a31b-e188aa03c959" status: 404 len: 194 microversion: 2.1 time: 0.038349 Aug 23 18:03:00.025063 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1464/2894] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:02:59 2022] DELETE /compute/v2.1/os-security-groups/2b653ae9-b74b-41d7-a31b-e188aa03c959 => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:03:00.042403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ada5f1c3-b9be-48d8-96e0-d487187b2f12 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27ecadd0d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:00.083003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-95e44af3-d238-448d-a456-6cec8b4c25b4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:00.084265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-95e44af3-d238-448d-a456-6cec8b4c25b4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:00.117664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95e44af3-d238-448d-a456-6cec8b4c25b4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:00.118304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95e44af3-d238-448d-a456-6cec8b4c25b4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:00.118635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95e44af3-d238-448d-a456-6cec8b4c25b4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:00.132043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95e44af3-d238-448d-a456-6cec8b4c25b4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:00.132462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-ada5f1c3-b9be-48d8-96e0-d487187b2f12 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1d23a33e-35e3-4b78-9245-49023246e6dd does not exist", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:03:00.133402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.security_group_api [None req-ada5f1c3-b9be-48d8-96e0-d487187b2f12 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Neutron security group 1d23a33e-35e3-4b78-9245-49023246e6dd not found {{(pid=128807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:03:00.134020 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-ada5f1c3-b9be-48d8-96e0-d487187b2f12 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Security group 1d23a33e-35e3-4b78-9245-49023246e6dd does not exist Aug 23 18:03:00.134020 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-27127181-9969-4075-8ee7-f74843787f83'] Aug 23 18:03:00.135011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95e44af3-d238-448d-a456-6cec8b4c25b4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ada5f1c3-b9be-48d8-96e0-d487187b2f12 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-security-groups/1d23a33e-35e3-4b78-9245-49023246e6dd HTTP/1.1 Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: exception: Security group 1d23a33e-35e3-4b78-9245-49023246e6dd does not exist Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-27127181-9969-4075-8ee7-f74843787f83'] Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '1d23a33e-35e3-4b78-9245-49023246e6dd'} Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:03:00.137181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1d23a33e-35e3-4b78-9245-49023246e6dd does not exist Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27127181-9969-4075-8ee7-f74843787f83'] Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1d23a33e-35e3-4b78-9245-49023246e6dd does not exist Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27127181-9969-4075-8ee7-f74843787f83'] Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1d23a33e-35e3-4b78-9245-49023246e6dd does not exist Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27127181-9969-4075-8ee7-f74843787f83'] Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1d23a33e-35e3-4b78-9245-49023246e6dd does not exist Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-27127181-9969-4075-8ee7-f74843787f83'] Aug 23 18:03:00.142252 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.149838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95e44af3-d238-448d-a456-6cec8b4c25b4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:00.150030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ada5f1c3-b9be-48d8-96e0-d487187b2f12 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Security group 1d23a33e-35e3-4b78-9245-49023246e6dd does not exist Aug 23 18:03:00.150030 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-27127181-9969-4075-8ee7-f74843787f83'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:00.150670 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ada5f1c3-b9be-48d8-96e0-d487187b2f12 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/1d23a33e-35e3-4b78-9245-49023246e6dd" status: 404 len: 194 microversion: 2.1 time: 0.128961 Aug 23 18:03:00.151484 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1431/2895] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:03:00 2022] DELETE /compute/v2.1/os-security-groups/1d23a33e-35e3-4b78-9245-49023246e6dd => generated 194 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:03:00.179229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86ab8aa9-42eb-49da-9414-908f53de0fd9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27eca76280>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:00.216729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-86ab8aa9-42eb-49da-9414-908f53de0fd9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:03:00.223044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.security_group_api [None req-86ab8aa9-42eb-49da-9414-908f53de0fd9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Neutron security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 not found {{(pid=128807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:03:00.223932 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-86ab8aa9-42eb-49da-9414-908f53de0fd9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:03:00.223932 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-7d80adbe-7570-44ef-bbd6-b722b3a95a98'] Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86ab8aa9-42eb-49da-9414-908f53de0fd9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-security-groups/7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 HTTP/1.1 Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: exception: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-7d80adbe-7570-44ef-bbd6-b722b3a95a98'] Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538'} Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:03:00.226136 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d80adbe-7570-44ef-bbd6-b722b3a95a98'] Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d80adbe-7570-44ef-bbd6-b722b3a95a98'] Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d80adbe-7570-44ef-bbd6-b722b3a95a98'] Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-7d80adbe-7570-44ef-bbd6-b722b3a95a98'] Aug 23 18:03:00.229736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.240514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86ab8aa9-42eb-49da-9414-908f53de0fd9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Security group 7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 does not exist Aug 23 18:03:00.240514 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-7d80adbe-7570-44ef-bbd6-b722b3a95a98'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:00.241819 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-86ab8aa9-42eb-49da-9414-908f53de0fd9 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538" status: 404 len: 194 microversion: 2.1 time: 0.086274 Aug 23 18:03:00.246331 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1432/2896] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:03:00 2022] DELETE /compute/v2.1/os-security-groups/7c52f61e-5a1a-4e89-8ac0-c8e5ba4d0538 => generated 194 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:03:00.252358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1ebde9b-8372-450d-9904-2eb5e9c4590a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27ecb16670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:00.327223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-d1ebde9b-8372-450d-9904-2eb5e9c4590a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:03:00.328765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.security_group_api [None req-d1ebde9b-8372-450d-9904-2eb5e9c4590a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Neutron security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 not found {{(pid=128807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:03:00.330141 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-d1ebde9b-8372-450d-9904-2eb5e9c4590a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:03:00.330141 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-8e9748d4-3752-4a68-8312-646965a8806e'] Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1ebde9b-8372-450d-9904-2eb5e9c4590a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-security-groups/914761a1-46cb-47a7-9e29-ca39a6e0d322 HTTP/1.1 Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: exception: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-8e9748d4-3752-4a68-8312-646965a8806e'] Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '914761a1-46cb-47a7-9e29-ca39a6e0d322'} Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:03:00.333412 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e9748d4-3752-4a68-8312-646965a8806e'] Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e9748d4-3752-4a68-8312-646965a8806e'] Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e9748d4-3752-4a68-8312-646965a8806e'] Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-8e9748d4-3752-4a68-8312-646965a8806e'] Aug 23 18:03:00.337153 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.344372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1ebde9b-8372-450d-9904-2eb5e9c4590a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Security group 914761a1-46cb-47a7-9e29-ca39a6e0d322 does not exist Aug 23 18:03:00.344372 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-8e9748d4-3752-4a68-8312-646965a8806e'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:00.345929 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d1ebde9b-8372-450d-9904-2eb5e9c4590a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/914761a1-46cb-47a7-9e29-ca39a6e0d322" status: 404 len: 194 microversion: 2.1 time: 0.098108 Aug 23 18:03:00.346788 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1433/2897] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:03:00 2022] DELETE /compute/v2.1/os-security-groups/914761a1-46cb-47a7-9e29-ca39a6e0d322 => generated 194 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:03:00.364757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c14daf8-e76d-4867-8d27-0dc0c954ea6b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27ec8915e0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:00.433499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-0c14daf8-e76d-4867-8d27-0dc0c954ea6b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:03:00.434914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.security_group_api [None req-0c14daf8-e76d-4867-8d27-0dc0c954ea6b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Neutron security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a not found {{(pid=128807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:03:00.435533 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-0c14daf8-e76d-4867-8d27-0dc0c954ea6b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:03:00.435533 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-770b4e08-a3a1-4aa1-9157-87759cce0efd'] Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c14daf8-e76d-4867-8d27-0dc0c954ea6b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-security-groups/e19ef6db-cf4c-43ce-8d5a-4ad469d7252a HTTP/1.1 Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: exception: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-770b4e08-a3a1-4aa1-9157-87759cce0efd'] Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'e19ef6db-cf4c-43ce-8d5a-4ad469d7252a'} Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:03:00.437794 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-770b4e08-a3a1-4aa1-9157-87759cce0efd'] Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-770b4e08-a3a1-4aa1-9157-87759cce0efd'] Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-770b4e08-a3a1-4aa1-9157-87759cce0efd'] Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-770b4e08-a3a1-4aa1-9157-87759cce0efd'] Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c14daf8-e76d-4867-8d27-0dc0c954ea6b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Security group e19ef6db-cf4c-43ce-8d5a-4ad469d7252a does not exist Aug 23 18:03:00.442522 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-770b4e08-a3a1-4aa1-9157-87759cce0efd'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:00.447286 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c14daf8-e76d-4867-8d27-0dc0c954ea6b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/e19ef6db-cf4c-43ce-8d5a-4ad469d7252a" status: 404 len: 194 microversion: 2.1 time: 0.086921 Aug 23 18:03:00.448655 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1434/2898] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:03:00 2022] DELETE /compute/v2.1/os-security-groups/e19ef6db-cf4c-43ce-8d5a-4ad469d7252a => generated 194 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:03:00.463120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d5318833-8085-4d2f-9816-ed60147ad133 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:00.465190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d5318833-8085-4d2f-9816-ed60147ad133 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:00.481615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5318833-8085-4d2f-9816-ed60147ad133 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:00.481615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5318833-8085-4d2f-9816-ed60147ad133 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:00.481615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5318833-8085-4d2f-9816-ed60147ad133 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:00.481964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5318833-8085-4d2f-9816-ed60147ad133 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:00.482161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5318833-8085-4d2f-9816-ed60147ad133 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:00.482630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5318833-8085-4d2f-9816-ed60147ad133 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:00.551094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-95e44af3-d238-448d-a456-6cec8b4c25b4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:00.563238 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-95e44af3-d238-448d-a456-6cec8b4c25b4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1321 microversion: 2.1 time: 0.517950 Aug 23 18:03:00.573142 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1465/2899] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:00 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1321 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:00.583439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f23cb72-2d0d-4e0e-b7f2-064f78dfb1f0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec7e0790>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:00.675463 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f23cb72-2d0d-4e0e-b7f2-064f78dfb1f0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1440 microversion: 2.1 time: 0.101164 Aug 23 18:03:00.683110 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1466/2900] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:00 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1440 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:00.693089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51e146af-3baa-4c23-9b20-dd9286ff595b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27ed0e00d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:00.727568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG neutronclient.v2_0.client [None req-51e146af-3baa-4c23-9b20-dd9286ff595b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist", "detail": ""}} {{(pid=128808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:03:00.728447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.security_group_api [None req-51e146af-3baa-4c23-9b20-dd9286ff595b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Neutron security group b7e9f136-21df-459d-b64c-f008c07221f1 not found {{(pid=128808) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:03:00.729238 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-51e146af-3baa-4c23-9b20-dd9286ff595b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:03:00.729238 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-809cf427-465f-4648-bdd2-07f2ed0b90e1'] Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51e146af-3baa-4c23-9b20-dd9286ff595b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/os-security-groups/b7e9f136-21df-459d-b64c-f008c07221f1 HTTP/1.1 Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: exception: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-809cf427-465f-4648-bdd2-07f2ed0b90e1'] Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'b7e9f136-21df-459d-b64c-f008c07221f1'} Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:03:00.731470 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-809cf427-465f-4648-bdd2-07f2ed0b90e1'] Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-809cf427-465f-4648-bdd2-07f2ed0b90e1'] Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-809cf427-465f-4648-bdd2-07f2ed0b90e1'] Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-809cf427-465f-4648-bdd2-07f2ed0b90e1'] Aug 23 18:03:00.735632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:00.742719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51e146af-3baa-4c23-9b20-dd9286ff595b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Security group b7e9f136-21df-459d-b64c-f008c07221f1 does not exist Aug 23 18:03:00.742719 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-809cf427-465f-4648-bdd2-07f2ed0b90e1'] {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:00.743981 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51e146af-3baa-4c23-9b20-dd9286ff595b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/b7e9f136-21df-459d-b64c-f008c07221f1" status: 404 len: 194 microversion: 2.1 time: 0.059458 Aug 23 18:03:00.747978 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1467/2901] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:03:00 2022] DELETE /compute/v2.1/os-security-groups/b7e9f136-21df-459d-b64c-f008c07221f1 => generated 194 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:03:00.762755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-07ffba97-6e98-4ced-b3e4-56fc60821308 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:00.763607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-07ffba97-6e98-4ced-b3e4-56fc60821308 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:00.776760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07ffba97-6e98-4ced-b3e4-56fc60821308 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:00.777911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07ffba97-6e98-4ced-b3e4-56fc60821308 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:00.778666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07ffba97-6e98-4ced-b3e4-56fc60821308 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:00.780778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07ffba97-6e98-4ced-b3e4-56fc60821308 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:00.782022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07ffba97-6e98-4ced-b3e4-56fc60821308 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:00.787624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07ffba97-6e98-4ced-b3e4-56fc60821308 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:00.848873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-07ffba97-6e98-4ced-b3e4-56fc60821308 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:03:01.025541 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-07ffba97-6e98-4ced-b3e4-56fc60821308 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 204 len: 0 microversion: 2.1 time: 0.271525 Aug 23 18:03:01.026677 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1468/2902] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:03:00 2022] DELETE /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:03:01.034069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-79523fa8-17f6-4ac7-94f5-2e887604b316 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:01.035192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-79523fa8-17f6-4ac7-94f5-2e887604b316 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:01.048806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-79523fa8-17f6-4ac7-94f5-2e887604b316 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:01.051932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-79523fa8-17f6-4ac7-94f5-2e887604b316 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:01.052673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-79523fa8-17f6-4ac7-94f5-2e887604b316 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:01.055382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-79523fa8-17f6-4ac7-94f5-2e887604b316 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:01.056098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-79523fa8-17f6-4ac7-94f5-2e887604b316 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:01.060091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-79523fa8-17f6-4ac7-94f5-2e887604b316 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:01.117871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d5318833-8085-4d2f-9816-ed60147ad133 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:01.133914 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d5318833-8085-4d2f-9816-ed60147ad133 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1318 microversion: 2.1 time: 0.682825 Aug 23 18:03:01.160772 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1435/2903] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:00 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1318 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:01.196111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91462983-7ba5-49bf-811b-8c67c813977a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:01.200776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-91462983-7ba5-49bf-811b-8c67c813977a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:01.225263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91462983-7ba5-49bf-811b-8c67c813977a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:01.225781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91462983-7ba5-49bf-811b-8c67c813977a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:01.226232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91462983-7ba5-49bf-811b-8c67c813977a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:01.237257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91462983-7ba5-49bf-811b-8c67c813977a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:01.240208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91462983-7ba5-49bf-811b-8c67c813977a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:01.242251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91462983-7ba5-49bf-811b-8c67c813977a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:01.363287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-79523fa8-17f6-4ac7-94f5-2e887604b316 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:01.429715 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-79523fa8-17f6-4ac7-94f5-2e887604b316 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1682 microversion: 2.1 time: 0.401296 Aug 23 18:03:01.432735 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1469/2904] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:01 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1682 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:01.619126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1a666610-6d81-4776-a1b2-83bade65d1c1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:01.620083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1a666610-6d81-4776-a1b2-83bade65d1c1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:01.632772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a666610-6d81-4776-a1b2-83bade65d1c1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:01.641402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a666610-6d81-4776-a1b2-83bade65d1c1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:01.643432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a666610-6d81-4776-a1b2-83bade65d1c1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:01.644510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a666610-6d81-4776-a1b2-83bade65d1c1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:01.645305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a666610-6d81-4776-a1b2-83bade65d1c1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:01.646189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a666610-6d81-4776-a1b2-83bade65d1c1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:02.074158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1a666610-6d81-4776-a1b2-83bade65d1c1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:02.091502 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1a666610-6d81-4776-a1b2-83bade65d1c1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1321 microversion: 2.1 time: 0.500340 Aug 23 18:03:02.102089 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1470/2905] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:01 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1321 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:02.130214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cdd9dbe9-97eb-4efa-9928-36d41d7e23c2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec620f70>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:02.169855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-91462983-7ba5-49bf-811b-8c67c813977a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:02.181755 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-91462983-7ba5-49bf-811b-8c67c813977a tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1647 microversion: 2.1 time: 1.017374 Aug 23 18:03:02.201955 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1436/2906] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:01 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1647 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:02.213874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a4050880-c8f7-44d3-80de-5d1dece2f6ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:02.214898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a4050880-c8f7-44d3-80de-5d1dece2f6ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:02.241411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4050880-c8f7-44d3-80de-5d1dece2f6ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:02.244450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4050880-c8f7-44d3-80de-5d1dece2f6ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:02.245276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4050880-c8f7-44d3-80de-5d1dece2f6ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:02.248143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4050880-c8f7-44d3-80de-5d1dece2f6ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:02.248835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4050880-c8f7-44d3-80de-5d1dece2f6ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:02.251052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4050880-c8f7-44d3-80de-5d1dece2f6ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:02.272626 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cdd9dbe9-97eb-4efa-9928-36d41d7e23c2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1440 microversion: 2.1 time: 0.168723 Aug 23 18:03:02.278764 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1471/2907] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:02 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1440 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:02.495055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-60a427d4-113b-41ce-b3b7-af2f3acc1b35 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:02.502041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-60a427d4-113b-41ce-b3b7-af2f3acc1b35 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:02.547492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60a427d4-113b-41ce-b3b7-af2f3acc1b35 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:02.549386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60a427d4-113b-41ce-b3b7-af2f3acc1b35 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:02.552007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60a427d4-113b-41ce-b3b7-af2f3acc1b35 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:02.553877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60a427d4-113b-41ce-b3b7-af2f3acc1b35 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:02.557598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60a427d4-113b-41ce-b3b7-af2f3acc1b35 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:02.558248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60a427d4-113b-41ce-b3b7-af2f3acc1b35 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:03.006501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-60a427d4-113b-41ce-b3b7-af2f3acc1b35 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:03.017707 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-60a427d4-113b-41ce-b3b7-af2f3acc1b35 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1682 microversion: 2.1 time: 0.555213 Aug 23 18:03:03.024692 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1472/2908] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:02 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1682 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:03.130029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51e89db6-e191-44e5-a695-ad0f774b36ba tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:03.131021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51e89db6-e191-44e5-a695-ad0f774b36ba tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:03.147102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51e89db6-e191-44e5-a695-ad0f774b36ba tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:03.148267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51e89db6-e191-44e5-a695-ad0f774b36ba tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:03.149817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51e89db6-e191-44e5-a695-ad0f774b36ba tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:03.154241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51e89db6-e191-44e5-a695-ad0f774b36ba tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:03.155233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51e89db6-e191-44e5-a695-ad0f774b36ba tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:03.157047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51e89db6-e191-44e5-a695-ad0f774b36ba tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:03.470169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a4050880-c8f7-44d3-80de-5d1dece2f6ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:03.481720 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a4050880-c8f7-44d3-80de-5d1dece2f6ad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1318 microversion: 2.1 time: 1.278168 Aug 23 18:03:03.512480 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1437/2909] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:02 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1318 bytes in 1309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:03.532367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f9397c1e-50e3-4aee-8d8e-9333f05963ad tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:03.539197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f9397c1e-50e3-4aee-8d8e-9333f05963ad tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:03.561136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9397c1e-50e3-4aee-8d8e-9333f05963ad tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:03.561832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9397c1e-50e3-4aee-8d8e-9333f05963ad tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:03.563845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9397c1e-50e3-4aee-8d8e-9333f05963ad tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:03.571222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9397c1e-50e3-4aee-8d8e-9333f05963ad tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:03.575661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9397c1e-50e3-4aee-8d8e-9333f05963ad tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:03.576366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9397c1e-50e3-4aee-8d8e-9333f05963ad tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:03.600694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-51e89db6-e191-44e5-a695-ad0f774b36ba tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:03.614042 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51e89db6-e191-44e5-a695-ad0f774b36ba tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1321 microversion: 2.1 time: 0.489947 Aug 23 18:03:03.614042 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1473/2910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:03 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1321 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:03:03.624019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-40620613-02f6-4611-95b8-82a6fa7519bc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec610820>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:03.683428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:03.711164 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-40620613-02f6-4611-95b8-82a6fa7519bc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1440 microversion: 2.1 time: 0.095743 Aug 23 18:03:03.711764 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1474/2911] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:03 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1440 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:04.034370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-a2f658ea-92da-4ada-b200-89444399f2f5 req-49eeafd5-cd1a-4c82-834f-3e4e6ab933f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769e5a46-b0fd-49a3-bffa-1538728a67cc", "name": "network-vif-plugged", "status": "completed", "tag": "4df03a69-a606-4878-8aa1-164f4e89e488"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:04.063445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a2f658ea-92da-4ada-b200-89444399f2f5 req-49eeafd5-cd1a-4c82-834f-3e4e6ab933f6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:04.064038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a2f658ea-92da-4ada-b200-89444399f2f5 req-49eeafd5-cd1a-4c82-834f-3e4e6ab933f6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:04.064481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a2f658ea-92da-4ada-b200-89444399f2f5 req-49eeafd5-cd1a-4c82-834f-3e4e6ab933f6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:04.101653 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-a2f658ea-92da-4ada-b200-89444399f2f5 req-49eeafd5-cd1a-4c82-834f-3e4e6ab933f6 service nova] Creating event network-vif-plugged:4df03a69-a606-4878-8aa1-164f4e89e488 for instance 769e5a46-b0fd-49a3-bffa-1538728a67cc on n-h1-850468-16 Aug 23 18:03:04.128354 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-a2f658ea-92da-4ada-b200-89444399f2f5 req-49eeafd5-cd1a-4c82-834f-3e4e6ab933f6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099273 Aug 23 18:03:04.129575 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1475/2912] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:03:04.141637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d4910916-4583-4b33-ac3b-9b387821a511 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:04.142633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d4910916-4583-4b33-ac3b-9b387821a511 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:04.158068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4910916-4583-4b33-ac3b-9b387821a511 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:04.158887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4910916-4583-4b33-ac3b-9b387821a511 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:04.159514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4910916-4583-4b33-ac3b-9b387821a511 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:04.160405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4910916-4583-4b33-ac3b-9b387821a511 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:04.161022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4910916-4583-4b33-ac3b-9b387821a511 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:04.168037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4910916-4583-4b33-ac3b-9b387821a511 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:04.743208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d4910916-4583-4b33-ac3b-9b387821a511 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:04.760119 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d4910916-4583-4b33-ac3b-9b387821a511 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1682 microversion: 2.1 time: 0.629122 Aug 23 18:03:04.763585 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1476/2913] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:04 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1682 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:04.776229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-75a764ba-181a-44ed-82e5-048ebe274d25 req-ebd51cd8-1634-49ad-bd15-4c6e8f926a7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fcce231c-02f5-4c4f-b217-a265e0be63e4", "name": "network-vif-deleted", "tag": "149f6379-8609-4e86-9e62-c07c4cb88a1c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:04.808602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-75a764ba-181a-44ed-82e5-048ebe274d25 req-ebd51cd8-1634-49ad-bd15-4c6e8f926a7f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:04.813806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-75a764ba-181a-44ed-82e5-048ebe274d25 req-ebd51cd8-1634-49ad-bd15-4c6e8f926a7f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:04.814265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-75a764ba-181a-44ed-82e5-048ebe274d25 req-ebd51cd8-1634-49ad-bd15-4c6e8f926a7f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:04.848898 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-75a764ba-181a-44ed-82e5-048ebe274d25 req-ebd51cd8-1634-49ad-bd15-4c6e8f926a7f service nova] Creating event network-vif-deleted:149f6379-8609-4e86-9e62-c07c4cb88a1c for instance fcce231c-02f5-4c4f-b217-a265e0be63e4 on n-h2-850468-16 Aug 23 18:03:04.865061 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-75a764ba-181a-44ed-82e5-048ebe274d25 req-ebd51cd8-1634-49ad-bd15-4c6e8f926a7f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099957 Aug 23 18:03:04.866227 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1477/2914] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:04.882380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d25ff8d8-3b23-4538-bb26-8c67a8f086f3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:04.887263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d25ff8d8-3b23-4538-bb26-8c67a8f086f3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:04.923720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d25ff8d8-3b23-4538-bb26-8c67a8f086f3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:04.924433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d25ff8d8-3b23-4538-bb26-8c67a8f086f3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:04.926812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d25ff8d8-3b23-4538-bb26-8c67a8f086f3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:04.927801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d25ff8d8-3b23-4538-bb26-8c67a8f086f3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:04.929524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d25ff8d8-3b23-4538-bb26-8c67a8f086f3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:04.930153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d25ff8d8-3b23-4538-bb26-8c67a8f086f3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:04.952572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f9397c1e-50e3-4aee-8d8e-9333f05963ad tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db5f64cd07c1440f9b484294ef350aa8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10967ccfae5f43258e54fef325e5a0b2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:04.973433 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f9397c1e-50e3-4aee-8d8e-9333f05963ad tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 200 len: 1647 microversion: 2.1 time: 1.453923 Aug 23 18:03:04.987687 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1438/2915] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:03 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 1647 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:04.996904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8e1745e9-24a6-49c5-b785-492a20f075e8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:05.003602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8e1745e9-24a6-49c5-b785-492a20f075e8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:05.020348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e1745e9-24a6-49c5-b785-492a20f075e8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:05.020852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e1745e9-24a6-49c5-b785-492a20f075e8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:05.021549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e1745e9-24a6-49c5-b785-492a20f075e8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:05.022274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e1745e9-24a6-49c5-b785-492a20f075e8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:05.022847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e1745e9-24a6-49c5-b785-492a20f075e8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:05.023284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e1745e9-24a6-49c5-b785-492a20f075e8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:05.260823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d25ff8d8-3b23-4538-bb26-8c67a8f086f3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:05.273907 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d25ff8d8-3b23-4538-bb26-8c67a8f086f3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1318 microversion: 2.1 time: 0.406208 Aug 23 18:03:05.276862 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1478/2916] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:04 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1318 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:05.291798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-18019260-c6e5-4846-b29c-9c40c06360d0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec87b280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:05.293943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8e1745e9-24a6-49c5-b785-492a20f075e8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:05.315114 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8e1745e9-24a6-49c5-b785-492a20f075e8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1321 microversion: 2.1 time: 0.319913 Aug 23 18:03:05.315767 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1439/2917] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:04 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1321 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:05.368295 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-18019260-c6e5-4846-b29c-9c40c06360d0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1440 microversion: 2.1 time: 0.089112 Aug 23 18:03:05.369428 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1479/2918] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:05 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1440 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:05.783311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5047a320-b0c9-406a-add0-a7d097398127 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:05.784084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5047a320-b0c9-406a-add0-a7d097398127 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:05.798322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5047a320-b0c9-406a-add0-a7d097398127 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:05.799268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5047a320-b0c9-406a-add0-a7d097398127 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:05.800080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5047a320-b0c9-406a-add0-a7d097398127 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:05.811211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5047a320-b0c9-406a-add0-a7d097398127 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:05.812269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5047a320-b0c9-406a-add0-a7d097398127 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:05.814120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5047a320-b0c9-406a-add0-a7d097398127 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:06.000986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b93f0fb5-4bde-46e5-9e14-467831f20db8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:06.001629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b93f0fb5-4bde-46e5-9e14-467831f20db8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] [instance: fcce231c-02f5-4c4f-b217-a265e0be63e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:06.013050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5047a320-b0c9-406a-add0-a7d097398127 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:06.018410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b93f0fb5-4bde-46e5-9e14-467831f20db8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:06.019471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b93f0fb5-4bde-46e5-9e14-467831f20db8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:06.020756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b93f0fb5-4bde-46e5-9e14-467831f20db8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:06.023896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b93f0fb5-4bde-46e5-9e14-467831f20db8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:06.025576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b93f0fb5-4bde-46e5-9e14-467831f20db8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:06.029246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b93f0fb5-4bde-46e5-9e14-467831f20db8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:06.035459 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5047a320-b0c9-406a-add0-a7d097398127 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1682 microversion: 2.1 time: 0.246493 Aug 23 18:03:06.036684 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1440/2919] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:05 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1682 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:06.057874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:06.124288 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b93f0fb5-4bde-46e5-9e14-467831f20db8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] HTTP exception thrown: Instance fcce231c-02f5-4c4f-b217-a265e0be63e4 could not be found. Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b93f0fb5-4bde-46e5-9e14-467831f20db8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Request method failure captured: Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 HTTP/1.1 Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXuoxoQX1fPy6oIx6peJP_oKG5ETxYYC3jrgkWQ63crNNHqeofA_Ua_8UQa2FYm-fRcoGYAcoH39HPDd4mcaVOgpq1_CqQ248jyCX6kOeLW0mSQ5mLtGKPLtdYVqC3sQn2PuudEqm8PkDnXymVf-pAeKvgj1BV3-A2GybQzLkJBmgk Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/10967ccfae5f43258e54fef325e5a0b2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/10967ccfae5f43258e54fef325e5a0b2"}]}] Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 10967ccfae5f43258e54fef325e5a0b2 Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1838220114 Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: db5f64cd07c1440f9b484294ef350aa8 Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-SecurityGroupsTestJSON-1838220114-project Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance fcce231c-02f5-4c4f-b217-a265e0be63e4 could not be found. Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'fcce231c-02f5-4c4f-b217-a265e0be63e4'} Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fcce231c-02f5-4c4f-b217-a265e0be63e4 could not be found. Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fcce231c-02f5-4c4f-b217-a265e0be63e4 could not be found. Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:06.131446 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:06.136355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:06.136355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:06.136355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:06.136355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:06.136355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:06.136355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fcce231c-02f5-4c4f-b217-a265e0be63e4 could not be found. Aug 23 18:03:06.136355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:06.136355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b93f0fb5-4bde-46e5-9e14-467831f20db8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Returning 404 to user: Instance fcce231c-02f5-4c4f-b217-a265e0be63e4 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:06.136355 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b93f0fb5-4bde-46e5-9e14-467831f20db8 tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4" status: 404 len: 111 microversion: 2.1 time: 0.141722 Aug 23 18:03:06.140171 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1480/2920] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:05 2022] GET /compute/v2.1/servers/fcce231c-02f5-4c4f-b217-a265e0be63e4 => generated 111 bytes in 149 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:03:06.144428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bdb45139-c182-476f-851f-05fa73e3b48b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27ed2ee4c0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:06.299094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8b0f6775-42e5-4a33-bc46-80a417bf2969 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:06.300462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8b0f6775-42e5-4a33-bc46-80a417bf2969 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:06.319458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b0f6775-42e5-4a33-bc46-80a417bf2969 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:06.322687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b0f6775-42e5-4a33-bc46-80a417bf2969 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:06.323364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b0f6775-42e5-4a33-bc46-80a417bf2969 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:06.326976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b0f6775-42e5-4a33-bc46-80a417bf2969 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:06.330789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b0f6775-42e5-4a33-bc46-80a417bf2969 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:06.332486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b0f6775-42e5-4a33-bc46-80a417bf2969 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:06.923703 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bdb45139-c182-476f-851f-05fa73e3b48b tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/1c2afb06-d171-448b-9dc3-c1dfe0d947e5" status: 202 len: 0 microversion: 2.1 time: 0.781925 Aug 23 18:03:06.927250 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1441/2921] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:03:06 2022] DELETE /compute/v2.1/os-security-groups/1c2afb06-d171-448b-9dc3-c1dfe0d947e5 => generated 0 bytes in 790 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:03:06.938887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cb14c5f0-a21c-4f52-ba4e-f9ae8f4eb321 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:06.949851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cb14c5f0-a21c-4f52-ba4e-f9ae8f4eb321 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:06.972877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb14c5f0-a21c-4f52-ba4e-f9ae8f4eb321 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:06.975528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb14c5f0-a21c-4f52-ba4e-f9ae8f4eb321 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:06.977331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb14c5f0-a21c-4f52-ba4e-f9ae8f4eb321 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:06.978076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb14c5f0-a21c-4f52-ba4e-f9ae8f4eb321 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:06.979386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb14c5f0-a21c-4f52-ba4e-f9ae8f4eb321 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:06.992051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb14c5f0-a21c-4f52-ba4e-f9ae8f4eb321 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:07.375592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cb14c5f0-a21c-4f52-ba4e-f9ae8f4eb321 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:07.395114 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cb14c5f0-a21c-4f52-ba4e-f9ae8f4eb321 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1470 microversion: 2.1 time: 0.466596 Aug 23 18:03:07.398676 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1442/2922] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:06 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1470 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:07.410256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b3f665f0-6aa7-40be-884c-8f6af43612e7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec8a78b0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:08.395274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8b0f6775-42e5-4a33-bc46-80a417bf2969 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:08.414016 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8b0f6775-42e5-4a33-bc46-80a417bf2969 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1318 microversion: 2.1 time: 2.119192 Aug 23 18:03:08.417108 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1481/2923] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:06 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1318 bytes in 2124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:08.423887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fa847ae1-6825-4602-a657-facbbd4ba95f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] Calling method '.version_select at 0x7f27ec951280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:09.117072 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fa847ae1-6825-4602-a657-facbbd4ba95f tempest-SecurityGroupsTestJSON-1838220114 tempest-SecurityGroupsTestJSON-1838220114-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/40e17e25-c205-43d5-93fc-eba22730b287" status: 202 len: 0 microversion: 2.1 time: 0.698344 Aug 23 18:03:09.122219 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1482/2924] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:03:08 2022] DELETE /compute/v2.1/os-security-groups/40e17e25-c205-43d5-93fc-eba22730b287 => generated 0 bytes in 703 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:03:09.127948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6c634131-3322-434c-9105-f7a915384efc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:09.128634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6c634131-3322-434c-9105-f7a915384efc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:09.149662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c634131-3322-434c-9105-f7a915384efc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:09.150318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c634131-3322-434c-9105-f7a915384efc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:09.150852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c634131-3322-434c-9105-f7a915384efc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:09.151620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c634131-3322-434c-9105-f7a915384efc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:09.155735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c634131-3322-434c-9105-f7a915384efc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:09.156826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c634131-3322-434c-9105-f7a915384efc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:10.649966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6c634131-3322-434c-9105-f7a915384efc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:10.665662 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6c634131-3322-434c-9105-f7a915384efc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1682 microversion: 2.1 time: 1.542826 Aug 23 18:03:10.666700 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1483/2925] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:09 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1682 bytes in 1545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:11.170497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6e397fa-f28d-480e-b55f-db3ec0ec1f47 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:11.176138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6e397fa-f28d-480e-b55f-db3ec0ec1f47 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] [instance: 4874a30e-a32b-4b53-9754-2a67d6e5e3b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:11.198615 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b6e397fa-f28d-480e-b55f-db3ec0ec1f47 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] HTTP exception thrown: Instance 4874a30e-a32b-4b53-9754-2a67d6e5e3b7 could not be found. Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6e397fa-f28d-480e-b55f-db3ec0ec1f47 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Request method failure captured: Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/4874a30e-a32b-4b53-9754-2a67d6e5e3b7/action HTTP/1.1 Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 15 Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRY_0fAW_id9e_zn_-7NLMZRRn2hoQeqIauiNv3sswYD56QaDeoSWGpya--nPBiwH2CmGX3FTjaFwdRBoNz8aYvEyxWqgxf3yg42eHFBMwwCMw5iJQbXhAwJCOyVOSklhw6jSA3CROupCfaYdPvO_7SWVyEIp05RxKJMMNwZ7u9BpCo Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: aa807f4ce80b4ce9a11355ba5a392c51 Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aa807f4ce80b4ce9a11355ba5a392c51"}]}] Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: aa807f4ce80b4ce9a11355ba5a392c51 Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersAdminNegativeTestJSON-1644191216-project-admin Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 7116801eb0f34e17ad0d689c0f6f4d58 Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1644191216-project-admin Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: {"migrate": {}} Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 4874a30e-a32b-4b53-9754-2a67d6e5e3b7 could not be found. Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '4874a30e-a32b-4b53-9754-2a67d6e5e3b7', 'body': {'migrate': {}}} Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4874a30e-a32b-4b53-9754-2a67d6e5e3b7 could not be found. Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4874a30e-a32b-4b53-9754-2a67d6e5e3b7 could not be found. Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:11.206140 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:11.210990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:11.210990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:11.210990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:11.210990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:11.210990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4874a30e-a32b-4b53-9754-2a67d6e5e3b7 could not be found. Aug 23 18:03:11.210990 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:11.214437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6e397fa-f28d-480e-b55f-db3ec0ec1f47 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Returning 404 to user: Instance 4874a30e-a32b-4b53-9754-2a67d6e5e3b7 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:11.217229 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6e397fa-f28d-480e-b55f-db3ec0ec1f47 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/4874a30e-a32b-4b53-9754-2a67d6e5e3b7/action" status: 404 len: 111 microversion: 2.1 time: 0.544761 Aug 23 18:03:11.220013 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1484/2926] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:03:10 2022] POST /compute/v2.1/servers/4874a30e-a32b-4b53-9754-2a67d6e5e3b7/action => generated 111 bytes in 549 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:03:11.237192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6bcab2f0-797d-4d98-9add-f65a16eb9bc8 req-78cfe012-3f3f-44f9-a333-26dda4424f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115be13c-aace-4476-be96-7ae226d6fe10", "name": "network-vif-plugged", "status": "completed", "tag": "f371eefc-d9b1-4401-a319-ec95d61fbeaa"}, {"server_uuid": "ba643625-f7fc-4d86-b706-fd5957739f37", "name": "network-vif-plugged", "status": "completed", "tag": "c752bba4-1778-4a12-9bcd-7ca38827dfc6"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:11.289836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6bcab2f0-797d-4d98-9add-f65a16eb9bc8 req-78cfe012-3f3f-44f9-a333-26dda4424f60 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:11.298180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6bcab2f0-797d-4d98-9add-f65a16eb9bc8 req-78cfe012-3f3f-44f9-a333-26dda4424f60 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:11.300913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6bcab2f0-797d-4d98-9add-f65a16eb9bc8 req-78cfe012-3f3f-44f9-a333-26dda4424f60 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:11.338032 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6bcab2f0-797d-4d98-9add-f65a16eb9bc8 req-78cfe012-3f3f-44f9-a333-26dda4424f60 service nova] Creating event network-vif-plugged:f371eefc-d9b1-4401-a319-ec95d61fbeaa for instance 115be13c-aace-4476-be96-7ae226d6fe10 on n-h1-850468-16 Aug 23 18:03:11.339044 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6bcab2f0-797d-4d98-9add-f65a16eb9bc8 req-78cfe012-3f3f-44f9-a333-26dda4424f60 service nova] Creating event network-vif-plugged:c752bba4-1778-4a12-9bcd-7ca38827dfc6 for instance ba643625-f7fc-4d86-b706-fd5957739f37 on n-h2-850468-16 Aug 23 18:03:11.364116 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6bcab2f0-797d-4d98-9add-f65a16eb9bc8 req-78cfe012-3f3f-44f9-a333-26dda4424f60 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.141976 Aug 23 18:03:11.365749 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1485/2927] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:11 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:11.388273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-57174ac5-78f1-402f-a8c6-41dad045d36a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:11.391065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-57174ac5-78f1-402f-a8c6-41dad045d36a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:11.418073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57174ac5-78f1-402f-a8c6-41dad045d36a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:11.418969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57174ac5-78f1-402f-a8c6-41dad045d36a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:11.420698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57174ac5-78f1-402f-a8c6-41dad045d36a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:11.424213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57174ac5-78f1-402f-a8c6-41dad045d36a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:11.426728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57174ac5-78f1-402f-a8c6-41dad045d36a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:11.427382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57174ac5-78f1-402f-a8c6-41dad045d36a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:11.963780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-57174ac5-78f1-402f-a8c6-41dad045d36a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:11.973424 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-57174ac5-78f1-402f-a8c6-41dad045d36a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1318 microversion: 2.1 time: 0.605866 Aug 23 18:03:11.974015 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1486/2928] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:11 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1318 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:11.994496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-513966916", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:16.956993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:17.447635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=20 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:20.895023 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b3f665f0-6aa7-40be-884c-8f6af43612e7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1440 microversion: 2.1 time: 13.494983 Aug 23 18:03:20.897638 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1443/2929] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:07 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1440 bytes in 13498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:20.913732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9534d3fc-1410-44df-9e56-f53299c6bfec tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:20.913732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9534d3fc-1410-44df-9e56-f53299c6bfec tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:20.959508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:03:20.968561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9534d3fc-1410-44df-9e56-f53299c6bfec tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:20.974099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9534d3fc-1410-44df-9e56-f53299c6bfec tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:20.977499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9534d3fc-1410-44df-9e56-f53299c6bfec tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:20.979292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9534d3fc-1410-44df-9e56-f53299c6bfec tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:20.981002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9534d3fc-1410-44df-9e56-f53299c6bfec tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:20.982833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9534d3fc-1410-44df-9e56-f53299c6bfec tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:21.307582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9534d3fc-1410-44df-9e56-f53299c6bfec tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:21.320338 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9534d3fc-1410-44df-9e56-f53299c6bfec tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1682 microversion: 2.1 time: 0.421511 Aug 23 18:03:21.324904 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1444/2930] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:20 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1682 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:21.331999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-20a93b56-e959-406b-b701-ac0c2cd543d0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:21.338977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-20a93b56-e959-406b-b701-ac0c2cd543d0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:21.353331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20a93b56-e959-406b-b701-ac0c2cd543d0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:21.357330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20a93b56-e959-406b-b701-ac0c2cd543d0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:21.358007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20a93b56-e959-406b-b701-ac0c2cd543d0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:21.359040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20a93b56-e959-406b-b701-ac0c2cd543d0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:21.363381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20a93b56-e959-406b-b701-ac0c2cd543d0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:21.373710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20a93b56-e959-406b-b701-ac0c2cd543d0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:21.840163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20a93b56-e959-406b-b701-ac0c2cd543d0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:21.852932 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-20a93b56-e959-406b-b701-ac0c2cd543d0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1467 microversion: 2.1 time: 0.526603 Aug 23 18:03:21.853528 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1445/2931] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:21 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1467 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:21.874814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8a46c27c-4852-4560-afff-6f50386cad5a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:21.875452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8a46c27c-4852-4560-afff-6f50386cad5a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 115be13c-aace-4476-be96-7ae226d6fe10] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:21.886614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:03:21.887334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:03:21.887823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:03:21.888243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:03:21.888607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a46c27c-4852-4560-afff-6f50386cad5a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:21.888730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:03:21.889116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a46c27c-4852-4560-afff-6f50386cad5a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:21.889567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a46c27c-4852-4560-afff-6f50386cad5a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:21.890374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a46c27c-4852-4560-afff-6f50386cad5a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:21.890876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a46c27c-4852-4560-afff-6f50386cad5a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:21.891313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a46c27c-4852-4560-afff-6f50386cad5a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:21.895464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:21.926847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:21.927684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:21.947000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:21.948014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:21.948507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:21.948951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:22.000876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=20 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:22.079263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Getting quotas for project 57bb1f989bf346ab9daefe20a2e9a0b3. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:03:22.113121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Getting quotas for user 845f5cca36ea458480b56e3b48f73454 and project 57bb1f989bf346ab9daefe20a2e9a0b3. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:03:22.151377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:03:22.153688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:03:22.251198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8a46c27c-4852-4560-afff-6f50386cad5a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:22.266853 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8a46c27c-4852-4560-afff-6f50386cad5a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10" status: 200 len: 1468 microversion: 2.1 time: 0.396168 Aug 23 18:03:22.268841 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1446/2932] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:21 2022] GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10 => generated 1468 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:22.276975 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8226f8db-6187-4d19-935b-58349d210357 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.290576 Aug 23 18:03:22.277986 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1487/2933] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:03:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 10293 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:03:22.291224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-191300a1-ec7d-448f-8c45-835e781b6adc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ecb25a60>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:22.295357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:22.323892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:22.330971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Searching by: {'reservation_id': 'r-vd9psi5u', 'deleted': False, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:03:22.359521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:22.360655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:22.361808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:22.367812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:22.368463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:22.368934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:22.519681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:03:22.757135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:22.803710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:22.804463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:22.804914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:23.780564 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-191300a1-ec7d-448f-8c45-835e781b6adc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1440 microversion: 2.1 time: 1.500045 Aug 23 18:03:23.789914 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1447/2934] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:22 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1440 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:23.810606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41bc28df-4e11-44af-bc9d-2b1ad147ebcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:23.816140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-41bc28df-4e11-44af-bc9d-2b1ad147ebcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:23.850259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41bc28df-4e11-44af-bc9d-2b1ad147ebcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:23.857982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41bc28df-4e11-44af-bc9d-2b1ad147ebcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:23.860417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41bc28df-4e11-44af-bc9d-2b1ad147ebcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:23.865071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41bc28df-4e11-44af-bc9d-2b1ad147ebcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:23.866257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41bc28df-4e11-44af-bc9d-2b1ad147ebcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:23.868252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41bc28df-4e11-44af-bc9d-2b1ad147ebcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:23.898371 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-76e1ec1a-b35b-4c57-9a74-3f6c2b06f53d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/detail?reservation_id=r-vd9psi5u" status: 200 len: 2928 microversion: 2.1 time: 1.614275 Aug 23 18:03:23.899319 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1488/2935] 10.222.0.61 () {58 vars in 1197 bytes} [Tue Aug 23 18:03:22 2022] GET /compute/v2.1/servers/detail?reservation_id=r-vd9psi5u => generated 2928 bytes in 1616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:03:23.904332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e617e2ae-9f8a-4fe6-affc-39bfc1488c50 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:23.909003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e617e2ae-9f8a-4fe6-affc-39bfc1488c50 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:23.920606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e617e2ae-9f8a-4fe6-affc-39bfc1488c50 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:23.921687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e617e2ae-9f8a-4fe6-affc-39bfc1488c50 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:23.928272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e617e2ae-9f8a-4fe6-affc-39bfc1488c50 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:23.929191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e617e2ae-9f8a-4fe6-affc-39bfc1488c50 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:23.929683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e617e2ae-9f8a-4fe6-affc-39bfc1488c50 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:23.951474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e617e2ae-9f8a-4fe6-affc-39bfc1488c50 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:24.123143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41bc28df-4e11-44af-bc9d-2b1ad147ebcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:24.138018 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-41bc28df-4e11-44af-bc9d-2b1ad147ebcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1217 microversion: 2.1 time: 0.346530 Aug 23 18:03:24.150582 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1448/2936] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:23 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1217 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:24.152898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c9ba7de7-c03d-4ce8-b1ec-fbf56b9fba89 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:24.184446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.compute.server_groups [None req-c9ba7de7-c03d-4ce8-b1ec-fbf56b9fba89 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Querying cell 410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) for 2 instances {{(pid=128807) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 23 18:03:24.185118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9ba7de7-c03d-4ce8-b1ec-fbf56b9fba89 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:24.185603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9ba7de7-c03d-4ce8-b1ec-fbf56b9fba89 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:24.186050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9ba7de7-c03d-4ce8-b1ec-fbf56b9fba89 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:24.266650 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c9ba7de7-c03d-4ce8-b1ec-fbf56b9fba89 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/251f1c1a-dc2e-49fe-afa8-4dae7e69d420" status: 200 len: 271 microversion: 2.1 time: 0.116582 Aug 23 18:03:24.267686 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1449/2937] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 18:03:24 2022] GET /compute/v2.1/os-server-groups/251f1c1a-dc2e-49fe-afa8-4dae7e69d420 => generated 271 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:24.277983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3465c657-d92c-472e-b804-84deffe54475 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:24.280911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3465c657-d92c-472e-b804-84deffe54475 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] [instance: 115be13c-aace-4476-be96-7ae226d6fe10] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:24.292598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3465c657-d92c-472e-b804-84deffe54475 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:24.293443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3465c657-d92c-472e-b804-84deffe54475 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:24.294049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3465c657-d92c-472e-b804-84deffe54475 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:24.298974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3465c657-d92c-472e-b804-84deffe54475 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:24.299847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3465c657-d92c-472e-b804-84deffe54475 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:24.301429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3465c657-d92c-472e-b804-84deffe54475 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:24.393942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e617e2ae-9f8a-4fe6-affc-39bfc1488c50 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:24.410011 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e617e2ae-9f8a-4fe6-affc-39bfc1488c50 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.509591 Aug 23 18:03:24.410498 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1489/2938] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:23 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:24.521578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3414759c-90e6-47ec-b0f0-1a89f3f490de tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:24.522215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3414759c-90e6-47ec-b0f0-1a89f3f490de tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:24.536528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3414759c-90e6-47ec-b0f0-1a89f3f490de tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:24.537027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3414759c-90e6-47ec-b0f0-1a89f3f490de tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:24.537968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3414759c-90e6-47ec-b0f0-1a89f3f490de tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:24.545266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3414759c-90e6-47ec-b0f0-1a89f3f490de tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:24.546455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3414759c-90e6-47ec-b0f0-1a89f3f490de tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:24.547097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3414759c-90e6-47ec-b0f0-1a89f3f490de tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:24.799824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3414759c-90e6-47ec-b0f0-1a89f3f490de tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:24.810576 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3414759c-90e6-47ec-b0f0-1a89f3f490de tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.293249 Aug 23 18:03:24.821865 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1490/2939] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:24 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:24.826916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fd857847-29c3-48f3-8514-b17f1a45c3cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec82d1f0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:25.513592 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3465c657-d92c-472e-b804-84deffe54475 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10" status: 200 len: 1621 microversion: 2.1 time: 1.238959 Aug 23 18:03:25.516417 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1450/2940] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:24 2022] GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10 => generated 1621 bytes in 1243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:03:25.525680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4661d28a-920a-4909-949f-f4cbbee9d8c2 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:25.528882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4661d28a-920a-4909-949f-f4cbbee9d8c2 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:25.554402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4661d28a-920a-4909-949f-f4cbbee9d8c2 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:25.555020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4661d28a-920a-4909-949f-f4cbbee9d8c2 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:25.556814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4661d28a-920a-4909-949f-f4cbbee9d8c2 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:25.570558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4661d28a-920a-4909-949f-f4cbbee9d8c2 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:25.573458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4661d28a-920a-4909-949f-f4cbbee9d8c2 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:25.573935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4661d28a-920a-4909-949f-f4cbbee9d8c2 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:25.748338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4661d28a-920a-4909-949f-f4cbbee9d8c2 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:25.763739 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4661d28a-920a-4909-949f-f4cbbee9d8c2 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1279 microversion: 2.1 time: 0.245129 Aug 23 18:03:25.764624 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1451/2941] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:25 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1279 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:25.794616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-e078d19a-72cd-46ce-afeb-932badc979fb req-34bbcbce-334f-4978-843d-e6e90a8e52eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d81bbbc-0ed1-445b-a321-b2175e975725", "name": "network-vif-unplugged", "status": "completed", "tag": "c9a2077a-21a0-4f0d-846d-bbb4743c4fa4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:25.837092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e078d19a-72cd-46ce-afeb-932badc979fb req-34bbcbce-334f-4978-843d-e6e90a8e52eb service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:25.839321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e078d19a-72cd-46ce-afeb-932badc979fb req-34bbcbce-334f-4978-843d-e6e90a8e52eb service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:25.841226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e078d19a-72cd-46ce-afeb-932badc979fb req-34bbcbce-334f-4978-843d-e6e90a8e52eb service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:25.920546 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-e078d19a-72cd-46ce-afeb-932badc979fb req-34bbcbce-334f-4978-843d-e6e90a8e52eb service nova] Creating event network-vif-unplugged:c9a2077a-21a0-4f0d-846d-bbb4743c4fa4 for instance 9d81bbbc-0ed1-445b-a321-b2175e975725 on n-h1-850468-16 Aug 23 18:03:25.945846 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-e078d19a-72cd-46ce-afeb-932badc979fb req-34bbcbce-334f-4978-843d-e6e90a8e52eb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.162327 Aug 23 18:03:25.948124 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1452/2942] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:25.972729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e3c4c8a3-879d-451f-9bc6-dc4471d1af45 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:25.978025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e3c4c8a3-879d-451f-9bc6-dc4471d1af45 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:26.005364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3c4c8a3-879d-451f-9bc6-dc4471d1af45 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:26.010601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3c4c8a3-879d-451f-9bc6-dc4471d1af45 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:26.011379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3c4c8a3-879d-451f-9bc6-dc4471d1af45 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:26.012317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3c4c8a3-879d-451f-9bc6-dc4471d1af45 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:26.013822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3c4c8a3-879d-451f-9bc6-dc4471d1af45 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:26.015967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3c4c8a3-879d-451f-9bc6-dc4471d1af45 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:26.902993 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e3c4c8a3-879d-451f-9bc6-dc4471d1af45 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 200 len: 1620 microversion: 2.1 time: 0.951637 Aug 23 18:03:26.946500 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1453/2943] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:25 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 1620 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:26.970577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-18a5f9f7-c7e5-45bc-8fbe-a0d7cbee0537 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:26.972092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-18a5f9f7-c7e5-45bc-8fbe-a0d7cbee0537 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:26.984567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18a5f9f7-c7e5-45bc-8fbe-a0d7cbee0537 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:26.985089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18a5f9f7-c7e5-45bc-8fbe-a0d7cbee0537 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:26.985530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18a5f9f7-c7e5-45bc-8fbe-a0d7cbee0537 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:26.986447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18a5f9f7-c7e5-45bc-8fbe-a0d7cbee0537 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:26.986944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18a5f9f7-c7e5-45bc-8fbe-a0d7cbee0537 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:27.006208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18a5f9f7-c7e5-45bc-8fbe-a0d7cbee0537 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:27.222719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-18a5f9f7-c7e5-45bc-8fbe-a0d7cbee0537 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:27.235359 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-18a5f9f7-c7e5-45bc-8fbe-a0d7cbee0537 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1279 microversion: 2.1 time: 0.287602 Aug 23 18:03:27.250450 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1454/2944] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:26 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1279 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:27.258625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-644672526", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "8feaf703-5072-4321-b05e-dfebaaa5c573"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:27.363636 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fd857847-29c3-48f3-8514-b17f1a45c3cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1440 microversion: 2.1 time: 2.538962 Aug 23 18:03:27.366645 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1491/2945] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:24 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1440 bytes in 2544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:27.397071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1166e0b0-5171-48a1-90c7-79e26589c6d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:27.398420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1166e0b0-5171-48a1-90c7-79e26589c6d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:27.417178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1166e0b0-5171-48a1-90c7-79e26589c6d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:27.421368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1166e0b0-5171-48a1-90c7-79e26589c6d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:27.423612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1166e0b0-5171-48a1-90c7-79e26589c6d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:27.425280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1166e0b0-5171-48a1-90c7-79e26589c6d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:27.427180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1166e0b0-5171-48a1-90c7-79e26589c6d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:27.427846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1166e0b0-5171-48a1-90c7-79e26589c6d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:27.469490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:03:28.196405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1166e0b0-5171-48a1-90c7-79e26589c6d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:28.209288 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1166e0b0-5171-48a1-90c7-79e26589c6d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.841361 Aug 23 18:03:28.220653 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1492/2946] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:27 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:28.246040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2058c87d-a5ee-4a63-ae0c-f401823ef527 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:28.255842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2058c87d-a5ee-4a63-ae0c-f401823ef527 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:28.269039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2058c87d-a5ee-4a63-ae0c-f401823ef527 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:28.270205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2058c87d-a5ee-4a63-ae0c-f401823ef527 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:28.294895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2058c87d-a5ee-4a63-ae0c-f401823ef527 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:28.299603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2058c87d-a5ee-4a63-ae0c-f401823ef527 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:28.304973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2058c87d-a5ee-4a63-ae0c-f401823ef527 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:28.305795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2058c87d-a5ee-4a63-ae0c-f401823ef527 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:28.317427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:03:28.318451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:03:28.319854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:03:28.320468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:03:28.321076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:03:28.335419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:28.336153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:28.336783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:28.337679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:28.338567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:28.339155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:28.378724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:03:28.397134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:03:28.422914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:03:28.442901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:03:28.541734 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a88d467e-3011-4104-8c7f-d8f05ec41e6d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.289375 Aug 23 18:03:28.542621 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1455/2947] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:03:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1291 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:03:28.556217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a47b2450-9af8-4715-b211-60e29a67226a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:28.556905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a47b2450-9af8-4715-b211-60e29a67226a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:28.579372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a47b2450-9af8-4715-b211-60e29a67226a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:28.579873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a47b2450-9af8-4715-b211-60e29a67226a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:28.580317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a47b2450-9af8-4715-b211-60e29a67226a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:28.581037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a47b2450-9af8-4715-b211-60e29a67226a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:28.581855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a47b2450-9af8-4715-b211-60e29a67226a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:28.582087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a47b2450-9af8-4715-b211-60e29a67226a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:29.149584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2058c87d-a5ee-4a63-ae0c-f401823ef527 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:29.164864 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2058c87d-a5ee-4a63-ae0c-f401823ef527 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.924237 Aug 23 18:03:29.171328 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1493/2948] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:28 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:29.187547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-be256e70-a35e-476c-813d-abf8a1830ebd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec0244c0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:29.262303 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-be256e70-a35e-476c-813d-abf8a1830ebd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1440 microversion: 2.1 time: 0.089022 Aug 23 18:03:29.271140 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1494/2949] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:29 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1440 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:29.282054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bd967f73-c38d-4bbc-b807-2663153627ba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:29.282723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bd967f73-c38d-4bbc-b807-2663153627ba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:29.432661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a47b2450-9af8-4715-b211-60e29a67226a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:29.445537 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a47b2450-9af8-4715-b211-60e29a67226a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1321 microversion: 2.1 time: 0.901805 Aug 23 18:03:29.454049 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1456/2950] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:28 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1321 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:29.471062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b157721d-5527-418a-813a-d0e9ab73c36c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:29.472030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b157721d-5527-418a-813a-d0e9ab73c36c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:29.481910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b157721d-5527-418a-813a-d0e9ab73c36c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:29.489621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b157721d-5527-418a-813a-d0e9ab73c36c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:29.490618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b157721d-5527-418a-813a-d0e9ab73c36c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:29.491616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b157721d-5527-418a-813a-d0e9ab73c36c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:29.492306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b157721d-5527-418a-813a-d0e9ab73c36c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:29.492990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b157721d-5527-418a-813a-d0e9ab73c36c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:29.954129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bd967f73-c38d-4bbc-b807-2663153627ba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:29.968402 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bd967f73-c38d-4bbc-b807-2663153627ba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1216 microversion: 2.1 time: 0.688729 Aug 23 18:03:29.969476 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1495/2951] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:29 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1216 bytes in 698 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:30.197754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b157721d-5527-418a-813a-d0e9ab73c36c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:30.212774 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b157721d-5527-418a-813a-d0e9ab73c36c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.757217 Aug 23 18:03:30.214316 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1457/2952] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:29 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:30.235310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b0b72b63-fe3c-4bb7-a43c-82075a9d26e9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:30.238682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b0b72b63-fe3c-4bb7-a43c-82075a9d26e9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:30.262922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0b72b63-fe3c-4bb7-a43c-82075a9d26e9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:30.266558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0b72b63-fe3c-4bb7-a43c-82075a9d26e9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:30.268493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0b72b63-fe3c-4bb7-a43c-82075a9d26e9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:30.269674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0b72b63-fe3c-4bb7-a43c-82075a9d26e9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:30.271608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0b72b63-fe3c-4bb7-a43c-82075a9d26e9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:30.273484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0b72b63-fe3c-4bb7-a43c-82075a9d26e9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:30.278238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1e967702-848d-4daf-8bd7-ff12512b587a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27dfc410d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:30.370441 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1e967702-848d-4daf-8bd7-ff12512b587a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1449 microversion: 2.1 time: 0.096066 Aug 23 18:03:30.371460 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1458/2953] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:30 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1449 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:03:30.379513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-76b43b9f-5bd8-4ffc-abda-bb6ff87f2c97 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:30.386212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-76b43b9f-5bd8-4ffc-abda-bb6ff87f2c97 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:30.387282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-76b43b9f-5bd8-4ffc-abda-bb6ff87f2c97 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Searching by: {'deleted': False, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:03:30.394846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76b43b9f-5bd8-4ffc-abda-bb6ff87f2c97 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:30.395719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76b43b9f-5bd8-4ffc-abda-bb6ff87f2c97 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:30.396319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76b43b9f-5bd8-4ffc-abda-bb6ff87f2c97 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:30.397255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76b43b9f-5bd8-4ffc-abda-bb6ff87f2c97 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:30.397912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76b43b9f-5bd8-4ffc-abda-bb6ff87f2c97 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:30.398568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76b43b9f-5bd8-4ffc-abda-bb6ff87f2c97 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:30.435518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-76b43b9f-5bd8-4ffc-abda-bb6ff87f2c97 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:03:30.449097 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b0b72b63-fe3c-4bb7-a43c-82075a9d26e9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.218354 Aug 23 18:03:30.449739 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1496/2954] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:03:30 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:03:30.466333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6cf38fdc-2023-4497-bb71-97bad6853f72 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec466160>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:30.540096 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-76b43b9f-5bd8-4ffc-abda-bb6ff87f2c97 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.153784 Aug 23 18:03:30.541115 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1459/2955] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 18:03:30 2022] GET /compute/v2.1/servers => generated 339 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:30.552057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f083cf07-d6b0-41f4-94c8-22bea5546be0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:30.552687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f083cf07-d6b0-41f4-94c8-22bea5546be0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:30.564561 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6cf38fdc-2023-4497-bb71-97bad6853f72 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 200 len: 1449 microversion: 2.1 time: 0.107645 Aug 23 18:03:30.569860 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1497/2956] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:30 2022] GET /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 1449 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:30.578223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f083cf07-d6b0-41f4-94c8-22bea5546be0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:30.578223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f083cf07-d6b0-41f4-94c8-22bea5546be0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:30.578223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f083cf07-d6b0-41f4-94c8-22bea5546be0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:30.578223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f083cf07-d6b0-41f4-94c8-22bea5546be0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:30.578223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f083cf07-d6b0-41f4-94c8-22bea5546be0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:30.578223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f083cf07-d6b0-41f4-94c8-22bea5546be0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:30.596423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c147f1d6-7c18-4034-aeaf-aa723860c3d4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:30.597296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c147f1d6-7c18-4034-aeaf-aa723860c3d4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:30.613949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c147f1d6-7c18-4034-aeaf-aa723860c3d4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:30.614449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c147f1d6-7c18-4034-aeaf-aa723860c3d4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:30.625859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c147f1d6-7c18-4034-aeaf-aa723860c3d4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:30.626844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c147f1d6-7c18-4034-aeaf-aa723860c3d4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:30.643239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c147f1d6-7c18-4034-aeaf-aa723860c3d4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:30.644440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c147f1d6-7c18-4034-aeaf-aa723860c3d4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:30.859569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f083cf07-d6b0-41f4-94c8-22bea5546be0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:30.873828 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f083cf07-d6b0-41f4-94c8-22bea5546be0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1671 microversion: 2.1 time: 0.329552 Aug 23 18:03:30.875357 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1460/2957] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:30 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1671 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:30.900363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:30.911792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:30.912700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Searching by: {'deleted': False, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:03:30.954827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:30.956574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:30.957248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:30.958206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:30.959598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:30.960373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:31.002808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:03:31.060825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:31.081214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:31.082296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:31.084119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:31.738799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c147f1d6-7c18-4034-aeaf-aa723860c3d4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:31.750057 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c147f1d6-7c18-4034-aeaf-aa723860c3d4 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1321 microversion: 2.1 time: 1.179082 Aug 23 18:03:31.753106 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1498/2958] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:30 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1321 bytes in 1183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:31.760103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5d276821-0b27-4692-851f-4364efed608b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec82daf0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:31.944079 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-388a3bcb-74d5-4b90-9916-d0246fc248eb tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 1709 microversion: 2.1 time: 1.065695 Aug 23 18:03:31.944678 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1461/2959] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 18:03:30 2022] GET /compute/v2.1/servers/detail => generated 1709 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:31.950422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-196fc51c-bbd2-4746-842d-47f04a685417 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:31.951412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-196fc51c-bbd2-4746-842d-47f04a685417 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:31.973095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-196fc51c-bbd2-4746-842d-47f04a685417 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:31.973843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-196fc51c-bbd2-4746-842d-47f04a685417 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:31.974661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-196fc51c-bbd2-4746-842d-47f04a685417 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:31.975661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-196fc51c-bbd2-4746-842d-47f04a685417 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:31.976284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-196fc51c-bbd2-4746-842d-47f04a685417 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:31.976861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-196fc51c-bbd2-4746-842d-47f04a685417 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:32.150359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-196fc51c-bbd2-4746-842d-47f04a685417 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:32.197852 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-196fc51c-bbd2-4746-842d-47f04a685417 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1274 microversion: 2.1 time: 0.251860 Aug 23 18:03:32.218392 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1462/2960] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:31 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:32.225502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2539525d-55ac-4e99-8549-3113402b86a0 req-22351e81-132e-47d7-87e2-2eaf83e9b7d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "168a9b93-02dd-4e3d-8bec-81ef826b9786", "tag": "b4656eca-5059-4a48-87ad-07cae9eab346"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:32.256284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2539525d-55ac-4e99-8549-3113402b86a0 req-22351e81-132e-47d7-87e2-2eaf83e9b7d1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:32.260958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2539525d-55ac-4e99-8549-3113402b86a0 req-22351e81-132e-47d7-87e2-2eaf83e9b7d1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:32.261635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2539525d-55ac-4e99-8549-3113402b86a0 req-22351e81-132e-47d7-87e2-2eaf83e9b7d1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:32.275940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:32.279588 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2539525d-55ac-4e99-8549-3113402b86a0 req-22351e81-132e-47d7-87e2-2eaf83e9b7d1 service nova] Creating event network-changed:b4656eca-5059-4a48-87ad-07cae9eab346 for instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 on n-h1-850468-16 Aug 23 18:03:32.287128 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2539525d-55ac-4e99-8549-3113402b86a0 req-22351e81-132e-47d7-87e2-2eaf83e9b7d1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065842 Aug 23 18:03:32.288261 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1463/2961] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:32.295754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7ff846d9-9b04-41bd-9f5e-aa7d02b72e60 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:32.297737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7ff846d9-9b04-41bd-9f5e-aa7d02b72e60 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:32.306074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ff846d9-9b04-41bd-9f5e-aa7d02b72e60 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:32.306773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ff846d9-9b04-41bd-9f5e-aa7d02b72e60 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:32.307441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ff846d9-9b04-41bd-9f5e-aa7d02b72e60 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:32.308276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ff846d9-9b04-41bd-9f5e-aa7d02b72e60 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:32.309030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ff846d9-9b04-41bd-9f5e-aa7d02b72e60 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:32.310321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ff846d9-9b04-41bd-9f5e-aa7d02b72e60 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:32.440608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:32.492189 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5d276821-0b27-4692-851f-4364efed608b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 204 len: 0 microversion: 2.1 time: 0.736036 Aug 23 18:03:32.493338 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1499/2962] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:31 2022] DELETE /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:03:32.500363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9840566-a8c0-4136-b8b9-4becf169618e tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:32.522183 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b9840566-a8c0-4136-b8b9-4becf169618e tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.027384 Aug 23 18:03:32.523691 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1500/2963] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 18:03:32 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:32.543144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b4817fbe-30d6-4c21-81b6-1a123b2bd6d3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:32.545507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b4817fbe-30d6-4c21-81b6-1a123b2bd6d3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:32.568902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4817fbe-30d6-4c21-81b6-1a123b2bd6d3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:32.572247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4817fbe-30d6-4c21-81b6-1a123b2bd6d3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:32.575147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4817fbe-30d6-4c21-81b6-1a123b2bd6d3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:32.576260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4817fbe-30d6-4c21-81b6-1a123b2bd6d3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:32.577163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4817fbe-30d6-4c21-81b6-1a123b2bd6d3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:32.577853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4817fbe-30d6-4c21-81b6-1a123b2bd6d3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:32.645536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b4817fbe-30d6-4c21-81b6-1a123b2bd6d3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:03:32.842206 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b4817fbe-30d6-4c21-81b6-1a123b2bd6d3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 204 len: 0 microversion: 2.1 time: 0.308733 Aug 23 18:03:32.843890 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1501/2964] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:03:32 2022] DELETE /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:03:32.859298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-88a9c64a-a8cb-4a22-895f-d48ea94dcd26 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:32.860542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-88a9c64a-a8cb-4a22-895f-d48ea94dcd26 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:32.876784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88a9c64a-a8cb-4a22-895f-d48ea94dcd26 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:32.880162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88a9c64a-a8cb-4a22-895f-d48ea94dcd26 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:32.881413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88a9c64a-a8cb-4a22-895f-d48ea94dcd26 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:32.884584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88a9c64a-a8cb-4a22-895f-d48ea94dcd26 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:32.885453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88a9c64a-a8cb-4a22-895f-d48ea94dcd26 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:32.888505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88a9c64a-a8cb-4a22-895f-d48ea94dcd26 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:33.275702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7ff846d9-9b04-41bd-9f5e-aa7d02b72e60 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:33.285557 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7ff846d9-9b04-41bd-9f5e-aa7d02b72e60 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1671 microversion: 2.1 time: 0.994883 Aug 23 18:03:33.290945 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1464/2965] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:32 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1671 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:33.302814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8071a81e-472b-4e54-8fa7-2f12dc0546d8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:33.307664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8071a81e-472b-4e54-8fa7-2f12dc0546d8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:33.316485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8071a81e-472b-4e54-8fa7-2f12dc0546d8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:33.317513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8071a81e-472b-4e54-8fa7-2f12dc0546d8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:33.318220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8071a81e-472b-4e54-8fa7-2f12dc0546d8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:33.319521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8071a81e-472b-4e54-8fa7-2f12dc0546d8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:33.320361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8071a81e-472b-4e54-8fa7-2f12dc0546d8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:33.321098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8071a81e-472b-4e54-8fa7-2f12dc0546d8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:33.394073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8071a81e-472b-4e54-8fa7-2f12dc0546d8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:03:33.433824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-88a9c64a-a8cb-4a22-895f-d48ea94dcd26 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:33.444218 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-88a9c64a-a8cb-4a22-895f-d48ea94dcd26 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1321 microversion: 2.1 time: 0.597559 Aug 23 18:03:33.447592 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1502/2966] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:32 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1321 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:33.454358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-417682569", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "bd6bcc31-356e-406f-85ed-9a6dbf64ea38"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:33.572386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] validate_networks() for [('bd6bcc31-356e-406f-85ed-9a6dbf64ea38', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:03:33.614238 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8071a81e-472b-4e54-8fa7-2f12dc0546d8 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "DELETE /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 204 len: 0 microversion: 2.1 time: 0.321542 Aug 23 18:03:33.615258 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1465/2967] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:03:33 2022] DELETE /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:03:33.626920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49b53ef7-9f72-4d4a-8f83-346051d138ef tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:33.633356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49b53ef7-9f72-4d4a-8f83-346051d138ef tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:33.644556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49b53ef7-9f72-4d4a-8f83-346051d138ef tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:33.647191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49b53ef7-9f72-4d4a-8f83-346051d138ef tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:33.647819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49b53ef7-9f72-4d4a-8f83-346051d138ef tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:33.648717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49b53ef7-9f72-4d4a-8f83-346051d138ef tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:33.653667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49b53ef7-9f72-4d4a-8f83-346051d138ef tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:33.655655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49b53ef7-9f72-4d4a-8f83-346051d138ef tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:33.975063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-49b53ef7-9f72-4d4a-8f83-346051d138ef tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:33.986781 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49b53ef7-9f72-4d4a-8f83-346051d138ef tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1316 microversion: 2.1 time: 0.368141 Aug 23 18:03:33.990016 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1466/2968] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:33 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1316 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:34.000911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7a75f776-db59-4d20-a739-374c0ab0d0c4 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:34.002015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7a75f776-db59-4d20-a739-374c0ab0d0c4 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:34.013587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a75f776-db59-4d20-a739-374c0ab0d0c4 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:34.014087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a75f776-db59-4d20-a739-374c0ab0d0c4 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:34.014626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a75f776-db59-4d20-a739-374c0ab0d0c4 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:34.021415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a75f776-db59-4d20-a739-374c0ab0d0c4 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:34.021953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a75f776-db59-4d20-a739-374c0ab0d0c4 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:34.022375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a75f776-db59-4d20-a739-374c0ab0d0c4 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:34.339520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7a75f776-db59-4d20-a739-374c0ab0d0c4 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:34.356368 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7a75f776-db59-4d20-a739-374c0ab0d0c4 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1712 microversion: 2.1 time: 0.358553 Aug 23 18:03:34.359381 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1467/2969] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:33 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1712 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:34.369738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-af50914b-8658-4b79-82f3-f2cbcac79970 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:34.370614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-af50914b-8658-4b79-82f3-f2cbcac79970 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:34.388764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af50914b-8658-4b79-82f3-f2cbcac79970 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:34.390028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af50914b-8658-4b79-82f3-f2cbcac79970 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:34.390776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af50914b-8658-4b79-82f3-f2cbcac79970 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:34.391805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af50914b-8658-4b79-82f3-f2cbcac79970 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:34.392573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af50914b-8658-4b79-82f3-f2cbcac79970 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:34.393224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af50914b-8658-4b79-82f3-f2cbcac79970 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:34.862173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-af50914b-8658-4b79-82f3-f2cbcac79970 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:34.875981 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-af50914b-8658-4b79-82f3-f2cbcac79970 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1671 microversion: 2.1 time: 0.515266 Aug 23 18:03:34.877810 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1468/2970] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:34 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1671 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:34.896991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec432df4-c9f4-4afd-ac4e-3558fed0acbd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:34.898073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ec432df4-c9f4-4afd-ac4e-3558fed0acbd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:34.911790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec432df4-c9f4-4afd-ac4e-3558fed0acbd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:34.912284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec432df4-c9f4-4afd-ac4e-3558fed0acbd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:34.912940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec432df4-c9f4-4afd-ac4e-3558fed0acbd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:34.918013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec432df4-c9f4-4afd-ac4e-3558fed0acbd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:34.919345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec432df4-c9f4-4afd-ac4e-3558fed0acbd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:34.919949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec432df4-c9f4-4afd-ac4e-3558fed0acbd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:35.226626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec432df4-c9f4-4afd-ac4e-3558fed0acbd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:35.239384 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec432df4-c9f4-4afd-ac4e-3558fed0acbd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1321 microversion: 2.1 time: 0.359183 Aug 23 18:03:35.255160 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1469/2971] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:34 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1321 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:35.267929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f85850e6-7415-4a4a-896e-5c0c3c7b1c6e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:35.268714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f85850e6-7415-4a4a-896e-5c0c3c7b1c6e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:35.285150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f85850e6-7415-4a4a-896e-5c0c3c7b1c6e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:35.285645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f85850e6-7415-4a4a-896e-5c0c3c7b1c6e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:35.287973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f85850e6-7415-4a4a-896e-5c0c3c7b1c6e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:35.289556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f85850e6-7415-4a4a-896e-5c0c3c7b1c6e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:35.291141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f85850e6-7415-4a4a-896e-5c0c3c7b1c6e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:35.292511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f85850e6-7415-4a4a-896e-5c0c3c7b1c6e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:35.816168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f85850e6-7415-4a4a-896e-5c0c3c7b1c6e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:35.847915 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f85850e6-7415-4a4a-896e-5c0c3c7b1c6e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1316 microversion: 2.1 time: 0.576497 Aug 23 18:03:35.850098 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1470/2972] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:35 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1316 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:35.863649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-fbaa8646-b340-481b-a69e-7691d31ab870 req-00b1d995-c73c-49ab-bf5f-e4aa3c50d85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769e5a46-b0fd-49a3-bffa-1538728a67cc", "name": "network-vif-unplugged", "status": "completed", "tag": "4df03a69-a606-4878-8aa1-164f4e89e488"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:35.900006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fbaa8646-b340-481b-a69e-7691d31ab870 req-00b1d995-c73c-49ab-bf5f-e4aa3c50d85d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:35.900515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fbaa8646-b340-481b-a69e-7691d31ab870 req-00b1d995-c73c-49ab-bf5f-e4aa3c50d85d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:35.907349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fbaa8646-b340-481b-a69e-7691d31ab870 req-00b1d995-c73c-49ab-bf5f-e4aa3c50d85d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:35.941686 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-fbaa8646-b340-481b-a69e-7691d31ab870 req-00b1d995-c73c-49ab-bf5f-e4aa3c50d85d service nova] Creating event network-vif-unplugged:4df03a69-a606-4878-8aa1-164f4e89e488 for instance 769e5a46-b0fd-49a3-bffa-1538728a67cc on n-h1-850468-16 Aug 23 18:03:35.955767 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-fbaa8646-b340-481b-a69e-7691d31ab870 req-00b1d995-c73c-49ab-bf5f-e4aa3c50d85d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103554 Aug 23 18:03:35.956404 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1471/2973] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:35.970366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:03:35.970926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:03:35.971345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:03:35.971689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:03:35.972105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:03:35.973525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-130b0145-df13-4b3c-89ec-5e02eae2ba3c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:35.978011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-130b0145-df13-4b3c-89ec-5e02eae2ba3c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:35.992205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:35.995019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:35.996029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:35.998222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:35.999669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-130b0145-df13-4b3c-89ec-5e02eae2ba3c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:36.000951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:36.001588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-130b0145-df13-4b3c-89ec-5e02eae2ba3c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:36.002289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:36.002406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-130b0145-df13-4b3c-89ec-5e02eae2ba3c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:36.005271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-130b0145-df13-4b3c-89ec-5e02eae2ba3c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:36.007146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-130b0145-df13-4b3c-89ec-5e02eae2ba3c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:36.008111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-130b0145-df13-4b3c-89ec-5e02eae2ba3c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:36.052002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Getting quotas for project 0c1067637ced47dab01d19a65bfc3dd7. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:03:36.060792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Getting quotas for user 78a1cc2772e846e0ac3ca0324ab3cee3 and project 0c1067637ced47dab01d19a65bfc3dd7. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:03:36.095383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:03:36.100016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:03:36.199167 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-777f151b-9f1a-49f7-b917-40aedb1dd5fc tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.749792 Aug 23 18:03:36.200155 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1503/2974] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:03:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2752 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:03:36.206520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b44415f5-90b3-4a2a-bf1e-dc5b0ad6c3d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:36.207941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b44415f5-90b3-4a2a-bf1e-dc5b0ad6c3d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:36.218780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b44415f5-90b3-4a2a-bf1e-dc5b0ad6c3d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:36.219461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b44415f5-90b3-4a2a-bf1e-dc5b0ad6c3d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:36.220218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b44415f5-90b3-4a2a-bf1e-dc5b0ad6c3d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:36.221388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b44415f5-90b3-4a2a-bf1e-dc5b0ad6c3d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:36.222631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b44415f5-90b3-4a2a-bf1e-dc5b0ad6c3d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:36.223775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b44415f5-90b3-4a2a-bf1e-dc5b0ad6c3d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:36.456519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-130b0145-df13-4b3c-89ec-5e02eae2ba3c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:36.474534 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-130b0145-df13-4b3c-89ec-5e02eae2ba3c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1712 microversion: 2.1 time: 0.513503 Aug 23 18:03:36.476728 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1472/2975] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:35 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1712 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:36.493464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5a943a75-399b-4c6e-84f9-aaa51ff9e3a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:36.494638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5a943a75-399b-4c6e-84f9-aaa51ff9e3a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:36.641499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b44415f5-90b3-4a2a-bf1e-dc5b0ad6c3d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:36.651784 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b44415f5-90b3-4a2a-bf1e-dc5b0ad6c3d7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1671 microversion: 2.1 time: 0.450206 Aug 23 18:03:36.666911 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1504/2976] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:36 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1671 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:36.672355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b945fb9d-69e6-4d5b-bfae-6d36a6a99702 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:36.677576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b945fb9d-69e6-4d5b-bfae-6d36a6a99702 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:36.691507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b945fb9d-69e6-4d5b-bfae-6d36a6a99702 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:36.693344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b945fb9d-69e6-4d5b-bfae-6d36a6a99702 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:36.695189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b945fb9d-69e6-4d5b-bfae-6d36a6a99702 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:36.696863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b945fb9d-69e6-4d5b-bfae-6d36a6a99702 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:36.697151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5a943a75-399b-4c6e-84f9-aaa51ff9e3a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:36.698897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b945fb9d-69e6-4d5b-bfae-6d36a6a99702 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:36.700742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b945fb9d-69e6-4d5b-bfae-6d36a6a99702 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:36.713638 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5a943a75-399b-4c6e-84f9-aaa51ff9e3a7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1207 microversion: 2.1 time: 0.235584 Aug 23 18:03:36.720872 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1473/2977] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:36 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1207 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:36.733899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-e5952b45-ddd7-4148-af6a-7a1310d3ec1b req-347dbb54-a0ee-4bd0-a5c7-5b47f7658917 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0910b63-6031-40e1-8e5b-b25eca463ee5", "tag": "bc750646-993b-42e5-a282-c50ac6462709"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:36.752118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e5952b45-ddd7-4148-af6a-7a1310d3ec1b req-347dbb54-a0ee-4bd0-a5c7-5b47f7658917 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:36.753574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e5952b45-ddd7-4148-af6a-7a1310d3ec1b req-347dbb54-a0ee-4bd0-a5c7-5b47f7658917 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:36.754200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e5952b45-ddd7-4148-af6a-7a1310d3ec1b req-347dbb54-a0ee-4bd0-a5c7-5b47f7658917 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:36.778990 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-e5952b45-ddd7-4148-af6a-7a1310d3ec1b req-347dbb54-a0ee-4bd0-a5c7-5b47f7658917 service nova] Creating event network-changed:bc750646-993b-42e5-a282-c50ac6462709 for instance b0910b63-6031-40e1-8e5b-b25eca463ee5 on n-h1-850468-16 Aug 23 18:03:36.794694 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-e5952b45-ddd7-4148-af6a-7a1310d3ec1b req-347dbb54-a0ee-4bd0-a5c7-5b47f7658917 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072391 Aug 23 18:03:36.795517 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1474/2978] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:36.872169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b7cf0e8a-4f7b-41af-bf64-3ce60c7daac6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:36.872877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b7cf0e8a-4f7b-41af-bf64-3ce60c7daac6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:36.887149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7cf0e8a-4f7b-41af-bf64-3ce60c7daac6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:36.891722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7cf0e8a-4f7b-41af-bf64-3ce60c7daac6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:36.892292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7cf0e8a-4f7b-41af-bf64-3ce60c7daac6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:36.894762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7cf0e8a-4f7b-41af-bf64-3ce60c7daac6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:36.896278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7cf0e8a-4f7b-41af-bf64-3ce60c7daac6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:36.898395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7cf0e8a-4f7b-41af-bf64-3ce60c7daac6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:37.110279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b7cf0e8a-4f7b-41af-bf64-3ce60c7daac6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:37.121625 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b7cf0e8a-4f7b-41af-bf64-3ce60c7daac6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1316 microversion: 2.1 time: 0.254535 Aug 23 18:03:37.122951 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1475/2979] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:36 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1316 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:37.135626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b945fb9d-69e6-4d5b-bfae-6d36a6a99702 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:37.144421 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b945fb9d-69e6-4d5b-bfae-6d36a6a99702 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1321 microversion: 2.1 time: 0.476066 Aug 23 18:03:37.145658 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1505/2980] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:36 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:37.505523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-75309ba1-7f60-4cbf-aab6-2898e29f8875 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:37.506895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-75309ba1-7f60-4cbf-aab6-2898e29f8875 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:37.517474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75309ba1-7f60-4cbf-aab6-2898e29f8875 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:37.518107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75309ba1-7f60-4cbf-aab6-2898e29f8875 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:37.518569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75309ba1-7f60-4cbf-aab6-2898e29f8875 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:37.519581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75309ba1-7f60-4cbf-aab6-2898e29f8875 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:37.520051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75309ba1-7f60-4cbf-aab6-2898e29f8875 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:37.520479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75309ba1-7f60-4cbf-aab6-2898e29f8875 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:37.676746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3bc6805-e7ab-49eb-aaea-04d530f066f3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:37.677654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f3bc6805-e7ab-49eb-aaea-04d530f066f3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:37.697807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3bc6805-e7ab-49eb-aaea-04d530f066f3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:37.699246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3bc6805-e7ab-49eb-aaea-04d530f066f3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:37.701941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3bc6805-e7ab-49eb-aaea-04d530f066f3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:37.703769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3bc6805-e7ab-49eb-aaea-04d530f066f3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:37.707412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3bc6805-e7ab-49eb-aaea-04d530f066f3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:37.712445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3bc6805-e7ab-49eb-aaea-04d530f066f3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:37.813684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-75309ba1-7f60-4cbf-aab6-2898e29f8875 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:37.828667 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-75309ba1-7f60-4cbf-aab6-2898e29f8875 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1712 microversion: 2.1 time: 0.332476 Aug 23 18:03:37.829965 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1476/2981] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:37 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1712 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:37.835888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b049fe8e-6765-416a-add3-a24fa0142610 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:37.836714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b049fe8e-6765-416a-add3-a24fa0142610 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:37.844591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b049fe8e-6765-416a-add3-a24fa0142610 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:37.845753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b049fe8e-6765-416a-add3-a24fa0142610 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:37.846200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b049fe8e-6765-416a-add3-a24fa0142610 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:37.846942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b049fe8e-6765-416a-add3-a24fa0142610 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:37.847408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b049fe8e-6765-416a-add3-a24fa0142610 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:37.847892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b049fe8e-6765-416a-add3-a24fa0142610 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:37.918710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b049fe8e-6765-416a-add3-a24fa0142610 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:37.928801 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b049fe8e-6765-416a-add3-a24fa0142610 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1259 microversion: 2.1 time: 0.097509 Aug 23 18:03:37.929393 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1477/2982] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:37 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1259 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:38.146344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cade607a-72d0-4774-9e40-0d2d54eb6485 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:38.147419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cade607a-72d0-4774-9e40-0d2d54eb6485 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:38.156421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cade607a-72d0-4774-9e40-0d2d54eb6485 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:38.157241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cade607a-72d0-4774-9e40-0d2d54eb6485 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:38.157709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f3bc6805-e7ab-49eb-aaea-04d530f066f3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:38.158754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cade607a-72d0-4774-9e40-0d2d54eb6485 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:38.160110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cade607a-72d0-4774-9e40-0d2d54eb6485 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:38.162905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cade607a-72d0-4774-9e40-0d2d54eb6485 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:38.163617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cade607a-72d0-4774-9e40-0d2d54eb6485 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:38.177525 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f3bc6805-e7ab-49eb-aaea-04d530f066f3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1671 microversion: 2.1 time: 0.506172 Aug 23 18:03:38.178136 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1506/2983] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:37 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1671 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:38.188585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4d13adc0-fd97-409b-8aa4-2f74c0b81abd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:38.191081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4d13adc0-fd97-409b-8aa4-2f74c0b81abd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:38.207065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d13adc0-fd97-409b-8aa4-2f74c0b81abd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:38.207820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d13adc0-fd97-409b-8aa4-2f74c0b81abd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:38.208484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d13adc0-fd97-409b-8aa4-2f74c0b81abd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:38.209601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d13adc0-fd97-409b-8aa4-2f74c0b81abd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:38.210227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d13adc0-fd97-409b-8aa4-2f74c0b81abd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:38.210982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d13adc0-fd97-409b-8aa4-2f74c0b81abd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:38.240316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:38.488370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cade607a-72d0-4774-9e40-0d2d54eb6485 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:38.498589 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cade607a-72d0-4774-9e40-0d2d54eb6485 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1316 microversion: 2.1 time: 0.357536 Aug 23 18:03:38.506706 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1478/2984] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:38 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1316 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:38.853196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93f77f85-8c91-4e1d-a1b0-de886d525e1c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:38.854346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-93f77f85-8c91-4e1d-a1b0-de886d525e1c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:38.867480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93f77f85-8c91-4e1d-a1b0-de886d525e1c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:38.873360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93f77f85-8c91-4e1d-a1b0-de886d525e1c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:38.877026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93f77f85-8c91-4e1d-a1b0-de886d525e1c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:38.878372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93f77f85-8c91-4e1d-a1b0-de886d525e1c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:38.880660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93f77f85-8c91-4e1d-a1b0-de886d525e1c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:38.881932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93f77f85-8c91-4e1d-a1b0-de886d525e1c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:39.254103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4d13adc0-fd97-409b-8aa4-2f74c0b81abd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:39.272677 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4d13adc0-fd97-409b-8aa4-2f74c0b81abd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1321 microversion: 2.1 time: 1.092034 Aug 23 18:03:39.273703 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1507/2985] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:38 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1321 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:39.280302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-df4205cd-b714-4fc5-87f7-c62e530d9f8c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:39.281370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-df4205cd-b714-4fc5-87f7-c62e530d9f8c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:39.289609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df4205cd-b714-4fc5-87f7-c62e530d9f8c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:39.290533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df4205cd-b714-4fc5-87f7-c62e530d9f8c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:39.291180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df4205cd-b714-4fc5-87f7-c62e530d9f8c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:39.292585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df4205cd-b714-4fc5-87f7-c62e530d9f8c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:39.293309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df4205cd-b714-4fc5-87f7-c62e530d9f8c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:39.293917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df4205cd-b714-4fc5-87f7-c62e530d9f8c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:39.447316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-df4205cd-b714-4fc5-87f7-c62e530d9f8c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:39.464343 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-df4205cd-b714-4fc5-87f7-c62e530d9f8c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1265 microversion: 2.1 time: 0.188754 Aug 23 18:03:39.481337 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1508/2986] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:39 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:39.499428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-17af590e-a161-4884-a1c5-81fd1d10dbd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:39.500730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-17af590e-a161-4884-a1c5-81fd1d10dbd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:39.508477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17af590e-a161-4884-a1c5-81fd1d10dbd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:39.509209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17af590e-a161-4884-a1c5-81fd1d10dbd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:39.509934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17af590e-a161-4884-a1c5-81fd1d10dbd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:39.510828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17af590e-a161-4884-a1c5-81fd1d10dbd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:39.511439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17af590e-a161-4884-a1c5-81fd1d10dbd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:39.512128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17af590e-a161-4884-a1c5-81fd1d10dbd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:40.092234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-93f77f85-8c91-4e1d-a1b0-de886d525e1c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:40.102157 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93f77f85-8c91-4e1d-a1b0-de886d525e1c tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1712 microversion: 2.1 time: 1.254344 Aug 23 18:03:40.105523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-17af590e-a161-4884-a1c5-81fd1d10dbd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:40.114737 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-17af590e-a161-4884-a1c5-81fd1d10dbd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.630048 Aug 23 18:03:40.128207 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1479/2987] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:38 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1712 bytes in 1281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:40.134425 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1509/2988] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:39 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:40.137694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8b9bc3b5-8c5b-4688-8c61-641b897a4016 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:40.138327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8b9bc3b5-8c5b-4688-8c61-641b897a4016 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:40.160200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6b53cdc4-675a-41bc-9d2f-ee592047a858 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:40.166441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6b53cdc4-675a-41bc-9d2f-ee592047a858 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:40.167673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9bc3b5-8c5b-4688-8c61-641b897a4016 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:40.168532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9bc3b5-8c5b-4688-8c61-641b897a4016 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:40.169040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9bc3b5-8c5b-4688-8c61-641b897a4016 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:40.172649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9bc3b5-8c5b-4688-8c61-641b897a4016 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:40.176195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9bc3b5-8c5b-4688-8c61-641b897a4016 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:40.176817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9bc3b5-8c5b-4688-8c61-641b897a4016 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:40.184687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b53cdc4-675a-41bc-9d2f-ee592047a858 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:40.185181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b53cdc4-675a-41bc-9d2f-ee592047a858 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:40.189238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b53cdc4-675a-41bc-9d2f-ee592047a858 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:40.192411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b53cdc4-675a-41bc-9d2f-ee592047a858 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:40.193091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b53cdc4-675a-41bc-9d2f-ee592047a858 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:40.193533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b53cdc4-675a-41bc-9d2f-ee592047a858 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:40.255884 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6b53cdc4-675a-41bc-9d2f-ee592047a858 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 200 len: 323 microversion: 2.1 time: 0.102600 Aug 23 18:03:40.256925 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1510/2989] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:03:40 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 323 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:03:40.267384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-980e6dda-17bc-4145-9d38-95764e33cbdf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:40.267981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-980e6dda-17bc-4145-9d38-95764e33cbdf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:40.275325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-980e6dda-17bc-4145-9d38-95764e33cbdf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:40.275892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-980e6dda-17bc-4145-9d38-95764e33cbdf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:40.276481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-980e6dda-17bc-4145-9d38-95764e33cbdf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:40.277255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-980e6dda-17bc-4145-9d38-95764e33cbdf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:40.277770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-980e6dda-17bc-4145-9d38-95764e33cbdf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:40.278215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-980e6dda-17bc-4145-9d38-95764e33cbdf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:40.580275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8b9bc3b5-8c5b-4688-8c61-641b897a4016 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:40.588513 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8b9bc3b5-8c5b-4688-8c61-641b897a4016 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1316 microversion: 2.1 time: 0.459089 Aug 23 18:03:40.602721 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1480/2990] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:40 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1316 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:40.608649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1773e1a3-8453-436a-9925-2f90290fb088 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:40.609574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1773e1a3-8453-436a-9925-2f90290fb088 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:40.616120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1773e1a3-8453-436a-9925-2f90290fb088 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:40.616950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1773e1a3-8453-436a-9925-2f90290fb088 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:40.617630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1773e1a3-8453-436a-9925-2f90290fb088 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:40.618608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1773e1a3-8453-436a-9925-2f90290fb088 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:40.619278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1773e1a3-8453-436a-9925-2f90290fb088 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:40.619922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1773e1a3-8453-436a-9925-2f90290fb088 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:40.625344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:40.815560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-980e6dda-17bc-4145-9d38-95764e33cbdf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:40.835566 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-980e6dda-17bc-4145-9d38-95764e33cbdf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.573026 Aug 23 18:03:40.836780 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1511/2991] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:40 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:03:40.841796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ca730563-ebbb-4f5c-b13f-ec5a1137d13f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:40.848522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ca730563-ebbb-4f5c-b13f-ec5a1137d13f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:40.859411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca730563-ebbb-4f5c-b13f-ec5a1137d13f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:40.863294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca730563-ebbb-4f5c-b13f-ec5a1137d13f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:40.863989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca730563-ebbb-4f5c-b13f-ec5a1137d13f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:40.866821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca730563-ebbb-4f5c-b13f-ec5a1137d13f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:40.866821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca730563-ebbb-4f5c-b13f-ec5a1137d13f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:40.866821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca730563-ebbb-4f5c-b13f-ec5a1137d13f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:40.983185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:41.031765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1773e1a3-8453-436a-9925-2f90290fb088 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:41.040287 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1773e1a3-8453-436a-9925-2f90290fb088 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1321 microversion: 2.1 time: 0.436022 Aug 23 18:03:41.040881 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1481/2992] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:40 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1321 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:41.075294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-da5580fc-4f1b-4b54-b4a8-634e8a0ef279 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:41.075926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-da5580fc-4f1b-4b54-b4a8-634e8a0ef279 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:41.096777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:41.098384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5580fc-4f1b-4b54-b4a8-634e8a0ef279 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:41.099044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5580fc-4f1b-4b54-b4a8-634e8a0ef279 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:41.099492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5580fc-4f1b-4b54-b4a8-634e8a0ef279 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:41.100220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5580fc-4f1b-4b54-b4a8-634e8a0ef279 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:41.100682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5580fc-4f1b-4b54-b4a8-634e8a0ef279 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:41.101165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5580fc-4f1b-4b54-b4a8-634e8a0ef279 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:41.109029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ca730563-ebbb-4f5c-b13f-ec5a1137d13f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:41.126446 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ca730563-ebbb-4f5c-b13f-ec5a1137d13f tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1265 microversion: 2.1 time: 0.288265 Aug 23 18:03:41.127098 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1512/2993] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:40 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1265 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:41.148078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-905a9fd6-676f-4ba3-9bbf-ddde2cbadbde tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:41.148945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-905a9fd6-676f-4ba3-9bbf-ddde2cbadbde tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:41.161317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-905a9fd6-676f-4ba3-9bbf-ddde2cbadbde tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:41.164274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-905a9fd6-676f-4ba3-9bbf-ddde2cbadbde tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:41.165113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-905a9fd6-676f-4ba3-9bbf-ddde2cbadbde tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:41.166681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-905a9fd6-676f-4ba3-9bbf-ddde2cbadbde tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:41.174130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-905a9fd6-676f-4ba3-9bbf-ddde2cbadbde tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:41.174853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-905a9fd6-676f-4ba3-9bbf-ddde2cbadbde tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:41.541410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-da5580fc-4f1b-4b54-b4a8-634e8a0ef279 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:41.556393 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-da5580fc-4f1b-4b54-b4a8-634e8a0ef279 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.494888 Aug 23 18:03:41.557374 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1482/2994] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:41 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:41.637558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-905a9fd6-676f-4ba3-9bbf-ddde2cbadbde tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:41.660596 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-905a9fd6-676f-4ba3-9bbf-ddde2cbadbde tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1712 microversion: 2.1 time: 0.515126 Aug 23 18:03:41.665426 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1513/2995] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:41 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1712 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:41.678634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-aa37f684-aca8-4433-b531-fd102e16acc2 req-1e4ea057-3a58-4076-88f4-72b6d5275c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "769e5a46-b0fd-49a3-bffa-1538728a67cc", "name": "network-vif-deleted", "tag": "4df03a69-a606-4878-8aa1-164f4e89e488"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:41.712917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-aa37f684-aca8-4433-b531-fd102e16acc2 req-1e4ea057-3a58-4076-88f4-72b6d5275c83 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:41.712917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-aa37f684-aca8-4433-b531-fd102e16acc2 req-1e4ea057-3a58-4076-88f4-72b6d5275c83 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:41.712917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-aa37f684-aca8-4433-b531-fd102e16acc2 req-1e4ea057-3a58-4076-88f4-72b6d5275c83 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:41.757013 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-aa37f684-aca8-4433-b531-fd102e16acc2 req-1e4ea057-3a58-4076-88f4-72b6d5275c83 service nova] Creating event network-vif-deleted:4df03a69-a606-4878-8aa1-164f4e89e488 for instance 769e5a46-b0fd-49a3-bffa-1538728a67cc on n-h1-850468-16 Aug 23 18:03:41.767724 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-aa37f684-aca8-4433-b531-fd102e16acc2 req-1e4ea057-3a58-4076-88f4-72b6d5275c83 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100862 Aug 23 18:03:41.768861 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1514/2996] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:41.779647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c0d65866-59f9-4d8c-9371-6ce9dcfd4173 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:41.782421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c0d65866-59f9-4d8c-9371-6ce9dcfd4173 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:41.799758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0d65866-59f9-4d8c-9371-6ce9dcfd4173 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:41.800493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0d65866-59f9-4d8c-9371-6ce9dcfd4173 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:41.801072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0d65866-59f9-4d8c-9371-6ce9dcfd4173 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:41.801974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0d65866-59f9-4d8c-9371-6ce9dcfd4173 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:41.803467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0d65866-59f9-4d8c-9371-6ce9dcfd4173 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:41.804229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0d65866-59f9-4d8c-9371-6ce9dcfd4173 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:41.874368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d38d72ca-a209-48c3-8db5-46b671194f55 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Calling method '.version_select at 0x7f27f1a91e50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:41.949343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-d38d72ca-a209-48c3-8db5-46b671194f55 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0384a060-257e-4a29-b7e1-9f2a24722f13 does not exist", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:03:41.950178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.security_group_api [None req-d38d72ca-a209-48c3-8db5-46b671194f55 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Neutron security group 0384a060-257e-4a29-b7e1-9f2a24722f13 not found {{(pid=128807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:03:41.950739 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-d38d72ca-a209-48c3-8db5-46b671194f55 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] HTTP exception thrown: Security group 0384a060-257e-4a29-b7e1-9f2a24722f13 does not exist Aug 23 18:03:41.950739 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-5ade3650-c4cd-49bf-9077-260eb4276688'] Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d38d72ca-a209-48c3-8db5-46b671194f55 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Request method failure captured: Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-security-groups/0384a060-257e-4a29-b7e1-9f2a24722f13 HTTP/1.1 Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRZ8NIJJ4QThU4Dgp6_qlSeybE2B-hCOvhXvoCOke402loAHezvJXYnuk-HSncA97OZmuKXSXyNZmxrz6fh8aAkw4dCy5oiijdgIGQcC9KWhFh6CCp9bKLNOhpH9gKuFDE2QphaZWbKqKs9vrbDeyw-8hFOQdgyklCEa8Fk9ldX6E9c Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 1357b4981e4f41de87d9278d5f19e404 Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1007656811 Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1357b4981e4f41de87d9278d5f19e404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1357b4981e4f41de87d9278d5f19e404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1357b4981e4f41de87d9278d5f19e404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1357b4981e4f41de87d9278d5f19e404"}]}] Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1007656811 Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 1357b4981e4f41de87d9278d5f19e404 Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1007656811 Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsNegativeTestJSON-1007656811-project Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: aaa8a25f364f412fb4e1ceff5fc9d459 Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1007656811-project Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: exception: Security group 0384a060-257e-4a29-b7e1-9f2a24722f13 does not exist Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-5ade3650-c4cd-49bf-9077-260eb4276688'] Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '0384a060-257e-4a29-b7e1-9f2a24722f13'} Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:03:41.952978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0384a060-257e-4a29-b7e1-9f2a24722f13 does not exist Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ade3650-c4cd-49bf-9077-260eb4276688'] Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0384a060-257e-4a29-b7e1-9f2a24722f13 does not exist Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ade3650-c4cd-49bf-9077-260eb4276688'] Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0384a060-257e-4a29-b7e1-9f2a24722f13 does not exist Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ade3650-c4cd-49bf-9077-260eb4276688'] Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0384a060-257e-4a29-b7e1-9f2a24722f13 does not exist Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-5ade3650-c4cd-49bf-9077-260eb4276688'] Aug 23 18:03:41.957190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:41.966174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d38d72ca-a209-48c3-8db5-46b671194f55 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Returning 404 to user: Security group 0384a060-257e-4a29-b7e1-9f2a24722f13 does not exist Aug 23 18:03:41.966174 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-5ade3650-c4cd-49bf-9077-260eb4276688'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:41.967105 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d38d72ca-a209-48c3-8db5-46b671194f55 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/0384a060-257e-4a29-b7e1-9f2a24722f13" status: 404 len: 194 microversion: 2.1 time: 0.408080 Aug 23 18:03:41.968237 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1483/2997] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:03:41 2022] DELETE /compute/v2.1/os-security-groups/0384a060-257e-4a29-b7e1-9f2a24722f13 => generated 194 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:03:41.980314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed7902b5-2c51-4191-a8c9-ff9537853b34 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:41.982908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ed7902b5-2c51-4191-a8c9-ff9537853b34 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:42.019890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed7902b5-2c51-4191-a8c9-ff9537853b34 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:42.020316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed7902b5-2c51-4191-a8c9-ff9537853b34 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:42.021722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed7902b5-2c51-4191-a8c9-ff9537853b34 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:42.023225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed7902b5-2c51-4191-a8c9-ff9537853b34 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:42.024019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed7902b5-2c51-4191-a8c9-ff9537853b34 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:42.024630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed7902b5-2c51-4191-a8c9-ff9537853b34 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:42.210421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c0d65866-59f9-4d8c-9371-6ce9dcfd4173 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:42.234145 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c0d65866-59f9-4d8c-9371-6ce9dcfd4173 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.462527 Aug 23 18:03:42.247152 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1515/2998] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:41 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:42.266621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7ac3e123-8e46-4c27-8a75-5536c19ca58b req-1c3c0eb3-fb73-4c0a-acd8-48aa225639fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168a9b93-02dd-4e3d-8bec-81ef826b9786", "name": "network-vif-plugged", "status": "completed", "tag": "b4656eca-5059-4a48-87ad-07cae9eab346"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:42.288828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7ac3e123-8e46-4c27-8a75-5536c19ca58b req-1c3c0eb3-fb73-4c0a-acd8-48aa225639fc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:42.289643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7ac3e123-8e46-4c27-8a75-5536c19ca58b req-1c3c0eb3-fb73-4c0a-acd8-48aa225639fc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:42.290288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7ac3e123-8e46-4c27-8a75-5536c19ca58b req-1c3c0eb3-fb73-4c0a-acd8-48aa225639fc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:42.302730 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7ac3e123-8e46-4c27-8a75-5536c19ca58b req-1c3c0eb3-fb73-4c0a-acd8-48aa225639fc service nova] Creating event network-vif-plugged:b4656eca-5059-4a48-87ad-07cae9eab346 for instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 on n-h1-850468-16 Aug 23 18:03:42.308515 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7ac3e123-8e46-4c27-8a75-5536c19ca58b req-1c3c0eb3-fb73-4c0a-acd8-48aa225639fc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060024 Aug 23 18:03:42.309128 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1516/2999] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:42.315328 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2b8f438e-258e-4475-8bfc-fde43db065fb tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.004902 Aug 23 18:03:42.319925 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1517/3000] 10.222.0.61 () {58 vars in 1164 bytes} [Tue Aug 23 18:03:42 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 18:03:42.327455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9270c90e-9c61-44d2-af8a-e7556ef5d35b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:42.328419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9270c90e-9c61-44d2-af8a-e7556ef5d35b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:42.337463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9270c90e-9c61-44d2-af8a-e7556ef5d35b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:42.337696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9270c90e-9c61-44d2-af8a-e7556ef5d35b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:42.338326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9270c90e-9c61-44d2-af8a-e7556ef5d35b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:42.341481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9270c90e-9c61-44d2-af8a-e7556ef5d35b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:42.342329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9270c90e-9c61-44d2-af8a-e7556ef5d35b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:42.343559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9270c90e-9c61-44d2-af8a-e7556ef5d35b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:42.625030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9270c90e-9c61-44d2-af8a-e7556ef5d35b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:42.634069 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9270c90e-9c61-44d2-af8a-e7556ef5d35b tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1321 microversion: 2.1 time: 0.313039 Aug 23 18:03:42.637015 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1518/3001] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:42 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:42.648582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-794f046c-4b98-4c22-b0c4-54b2d02130c7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:42.652331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-794f046c-4b98-4c22-b0c4-54b2d02130c7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:42.666025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-794f046c-4b98-4c22-b0c4-54b2d02130c7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:42.667754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-794f046c-4b98-4c22-b0c4-54b2d02130c7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:42.670123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-794f046c-4b98-4c22-b0c4-54b2d02130c7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:42.671322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-794f046c-4b98-4c22-b0c4-54b2d02130c7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:42.673106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-794f046c-4b98-4c22-b0c4-54b2d02130c7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:42.673713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-794f046c-4b98-4c22-b0c4-54b2d02130c7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:42.763621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ed7902b5-2c51-4191-a8c9-ff9537853b34 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:42.779208 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ed7902b5-2c51-4191-a8c9-ff9537853b34 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1316 microversion: 2.1 time: 0.808759 Aug 23 18:03:42.781350 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1484/3002] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:41 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1316 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:42.796938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-61977217-fdf4-4c72-8f07-9fcfa81cffe1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:42.800450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-61977217-fdf4-4c72-8f07-9fcfa81cffe1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:42.814834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61977217-fdf4-4c72-8f07-9fcfa81cffe1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:42.819968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61977217-fdf4-4c72-8f07-9fcfa81cffe1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:42.820529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61977217-fdf4-4c72-8f07-9fcfa81cffe1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:42.821285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61977217-fdf4-4c72-8f07-9fcfa81cffe1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:42.821751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61977217-fdf4-4c72-8f07-9fcfa81cffe1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:42.822180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61977217-fdf4-4c72-8f07-9fcfa81cffe1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:43.074764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-794f046c-4b98-4c22-b0c4-54b2d02130c7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:43.083741 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-794f046c-4b98-4c22-b0c4-54b2d02130c7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1307 microversion: 2.1 time: 0.442925 Aug 23 18:03:43.103109 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1519/3003] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:42 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1307 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:43.112193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2daad3da-700b-4cad-acea-ae0be772a7b9 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Calling method '.version_select at 0x7f27ec665dc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:43.606786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-61977217-fdf4-4c72-8f07-9fcfa81cffe1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:43.627268 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-61977217-fdf4-4c72-8f07-9fcfa81cffe1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.838557 Aug 23 18:03:43.630617 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1485/3004] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:42 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:43.653383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:43.676568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:43.703172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:43.710766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:43.711181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:43.711953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:43.712494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:43.712929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:43.792109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:43.793591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:43.801324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:43.802305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lazy-loading 'fault' on Instance uuid 311dc663-0ec5-4c69-8684-8404750c745e {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:03:43.942527 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2daad3da-700b-4cad-acea-ae0be772a7b9 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.838119 Aug 23 18:03:43.943387 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1520/3005] 10.222.0.61 () {58 vars in 1158 bytes} [Tue Aug 23 18:03:43 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:43.948262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-19e05573-714d-4e56-b240-43ba4d2b6540 req-1e3a5ded-5185-46b7-b816-1438a8fed9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "311dc663-0ec5-4c69-8684-8404750c745e", "name": "network-vif-deleted", "tag": "971907ed-8899-4e44-b7e5-cddccbc9dc07"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:44.007183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-19e05573-714d-4e56-b240-43ba4d2b6540 req-1e3a5ded-5185-46b7-b816-1438a8fed9d5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:44.008927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-19e05573-714d-4e56-b240-43ba4d2b6540 req-1e3a5ded-5185-46b7-b816-1438a8fed9d5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:44.012688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-19e05573-714d-4e56-b240-43ba4d2b6540 req-1e3a5ded-5185-46b7-b816-1438a8fed9d5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:44.068683 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-19e05573-714d-4e56-b240-43ba4d2b6540 req-1e3a5ded-5185-46b7-b816-1438a8fed9d5 service nova] Creating event network-vif-deleted:971907ed-8899-4e44-b7e5-cddccbc9dc07 for instance 311dc663-0ec5-4c69-8684-8404750c745e on n-h1-850468-16 Aug 23 18:03:44.084209 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-19e05573-714d-4e56-b240-43ba4d2b6540 req-1e3a5ded-5185-46b7-b816-1438a8fed9d5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139252 Aug 23 18:03:44.087070 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1521/3006] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:44.101671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-492e3c13-a6d6-4f96-ad5e-553ae61da4e1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:44.104747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-492e3c13-a6d6-4f96-ad5e-553ae61da4e1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:44.115006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-492e3c13-a6d6-4f96-ad5e-553ae61da4e1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:44.120733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-492e3c13-a6d6-4f96-ad5e-553ae61da4e1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:44.123175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-492e3c13-a6d6-4f96-ad5e-553ae61da4e1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:44.124534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-492e3c13-a6d6-4f96-ad5e-553ae61da4e1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:44.127364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-492e3c13-a6d6-4f96-ad5e-553ae61da4e1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:44.128089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-492e3c13-a6d6-4f96-ad5e-553ae61da4e1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:44.204982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dca9686ab24246c5b0193976300dd07b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76feccd8ed314c7b9a6c7b031ad5affe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:44.214011 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c9fe2b23-6f07-4049-883d-7dd94134d72d tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 200 len: 1366 microversion: 2.1 time: 0.581920 Aug 23 18:03:44.231190 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1486/3007] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:43 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 1366 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:44.239765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-757aa1de-aa33-4691-bdce-391095a2f7fd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:44.240632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-757aa1de-aa33-4691-bdce-391095a2f7fd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:44.257919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-757aa1de-aa33-4691-bdce-391095a2f7fd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:44.258763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-757aa1de-aa33-4691-bdce-391095a2f7fd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:44.259271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-757aa1de-aa33-4691-bdce-391095a2f7fd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:44.265850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-757aa1de-aa33-4691-bdce-391095a2f7fd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:44.266760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-757aa1de-aa33-4691-bdce-391095a2f7fd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:44.271335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-757aa1de-aa33-4691-bdce-391095a2f7fd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:44.643591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-492e3c13-a6d6-4f96-ad5e-553ae61da4e1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:44.674416 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-492e3c13-a6d6-4f96-ad5e-553ae61da4e1 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1321 microversion: 2.1 time: 0.581136 Aug 23 18:03:44.677464 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1522/3008] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:44 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1321 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:44.700007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1869451634", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "ab5199d4-2532-451f-9ad2-38d9c898fa71"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:44.811949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] validate_networks() for [('ab5199d4-2532-451f-9ad2-38d9c898fa71', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:03:45.064588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-757aa1de-aa33-4691-bdce-391095a2f7fd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:45.087221 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-757aa1de-aa33-4691-bdce-391095a2f7fd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1316 microversion: 2.1 time: 0.851113 Aug 23 18:03:45.087880 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1487/3009] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:44 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1316 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:45.117703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1c414fed-97f6-4a1c-9a1d-26c30e17f1c8 req-2fdc4517-f2c5-464d-a7bb-1e5c3f8e6593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac15912e-be60-47a8-830a-2c5a25324a7e", "tag": "ee2214eb-a359-41ed-ab6e-41dc3a10f1f2"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:45.137845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1c414fed-97f6-4a1c-9a1d-26c30e17f1c8 req-2fdc4517-f2c5-464d-a7bb-1e5c3f8e6593 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:45.138157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1c414fed-97f6-4a1c-9a1d-26c30e17f1c8 req-2fdc4517-f2c5-464d-a7bb-1e5c3f8e6593 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:45.138650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1c414fed-97f6-4a1c-9a1d-26c30e17f1c8 req-2fdc4517-f2c5-464d-a7bb-1e5c3f8e6593 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:45.174094 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1c414fed-97f6-4a1c-9a1d-26c30e17f1c8 req-2fdc4517-f2c5-464d-a7bb-1e5c3f8e6593 service nova] Creating event network-changed:ee2214eb-a359-41ed-ab6e-41dc3a10f1f2 for instance ac15912e-be60-47a8-830a-2c5a25324a7e on n-h2-850468-16 Aug 23 18:03:45.181403 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1c414fed-97f6-4a1c-9a1d-26c30e17f1c8 req-2fdc4517-f2c5-464d-a7bb-1e5c3f8e6593 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088758 Aug 23 18:03:45.187378 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1488/3010] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:45.207819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b456378-5ff7-41fe-8ac5-5432aadb6bd3 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Calling method '.version_select at 0x7f27ecfc51f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:45.687537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-4b456378-5ff7-41fe-8ac5-5432aadb6bd3 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:03:45.688498 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-4b456378-5ff7-41fe-8ac5-5432aadb6bd3 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] HTTP exception thrown: Insufficient rights for removing default security group. Aug 23 18:03:45.688498 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-0cf6ca04-e62c-4b96-b589-a631af9f74a7'] Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b456378-5ff7-41fe-8ac5-5432aadb6bd3 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Request method failure captured: Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-security-groups/1b41fab9-a9c0-42b5-b6f0-b051baa7d86a HTTP/1.1 Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRZ8NIJJ4QThU4Dgp6_qlSeybE2B-hCOvhXvoCOke402loAHezvJXYnuk-HSncA97OZmuKXSXyNZmxrz6fh8aAkw4dCy5oiijdgIGQcC9KWhFh6CCp9bKLNOhpH9gKuFDE2QphaZWbKqKs9vrbDeyw-8hFOQdgyklCEa8Fk9ldX6E9c Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 1357b4981e4f41de87d9278d5f19e404 Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1007656811 Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1357b4981e4f41de87d9278d5f19e404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1357b4981e4f41de87d9278d5f19e404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1357b4981e4f41de87d9278d5f19e404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1357b4981e4f41de87d9278d5f19e404"}]}] Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1007656811 Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 1357b4981e4f41de87d9278d5f19e404 Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1007656811 Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsNegativeTestJSON-1007656811-project Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: aaa8a25f364f412fb4e1ceff5fc9d459 Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1007656811-project Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: exception: Insufficient rights for removing default security group. Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-0cf6ca04-e62c-4b96-b589-a631af9f74a7'] Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '1b41fab9-a9c0-42b5-b6f0-b051baa7d86a'} Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1045, in delete_security_group Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:03:45.691620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cf6ca04-e62c-4b96-b589-a631af9f74a7'] Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cf6ca04-e62c-4b96-b589-a631af9f74a7'] Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cf6ca04-e62c-4b96-b589-a631af9f74a7'] Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0cf6ca04-e62c-4b96-b589-a631af9f74a7'] Aug 23 18:03:45.696269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:45.702402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b456378-5ff7-41fe-8ac5-5432aadb6bd3 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Returning 400 to user: Insufficient rights for removing default security group. Aug 23 18:03:45.702402 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-0cf6ca04-e62c-4b96-b589-a631af9f74a7'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:45.704255 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b456378-5ff7-41fe-8ac5-5432aadb6bd3 tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/1b41fab9-a9c0-42b5-b6f0-b051baa7d86a" status: 400 len: 182 microversion: 2.1 time: 0.515333 Aug 23 18:03:45.706209 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1489/3011] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:03:45 2022] DELETE /compute/v2.1/os-security-groups/1b41fab9-a9c0-42b5-b6f0-b051baa7d86a => generated 182 bytes in 518 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:03:45.720859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2eee4b05-2915-4638-8073-303ed2a25e99 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:45.722605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2eee4b05-2915-4638-8073-303ed2a25e99 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:45.744822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2eee4b05-2915-4638-8073-303ed2a25e99 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:45.747250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2eee4b05-2915-4638-8073-303ed2a25e99 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:45.747945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2eee4b05-2915-4638-8073-303ed2a25e99 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:45.750826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2eee4b05-2915-4638-8073-303ed2a25e99 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:45.753082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2eee4b05-2915-4638-8073-303ed2a25e99 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:45.753802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2eee4b05-2915-4638-8073-303ed2a25e99 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:46.028492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:46.083137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=16 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:46.144688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2eee4b05-2915-4638-8073-303ed2a25e99 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:46.173516 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2eee4b05-2915-4638-8073-303ed2a25e99 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1307 microversion: 2.1 time: 0.465043 Aug 23 18:03:46.174949 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1490/3012] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:45 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1307 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:46.191259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-65be6c1d-f3ee-4d21-a4a7-d9164ca36a53 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:46.192508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-65be6c1d-f3ee-4d21-a4a7-d9164ca36a53 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] [instance: 311dc663-0ec5-4c69-8684-8404750c745e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:46.209552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65be6c1d-f3ee-4d21-a4a7-d9164ca36a53 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:46.210479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65be6c1d-f3ee-4d21-a4a7-d9164ca36a53 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:46.211242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65be6c1d-f3ee-4d21-a4a7-d9164ca36a53 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:46.213799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65be6c1d-f3ee-4d21-a4a7-d9164ca36a53 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:46.214588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65be6c1d-f3ee-4d21-a4a7-d9164ca36a53 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:46.215284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65be6c1d-f3ee-4d21-a4a7-d9164ca36a53 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:46.237727 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-65be6c1d-f3ee-4d21-a4a7-d9164ca36a53 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] HTTP exception thrown: Instance 311dc663-0ec5-4c69-8684-8404750c745e could not be found. Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-65be6c1d-f3ee-4d21-a4a7-d9164ca36a53 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Request method failure captured: Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e HTTP/1.1 Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRX8rKHTX0yvScTDf4At_i_HZPV3NoHmTROIgIMlhKpPU57bXBlHz1IDFrTX5puYEurzXrB4LTPVxOU0WIlAFn2dDKumKa0nEHg_F44Wn4aHgmVrxlHFez_8r3tRzUmsyDEx5iJ035TtkQJ_Z0R9U5SeTPKCewikYAFRPajKOB64vu8 Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 76feccd8ed314c7b9a6c7b031ad5affe Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestManualDisk-2030130854 Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_76feccd8ed314c7b9a6c7b031ad5affe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/76feccd8ed314c7b9a6c7b031ad5affe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/76feccd8ed314c7b9a6c7b031ad5affe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/76feccd8ed314c7b9a6c7b031ad5affe"}]}] Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestManualDisk-2030130854 Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 76feccd8ed314c7b9a6c7b031ad5affe Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestManualDisk-2030130854 Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestManualDisk-2030130854-project Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: dca9686ab24246c5b0193976300dd07b Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestManualDisk-2030130854-project Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 311dc663-0ec5-4c69-8684-8404750c745e could not be found. Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '311dc663-0ec5-4c69-8684-8404750c745e'} Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 311dc663-0ec5-4c69-8684-8404750c745e could not be found. Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 311dc663-0ec5-4c69-8684-8404750c745e could not be found. Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:46.239926 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.252452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:46.252452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:46.252452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:46.252452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:46.252452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:46.252452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 311dc663-0ec5-4c69-8684-8404750c745e could not be found. Aug 23 18:03:46.252452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.252452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-65be6c1d-f3ee-4d21-a4a7-d9164ca36a53 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Returning 404 to user: Instance 311dc663-0ec5-4c69-8684-8404750c745e could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:46.252452 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-65be6c1d-f3ee-4d21-a4a7-d9164ca36a53 tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e" status: 404 len: 111 microversion: 2.1 time: 0.068341 Aug 23 18:03:46.252452 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1491/3013] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:46 2022] GET /compute/v2.1/servers/311dc663-0ec5-4c69-8684-8404750c745e => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:03:46.261281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9c82e48c-0b3a-452a-8f45-ce604aba2e8f tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:46.262318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9c82e48c-0b3a-452a-8f45-ce604aba2e8f tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:46.269818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c82e48c-0b3a-452a-8f45-ce604aba2e8f tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:46.270276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c82e48c-0b3a-452a-8f45-ce604aba2e8f tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:46.270819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c82e48c-0b3a-452a-8f45-ce604aba2e8f tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:46.275072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c82e48c-0b3a-452a-8f45-ce604aba2e8f tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:46.275072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c82e48c-0b3a-452a-8f45-ce604aba2e8f tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:46.275072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c82e48c-0b3a-452a-8f45-ce604aba2e8f tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:46.366595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:03:46.367185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:03:46.367829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:03:46.368253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:03:46.368678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:03:46.379500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:46.380178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:46.380631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:46.381368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:46.381831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:46.382265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:46.397268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:46.415978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Getting quotas for project ed54655c5a6442d680ee1cb81021ddd2. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:03:46.423881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Getting quotas for user 11cb3b659afa416bb3371795600189fb and project ed54655c5a6442d680ee1cb81021ddd2. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:03:46.439404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:03:46.442028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:03:46.513424 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ee9a5c69-4f36-4116-a4dd-9bccef49cfd5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.834367 Aug 23 18:03:46.515821 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1523/3014] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:03:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:03:46.521182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5dc85137-7223-4c84-83c0-89de504d384c tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Calling method '.version_select at 0x7f27ec4669d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:46.573644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG neutronclient.v2_0.client [None req-5dc85137-7223-4c84-83c0-89de504d384c tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 4d3871cf-30a7-4c5e-a33c-5a8c92114dd6 does not exist", "detail": ""}} {{(pid=128808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:03:46.574678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.security_group_api [None req-5dc85137-7223-4c84-83c0-89de504d384c tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Neutron security group 4d3871cf-30a7-4c5e-a33c-5a8c92114dd6 not found {{(pid=128808) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:03:46.575762 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-5dc85137-7223-4c84-83c0-89de504d384c tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] HTTP exception thrown: Security group 4d3871cf-30a7-4c5e-a33c-5a8c92114dd6 does not exist Aug 23 18:03:46.575762 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-e121210b-3d7e-483d-8139-3c1161fc26f9'] Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5dc85137-7223-4c84-83c0-89de504d384c tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Request method failure captured: Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-security-groups/4d3871cf-30a7-4c5e-a33c-5a8c92114dd6 HTTP/1.1 Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRZ8NIJJ4QThU4Dgp6_qlSeybE2B-hCOvhXvoCOke402loAHezvJXYnuk-HSncA97OZmuKXSXyNZmxrz6fh8aAkw4dCy5oiijdgIGQcC9KWhFh6CCp9bKLNOhpH9gKuFDE2QphaZWbKqKs9vrbDeyw-8hFOQdgyklCEa8Fk9ldX6E9c Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 1357b4981e4f41de87d9278d5f19e404 Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1007656811 Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1357b4981e4f41de87d9278d5f19e404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1357b4981e4f41de87d9278d5f19e404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1357b4981e4f41de87d9278d5f19e404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1357b4981e4f41de87d9278d5f19e404"}]}] Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1007656811 Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 1357b4981e4f41de87d9278d5f19e404 Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1007656811 Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-SecurityGroupsNegativeTestJSON-1007656811-project Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: aaa8a25f364f412fb4e1ceff5fc9d459 Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1007656811-project Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: exception: Security group 4d3871cf-30a7-4c5e-a33c-5a8c92114dd6 does not exist Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-e121210b-3d7e-483d-8139-3c1161fc26f9'] Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '4d3871cf-30a7-4c5e-a33c-5a8c92114dd6'} Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:03:46.579386 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 4d3871cf-30a7-4c5e-a33c-5a8c92114dd6 does not exist Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e121210b-3d7e-483d-8139-3c1161fc26f9'] Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 4d3871cf-30a7-4c5e-a33c-5a8c92114dd6 does not exist Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e121210b-3d7e-483d-8139-3c1161fc26f9'] Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 4d3871cf-30a7-4c5e-a33c-5a8c92114dd6 does not exist Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e121210b-3d7e-483d-8139-3c1161fc26f9'] Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 4d3871cf-30a7-4c5e-a33c-5a8c92114dd6 does not exist Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e121210b-3d7e-483d-8139-3c1161fc26f9'] Aug 23 18:03:46.583761 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.589802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9c82e48c-0b3a-452a-8f45-ce604aba2e8f tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:46.591110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5dc85137-7223-4c84-83c0-89de504d384c tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Returning 404 to user: Security group 4d3871cf-30a7-4c5e-a33c-5a8c92114dd6 does not exist Aug 23 18:03:46.591110 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-e121210b-3d7e-483d-8139-3c1161fc26f9'] {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:46.592785 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5dc85137-7223-4c84-83c0-89de504d384c tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/4d3871cf-30a7-4c5e-a33c-5a8c92114dd6" status: 404 len: 194 microversion: 2.1 time: 0.075056 Aug 23 18:03:46.595517 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1524/3015] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 18:03:46 2022] GET /compute/v2.1/os-security-groups/4d3871cf-30a7-4c5e-a33c-5a8c92114dd6 => generated 194 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:03:46.602319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-084c6a1a-8b5a-499e-b5e2-8b29e4539de4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:46.603263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-084c6a1a-8b5a-499e-b5e2-8b29e4539de4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:46.604471 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9c82e48c-0b3a-452a-8f45-ce604aba2e8f tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1471 microversion: 2.1 time: 0.355694 Aug 23 18:03:46.607074 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1492/3016] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:46 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1471 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:46.612161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-084c6a1a-8b5a-499e-b5e2-8b29e4539de4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:46.612870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-084c6a1a-8b5a-499e-b5e2-8b29e4539de4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:46.613479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-084c6a1a-8b5a-499e-b5e2-8b29e4539de4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:46.614385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-084c6a1a-8b5a-499e-b5e2-8b29e4539de4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:46.615131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-084c6a1a-8b5a-499e-b5e2-8b29e4539de4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:46.615722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-084c6a1a-8b5a-499e-b5e2-8b29e4539de4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:46.618305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-002cdd94-4b3c-4396-b804-997338e7909e tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] Calling method '.version_select at 0x7f27eccce3a0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:46.676611 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-002cdd94-4b3c-4396-b804-997338e7909e tempest-ServersTestManualDisk-2030130854 tempest-ServersTestManualDisk-2030130854-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-723560221" status: 202 len: 0 microversion: 2.1 time: 0.063341 Aug 23 18:03:46.679542 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1493/3017] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Aug 23 18:03:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-723560221 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:03:46.693748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d08aedab-57ad-4ce2-853d-f64ef79fed3f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:46.695070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d08aedab-57ad-4ce2-853d-f64ef79fed3f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:46.716442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=10 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:46.821196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d08aedab-57ad-4ce2-853d-f64ef79fed3f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:46.834141 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d08aedab-57ad-4ce2-853d-f64ef79fed3f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1215 microversion: 2.1 time: 0.151192 Aug 23 18:03:46.838217 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1494/3018] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:46 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:46.854531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-805d41a2-6bad-4918-8396-eaa1579099ae tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Action: 'update', calling method: .version_select at 0x7f27ecb12ca0>, body: {"security_group": {"name": "tempest-sg-231145376", "description": "tempest-description-1195984441"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:46.923487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-084c6a1a-8b5a-499e-b5e2-8b29e4539de4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:46.930266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG neutronclient.v2_0.client [None req-805d41a2-6bad-4918-8396-eaa1579099ae tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c0a152a1-2f88-4f8a-9869-076ad5f79e18 does not exist", "detail": ""}} {{(pid=128807) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:03:46.930930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.security_group_api [None req-805d41a2-6bad-4918-8396-eaa1579099ae tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Neutron security group c0a152a1-2f88-4f8a-9869-076ad5f79e18 not found {{(pid=128807) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:03:46.931468 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-805d41a2-6bad-4918-8396-eaa1579099ae tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] HTTP exception thrown: Security group c0a152a1-2f88-4f8a-9869-076ad5f79e18 does not exist Aug 23 18:03:46.931468 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-baaab3c0-e8e3-401e-8d50-908dc7b53c58'] Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-805d41a2-6bad-4918-8396-eaa1579099ae tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Request method failure captured: Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: request: PUT /compute/v2.1/os-security-groups/c0a152a1-2f88-4f8a-9869-076ad5f79e18 HTTP/1.1 Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 101 Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRZ8NIJJ4QThU4Dgp6_qlSeybE2B-hCOvhXvoCOke402loAHezvJXYnuk-HSncA97OZmuKXSXyNZmxrz6fh8aAkw4dCy5oiijdgIGQcC9KWhFh6CCp9bKLNOhpH9gKuFDE2QphaZWbKqKs9vrbDeyw-8hFOQdgyklCEa8Fk9ldX6E9c Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 1357b4981e4f41de87d9278d5f19e404 Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1007656811 Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1357b4981e4f41de87d9278d5f19e404"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1357b4981e4f41de87d9278d5f19e404"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1357b4981e4f41de87d9278d5f19e404"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1357b4981e4f41de87d9278d5f19e404"}]}] Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1007656811 Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 1357b4981e4f41de87d9278d5f19e404 Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1007656811 Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-SecurityGroupsNegativeTestJSON-1007656811-project Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: aaa8a25f364f412fb4e1ceff5fc9d459 Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1007656811-project Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: {"security_group": {"name": "tempest-sg-231145376", "description": "tempest-description-1195984441"}} Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: exception: Security group c0a152a1-2f88-4f8a-9869-076ad5f79e18 does not exist Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-baaab3c0-e8e3-401e-8d50-908dc7b53c58'] Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'c0a152a1-2f88-4f8a-9869-076ad5f79e18', 'body': {'security_group': {'name': 'tempest-sg-231145376', 'description': 'tempest-description-1195984441'}}} Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:03:46.934782 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c0a152a1-2f88-4f8a-9869-076ad5f79e18 does not exist Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baaab3c0-e8e3-401e-8d50-908dc7b53c58'] Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c0a152a1-2f88-4f8a-9869-076ad5f79e18 does not exist Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baaab3c0-e8e3-401e-8d50-908dc7b53c58'] Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c0a152a1-2f88-4f8a-9869-076ad5f79e18 does not exist Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baaab3c0-e8e3-401e-8d50-908dc7b53c58'] Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c0a152a1-2f88-4f8a-9869-076ad5f79e18 does not exist Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-baaab3c0-e8e3-401e-8d50-908dc7b53c58'] Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-805d41a2-6bad-4918-8396-eaa1579099ae tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] Returning 404 to user: Security group c0a152a1-2f88-4f8a-9869-076ad5f79e18 does not exist Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: Neutron server returns request_ids: ['req-baaab3c0-e8e3-401e-8d50-908dc7b53c58'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-805d41a2-6bad-4918-8396-eaa1579099ae tempest-SecurityGroupsNegativeTestJSON-1007656811 tempest-SecurityGroupsNegativeTestJSON-1007656811-project] 10.222.0.61 "PUT /compute/v2.1/os-security-groups/c0a152a1-2f88-4f8a-9869-076ad5f79e18" status: 404 len: 194 microversion: 2.1 time: 0.096930 Aug 23 18:03:46.939288 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1495/3019] 10.222.0.61 () {60 vars in 1290 bytes} [Tue Aug 23 18:03:46 2022] PUT /compute/v2.1/os-security-groups/c0a152a1-2f88-4f8a-9869-076ad5f79e18 => generated 194 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:03:46.946609 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-084c6a1a-8b5a-499e-b5e2-8b29e4539de4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1316 microversion: 2.1 time: 0.335182 Aug 23 18:03:46.948954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8312df74-4ace-4ce5-ade2-10f26fbb2427 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:46.955700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8312df74-4ace-4ce5-ade2-10f26fbb2427 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:46.968431 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1525/3020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:46 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1316 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:46.992792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8312df74-4ace-4ce5-ade2-10f26fbb2427 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:46.993299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8312df74-4ace-4ce5-ade2-10f26fbb2427 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:46.993747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8312df74-4ace-4ce5-ade2-10f26fbb2427 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:46.994484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8312df74-4ace-4ce5-ade2-10f26fbb2427 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:46.994976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8312df74-4ace-4ce5-ade2-10f26fbb2427 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:46.995416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8312df74-4ace-4ce5-ade2-10f26fbb2427 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:47.043960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-8312df74-4ace-4ce5-ade2-10f26fbb2427 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lazy-loading 'flavor' on Instance uuid 168a9b93-02dd-4e3d-8bec-81ef826b9786 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:03:47.174455 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8312df74-4ace-4ce5-ade2-10f26fbb2427 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786/action" status: 202 len: 0 microversion: 2.1 time: 0.234274 Aug 23 18:03:47.182112 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1496/3021] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:03:46 2022] POST /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786/action => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:03:47.187370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-826c8d6c-e6f3-4a46-ae93-a8f0a6727189 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:47.188012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-826c8d6c-e6f3-4a46-ae93-a8f0a6727189 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:47.205987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-efe42068-c869-45f4-9f8f-62f86d3355eb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:47.208236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-efe42068-c869-45f4-9f8f-62f86d3355eb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:47.212754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-826c8d6c-e6f3-4a46-ae93-a8f0a6727189 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:47.215865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-826c8d6c-e6f3-4a46-ae93-a8f0a6727189 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:47.220582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-826c8d6c-e6f3-4a46-ae93-a8f0a6727189 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:47.222374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-826c8d6c-e6f3-4a46-ae93-a8f0a6727189 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:47.223680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-826c8d6c-e6f3-4a46-ae93-a8f0a6727189 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:47.226291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-826c8d6c-e6f3-4a46-ae93-a8f0a6727189 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:47.226428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efe42068-c869-45f4-9f8f-62f86d3355eb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:47.226862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efe42068-c869-45f4-9f8f-62f86d3355eb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:47.228252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efe42068-c869-45f4-9f8f-62f86d3355eb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:47.230297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efe42068-c869-45f4-9f8f-62f86d3355eb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:47.231683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efe42068-c869-45f4-9f8f-62f86d3355eb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:47.233220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efe42068-c869-45f4-9f8f-62f86d3355eb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:47.861007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-efe42068-c869-45f4-9f8f-62f86d3355eb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:47.887087 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-efe42068-c869-45f4-9f8f-62f86d3355eb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1307 microversion: 2.1 time: 0.691562 Aug 23 18:03:47.904016 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1497/3022] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:47 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1307 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:47.916099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-8ad54d4b-3591-4f73-956f-3dae2090dfdc req-cba7fc81-e146-4de2-8820-b25a07f07307 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0910b63-6031-40e1-8e5b-b25eca463ee5", "name": "network-vif-plugged", "status": "completed", "tag": "bc750646-993b-42e5-a282-c50ac6462709"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:47.958523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8ad54d4b-3591-4f73-956f-3dae2090dfdc req-cba7fc81-e146-4de2-8820-b25a07f07307 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:47.959109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8ad54d4b-3591-4f73-956f-3dae2090dfdc req-cba7fc81-e146-4de2-8820-b25a07f07307 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:47.959560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8ad54d4b-3591-4f73-956f-3dae2090dfdc req-cba7fc81-e146-4de2-8820-b25a07f07307 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:48.017786 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-8ad54d4b-3591-4f73-956f-3dae2090dfdc req-cba7fc81-e146-4de2-8820-b25a07f07307 service nova] Creating event network-vif-plugged:bc750646-993b-42e5-a282-c50ac6462709 for instance b0910b63-6031-40e1-8e5b-b25eca463ee5 on n-h1-850468-16 Aug 23 18:03:48.035319 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-8ad54d4b-3591-4f73-956f-3dae2090dfdc req-cba7fc81-e146-4de2-8820-b25a07f07307 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.126757 Aug 23 18:03:48.039760 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1498/3023] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:48.054197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-493e0246-7633-4280-a5c0-9dd5f2aecced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:48.057270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-493e0246-7633-4280-a5c0-9dd5f2aecced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:48.081343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-493e0246-7633-4280-a5c0-9dd5f2aecced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:48.081343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-493e0246-7633-4280-a5c0-9dd5f2aecced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:48.081343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-493e0246-7633-4280-a5c0-9dd5f2aecced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:48.081343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-493e0246-7633-4280-a5c0-9dd5f2aecced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:48.087145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-493e0246-7633-4280-a5c0-9dd5f2aecced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:48.088344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-493e0246-7633-4280-a5c0-9dd5f2aecced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:48.254933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-493e0246-7633-4280-a5c0-9dd5f2aecced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:48.270681 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-493e0246-7633-4280-a5c0-9dd5f2aecced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1267 microversion: 2.1 time: 0.228755 Aug 23 18:03:48.276318 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1499/3024] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:48 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1267 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:48.285477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6413a023-b0a4-4d56-9601-d9b70059992e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:48.288259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6413a023-b0a4-4d56-9601-d9b70059992e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:48.306757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6413a023-b0a4-4d56-9601-d9b70059992e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:48.309425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6413a023-b0a4-4d56-9601-d9b70059992e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:48.311838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6413a023-b0a4-4d56-9601-d9b70059992e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:48.312912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6413a023-b0a4-4d56-9601-d9b70059992e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:48.315120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6413a023-b0a4-4d56-9601-d9b70059992e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:48.315891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6413a023-b0a4-4d56-9601-d9b70059992e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:48.527489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6413a023-b0a4-4d56-9601-d9b70059992e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:48.549545 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6413a023-b0a4-4d56-9601-d9b70059992e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1316 microversion: 2.1 time: 0.271660 Aug 23 18:03:48.563745 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1500/3025] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:48 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1316 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:48.646910 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-826c8d6c-e6f3-4a46-ae93-a8f0a6727189 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1632 microversion: 2.1 time: 1.462898 Aug 23 18:03:48.650442 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1526/3026] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:47 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1632 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:48.910651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5065109c-cc9b-4f1c-9859-77ce0445d9f3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:48.911304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5065109c-cc9b-4f1c-9859-77ce0445d9f3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:48.926963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5065109c-cc9b-4f1c-9859-77ce0445d9f3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:48.927675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5065109c-cc9b-4f1c-9859-77ce0445d9f3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:48.928307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5065109c-cc9b-4f1c-9859-77ce0445d9f3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:48.929038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5065109c-cc9b-4f1c-9859-77ce0445d9f3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:48.929499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5065109c-cc9b-4f1c-9859-77ce0445d9f3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:48.929930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5065109c-cc9b-4f1c-9859-77ce0445d9f3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:49.298666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f895704b-3a60-4e5b-a5d5-6d82a3a81e27 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:49.299858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f895704b-3a60-4e5b-a5d5-6d82a3a81e27 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:49.317123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f895704b-3a60-4e5b-a5d5-6d82a3a81e27 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:49.317929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f895704b-3a60-4e5b-a5d5-6d82a3a81e27 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:49.318683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f895704b-3a60-4e5b-a5d5-6d82a3a81e27 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:49.320083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f895704b-3a60-4e5b-a5d5-6d82a3a81e27 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:49.323802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f895704b-3a60-4e5b-a5d5-6d82a3a81e27 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:49.324464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f895704b-3a60-4e5b-a5d5-6d82a3a81e27 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:49.337440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5065109c-cc9b-4f1c-9859-77ce0445d9f3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:49.348119 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5065109c-cc9b-4f1c-9859-77ce0445d9f3 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1307 microversion: 2.1 time: 0.442414 Aug 23 18:03:49.381287 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1501/3027] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:48 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1307 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:49.454612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f895704b-3a60-4e5b-a5d5-6d82a3a81e27 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:49.463351 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f895704b-3a60-4e5b-a5d5-6d82a3a81e27 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1273 microversion: 2.1 time: 0.170351 Aug 23 18:03:49.463930 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1527/3028] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:49 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1273 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:03:49.579183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a59a9beb-1c68-4163-b23d-7c6816dc5526 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:49.580161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a59a9beb-1c68-4163-b23d-7c6816dc5526 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:49.592757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a59a9beb-1c68-4163-b23d-7c6816dc5526 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:49.601139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a59a9beb-1c68-4163-b23d-7c6816dc5526 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:49.607245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a59a9beb-1c68-4163-b23d-7c6816dc5526 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:49.610571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a59a9beb-1c68-4163-b23d-7c6816dc5526 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:49.611847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a59a9beb-1c68-4163-b23d-7c6816dc5526 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:49.614532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a59a9beb-1c68-4163-b23d-7c6816dc5526 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:49.668627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b1b279fa-d561-4df9-ac40-7ff78f7a634d tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:49.669337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b1b279fa-d561-4df9-ac40-7ff78f7a634d tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:49.676581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1b279fa-d561-4df9-ac40-7ff78f7a634d tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:49.677393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1b279fa-d561-4df9-ac40-7ff78f7a634d tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:49.678301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1b279fa-d561-4df9-ac40-7ff78f7a634d tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:49.679390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1b279fa-d561-4df9-ac40-7ff78f7a634d tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:49.680156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1b279fa-d561-4df9-ac40-7ff78f7a634d tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:49.680851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1b279fa-d561-4df9-ac40-7ff78f7a634d tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:49.980700 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b1b279fa-d561-4df9-ac40-7ff78f7a634d tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1615 microversion: 2.1 time: 0.315920 Aug 23 18:03:49.984079 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1528/3029] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:49 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1615 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:03:49.994328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a59a9beb-1c68-4163-b23d-7c6816dc5526 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:49.999239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:50.040975 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a59a9beb-1c68-4163-b23d-7c6816dc5526 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1316 microversion: 2.1 time: 0.463365 Aug 23 18:03:50.042865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ac916ec-1e01-4951-90dd-1507c20459cb tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:50.044421 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1502/3030] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:49 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1316 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:50.047103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8ac916ec-1e01-4951-90dd-1507c20459cb tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:50.055910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac916ec-1e01-4951-90dd-1507c20459cb tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:50.057421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac916ec-1e01-4951-90dd-1507c20459cb tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:50.058170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac916ec-1e01-4951-90dd-1507c20459cb tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:50.059494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac916ec-1e01-4951-90dd-1507c20459cb tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:50.060225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac916ec-1e01-4951-90dd-1507c20459cb tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:50.060909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac916ec-1e01-4951-90dd-1507c20459cb tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:50.199091 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8ac916ec-1e01-4951-90dd-1507c20459cb tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] HTTP exception thrown: Cannot 'migrate' instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 while it is in vm_state suspended Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ac916ec-1e01-4951-90dd-1507c20459cb tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Request method failure captured: Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786/action HTTP/1.1 Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 15 Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRY_0fAW_id9e_zn_-7NLMZRRn2hoQeqIauiNv3sswYD56QaDeoSWGpya--nPBiwH2CmGX3FTjaFwdRBoNz8aYvEyxWqgxf3yg42eHFBMwwCMw5iJQbXhAwJCOyVOSklhw6jSA3CROupCfaYdPvO_7SWVyEIp05RxKJMMNwZ7u9BpCo Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: aa807f4ce80b4ce9a11355ba5a392c51 Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aa807f4ce80b4ce9a11355ba5a392c51"}]}] Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: aa807f4ce80b4ce9a11355ba5a392c51 Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersAdminNegativeTestJSON-1644191216-project-admin Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 7116801eb0f34e17ad0d689c0f6f4d58 Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1644191216-project-admin Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: {"migrate": {}} Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: exception: Cannot 'migrate' instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 while it is in vm_state suspended Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '168a9b93-02dd-4e3d-8bec-81ef826b9786', 'body': {'migrate': {}}} Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 in vm_state suspended. Cannot resize while the instance is in this state. Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:03:50.200927 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 while it is in vm_state suspended Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 while it is in vm_state suspended Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ac916ec-1e01-4951-90dd-1507c20459cb tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Returning 409 to user: Cannot 'migrate' instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 while it is in vm_state suspended {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8ac916ec-1e01-4951-90dd-1507c20459cb tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786/action" status: 409 len: 148 microversion: 2.1 time: 0.186257 Aug 23 18:03:50.212588 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1529/3031] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:03:50 2022] POST /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786/action => generated 148 bytes in 188 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:03:50.216453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-138d9269-51c6-43f6-9181-c6f8e0d0d63b tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-138d9269-51c6-43f6-9181-c6f8e0d0d63b tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Request method failure captured: Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34/action HTTP/1.1 Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 39 Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRY_0fAW_id9e_zn_-7NLMZRRn2hoQeqIauiNv3sswYD56QaDeoSWGpya--nPBiwH2CmGX3FTjaFwdRBoNz8aYvEyxWqgxf3yg42eHFBMwwCMw5iJQbXhAwJCOyVOSklhw6jSA3CROupCfaYdPvO_7SWVyEIp05RxKJMMNwZ7u9BpCo Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: aa807f4ce80b4ce9a11355ba5a392c51 Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aa807f4ce80b4ce9a11355ba5a392c51"}]}] Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: aa807f4ce80b4ce9a11355ba5a392c51 Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersAdminNegativeTestJSON-1644191216-project-admin Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 7116801eb0f34e17ad0d689c0f6f4d58 Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1644191216-project-admin Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: {"os-resetState": {"state": "invalid"}} Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '36016e6f-16b3-47fe-8f99-dcc878c83e34', 'body': {'os-resetState': {'state': 'invalid'}}} Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'invalid' Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:03:50.223084 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-138d9269-51c6-43f6-9181-c6f8e0d0d63b tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:50.227788 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-138d9269-51c6-43f6-9181-c6f8e0d0d63b tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34/action" status: 400 len: 144 microversion: 2.1 time: 0.013162 Aug 23 18:03:50.242117 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1503/3032] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:03:50 2022] POST /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34/action => generated 144 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:03:50.246401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6b43dcc6-825b-424a-bdc3-b305e750f5e3 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6b43dcc6-825b-424a-bdc3-b305e750f5e3 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Request method failure captured: Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34/action HTTP/1.1 Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 31 Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRY_0fAW_id9e_zn_-7NLMZRRn2hoQeqIauiNv3sswYD56QaDeoSWGpya--nPBiwH2CmGX3FTjaFwdRBoNz8aYvEyxWqgxf3yg42eHFBMwwCMw5iJQbXhAwJCOyVOSklhw6jSA3CROupCfaYdPvO_7SWVyEIp05RxKJMMNwZ7u9BpCo Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: aa807f4ce80b4ce9a11355ba5a392c51 Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aa807f4ce80b4ce9a11355ba5a392c51"}]}] Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: aa807f4ce80b4ce9a11355ba5a392c51 Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersAdminNegativeTestJSON-1644191216-project-admin Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 7116801eb0f34e17ad0d689c0f6f4d58 Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1644191216-project-admin Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: {"os-resetState": {"state": 1}} Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '36016e6f-16b3-47fe-8f99-dcc878c83e34', 'body': {'os-resetState': {'state': 1}}} Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 1 Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 23 18:03:50.256977 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.261913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:50.261913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.261913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:50.261913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:50.261913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:50.261913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:03:50.261913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:03:50.261913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Aug 23 18:03:50.261913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.261913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6b43dcc6-825b-424a-bdc3-b305e750f5e3 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:50.261913 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6b43dcc6-825b-424a-bdc3-b305e750f5e3 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34/action" status: 400 len: 120 microversion: 2.1 time: 0.017291 Aug 23 18:03:50.277672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-62d42e8b-635d-4a5a-83d6-4ffcb86ea828 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:50.278868 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1530/3033] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:03:50 2022] POST /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34/action => generated 120 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:03:50.280475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-62d42e8b-635d-4a5a-83d6-4ffcb86ea828 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Failed to fetch instance by id 999 {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 18:03:50.281201 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-62d42e8b-635d-4a5a-83d6-4ffcb86ea828 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] HTTP exception thrown: Instance 999 could not be found. Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-62d42e8b-635d-4a5a-83d6-4ffcb86ea828 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Request method failure captured: Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 37 Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRY_0fAW_id9e_zn_-7NLMZRRn2hoQeqIauiNv3sswYD56QaDeoSWGpya--nPBiwH2CmGX3FTjaFwdRBoNz8aYvEyxWqgxf3yg42eHFBMwwCMw5iJQbXhAwJCOyVOSklhw6jSA3CROupCfaYdPvO_7SWVyEIp05RxKJMMNwZ7u9BpCo Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: aa807f4ce80b4ce9a11355ba5a392c51 Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aa807f4ce80b4ce9a11355ba5a392c51"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aa807f4ce80b4ce9a11355ba5a392c51"}]}] Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: aa807f4ce80b4ce9a11355ba5a392c51 Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1644191216 Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersAdminNegativeTestJSON-1644191216-project-admin Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 7116801eb0f34e17ad0d689c0f6f4d58 Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1644191216-project-admin Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: {"os-resetState": {"state": "error"}} Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 999 could not be found. Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:50.289944 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:50.294593 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:50.294593 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 23 18:03:50.294593 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:50.295769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-62d42e8b-635d-4a5a-83d6-4ffcb86ea828 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:50.297007 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-62d42e8b-635d-4a5a-83d6-4ffcb86ea828 tempest-ServersAdminNegativeTestJSON-1644191216 tempest-ServersAdminNegativeTestJSON-1644191216-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.023268 Aug 23 18:03:50.301918 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1504/3034] 10.222.0.61 () {60 vars in 1179 bytes} [Tue Aug 23 18:03:50 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:03:50.309126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-22da0cad-058d-4d95-b387-ed88240fb805 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:50.309639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-22da0cad-058d-4d95-b387-ed88240fb805 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:50.335008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22da0cad-058d-4d95-b387-ed88240fb805 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:50.335582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22da0cad-058d-4d95-b387-ed88240fb805 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:50.336250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22da0cad-058d-4d95-b387-ed88240fb805 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:50.336987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22da0cad-058d-4d95-b387-ed88240fb805 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:50.362782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22da0cad-058d-4d95-b387-ed88240fb805 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:50.363358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22da0cad-058d-4d95-b387-ed88240fb805 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:50.376439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-010d309c-a9fa-4cf8-9401-3c537fa1fb98 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:50.377103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-010d309c-a9fa-4cf8-9401-3c537fa1fb98 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:50.383652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-010d309c-a9fa-4cf8-9401-3c537fa1fb98 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:50.384148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-010d309c-a9fa-4cf8-9401-3c537fa1fb98 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:50.384589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-010d309c-a9fa-4cf8-9401-3c537fa1fb98 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:50.385309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-010d309c-a9fa-4cf8-9401-3c537fa1fb98 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:50.385768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-010d309c-a9fa-4cf8-9401-3c537fa1fb98 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:50.386198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-010d309c-a9fa-4cf8-9401-3c537fa1fb98 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:50.408519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:50.461483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-22da0cad-058d-4d95-b387-ed88240fb805 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:03:50.644984 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-22da0cad-058d-4d95-b387-ed88240fb805 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "DELETE /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 204 len: 0 microversion: 2.1 time: 0.341951 Aug 23 18:03:50.649010 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1531/3035] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:03:50 2022] DELETE /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:03:50.655719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-02ce31b0-6323-43d5-b6ad-282f1e835c3c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:50.657359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-02ce31b0-6323-43d5-b6ad-282f1e835c3c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:50.672565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02ce31b0-6323-43d5-b6ad-282f1e835c3c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:50.673861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02ce31b0-6323-43d5-b6ad-282f1e835c3c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:50.675080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02ce31b0-6323-43d5-b6ad-282f1e835c3c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:50.676120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02ce31b0-6323-43d5-b6ad-282f1e835c3c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:50.676798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02ce31b0-6323-43d5-b6ad-282f1e835c3c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:50.677715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02ce31b0-6323-43d5-b6ad-282f1e835c3c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:51.085757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-02ce31b0-6323-43d5-b6ad-282f1e835c3c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:51.096037 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-02ce31b0-6323-43d5-b6ad-282f1e835c3c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1273 microversion: 2.1 time: 0.445636 Aug 23 18:03:51.110287 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1532/3036] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:50 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1273 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:51.115665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-839a50e7-c163-4600-ad76-02fe40f48c49 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:51.116652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-839a50e7-c163-4600-ad76-02fe40f48c49 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:51.123514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-839a50e7-c163-4600-ad76-02fe40f48c49 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:51.125053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-839a50e7-c163-4600-ad76-02fe40f48c49 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:51.125854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-839a50e7-c163-4600-ad76-02fe40f48c49 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:51.126823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-839a50e7-c163-4600-ad76-02fe40f48c49 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:51.127452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-839a50e7-c163-4600-ad76-02fe40f48c49 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:51.128071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-839a50e7-c163-4600-ad76-02fe40f48c49 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:51.172809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-010d309c-a9fa-4cf8-9401-3c537fa1fb98 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:51.183227 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-010d309c-a9fa-4cf8-9401-3c537fa1fb98 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1307 microversion: 2.1 time: 0.815465 Aug 23 18:03:51.193915 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1505/3037] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:50 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1307 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:03:51.207945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e3b9893b-dad4-4a85-9535-52120b12919b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:51.209549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e3b9893b-dad4-4a85-9535-52120b12919b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:51.219786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3b9893b-dad4-4a85-9535-52120b12919b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:51.220582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3b9893b-dad4-4a85-9535-52120b12919b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:51.221195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3b9893b-dad4-4a85-9535-52120b12919b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:51.222264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3b9893b-dad4-4a85-9535-52120b12919b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:51.223076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3b9893b-dad4-4a85-9535-52120b12919b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:51.223672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3b9893b-dad4-4a85-9535-52120b12919b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:51.544051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-839a50e7-c163-4600-ad76-02fe40f48c49 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:51.566246 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-839a50e7-c163-4600-ad76-02fe40f48c49 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1468 microversion: 2.1 time: 0.454324 Aug 23 18:03:51.569383 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1533/3038] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:51 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1468 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:51.583219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e3b9893b-dad4-4a85-9535-52120b12919b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:51.594647 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e3b9893b-dad4-4a85-9535-52120b12919b tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1464 microversion: 2.1 time: 0.391256 Aug 23 18:03:51.595659 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1506/3039] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:51 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1464 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:51.618128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-47e601cf-c616-4f0c-9c97-77a12c71a4e8 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:51.618756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-47e601cf-c616-4f0c-9c97-77a12c71a4e8 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:51.630699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47e601cf-c616-4f0c-9c97-77a12c71a4e8 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:51.631204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47e601cf-c616-4f0c-9c97-77a12c71a4e8 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:51.631650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47e601cf-c616-4f0c-9c97-77a12c71a4e8 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:51.632376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47e601cf-c616-4f0c-9c97-77a12c71a4e8 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:51.632841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47e601cf-c616-4f0c-9c97-77a12c71a4e8 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:51.640491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47e601cf-c616-4f0c-9c97-77a12c71a4e8 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:51.650840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2a060d45-8c41-4306-b461-433cadbcce72 req-6171ce7e-1b4c-4e35-9170-b06b71957d5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac15912e-be60-47a8-830a-2c5a25324a7e", "name": "network-vif-plugged", "status": "completed", "tag": "ee2214eb-a359-41ed-ab6e-41dc3a10f1f2"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:51.671716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2a060d45-8c41-4306-b461-433cadbcce72 req-6171ce7e-1b4c-4e35-9170-b06b71957d5a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:51.675022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2a060d45-8c41-4306-b461-433cadbcce72 req-6171ce7e-1b4c-4e35-9170-b06b71957d5a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:51.676670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2a060d45-8c41-4306-b461-433cadbcce72 req-6171ce7e-1b4c-4e35-9170-b06b71957d5a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:51.698693 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2a060d45-8c41-4306-b461-433cadbcce72 req-6171ce7e-1b4c-4e35-9170-b06b71957d5a service nova] Creating event network-vif-plugged:ee2214eb-a359-41ed-ab6e-41dc3a10f1f2 for instance ac15912e-be60-47a8-830a-2c5a25324a7e on n-h2-850468-16 Aug 23 18:03:51.711604 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2a060d45-8c41-4306-b461-433cadbcce72 req-6171ce7e-1b4c-4e35-9170-b06b71957d5a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066888 Aug 23 18:03:51.712683 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1507/3040] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:52.061248 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-47e601cf-c616-4f0c-9c97-77a12c71a4e8 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1617 microversion: 2.1 time: 0.446569 Aug 23 18:03:52.067001 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1534/3041] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:51 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1617 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:52.120727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff7909df-be3e-49a3-827a-b4906111c0c5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:52.121657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff7909df-be3e-49a3-827a-b4906111c0c5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:52.137511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff7909df-be3e-49a3-827a-b4906111c0c5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:52.138651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff7909df-be3e-49a3-827a-b4906111c0c5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:52.142179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff7909df-be3e-49a3-827a-b4906111c0c5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:52.143674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff7909df-be3e-49a3-827a-b4906111c0c5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:52.144326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff7909df-be3e-49a3-827a-b4906111c0c5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:52.144936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff7909df-be3e-49a3-827a-b4906111c0c5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:52.209204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-97acbc9a-cd06-40ae-949a-fdd865e31940 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:52.209822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-97acbc9a-cd06-40ae-949a-fdd865e31940 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:52.229184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97acbc9a-cd06-40ae-949a-fdd865e31940 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:52.235494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97acbc9a-cd06-40ae-949a-fdd865e31940 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:52.236023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97acbc9a-cd06-40ae-949a-fdd865e31940 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:52.242949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97acbc9a-cd06-40ae-949a-fdd865e31940 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:52.243736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97acbc9a-cd06-40ae-949a-fdd865e31940 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:52.246457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97acbc9a-cd06-40ae-949a-fdd865e31940 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:52.879480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97acbc9a-cd06-40ae-949a-fdd865e31940 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:52.891970 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-97acbc9a-cd06-40ae-949a-fdd865e31940 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1307 microversion: 2.1 time: 0.686947 Aug 23 18:03:52.893133 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1535/3042] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:52 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1307 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:52.902408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1929498521", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["8feaf703-5072-4321-b05e-dfebaaa5c573"]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:52.945059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff7909df-be3e-49a3-827a-b4906111c0c5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:52.957470 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff7909df-be3e-49a3-827a-b4906111c0c5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1315 microversion: 2.1 time: 0.843874 Aug 23 18:03:52.961423 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1508/3043] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:52 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1315 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:52.966327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0e0f1565-efe9-4c0d-94f4-69aa04426dcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:52.971360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0e0f1565-efe9-4c0d-94f4-69aa04426dcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:52.988414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e0f1565-efe9-4c0d-94f4-69aa04426dcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:52.989147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e0f1565-efe9-4c0d-94f4-69aa04426dcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:52.989790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e0f1565-efe9-4c0d-94f4-69aa04426dcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:52.990121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:03:52.990515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e0f1565-efe9-4c0d-94f4-69aa04426dcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:52.991007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e0f1565-efe9-4c0d-94f4-69aa04426dcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:52.991437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e0f1565-efe9-4c0d-94f4-69aa04426dcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:53.638233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0e0f1565-efe9-4c0d-94f4-69aa04426dcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:53.667331 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0e0f1565-efe9-4c0d-94f4-69aa04426dcb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1468 microversion: 2.1 time: 0.703666 Aug 23 18:03:53.669749 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1509/3044] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:52 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1468 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:53.681462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:03:53.682720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:03:53.684755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:03:53.687785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:03:53.689609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:03:53.719066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:53.720011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:53.720820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:53.722047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:53.722522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:53.726762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:53.815373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:03:53.834294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:03:53.903153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:03:53.919445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9e85de5b-1062-4e77-bd4a-b2a32be97614 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:53.920302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9e85de5b-1062-4e77-bd4a-b2a32be97614 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:53.934710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:03:53.947527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e85de5b-1062-4e77-bd4a-b2a32be97614 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:53.949291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e85de5b-1062-4e77-bd4a-b2a32be97614 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:53.952033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e85de5b-1062-4e77-bd4a-b2a32be97614 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:53.972891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e85de5b-1062-4e77-bd4a-b2a32be97614 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:53.973453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e85de5b-1062-4e77-bd4a-b2a32be97614 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:53.978318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e85de5b-1062-4e77-bd4a-b2a32be97614 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:54.129073 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c53fb951-6a16-4357-8188-6b99372058f2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.233395 Aug 23 18:03:54.129807 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1536/3045] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:03:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1236 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:03:54.140879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48a93cd7-f67b-477c-800c-9ed99883244b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:54.141630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-48a93cd7-f67b-477c-800c-9ed99883244b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:54.149097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48a93cd7-f67b-477c-800c-9ed99883244b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:54.149617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48a93cd7-f67b-477c-800c-9ed99883244b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:54.150021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48a93cd7-f67b-477c-800c-9ed99883244b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:54.150767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48a93cd7-f67b-477c-800c-9ed99883244b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:54.151552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48a93cd7-f67b-477c-800c-9ed99883244b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:54.152328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48a93cd7-f67b-477c-800c-9ed99883244b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:55.053182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-48a93cd7-f67b-477c-800c-9ed99883244b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:55.063360 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48a93cd7-f67b-477c-800c-9ed99883244b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1315 microversion: 2.1 time: 0.926551 Aug 23 18:03:55.068379 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1537/3046] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:54 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1315 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:55.089826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-50ddd267-5091-4c6f-9888-05d43a8b2c24 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:55.095855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-50ddd267-5091-4c6f-9888-05d43a8b2c24 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:55.200734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-50ddd267-5091-4c6f-9888-05d43a8b2c24 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:55.210035 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-50ddd267-5091-4c6f-9888-05d43a8b2c24 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1217 microversion: 2.1 time: 0.140198 Aug 23 18:03:55.212671 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1538/3047] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:55 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1217 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:55.222884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:55.223839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:55.248068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:55.252455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:55.253740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:55.256241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:55.258139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:55.262814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:55.336247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9e85de5b-1062-4e77-bd4a-b2a32be97614 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:55.356334 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9e85de5b-1062-4e77-bd4a-b2a32be97614 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1486 microversion: 2.1 time: 1.442933 Aug 23 18:03:55.358717 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1510/3048] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:53 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1486 bytes in 1446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:55.365696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b5df618b-106e-4b68-8f55-9d9ec00c6da6 req-5e2460a4-fce0-437b-a04e-7be2f7d74272 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "168a9b93-02dd-4e3d-8bec-81ef826b9786", "name": "network-vif-deleted", "tag": "b4656eca-5059-4a48-87ad-07cae9eab346"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:55.408788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b5df618b-106e-4b68-8f55-9d9ec00c6da6 req-5e2460a4-fce0-437b-a04e-7be2f7d74272 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:55.412320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b5df618b-106e-4b68-8f55-9d9ec00c6da6 req-5e2460a4-fce0-437b-a04e-7be2f7d74272 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:55.412961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b5df618b-106e-4b68-8f55-9d9ec00c6da6 req-5e2460a4-fce0-437b-a04e-7be2f7d74272 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:55.415917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:55.416438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:55.417115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:55.422899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lazy-loading 'fault' on Instance uuid 168a9b93-02dd-4e3d-8bec-81ef826b9786 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:03:55.480274 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b5df618b-106e-4b68-8f55-9d9ec00c6da6 req-5e2460a4-fce0-437b-a04e-7be2f7d74272 service nova] Creating event network-vif-deleted:b4656eca-5059-4a48-87ad-07cae9eab346 for instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 on n-h1-850468-16 Aug 23 18:03:55.510124 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b5df618b-106e-4b68-8f55-9d9ec00c6da6 req-5e2460a4-fce0-437b-a04e-7be2f7d74272 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149903 Aug 23 18:03:55.513477 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1511/3049] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:55.551711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-60170cd0-5c5f-4e81-8c33-7c2f00a1ba19 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-148348613"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:55.558016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-60170cd0-5c5f-4e81-8c33-7c2f00a1ba19 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:55.558899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:55.573518 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0c4c3956-e039-42bc-8828-bda3d8d3c02a tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 200 len: 1311 microversion: 2.1 time: 0.356656 Aug 23 18:03:55.577198 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1539/3050] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:55 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 1311 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:55.591411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60170cd0-5c5f-4e81-8c33-7c2f00a1ba19 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:55.593071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60170cd0-5c5f-4e81-8c33-7c2f00a1ba19 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:55.593544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60170cd0-5c5f-4e81-8c33-7c2f00a1ba19 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:55.609453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60170cd0-5c5f-4e81-8c33-7c2f00a1ba19 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:55.609964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60170cd0-5c5f-4e81-8c33-7c2f00a1ba19 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:55.610426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60170cd0-5c5f-4e81-8c33-7c2f00a1ba19 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:56.089937 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-60170cd0-5c5f-4e81-8c33-7c2f00a1ba19 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "POST /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e/action" status: 202 len: 0 microversion: 2.1 time: 0.565433 Aug 23 18:03:56.092831 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1512/3051] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:03:55 2022] POST /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e/action => generated 0 bytes in 570 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 18:03:56.100171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-494a6dee-c0c3-4db1-8682-c0874aff642b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:56.100861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-494a6dee-c0c3-4db1-8682-c0874aff642b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:56.108014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8d95cc9b-d605-452c-a962-8ef8df75e81c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27f1be4280>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:56.134978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-494a6dee-c0c3-4db1-8682-c0874aff642b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:56.137936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-494a6dee-c0c3-4db1-8682-c0874aff642b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:56.142915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-494a6dee-c0c3-4db1-8682-c0874aff642b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:56.152289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-494a6dee-c0c3-4db1-8682-c0874aff642b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:56.153541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-494a6dee-c0c3-4db1-8682-c0874aff642b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:56.158971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-494a6dee-c0c3-4db1-8682-c0874aff642b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:56.190568 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8d95cc9b-d605-452c-a962-8ef8df75e81c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/90857604-d1cf-4ff6-a7b8-391cf50588cf" status: 200 len: 1413 microversion: 2.1 time: 0.090750 Aug 23 18:03:56.202376 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1513/3052] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:56 2022] GET /compute/v2.1/images/90857604-d1cf-4ff6-a7b8-391cf50588cf => generated 1413 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:56.229851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e7c339b4-57a0-4855-8507-41b02fd3a37c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec86fee0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:56.321293 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e7c339b4-57a0-4855-8507-41b02fd3a37c tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/90857604-d1cf-4ff6-a7b8-391cf50588cf" status: 200 len: 1413 microversion: 2.1 time: 0.107113 Aug 23 18:03:56.331572 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1514/3053] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:56 2022] GET /compute/v2.1/images/90857604-d1cf-4ff6-a7b8-391cf50588cf => generated 1413 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:56.351350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66c1ea75-cd27-4984-b565-27dd2b719c27 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:56.352806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66c1ea75-cd27-4984-b565-27dd2b719c27 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:56.362618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c1ea75-cd27-4984-b565-27dd2b719c27 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:56.363317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c1ea75-cd27-4984-b565-27dd2b719c27 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:56.363985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c1ea75-cd27-4984-b565-27dd2b719c27 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:56.364906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c1ea75-cd27-4984-b565-27dd2b719c27 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:56.367563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c1ea75-cd27-4984-b565-27dd2b719c27 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:56.368310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c1ea75-cd27-4984-b565-27dd2b719c27 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:56.674866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-494a6dee-c0c3-4db1-8682-c0874aff642b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:56.696313 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-494a6dee-c0c3-4db1-8682-c0874aff642b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1315 microversion: 2.1 time: 0.607420 Aug 23 18:03:56.697564 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1540/3054] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:56 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:56.705155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5030fac1-3c3f-4da1-ba72-df0aa1dc1148 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec518280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:56.827919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:03:56.841009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66c1ea75-cd27-4984-b565-27dd2b719c27 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:56.864108 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66c1ea75-cd27-4984-b565-27dd2b719c27 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1269 microversion: 2.1 time: 0.530878 Aug 23 18:03:56.871827 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1515/3055] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:56 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1269 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:56.886105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1bb14111-d527-47be-89c0-e2496cb18ffb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:56.893876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1bb14111-d527-47be-89c0-e2496cb18ffb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 168a9b93-02dd-4e3d-8bec-81ef826b9786] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:56.908285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bb14111-d527-47be-89c0-e2496cb18ffb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:56.911202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bb14111-d527-47be-89c0-e2496cb18ffb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:56.912022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bb14111-d527-47be-89c0-e2496cb18ffb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:56.913038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bb14111-d527-47be-89c0-e2496cb18ffb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:56.919346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bb14111-d527-47be-89c0-e2496cb18ffb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:56.920410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bb14111-d527-47be-89c0-e2496cb18ffb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:56.952795 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-1bb14111-d527-47be-89c0-e2496cb18ffb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] HTTP exception thrown: Instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 could not be found. Aug 23 18:03:56.953178 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5030fac1-3c3f-4da1-ba72-df0aa1dc1148 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/images/90857604-d1cf-4ff6-a7b8-391cf50588cf" status: 204 len: 0 microversion: 2.1 time: 0.254153 Aug 23 18:03:56.953760 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1541/3056] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:56 2022] DELETE /compute/v2.1/images/90857604-d1cf-4ff6-a7b8-391cf50588cf => generated 0 bytes in 255 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1bb14111-d527-47be-89c0-e2496cb18ffb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Request method failure captured: Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 HTTP/1.1 Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRY-96hAv6KCo9RBXG0zknvvW0OxA7k2L0ew9XUIBcK7l6XtAU7LA7juA35VcLZ-koCVg-dQbq1x2G7mnKtx5pocqw0wvfIsMmKd_cMhso8THJYsAaY5B-aIj408b0rGbg49ufjSYJY4rGSnIVlCSzxCaKmZBAeIIStt4u1JUCH-ViA Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 57bb1f989bf346ab9daefe20a2e9a0b3 Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-639093848 Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_57bb1f989bf346ab9daefe20a2e9a0b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/57bb1f989bf346ab9daefe20a2e9a0b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/57bb1f989bf346ab9daefe20a2e9a0b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/57bb1f989bf346ab9daefe20a2e9a0b3"}]}] Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersAdminNegativeTestJSON-639093848 Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 57bb1f989bf346ab9daefe20a2e9a0b3 Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-639093848 Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersAdminNegativeTestJSON-639093848-project Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 845f5cca36ea458480b56e3b48f73454 Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersAdminNegativeTestJSON-639093848-project Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 could not be found. Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '168a9b93-02dd-4e3d-8bec-81ef826b9786'} Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 could not be found. Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 could not be found. Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:56.954750 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:56.959556 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:56.959556 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:56.959556 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:56.959556 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:56.959556 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:56.959556 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:56.959556 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 could not be found. Aug 23 18:03:56.959556 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:03:56.959556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1bb14111-d527-47be-89c0-e2496cb18ffb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Returning 404 to user: Instance 168a9b93-02dd-4e3d-8bec-81ef826b9786 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:56.959556 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1bb14111-d527-47be-89c0-e2496cb18ffb tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786" status: 404 len: 111 microversion: 2.1 time: 0.083316 Aug 23 18:03:56.966866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-2efd8303-6569-4f43-afae-7734e0e69c68 req-d0762856-555b-42f4-b29f-c8d9890178f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "431ff681-8a42-4440-b060-27bac6fb4ecb", "tag": "79e72ec6-2dad-439f-8c32-0b34ee6277fe"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:03:56.967683 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1516/3057] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:56 2022] GET /compute/v2.1/servers/168a9b93-02dd-4e3d-8bec-81ef826b9786 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:03:56.976674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fba2e7e5-d17c-4318-a2b0-eda87ccd8b0e tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:56.977372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fba2e7e5-d17c-4318-a2b0-eda87ccd8b0e tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:56.984739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fba2e7e5-d17c-4318-a2b0-eda87ccd8b0e tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:56.985821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fba2e7e5-d17c-4318-a2b0-eda87ccd8b0e tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:56.986432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fba2e7e5-d17c-4318-a2b0-eda87ccd8b0e tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:56.987365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fba2e7e5-d17c-4318-a2b0-eda87ccd8b0e tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:56.988166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fba2e7e5-d17c-4318-a2b0-eda87ccd8b0e tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:56.988754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fba2e7e5-d17c-4318-a2b0-eda87ccd8b0e tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:56.996312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2efd8303-6569-4f43-afae-7734e0e69c68 req-d0762856-555b-42f4-b29f-c8d9890178f8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:56.996895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2efd8303-6569-4f43-afae-7734e0e69c68 req-d0762856-555b-42f4-b29f-c8d9890178f8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:56.997352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2efd8303-6569-4f43-afae-7734e0e69c68 req-d0762856-555b-42f4-b29f-c8d9890178f8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:57.017307 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-2efd8303-6569-4f43-afae-7734e0e69c68 req-d0762856-555b-42f4-b29f-c8d9890178f8 service nova] Creating event network-changed:79e72ec6-2dad-439f-8c32-0b34ee6277fe for instance 431ff681-8a42-4440-b060-27bac6fb4ecb on n-h1-850468-16 Aug 23 18:03:57.024829 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-2efd8303-6569-4f43-afae-7734e0e69c68 req-d0762856-555b-42f4-b29f-c8d9890178f8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069337 Aug 23 18:03:57.027559 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1542/3058] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:03:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:03:57.040064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c0b2c163-8739-4982-8af2-c79ef61bb003 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec82df70>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:57.042669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fba2e7e5-d17c-4318-a2b0-eda87ccd8b0e tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:03:57.074671 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-c0b2c163-8739-4982-8af2-c79ef61bb003 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] HTTP exception thrown: Image not found. Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c0b2c163-8739-4982-8af2-c79ef61bb003 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Request method failure captured: Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/images/90857604-d1cf-4ff6-a7b8-391cf50588cf HTTP/1.1 Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRWHbV3OLKgIuNNXT5KCGZW7WT58aaAh9H89jE9QOZe82T8lIE_66bOTSflRCy4DYnq1nnsH73sZ7AopFhI6uIHrsl4n3xhrK5GELGV-O9mdGJRj8jUlbh44mSdwnGxUM3HP4lKIPkNUXzU__9FA4HrRgHB_ar7sGP9pzWp6deCKskM Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}] Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesTestJSON-1282878009 Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesTestJSON-1282878009-project Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 78a1cc2772e846e0ac3ca0324ab3cee3 Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesTestJSON-1282878009-project Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '90857604-d1cf-4ff6-a7b8-391cf50588cf'} Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 90857604-d1cf-4ff6-a7b8-391cf50588cf Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 18:03:57.078982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 90857604-d1cf-4ff6-a7b8-391cf50588cf could not be found. Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c0b2c163-8739-4982-8af2-c79ef61bb003 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:03:57.083545 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c0b2c163-8739-4982-8af2-c79ef61bb003 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/images/90857604-d1cf-4ff6-a7b8-391cf50588cf" status: 404 len: 62 microversion: 2.1 time: 0.052171 Aug 23 18:03:57.087872 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1543/3059] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:03:57 2022] GET /compute/v2.1/images/90857604-d1cf-4ff6-a7b8-391cf50588cf => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:03:57.096446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a76c1c3f-97e1-43a8-b250-d9fd45eff1d2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:57.097194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a76c1c3f-97e1-43a8-b250-d9fd45eff1d2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:57.111532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a76c1c3f-97e1-43a8-b250-d9fd45eff1d2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:57.112208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a76c1c3f-97e1-43a8-b250-d9fd45eff1d2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:57.112661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a76c1c3f-97e1-43a8-b250-d9fd45eff1d2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:57.114118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a76c1c3f-97e1-43a8-b250-d9fd45eff1d2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:57.114697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a76c1c3f-97e1-43a8-b250-d9fd45eff1d2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:57.115203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a76c1c3f-97e1-43a8-b250-d9fd45eff1d2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:57.178930 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fba2e7e5-d17c-4318-a2b0-eda87ccd8b0e tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "DELETE /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 204 len: 0 microversion: 2.1 time: 0.209692 Aug 23 18:03:57.180116 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1517/3060] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:03:56 2022] DELETE /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:03:57.189787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49489128-203a-4fe4-bc5d-9692588c5dff tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:57.190694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49489128-203a-4fe4-bc5d-9692588c5dff tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:57.198299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49489128-203a-4fe4-bc5d-9692588c5dff tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:57.199011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49489128-203a-4fe4-bc5d-9692588c5dff tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:57.199618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49489128-203a-4fe4-bc5d-9692588c5dff tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:57.200446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49489128-203a-4fe4-bc5d-9692588c5dff tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:57.201013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49489128-203a-4fe4-bc5d-9692588c5dff tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:57.203218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49489128-203a-4fe4-bc5d-9692588c5dff tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:57.697529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a76c1c3f-97e1-43a8-b250-d9fd45eff1d2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:57.707044 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a76c1c3f-97e1-43a8-b250-d9fd45eff1d2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1498 microversion: 2.1 time: 0.617675 Aug 23 18:03:57.707949 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1544/3061] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:57 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1498 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:57.726998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-46a6059b-2803-4b4b-a641-d319b7ddf54f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:57.729912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-46a6059b-2803-4b4b-a641-d319b7ddf54f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:57.742392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46a6059b-2803-4b4b-a641-d319b7ddf54f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:57.743130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46a6059b-2803-4b4b-a641-d319b7ddf54f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:57.743724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46a6059b-2803-4b4b-a641-d319b7ddf54f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:57.745976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46a6059b-2803-4b4b-a641-d319b7ddf54f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:57.746935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46a6059b-2803-4b4b-a641-d319b7ddf54f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:57.747583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46a6059b-2803-4b4b-a641-d319b7ddf54f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:57.829454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-49489128-203a-4fe4-bc5d-9692588c5dff tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:57.841387 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49489128-203a-4fe4-bc5d-9692588c5dff tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1476 microversion: 2.1 time: 0.657033 Aug 23 18:03:57.847335 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1518/3062] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:57 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1476 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:03:57.893520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3bbc0e09-aaf4-4e04-9512-abeb199b6706 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:57.894145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3bbc0e09-aaf4-4e04-9512-abeb199b6706 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:57.908459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bbc0e09-aaf4-4e04-9512-abeb199b6706 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:57.908966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bbc0e09-aaf4-4e04-9512-abeb199b6706 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:57.909993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bbc0e09-aaf4-4e04-9512-abeb199b6706 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:57.910754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bbc0e09-aaf4-4e04-9512-abeb199b6706 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:57.911216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bbc0e09-aaf4-4e04-9512-abeb199b6706 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:57.911651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bbc0e09-aaf4-4e04-9512-abeb199b6706 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:58.179468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3bbc0e09-aaf4-4e04-9512-abeb199b6706 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:58.195999 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3bbc0e09-aaf4-4e04-9512-abeb199b6706 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1275 microversion: 2.1 time: 0.307000 Aug 23 18:03:58.198852 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1519/3063] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:57 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:58.238456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-46a6059b-2803-4b4b-a641-d319b7ddf54f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:58.250271 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-46a6059b-2803-4b4b-a641-d319b7ddf54f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1315 microversion: 2.1 time: 0.535108 Aug 23 18:03:58.265091 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1545/3064] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:57 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1315 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:58.730534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b58491c-ee56-4ccf-b8df-9f9df3c4d16d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:58.731415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4b58491c-ee56-4ccf-b8df-9f9df3c4d16d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:58.745023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b58491c-ee56-4ccf-b8df-9f9df3c4d16d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:58.746825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b58491c-ee56-4ccf-b8df-9f9df3c4d16d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:58.750135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b58491c-ee56-4ccf-b8df-9f9df3c4d16d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:58.751127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b58491c-ee56-4ccf-b8df-9f9df3c4d16d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:58.752699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b58491c-ee56-4ccf-b8df-9f9df3c4d16d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:58.753637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b58491c-ee56-4ccf-b8df-9f9df3c4d16d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:58.864407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d41f053f-a258-45e9-87c0-e0c21899e2b8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:58.865388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d41f053f-a258-45e9-87c0-e0c21899e2b8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:58.874164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d41f053f-a258-45e9-87c0-e0c21899e2b8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:58.879080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d41f053f-a258-45e9-87c0-e0c21899e2b8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:58.885468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d41f053f-a258-45e9-87c0-e0c21899e2b8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:58.886729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d41f053f-a258-45e9-87c0-e0c21899e2b8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:58.887420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d41f053f-a258-45e9-87c0-e0c21899e2b8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:58.888029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d41f053f-a258-45e9-87c0-e0c21899e2b8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:59.121819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d41f053f-a258-45e9-87c0-e0c21899e2b8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:59.140072 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d41f053f-a258-45e9-87c0-e0c21899e2b8 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1476 microversion: 2.1 time: 0.279162 Aug 23 18:03:59.141264 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1546/3065] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:58 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1476 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:59.221218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc6ca000-cf97-45e5-9be4-f978cd56f484 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:59.222054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc6ca000-cf97-45e5-9be4-f978cd56f484 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:59.228273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc6ca000-cf97-45e5-9be4-f978cd56f484 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:59.228991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc6ca000-cf97-45e5-9be4-f978cd56f484 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:59.229599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc6ca000-cf97-45e5-9be4-f978cd56f484 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:59.230470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc6ca000-cf97-45e5-9be4-f978cd56f484 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:59.231142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc6ca000-cf97-45e5-9be4-f978cd56f484 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:59.231717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc6ca000-cf97-45e5-9be4-f978cd56f484 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:59.414189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4b58491c-ee56-4ccf-b8df-9f9df3c4d16d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:59.427515 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b58491c-ee56-4ccf-b8df-9f9df3c4d16d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1498 microversion: 2.1 time: 0.697048 Aug 23 18:03:59.427914 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1520/3066] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:58 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1498 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:59.432612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-087a834e-7b59-44e6-b77c-8e1e3bb60e5d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:03:59.441047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-087a834e-7b59-44e6-b77c-8e1e3bb60e5d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:03:59.456044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-087a834e-7b59-44e6-b77c-8e1e3bb60e5d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:59.456547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-087a834e-7b59-44e6-b77c-8e1e3bb60e5d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:59.457055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-087a834e-7b59-44e6-b77c-8e1e3bb60e5d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:59.457775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-087a834e-7b59-44e6-b77c-8e1e3bb60e5d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:03:59.458227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-087a834e-7b59-44e6-b77c-8e1e3bb60e5d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:03:59.459155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-087a834e-7b59-44e6-b77c-8e1e3bb60e5d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:03:59.733264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc6ca000-cf97-45e5-9be4-f978cd56f484 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:59.744480 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc6ca000-cf97-45e5-9be4-f978cd56f484 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1317 microversion: 2.1 time: 0.528773 Aug 23 18:03:59.762360 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1547/3067] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:59 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:03:59.792885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-087a834e-7b59-44e6-b77c-8e1e3bb60e5d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:03:59.801516 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-087a834e-7b59-44e6-b77c-8e1e3bb60e5d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1315 microversion: 2.1 time: 0.372500 Aug 23 18:03:59.806883 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1521/3068] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:03:59 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1315 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:00.162260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5aaa91ef-2531-4f04-b6b2-992ca0b6bc94 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:00.163103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5aaa91ef-2531-4f04-b6b2-992ca0b6bc94 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:00.182070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aaa91ef-2531-4f04-b6b2-992ca0b6bc94 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:00.182686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aaa91ef-2531-4f04-b6b2-992ca0b6bc94 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:00.183159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aaa91ef-2531-4f04-b6b2-992ca0b6bc94 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:00.183888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aaa91ef-2531-4f04-b6b2-992ca0b6bc94 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:00.184345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aaa91ef-2531-4f04-b6b2-992ca0b6bc94 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:00.184767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aaa91ef-2531-4f04-b6b2-992ca0b6bc94 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:00.458076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-938baa9e-3387-4468-9202-2d951c49bb28 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:00.458732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-938baa9e-3387-4468-9202-2d951c49bb28 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:00.476702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-938baa9e-3387-4468-9202-2d951c49bb28 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:00.477197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-938baa9e-3387-4468-9202-2d951c49bb28 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:00.477635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-938baa9e-3387-4468-9202-2d951c49bb28 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:00.478519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-938baa9e-3387-4468-9202-2d951c49bb28 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:00.479145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-938baa9e-3387-4468-9202-2d951c49bb28 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:00.483275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-938baa9e-3387-4468-9202-2d951c49bb28 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:00.515855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:00.543573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5aaa91ef-2531-4f04-b6b2-992ca0b6bc94 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:00.556571 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5aaa91ef-2531-4f04-b6b2-992ca0b6bc94 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1476 microversion: 2.1 time: 0.398187 Aug 23 18:04:00.571055 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1548/3069] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:00 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1476 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:00.690795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-e36b026c-ef29-4056-b3ae-16945ca37a8b req-9119aa4c-df21-4fb9-9cc7-16bbfad4b9a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36016e6f-16b3-47fe-8f99-dcc878c83e34", "name": "network-vif-deleted", "tag": "c6a1d58c-1f7a-400a-b17a-eaceccb995f5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:00.723699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e36b026c-ef29-4056-b3ae-16945ca37a8b req-9119aa4c-df21-4fb9-9cc7-16bbfad4b9a0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:00.724223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e36b026c-ef29-4056-b3ae-16945ca37a8b req-9119aa4c-df21-4fb9-9cc7-16bbfad4b9a0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:00.724952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e36b026c-ef29-4056-b3ae-16945ca37a8b req-9119aa4c-df21-4fb9-9cc7-16bbfad4b9a0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:00.741499 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-e36b026c-ef29-4056-b3ae-16945ca37a8b req-9119aa4c-df21-4fb9-9cc7-16bbfad4b9a0 service nova] Creating event network-vif-deleted:c6a1d58c-1f7a-400a-b17a-eaceccb995f5 for instance 36016e6f-16b3-47fe-8f99-dcc878c83e34 on n-h2-850468-16 Aug 23 18:04:00.751891 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-e36b026c-ef29-4056-b3ae-16945ca37a8b req-9119aa4c-df21-4fb9-9cc7-16bbfad4b9a0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067951 Aug 23 18:04:00.756758 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1549/3070] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:04:00.775028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ecddaefa-65f7-4832-94be-176041c7880a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:00.775948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ecddaefa-65f7-4832-94be-176041c7880a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:00.787685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecddaefa-65f7-4832-94be-176041c7880a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:00.788470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecddaefa-65f7-4832-94be-176041c7880a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:00.789221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecddaefa-65f7-4832-94be-176041c7880a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:00.790179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecddaefa-65f7-4832-94be-176041c7880a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:00.791070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecddaefa-65f7-4832-94be-176041c7880a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:00.792673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecddaefa-65f7-4832-94be-176041c7880a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:00.944091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-938baa9e-3387-4468-9202-2d951c49bb28 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:00.958771 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-938baa9e-3387-4468-9202-2d951c49bb28 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1504 microversion: 2.1 time: 0.505791 Aug 23 18:04:00.962582 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1522/3071] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:00 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1504 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:00.996648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-87deb35d-e535-4661-ba87-bb112073efd3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:00.997336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-87deb35d-e535-4661-ba87-bb112073efd3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:01.016713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87deb35d-e535-4661-ba87-bb112073efd3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:01.022440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87deb35d-e535-4661-ba87-bb112073efd3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:01.023200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87deb35d-e535-4661-ba87-bb112073efd3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:01.025568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87deb35d-e535-4661-ba87-bb112073efd3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:01.026359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87deb35d-e535-4661-ba87-bb112073efd3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:01.028737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87deb35d-e535-4661-ba87-bb112073efd3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:01.051379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ecddaefa-65f7-4832-94be-176041c7880a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:01.060281 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ecddaefa-65f7-4832-94be-176041c7880a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1317 microversion: 2.1 time: 0.293803 Aug 23 18:04:01.076682 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1550/3072] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:00 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:01.568057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-87deb35d-e535-4661-ba87-bb112073efd3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:01.579586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:01.580210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:01.580329 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-87deb35d-e535-4661-ba87-bb112073efd3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1315 microversion: 2.1 time: 0.615873 Aug 23 18:04:01.580861 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1523/3073] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:00 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:01.603833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:01.604325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:01.604769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:01.605496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:01.606095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:01.606887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:01.622391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:01.674623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:01.675366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:01.676499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:01.677918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lazy-loading 'fault' on Instance uuid 36016e6f-16b3-47fe-8f99-dcc878c83e34 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:04:01.824488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '845f5cca36ea458480b56e3b48f73454', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57bb1f989bf346ab9daefe20a2e9a0b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:01.846565 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-25f4d322-c9c0-4e91-9920-0f8554681ecd tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 200 len: 1311 microversion: 2.1 time: 0.270336 Aug 23 18:04:01.848076 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1551/3074] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:01 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 1311 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:01.985675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4f1187bc-5813-4a01-9d2f-298ee7d66de9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:01.987283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4f1187bc-5813-4a01-9d2f-298ee7d66de9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:02.004712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f1187bc-5813-4a01-9d2f-298ee7d66de9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:02.007399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f1187bc-5813-4a01-9d2f-298ee7d66de9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:02.011004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f1187bc-5813-4a01-9d2f-298ee7d66de9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:02.022471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f1187bc-5813-4a01-9d2f-298ee7d66de9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:02.023180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f1187bc-5813-4a01-9d2f-298ee7d66de9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:02.025605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f1187bc-5813-4a01-9d2f-298ee7d66de9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:02.084860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5e2b667b-984d-4668-9836-640e81979dd4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:02.085629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5e2b667b-984d-4668-9836-640e81979dd4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:02.108842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e2b667b-984d-4668-9836-640e81979dd4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:02.113936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e2b667b-984d-4668-9836-640e81979dd4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:02.114614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e2b667b-984d-4668-9836-640e81979dd4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:02.117784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e2b667b-984d-4668-9836-640e81979dd4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:02.120961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e2b667b-984d-4668-9836-640e81979dd4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:02.121411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e2b667b-984d-4668-9836-640e81979dd4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:02.493125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4f1187bc-5813-4a01-9d2f-298ee7d66de9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:02.518088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5e2b667b-984d-4668-9836-640e81979dd4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:02.526342 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4f1187bc-5813-4a01-9d2f-298ee7d66de9 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1504 microversion: 2.1 time: 0.545671 Aug 23 18:04:02.527720 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1524/3075] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:01 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1504 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:02.550722 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5e2b667b-984d-4668-9836-640e81979dd4 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1317 microversion: 2.1 time: 0.468096 Aug 23 18:04:02.551035 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1552/3076] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:02 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1317 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:02.604766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-76f4a452-1173-4ae9-91e2-5de94ef48e32 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:02.607635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-76f4a452-1173-4ae9-91e2-5de94ef48e32 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:02.619602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76f4a452-1173-4ae9-91e2-5de94ef48e32 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:02.620358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76f4a452-1173-4ae9-91e2-5de94ef48e32 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:02.620921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76f4a452-1173-4ae9-91e2-5de94ef48e32 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:02.621790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76f4a452-1173-4ae9-91e2-5de94ef48e32 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:02.622159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76f4a452-1173-4ae9-91e2-5de94ef48e32 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:02.622707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76f4a452-1173-4ae9-91e2-5de94ef48e32 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:02.770633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-de4c2622-58e5-48fa-addc-b1d70c0afe00 req-6e7d97cf-679d-412b-a44b-ee5e278da15d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b332b070-1b5a-4c6e-adc2-75a0e69b9189", "tag": "63f3ce0d-67cf-4586-b55b-73fafad66992"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:02.791220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-de4c2622-58e5-48fa-addc-b1d70c0afe00 req-6e7d97cf-679d-412b-a44b-ee5e278da15d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:02.794065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-de4c2622-58e5-48fa-addc-b1d70c0afe00 req-6e7d97cf-679d-412b-a44b-ee5e278da15d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:02.794690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-de4c2622-58e5-48fa-addc-b1d70c0afe00 req-6e7d97cf-679d-412b-a44b-ee5e278da15d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:02.805236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-76f4a452-1173-4ae9-91e2-5de94ef48e32 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:02.818142 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-76f4a452-1173-4ae9-91e2-5de94ef48e32 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1315 microversion: 2.1 time: 0.219045 Aug 23 18:04:02.818759 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1525/3077] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:02 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:02.832529 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-de4c2622-58e5-48fa-addc-b1d70c0afe00 req-6e7d97cf-679d-412b-a44b-ee5e278da15d service nova] Creating event network-changed:63f3ce0d-67cf-4586-b55b-73fafad66992 for instance b332b070-1b5a-4c6e-adc2-75a0e69b9189 on n-h1-850468-16 Aug 23 18:04:02.843115 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-de4c2622-58e5-48fa-addc-b1d70c0afe00 req-6e7d97cf-679d-412b-a44b-ee5e278da15d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073527 Aug 23 18:04:02.846200 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1553/3078] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:02.876890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c4cba821-cad7-4234-b43f-621e0143ad55 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:02.877965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c4cba821-cad7-4234-b43f-621e0143ad55 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] [instance: 36016e6f-16b3-47fe-8f99-dcc878c83e34] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:02.890878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4cba821-cad7-4234-b43f-621e0143ad55 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:02.891380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4cba821-cad7-4234-b43f-621e0143ad55 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:02.891828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4cba821-cad7-4234-b43f-621e0143ad55 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:02.893518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4cba821-cad7-4234-b43f-621e0143ad55 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:02.894116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4cba821-cad7-4234-b43f-621e0143ad55 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:02.894758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4cba821-cad7-4234-b43f-621e0143ad55 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:02.911168 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-c4cba821-cad7-4234-b43f-621e0143ad55 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] HTTP exception thrown: Instance 36016e6f-16b3-47fe-8f99-dcc878c83e34 could not be found. Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c4cba821-cad7-4234-b43f-621e0143ad55 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Request method failure captured: Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 HTTP/1.1 Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRY-96hAv6KCo9RBXG0zknvvW0OxA7k2L0ew9XUIBcK7l6XtAU7LA7juA35VcLZ-koCVg-dQbq1x2G7mnKtx5pocqw0wvfIsMmKd_cMhso8THJYsAaY5B-aIj408b0rGbg49ufjSYJY4rGSnIVlCSzxCaKmZBAeIIStt4u1JUCH-ViA Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 57bb1f989bf346ab9daefe20a2e9a0b3 Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-639093848 Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_57bb1f989bf346ab9daefe20a2e9a0b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/57bb1f989bf346ab9daefe20a2e9a0b3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/57bb1f989bf346ab9daefe20a2e9a0b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/57bb1f989bf346ab9daefe20a2e9a0b3"}]}] Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersAdminNegativeTestJSON-639093848 Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 57bb1f989bf346ab9daefe20a2e9a0b3 Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-639093848 Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersAdminNegativeTestJSON-639093848-project Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 845f5cca36ea458480b56e3b48f73454 Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersAdminNegativeTestJSON-639093848-project Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 36016e6f-16b3-47fe-8f99-dcc878c83e34 could not be found. Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '36016e6f-16b3-47fe-8f99-dcc878c83e34'} Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36016e6f-16b3-47fe-8f99-dcc878c83e34 could not be found. Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36016e6f-16b3-47fe-8f99-dcc878c83e34 could not be found. Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:02.913507 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:02.918040 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:02.918040 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:02.918040 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:02.918040 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:02.918040 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:02.918040 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:02.918040 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36016e6f-16b3-47fe-8f99-dcc878c83e34 could not be found. Aug 23 18:04:02.918040 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:02.918040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c4cba821-cad7-4234-b43f-621e0143ad55 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] Returning 404 to user: Instance 36016e6f-16b3-47fe-8f99-dcc878c83e34 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:02.918040 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c4cba821-cad7-4234-b43f-621e0143ad55 tempest-ServersAdminNegativeTestJSON-639093848 tempest-ServersAdminNegativeTestJSON-639093848-project] 10.222.0.61 "GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34" status: 404 len: 111 microversion: 2.1 time: 0.046757 Aug 23 18:04:02.919132 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1526/3079] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:02 2022] GET /compute/v2.1/servers/36016e6f-16b3-47fe-8f99-dcc878c83e34 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:04:03.564266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c4e5fc1-32e5-40cc-9420-014beb60b72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:03.565370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4c4e5fc1-32e5-40cc-9420-014beb60b72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:03.583459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c1b81c7d-782b-4619-af30-c103c969f144 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:03.584630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c1b81c7d-782b-4619-af30-c103c969f144 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:03.602792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1b81c7d-782b-4619-af30-c103c969f144 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:03.604071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c4e5fc1-32e5-40cc-9420-014beb60b72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:03.605091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1b81c7d-782b-4619-af30-c103c969f144 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:03.606060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1b81c7d-782b-4619-af30-c103c969f144 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:03.606612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c4e5fc1-32e5-40cc-9420-014beb60b72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:03.608193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1b81c7d-782b-4619-af30-c103c969f144 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:03.608899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c4e5fc1-32e5-40cc-9420-014beb60b72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:03.609973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c4e5fc1-32e5-40cc-9420-014beb60b72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:03.611044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c4e5fc1-32e5-40cc-9420-014beb60b72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:03.611304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1b81c7d-782b-4619-af30-c103c969f144 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:03.611885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1b81c7d-782b-4619-af30-c103c969f144 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:03.612458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c4e5fc1-32e5-40cc-9420-014beb60b72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:03.761446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:03.969218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c1b81c7d-782b-4619-af30-c103c969f144 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:03.981209 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c1b81c7d-782b-4619-af30-c103c969f144 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1317 microversion: 2.1 time: 0.410502 Aug 23 18:04:03.983352 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1527/3080] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:03 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1317 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:03.988321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-895a6f17-7046-42a5-9a66-39ac2663afbc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:03.989120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-895a6f17-7046-42a5-9a66-39ac2663afbc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:03.995391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-895a6f17-7046-42a5-9a66-39ac2663afbc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:03.996098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-895a6f17-7046-42a5-9a66-39ac2663afbc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:03.996692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-895a6f17-7046-42a5-9a66-39ac2663afbc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:03.997550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-895a6f17-7046-42a5-9a66-39ac2663afbc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:03.998881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-895a6f17-7046-42a5-9a66-39ac2663afbc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:03.999495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-895a6f17-7046-42a5-9a66-39ac2663afbc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:04.202493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4c4e5fc1-32e5-40cc-9420-014beb60b72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:04.219536 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4c4e5fc1-32e5-40cc-9420-014beb60b72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1504 microversion: 2.1 time: 0.658209 Aug 23 18:04:04.221710 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1554/3081] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:03 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1504 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:04.233645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c374f267-f2aa-4932-a7d4-44e16ae7a954 req-c47fa859-b657-42dd-ae41-178847dab1b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac15912e-be60-47a8-830a-2c5a25324a7e", "name": "network-vif-plugged", "status": "completed", "tag": "ee2214eb-a359-41ed-ab6e-41dc3a10f1f2"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:04.249748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c374f267-f2aa-4932-a7d4-44e16ae7a954 req-c47fa859-b657-42dd-ae41-178847dab1b0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:04.250898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c374f267-f2aa-4932-a7d4-44e16ae7a954 req-c47fa859-b657-42dd-ae41-178847dab1b0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:04.251536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c374f267-f2aa-4932-a7d4-44e16ae7a954 req-c47fa859-b657-42dd-ae41-178847dab1b0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:04.278840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-895a6f17-7046-42a5-9a66-39ac2663afbc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:04.298114 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c374f267-f2aa-4932-a7d4-44e16ae7a954 req-c47fa859-b657-42dd-ae41-178847dab1b0 service nova] Creating event network-vif-plugged:ee2214eb-a359-41ed-ab6e-41dc3a10f1f2 for instance ac15912e-be60-47a8-830a-2c5a25324a7e on n-h2-850468-16 Aug 23 18:04:04.301357 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-895a6f17-7046-42a5-9a66-39ac2663afbc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1315 microversion: 2.1 time: 0.312904 Aug 23 18:04:04.302275 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1528/3082] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:03 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1315 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:04.313854 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c374f267-f2aa-4932-a7d4-44e16ae7a954 req-c47fa859-b657-42dd-ae41-178847dab1b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089090 Aug 23 18:04:04.316804 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1555/3083] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:04:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:05.011653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-184dad43-74d1-49d4-aa0b-d75dbbafaf11 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:05.012368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-184dad43-74d1-49d4-aa0b-d75dbbafaf11 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:05.030891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-184dad43-74d1-49d4-aa0b-d75dbbafaf11 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:05.033262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-184dad43-74d1-49d4-aa0b-d75dbbafaf11 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:05.033865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-184dad43-74d1-49d4-aa0b-d75dbbafaf11 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:05.035642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-184dad43-74d1-49d4-aa0b-d75dbbafaf11 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:05.036564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-184dad43-74d1-49d4-aa0b-d75dbbafaf11 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:05.036564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-184dad43-74d1-49d4-aa0b-d75dbbafaf11 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:05.245934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1cf90a6b-2c6f-434b-8d9d-3957f2cc41db tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:05.247467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1cf90a6b-2c6f-434b-8d9d-3957f2cc41db tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:05.258721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-184dad43-74d1-49d4-aa0b-d75dbbafaf11 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:05.268497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=14 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:05.273105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cf90a6b-2c6f-434b-8d9d-3957f2cc41db tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:05.274848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cf90a6b-2c6f-434b-8d9d-3957f2cc41db tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:05.277431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cf90a6b-2c6f-434b-8d9d-3957f2cc41db tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:05.278701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cf90a6b-2c6f-434b-8d9d-3957f2cc41db tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:05.280501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cf90a6b-2c6f-434b-8d9d-3957f2cc41db tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:05.280951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cf90a6b-2c6f-434b-8d9d-3957f2cc41db tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:05.297506 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-184dad43-74d1-49d4-aa0b-d75dbbafaf11 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1317 microversion: 2.1 time: 0.287471 Aug 23 18:04:05.313310 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1529/3084] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:05 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1317 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:05.348600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-952f8d32-b03e-4e67-ba10-91ae7161d9e6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:05.351510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-952f8d32-b03e-4e67-ba10-91ae7161d9e6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:05.376533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-952f8d32-b03e-4e67-ba10-91ae7161d9e6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:05.381093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-952f8d32-b03e-4e67-ba10-91ae7161d9e6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:05.381614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-952f8d32-b03e-4e67-ba10-91ae7161d9e6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:05.384249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-952f8d32-b03e-4e67-ba10-91ae7161d9e6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:05.384707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-952f8d32-b03e-4e67-ba10-91ae7161d9e6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:05.385446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-952f8d32-b03e-4e67-ba10-91ae7161d9e6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:05.688065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1cf90a6b-2c6f-434b-8d9d-3957f2cc41db tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:05.720200 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1cf90a6b-2c6f-434b-8d9d-3957f2cc41db tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1486 microversion: 2.1 time: 0.473955 Aug 23 18:04:05.739853 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1556/3085] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:05 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1486 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:05.755839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9f6bf8a-6bcd-4ed4-83b1-34026a4be72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:05.762242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b9f6bf8a-6bcd-4ed4-83b1-34026a4be72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:05.784211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9f6bf8a-6bcd-4ed4-83b1-34026a4be72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:05.785790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9f6bf8a-6bcd-4ed4-83b1-34026a4be72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:05.786425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9f6bf8a-6bcd-4ed4-83b1-34026a4be72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:05.788608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9f6bf8a-6bcd-4ed4-83b1-34026a4be72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:05.789779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9f6bf8a-6bcd-4ed4-83b1-34026a4be72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:05.790403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9f6bf8a-6bcd-4ed4-83b1-34026a4be72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:05.878842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b9f6bf8a-6bcd-4ed4-83b1-34026a4be72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:04:05.986977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:06.004700 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b9f6bf8a-6bcd-4ed4-83b1-34026a4be72b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 204 len: 0 microversion: 2.1 time: 0.263232 Aug 23 18:04:06.005537 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1557/3086] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:04:05 2022] DELETE /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:04:06.019368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d41f7ea-f856-47cb-93c3-c1ed8ec4bfbb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec454ca0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:06.059327 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-7d41f7ea-f856-47cb-93c3-c1ed8ec4bfbb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] HTTP exception thrown: Image not found. Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d41f7ea-f856-47cb-93c3-c1ed8ec4bfbb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Request method failure captured: Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/images/90857604-d1cf-4ff6-a7b8-391cf50588cf HTTP/1.1 Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRWHbV3OLKgIuNNXT5KCGZW7WT58aaAh9H89jE9QOZe82T8lIE_66bOTSflRCy4DYnq1nnsH73sZ7AopFhI6uIHrsl4n3xhrK5GELGV-O9mdGJRj8jUlbh44mSdwnGxUM3HP4lKIPkNUXzU__9FA4HrRgHB_ar7sGP9pzWp6deCKskM Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}] Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 78a1cc2772e846e0ac3ca0324ab3cee3 Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '90857604-d1cf-4ff6-a7b8-391cf50588cf'} Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 90857604-d1cf-4ff6-a7b8-391cf50588cf to delete Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 90857604-d1cf-4ff6-a7b8-391cf50588cf could not be found. Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:06.062644 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d41f7ea-f856-47cb-93c3-c1ed8ec4bfbb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:06.066612 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7d41f7ea-f856-47cb-93c3-c1ed8ec4bfbb tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/images/90857604-d1cf-4ff6-a7b8-391cf50588cf" status: 404 len: 62 microversion: 2.1 time: 0.050301 Aug 23 18:04:06.068065 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1558/3087] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:06 2022] DELETE /compute/v2.1/images/90857604-d1cf-4ff6-a7b8-391cf50588cf => generated 62 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:04:06.095830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-96ac59c6-052d-4e94-9023-71aad93b3b43 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:06.103599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-96ac59c6-052d-4e94-9023-71aad93b3b43 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:06.126588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96ac59c6-052d-4e94-9023-71aad93b3b43 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:06.127949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96ac59c6-052d-4e94-9023-71aad93b3b43 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:06.130206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96ac59c6-052d-4e94-9023-71aad93b3b43 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:06.131846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96ac59c6-052d-4e94-9023-71aad93b3b43 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:06.133097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96ac59c6-052d-4e94-9023-71aad93b3b43 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:06.136660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96ac59c6-052d-4e94-9023-71aad93b3b43 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:06.215083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-96ac59c6-052d-4e94-9023-71aad93b3b43 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:04:06.305978 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.compute.api [None req-96ac59c6-052d-4e94-9023-71aad93b3b43 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Instance is already in deleting state, ignoring this request Aug 23 18:04:06.308594 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-96ac59c6-052d-4e94-9023-71aad93b3b43 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 204 len: 0 microversion: 2.1 time: 0.238052 Aug 23 18:04:06.309862 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1559/3088] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:04:06 2022] DELETE /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:04:06.324071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3e7230bf-49aa-4e8b-9759-c8aca9406bff tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:06.325046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3e7230bf-49aa-4e8b-9759-c8aca9406bff tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:06.335952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e7230bf-49aa-4e8b-9759-c8aca9406bff tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:06.337164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e7230bf-49aa-4e8b-9759-c8aca9406bff tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:06.337952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e7230bf-49aa-4e8b-9759-c8aca9406bff tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:06.339024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e7230bf-49aa-4e8b-9759-c8aca9406bff tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:06.340263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e7230bf-49aa-4e8b-9759-c8aca9406bff tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:06.341389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e7230bf-49aa-4e8b-9759-c8aca9406bff tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:06.433987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-952f8d32-b03e-4e67-ba10-91ae7161d9e6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:06.444575 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-952f8d32-b03e-4e67-ba10-91ae7161d9e6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1315 microversion: 2.1 time: 1.115608 Aug 23 18:04:06.447788 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1530/3089] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:05 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1315 bytes in 1120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:06.455800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e9e57a8b-89b6-40fe-a7ac-d9786e36a230 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:06.457567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e9e57a8b-89b6-40fe-a7ac-d9786e36a230 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:06.466155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9e57a8b-89b6-40fe-a7ac-d9786e36a230 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:06.467551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9e57a8b-89b6-40fe-a7ac-d9786e36a230 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:06.468219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9e57a8b-89b6-40fe-a7ac-d9786e36a230 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:06.469554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9e57a8b-89b6-40fe-a7ac-d9786e36a230 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:06.470177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9e57a8b-89b6-40fe-a7ac-d9786e36a230 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:06.470861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9e57a8b-89b6-40fe-a7ac-d9786e36a230 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:06.722486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e9e57a8b-89b6-40fe-a7ac-d9786e36a230 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:06.734203 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e9e57a8b-89b6-40fe-a7ac-d9786e36a230 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1492 microversion: 2.1 time: 0.284719 Aug 23 18:04:06.752821 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1531/3090] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:06 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1492 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:06.757213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-bd5b593f-11bb-4d54-924c-041114ee3a6f req-984f1f3d-b1a2-44d1-a07b-345642a6bbfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431ff681-8a42-4440-b060-27bac6fb4ecb", "name": "network-vif-plugged", "status": "completed", "tag": "79e72ec6-2dad-439f-8c32-0b34ee6277fe"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:06.772752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bd5b593f-11bb-4d54-924c-041114ee3a6f req-984f1f3d-b1a2-44d1-a07b-345642a6bbfd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:06.779422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bd5b593f-11bb-4d54-924c-041114ee3a6f req-984f1f3d-b1a2-44d1-a07b-345642a6bbfd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:06.780044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bd5b593f-11bb-4d54-924c-041114ee3a6f req-984f1f3d-b1a2-44d1-a07b-345642a6bbfd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:06.800976 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-bd5b593f-11bb-4d54-924c-041114ee3a6f req-984f1f3d-b1a2-44d1-a07b-345642a6bbfd service nova] Creating event network-vif-plugged:79e72ec6-2dad-439f-8c32-0b34ee6277fe for instance 431ff681-8a42-4440-b060-27bac6fb4ecb on n-h1-850468-16 Aug 23 18:04:06.813050 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-bd5b593f-11bb-4d54-924c-041114ee3a6f req-984f1f3d-b1a2-44d1-a07b-345642a6bbfd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071618 Aug 23 18:04:06.814226 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1532/3091] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:07.371828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e7230bf-49aa-4e8b-9759-c8aca9406bff tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:07.383681 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3e7230bf-49aa-4e8b-9759-c8aca9406bff tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1317 microversion: 2.1 time: 1.065731 Aug 23 18:04:07.385921 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1560/3092] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:06 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1317 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:07.475451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5aad120b-7d84-44f5-ace9-e3de3f73cc69 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:07.476253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5aad120b-7d84-44f5-ace9-e3de3f73cc69 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:07.486156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:07.495416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5aad120b-7d84-44f5-ace9-e3de3f73cc69 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:07.496259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5aad120b-7d84-44f5-ace9-e3de3f73cc69 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:07.499014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5aad120b-7d84-44f5-ace9-e3de3f73cc69 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:07.500879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5aad120b-7d84-44f5-ace9-e3de3f73cc69 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:07.501974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5aad120b-7d84-44f5-ace9-e3de3f73cc69 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:07.503457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5aad120b-7d84-44f5-ace9-e3de3f73cc69 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:07.760558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3689a2d0-135c-479c-8dac-16ce01ae467d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:07.761471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3689a2d0-135c-479c-8dac-16ce01ae467d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:07.774900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3689a2d0-135c-479c-8dac-16ce01ae467d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:07.776403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3689a2d0-135c-479c-8dac-16ce01ae467d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:07.776992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3689a2d0-135c-479c-8dac-16ce01ae467d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:07.781011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3689a2d0-135c-479c-8dac-16ce01ae467d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:07.782080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3689a2d0-135c-479c-8dac-16ce01ae467d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:07.783885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3689a2d0-135c-479c-8dac-16ce01ae467d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:07.840296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5aad120b-7d84-44f5-ace9-e3de3f73cc69 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:07.856173 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5aad120b-7d84-44f5-ace9-e3de3f73cc69 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1315 microversion: 2.1 time: 0.386450 Aug 23 18:04:07.857071 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1533/3093] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:07 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1315 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:08.411180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f9030f67-85dc-4191-9d01-e771f8b12682 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:08.411807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f9030f67-85dc-4191-9d01-e771f8b12682 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:08.426991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9030f67-85dc-4191-9d01-e771f8b12682 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:08.427782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9030f67-85dc-4191-9d01-e771f8b12682 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:08.428514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9030f67-85dc-4191-9d01-e771f8b12682 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:08.429394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9030f67-85dc-4191-9d01-e771f8b12682 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:08.430317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9030f67-85dc-4191-9d01-e771f8b12682 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:08.430931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9030f67-85dc-4191-9d01-e771f8b12682 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:08.502804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3689a2d0-135c-479c-8dac-16ce01ae467d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:08.517659 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3689a2d0-135c-479c-8dac-16ce01ae467d tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1492 microversion: 2.1 time: 0.760985 Aug 23 18:04:08.526864 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1561/3094] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:07 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1492 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:08.824413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f9030f67-85dc-4191-9d01-e771f8b12682 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:08.850380 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f9030f67-85dc-4191-9d01-e771f8b12682 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1317 microversion: 2.1 time: 0.443994 Aug 23 18:04:08.851720 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1534/3095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:08 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1317 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:08.875852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-97f783e8-e537-4e73-80f6-8e9b9475e87c req-2932206a-e66b-4ac8-93ca-2aa9952d630b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac15912e-be60-47a8-830a-2c5a25324a7e", "name": "network-vif-unplugged", "status": "completed", "tag": "ee2214eb-a359-41ed-ab6e-41dc3a10f1f2"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:08.883082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3ac38e05-8d9f-4527-b5c2-1367eebf3ac1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:08.886584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3ac38e05-8d9f-4527-b5c2-1367eebf3ac1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:08.918227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ac38e05-8d9f-4527-b5c2-1367eebf3ac1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:08.921773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-97f783e8-e537-4e73-80f6-8e9b9475e87c req-2932206a-e66b-4ac8-93ca-2aa9952d630b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:08.923500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ac38e05-8d9f-4527-b5c2-1367eebf3ac1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:08.924124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ac38e05-8d9f-4527-b5c2-1367eebf3ac1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:08.937044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ac38e05-8d9f-4527-b5c2-1367eebf3ac1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:08.937688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ac38e05-8d9f-4527-b5c2-1367eebf3ac1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:08.939820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-97f783e8-e537-4e73-80f6-8e9b9475e87c req-2932206a-e66b-4ac8-93ca-2aa9952d630b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:08.942405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-97f783e8-e537-4e73-80f6-8e9b9475e87c req-2932206a-e66b-4ac8-93ca-2aa9952d630b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:08.943983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ac38e05-8d9f-4527-b5c2-1367eebf3ac1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:08.985708 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-97f783e8-e537-4e73-80f6-8e9b9475e87c req-2932206a-e66b-4ac8-93ca-2aa9952d630b service nova] Creating event network-vif-unplugged:ee2214eb-a359-41ed-ab6e-41dc3a10f1f2 for instance ac15912e-be60-47a8-830a-2c5a25324a7e on n-h2-850468-16 Aug 23 18:04:08.999833 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-97f783e8-e537-4e73-80f6-8e9b9475e87c req-2932206a-e66b-4ac8-93ca-2aa9952d630b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.129614 Aug 23 18:04:09.002260 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1562/3096] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:04:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:09.242765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3ac38e05-8d9f-4527-b5c2-1367eebf3ac1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:09.257185 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3ac38e05-8d9f-4527-b5c2-1367eebf3ac1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1502 microversion: 2.1 time: 0.382139 Aug 23 18:04:09.258385 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1535/3097] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:08 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1502 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:09.287809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-633ebf8e-e6fd-4b95-9e87-9955cace6925 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:09.305957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-633ebf8e-e6fd-4b95-9e87-9955cace6925 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:09.309305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-633ebf8e-e6fd-4b95-9e87-9955cace6925 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:09.312106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-633ebf8e-e6fd-4b95-9e87-9955cace6925 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:09.376985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-633ebf8e-e6fd-4b95-9e87-9955cace6925 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Going to try to stop instance {{(pid=128808) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 18:04:09.499011 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-633ebf8e-e6fd-4b95-9e87-9955cace6925 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb/action" status: 202 len: 0 microversion: 2.1 time: 0.216217 Aug 23 18:04:09.509325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9065fc70-bddc-4e6f-bcd1-6ef4d50e566d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:09.510001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9065fc70-bddc-4e6f-bcd1-6ef4d50e566d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:09.512345 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1563/3098] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:04:09 2022] POST /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb/action => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:04:09.523930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9065fc70-bddc-4e6f-bcd1-6ef4d50e566d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:09.526202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9065fc70-bddc-4e6f-bcd1-6ef4d50e566d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:09.527191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9065fc70-bddc-4e6f-bcd1-6ef4d50e566d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:09.530883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9065fc70-bddc-4e6f-bcd1-6ef4d50e566d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:09.532659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9065fc70-bddc-4e6f-bcd1-6ef4d50e566d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:09.534235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9065fc70-bddc-4e6f-bcd1-6ef4d50e566d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:09.554645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db675e32-e0a3-43f0-b400-d93dc10e3fe0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:09.555844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-db675e32-e0a3-43f0-b400-d93dc10e3fe0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:09.565474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db675e32-e0a3-43f0-b400-d93dc10e3fe0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:09.571717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db675e32-e0a3-43f0-b400-d93dc10e3fe0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:09.572409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db675e32-e0a3-43f0-b400-d93dc10e3fe0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:09.573314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db675e32-e0a3-43f0-b400-d93dc10e3fe0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:09.579296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db675e32-e0a3-43f0-b400-d93dc10e3fe0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:09.580311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db675e32-e0a3-43f0-b400-d93dc10e3fe0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:09.872542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9065fc70-bddc-4e6f-bcd1-6ef4d50e566d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:09.891695 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9065fc70-bddc-4e6f-bcd1-6ef4d50e566d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 0.382114 Aug 23 18:04:09.892686 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1536/3099] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:09 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:09.904605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d4345c2d-7234-4680-b1fa-a7e52e2fad25 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:09.905436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d4345c2d-7234-4680-b1fa-a7e52e2fad25 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:09.924160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4345c2d-7234-4680-b1fa-a7e52e2fad25 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:09.926807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4345c2d-7234-4680-b1fa-a7e52e2fad25 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:09.927301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4345c2d-7234-4680-b1fa-a7e52e2fad25 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:09.928061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4345c2d-7234-4680-b1fa-a7e52e2fad25 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:09.928530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4345c2d-7234-4680-b1fa-a7e52e2fad25 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:09.933237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4345c2d-7234-4680-b1fa-a7e52e2fad25 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:10.361276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d4345c2d-7234-4680-b1fa-a7e52e2fad25 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:10.361831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-db675e32-e0a3-43f0-b400-d93dc10e3fe0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:10.369836 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-db675e32-e0a3-43f0-b400-d93dc10e3fe0 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1492 microversion: 2.1 time: 0.821199 Aug 23 18:04:10.374020 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1564/3100] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:09 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1492 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:10.381600 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d4345c2d-7234-4680-b1fa-a7e52e2fad25 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1317 microversion: 2.1 time: 0.487756 Aug 23 18:04:10.382377 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1537/3101] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:09 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1317 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:10.629839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1229a77a-7064-4e56-a81d-89819238fff4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:10.633752 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:04:10.633752 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:04:10.635327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1229a77a-7064-4e56-a81d-89819238fff4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:10.636014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1229a77a-7064-4e56-a81d-89819238fff4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:10.637304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1229a77a-7064-4e56-a81d-89819238fff4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:10.639185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1229a77a-7064-4e56-a81d-89819238fff4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:10.641782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1229a77a-7064-4e56-a81d-89819238fff4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:10.643920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1229a77a-7064-4e56-a81d-89819238fff4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:10.670163 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1229a77a-7064-4e56-a81d-89819238fff4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.293989 Aug 23 18:04:10.678721 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1565/3102] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 18:04:10 2022] GET /compute/v2.1/os-services => generated 949 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:10.683338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4839cd70-dac8-47c0-a0bc-ceb1e2bbd894 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:10.689298 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:04:10.689298 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:04:10.690861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4839cd70-dac8-47c0-a0bc-ceb1e2bbd894 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:10.691368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4839cd70-dac8-47c0-a0bc-ceb1e2bbd894 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:10.694388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4839cd70-dac8-47c0-a0bc-ceb1e2bbd894 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:10.695243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4839cd70-dac8-47c0-a0bc-ceb1e2bbd894 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:10.697068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4839cd70-dac8-47c0-a0bc-ceb1e2bbd894 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:10.700302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4839cd70-dac8-47c0-a0bc-ceb1e2bbd894 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:10.782916 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4839cd70-dac8-47c0-a0bc-ceb1e2bbd894 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=n-d-850468-16" status: 200 len: 581 microversion: 2.1 time: 0.103460 Aug 23 18:04:10.793911 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1538/3103] 10.222.0.61 () {58 vars in 1174 bytes} [Tue Aug 23 18:04:10 2022] GET /compute/v2.1/os-services?host=n-d-850468-16 => generated 581 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:04:10.801998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-68a21966-e61a-4a68-9689-1263db0a22c4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:10.805560 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:04:10.805560 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:04:10.806966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68a21966-e61a-4a68-9689-1263db0a22c4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:10.807468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68a21966-e61a-4a68-9689-1263db0a22c4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:10.813872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68a21966-e61a-4a68-9689-1263db0a22c4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:10.815022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68a21966-e61a-4a68-9689-1263db0a22c4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:10.815524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68a21966-e61a-4a68-9689-1263db0a22c4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:10.815978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68a21966-e61a-4a68-9689-1263db0a22c4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:10.865969 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-68a21966-e61a-4a68-9689-1263db0a22c4 tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.069132 Aug 23 18:04:10.870655 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1566/3104] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Aug 23 18:04:10 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:10.885939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-271f326d-3b2f-4184-a447-69d4f292a01f tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:10.889176 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:04:10.889176 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:04:10.891171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-271f326d-3b2f-4184-a447-69d4f292a01f tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:10.891931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-271f326d-3b2f-4184-a447-69d4f292a01f tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:10.892590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-271f326d-3b2f-4184-a447-69d4f292a01f tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:10.893572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-271f326d-3b2f-4184-a447-69d4f292a01f tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:10.895194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-271f326d-3b2f-4184-a447-69d4f292a01f tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:10.895917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-271f326d-3b2f-4184-a447-69d4f292a01f tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:10.916952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2a21e11b-0686-497a-85bc-fe23f6ed57f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:10.917711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2a21e11b-0686-497a-85bc-fe23f6ed57f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:10.927783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a21e11b-0686-497a-85bc-fe23f6ed57f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:10.928284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a21e11b-0686-497a-85bc-fe23f6ed57f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:10.928719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a21e11b-0686-497a-85bc-fe23f6ed57f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:10.929442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a21e11b-0686-497a-85bc-fe23f6ed57f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:10.929897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a21e11b-0686-497a-85bc-fe23f6ed57f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:10.930330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a21e11b-0686-497a-85bc-fe23f6ed57f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:10.933037 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-271f326d-3b2f-4184-a447-69d4f292a01f tempest-ServicesAdminTestJSON-1727022691 tempest-ServicesAdminTestJSON-1727022691-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 949 microversion: 2.1 time: 0.050922 Aug 23 18:04:10.938286 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1539/3105] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 18:04:10 2022] GET /compute/v2.1/os-services => generated 949 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:11.416993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8d991479-f13a-4119-81ed-d94fc30d61a2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:11.423355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8d991479-f13a-4119-81ed-d94fc30d61a2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:11.448045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d991479-f13a-4119-81ed-d94fc30d61a2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:11.452324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d991479-f13a-4119-81ed-d94fc30d61a2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:11.458495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d991479-f13a-4119-81ed-d94fc30d61a2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:11.460763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d991479-f13a-4119-81ed-d94fc30d61a2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:11.463447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d991479-f13a-4119-81ed-d94fc30d61a2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:11.471613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d991479-f13a-4119-81ed-d94fc30d61a2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:11.787989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8d991479-f13a-4119-81ed-d94fc30d61a2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:11.801163 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8d991479-f13a-4119-81ed-d94fc30d61a2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1492 microversion: 2.1 time: 0.405149 Aug 23 18:04:11.815457 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1540/3106] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:11 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1492 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:11.824452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e8285b50-36f4-42a0-88d1-6216a7be31d1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:11.828649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e8285b50-36f4-42a0-88d1-6216a7be31d1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:11.845336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8285b50-36f4-42a0-88d1-6216a7be31d1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:11.851918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8285b50-36f4-42a0-88d1-6216a7be31d1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:11.852768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8285b50-36f4-42a0-88d1-6216a7be31d1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:11.855006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8285b50-36f4-42a0-88d1-6216a7be31d1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:11.855755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8285b50-36f4-42a0-88d1-6216a7be31d1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:11.858489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8285b50-36f4-42a0-88d1-6216a7be31d1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:12.121314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e8285b50-36f4-42a0-88d1-6216a7be31d1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:12.125137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:12.142214 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e8285b50-36f4-42a0-88d1-6216a7be31d1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1317 microversion: 2.1 time: 0.321484 Aug 23 18:04:12.142868 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1541/3107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:11 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1317 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:12.155861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-327ab04d-ad15-4e17-8261-f80c808b7c49 req-e491508d-1cf3-4046-b9f8-fdde01a99be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b332b070-1b5a-4c6e-adc2-75a0e69b9189", "name": "network-vif-plugged", "status": "completed", "tag": "63f3ce0d-67cf-4586-b55b-73fafad66992"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:12.172751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-327ab04d-ad15-4e17-8261-f80c808b7c49 req-e491508d-1cf3-4046-b9f8-fdde01a99be3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:12.173434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-327ab04d-ad15-4e17-8261-f80c808b7c49 req-e491508d-1cf3-4046-b9f8-fdde01a99be3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:12.177665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-327ab04d-ad15-4e17-8261-f80c808b7c49 req-e491508d-1cf3-4046-b9f8-fdde01a99be3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:12.213546 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-327ab04d-ad15-4e17-8261-f80c808b7c49 req-e491508d-1cf3-4046-b9f8-fdde01a99be3 service nova] Creating event network-vif-plugged:63f3ce0d-67cf-4586-b55b-73fafad66992 for instance b332b070-1b5a-4c6e-adc2-75a0e69b9189 on n-h1-850468-16 Aug 23 18:04:12.225349 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-327ab04d-ad15-4e17-8261-f80c808b7c49 req-e491508d-1cf3-4046-b9f8-fdde01a99be3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081049 Aug 23 18:04:12.226354 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1542/3108] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:12.597653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-bad2fcee-b3ed-465a-8f04-91be083bc012 req-65cf3c96-c6c1-42c3-8994-adad206be8ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac15912e-be60-47a8-830a-2c5a25324a7e", "name": "network-vif-deleted", "tag": "ee2214eb-a359-41ed-ab6e-41dc3a10f1f2"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:12.660668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bad2fcee-b3ed-465a-8f04-91be083bc012 req-65cf3c96-c6c1-42c3-8994-adad206be8ed service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:12.661167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bad2fcee-b3ed-465a-8f04-91be083bc012 req-65cf3c96-c6c1-42c3-8994-adad206be8ed service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:12.661610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bad2fcee-b3ed-465a-8f04-91be083bc012 req-65cf3c96-c6c1-42c3-8994-adad206be8ed service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:12.691851 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-bad2fcee-b3ed-465a-8f04-91be083bc012 req-65cf3c96-c6c1-42c3-8994-adad206be8ed service nova] Creating event network-vif-deleted:ee2214eb-a359-41ed-ab6e-41dc3a10f1f2 for instance ac15912e-be60-47a8-830a-2c5a25324a7e on n-h2-850468-16 Aug 23 18:04:12.695406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2a21e11b-0686-497a-85bc-fe23f6ed57f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:12.699154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:12.709866 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2a21e11b-0686-497a-85bc-fe23f6ed57f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 1.797799 Aug 23 18:04:12.710435 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1567/3109] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:10 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 1799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:12.730252 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-bad2fcee-b3ed-465a-8f04-91be083bc012 req-65cf3c96-c6c1-42c3-8994-adad206be8ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140690 Aug 23 18:04:12.736065 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1543/3110] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:12.829065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:12.830004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:12.844684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:12.845198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:12.845643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:12.846371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:12.846854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:12.853762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:12.937698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:12.938500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:12.938903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:12.939451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lazy-loading 'fault' on Instance uuid ac15912e-be60-47a8-830a-2c5a25324a7e {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:04:13.152486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78a1cc2772e846e0ac3ca0324ab3cee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c1067637ced47dab01d19a65bfc3dd7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:13.163885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1e37ef65-feaa-4435-a082-3f32d83aee98 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:13.164600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1e37ef65-feaa-4435-a082-3f32d83aee98 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:13.171583 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bbba1908-f420-43eb-8634-69180f33965a tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 200 len: 1297 microversion: 2.1 time: 0.347458 Aug 23 18:04:13.178004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e37ef65-feaa-4435-a082-3f32d83aee98 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:13.178878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e37ef65-feaa-4435-a082-3f32d83aee98 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:13.180452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e37ef65-feaa-4435-a082-3f32d83aee98 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:13.180949 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1568/3111] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:12 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 1297 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:13.181881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e37ef65-feaa-4435-a082-3f32d83aee98 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:13.182507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e37ef65-feaa-4435-a082-3f32d83aee98 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:13.183122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e37ef65-feaa-4435-a082-3f32d83aee98 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:13.492783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1e37ef65-feaa-4435-a082-3f32d83aee98 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:13.512562 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1e37ef65-feaa-4435-a082-3f32d83aee98 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1317 microversion: 2.1 time: 0.352797 Aug 23 18:04:13.517318 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1544/3112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:13 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1317 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:13.736784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa6f7777-153a-435d-a533-74ef4470a6c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:13.737561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa6f7777-153a-435d-a533-74ef4470a6c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:13.750126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa6f7777-153a-435d-a533-74ef4470a6c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:13.752973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa6f7777-153a-435d-a533-74ef4470a6c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:13.754209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa6f7777-153a-435d-a533-74ef4470a6c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:13.756653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa6f7777-153a-435d-a533-74ef4470a6c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:13.757895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa6f7777-153a-435d-a533-74ef4470a6c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:13.759395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa6f7777-153a-435d-a533-74ef4470a6c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.201909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c65fa3d2-54da-4187-8095-a8da8730b6f7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:14.203267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c65fa3d2-54da-4187-8095-a8da8730b6f7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: ac15912e-be60-47a8-830a-2c5a25324a7e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:14.224763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c65fa3d2-54da-4187-8095-a8da8730b6f7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.227745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c65fa3d2-54da-4187-8095-a8da8730b6f7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.229035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c65fa3d2-54da-4187-8095-a8da8730b6f7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.231366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c65fa3d2-54da-4187-8095-a8da8730b6f7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.236755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c65fa3d2-54da-4187-8095-a8da8730b6f7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.239123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c65fa3d2-54da-4187-8095-a8da8730b6f7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.295575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa6f7777-153a-435d-a533-74ef4470a6c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:14.304745 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa6f7777-153a-435d-a533-74ef4470a6c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 0.572404 Aug 23 18:04:14.307524 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1569/3113] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:13 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:14.309458 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-c65fa3d2-54da-4187-8095-a8da8730b6f7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] HTTP exception thrown: Instance ac15912e-be60-47a8-830a-2c5a25324a7e could not be found. Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c65fa3d2-54da-4187-8095-a8da8730b6f7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Request method failure captured: Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e HTTP/1.1 Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRWHbV3OLKgIuNNXT5KCGZW7WT58aaAh9H89jE9QOZe82T8lIE_66bOTSflRCy4DYnq1nnsH73sZ7AopFhI6uIHrsl4n3xhrK5GELGV-O9mdGJRj8jUlbh44mSdwnGxUM3HP4lKIPkNUXzU__9FA4HrRgHB_ar7sGP9pzWp6deCKskM Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}] Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 78a1cc2772e846e0ac3ca0324ab3cee3 Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance ac15912e-be60-47a8-830a-2c5a25324a7e could not be found. Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'ac15912e-be60-47a8-830a-2c5a25324a7e'} Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac15912e-be60-47a8-830a-2c5a25324a7e could not be found. Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac15912e-be60-47a8-830a-2c5a25324a7e could not be found. Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.323391 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.328689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.328689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.328689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:14.328689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:14.328689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac15912e-be60-47a8-830a-2c5a25324a7e could not be found. Aug 23 18:04:14.328689 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.328689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c65fa3d2-54da-4187-8095-a8da8730b6f7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Returning 404 to user: Instance ac15912e-be60-47a8-830a-2c5a25324a7e could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:14.328689 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c65fa3d2-54da-4187-8095-a8da8730b6f7 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e" status: 404 len: 111 microversion: 2.1 time: 0.128170 Aug 23 18:04:14.332875 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1545/3114] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:14 2022] GET /compute/v2.1/servers/ac15912e-be60-47a8-830a-2c5a25324a7e => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:04:14.334927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9dfb280-9b8d-4a85-b1a2-61e659aff86e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec3b4dc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:14.370013 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b9dfb280-9b8d-4a85-b1a2-61e659aff86e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] HTTP exception thrown: Image not found. Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9dfb280-9b8d-4a85-b1a2-61e659aff86e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Request method failure captured: Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 HTTP/1.1 Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRWHbV3OLKgIuNNXT5KCGZW7WT58aaAh9H89jE9QOZe82T8lIE_66bOTSflRCy4DYnq1nnsH73sZ7AopFhI6uIHrsl4n3xhrK5GELGV-O9mdGJRj8jUlbh44mSdwnGxUM3HP4lKIPkNUXzU__9FA4HrRgHB_ar7sGP9pzWp6deCKskM Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}] Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 78a1cc2772e846e0ac3ca0324ab3cee3 Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '20baf876-5f32-4bfb-94b6-838225226cd8'} Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 20baf876-5f32-4bfb-94b6-838225226cd8 to delete Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 20baf876-5f32-4bfb-94b6-838225226cd8 could not be found. Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.372257 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:04:14.377366 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.379785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9dfb280-9b8d-4a85-b1a2-61e659aff86e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:14.380806 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b9dfb280-9b8d-4a85-b1a2-61e659aff86e tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8" status: 404 len: 62 microversion: 2.1 time: 0.049974 Aug 23 18:04:14.382478 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1570/3115] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:14 2022] DELETE /compute/v2.1/images/20baf876-5f32-4bfb-94b6-838225226cd8 => generated 62 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 18:04:14.391528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a8ecbbb-7483-4dc2-b038-663a88260d08 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:14.392030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a8ecbbb-7483-4dc2-b038-663a88260d08 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:14.400381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a8ecbbb-7483-4dc2-b038-663a88260d08 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.400873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a8ecbbb-7483-4dc2-b038-663a88260d08 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.401314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a8ecbbb-7483-4dc2-b038-663a88260d08 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.402022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a8ecbbb-7483-4dc2-b038-663a88260d08 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.402475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a8ecbbb-7483-4dc2-b038-663a88260d08 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.402939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a8ecbbb-7483-4dc2-b038-663a88260d08 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.505762 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-9a8ecbbb-7483-4dc2-b038-663a88260d08 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] HTTP exception thrown: Instance 769e5a46-b0fd-49a3-bffa-1538728a67cc could not be found. Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a8ecbbb-7483-4dc2-b038-663a88260d08 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Request method failure captured: Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc HTTP/1.1 Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRWHbV3OLKgIuNNXT5KCGZW7WT58aaAh9H89jE9QOZe82T8lIE_66bOTSflRCy4DYnq1nnsH73sZ7AopFhI6uIHrsl4n3xhrK5GELGV-O9mdGJRj8jUlbh44mSdwnGxUM3HP4lKIPkNUXzU__9FA4HrRgHB_ar7sGP9pzWp6deCKskM Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}] Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 78a1cc2772e846e0ac3ca0324ab3cee3 Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 769e5a46-b0fd-49a3-bffa-1538728a67cc could not be found. Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '769e5a46-b0fd-49a3-bffa-1538728a67cc'} Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769e5a46-b0fd-49a3-bffa-1538728a67cc could not be found. Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:14.507445 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769e5a46-b0fd-49a3-bffa-1538728a67cc could not be found. Aug 23 18:04:14.512107 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.512107 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.512107 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.512107 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.512107 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.512107 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.512107 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:14.512107 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:14.512107 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769e5a46-b0fd-49a3-bffa-1538728a67cc could not be found. Aug 23 18:04:14.512107 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.512107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a8ecbbb-7483-4dc2-b038-663a88260d08 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Returning 404 to user: Instance 769e5a46-b0fd-49a3-bffa-1538728a67cc could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:14.512107 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a8ecbbb-7483-4dc2-b038-663a88260d08 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 404 len: 111 microversion: 2.1 time: 0.121957 Aug 23 18:04:14.518078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e50fe720-ef5e-4fa1-9ab4-bd274d752e78 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:14.518730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e50fe720-ef5e-4fa1-9ab4-bd274d752e78 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 769e5a46-b0fd-49a3-bffa-1538728a67cc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:14.531098 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1546/3116] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:04:14 2022] DELETE /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 111 bytes in 145 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:04:14.546130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e50fe720-ef5e-4fa1-9ab4-bd274d752e78 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.550808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e50fe720-ef5e-4fa1-9ab4-bd274d752e78 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.551304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e50fe720-ef5e-4fa1-9ab4-bd274d752e78 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.552058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e50fe720-ef5e-4fa1-9ab4-bd274d752e78 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.561012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e50fe720-ef5e-4fa1-9ab4-bd274d752e78 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.561540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e50fe720-ef5e-4fa1-9ab4-bd274d752e78 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.566201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6c17d94d-a7a0-40a8-892a-36428b061558 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:14.566861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6c17d94d-a7a0-40a8-892a-36428b061558 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:14.580323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c17d94d-a7a0-40a8-892a-36428b061558 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.580819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c17d94d-a7a0-40a8-892a-36428b061558 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.581274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c17d94d-a7a0-40a8-892a-36428b061558 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.582003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c17d94d-a7a0-40a8-892a-36428b061558 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.582470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c17d94d-a7a0-40a8-892a-36428b061558 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.594833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c17d94d-a7a0-40a8-892a-36428b061558 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.635715 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-e50fe720-ef5e-4fa1-9ab4-bd274d752e78 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] HTTP exception thrown: Instance 769e5a46-b0fd-49a3-bffa-1538728a67cc could not be found. Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e50fe720-ef5e-4fa1-9ab4-bd274d752e78 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Request method failure captured: Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc HTTP/1.1 Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRWHbV3OLKgIuNNXT5KCGZW7WT58aaAh9H89jE9QOZe82T8lIE_66bOTSflRCy4DYnq1nnsH73sZ7AopFhI6uIHrsl4n3xhrK5GELGV-O9mdGJRj8jUlbh44mSdwnGxUM3HP4lKIPkNUXzU__9FA4HrRgHB_ar7sGP9pzWp6deCKskM Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}] Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 78a1cc2772e846e0ac3ca0324ab3cee3 Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 769e5a46-b0fd-49a3-bffa-1538728a67cc could not be found. Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '769e5a46-b0fd-49a3-bffa-1538728a67cc'} Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 769e5a46-b0fd-49a3-bffa-1538728a67cc could not be found. Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 769e5a46-b0fd-49a3-bffa-1538728a67cc could not be found. Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.637964 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.642533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.642533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.642533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:14.642533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:14.642533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 769e5a46-b0fd-49a3-bffa-1538728a67cc could not be found. Aug 23 18:04:14.642533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.646448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e50fe720-ef5e-4fa1-9ab4-bd274d752e78 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Returning 404 to user: Instance 769e5a46-b0fd-49a3-bffa-1538728a67cc could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:14.647718 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e50fe720-ef5e-4fa1-9ab4-bd274d752e78 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc" status: 404 len: 111 microversion: 2.1 time: 0.134091 Aug 23 18:04:14.652413 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1571/3117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:14 2022] GET /compute/v2.1/servers/769e5a46-b0fd-49a3-bffa-1538728a67cc => generated 111 bytes in 139 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:04:14.661177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5db91b38-80bb-473e-a67f-a09357f7b4ed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec3b4dc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:14.704615 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-5db91b38-80bb-473e-a67f-a09357f7b4ed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] HTTP exception thrown: Image not found. Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5db91b38-80bb-473e-a67f-a09357f7b4ed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Request method failure captured: Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 HTTP/1.1 Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRWHbV3OLKgIuNNXT5KCGZW7WT58aaAh9H89jE9QOZe82T8lIE_66bOTSflRCy4DYnq1nnsH73sZ7AopFhI6uIHrsl4n3xhrK5GELGV-O9mdGJRj8jUlbh44mSdwnGxUM3HP4lKIPkNUXzU__9FA4HrRgHB_ar7sGP9pzWp6deCKskM Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}] Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 78a1cc2772e846e0ac3ca0324ab3cee3 Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '9ac6bec9-e100-417b-9750-0106f4f814b4'} Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 9ac6bec9-e100-417b-9750-0106f4f814b4 to delete Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 9ac6bec9-e100-417b-9750-0106f4f814b4 could not be found. Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.707330 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:04:14.711425 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.715176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5db91b38-80bb-473e-a67f-a09357f7b4ed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:14.718075 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5db91b38-80bb-473e-a67f-a09357f7b4ed tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4" status: 404 len: 62 microversion: 2.1 time: 0.059660 Aug 23 18:04:14.731078 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1572/3118] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:14 2022] DELETE /compute/v2.1/images/9ac6bec9-e100-417b-9750-0106f4f814b4 => generated 62 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 18:04:14.749510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-115a9183-a623-4702-81df-c029e1ff125b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:14.750785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-115a9183-a623-4702-81df-c029e1ff125b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:14.771694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-115a9183-a623-4702-81df-c029e1ff125b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.774020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-115a9183-a623-4702-81df-c029e1ff125b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.775635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-115a9183-a623-4702-81df-c029e1ff125b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.777679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-115a9183-a623-4702-81df-c029e1ff125b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.783578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-115a9183-a623-4702-81df-c029e1ff125b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.784551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-115a9183-a623-4702-81df-c029e1ff125b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.833348 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-115a9183-a623-4702-81df-c029e1ff125b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] HTTP exception thrown: Instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 could not be found. Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-115a9183-a623-4702-81df-c029e1ff125b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Request method failure captured: Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 HTTP/1.1 Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRWHbV3OLKgIuNNXT5KCGZW7WT58aaAh9H89jE9QOZe82T8lIE_66bOTSflRCy4DYnq1nnsH73sZ7AopFhI6uIHrsl4n3xhrK5GELGV-O9mdGJRj8jUlbh44mSdwnGxUM3HP4lKIPkNUXzU__9FA4HrRgHB_ar7sGP9pzWp6deCKskM Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}] Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 78a1cc2772e846e0ac3ca0324ab3cee3 Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 could not be found. Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2'} Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 could not be found. Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:14.840636 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 could not be found. Aug 23 18:04:14.845850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.845850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.845850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.845850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.845850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.845850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.845850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:14.845850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:14.845850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 could not be found. Aug 23 18:04:14.845850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.849371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-115a9183-a623-4702-81df-c029e1ff125b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Returning 404 to user: Instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:14.850512 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-115a9183-a623-4702-81df-c029e1ff125b tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 404 len: 111 microversion: 2.1 time: 0.108292 Aug 23 18:04:14.859616 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1573/3119] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:04:14 2022] DELETE /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:04:14.865519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9896a95e-1c5a-4420-be6b-ab892c1660ca tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:14.866500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9896a95e-1c5a-4420-be6b-ab892c1660ca tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:14.878633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9896a95e-1c5a-4420-be6b-ab892c1660ca tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.880756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9896a95e-1c5a-4420-be6b-ab892c1660ca tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.881456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9896a95e-1c5a-4420-be6b-ab892c1660ca tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.882397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9896a95e-1c5a-4420-be6b-ab892c1660ca tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.883135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9896a95e-1c5a-4420-be6b-ab892c1660ca tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.883844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9896a95e-1c5a-4420-be6b-ab892c1660ca tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.906531 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-9896a95e-1c5a-4420-be6b-ab892c1660ca tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] HTTP exception thrown: Instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 could not be found. Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9896a95e-1c5a-4420-be6b-ab892c1660ca tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Request method failure captured: Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 HTTP/1.1 Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRWHbV3OLKgIuNNXT5KCGZW7WT58aaAh9H89jE9QOZe82T8lIE_66bOTSflRCy4DYnq1nnsH73sZ7AopFhI6uIHrsl4n3xhrK5GELGV-O9mdGJRj8jUlbh44mSdwnGxUM3HP4lKIPkNUXzU__9FA4HrRgHB_ar7sGP9pzWp6deCKskM Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}] Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 78a1cc2772e846e0ac3ca0324ab3cee3 Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 could not be found. Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2'} Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 could not be found. Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 could not be found. Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.912039 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.916980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.916980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.916980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:14.916980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:14.916980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 could not be found. Aug 23 18:04:14.916980 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.916980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9896a95e-1c5a-4420-be6b-ab892c1660ca tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Returning 404 to user: Instance 7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:14.916980 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9896a95e-1c5a-4420-be6b-ab892c1660ca tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2" status: 404 len: 111 microversion: 2.1 time: 0.052503 Aug 23 18:04:14.916980 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1574/3120] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:14 2022] GET /compute/v2.1/servers/7e4a7c93-c4e3-4f6f-b04c-8c1a3648efe2 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:04:14.926185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00059868-a9b8-4354-bb87-0e9481c574c2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '.version_select at 0x7f27ec634ca0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:14.954019 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-00059868-a9b8-4354-bb87-0e9481c574c2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] HTTP exception thrown: Image not found. Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00059868-a9b8-4354-bb87-0e9481c574c2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Request method failure captured: Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a HTTP/1.1 Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRWHbV3OLKgIuNNXT5KCGZW7WT58aaAh9H89jE9QOZe82T8lIE_66bOTSflRCy4DYnq1nnsH73sZ7AopFhI6uIHrsl4n3xhrK5GELGV-O9mdGJRj8jUlbh44mSdwnGxUM3HP4lKIPkNUXzU__9FA4HrRgHB_ar7sGP9pzWp6deCKskM Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}] Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 78a1cc2772e846e0ac3ca0324ab3cee3 Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '22286a62-81e3-43d1-85fe-7ab0621fbd0a'} Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 22286a62-81e3-43d1-85fe-7ab0621fbd0a to delete Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 22286a62-81e3-43d1-85fe-7ab0621fbd0a could not be found. Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.955784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00059868-a9b8-4354-bb87-0e9481c574c2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-00059868-a9b8-4354-bb87-0e9481c574c2 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a" status: 404 len: 62 microversion: 2.1 time: 0.036699 Aug 23 18:04:14.963802 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1575/3121] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:14 2022] DELETE /compute/v2.1/images/22286a62-81e3-43d1-85fe-7ab0621fbd0a => generated 62 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:04:14.969732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-67d4926a-ef1a-4e0f-b536-ac10acd9df50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:14.970516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-67d4926a-ef1a-4e0f-b536-ac10acd9df50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:14.978937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67d4926a-ef1a-4e0f-b536-ac10acd9df50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.979675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67d4926a-ef1a-4e0f-b536-ac10acd9df50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.980165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67d4926a-ef1a-4e0f-b536-ac10acd9df50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:14.981790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67d4926a-ef1a-4e0f-b536-ac10acd9df50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:14.983969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67d4926a-ef1a-4e0f-b536-ac10acd9df50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:14.984749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-67d4926a-ef1a-4e0f-b536-ac10acd9df50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:15.003108 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-67d4926a-ef1a-4e0f-b536-ac10acd9df50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] HTTP exception thrown: Instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 could not be found. Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-67d4926a-ef1a-4e0f-b536-ac10acd9df50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Request method failure captured: Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 HTTP/1.1 Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRWHbV3OLKgIuNNXT5KCGZW7WT58aaAh9H89jE9QOZe82T8lIE_66bOTSflRCy4DYnq1nnsH73sZ7AopFhI6uIHrsl4n3xhrK5GELGV-O9mdGJRj8jUlbh44mSdwnGxUM3HP4lKIPkNUXzU__9FA4HrRgHB_ar7sGP9pzWp6deCKskM Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}] Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 78a1cc2772e846e0ac3ca0324ab3cee3 Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 could not be found. Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'b4b43649-db0d-42b6-a207-a8c75fc2a5a8'} Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 could not be found. Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:15.005985 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 could not be found. Aug 23 18:04:15.009731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:15.009731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:15.009731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:15.009731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:15.009731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:15.009731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:15.009731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:15.009731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:15.009731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 could not be found. Aug 23 18:04:15.009731 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:15.012145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-67d4926a-ef1a-4e0f-b536-ac10acd9df50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Returning 404 to user: Instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:15.013259 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-67d4926a-ef1a-4e0f-b536-ac10acd9df50 tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 404 len: 111 microversion: 2.1 time: 0.049326 Aug 23 18:04:15.014981 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1576/3122] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:04:14 2022] DELETE /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:04:15.028266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a0490350-4b45-44de-96fe-9bf4926c57cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:15.030623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a0490350-4b45-44de-96fe-9bf4926c57cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] [instance: b4b43649-db0d-42b6-a207-a8c75fc2a5a8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:15.047885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0490350-4b45-44de-96fe-9bf4926c57cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:15.050057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0490350-4b45-44de-96fe-9bf4926c57cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:15.050756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0490350-4b45-44de-96fe-9bf4926c57cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:15.052907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0490350-4b45-44de-96fe-9bf4926c57cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:15.054729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0490350-4b45-44de-96fe-9bf4926c57cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:15.055483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0490350-4b45-44de-96fe-9bf4926c57cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:15.100778 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-a0490350-4b45-44de-96fe-9bf4926c57cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] HTTP exception thrown: Instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 could not be found. Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a0490350-4b45-44de-96fe-9bf4926c57cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Request method failure captured: Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 HTTP/1.1 Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRWHbV3OLKgIuNNXT5KCGZW7WT58aaAh9H89jE9QOZe82T8lIE_66bOTSflRCy4DYnq1nnsH73sZ7AopFhI6uIHrsl4n3xhrK5GELGV-O9mdGJRj8jUlbh44mSdwnGxUM3HP4lKIPkNUXzU__9FA4HrRgHB_ar7sGP9pzWp6deCKskM Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/0c1067637ced47dab01d19a65bfc3dd7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/0c1067637ced47dab01d19a65bfc3dd7"}]}] Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 0c1067637ced47dab01d19a65bfc3dd7 Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesTestJSON-1282878009 Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 78a1cc2772e846e0ac3ca0324ab3cee3 Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesTestJSON-1282878009-project Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 could not be found. Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'b4b43649-db0d-42b6-a207-a8c75fc2a5a8'} Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 could not be found. Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 could not be found. Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:15.102347 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:15.107637 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:15.107637 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:15.107637 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:15.107637 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:15.107637 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 could not be found. Aug 23 18:04:15.107637 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:15.107637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a0490350-4b45-44de-96fe-9bf4926c57cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] Returning 404 to user: Instance b4b43649-db0d-42b6-a207-a8c75fc2a5a8 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:15.107637 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a0490350-4b45-44de-96fe-9bf4926c57cd tempest-ImagesTestJSON-1282878009 tempest-ImagesTestJSON-1282878009-project] 10.222.0.61 "GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8" status: 404 len: 111 microversion: 2.1 time: 0.084561 Aug 23 18:04:15.107637 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1577/3123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:15 2022] GET /compute/v2.1/servers/b4b43649-db0d-42b6-a207-a8c75fc2a5a8 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:04:15.307243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c17d94d-a7a0-40a8-892a-36428b061558 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:15.330291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-07218490-e44a-49c6-9dd6-e20469e4f03b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:15.331783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-07218490-e44a-49c6-9dd6-e20469e4f03b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:15.335589 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6c17d94d-a7a0-40a8-892a-36428b061558 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1317 microversion: 2.1 time: 0.789353 Aug 23 18:04:15.336274 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1547/3124] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:14 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1317 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:15.345029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07218490-e44a-49c6-9dd6-e20469e4f03b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:15.345527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07218490-e44a-49c6-9dd6-e20469e4f03b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:15.345962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07218490-e44a-49c6-9dd6-e20469e4f03b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:15.346751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07218490-e44a-49c6-9dd6-e20469e4f03b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:15.347264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07218490-e44a-49c6-9dd6-e20469e4f03b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:15.347689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07218490-e44a-49c6-9dd6-e20469e4f03b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:16.360054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2601bc2d-e4b2-42b9-8cac-1d07dfd381cd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:16.360681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2601bc2d-e4b2-42b9-8cac-1d07dfd381cd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:16.392478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2601bc2d-e4b2-42b9-8cac-1d07dfd381cd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:16.393095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2601bc2d-e4b2-42b9-8cac-1d07dfd381cd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:16.395712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2601bc2d-e4b2-42b9-8cac-1d07dfd381cd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:16.399005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2601bc2d-e4b2-42b9-8cac-1d07dfd381cd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:16.408326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2601bc2d-e4b2-42b9-8cac-1d07dfd381cd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:16.410089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2601bc2d-e4b2-42b9-8cac-1d07dfd381cd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:16.842617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-07218490-e44a-49c6-9dd6-e20469e4f03b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:16.854221 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-07218490-e44a-49c6-9dd6-e20469e4f03b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 1.530963 Aug 23 18:04:16.854898 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1578/3125] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:15 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:16.966593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2601bc2d-e4b2-42b9-8cac-1d07dfd381cd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:16.976596 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2601bc2d-e4b2-42b9-8cac-1d07dfd381cd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1466 microversion: 2.1 time: 0.623008 Aug 23 18:04:16.998159 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1548/3126] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:16 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1466 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:17.016084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c960259a-41e9-4a9f-865c-a9ad1f7ba39c tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:17.016946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c960259a-41e9-4a9f-865c-a9ad1f7ba39c tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:17.026946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c960259a-41e9-4a9f-865c-a9ad1f7ba39c tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:17.039300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c960259a-41e9-4a9f-865c-a9ad1f7ba39c tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:17.039726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c960259a-41e9-4a9f-865c-a9ad1f7ba39c tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:17.040514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c960259a-41e9-4a9f-865c-a9ad1f7ba39c tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:17.042218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c960259a-41e9-4a9f-865c-a9ad1f7ba39c tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:17.042699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c960259a-41e9-4a9f-865c-a9ad1f7ba39c tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:17.878420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dfac6646-749a-4a44-9261-bdc2cc1b982f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:17.879145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dfac6646-749a-4a44-9261-bdc2cc1b982f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:17.904470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfac6646-749a-4a44-9261-bdc2cc1b982f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:17.908940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfac6646-749a-4a44-9261-bdc2cc1b982f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:17.909500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfac6646-749a-4a44-9261-bdc2cc1b982f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:17.912278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfac6646-749a-4a44-9261-bdc2cc1b982f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:17.912766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfac6646-749a-4a44-9261-bdc2cc1b982f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:17.921043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfac6646-749a-4a44-9261-bdc2cc1b982f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:18.423718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dfac6646-749a-4a44-9261-bdc2cc1b982f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:18.440152 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dfac6646-749a-4a44-9261-bdc2cc1b982f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 0.564940 Aug 23 18:04:18.442349 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1549/3127] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:17 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:18.477526 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c960259a-41e9-4a9f-865c-a9ad1f7ba39c tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1619 microversion: 2.1 time: 1.470804 Aug 23 18:04:18.480835 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1579/3128] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:17 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1619 bytes in 1475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:18.799856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1819068689", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "8feaf703-5072-4321-b05e-dfebaaa5c573"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:18.959789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:04:19.464450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f115be9f-15ea-48ef-a188-808c2f5a2148 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:19.466717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f115be9f-15ea-48ef-a188-808c2f5a2148 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:19.488309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f115be9f-15ea-48ef-a188-808c2f5a2148 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:19.493386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f115be9f-15ea-48ef-a188-808c2f5a2148 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:19.494448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f115be9f-15ea-48ef-a188-808c2f5a2148 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:19.497628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f115be9f-15ea-48ef-a188-808c2f5a2148 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:19.501219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f115be9f-15ea-48ef-a188-808c2f5a2148 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:19.503876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f115be9f-15ea-48ef-a188-808c2f5a2148 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:20.353170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f115be9f-15ea-48ef-a188-808c2f5a2148 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:20.384467 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f115be9f-15ea-48ef-a188-808c2f5a2148 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 0.921858 Aug 23 18:04:20.390875 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1580/3129] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:19 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:20.832654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:20.887407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:04:20.888513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:04:20.889128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:04:20.893789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:04:20.897262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:04:20.915191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:20.941461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:20.943539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:20.945537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:20.947861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:20.948866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:20.952994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.004527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:04:21.019866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Getting quotas for user cd9fba74d93549eab6dd981627cbd7f8 and project eeb9f8355f1f412da3eb256151e73fbf. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:04:21.022661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-19090f60-ea33-4597-8c64-65b2809d468d tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec665040>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:21.028306 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:04:21.028306 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:04:21.031955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19090f60-ea33-4597-8c64-65b2809d468d tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.032464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19090f60-ea33-4597-8c64-65b2809d468d tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.036292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19090f60-ea33-4597-8c64-65b2809d468d tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.064019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:04:21.075398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:04:21.082175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19090f60-ea33-4597-8c64-65b2809d468d tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.082725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19090f60-ea33-4597-8c64-65b2809d468d tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.083373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19090f60-ea33-4597-8c64-65b2809d468d tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.100773 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-19090f60-ea33-4597-8c64-65b2809d468d tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] HTTP exception thrown: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-19090f60-ea33-4597-8c64-65b2809d468d tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Request method failure captured: Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: request: PUT /compute/v2.1/os-services/fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 HTTP/1.1 Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 56 Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRakLbc3BdwgdBNTGK4dU-_e53x_pBIJajQSRw3IFxNWCynkkeIuBguR8O-MZf-r6Lz_Gznji9sdg1CKd_iAGRIo1yk-DgAHUZe3pw-9xdZyx5Rj0WTbYFOaSM40nRU17E-s_QRMt8e0M3PM25Re4ZfqIXSNmMTWQXoYyUzbUe-MWBg Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.53 Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: fc9157aae2e14b87b74f2b58a5ee88f2 Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-633186939 Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fc9157aae2e14b87b74f2b58a5ee88f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc9157aae2e14b87b74f2b58a5ee88f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fc9157aae2e14b87b74f2b58a5ee88f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc9157aae2e14b87b74f2b58a5ee88f2"}]}] Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-633186939 Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: fc9157aae2e14b87b74f2b58a5ee88f2 Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-633186939 Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2c943695eee24d26a628ccda993334d2 Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: {"status": "disabled", "disabled_reason": "maintenance"} Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: exception: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'fedeaff1-1f62-4e03-8c93-b7f6ed9065b6', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:04:21.109413 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.114619 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.126867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-19090f60-ea33-4597-8c64-65b2809d468d tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Returning 404 to user: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:21.128422 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-19090f60-ea33-4597-8c64-65b2809d468d tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-services/fedeaff1-1f62-4e03-8c93-b7f6ed9065b6" status: 404 len: 110 microversion: 2.53 time: 0.423510 Aug 23 18:04:21.129514 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1581/3130] 10.222.0.61 () {62 vars in 1309 bytes} [Tue Aug 23 18:04:20 2022] PUT /compute/v2.1/os-services/fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 => generated 110 bytes in 425 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 23 18:04:21.140719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c131724-6ba2-4205-82c4-be124d59e6d1 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec3cb0d0>, body: {"status": "disabled"} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:21.144678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c131724-6ba2-4205-82c4-be124d59e6d1 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.146769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c131724-6ba2-4205-82c4-be124d59e6d1 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.146769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c131724-6ba2-4205-82c4-be124d59e6d1 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.159335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c131724-6ba2-4205-82c4-be124d59e6d1 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.163197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c131724-6ba2-4205-82c4-be124d59e6d1 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.163876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c131724-6ba2-4205-82c4-be124d59e6d1 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.181097 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-4c131724-6ba2-4205-82c4-be124d59e6d1 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] HTTP exception thrown: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c131724-6ba2-4205-82c4-be124d59e6d1 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Request method failure captured: Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: request: PUT /compute/v2.1/os-services/fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 HTTP/1.1 Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 22 Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRakLbc3BdwgdBNTGK4dU-_e53x_pBIJajQSRw3IFxNWCynkkeIuBguR8O-MZf-r6Lz_Gznji9sdg1CKd_iAGRIo1yk-DgAHUZe3pw-9xdZyx5Rj0WTbYFOaSM40nRU17E-s_QRMt8e0M3PM25Re4ZfqIXSNmMTWQXoYyUzbUe-MWBg Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.53 Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: fc9157aae2e14b87b74f2b58a5ee88f2 Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-633186939 Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fc9157aae2e14b87b74f2b58a5ee88f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc9157aae2e14b87b74f2b58a5ee88f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fc9157aae2e14b87b74f2b58a5ee88f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc9157aae2e14b87b74f2b58a5ee88f2"}]}] Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-633186939 Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: fc9157aae2e14b87b74f2b58a5ee88f2 Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-633186939 Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2c943695eee24d26a628ccda993334d2 Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: {"status": "disabled"} Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: exception: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'fedeaff1-1f62-4e03-8c93-b7f6ed9065b6', 'body': {'status': 'disabled'}} Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:04:21.183084 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.188063 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.191572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c131724-6ba2-4205-82c4-be124d59e6d1 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Returning 404 to user: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:21.192646 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4c131724-6ba2-4205-82c4-be124d59e6d1 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-services/fedeaff1-1f62-4e03-8c93-b7f6ed9065b6" status: 404 len: 110 microversion: 2.53 time: 0.056678 Aug 23 18:04:21.197343 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1582/3131] 10.222.0.61 () {62 vars in 1309 bytes} [Tue Aug 23 18:04:21 2022] PUT /compute/v2.1/os-services/fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 => generated 110 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:04:21.207181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d954a82b-0e3a-41c1-9a8e-47f584f512cf tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Action: 'update', calling method: .version_select at 0x7f27ec82d700>, body: {"status": "enabled"} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:21.213573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d954a82b-0e3a-41c1-9a8e-47f584f512cf tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.230366 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-127a8a9b-c23d-43b8-a1d0-a174f043c18f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.444343 Aug 23 18:04:21.231551 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1550/3132] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:04:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 2449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:04:21.249574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d10ab1ec-ee9b-4e44-a68e-df94c54784c6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:21.250339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d10ab1ec-ee9b-4e44-a68e-df94c54784c6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:21.255719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d954a82b-0e3a-41c1-9a8e-47f584f512cf tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.042s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.258005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d954a82b-0e3a-41c1-9a8e-47f584f512cf tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.284696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d954a82b-0e3a-41c1-9a8e-47f584f512cf tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.289621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d954a82b-0e3a-41c1-9a8e-47f584f512cf tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.291913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d954a82b-0e3a-41c1-9a8e-47f584f512cf tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.313473 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-d954a82b-0e3a-41c1-9a8e-47f584f512cf tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] HTTP exception thrown: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d954a82b-0e3a-41c1-9a8e-47f584f512cf tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Request method failure captured: Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: request: PUT /compute/v2.1/os-services/fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 HTTP/1.1 Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 21 Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRakLbc3BdwgdBNTGK4dU-_e53x_pBIJajQSRw3IFxNWCynkkeIuBguR8O-MZf-r6Lz_Gznji9sdg1CKd_iAGRIo1yk-DgAHUZe3pw-9xdZyx5Rj0WTbYFOaSM40nRU17E-s_QRMt8e0M3PM25Re4ZfqIXSNmMTWQXoYyUzbUe-MWBg Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.53 Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: fc9157aae2e14b87b74f2b58a5ee88f2 Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-633186939 Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fc9157aae2e14b87b74f2b58a5ee88f2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc9157aae2e14b87b74f2b58a5ee88f2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fc9157aae2e14b87b74f2b58a5ee88f2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fc9157aae2e14b87b74f2b58a5ee88f2"}]}] Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-633186939 Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: fc9157aae2e14b87b74f2b58a5ee88f2 Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-633186939 Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2c943695eee24d26a628ccda993334d2 Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: {"status": "enabled"} Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: exception: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'fedeaff1-1f62-4e03-8c93-b7f6ed9065b6', 'body': {'status': 'enabled'}} Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6202, in service_get_by_id Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6062, in _find_service_in_cell Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6204, in service_get_by_id Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:04:21.315879 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. Aug 23 18:04:21.323497 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:21.327355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d954a82b-0e3a-41c1-9a8e-47f584f512cf tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Returning 404 to user: Service fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:21.332250 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d954a82b-0e3a-41c1-9a8e-47f584f512cf tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-services/fedeaff1-1f62-4e03-8c93-b7f6ed9065b6" status: 404 len: 110 microversion: 2.53 time: 0.132605 Aug 23 18:04:21.333675 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1583/3133] 10.222.0.61 () {62 vars in 1309 bytes} [Tue Aug 23 18:04:21 2022] PUT /compute/v2.1/os-services/fedeaff1-1f62-4e03-8c93-b7f6ed9065b6 => generated 110 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:04:21.344694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fb3616fa-d167-44f5-87de-79e5345799d6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:21.361430 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:04:21.361430 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:04:21.368415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb3616fa-d167-44f5-87de-79e5345799d6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.371927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb3616fa-d167-44f5-87de-79e5345799d6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.373627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb3616fa-d167-44f5-87de-79e5345799d6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.378584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb3616fa-d167-44f5-87de-79e5345799d6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.381080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb3616fa-d167-44f5-87de-79e5345799d6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.383175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb3616fa-d167-44f5-87de-79e5345799d6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.439852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d10ab1ec-ee9b-4e44-a68e-df94c54784c6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:21.454257 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d10ab1ec-ee9b-4e44-a68e-df94c54784c6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1217 microversion: 2.1 time: 0.215166 Aug 23 18:04:21.471284 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1551/3134] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:21 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1217 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:21.476626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d211b7a0-f9ef-43cc-ad48-b8db48274c16 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:21.482858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d211b7a0-f9ef-43cc-ad48-b8db48274c16 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:21.502389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d211b7a0-f9ef-43cc-ad48-b8db48274c16 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.503190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d211b7a0-f9ef-43cc-ad48-b8db48274c16 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.503800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d211b7a0-f9ef-43cc-ad48-b8db48274c16 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.504722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d211b7a0-f9ef-43cc-ad48-b8db48274c16 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.508117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d211b7a0-f9ef-43cc-ad48-b8db48274c16 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.513511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d211b7a0-f9ef-43cc-ad48-b8db48274c16 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.569124 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fb3616fa-d167-44f5-87de-79e5345799d6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.230177 Aug 23 18:04:21.581117 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1584/3135] 10.222.0.61 () {60 vars in 1178 bytes} [Tue Aug 23 18:04:21 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:04:21.614677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1afd91f1-2079-46f1-9fb4-f0ab844f6485 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:21.623679 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:04:21.623679 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:04:21.637935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1afd91f1-2079-46f1-9fb4-f0ab844f6485 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.640704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1afd91f1-2079-46f1-9fb4-f0ab844f6485 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.641971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1afd91f1-2079-46f1-9fb4-f0ab844f6485 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.644202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1afd91f1-2079-46f1-9fb4-f0ab844f6485 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.647627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1afd91f1-2079-46f1-9fb4-f0ab844f6485 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.649114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1afd91f1-2079-46f1-9fb4-f0ab844f6485 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.721448 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1afd91f1-2079-46f1-9fb4-f0ab844f6485 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.137017 Aug 23 18:04:21.727971 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1585/3136] 10.222.0.61 () {60 vars in 1211 bytes} [Tue Aug 23 18:04:21 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1244 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:04:21.746326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b332162c-38e2-4d97-bfee-7b18163b2db6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:21.760141 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:04:21.760141 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:04:21.765832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b332162c-38e2-4d97-bfee-7b18163b2db6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.766793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b332162c-38e2-4d97-bfee-7b18163b2db6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.767544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b332162c-38e2-4d97-bfee-7b18163b2db6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.768530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b332162c-38e2-4d97-bfee-7b18163b2db6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.769239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b332162c-38e2-4d97-bfee-7b18163b2db6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.769889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b332162c-38e2-4d97-bfee-7b18163b2db6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.845533 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b332162c-38e2-4d97-bfee-7b18163b2db6 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.109508 Aug 23 18:04:21.847391 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1586/3137] 10.222.0.61 () {60 vars in 1178 bytes} [Tue Aug 23 18:04:21 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:04:21.861308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-88974dad-f1f3-4b9e-bedf-514c0d8db21a tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:21.866241 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:04:21.866241 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:04:21.869108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88974dad-f1f3-4b9e-bedf-514c0d8db21a tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.869617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88974dad-f1f3-4b9e-bedf-514c0d8db21a tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.871970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88974dad-f1f3-4b9e-bedf-514c0d8db21a tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.874326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88974dad-f1f3-4b9e-bedf-514c0d8db21a tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.875457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88974dad-f1f3-4b9e-bedf-514c0d8db21a tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.877850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88974dad-f1f3-4b9e-bedf-514c0d8db21a tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.953281 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-88974dad-f1f3-4b9e-bedf-514c0d8db21a tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=n-d-850468-16&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.096982 Aug 23 18:04:21.964108 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1587/3138] 10.222.0.61 () {60 vars in 1237 bytes} [Tue Aug 23 18:04:21 2022] GET /compute/v2.1/os-services?host=n-d-850468-16&binary=xxx => generated 16 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:21.977173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-31675e30-d2bf-4dda-af0d-12f9b350f992 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:21.985121 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:04:21.985121 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:04:21.990851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31675e30-d2bf-4dda-af0d-12f9b350f992 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.991931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31675e30-d2bf-4dda-af0d-12f9b350f992 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:21.996271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31675e30-d2bf-4dda-af0d-12f9b350f992 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:21.998817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31675e30-d2bf-4dda-af0d-12f9b350f992 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:21.999670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31675e30-d2bf-4dda-af0d-12f9b350f992 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:22.000287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31675e30-d2bf-4dda-af0d-12f9b350f992 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:22.037830 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-31675e30-d2bf-4dda-af0d-12f9b350f992 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services" status: 200 len: 1244 microversion: 2.53 time: 0.066020 Aug 23 18:04:22.039020 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1588/3139] 10.222.0.61 () {60 vars in 1178 bytes} [Tue Aug 23 18:04:21 2022] GET /compute/v2.1/os-services => generated 1244 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:04:22.063881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eaf76a76-c9ec-4996-8ee1-8bece331d869 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:22.065875 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:04:22.065875 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:04:22.079644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eaf76a76-c9ec-4996-8ee1-8bece331d869 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:22.080162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eaf76a76-c9ec-4996-8ee1-8bece331d869 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:22.080605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eaf76a76-c9ec-4996-8ee1-8bece331d869 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:22.083713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eaf76a76-c9ec-4996-8ee1-8bece331d869 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:22.093408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eaf76a76-c9ec-4996-8ee1-8bece331d869 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:22.094286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eaf76a76-c9ec-4996-8ee1-8bece331d869 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:22.164849 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eaf76a76-c9ec-4996-8ee1-8bece331d869 tempest-ServicesAdminNegativeV253TestJSON-633186939 tempest-ServicesAdminNegativeV253TestJSON-633186939-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.115122 Aug 23 18:04:22.177891 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1589/3140] 10.222.0.61 () {60 vars in 1239 bytes} [Tue Aug 23 18:04:22 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:22.197992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d211b7a0-f9ef-43cc-ad48-b8db48274c16 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:22.207134 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d211b7a0-f9ef-43cc-ad48-b8db48274c16 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 0.734298 Aug 23 18:04:22.214462 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1552/3141] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:21 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:22.476979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6aa8d69e-a990-4477-beef-b12ce1c38a0f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:22.477828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6aa8d69e-a990-4477-beef-b12ce1c38a0f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:22.488207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aa8d69e-a990-4477-beef-b12ce1c38a0f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:22.488207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aa8d69e-a990-4477-beef-b12ce1c38a0f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:22.491026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aa8d69e-a990-4477-beef-b12ce1c38a0f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:22.497893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aa8d69e-a990-4477-beef-b12ce1c38a0f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:22.504159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aa8d69e-a990-4477-beef-b12ce1c38a0f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:22.504779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6aa8d69e-a990-4477-beef-b12ce1c38a0f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:22.602934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-53051ce4-6c32-4f67-94cd-fc75ad688c50 tempest-ServicesAdminNegativeV253TestJSON-1225930206 tempest-ServicesAdminNegativeV253TestJSON-1225930206-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:22.605651 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:04:22.605651 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:04:22.608729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-53051ce4-6c32-4f67-94cd-fc75ad688c50 tempest-ServicesAdminNegativeV253TestJSON-1225930206 tempest-ServicesAdminNegativeV253TestJSON-1225930206-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '173312f454b94ee89491d4075400dafe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5dcc42b65964aef952cd73d396002dd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-53051ce4-6c32-4f67-94cd-fc75ad688c50 tempest-ServicesAdminNegativeV253TestJSON-1225930206 tempest-ServicesAdminNegativeV253TestJSON-1225930206-project] Request method failure captured: Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-services HTTP/1.1 Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRaiMgwgw4hfUGXvTWgoslFzw5ArUEBAKYI32xJ6VJSuIxqD93j4LVbpunWkoJxRqoCmegXpGwEkDSRPAE1ujj0fmx7Ev4FU22MLYww7dQd64vlA2YwEb-6EIq_-IiO6U8kV4goCYSjkDXb4nvjFhCUjaGJpz_F2vjMTyQyH9_85bA0 Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.53 Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: c5dcc42b65964aef952cd73d396002dd Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-1225930206 Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c5dcc42b65964aef952cd73d396002dd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c5dcc42b65964aef952cd73d396002dd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c5dcc42b65964aef952cd73d396002dd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c5dcc42b65964aef952cd73d396002dd"}]}] Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-1225930206 Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: c5dcc42b65964aef952cd73d396002dd Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-1225930206 Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServicesAdminNegativeV253TestJSON-1225930206-project Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 173312f454b94ee89491d4075400dafe Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-1225930206-project Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: action_args: {} Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 18:04:22.620675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 23 18:04:22.625815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:22.625815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:22.625815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:22.625815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:22.625815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:22.625815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:22.625815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 18:04:22.625815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 18:04:22.625815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Aug 23 18:04:22.625815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:22.625815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-53051ce4-6c32-4f67-94cd-fc75ad688c50 tempest-ServicesAdminNegativeV253TestJSON-1225930206 tempest-ServicesAdminNegativeV253TestJSON-1225930206-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:22.633067 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-53051ce4-6c32-4f67-94cd-fc75ad688c50 tempest-ServicesAdminNegativeV253TestJSON-1225930206 tempest-ServicesAdminNegativeV253TestJSON-1225930206-project] 10.222.0.61 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.453634 Aug 23 18:04:22.650570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1590/3142] 10.222.0.61 () {60 vars in 1178 bytes} [Tue Aug 23 18:04:22 2022] GET /compute/v2.1/os-services => generated 112 bytes in 472 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:04:22.681432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6aa8d69e-a990-4477-beef-b12ce1c38a0f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:22.694637 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6aa8d69e-a990-4477-beef-b12ce1c38a0f tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1221 microversion: 2.1 time: 0.221977 Aug 23 18:04:22.695559 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1553/3143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:22 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1221 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:23.240489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b206dc88-0996-49ef-854d-612dc5056ec1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:23.241113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b206dc88-0996-49ef-854d-612dc5056ec1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:23.253699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b206dc88-0996-49ef-854d-612dc5056ec1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:23.267930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b206dc88-0996-49ef-854d-612dc5056ec1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:23.282720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b206dc88-0996-49ef-854d-612dc5056ec1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:23.283883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b206dc88-0996-49ef-854d-612dc5056ec1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:23.284599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b206dc88-0996-49ef-854d-612dc5056ec1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:23.285272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b206dc88-0996-49ef-854d-612dc5056ec1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:23.717440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ae2144fc-ba5c-4b0b-9366-21dd7f3dcff8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:23.718838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ae2144fc-ba5c-4b0b-9366-21dd7f3dcff8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:23.735638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae2144fc-ba5c-4b0b-9366-21dd7f3dcff8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:23.737424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae2144fc-ba5c-4b0b-9366-21dd7f3dcff8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:23.738125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae2144fc-ba5c-4b0b-9366-21dd7f3dcff8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:23.740368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae2144fc-ba5c-4b0b-9366-21dd7f3dcff8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:23.744903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae2144fc-ba5c-4b0b-9366-21dd7f3dcff8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:23.746375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae2144fc-ba5c-4b0b-9366-21dd7f3dcff8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:23.890938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ae2144fc-ba5c-4b0b-9366-21dd7f3dcff8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:23.900587 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ae2144fc-ba5c-4b0b-9366-21dd7f3dcff8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1269 microversion: 2.1 time: 0.187810 Aug 23 18:04:23.901864 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1554/3144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:23 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1269 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:23.932560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b206dc88-0996-49ef-854d-612dc5056ec1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:23.948837 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b206dc88-0996-49ef-854d-612dc5056ec1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 0.714007 Aug 23 18:04:23.961765 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1591/3145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:23 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:24.924522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7562b640-d0e6-4573-8295-82fc9d9610c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:24.925261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7562b640-d0e6-4573-8295-82fc9d9610c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:24.949921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7562b640-d0e6-4573-8295-82fc9d9610c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:24.950525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7562b640-d0e6-4573-8295-82fc9d9610c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:24.951015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7562b640-d0e6-4573-8295-82fc9d9610c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:24.958813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7562b640-d0e6-4573-8295-82fc9d9610c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:24.959622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7562b640-d0e6-4573-8295-82fc9d9610c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:24.960277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7562b640-d0e6-4573-8295-82fc9d9610c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:24.973426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6b7d0cbc-d64a-4af9-b56c-277a961f5996 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:24.974729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6b7d0cbc-d64a-4af9-b56c-277a961f5996 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:24.987069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b7d0cbc-d64a-4af9-b56c-277a961f5996 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:24.987578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b7d0cbc-d64a-4af9-b56c-277a961f5996 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:24.988274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b7d0cbc-d64a-4af9-b56c-277a961f5996 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:25.013603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b7d0cbc-d64a-4af9-b56c-277a961f5996 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:25.014188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b7d0cbc-d64a-4af9-b56c-277a961f5996 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:25.014762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b7d0cbc-d64a-4af9-b56c-277a961f5996 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:25.368779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7562b640-d0e6-4573-8295-82fc9d9610c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:25.382860 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7562b640-d0e6-4573-8295-82fc9d9610c0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1275 microversion: 2.1 time: 0.463379 Aug 23 18:04:25.399909 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1555/3146] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:24 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1275 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:25.566698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6b7d0cbc-d64a-4af9-b56c-277a961f5996 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:25.580600 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6b7d0cbc-d64a-4af9-b56c-277a961f5996 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 0.611256 Aug 23 18:04:25.585777 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1592/3147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:24 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:26.410271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9ccaf15d-720d-47c5-9fe1-8e174871d920 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:26.410271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9ccaf15d-720d-47c5-9fe1-8e174871d920 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:26.439008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ccaf15d-720d-47c5-9fe1-8e174871d920 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:26.439651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ccaf15d-720d-47c5-9fe1-8e174871d920 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:26.440122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ccaf15d-720d-47c5-9fe1-8e174871d920 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:26.440902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ccaf15d-720d-47c5-9fe1-8e174871d920 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:26.444287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ccaf15d-720d-47c5-9fe1-8e174871d920 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:26.444799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ccaf15d-720d-47c5-9fe1-8e174871d920 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:26.581409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-73a72fd4-548c-45f2-a4fb-5fdcc00ba251 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] Action: 'create', calling method: .version_select at 0x7f27f1bca040>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:26.646221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-73a72fd4-548c-45f2-a4fb-5fdcc00ba251 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] Getting quotas for project 4c12af7577c24a2f8015ba4396053ea7. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:04:26.677643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9ccaf15d-720d-47c5-9fe1-8e174871d920 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:26.679049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-73a72fd4-548c-45f2-a4fb-5fdcc00ba251 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] Getting quotas for user c64b4267a87a45d0b3e0a1142cc634ef and project 4c12af7577c24a2f8015ba4396053ea7. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:04:26.708574 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9ccaf15d-720d-47c5-9fe1-8e174871d920 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1275 microversion: 2.1 time: 0.303990 Aug 23 18:04:26.710239 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1593/3148] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:26 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1275 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:26.718697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3e04386f-359f-42ed-a69b-8707b50ea5b9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:26.719594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3e04386f-359f-42ed-a69b-8707b50ea5b9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:26.760623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e04386f-359f-42ed-a69b-8707b50ea5b9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:26.771392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e04386f-359f-42ed-a69b-8707b50ea5b9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:26.773324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e04386f-359f-42ed-a69b-8707b50ea5b9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:26.774269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e04386f-359f-42ed-a69b-8707b50ea5b9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:26.776816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e04386f-359f-42ed-a69b-8707b50ea5b9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:26.794129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e04386f-359f-42ed-a69b-8707b50ea5b9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:26.816821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-73a72fd4-548c-45f2-a4fb-5fdcc00ba251 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] Getting quotas for project 4c12af7577c24a2f8015ba4396053ea7. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:04:26.839015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-73a72fd4-548c-45f2-a4fb-5fdcc00ba251 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] Getting quotas for user c64b4267a87a45d0b3e0a1142cc634ef and project 4c12af7577c24a2f8015ba4396053ea7. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:04:26.875514 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-73a72fd4-548c-45f2-a4fb-5fdcc00ba251 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.635261 Aug 23 18:04:26.877636 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1556/3149] 10.222.0.61 () {62 vars in 1214 bytes} [Tue Aug 23 18:04:26 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:04:26.887797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86c08727-f61d-4c68-9cf3-2fbbc68b1664 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:26.931188 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-86c08727-f61d-4c68-9cf3-2fbbc68b1664 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.045266 Aug 23 18:04:26.933457 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1557/3150] 10.222.0.61 () {60 vars in 1193 bytes} [Tue Aug 23 18:04:26 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 18:04:26.947663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bfa8fd6c-b185-440e-bb47-c88c3b3c51f7 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:26.979052 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bfa8fd6c-b185-440e-bb47-c88c3b3c51f7 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d" status: 200 len: 235 microversion: 2.64 time: 0.037654 Aug 23 18:04:26.980782 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1558/3151] 10.222.0.61 () {60 vars in 1304 bytes} [Tue Aug 23 18:04:26 2022] GET /compute/v2.1/os-server-groups/c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d => generated 235 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 23 18:04:26.992625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d438475b-8dc5-4138-8887-68884e3ae407 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:27.056126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:27.069186 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d438475b-8dc5-4138-8887-68884e3ae407 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d" status: 204 len: 0 microversion: 2.64 time: 0.080831 Aug 23 18:04:27.074845 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1559/3152] 10.222.0.61 () {60 vars in 1307 bytes} [Tue Aug 23 18:04:26 2022] DELETE /compute/v2.1/os-server-groups/c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d => generated 0 bytes in 84 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 18:04:27.083663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9e11ad76-8f54-4445-85c4-186ba9e8dd46 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:27.095711 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-9e11ad76-8f54-4445-85c4-186ba9e8dd46 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] HTTP exception thrown: Instance group c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d could not be found. Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9e11ad76-8f54-4445-85c4-186ba9e8dd46 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] Request method failure captured: Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-server-groups/c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d HTTP/1.1 Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRaqYK1z4u-DOmq9-_WKa7jIwMJzrPyyDon8HHMGdOjYsM3X8A3TykVEE8qbR3OYXAHzhrEqSsv1vC-dQ7LvHpCvTpmBOjsxfQx_gfxsY-_5IBUiy2sexYwjDfAwxHhSVfm6LcCFTbDyHFefH-3bB0ax7vU1EPpkzIT0Li7NiU-lE2s Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.64 Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 4c12af7577c24a2f8015ba4396053ea7 Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerGroup264TestJSON-404936195 Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4c12af7577c24a2f8015ba4396053ea7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c12af7577c24a2f8015ba4396053ea7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4c12af7577c24a2f8015ba4396053ea7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4c12af7577c24a2f8015ba4396053ea7"}]}] Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerGroup264TestJSON-404936195 Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 4c12af7577c24a2f8015ba4396053ea7 Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerGroup264TestJSON-404936195 Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerGroup264TestJSON-404936195-project Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: c64b4267a87a45d0b3e0a1142cc634ef Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerGroup264TestJSON-404936195-project Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance group c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d could not be found. Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d'} Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d could not be found. Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d could not be found. Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:27.107314 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:27.112161 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:27.112161 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:27.112161 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:27.112161 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:27.112161 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d could not be found. Aug 23 18:04:27.112161 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:04:27.113981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9e11ad76-8f54-4445-85c4-186ba9e8dd46 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] Returning 404 to user: Instance group c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:27.115298 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9e11ad76-8f54-4445-85c4-186ba9e8dd46 tempest-ServerGroup264TestJSON-404936195 tempest-ServerGroup264TestJSON-404936195-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d" status: 404 len: 117 microversion: 2.64 time: 0.037566 Aug 23 18:04:27.121289 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1560/3153] 10.222.0.61 () {60 vars in 1307 bytes} [Tue Aug 23 18:04:27 2022] DELETE /compute/v2.1/os-server-groups/c083f5f4-fb6d-4dc9-b8e5-ddf786d0565d => generated 117 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:04:27.732607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-261e0253-4d57-49e7-851d-a77fd689d34a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:27.734628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-261e0253-4d57-49e7-851d-a77fd689d34a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:27.746958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-261e0253-4d57-49e7-851d-a77fd689d34a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:27.755494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-261e0253-4d57-49e7-851d-a77fd689d34a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:27.758752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-261e0253-4d57-49e7-851d-a77fd689d34a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:27.760781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-261e0253-4d57-49e7-851d-a77fd689d34a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:27.762940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-261e0253-4d57-49e7-851d-a77fd689d34a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:27.763945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-261e0253-4d57-49e7-851d-a77fd689d34a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:28.195616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-261e0253-4d57-49e7-851d-a77fd689d34a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:28.208773 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-261e0253-4d57-49e7-851d-a77fd689d34a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1317 microversion: 2.1 time: 0.480273 Aug 23 18:04:28.226080 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1561/3154] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:27 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1317 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:28.231514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e04386f-359f-42ed-a69b-8707b50ea5b9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:28.242633 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3e04386f-359f-42ed-a69b-8707b50ea5b9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 1.528985 Aug 23 18:04:28.245173 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1594/3155] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:26 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:29.231856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d403e1e-ca21-47d7-8302-9bca075ef259 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:29.232897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2d403e1e-ca21-47d7-8302-9bca075ef259 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:29.244241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d403e1e-ca21-47d7-8302-9bca075ef259 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:29.248587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d403e1e-ca21-47d7-8302-9bca075ef259 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:29.250463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d403e1e-ca21-47d7-8302-9bca075ef259 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:29.252487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d403e1e-ca21-47d7-8302-9bca075ef259 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:29.252976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d403e1e-ca21-47d7-8302-9bca075ef259 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:29.256079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d403e1e-ca21-47d7-8302-9bca075ef259 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:29.270903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd27beca-5784-44e1-a6fe-6d2146ef03e1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:29.271724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cd27beca-5784-44e1-a6fe-6d2146ef03e1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:29.288340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd27beca-5784-44e1-a6fe-6d2146ef03e1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:29.289938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd27beca-5784-44e1-a6fe-6d2146ef03e1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:29.291860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd27beca-5784-44e1-a6fe-6d2146ef03e1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:29.296982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd27beca-5784-44e1-a6fe-6d2146ef03e1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:29.297529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd27beca-5784-44e1-a6fe-6d2146ef03e1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:29.299338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd27beca-5784-44e1-a6fe-6d2146ef03e1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:30.030870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cd27beca-5784-44e1-a6fe-6d2146ef03e1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:30.046267 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd27beca-5784-44e1-a6fe-6d2146ef03e1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 0.781337 Aug 23 18:04:30.047537 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1595/3156] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:29 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:30.188994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-65ed4423-4104-415e-88d7-a6d15877f585 req-06ab2273-c73d-4338-aca0-000427a524df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "287f8903-5ddc-4430-bf9f-c98b019c7318", "tag": "7852aa18-73bd-44b5-8761-dd8ef62c9525"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:30.209473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-65ed4423-4104-415e-88d7-a6d15877f585 req-06ab2273-c73d-4338-aca0-000427a524df service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:30.210149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-65ed4423-4104-415e-88d7-a6d15877f585 req-06ab2273-c73d-4338-aca0-000427a524df service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:30.210775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-65ed4423-4104-415e-88d7-a6d15877f585 req-06ab2273-c73d-4338-aca0-000427a524df service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:30.231768 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-65ed4423-4104-415e-88d7-a6d15877f585 req-06ab2273-c73d-4338-aca0-000427a524df service nova] Creating event network-changed:7852aa18-73bd-44b5-8761-dd8ef62c9525 for instance 287f8903-5ddc-4430-bf9f-c98b019c7318 on n-h2-850468-16 Aug 23 18:04:30.252427 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-65ed4423-4104-415e-88d7-a6d15877f585 req-06ab2273-c73d-4338-aca0-000427a524df service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068570 Aug 23 18:04:30.253646 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1596/3157] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:04:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:04:30.860049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2d403e1e-ca21-47d7-8302-9bca075ef259 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:30.877708 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2d403e1e-ca21-47d7-8302-9bca075ef259 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1317 microversion: 2.1 time: 1.650795 Aug 23 18:04:30.896624 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1562/3158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:29 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1317 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:31.074700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6cdb688-66e6-435d-9a26-564ff154c499 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:31.077094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6cdb688-66e6-435d-9a26-564ff154c499 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:31.085663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6cdb688-66e6-435d-9a26-564ff154c499 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:31.086507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6cdb688-66e6-435d-9a26-564ff154c499 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:31.087206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6cdb688-66e6-435d-9a26-564ff154c499 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:31.088294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6cdb688-66e6-435d-9a26-564ff154c499 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:31.088961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6cdb688-66e6-435d-9a26-564ff154c499 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:31.089611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6cdb688-66e6-435d-9a26-564ff154c499 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:31.698491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:31.753449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6cdb688-66e6-435d-9a26-564ff154c499 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:31.766229 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6cdb688-66e6-435d-9a26-564ff154c499 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 0.701557 Aug 23 18:04:31.788215 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1597/3159] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:31 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:31.866888 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f7566cdc-3f5d-4b2b-a79d-4c66679988e8 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] 10.222.0.61 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.174253 Aug 23 18:04:31.871907 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1563/3160] 10.222.0.61 () {58 vars in 1128 bytes} [Tue Aug 23 18:04:31 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 18:04:31.878298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dadf2a5c-6931-433b-95c0-8412610e9ab5 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Calling method '.version_select at 0x7f27ec454ca0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:31.900340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93ed2014-d29b-4d0a-8356-5461d7735bad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:31.901006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-93ed2014-d29b-4d0a-8356-5461d7735bad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:31.905882 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-dadf2a5c-6931-433b-95c0-8412610e9ab5 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] HTTP exception thrown: Image not found. Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dadf2a5c-6931-433b-95c0-8412610e9ab5 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Request method failure captured: Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRavceIXLY-Fo4NHr_uOndvoY6I5BQjJFeugfeTA0Hg59TJk75xoo3d1UOfX4e87vbK5Hy_NRomnmPno42uVMFUlVbTQtv0zLWcyG-Niic5V8fMWZPTUVr2Nn69illCb0BPWWGEvMcLzmqv26F8yKkN5KDO-TpMDa4BTWNEu8SZQ-9g Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 761934b56e9e417fbf6c4a33b5e2a146 Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/761934b56e9e417fbf6c4a33b5e2a146"}]}] Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 761934b56e9e417fbf6c4a33b5e2a146 Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesDeleteNegativeTestJSON-80355421-project Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: bdd60bf9575d4423bcf380c97ce94ef3 Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-80355421-project Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '-1'} Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:31.909324 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:04:31.913599 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:31.915845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93ed2014-d29b-4d0a-8356-5461d7735bad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:31.915845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93ed2014-d29b-4d0a-8356-5461d7735bad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:31.917801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dadf2a5c-6931-433b-95c0-8412610e9ab5 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:31.919515 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dadf2a5c-6931-433b-95c0-8412610e9ab5 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] 10.222.0.61 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.045188 Aug 23 18:04:31.920231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93ed2014-d29b-4d0a-8356-5461d7735bad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:31.921194 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1598/3161] 10.222.0.61 () {58 vars in 1134 bytes} [Tue Aug 23 18:04:31 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:04:31.924101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93ed2014-d29b-4d0a-8356-5461d7735bad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:31.925431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93ed2014-d29b-4d0a-8356-5461d7735bad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:31.931279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93ed2014-d29b-4d0a-8356-5461d7735bad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:31.935983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d89c7ff-1afd-4dfb-a82f-6bdf34addb2f tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Calling method '.version_select at 0x7f27ec342dc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:31.998570 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8d89c7ff-1afd-4dfb-a82f-6bdf34addb2f tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] HTTP exception thrown: Image not found. Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d89c7ff-1afd-4dfb-a82f-6bdf34addb2f tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Request method failure captured: Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/images/af5eac7a-3eff-4f83-a32e-2e4d6486f0aj HTTP/1.1 Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRavceIXLY-Fo4NHr_uOndvoY6I5BQjJFeugfeTA0Hg59TJk75xoo3d1UOfX4e87vbK5Hy_NRomnmPno42uVMFUlVbTQtv0zLWcyG-Niic5V8fMWZPTUVr2Nn69illCb0BPWWGEvMcLzmqv26F8yKkN5KDO-TpMDa4BTWNEu8SZQ-9g Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 761934b56e9e417fbf6c4a33b5e2a146 Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/761934b56e9e417fbf6c4a33b5e2a146"}]}] Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 761934b56e9e417fbf6c4a33b5e2a146 Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesDeleteNegativeTestJSON-80355421-project Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: bdd60bf9575d4423bcf380c97ce94ef3 Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-80355421-project Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'af5eac7a-3eff-4f83-a32e-2e4d6486f0aj'} Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image af5eac7a-3eff-4f83-a32e-2e4d6486f0aj to delete Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image af5eac7a-3eff-4f83-a32e-2e4d6486f0aj could not be found. Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:32.000539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d89c7ff-1afd-4dfb-a82f-6bdf34addb2f tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8d89c7ff-1afd-4dfb-a82f-6bdf34addb2f tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] 10.222.0.61 "DELETE /compute/v2.1/images/af5eac7a-3eff-4f83-a32e-2e4d6486f0aj" status: 404 len: 62 microversion: 2.1 time: 0.073922 Aug 23 18:04:32.005164 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1599/3162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:31 2022] DELETE /compute/v2.1/images/af5eac7a-3eff-4f83-a32e-2e4d6486f0aj => generated 62 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:04:32.014733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e911efb0-0214-48e4-9968-6a2cc9944ae1 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Calling method '.version_select at 0x7f27ec454160>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:32.032893 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-e911efb0-0214-48e4-9968-6a2cc9944ae1 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] HTTP exception thrown: Image not found. Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e911efb0-0214-48e4-9968-6a2cc9944ae1 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Request method failure captured: Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/images/e43c5618-0304-4667-a3ee-3db0e319278a1 HTTP/1.1 Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRavceIXLY-Fo4NHr_uOndvoY6I5BQjJFeugfeTA0Hg59TJk75xoo3d1UOfX4e87vbK5Hy_NRomnmPno42uVMFUlVbTQtv0zLWcyG-Niic5V8fMWZPTUVr2Nn69illCb0BPWWGEvMcLzmqv26F8yKkN5KDO-TpMDa4BTWNEu8SZQ-9g Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 761934b56e9e417fbf6c4a33b5e2a146 Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/761934b56e9e417fbf6c4a33b5e2a146"}]}] Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 761934b56e9e417fbf6c4a33b5e2a146 Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesDeleteNegativeTestJSON-80355421-project Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: bdd60bf9575d4423bcf380c97ce94ef3 Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-80355421-project Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'e43c5618-0304-4667-a3ee-3db0e319278a1'} Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e43c5618-0304-4667-a3ee-3db0e319278a1 to delete Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e43c5618-0304-4667-a3ee-3db0e319278a1 could not be found. Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:32.034657 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:04:32.039542 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.041956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e911efb0-0214-48e4-9968-6a2cc9944ae1 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:32.043004 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e911efb0-0214-48e4-9968-6a2cc9944ae1 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] 10.222.0.61 "DELETE /compute/v2.1/images/e43c5618-0304-4667-a3ee-3db0e319278a1" status: 404 len: 62 microversion: 2.1 time: 0.033100 Aug 23 18:04:32.047673 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1600/3163] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:04:32 2022] DELETE /compute/v2.1/images/e43c5618-0304-4667-a3ee-3db0e319278a1 => generated 62 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:04:32.059663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f95b128-5496-41b0-acea-2426297a159d tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Calling method '.version_select at 0x7f27ec82d8b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:32.106316 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-4f95b128-5496-41b0-acea-2426297a159d tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] HTTP exception thrown: Image not found. Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f95b128-5496-41b0-acea-2426297a159d tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Request method failure captured: Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/images/tempest-invalid-1141263052 HTTP/1.1 Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRavceIXLY-Fo4NHr_uOndvoY6I5BQjJFeugfeTA0Hg59TJk75xoo3d1UOfX4e87vbK5Hy_NRomnmPno42uVMFUlVbTQtv0zLWcyG-Niic5V8fMWZPTUVr2Nn69illCb0BPWWGEvMcLzmqv26F8yKkN5KDO-TpMDa4BTWNEu8SZQ-9g Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 761934b56e9e417fbf6c4a33b5e2a146 Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/761934b56e9e417fbf6c4a33b5e2a146"}]}] Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 761934b56e9e417fbf6c4a33b5e2a146 Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesDeleteNegativeTestJSON-80355421-project Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: bdd60bf9575d4423bcf380c97ce94ef3 Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-80355421-project Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'tempest-invalid-1141263052'} Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-1141263052 to delete Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-1141263052 could not be found. Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.109428 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:04:32.114505 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.118708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f95b128-5496-41b0-acea-2426297a159d tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:32.118708 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4f95b128-5496-41b0-acea-2426297a159d tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] 10.222.0.61 "DELETE /compute/v2.1/images/tempest-invalid-1141263052" status: 404 len: 62 microversion: 2.1 time: 0.063545 Aug 23 18:04:32.118708 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1601/3164] 10.222.0.61 () {58 vars in 1206 bytes} [Tue Aug 23 18:04:32 2022] DELETE /compute/v2.1/images/tempest-invalid-1141263052 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 18:04:32.128089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=18 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:32.132891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b4702b8-a1cc-47d9-a68a-a25717adc477 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Calling method '.version_select at 0x7f27ec3298b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:32.176140 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-3b4702b8-a1cc-47d9-a68a-a25717adc477 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] HTTP exception thrown: Image not found. Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b4702b8-a1cc-47d9-a68a-a25717adc477 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Request method failure captured: Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/images/5a83d690-eb3e-4938-b5a5-8a767f951b1b HTTP/1.1 Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRavceIXLY-Fo4NHr_uOndvoY6I5BQjJFeugfeTA0Hg59TJk75xoo3d1UOfX4e87vbK5Hy_NRomnmPno42uVMFUlVbTQtv0zLWcyG-Niic5V8fMWZPTUVr2Nn69illCb0BPWWGEvMcLzmqv26F8yKkN5KDO-TpMDa4BTWNEu8SZQ-9g Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 761934b56e9e417fbf6c4a33b5e2a146 Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/761934b56e9e417fbf6c4a33b5e2a146"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/761934b56e9e417fbf6c4a33b5e2a146"}]}] Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 761934b56e9e417fbf6c4a33b5e2a146 Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-80355421 Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesDeleteNegativeTestJSON-80355421-project Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: bdd60bf9575d4423bcf380c97ce94ef3 Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-80355421-project Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '5a83d690-eb3e-4938-b5a5-8a767f951b1b'} Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 5a83d690-eb3e-4938-b5a5-8a767f951b1b to delete Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 5a83d690-eb3e-4938-b5a5-8a767f951b1b could not be found. Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:32.178082 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b4702b8-a1cc-47d9-a68a-a25717adc477 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3b4702b8-a1cc-47d9-a68a-a25717adc477 tempest-ImagesDeleteNegativeTestJSON-80355421 tempest-ImagesDeleteNegativeTestJSON-80355421-project] 10.222.0.61 "DELETE /compute/v2.1/images/5a83d690-eb3e-4938-b5a5-8a767f951b1b" status: 404 len: 62 microversion: 2.1 time: 0.053213 Aug 23 18:04:32.184412 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1602/3165] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:32 2022] DELETE /compute/v2.1/images/5a83d690-eb3e-4938-b5a5-8a767f951b1b => generated 62 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 18:04:32.407842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-93ed2014-d29b-4d0a-8356-5461d7735bad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:32.429644 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93ed2014-d29b-4d0a-8356-5461d7735bad tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1317 microversion: 2.1 time: 0.533750 Aug 23 18:04:32.430911 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1564/3166] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:31 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1317 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:32.796281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7fec9084-8a6b-49d5-be8e-b1750a5f77d0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:32.798627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7fec9084-8a6b-49d5-be8e-b1750a5f77d0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:32.815235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fec9084-8a6b-49d5-be8e-b1750a5f77d0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:32.817681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fec9084-8a6b-49d5-be8e-b1750a5f77d0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:32.818243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fec9084-8a6b-49d5-be8e-b1750a5f77d0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:32.820068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fec9084-8a6b-49d5-be8e-b1750a5f77d0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:32.822067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fec9084-8a6b-49d5-be8e-b1750a5f77d0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:32.824753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fec9084-8a6b-49d5-be8e-b1750a5f77d0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:32.837109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:33.271255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7fec9084-8a6b-49d5-be8e-b1750a5f77d0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:33.281587 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7fec9084-8a6b-49d5-be8e-b1750a5f77d0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 0.490938 Aug 23 18:04:33.282241 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1603/3167] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:32 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:33.460682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-79daf690-aba4-4fb5-a368-75a13e7be757 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:33.464349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-79daf690-aba4-4fb5-a368-75a13e7be757 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:33.480427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79daf690-aba4-4fb5-a368-75a13e7be757 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:33.483143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79daf690-aba4-4fb5-a368-75a13e7be757 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:33.486908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79daf690-aba4-4fb5-a368-75a13e7be757 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:33.487963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79daf690-aba4-4fb5-a368-75a13e7be757 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:33.488642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79daf690-aba4-4fb5-a368-75a13e7be757 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:33.489132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79daf690-aba4-4fb5-a368-75a13e7be757 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:34.074800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-79daf690-aba4-4fb5-a368-75a13e7be757 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:34.088847 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-79daf690-aba4-4fb5-a368-75a13e7be757 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1317 microversion: 2.1 time: 0.637217 Aug 23 18:04:34.089971 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1565/3168] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:33 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1317 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:34.304875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-46b2b2cd-ffb2-4988-aca1-51ca04775d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:34.305643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-46b2b2cd-ffb2-4988-aca1-51ca04775d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:34.325852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46b2b2cd-ffb2-4988-aca1-51ca04775d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:34.326724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46b2b2cd-ffb2-4988-aca1-51ca04775d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:34.327433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46b2b2cd-ffb2-4988-aca1-51ca04775d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:34.328689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46b2b2cd-ffb2-4988-aca1-51ca04775d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:34.329506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46b2b2cd-ffb2-4988-aca1-51ca04775d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:34.330277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46b2b2cd-ffb2-4988-aca1-51ca04775d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:34.835569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-46b2b2cd-ffb2-4988-aca1-51ca04775d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:34.860621 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-46b2b2cd-ffb2-4988-aca1-51ca04775d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 0.558399 Aug 23 18:04:34.889711 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1604/3169] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:34 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:35.112236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa48dda1-c95b-4612-accc-d3f642602a2a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:35.112715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fa48dda1-c95b-4612-accc-d3f642602a2a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:35.125341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa48dda1-c95b-4612-accc-d3f642602a2a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:35.125895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa48dda1-c95b-4612-accc-d3f642602a2a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:35.126339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa48dda1-c95b-4612-accc-d3f642602a2a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:35.127162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa48dda1-c95b-4612-accc-d3f642602a2a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:35.127606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa48dda1-c95b-4612-accc-d3f642602a2a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:35.128107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa48dda1-c95b-4612-accc-d3f642602a2a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:35.404807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fa48dda1-c95b-4612-accc-d3f642602a2a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:35.416331 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fa48dda1-c95b-4612-accc-d3f642602a2a tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1317 microversion: 2.1 time: 0.306557 Aug 23 18:04:35.430117 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1566/3170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:35 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:35.899689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcdc0d13-66e7-4ef3-b114-7b7799bd1876 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:35.900222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fcdc0d13-66e7-4ef3-b114-7b7799bd1876 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:35.918201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcdc0d13-66e7-4ef3-b114-7b7799bd1876 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:35.923077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcdc0d13-66e7-4ef3-b114-7b7799bd1876 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:35.923991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcdc0d13-66e7-4ef3-b114-7b7799bd1876 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:35.927919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcdc0d13-66e7-4ef3-b114-7b7799bd1876 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:35.929690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcdc0d13-66e7-4ef3-b114-7b7799bd1876 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:35.932648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcdc0d13-66e7-4ef3-b114-7b7799bd1876 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:36.438826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-311f8161-e3b6-4176-b67f-ca27702d5d63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:36.440030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-311f8161-e3b6-4176-b67f-ca27702d5d63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:36.459386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-311f8161-e3b6-4176-b67f-ca27702d5d63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:36.459921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-311f8161-e3b6-4176-b67f-ca27702d5d63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:36.460361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-311f8161-e3b6-4176-b67f-ca27702d5d63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:36.467221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-311f8161-e3b6-4176-b67f-ca27702d5d63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:36.476919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-311f8161-e3b6-4176-b67f-ca27702d5d63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:36.482418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-311f8161-e3b6-4176-b67f-ca27702d5d63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:36.859551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=16 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:36.905432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fcdc0d13-66e7-4ef3-b114-7b7799bd1876 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:36.927442 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fcdc0d13-66e7-4ef3-b114-7b7799bd1876 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 1.034360 Aug 23 18:04:36.931609 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1605/3171] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:35 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:37.113495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-311f8161-e3b6-4176-b67f-ca27702d5d63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:37.123542 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-311f8161-e3b6-4176-b67f-ca27702d5d63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1317 microversion: 2.1 time: 0.688584 Aug 23 18:04:37.129483 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1567/3172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:36 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1317 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:37.433198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-906516487", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:37.488590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:37.603082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:04:37.959997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4bfa6682-45f8-4e0d-b824-97ed6a3b480f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:37.960625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4bfa6682-45f8-4e0d-b824-97ed6a3b480f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:37.983442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bfa6682-45f8-4e0d-b824-97ed6a3b480f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:37.985711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bfa6682-45f8-4e0d-b824-97ed6a3b480f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:37.986375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bfa6682-45f8-4e0d-b824-97ed6a3b480f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:37.991888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bfa6682-45f8-4e0d-b824-97ed6a3b480f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:37.992623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bfa6682-45f8-4e0d-b824-97ed6a3b480f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:37.993239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bfa6682-45f8-4e0d-b824-97ed6a3b480f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:38.552284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:04:38.553492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:04:38.554218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:04:38.555574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:04:38.556181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:04:38.566963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:38.574063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:38.576282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:38.581908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:38.582473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:38.585963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:38.620664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Getting quotas for project 13bee7ab4bce40a6a01424dc7a620320. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:04:38.629256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Getting quotas for user 288ed685c4de46349aa9f7fc95951bfb and project 13bee7ab4bce40a6a01424dc7a620320. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:04:38.651632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:04:38.656010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:04:38.793243 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-12783ee8-1622-40e0-9500-fd00e48dfa79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.702813 Aug 23 18:04:38.800665 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1606/3173] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:04:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:04:38.813340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0aed404b-2372-435e-807d-7ea2cd112e3d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:38.814353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0aed404b-2372-435e-807d-7ea2cd112e3d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:38.836605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aed404b-2372-435e-807d-7ea2cd112e3d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:38.837987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aed404b-2372-435e-807d-7ea2cd112e3d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:38.838718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aed404b-2372-435e-807d-7ea2cd112e3d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:38.843418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aed404b-2372-435e-807d-7ea2cd112e3d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:38.845020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aed404b-2372-435e-807d-7ea2cd112e3d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:38.849193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aed404b-2372-435e-807d-7ea2cd112e3d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:39.169136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4bfa6682-45f8-4e0d-b824-97ed6a3b480f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:39.173972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:39.195508 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4bfa6682-45f8-4e0d-b824-97ed6a3b480f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1512 microversion: 2.1 time: 1.233158 Aug 23 18:04:39.204195 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1568/3174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:37 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1512 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:39.223436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0aed404b-2372-435e-807d-7ea2cd112e3d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:39.232746 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0aed404b-2372-435e-807d-7ea2cd112e3d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1317 microversion: 2.1 time: 0.429812 Aug 23 18:04:39.240204 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1607/3175] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:38 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1317 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:39.240685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eecc9656-2cd8-4f50-ae45-8ba392d59d1e tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:39.243241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eecc9656-2cd8-4f50-ae45-8ba392d59d1e tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:39.426990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eecc9656-2cd8-4f50-ae45-8ba392d59d1e tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:39.437632 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eecc9656-2cd8-4f50-ae45-8ba392d59d1e tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1216 microversion: 2.1 time: 0.226387 Aug 23 18:04:39.438275 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1569/3176] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:39 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1216 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:40.229453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-75a9764c-af5e-487d-a41c-42ca7589a48c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:40.230085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-75a9764c-af5e-487d-a41c-42ca7589a48c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:40.245688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75a9764c-af5e-487d-a41c-42ca7589a48c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:40.246880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75a9764c-af5e-487d-a41c-42ca7589a48c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:40.247286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75a9764c-af5e-487d-a41c-42ca7589a48c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:40.249183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75a9764c-af5e-487d-a41c-42ca7589a48c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:40.251517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75a9764c-af5e-487d-a41c-42ca7589a48c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:40.252137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75a9764c-af5e-487d-a41c-42ca7589a48c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:40.259910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9b02196d-fc32-4931-9359-568d2167bf46 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:40.261165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9b02196d-fc32-4931-9359-568d2167bf46 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:40.283717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b02196d-fc32-4931-9359-568d2167bf46 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:40.284840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b02196d-fc32-4931-9359-568d2167bf46 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:40.285461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b02196d-fc32-4931-9359-568d2167bf46 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:40.286585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b02196d-fc32-4931-9359-568d2167bf46 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:40.290885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b02196d-fc32-4931-9359-568d2167bf46 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:40.290885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b02196d-fc32-4931-9359-568d2167bf46 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:40.832607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9b02196d-fc32-4931-9359-568d2167bf46 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:40.845738 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9b02196d-fc32-4931-9359-568d2167bf46 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1317 microversion: 2.1 time: 0.588259 Aug 23 18:04:40.848881 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1570/3177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:40 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1317 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:40.858080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-55abae9e-292e-4c25-a2be-fbc1ee0e5e92 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:40.860797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-75a9764c-af5e-487d-a41c-42ca7589a48c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:40.864723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-55abae9e-292e-4c25-a2be-fbc1ee0e5e92 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:40.888884 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-75a9764c-af5e-487d-a41c-42ca7589a48c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1489 microversion: 2.1 time: 0.662802 Aug 23 18:04:40.900272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55abae9e-292e-4c25-a2be-fbc1ee0e5e92 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:40.904031 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1608/3178] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:40 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1489 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:40.904271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55abae9e-292e-4c25-a2be-fbc1ee0e5e92 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:40.905778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55abae9e-292e-4c25-a2be-fbc1ee0e5e92 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:40.912509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55abae9e-292e-4c25-a2be-fbc1ee0e5e92 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:40.913167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55abae9e-292e-4c25-a2be-fbc1ee0e5e92 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:40.914254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-2ba68c7e-fa59-4148-9712-8c611772f535 req-becfe461-2557-447f-8183-7069d62db453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287f8903-5ddc-4430-bf9f-c98b019c7318", "name": "network-vif-plugged", "status": "completed", "tag": "7852aa18-73bd-44b5-8761-dd8ef62c9525"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:40.914678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55abae9e-292e-4c25-a2be-fbc1ee0e5e92 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:40.937796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2ba68c7e-fa59-4148-9712-8c611772f535 req-becfe461-2557-447f-8183-7069d62db453 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:40.938818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2ba68c7e-fa59-4148-9712-8c611772f535 req-becfe461-2557-447f-8183-7069d62db453 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:40.939621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2ba68c7e-fa59-4148-9712-8c611772f535 req-becfe461-2557-447f-8183-7069d62db453 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:40.959030 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-2ba68c7e-fa59-4148-9712-8c611772f535 req-becfe461-2557-447f-8183-7069d62db453 service nova] Creating event network-vif-plugged:7852aa18-73bd-44b5-8761-dd8ef62c9525 for instance 287f8903-5ddc-4430-bf9f-c98b019c7318 on n-h2-850468-16 Aug 23 18:04:40.972728 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-2ba68c7e-fa59-4148-9712-8c611772f535 req-becfe461-2557-447f-8183-7069d62db453 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067168 Aug 23 18:04:40.973979 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1609/3179] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:40.982765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-600481f2-d273-4854-ae7b-9904e2f394db tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:40.988435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-600481f2-d273-4854-ae7b-9904e2f394db tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:40.996084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-600481f2-d273-4854-ae7b-9904e2f394db tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:40.997857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-600481f2-d273-4854-ae7b-9904e2f394db tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:40.998500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-600481f2-d273-4854-ae7b-9904e2f394db tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:40.999396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-600481f2-d273-4854-ae7b-9904e2f394db tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:41.000016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-600481f2-d273-4854-ae7b-9904e2f394db tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:41.000624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-600481f2-d273-4854-ae7b-9904e2f394db tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:41.082316 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-600481f2-d273-4854-ae7b-9904e2f394db tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 200 len: 162 microversion: 2.1 time: 0.106133 Aug 23 18:04:41.083529 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1610/3180] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:04:40 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 162 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:41.103975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a1c2c4fa-602e-45a3-88b3-b0ea441c9ae6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:41.104770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a1c2c4fa-602e-45a3-88b3-b0ea441c9ae6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:41.117868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1c2c4fa-602e-45a3-88b3-b0ea441c9ae6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:41.117868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1c2c4fa-602e-45a3-88b3-b0ea441c9ae6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:41.117868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1c2c4fa-602e-45a3-88b3-b0ea441c9ae6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:41.117868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1c2c4fa-602e-45a3-88b3-b0ea441c9ae6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:41.118354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1c2c4fa-602e-45a3-88b3-b0ea441c9ae6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:41.118841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1c2c4fa-602e-45a3-88b3-b0ea441c9ae6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:41.245605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-55abae9e-292e-4c25-a2be-fbc1ee0e5e92 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:41.254318 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-55abae9e-292e-4c25-a2be-fbc1ee0e5e92 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1268 microversion: 2.1 time: 0.403565 Aug 23 18:04:41.262041 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1571/3181] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:40 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1268 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:41.873525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ccc4da8e-d47e-4982-b973-f883463a4fba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:41.874358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ccc4da8e-d47e-4982-b973-f883463a4fba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:41.896085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc4da8e-d47e-4982-b973-f883463a4fba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:41.898084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc4da8e-d47e-4982-b973-f883463a4fba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:41.901905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc4da8e-d47e-4982-b973-f883463a4fba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:41.904291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc4da8e-d47e-4982-b973-f883463a4fba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:41.906203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc4da8e-d47e-4982-b973-f883463a4fba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:41.909253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc4da8e-d47e-4982-b973-f883463a4fba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:42.036543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a1c2c4fa-602e-45a3-88b3-b0ea441c9ae6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:42.049864 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a1c2c4fa-602e-45a3-88b3-b0ea441c9ae6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.960034 Aug 23 18:04:42.051708 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1611/3182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:41 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:42.101219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c390070e-ccb3-4bd0-aaa5-4a5d6fe7a880 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:42.108816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c390070e-ccb3-4bd0-aaa5-4a5d6fe7a880 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:42.138884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c390070e-ccb3-4bd0-aaa5-4a5d6fe7a880 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:42.140097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c390070e-ccb3-4bd0-aaa5-4a5d6fe7a880 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:42.144762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c390070e-ccb3-4bd0-aaa5-4a5d6fe7a880 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:42.147747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c390070e-ccb3-4bd0-aaa5-4a5d6fe7a880 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:42.150798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c390070e-ccb3-4bd0-aaa5-4a5d6fe7a880 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:42.150798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c390070e-ccb3-4bd0-aaa5-4a5d6fe7a880 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:42.417391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ccc4da8e-d47e-4982-b973-f883463a4fba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:42.446241 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ccc4da8e-d47e-4982-b973-f883463a4fba tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1317 microversion: 2.1 time: 0.564265 Aug 23 18:04:42.448747 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1572/3183] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:41 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1317 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:42.461804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86242fb8-7ca0-4897-9800-4d7920333494 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:42.465035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-86242fb8-7ca0-4897-9800-4d7920333494 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:42.485468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86242fb8-7ca0-4897-9800-4d7920333494 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:42.487889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86242fb8-7ca0-4897-9800-4d7920333494 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:42.491234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86242fb8-7ca0-4897-9800-4d7920333494 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:42.492643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86242fb8-7ca0-4897-9800-4d7920333494 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:42.494907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86242fb8-7ca0-4897-9800-4d7920333494 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:42.495833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86242fb8-7ca0-4897-9800-4d7920333494 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:42.643753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c390070e-ccb3-4bd0-aaa5-4a5d6fe7a880 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:42.657358 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c390070e-ccb3-4bd0-aaa5-4a5d6fe7a880 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.581168 Aug 23 18:04:42.661119 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1612/3184] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:42 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:42.662917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-86242fb8-7ca0-4897-9800-4d7920333494 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:42.685281 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-86242fb8-7ca0-4897-9800-4d7920333494 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1274 microversion: 2.1 time: 0.235151 Aug 23 18:04:42.686403 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1573/3185] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:42 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1274 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:42.692567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-26a19efa-5ae3-4a8e-bce9-d9bcf198a45a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:42.693753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-26a19efa-5ae3-4a8e-bce9-d9bcf198a45a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:42.721301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26a19efa-5ae3-4a8e-bce9-d9bcf198a45a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:42.727647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26a19efa-5ae3-4a8e-bce9-d9bcf198a45a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:42.728229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26a19efa-5ae3-4a8e-bce9-d9bcf198a45a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:42.729818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26a19efa-5ae3-4a8e-bce9-d9bcf198a45a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:42.730310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26a19efa-5ae3-4a8e-bce9-d9bcf198a45a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:42.730816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26a19efa-5ae3-4a8e-bce9-d9bcf198a45a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:43.413009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-26a19efa-5ae3-4a8e-bce9-d9bcf198a45a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:43.432899 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-26a19efa-5ae3-4a8e-bce9-d9bcf198a45a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.748776 Aug 23 18:04:43.440974 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1613/3186] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:42 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:43.482268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ab53da8a-4639-4f5b-82f8-2d3e8debe67f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:43.483162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ab53da8a-4639-4f5b-82f8-2d3e8debe67f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:43.498390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a8621e79-77d6-4052-80aa-ff862175cdcd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:43.500413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a8621e79-77d6-4052-80aa-ff862175cdcd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:43.519637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab53da8a-4639-4f5b-82f8-2d3e8debe67f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:43.525844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab53da8a-4639-4f5b-82f8-2d3e8debe67f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:43.526518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab53da8a-4639-4f5b-82f8-2d3e8debe67f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:43.530743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8621e79-77d6-4052-80aa-ff862175cdcd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:43.531535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8621e79-77d6-4052-80aa-ff862175cdcd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:43.532241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8621e79-77d6-4052-80aa-ff862175cdcd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:43.532768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab53da8a-4639-4f5b-82f8-2d3e8debe67f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:43.533978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8621e79-77d6-4052-80aa-ff862175cdcd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:43.536367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab53da8a-4639-4f5b-82f8-2d3e8debe67f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:43.536823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8621e79-77d6-4052-80aa-ff862175cdcd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:43.536969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab53da8a-4639-4f5b-82f8-2d3e8debe67f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:43.537573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8621e79-77d6-4052-80aa-ff862175cdcd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:44.011806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a8621e79-77d6-4052-80aa-ff862175cdcd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:44.037781 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a8621e79-77d6-4052-80aa-ff862175cdcd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1317 microversion: 2.1 time: 0.557856 Aug 23 18:04:44.038977 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1614/3187] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:43 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1317 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:44.054990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6fc8f349-6d17-4a28-a4eb-023d6cf91e11 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:44.055925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6fc8f349-6d17-4a28-a4eb-023d6cf91e11 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:44.069317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fc8f349-6d17-4a28-a4eb-023d6cf91e11 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:44.069821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fc8f349-6d17-4a28-a4eb-023d6cf91e11 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:44.071876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fc8f349-6d17-4a28-a4eb-023d6cf91e11 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:44.073347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fc8f349-6d17-4a28-a4eb-023d6cf91e11 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:44.076191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fc8f349-6d17-4a28-a4eb-023d6cf91e11 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:44.077542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fc8f349-6d17-4a28-a4eb-023d6cf91e11 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:44.266053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6fc8f349-6d17-4a28-a4eb-023d6cf91e11 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:44.286023 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6fc8f349-6d17-4a28-a4eb-023d6cf91e11 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1274 microversion: 2.1 time: 0.243316 Aug 23 18:04:44.286671 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1615/3188] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:44 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1274 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:44.686825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ab53da8a-4639-4f5b-82f8-2d3e8debe67f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:44.705126 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ab53da8a-4639-4f5b-82f8-2d3e8debe67f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 1.237574 Aug 23 18:04:44.707616 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1574/3189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:43 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 1246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:45.058639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-834610093", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "ab5199d4-2532-451f-9ad2-38d9c898fa71"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:45.063691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fdf9d579-891b-4358-b714-4b5f88f4e9d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:45.065927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fdf9d579-891b-4358-b714-4b5f88f4e9d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:45.093135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdf9d579-891b-4358-b714-4b5f88f4e9d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:45.094309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdf9d579-891b-4358-b714-4b5f88f4e9d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:45.095874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdf9d579-891b-4358-b714-4b5f88f4e9d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:45.100749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdf9d579-891b-4358-b714-4b5f88f4e9d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:45.101704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdf9d579-891b-4358-b714-4b5f88f4e9d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:45.103796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdf9d579-891b-4358-b714-4b5f88f4e9d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:45.209063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] validate_networks() for [('ab5199d4-2532-451f-9ad2-38d9c898fa71', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:04:45.881598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fdf9d579-891b-4358-b714-4b5f88f4e9d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:45.892050 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fdf9d579-891b-4358-b714-4b5f88f4e9d2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1466 microversion: 2.1 time: 0.834814 Aug 23 18:04:45.912089 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1575/3190] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:45 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1466 bytes in 855 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:45.921293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b8ae1fa7-d48d-4558-a9d9-17f39a676184 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:45.932394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b8ae1fa7-d48d-4558-a9d9-17f39a676184 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:45.943899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8ae1fa7-d48d-4558-a9d9-17f39a676184 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:45.955464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8ae1fa7-d48d-4558-a9d9-17f39a676184 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:45.956292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8ae1fa7-d48d-4558-a9d9-17f39a676184 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:45.957292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8ae1fa7-d48d-4558-a9d9-17f39a676184 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:45.957980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8ae1fa7-d48d-4558-a9d9-17f39a676184 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:45.958716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8ae1fa7-d48d-4558-a9d9-17f39a676184 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:46.757505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:04:46.758532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:04:46.760315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:04:46.761299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:04:46.761886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:04:46.785223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:46.790487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:46.791677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:46.792978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:46.793652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:46.794366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:46.822925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Getting quotas for project ed54655c5a6442d680ee1cb81021ddd2. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:04:46.831903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Getting quotas for user 11cb3b659afa416bb3371795600189fb and project ed54655c5a6442d680ee1cb81021ddd2. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:04:46.858182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:04:46.861622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:04:46.958310 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-99f53858-8e4d-4c35-a229-2584b14877e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.905694 Aug 23 18:04:46.964068 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1616/3191] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:04:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1912 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:04:46.977172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a0c0898a-21a3-4a9c-b415-fc41f0e28e60 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:46.978735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a0c0898a-21a3-4a9c-b415-fc41f0e28e60 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:46.993035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0c0898a-21a3-4a9c-b415-fc41f0e28e60 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:46.993941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0c0898a-21a3-4a9c-b415-fc41f0e28e60 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:46.994941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0c0898a-21a3-4a9c-b415-fc41f0e28e60 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:47.012571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0c0898a-21a3-4a9c-b415-fc41f0e28e60 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:47.013590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0c0898a-21a3-4a9c-b415-fc41f0e28e60 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:47.017163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0c0898a-21a3-4a9c-b415-fc41f0e28e60 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:47.417371 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a0c0898a-21a3-4a9c-b415-fc41f0e28e60 tempest-ServersOnMultiNodesTest-1659180113 tempest-ServersOnMultiNodesTest-1659180113-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1619 microversion: 2.1 time: 0.451850 Aug 23 18:04:47.417954 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1617/3192] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:46 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1619 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:47.433835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cb2e3e61-bf60-4f2f-87f7-b93df63c68ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:47.433835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cb2e3e61-bf60-4f2f-87f7-b93df63c68ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:47.511910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cb2e3e61-bf60-4f2f-87f7-b93df63c68ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:47.524364 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cb2e3e61-bf60-4f2f-87f7-b93df63c68ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1214 microversion: 2.1 time: 0.103132 Aug 23 18:04:47.525362 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1618/3193] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:47 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1214 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:47.534625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b977295c-3605-4b72-a2dc-77003c7322dd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:47.535313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b977295c-3605-4b72-a2dc-77003c7322dd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:47.553591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b977295c-3605-4b72-a2dc-77003c7322dd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:47.555680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b977295c-3605-4b72-a2dc-77003c7322dd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:47.556702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b977295c-3605-4b72-a2dc-77003c7322dd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:47.559858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b977295c-3605-4b72-a2dc-77003c7322dd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:47.562691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b977295c-3605-4b72-a2dc-77003c7322dd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:47.563358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b977295c-3605-4b72-a2dc-77003c7322dd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:47.649145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b977295c-3605-4b72-a2dc-77003c7322dd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:04:47.836991 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b977295c-3605-4b72-a2dc-77003c7322dd tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "DELETE /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 204 len: 0 microversion: 2.1 time: 0.306197 Aug 23 18:04:47.838333 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1619/3194] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:04:47 2022] DELETE /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:04:47.847968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d59f35c3-5c9a-41e6-bd4c-6cb5a22083d9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:47.848922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d59f35c3-5c9a-41e6-bd4c-6cb5a22083d9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:47.860452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59f35c3-5c9a-41e6-bd4c-6cb5a22083d9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:47.861153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59f35c3-5c9a-41e6-bd4c-6cb5a22083d9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:47.862426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59f35c3-5c9a-41e6-bd4c-6cb5a22083d9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:47.867562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b8ae1fa7-d48d-4558-a9d9-17f39a676184 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:47.873328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59f35c3-5c9a-41e6-bd4c-6cb5a22083d9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:47.876327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59f35c3-5c9a-41e6-bd4c-6cb5a22083d9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:47.880541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59f35c3-5c9a-41e6-bd4c-6cb5a22083d9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:47.883039 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b8ae1fa7-d48d-4558-a9d9-17f39a676184 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1316 microversion: 2.1 time: 1.967876 Aug 23 18:04:47.884307 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1576/3195] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:45 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1316 bytes in 1971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:48.555337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-232a586f-e087-4af0-b046-c4fbca2c222f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:48.556392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-232a586f-e087-4af0-b046-c4fbca2c222f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:48.570371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-232a586f-e087-4af0-b046-c4fbca2c222f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:48.571864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-232a586f-e087-4af0-b046-c4fbca2c222f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:48.574386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-232a586f-e087-4af0-b046-c4fbca2c222f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:48.576567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-232a586f-e087-4af0-b046-c4fbca2c222f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:48.577738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-232a586f-e087-4af0-b046-c4fbca2c222f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:48.578848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-232a586f-e087-4af0-b046-c4fbca2c222f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:48.789163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-232a586f-e087-4af0-b046-c4fbca2c222f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:48.809519 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-232a586f-e087-4af0-b046-c4fbca2c222f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1266 microversion: 2.1 time: 0.266811 Aug 23 18:04:48.811271 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1577/3196] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:48 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:48.827996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-c686e33a-181e-45d4-bc4f-79d28389674a req-67c23253-01d4-419e-8679-6967f89c2969 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a2f8a54-72ff-43c4-a31e-76b29723e3e1", "tag": "d48d38dd-3b1f-4db9-957e-46b040401b51"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:48.874833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c686e33a-181e-45d4-bc4f-79d28389674a req-67c23253-01d4-419e-8679-6967f89c2969 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:48.879188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c686e33a-181e-45d4-bc4f-79d28389674a req-67c23253-01d4-419e-8679-6967f89c2969 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:48.879859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c686e33a-181e-45d4-bc4f-79d28389674a req-67c23253-01d4-419e-8679-6967f89c2969 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:48.918108 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-c686e33a-181e-45d4-bc4f-79d28389674a req-67c23253-01d4-419e-8679-6967f89c2969 service nova] Creating event network-changed:d48d38dd-3b1f-4db9-957e-46b040401b51 for instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 on n-h2-850468-16 Aug 23 18:04:48.936685 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-c686e33a-181e-45d4-bc4f-79d28389674a req-67c23253-01d4-419e-8679-6967f89c2969 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118339 Aug 23 18:04:48.941590 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1578/3197] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:48.962478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bbcbf5c5-8467-4f89-9998-76fd079bef28 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:48.963611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bbcbf5c5-8467-4f89-9998-76fd079bef28 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:48.975523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbcbf5c5-8467-4f89-9998-76fd079bef28 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:48.977491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbcbf5c5-8467-4f89-9998-76fd079bef28 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:48.983627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbcbf5c5-8467-4f89-9998-76fd079bef28 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:48.985324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbcbf5c5-8467-4f89-9998-76fd079bef28 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:48.988151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbcbf5c5-8467-4f89-9998-76fd079bef28 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:48.991410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbcbf5c5-8467-4f89-9998-76fd079bef28 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:49.349897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bbcbf5c5-8467-4f89-9998-76fd079bef28 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:49.364556 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bbcbf5c5-8467-4f89-9998-76fd079bef28 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1316 microversion: 2.1 time: 0.420621 Aug 23 18:04:49.377889 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1579/3198] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:48 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1316 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:49.835724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bec62d6b-3623-47dc-b01e-f6741b3137ad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:49.836859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bec62d6b-3623-47dc-b01e-f6741b3137ad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:49.839649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:49.872236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bec62d6b-3623-47dc-b01e-f6741b3137ad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:49.879774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bec62d6b-3623-47dc-b01e-f6741b3137ad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:49.882812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bec62d6b-3623-47dc-b01e-f6741b3137ad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:49.886715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bec62d6b-3623-47dc-b01e-f6741b3137ad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:49.889172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bec62d6b-3623-47dc-b01e-f6741b3137ad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:49.893697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bec62d6b-3623-47dc-b01e-f6741b3137ad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:50.151444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bec62d6b-3623-47dc-b01e-f6741b3137ad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:50.178862 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bec62d6b-3623-47dc-b01e-f6741b3137ad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1272 microversion: 2.1 time: 0.348680 Aug 23 18:04:50.193443 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1580/3199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:49 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1272 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:50.228580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d59f35c3-5c9a-41e6-bd4c-6cb5a22083d9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:50.241953 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d59f35c3-5c9a-41e6-bd4c-6cb5a22083d9 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1472 microversion: 2.1 time: 2.398425 Aug 23 18:04:50.243176 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1620/3200] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:47 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1472 bytes in 2400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:50.385774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-17c74989-a8b5-42fc-be70-28d1fb0c710d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:50.386674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-17c74989-a8b5-42fc-be70-28d1fb0c710d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:50.408988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17c74989-a8b5-42fc-be70-28d1fb0c710d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:50.409486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17c74989-a8b5-42fc-be70-28d1fb0c710d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:50.409925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17c74989-a8b5-42fc-be70-28d1fb0c710d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:50.410858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17c74989-a8b5-42fc-be70-28d1fb0c710d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:50.411642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17c74989-a8b5-42fc-be70-28d1fb0c710d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:50.412231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17c74989-a8b5-42fc-be70-28d1fb0c710d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:51.010470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-17c74989-a8b5-42fc-be70-28d1fb0c710d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:51.026108 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-17c74989-a8b5-42fc-be70-28d1fb0c710d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1316 microversion: 2.1 time: 0.644465 Aug 23 18:04:51.027506 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1581/3201] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:50 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1316 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:51.216377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cb930e22-624a-4c12-a7be-50f72b13c327 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:51.218395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cb930e22-624a-4c12-a7be-50f72b13c327 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:51.235049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb930e22-624a-4c12-a7be-50f72b13c327 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:51.237582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb930e22-624a-4c12-a7be-50f72b13c327 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:51.238630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb930e22-624a-4c12-a7be-50f72b13c327 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:51.240502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb930e22-624a-4c12-a7be-50f72b13c327 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:51.242207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb930e22-624a-4c12-a7be-50f72b13c327 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:51.243545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb930e22-624a-4c12-a7be-50f72b13c327 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:51.273544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0dc3442e-30cc-42ce-bdb5-4ba08da8c421 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:51.274623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0dc3442e-30cc-42ce-bdb5-4ba08da8c421 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:51.311161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0dc3442e-30cc-42ce-bdb5-4ba08da8c421 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:51.312070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0dc3442e-30cc-42ce-bdb5-4ba08da8c421 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:51.312774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0dc3442e-30cc-42ce-bdb5-4ba08da8c421 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:51.313710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0dc3442e-30cc-42ce-bdb5-4ba08da8c421 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:51.314645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0dc3442e-30cc-42ce-bdb5-4ba08da8c421 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:51.319632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0dc3442e-30cc-42ce-bdb5-4ba08da8c421 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:51.347819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:51.754377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cb930e22-624a-4c12-a7be-50f72b13c327 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:51.773311 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cb930e22-624a-4c12-a7be-50f72b13c327 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1272 microversion: 2.1 time: 0.560477 Aug 23 18:04:51.773942 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1621/3202] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:51 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1272 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:52.006344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0dc3442e-30cc-42ce-bdb5-4ba08da8c421 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:52.032289 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0dc3442e-30cc-42ce-bdb5-4ba08da8c421 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1472 microversion: 2.1 time: 0.763719 Aug 23 18:04:52.046675 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1582/3203] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:51 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1472 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:52.053801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ffe93faf-1fab-4bf6-a7c5-79da227cd3ec tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:52.054016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ffe93faf-1fab-4bf6-a7c5-79da227cd3ec tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:52.073324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffe93faf-1fab-4bf6-a7c5-79da227cd3ec tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:52.073833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffe93faf-1fab-4bf6-a7c5-79da227cd3ec tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:52.074277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffe93faf-1fab-4bf6-a7c5-79da227cd3ec tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:52.082656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffe93faf-1fab-4bf6-a7c5-79da227cd3ec tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:52.090999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffe93faf-1fab-4bf6-a7c5-79da227cd3ec tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:52.091822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffe93faf-1fab-4bf6-a7c5-79da227cd3ec tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:52.797514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e2c5e898-aec0-4145-8e87-6ec0175b8c93 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:52.799256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e2c5e898-aec0-4145-8e87-6ec0175b8c93 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:52.813924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2c5e898-aec0-4145-8e87-6ec0175b8c93 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:52.814434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2c5e898-aec0-4145-8e87-6ec0175b8c93 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:52.816764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2c5e898-aec0-4145-8e87-6ec0175b8c93 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:52.821043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2c5e898-aec0-4145-8e87-6ec0175b8c93 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:52.821548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2c5e898-aec0-4145-8e87-6ec0175b8c93 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:52.822003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2c5e898-aec0-4145-8e87-6ec0175b8c93 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:53.096734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e2c5e898-aec0-4145-8e87-6ec0175b8c93 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:53.119077 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e2c5e898-aec0-4145-8e87-6ec0175b8c93 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1272 microversion: 2.1 time: 0.327021 Aug 23 18:04:53.124118 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1583/3204] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:52 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1272 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:53.134692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-18a37e0f-401e-41ae-ab48-c7f9ee5a74a6 req-ecd7e2f8-9dbe-4c6c-b52d-dbb5afcd5254 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "287f8903-5ddc-4430-bf9f-c98b019c7318", "name": "network-vif-deleted", "tag": "7852aa18-73bd-44b5-8761-dd8ef62c9525"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:53.150037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-18a37e0f-401e-41ae-ab48-c7f9ee5a74a6 req-ecd7e2f8-9dbe-4c6c-b52d-dbb5afcd5254 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:53.151293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-18a37e0f-401e-41ae-ab48-c7f9ee5a74a6 req-ecd7e2f8-9dbe-4c6c-b52d-dbb5afcd5254 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:53.152039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-18a37e0f-401e-41ae-ab48-c7f9ee5a74a6 req-ecd7e2f8-9dbe-4c6c-b52d-dbb5afcd5254 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:53.188093 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-18a37e0f-401e-41ae-ab48-c7f9ee5a74a6 req-ecd7e2f8-9dbe-4c6c-b52d-dbb5afcd5254 service nova] Creating event network-vif-deleted:7852aa18-73bd-44b5-8761-dd8ef62c9525 for instance 287f8903-5ddc-4430-bf9f-c98b019c7318 on n-h2-850468-16 Aug 23 18:04:53.195302 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-18a37e0f-401e-41ae-ab48-c7f9ee5a74a6 req-ecd7e2f8-9dbe-4c6c-b52d-dbb5afcd5254 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066337 Aug 23 18:04:53.197521 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1584/3205] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:53.219009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d65827d-5c0d-4f74-96c9-0c058dcc4d06 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:53.219750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d65827d-5c0d-4f74-96c9-0c058dcc4d06 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:53.231702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d65827d-5c0d-4f74-96c9-0c058dcc4d06 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:53.232223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d65827d-5c0d-4f74-96c9-0c058dcc4d06 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:53.232674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d65827d-5c0d-4f74-96c9-0c058dcc4d06 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:53.233412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d65827d-5c0d-4f74-96c9-0c058dcc4d06 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:53.234085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d65827d-5c0d-4f74-96c9-0c058dcc4d06 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:53.235653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d65827d-5c0d-4f74-96c9-0c058dcc4d06 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:53.431713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5d65827d-5c0d-4f74-96c9-0c058dcc4d06 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:53.441390 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d65827d-5c0d-4f74-96c9-0c058dcc4d06 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1430 microversion: 2.1 time: 0.242080 Aug 23 18:04:53.444328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ffe93faf-1fab-4bf6-a7c5-79da227cd3ec tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:53.460663 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ffe93faf-1fab-4bf6-a7c5-79da227cd3ec tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1316 microversion: 2.1 time: 1.413201 Aug 23 18:04:53.466989 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1585/3206] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:53 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1430 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:53.468004 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1622/3207] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:52 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1316 bytes in 1421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:54.145840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3aec6654-ea43-42ec-a877-6aa516c23cde tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:54.146502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3aec6654-ea43-42ec-a877-6aa516c23cde tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:54.175852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aec6654-ea43-42ec-a877-6aa516c23cde tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:54.176687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aec6654-ea43-42ec-a877-6aa516c23cde tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:54.177427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aec6654-ea43-42ec-a877-6aa516c23cde tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:54.178245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aec6654-ea43-42ec-a877-6aa516c23cde tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:54.178777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aec6654-ea43-42ec-a877-6aa516c23cde tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:54.187098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aec6654-ea43-42ec-a877-6aa516c23cde tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:54.480222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51603760-e645-4ea6-a967-bbd2bcffca31 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:54.483895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51603760-e645-4ea6-a967-bbd2bcffca31 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:54.497675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51603760-e645-4ea6-a967-bbd2bcffca31 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:54.499017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51603760-e645-4ea6-a967-bbd2bcffca31 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:54.499642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51603760-e645-4ea6-a967-bbd2bcffca31 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:54.500716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51603760-e645-4ea6-a967-bbd2bcffca31 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:54.501324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51603760-e645-4ea6-a967-bbd2bcffca31 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:54.502066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51603760-e645-4ea6-a967-bbd2bcffca31 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:54.667408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-51603760-e645-4ea6-a967-bbd2bcffca31 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:54.689297 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51603760-e645-4ea6-a967-bbd2bcffca31 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 200 len: 1430 microversion: 2.1 time: 0.215461 Aug 23 18:04:54.691757 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1623/3208] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:54 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 1430 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:04:54.710735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5685d594-1071-4f6c-8894-768163baf586 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:54.712024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5685d594-1071-4f6c-8894-768163baf586 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:54.730094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5685d594-1071-4f6c-8894-768163baf586 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:54.730742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5685d594-1071-4f6c-8894-768163baf586 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:54.733812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5685d594-1071-4f6c-8894-768163baf586 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:54.744148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5685d594-1071-4f6c-8894-768163baf586 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:54.744833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5685d594-1071-4f6c-8894-768163baf586 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:54.748121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5685d594-1071-4f6c-8894-768163baf586 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:54.848980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3aec6654-ea43-42ec-a877-6aa516c23cde tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:54.862964 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3aec6654-ea43-42ec-a877-6aa516c23cde tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1314 microversion: 2.1 time: 0.722582 Aug 23 18:04:54.865305 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1586/3209] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:54 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:56.227090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5685d594-1071-4f6c-8894-768163baf586 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:56.237752 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5685d594-1071-4f6c-8894-768163baf586 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1316 microversion: 2.1 time: 1.543194 Aug 23 18:04:56.258117 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1624/3210] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:54 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1316 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:56.272025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ff11ec1-2840-4342-ac2f-70b6b6c42fc0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:56.272906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2ff11ec1-2840-4342-ac2f-70b6b6c42fc0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 287f8903-5ddc-4430-bf9f-c98b019c7318] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:56.287344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-217951886", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "97b52358-3bac-44f1-883d-362f6423aa85"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:56.294079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ff11ec1-2840-4342-ac2f-70b6b6c42fc0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:56.294793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ff11ec1-2840-4342-ac2f-70b6b6c42fc0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:56.295484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ff11ec1-2840-4342-ac2f-70b6b6c42fc0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:56.296457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ff11ec1-2840-4342-ac2f-70b6b6c42fc0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:56.298408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ff11ec1-2840-4342-ac2f-70b6b6c42fc0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:56.302653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ff11ec1-2840-4342-ac2f-70b6b6c42fc0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:56.344200 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-2ff11ec1-2840-4342-ac2f-70b6b6c42fc0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] HTTP exception thrown: Instance 287f8903-5ddc-4430-bf9f-c98b019c7318 could not be found. Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ff11ec1-2840-4342-ac2f-70b6b6c42fc0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Request method failure captured: Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 HTTP/1.1 Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXz-QcbvLEqfM5Fvm_6RWB9j3Vx6VI06EpMZHbE0XCyFvEdeIqxZZXm4RDDnTqct29gAslo9Hq7JYktSYJNWsvk9gUtWiSrTwDWVWpwplP-E4k1v0FwDMzIdXpFl3ZeTFc0XOtKuNfFs_K9ET0qEhfYCkPdyTKnIJGg4IT5AUJTxMs Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}] Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: cd9fba74d93549eab6dd981627cbd7f8 Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 287f8903-5ddc-4430-bf9f-c98b019c7318 could not be found. Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '287f8903-5ddc-4430-bf9f-c98b019c7318'} Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 287f8903-5ddc-4430-bf9f-c98b019c7318 could not be found. Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 287f8903-5ddc-4430-bf9f-c98b019c7318 could not be found. Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:04:56.353825 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:56.358767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:04:56.358767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:04:56.358767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:04:56.358767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:04:56.358767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:04:56.358767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 287f8903-5ddc-4430-bf9f-c98b019c7318 could not be found. Aug 23 18:04:56.358767 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:04:56.362860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ff11ec1-2840-4342-ac2f-70b6b6c42fc0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Returning 404 to user: Instance 287f8903-5ddc-4430-bf9f-c98b019c7318 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:04:56.364116 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2ff11ec1-2840-4342-ac2f-70b6b6c42fc0 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318" status: 404 len: 111 microversion: 2.1 time: 0.104645 Aug 23 18:04:56.365464 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1625/3211] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:56 2022] GET /compute/v2.1/servers/287f8903-5ddc-4430-bf9f-c98b019c7318 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:04:56.374176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-446b97d0-d40d-4cb9-8d03-492c48cf9260 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:56.378326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-446b97d0-d40d-4cb9-8d03-492c48cf9260 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:56.394341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-446b97d0-d40d-4cb9-8d03-492c48cf9260 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:56.395179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-446b97d0-d40d-4cb9-8d03-492c48cf9260 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:56.399174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-446b97d0-d40d-4cb9-8d03-492c48cf9260 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:56.400196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-446b97d0-d40d-4cb9-8d03-492c48cf9260 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:56.400842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-446b97d0-d40d-4cb9-8d03-492c48cf9260 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:56.401432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-446b97d0-d40d-4cb9-8d03-492c48cf9260 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:56.748013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-446b97d0-d40d-4cb9-8d03-492c48cf9260 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:56.756192 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-446b97d0-d40d-4cb9-8d03-492c48cf9260 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1314 microversion: 2.1 time: 0.389470 Aug 23 18:04:56.762656 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1626/3212] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:56 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:56.767712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dc600985-dcc9-4a3d-9231-e867f3b37d75 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:56.773659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc600985-dcc9-4a3d-9231-e867f3b37d75 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:56.798038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc600985-dcc9-4a3d-9231-e867f3b37d75 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:56.798414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc600985-dcc9-4a3d-9231-e867f3b37d75 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:56.798903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc600985-dcc9-4a3d-9231-e867f3b37d75 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:56.799614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc600985-dcc9-4a3d-9231-e867f3b37d75 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:56.800074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc600985-dcc9-4a3d-9231-e867f3b37d75 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:56.800496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc600985-dcc9-4a3d-9231-e867f3b37d75 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:56.833653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:56.864319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc600985-dcc9-4a3d-9231-e867f3b37d75 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:04:57.106499 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dc600985-dcc9-4a3d-9231-e867f3b37d75 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 204 len: 0 microversion: 2.1 time: 0.341520 Aug 23 18:04:57.108965 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1627/3213] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:04:56 2022] DELETE /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:04:57.127095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b37ee1be-d95a-466e-820b-c9d58e0bc43d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:57.128961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b37ee1be-d95a-466e-820b-c9d58e0bc43d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:57.149916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b37ee1be-d95a-466e-820b-c9d58e0bc43d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:57.150819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b37ee1be-d95a-466e-820b-c9d58e0bc43d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:57.151618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b37ee1be-d95a-466e-820b-c9d58e0bc43d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:57.153033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b37ee1be-d95a-466e-820b-c9d58e0bc43d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:57.153652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b37ee1be-d95a-466e-820b-c9d58e0bc43d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:57.154866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b37ee1be-d95a-466e-820b-c9d58e0bc43d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:57.520770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=14 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:04:57.831522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b37ee1be-d95a-466e-820b-c9d58e0bc43d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:57.850046 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b37ee1be-d95a-466e-820b-c9d58e0bc43d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1472 microversion: 2.1 time: 0.736446 Aug 23 18:04:57.850688 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1628/3214] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:57 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1472 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:57.876251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-85e4021a-d29b-4824-8852-51e90612c1a7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:57.877581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-85e4021a-d29b-4824-8852-51e90612c1a7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:57.886033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85e4021a-d29b-4824-8852-51e90612c1a7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:57.887145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85e4021a-d29b-4824-8852-51e90612c1a7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:57.888905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85e4021a-d29b-4824-8852-51e90612c1a7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:57.890466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85e4021a-d29b-4824-8852-51e90612c1a7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:57.891200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85e4021a-d29b-4824-8852-51e90612c1a7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:57.892242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85e4021a-d29b-4824-8852-51e90612c1a7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:58.775986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-85e4021a-d29b-4824-8852-51e90612c1a7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:58.790030 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-85e4021a-d29b-4824-8852-51e90612c1a7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1316 microversion: 2.1 time: 0.925742 Aug 23 18:04:58.797645 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1629/3215] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:57 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1316 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:58.816693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-931df6ae-fde6-4c6c-8e9b-3fa54bb73f97 req-2b246a93-5936-4c44-a6fc-39625c2c8e86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91d1f815-6923-4e40-b5de-f829a0ca663d", "tag": "dd24fd67-d5f4-425a-bcd3-10fbbf054506"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:04:58.832347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-931df6ae-fde6-4c6c-8e9b-3fa54bb73f97 req-2b246a93-5936-4c44-a6fc-39625c2c8e86 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:58.833202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-931df6ae-fde6-4c6c-8e9b-3fa54bb73f97 req-2b246a93-5936-4c44-a6fc-39625c2c8e86 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:58.833844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-931df6ae-fde6-4c6c-8e9b-3fa54bb73f97 req-2b246a93-5936-4c44-a6fc-39625c2c8e86 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:58.850063 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-931df6ae-fde6-4c6c-8e9b-3fa54bb73f97 req-2b246a93-5936-4c44-a6fc-39625c2c8e86 service nova] Creating event network-changed:dd24fd67-d5f4-425a-bcd3-10fbbf054506 for instance 91d1f815-6923-4e40-b5de-f829a0ca663d on n-h1-850468-16 Aug 23 18:04:58.858776 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-931df6ae-fde6-4c6c-8e9b-3fa54bb73f97 req-2b246a93-5936-4c44-a6fc-39625c2c8e86 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056418 Aug 23 18:04:58.861253 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1630/3216] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:04:58.869928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-96fd6aeb-f092-4338-9485-173c915d4239 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:58.870833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-96fd6aeb-f092-4338-9485-173c915d4239 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:58.889478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96fd6aeb-f092-4338-9485-173c915d4239 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:58.890878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96fd6aeb-f092-4338-9485-173c915d4239 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:58.891482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96fd6aeb-f092-4338-9485-173c915d4239 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:58.892368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96fd6aeb-f092-4338-9485-173c915d4239 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:58.892980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96fd6aeb-f092-4338-9485-173c915d4239 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:58.893562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96fd6aeb-f092-4338-9485-173c915d4239 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:59.831732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-96fd6aeb-f092-4338-9485-173c915d4239 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:04:59.848703 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-96fd6aeb-f092-4338-9485-173c915d4239 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1314 microversion: 2.1 time: 0.985884 Aug 23 18:04:59.849312 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1631/3217] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:58 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1314 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:04:59.868571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-97c92eba-a19d-4785-bb93-9cd9e6ca579d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:04:59.876608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-97c92eba-a19d-4785-bb93-9cd9e6ca579d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:04:59.895276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c92eba-a19d-4785-bb93-9cd9e6ca579d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:59.898210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c92eba-a19d-4785-bb93-9cd9e6ca579d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:59.899036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c92eba-a19d-4785-bb93-9cd9e6ca579d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:04:59.899969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c92eba-a19d-4785-bb93-9cd9e6ca579d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:04:59.900632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c92eba-a19d-4785-bb93-9cd9e6ca579d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:04:59.901360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c92eba-a19d-4785-bb93-9cd9e6ca579d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:00.228176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97c92eba-a19d-4785-bb93-9cd9e6ca579d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:00.237663 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-97c92eba-a19d-4785-bb93-9cd9e6ca579d tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 200 len: 1430 microversion: 2.1 time: 0.385404 Aug 23 18:05:00.238254 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1632/3218] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:04:59 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 1430 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:00.251901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-265056f1-2fb6-4c18-a8ed-d0551083ab48 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:00.252724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-265056f1-2fb6-4c18-a8ed-d0551083ab48 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:00.273386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-265056f1-2fb6-4c18-a8ed-d0551083ab48 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:00.274242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-265056f1-2fb6-4c18-a8ed-d0551083ab48 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:00.277221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-265056f1-2fb6-4c18-a8ed-d0551083ab48 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:00.279162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-265056f1-2fb6-4c18-a8ed-d0551083ab48 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:00.283817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-265056f1-2fb6-4c18-a8ed-d0551083ab48 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:00.284282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-265056f1-2fb6-4c18-a8ed-d0551083ab48 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:00.673409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-265056f1-2fb6-4c18-a8ed-d0551083ab48 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:00.687588 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-265056f1-2fb6-4c18-a8ed-d0551083ab48 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1316 microversion: 2.1 time: 0.438847 Aug 23 18:05:00.688855 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1633/3219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:00 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1316 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:00.695819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-ef81a125-8ee2-4000-a951-3b4f6b57e401 req-826e1308-dc11-46a4-b95c-cfee0f45d0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b332b070-1b5a-4c6e-adc2-75a0e69b9189", "name": "network-vif-deleted", "tag": "63f3ce0d-67cf-4586-b55b-73fafad66992"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:00.709519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ef81a125-8ee2-4000-a951-3b4f6b57e401 req-826e1308-dc11-46a4-b95c-cfee0f45d0c5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:00.710206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ef81a125-8ee2-4000-a951-3b4f6b57e401 req-826e1308-dc11-46a4-b95c-cfee0f45d0c5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:00.711066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ef81a125-8ee2-4000-a951-3b4f6b57e401 req-826e1308-dc11-46a4-b95c-cfee0f45d0c5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:00.732883 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-ef81a125-8ee2-4000-a951-3b4f6b57e401 req-826e1308-dc11-46a4-b95c-cfee0f45d0c5 service nova] Creating event network-vif-deleted:63f3ce0d-67cf-4586-b55b-73fafad66992 for instance b332b070-1b5a-4c6e-adc2-75a0e69b9189 on n-h1-850468-16 Aug 23 18:05:00.742729 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-ef81a125-8ee2-4000-a951-3b4f6b57e401 req-826e1308-dc11-46a4-b95c-cfee0f45d0c5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051218 Aug 23 18:05:00.749918 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1634/3220] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:00.877916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ad96ba5e-9c3d-479d-87cf-e1554f28fcb4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:00.878855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ad96ba5e-9c3d-479d-87cf-e1554f28fcb4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:00.882565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:00.892547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad96ba5e-9c3d-479d-87cf-e1554f28fcb4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:00.893051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad96ba5e-9c3d-479d-87cf-e1554f28fcb4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:00.893927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad96ba5e-9c3d-479d-87cf-e1554f28fcb4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:00.895128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad96ba5e-9c3d-479d-87cf-e1554f28fcb4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:00.896653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad96ba5e-9c3d-479d-87cf-e1554f28fcb4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:00.897302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad96ba5e-9c3d-479d-87cf-e1554f28fcb4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:01.093220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ad96ba5e-9c3d-479d-87cf-e1554f28fcb4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:01.103370 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ad96ba5e-9c3d-479d-87cf-e1554f28fcb4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1314 microversion: 2.1 time: 0.233426 Aug 23 18:05:01.104565 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1635/3221] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:00 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:01.317084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1365061656", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:04.723488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] validate_networks() for [('97b52358-3bac-44f1-883d-362f6423aa85', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:05:04.740383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] validate_networks() for [('eff190ee-6bd0-44c2-a8f1-02bb9034c43b', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:05:04.853722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=94 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:05.506349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:05:05.506813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:05:05.507543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:05:05.507969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:05:05.508395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:05:05.510389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:DELETE=3,nova_api:SELECT=57 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:05.514285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:05:05.514736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:05:05.515222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:05:05.515631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:05:05.516044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:05:05.527125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:05.528734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:05.529385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:05.530878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:05.531566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:05.532208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:05.533034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:05.534239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:05.534729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:05.535461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:05.551128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:05.552219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:05.560995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Getting quotas for project d7da9d1674484e78bcf8e9d68bbb942d. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:05.568108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Getting quotas for user 413560b41e2648a3ba2611c68bd7e3b9 and project d7da9d1674484e78bcf8e9d68bbb942d. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:05.594196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:05:05.597062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:05:05.611130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Getting quotas for project abd08de41b7e42c29d3e4e7c97dc9f2a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:05.621099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Getting quotas for user 283c529ff2774efca184740ad6ccfdd5 and project abd08de41b7e42c29d3e4e7c97dc9f2a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:05.644909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:05:05.648062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:05:05.681535 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff1ac936-b47e-4e58-9c07-79f4a9bfd67b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 10.036172 Aug 23 18:05:05.682911 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1587/3222] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:04:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 10039 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:05:05.688893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4cbe0e67-099c-458a-8408-ea294bc528c4 req-929d3afe-df58-4e6a-86ed-a68ed0d6d758 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a2f8a54-72ff-43c4-a31e-76b29723e3e1", "name": "network-vif-plugged", "status": "completed", "tag": "d48d38dd-3b1f-4db9-957e-46b040401b51"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:05.701481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4cbe0e67-099c-458a-8408-ea294bc528c4 req-929d3afe-df58-4e6a-86ed-a68ed0d6d758 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:05.702300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4cbe0e67-099c-458a-8408-ea294bc528c4 req-929d3afe-df58-4e6a-86ed-a68ed0d6d758 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:05.703007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4cbe0e67-099c-458a-8408-ea294bc528c4 req-929d3afe-df58-4e6a-86ed-a68ed0d6d758 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:05.718850 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4cbe0e67-099c-458a-8408-ea294bc528c4 req-929d3afe-df58-4e6a-86ed-a68ed0d6d758 service nova] Creating event network-vif-plugged:d48d38dd-3b1f-4db9-957e-46b040401b51 for instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 on n-h2-850468-16 Aug 23 18:05:05.734222 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4cbe0e67-099c-458a-8408-ea294bc528c4 req-929d3afe-df58-4e6a-86ed-a68ed0d6d758 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049545 Aug 23 18:05:05.739341 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1588/3223] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:05.760653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41ae72d8-acb4-4632-8b95-b3cf24ee990e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:05.762162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-41ae72d8-acb4-4632-8b95-b3cf24ee990e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b332b070-1b5a-4c6e-adc2-75a0e69b9189] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:05.775662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ae72d8-acb4-4632-8b95-b3cf24ee990e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:05.781024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ae72d8-acb4-4632-8b95-b3cf24ee990e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:05.781722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ae72d8-acb4-4632-8b95-b3cf24ee990e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:05.783251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ae72d8-acb4-4632-8b95-b3cf24ee990e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:05.787181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ae72d8-acb4-4632-8b95-b3cf24ee990e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:05.787876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ae72d8-acb4-4632-8b95-b3cf24ee990e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:05.803996 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-376cb012-18cb-40db-bbac-d4e5dbbf0d67 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.697985 Aug 23 18:05:05.814512 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1636/3224] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:05:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 4708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:05:05.826939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6c68c9c-4bcf-4e93-8d6d-d6cee10c4088 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:05.830098 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-41ae72d8-acb4-4632-8b95-b3cf24ee990e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] HTTP exception thrown: Instance b332b070-1b5a-4c6e-adc2-75a0e69b9189 could not be found. Aug 23 18:05:05.830642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6c68c9c-4bcf-4e93-8d6d-d6cee10c4088 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:05.845155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6c68c9c-4bcf-4e93-8d6d-d6cee10c4088 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:05.845971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6c68c9c-4bcf-4e93-8d6d-d6cee10c4088 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:05.846601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6c68c9c-4bcf-4e93-8d6d-d6cee10c4088 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41ae72d8-acb4-4632-8b95-b3cf24ee990e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Request method failure captured: Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 HTTP/1.1 Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRXz-QcbvLEqfM5Fvm_6RWB9j3Vx6VI06EpMZHbE0XCyFvEdeIqxZZXm4RDDnTqct29gAslo9Hq7JYktSYJNWsvk9gUtWiSrTwDWVWpwplP-E4k1v0FwDMzIdXpFl3ZeTFc0XOtKuNfFs_K9ET0qEhfYCkPdyTKnIJGg4IT5AUJTxMs Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}] Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: cd9fba74d93549eab6dd981627cbd7f8 Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance b332b070-1b5a-4c6e-adc2-75a0e69b9189 could not be found. Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'b332b070-1b5a-4c6e-adc2-75a0e69b9189'} Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b332b070-1b5a-4c6e-adc2-75a0e69b9189 could not be found. Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b332b070-1b5a-4c6e-adc2-75a0e69b9189 could not be found. Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:05.847146 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:05.851483 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:05.851483 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:05.851483 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:05.851483 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:05.851483 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:05.851483 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b332b070-1b5a-4c6e-adc2-75a0e69b9189 could not be found. Aug 23 18:05:05.851483 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:05.851483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41ae72d8-acb4-4632-8b95-b3cf24ee990e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Returning 404 to user: Instance b332b070-1b5a-4c6e-adc2-75a0e69b9189 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:05.852022 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-41ae72d8-acb4-4632-8b95-b3cf24ee990e tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189" status: 404 len: 111 microversion: 2.1 time: 0.111456 Aug 23 18:05:05.852610 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1589/3225] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:05 2022] GET /compute/v2.1/servers/b332b070-1b5a-4c6e-adc2-75a0e69b9189 => generated 111 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:05.853363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6c68c9c-4bcf-4e93-8d6d-d6cee10c4088 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:05.874728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6c68c9c-4bcf-4e93-8d6d-d6cee10c4088 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:05.876160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6c68c9c-4bcf-4e93-8d6d-d6cee10c4088 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:05.881056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e4d2ad2-f7e0-4b9d-9997-b091e4d763a0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:05.889366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4e4d2ad2-f7e0-4b9d-9997-b091e4d763a0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:05.901760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e4d2ad2-f7e0-4b9d-9997-b091e4d763a0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:05.902843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e4d2ad2-f7e0-4b9d-9997-b091e4d763a0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:05.903505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e4d2ad2-f7e0-4b9d-9997-b091e4d763a0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:05.905755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e4d2ad2-f7e0-4b9d-9997-b091e4d763a0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:05.908910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e4d2ad2-f7e0-4b9d-9997-b091e4d763a0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:05.909498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e4d2ad2-f7e0-4b9d-9997-b091e4d763a0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:06.427674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b6c68c9c-4bcf-4e93-8d6d-d6cee10c4088 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:06.440254 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6c68c9c-4bcf-4e93-8d6d-d6cee10c4088 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1316 microversion: 2.1 time: 0.621099 Aug 23 18:05:06.441530 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1637/3226] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:05 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:06.448174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-55336538-5471-4e49-944f-f48591612de0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:06.450277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-55336538-5471-4e49-944f-f48591612de0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:06.549758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-55336538-5471-4e49-944f-f48591612de0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:06.558319 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-55336538-5471-4e49-944f-f48591612de0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1215 microversion: 2.1 time: 0.115424 Aug 23 18:05:06.559429 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1638/3227] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:06 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:06.564301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1f1a85d4-8c79-40d6-bc07-2e31956bce2d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:06.564913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1f1a85d4-8c79-40d6-bc07-2e31956bce2d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:06.565275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e4d2ad2-f7e0-4b9d-9997-b091e4d763a0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:06.585016 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e4d2ad2-f7e0-4b9d-9997-b091e4d763a0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1314 microversion: 2.1 time: 0.712966 Aug 23 18:05:06.585542 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1590/3228] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:05 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1314 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:06.598395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8015efea-286b-45ce-92a2-1ef3f720e2f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:06.601622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8015efea-286b-45ce-92a2-1ef3f720e2f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:06.639577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8015efea-286b-45ce-92a2-1ef3f720e2f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:06.640108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8015efea-286b-45ce-92a2-1ef3f720e2f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:06.642822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8015efea-286b-45ce-92a2-1ef3f720e2f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:06.643654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8015efea-286b-45ce-92a2-1ef3f720e2f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:06.645283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8015efea-286b-45ce-92a2-1ef3f720e2f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:06.645793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8015efea-286b-45ce-92a2-1ef3f720e2f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:06.728608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8015efea-286b-45ce-92a2-1ef3f720e2f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:05:06.733185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1f1a85d4-8c79-40d6-bc07-2e31956bce2d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:06.750309 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1f1a85d4-8c79-40d6-bc07-2e31956bce2d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1222 microversion: 2.1 time: 0.188651 Aug 23 18:05:06.755123 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1639/3229] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:06 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1222 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:06.846944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1601258950", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:06.982720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] validate_networks() for [('eff190ee-6bd0-44c2-a8f1-02bb9034c43b', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:05:07.066913 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8015efea-286b-45ce-92a2-1ef3f720e2f6 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 204 len: 0 microversion: 2.1 time: 0.476571 Aug 23 18:05:07.070087 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1591/3230] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:05:06 2022] DELETE /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:07.112088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d4f77b0-9cca-4f1a-ba2e-9910a78f7da8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:07.113324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d4f77b0-9cca-4f1a-ba2e-9910a78f7da8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:07.123615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d4f77b0-9cca-4f1a-ba2e-9910a78f7da8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:07.124555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d4f77b0-9cca-4f1a-ba2e-9910a78f7da8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:07.125240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d4f77b0-9cca-4f1a-ba2e-9910a78f7da8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:07.126299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d4f77b0-9cca-4f1a-ba2e-9910a78f7da8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:07.127032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d4f77b0-9cca-4f1a-ba2e-9910a78f7da8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:07.128286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d4f77b0-9cca-4f1a-ba2e-9910a78f7da8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:07.326901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4d4f77b0-9cca-4f1a-ba2e-9910a78f7da8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:07.335244 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d4f77b0-9cca-4f1a-ba2e-9910a78f7da8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1470 microversion: 2.1 time: 0.255112 Aug 23 18:05:07.350104 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1592/3231] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:07 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1470 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:07.468650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8496b131-4566-4f19-8338-2588f391ef0d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:07.469561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8496b131-4566-4f19-8338-2588f391ef0d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:07.479216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8496b131-4566-4f19-8338-2588f391ef0d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:07.481336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8496b131-4566-4f19-8338-2588f391ef0d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:07.483225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8496b131-4566-4f19-8338-2588f391ef0d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:07.484815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8496b131-4566-4f19-8338-2588f391ef0d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:07.486120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8496b131-4566-4f19-8338-2588f391ef0d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:07.488129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8496b131-4566-4f19-8338-2588f391ef0d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:07.545072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:05:07.545508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:05:07.546062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:05:07.546486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:05:07.546932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:05:07.560200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:07.560695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:07.561156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:07.562064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:07.562534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:07.562994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:07.591255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Getting quotas for project abd08de41b7e42c29d3e4e7c97dc9f2a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:07.597792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Getting quotas for user 283c529ff2774efca184740ad6ccfdd5 and project abd08de41b7e42c29d3e4e7c97dc9f2a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:07.635122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:05:07.647409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:05:07.718280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8496b131-4566-4f19-8338-2588f391ef0d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:07.728154 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8496b131-4566-4f19-8338-2588f391ef0d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1316 microversion: 2.1 time: 0.266066 Aug 23 18:05:07.729528 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1593/3232] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:07 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1316 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:07.734899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f0070682-d1c0-4b16-8fb8-e5b3a4f992b0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:07.735747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f0070682-d1c0-4b16-8fb8-e5b3a4f992b0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:07.758615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0070682-d1c0-4b16-8fb8-e5b3a4f992b0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:07.759415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0070682-d1c0-4b16-8fb8-e5b3a4f992b0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:07.760485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0070682-d1c0-4b16-8fb8-e5b3a4f992b0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:07.761727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0070682-d1c0-4b16-8fb8-e5b3a4f992b0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:07.763933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0070682-d1c0-4b16-8fb8-e5b3a4f992b0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:07.764674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0070682-d1c0-4b16-8fb8-e5b3a4f992b0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:07.806785 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b2b772ef-c265-4ce9-b0a9-1167a0550d17 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.966628 Aug 23 18:05:07.808102 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1640/3233] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:05:06 2022] POST /compute/v2.1/servers => generated 383 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:05:07.816239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a3a37509-cbeb-4378-8e08-d55a5e10246f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:07.817220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a3a37509-cbeb-4378-8e08-d55a5e10246f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:07.825858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3a37509-cbeb-4378-8e08-d55a5e10246f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:07.826929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3a37509-cbeb-4378-8e08-d55a5e10246f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:07.827724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3a37509-cbeb-4378-8e08-d55a5e10246f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:07.841868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3a37509-cbeb-4378-8e08-d55a5e10246f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:07.843931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3a37509-cbeb-4378-8e08-d55a5e10246f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:07.844646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3a37509-cbeb-4378-8e08-d55a5e10246f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:07.899796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f0070682-d1c0-4b16-8fb8-e5b3a4f992b0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:07.913414 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f0070682-d1c0-4b16-8fb8-e5b3a4f992b0 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1219 microversion: 2.1 time: 0.181710 Aug 23 18:05:07.928570 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1594/3234] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:07 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1219 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:07.945496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-05a20d0d-356c-4b51-ae24-8f1028aa509a req-170e1de4-416c-4a2d-9c40-4546a74301b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d1f815-6923-4e40-b5de-f829a0ca663d", "name": "network-vif-plugged", "status": "completed", "tag": "dd24fd67-d5f4-425a-bcd3-10fbbf054506"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:07.961779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-05a20d0d-356c-4b51-ae24-8f1028aa509a req-170e1de4-416c-4a2d-9c40-4546a74301b8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:07.968413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-05a20d0d-356c-4b51-ae24-8f1028aa509a req-170e1de4-416c-4a2d-9c40-4546a74301b8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:07.969135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-05a20d0d-356c-4b51-ae24-8f1028aa509a req-170e1de4-416c-4a2d-9c40-4546a74301b8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:07.998618 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-05a20d0d-356c-4b51-ae24-8f1028aa509a req-170e1de4-416c-4a2d-9c40-4546a74301b8 service nova] Creating event network-vif-plugged:dd24fd67-d5f4-425a-bcd3-10fbbf054506 for instance 91d1f815-6923-4e40-b5de-f829a0ca663d on n-h1-850468-16 Aug 23 18:05:08.006028 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-05a20d0d-356c-4b51-ae24-8f1028aa509a req-170e1de4-416c-4a2d-9c40-4546a74301b8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075228 Aug 23 18:05:08.007724 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1595/3235] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:08.031339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c92b8628-5095-4240-856a-8f2d4b4dbba3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:08.032523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c92b8628-5095-4240-856a-8f2d4b4dbba3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:08.209797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a3a37509-cbeb-4378-8e08-d55a5e10246f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:08.214506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:08.243941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c92b8628-5095-4240-856a-8f2d4b4dbba3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:08.247319 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a3a37509-cbeb-4378-8e08-d55a5e10246f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1314 microversion: 2.1 time: 0.432110 Aug 23 18:05:08.258959 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1641/3236] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:07 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1314 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:08.259656 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c92b8628-5095-4240-856a-8f2d4b4dbba3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1222 microversion: 2.1 time: 0.245998 Aug 23 18:05:08.259656 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1596/3237] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:08 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1222 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:08.359390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-88445e16-fd3d-4486-beba-29e126b0bd60 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:08.359750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-88445e16-fd3d-4486-beba-29e126b0bd60 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:08.393401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88445e16-fd3d-4486-beba-29e126b0bd60 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:08.397099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88445e16-fd3d-4486-beba-29e126b0bd60 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:08.398677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88445e16-fd3d-4486-beba-29e126b0bd60 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:08.402671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88445e16-fd3d-4486-beba-29e126b0bd60 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:08.404108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88445e16-fd3d-4486-beba-29e126b0bd60 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:08.407002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88445e16-fd3d-4486-beba-29e126b0bd60 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:08.751776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-51f20979-8439-42a3-a709-959b94e6fd56 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:08.752681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-51f20979-8439-42a3-a709-959b94e6fd56 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:08.770405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51f20979-8439-42a3-a709-959b94e6fd56 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:08.771106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51f20979-8439-42a3-a709-959b94e6fd56 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:08.772519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51f20979-8439-42a3-a709-959b94e6fd56 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:08.775648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51f20979-8439-42a3-a709-959b94e6fd56 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:08.776308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51f20979-8439-42a3-a709-959b94e6fd56 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:08.779942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51f20979-8439-42a3-a709-959b94e6fd56 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:08.924511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-88445e16-fd3d-4486-beba-29e126b0bd60 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:08.937497 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-88445e16-fd3d-4486-beba-29e126b0bd60 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1470 microversion: 2.1 time: 0.584134 Aug 23 18:05:08.941925 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1642/3238] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:08 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1470 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:08.948136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9d097d71-f346-4cb6-acb1-fb829cf088ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:08.951994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9d097d71-f346-4cb6-acb1-fb829cf088ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:08.964406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d097d71-f346-4cb6-acb1-fb829cf088ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:08.967688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d097d71-f346-4cb6-acb1-fb829cf088ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:08.972384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d097d71-f346-4cb6-acb1-fb829cf088ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:08.974415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d097d71-f346-4cb6-acb1-fb829cf088ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:08.977018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d097d71-f346-4cb6-acb1-fb829cf088ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:08.981615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d097d71-f346-4cb6-acb1-fb829cf088ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:09.149026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-51f20979-8439-42a3-a709-959b94e6fd56 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:09.162175 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-51f20979-8439-42a3-a709-959b94e6fd56 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1465 microversion: 2.1 time: 0.414670 Aug 23 18:05:09.164005 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1597/3239] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:08 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1465 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:09.188328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e80a4a2-50dd-4b58-9343-5a89f9c0af36 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-694960573", "metadata": {"image_type": "test"}}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:09.192535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4e80a4a2-50dd-4b58-9343-5a89f9c0af36 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:09.206554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9d097d71-f346-4cb6-acb1-fb829cf088ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:09.210051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e80a4a2-50dd-4b58-9343-5a89f9c0af36 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:09.211128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e80a4a2-50dd-4b58-9343-5a89f9c0af36 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:09.211579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e80a4a2-50dd-4b58-9343-5a89f9c0af36 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:09.213539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e80a4a2-50dd-4b58-9343-5a89f9c0af36 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:09.214090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e80a4a2-50dd-4b58-9343-5a89f9c0af36 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:09.214345 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9d097d71-f346-4cb6-acb1-fb829cf088ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1267 microversion: 2.1 time: 0.271071 Aug 23 18:05:09.215185 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1643/3240] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:08 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1267 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:09.226718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e80a4a2-50dd-4b58-9343-5a89f9c0af36 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:09.286953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3d9e7fa0-c82c-422b-a441-5ab5ce4da891 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:09.287812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3d9e7fa0-c82c-422b-a441-5ab5ce4da891 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:09.304817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4e80a4a2-50dd-4b58-9343-5a89f9c0af36 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Getting quotas for project 13bee7ab4bce40a6a01424dc7a620320. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:09.305552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d9e7fa0-c82c-422b-a441-5ab5ce4da891 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:09.306052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d9e7fa0-c82c-422b-a441-5ab5ce4da891 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:09.306504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d9e7fa0-c82c-422b-a441-5ab5ce4da891 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:09.307247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d9e7fa0-c82c-422b-a441-5ab5ce4da891 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:09.307716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d9e7fa0-c82c-422b-a441-5ab5ce4da891 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:09.308136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d9e7fa0-c82c-422b-a441-5ab5ce4da891 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:09.313452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4e80a4a2-50dd-4b58-9343-5a89f9c0af36 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Getting quotas for user 288ed685c4de46349aa9f7fc95951bfb and project 13bee7ab4bce40a6a01424dc7a620320. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:09.804985 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e80a4a2-50dd-4b58-9343-5a89f9c0af36 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "POST /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1/action" status: 202 len: 0 microversion: 2.1 time: 0.620759 Aug 23 18:05:09.805744 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1598/3241] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:09 2022] POST /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 18:05:09.841152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-00ce06d3-0c1e-46b8-9663-a290a52f6528 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:09.846098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-00ce06d3-0c1e-46b8-9663-a290a52f6528 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:09.860986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00ce06d3-0c1e-46b8-9663-a290a52f6528 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:09.864440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00ce06d3-0c1e-46b8-9663-a290a52f6528 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:09.865483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00ce06d3-0c1e-46b8-9663-a290a52f6528 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:09.868099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00ce06d3-0c1e-46b8-9663-a290a52f6528 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:09.871552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00ce06d3-0c1e-46b8-9663-a290a52f6528 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:09.873533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00ce06d3-0c1e-46b8-9663-a290a52f6528 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:10.050077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-00ce06d3-0c1e-46b8-9663-a290a52f6528 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:10.063357 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-00ce06d3-0c1e-46b8-9663-a290a52f6528 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1218 microversion: 2.1 time: 0.254678 Aug 23 18:05:10.065451 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1599/3242] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:09 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1218 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:10.071221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a0903f45-b12d-4472-8be7-06de952b4025 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27f1c5a040>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:10.174875 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a0903f45-b12d-4472-8be7-06de952b4025 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.108098 Aug 23 18:05:10.175649 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1600/3243] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:10 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:10.185098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-047622ac-3d1c-429b-8331-13195fc5a513 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:10.185749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-047622ac-3d1c-429b-8331-13195fc5a513 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:10.207643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-047622ac-3d1c-429b-8331-13195fc5a513 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:10.208098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-047622ac-3d1c-429b-8331-13195fc5a513 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:10.208559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-047622ac-3d1c-429b-8331-13195fc5a513 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:10.209294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-047622ac-3d1c-429b-8331-13195fc5a513 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:10.209762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-047622ac-3d1c-429b-8331-13195fc5a513 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:10.210194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-047622ac-3d1c-429b-8331-13195fc5a513 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:10.530247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-047622ac-3d1c-429b-8331-13195fc5a513 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:10.545740 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-047622ac-3d1c-429b-8331-13195fc5a513 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1470 microversion: 2.1 time: 0.366013 Aug 23 18:05:10.563053 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1601/3244] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:10 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1470 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:10.589027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a8b91bde-b421-44c6-afa5-2647bb6fa0b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:10.591456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a8b91bde-b421-44c6-afa5-2647bb6fa0b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:10.595740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3d9e7fa0-c82c-422b-a441-5ab5ce4da891 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:10.605862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8b91bde-b421-44c6-afa5-2647bb6fa0b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:10.606501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8b91bde-b421-44c6-afa5-2647bb6fa0b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:10.606827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8b91bde-b421-44c6-afa5-2647bb6fa0b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:10.607503 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3d9e7fa0-c82c-422b-a441-5ab5ce4da891 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1314 microversion: 2.1 time: 1.325998 Aug 23 18:05:10.607638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8b91bde-b421-44c6-afa5-2647bb6fa0b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:10.608972 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1644/3245] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:09 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1314 bytes in 1328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:10.610133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8b91bde-b421-44c6-afa5-2647bb6fa0b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:10.612809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8b91bde-b421-44c6-afa5-2647bb6fa0b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:10.874062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a8b91bde-b421-44c6-afa5-2647bb6fa0b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:10.886330 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a8b91bde-b421-44c6-afa5-2647bb6fa0b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1267 microversion: 2.1 time: 0.321922 Aug 23 18:05:10.888844 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1602/3246] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:10 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1267 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:11.052445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-03c7eacd-91cc-4c8a-9fd6-ada61ece6dc1 req-7a08782f-77ae-42ca-906f-67624966cbde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0910b63-6031-40e1-8e5b-b25eca463ee5", "name": "network-vif-deleted", "tag": "bc750646-993b-42e5-a282-c50ac6462709"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:11.064663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-03c7eacd-91cc-4c8a-9fd6-ada61ece6dc1 req-7a08782f-77ae-42ca-906f-67624966cbde service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:11.066281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-03c7eacd-91cc-4c8a-9fd6-ada61ece6dc1 req-7a08782f-77ae-42ca-906f-67624966cbde service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:11.067037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-03c7eacd-91cc-4c8a-9fd6-ada61ece6dc1 req-7a08782f-77ae-42ca-906f-67624966cbde service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:11.088609 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-03c7eacd-91cc-4c8a-9fd6-ada61ece6dc1 req-7a08782f-77ae-42ca-906f-67624966cbde service nova] Creating event network-vif-deleted:bc750646-993b-42e5-a282-c50ac6462709 for instance b0910b63-6031-40e1-8e5b-b25eca463ee5 on n-h1-850468-16 Aug 23 18:05:11.093718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7f29614b-ff1b-450f-a818-222f4490374b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:11.094397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7f29614b-ff1b-450f-a818-222f4490374b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:11.098711 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-03c7eacd-91cc-4c8a-9fd6-ada61ece6dc1 req-7a08782f-77ae-42ca-906f-67624966cbde service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051159 Aug 23 18:05:11.099730 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1645/3247] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:11.110407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f29614b-ff1b-450f-a818-222f4490374b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:11.111212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f29614b-ff1b-450f-a818-222f4490374b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:11.111795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f29614b-ff1b-450f-a818-222f4490374b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:11.112420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f29614b-ff1b-450f-a818-222f4490374b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:11.112879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f29614b-ff1b-450f-a818-222f4490374b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:11.113353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f29614b-ff1b-450f-a818-222f4490374b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:11.191484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fbccdf94-5c32-418d-8599-b7ac1a45d4d3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec518280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:11.273868 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fbccdf94-5c32-418d-8599-b7ac1a45d4d3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.087238 Aug 23 18:05:11.275337 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1646/3248] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:11 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:11.319744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7f29614b-ff1b-450f-a818-222f4490374b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:11.329523 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7f29614b-ff1b-450f-a818-222f4490374b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1274 microversion: 2.1 time: 0.241282 Aug 23 18:05:11.360155 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1603/3249] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:11 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1274 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:11.569695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:11.571490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:11.608795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:11.609371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:11.609754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:11.620624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:11.623363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:11.623819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:11.633328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-311c89c1-b343-4ae2-9204-de807fb8ee6a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:11.634511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-311c89c1-b343-4ae2-9204-de807fb8ee6a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:11.642534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-311c89c1-b343-4ae2-9204-de807fb8ee6a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:11.643062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-311c89c1-b343-4ae2-9204-de807fb8ee6a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:11.643822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-311c89c1-b343-4ae2-9204-de807fb8ee6a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:11.644549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-311c89c1-b343-4ae2-9204-de807fb8ee6a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:11.674797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-311c89c1-b343-4ae2-9204-de807fb8ee6a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:11.676304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-311c89c1-b343-4ae2-9204-de807fb8ee6a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.031s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:11.734080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:11.767405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:11.783155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:11.783759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:11.784249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lazy-loading 'fault' on Instance uuid b0910b63-6031-40e1-8e5b-b25eca463ee5 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:05:12.019428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:12.035953 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51676255-2db5-4459-a558-ab53aafdd743 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 200 len: 1306 microversion: 2.1 time: 0.472447 Aug 23 18:05:12.037455 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1647/3250] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:11 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 1306 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:12.052110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce0bacdc-09fc-43f0-89fe-e5d31e381f4b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:12.052743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ce0bacdc-09fc-43f0-89fe-e5d31e381f4b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:12.079583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce0bacdc-09fc-43f0-89fe-e5d31e381f4b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:12.085889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce0bacdc-09fc-43f0-89fe-e5d31e381f4b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:12.086530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce0bacdc-09fc-43f0-89fe-e5d31e381f4b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:12.090954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce0bacdc-09fc-43f0-89fe-e5d31e381f4b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:12.095209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce0bacdc-09fc-43f0-89fe-e5d31e381f4b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:12.095672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce0bacdc-09fc-43f0-89fe-e5d31e381f4b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:12.305705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ce0bacdc-09fc-43f0-89fe-e5d31e381f4b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:12.318403 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce0bacdc-09fc-43f0-89fe-e5d31e381f4b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1273 microversion: 2.1 time: 0.279339 Aug 23 18:05:12.331298 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1648/3251] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:12 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1273 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:12.339389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-16c4a8f7-9113-4f09-a5db-d9aa6854aa2c tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df8070d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:12.414747 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-16c4a8f7-9113-4f09-a5db-d9aa6854aa2c tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.082000 Aug 23 18:05:12.415526 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1649/3252] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:12 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:12.434821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-862cdea8-ae14-4993-9698-00d07433398a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:12.435968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-862cdea8-ae14-4993-9698-00d07433398a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:12.442520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-862cdea8-ae14-4993-9698-00d07433398a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:12.443295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-862cdea8-ae14-4993-9698-00d07433398a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:12.443914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-862cdea8-ae14-4993-9698-00d07433398a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:12.444800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-862cdea8-ae14-4993-9698-00d07433398a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:12.445442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-862cdea8-ae14-4993-9698-00d07433398a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:12.446039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-862cdea8-ae14-4993-9698-00d07433398a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:12.563122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-862cdea8-ae14-4993-9698-00d07433398a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:12.576374 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-862cdea8-ae14-4993-9698-00d07433398a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1280 microversion: 2.1 time: 0.159604 Aug 23 18:05:12.579470 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1650/3253] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:12 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1280 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:12.594912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-311c89c1-b343-4ae2-9204-de807fb8ee6a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:12.615958 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-311c89c1-b343-4ae2-9204-de807fb8ee6a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1501 microversion: 2.1 time: 0.984732 Aug 23 18:05:12.618746 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1604/3254] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:11 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1501 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:12.646607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f82f7550-ff78-4206-b2ba-b37a3c565896 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:12.650118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f82f7550-ff78-4206-b2ba-b37a3c565896 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:12.668714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f82f7550-ff78-4206-b2ba-b37a3c565896 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:12.669633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f82f7550-ff78-4206-b2ba-b37a3c565896 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:12.670531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f82f7550-ff78-4206-b2ba-b37a3c565896 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:12.671540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f82f7550-ff78-4206-b2ba-b37a3c565896 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:12.672250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f82f7550-ff78-4206-b2ba-b37a3c565896 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:12.672914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f82f7550-ff78-4206-b2ba-b37a3c565896 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:12.771336 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f82f7550-ff78-4206-b2ba-b37a3c565896 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action" status: 200 len: 14 microversion: 2.1 time: 0.128772 Aug 23 18:05:12.772558 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1651/3255] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:12 2022] POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action => generated 14 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:05:13.060716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c3d57ae-680e-4054-864d-7eedd3146be1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:13.061375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5c3d57ae-680e-4054-864d-7eedd3146be1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: b0910b63-6031-40e1-8e5b-b25eca463ee5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:13.073129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c3d57ae-680e-4054-864d-7eedd3146be1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:13.073632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c3d57ae-680e-4054-864d-7eedd3146be1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:13.074117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c3d57ae-680e-4054-864d-7eedd3146be1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:13.074874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c3d57ae-680e-4054-864d-7eedd3146be1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:13.075344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c3d57ae-680e-4054-864d-7eedd3146be1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:13.092277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c3d57ae-680e-4054-864d-7eedd3146be1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:13.127926 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-5c3d57ae-680e-4054-864d-7eedd3146be1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] HTTP exception thrown: Instance b0910b63-6031-40e1-8e5b-b25eca463ee5 could not be found. Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c3d57ae-680e-4054-864d-7eedd3146be1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Request method failure captured: Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 HTTP/1.1 Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRXz-QcbvLEqfM5Fvm_6RWB9j3Vx6VI06EpMZHbE0XCyFvEdeIqxZZXm4RDDnTqct29gAslo9Hq7JYktSYJNWsvk9gUtWiSrTwDWVWpwplP-E4k1v0FwDMzIdXpFl3ZeTFc0XOtKuNfFs_K9ET0qEhfYCkPdyTKnIJGg4IT5AUJTxMs Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}] Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: cd9fba74d93549eab6dd981627cbd7f8 Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance b0910b63-6031-40e1-8e5b-b25eca463ee5 could not be found. Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'b0910b63-6031-40e1-8e5b-b25eca463ee5'} Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0910b63-6031-40e1-8e5b-b25eca463ee5 could not be found. Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0910b63-6031-40e1-8e5b-b25eca463ee5 could not be found. Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:13.129898 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:13.134021 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:13.134021 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:13.134021 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:13.134021 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:13.134021 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:13.134021 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0910b63-6031-40e1-8e5b-b25eca463ee5 could not be found. Aug 23 18:05:13.134021 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:13.143687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c3d57ae-680e-4054-864d-7eedd3146be1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Returning 404 to user: Instance b0910b63-6031-40e1-8e5b-b25eca463ee5 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:13.148298 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5c3d57ae-680e-4054-864d-7eedd3146be1 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5" status: 404 len: 111 microversion: 2.1 time: 0.092517 Aug 23 18:05:13.159087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f68419d-079e-4160-a01c-c4b9d830fdd2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:13.160237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0f68419d-079e-4160-a01c-c4b9d830fdd2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 115be13c-aace-4476-be96-7ae226d6fe10] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:13.167311 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1605/3256] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:13 2022] GET /compute/v2.1/servers/b0910b63-6031-40e1-8e5b-b25eca463ee5 => generated 111 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:13.177226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f68419d-079e-4160-a01c-c4b9d830fdd2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:13.178056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f68419d-079e-4160-a01c-c4b9d830fdd2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:13.179100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f68419d-079e-4160-a01c-c4b9d830fdd2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:13.179871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f68419d-079e-4160-a01c-c4b9d830fdd2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:13.180369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f68419d-079e-4160-a01c-c4b9d830fdd2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:13.180848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f68419d-079e-4160-a01c-c4b9d830fdd2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:13.232732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0f68419d-079e-4160-a01c-c4b9d830fdd2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 115be13c-aace-4476-be96-7ae226d6fe10] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:05:13.345977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-14367826-2d62-4564-8089-7c0c061c3da4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:13.347900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-14367826-2d62-4564-8089-7c0c061c3da4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:13.368283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14367826-2d62-4564-8089-7c0c061c3da4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:13.371446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14367826-2d62-4564-8089-7c0c061c3da4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:13.374105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14367826-2d62-4564-8089-7c0c061c3da4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:13.376058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14367826-2d62-4564-8089-7c0c061c3da4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:13.377217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14367826-2d62-4564-8089-7c0c061c3da4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:13.379300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14367826-2d62-4564-8089-7c0c061c3da4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:13.458061 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0f68419d-079e-4160-a01c-c4b9d830fdd2 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "DELETE /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10" status: 204 len: 0 microversion: 2.1 time: 0.303515 Aug 23 18:05:13.462107 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1652/3257] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:05:13 2022] DELETE /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:13.471411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3a71eb33-2691-4397-bea4-d985f546674d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df8074c0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:13.530790 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3a71eb33-2691-4397-bea4-d985f546674d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.064602 Aug 23 18:05:13.534156 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1653/3258] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:13 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:13.541437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0c107c62-de6d-4e34-b91d-b53822f4e290 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:13.544638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0c107c62-de6d-4e34-b91d-b53822f4e290 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:13.557044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c107c62-de6d-4e34-b91d-b53822f4e290 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:13.557551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c107c62-de6d-4e34-b91d-b53822f4e290 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:13.558004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c107c62-de6d-4e34-b91d-b53822f4e290 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:13.559304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c107c62-de6d-4e34-b91d-b53822f4e290 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:13.561519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c107c62-de6d-4e34-b91d-b53822f4e290 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:13.563556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c107c62-de6d-4e34-b91d-b53822f4e290 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:13.619431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0c107c62-de6d-4e34-b91d-b53822f4e290 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:05:13.777045 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0c107c62-de6d-4e34-b91d-b53822f4e290 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 204 len: 0 microversion: 2.1 time: 0.240486 Aug 23 18:05:13.782019 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1654/3259] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:05:13 2022] DELETE /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:13.789875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-054259a3-a153-4278-9123-07cac0e1b1fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:13.790890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-054259a3-a153-4278-9123-07cac0e1b1fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:13.798957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-054259a3-a153-4278-9123-07cac0e1b1fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:13.799951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-054259a3-a153-4278-9123-07cac0e1b1fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:13.800940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-054259a3-a153-4278-9123-07cac0e1b1fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:13.801857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-054259a3-a153-4278-9123-07cac0e1b1fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:13.802517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-054259a3-a153-4278-9123-07cac0e1b1fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:13.803508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-054259a3-a153-4278-9123-07cac0e1b1fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:13.937345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-054259a3-a153-4278-9123-07cac0e1b1fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:13.952750 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-054259a3-a153-4278-9123-07cac0e1b1fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1280 microversion: 2.1 time: 0.166130 Aug 23 18:05:13.971167 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1655/3260] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:13 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1280 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:13.985257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-289fa700-e0ef-45a8-88cd-c8ec65419342 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:13.990109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-289fa700-e0ef-45a8-88cd-c8ec65419342 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:14.009948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-289fa700-e0ef-45a8-88cd-c8ec65419342 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:14.016544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-289fa700-e0ef-45a8-88cd-c8ec65419342 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:14.017276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-289fa700-e0ef-45a8-88cd-c8ec65419342 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:14.018112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-289fa700-e0ef-45a8-88cd-c8ec65419342 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:14.018695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-289fa700-e0ef-45a8-88cd-c8ec65419342 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:14.019200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-289fa700-e0ef-45a8-88cd-c8ec65419342 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:14.246158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-14367826-2d62-4564-8089-7c0c061c3da4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:14.258750 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-14367826-2d62-4564-8089-7c0c061c3da4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1315 microversion: 2.1 time: 0.917447 Aug 23 18:05:14.274667 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1606/3261] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:13 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1315 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:14.291751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-300664eb-a8dc-4d5d-8507-9b094c2e03ec tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:14.292393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-300664eb-a8dc-4d5d-8507-9b094c2e03ec tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 115be13c-aace-4476-be96-7ae226d6fe10] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:14.344649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-300664eb-a8dc-4d5d-8507-9b094c2e03ec tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:14.345949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-300664eb-a8dc-4d5d-8507-9b094c2e03ec tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:14.347131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-300664eb-a8dc-4d5d-8507-9b094c2e03ec tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:14.347870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-300664eb-a8dc-4d5d-8507-9b094c2e03ec tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:14.356682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-300664eb-a8dc-4d5d-8507-9b094c2e03ec tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:14.357057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-300664eb-a8dc-4d5d-8507-9b094c2e03ec tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:14.439633 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-289fa700-e0ef-45a8-88cd-c8ec65419342 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action" status: 200 len: 14 microversion: 2.1 time: 0.465977 Aug 23 18:05:14.440279 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1656/3262] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:13 2022] POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action => generated 14 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:05:14.445789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-fc64c5cd-faaa-43dd-97b4-a2e23403f630 req-d500537c-ecd3-4432-a810-7ca34efb8f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0cc7aec-9266-46f5-a751-846260cc0f85", "tag": "6df2430e-f90f-4c67-8461-00dc8fe0b244"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:14.479772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fc64c5cd-faaa-43dd-97b4-a2e23403f630 req-d500537c-ecd3-4432-a810-7ca34efb8f48 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:14.489249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fc64c5cd-faaa-43dd-97b4-a2e23403f630 req-d500537c-ecd3-4432-a810-7ca34efb8f48 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:14.490614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fc64c5cd-faaa-43dd-97b4-a2e23403f630 req-d500537c-ecd3-4432-a810-7ca34efb8f48 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:14.529065 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-fc64c5cd-faaa-43dd-97b4-a2e23403f630 req-d500537c-ecd3-4432-a810-7ca34efb8f48 service nova] Creating event network-changed:6df2430e-f90f-4c67-8461-00dc8fe0b244 for instance a0cc7aec-9266-46f5-a751-846260cc0f85 on n-h1-850468-16 Aug 23 18:05:14.538338 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-fc64c5cd-faaa-43dd-97b4-a2e23403f630 req-d500537c-ecd3-4432-a810-7ca34efb8f48 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096009 Aug 23 18:05:14.539311 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1657/3263] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:14.549187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f6bb816f-ce00-414b-a55f-11e30a902f13 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec38c0d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:14.669274 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f6bb816f-ce00-414b-a55f-11e30a902f13 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.123902 Aug 23 18:05:14.671106 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1658/3264] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:14 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:14.800082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-300664eb-a8dc-4d5d-8507-9b094c2e03ec tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:14.835684 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-300664eb-a8dc-4d5d-8507-9b094c2e03ec tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10" status: 200 len: 1474 microversion: 2.1 time: 0.559461 Aug 23 18:05:14.841585 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1607/3265] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:14 2022] GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10 => generated 1474 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:14.981624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-53107b0f-55dc-4b12-9768-0db98b8b15ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:14.984570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-53107b0f-55dc-4b12-9768-0db98b8b15ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:15.000070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53107b0f-55dc-4b12-9768-0db98b8b15ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:15.002797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53107b0f-55dc-4b12-9768-0db98b8b15ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:15.007414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53107b0f-55dc-4b12-9768-0db98b8b15ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:15.008198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53107b0f-55dc-4b12-9768-0db98b8b15ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:15.008706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53107b0f-55dc-4b12-9768-0db98b8b15ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:15.009142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53107b0f-55dc-4b12-9768-0db98b8b15ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:15.144394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-53107b0f-55dc-4b12-9768-0db98b8b15ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:15.157212 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-53107b0f-55dc-4b12-9768-0db98b8b15ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1280 microversion: 2.1 time: 0.182323 Aug 23 18:05:15.163111 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1659/3266] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:14 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1280 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:15.282992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1befce77-ced5-4241-9c48-fdecbad953c6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:15.283607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1befce77-ced5-4241-9c48-fdecbad953c6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:15.303426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1befce77-ced5-4241-9c48-fdecbad953c6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:15.303986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1befce77-ced5-4241-9c48-fdecbad953c6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:15.307392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1befce77-ced5-4241-9c48-fdecbad953c6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:15.308598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1befce77-ced5-4241-9c48-fdecbad953c6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:15.309278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1befce77-ced5-4241-9c48-fdecbad953c6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:15.309886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1befce77-ced5-4241-9c48-fdecbad953c6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:15.451618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f802e623-95bf-4219-a121-ce7664c70fd8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:15.454821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f802e623-95bf-4219-a121-ce7664c70fd8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:15.470360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f802e623-95bf-4219-a121-ce7664c70fd8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:15.478001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f802e623-95bf-4219-a121-ce7664c70fd8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:15.478491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f802e623-95bf-4219-a121-ce7664c70fd8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:15.484590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f802e623-95bf-4219-a121-ce7664c70fd8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:15.485362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f802e623-95bf-4219-a121-ce7664c70fd8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:15.486009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f802e623-95bf-4219-a121-ce7664c70fd8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:15.546679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:16.708434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1befce77-ced5-4241-9c48-fdecbad953c6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:16.732128 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1befce77-ced5-4241-9c48-fdecbad953c6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1315 microversion: 2.1 time: 1.453460 Aug 23 18:05:16.735237 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1608/3267] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:15 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1315 bytes in 1459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:16.748140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-da00ce94-811c-48f2-b857-074365c14f72 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ed2ee280>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:16.858805 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-da00ce94-811c-48f2-b857-074365c14f72 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.119736 Aug 23 18:05:16.868032 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1609/3268] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:16 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:16.875315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d5092da6-9c7e-4af1-97c3-8b79193a43b3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:16.876338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d5092da6-9c7e-4af1-97c3-8b79193a43b3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 115be13c-aace-4476-be96-7ae226d6fe10] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:16.884448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5092da6-9c7e-4af1-97c3-8b79193a43b3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:16.885372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5092da6-9c7e-4af1-97c3-8b79193a43b3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:16.886078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5092da6-9c7e-4af1-97c3-8b79193a43b3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:16.887672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5092da6-9c7e-4af1-97c3-8b79193a43b3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:16.888700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5092da6-9c7e-4af1-97c3-8b79193a43b3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:16.889642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5092da6-9c7e-4af1-97c3-8b79193a43b3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:17.569810 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f802e623-95bf-4219-a121-ce7664c70fd8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action" status: 200 len: 14 microversion: 2.1 time: 2.122327 Aug 23 18:05:17.573575 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1660/3269] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:15 2022] POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action => generated 14 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 18:05:17.586558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d733a0ee-1f86-48ab-b2b1-7e8517e7f314 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:17.594162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d733a0ee-1f86-48ab-b2b1-7e8517e7f314 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:17.600542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:17.630002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=16 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:17.671201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d733a0ee-1f86-48ab-b2b1-7e8517e7f314 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:17.672780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d733a0ee-1f86-48ab-b2b1-7e8517e7f314 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:17.673340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d733a0ee-1f86-48ab-b2b1-7e8517e7f314 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:17.674626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d733a0ee-1f86-48ab-b2b1-7e8517e7f314 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:17.677653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d733a0ee-1f86-48ab-b2b1-7e8517e7f314 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:17.679054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d733a0ee-1f86-48ab-b2b1-7e8517e7f314 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:17.751366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:18.178187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d733a0ee-1f86-48ab-b2b1-7e8517e7f314 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:18.230690 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d733a0ee-1f86-48ab-b2b1-7e8517e7f314 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.641356 Aug 23 18:05:18.248276 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1661/3270] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:17 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:18.254498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6de3ff43-c9de-49f4-94b6-d03e7b25a344 req-74d8b579-eb47-4329-bfa0-7c6e1c9077ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba643625-f7fc-4d86-b706-fd5957739f37", "name": "network-vif-deleted", "tag": "c752bba4-1778-4a12-9bcd-7ca38827dfc6"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:18.254965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:18.290928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6de3ff43-c9de-49f4-94b6-d03e7b25a344 req-74d8b579-eb47-4329-bfa0-7c6e1c9077ef service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:18.292046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6de3ff43-c9de-49f4-94b6-d03e7b25a344 req-74d8b579-eb47-4329-bfa0-7c6e1c9077ef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:18.292963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6de3ff43-c9de-49f4-94b6-d03e7b25a344 req-74d8b579-eb47-4329-bfa0-7c6e1c9077ef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:18.356764 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6de3ff43-c9de-49f4-94b6-d03e7b25a344 req-74d8b579-eb47-4329-bfa0-7c6e1c9077ef service nova] Creating event network-vif-deleted:c752bba4-1778-4a12-9bcd-7ca38827dfc6 for instance ba643625-f7fc-4d86-b706-fd5957739f37 on n-h2-850468-16 Aug 23 18:05:18.373348 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6de3ff43-c9de-49f4-94b6-d03e7b25a344 req-74d8b579-eb47-4329-bfa0-7c6e1c9077ef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123203 Aug 23 18:05:18.378858 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1662/3271] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:18.391725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9ca726a0-07dc-4ff0-8ff4-72fb8f8d5a1e tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:18.392682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9ca726a0-07dc-4ff0-8ff4-72fb8f8d5a1e tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:18.440982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ca726a0-07dc-4ff0-8ff4-72fb8f8d5a1e tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:18.441490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ca726a0-07dc-4ff0-8ff4-72fb8f8d5a1e tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:18.444947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ca726a0-07dc-4ff0-8ff4-72fb8f8d5a1e tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:18.448392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ca726a0-07dc-4ff0-8ff4-72fb8f8d5a1e tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:18.448954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ca726a0-07dc-4ff0-8ff4-72fb8f8d5a1e tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:18.449650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ca726a0-07dc-4ff0-8ff4-72fb8f8d5a1e tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:18.475555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d5092da6-9c7e-4af1-97c3-8b79193a43b3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:18.486850 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d5092da6-9c7e-4af1-97c3-8b79193a43b3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10" status: 200 len: 1474 microversion: 2.1 time: 1.615759 Aug 23 18:05:18.505640 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1610/3272] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:16 2022] GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10 => generated 1474 bytes in 1636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:18.513747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b5d65814-d807-4015-8b14-86c0427c6a8f tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfce6af0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:18.659827 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b5d65814-d807-4015-8b14-86c0427c6a8f tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.152529 Aug 23 18:05:18.661159 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1611/3273] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:18 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:18.675922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1b95e04e-6536-42e4-a9a1-b92dc490ffc7 req-9b8cbbc2-4dfd-4f57-bf27-89ff67516673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a2f8a54-72ff-43c4-a31e-76b29723e3e1", "name": "network-vif-plugged", "status": "completed", "tag": "d48d38dd-3b1f-4db9-957e-46b040401b51"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:18.707037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1b95e04e-6536-42e4-a9a1-b92dc490ffc7 req-9b8cbbc2-4dfd-4f57-bf27-89ff67516673 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:18.707700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1b95e04e-6536-42e4-a9a1-b92dc490ffc7 req-9b8cbbc2-4dfd-4f57-bf27-89ff67516673 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:18.711027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1b95e04e-6536-42e4-a9a1-b92dc490ffc7 req-9b8cbbc2-4dfd-4f57-bf27-89ff67516673 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:18.737579 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1b95e04e-6536-42e4-a9a1-b92dc490ffc7 req-9b8cbbc2-4dfd-4f57-bf27-89ff67516673 service nova] Creating event network-vif-plugged:d48d38dd-3b1f-4db9-957e-46b040401b51 for instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 on n-h2-850468-16 Aug 23 18:05:18.753041 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1b95e04e-6536-42e4-a9a1-b92dc490ffc7 req-9b8cbbc2-4dfd-4f57-bf27-89ff67516673 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087116 Aug 23 18:05:18.753935 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1612/3274] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:18.765622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cd8ea2f5-caf4-450b-b2eb-ab0936b0d023 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:18.797919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cd8ea2f5-caf4-450b-b2eb-ab0936b0d023 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:18.816307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd8ea2f5-caf4-450b-b2eb-ab0936b0d023 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:18.817433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd8ea2f5-caf4-450b-b2eb-ab0936b0d023 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:18.818074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd8ea2f5-caf4-450b-b2eb-ab0936b0d023 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:18.819462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd8ea2f5-caf4-450b-b2eb-ab0936b0d023 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:18.820086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd8ea2f5-caf4-450b-b2eb-ab0936b0d023 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:18.820672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd8ea2f5-caf4-450b-b2eb-ab0936b0d023 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:18.907222 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cd8ea2f5-caf4-450b-b2eb-ab0936b0d023 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action" status: 200 len: 14 microversion: 2.1 time: 0.149628 Aug 23 18:05:18.910222 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1613/3275] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:18 2022] POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:05:19.254052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81044583-bf2b-49c0-829f-e5992b5473bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:19.254797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-81044583-bf2b-49c0-829f-e5992b5473bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:19.266206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81044583-bf2b-49c0-829f-e5992b5473bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:19.272160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81044583-bf2b-49c0-829f-e5992b5473bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:19.272719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81044583-bf2b-49c0-829f-e5992b5473bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:19.273594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81044583-bf2b-49c0-829f-e5992b5473bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:19.274073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81044583-bf2b-49c0-829f-e5992b5473bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:19.274506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81044583-bf2b-49c0-829f-e5992b5473bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:19.648019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9ca726a0-07dc-4ff0-8ff4-72fb8f8d5a1e tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:19.688765 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9ca726a0-07dc-4ff0-8ff4-72fb8f8d5a1e tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1315 microversion: 2.1 time: 1.302591 Aug 23 18:05:19.712234 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1663/3276] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:18 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1315 bytes in 1332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:19.730582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-06b09c9d-7a1e-402c-a3e2-1aa036ed1b38 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:19.742644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-06b09c9d-7a1e-402c-a3e2-1aa036ed1b38 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 115be13c-aace-4476-be96-7ae226d6fe10] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:19.769831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06b09c9d-7a1e-402c-a3e2-1aa036ed1b38 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:19.772080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06b09c9d-7a1e-402c-a3e2-1aa036ed1b38 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:19.774173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06b09c9d-7a1e-402c-a3e2-1aa036ed1b38 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:19.775861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06b09c9d-7a1e-402c-a3e2-1aa036ed1b38 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:19.777571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06b09c9d-7a1e-402c-a3e2-1aa036ed1b38 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:19.780409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06b09c9d-7a1e-402c-a3e2-1aa036ed1b38 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:19.903769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81044583-bf2b-49c0-829f-e5992b5473bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:19.920098 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81044583-bf2b-49c0-829f-e5992b5473bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.670312 Aug 23 18:05:19.921275 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1614/3277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:19 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:19.939812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4dca8596-9c0f-492e-b19c-de0919dd26b5 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfb8d0d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:20.053592 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4dca8596-9c0f-492e-b19c-de0919dd26b5 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.131042 Aug 23 18:05:20.054654 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1615/3278] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:19 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:20.066804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-06b09c9d-7a1e-402c-a3e2-1aa036ed1b38 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:20.067872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0d2c075a-4bb0-4608-a068-a65ec6262724 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:20.070403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0d2c075a-4bb0-4608-a068-a65ec6262724 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:20.079385 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-06b09c9d-7a1e-402c-a3e2-1aa036ed1b38 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10" status: 200 len: 1432 microversion: 2.1 time: 0.364579 Aug 23 18:05:20.085074 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1664/3279] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:19 2022] GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10 => generated 1432 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:20.086783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d2c075a-4bb0-4608-a068-a65ec6262724 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:20.087395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d2c075a-4bb0-4608-a068-a65ec6262724 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:20.092316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d2c075a-4bb0-4608-a068-a65ec6262724 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:20.093231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d2c075a-4bb0-4608-a068-a65ec6262724 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:20.093821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d2c075a-4bb0-4608-a068-a65ec6262724 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:20.094370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d2c075a-4bb0-4608-a068-a65ec6262724 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:20.162323 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0d2c075a-4bb0-4608-a068-a65ec6262724 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action" status: 200 len: 14 microversion: 2.1 time: 0.098457 Aug 23 18:05:20.163104 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1616/3280] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:20 2022] POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:05:20.209246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-65b28329-a568-427a-bc06-3cd6af5e6fff req-c32c06da-3ede-476d-94bf-d9808b8cce5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "115be13c-aace-4476-be96-7ae226d6fe10", "name": "network-vif-deleted", "tag": "f371eefc-d9b1-4401-a319-ec95d61fbeaa"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:20.295289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-65b28329-a568-427a-bc06-3cd6af5e6fff req-c32c06da-3ede-476d-94bf-d9808b8cce5c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:20.296156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-65b28329-a568-427a-bc06-3cd6af5e6fff req-c32c06da-3ede-476d-94bf-d9808b8cce5c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:20.297617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-65b28329-a568-427a-bc06-3cd6af5e6fff req-c32c06da-3ede-476d-94bf-d9808b8cce5c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:20.343732 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-65b28329-a568-427a-bc06-3cd6af5e6fff req-c32c06da-3ede-476d-94bf-d9808b8cce5c service nova] Creating event network-vif-deleted:f371eefc-d9b1-4401-a319-ec95d61fbeaa for instance 115be13c-aace-4476-be96-7ae226d6fe10 on n-h1-850468-16 Aug 23 18:05:20.358290 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-65b28329-a568-427a-bc06-3cd6af5e6fff req-c32c06da-3ede-476d-94bf-d9808b8cce5c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152605 Aug 23 18:05:20.362361 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1665/3281] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:20.718197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-69c238d9-8621-4907-a064-d40b2159872d tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:20.719936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-69c238d9-8621-4907-a064-d40b2159872d tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:20.760938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69c238d9-8621-4907-a064-d40b2159872d tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:20.765972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69c238d9-8621-4907-a064-d40b2159872d tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:20.766445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69c238d9-8621-4907-a064-d40b2159872d tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:20.770647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69c238d9-8621-4907-a064-d40b2159872d tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:20.774024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69c238d9-8621-4907-a064-d40b2159872d tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:20.779169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69c238d9-8621-4907-a064-d40b2159872d tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:20.951064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a3b8863b-de09-48d6-aebb-2a75e0dea3ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:20.952550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a3b8863b-de09-48d6-aebb-2a75e0dea3ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:20.966387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:20.968501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3b8863b-de09-48d6-aebb-2a75e0dea3ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:20.969500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3b8863b-de09-48d6-aebb-2a75e0dea3ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:20.970257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3b8863b-de09-48d6-aebb-2a75e0dea3ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:20.971306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3b8863b-de09-48d6-aebb-2a75e0dea3ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:20.972162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3b8863b-de09-48d6-aebb-2a75e0dea3ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:20.972870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3b8863b-de09-48d6-aebb-2a75e0dea3ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:21.633643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-69c238d9-8621-4907-a064-d40b2159872d tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:21.641973 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-69c238d9-8621-4907-a064-d40b2159872d tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1315 microversion: 2.1 time: 0.928981 Aug 23 18:05:21.655261 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1617/3282] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:20 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1315 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:21.666193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8fe96125-36ca-48dc-876a-9d353802cb01 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec264550>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:21.729436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a3b8863b-de09-48d6-aebb-2a75e0dea3ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:21.744436 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a3b8863b-de09-48d6-aebb-2a75e0dea3ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.798545 Aug 23 18:05:21.764651 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1666/3283] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:20 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:21.772725 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8fe96125-36ca-48dc-876a-9d353802cb01 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.116148 Aug 23 18:05:21.780271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a722b245-c3fc-41f1-95cc-3cdcaeb2ec4c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:21.798353 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1618/3284] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:21 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:21.798353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ecda3fb-78d8-4e5e-91b4-7a10302353a3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:21.799538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a722b245-c3fc-41f1-95cc-3cdcaeb2ec4c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 115be13c-aace-4476-be96-7ae226d6fe10] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:21.812391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8ecda3fb-78d8-4e5e-91b4-7a10302353a3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:21.831106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a722b245-c3fc-41f1-95cc-3cdcaeb2ec4c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:21.834289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a722b245-c3fc-41f1-95cc-3cdcaeb2ec4c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:21.834954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a722b245-c3fc-41f1-95cc-3cdcaeb2ec4c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:21.838657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ecda3fb-78d8-4e5e-91b4-7a10302353a3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:21.839718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a722b245-c3fc-41f1-95cc-3cdcaeb2ec4c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:21.841631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a722b245-c3fc-41f1-95cc-3cdcaeb2ec4c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:21.845205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a722b245-c3fc-41f1-95cc-3cdcaeb2ec4c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:21.847248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ecda3fb-78d8-4e5e-91b4-7a10302353a3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:21.849711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ecda3fb-78d8-4e5e-91b4-7a10302353a3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:21.851985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ecda3fb-78d8-4e5e-91b4-7a10302353a3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:21.853073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ecda3fb-78d8-4e5e-91b4-7a10302353a3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:21.856110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ecda3fb-78d8-4e5e-91b4-7a10302353a3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:21.895514 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-a722b245-c3fc-41f1-95cc-3cdcaeb2ec4c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] HTTP exception thrown: Instance 115be13c-aace-4476-be96-7ae226d6fe10 could not be found. Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a722b245-c3fc-41f1-95cc-3cdcaeb2ec4c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Request method failure captured: Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10 HTTP/1.1 Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXz-QcbvLEqfM5Fvm_6RWB9j3Vx6VI06EpMZHbE0XCyFvEdeIqxZZXm4RDDnTqct29gAslo9Hq7JYktSYJNWsvk9gUtWiSrTwDWVWpwplP-E4k1v0FwDMzIdXpFl3ZeTFc0XOtKuNfFs_K9ET0qEhfYCkPdyTKnIJGg4IT5AUJTxMs Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}] Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: cd9fba74d93549eab6dd981627cbd7f8 Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 115be13c-aace-4476-be96-7ae226d6fe10 could not be found. Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '115be13c-aace-4476-be96-7ae226d6fe10'} Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 115be13c-aace-4476-be96-7ae226d6fe10 could not be found. Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 115be13c-aace-4476-be96-7ae226d6fe10 could not be found. Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:21.909671 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:21.914074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:21.914074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:21.914074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:21.914074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:21.914074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:21.914074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 115be13c-aace-4476-be96-7ae226d6fe10 could not be found. Aug 23 18:05:21.914074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:21.918940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a722b245-c3fc-41f1-95cc-3cdcaeb2ec4c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Returning 404 to user: Instance 115be13c-aace-4476-be96-7ae226d6fe10 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:21.927867 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a722b245-c3fc-41f1-95cc-3cdcaeb2ec4c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10" status: 404 len: 111 microversion: 2.1 time: 0.159817 Aug 23 18:05:21.929031 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1667/3285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:21 2022] GET /compute/v2.1/servers/115be13c-aace-4476-be96-7ae226d6fe10 => generated 111 bytes in 164 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:21.951101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7fef3e80-3730-4448-82c6-6f67ae0e4e0c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:21.954834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7fef3e80-3730-4448-82c6-6f67ae0e4e0c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: ba643625-f7fc-4d86-b706-fd5957739f37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:21.966186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fef3e80-3730-4448-82c6-6f67ae0e4e0c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:21.967140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fef3e80-3730-4448-82c6-6f67ae0e4e0c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:21.967892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fef3e80-3730-4448-82c6-6f67ae0e4e0c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:21.968858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fef3e80-3730-4448-82c6-6f67ae0e4e0c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:21.969548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fef3e80-3730-4448-82c6-6f67ae0e4e0c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:21.970338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fef3e80-3730-4448-82c6-6f67ae0e4e0c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:21.986529 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8ecda3fb-78d8-4e5e-91b4-7a10302353a3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action" status: 200 len: 14 microversion: 2.1 time: 0.189173 Aug 23 18:05:21.987706 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1619/3286] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:21 2022] POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action => generated 14 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:05:21.999417 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-7fef3e80-3730-4448-82c6-6f67ae0e4e0c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] HTTP exception thrown: Instance ba643625-f7fc-4d86-b706-fd5957739f37 could not be found. Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7fef3e80-3730-4448-82c6-6f67ae0e4e0c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Request method failure captured: Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 HTTP/1.1 Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXz-QcbvLEqfM5Fvm_6RWB9j3Vx6VI06EpMZHbE0XCyFvEdeIqxZZXm4RDDnTqct29gAslo9Hq7JYktSYJNWsvk9gUtWiSrTwDWVWpwplP-E4k1v0FwDMzIdXpFl3ZeTFc0XOtKuNfFs_K9ET0qEhfYCkPdyTKnIJGg4IT5AUJTxMs Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}] Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: cd9fba74d93549eab6dd981627cbd7f8 Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance ba643625-f7fc-4d86-b706-fd5957739f37 could not be found. Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'ba643625-f7fc-4d86-b706-fd5957739f37'} Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba643625-f7fc-4d86-b706-fd5957739f37 could not be found. Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba643625-f7fc-4d86-b706-fd5957739f37 could not be found. Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:22.001134 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:22.005095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:22.005095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:22.005095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:22.005095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:22.005095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:22.005095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba643625-f7fc-4d86-b706-fd5957739f37 could not be found. Aug 23 18:05:22.005095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:22.008790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7fef3e80-3730-4448-82c6-6f67ae0e4e0c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Returning 404 to user: Instance ba643625-f7fc-4d86-b706-fd5957739f37 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:22.011157 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7fef3e80-3730-4448-82c6-6f67ae0e4e0c tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37" status: 404 len: 111 microversion: 2.1 time: 0.076670 Aug 23 18:05:22.011157 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1668/3287] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:21 2022] GET /compute/v2.1/servers/ba643625-f7fc-4d86-b706-fd5957739f37 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:22.021865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2149d7e6-22fd-4e6d-a184-e8ab6c9e91ee tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:22.131407 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2149d7e6-22fd-4e6d-a184-e8ab6c9e91ee tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/251f1c1a-dc2e-49fe-afa8-4dae7e69d420" status: 204 len: 0 microversion: 2.1 time: 0.115181 Aug 23 18:05:22.132326 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1620/3288] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Aug 23 18:05:22 2022] DELETE /compute/v2.1/os-server-groups/251f1c1a-dc2e-49fe-afa8-4dae7e69d420 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:05:22.145671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2e495f35-52be-4f9d-b8ac-46c7df865b42 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:22.146248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2e495f35-52be-4f9d-b8ac-46c7df865b42 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: e1adfb52-d290-451a-89bf-4d63824150c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:22.172375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e495f35-52be-4f9d-b8ac-46c7df865b42 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:22.172859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e495f35-52be-4f9d-b8ac-46c7df865b42 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:22.194517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e495f35-52be-4f9d-b8ac-46c7df865b42 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:22.196741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e495f35-52be-4f9d-b8ac-46c7df865b42 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:22.197227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e495f35-52be-4f9d-b8ac-46c7df865b42 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:22.197888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e495f35-52be-4f9d-b8ac-46c7df865b42 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:22.291306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2e495f35-52be-4f9d-b8ac-46c7df865b42 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: e1adfb52-d290-451a-89bf-4d63824150c5] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:05:22.452140 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2e495f35-52be-4f9d-b8ac-46c7df865b42 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5" status: 204 len: 0 microversion: 2.1 time: 0.313867 Aug 23 18:05:22.453201 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1669/3289] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:05:22 2022] DELETE /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:22.462508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6750ec7b-4b80-4529-bc06-c260fa419e57 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:22.463663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6750ec7b-4b80-4529-bc06-c260fa419e57 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:22.478771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6750ec7b-4b80-4529-bc06-c260fa419e57 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:22.481136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6750ec7b-4b80-4529-bc06-c260fa419e57 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:22.489760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-14d7ef9b-892b-4271-a62c-a9912152de2d req-71b3ee5e-c20b-49e2-b708-5e0e455a8052 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea6af0b0-dd81-47c9-ba04-42c3612b8eec", "tag": "f01e6452-6754-4b61-9a8a-6d65fe07fa27"}, {"name": "network-changed", "server_uuid": "ed1a8703-4973-4c42-859a-5734d134f015", "tag": "28cb5722-a367-4d3b-a963-3b1846155944"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:22.496570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6750ec7b-4b80-4529-bc06-c260fa419e57 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:22.500462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6750ec7b-4b80-4529-bc06-c260fa419e57 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:22.503363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6750ec7b-4b80-4529-bc06-c260fa419e57 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:22.505360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6750ec7b-4b80-4529-bc06-c260fa419e57 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:22.518167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-14d7ef9b-892b-4271-a62c-a9912152de2d req-71b3ee5e-c20b-49e2-b708-5e0e455a8052 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:22.522716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-14d7ef9b-892b-4271-a62c-a9912152de2d req-71b3ee5e-c20b-49e2-b708-5e0e455a8052 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:22.524243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-14d7ef9b-892b-4271-a62c-a9912152de2d req-71b3ee5e-c20b-49e2-b708-5e0e455a8052 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:22.576590 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-14d7ef9b-892b-4271-a62c-a9912152de2d req-71b3ee5e-c20b-49e2-b708-5e0e455a8052 service nova] Creating event network-changed:f01e6452-6754-4b61-9a8a-6d65fe07fa27 for instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec on n-h1-850468-16 Aug 23 18:05:22.580728 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-14d7ef9b-892b-4271-a62c-a9912152de2d req-71b3ee5e-c20b-49e2-b708-5e0e455a8052 service nova] Creating event network-changed:28cb5722-a367-4d3b-a963-3b1846155944 for instance ed1a8703-4973-4c42-859a-5734d134f015 on n-h1-850468-16 Aug 23 18:05:22.593335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6750ec7b-4b80-4529-bc06-c260fa419e57 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:05:22.597066 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-14d7ef9b-892b-4271-a62c-a9912152de2d req-71b3ee5e-c20b-49e2-b708-5e0e455a8052 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.112886 Aug 23 18:05:22.598137 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1670/3290] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:22 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:22.671167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e6c2be82-25ad-4258-aa69-b1485df37bc4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:22.679843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e6c2be82-25ad-4258-aa69-b1485df37bc4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:22.711815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6c2be82-25ad-4258-aa69-b1485df37bc4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:22.716554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6c2be82-25ad-4258-aa69-b1485df37bc4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:22.717608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6c2be82-25ad-4258-aa69-b1485df37bc4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:22.718700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6c2be82-25ad-4258-aa69-b1485df37bc4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:22.720895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6c2be82-25ad-4258-aa69-b1485df37bc4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:22.721508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6c2be82-25ad-4258-aa69-b1485df37bc4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:22.800863 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6750ec7b-4b80-4529-bc06-c260fa419e57 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 204 len: 0 microversion: 2.1 time: 0.341557 Aug 23 18:05:22.805389 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1621/3291] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:05:22 2022] DELETE /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:22.818685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3579d19c-0653-4411-b726-01fd6db36c48 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:22.823761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3579d19c-0653-4411-b726-01fd6db36c48 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:22.828651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:22.848657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3579d19c-0653-4411-b726-01fd6db36c48 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:22.852202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3579d19c-0653-4411-b726-01fd6db36c48 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:22.853814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3579d19c-0653-4411-b726-01fd6db36c48 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:22.855423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3579d19c-0653-4411-b726-01fd6db36c48 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:22.857220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3579d19c-0653-4411-b726-01fd6db36c48 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:22.858380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3579d19c-0653-4411-b726-01fd6db36c48 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:23.114622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e6c2be82-25ad-4258-aa69-b1485df37bc4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:23.135929 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e6c2be82-25ad-4258-aa69-b1485df37bc4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1315 microversion: 2.1 time: 0.469400 Aug 23 18:05:23.139911 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1671/3292] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:22 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1315 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:23.150803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a75197f-45bc-47af-9fe7-a45383bb09f7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfa32790>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:23.265237 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a75197f-45bc-47af-9fe7-a45383bb09f7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.123829 Aug 23 18:05:23.282617 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1672/3293] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:23 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:23.288580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8cecfb0c-f643-43c2-93a8-866c21a9bfb8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:23.289218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8cecfb0c-f643-43c2-93a8-866c21a9bfb8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: e1adfb52-d290-451a-89bf-4d63824150c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:23.297231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cecfb0c-f643-43c2-93a8-866c21a9bfb8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:23.297898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cecfb0c-f643-43c2-93a8-866c21a9bfb8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:23.298164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cecfb0c-f643-43c2-93a8-866c21a9bfb8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:23.303498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cecfb0c-f643-43c2-93a8-866c21a9bfb8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:23.313641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cecfb0c-f643-43c2-93a8-866c21a9bfb8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:23.314560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cecfb0c-f643-43c2-93a8-866c21a9bfb8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:23.430427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3579d19c-0653-4411-b726-01fd6db36c48 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:23.443607 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3579d19c-0653-4411-b726-01fd6db36c48 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.636239 Aug 23 18:05:23.454734 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1622/3294] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:22 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:23.460747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c56da52e-e35e-480f-8bd6-a1a64355b0ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:23.463446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c56da52e-e35e-480f-8bd6-a1a64355b0ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:23.480765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c56da52e-e35e-480f-8bd6-a1a64355b0ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:23.484640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c56da52e-e35e-480f-8bd6-a1a64355b0ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:23.485376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c56da52e-e35e-480f-8bd6-a1a64355b0ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:23.491555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c56da52e-e35e-480f-8bd6-a1a64355b0ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:23.492361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c56da52e-e35e-480f-8bd6-a1a64355b0ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:23.493050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c56da52e-e35e-480f-8bd6-a1a64355b0ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:23.581247 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c56da52e-e35e-480f-8bd6-a1a64355b0ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action" status: 200 len: 8205 microversion: 2.1 time: 0.124128 Aug 23 18:05:23.582483 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1623/3295] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:23 2022] POST /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d/action => generated 8205 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:23.605789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a6992be4-7e32-4c4f-ab10-bb32b066c579 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:23.609414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a6992be4-7e32-4c4f-ab10-bb32b066c579 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:23.635351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6992be4-7e32-4c4f-ab10-bb32b066c579 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:23.637230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6992be4-7e32-4c4f-ab10-bb32b066c579 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:23.637934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6992be4-7e32-4c4f-ab10-bb32b066c579 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:23.638985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6992be4-7e32-4c4f-ab10-bb32b066c579 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:23.639677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6992be4-7e32-4c4f-ab10-bb32b066c579 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:23.640604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6992be4-7e32-4c4f-ab10-bb32b066c579 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:23.677084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8cecfb0c-f643-43c2-93a8-866c21a9bfb8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:23.687767 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8cecfb0c-f643-43c2-93a8-866c21a9bfb8 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5" status: 200 len: 1474 microversion: 2.1 time: 0.415077 Aug 23 18:05:23.689130 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1673/3296] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:23 2022] GET /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5 => generated 1474 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:23.919759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a6992be4-7e32-4c4f-ab10-bb32b066c579 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:23.932563 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a6992be4-7e32-4c4f-ab10-bb32b066c579 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.343597 Aug 23 18:05:23.934003 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1624/3297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:23 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:23.959391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5089bc76-9568-4557-9792-fad79c31f805 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:23.960016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5089bc76-9568-4557-9792-fad79c31f805 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:23.969216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5089bc76-9568-4557-9792-fad79c31f805 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:23.969704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5089bc76-9568-4557-9792-fad79c31f805 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:23.970140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5089bc76-9568-4557-9792-fad79c31f805 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:23.970879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5089bc76-9568-4557-9792-fad79c31f805 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:23.971329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5089bc76-9568-4557-9792-fad79c31f805 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:23.971769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5089bc76-9568-4557-9792-fad79c31f805 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:24.158791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2af59168-2643-4e35-a7b6-84b0c974c844 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:24.159492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2af59168-2643-4e35-a7b6-84b0c974c844 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:24.180049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2af59168-2643-4e35-a7b6-84b0c974c844 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:24.182221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2af59168-2643-4e35-a7b6-84b0c974c844 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:24.188022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2af59168-2643-4e35-a7b6-84b0c974c844 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:24.190438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2af59168-2643-4e35-a7b6-84b0c974c844 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:24.192571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2af59168-2643-4e35-a7b6-84b0c974c844 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:24.193293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2af59168-2643-4e35-a7b6-84b0c974c844 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:24.315122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5089bc76-9568-4557-9792-fad79c31f805 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:24.325590 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5089bc76-9568-4557-9792-fad79c31f805 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.370786 Aug 23 18:05:24.332889 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1674/3298] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:23 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:24.348204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-15a03ba6-3da0-4b28-a306-de451d7ebf00 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df9ddd30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:24.500429 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-15a03ba6-3da0-4b28-a306-de451d7ebf00 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.164088 Aug 23 18:05:24.509829 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1675/3299] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:24 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:24.524586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-65357353-7dd4-4607-844e-8311b9e8ec37 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:24.529620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-65357353-7dd4-4607-844e-8311b9e8ec37 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:24.555492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65357353-7dd4-4607-844e-8311b9e8ec37 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:24.556017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65357353-7dd4-4607-844e-8311b9e8ec37 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:24.556470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65357353-7dd4-4607-844e-8311b9e8ec37 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:24.558478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65357353-7dd4-4607-844e-8311b9e8ec37 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:24.559043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65357353-7dd4-4607-844e-8311b9e8ec37 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:24.559536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65357353-7dd4-4607-844e-8311b9e8ec37 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:24.646869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2af59168-2643-4e35-a7b6-84b0c974c844 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:24.659879 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2af59168-2643-4e35-a7b6-84b0c974c844 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1315 microversion: 2.1 time: 0.505217 Aug 23 18:05:24.663619 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1625/3300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:24 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1315 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:24.671789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a5c5b6b-bfd7-499a-b640-73f44c6c14f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:24.672395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6a5c5b6b-bfd7-499a-b640-73f44c6c14f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:24.693004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a5c5b6b-bfd7-499a-b640-73f44c6c14f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:24.693496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a5c5b6b-bfd7-499a-b640-73f44c6c14f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:24.693932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a5c5b6b-bfd7-499a-b640-73f44c6c14f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:24.694666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a5c5b6b-bfd7-499a-b640-73f44c6c14f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:24.695117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a5c5b6b-bfd7-499a-b640-73f44c6c14f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:24.698128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a5c5b6b-bfd7-499a-b640-73f44c6c14f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:24.940156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a5c5b6b-bfd7-499a-b640-73f44c6c14f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:24.951380 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a5c5b6b-bfd7-499a-b640-73f44c6c14f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.285801 Aug 23 18:05:24.969167 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1626/3301] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:24 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:24.974704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1c1ebe48-2363-4880-b180-54d3b66b455e req-0515f26a-0914-415b-985d-5a78656483aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0cc7aec-9266-46f5-a751-846260cc0f85", "name": "network-vif-plugged", "status": "completed", "tag": "6df2430e-f90f-4c67-8461-00dc8fe0b244"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:24.988410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1c1ebe48-2363-4880-b180-54d3b66b455e req-0515f26a-0914-415b-985d-5a78656483aa service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:24.989344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1c1ebe48-2363-4880-b180-54d3b66b455e req-0515f26a-0914-415b-985d-5a78656483aa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:24.990060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1c1ebe48-2363-4880-b180-54d3b66b455e req-0515f26a-0914-415b-985d-5a78656483aa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:24.995441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:25.006326 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1c1ebe48-2363-4880-b180-54d3b66b455e req-0515f26a-0914-415b-985d-5a78656483aa service nova] Creating event network-vif-plugged:6df2430e-f90f-4c67-8461-00dc8fe0b244 for instance a0cc7aec-9266-46f5-a751-846260cc0f85 on n-h1-850468-16 Aug 23 18:05:25.018480 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1c1ebe48-2363-4880-b180-54d3b66b455e req-0515f26a-0914-415b-985d-5a78656483aa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046063 Aug 23 18:05:25.020345 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1627/3302] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:25.028825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a7ee5a1c-91e3-4767-8ddc-ab841762ebc3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:25.029852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a7ee5a1c-91e3-4767-8ddc-ab841762ebc3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: e1adfb52-d290-451a-89bf-4d63824150c5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:25.036287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7ee5a1c-91e3-4767-8ddc-ab841762ebc3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:25.037221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7ee5a1c-91e3-4767-8ddc-ab841762ebc3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:25.038021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7ee5a1c-91e3-4767-8ddc-ab841762ebc3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:25.039268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7ee5a1c-91e3-4767-8ddc-ab841762ebc3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:25.039961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7ee5a1c-91e3-4767-8ddc-ab841762ebc3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:25.040598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7ee5a1c-91e3-4767-8ddc-ab841762ebc3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:25.213546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65357353-7dd4-4607-844e-8311b9e8ec37 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:25.233053 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-65357353-7dd4-4607-844e-8311b9e8ec37 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.726492 Aug 23 18:05:25.249625 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1676/3303] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:24 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:25.255824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef977c6a-f7b5-4cb4-9955-47fd1bb16271 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:25.256679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef977c6a-f7b5-4cb4-9955-47fd1bb16271 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:25.265048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef977c6a-f7b5-4cb4-9955-47fd1bb16271 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:25.265802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef977c6a-f7b5-4cb4-9955-47fd1bb16271 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:25.266442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef977c6a-f7b5-4cb4-9955-47fd1bb16271 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:25.267645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef977c6a-f7b5-4cb4-9955-47fd1bb16271 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:25.269326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef977c6a-f7b5-4cb4-9955-47fd1bb16271 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:25.270324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef977c6a-f7b5-4cb4-9955-47fd1bb16271 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:25.703300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef977c6a-f7b5-4cb4-9955-47fd1bb16271 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:25.722691 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef977c6a-f7b5-4cb4-9955-47fd1bb16271 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.468185 Aug 23 18:05:25.728570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1677/3304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:25 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:25.752036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7e93920-812c-4919-8f41-c8927e495e27 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ef260160>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:25.860572 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c7e93920-812c-4919-8f41-c8927e495e27 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.130552 Aug 23 18:05:25.861208 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1678/3305] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:25 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:25.873420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f30da50-ba4a-48fd-ad54-5c80c7c96030 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:25.874061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4f30da50-ba4a-48fd-ad54-5c80c7c96030 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:25.895088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f30da50-ba4a-48fd-ad54-5c80c7c96030 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:25.895605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f30da50-ba4a-48fd-ad54-5c80c7c96030 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:25.898489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f30da50-ba4a-48fd-ad54-5c80c7c96030 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:25.901198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f30da50-ba4a-48fd-ad54-5c80c7c96030 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:25.901828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f30da50-ba4a-48fd-ad54-5c80c7c96030 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:25.906220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f30da50-ba4a-48fd-ad54-5c80c7c96030 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:26.183524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4f30da50-ba4a-48fd-ad54-5c80c7c96030 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:26.194800 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4f30da50-ba4a-48fd-ad54-5c80c7c96030 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1315 microversion: 2.1 time: 0.328296 Aug 23 18:05:26.197769 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1679/3306] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:25 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:26.220811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fb89acb6-b91e-4dbd-9068-5b6258a86c9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:26.221770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fb89acb6-b91e-4dbd-9068-5b6258a86c9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:26.237020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb89acb6-b91e-4dbd-9068-5b6258a86c9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:26.237721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb89acb6-b91e-4dbd-9068-5b6258a86c9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:26.238441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb89acb6-b91e-4dbd-9068-5b6258a86c9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:26.242145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb89acb6-b91e-4dbd-9068-5b6258a86c9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:26.242935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb89acb6-b91e-4dbd-9068-5b6258a86c9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:26.243584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb89acb6-b91e-4dbd-9068-5b6258a86c9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:26.408796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fb89acb6-b91e-4dbd-9068-5b6258a86c9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Locking {{(pid=128808) lock /opt/stack/nova/nova/compute/api.py:4828}} Aug 23 18:05:26.503297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:26.636455 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fb89acb6-b91e-4dbd-9068-5b6258a86c9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.435174 Aug 23 18:05:26.644492 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1680/3307] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:26 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:05:26.654475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-580c6a5d-9b7f-4d62-9a00-879ce14419a1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:26.668817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-580c6a5d-9b7f-4d62-9a00-879ce14419a1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:26.682263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-580c6a5d-9b7f-4d62-9a00-879ce14419a1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:26.693206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-580c6a5d-9b7f-4d62-9a00-879ce14419a1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:26.694700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-580c6a5d-9b7f-4d62-9a00-879ce14419a1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:26.703496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-580c6a5d-9b7f-4d62-9a00-879ce14419a1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:26.704079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-580c6a5d-9b7f-4d62-9a00-879ce14419a1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:26.704482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-580c6a5d-9b7f-4d62-9a00-879ce14419a1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:27.136040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-580c6a5d-9b7f-4d62-9a00-879ce14419a1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:27.144410 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-580c6a5d-9b7f-4d62-9a00-879ce14419a1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.498158 Aug 23 18:05:27.155420 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1681/3308] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:26 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:27.167967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-333ad2c1-993e-4329-bc19-ceee8a96e98f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:27.168598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-333ad2c1-993e-4329-bc19-ceee8a96e98f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:27.196664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-333ad2c1-993e-4329-bc19-ceee8a96e98f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:27.197281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-333ad2c1-993e-4329-bc19-ceee8a96e98f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:27.203506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-333ad2c1-993e-4329-bc19-ceee8a96e98f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:27.204395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-333ad2c1-993e-4329-bc19-ceee8a96e98f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:27.204885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-333ad2c1-993e-4329-bc19-ceee8a96e98f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:27.205316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-333ad2c1-993e-4329-bc19-ceee8a96e98f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:27.542095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a7ee5a1c-91e3-4767-8ddc-ab841762ebc3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:27.554570 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a7ee5a1c-91e3-4767-8ddc-ab841762ebc3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5" status: 200 len: 1474 microversion: 2.1 time: 2.532686 Aug 23 18:05:27.563915 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1628/3309] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:25 2022] GET /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5 => generated 1474 bytes in 2540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:27.577976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-cacd2044-25cd-4b48-b189-b2d496b00f00 req-efb81579-1eaa-411e-a402-18f64792b0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1adfb52-d290-451a-89bf-4d63824150c5", "name": "network-vif-deleted", "tag": "877ab05b-84d2-46a6-a689-4dfd4bb855ca"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:27.615102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-333ad2c1-993e-4329-bc19-ceee8a96e98f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:27.640018 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-333ad2c1-993e-4329-bc19-ceee8a96e98f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.481175 Aug 23 18:05:27.641599 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1682/3310] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:27 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:27.655416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cacd2044-25cd-4b48-b189-b2d496b00f00 req-efb81579-1eaa-411e-a402-18f64792b0d8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:27.655416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cacd2044-25cd-4b48-b189-b2d496b00f00 req-efb81579-1eaa-411e-a402-18f64792b0d8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:27.655416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cacd2044-25cd-4b48-b189-b2d496b00f00 req-efb81579-1eaa-411e-a402-18f64792b0d8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:27.686046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-98c7fb5b-64e6-4f5c-914a-7ab38d5cc155 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec492b80>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:27.724961 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-cacd2044-25cd-4b48-b189-b2d496b00f00 req-efb81579-1eaa-411e-a402-18f64792b0d8 service nova] Creating event network-vif-deleted:877ab05b-84d2-46a6-a689-4dfd4bb855ca for instance e1adfb52-d290-451a-89bf-4d63824150c5 on n-h2-850468-16 Aug 23 18:05:27.748599 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-cacd2044-25cd-4b48-b189-b2d496b00f00 req-efb81579-1eaa-411e-a402-18f64792b0d8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.183209 Aug 23 18:05:27.753631 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1629/3311] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:27.792633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f2df9dfb-d5ed-4ed0-895f-5bc3d0eb2369 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:27.796099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f2df9dfb-d5ed-4ed0-895f-5bc3d0eb2369 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:27.844014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2df9dfb-d5ed-4ed0-895f-5bc3d0eb2369 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:27.851350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2df9dfb-d5ed-4ed0-895f-5bc3d0eb2369 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:27.859674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2df9dfb-d5ed-4ed0-895f-5bc3d0eb2369 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:27.860397 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-98c7fb5b-64e6-4f5c-914a-7ab38d5cc155 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.215695 Aug 23 18:05:27.860902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2df9dfb-d5ed-4ed0-895f-5bc3d0eb2369 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:27.862851 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1683/3312] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:27 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:27.869271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2df9dfb-d5ed-4ed0-895f-5bc3d0eb2369 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:27.874047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2df9dfb-d5ed-4ed0-895f-5bc3d0eb2369 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:27.890249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-803f18ec-b28c-485c-aecf-0e0856770ffd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:27.928796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-803f18ec-b28c-485c-aecf-0e0856770ffd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:27.929305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-803f18ec-b28c-485c-aecf-0e0856770ffd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:27.930192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-803f18ec-b28c-485c-aecf-0e0856770ffd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:28.035293 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-803f18ec-b28c-485c-aecf-0e0856770ffd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] HTTP exception thrown: Instance 9d81bbbc-0ed1-445b-a321-b2175e975725 is locked Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-803f18ec-b28c-485c-aecf-0e0856770ffd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Request method failure captured: Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action HTTP/1.1 Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 15 Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRWUjVu1gQ57GIBhn5ficd1q4sunvbDMhg4jnpM49H5FOoGa8tQBKtFGb1X8myXD8BTADCdwVkFlKLPo8JzqRSWAH_0-WFVVtdSi-oyHnTOx-jP9SlEg8K7_nGTPKY37ckiDWUMDyWBa1CjIHb-akSJyS9B7B9QrxhdVDPqk43Fm-B8 Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ed54655c5a6442d680ee1cb81021ddd2 Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed54655c5a6442d680ee1cb81021ddd2"}]}] Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ed54655c5a6442d680ee1cb81021ddd2 Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerActionsTestJSON-2018628031-project Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 11cb3b659afa416bb3371795600189fb Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerActionsTestJSON-2018628031-project Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: {"os-stop": {}} Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 9d81bbbc-0ed1-445b-a321-b2175e975725 is locked Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '9d81bbbc-0ed1-445b-a321-b2175e975725', 'body': {'os-stop': {}}} Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1446, in _stop_server Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 237, in inner Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance 9d81bbbc-0ed1-445b-a321-b2175e975725 is locked Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1448, in _stop_server Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance 9d81bbbc-0ed1-445b-a321-b2175e975725 is locked Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d81bbbc-0ed1-445b-a321-b2175e975725 is locked Aug 23 18:05:28.037827 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:28.043065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-803f18ec-b28c-485c-aecf-0e0856770ffd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Returning 409 to user: Instance 9d81bbbc-0ed1-445b-a321-b2175e975725 is locked {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:28.043065 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-803f18ec-b28c-485c-aecf-0e0856770ffd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 409 len: 107 microversion: 2.1 time: 0.175834 Aug 23 18:05:28.043065 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1684/3313] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:27 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 107 bytes in 177 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:05:28.055868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-010072e8-f4a0-4808-8150-c1bb0599e9f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:28.056502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-010072e8-f4a0-4808-8150-c1bb0599e9f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:28.072887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010072e8-f4a0-4808-8150-c1bb0599e9f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:28.073936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010072e8-f4a0-4808-8150-c1bb0599e9f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:28.074393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010072e8-f4a0-4808-8150-c1bb0599e9f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:28.075255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010072e8-f4a0-4808-8150-c1bb0599e9f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:28.075719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010072e8-f4a0-4808-8150-c1bb0599e9f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:28.083577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010072e8-f4a0-4808-8150-c1bb0599e9f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:28.182464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-010072e8-f4a0-4808-8150-c1bb0599e9f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Unlocking {{(pid=128808) unlock /opt/stack/nova/nova/compute/api.py:4857}} Aug 23 18:05:28.281794 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-010072e8-f4a0-4808-8150-c1bb0599e9f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.235349 Aug 23 18:05:28.287779 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1685/3314] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:28 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:05:28.297811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cfb375ff-2db7-498a-8f40-53cb7af5b2bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:28.299659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cfb375ff-2db7-498a-8f40-53cb7af5b2bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:28.314231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfb375ff-2db7-498a-8f40-53cb7af5b2bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:28.315028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfb375ff-2db7-498a-8f40-53cb7af5b2bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:28.317260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfb375ff-2db7-498a-8f40-53cb7af5b2bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:28.319332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfb375ff-2db7-498a-8f40-53cb7af5b2bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:28.334118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfb375ff-2db7-498a-8f40-53cb7af5b2bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:28.339818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfb375ff-2db7-498a-8f40-53cb7af5b2bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:28.650854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cfb375ff-2db7-498a-8f40-53cb7af5b2bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:28.662485 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cfb375ff-2db7-498a-8f40-53cb7af5b2bc tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.370337 Aug 23 18:05:28.663120 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1686/3315] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:28 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:28.673303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48541f49-db24-4257-bba4-1ef6630a3be8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:28.692400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48541f49-db24-4257-bba4-1ef6630a3be8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:28.692947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48541f49-db24-4257-bba4-1ef6630a3be8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:28.693752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48541f49-db24-4257-bba4-1ef6630a3be8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:28.720489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-48541f49-db24-4257-bba4-1ef6630a3be8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Going to try to stop instance {{(pid=128808) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 18:05:28.790401 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48541f49-db24-4257-bba4-1ef6630a3be8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.121673 Aug 23 18:05:28.798715 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1687/3316] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:28 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:05:28.806255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9507204a-fd19-4aa2-9e89-3d62213b0182 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:28.807254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9507204a-fd19-4aa2-9e89-3d62213b0182 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: e1adfb52-d290-451a-89bf-4d63824150c5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:28.815776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9507204a-fd19-4aa2-9e89-3d62213b0182 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:28.816536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9507204a-fd19-4aa2-9e89-3d62213b0182 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:28.817185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9507204a-fd19-4aa2-9e89-3d62213b0182 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:28.818329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9507204a-fd19-4aa2-9e89-3d62213b0182 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:28.819351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9507204a-fd19-4aa2-9e89-3d62213b0182 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:28.819957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9507204a-fd19-4aa2-9e89-3d62213b0182 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:28.838357 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-9507204a-fd19-4aa2-9e89-3d62213b0182 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] HTTP exception thrown: Instance e1adfb52-d290-451a-89bf-4d63824150c5 could not be found. Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9507204a-fd19-4aa2-9e89-3d62213b0182 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Request method failure captured: Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5 HTTP/1.1 Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXz-QcbvLEqfM5Fvm_6RWB9j3Vx6VI06EpMZHbE0XCyFvEdeIqxZZXm4RDDnTqct29gAslo9Hq7JYktSYJNWsvk9gUtWiSrTwDWVWpwplP-E4k1v0FwDMzIdXpFl3ZeTFc0XOtKuNfFs_K9ET0qEhfYCkPdyTKnIJGg4IT5AUJTxMs Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}] Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: cd9fba74d93549eab6dd981627cbd7f8 Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance e1adfb52-d290-451a-89bf-4d63824150c5 could not be found. Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'e1adfb52-d290-451a-89bf-4d63824150c5'} Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1adfb52-d290-451a-89bf-4d63824150c5 could not be found. Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1adfb52-d290-451a-89bf-4d63824150c5 could not be found. Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:28.846381 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:28.851410 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:28.851410 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:28.851410 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:28.851410 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:28.851410 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:28.851410 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1adfb52-d290-451a-89bf-4d63824150c5 could not be found. Aug 23 18:05:28.851410 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:28.854529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9507204a-fd19-4aa2-9e89-3d62213b0182 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Returning 404 to user: Instance e1adfb52-d290-451a-89bf-4d63824150c5 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:28.856964 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9507204a-fd19-4aa2-9e89-3d62213b0182 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5" status: 404 len: 111 microversion: 2.1 time: 0.055217 Aug 23 18:05:28.859118 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1688/3317] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:28 2022] GET /compute/v2.1/servers/e1adfb52-d290-451a-89bf-4d63824150c5 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:28.871834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-42b40333-c0f7-4670-8d45-2957a2a41569 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:28.875378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-42b40333-c0f7-4670-8d45-2957a2a41569 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:28.891651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42b40333-c0f7-4670-8d45-2957a2a41569 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:28.893897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42b40333-c0f7-4670-8d45-2957a2a41569 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:28.894674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42b40333-c0f7-4670-8d45-2957a2a41569 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:28.896420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42b40333-c0f7-4670-8d45-2957a2a41569 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:28.897101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42b40333-c0f7-4670-8d45-2957a2a41569 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:28.897710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42b40333-c0f7-4670-8d45-2957a2a41569 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:29.055553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f2df9dfb-d5ed-4ed0-895f-5bc3d0eb2369 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:29.064874 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f2df9dfb-d5ed-4ed0-895f-5bc3d0eb2369 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1315 microversion: 2.1 time: 1.308544 Aug 23 18:05:29.065466 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1630/3318] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:27 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1315 bytes in 1310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:29.086107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-20b9a0a6-b552-4bc4-842e-07c95fadebb3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:29.086980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-20b9a0a6-b552-4bc4-842e-07c95fadebb3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:29.108550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20b9a0a6-b552-4bc4-842e-07c95fadebb3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:29.109621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20b9a0a6-b552-4bc4-842e-07c95fadebb3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:29.110084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20b9a0a6-b552-4bc4-842e-07c95fadebb3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:29.110844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20b9a0a6-b552-4bc4-842e-07c95fadebb3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:29.111300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20b9a0a6-b552-4bc4-842e-07c95fadebb3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:29.116926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20b9a0a6-b552-4bc4-842e-07c95fadebb3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:29.274348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-42b40333-c0f7-4670-8d45-2957a2a41569 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:29.288038 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-42b40333-c0f7-4670-8d45-2957a2a41569 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.427100 Aug 23 18:05:29.295309 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1689/3319] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:28 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:29.315405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20b9a0a6-b552-4bc4-842e-07c95fadebb3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:29.320645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-791d42da-09f7-4daf-80ca-5368062f3d22 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df7e3280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:29.324721 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-20b9a0a6-b552-4bc4-842e-07c95fadebb3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 200 len: 1432 microversion: 2.1 time: 0.242393 Aug 23 18:05:29.330229 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1631/3320] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:29 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 1432 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:29.365174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-94294795-6d66-49de-a7ed-65533665c6d7 req-99374473-1775-4398-812b-60583879fcb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dda3e215-afdf-4d78-bd76-d27e7491c589", "name": "network-vif-deleted", "tag": "94e5ded1-138f-4678-b2ef-0b8a6f4c59ca"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:29.394318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-94294795-6d66-49de-a7ed-65533665c6d7 req-99374473-1775-4398-812b-60583879fcb7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:29.395550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-94294795-6d66-49de-a7ed-65533665c6d7 req-99374473-1775-4398-812b-60583879fcb7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:29.396184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-94294795-6d66-49de-a7ed-65533665c6d7 req-99374473-1775-4398-812b-60583879fcb7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:29.420449 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-94294795-6d66-49de-a7ed-65533665c6d7 req-99374473-1775-4398-812b-60583879fcb7 service nova] Creating event network-vif-deleted:94e5ded1-138f-4678-b2ef-0b8a6f4c59ca for instance dda3e215-afdf-4d78-bd76-d27e7491c589 on n-h2-850468-16 Aug 23 18:05:29.435855 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-94294795-6d66-49de-a7ed-65533665c6d7 req-99374473-1775-4398-812b-60583879fcb7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074193 Aug 23 18:05:29.439805 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1632/3321] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:05:29.485915 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-791d42da-09f7-4daf-80ca-5368062f3d22 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.186188 Aug 23 18:05:29.486665 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1690/3322] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:29 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:29.686045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-554fb6b5-dd18-4b6c-ae67-07baf1cac97c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:29.687269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-554fb6b5-dd18-4b6c-ae67-07baf1cac97c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:29.708900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-554fb6b5-dd18-4b6c-ae67-07baf1cac97c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:29.720188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-554fb6b5-dd18-4b6c-ae67-07baf1cac97c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:29.722194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-554fb6b5-dd18-4b6c-ae67-07baf1cac97c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:29.723259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-554fb6b5-dd18-4b6c-ae67-07baf1cac97c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:29.723882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-554fb6b5-dd18-4b6c-ae67-07baf1cac97c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:29.727628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-554fb6b5-dd18-4b6c-ae67-07baf1cac97c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:30.038841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-554fb6b5-dd18-4b6c-ae67-07baf1cac97c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:30.050030 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-554fb6b5-dd18-4b6c-ae67-07baf1cac97c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.369162 Aug 23 18:05:30.051305 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1633/3323] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:29 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:30.090182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-474d39ff-228a-4899-9c2a-cf2c0aa5569f tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:30.091793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-474d39ff-228a-4899-9c2a-cf2c0aa5569f tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:30.120061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-474d39ff-228a-4899-9c2a-cf2c0aa5569f tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:30.122108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-474d39ff-228a-4899-9c2a-cf2c0aa5569f tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:30.122924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-474d39ff-228a-4899-9c2a-cf2c0aa5569f tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:30.124749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-474d39ff-228a-4899-9c2a-cf2c0aa5569f tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:30.125780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-474d39ff-228a-4899-9c2a-cf2c0aa5569f tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:30.126586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-474d39ff-228a-4899-9c2a-cf2c0aa5569f tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:30.333488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f3445ebe-4df8-414c-8b36-a1ad4022bfab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:30.336648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f3445ebe-4df8-414c-8b36-a1ad4022bfab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:30.353585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3445ebe-4df8-414c-8b36-a1ad4022bfab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:30.357412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3445ebe-4df8-414c-8b36-a1ad4022bfab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:30.359488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3445ebe-4df8-414c-8b36-a1ad4022bfab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:30.361202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3445ebe-4df8-414c-8b36-a1ad4022bfab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:30.362064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3445ebe-4df8-414c-8b36-a1ad4022bfab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:30.363057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3445ebe-4df8-414c-8b36-a1ad4022bfab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:30.463006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-474d39ff-228a-4899-9c2a-cf2c0aa5569f tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:30.474115 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-474d39ff-228a-4899-9c2a-cf2c0aa5569f tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1315 microversion: 2.1 time: 0.389289 Aug 23 18:05:30.475210 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1691/3324] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:30 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1315 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:30.480578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-089c939e-315b-4ae4-87da-1121f54a3032 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:30.494921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-089c939e-315b-4ae4-87da-1121f54a3032 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: dda3e215-afdf-4d78-bd76-d27e7491c589] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:30.512984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-089c939e-315b-4ae4-87da-1121f54a3032 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:30.515798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-089c939e-315b-4ae4-87da-1121f54a3032 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:30.517340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-089c939e-315b-4ae4-87da-1121f54a3032 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:30.518903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-089c939e-315b-4ae4-87da-1121f54a3032 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:30.521330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-089c939e-315b-4ae4-87da-1121f54a3032 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:30.522814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-089c939e-315b-4ae4-87da-1121f54a3032 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:30.560339 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-089c939e-315b-4ae4-87da-1121f54a3032 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] HTTP exception thrown: Instance dda3e215-afdf-4d78-bd76-d27e7491c589 could not be found. Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-089c939e-315b-4ae4-87da-1121f54a3032 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Request method failure captured: Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 HTTP/1.1 Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXz-QcbvLEqfM5Fvm_6RWB9j3Vx6VI06EpMZHbE0XCyFvEdeIqxZZXm4RDDnTqct29gAslo9Hq7JYktSYJNWsvk9gUtWiSrTwDWVWpwplP-E4k1v0FwDMzIdXpFl3ZeTFc0XOtKuNfFs_K9ET0qEhfYCkPdyTKnIJGg4IT5AUJTxMs Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}] Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: cd9fba74d93549eab6dd981627cbd7f8 Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance dda3e215-afdf-4d78-bd76-d27e7491c589 could not be found. Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'dda3e215-afdf-4d78-bd76-d27e7491c589'} Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dda3e215-afdf-4d78-bd76-d27e7491c589 could not be found. Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dda3e215-afdf-4d78-bd76-d27e7491c589 could not be found. Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:30.562203 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:30.566723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:30.566723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:30.566723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:30.566723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:30.566723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:30.566723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dda3e215-afdf-4d78-bd76-d27e7491c589 could not be found. Aug 23 18:05:30.566723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:30.571571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-089c939e-315b-4ae4-87da-1121f54a3032 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Returning 404 to user: Instance dda3e215-afdf-4d78-bd76-d27e7491c589 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:30.572688 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-089c939e-315b-4ae4-87da-1121f54a3032 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589" status: 404 len: 111 microversion: 2.1 time: 0.096363 Aug 23 18:05:30.574372 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1692/3325] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:30 2022] GET /compute/v2.1/servers/dda3e215-afdf-4d78-bd76-d27e7491c589 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:30.580559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a8b30a6e-0335-4022-932c-801906741fd1 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec438af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:30.624218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f3445ebe-4df8-414c-8b36-a1ad4022bfab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:30.654708 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f3445ebe-4df8-414c-8b36-a1ad4022bfab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.335865 Aug 23 18:05:30.655406 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1634/3326] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:30 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:30.659555 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a8b30a6e-0335-4022-932c-801906741fd1 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.083863 Aug 23 18:05:30.660344 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1693/3327] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:30 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:30.684428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-504d9a96-4ccc-4cdd-9254-bc834617a947 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:30.747499 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-504d9a96-4ccc-4cdd-9254-bc834617a947 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/f3fd203c-3106-428b-98a7-57b3a8c52974" status: 204 len: 0 microversion: 2.1 time: 0.085711 Aug 23 18:05:30.751627 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1635/3328] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Aug 23 18:05:30 2022] DELETE /compute/v2.1/os-server-groups/f3fd203c-3106-428b-98a7-57b3a8c52974 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:30.758638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b4b62f7d-f954-4031-af59-734e5b6a3733 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:30.759207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b4b62f7d-f954-4031-af59-734e5b6a3733 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:30.771665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4b62f7d-f954-4031-af59-734e5b6a3733 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:30.772173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4b62f7d-f954-4031-af59-734e5b6a3733 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:30.772642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4b62f7d-f954-4031-af59-734e5b6a3733 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:30.773812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4b62f7d-f954-4031-af59-734e5b6a3733 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:30.774419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4b62f7d-f954-4031-af59-734e5b6a3733 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:30.775279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4b62f7d-f954-4031-af59-734e5b6a3733 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:30.812870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b4b62f7d-f954-4031-af59-734e5b6a3733 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:05:30.998000 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b4b62f7d-f954-4031-af59-734e5b6a3733 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 204 len: 0 microversion: 2.1 time: 0.244564 Aug 23 18:05:30.998632 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1694/3329] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:05:30 2022] DELETE /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:31.009254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c429d21-de3a-4c8a-aa10-ce5ea84ebf63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:31.010449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c429d21-de3a-4c8a-aa10-ce5ea84ebf63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:31.024019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c429d21-de3a-4c8a-aa10-ce5ea84ebf63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:31.024724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c429d21-de3a-4c8a-aa10-ce5ea84ebf63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:31.025160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c429d21-de3a-4c8a-aa10-ce5ea84ebf63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:31.025868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c429d21-de3a-4c8a-aa10-ce5ea84ebf63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:31.026316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c429d21-de3a-4c8a-aa10-ce5ea84ebf63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:31.027412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c429d21-de3a-4c8a-aa10-ce5ea84ebf63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:31.073599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-17f13916-7d14-477d-b02a-ba872991af66 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:31.075013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-17f13916-7d14-477d-b02a-ba872991af66 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:31.088216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17f13916-7d14-477d-b02a-ba872991af66 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:31.096220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17f13916-7d14-477d-b02a-ba872991af66 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:31.098176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17f13916-7d14-477d-b02a-ba872991af66 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:31.099235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17f13916-7d14-477d-b02a-ba872991af66 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:31.099971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17f13916-7d14-477d-b02a-ba872991af66 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:31.100699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17f13916-7d14-477d-b02a-ba872991af66 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:31.282726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-17f13916-7d14-477d-b02a-ba872991af66 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:31.292225 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-17f13916-7d14-477d-b02a-ba872991af66 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.222894 Aug 23 18:05:31.307294 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1695/3330] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:31 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:31.501799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-18724929-2c24-45e4-b67d-0797389718b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:31.503086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-18724929-2c24-45e4-b67d-0797389718b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:31.516268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18724929-2c24-45e4-b67d-0797389718b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:31.522424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c429d21-de3a-4c8a-aa10-ce5ea84ebf63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:31.523813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18724929-2c24-45e4-b67d-0797389718b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:31.524275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18724929-2c24-45e4-b67d-0797389718b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:31.527352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18724929-2c24-45e4-b67d-0797389718b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:31.527845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18724929-2c24-45e4-b67d-0797389718b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:31.528292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18724929-2c24-45e4-b67d-0797389718b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:31.535902 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c429d21-de3a-4c8a-aa10-ce5ea84ebf63 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1471 microversion: 2.1 time: 0.530421 Aug 23 18:05:31.537716 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1636/3331] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:31 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1471 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:31.551785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=8,nova_cell1:INSERT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:31.678102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e7b70137-c0a6-4ea9-b8ad-ab8d9d9b3c13 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27f1c51f70>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:31.806149 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e7b70137-c0a6-4ea9-b8ad-ab8d9d9b3c13 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.126580 Aug 23 18:05:31.814700 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1637/3332] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:31 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:31.829645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-834fb38c-007b-4f82-9b30-d71ddafd4ba5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:31.831141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-834fb38c-007b-4f82-9b30-d71ddafd4ba5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:31.850170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-834fb38c-007b-4f82-9b30-d71ddafd4ba5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:31.850557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-18724929-2c24-45e4-b67d-0797389718b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:31.852603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-834fb38c-007b-4f82-9b30-d71ddafd4ba5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:31.857393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-834fb38c-007b-4f82-9b30-d71ddafd4ba5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:31.859347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-834fb38c-007b-4f82-9b30-d71ddafd4ba5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:31.861181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-834fb38c-007b-4f82-9b30-d71ddafd4ba5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:31.862385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-834fb38c-007b-4f82-9b30-d71ddafd4ba5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:31.862672 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-18724929-2c24-45e4-b67d-0797389718b6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1315 microversion: 2.1 time: 0.367791 Aug 23 18:05:31.864665 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1696/3333] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:31 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1315 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:32.318609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bd2d00c1-6467-42ca-a8dc-8e42d6093eea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:32.327571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bd2d00c1-6467-42ca-a8dc-8e42d6093eea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:32.356237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-834fb38c-007b-4f82-9b30-d71ddafd4ba5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:32.364251 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-834fb38c-007b-4f82-9b30-d71ddafd4ba5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.547493 Aug 23 18:05:32.395503 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1638/3334] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:31 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:32.396739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd2d00c1-6467-42ca-a8dc-8e42d6093eea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:32.399927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd2d00c1-6467-42ca-a8dc-8e42d6093eea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:32.400387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd2d00c1-6467-42ca-a8dc-8e42d6093eea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:32.401230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd2d00c1-6467-42ca-a8dc-8e42d6093eea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:32.402253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd2d00c1-6467-42ca-a8dc-8e42d6093eea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:32.413799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd2d00c1-6467-42ca-a8dc-8e42d6093eea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:32.574623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c2800f41-5de6-478f-be4e-07b28f640e29 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:32.574623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c2800f41-5de6-478f-be4e-07b28f640e29 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:32.583669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2800f41-5de6-478f-be4e-07b28f640e29 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:32.584174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2800f41-5de6-478f-be4e-07b28f640e29 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:32.584618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2800f41-5de6-478f-be4e-07b28f640e29 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:32.585337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2800f41-5de6-478f-be4e-07b28f640e29 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:32.585884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2800f41-5de6-478f-be4e-07b28f640e29 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:32.586367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2800f41-5de6-478f-be4e-07b28f640e29 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:32.861150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bd2d00c1-6467-42ca-a8dc-8e42d6093eea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:32.873984 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bd2d00c1-6467-42ca-a8dc-8e42d6093eea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.561443 Aug 23 18:05:32.874815 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1697/3335] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:32 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:32.880632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-51ca55af-8e5c-4a7e-bb42-ccd7bed7e7fe req-7ed95f6c-d53d-4809-86f5-01e8ee9b9537 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6af0b0-dd81-47c9-ba04-42c3612b8eec", "name": "network-vif-plugged", "status": "completed", "tag": "f01e6452-6754-4b61-9a8a-6d65fe07fa27"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:32.893702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-51ca55af-8e5c-4a7e-bb42-ccd7bed7e7fe req-7ed95f6c-d53d-4809-86f5-01e8ee9b9537 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:32.894720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-51ca55af-8e5c-4a7e-bb42-ccd7bed7e7fe req-7ed95f6c-d53d-4809-86f5-01e8ee9b9537 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:32.895788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-51ca55af-8e5c-4a7e-bb42-ccd7bed7e7fe req-7ed95f6c-d53d-4809-86f5-01e8ee9b9537 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:32.918969 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-51ca55af-8e5c-4a7e-bb42-ccd7bed7e7fe req-7ed95f6c-d53d-4809-86f5-01e8ee9b9537 service nova] Creating event network-vif-plugged:f01e6452-6754-4b61-9a8a-6d65fe07fa27 for instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec on n-h1-850468-16 Aug 23 18:05:32.926395 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-51ca55af-8e5c-4a7e-bb42-ccd7bed7e7fe req-7ed95f6c-d53d-4809-86f5-01e8ee9b9537 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048517 Aug 23 18:05:32.927392 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1698/3336] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:32.936130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-df046b10-e267-4b8b-a9dc-45e7ca86bc4d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df7a2820>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:33.046776 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-df046b10-e267-4b8b-a9dc-45e7ca86bc4d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.117157 Aug 23 18:05:33.056786 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1699/3337] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:32 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:33.065583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b0273599-7d73-4926-8964-3087d31cc611 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:33.068096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b0273599-7d73-4926-8964-3087d31cc611 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:33.078595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0273599-7d73-4926-8964-3087d31cc611 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:33.079300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0273599-7d73-4926-8964-3087d31cc611 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:33.079972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0273599-7d73-4926-8964-3087d31cc611 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:33.080867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0273599-7d73-4926-8964-3087d31cc611 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:33.081507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0273599-7d73-4926-8964-3087d31cc611 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:33.082119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0273599-7d73-4926-8964-3087d31cc611 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:33.419069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b0273599-7d73-4926-8964-3087d31cc611 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:33.435954 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b0273599-7d73-4926-8964-3087d31cc611 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1503 microversion: 2.1 time: 0.375779 Aug 23 18:05:33.439279 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1700/3338] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:33 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1503 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:33.451786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3c6f42c0-ac34-4b3c-9dfa-386eaeb76051 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:33.456169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3c6f42c0-ac34-4b3c-9dfa-386eaeb76051 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:33.472176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c6f42c0-ac34-4b3c-9dfa-386eaeb76051 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:33.474630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c6f42c0-ac34-4b3c-9dfa-386eaeb76051 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:33.475515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c6f42c0-ac34-4b3c-9dfa-386eaeb76051 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:33.480163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c6f42c0-ac34-4b3c-9dfa-386eaeb76051 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:33.481275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c6f42c0-ac34-4b3c-9dfa-386eaeb76051 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:33.481937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c6f42c0-ac34-4b3c-9dfa-386eaeb76051 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:33.579324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c2800f41-5de6-478f-be4e-07b28f640e29 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:33.589095 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c2800f41-5de6-478f-be4e-07b28f640e29 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1471 microversion: 2.1 time: 1.032376 Aug 23 18:05:33.593964 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1639/3339] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:32 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1471 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:33.603810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dc6cad92-60d6-4afa-b1f0-c27e10338d24 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:33.605761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dc6cad92-60d6-4afa-b1f0-c27e10338d24 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:33.646241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc6cad92-60d6-4afa-b1f0-c27e10338d24 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:33.646791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc6cad92-60d6-4afa-b1f0-c27e10338d24 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:33.647239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc6cad92-60d6-4afa-b1f0-c27e10338d24 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:33.647967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc6cad92-60d6-4afa-b1f0-c27e10338d24 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:33.648429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc6cad92-60d6-4afa-b1f0-c27e10338d24 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:33.648861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc6cad92-60d6-4afa-b1f0-c27e10338d24 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:33.759034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dc6cad92-60d6-4afa-b1f0-c27e10338d24 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:05:33.887499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3c6f42c0-ac34-4b3c-9dfa-386eaeb76051 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:33.907752 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3c6f42c0-ac34-4b3c-9dfa-386eaeb76051 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.462253 Aug 23 18:05:33.912722 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1701/3340] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:33 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:33.923746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e26f1d62-2e0b-4198-be2b-0583314fde12 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:33.925983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e26f1d62-2e0b-4198-be2b-0583314fde12 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:33.954810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e26f1d62-2e0b-4198-be2b-0583314fde12 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:33.955693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e26f1d62-2e0b-4198-be2b-0583314fde12 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:33.956398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e26f1d62-2e0b-4198-be2b-0583314fde12 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:33.957396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e26f1d62-2e0b-4198-be2b-0583314fde12 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:33.958322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e26f1d62-2e0b-4198-be2b-0583314fde12 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:33.958993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e26f1d62-2e0b-4198-be2b-0583314fde12 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:34.046280 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dc6cad92-60d6-4afa-b1f0-c27e10338d24 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 204 len: 0 microversion: 2.1 time: 0.450611 Aug 23 18:05:34.047699 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1640/3341] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:05:33 2022] DELETE /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:34.061348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d555eb1-26f9-437e-91e2-59a918c4c0e4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:34.064420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d555eb1-26f9-437e-91e2-59a918c4c0e4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:34.078598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d555eb1-26f9-437e-91e2-59a918c4c0e4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:34.079466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d555eb1-26f9-437e-91e2-59a918c4c0e4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:34.080125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d555eb1-26f9-437e-91e2-59a918c4c0e4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:34.083474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d555eb1-26f9-437e-91e2-59a918c4c0e4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:34.083955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d555eb1-26f9-437e-91e2-59a918c4c0e4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:34.084399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d555eb1-26f9-437e-91e2-59a918c4c0e4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:34.299190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e26f1d62-2e0b-4198-be2b-0583314fde12 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:34.317448 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e26f1d62-2e0b-4198-be2b-0583314fde12 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.399723 Aug 23 18:05:34.319084 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1702/3342] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:33 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:34.334791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a026224-473e-4733-9792-fb32aedcb804 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec438af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:34.447564 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6a026224-473e-4733-9792-fb32aedcb804 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.127105 Aug 23 18:05:34.457710 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1703/3343] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:34 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:34.483783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4d555eb1-26f9-437e-91e2-59a918c4c0e4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:34.501700 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d555eb1-26f9-437e-91e2-59a918c4c0e4 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1509 microversion: 2.1 time: 0.449719 Aug 23 18:05:34.518257 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1641/3344] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:34 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1509 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:34.622718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1d0c445c-7798-4adf-b024-45e821531161 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:34.624822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1d0c445c-7798-4adf-b024-45e821531161 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:34.653048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d0c445c-7798-4adf-b024-45e821531161 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:34.653591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d0c445c-7798-4adf-b024-45e821531161 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:34.655757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d0c445c-7798-4adf-b024-45e821531161 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:34.657353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d0c445c-7798-4adf-b024-45e821531161 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:34.658003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d0c445c-7798-4adf-b024-45e821531161 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:34.659083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d0c445c-7798-4adf-b024-45e821531161 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:34.748843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b50c307e-fd7e-4a93-829c-c4916edde67e req-4feca7a8-444e-4645-8de0-581d05a67cb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8feaf703-5072-4321-b05e-dfebaaa5c573", "name": "network-vif-deleted", "tag": "37148738-a43c-4c4b-a015-de86f9ba132b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:34.789383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b50c307e-fd7e-4a93-829c-c4916edde67e req-4feca7a8-444e-4645-8de0-581d05a67cb5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:34.790458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b50c307e-fd7e-4a93-829c-c4916edde67e req-4feca7a8-444e-4645-8de0-581d05a67cb5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:34.791083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b50c307e-fd7e-4a93-829c-c4916edde67e req-4feca7a8-444e-4645-8de0-581d05a67cb5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:34.807259 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b50c307e-fd7e-4a93-829c-c4916edde67e req-4feca7a8-444e-4645-8de0-581d05a67cb5 service nova] Creating event network-vif-deleted:37148738-a43c-4c4b-a015-de86f9ba132b for instance 8feaf703-5072-4321-b05e-dfebaaa5c573 on n-h2-850468-16 Aug 23 18:05:34.822411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d0c445c-7798-4adf-b024-45e821531161 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cd9fba74d93549eab6dd981627cbd7f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eeb9f8355f1f412da3eb256151e73fbf', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:34.837456 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b50c307e-fd7e-4a93-829c-c4916edde67e req-4feca7a8-444e-4645-8de0-581d05a67cb5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095868 Aug 23 18:05:34.841492 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1642/3345] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:34.861637 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1d0c445c-7798-4adf-b024-45e821531161 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 200 len: 1429 microversion: 2.1 time: 0.246041 Aug 23 18:05:34.862529 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1704/3346] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:34 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 1429 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:34.937415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aaec8661-afce-4369-b989-89cf5589d773 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:34.938631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aaec8661-afce-4369-b989-89cf5589d773 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:34.955241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aaec8661-afce-4369-b989-89cf5589d773 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:34.955970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aaec8661-afce-4369-b989-89cf5589d773 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:34.958045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aaec8661-afce-4369-b989-89cf5589d773 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:34.962523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aaec8661-afce-4369-b989-89cf5589d773 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:34.963314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aaec8661-afce-4369-b989-89cf5589d773 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:34.964560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aaec8661-afce-4369-b989-89cf5589d773 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:35.302781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aaec8661-afce-4369-b989-89cf5589d773 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:35.321203 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aaec8661-afce-4369-b989-89cf5589d773 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.391174 Aug 23 18:05:35.324466 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1643/3347] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:34 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:35.351159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-63bd387d-be44-4037-bfed-4d67621f333a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:35.351992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-63bd387d-be44-4037-bfed-4d67621f333a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:35.360743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63bd387d-be44-4037-bfed-4d67621f333a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:35.361432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63bd387d-be44-4037-bfed-4d67621f333a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:35.361876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63bd387d-be44-4037-bfed-4d67621f333a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:35.362822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63bd387d-be44-4037-bfed-4d67621f333a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:35.363512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63bd387d-be44-4037-bfed-4d67621f333a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:35.364222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63bd387d-be44-4037-bfed-4d67621f333a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:35.465174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-411eb172-45c0-480d-b802-5d3c5b213e45 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfb8df70>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:35.545446 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-411eb172-45c0-480d-b802-5d3c5b213e45 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.085027 Aug 23 18:05:35.547825 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1644/3348] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:35 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:35.562152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-63bd387d-be44-4037-bfed-4d67621f333a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:35.572506 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-63bd387d-be44-4037-bfed-4d67621f333a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.226449 Aug 23 18:05:35.574734 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1705/3349] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:35 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:35.587173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c2b9247f-4fcc-4123-9b83-7d64111c4bba tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:35.588072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c2b9247f-4fcc-4123-9b83-7d64111c4bba tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:35.601320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b9247f-4fcc-4123-9b83-7d64111c4bba tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:35.603710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b9247f-4fcc-4123-9b83-7d64111c4bba tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:35.605364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b9247f-4fcc-4123-9b83-7d64111c4bba tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:35.607849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b9247f-4fcc-4123-9b83-7d64111c4bba tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:35.610316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b9247f-4fcc-4123-9b83-7d64111c4bba tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:35.611481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b9247f-4fcc-4123-9b83-7d64111c4bba tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:35.886283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-77d05ac9-c0d4-43fc-84a4-68a3dfde0ee3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:35.887078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-77d05ac9-c0d4-43fc-84a4-68a3dfde0ee3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] [instance: 8feaf703-5072-4321-b05e-dfebaaa5c573] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:35.904727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77d05ac9-c0d4-43fc-84a4-68a3dfde0ee3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:35.905683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77d05ac9-c0d4-43fc-84a4-68a3dfde0ee3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:35.906315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77d05ac9-c0d4-43fc-84a4-68a3dfde0ee3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:35.907420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77d05ac9-c0d4-43fc-84a4-68a3dfde0ee3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:35.908120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77d05ac9-c0d4-43fc-84a4-68a3dfde0ee3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:35.908760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77d05ac9-c0d4-43fc-84a4-68a3dfde0ee3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:35.935497 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-77d05ac9-c0d4-43fc-84a4-68a3dfde0ee3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] HTTP exception thrown: Instance 8feaf703-5072-4321-b05e-dfebaaa5c573 could not be found. Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-77d05ac9-c0d4-43fc-84a4-68a3dfde0ee3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Request method failure captured: Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 HTTP/1.1 Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRXz-QcbvLEqfM5Fvm_6RWB9j3Vx6VI06EpMZHbE0XCyFvEdeIqxZZXm4RDDnTqct29gAslo9Hq7JYktSYJNWsvk9gUtWiSrTwDWVWpwplP-E4k1v0FwDMzIdXpFl3ZeTFc0XOtKuNfFs_K9ET0qEhfYCkPdyTKnIJGg4IT5AUJTxMs Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eeb9f8355f1f412da3eb256151e73fbf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eeb9f8355f1f412da3eb256151e73fbf"}]}] Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: eeb9f8355f1f412da3eb256151e73fbf Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-875884066 Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: cd9fba74d93549eab6dd981627cbd7f8 Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersOnMultiNodesTest-875884066-project Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 8feaf703-5072-4321-b05e-dfebaaa5c573 could not be found. Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '8feaf703-5072-4321-b05e-dfebaaa5c573'} Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8feaf703-5072-4321-b05e-dfebaaa5c573 could not be found. Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8feaf703-5072-4321-b05e-dfebaaa5c573 could not be found. Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:35.937187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:35.942204 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:35.942204 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:35.942204 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:35.942204 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:35.942204 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:35.942204 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8feaf703-5072-4321-b05e-dfebaaa5c573 could not be found. Aug 23 18:05:35.942204 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:35.944381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-77d05ac9-c0d4-43fc-84a4-68a3dfde0ee3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] Returning 404 to user: Instance 8feaf703-5072-4321-b05e-dfebaaa5c573 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:35.945421 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-77d05ac9-c0d4-43fc-84a4-68a3dfde0ee3 tempest-ServersOnMultiNodesTest-875884066 tempest-ServersOnMultiNodesTest-875884066-project] 10.222.0.61 "GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573" status: 404 len: 111 microversion: 2.1 time: 0.064066 Aug 23 18:05:35.946467 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1706/3350] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:35 2022] GET /compute/v2.1/servers/8feaf703-5072-4321-b05e-dfebaaa5c573 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:35.954413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c2b9247f-4fcc-4123-9b83-7d64111c4bba tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:35.963564 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c2b9247f-4fcc-4123-9b83-7d64111c4bba tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1509 microversion: 2.1 time: 0.412139 Aug 23 18:05:35.966118 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1645/3351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:35 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1509 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:36.352945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b8f8c15-f32e-48c4-85d5-bc8c39c294dc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:36.353797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b8f8c15-f32e-48c4-85d5-bc8c39c294dc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:36.387706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b8f8c15-f32e-48c4-85d5-bc8c39c294dc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:36.393178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b8f8c15-f32e-48c4-85d5-bc8c39c294dc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:36.394262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b8f8c15-f32e-48c4-85d5-bc8c39c294dc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:36.395820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b8f8c15-f32e-48c4-85d5-bc8c39c294dc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:36.399989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b8f8c15-f32e-48c4-85d5-bc8c39c294dc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:36.400723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b8f8c15-f32e-48c4-85d5-bc8c39c294dc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:36.434622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-6e8cebbc-5476-4888-862b-6e3aa8185acd req-9700c4a5-95fe-4e25-bafb-d96ce1e5fe5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1a8703-4973-4c42-859a-5734d134f015", "name": "network-vif-plugged", "status": "completed", "tag": "28cb5722-a367-4d3b-a963-3b1846155944"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:36.458208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6e8cebbc-5476-4888-862b-6e3aa8185acd req-9700c4a5-95fe-4e25-bafb-d96ce1e5fe5d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:36.460615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6e8cebbc-5476-4888-862b-6e3aa8185acd req-9700c4a5-95fe-4e25-bafb-d96ce1e5fe5d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:36.460615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6e8cebbc-5476-4888-862b-6e3aa8185acd req-9700c4a5-95fe-4e25-bafb-d96ce1e5fe5d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:36.516025 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-6e8cebbc-5476-4888-862b-6e3aa8185acd req-9700c4a5-95fe-4e25-bafb-d96ce1e5fe5d service nova] Creating event network-vif-plugged:28cb5722-a367-4d3b-a963-3b1846155944 for instance ed1a8703-4973-4c42-859a-5734d134f015 on n-h1-850468-16 Aug 23 18:05:36.534471 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-6e8cebbc-5476-4888-862b-6e3aa8185acd req-9700c4a5-95fe-4e25-bafb-d96ce1e5fe5d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106220 Aug 23 18:05:36.535958 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1646/3352] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:05:36.564708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-caa4f01a-95d9-455d-8b79-e186d4ad355a tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfce6a60>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:36.702298 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-caa4f01a-95d9-455d-8b79-e186d4ad355a tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.141502 Aug 23 18:05:36.710320 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1647/3353] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:36 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:36.718019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-704a81b2-3aae-4e7c-9446-6f7f7671f7f1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:36.719236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-704a81b2-3aae-4e7c-9446-6f7f7671f7f1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:36.727750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-704a81b2-3aae-4e7c-9446-6f7f7671f7f1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:36.728805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-704a81b2-3aae-4e7c-9446-6f7f7671f7f1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:36.729548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-704a81b2-3aae-4e7c-9446-6f7f7671f7f1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:36.731381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-704a81b2-3aae-4e7c-9446-6f7f7671f7f1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:36.732044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-704a81b2-3aae-4e7c-9446-6f7f7671f7f1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:36.733065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-704a81b2-3aae-4e7c-9446-6f7f7671f7f1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:36.968743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b8f8c15-f32e-48c4-85d5-bc8c39c294dc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:36.977736 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b8f8c15-f32e-48c4-85d5-bc8c39c294dc tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.629829 Aug 23 18:05:36.978319 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1707/3354] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:36 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:37.000724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-54c66703-db98-431f-bcad-afbc8b3d30ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:37.001580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-54c66703-db98-431f-bcad-afbc8b3d30ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:37.008428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54c66703-db98-431f-bcad-afbc8b3d30ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:37.009214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54c66703-db98-431f-bcad-afbc8b3d30ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:37.009823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54c66703-db98-431f-bcad-afbc8b3d30ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:37.011408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54c66703-db98-431f-bcad-afbc8b3d30ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:37.012154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54c66703-db98-431f-bcad-afbc8b3d30ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:37.012854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54c66703-db98-431f-bcad-afbc8b3d30ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:37.491160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-54c66703-db98-431f-bcad-afbc8b3d30ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:37.506296 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-54c66703-db98-431f-bcad-afbc8b3d30ef tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1509 microversion: 2.1 time: 0.509346 Aug 23 18:05:37.507093 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1708/3355] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:36 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1509 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:37.720044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5ceafa71-4c2c-4005-a5c4-f49103bdc44c tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df7a8c10>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:37.820284 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5ceafa71-4c2c-4005-a5c4-f49103bdc44c tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.106769 Aug 23 18:05:37.822762 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1709/3356] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:37 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:37.903856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-704a81b2-3aae-4e7c-9446-6f7f7671f7f1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:37.914943 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-704a81b2-3aae-4e7c-9446-6f7f7671f7f1 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 1.202910 Aug 23 18:05:37.915537 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1648/3357] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:36 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 1204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:38.000013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3672c245-aa93-4b1d-8f60-1a0159b8704d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:38.001540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3672c245-aa93-4b1d-8f60-1a0159b8704d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:38.031643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3672c245-aa93-4b1d-8f60-1a0159b8704d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:38.032674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3672c245-aa93-4b1d-8f60-1a0159b8704d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:38.038220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3672c245-aa93-4b1d-8f60-1a0159b8704d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:38.039323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3672c245-aa93-4b1d-8f60-1a0159b8704d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:38.042487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3672c245-aa93-4b1d-8f60-1a0159b8704d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:38.043263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3672c245-aa93-4b1d-8f60-1a0159b8704d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:38.147453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-97b19aa3-c731-4b0b-8c0f-dc2115161af2 req-0115e1be-19e1-4d04-a370-a41833b0e57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0cc7aec-9266-46f5-a751-846260cc0f85", "name": "network-vif-deleted", "tag": "6df2430e-f90f-4c67-8461-00dc8fe0b244"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:38.165187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-97b19aa3-c731-4b0b-8c0f-dc2115161af2 req-0115e1be-19e1-4d04-a370-a41833b0e57b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:38.170473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-97b19aa3-c731-4b0b-8c0f-dc2115161af2 req-0115e1be-19e1-4d04-a370-a41833b0e57b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:38.171538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-97b19aa3-c731-4b0b-8c0f-dc2115161af2 req-0115e1be-19e1-4d04-a370-a41833b0e57b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:38.203702 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-97b19aa3-c731-4b0b-8c0f-dc2115161af2 req-0115e1be-19e1-4d04-a370-a41833b0e57b service nova] Creating event network-vif-deleted:6df2430e-f90f-4c67-8461-00dc8fe0b244 for instance a0cc7aec-9266-46f5-a751-846260cc0f85 on n-h1-850468-16 Aug 23 18:05:38.209496 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-97b19aa3-c731-4b0b-8c0f-dc2115161af2 req-0115e1be-19e1-4d04-a370-a41833b0e57b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065811 Aug 23 18:05:38.210674 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1649/3358] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:38.491840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3672c245-aa93-4b1d-8f60-1a0159b8704d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:38.503079 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3672c245-aa93-4b1d-8f60-1a0159b8704d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.507415 Aug 23 18:05:38.506982 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1710/3359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:37 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:38.531218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:38.531933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:38.545421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:38.547814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:38.548615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:38.551072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:38.552496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:38.555600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:38.634161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:38.670034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:38.678059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:38.678059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:38.678059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lazy-loading 'fault' on Instance uuid a0cc7aec-9266-46f5-a751-846260cc0f85 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:05:38.755718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:38.778671 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e95db9e1-aeef-489a-9eb8-6bf7e88493c3 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1305 microversion: 2.1 time: 0.253930 Aug 23 18:05:38.790641 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1650/3360] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:38 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1305 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:38.838490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cab966b1-7067-4ceb-be19-f146881523d4 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df8b7310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:38.941133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d8f41af-b71d-4c21-beaf-5ebdb2477922 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:38.942735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d8f41af-b71d-4c21-beaf-5ebdb2477922 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:38.958589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d8f41af-b71d-4c21-beaf-5ebdb2477922 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:38.966258 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cab966b1-7067-4ceb-be19-f146881523d4 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.132615 Aug 23 18:05:38.966939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d8f41af-b71d-4c21-beaf-5ebdb2477922 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:38.971009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d8f41af-b71d-4c21-beaf-5ebdb2477922 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:38.972976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d8f41af-b71d-4c21-beaf-5ebdb2477922 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:38.973637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d8f41af-b71d-4c21-beaf-5ebdb2477922 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:38.977318 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1711/3361] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:38 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:38.977844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d8f41af-b71d-4c21-beaf-5ebdb2477922 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:39.533332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2b647205-c185-4d10-8190-27571f4b43b7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:39.534615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2b647205-c185-4d10-8190-27571f4b43b7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:39.554321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b647205-c185-4d10-8190-27571f4b43b7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:39.556199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b647205-c185-4d10-8190-27571f4b43b7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:39.556829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b647205-c185-4d10-8190-27571f4b43b7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:39.559516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b647205-c185-4d10-8190-27571f4b43b7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:39.560238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b647205-c185-4d10-8190-27571f4b43b7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:39.563267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b647205-c185-4d10-8190-27571f4b43b7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:39.608791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6d8f41af-b71d-4c21-beaf-5ebdb2477922 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:39.647267 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d8f41af-b71d-4c21-beaf-5ebdb2477922 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1322 microversion: 2.1 time: 0.710356 Aug 23 18:05:39.648840 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1651/3362] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:38 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1322 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:39.806638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:39.808134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:39.823339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:39.825420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:39.828304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:39.830425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:39.832150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:39.832832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:39.915064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:39.920776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:39.922555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:39.927057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lazy-loading 'fault' on Instance uuid a0cc7aec-9266-46f5-a751-846260cc0f85 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:05:39.975519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2b647205-c185-4d10-8190-27571f4b43b7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:39.987324 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2b647205-c185-4d10-8190-27571f4b43b7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.459519 Aug 23 18:05:39.990340 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1712/3363] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:39 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:39.997580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6bd4df0e-b1cb-433e-8015-24095d96ea1d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df7c7a60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:40.060362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '413560b41e2648a3ba2611c68bd7e3b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd7da9d1674484e78bcf8e9d68bbb942d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:40.079929 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-56074aad-0ffa-46ab-8060-9ef91bb7c16c tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 200 len: 1305 microversion: 2.1 time: 0.279425 Aug 23 18:05:40.083113 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1652/3364] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:39 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 1305 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:40.136601 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6bd4df0e-b1cb-433e-8015-24095d96ea1d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.137382 Aug 23 18:05:40.139148 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1713/3365] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:39 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:40.672313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-18d49aa4-e4a3-40ef-9978-ddeb2fa6bf73 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:40.672981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-18d49aa4-e4a3-40ef-9978-ddeb2fa6bf73 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:40.686058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18d49aa4-e4a3-40ef-9978-ddeb2fa6bf73 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:40.688487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18d49aa4-e4a3-40ef-9978-ddeb2fa6bf73 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:40.689938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18d49aa4-e4a3-40ef-9978-ddeb2fa6bf73 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:40.691870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18d49aa4-e4a3-40ef-9978-ddeb2fa6bf73 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:40.692673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18d49aa4-e4a3-40ef-9978-ddeb2fa6bf73 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:40.693127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18d49aa4-e4a3-40ef-9978-ddeb2fa6bf73 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.017407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-11e4c566-27b8-4485-a1fa-af0e02ff93c2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:41.018903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-11e4c566-27b8-4485-a1fa-af0e02ff93c2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:41.031547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11e4c566-27b8-4485-a1fa-af0e02ff93c2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.032055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11e4c566-27b8-4485-a1fa-af0e02ff93c2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:41.032505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11e4c566-27b8-4485-a1fa-af0e02ff93c2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.035423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11e4c566-27b8-4485-a1fa-af0e02ff93c2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.037258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11e4c566-27b8-4485-a1fa-af0e02ff93c2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:41.037258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11e4c566-27b8-4485-a1fa-af0e02ff93c2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.102069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-18d49aa4-e4a3-40ef-9978-ddeb2fa6bf73 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:41.111247 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-18d49aa4-e4a3-40ef-9978-ddeb2fa6bf73 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1516 microversion: 2.1 time: 0.446035 Aug 23 18:05:41.145698 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1653/3366] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:40 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1516 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:41.161357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-70cee7fc-496e-47af-a263-3237f51c3c2b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:41.161972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-70cee7fc-496e-47af-a263-3237f51c3c2b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:41.195976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70cee7fc-496e-47af-a263-3237f51c3c2b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.202444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70cee7fc-496e-47af-a263-3237f51c3c2b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:41.203155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70cee7fc-496e-47af-a263-3237f51c3c2b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.203929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70cee7fc-496e-47af-a263-3237f51c3c2b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.209368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70cee7fc-496e-47af-a263-3237f51c3c2b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:41.209872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70cee7fc-496e-47af-a263-3237f51c3c2b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.285600 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-70cee7fc-496e-47af-a263-3237f51c3c2b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] HTTP exception thrown: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-70cee7fc-496e-47af-a263-3237f51c3c2b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Request method failure captured: Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 HTTP/1.1 Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRbH4CHtUOJ8grkctJMxJIZQRiMYGN6S19U42mh-F0PDk4OGPqbwLTJEQIkbOBF8qoINHa-gmcMRf7Vi5T3xANLX6VyDucvF_oJoXPiJXT8SXzPlcCjcCc6XKgTuzFv4yNr-CyCTIpeoQDT6AyslC5HiI1KWAGwprQ9V5OtTBRWcrKA Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}] Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 413560b41e2648a3ba2611c68bd7e3b9 Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'a0cc7aec-9266-46f5-a751-846260cc0f85'} Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:41.301643 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.306126 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.306126 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:41.306126 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:41.306126 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:41.306126 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:41.306126 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.306126 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.309961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-70cee7fc-496e-47af-a263-3237f51c3c2b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Returning 404 to user: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:41.312010 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-70cee7fc-496e-47af-a263-3237f51c3c2b tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 404 len: 111 microversion: 2.1 time: 0.166251 Aug 23 18:05:41.314626 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1654/3367] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:41 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 111 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:41.326291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-963d714b-a1e1-4830-8410-f4142385507a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:41.332329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-963d714b-a1e1-4830-8410-f4142385507a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:41.356549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-963d714b-a1e1-4830-8410-f4142385507a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.360146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-963d714b-a1e1-4830-8410-f4142385507a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:41.360895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-963d714b-a1e1-4830-8410-f4142385507a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.362074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-963d714b-a1e1-4830-8410-f4142385507a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.363251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-963d714b-a1e1-4830-8410-f4142385507a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:41.364542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-963d714b-a1e1-4830-8410-f4142385507a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.415324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-963d714b-a1e1-4830-8410-f4142385507a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lazy-loading 'flavor' on Instance uuid ed1a8703-4973-4c42-859a-5734d134f015 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:05:41.538318 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-963d714b-a1e1-4830-8410-f4142385507a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015/action" status: 200 len: 32 microversion: 2.1 time: 0.222004 Aug 23 18:05:41.539419 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1655/3368] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:41 2022] POST /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015/action => generated 32 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:05:41.552824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6686c205-f02d-4b78-a554-60bf1f85960d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27f1c5ab80>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:41.580066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-11e4c566-27b8-4485-a1fa-af0e02ff93c2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:41.596994 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-11e4c566-27b8-4485-a1fa-af0e02ff93c2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.582995 Aug 23 18:05:41.597620 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1714/3369] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:41 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:41.612764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a81a5914-971e-4a70-91e4-fe1f35e47bc6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-149798559", "metadata": {"image_type": "test"}}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:41.624207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a81a5914-971e-4a70-91e4-fe1f35e47bc6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:41.658918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a81a5914-971e-4a70-91e4-fe1f35e47bc6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.662226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a81a5914-971e-4a70-91e4-fe1f35e47bc6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:41.662771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a81a5914-971e-4a70-91e4-fe1f35e47bc6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.663536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a81a5914-971e-4a70-91e4-fe1f35e47bc6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.664044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a81a5914-971e-4a70-91e4-fe1f35e47bc6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:41.664435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a81a5914-971e-4a70-91e4-fe1f35e47bc6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.693070 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6686c205-f02d-4b78-a554-60bf1f85960d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.151823 Aug 23 18:05:41.694039 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1656/3370] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:41 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:41.708510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-300a6b3c-f032-4fdd-8254-83e3355f8f6a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:41.710341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-300a6b3c-f032-4fdd-8254-83e3355f8f6a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:41.717488 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-a81a5914-971e-4a70-91e4-fe1f35e47bc6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] HTTP exception thrown: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a81a5914-971e-4a70-91e4-fe1f35e47bc6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Request method failure captured: Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85/action HTTP/1.1 Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 111 Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRbH4CHtUOJ8grkctJMxJIZQRiMYGN6S19U42mh-F0PDk4OGPqbwLTJEQIkbOBF8qoINHa-gmcMRf7Vi5T3xANLX6VyDucvF_oJoXPiJXT8SXzPlcCjcCc6XKgTuzFv4yNr-CyCTIpeoQDT6AyslC5HiI1KWAGwprQ9V5OtTBRWcrKA Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}] Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 413560b41e2648a3ba2611c68bd7e3b9 Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-149798559", "metadata": {"image_type": "test"}}} Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'a0cc7aec-9266-46f5-a751-846260cc0f85', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-149798559', 'metadata': {'image_type': 'test'}}}} Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 18:05:41.721886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.727031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.728099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-300a6b3c-f032-4fdd-8254-83e3355f8f6a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.728099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-300a6b3c-f032-4fdd-8254-83e3355f8f6a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:41.728099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-300a6b3c-f032-4fdd-8254-83e3355f8f6a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.728099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-300a6b3c-f032-4fdd-8254-83e3355f8f6a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.728099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-300a6b3c-f032-4fdd-8254-83e3355f8f6a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:41.728099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-300a6b3c-f032-4fdd-8254-83e3355f8f6a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.731327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a81a5914-971e-4a70-91e4-fe1f35e47bc6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Returning 404 to user: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:41.734719 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a81a5914-971e-4a70-91e4-fe1f35e47bc6 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "POST /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85/action" status: 404 len: 111 microversion: 2.1 time: 0.132946 Aug 23 18:05:41.735916 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1715/3371] 10.222.0.61 () {60 vars in 1279 bytes} [Tue Aug 23 18:05:41 2022] POST /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85/action => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:41.749942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-58f429f0-650d-448c-9064-bb3dc7bbc2ea tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1001317747", "metadata": {"image_type": "test"}}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:41.752632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-58f429f0-650d-448c-9064-bb3dc7bbc2ea tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Failed to fetch instance by id tempest-invalid-1661584232 {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 18:05:41.753509 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-58f429f0-650d-448c-9064-bb3dc7bbc2ea tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] HTTP exception thrown: Instance tempest-invalid-1661584232 could not be found. Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-58f429f0-650d-448c-9064-bb3dc7bbc2ea tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Request method failure captured: Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/tempest-invalid-1661584232/action HTTP/1.1 Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 112 Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRbH4CHtUOJ8grkctJMxJIZQRiMYGN6S19U42mh-F0PDk4OGPqbwLTJEQIkbOBF8qoINHa-gmcMRf7Vi5T3xANLX6VyDucvF_oJoXPiJXT8SXzPlcCjcCc6XKgTuzFv4yNr-CyCTIpeoQDT6AyslC5HiI1KWAGwprQ9V5OtTBRWcrKA Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}] Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 413560b41e2648a3ba2611c68bd7e3b9 Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1001317747", "metadata": {"image_type": "test"}}} Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance tempest-invalid-1661584232 could not be found. Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'tempest-invalid-1661584232', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1001317747', 'metadata': {'image_type': 'test'}}}} Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-1661584232 could not be found. Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:41.755298 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-1661584232 could not be found. Aug 23 18:05:41.759787 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.759787 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:41.759787 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.759787 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.759787 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:41.759787 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:41.759787 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:41.759787 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:41.759787 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-1661584232 could not be found. Aug 23 18:05:41.759787 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.762426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-58f429f0-650d-448c-9064-bb3dc7bbc2ea tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Returning 404 to user: Instance tempest-invalid-1661584232 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:41.764024 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-58f429f0-650d-448c-9064-bb3dc7bbc2ea tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "POST /compute/v2.1/servers/tempest-invalid-1661584232/action" status: 404 len: 101 microversion: 2.1 time: 0.018905 Aug 23 18:05:41.765318 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1716/3372] 10.222.0.61 () {60 vars in 1249 bytes} [Tue Aug 23 18:05:41 2022] POST /compute/v2.1/servers/tempest-invalid-1661584232/action => generated 101 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:41.783626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7c60420-a86f-439a-b138-af983f1ad8c9 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-2065984675"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:41.799895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b7c60420-a86f-439a-b138-af983f1ad8c9 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 18:05:41.801526 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b7c60420-a86f-439a-b138-af983f1ad8c9 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7c60420-a86f-439a-b138-af983f1ad8c9 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Request method failure captured: Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 57 Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRbH4CHtUOJ8grkctJMxJIZQRiMYGN6S19U42mh-F0PDk4OGPqbwLTJEQIkbOBF8qoINHa-gmcMRf7Vi5T3xANLX6VyDucvF_oJoXPiJXT8SXzPlcCjcCc6XKgTuzFv4yNr-CyCTIpeoQDT6AyslC5HiI1KWAGwprQ9V5OtTBRWcrKA Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}] Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 413560b41e2648a3ba2611c68bd7e3b9 Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: {"createImage": {"name": "tempest-test-snap-2065984675"}} Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-2065984675'}}} Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 18:05:41.811931 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.817834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:41.817834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.817834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.817834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:41.817834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:41.817834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:41.817834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:41.817834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 18:05:41.817834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.823500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7c60420-a86f-439a-b138-af983f1ad8c9 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:41.828928 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b7c60420-a86f-439a-b138-af983f1ad8c9 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.057850 Aug 23 18:05:41.830862 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1717/3373] 10.222.0.61 () {60 vars in 1275 bytes} [Tue Aug 23 18:05:41 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:41.847895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d025288-e435-44f0-a119-34c83b2a7d12 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-551794172"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:41.853348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8d025288-e435-44f0-a119-34c83b2a7d12 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 18:05:41.856542 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8d025288-e435-44f0-a119-34c83b2a7d12 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d025288-e435-44f0-a119-34c83b2a7d12 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Request method failure captured: Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 56 Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRbH4CHtUOJ8grkctJMxJIZQRiMYGN6S19U42mh-F0PDk4OGPqbwLTJEQIkbOBF8qoINHa-gmcMRf7Vi5T3xANLX6VyDucvF_oJoXPiJXT8SXzPlcCjcCc6XKgTuzFv4yNr-CyCTIpeoQDT6AyslC5HiI1KWAGwprQ9V5OtTBRWcrKA Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}] Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 413560b41e2648a3ba2611c68bd7e3b9 Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: {"createImage": {"name": "tempest-test-snap-551794172"}} Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-551794172'}}} Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1316, in _action_create_image Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 18:05:41.858753 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.862903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:41.862903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.862903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.862903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:41.862903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:41.862903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:41.862903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:41.862903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Aug 23 18:05:41.862903 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.867576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d025288-e435-44f0-a119-34c83b2a7d12 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:41.869420 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8d025288-e435-44f0-a119-34c83b2a7d12 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.032228 Aug 23 18:05:41.875533 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1718/3374] 10.222.0.61 () {60 vars in 1281 bytes} [Tue Aug 23 18:05:41 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:41.887659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33da6cc6-130c-44cb-8267-13b47f3c89d5 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:41.893641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33da6cc6-130c-44cb-8267-13b47f3c89d5 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:41.911153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33da6cc6-130c-44cb-8267-13b47f3c89d5 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.911765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33da6cc6-130c-44cb-8267-13b47f3c89d5 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:41.912318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33da6cc6-130c-44cb-8267-13b47f3c89d5 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.916063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33da6cc6-130c-44cb-8267-13b47f3c89d5 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.916909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33da6cc6-130c-44cb-8267-13b47f3c89d5 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:41.917496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33da6cc6-130c-44cb-8267-13b47f3c89d5 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:41.951151 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-33da6cc6-130c-44cb-8267-13b47f3c89d5 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] HTTP exception thrown: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33da6cc6-130c-44cb-8267-13b47f3c89d5 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Request method failure captured: Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 HTTP/1.1 Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRbH4CHtUOJ8grkctJMxJIZQRiMYGN6S19U42mh-F0PDk4OGPqbwLTJEQIkbOBF8qoINHa-gmcMRf7Vi5T3xANLX6VyDucvF_oJoXPiJXT8SXzPlcCjcCc6XKgTuzFv4yNr-CyCTIpeoQDT6AyslC5HiI1KWAGwprQ9V5OtTBRWcrKA Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}] Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 413560b41e2648a3ba2611c68bd7e3b9 Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'a0cc7aec-9266-46f5-a751-846260cc0f85'} Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:41.956771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:41.960908 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.960908 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.960908 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:41.960908 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.960908 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:41.960908 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:41.960908 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:41.960908 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:41.960908 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:41.960908 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:41.960908 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:41.963635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33da6cc6-130c-44cb-8267-13b47f3c89d5 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Returning 404 to user: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:41.965018 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-33da6cc6-130c-44cb-8267-13b47f3c89d5 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 404 len: 111 microversion: 2.1 time: 0.084350 Aug 23 18:05:41.969148 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1719/3375] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:05:41 2022] DELETE /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:41.981315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4a91293c-a437-4ee7-9ced-713d1ab9e868 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:41.982311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4a91293c-a437-4ee7-9ced-713d1ab9e868 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] [instance: a0cc7aec-9266-46f5-a751-846260cc0f85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:41.997079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a91293c-a437-4ee7-9ced-713d1ab9e868 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:41.998895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a91293c-a437-4ee7-9ced-713d1ab9e868 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:42.000188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a91293c-a437-4ee7-9ced-713d1ab9e868 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:42.002005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a91293c-a437-4ee7-9ced-713d1ab9e868 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:42.004142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a91293c-a437-4ee7-9ced-713d1ab9e868 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:42.005883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a91293c-a437-4ee7-9ced-713d1ab9e868 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:42.051911 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-4a91293c-a437-4ee7-9ced-713d1ab9e868 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] HTTP exception thrown: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4a91293c-a437-4ee7-9ced-713d1ab9e868 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Request method failure captured: Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 HTTP/1.1 Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRbH4CHtUOJ8grkctJMxJIZQRiMYGN6S19U42mh-F0PDk4OGPqbwLTJEQIkbOBF8qoINHa-gmcMRf7Vi5T3xANLX6VyDucvF_oJoXPiJXT8SXzPlcCjcCc6XKgTuzFv4yNr-CyCTIpeoQDT6AyslC5HiI1KWAGwprQ9V5OtTBRWcrKA Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d7da9d1674484e78bcf8e9d68bbb942d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d7da9d1674484e78bcf8e9d68bbb942d"}]}] Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d7da9d1674484e78bcf8e9d68bbb942d Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-459930966 Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 413560b41e2648a3ba2611c68bd7e3b9 Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesNegativeTestJSON-459930966-project Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'a0cc7aec-9266-46f5-a751-846260cc0f85'} Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:42.057005 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:42.061120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:42.061120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:42.061120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:42.061120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:42.061120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:42.061120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. Aug 23 18:05:42.061120 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:42.061120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4a91293c-a437-4ee7-9ced-713d1ab9e868 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] Returning 404 to user: Instance a0cc7aec-9266-46f5-a751-846260cc0f85 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:42.061120 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4a91293c-a437-4ee7-9ced-713d1ab9e868 tempest-ImagesNegativeTestJSON-459930966 tempest-ImagesNegativeTestJSON-459930966-project] 10.222.0.61 "GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85" status: 404 len: 111 microversion: 2.1 time: 0.086747 Aug 23 18:05:42.083705 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1720/3376] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:41 2022] GET /compute/v2.1/servers/a0cc7aec-9266-46f5-a751-846260cc0f85 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:05:42.621875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9e0b671-c5c4-4242-9c98-8421b5666598 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:42.622965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b9e0b671-c5c4-4242-9c98-8421b5666598 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:42.640969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9e0b671-c5c4-4242-9c98-8421b5666598 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:42.641499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9e0b671-c5c4-4242-9c98-8421b5666598 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:42.644231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9e0b671-c5c4-4242-9c98-8421b5666598 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:42.648806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9e0b671-c5c4-4242-9c98-8421b5666598 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:42.649371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9e0b671-c5c4-4242-9c98-8421b5666598 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:42.654999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9e0b671-c5c4-4242-9c98-8421b5666598 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:43.670485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b9e0b671-c5c4-4242-9c98-8421b5666598 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:43.686076 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b9e0b671-c5c4-4242-9c98-8421b5666598 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1656 microversion: 2.1 time: 1.068408 Aug 23 18:05:43.687319 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1721/3377] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:42 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1656 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:43.697775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d4f6019c-a796-49d2-9369-c495f3b4d19b tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df790af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:43.867068 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d4f6019c-a796-49d2-9369-c495f3b4d19b tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.176973 Aug 23 18:05:43.868000 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1722/3378] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:43 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:44.123091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-300a6b3c-f032-4fdd-8254-83e3355f8f6a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:44.133646 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-300a6b3c-f032-4fdd-8254-83e3355f8f6a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 2.438362 Aug 23 18:05:44.139404 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1657/3379] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:41 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 2445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:44.155626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e4cd5de-d406-4c43-8deb-339fbbadd501 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:44.168458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e4cd5de-d406-4c43-8deb-339fbbadd501 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:44.188889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e4cd5de-d406-4c43-8deb-339fbbadd501 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:44.189635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e4cd5de-d406-4c43-8deb-339fbbadd501 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:44.269485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4e4cd5de-d406-4c43-8deb-339fbbadd501 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Going to try to start instance {{(pid=128807) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 18:05:44.378191 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e4cd5de-d406-4c43-8deb-339fbbadd501 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.236114 Aug 23 18:05:44.379410 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1658/3380] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:44 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:05:44.389995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c6349f2-0730-4183-83c8-40604519db03 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:44.394655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5c6349f2-0730-4183-83c8-40604519db03 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:44.416259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c6349f2-0730-4183-83c8-40604519db03 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:44.421758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c6349f2-0730-4183-83c8-40604519db03 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:44.422801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c6349f2-0730-4183-83c8-40604519db03 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:44.423821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c6349f2-0730-4183-83c8-40604519db03 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:44.424523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c6349f2-0730-4183-83c8-40604519db03 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:44.425216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c6349f2-0730-4183-83c8-40604519db03 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:44.533357 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7e6b0cf6-cd7b-47c6-8ac9-a6fa0c1389a2 tempest-TenantUsagesNegativeTestJSON-1381864773 tempest-TenantUsagesNegativeTestJSON-1381864773-project-admin] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-22T18%3A05%3A43.519433&end=2022-08-24T18%3A05%3A43.519433" status: 404 len: 112 microversion: - time: 0.664188 Aug 23 18:05:44.534718 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1723/3381] 10.222.0.61 () {58 vars in 1316 bytes} [Tue Aug 23 18:05:43 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-08-22T18%3A05%3A43.519433&end=2022-08-24T18%3A05%3A43.519433 => generated 112 bytes in 666 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 18:05:44.550236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac6a189d-0960-40ce-b4ba-14f996fe28e2 tempest-TenantUsagesNegativeTestJSON-1381864773 tempest-TenantUsagesNegativeTestJSON-1381864773-project-admin] Calling method '.version_select at 0x7f27df7c7670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:44.571601 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-ac6a189d-0960-40ce-b4ba-14f996fe28e2 tempest-TenantUsagesNegativeTestJSON-1381864773 tempest-TenantUsagesNegativeTestJSON-1381864773-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac6a189d-0960-40ce-b4ba-14f996fe28e2 tempest-TenantUsagesNegativeTestJSON-1381864773 tempest-TenantUsagesNegativeTestJSON-1381864773-project-admin] Request method failure captured: Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-simple-tenant-usage/f67ffb5fc43147f0bbcca78e99eee0cd?start=2022-08-24T18%3A05%3A43.519433&end=2022-08-22T18%3A05%3A43.519433 HTTP/1.1 Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRb3SYfQHv2S_G-ZLx1AlCn8iwhPMMDWOZ6eDJAVNw_qCgUVRKb98FNZm1uwIa18IJhZqquedCwvi9FR7B887Wu6nZQEVluW_GyblH5cff9u_AaTSj2fH-jFw0unAtd0bcfx0pOEyhQ4sSFJkMuqlZMiYQdV4Mz8Gi4uNl7_7fxIdhc Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 87c453ed96de454e8a465fa15e0b7ca1 Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1381864773 Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_87c453ed96de454e8a465fa15e0b7ca1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/87c453ed96de454e8a465fa15e0b7ca1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/87c453ed96de454e8a465fa15e0b7ca1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/87c453ed96de454e8a465fa15e0b7ca1"}]}] Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1381864773 Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 87c453ed96de454e8a465fa15e0b7ca1 Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1381864773 Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TenantUsagesNegativeTestJSON-1381864773-project-admin Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b907dc4ee351471eaa1ab4c9e90952b4 Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1381864773-project-admin Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid start time. The start time cannot occur after the end time. Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f67ffb5fc43147f0bbcca78e99eee0cd'} Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._show(req, id) Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Aug 23 18:05:44.583587 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:44.588154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac6a189d-0960-40ce-b4ba-14f996fe28e2 tempest-TenantUsagesNegativeTestJSON-1381864773 tempest-TenantUsagesNegativeTestJSON-1381864773-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:44.588154 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac6a189d-0960-40ce-b4ba-14f996fe28e2 tempest-TenantUsagesNegativeTestJSON-1381864773 tempest-TenantUsagesNegativeTestJSON-1381864773-project-admin] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage/f67ffb5fc43147f0bbcca78e99eee0cd?start=2022-08-24T18%3A05%3A43.519433&end=2022-08-22T18%3A05%3A43.519433" status: 400 len: 111 microversion: 2.1 time: 0.041308 Aug 23 18:05:44.588390 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1724/3382] 10.222.0.61 () {58 vars in 1412 bytes} [Tue Aug 23 18:05:44 2022] GET /compute/v2.1/os-simple-tenant-usage/f67ffb5fc43147f0bbcca78e99eee0cd?start=2022-08-24T18%3A05%3A43.519433&end=2022-08-22T18%3A05%3A43.519433 => generated 111 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:05:45.056158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5d72bf4-5ca5-487f-9d5e-823d7ef6f275 tempest-TenantUsagesNegativeTestJSON-439442873 tempest-TenantUsagesNegativeTestJSON-439442873-project] Calling method '.version_select at 0x7f27df7e3b80>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:45.063600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e5d72bf4-5ca5-487f-9d5e-823d7ef6f275 tempest-TenantUsagesNegativeTestJSON-439442873 tempest-TenantUsagesNegativeTestJSON-439442873-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': 'cf83a35390444d04a4213082829763f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f67ffb5fc43147f0bbcca78e99eee0cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5d72bf4-5ca5-487f-9d5e-823d7ef6f275 tempest-TenantUsagesNegativeTestJSON-439442873 tempest-TenantUsagesNegativeTestJSON-439442873-project] Request method failure captured: Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-22T18%3A05%3A43.519433&end=2022-08-24T18%3A05%3A43.519433&detailed=1 HTTP/1.1 Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRb1wCq5VgsS-wU9RKkOw9HSirFWTdNxxnuQlx4v15eBneqG2gZXumuMGNCV-bScth71qUNdA2lAHuyTKWlz4CoewKPQVJKDpcxgqfJzYa_c7cKtmXjEiEqNhezctrxqI1k5TTRS1NkZn6ftahwC7Xj21u9J89kpfmnCLcct_q7mp5A Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: f67ffb5fc43147f0bbcca78e99eee0cd Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-439442873 Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f67ffb5fc43147f0bbcca78e99eee0cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f67ffb5fc43147f0bbcca78e99eee0cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f67ffb5fc43147f0bbcca78e99eee0cd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f67ffb5fc43147f0bbcca78e99eee0cd"}]}] Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-439442873 Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: f67ffb5fc43147f0bbcca78e99eee0cd Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-439442873 Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TenantUsagesNegativeTestJSON-439442873-project Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: cf83a35390444d04a4213082829763f5 Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-439442873-project Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: action_args: {} Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._index(req) Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.force_reraise() Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise self.value Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.enforce( Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Aug 23 18:05:45.065305 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5d72bf4-5ca5-487f-9d5e-823d7ef6f275 tempest-TenantUsagesNegativeTestJSON-439442873 tempest-TenantUsagesNegativeTestJSON-439442873-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:45.069397 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e5d72bf4-5ca5-487f-9d5e-823d7ef6f275 tempest-TenantUsagesNegativeTestJSON-439442873 tempest-TenantUsagesNegativeTestJSON-439442873-project] 10.222.0.61 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-22T18%3A05%3A43.519433&end=2022-08-24T18%3A05%3A43.519433&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.468603 Aug 23 18:05:45.078904 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1725/3383] 10.222.0.61 () {58 vars in 1335 bytes} [Tue Aug 23 18:05:44 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-08-22T18%3A05%3A43.519433&end=2022-08-24T18%3A05%3A43.519433&detailed=1 => generated 123 bytes in 481 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:05:45.096288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d6744f81-1bbd-439d-95af-0b290d9494b2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec492a60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:45.246925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5c6349f2-0730-4183-83c8-40604519db03 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:45.267432 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5c6349f2-0730-4183-83c8-40604519db03 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1665 microversion: 2.1 time: 0.883877 Aug 23 18:05:45.278590 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1659/3384] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:44 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1665 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:45.316586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-42c96e78-e17b-4d79-9cb0-fcda9ebbe8ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:45.317220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-42c96e78-e17b-4d79-9cb0-fcda9ebbe8ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:45.324724 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d6744f81-1bbd-439d-95af-0b290d9494b2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.232570 Aug 23 18:05:45.345986 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1726/3385] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:45 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:45.368500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42c96e78-e17b-4d79-9cb0-fcda9ebbe8ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:45.369009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42c96e78-e17b-4d79-9cb0-fcda9ebbe8ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:45.369457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42c96e78-e17b-4d79-9cb0-fcda9ebbe8ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:45.371018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42c96e78-e17b-4d79-9cb0-fcda9ebbe8ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:45.371413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42c96e78-e17b-4d79-9cb0-fcda9ebbe8ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:45.371849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42c96e78-e17b-4d79-9cb0-fcda9ebbe8ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:46.293432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fefe2457-b5cf-46e9-86b1-d48bea316df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:46.294267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fefe2457-b5cf-46e9-86b1-d48bea316df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:46.335976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fefe2457-b5cf-46e9-86b1-d48bea316df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:46.336597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fefe2457-b5cf-46e9-86b1-d48bea316df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:46.341303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fefe2457-b5cf-46e9-86b1-d48bea316df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:46.342142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fefe2457-b5cf-46e9-86b1-d48bea316df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:46.352325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fefe2457-b5cf-46e9-86b1-d48bea316df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:46.358230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fefe2457-b5cf-46e9-86b1-d48bea316df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:46.999069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-42c96e78-e17b-4d79-9cb0-fcda9ebbe8ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:47.025602 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-42c96e78-e17b-4d79-9cb0-fcda9ebbe8ea tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 1.752480 Aug 23 18:05:47.028474 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1660/3386] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:45 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 1760 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:47.060146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c05c94c6-ff4a-4a2b-8fdb-1b96eb2cc7a4 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfca9430>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:47.193052 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c05c94c6-ff4a-4a2b-8fdb-1b96eb2cc7a4 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1423 microversion: 2.1 time: 0.132669 Aug 23 18:05:47.194104 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1661/3387] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:47 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1423 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:47.217604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fefe2457-b5cf-46e9-86b1-d48bea316df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:47.225797 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fefe2457-b5cf-46e9-86b1-d48bea316df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1665 microversion: 2.1 time: 0.938293 Aug 23 18:05:47.231668 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1727/3388] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:46 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1665 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:48.050440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-52e61152-f1a3-4d40-8faf-5ae4cdd09adf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:48.051190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-52e61152-f1a3-4d40-8faf-5ae4cdd09adf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:48.064282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52e61152-f1a3-4d40-8faf-5ae4cdd09adf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:48.066312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52e61152-f1a3-4d40-8faf-5ae4cdd09adf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:48.066875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52e61152-f1a3-4d40-8faf-5ae4cdd09adf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:48.068098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52e61152-f1a3-4d40-8faf-5ae4cdd09adf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:48.068482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52e61152-f1a3-4d40-8faf-5ae4cdd09adf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:48.068930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52e61152-f1a3-4d40-8faf-5ae4cdd09adf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:48.208290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7f555e0-94ff-4bf3-8743-7832614a59e8 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df7b84c0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:48.294324 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f7f555e0-94ff-4bf3-8743-7832614a59e8 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1432 microversion: 2.1 time: 0.089750 Aug 23 18:05:48.294979 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1728/3389] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:48 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1432 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:48.304850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1dc8195-b510-48e6-908b-0ff059637ace tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:48.307073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d1dc8195-b510-48e6-908b-0ff059637ace tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:48.325992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1dc8195-b510-48e6-908b-0ff059637ace tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:48.326903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1dc8195-b510-48e6-908b-0ff059637ace tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:48.327515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1dc8195-b510-48e6-908b-0ff059637ace tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:48.328420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1dc8195-b510-48e6-908b-0ff059637ace tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:48.329039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1dc8195-b510-48e6-908b-0ff059637ace tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:48.329636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1dc8195-b510-48e6-908b-0ff059637ace tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:48.769653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-52e61152-f1a3-4d40-8faf-5ae4cdd09adf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:48.781121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d1dc8195-b510-48e6-908b-0ff059637ace tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:48.790141 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-52e61152-f1a3-4d40-8faf-5ae4cdd09adf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.744671 Aug 23 18:05:48.794335 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1662/3390] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:48 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:48.796651 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d1dc8195-b510-48e6-908b-0ff059637ace tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1665 microversion: 2.1 time: 0.492978 Aug 23 18:05:48.797251 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1729/3391] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:48 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1665 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:48.801000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-38251033-a0b5-439e-96d5-edbcb2819a2d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfb9f5e0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:48.893036 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-38251033-a0b5-439e-96d5-edbcb2819a2d tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 200 len: 1432 microversion: 2.1 time: 0.097355 Aug 23 18:05:48.893747 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1663/3392] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:48 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 1432 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:48.908664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3700c0c2-1765-4b11-a58d-cc88772a89b2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:48.909287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3700c0c2-1765-4b11-a58d-cc88772a89b2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:48.917817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:48.919664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3700c0c2-1765-4b11-a58d-cc88772a89b2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:48.926246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3700c0c2-1765-4b11-a58d-cc88772a89b2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:48.927497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3700c0c2-1765-4b11-a58d-cc88772a89b2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:48.937946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3700c0c2-1765-4b11-a58d-cc88772a89b2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:48.938985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3700c0c2-1765-4b11-a58d-cc88772a89b2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:48.939677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3700c0c2-1765-4b11-a58d-cc88772a89b2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:49.001494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:49.379049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3700c0c2-1765-4b11-a58d-cc88772a89b2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:49.394660 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3700c0c2-1765-4b11-a58d-cc88772a89b2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1465 microversion: 2.1 time: 0.489898 Aug 23 18:05:49.398730 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1730/3393] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:48 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1465 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:49.419964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-30fcd51f-4c56-4404-9e9d-420ba3ccc108 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfbb00d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:49.509384 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-30fcd51f-4c56-4404-9e9d-420ba3ccc108 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/126e0038-c91e-4894-b027-98e76f88a186" status: 200 len: 784 microversion: 2.1 time: 0.093822 Aug 23 18:05:49.511560 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1664/3394] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:49 2022] GET /compute/v2.1/images/126e0038-c91e-4894-b027-98e76f88a186 => generated 784 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:49.524986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1bfc0358-0fd9-4c42-95bd-7b77041aa99f tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:49.540327 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1bfc0358-0fd9-4c42-95bd-7b77041aa99f tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.018069 Aug 23 18:05:49.564953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e054839-9fb6-4375-a77c-88409efa1a77 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec0e5ca0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:49.571812 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1731/3395] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 18:05:49 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:49.812834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-49e4f85c-e9d7-4412-b11b-4cc832dd538c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:49.814215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-49e4f85c-e9d7-4412-b11b-4cc832dd538c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:49.824490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49e4f85c-e9d7-4412-b11b-4cc832dd538c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:49.824993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49e4f85c-e9d7-4412-b11b-4cc832dd538c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:49.825435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49e4f85c-e9d7-4412-b11b-4cc832dd538c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:49.826154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49e4f85c-e9d7-4412-b11b-4cc832dd538c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:49.828757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49e4f85c-e9d7-4412-b11b-4cc832dd538c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:49.829172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49e4f85c-e9d7-4412-b11b-4cc832dd538c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:50.293343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-49e4f85c-e9d7-4412-b11b-4cc832dd538c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:50.305031 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-49e4f85c-e9d7-4412-b11b-4cc832dd538c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.496398 Aug 23 18:05:50.308511 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1732/3396] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:49 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:50.316677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-84e0d6d2-9a53-4a8e-ab5c-8ef20bb734ab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:50.317305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-84e0d6d2-9a53-4a8e-ab5c-8ef20bb734ab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:50.325417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e0d6d2-9a53-4a8e-ab5c-8ef20bb734ab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:50.326136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e0d6d2-9a53-4a8e-ab5c-8ef20bb734ab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:50.326616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e0d6d2-9a53-4a8e-ab5c-8ef20bb734ab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:50.327520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e0d6d2-9a53-4a8e-ab5c-8ef20bb734ab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:50.328748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e0d6d2-9a53-4a8e-ab5c-8ef20bb734ab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:50.329574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e0d6d2-9a53-4a8e-ab5c-8ef20bb734ab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:50.755256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-84e0d6d2-9a53-4a8e-ab5c-8ef20bb734ab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:50.771819 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-84e0d6d2-9a53-4a8e-ab5c-8ef20bb734ab tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.460695 Aug 23 18:05:50.794528 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1733/3397] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:50 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:50.799916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a01ca8fa-57d4-4669-928e-b29527aba168 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Action: 'create', calling method: .version_select at 0x7f27df7c7c10>, body: {"keypair": {"name": "tempest-keypair-1622703101", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQUyNHVJbSxGKVw3TMGxFLXOQoglp8KQhOv4eJGwcPXURlmyTHulqdYyKdZ36keDiEUcsZQ8+6ABfmvolXHjp/piwVxo0e2mLlQ4J7DZaBQJNOwLmisR3xAe9x9Gx+4Fg=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:50.850146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a01ca8fa-57d4-4669-928e-b29527aba168 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Getting quotas for project 6311e21dbe2940cbadac9f3bb3a3116c. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:50.860007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a01ca8fa-57d4-4669-928e-b29527aba168 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Getting quotas for user 30dc491d4aea4ed68055d6ecdf355626 and project 6311e21dbe2940cbadac9f3bb3a3116c. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:50.886944 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a01ca8fa-57d4-4669-928e-b29527aba168 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [ee013254-ad44-4cb4-b5e8-493e981442a5] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 18:05:51.054665 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e054839-9fb6-4375-a77c-88409efa1a77 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "DELETE /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 204 len: 0 microversion: 2.1 time: 1.493186 Aug 23 18:05:51.059761 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1665/3398] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:49 2022] DELETE /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 0 bytes in 1495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:51.066077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9e698b33-fdc4-4a74-ac13-f8ee6c38c1bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:51.067137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9e698b33-fdc4-4a74-ac13-f8ee6c38c1bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:51.076002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e698b33-fdc4-4a74-ac13-f8ee6c38c1bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:51.076866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e698b33-fdc4-4a74-ac13-f8ee6c38c1bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:51.077492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e698b33-fdc4-4a74-ac13-f8ee6c38c1bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:51.078762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e698b33-fdc4-4a74-ac13-f8ee6c38c1bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:51.079249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e698b33-fdc4-4a74-ac13-f8ee6c38c1bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:51.079830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e698b33-fdc4-4a74-ac13-f8ee6c38c1bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:51.282861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9e698b33-fdc4-4a74-ac13-f8ee6c38c1bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:51.295291 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9e698b33-fdc4-4a74-ac13-f8ee6c38c1bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.230015 Aug 23 18:05:51.295291 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1666/3399] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:51 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:51.297479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47ecdf1c-4f77-4711-8043-de51fdda2e79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec264550>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:51.327078 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-47ecdf1c-4f77-4711-8043-de51fdda2e79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] HTTP exception thrown: Image not found. Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47ecdf1c-4f77-4711-8043-de51fdda2e79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Request method failure captured: Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 HTTP/1.1 Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRa0PB_xYvA-kDmBq7wbeloDups4NDpZfrPLl8eiS7a2BhLGB5TQVGqw0wTHdQhFqcoU2TjwToZHJ9gAjROk3QoHiSjAPciA3q9wYd4duGJwPaFjhbat5rHYyLB885rgnKeWwKmVMeP8hLFbT23wOH2zl1k5vUC7HQhZktA8-jPiOPQ Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 13bee7ab4bce40a6a01424dc7a620320 Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesOneServerTestJSON-1875632797 Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_13bee7ab4bce40a6a01424dc7a620320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/13bee7ab4bce40a6a01424dc7a620320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/13bee7ab4bce40a6a01424dc7a620320"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/13bee7ab4bce40a6a01424dc7a620320"}]}] Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesOneServerTestJSON-1875632797 Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 13bee7ab4bce40a6a01424dc7a620320 Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1875632797 Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesOneServerTestJSON-1875632797-project Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 288ed685c4de46349aa9f7fc95951bfb Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesOneServerTestJSON-1875632797-project Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: exception: Image not found. Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '004f96d7-f1ed-4852-b869-57efa01e6a60'} Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 004f96d7-f1ed-4852-b869-57efa01e6a60 Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Aug 23 18:05:51.329975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get(image_id) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 004f96d7-f1ed-4852-b869-57efa01e6a60 could not be found. Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47ecdf1c-4f77-4711-8043-de51fdda2e79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Returning 404 to user: Image not found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-47ecdf1c-4f77-4711-8043-de51fdda2e79 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 404 len: 62 microversion: 2.1 time: 0.038018 Aug 23 18:05:51.341981 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1667/3400] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:51 2022] GET /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 62 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:05:51.345635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6424ad3-7f50-4b71-856e-b4e4313b156b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:51.345635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6424ad3-7f50-4b71-856e-b4e4313b156b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:51.353500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6424ad3-7f50-4b71-856e-b4e4313b156b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:51.353949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6424ad3-7f50-4b71-856e-b4e4313b156b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:51.354459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6424ad3-7f50-4b71-856e-b4e4313b156b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:51.355655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6424ad3-7f50-4b71-856e-b4e4313b156b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:51.356347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6424ad3-7f50-4b71-856e-b4e4313b156b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:51.356970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6424ad3-7f50-4b71-856e-b4e4313b156b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:51.429358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6424ad3-7f50-4b71-856e-b4e4313b156b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Unlocking {{(pid=128807) unlock /opt/stack/nova/nova/compute/api.py:4857}} Aug 23 18:05:51.508480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:51.547857 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6424ad3-7f50-4b71-856e-b4e4313b156b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.208442 Aug 23 18:05:51.549331 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1668/3401] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:51 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:05:51.555108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-36564f37-4be7-4cfe-80ec-0c0037ba602d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:51.556193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-36564f37-4be7-4cfe-80ec-0c0037ba602d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:51.572603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36564f37-4be7-4cfe-80ec-0c0037ba602d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:51.574688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36564f37-4be7-4cfe-80ec-0c0037ba602d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:51.576048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36564f37-4be7-4cfe-80ec-0c0037ba602d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:51.576838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36564f37-4be7-4cfe-80ec-0c0037ba602d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:51.578594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36564f37-4be7-4cfe-80ec-0c0037ba602d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:51.578980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36564f37-4be7-4cfe-80ec-0c0037ba602d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:51.796195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-36564f37-4be7-4cfe-80ec-0c0037ba602d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:51.812436 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-36564f37-4be7-4cfe-80ec-0c0037ba602d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.261492 Aug 23 18:05:51.814192 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1669/3402] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:51 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:51.820644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3fd18066-0299-40e8-8d79-36e5b98192f9 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-2032953328"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:51.824837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3fd18066-0299-40e8-8d79-36e5b98192f9 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:51.834990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3fd18066-0299-40e8-8d79-36e5b98192f9 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:51.836405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3fd18066-0299-40e8-8d79-36e5b98192f9 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:51.837287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3fd18066-0299-40e8-8d79-36e5b98192f9 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:51.838216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3fd18066-0299-40e8-8d79-36e5b98192f9 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:51.841030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3fd18066-0299-40e8-8d79-36e5b98192f9 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:51.844502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3fd18066-0299-40e8-8d79-36e5b98192f9 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:51.895691 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [None req-a01ca8fa-57d4-4669-928e-b29527aba168 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [ee013254-ad44-4cb4-b5e8-493e981442a5] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 45252. Aug 23 18:05:51.933050 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a01ca8fa-57d4-4669-928e-b29527aba168 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.32 time: 1.136389 Aug 23 18:05:51.933651 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1734/3403] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Aug 23 18:05:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1139 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 18:05:51.941771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ff1166e5-cc2d-4455-b8fd-481fd0fc14ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:51.942685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ff1166e5-cc2d-4455-b8fd-481fd0fc14ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:51.966812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff1166e5-cc2d-4455-b8fd-481fd0fc14ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:51.967130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff1166e5-cc2d-4455-b8fd-481fd0fc14ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:51.968814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff1166e5-cc2d-4455-b8fd-481fd0fc14ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:51.971769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff1166e5-cc2d-4455-b8fd-481fd0fc14ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:51.972469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff1166e5-cc2d-4455-b8fd-481fd0fc14ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:51.974690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff1166e5-cc2d-4455-b8fd-481fd0fc14ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:52.319901 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3fd18066-0299-40e8-8d79-36e5b98192f9 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "POST /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1/action" status: 202 len: 0 microversion: 2.1 time: 0.505121 Aug 23 18:05:52.332052 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1670/3404] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:51 2022] POST /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 18:05:52.350490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b5645e26-e8af-444e-85e4-09a1dc555679 req-054f5b52-33ea-499a-be44-cfdd1b0f1350 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a2f8a54-72ff-43c4-a31e-76b29723e3e1", "name": "network-vif-unplugged", "status": "completed", "tag": "d48d38dd-3b1f-4db9-957e-46b040401b51"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:52.361383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ff1166e5-cc2d-4455-b8fd-481fd0fc14ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:52.369589 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ff1166e5-cc2d-4455-b8fd-481fd0fc14ce tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.433059 Aug 23 18:05:52.371069 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1735/3405] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:51 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:52.400308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6e3f8d2c-fe3c-47d6-869b-65a76aa8148c tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df7c7af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:52.413618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b5645e26-e8af-444e-85e4-09a1dc555679 req-054f5b52-33ea-499a-be44-cfdd1b0f1350 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:52.413998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b5645e26-e8af-444e-85e4-09a1dc555679 req-054f5b52-33ea-499a-be44-cfdd1b0f1350 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:52.415343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b5645e26-e8af-444e-85e4-09a1dc555679 req-054f5b52-33ea-499a-be44-cfdd1b0f1350 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:52.442283 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b5645e26-e8af-444e-85e4-09a1dc555679 req-054f5b52-33ea-499a-be44-cfdd1b0f1350 service nova] Creating event network-vif-unplugged:d48d38dd-3b1f-4db9-957e-46b040401b51 for instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 on n-h2-850468-16 Aug 23 18:05:52.452103 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b5645e26-e8af-444e-85e4-09a1dc555679 req-054f5b52-33ea-499a-be44-cfdd1b0f1350 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.117855 Aug 23 18:05:52.453272 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1671/3406] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:05:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:52.461483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2bdfe3d9-bc5f-45bb-a349-a5e6a543ca7f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:52.462297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2bdfe3d9-bc5f-45bb-a349-a5e6a543ca7f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:52.472606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bdfe3d9-bc5f-45bb-a349-a5e6a543ca7f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:52.473325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bdfe3d9-bc5f-45bb-a349-a5e6a543ca7f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:52.473924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bdfe3d9-bc5f-45bb-a349-a5e6a543ca7f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:52.475171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bdfe3d9-bc5f-45bb-a349-a5e6a543ca7f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:52.477874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bdfe3d9-bc5f-45bb-a349-a5e6a543ca7f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:52.479100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bdfe3d9-bc5f-45bb-a349-a5e6a543ca7f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:52.504125 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6e3f8d2c-fe3c-47d6-869b-65a76aa8148c tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.131819 Aug 23 18:05:52.515260 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1736/3407] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:52 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:52.835912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4e6695c9-5d96-4143-8792-5a9a4b472e76 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:52.836553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4e6695c9-5d96-4143-8792-5a9a4b472e76 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:52.852800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e6695c9-5d96-4143-8792-5a9a4b472e76 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:52.859028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e6695c9-5d96-4143-8792-5a9a4b472e76 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:52.861232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e6695c9-5d96-4143-8792-5a9a4b472e76 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:52.863616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e6695c9-5d96-4143-8792-5a9a4b472e76 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:52.866331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e6695c9-5d96-4143-8792-5a9a4b472e76 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:52.867210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e6695c9-5d96-4143-8792-5a9a4b472e76 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:52.887609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2bdfe3d9-bc5f-45bb-a349-a5e6a543ca7f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:52.898780 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2bdfe3d9-bc5f-45bb-a349-a5e6a543ca7f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.443983 Aug 23 18:05:52.911345 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1672/3408] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:52 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:52.924717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0010e134-42e2-4b82-b2ed-9a7317bfc51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:52.925375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0010e134-42e2-4b82-b2ed-9a7317bfc51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:52.939005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:52.956825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0010e134-42e2-4b82-b2ed-9a7317bfc51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:52.957703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0010e134-42e2-4b82-b2ed-9a7317bfc51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:52.958492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0010e134-42e2-4b82-b2ed-9a7317bfc51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:52.959404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0010e134-42e2-4b82-b2ed-9a7317bfc51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:52.960820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0010e134-42e2-4b82-b2ed-9a7317bfc51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:52.964640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0010e134-42e2-4b82-b2ed-9a7317bfc51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:53.150753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4e6695c9-5d96-4143-8792-5a9a4b472e76 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:53.161594 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4e6695c9-5d96-4143-8792-5a9a4b472e76 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.329710 Aug 23 18:05:53.162799 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1737/3409] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:52 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:53.402279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0010e134-42e2-4b82-b2ed-9a7317bfc51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:53.423274 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0010e134-42e2-4b82-b2ed-9a7317bfc51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.502607 Aug 23 18:05:53.433344 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1673/3410] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:52 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:53.446427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7abeb96c-9fb9-459a-af25-2cd58cf0700d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:53.452579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7abeb96c-9fb9-459a-af25-2cd58cf0700d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:53.460017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7abeb96c-9fb9-459a-af25-2cd58cf0700d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:53.460856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7abeb96c-9fb9-459a-af25-2cd58cf0700d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:53.461748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7abeb96c-9fb9-459a-af25-2cd58cf0700d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:53.462760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7abeb96c-9fb9-459a-af25-2cd58cf0700d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:53.463994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7abeb96c-9fb9-459a-af25-2cd58cf0700d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:53.464992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7abeb96c-9fb9-459a-af25-2cd58cf0700d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:53.523744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec63906d-8189-4345-867f-6f95d8831496 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27f1b38af0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:53.601408 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec63906d-8189-4345-867f-6f95d8831496 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.081445 Aug 23 18:05:53.602311 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1674/3411] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:53 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:53.606071 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7abeb96c-9fb9-459a-af25-2cd58cf0700d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.163529 Aug 23 18:05:53.607922 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1738/3412] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:53 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:05:53.617015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1a9f1df3-8652-46e3-9203-b817f3d53768 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:53.618639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1a9f1df3-8652-46e3-9203-b817f3d53768 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:53.627767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a9f1df3-8652-46e3-9203-b817f3d53768 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:53.628508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a9f1df3-8652-46e3-9203-b817f3d53768 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:53.629180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a9f1df3-8652-46e3-9203-b817f3d53768 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:53.630169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a9f1df3-8652-46e3-9203-b817f3d53768 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:53.631122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a9f1df3-8652-46e3-9203-b817f3d53768 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:53.631792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a9f1df3-8652-46e3-9203-b817f3d53768 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:53.834854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1a9f1df3-8652-46e3-9203-b817f3d53768 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:53.844279 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1a9f1df3-8652-46e3-9203-b817f3d53768 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1674 microversion: 2.1 time: 0.232228 Aug 23 18:05:53.845797 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1675/3413] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:53 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1674 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:54.184696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7e57da95-10a7-40fd-bd85-1012e250858a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:54.186027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7e57da95-10a7-40fd-bd85-1012e250858a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:54.193025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e57da95-10a7-40fd-bd85-1012e250858a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:54.193753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e57da95-10a7-40fd-bd85-1012e250858a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:54.194383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e57da95-10a7-40fd-bd85-1012e250858a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:54.195316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e57da95-10a7-40fd-bd85-1012e250858a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:54.195961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e57da95-10a7-40fd-bd85-1012e250858a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:54.196571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e57da95-10a7-40fd-bd85-1012e250858a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:54.476439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-99d95c5b-b82e-4c2a-b28f-88e5d4168f3b tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Action: 'create', calling method: .version_select at 0x7f27dfb48dc0>, body: {"keypair": {"name": "tempest-keypair-1310974342", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXNTV/naL+GghtWNEUrCfByD6qKjTAzDURBkv+XI/06is/yd5IhKMMz4jDOaaV0Q7y2dCQlgCbwhzHIr2o2f9amJiVSaK/x+HxodyYjO9KcDElUyjfD/J3YxMwc1QtmFw=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:54.493845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-99d95c5b-b82e-4c2a-b28f-88e5d4168f3b tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:54.501649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-99d95c5b-b82e-4c2a-b28f-88e5d4168f3b tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for user b866c49e30504fcc9ef4aca4f9acbd21 and project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:54.528712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7e57da95-10a7-40fd-bd85-1012e250858a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:54.536826 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7e57da95-10a7-40fd-bd85-1012e250858a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.356841 Aug 23 18:05:54.541910 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1739/3414] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:54 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:54.543299 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-99d95c5b-b82e-4c2a-b28f-88e5d4168f3b tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.237615 Aug 23 18:05:54.552228 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1676/3415] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Aug 23 18:05:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 248 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 18:05:54.561370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-146cb0a8-cbc4-47d9-888e-5bd507145665 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27df7c7670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:54.587159 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-146cb0a8-cbc4-47d9-888e-5bd507145665 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-1310974342" status: 200 len: 513 microversion: 2.2 time: 0.034767 Aug 23 18:05:54.590907 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1740/3416] 10.222.0.61 () {60 vars in 1258 bytes} [Tue Aug 23 18:05:54 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1310974342 => generated 513 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:54.603235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fed87871-8dcb-4a0a-8c5a-cc48c0a77783 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27dfb50c10>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:54.624414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-41f223c1-9bc1-46b5-9c52-0712dd2c7196 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df782e50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:54.645181 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fed87871-8dcb-4a0a-8c5a-cc48c0a77783 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310974342" status: 204 len: 0 microversion: 2.2 time: 0.046839 Aug 23 18:05:54.654151 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1677/3417] 10.222.0.61 () {60 vars in 1261 bytes} [Tue Aug 23 18:05:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1310974342 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:54.664876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8666919a-da33-4eea-b680-f0c23064cc2c tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Action: 'create', calling method: .version_select at 0x7f27dfb7d790>, body: {"keypair": {"name": "tempest-keypair-1675312930", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxm81ICqbD8oLiCgFKMG04JhUEGRIAsu6KwUKkUBNhymahwAQBbbnwFNaK2ylaEfU3T9/DLu2ED6N8J8XU6hY7UMIKNm7FraGTNdAOTq/KqqUodCIoGZ/Ui6Dnb9iPbkw=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:54.710015 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-41f223c1-9bc1-46b5-9c52-0712dd2c7196 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.090336 Aug 23 18:05:54.714450 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1741/3418] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:54 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:54.717454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-8666919a-da33-4eea-b680-f0c23064cc2c tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:54.724031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-8666919a-da33-4eea-b680-f0c23064cc2c tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for user b866c49e30504fcc9ef4aca4f9acbd21 and project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:54.781915 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8666919a-da33-4eea-b680-f0c23064cc2c tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.124932 Aug 23 18:05:54.784703 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1678/3419] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Aug 23 18:05:54 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 130 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 18:05:54.795874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e8d70e12-f5d7-4053-b2e8-5735bf490bd5 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27df7b8820>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:54.829936 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e8d70e12-f5d7-4053-b2e8-5735bf490bd5 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675312930" status: 204 len: 0 microversion: 2.2 time: 0.038552 Aug 23 18:05:54.834707 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1742/3420] 10.222.0.61 () {60 vars in 1261 bytes} [Tue Aug 23 18:05:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675312930 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:54.841324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a7db0d8-250e-452c-8c31-612c5362ac64 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Action: 'create', calling method: .version_select at 0x7f27dfb48dc0>, body: {"keypair": {"name": "tempest-keypair-2078054785", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:54.859316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-9a7db0d8-250e-452c-8c31-612c5362ac64 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:54.866560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-9a7db0d8-250e-452c-8c31-612c5362ac64 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for user b866c49e30504fcc9ef4aca4f9acbd21 and project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:54.869421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3ded6828-4565-407f-93ab-aed9ac2ff621 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:54.870116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3ded6828-4565-407f-93ab-aed9ac2ff621 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:54.879314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ded6828-4565-407f-93ab-aed9ac2ff621 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:54.880965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ded6828-4565-407f-93ab-aed9ac2ff621 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:54.882454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ded6828-4565-407f-93ab-aed9ac2ff621 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:54.884645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ded6828-4565-407f-93ab-aed9ac2ff621 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:54.885818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ded6828-4565-407f-93ab-aed9ac2ff621 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:54.886533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ded6828-4565-407f-93ab-aed9ac2ff621 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:54.929098 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a7db0d8-250e-452c-8c31-612c5362ac64 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 589 microversion: 2.2 time: 0.091675 Aug 23 18:05:54.931460 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1679/3421] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Aug 23 18:05:54 2022] POST /compute/v2.1/os-keypairs => generated 589 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 18:05:54.942858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ddaf9ceb-d2a6-46d3-9f96-44584f83d0e2 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27dfb50160>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:55.003095 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ddaf9ceb-d2a6-46d3-9f96-44584f83d0e2 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078054785" status: 204 len: 0 microversion: 2.2 time: 0.064577 Aug 23 18:05:55.004094 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1680/3422] 10.222.0.61 () {60 vars in 1261 bytes} [Tue Aug 23 18:05:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2078054785 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:05:55.027926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-784c3785-3284-4389-ad6d-6374873162d0 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Action: 'create', calling method: .version_select at 0x7f27dfbb0f70>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-1312542404", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJT65rQ6CJ+qxBPvnjUcWl5b2jEJcZFMSnkxIb4CXAWFNQpl16VLAxH5YjySyRBqlWK2ELpPi2C5bSzykrtFRh7pEtEq5P4py6zMmSs8ntQZXzjUidmhT/+fOecGgzHofA=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:55.064617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-784c3785-3284-4389-ad6d-6374873162d0 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:55.072547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-784c3785-3284-4389-ad6d-6374873162d0 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for user b866c49e30504fcc9ef4aca4f9acbd21 and project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:55.108311 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-784c3785-3284-4389-ad6d-6374873162d0 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.094995 Aug 23 18:05:55.109348 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1681/3423] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Aug 23 18:05:55 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 97 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 18:05:55.130786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ab7ccf6-0cf1-44c6-95a5-6d69ad29d5ce tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Action: 'create', calling method: .version_select at 0x7f27dfb9f280>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-346624799", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBD0qs/TTInr5vk2bzyO/Vb2rFOAZhm3xMGK/DQiJolBii6VnMVWshdF9XEg+tq9Ve0C5UDFhFg1shy5aAAD+3+GjrO1PGGy1SQeX31yGRB+2onDX17u5UKgar1IUVL1ug=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:55.171267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-1ab7ccf6-0cf1-44c6-95a5-6d69ad29d5ce tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:55.178265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-1ab7ccf6-0cf1-44c6-95a5-6d69ad29d5ce tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for user b866c49e30504fcc9ef4aca4f9acbd21 and project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:55.252944 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1ab7ccf6-0cf1-44c6-95a5-6d69ad29d5ce tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.133250 Aug 23 18:05:55.253639 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1682/3424] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Aug 23 18:05:55 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 135 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Aug 23 18:05:55.267693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2837761b-63fb-4589-9281-143dc136ff04 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Action: 'create', calling method: .version_select at 0x7f27dfb48c10>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2096069317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJixNx2mrxDVltAoCRCIr4cnnpOQ2aRj2BynkBTVUDQHQyMNfSCBny6vpmno8R4B6OxzD7Be7lLKcgft1+5dZixIxyOtQbgDrbg60NlYuz059q0hQ0RkIUm09taAeqonYw=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:55.280039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3ded6828-4565-407f-93ab-aed9ac2ff621 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:55.290145 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3ded6828-4565-407f-93ab-aed9ac2ff621 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1654 microversion: 2.1 time: 0.425451 Aug 23 18:05:55.290771 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1743/3425] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:54 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1654 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:55.316150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-458cd69d-6437-46da-876b-7b7928b8e20a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:55.317258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-458cd69d-6437-46da-876b-7b7928b8e20a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:55.334096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-458cd69d-6437-46da-876b-7b7928b8e20a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:55.334849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-458cd69d-6437-46da-876b-7b7928b8e20a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:55.335334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-2837761b-63fb-4589-9281-143dc136ff04 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:55.337085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-458cd69d-6437-46da-876b-7b7928b8e20a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:55.339994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-458cd69d-6437-46da-876b-7b7928b8e20a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:55.340915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-458cd69d-6437-46da-876b-7b7928b8e20a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:55.343145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-458cd69d-6437-46da-876b-7b7928b8e20a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:55.350600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-2837761b-63fb-4589-9281-143dc136ff04 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for user b866c49e30504fcc9ef4aca4f9acbd21 and project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:55.427325 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2837761b-63fb-4589-9281-143dc136ff04 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.163542 Aug 23 18:05:55.428207 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1683/3426] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Aug 23 18:05:55 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 165 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 18:05:55.441252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5a1c1974-af30-483b-85ef-021f9e49b871 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27dfb500d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:55.460313 n-d-850468-16 devstack@n-api.service[128807]: WARNING oslo_db.sqlalchemy.utils [None req-5a1c1974-af30-483b-85ef-021f9e49b871 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 23 18:05:55.479996 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5a1c1974-af30-483b-85ef-021f9e49b871 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 1141 microversion: 2.2 time: 0.042455 Aug 23 18:05:55.496322 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1684/3427] 10.222.0.61 () {60 vars in 1177 bytes} [Tue Aug 23 18:05:55 2022] GET /compute/v2.1/os-keypairs => generated 1141 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:55.501813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8b815dce-c917-4ba1-8cc4-611f53e7d785 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27dfbb0670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:55.541941 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8b815dce-c917-4ba1-8cc4-611f53e7d785 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2096069317" status: 204 len: 0 microversion: 2.2 time: 0.043163 Aug 23 18:05:55.547474 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1685/3428] 10.222.0.61 () {60 vars in 1321 bytes} [Tue Aug 23 18:05:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2096069317 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:55.552899 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-458cd69d-6437-46da-876b-7b7928b8e20a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.242318 Aug 23 18:05:55.553763 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1744/3429] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:05:55 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:05:55.557598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-1867952136", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "a4471766-ff5c-4c5c-b2f0-ae5590b26b1e"}, {"port": "9c28fa0d-aebc-4d70-8e94-d3f630cc158d", "tag": "port-1"}, {"port": "3a378893-dcd4-44a5-a7c5-f85909c867a9", "tag": "port-2"}, {"uuid": "7a001ae2-adbe-452e-8178-d99d1cde8235", "tag": "net-1"}, {"uuid": "7a001ae2-adbe-452e-8178-d99d1cde8235"}, {"uuid": "786e0ece-0346-44e9-82f5-e8278d01933a", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "786e0ece-0346-44e9-82f5-e8278d01933a", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "df53ea15-0fd0-43c8-b958-093365afcbc9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "ed300d60-7259-4f73-95a0-5d6d36044dbc", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "f1287da3-d0ee-43d3-ac1d-0da54e4c81f5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--469784770"}], "key_name": "tempest-keypair-1622703101", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:55.560892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-76dc2342-ca19-4e1f-945b-00c03d218437 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27df7afee0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:55.605363 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-76dc2342-ca19-4e1f-945b-00c03d218437 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-346624799" status: 204 len: 0 microversion: 2.2 time: 0.050098 Aug 23 18:05:55.609898 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1745/3430] 10.222.0.61 () {60 vars in 1318 bytes} [Tue Aug 23 18:05:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-346624799 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:55.615900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4de8b79e-8749-4a57-8e32-e048caf651c6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:55.616892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4de8b79e-8749-4a57-8e32-e048caf651c6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:55.638031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4de8b79e-8749-4a57-8e32-e048caf651c6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:55.639120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4de8b79e-8749-4a57-8e32-e048caf651c6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:55.640287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4de8b79e-8749-4a57-8e32-e048caf651c6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:55.644766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4de8b79e-8749-4a57-8e32-e048caf651c6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:55.645470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4de8b79e-8749-4a57-8e32-e048caf651c6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:55.646252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4de8b79e-8749-4a57-8e32-e048caf651c6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:55.787087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] validate_networks() for [('a4471766-ff5c-4c5c-b2f0-ae5590b26b1e', None, None, None, None, None), (None, None, '9c28fa0d-aebc-4d70-8e94-d3f630cc158d', None, None, None), (None, None, '3a378893-dcd4-44a5-a7c5-f85909c867a9', None, None, None), ('7a001ae2-adbe-452e-8178-d99d1cde8235', None, None, None, None, None), ('7a001ae2-adbe-452e-8178-d99d1cde8235', None, None, None, None, None), ('786e0ece-0346-44e9-82f5-e8278d01933a', '10.2.2.100', None, None, None, None), ('786e0ece-0346-44e9-82f5-e8278d01933a', '10.2.2.200', None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:05:55.934623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4de8b79e-8749-4a57-8e32-e048caf651c6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:55.951355 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4de8b79e-8749-4a57-8e32-e048caf651c6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.340296 Aug 23 18:05:55.951940 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1746/3431] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:55 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:55.969595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ba1c20c-e231-4ea0-88c9-f7e702f4f567 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:55.970945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8ba1c20c-e231-4ea0-88c9-f7e702f4f567 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:55.983151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ba1c20c-e231-4ea0-88c9-f7e702f4f567 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:55.983657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ba1c20c-e231-4ea0-88c9-f7e702f4f567 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:55.984102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ba1c20c-e231-4ea0-88c9-f7e702f4f567 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:55.988581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ba1c20c-e231-4ea0-88c9-f7e702f4f567 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:55.989072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ba1c20c-e231-4ea0-88c9-f7e702f4f567 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:55.989507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ba1c20c-e231-4ea0-88c9-f7e702f4f567 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:56.364233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8ba1c20c-e231-4ea0-88c9-f7e702f4f567 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:56.384423 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8ba1c20c-e231-4ea0-88c9-f7e702f4f567 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.421855 Aug 23 18:05:56.386926 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1747/3432] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:55 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:56.392332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-43f2b5fd-80be-4e08-98f1-303757f62517 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27df7c7b80>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:56.417982 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-43f2b5fd-80be-4e08-98f1-303757f62517 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1312542404" status: 204 len: 0 microversion: 2.2 time: 0.029697 Aug 23 18:05:56.419119 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1748/3433] 10.222.0.61 () {60 vars in 1321 bytes} [Tue Aug 23 18:05:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-1312542404 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:56.433947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f59d0476-8f0a-4082-8a5a-93a13369706e tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df790ca0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:56.498401 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f59d0476-8f0a-4082-8a5a-93a13369706e tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.071668 Aug 23 18:05:56.506850 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1749/3434] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:56 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:56.521569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-909e3298-d65b-431c-8dc5-56add6e51924 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:56.522256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-909e3298-d65b-431c-8dc5-56add6e51924 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:56.530078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-909e3298-d65b-431c-8dc5-56add6e51924 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:56.530622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-909e3298-d65b-431c-8dc5-56add6e51924 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:56.531132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-909e3298-d65b-431c-8dc5-56add6e51924 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:56.531873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-909e3298-d65b-431c-8dc5-56add6e51924 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:56.532340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-909e3298-d65b-431c-8dc5-56add6e51924 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:56.533332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-909e3298-d65b-431c-8dc5-56add6e51924 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:56.769763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-909e3298-d65b-431c-8dc5-56add6e51924 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:56.781427 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-909e3298-d65b-431c-8dc5-56add6e51924 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.272386 Aug 23 18:05:56.781560 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1750/3435] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:56 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:56.800992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2cf0952a-c745-4c7b-bdad-35c5685463d9 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Action: 'create', calling method: .version_select at 0x7f27df7c71f0>, body: {"keypair": {"name": "tempest-keypair-1311142181", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDvwd0U/Xd/OfynNp1ygLgrb8Z0zlqn6S6zbP1ptk35Qd7mMwQd9Tkw0UWCFXoE0WrG0eKdzijrvC3eEk+T6RXtxhj8yFdNuRFnkvpN945AmnDZha710Cek1IV9ooHEPQ=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:56.818357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-2cf0952a-c745-4c7b-bdad-35c5685463d9 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:56.825304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-2cf0952a-c745-4c7b-bdad-35c5685463d9 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for user b866c49e30504fcc9ef4aca4f9acbd21 and project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:56.861019 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2cf0952a-c745-4c7b-bdad-35c5685463d9 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.064025 Aug 23 18:05:56.861610 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1751/3436] 10.222.0.61 () {62 vars in 1199 bytes} [Tue Aug 23 18:05:56 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 80 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Aug 23 18:05:56.866825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-928e1b36-9007-4811-8ace-aa6301c58cf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:56.868254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-928e1b36-9007-4811-8ace-aa6301c58cf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:56.876298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-928e1b36-9007-4811-8ace-aa6301c58cf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:56.877150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-928e1b36-9007-4811-8ace-aa6301c58cf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:56.877590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-928e1b36-9007-4811-8ace-aa6301c58cf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:56.878341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-928e1b36-9007-4811-8ace-aa6301c58cf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:56.879062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-928e1b36-9007-4811-8ace-aa6301c58cf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:56.879679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-928e1b36-9007-4811-8ace-aa6301c58cf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:57.051400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-928e1b36-9007-4811-8ace-aa6301c58cf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:57.060147 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-928e1b36-9007-4811-8ace-aa6301c58cf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.197290 Aug 23 18:05:57.071598 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1752/3437] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:56 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:57.071598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-282b8430-f13d-472a-89d2-08dfdf5071db tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27df782160>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:57.078777 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-282b8430-f13d-472a-89d2-08dfdf5071db tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-1311142181" status: 200 len: 513 microversion: 2.2 time: 0.013808 Aug 23 18:05:57.078777 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1753/3438] 10.222.0.61 () {60 vars in 1258 bytes} [Tue Aug 23 18:05:57 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1311142181 => generated 513 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:57.089657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4e72af10-5659-4c59-a955-4686724e947c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:57.089657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4e72af10-5659-4c59-a955-4686724e947c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:57.096569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e72af10-5659-4c59-a955-4686724e947c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:57.097127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e72af10-5659-4c59-a955-4686724e947c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:57.097758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e72af10-5659-4c59-a955-4686724e947c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:57.098483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e72af10-5659-4c59-a955-4686724e947c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:57.098985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e72af10-5659-4c59-a955-4686724e947c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:57.099420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e72af10-5659-4c59-a955-4686724e947c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:57.261506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4e72af10-5659-4c59-a955-4686724e947c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:57.273350 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4e72af10-5659-4c59-a955-4686724e947c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.194975 Aug 23 18:05:57.279363 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1754/3439] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:57 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:57.290534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ab8de12-a045-46a0-8fc9-7a9c2f48b721 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27df750d30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:57.297364 n-d-850468-16 devstack@n-api.service[128808]: WARNING oslo_db.sqlalchemy.utils [None req-8ab8de12-a045-46a0-8fc9-7a9c2f48b721 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 23 18:05:57.303715 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8ab8de12-a045-46a0-8fc9-7a9c2f48b721 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.023141 Aug 23 18:05:57.304767 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1755/3440] 10.222.0.61 () {60 vars in 1177 bytes} [Tue Aug 23 18:05:57 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:05:57.310518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7f066cf-9e89-4929-b0c6-de676a79a125 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:57.311940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d7f066cf-9e89-4929-b0c6-de676a79a125 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:57.334091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7f066cf-9e89-4929-b0c6-de676a79a125 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:57.337549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7f066cf-9e89-4929-b0c6-de676a79a125 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:57.341548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7f066cf-9e89-4929-b0c6-de676a79a125 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:57.342407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7f066cf-9e89-4929-b0c6-de676a79a125 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:57.344095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7f066cf-9e89-4929-b0c6-de676a79a125 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:57.344427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7f066cf-9e89-4929-b0c6-de676a79a125 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:57.559008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7f066cf-9e89-4929-b0c6-de676a79a125 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:57.564195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:57.579981 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7f066cf-9e89-4929-b0c6-de676a79a125 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.273335 Aug 23 18:05:57.582724 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1756/3441] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:57 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:57.590142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8548207-3cfe-4524-9016-82d2f6104b93 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27df7508b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:57.619809 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8548207-3cfe-4524-9016-82d2f6104b93 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311142181" status: 204 len: 0 microversion: 2.2 time: 0.035271 Aug 23 18:05:57.620953 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1757/3442] 10.222.0.61 () {60 vars in 1261 bytes} [Tue Aug 23 18:05:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1311142181 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:57.631255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-79a96113-1cfb-41d2-b170-846821471c1a tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df7b8280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:57.696511 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-79a96113-1cfb-41d2-b170-846821471c1a tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.074292 Aug 23 18:05:57.697115 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1758/3443] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:57 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:57.717393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-170d391e-e5d1-4d97-b3a6-1e5cd9ed8619 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:57.718026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-170d391e-e5d1-4d97-b3a6-1e5cd9ed8619 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:57.731446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-170d391e-e5d1-4d97-b3a6-1e5cd9ed8619 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:57.731952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-170d391e-e5d1-4d97-b3a6-1e5cd9ed8619 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:57.732385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-170d391e-e5d1-4d97-b3a6-1e5cd9ed8619 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:57.733339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-170d391e-e5d1-4d97-b3a6-1e5cd9ed8619 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:57.733978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-170d391e-e5d1-4d97-b3a6-1e5cd9ed8619 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:57.734573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-170d391e-e5d1-4d97-b3a6-1e5cd9ed8619 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:57.944429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-170d391e-e5d1-4d97-b3a6-1e5cd9ed8619 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:57.956471 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-170d391e-e5d1-4d97-b3a6-1e5cd9ed8619 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.257356 Aug 23 18:05:57.971291 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1759/3444] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:57 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:57.981626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ee60bed6-ca79-4a75-a347-b9efdf917090 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Action: 'create', calling method: .version_select at 0x7f27df7b81f0>, body: {"keypair": {"name": "tempest-keypair-791343263", "type": "x509"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:05:58.014532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ee60bed6-ca79-4a75-a347-b9efdf917090 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:58.026867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ee60bed6-ca79-4a75-a347-b9efdf917090 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for user b866c49e30504fcc9ef4aca4f9acbd21 and project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:58.045478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.processutils [None req-ee60bed6-ca79-4a75-a347-b9efdf917090 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpju7apym8/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpju7apym8/temp.key -subj /CN=b866c49e30504fcc9ef4aca4f9acbd21 -extensions v3_req_client {{(pid=128808) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 23 18:05:58.609884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.processutils [None req-ee60bed6-ca79-4a75-a347-b9efdf917090 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpju7apym8/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpju7apym8/temp.key -subj /CN=b866c49e30504fcc9ef4aca4f9acbd21 -extensions v3_req_client" returned: 0 in 0.564s {{(pid=128808) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 23 18:05:58.610904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.processutils [None req-ee60bed6-ca79-4a75-a347-b9efdf917090 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpju7apym8/temp.key -password pass: {{(pid=128808) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Aug 23 18:05:58.690467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.processutils [None req-ee60bed6-ca79-4a75-a347-b9efdf917090 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpju7apym8/temp.key -password pass:" returned: 0 in 0.079s {{(pid=128808) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Aug 23 18:05:58.783761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ee60bed6-ca79-4a75-a347-b9efdf917090 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:05:58.792185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ee60bed6-ca79-4a75-a347-b9efdf917090 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Getting quotas for user b866c49e30504fcc9ef4aca4f9acbd21 and project e40b253aa33641d7aa01cb81d5e14f48. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:05:58.803675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=3,nova_api:DELETE=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:05:58.816746 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ee60bed6-ca79-4a75-a347-b9efdf917090 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 4692 microversion: 2.2 time: 0.843909 Aug 23 18:05:58.819025 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1760/3445] 10.222.0.61 () {62 vars in 1198 bytes} [Tue Aug 23 18:05:57 2022] POST /compute/v2.1/os-keypairs => generated 4692 bytes in 847 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:05:58.827848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c5d32379-0686-4086-84a0-e1b866d9694b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:58.830221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c5d32379-0686-4086-84a0-e1b866d9694b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:58.843166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5d32379-0686-4086-84a0-e1b866d9694b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:58.844124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5d32379-0686-4086-84a0-e1b866d9694b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:58.844819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5d32379-0686-4086-84a0-e1b866d9694b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:58.845970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5d32379-0686-4086-84a0-e1b866d9694b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:58.846831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5d32379-0686-4086-84a0-e1b866d9694b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:58.847489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5d32379-0686-4086-84a0-e1b866d9694b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:59.084379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c5d32379-0686-4086-84a0-e1b866d9694b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:59.094890 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c5d32379-0686-4086-84a0-e1b866d9694b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.273422 Aug 23 18:05:59.102589 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1761/3446] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:58 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:59.102589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9db724f2-aeef-4a33-ab8b-2752a5e7810a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:59.102589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9db724f2-aeef-4a33-ab8b-2752a5e7810a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:05:59.113354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9db724f2-aeef-4a33-ab8b-2752a5e7810a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:59.113354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9db724f2-aeef-4a33-ab8b-2752a5e7810a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:59.113354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9db724f2-aeef-4a33-ab8b-2752a5e7810a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:59.113354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9db724f2-aeef-4a33-ab8b-2752a5e7810a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:05:59.113354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9db724f2-aeef-4a33-ab8b-2752a5e7810a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:05:59.113354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9db724f2-aeef-4a33-ab8b-2752a5e7810a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:05:59.311010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9db724f2-aeef-4a33-ab8b-2752a5e7810a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:05:59.320502 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9db724f2-aeef-4a33-ab8b-2752a5e7810a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.223647 Aug 23 18:05:59.321092 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1762/3447] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:05:59 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:59.329052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f6a18980-3d19-48d4-99b7-415fb3e29530 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec492a60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:59.400639 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f6a18980-3d19-48d4-99b7-415fb3e29530 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.075372 Aug 23 18:05:59.401536 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1763/3448] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:05:59 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:59.415175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-249e0da6-7520-404e-b383-6647a4d3d5b6 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27df7b8a60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:59.425739 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-249e0da6-7520-404e-b383-6647a4d3d5b6 tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs/tempest-keypair-791343263" status: 200 len: 1533 microversion: 2.2 time: 0.022905 Aug 23 18:05:59.432863 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1764/3449] 10.222.0.61 () {60 vars in 1255 bytes} [Tue Aug 23 18:05:59 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-791343263 => generated 1533 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:05:59.438747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83fd75a9-f597-4d37-be62-53316b96b60d tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27df7f8940>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:59.443299 n-d-850468-16 devstack@n-api.service[128808]: WARNING oslo_db.sqlalchemy.utils [None req-83fd75a9-f597-4d37-be62-53316b96b60d tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 23 18:05:59.450786 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-83fd75a9-f597-4d37-be62-53316b96b60d tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 1390 microversion: 2.2 time: 0.016181 Aug 23 18:05:59.451483 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1765/3450] 10.222.0.61 () {60 vars in 1177 bytes} [Tue Aug 23 18:05:59 2022] GET /compute/v2.1/os-keypairs => generated 1390 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:05:59.462274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2a84b509-0b79-4fc4-ab3a-d38669246f0c tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] Calling method '.version_select at 0x7f27df7f8d30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:05:59.502521 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2a84b509-0b79-4fc4-ab3a-d38669246f0c tempest-KeyPairsV22TestJSON-1770454115 tempest-KeyPairsV22TestJSON-1770454115-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-791343263" status: 204 len: 0 microversion: 2.2 time: 0.044298 Aug 23 18:05:59.507520 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1766/3451] 10.222.0.61 () {60 vars in 1258 bytes} [Tue Aug 23 18:05:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-791343263 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:06:00.344925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-501b0a20-e2e4-46ab-83bd-7021b68346f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:00.347700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-501b0a20-e2e4-46ab-83bd-7021b68346f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:00.365875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-501b0a20-e2e4-46ab-83bd-7021b68346f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:00.371809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-501b0a20-e2e4-46ab-83bd-7021b68346f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:00.372715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-501b0a20-e2e4-46ab-83bd-7021b68346f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:00.374217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-501b0a20-e2e4-46ab-83bd-7021b68346f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:00.378434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-501b0a20-e2e4-46ab-83bd-7021b68346f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:00.379238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-501b0a20-e2e4-46ab-83bd-7021b68346f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:00.933226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-501b0a20-e2e4-46ab-83bd-7021b68346f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:00.949308 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-501b0a20-e2e4-46ab-83bd-7021b68346f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.608218 Aug 23 18:06:00.949623 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1767/3452] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:00 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:00.973484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2cc3d176-975f-41af-a18e-14a578dfdb2c tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df7f8310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:01.051131 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2cc3d176-975f-41af-a18e-14a578dfdb2c tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.097703 Aug 23 18:06:01.051958 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1768/3453] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:00 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:01.072950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f950437b-0226-4090-8511-12c2f2d357e4 req-a98fe6e9-ea8b-4b87-89ac-d8ed9c3dd498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a2f8a54-72ff-43c4-a31e-76b29723e3e1", "name": "network-vif-plugged", "status": "completed", "tag": "d48d38dd-3b1f-4db9-957e-46b040401b51"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:01.110971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f950437b-0226-4090-8511-12c2f2d357e4 req-a98fe6e9-ea8b-4b87-89ac-d8ed9c3dd498 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:01.111734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f950437b-0226-4090-8511-12c2f2d357e4 req-a98fe6e9-ea8b-4b87-89ac-d8ed9c3dd498 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:01.112274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f950437b-0226-4090-8511-12c2f2d357e4 req-a98fe6e9-ea8b-4b87-89ac-d8ed9c3dd498 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:01.142061 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f950437b-0226-4090-8511-12c2f2d357e4 req-a98fe6e9-ea8b-4b87-89ac-d8ed9c3dd498 service nova] Creating event network-vif-plugged:d48d38dd-3b1f-4db9-957e-46b040401b51 for instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 on n-h2-850468-16 Aug 23 18:06:01.148356 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f950437b-0226-4090-8511-12c2f2d357e4 req-a98fe6e9-ea8b-4b87-89ac-d8ed9c3dd498 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087270 Aug 23 18:06:01.149215 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1769/3454] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:06:01.814427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:06:01.815498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:06:01.816184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:06:01.817037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:06:01.817698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:06:01.842677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:01.845929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:01.848411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:01.849613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:01.863040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:01.863835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:01.926751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Getting quotas for project 6311e21dbe2940cbadac9f3bb3a3116c. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:06:01.950986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Getting quotas for user 30dc491d4aea4ed68055d6ecdf355626 and project 6311e21dbe2940cbadac9f3bb3a3116c. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:06:01.959500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=6,nova_api:DELETE=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:01.974530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-66a1ea1b-ab83-4748-9682-9ae725f6d5a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:01.974530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-66a1ea1b-ab83-4748-9682-9ae725f6d5a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:01.989250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66a1ea1b-ab83-4748-9682-9ae725f6d5a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:01.989755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66a1ea1b-ab83-4748-9682-9ae725f6d5a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:01.990203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66a1ea1b-ab83-4748-9682-9ae725f6d5a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:01.990951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66a1ea1b-ab83-4748-9682-9ae725f6d5a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:01.996119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66a1ea1b-ab83-4748-9682-9ae725f6d5a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:01.996599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66a1ea1b-ab83-4748-9682-9ae725f6d5a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:02.339543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:06:02.346514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='df53ea15-0fd0-43c8-b958-093365afcbc9',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='ed300d60-7259-4f73-95a0-5d6d36044dbc',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f1287da3-d0ee-43d3-ac1d-0da54e4c81f5',volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:06:02.702078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-66a1ea1b-ab83-4748-9682-9ae725f6d5a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:02.714555 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-66a1ea1b-ab83-4748-9682-9ae725f6d5a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.747551 Aug 23 18:06:02.731342 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1770/3455] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:01 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:06:02.743165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a8e3950a-62f4-43fa-9a80-5f59dd8291f0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df776f70>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:02.825751 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a8e3950a-62f4-43fa-9a80-5f59dd8291f0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.090783 Aug 23 18:06:02.827208 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1771/3456] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:02 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:03.242985 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc70a0ee-59df-4161-aa1e-2528c7b090d9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 7.691013 Aug 23 18:06:03.243681 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1686/3457] 10.222.0.61 () {62 vars in 1189 bytes} [Tue Aug 23 18:05:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 7696 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 18:06:03.261495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-780acfad-6a8c-469a-873a-1536a7865fee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:03.264124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-780acfad-6a8c-469a-873a-1536a7865fee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:03.523780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-447ec261-2971-409f-93d6-9e75f7e78eae tempest-AbsoluteLimitsTestJSON-1959806203 tempest-AbsoluteLimitsTestJSON-1959806203-project] Calling method '.version_select at 0x7f27dfba7a60>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:03.545898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-447ec261-2971-409f-93d6-9e75f7e78eae tempest-AbsoluteLimitsTestJSON-1959806203 tempest-AbsoluteLimitsTestJSON-1959806203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:03.547092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-447ec261-2971-409f-93d6-9e75f7e78eae tempest-AbsoluteLimitsTestJSON-1959806203 tempest-AbsoluteLimitsTestJSON-1959806203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:03.548204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-447ec261-2971-409f-93d6-9e75f7e78eae tempest-AbsoluteLimitsTestJSON-1959806203 tempest-AbsoluteLimitsTestJSON-1959806203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:03.549137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-447ec261-2971-409f-93d6-9e75f7e78eae tempest-AbsoluteLimitsTestJSON-1959806203 tempest-AbsoluteLimitsTestJSON-1959806203-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:03.550003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-447ec261-2971-409f-93d6-9e75f7e78eae tempest-AbsoluteLimitsTestJSON-1959806203 tempest-AbsoluteLimitsTestJSON-1959806203-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:03.551191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-447ec261-2971-409f-93d6-9e75f7e78eae tempest-AbsoluteLimitsTestJSON-1959806203 tempest-AbsoluteLimitsTestJSON-1959806203-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:03.614998 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-447ec261-2971-409f-93d6-9e75f7e78eae tempest-AbsoluteLimitsTestJSON-1959806203 tempest-AbsoluteLimitsTestJSON-1959806203-project] 10.222.0.61 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.325095 Aug 23 18:06:03.620064 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1687/3458] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 18:06:03 2022] GET /compute/v2.1/limits => generated 511 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:06:03.761626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-65cef24e-d5af-4334-b7c5-3081fb90df6d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:03.762357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-65cef24e-d5af-4334-b7c5-3081fb90df6d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:03.778056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65cef24e-d5af-4334-b7c5-3081fb90df6d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:03.778639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65cef24e-d5af-4334-b7c5-3081fb90df6d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:03.779053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65cef24e-d5af-4334-b7c5-3081fb90df6d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:03.799400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65cef24e-d5af-4334-b7c5-3081fb90df6d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:03.799895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65cef24e-d5af-4334-b7c5-3081fb90df6d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:03.800343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65cef24e-d5af-4334-b7c5-3081fb90df6d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:04.002195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-780acfad-6a8c-469a-873a-1536a7865fee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:04.026589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-780acfad-6a8c-469a-873a-1536a7865fee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:04.034629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-780acfad-6a8c-469a-873a-1536a7865fee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:04.038873 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-780acfad-6a8c-469a-873a-1536a7865fee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1286 microversion: 2.32 time: 0.787207 Aug 23 18:06:04.040164 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1772/3459] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:03 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1286 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:04.051578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0728b9c9-341f-4d98-87fa-823f02baf204 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df7f8670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:04.145879 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0728b9c9-341f-4d98-87fa-823f02baf204 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.103652 Aug 23 18:06:04.153626 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1773/3460] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:04 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:04.439750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-65cef24e-d5af-4334-b7c5-3081fb90df6d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:04.454088 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-65cef24e-d5af-4334-b7c5-3081fb90df6d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.709858 Aug 23 18:06:04.473091 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1688/3461] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:03 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:05.067144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-61b12339-5ea8-4eac-8241-7aead88a045a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:05.068323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-61b12339-5ea8-4eac-8241-7aead88a045a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:05.170053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c763af9-9469-49eb-8970-72b3ee492e2b tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfb09e50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:05.315417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-61b12339-5ea8-4eac-8241-7aead88a045a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:05.321332 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c763af9-9469-49eb-8970-72b3ee492e2b tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.157016 Aug 23 18:06:05.322910 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1689/3462] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:05 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:05.327185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-61b12339-5ea8-4eac-8241-7aead88a045a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:05.331748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-61b12339-5ea8-4eac-8241-7aead88a045a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:05.334338 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-61b12339-5ea8-4eac-8241-7aead88a045a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1286 microversion: 2.32 time: 0.271273 Aug 23 18:06:05.336017 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1774/3463] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:05 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1286 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:05.482202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d7888e82-ef3d-488a-bee4-294eda607bc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:05.483485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d7888e82-ef3d-488a-bee4-294eda607bc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:05.504438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7888e82-ef3d-488a-bee4-294eda607bc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:05.505079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7888e82-ef3d-488a-bee4-294eda607bc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:05.505558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7888e82-ef3d-488a-bee4-294eda607bc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:05.506284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7888e82-ef3d-488a-bee4-294eda607bc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:05.506776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7888e82-ef3d-488a-bee4-294eda607bc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:05.507210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7888e82-ef3d-488a-bee4-294eda607bc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:06.030574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d7888e82-ef3d-488a-bee4-294eda607bc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:06.048456 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d7888e82-ef3d-488a-bee4-294eda607bc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.571648 Aug 23 18:06:06.053360 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1690/3464] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:05 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:06.338610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-862e62c3-1b40-4b9d-8c85-569392d35ee7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df776280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:06.365584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07b027ca-14c9-4ec8-b730-89927bba9add tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:06.366214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07b027ca-14c9-4ec8-b730-89927bba9add tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:06.378676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07b027ca-14c9-4ec8-b730-89927bba9add tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:06.379643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07b027ca-14c9-4ec8-b730-89927bba9add tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:06.383424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07b027ca-14c9-4ec8-b730-89927bba9add tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:06.386416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07b027ca-14c9-4ec8-b730-89927bba9add tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:06.387162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07b027ca-14c9-4ec8-b730-89927bba9add tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:06.388926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07b027ca-14c9-4ec8-b730-89927bba9add tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:06.508064 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-862e62c3-1b40-4b9d-8c85-569392d35ee7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.173999 Aug 23 18:06:06.508989 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1775/3465] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:06 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:06.649577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-07b027ca-14c9-4ec8-b730-89927bba9add tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:06.668310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-07b027ca-14c9-4ec8-b730-89927bba9add tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:06.678239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-07b027ca-14c9-4ec8-b730-89927bba9add tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:06.691022 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-07b027ca-14c9-4ec8-b730-89927bba9add tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1576 microversion: 2.32 time: 0.330227 Aug 23 18:06:06.695697 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1691/3466] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:06 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1576 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:06:07.093586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4b74556e-ae9c-4aca-9263-d970b0124be0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:07.097513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4b74556e-ae9c-4aca-9263-d970b0124be0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:07.125430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b74556e-ae9c-4aca-9263-d970b0124be0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:07.139321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b74556e-ae9c-4aca-9263-d970b0124be0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:07.140264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b74556e-ae9c-4aca-9263-d970b0124be0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:07.142467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b74556e-ae9c-4aca-9263-d970b0124be0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:07.160511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b74556e-ae9c-4aca-9263-d970b0124be0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:07.162622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b74556e-ae9c-4aca-9263-d970b0124be0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:07.524222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e262e201-2a18-4afe-abbe-0fc4ddfe9c98 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfbb0820>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:07.609511 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e262e201-2a18-4afe-abbe-0fc4ddfe9c98 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.089383 Aug 23 18:06:07.613243 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1692/3467] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:07 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:07.720859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d2b5591-2f3a-4a54-9424-2852bb4e3139 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:07.722345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2d2b5591-2f3a-4a54-9424-2852bb4e3139 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:07.747882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d2b5591-2f3a-4a54-9424-2852bb4e3139 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:07.748531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d2b5591-2f3a-4a54-9424-2852bb4e3139 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:07.748993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d2b5591-2f3a-4a54-9424-2852bb4e3139 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:07.749820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d2b5591-2f3a-4a54-9424-2852bb4e3139 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:07.750281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d2b5591-2f3a-4a54-9424-2852bb4e3139 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:07.760446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d2b5591-2f3a-4a54-9424-2852bb4e3139 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:07.977549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b74556e-ae9c-4aca-9263-d970b0124be0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:07.985620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2d2b5591-2f3a-4a54-9424-2852bb4e3139 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:08.000599 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4b74556e-ae9c-4aca-9263-d970b0124be0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 0.922508 Aug 23 18:06:08.001277 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1776/3468] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:07 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:08.019502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2d2b5591-2f3a-4a54-9424-2852bb4e3139 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:08.027245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2d2b5591-2f3a-4a54-9424-2852bb4e3139 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:08.030469 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2d2b5591-2f3a-4a54-9424-2852bb4e3139 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1594 microversion: 2.32 time: 0.313919 Aug 23 18:06:08.034890 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1693/3469] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:07 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1594 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:08.644428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-32f79a08-af18-40c9-beb4-83dfb603422f tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df7b8d30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:08.741421 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-32f79a08-af18-40c9-beb4-83dfb603422f tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.116503 Aug 23 18:06:08.742076 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1777/3470] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:08 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:09.023639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-100da8b5-9d5c-4f8a-b85d-7bbb990b6455 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:09.024285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-100da8b5-9d5c-4f8a-b85d-7bbb990b6455 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:09.036689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-100da8b5-9d5c-4f8a-b85d-7bbb990b6455 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:09.049805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-100da8b5-9d5c-4f8a-b85d-7bbb990b6455 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:09.053018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-100da8b5-9d5c-4f8a-b85d-7bbb990b6455 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:09.061492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d003ddb1-9e58-4cff-a549-5de2a98c5db0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:09.062585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d003ddb1-9e58-4cff-a549-5de2a98c5db0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:09.066475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-100da8b5-9d5c-4f8a-b85d-7bbb990b6455 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:09.078007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-100da8b5-9d5c-4f8a-b85d-7bbb990b6455 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:09.081004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-100da8b5-9d5c-4f8a-b85d-7bbb990b6455 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:09.088327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d003ddb1-9e58-4cff-a549-5de2a98c5db0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:09.100786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d003ddb1-9e58-4cff-a549-5de2a98c5db0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:09.112930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d003ddb1-9e58-4cff-a549-5de2a98c5db0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:09.119648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d003ddb1-9e58-4cff-a549-5de2a98c5db0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:09.124428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d003ddb1-9e58-4cff-a549-5de2a98c5db0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:09.127641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d003ddb1-9e58-4cff-a549-5de2a98c5db0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:09.813505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d003ddb1-9e58-4cff-a549-5de2a98c5db0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:09.827739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d003ddb1-9e58-4cff-a549-5de2a98c5db0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:09.850089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d003ddb1-9e58-4cff-a549-5de2a98c5db0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:09.855712 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d003ddb1-9e58-4cff-a549-5de2a98c5db0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1594 microversion: 2.32 time: 0.799014 Aug 23 18:06:09.863435 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1778/3471] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:09 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1594 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:06:09.887299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0dbcf86a-7c72-4193-a4ef-d21697c893a3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df77be50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:10.009027 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0dbcf86a-7c72-4193-a4ef-d21697c893a3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.144217 Aug 23 18:06:10.011831 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1779/3472] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:09 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:10.378443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-100da8b5-9d5c-4f8a-b85d-7bbb990b6455 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:10.397646 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-100da8b5-9d5c-4f8a-b85d-7bbb990b6455 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 1.379072 Aug 23 18:06:10.414444 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1694/3473] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:09 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 1396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:10.885587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-89ab4f20-b3f6-4bf6-b806-7d0519266aae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:10.886950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-89ab4f20-b3f6-4bf6-b806-7d0519266aae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:10.943508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89ab4f20-b3f6-4bf6-b806-7d0519266aae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:10.944270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89ab4f20-b3f6-4bf6-b806-7d0519266aae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:10.944732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89ab4f20-b3f6-4bf6-b806-7d0519266aae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:10.945484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89ab4f20-b3f6-4bf6-b806-7d0519266aae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:10.948958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89ab4f20-b3f6-4bf6-b806-7d0519266aae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:10.949557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89ab4f20-b3f6-4bf6-b806-7d0519266aae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:11.025263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-658241dd-4d33-43f2-bccc-4c0baa1fdd21 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfbb4430>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:11.123546 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-658241dd-4d33-43f2-bccc-4c0baa1fdd21 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.101339 Aug 23 18:06:11.131006 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1695/3474] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:11 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:11.421358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-29f04818-e1a3-4669-9504-3e780bf29578 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:11.422018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-29f04818-e1a3-4669-9504-3e780bf29578 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:11.449798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29f04818-e1a3-4669-9504-3e780bf29578 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:11.460539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29f04818-e1a3-4669-9504-3e780bf29578 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:11.468019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29f04818-e1a3-4669-9504-3e780bf29578 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:11.471325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29f04818-e1a3-4669-9504-3e780bf29578 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:11.475968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29f04818-e1a3-4669-9504-3e780bf29578 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:11.483094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29f04818-e1a3-4669-9504-3e780bf29578 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:11.902655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-89ab4f20-b3f6-4bf6-b806-7d0519266aae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:11.939859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-89ab4f20-b3f6-4bf6-b806-7d0519266aae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:11.945496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-89ab4f20-b3f6-4bf6-b806-7d0519266aae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:11.954903 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-89ab4f20-b3f6-4bf6-b806-7d0519266aae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1661 microversion: 2.32 time: 1.071053 Aug 23 18:06:11.958568 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1780/3475] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:10 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1661 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:12.142143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-67ebcb2a-7151-4095-8108-897ee0238688 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df7005e0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:12.257654 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-67ebcb2a-7151-4095-8108-897ee0238688 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.119549 Aug 23 18:06:12.267289 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1781/3476] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:12 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:06:12.989862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-abd7db75-6846-49e8-a1e8-97a16c4e7791 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:12.991566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-abd7db75-6846-49e8-a1e8-97a16c4e7791 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:13.001765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd7db75-6846-49e8-a1e8-97a16c4e7791 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:13.002530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd7db75-6846-49e8-a1e8-97a16c4e7791 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:13.003197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd7db75-6846-49e8-a1e8-97a16c4e7791 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:13.004212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd7db75-6846-49e8-a1e8-97a16c4e7791 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:13.004883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd7db75-6846-49e8-a1e8-97a16c4e7791 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:13.005512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd7db75-6846-49e8-a1e8-97a16c4e7791 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:13.546056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=32 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:13.580480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:13.754262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-abd7db75-6846-49e8-a1e8-97a16c4e7791 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:13.773879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-abd7db75-6846-49e8-a1e8-97a16c4e7791 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:13.783766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-abd7db75-6846-49e8-a1e8-97a16c4e7791 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:13.791781 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-abd7db75-6846-49e8-a1e8-97a16c4e7791 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1661 microversion: 2.32 time: 0.808727 Aug 23 18:06:13.792910 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1782/3477] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:12 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1661 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:06:13.813030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-77d27cb0-8c12-4702-88e7-2e2beada64b8 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df782a60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:13.929262 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-77d27cb0-8c12-4702-88e7-2e2beada64b8 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.132600 Aug 23 18:06:13.931578 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1783/3478] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:13 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:14.023638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-29f04818-e1a3-4669-9504-3e780bf29578 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:14.046225 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-29f04818-e1a3-4669-9504-3e780bf29578 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 2.627248 Aug 23 18:06:14.050938 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1696/3479] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:11 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 2634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:06:14.824804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ee027d62-19cf-4773-9edb-99611693a783 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:14.825651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ee027d62-19cf-4773-9edb-99611693a783 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:14.840857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee027d62-19cf-4773-9edb-99611693a783 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:14.841366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee027d62-19cf-4773-9edb-99611693a783 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:14.841811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee027d62-19cf-4773-9edb-99611693a783 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:14.842627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee027d62-19cf-4773-9edb-99611693a783 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:14.849979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee027d62-19cf-4773-9edb-99611693a783 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:14.850487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee027d62-19cf-4773-9edb-99611693a783 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:14.945073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ad3a85c4-f17a-45a5-af6a-1bac4006cc2f tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfb1d1f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:15.022880 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ad3a85c4-f17a-45a5-af6a-1bac4006cc2f tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.081878 Aug 23 18:06:15.031233 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1697/3480] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:14 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:15.069293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91f1c166-db07-440f-acb8-3a10fd97ba63 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:15.070055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-91f1c166-db07-440f-acb8-3a10fd97ba63 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:15.090962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f1c166-db07-440f-acb8-3a10fd97ba63 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:15.091535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f1c166-db07-440f-acb8-3a10fd97ba63 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:15.094812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f1c166-db07-440f-acb8-3a10fd97ba63 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:15.096190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f1c166-db07-440f-acb8-3a10fd97ba63 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:15.102166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f1c166-db07-440f-acb8-3a10fd97ba63 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:15.104132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f1c166-db07-440f-acb8-3a10fd97ba63 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:15.325313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=20 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:15.800282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ee027d62-19cf-4773-9edb-99611693a783 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:15.826335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ee027d62-19cf-4773-9edb-99611693a783 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:15.828627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ee027d62-19cf-4773-9edb-99611693a783 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:15.833618 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ee027d62-19cf-4773-9edb-99611693a783 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1707 microversion: 2.32 time: 1.016224 Aug 23 18:06:15.838418 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1784/3481] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:14 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1707 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:16.038392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-37d6de4a-6638-4a93-a806-a39cd63712c1 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df782af0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:16.160769 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-37d6de4a-6638-4a93-a806-a39cd63712c1 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.126965 Aug 23 18:06:16.161504 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1785/3482] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:16 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:16.861965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33411e38-6d73-406f-8210-a98c02bf5b02 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:16.863428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33411e38-6d73-406f-8210-a98c02bf5b02 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:16.876857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33411e38-6d73-406f-8210-a98c02bf5b02 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:16.880855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33411e38-6d73-406f-8210-a98c02bf5b02 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:16.891478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33411e38-6d73-406f-8210-a98c02bf5b02 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:16.892430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33411e38-6d73-406f-8210-a98c02bf5b02 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:16.895799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33411e38-6d73-406f-8210-a98c02bf5b02 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:16.896385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33411e38-6d73-406f-8210-a98c02bf5b02 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:17.208071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-91f1c166-db07-440f-acb8-3a10fd97ba63 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:17.227300 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-91f1c166-db07-440f-acb8-3a10fd97ba63 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1522 microversion: 2.1 time: 2.162607 Aug 23 18:06:17.229799 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1698/3483] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:15 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1522 bytes in 2166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:06:17.239286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9d4ed406-fe6e-41fc-bf56-d4b6005756a2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec0e5b80>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:17.338951 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9d4ed406-fe6e-41fc-bf56-d4b6005756a2 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.102023 Aug 23 18:06:17.340045 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1699/3484] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:17 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:18.061681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-33411e38-6d73-406f-8210-a98c02bf5b02 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:18.082663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-33411e38-6d73-406f-8210-a98c02bf5b02 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:18.085249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-33411e38-6d73-406f-8210-a98c02bf5b02 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:18.089839 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-33411e38-6d73-406f-8210-a98c02bf5b02 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1707 microversion: 2.32 time: 1.232435 Aug 23 18:06:18.099130 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1786/3485] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:16 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1707 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:06:18.250355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e712a0bc-0128-436d-8703-9b528f0dc50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:18.251383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e712a0bc-0128-436d-8703-9b528f0dc50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:18.287512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e712a0bc-0128-436d-8703-9b528f0dc50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:18.292815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e712a0bc-0128-436d-8703-9b528f0dc50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:18.298367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e712a0bc-0128-436d-8703-9b528f0dc50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:18.304146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e712a0bc-0128-436d-8703-9b528f0dc50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:18.306333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e712a0bc-0128-436d-8703-9b528f0dc50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:18.314235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e712a0bc-0128-436d-8703-9b528f0dc50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:18.355292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9493b750-3d9f-41c8-a703-a1712b0c58d3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df702820>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:18.443946 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9493b750-3d9f-41c8-a703-a1712b0c58d3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.093252 Aug 23 18:06:18.444538 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1787/3486] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:18 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:06:18.738530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e712a0bc-0128-436d-8703-9b528f0dc50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:18.750815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:18.752179 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e712a0bc-0128-436d-8703-9b528f0dc50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1502 microversion: 2.1 time: 0.506034 Aug 23 18:06:18.757902 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1700/3487] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:18 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1502 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:18.773286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6b903e93-954a-4464-9269-187341456aaa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:18.773978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6b903e93-954a-4464-9269-187341456aaa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:18.792507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b903e93-954a-4464-9269-187341456aaa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:18.793019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b903e93-954a-4464-9269-187341456aaa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:18.793464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b903e93-954a-4464-9269-187341456aaa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:18.794200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b903e93-954a-4464-9269-187341456aaa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:18.794682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b903e93-954a-4464-9269-187341456aaa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:18.803349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b903e93-954a-4464-9269-187341456aaa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:19.124773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d7dc80ea-fb5b-4e73-aadd-ef1b3264489d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:19.126176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d7dc80ea-fb5b-4e73-aadd-ef1b3264489d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:19.141314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7dc80ea-fb5b-4e73-aadd-ef1b3264489d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:19.142084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7dc80ea-fb5b-4e73-aadd-ef1b3264489d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:19.142792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7dc80ea-fb5b-4e73-aadd-ef1b3264489d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:19.143990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7dc80ea-fb5b-4e73-aadd-ef1b3264489d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:19.148340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7dc80ea-fb5b-4e73-aadd-ef1b3264489d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:19.149006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7dc80ea-fb5b-4e73-aadd-ef1b3264489d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:19.806906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d7dc80ea-fb5b-4e73-aadd-ef1b3264489d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:19.831428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d7dc80ea-fb5b-4e73-aadd-ef1b3264489d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:19.844568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d7dc80ea-fb5b-4e73-aadd-ef1b3264489d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:19.845804 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d7dc80ea-fb5b-4e73-aadd-ef1b3264489d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1753 microversion: 2.32 time: 0.725142 Aug 23 18:06:19.871597 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1701/3488] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:19 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1753 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:19.886510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3abd501b-2bec-4e9c-be2a-1b11d2f365a8 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfb7d1f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:20.021452 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3abd501b-2bec-4e9c-be2a-1b11d2f365a8 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.148291 Aug 23 18:06:20.024377 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1702/3489] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:19 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:20.587584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6b903e93-954a-4464-9269-187341456aaa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:20.616747 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6b903e93-954a-4464-9269-187341456aaa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1515 microversion: 2.1 time: 1.844063 Aug 23 18:06:20.620968 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1788/3490] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:18 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1515 bytes in 1852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:20.649535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5c39bd5-b5fb-4ff5-8c4f-b11e2b90ab64 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:20.652414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a5c39bd5-b5fb-4ff5-8c4f-b11e2b90ab64 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 201bdfd1-80e9-48ad-9345-b207203ef270] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:20.689930 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-a5c39bd5-b5fb-4ff5-8c4f-b11e2b90ab64 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] HTTP exception thrown: Instance 201bdfd1-80e9-48ad-9345-b207203ef270 could not be found. Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5c39bd5-b5fb-4ff5-8c4f-b11e2b90ab64 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Request method failure captured: Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/201bdfd1-80e9-48ad-9345-b207203ef270/action HTTP/1.1 Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 14 Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRbMS5n_NsGau0vnGI0iBrS85eKgyFW2-flo5AMEagzFwHXr8y830jIBRx2ycNUqbit5tulaOzYGG8jmEgWnoI2Kij-0Ap1FvDFmaX_VNZTOBEswqTbIxjk8xyB5l_Bmsy2gQs8ixm2uUwN9H5qHjYOcvdPlZGrIYQD4Gm01UoxEIk4 Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}] Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 283c529ff2774efca184740ad6ccfdd5 Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: {"rescue": {}} Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 201bdfd1-80e9-48ad-9345-b207203ef270 could not be found. Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '201bdfd1-80e9-48ad-9345-b207203ef270', 'body': {'rescue': {}}} Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 201bdfd1-80e9-48ad-9345-b207203ef270 could not be found. Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 201bdfd1-80e9-48ad-9345-b207203ef270 could not be found. Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:20.704774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:20.710475 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:06:20.710475 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:06:20.710475 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:06:20.710475 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:06:20.710475 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 201bdfd1-80e9-48ad-9345-b207203ef270 could not be found. Aug 23 18:06:20.710475 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:20.710475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5c39bd5-b5fb-4ff5-8c4f-b11e2b90ab64 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Returning 404 to user: Instance 201bdfd1-80e9-48ad-9345-b207203ef270 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:06:20.710475 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a5c39bd5-b5fb-4ff5-8c4f-b11e2b90ab64 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/201bdfd1-80e9-48ad-9345-b207203ef270/action" status: 404 len: 111 microversion: 2.1 time: 0.062360 Aug 23 18:06:20.710475 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1703/3491] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:06:20 2022] POST /compute/v2.1/servers/201bdfd1-80e9-48ad-9345-b207203ef270/action => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:06:20.719763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b280d99d-46fc-418b-9447-e908288973ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:20.720334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b280d99d-46fc-418b-9447-e908288973ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:20.736239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b280d99d-46fc-418b-9447-e908288973ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:20.736726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b280d99d-46fc-418b-9447-e908288973ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:20.737176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b280d99d-46fc-418b-9447-e908288973ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:20.737908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b280d99d-46fc-418b-9447-e908288973ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:20.751314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b280d99d-46fc-418b-9447-e908288973ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:20.751782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b280d99d-46fc-418b-9447-e908288973ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:20.869654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3c6bad7d-8ee8-463f-99cf-14acd0822ed6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:20.870294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3c6bad7d-8ee8-463f-99cf-14acd0822ed6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:20.889668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c6bad7d-8ee8-463f-99cf-14acd0822ed6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:20.899561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c6bad7d-8ee8-463f-99cf-14acd0822ed6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:20.902338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c6bad7d-8ee8-463f-99cf-14acd0822ed6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:20.903384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c6bad7d-8ee8-463f-99cf-14acd0822ed6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:20.912983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c6bad7d-8ee8-463f-99cf-14acd0822ed6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:20.915942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c6bad7d-8ee8-463f-99cf-14acd0822ed6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:21.120881 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b280d99d-46fc-418b-9447-e908288973ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/action" status: 202 len: 0 microversion: 2.1 time: 0.405854 Aug 23 18:06:21.122587 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1789/3492] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:06:20 2022] POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:06:21.153015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1e7af2e3-1ce1-4674-a041-2b761817b6c4 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df790310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:22.670760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3c6bad7d-8ee8-463f-99cf-14acd0822ed6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:22.709440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3c6bad7d-8ee8-463f-99cf-14acd0822ed6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:22.711111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3c6bad7d-8ee8-463f-99cf-14acd0822ed6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:22.712353 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3c6bad7d-8ee8-463f-99cf-14acd0822ed6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1753 microversion: 2.32 time: 1.847037 Aug 23 18:06:22.712989 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1704/3493] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:20 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1753 bytes in 1848 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:06:22.754115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1e66c5d0-ebb9-4b70-b7e4-c300249aa2b6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:22.765606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1e66c5d0-ebb9-4b70-b7e4-c300249aa2b6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:22.796100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e66c5d0-ebb9-4b70-b7e4-c300249aa2b6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:22.796606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e66c5d0-ebb9-4b70-b7e4-c300249aa2b6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:22.797069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e66c5d0-ebb9-4b70-b7e4-c300249aa2b6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:22.797800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e66c5d0-ebb9-4b70-b7e4-c300249aa2b6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:22.798265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e66c5d0-ebb9-4b70-b7e4-c300249aa2b6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:22.823518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e66c5d0-ebb9-4b70-b7e4-c300249aa2b6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:26.498195 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1e7af2e3-1ce1-4674-a041-2b761817b6c4 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 5.373818 Aug 23 18:06:26.498842 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1790/3494] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:21 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 5375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:26.538035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bcb832ce-2a46-4a94-a989-59eea18ce721 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:26.539175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bcb832ce-2a46-4a94-a989-59eea18ce721 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:26.580354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcb832ce-2a46-4a94-a989-59eea18ce721 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:26.581244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcb832ce-2a46-4a94-a989-59eea18ce721 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:26.585297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcb832ce-2a46-4a94-a989-59eea18ce721 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:26.587160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcb832ce-2a46-4a94-a989-59eea18ce721 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:26.595693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcb832ce-2a46-4a94-a989-59eea18ce721 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:26.596433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcb832ce-2a46-4a94-a989-59eea18ce721 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:27.183028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1e66c5d0-ebb9-4b70-b7e4-c300249aa2b6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:27.201938 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1e66c5d0-ebb9-4b70-b7e4-c300249aa2b6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1500 microversion: 2.1 time: 4.461669 Aug 23 18:06:27.206302 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1705/3495] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:22 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1500 bytes in 4470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:27.243330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:27.249284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:27.276770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:27.277599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:27.278353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:27.281656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:27.282349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:27.285088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:27.386663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bcb832ce-2a46-4a94-a989-59eea18ce721 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:27.406162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lazy-loading 'flavor' on Instance uuid ea6af0b0-dd81-47c9-ba04-42c3612b8eec {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:06:27.433579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bcb832ce-2a46-4a94-a989-59eea18ce721 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:27.435394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bcb832ce-2a46-4a94-a989-59eea18ce721 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:27.438020 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bcb832ce-2a46-4a94-a989-59eea18ce721 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1799 microversion: 2.32 time: 0.931441 Aug 23 18:06:27.455168 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1791/3496] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:26 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1799 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:27.463295 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] HTTP exception thrown: Cannot 'rescue' instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec while it is in vm_state paused Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Request method failure captured: Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/action HTTP/1.1 Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 14 Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRbMS5n_NsGau0vnGI0iBrS85eKgyFW2-flo5AMEagzFwHXr8y830jIBRx2ycNUqbit5tulaOzYGG8jmEgWnoI2Kij-0Ap1FvDFmaX_VNZTOBEswqTbIxjk8xyB5l_Bmsy2gQs8ixm2uUwN9H5qHjYOcvdPlZGrIYQD4Gm01UoxEIk4 Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}] Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 283c529ff2774efca184740ad6ccfdd5 Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: {"rescue": {}} Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: exception: Cannot 'rescue' instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec while it is in vm_state paused Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'ea6af0b0-dd81-47c9-ba04-42c3612b8eec', 'body': {'rescue': {}}} Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec in vm_state paused. Cannot rescue while the instance is in this state. Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec while it is in vm_state paused Aug 23 18:06:27.486129 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:27.495301 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:06:27.495301 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:27.495301 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:27.495301 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:06:27.495301 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:06:27.495301 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:06:27.495301 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:06:27.495301 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec while it is in vm_state paused Aug 23 18:06:27.495301 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:27.495301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Returning 409 to user: Cannot 'rescue' instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec while it is in vm_state paused {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:06:27.495301 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2eaf395e-13cb-4224-9c1c-4e01d5020b8b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/action" status: 409 len: 144 microversion: 2.1 time: 0.256909 Aug 23 18:06:27.509701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4aa71352-4534-4790-9994-9e90143b1658 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:27.510681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4aa71352-4534-4790-9994-9e90143b1658 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:27.512751 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1706/3497] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:06:27 2022] POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/action => generated 144 bytes in 278 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:06:27.529596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-26f22d31-29d9-43cc-9c51-d84ba619791c tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfb77670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:27.529879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa71352-4534-4790-9994-9e90143b1658 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:27.533573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa71352-4534-4790-9994-9e90143b1658 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:27.534628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa71352-4534-4790-9994-9e90143b1658 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:27.535619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa71352-4534-4790-9994-9e90143b1658 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:27.538731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa71352-4534-4790-9994-9e90143b1658 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:27.541771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa71352-4534-4790-9994-9e90143b1658 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:27.642435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:27.693538 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-26f22d31-29d9-43cc-9c51-d84ba619791c tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.176200 Aug 23 18:06:27.697507 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1707/3498] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:27 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:28.029810 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4aa71352-4534-4790-9994-9e90143b1658 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/action" status: 202 len: 0 microversion: 2.1 time: 0.520936 Aug 23 18:06:28.037499 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1792/3499] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:06:27 2022] POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/action => generated 0 bytes in 537 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:06:28.057093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c6b8f477-1b90-4e76-bd5e-cb10d9dd40c4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:28.060700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c6b8f477-1b90-4e76-bd5e-cb10d9dd40c4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:28.080231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6b8f477-1b90-4e76-bd5e-cb10d9dd40c4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:28.081082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6b8f477-1b90-4e76-bd5e-cb10d9dd40c4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:28.081727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6b8f477-1b90-4e76-bd5e-cb10d9dd40c4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:28.085363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6b8f477-1b90-4e76-bd5e-cb10d9dd40c4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:28.086065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6b8f477-1b90-4e76-bd5e-cb10d9dd40c4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:28.086726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6b8f477-1b90-4e76-bd5e-cb10d9dd40c4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:28.489980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1936a8c-4911-4cc1-bef3-728399c2f8ef tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:28.490721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d1936a8c-4911-4cc1-bef3-728399c2f8ef tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:28.522251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1936a8c-4911-4cc1-bef3-728399c2f8ef tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:28.523020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1936a8c-4911-4cc1-bef3-728399c2f8ef tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:28.523234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1936a8c-4911-4cc1-bef3-728399c2f8ef tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:28.540034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1936a8c-4911-4cc1-bef3-728399c2f8ef tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:28.546407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1936a8c-4911-4cc1-bef3-728399c2f8ef tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:28.547023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1936a8c-4911-4cc1-bef3-728399c2f8ef tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:28.996826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c6b8f477-1b90-4e76-bd5e-cb10d9dd40c4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:29.016625 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c6b8f477-1b90-4e76-bd5e-cb10d9dd40c4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1507 microversion: 2.1 time: 0.971698 Aug 23 18:06:29.020208 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1708/3500] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:28 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1507 bytes in 981 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:29.044538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c0ddca0-6d52-40d3-82ae-7dc9ee712a08 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfb774c0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:29.175635 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5c0ddca0-6d52-40d3-82ae-7dc9ee712a08 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.154300 Aug 23 18:06:29.176818 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1709/3501] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:29 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:29.393158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d1936a8c-4911-4cc1-bef3-728399c2f8ef tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:29.416360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d1936a8c-4911-4cc1-bef3-728399c2f8ef tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:29.426651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d1936a8c-4911-4cc1-bef3-728399c2f8ef tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:29.433766 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d1936a8c-4911-4cc1-bef3-728399c2f8ef tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1799 microversion: 2.32 time: 0.948104 Aug 23 18:06:29.440559 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1793/3502] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:28 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1799 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:06:30.050930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6e9ccad-d923-4f74-a178-90c2a62dc147 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:30.051732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6e9ccad-d923-4f74-a178-90c2a62dc147 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:30.079001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6e9ccad-d923-4f74-a178-90c2a62dc147 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:30.079434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6e9ccad-d923-4f74-a178-90c2a62dc147 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:30.079890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6e9ccad-d923-4f74-a178-90c2a62dc147 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:30.099121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6e9ccad-d923-4f74-a178-90c2a62dc147 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:30.099747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6e9ccad-d923-4f74-a178-90c2a62dc147 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:30.130931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6e9ccad-d923-4f74-a178-90c2a62dc147 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:30.196494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-21139d1c-a16f-495a-9c3e-3d7dd2af547b tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df7f8f70>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:30.411791 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-21139d1c-a16f-495a-9c3e-3d7dd2af547b tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.215772 Aug 23 18:06:30.412840 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1794/3503] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:30 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:30.474352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f01755c-f6aa-42a7-a55a-f6d9648dbe98 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:30.475110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f01755c-f6aa-42a7-a55a-f6d9648dbe98 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:30.492605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:30.504290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f01755c-f6aa-42a7-a55a-f6d9648dbe98 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:30.506618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f01755c-f6aa-42a7-a55a-f6d9648dbe98 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:30.507735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f01755c-f6aa-42a7-a55a-f6d9648dbe98 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:30.512727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f01755c-f6aa-42a7-a55a-f6d9648dbe98 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:30.515479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f01755c-f6aa-42a7-a55a-f6d9648dbe98 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:30.516481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f01755c-f6aa-42a7-a55a-f6d9648dbe98 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:31.132276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f6e9ccad-d923-4f74-a178-90c2a62dc147 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:31.145431 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6e9ccad-d923-4f74-a178-90c2a62dc147 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1515 microversion: 2.1 time: 1.098314 Aug 23 18:06:31.146254 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1710/3504] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:30 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1515 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:31.184118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f01755c-f6aa-42a7-a55a-f6d9648dbe98 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:31.215000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f01755c-f6aa-42a7-a55a-f6d9648dbe98 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:31.231322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f01755c-f6aa-42a7-a55a-f6d9648dbe98 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:31.232761 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f01755c-f6aa-42a7-a55a-f6d9648dbe98 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1799 microversion: 2.32 time: 0.762719 Aug 23 18:06:31.234482 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1795/3505] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:30 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1799 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:06:31.435161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4f767b73-b16a-4648-bc4e-a5801e2e9651 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec9ec0d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:31.595657 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4f767b73-b16a-4648-bc4e-a5801e2e9651 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.165577 Aug 23 18:06:31.596563 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1711/3506] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:31 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:32.288834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-63783f3b-37ad-4f64-b891-eff883bbbaae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:32.290597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-63783f3b-37ad-4f64-b891-eff883bbbaae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:32.303616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63783f3b-37ad-4f64-b891-eff883bbbaae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:32.317816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63783f3b-37ad-4f64-b891-eff883bbbaae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:32.329720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63783f3b-37ad-4f64-b891-eff883bbbaae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:32.331341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63783f3b-37ad-4f64-b891-eff883bbbaae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:32.362733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63783f3b-37ad-4f64-b891-eff883bbbaae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:32.363646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63783f3b-37ad-4f64-b891-eff883bbbaae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:32.631130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-55232a82-f87f-4525-9a8e-41d2e76e97df tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfbb0430>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:32.812179 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-55232a82-f87f-4525-9a8e-41d2e76e97df tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.185239 Aug 23 18:06:32.829764 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1712/3507] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:32 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:33.519195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-63783f3b-37ad-4f64-b891-eff883bbbaae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:33.551116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-63783f3b-37ad-4f64-b891-eff883bbbaae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:33.553237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-63783f3b-37ad-4f64-b891-eff883bbbaae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:33.563533 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-63783f3b-37ad-4f64-b891-eff883bbbaae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1845 microversion: 2.32 time: 1.280206 Aug 23 18:06:33.565901 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1796/3508] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:32 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1845 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:33.833442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-61a19c00-0bd8-4f0e-97e0-4b129bb51f01 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfb7d1f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:33.974017 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-61a19c00-0bd8-4f0e-97e0-4b129bb51f01 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.144571 Aug 23 18:06:33.975126 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1713/3509] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:33 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:34.596757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-90c2f13a-9780-4aa4-8cc7-44cb4ffe38fd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:34.598081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-90c2f13a-9780-4aa4-8cc7-44cb4ffe38fd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:34.614997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90c2f13a-9780-4aa4-8cc7-44cb4ffe38fd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:34.632167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90c2f13a-9780-4aa4-8cc7-44cb4ffe38fd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:34.639309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90c2f13a-9780-4aa4-8cc7-44cb4ffe38fd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:34.640339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90c2f13a-9780-4aa4-8cc7-44cb4ffe38fd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:34.644278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90c2f13a-9780-4aa4-8cc7-44cb4ffe38fd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:34.647914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90c2f13a-9780-4aa4-8cc7-44cb4ffe38fd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:34.989938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e9b95541-96d8-4986-a40a-ffdc6c48e9b9 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27ec2645e0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:35.129243 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e9b95541-96d8-4986-a40a-ffdc6c48e9b9 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1429 microversion: 2.1 time: 0.143731 Aug 23 18:06:35.169029 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1714/3510] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:34 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1429 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:35.191814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-6fd5fe25-d90e-4a90-8621-e16cd1a97689 req-9f51d89b-d004-46b5-92c8-3fda1808238a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "tag": "1eee6fec-aebe-4ef5-b406-7ef3e9925c14"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:35.275800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:35.330410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6fd5fe25-d90e-4a90-8621-e16cd1a97689 req-9f51d89b-d004-46b5-92c8-3fda1808238a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:35.349438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6fd5fe25-d90e-4a90-8621-e16cd1a97689 req-9f51d89b-d004-46b5-92c8-3fda1808238a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:35.352612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6fd5fe25-d90e-4a90-8621-e16cd1a97689 req-9f51d89b-d004-46b5-92c8-3fda1808238a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:35.429662 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-6fd5fe25-d90e-4a90-8621-e16cd1a97689 req-9f51d89b-d004-46b5-92c8-3fda1808238a service nova] Creating event network-changed:1eee6fec-aebe-4ef5-b406-7ef3e9925c14 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:06:35.496868 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-6fd5fe25-d90e-4a90-8621-e16cd1a97689 req-9f51d89b-d004-46b5-92c8-3fda1808238a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.321661 Aug 23 18:06:35.525892 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1715/3511] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:06:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:06:35.954224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-90c2f13a-9780-4aa4-8cc7-44cb4ffe38fd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:35.984236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-90c2f13a-9780-4aa4-8cc7-44cb4ffe38fd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:35.996598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-90c2f13a-9780-4aa4-8cc7-44cb4ffe38fd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:35.998281 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-90c2f13a-9780-4aa4-8cc7-44cb4ffe38fd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1845 microversion: 2.32 time: 1.405447 Aug 23 18:06:36.024219 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1797/3512] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:34 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1845 bytes in 1432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:36.166444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56b1bc20-eeed-4c4f-9c0d-81e8320efec7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27f1c5a8b0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:37.049190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c79480a4-94d5-4e83-a68f-e506bf1db182 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:37.049873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c79480a4-94d5-4e83-a68f-e506bf1db182 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:37.067411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c79480a4-94d5-4e83-a68f-e506bf1db182 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:37.074946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c79480a4-94d5-4e83-a68f-e506bf1db182 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:37.077478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c79480a4-94d5-4e83-a68f-e506bf1db182 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:37.081114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c79480a4-94d5-4e83-a68f-e506bf1db182 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:37.083727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c79480a4-94d5-4e83-a68f-e506bf1db182 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:37.084524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c79480a4-94d5-4e83-a68f-e506bf1db182 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:38.244892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c79480a4-94d5-4e83-a68f-e506bf1db182 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:38.263251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c79480a4-94d5-4e83-a68f-e506bf1db182 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:38.271509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c79480a4-94d5-4e83-a68f-e506bf1db182 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:38.277993 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c79480a4-94d5-4e83-a68f-e506bf1db182 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1866 microversion: 2.32 time: 1.234297 Aug 23 18:06:38.279442 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1798/3513] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:37 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1866 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:38.284509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2104513547", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "efca7801-4c49-4f2e-ba97-2ba72d461e4f"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:40.451003 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-56b1bc20-eeed-4c4f-9c0d-81e8320efec7 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1438 microversion: 2.1 time: 4.289233 Aug 23 18:06:40.460976 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1716/3514] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:36 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1438 bytes in 4300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:40.474101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-e142a020-12df-435f-b4cd-b0461ca1c78b req-1512ebd1-5b8d-47b8-826b-4c78f4a73f3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "tag": "9c28fa0d-aebc-4d70-8e94-d3f630cc158d"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:40.489961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] validate_networks() for [('efca7801-4c49-4f2e-ba97-2ba72d461e4f', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:06:40.513593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e142a020-12df-435f-b4cd-b0461ca1c78b req-1512ebd1-5b8d-47b8-826b-4c78f4a73f3e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:40.514093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e142a020-12df-435f-b4cd-b0461ca1c78b req-1512ebd1-5b8d-47b8-826b-4c78f4a73f3e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:40.514525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e142a020-12df-435f-b4cd-b0461ca1c78b req-1512ebd1-5b8d-47b8-826b-4c78f4a73f3e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:40.548716 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-e142a020-12df-435f-b4cd-b0461ca1c78b req-1512ebd1-5b8d-47b8-826b-4c78f4a73f3e service nova] Creating event network-changed:9c28fa0d-aebc-4d70-8e94-d3f630cc158d for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:06:40.559803 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-e142a020-12df-435f-b4cd-b0461ca1c78b req-1512ebd1-5b8d-47b8-826b-4c78f4a73f3e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097439 Aug 23 18:06:40.561890 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1717/3515] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:06:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:06:40.595637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25b63264-f5cc-4cab-808a-806e4db90482 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:40.604007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-25b63264-f5cc-4cab-808a-806e4db90482 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:40.640468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25b63264-f5cc-4cab-808a-806e4db90482 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:40.643266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25b63264-f5cc-4cab-808a-806e4db90482 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:40.644786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25b63264-f5cc-4cab-808a-806e4db90482 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:40.647147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25b63264-f5cc-4cab-808a-806e4db90482 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:40.650157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25b63264-f5cc-4cab-808a-806e4db90482 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:40.650800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25b63264-f5cc-4cab-808a-806e4db90482 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:40.722430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-25b63264-f5cc-4cab-808a-806e4db90482 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lazy-loading 'flavor' on Instance uuid ea6af0b0-dd81-47c9-ba04-42c3612b8eec {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:06:40.981976 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-25b63264-f5cc-4cab-808a-806e4db90482 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/action" status: 200 len: 32 microversion: 2.1 time: 0.417234 Aug 23 18:06:40.986261 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1718/3516] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:06:40 2022] POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/action => generated 32 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:06:41.007619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1173e21a-6c22-4190-a367-38c17bfd8a8b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:41.012544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1173e21a-6c22-4190-a367-38c17bfd8a8b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:41.036408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1173e21a-6c22-4190-a367-38c17bfd8a8b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:41.036942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1173e21a-6c22-4190-a367-38c17bfd8a8b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:41.037384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1173e21a-6c22-4190-a367-38c17bfd8a8b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:41.046905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1173e21a-6c22-4190-a367-38c17bfd8a8b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:41.047664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1173e21a-6c22-4190-a367-38c17bfd8a8b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:41.048188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1173e21a-6c22-4190-a367-38c17bfd8a8b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:41.505224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1173e21a-6c22-4190-a367-38c17bfd8a8b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:41.527094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1173e21a-6c22-4190-a367-38c17bfd8a8b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:41.528681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1173e21a-6c22-4190-a367-38c17bfd8a8b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:41.532049 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1173e21a-6c22-4190-a367-38c17bfd8a8b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1887 microversion: 2.32 time: 0.543069 Aug 23 18:06:41.535445 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1719/3517] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:40 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1887 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:42.101346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2b40d8a3-87c5-4e00-84ab-92179b62b8d0 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Action: 'create', calling method: .version_select at 0x7f27dfbb4040>, body: {"keypair": {"name": "tempest-keypair-894823886", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOu2vRUtsWs85k286GXLfmNqCWUhfX4XtSqlzH3ZB4GJoBTOLWvRECLC3AujcIRCL9hH1Nql4v3V1PSXY2DCI3caLkJnygYvB7SYSed+ySAgqCqb5yfFvEXku81PHl9Gvg=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:42.153494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-2b40d8a3-87c5-4e00-84ab-92179b62b8d0 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Getting quotas for project 62607278cfa846a1b818bf8af91db1da. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:06:42.165023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-2b40d8a3-87c5-4e00-84ab-92179b62b8d0 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Getting quotas for user 45d01351a0604f539d16033483a387b7 and project 62607278cfa846a1b818bf8af91db1da. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:06:42.235891 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2b40d8a3-87c5-4e00-84ab-92179b62b8d0 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.699100 Aug 23 18:06:42.237807 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1720/3518] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:06:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:06:42.242862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d6234af0-e243-4ca3-b771-915e5d56b994 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27dfb50e50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:42.365853 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d6234af0-e243-4ca3-b771-915e5d56b994 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 200 len: 1438 microversion: 2.1 time: 0.126807 Aug 23 18:06:42.366854 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1721/3519] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:06:42 2022] GET /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 1438 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:42.379418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cb7e417e-c50b-4302-a3cc-84e8fa621ef4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:42.387737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cb7e417e-c50b-4302-a3cc-84e8fa621ef4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:42.411611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb7e417e-c50b-4302-a3cc-84e8fa621ef4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:42.412120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb7e417e-c50b-4302-a3cc-84e8fa621ef4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:42.413793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb7e417e-c50b-4302-a3cc-84e8fa621ef4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:42.414588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb7e417e-c50b-4302-a3cc-84e8fa621ef4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:42.417811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb7e417e-c50b-4302-a3cc-84e8fa621ef4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:42.419609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb7e417e-c50b-4302-a3cc-84e8fa621ef4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:42.925774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:06:42.926779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:06:42.927462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:06:42.928062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:06:42.928663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:06:42.952854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:42.959091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:42.963988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:42.968299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:42.969742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:42.969742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:43.021691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Getting quotas for project ea86d950d3924eec9e05e4b4cdb87c68. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:06:43.033699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Getting quotas for user f3b3185ff033439a88ad2577ef0133a8 and project ea86d950d3924eec9e05e4b4cdb87c68. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:06:43.088799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:06:43.091809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:06:43.204043 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e527745b-21fd-48c1-825d-43e73c661544 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.923217 Aug 23 18:06:43.205337 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1799/3520] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:06:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 4925 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:06:43.216911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-53b2bdd6-1ebf-48ec-9d7b-4a4fbdc7d222 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:43.217836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-53b2bdd6-1ebf-48ec-9d7b-4a4fbdc7d222 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:43.231441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53b2bdd6-1ebf-48ec-9d7b-4a4fbdc7d222 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:43.232173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53b2bdd6-1ebf-48ec-9d7b-4a4fbdc7d222 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:43.232795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53b2bdd6-1ebf-48ec-9d7b-4a4fbdc7d222 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:43.233879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53b2bdd6-1ebf-48ec-9d7b-4a4fbdc7d222 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:43.234563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53b2bdd6-1ebf-48ec-9d7b-4a4fbdc7d222 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:43.235170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-53b2bdd6-1ebf-48ec-9d7b-4a4fbdc7d222 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:43.759380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cb7e417e-c50b-4302-a3cc-84e8fa621ef4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:43.774004 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cb7e417e-c50b-4302-a3cc-84e8fa621ef4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1521 microversion: 2.1 time: 1.405766 Aug 23 18:06:43.778472 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1722/3521] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:42 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1521 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:43.799601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-729e53f8-b8db-4df1-878a-336a070932c5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:43.800224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-729e53f8-b8db-4df1-878a-336a070932c5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:43.815024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-729e53f8-b8db-4df1-878a-336a070932c5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:43.819112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-729e53f8-b8db-4df1-878a-336a070932c5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:43.821960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-729e53f8-b8db-4df1-878a-336a070932c5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:43.822813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-729e53f8-b8db-4df1-878a-336a070932c5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:43.823284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-729e53f8-b8db-4df1-878a-336a070932c5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:43.823936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-729e53f8-b8db-4df1-878a-336a070932c5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:43.861559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-53b2bdd6-1ebf-48ec-9d7b-4a4fbdc7d222 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:43.876938 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-53b2bdd6-1ebf-48ec-9d7b-4a4fbdc7d222 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1465 microversion: 2.1 time: 0.665236 Aug 23 18:06:43.887252 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1800/3522] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:43 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1465 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:43.900786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-835a7585-6150-411e-aea8-09a87c98f8ab tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:43.918687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-835a7585-6150-411e-aea8-09a87c98f8ab tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:44.095838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-835a7585-6150-411e-aea8-09a87c98f8ab tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:44.109752 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-835a7585-6150-411e-aea8-09a87c98f8ab tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1214 microversion: 2.1 time: 0.220923 Aug 23 18:06:44.110643 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1801/3523] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:43 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1214 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:44.318100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-28b86de8-5114-437e-bd55-676ba7450512 req-804f620e-e5b4-4b7a-8721-15c0d3fb593c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "tag": "3a378893-dcd4-44a5-a7c5-f85909c867a9"}, {"name": "network-changed", "server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "tag": "a1a07c6e-8c7d-4734-a891-22a469b9c832"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:44.355599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-28b86de8-5114-437e-bd55-676ba7450512 req-804f620e-e5b4-4b7a-8721-15c0d3fb593c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:44.355599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-28b86de8-5114-437e-bd55-676ba7450512 req-804f620e-e5b4-4b7a-8721-15c0d3fb593c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:44.355930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-28b86de8-5114-437e-bd55-676ba7450512 req-804f620e-e5b4-4b7a-8721-15c0d3fb593c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:44.413943 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-28b86de8-5114-437e-bd55-676ba7450512 req-804f620e-e5b4-4b7a-8721-15c0d3fb593c service nova] Creating event network-changed:3a378893-dcd4-44a5-a7c5-f85909c867a9 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:06:44.414465 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-28b86de8-5114-437e-bd55-676ba7450512 req-804f620e-e5b4-4b7a-8721-15c0d3fb593c service nova] Creating event network-changed:a1a07c6e-8c7d-4734-a891-22a469b9c832 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:06:44.442472 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-28b86de8-5114-437e-bd55-676ba7450512 req-804f620e-e5b4-4b7a-8721-15c0d3fb593c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.330351 Aug 23 18:06:44.443147 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1802/3524] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:06:44.474308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c5ecbd34-3e6c-41dc-a3fa-de384207b073 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df782160>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:45.433263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-729e53f8-b8db-4df1-878a-336a070932c5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:45.464809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-729e53f8-b8db-4df1-878a-336a070932c5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:45.469916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-729e53f8-b8db-4df1-878a-336a070932c5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:45.473829 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-729e53f8-b8db-4df1-878a-336a070932c5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1887 microversion: 2.32 time: 1.693949 Aug 23 18:06:45.475231 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1723/3525] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:43 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1887 bytes in 1696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:46.006231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-c346d2a5-f21c-4c21-a07e-6b442f71e7f7 req-763ef0e8-2289-44a2-8586-07c50946531c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a2f8a54-72ff-43c4-a31e-76b29723e3e1", "name": "network-vif-unplugged", "status": "completed", "tag": "d48d38dd-3b1f-4db9-957e-46b040401b51"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:46.033621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c346d2a5-f21c-4c21-a07e-6b442f71e7f7 req-763ef0e8-2289-44a2-8586-07c50946531c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:46.035764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c346d2a5-f21c-4c21-a07e-6b442f71e7f7 req-763ef0e8-2289-44a2-8586-07c50946531c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:46.036819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c346d2a5-f21c-4c21-a07e-6b442f71e7f7 req-763ef0e8-2289-44a2-8586-07c50946531c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:46.054178 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-c346d2a5-f21c-4c21-a07e-6b442f71e7f7 req-763ef0e8-2289-44a2-8586-07c50946531c service nova] Creating event network-vif-unplugged:d48d38dd-3b1f-4db9-957e-46b040401b51 for instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 on n-h2-850468-16 Aug 23 18:06:46.066507 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-c346d2a5-f21c-4c21-a07e-6b442f71e7f7 req-763ef0e8-2289-44a2-8586-07c50946531c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.586282 Aug 23 18:06:46.068367 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1724/3526] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:06:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:06:46.079538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc14d753-e8c3-485d-809e-5d73efdd6c27 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:46.080821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc14d753-e8c3-485d-809e-5d73efdd6c27 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:46.099436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc14d753-e8c3-485d-809e-5d73efdd6c27 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:46.099953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc14d753-e8c3-485d-809e-5d73efdd6c27 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:46.100943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc14d753-e8c3-485d-809e-5d73efdd6c27 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:46.101725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc14d753-e8c3-485d-809e-5d73efdd6c27 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:46.102224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc14d753-e8c3-485d-809e-5d73efdd6c27 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:46.103768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc14d753-e8c3-485d-809e-5d73efdd6c27 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:46.439919 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c5ecbd34-3e6c-41dc-a3fa-de384207b073 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "DELETE /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d" status: 204 len: 0 microversion: 2.1 time: 1.986924 Aug 23 18:06:46.441537 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1803/3527] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:44 2022] DELETE /compute/v2.1/images/144c8178-0563-425a-8bd1-47530e031e4d => generated 0 bytes in 1989 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:06:46.447338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d129ba5-7e1e-4873-ae1c-417dd1b48089 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:46.448322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7d129ba5-7e1e-4873-ae1c-417dd1b48089 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:46.478830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d129ba5-7e1e-4873-ae1c-417dd1b48089 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:46.485378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d129ba5-7e1e-4873-ae1c-417dd1b48089 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:46.486120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d129ba5-7e1e-4873-ae1c-417dd1b48089 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:46.487080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d129ba5-7e1e-4873-ae1c-417dd1b48089 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:46.487821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d129ba5-7e1e-4873-ae1c-417dd1b48089 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:46.490102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d129ba5-7e1e-4873-ae1c-417dd1b48089 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:46.619527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7d129ba5-7e1e-4873-ae1c-417dd1b48089 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:46.628305 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7d129ba5-7e1e-4873-ae1c-417dd1b48089 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1284 microversion: 2.1 time: 0.185447 Aug 23 18:06:46.633584 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1804/3528] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:46 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:46.647791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6b1b95d-6fc3-4f21-844e-afdd8ae0e030 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '.version_select at 0x7f27df782940>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:46.722601 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b6b1b95d-6fc3-4f21-844e-afdd8ae0e030 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] HTTP exception thrown: Image not found. Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6b1b95d-6fc3-4f21-844e-afdd8ae0e030 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Request method failure captured: Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 HTTP/1.1 Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRa0PB_xYvA-kDmBq7wbeloDups4NDpZfrPLl8eiS7a2BhLGB5TQVGqw0wTHdQhFqcoU2TjwToZHJ9gAjROk3QoHiSjAPciA3q9wYd4duGJwPaFjhbat5rHYyLB885rgnKeWwKmVMeP8hLFbT23wOH2zl1k5vUC7HQhZktA8-jPiOPQ Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 13bee7ab4bce40a6a01424dc7a620320 Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ImagesOneServerTestJSON-1875632797 Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_13bee7ab4bce40a6a01424dc7a620320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/13bee7ab4bce40a6a01424dc7a620320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/13bee7ab4bce40a6a01424dc7a620320"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/13bee7ab4bce40a6a01424dc7a620320"}]}] Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ImagesOneServerTestJSON-1875632797 Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 13bee7ab4bce40a6a01424dc7a620320 Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1875632797 Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ImagesOneServerTestJSON-1875632797-project Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 288ed685c4de46349aa9f7fc95951bfb Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ImagesOneServerTestJSON-1875632797-project Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: exception: Image not found. Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '004f96d7-f1ed-4852-b869-57efa01e6a60'} Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 386, in delete Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 004f96d7-f1ed-4852-b869-57efa01e6a60 to delete Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 004f96d7-f1ed-4852-b869-57efa01e6a60 could not be found. Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:06:46.754133 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6b1b95d-6fc3-4f21-844e-afdd8ae0e030 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Returning 404 to user: Image not found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:06:46.760533 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6b1b95d-6fc3-4f21-844e-afdd8ae0e030 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "DELETE /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60" status: 404 len: 62 microversion: 2.1 time: 0.122199 Aug 23 18:06:46.762586 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1805/3529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:46 2022] DELETE /compute/v2.1/images/004f96d7-f1ed-4852-b869-57efa01e6a60 => generated 62 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:06:46.766609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-733e5662-8cab-4b39-95fb-b1f8155bc370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:46.769753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-733e5662-8cab-4b39-95fb-b1f8155bc370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:46.794363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-733e5662-8cab-4b39-95fb-b1f8155bc370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:46.805482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-733e5662-8cab-4b39-95fb-b1f8155bc370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:46.806638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-733e5662-8cab-4b39-95fb-b1f8155bc370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:46.807485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-733e5662-8cab-4b39-95fb-b1f8155bc370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:46.808199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-733e5662-8cab-4b39-95fb-b1f8155bc370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:46.809642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-733e5662-8cab-4b39-95fb-b1f8155bc370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:47.218561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bc14d753-e8c3-485d-809e-5d73efdd6c27 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:47.228319 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc14d753-e8c3-485d-809e-5d73efdd6c27 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1521 microversion: 2.1 time: 1.156022 Aug 23 18:06:47.228907 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1725/3530] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:46 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1521 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:47.247675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9e914515-2c20-44f5-97de-a3cf369dfc25 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:47.248448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9e914515-2c20-44f5-97de-a3cf369dfc25 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:47.264625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e914515-2c20-44f5-97de-a3cf369dfc25 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:47.265599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e914515-2c20-44f5-97de-a3cf369dfc25 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:47.266218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e914515-2c20-44f5-97de-a3cf369dfc25 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:47.267145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e914515-2c20-44f5-97de-a3cf369dfc25 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:47.271293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e914515-2c20-44f5-97de-a3cf369dfc25 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:47.272171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e914515-2c20-44f5-97de-a3cf369dfc25 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:47.327644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9e914515-2c20-44f5-97de-a3cf369dfc25 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:06:47.450769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:47.497221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-733e5662-8cab-4b39-95fb-b1f8155bc370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:47.527607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-733e5662-8cab-4b39-95fb-b1f8155bc370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:47.537102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-733e5662-8cab-4b39-95fb-b1f8155bc370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:47.551754 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-733e5662-8cab-4b39-95fb-b1f8155bc370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1887 microversion: 2.32 time: 0.785517 Aug 23 18:06:47.567244 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1806/3531] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:46 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1887 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:47.574735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-a3c2f94e-44d9-4bc8-8498-d80dc6fc5a10 req-6961cee5-003a-40d9-b172-faf73d3209aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "tag": "766e8ecd-c0de-42b0-afc9-f573d08d79cc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:47.577538 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9e914515-2c20-44f5-97de-a3cf369dfc25 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 204 len: 0 microversion: 2.1 time: 0.342145 Aug 23 18:06:47.578650 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1726/3532] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:06:47 2022] DELETE /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:06:47.598926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-17831f00-b05e-4ce1-b539-bf1d26dc6dcf tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:47.600215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-17831f00-b05e-4ce1-b539-bf1d26dc6dcf tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:47.612243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a3c2f94e-44d9-4bc8-8498-d80dc6fc5a10 req-6961cee5-003a-40d9-b172-faf73d3209aa service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:47.612753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a3c2f94e-44d9-4bc8-8498-d80dc6fc5a10 req-6961cee5-003a-40d9-b172-faf73d3209aa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:47.613200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a3c2f94e-44d9-4bc8-8498-d80dc6fc5a10 req-6961cee5-003a-40d9-b172-faf73d3209aa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:47.621844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17831f00-b05e-4ce1-b539-bf1d26dc6dcf tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:47.622828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17831f00-b05e-4ce1-b539-bf1d26dc6dcf tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:47.623584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17831f00-b05e-4ce1-b539-bf1d26dc6dcf tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:47.625426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17831f00-b05e-4ce1-b539-bf1d26dc6dcf tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:47.626157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17831f00-b05e-4ce1-b539-bf1d26dc6dcf tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:47.627672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17831f00-b05e-4ce1-b539-bf1d26dc6dcf tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:47.638259 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-a3c2f94e-44d9-4bc8-8498-d80dc6fc5a10 req-6961cee5-003a-40d9-b172-faf73d3209aa service nova] Creating event network-changed:766e8ecd-c0de-42b0-afc9-f573d08d79cc for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:06:47.644592 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-a3c2f94e-44d9-4bc8-8498-d80dc6fc5a10 req-6961cee5-003a-40d9-b172-faf73d3209aa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089018 Aug 23 18:06:47.647932 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1807/3533] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:06:47.660316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-70c4e5ef-cbe7-42de-be92-496504a16beb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:47.662483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-70c4e5ef-cbe7-42de-be92-496504a16beb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:47.682531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70c4e5ef-cbe7-42de-be92-496504a16beb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:47.683299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70c4e5ef-cbe7-42de-be92-496504a16beb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:47.683929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70c4e5ef-cbe7-42de-be92-496504a16beb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:47.684827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70c4e5ef-cbe7-42de-be92-496504a16beb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:47.686910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70c4e5ef-cbe7-42de-be92-496504a16beb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:47.687556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70c4e5ef-cbe7-42de-be92-496504a16beb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:47.879092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-70c4e5ef-cbe7-42de-be92-496504a16beb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:47.888630 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-70c4e5ef-cbe7-42de-be92-496504a16beb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1272 microversion: 2.1 time: 0.234545 Aug 23 18:06:47.891568 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1808/3534] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:47 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1272 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:48.155949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-17831f00-b05e-4ce1-b539-bf1d26dc6dcf tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:48.172963 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-17831f00-b05e-4ce1-b539-bf1d26dc6dcf tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1471 microversion: 2.1 time: 0.589015 Aug 23 18:06:48.174051 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1727/3535] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:47 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1471 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:48.253247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b018e21-ba83-4f16-b8bd-326f4535fbf9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:48.256087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b018e21-ba83-4f16-b8bd-326f4535fbf9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:48.267622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b018e21-ba83-4f16-b8bd-326f4535fbf9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:48.270680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b018e21-ba83-4f16-b8bd-326f4535fbf9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:48.271325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b018e21-ba83-4f16-b8bd-326f4535fbf9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:48.275003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b018e21-ba83-4f16-b8bd-326f4535fbf9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:48.275722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b018e21-ba83-4f16-b8bd-326f4535fbf9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:48.276341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b018e21-ba83-4f16-b8bd-326f4535fbf9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:48.578957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f546ea44-3538-49e1-a238-daebb3feebb9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:48.579766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f546ea44-3538-49e1-a238-daebb3feebb9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:48.598196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f546ea44-3538-49e1-a238-daebb3feebb9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:48.599260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f546ea44-3538-49e1-a238-daebb3feebb9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:48.599956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f546ea44-3538-49e1-a238-daebb3feebb9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:48.600958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f546ea44-3538-49e1-a238-daebb3feebb9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:48.601530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f546ea44-3538-49e1-a238-daebb3feebb9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:48.602088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f546ea44-3538-49e1-a238-daebb3feebb9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:48.669541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b018e21-ba83-4f16-b8bd-326f4535fbf9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:48.684397 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b018e21-ba83-4f16-b8bd-326f4535fbf9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1521 microversion: 2.1 time: 0.434027 Aug 23 18:06:48.686866 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1809/3536] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:48 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1521 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:48.710470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1242649941", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "a9f0de74-9976-4faf-bd82-1d5a30f3de06"}], "security_groups": [{"name": "tempest-securitygroup--1923710875"}], "key_name": "tempest-keypair-894823886", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:48.904232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] validate_networks() for [('a9f0de74-9976-4faf-bd82-1d5a30f3de06', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:06:49.012707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f546ea44-3538-49e1-a238-daebb3feebb9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:49.033700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f546ea44-3538-49e1-a238-daebb3feebb9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:49.037028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f546ea44-3538-49e1-a238-daebb3feebb9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:49.038815 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f546ea44-3538-49e1-a238-daebb3feebb9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1887 microversion: 2.32 time: 0.464887 Aug 23 18:06:49.040418 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1728/3537] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:48 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1887 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:06:49.045209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-59d211d1-3744-45ba-9ce5-61f10376b19b tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:49.045830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-59d211d1-3744-45ba-9ce5-61f10376b19b tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:49.067212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59d211d1-3744-45ba-9ce5-61f10376b19b tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:49.067721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59d211d1-3744-45ba-9ce5-61f10376b19b tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:49.068175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59d211d1-3744-45ba-9ce5-61f10376b19b tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:49.068900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59d211d1-3744-45ba-9ce5-61f10376b19b tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:49.069367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59d211d1-3744-45ba-9ce5-61f10376b19b tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:49.069810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59d211d1-3744-45ba-9ce5-61f10376b19b tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:49.616751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-59d211d1-3744-45ba-9ce5-61f10376b19b tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:49.626312 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-59d211d1-3744-45ba-9ce5-61f10376b19b tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1314 microversion: 2.1 time: 0.584801 Aug 23 18:06:49.635006 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1729/3538] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:49 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1314 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:49.648554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Getting quotas for project 62607278cfa846a1b818bf8af91db1da. Resources: dict_keys(['metadata_items']) {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:06:49.649372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f303f3c7-3ec4-4506-b496-c12beecc4fa3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:49.650145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f303f3c7-3ec4-4506-b496-c12beecc4fa3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:49.655643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Getting quotas for user 45d01351a0604f539d16033483a387b7 and project 62607278cfa846a1b818bf8af91db1da. Resources: dict_keys(['metadata_items']) {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:06:49.670937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f303f3c7-3ec4-4506-b496-c12beecc4fa3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:49.671440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f303f3c7-3ec4-4506-b496-c12beecc4fa3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:49.671616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:06:49.672068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f303f3c7-3ec4-4506-b496-c12beecc4fa3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:49.672589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f303f3c7-3ec4-4506-b496-c12beecc4fa3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:49.672843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:06:49.673488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:06:49.674064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:06:49.674878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:06:49.680023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f303f3c7-3ec4-4506-b496-c12beecc4fa3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:49.681306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f303f3c7-3ec4-4506-b496-c12beecc4fa3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:49.687644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:49.688375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:49.689123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:49.690464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:49.691131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:49.691748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:49.713014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Getting quotas for project 62607278cfa846a1b818bf8af91db1da. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:06:49.719694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Getting quotas for user 45d01351a0604f539d16033483a387b7 and project 62607278cfa846a1b818bf8af91db1da. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:06:49.736097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:06:49.738964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:06:49.821562 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7ba9c01c-ab77-432f-af03-02e45154fd93 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.116091 Aug 23 18:06:49.831393 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1810/3539] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:06:48 2022] POST /compute/v2.1/servers => generated 407 bytes in 1128 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:06:49.845413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-16122b41-8e43-437f-89bb-979be0a73de6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:49.846271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-16122b41-8e43-437f-89bb-979be0a73de6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:49.863688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16122b41-8e43-437f-89bb-979be0a73de6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:49.865968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16122b41-8e43-437f-89bb-979be0a73de6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:49.867132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16122b41-8e43-437f-89bb-979be0a73de6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:49.870935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16122b41-8e43-437f-89bb-979be0a73de6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:49.871513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16122b41-8e43-437f-89bb-979be0a73de6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:49.872108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16122b41-8e43-437f-89bb-979be0a73de6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:50.383024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-16122b41-8e43-437f-89bb-979be0a73de6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:50.393356 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-16122b41-8e43-437f-89bb-979be0a73de6 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1521 microversion: 2.1 time: 0.560045 Aug 23 18:06:50.398394 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1811/3540] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:49 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1521 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:50.416934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-09e72318-98d1-44af-a119-215539950184 req-6055f782-2063-4c9a-a769-ec66dd8dc002 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "tag": "5997e602-944a-4dfe-a4ef-1adf63e98362"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:50.472700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-09e72318-98d1-44af-a119-215539950184 req-6055f782-2063-4c9a-a769-ec66dd8dc002 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:50.476007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-09e72318-98d1-44af-a119-215539950184 req-6055f782-2063-4c9a-a769-ec66dd8dc002 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:50.480421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-09e72318-98d1-44af-a119-215539950184 req-6055f782-2063-4c9a-a769-ec66dd8dc002 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:50.517945 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-09e72318-98d1-44af-a119-215539950184 req-6055f782-2063-4c9a-a769-ec66dd8dc002 service nova] Creating event network-changed:5997e602-944a-4dfe-a4ef-1adf63e98362 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:06:50.527315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f303f3c7-3ec4-4506-b496-c12beecc4fa3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:50.536700 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-09e72318-98d1-44af-a119-215539950184 req-6055f782-2063-4c9a-a769-ec66dd8dc002 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135138 Aug 23 18:06:50.537319 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1812/3541] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:06:50.552127 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f303f3c7-3ec4-4506-b496-c12beecc4fa3 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1471 microversion: 2.1 time: 0.915017 Aug 23 18:06:50.554026 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1730/3542] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:49 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1471 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:50.582475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7229044e-d2d0-4a79-9524-00b0f6b69d00 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:50.584810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-22012ed2-6f1b-402f-82c4-d325514c8abb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:50.588696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7229044e-d2d0-4a79-9524-00b0f6b69d00 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:50.589458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-22012ed2-6f1b-402f-82c4-d325514c8abb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:50.614465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22012ed2-6f1b-402f-82c4-d325514c8abb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:50.617737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22012ed2-6f1b-402f-82c4-d325514c8abb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:50.620124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22012ed2-6f1b-402f-82c4-d325514c8abb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:50.621157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22012ed2-6f1b-402f-82c4-d325514c8abb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:50.623061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22012ed2-6f1b-402f-82c4-d325514c8abb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:50.623800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22012ed2-6f1b-402f-82c4-d325514c8abb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:50.872997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7229044e-d2d0-4a79-9524-00b0f6b69d00 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:50.888763 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7229044e-d2d0-4a79-9524-00b0f6b69d00 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1269 microversion: 2.1 time: 0.346712 Aug 23 18:06:50.889466 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1813/3543] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:50 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1269 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:50.919779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-17d3700a-7e08-4b5f-94a0-ddfa30ec233f tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:50.923373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-17d3700a-7e08-4b5f-94a0-ddfa30ec233f tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:50.960129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d3700a-7e08-4b5f-94a0-ddfa30ec233f tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:50.962248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d3700a-7e08-4b5f-94a0-ddfa30ec233f tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:50.966168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d3700a-7e08-4b5f-94a0-ddfa30ec233f tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:50.969962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d3700a-7e08-4b5f-94a0-ddfa30ec233f tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:50.973482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d3700a-7e08-4b5f-94a0-ddfa30ec233f tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:50.977766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d3700a-7e08-4b5f-94a0-ddfa30ec233f tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:51.277064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22012ed2-6f1b-402f-82c4-d325514c8abb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:51.291615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22012ed2-6f1b-402f-82c4-d325514c8abb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:51.293869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22012ed2-6f1b-402f-82c4-d325514c8abb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:51.295312 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-22012ed2-6f1b-402f-82c4-d325514c8abb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1887 microversion: 2.32 time: 0.740081 Aug 23 18:06:51.296505 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1731/3544] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:50 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1887 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:51.432783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8dd83e73-75fc-4476-8453-94398da5af06 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:51.433716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8dd83e73-75fc-4476-8453-94398da5af06 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:51.456452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dd83e73-75fc-4476-8453-94398da5af06 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:51.464022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dd83e73-75fc-4476-8453-94398da5af06 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:51.464821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dd83e73-75fc-4476-8453-94398da5af06 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:51.468462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dd83e73-75fc-4476-8453-94398da5af06 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:51.487410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dd83e73-75fc-4476-8453-94398da5af06 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:51.489095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8dd83e73-75fc-4476-8453-94398da5af06 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:51.610137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-17d3700a-7e08-4b5f-94a0-ddfa30ec233f tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:51.622636 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-17d3700a-7e08-4b5f-94a0-ddfa30ec233f tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1314 microversion: 2.1 time: 0.728748 Aug 23 18:06:51.635207 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1814/3545] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:50 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1314 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:51.666153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce5ff491-528c-4b64-aa1d-3eb92c12e5fd tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:51.666931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ce5ff491-528c-4b64-aa1d-3eb92c12e5fd tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:51.686262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce5ff491-528c-4b64-aa1d-3eb92c12e5fd tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:51.688660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce5ff491-528c-4b64-aa1d-3eb92c12e5fd tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:51.689262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce5ff491-528c-4b64-aa1d-3eb92c12e5fd tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:51.690453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce5ff491-528c-4b64-aa1d-3eb92c12e5fd tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:51.691024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce5ff491-528c-4b64-aa1d-3eb92c12e5fd tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:51.692944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce5ff491-528c-4b64-aa1d-3eb92c12e5fd tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:52.085883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ce5ff491-528c-4b64-aa1d-3eb92c12e5fd tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ed685c4de46349aa9f7fc95951bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13bee7ab4bce40a6a01424dc7a620320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:52.101762 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce5ff491-528c-4b64-aa1d-3eb92c12e5fd tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 200 len: 1429 microversion: 2.1 time: 0.459394 Aug 23 18:06:52.104817 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1815/3546] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:51 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 1429 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:52.113456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b2d723e5-46b8-4e50-b5e5-08ace9addfbd tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:52.121304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b2d723e5-46b8-4e50-b5e5-08ace9addfbd tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:52.151821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2d723e5-46b8-4e50-b5e5-08ace9addfbd tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:52.152014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8dd83e73-75fc-4476-8453-94398da5af06 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:52.154738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2d723e5-46b8-4e50-b5e5-08ace9addfbd tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:52.156656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2d723e5-46b8-4e50-b5e5-08ace9addfbd tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:52.165460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2d723e5-46b8-4e50-b5e5-08ace9addfbd tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:52.169757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2d723e5-46b8-4e50-b5e5-08ace9addfbd tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:52.170238 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8dd83e73-75fc-4476-8453-94398da5af06 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1521 microversion: 2.1 time: 0.747655 Aug 23 18:06:52.171472 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1732/3547] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:51 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1521 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:06:52.184959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2d723e5-46b8-4e50-b5e5-08ace9addfbd tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:52.254482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:52.323231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4bdf3b19-30ea-4cc2-a714-47ff3304790c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:52.323860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4bdf3b19-30ea-4cc2-a714-47ff3304790c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:52.337493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:52.361811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bdf3b19-30ea-4cc2-a714-47ff3304790c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:52.374291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bdf3b19-30ea-4cc2-a714-47ff3304790c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:52.375522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bdf3b19-30ea-4cc2-a714-47ff3304790c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:52.376997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bdf3b19-30ea-4cc2-a714-47ff3304790c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:52.377921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bdf3b19-30ea-4cc2-a714-47ff3304790c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:52.378617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bdf3b19-30ea-4cc2-a714-47ff3304790c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:52.464533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b2d723e5-46b8-4e50-b5e5-08ace9addfbd tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:52.485098 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b2d723e5-46b8-4e50-b5e5-08ace9addfbd tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1329 microversion: 2.1 time: 0.377557 Aug 23 18:06:52.486381 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1816/3548] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:52 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1329 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:52.955186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7ef08f87-6108-4623-9168-17f724ba5dd3 req-52780e5b-3a68-4431-a300-1cf103919082 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "tag": "6a403b9a-dd76-4743-b4c7-d8a95b097009"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:53.008953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7ef08f87-6108-4623-9168-17f724ba5dd3 req-52780e5b-3a68-4431-a300-1cf103919082 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:53.013145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7ef08f87-6108-4623-9168-17f724ba5dd3 req-52780e5b-3a68-4431-a300-1cf103919082 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:53.016960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7ef08f87-6108-4623-9168-17f724ba5dd3 req-52780e5b-3a68-4431-a300-1cf103919082 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:53.082186 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7ef08f87-6108-4623-9168-17f724ba5dd3 req-52780e5b-3a68-4431-a300-1cf103919082 service nova] Creating event network-changed:6a403b9a-dd76-4743-b4c7-d8a95b097009 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:06:53.094763 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7ef08f87-6108-4623-9168-17f724ba5dd3 req-52780e5b-3a68-4431-a300-1cf103919082 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.606079 Aug 23 18:06:53.096447 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1817/3549] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:06:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:06:53.105884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-863abac8-fda4-4a10-b4c1-f8247e9bd75b req-ff46734a-5253-423c-a1d5-168b5031b828 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d5d14ef6-0b4d-493a-bf80-523fcb3c3b12", "tag": "c8809d3c-5282-4081-bf4b-cdae3769ff62"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:53.137471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-863abac8-fda4-4a10-b4c1-f8247e9bd75b req-ff46734a-5253-423c-a1d5-168b5031b828 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:53.137953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-863abac8-fda4-4a10-b4c1-f8247e9bd75b req-ff46734a-5253-423c-a1d5-168b5031b828 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:53.138639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-863abac8-fda4-4a10-b4c1-f8247e9bd75b req-ff46734a-5253-423c-a1d5-168b5031b828 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:53.161418 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-863abac8-fda4-4a10-b4c1-f8247e9bd75b req-ff46734a-5253-423c-a1d5-168b5031b828 service nova] Creating event network-changed:c8809d3c-5282-4081-bf4b-cdae3769ff62 for instance d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 on n-h2-850468-16 Aug 23 18:06:53.180951 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-863abac8-fda4-4a10-b4c1-f8247e9bd75b req-ff46734a-5253-423c-a1d5-168b5031b828 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082165 Aug 23 18:06:53.182651 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1818/3550] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:06:53.216016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fe425195-0edf-4223-8d02-04148231e512 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:53.217140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fe425195-0edf-4223-8d02-04148231e512 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:53.228424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe425195-0edf-4223-8d02-04148231e512 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:53.229809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe425195-0edf-4223-8d02-04148231e512 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:53.230559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe425195-0edf-4223-8d02-04148231e512 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:53.231637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe425195-0edf-4223-8d02-04148231e512 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:53.232282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe425195-0edf-4223-8d02-04148231e512 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:53.233091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe425195-0edf-4223-8d02-04148231e512 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:53.562252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4bdf3b19-30ea-4cc2-a714-47ff3304790c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:53.580777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4bdf3b19-30ea-4cc2-a714-47ff3304790c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:53.589090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4bdf3b19-30ea-4cc2-a714-47ff3304790c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:53.604922 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4bdf3b19-30ea-4cc2-a714-47ff3304790c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1887 microversion: 2.32 time: 1.277021 Aug 23 18:06:53.605574 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1733/3551] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:52 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1887 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:06:53.621839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fbed6659-08d0-4b8b-9e94-7699195022b0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:53.625270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fbed6659-08d0-4b8b-9e94-7699195022b0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] [instance: 7a2f8a54-72ff-43c4-a31e-76b29723e3e1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:53.641740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbed6659-08d0-4b8b-9e94-7699195022b0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:53.642237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbed6659-08d0-4b8b-9e94-7699195022b0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:53.642703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbed6659-08d0-4b8b-9e94-7699195022b0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:53.643648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbed6659-08d0-4b8b-9e94-7699195022b0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:53.643849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbed6659-08d0-4b8b-9e94-7699195022b0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:53.644272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbed6659-08d0-4b8b-9e94-7699195022b0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:53.684833 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-fbed6659-08d0-4b8b-9e94-7699195022b0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] HTTP exception thrown: Instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 could not be found. Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fbed6659-08d0-4b8b-9e94-7699195022b0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Request method failure captured: Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 HTTP/1.1 Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRa0PB_xYvA-kDmBq7wbeloDups4NDpZfrPLl8eiS7a2BhLGB5TQVGqw0wTHdQhFqcoU2TjwToZHJ9gAjROk3QoHiSjAPciA3q9wYd4duGJwPaFjhbat5rHYyLB885rgnKeWwKmVMeP8hLFbT23wOH2zl1k5vUC7HQhZktA8-jPiOPQ Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 13bee7ab4bce40a6a01424dc7a620320 Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ImagesOneServerTestJSON-1875632797 Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_13bee7ab4bce40a6a01424dc7a620320"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/13bee7ab4bce40a6a01424dc7a620320"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/13bee7ab4bce40a6a01424dc7a620320"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/13bee7ab4bce40a6a01424dc7a620320"}]}] Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ImagesOneServerTestJSON-1875632797 Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 13bee7ab4bce40a6a01424dc7a620320 Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-1875632797 Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ImagesOneServerTestJSON-1875632797-project Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 288ed685c4de46349aa9f7fc95951bfb Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ImagesOneServerTestJSON-1875632797-project Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 could not be found. Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '7a2f8a54-72ff-43c4-a31e-76b29723e3e1'} Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 could not be found. Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 could not be found. Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:06:53.691190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:53.696633 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:53.696633 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:06:53.696633 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:06:53.696633 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:06:53.696633 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:06:53.696633 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 could not be found. Aug 23 18:06:53.696633 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:53.696633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fbed6659-08d0-4b8b-9e94-7699195022b0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] Returning 404 to user: Instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:06:53.696633 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fbed6659-08d0-4b8b-9e94-7699195022b0 tempest-ImagesOneServerTestJSON-1875632797 tempest-ImagesOneServerTestJSON-1875632797-project] 10.222.0.61 "GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1" status: 404 len: 111 microversion: 2.1 time: 0.085599 Aug 23 18:06:53.696633 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1734/3552] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:53 2022] GET /compute/v2.1/servers/7a2f8a54-72ff-43c4-a31e-76b29723e3e1 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:06:53.734146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-276968af-10d4-4077-8198-d8bd0d3f1212 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:53.744522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-276968af-10d4-4077-8198-d8bd0d3f1212 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:53.768022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-276968af-10d4-4077-8198-d8bd0d3f1212 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:53.771165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-276968af-10d4-4077-8198-d8bd0d3f1212 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:53.771715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-276968af-10d4-4077-8198-d8bd0d3f1212 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:53.772468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-276968af-10d4-4077-8198-d8bd0d3f1212 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:53.772933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-276968af-10d4-4077-8198-d8bd0d3f1212 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:53.773431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-276968af-10d4-4077-8198-d8bd0d3f1212 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:53.785367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fe425195-0edf-4223-8d02-04148231e512 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:53.802143 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fe425195-0edf-4223-8d02-04148231e512 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1314 microversion: 2.1 time: 0.618040 Aug 23 18:06:53.813004 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1819/3553] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:53 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:53.828920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-914d1af2-f572-4e0b-ac6d-0186bc7e2a1b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:53.832139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-914d1af2-f572-4e0b-ac6d-0186bc7e2a1b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:53.867159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-914d1af2-f572-4e0b-ac6d-0186bc7e2a1b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:53.874021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-914d1af2-f572-4e0b-ac6d-0186bc7e2a1b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:53.874799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-914d1af2-f572-4e0b-ac6d-0186bc7e2a1b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:53.876209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-914d1af2-f572-4e0b-ac6d-0186bc7e2a1b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:53.879181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-914d1af2-f572-4e0b-ac6d-0186bc7e2a1b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:53.879962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-914d1af2-f572-4e0b-ac6d-0186bc7e2a1b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:54.094063 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-276968af-10d4-4077-8198-d8bd0d3f1212 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.370719 Aug 23 18:06:54.100440 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1735/3554] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:06:53 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:06:54.139749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25fd680c-80bf-4dfe-b146-f66ee77d3baa tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:54.149412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-25fd680c-80bf-4dfe-b146-f66ee77d3baa tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:54.171780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25fd680c-80bf-4dfe-b146-f66ee77d3baa tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:54.176342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25fd680c-80bf-4dfe-b146-f66ee77d3baa tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:54.176827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25fd680c-80bf-4dfe-b146-f66ee77d3baa tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:54.178747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25fd680c-80bf-4dfe-b146-f66ee77d3baa tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:54.181466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25fd680c-80bf-4dfe-b146-f66ee77d3baa tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:54.182132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25fd680c-80bf-4dfe-b146-f66ee77d3baa tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:54.427878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-25fd680c-80bf-4dfe-b146-f66ee77d3baa tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:54.443715 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-25fd680c-80bf-4dfe-b146-f66ee77d3baa tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1327 microversion: 2.1 time: 0.336704 Aug 23 18:06:54.445002 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1736/3555] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:54 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1327 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:54.459389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-914d1af2-f572-4e0b-ac6d-0186bc7e2a1b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:54.467104 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-914d1af2-f572-4e0b-ac6d-0186bc7e2a1b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1521 microversion: 2.1 time: 0.651263 Aug 23 18:06:54.469825 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1820/3556] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:53 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1521 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:54.484784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e5d421c9-e80f-4671-9109-15c5d3cc25a4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:54.485548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e5d421c9-e80f-4671-9109-15c5d3cc25a4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:54.503304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5d421c9-e80f-4671-9109-15c5d3cc25a4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:54.505708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5d421c9-e80f-4671-9109-15c5d3cc25a4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:54.507944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5d421c9-e80f-4671-9109-15c5d3cc25a4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:54.509455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5d421c9-e80f-4671-9109-15c5d3cc25a4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:54.513556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5d421c9-e80f-4671-9109-15c5d3cc25a4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:54.515703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5d421c9-e80f-4671-9109-15c5d3cc25a4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:54.629303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-df46ea5e-b6f0-42ac-bf3d-92a718e72cd2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:54.630325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-df46ea5e-b6f0-42ac-bf3d-92a718e72cd2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:54.640257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df46ea5e-b6f0-42ac-bf3d-92a718e72cd2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:54.643136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df46ea5e-b6f0-42ac-bf3d-92a718e72cd2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:54.649597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df46ea5e-b6f0-42ac-bf3d-92a718e72cd2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:54.651245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df46ea5e-b6f0-42ac-bf3d-92a718e72cd2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:54.652525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df46ea5e-b6f0-42ac-bf3d-92a718e72cd2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:54.653430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df46ea5e-b6f0-42ac-bf3d-92a718e72cd2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:54.997400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5d421c9-e80f-4671-9109-15c5d3cc25a4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:55.010499 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e5d421c9-e80f-4671-9109-15c5d3cc25a4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1671 microversion: 2.1 time: 0.559944 Aug 23 18:06:55.026992 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1737/3557] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:54 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1671 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:55.043840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4f853dad-f5de-4436-9c23-8d44973f4268 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:55.053517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4f853dad-f5de-4436-9c23-8d44973f4268 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:55.074992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f853dad-f5de-4436-9c23-8d44973f4268 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:55.078240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f853dad-f5de-4436-9c23-8d44973f4268 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:55.079569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f853dad-f5de-4436-9c23-8d44973f4268 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:55.081098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f853dad-f5de-4436-9c23-8d44973f4268 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:55.082410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f853dad-f5de-4436-9c23-8d44973f4268 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:55.085062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f853dad-f5de-4436-9c23-8d44973f4268 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:55.412580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4f853dad-f5de-4436-9c23-8d44973f4268 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:55.429504 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4f853dad-f5de-4436-9c23-8d44973f4268 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1314 microversion: 2.1 time: 0.400545 Aug 23 18:06:55.431468 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1738/3558] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:55 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:55.455567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-a4a2b0d5-c5d5-448c-b446-0c7e29439e81 req-e2a02ef5-55c3-4ba0-8a72-fac237933fac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a2f8a54-72ff-43c4-a31e-76b29723e3e1", "name": "network-vif-deleted", "tag": "d48d38dd-3b1f-4db9-957e-46b040401b51"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:55.475723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a4a2b0d5-c5d5-448c-b446-0c7e29439e81 req-e2a02ef5-55c3-4ba0-8a72-fac237933fac service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:55.478011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a4a2b0d5-c5d5-448c-b446-0c7e29439e81 req-e2a02ef5-55c3-4ba0-8a72-fac237933fac service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:55.479210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a4a2b0d5-c5d5-448c-b446-0c7e29439e81 req-e2a02ef5-55c3-4ba0-8a72-fac237933fac service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:55.495008 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-a4a2b0d5-c5d5-448c-b446-0c7e29439e81 req-e2a02ef5-55c3-4ba0-8a72-fac237933fac service nova] Creating event network-vif-deleted:d48d38dd-3b1f-4db9-957e-46b040401b51 for instance 7a2f8a54-72ff-43c4-a31e-76b29723e3e1 on n-h2-850468-16 Aug 23 18:06:55.502198 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-a4a2b0d5-c5d5-448c-b446-0c7e29439e81 req-e2a02ef5-55c3-4ba0-8a72-fac237933fac service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052438 Aug 23 18:06:55.503181 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1739/3559] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:06:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:06:55.516975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-056e0537-bbb7-474c-8aab-7f03ce49d4ae tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:55.516975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-056e0537-bbb7-474c-8aab-7f03ce49d4ae tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:55.521848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-056e0537-bbb7-474c-8aab-7f03ce49d4ae tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:55.522397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-056e0537-bbb7-474c-8aab-7f03ce49d4ae tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:55.522887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-056e0537-bbb7-474c-8aab-7f03ce49d4ae tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:55.523661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-056e0537-bbb7-474c-8aab-7f03ce49d4ae tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:55.524898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-056e0537-bbb7-474c-8aab-7f03ce49d4ae tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:55.526084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-056e0537-bbb7-474c-8aab-7f03ce49d4ae tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:55.574706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-df46ea5e-b6f0-42ac-bf3d-92a718e72cd2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:55.609933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-df46ea5e-b6f0-42ac-bf3d-92a718e72cd2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:55.611575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-df46ea5e-b6f0-42ac-bf3d-92a718e72cd2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:55.614943 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-df46ea5e-b6f0-42ac-bf3d-92a718e72cd2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.989421 Aug 23 18:06:55.616710 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1821/3560] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:54 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:55.652854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f35fa50c-e10c-41c4-8d9d-aab4348a8f6e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:55.653777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f35fa50c-e10c-41c4-8d9d-aab4348a8f6e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:55.669650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f35fa50c-e10c-41c4-8d9d-aab4348a8f6e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:55.671642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f35fa50c-e10c-41c4-8d9d-aab4348a8f6e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:55.672522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f35fa50c-e10c-41c4-8d9d-aab4348a8f6e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:55.674111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f35fa50c-e10c-41c4-8d9d-aab4348a8f6e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:55.676283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f35fa50c-e10c-41c4-8d9d-aab4348a8f6e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:55.677633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f35fa50c-e10c-41c4-8d9d-aab4348a8f6e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:55.956654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-056e0537-bbb7-474c-8aab-7f03ce49d4ae tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:55.966151 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-056e0537-bbb7-474c-8aab-7f03ce49d4ae tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1395 microversion: 2.1 time: 0.461769 Aug 23 18:06:55.967025 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1740/3561] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:55 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1395 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:55.978430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f35fa50c-e10c-41c4-8d9d-aab4348a8f6e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:55.988191 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f35fa50c-e10c-41c4-8d9d-aab4348a8f6e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1521 microversion: 2.1 time: 0.370146 Aug 23 18:06:55.989369 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1822/3562] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:55 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1521 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:56.051631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a2bae8fd-2b2a-428d-a253-8783bb8b1e05 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:56.053273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a2bae8fd-2b2a-428d-a253-8783bb8b1e05 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:56.060399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2bae8fd-2b2a-428d-a253-8783bb8b1e05 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:56.071608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2bae8fd-2b2a-428d-a253-8783bb8b1e05 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:56.090006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2bae8fd-2b2a-428d-a253-8783bb8b1e05 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:56.091304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2bae8fd-2b2a-428d-a253-8783bb8b1e05 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:56.091955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2bae8fd-2b2a-428d-a253-8783bb8b1e05 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:56.092573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2bae8fd-2b2a-428d-a253-8783bb8b1e05 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:56.401736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a2bae8fd-2b2a-428d-a253-8783bb8b1e05 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:56.410803 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a2bae8fd-2b2a-428d-a253-8783bb8b1e05 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1671 microversion: 2.1 time: 0.362885 Aug 23 18:06:56.423521 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1741/3563] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:56 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1671 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:56.455450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d6054e95-4070-40bd-9da1-944b7dea41c4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:56.456089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d6054e95-4070-40bd-9da1-944b7dea41c4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:56.466197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6054e95-4070-40bd-9da1-944b7dea41c4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:56.466730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6054e95-4070-40bd-9da1-944b7dea41c4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:56.467245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6054e95-4070-40bd-9da1-944b7dea41c4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:56.467950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6054e95-4070-40bd-9da1-944b7dea41c4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:56.468598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6054e95-4070-40bd-9da1-944b7dea41c4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:56.469271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6054e95-4070-40bd-9da1-944b7dea41c4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:56.640783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-30a2a187-676b-4e10-b585-2b931303c497 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:56.641677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-30a2a187-676b-4e10-b585-2b931303c497 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:56.653848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30a2a187-676b-4e10-b585-2b931303c497 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:56.655243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30a2a187-676b-4e10-b585-2b931303c497 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:56.656786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30a2a187-676b-4e10-b585-2b931303c497 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:56.659354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30a2a187-676b-4e10-b585-2b931303c497 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:56.660783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30a2a187-676b-4e10-b585-2b931303c497 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:56.661408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30a2a187-676b-4e10-b585-2b931303c497 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:56.757841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d6054e95-4070-40bd-9da1-944b7dea41c4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:56.770734 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d6054e95-4070-40bd-9da1-944b7dea41c4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1314 microversion: 2.1 time: 0.319011 Aug 23 18:06:56.771537 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1823/3564] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:56 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:56.987553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3c8d453-df1d-4d08-a44c-5b9b8c970fa6 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:56.988075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f3c8d453-df1d-4d08-a44c-5b9b8c970fa6 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:57.000693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3c8d453-df1d-4d08-a44c-5b9b8c970fa6 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:57.001552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3c8d453-df1d-4d08-a44c-5b9b8c970fa6 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:57.002187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3c8d453-df1d-4d08-a44c-5b9b8c970fa6 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:57.004401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3c8d453-df1d-4d08-a44c-5b9b8c970fa6 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:57.005046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3c8d453-df1d-4d08-a44c-5b9b8c970fa6 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:57.005658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3c8d453-df1d-4d08-a44c-5b9b8c970fa6 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:57.200561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-30a2a187-676b-4e10-b585-2b931303c497 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:57.228948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-30a2a187-676b-4e10-b585-2b931303c497 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:57.238481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-30a2a187-676b-4e10-b585-2b931303c497 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:57.246421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f3c8d453-df1d-4d08-a44c-5b9b8c970fa6 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:57.247147 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-30a2a187-676b-4e10-b585-2b931303c497 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.611334 Aug 23 18:06:57.249187 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1742/3565] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:56 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:57.270983 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f3c8d453-df1d-4d08-a44c-5b9b8c970fa6 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1395 microversion: 2.1 time: 0.284459 Aug 23 18:06:57.270983 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1824/3566] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:56 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1395 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:06:57.288336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fdea2459-b0e6-479c-baca-33b0b6758904 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:57.290129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fdea2459-b0e6-479c-baca-33b0b6758904 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:57.304918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdea2459-b0e6-479c-baca-33b0b6758904 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:57.307162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdea2459-b0e6-479c-baca-33b0b6758904 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:57.310763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdea2459-b0e6-479c-baca-33b0b6758904 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:57.313194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdea2459-b0e6-479c-baca-33b0b6758904 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:57.313984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdea2459-b0e6-479c-baca-33b0b6758904 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:57.314329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdea2459-b0e6-479c-baca-33b0b6758904 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:57.460422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e785b584-af0f-44e8-9840-13b375c1bdb5 tempest-AZV2TestJSON-711065614 tempest-AZV2TestJSON-711065614-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:57.462608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e785b584-af0f-44e8-9840-13b375c1bdb5 tempest-AZV2TestJSON-711065614 tempest-AZV2TestJSON-711065614-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:57.463105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e785b584-af0f-44e8-9840-13b375c1bdb5 tempest-AZV2TestJSON-711065614 tempest-AZV2TestJSON-711065614-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:57.463551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e785b584-af0f-44e8-9840-13b375c1bdb5 tempest-AZV2TestJSON-711065614 tempest-AZV2TestJSON-711065614-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:57.464284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e785b584-af0f-44e8-9840-13b375c1bdb5 tempest-AZV2TestJSON-711065614 tempest-AZV2TestJSON-711065614-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:57.464741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e785b584-af0f-44e8-9840-13b375c1bdb5 tempest-AZV2TestJSON-711065614 tempest-AZV2TestJSON-711065614-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:57.465167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e785b584-af0f-44e8-9840-13b375c1bdb5 tempest-AZV2TestJSON-711065614 tempest-AZV2TestJSON-711065614-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:57.535840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:57.550205 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e785b584-af0f-44e8-9840-13b375c1bdb5 tempest-AZV2TestJSON-711065614 tempest-AZV2TestJSON-711065614-project] 10.222.0.61 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.280471 Aug 23 18:06:57.552340 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1825/3567] 10.222.0.61 () {58 vars in 1164 bytes} [Tue Aug 23 18:06:57 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:06:57.570101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b4ab3d24-80cc-49a4-b5c8-2b5e6c411bf5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:57.573199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b4ab3d24-80cc-49a4-b5c8-2b5e6c411bf5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:57.591546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4ab3d24-80cc-49a4-b5c8-2b5e6c411bf5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:57.592044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4ab3d24-80cc-49a4-b5c8-2b5e6c411bf5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:57.592490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4ab3d24-80cc-49a4-b5c8-2b5e6c411bf5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:57.593203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4ab3d24-80cc-49a4-b5c8-2b5e6c411bf5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:57.593650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4ab3d24-80cc-49a4-b5c8-2b5e6c411bf5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:57.594080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4ab3d24-80cc-49a4-b5c8-2b5e6c411bf5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:57.770304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fdea2459-b0e6-479c-baca-33b0b6758904 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:57.772858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:INSERT=2,nova_cell1:SELECT=97,nova_cell1:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:06:57.784181 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fdea2459-b0e6-479c-baca-33b0b6758904 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1521 microversion: 2.1 time: 0.510866 Aug 23 18:06:57.784773 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1743/3568] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:57 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:57.799367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f229f006-d1fe-4b98-ad6d-0587ee1dc3e5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:57.806865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f229f006-d1fe-4b98-ad6d-0587ee1dc3e5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:57.822726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f229f006-d1fe-4b98-ad6d-0587ee1dc3e5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:57.823594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f229f006-d1fe-4b98-ad6d-0587ee1dc3e5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:57.824245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f229f006-d1fe-4b98-ad6d-0587ee1dc3e5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:57.825161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f229f006-d1fe-4b98-ad6d-0587ee1dc3e5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:57.825789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f229f006-d1fe-4b98-ad6d-0587ee1dc3e5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:57.826730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f229f006-d1fe-4b98-ad6d-0587ee1dc3e5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:58.215851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f229f006-d1fe-4b98-ad6d-0587ee1dc3e5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:58.224184 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f229f006-d1fe-4b98-ad6d-0587ee1dc3e5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1314 microversion: 2.1 time: 0.431961 Aug 23 18:06:58.236903 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1744/3569] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:57 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:58.244949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b4ab3d24-80cc-49a4-b5c8-2b5e6c411bf5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:58.258787 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b4ab3d24-80cc-49a4-b5c8-2b5e6c411bf5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1671 microversion: 2.1 time: 0.702377 Aug 23 18:06:58.259774 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1826/3570] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:57 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1671 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:58.278484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb338782-4ac7-4a65-aa02-f2c090866452 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:58.279138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eb338782-4ac7-4a65-aa02-f2c090866452 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:58.288330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb338782-4ac7-4a65-aa02-f2c090866452 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:58.288837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb338782-4ac7-4a65-aa02-f2c090866452 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:58.289276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb338782-4ac7-4a65-aa02-f2c090866452 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:58.290501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3a8f2ff9-4f2a-4cb8-a5d0-6468c75b62ca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:58.291178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3a8f2ff9-4f2a-4cb8-a5d0-6468c75b62ca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:58.298903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb338782-4ac7-4a65-aa02-f2c090866452 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:58.299527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb338782-4ac7-4a65-aa02-f2c090866452 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:58.299991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb338782-4ac7-4a65-aa02-f2c090866452 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:58.310632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a8f2ff9-4f2a-4cb8-a5d0-6468c75b62ca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:58.313682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a8f2ff9-4f2a-4cb8-a5d0-6468c75b62ca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:58.314428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a8f2ff9-4f2a-4cb8-a5d0-6468c75b62ca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:58.316203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a8f2ff9-4f2a-4cb8-a5d0-6468c75b62ca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:58.321497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a8f2ff9-4f2a-4cb8-a5d0-6468c75b62ca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:58.323513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a8f2ff9-4f2a-4cb8-a5d0-6468c75b62ca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:58.912448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3a8f2ff9-4f2a-4cb8-a5d0-6468c75b62ca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:58.920927 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3a8f2ff9-4f2a-4cb8-a5d0-6468c75b62ca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1395 microversion: 2.1 time: 0.635067 Aug 23 18:06:58.927382 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1827/3571] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:58 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1395 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:58.942864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7aa2c3ff-9665-4bdc-9ca0-201051c4b6e7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:58.944591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7aa2c3ff-9665-4bdc-9ca0-201051c4b6e7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:58.954384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7aa2c3ff-9665-4bdc-9ca0-201051c4b6e7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:58.955160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7aa2c3ff-9665-4bdc-9ca0-201051c4b6e7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:58.955801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7aa2c3ff-9665-4bdc-9ca0-201051c4b6e7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:58.956698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7aa2c3ff-9665-4bdc-9ca0-201051c4b6e7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:58.957315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7aa2c3ff-9665-4bdc-9ca0-201051c4b6e7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:58.959101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7aa2c3ff-9665-4bdc-9ca0-201051c4b6e7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:58.967471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eb338782-4ac7-4a65-aa02-f2c090866452 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:59.000567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eb338782-4ac7-4a65-aa02-f2c090866452 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:59.002103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eb338782-4ac7-4a65-aa02-f2c090866452 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:59.003346 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eb338782-4ac7-4a65-aa02-f2c090866452 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.729358 Aug 23 18:06:59.027851 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1745/3572] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:06:58 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:06:59.189599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-09610a03-9c1e-4df8-b3a7-4e24ae1aa286 req-9bf6de31-038c-403e-9185-96d8ddc7124e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb", "tag": "25acea94-b112-429c-a10e-d1e3da5a4dbc"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:59.215970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-09610a03-9c1e-4df8-b3a7-4e24ae1aa286 req-9bf6de31-038c-403e-9185-96d8ddc7124e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:59.216665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-09610a03-9c1e-4df8-b3a7-4e24ae1aa286 req-9bf6de31-038c-403e-9185-96d8ddc7124e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:59.216950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-09610a03-9c1e-4df8-b3a7-4e24ae1aa286 req-9bf6de31-038c-403e-9185-96d8ddc7124e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:59.259797 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-09610a03-9c1e-4df8-b3a7-4e24ae1aa286 req-9bf6de31-038c-403e-9185-96d8ddc7124e service nova] Creating event network-changed:25acea94-b112-429c-a10e-d1e3da5a4dbc for instance 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb on n-h1-850468-16 Aug 23 18:06:59.282484 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-09610a03-9c1e-4df8-b3a7-4e24ae1aa286 req-9bf6de31-038c-403e-9185-96d8ddc7124e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096533 Aug 23 18:06:59.284167 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1746/3573] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:06:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:06:59.300435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-42df25c4-1fa5-4749-b011-7a0b4372eab1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:59.302283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-42df25c4-1fa5-4749-b011-7a0b4372eab1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:59.336335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42df25c4-1fa5-4749-b011-7a0b4372eab1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:59.336857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42df25c4-1fa5-4749-b011-7a0b4372eab1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:59.337414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42df25c4-1fa5-4749-b011-7a0b4372eab1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:59.338160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42df25c4-1fa5-4749-b011-7a0b4372eab1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:59.338737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42df25c4-1fa5-4749-b011-7a0b4372eab1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:59.339792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42df25c4-1fa5-4749-b011-7a0b4372eab1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:59.362338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7aa2c3ff-9665-4bdc-9ca0-201051c4b6e7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:59.378986 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7aa2c3ff-9665-4bdc-9ca0-201051c4b6e7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1501 microversion: 2.1 time: 0.444436 Aug 23 18:06:59.394844 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1828/3574] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:58 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1501 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:59.407947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e9370b86-8e94-48f6-a5cb-06d7a6b721c8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:06:59.408835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e9370b86-8e94-48f6-a5cb-06d7a6b721c8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:59.423731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9370b86-8e94-48f6-a5cb-06d7a6b721c8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:59.424759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9370b86-8e94-48f6-a5cb-06d7a6b721c8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:59.435175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9370b86-8e94-48f6-a5cb-06d7a6b721c8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:59.436714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9370b86-8e94-48f6-a5cb-06d7a6b721c8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:59.437728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9370b86-8e94-48f6-a5cb-06d7a6b721c8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:59.438419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9370b86-8e94-48f6-a5cb-06d7a6b721c8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:59.783620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-42df25c4-1fa5-4749-b011-7a0b4372eab1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:06:59.797071 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-42df25c4-1fa5-4749-b011-7a0b4372eab1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1314 microversion: 2.1 time: 0.509735 Aug 23 18:06:59.797916 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1747/3575] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:59 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1314 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:06:59.804866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d87b6316-90e9-48de-8d0b-df8f4d509407 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a301354f-81ae-43e6-b769-35ef961e109e"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:59.808991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d87b6316-90e9-48de-8d0b-df8f4d509407 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:59.826431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d87b6316-90e9-48de-8d0b-df8f4d509407 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:59.827254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d87b6316-90e9-48de-8d0b-df8f4d509407 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:59.827899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d87b6316-90e9-48de-8d0b-df8f4d509407 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:59.828794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d87b6316-90e9-48de-8d0b-df8f4d509407 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:59.829433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d87b6316-90e9-48de-8d0b-df8f4d509407 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:59.830038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d87b6316-90e9-48de-8d0b-df8f4d509407 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:59.882861 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-d87b6316-90e9-48de-8d0b-df8f4d509407 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] HTTP exception thrown: Cannot 'attach_volume' instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec while it is in vm_state rescued Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d87b6316-90e9-48de-8d0b-df8f4d509407 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Request method failure captured: Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/os-volume_attachments HTTP/1.1 Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 74 Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRbMS5n_NsGau0vnGI0iBrS85eKgyFW2-flo5AMEagzFwHXr8y830jIBRx2ycNUqbit5tulaOzYGG8jmEgWnoI2Kij-0Ap1FvDFmaX_VNZTOBEswqTbIxjk8xyB5l_Bmsy2gQs8ixm2uUwN9H5qHjYOcvdPlZGrIYQD4Gm01UoxEIk4 Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}] Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 283c529ff2774efca184740ad6ccfdd5 Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: {"volumeAttachment": {"volumeId": "a301354f-81ae-43e6-b769-35ef961e109e"}} Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: exception: Cannot 'attach_volume' instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec while it is in vm_state rescued Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': 'ea6af0b0-dd81-47c9-ba04-42c3612b8eec', 'body': {'volumeAttachment': {'volumeId': 'a301354f-81ae-43e6-b769-35ef961e109e'}}} Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 23 18:06:59.893931 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec while it is in vm_state rescued Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec while it is in vm_state rescued Aug 23 18:06:59.899943 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:06:59.901948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d87b6316-90e9-48de-8d0b-df8f4d509407 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Returning 409 to user: Cannot 'attach_volume' instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec while it is in vm_state rescued {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:06:59.903054 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d87b6316-90e9-48de-8d0b-df8f4d509407 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.103930 Aug 23 18:06:59.903809 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1748/3576] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:06:59 2022] POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/os-volume_attachments => generated 152 bytes in 105 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:06:59.915799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-21ccf9a1-68f4-4faa-9c47-10d5b59f4849 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:06:59.916652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-21ccf9a1-68f4-4faa-9c47-10d5b59f4849 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:06:59.937572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21ccf9a1-68f4-4faa-9c47-10d5b59f4849 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:59.938663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21ccf9a1-68f4-4faa-9c47-10d5b59f4849 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:59.939320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21ccf9a1-68f4-4faa-9c47-10d5b59f4849 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:06:59.940293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21ccf9a1-68f4-4faa-9c47-10d5b59f4849 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:06:59.940958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21ccf9a1-68f4-4faa-9c47-10d5b59f4849 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:06:59.941578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21ccf9a1-68f4-4faa-9c47-10d5b59f4849 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:00.004482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e9370b86-8e94-48f6-a5cb-06d7a6b721c8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:00.021399 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e9370b86-8e94-48f6-a5cb-06d7a6b721c8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.619046 Aug 23 18:07:00.022332 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1829/3577] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:06:59 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:00.050234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e8c0c659-144e-43c5-afd5-f9196ef07d7b tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:00.053355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e8c0c659-144e-43c5-afd5-f9196ef07d7b tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:00.067993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8c0c659-144e-43c5-afd5-f9196ef07d7b tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:00.073331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8c0c659-144e-43c5-afd5-f9196ef07d7b tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:00.077597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8c0c659-144e-43c5-afd5-f9196ef07d7b tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:00.079611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8c0c659-144e-43c5-afd5-f9196ef07d7b tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:00.080637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8c0c659-144e-43c5-afd5-f9196ef07d7b tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:00.082956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8c0c659-144e-43c5-afd5-f9196ef07d7b tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:00.094999 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-21ccf9a1-68f4-4faa-9c47-10d5b59f4849 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/action" status: 202 len: 0 microversion: 2.1 time: 0.182935 Aug 23 18:07:00.096470 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1749/3578] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:06:59 2022] POST /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec/action => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:07:00.116049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-20e43381-1b80-4b31-898d-7688d226890e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:00.119664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-20e43381-1b80-4b31-898d-7688d226890e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:00.140434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20e43381-1b80-4b31-898d-7688d226890e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:00.141235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20e43381-1b80-4b31-898d-7688d226890e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:00.142455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20e43381-1b80-4b31-898d-7688d226890e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:00.144104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20e43381-1b80-4b31-898d-7688d226890e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:00.146777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20e43381-1b80-4b31-898d-7688d226890e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:00.147421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20e43381-1b80-4b31-898d-7688d226890e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:00.478285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20e43381-1b80-4b31-898d-7688d226890e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:00.494029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20e43381-1b80-4b31-898d-7688d226890e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:00.498270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20e43381-1b80-4b31-898d-7688d226890e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:00.503184 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-20e43381-1b80-4b31-898d-7688d226890e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.405236 Aug 23 18:07:00.504137 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1750/3579] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:00 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:00.518901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ebd4b7db-52d0-425c-885c-bece663208e3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:00.521852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ebd4b7db-52d0-425c-885c-bece663208e3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:00.538126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebd4b7db-52d0-425c-885c-bece663208e3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:00.540436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebd4b7db-52d0-425c-885c-bece663208e3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:00.542004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebd4b7db-52d0-425c-885c-bece663208e3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:00.548381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebd4b7db-52d0-425c-885c-bece663208e3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:00.550328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebd4b7db-52d0-425c-885c-bece663208e3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:00.551005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebd4b7db-52d0-425c-885c-bece663208e3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:00.854437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ebd4b7db-52d0-425c-885c-bece663208e3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:00.868156 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ebd4b7db-52d0-425c-885c-bece663208e3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1509 microversion: 2.1 time: 0.360818 Aug 23 18:07:00.880243 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1751/3580] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:00 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1509 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:00.880476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8c0c659-144e-43c5-afd5-f9196ef07d7b tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:00.890072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-7dd76ac5-b776-4e89-bb43-ce1306388edb req-558b1dca-96b0-4c32-b514-466bcbbfcdea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d14ef6-0b4d-493a-bf80-523fcb3c3b12", "name": "network-vif-plugged", "status": "completed", "tag": "c8809d3c-5282-4081-bf4b-cdae3769ff62"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:00.898878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=20 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:00.903129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7dd76ac5-b776-4e89-bb43-ce1306388edb req-558b1dca-96b0-4c32-b514-466bcbbfcdea service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:00.903974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7dd76ac5-b776-4e89-bb43-ce1306388edb req-558b1dca-96b0-4c32-b514-466bcbbfcdea service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:00.904638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7dd76ac5-b776-4e89-bb43-ce1306388edb req-558b1dca-96b0-4c32-b514-466bcbbfcdea service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:00.905020 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e8c0c659-144e-43c5-afd5-f9196ef07d7b tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1395 microversion: 2.1 time: 0.880013 Aug 23 18:07:00.906134 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1830/3581] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:00 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1395 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:00.914863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dbc3ee1a-1780-4789-9b9e-b0c6abcd163e tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:00.915493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dbc3ee1a-1780-4789-9b9e-b0c6abcd163e tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:00.919131 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-7dd76ac5-b776-4e89-bb43-ce1306388edb req-558b1dca-96b0-4c32-b514-466bcbbfcdea service nova] Creating event network-vif-plugged:c8809d3c-5282-4081-bf4b-cdae3769ff62 for instance d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 on n-h2-850468-16 Aug 23 18:07:00.925645 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-7dd76ac5-b776-4e89-bb43-ce1306388edb req-558b1dca-96b0-4c32-b514-466bcbbfcdea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042282 Aug 23 18:07:00.931725 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1752/3582] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:00.933846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee1a-1780-4789-9b9e-b0c6abcd163e tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:00.937303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee1a-1780-4789-9b9e-b0c6abcd163e tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:00.938587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee1a-1780-4789-9b9e-b0c6abcd163e tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:00.942530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee1a-1780-4789-9b9e-b0c6abcd163e tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:00.947063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee1a-1780-4789-9b9e-b0c6abcd163e tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:00.947514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbc3ee1a-1780-4789-9b9e-b0c6abcd163e tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:01.292489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dbc3ee1a-1780-4789-9b9e-b0c6abcd163e tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:01.302727 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dbc3ee1a-1780-4789-9b9e-b0c6abcd163e tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1314 microversion: 2.1 time: 0.394979 Aug 23 18:07:01.303689 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1831/3583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:00 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:01.528164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1b68b349-8044-4508-9137-40a9f25cec21 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:01.528839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1b68b349-8044-4508-9137-40a9f25cec21 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:01.542128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b68b349-8044-4508-9137-40a9f25cec21 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:01.550600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b68b349-8044-4508-9137-40a9f25cec21 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:01.551390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b68b349-8044-4508-9137-40a9f25cec21 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:01.552821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b68b349-8044-4508-9137-40a9f25cec21 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:01.553953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b68b349-8044-4508-9137-40a9f25cec21 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:01.554581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b68b349-8044-4508-9137-40a9f25cec21 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:01.891326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9a5b6658-9e2a-41ce-9550-e968a4844bbb tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:01.892151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9a5b6658-9e2a-41ce-9550-e968a4844bbb tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:01.910194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a5b6658-9e2a-41ce-9550-e968a4844bbb tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:01.911026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a5b6658-9e2a-41ce-9550-e968a4844bbb tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:01.911642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a5b6658-9e2a-41ce-9550-e968a4844bbb tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:01.912560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a5b6658-9e2a-41ce-9550-e968a4844bbb tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:01.913190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a5b6658-9e2a-41ce-9550-e968a4844bbb tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:01.913990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a5b6658-9e2a-41ce-9550-e968a4844bbb tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:02.299132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9a5b6658-9e2a-41ce-9550-e968a4844bbb tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:02.316564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1b68b349-8044-4508-9137-40a9f25cec21 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:02.326616 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9a5b6658-9e2a-41ce-9550-e968a4844bbb tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1509 microversion: 2.1 time: 0.437820 Aug 23 18:07:02.342245 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1832/3584] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:01 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1509 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:02.342379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1b68b349-8044-4508-9137-40a9f25cec21 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:02.342379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1b68b349-8044-4508-9137-40a9f25cec21 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:02.342379 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1b68b349-8044-4508-9137-40a9f25cec21 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.816387 Aug 23 18:07:02.345213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6867823e-08f0-4bf4-bc61-d3c755cdd68f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:02.359416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6867823e-08f0-4bf4-bc61-d3c755cdd68f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:02.363518 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1753/3585] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:01 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:02.374091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6867823e-08f0-4bf4-bc61-d3c755cdd68f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:02.374622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6867823e-08f0-4bf4-bc61-d3c755cdd68f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:02.375076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6867823e-08f0-4bf4-bc61-d3c755cdd68f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:02.375790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6867823e-08f0-4bf4-bc61-d3c755cdd68f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:02.376250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6867823e-08f0-4bf4-bc61-d3c755cdd68f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:02.376386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-69cb8ec2-b410-434a-bade-ce492e9aa645 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:02.376675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6867823e-08f0-4bf4-bc61-d3c755cdd68f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:02.377484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-69cb8ec2-b410-434a-bade-ce492e9aa645 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:02.398421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69cb8ec2-b410-434a-bade-ce492e9aa645 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:02.398982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69cb8ec2-b410-434a-bade-ce492e9aa645 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:02.399453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69cb8ec2-b410-434a-bade-ce492e9aa645 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:02.407201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69cb8ec2-b410-434a-bade-ce492e9aa645 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:02.407727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69cb8ec2-b410-434a-bade-ce492e9aa645 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:02.408541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69cb8ec2-b410-434a-bade-ce492e9aa645 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:02.701240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6867823e-08f0-4bf4-bc61-d3c755cdd68f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:02.713066 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6867823e-08f0-4bf4-bc61-d3c755cdd68f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1395 microversion: 2.1 time: 0.378850 Aug 23 18:07:02.727156 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1833/3586] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:02 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1395 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:02.871063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-69cb8ec2-b410-434a-bade-ce492e9aa645 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:02.881177 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-69cb8ec2-b410-434a-bade-ce492e9aa645 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1314 microversion: 2.1 time: 0.516067 Aug 23 18:07:02.900079 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1754/3587] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:02 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1314 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:03.365391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db04760e-dcb4-47b4-8e44-02a927ee0b0b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:03.366271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b10bfa16-bcf4-4ac5-8b59-9890e19a9e52 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:03.368418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-db04760e-dcb4-47b4-8e44-02a927ee0b0b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:03.368601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b10bfa16-bcf4-4ac5-8b59-9890e19a9e52 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:03.378497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db04760e-dcb4-47b4-8e44-02a927ee0b0b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:03.380361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db04760e-dcb4-47b4-8e44-02a927ee0b0b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:03.381000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db04760e-dcb4-47b4-8e44-02a927ee0b0b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:03.383072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db04760e-dcb4-47b4-8e44-02a927ee0b0b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:03.383964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db04760e-dcb4-47b4-8e44-02a927ee0b0b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:03.384579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db04760e-dcb4-47b4-8e44-02a927ee0b0b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:03.389746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b10bfa16-bcf4-4ac5-8b59-9890e19a9e52 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:03.392192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b10bfa16-bcf4-4ac5-8b59-9890e19a9e52 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:03.392777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b10bfa16-bcf4-4ac5-8b59-9890e19a9e52 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:03.393603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b10bfa16-bcf4-4ac5-8b59-9890e19a9e52 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:03.395605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b10bfa16-bcf4-4ac5-8b59-9890e19a9e52 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:03.397618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b10bfa16-bcf4-4ac5-8b59-9890e19a9e52 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:03.833929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b10bfa16-bcf4-4ac5-8b59-9890e19a9e52 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:03.853583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b10bfa16-bcf4-4ac5-8b59-9890e19a9e52 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:03.855144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b10bfa16-bcf4-4ac5-8b59-9890e19a9e52 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:03.856396 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b10bfa16-bcf4-4ac5-8b59-9890e19a9e52 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.494426 Aug 23 18:07:03.857451 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1755/3588] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:03 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:07:03.878090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-db04760e-dcb4-47b4-8e44-02a927ee0b0b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:03.902048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:03.911499 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-db04760e-dcb4-47b4-8e44-02a927ee0b0b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1509 microversion: 2.1 time: 0.565978 Aug 23 18:07:03.916060 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1834/3589] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:03 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1509 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:03.923233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f5ca7256-364c-4b12-aec2-f1209f96d102 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:03.925556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f5ca7256-364c-4b12-aec2-f1209f96d102 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:03.942599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5ca7256-364c-4b12-aec2-f1209f96d102 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:03.944874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5ca7256-364c-4b12-aec2-f1209f96d102 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:03.948066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5ca7256-364c-4b12-aec2-f1209f96d102 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:03.949107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5ca7256-364c-4b12-aec2-f1209f96d102 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:03.949829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5ca7256-364c-4b12-aec2-f1209f96d102 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:03.951412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5ca7256-364c-4b12-aec2-f1209f96d102 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:04.214130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e2774dd6-b9b2-429b-aef7-aedd859e7bdb tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Action: 'create', calling method: .version_select at 0x7f27dfb79670>, body: {"keypair": {"name": "tempest-keypair-734650675", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM3MP7WKt05CclmfBUFem98Ydo1MpfdIX9thUbkOdyBcRjK725Eb2TOBpPItgQ0Cofg0HEy62/Wo+Xv44oc9duGUlwp+rZbMyEVk0O+Nvcnr9XUOkj07L0Q6CcWtKIdKEA=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:04.244351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-e2774dd6-b9b2-429b-aef7-aedd859e7bdb tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Getting quotas for project c7dd15dea3fb4e4bb5f051b71f529e97. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:07:04.253990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-e2774dd6-b9b2-429b-aef7-aedd859e7bdb tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Getting quotas for user 95a73eec1ec44dfe9f6c6cfdfec8ad57 and project c7dd15dea3fb4e4bb5f051b71f529e97. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:07:04.269786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:04.306275 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e2774dd6-b9b2-429b-aef7-aedd859e7bdb tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.446828 Aug 23 18:07:04.314766 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1756/3590] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:07:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:04.321771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1d10bd94-b3ab-47b7-a22a-a332a4a1c226 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:04.323235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1d10bd94-b3ab-47b7-a22a-a332a4a1c226 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:04.331048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d10bd94-b3ab-47b7-a22a-a332a4a1c226 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:04.331897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d10bd94-b3ab-47b7-a22a-a332a4a1c226 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:04.332579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d10bd94-b3ab-47b7-a22a-a332a4a1c226 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:04.333544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d10bd94-b3ab-47b7-a22a-a332a4a1c226 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:04.334211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d10bd94-b3ab-47b7-a22a-a332a4a1c226 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:04.334892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d10bd94-b3ab-47b7-a22a-a332a4a1c226 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:04.564493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1d10bd94-b3ab-47b7-a22a-a332a4a1c226 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:04.584537 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1d10bd94-b3ab-47b7-a22a-a332a4a1c226 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1497 microversion: 2.1 time: 0.266890 Aug 23 18:07:04.587435 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1757/3591] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:04 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1497 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:04.920753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aec26dd7-47b5-44a3-a86d-0505db71cfd5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:04.922215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aec26dd7-47b5-44a3-a86d-0505db71cfd5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:04.936702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aec26dd7-47b5-44a3-a86d-0505db71cfd5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:04.937208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aec26dd7-47b5-44a3-a86d-0505db71cfd5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:04.944128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aec26dd7-47b5-44a3-a86d-0505db71cfd5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:04.948315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aec26dd7-47b5-44a3-a86d-0505db71cfd5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:04.963787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aec26dd7-47b5-44a3-a86d-0505db71cfd5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:04.964369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aec26dd7-47b5-44a3-a86d-0505db71cfd5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:04.973995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f5ca7256-364c-4b12-aec2-f1209f96d102 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:04.992053 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f5ca7256-364c-4b12-aec2-f1209f96d102 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1395 microversion: 2.1 time: 1.069953 Aug 23 18:07:04.999464 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1835/3592] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:03 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1395 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:05.010421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1c59b4a-dfde-4835-bb66-33dc1e589352 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:05.014324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d1c59b4a-dfde-4835-bb66-33dc1e589352 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:05.021206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1c59b4a-dfde-4835-bb66-33dc1e589352 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:05.033060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1c59b4a-dfde-4835-bb66-33dc1e589352 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:05.033798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1c59b4a-dfde-4835-bb66-33dc1e589352 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:05.034831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1c59b4a-dfde-4835-bb66-33dc1e589352 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:05.035560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1c59b4a-dfde-4835-bb66-33dc1e589352 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:05.036318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1c59b4a-dfde-4835-bb66-33dc1e589352 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:05.422891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aec26dd7-47b5-44a3-a86d-0505db71cfd5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:05.448036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aec26dd7-47b5-44a3-a86d-0505db71cfd5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:05.449660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aec26dd7-47b5-44a3-a86d-0505db71cfd5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:05.451231 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aec26dd7-47b5-44a3-a86d-0505db71cfd5 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.560917 Aug 23 18:07:05.453759 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1758/3593] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:04 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:05.528702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d1c59b4a-dfde-4835-bb66-33dc1e589352 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:05.536787 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d1c59b4a-dfde-4835-bb66-33dc1e589352 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1509 microversion: 2.1 time: 0.535847 Aug 23 18:07:05.538878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-603e0900-c20a-4f05-853c-043c0806e1a3 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:05.541167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-603e0900-c20a-4f05-853c-043c0806e1a3 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:05.545961 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1836/3594] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:04 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1509 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:05.549350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-603e0900-c20a-4f05-853c-043c0806e1a3 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:05.550004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-603e0900-c20a-4f05-853c-043c0806e1a3 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:05.550677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-603e0900-c20a-4f05-853c-043c0806e1a3 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:05.552248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-603e0900-c20a-4f05-853c-043c0806e1a3 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:05.553629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-603e0900-c20a-4f05-853c-043c0806e1a3 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:05.554220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-603e0900-c20a-4f05-853c-043c0806e1a3 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:05.591256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-603e0900-c20a-4f05-853c-043c0806e1a3 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:07:05.733037 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-603e0900-c20a-4f05-853c-043c0806e1a3 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 204 len: 0 microversion: 2.1 time: 0.197540 Aug 23 18:07:05.736957 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1759/3595] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:07:05 2022] DELETE /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:07:05.744553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb9cf4ed-f8ac-4fda-9812-91a8eb0babfb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:05.745451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eb9cf4ed-f8ac-4fda-9812-91a8eb0babfb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:05.756656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb9cf4ed-f8ac-4fda-9812-91a8eb0babfb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:05.757158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb9cf4ed-f8ac-4fda-9812-91a8eb0babfb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:05.761264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb9cf4ed-f8ac-4fda-9812-91a8eb0babfb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:05.762291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb9cf4ed-f8ac-4fda-9812-91a8eb0babfb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:05.763677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb9cf4ed-f8ac-4fda-9812-91a8eb0babfb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:05.765137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb9cf4ed-f8ac-4fda-9812-91a8eb0babfb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:06.016637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8b2aac73-90db-4c94-a61e-777a3e52a76e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:06.017631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8b2aac73-90db-4c94-a61e-777a3e52a76e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:06.032510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b2aac73-90db-4c94-a61e-777a3e52a76e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:06.037431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b2aac73-90db-4c94-a61e-777a3e52a76e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:06.038192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b2aac73-90db-4c94-a61e-777a3e52a76e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:06.041378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b2aac73-90db-4c94-a61e-777a3e52a76e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:06.042138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b2aac73-90db-4c94-a61e-777a3e52a76e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:06.042816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b2aac73-90db-4c94-a61e-777a3e52a76e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:06.094120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:06.183589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eb9cf4ed-f8ac-4fda-9812-91a8eb0babfb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:06.195388 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eb9cf4ed-f8ac-4fda-9812-91a8eb0babfb tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1503 microversion: 2.1 time: 0.456799 Aug 23 18:07:06.197717 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1837/3596] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:05 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1503 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:06.372483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8b2aac73-90db-4c94-a61e-777a3e52a76e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:06.405879 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8b2aac73-90db-4c94-a61e-777a3e52a76e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1395 microversion: 2.1 time: 0.390819 Aug 23 18:07:06.406981 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1760/3597] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:06 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1395 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:06.478466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-45ed92db-3c2b-4e1f-bae8-64de4b93bf19 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:06.479233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-45ed92db-3c2b-4e1f-bae8-64de4b93bf19 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:06.490804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45ed92db-3c2b-4e1f-bae8-64de4b93bf19 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:06.491927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45ed92db-3c2b-4e1f-bae8-64de4b93bf19 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:06.495436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45ed92db-3c2b-4e1f-bae8-64de4b93bf19 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:06.495874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45ed92db-3c2b-4e1f-bae8-64de4b93bf19 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:06.498997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45ed92db-3c2b-4e1f-bae8-64de4b93bf19 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:06.499581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45ed92db-3c2b-4e1f-bae8-64de4b93bf19 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:06.581866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-af36526d-4715-439a-aa39-afb2c838cd40 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:06.581866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-af36526d-4715-439a-aa39-afb2c838cd40 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:06.592555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af36526d-4715-439a-aa39-afb2c838cd40 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:06.597916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af36526d-4715-439a-aa39-afb2c838cd40 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:06.598500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af36526d-4715-439a-aa39-afb2c838cd40 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:06.599299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af36526d-4715-439a-aa39-afb2c838cd40 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:06.599768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af36526d-4715-439a-aa39-afb2c838cd40 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:06.600186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af36526d-4715-439a-aa39-afb2c838cd40 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:06.968172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-af36526d-4715-439a-aa39-afb2c838cd40 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:06.980040 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-af36526d-4715-439a-aa39-afb2c838cd40 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1509 microversion: 2.1 time: 0.409817 Aug 23 18:07:06.994463 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1761/3598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:06 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1509 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:07.129702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4f8bedeb-69c8-4f47-a83f-237ea47dad4b req-bd1f008e-7356-4e2b-b1b3-5c0da81de9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb", "name": "network-vif-plugged", "status": "completed", "tag": "25acea94-b112-429c-a10e-d1e3da5a4dbc"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:07.156623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4f8bedeb-69c8-4f47-a83f-237ea47dad4b req-bd1f008e-7356-4e2b-b1b3-5c0da81de9ff service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:07.159103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4f8bedeb-69c8-4f47-a83f-237ea47dad4b req-bd1f008e-7356-4e2b-b1b3-5c0da81de9ff service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:07.159912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4f8bedeb-69c8-4f47-a83f-237ea47dad4b req-bd1f008e-7356-4e2b-b1b3-5c0da81de9ff service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:07.202332 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4f8bedeb-69c8-4f47-a83f-237ea47dad4b req-bd1f008e-7356-4e2b-b1b3-5c0da81de9ff service nova] Creating event network-vif-plugged:25acea94-b112-429c-a10e-d1e3da5a4dbc for instance 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb on n-h1-850468-16 Aug 23 18:07:07.214337 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4f8bedeb-69c8-4f47-a83f-237ea47dad4b req-bd1f008e-7356-4e2b-b1b3-5c0da81de9ff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084616 Aug 23 18:07:07.216990 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1762/3599] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:07.235633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-68ed76cd-3fdd-4ca6-9335-e6460090ba6c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:07.236345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-68ed76cd-3fdd-4ca6-9335-e6460090ba6c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:07.246976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68ed76cd-3fdd-4ca6-9335-e6460090ba6c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:07.247536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68ed76cd-3fdd-4ca6-9335-e6460090ba6c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:07.248562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68ed76cd-3fdd-4ca6-9335-e6460090ba6c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:07.249291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68ed76cd-3fdd-4ca6-9335-e6460090ba6c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:07.250045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68ed76cd-3fdd-4ca6-9335-e6460090ba6c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:07.250741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68ed76cd-3fdd-4ca6-9335-e6460090ba6c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:07.307821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45ed92db-3c2b-4e1f-bae8-64de4b93bf19 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:07.322425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45ed92db-3c2b-4e1f-bae8-64de4b93bf19 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:07.324412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45ed92db-3c2b-4e1f-bae8-64de4b93bf19 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:07.326124 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-45ed92db-3c2b-4e1f-bae8-64de4b93bf19 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.852348 Aug 23 18:07:07.327229 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1838/3600] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:06 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:07.427517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-033bb7eb-87dd-4794-966b-1f72e451f67f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:07.428204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-033bb7eb-87dd-4794-966b-1f72e451f67f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:07.436095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-033bb7eb-87dd-4794-966b-1f72e451f67f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:07.436725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-033bb7eb-87dd-4794-966b-1f72e451f67f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:07.437565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-033bb7eb-87dd-4794-966b-1f72e451f67f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:07.438506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-033bb7eb-87dd-4794-966b-1f72e451f67f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:07.439240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-033bb7eb-87dd-4794-966b-1f72e451f67f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:07.439889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-033bb7eb-87dd-4794-966b-1f72e451f67f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:07.502476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:07.612621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-68ed76cd-3fdd-4ca6-9335-e6460090ba6c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:07.623080 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-68ed76cd-3fdd-4ca6-9335-e6460090ba6c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1503 microversion: 2.1 time: 0.404453 Aug 23 18:07:07.623673 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1763/3601] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:07 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1503 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:07.643061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1871913526", "imageRef": "374b3476-9d78-421b-98a8-1023f802af7c", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "bbd27588-8b48-44b7-82b0-9e01cc93188c"}], "security_groups": [{"name": "tempest-securitygroup--1884886156"}], "key_name": "tempest-keypair-734650675", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:07.747007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-033bb7eb-87dd-4794-966b-1f72e451f67f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:07.755251 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-033bb7eb-87dd-4794-966b-1f72e451f67f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1395 microversion: 2.1 time: 0.332253 Aug 23 18:07:07.775214 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1839/3602] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:07 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1395 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:08.001574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b789def5-5d5d-4b68-b110-61da5be2348a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:08.002232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b789def5-5d5d-4b68-b110-61da5be2348a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:08.010050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b789def5-5d5d-4b68-b110-61da5be2348a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:08.014223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b789def5-5d5d-4b68-b110-61da5be2348a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:08.014749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b789def5-5d5d-4b68-b110-61da5be2348a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:08.015580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b789def5-5d5d-4b68-b110-61da5be2348a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:08.024640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b789def5-5d5d-4b68-b110-61da5be2348a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:08.025260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b789def5-5d5d-4b68-b110-61da5be2348a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:08.377307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] validate_networks() for [('bbd27588-8b48-44b7-82b0-9e01cc93188c', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:07:08.774850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b789def5-5d5d-4b68-b110-61da5be2348a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:08.787435 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b789def5-5d5d-4b68-b110-61da5be2348a tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1515 microversion: 2.1 time: 0.789773 Aug 23 18:07:08.791923 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1840/3603] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:07 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1515 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:08.798413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a2d6f92f-cc9e-48b6-ab29-c97e6a6d34cd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:08.799428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a2d6f92f-cc9e-48b6-ab29-c97e6a6d34cd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:08.810641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2d6f92f-cc9e-48b6-ab29-c97e6a6d34cd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:08.811432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2d6f92f-cc9e-48b6-ab29-c97e6a6d34cd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:08.812271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2d6f92f-cc9e-48b6-ab29-c97e6a6d34cd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:08.813397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2d6f92f-cc9e-48b6-ab29-c97e6a6d34cd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:08.814434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2d6f92f-cc9e-48b6-ab29-c97e6a6d34cd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:08.815373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2d6f92f-cc9e-48b6-ab29-c97e6a6d34cd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:09.146498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:07:09.147085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:07:09.149481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:07:09.150247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:07:09.150809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:07:09.200420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:09.203652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:09.204474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:09.208659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:09.212131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:09.216481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:09.277841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Getting quotas for project c7dd15dea3fb4e4bb5f051b71f529e97. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:07:09.294737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Getting quotas for user 95a73eec1ec44dfe9f6c6cfdfec8ad57 and project c7dd15dea3fb4e4bb5f051b71f529e97. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:07:09.329741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:07:09.335171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='374b3476-9d78-421b-98a8-1023f802af7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:07:09.461864 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-55a0cfc7-8502-4d11-8977-87e8aab42f66 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.821090 Aug 23 18:07:09.469978 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1764/3604] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:07:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1846 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:07:09.474952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:09.483637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:09.516554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:09.517858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:09.518499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:09.519432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:09.520226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:09.520860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:09.562583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a2d6f92f-cc9e-48b6-ab29-c97e6a6d34cd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:09.599491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a2d6f92f-cc9e-48b6-ab29-c97e6a6d34cd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:09.601074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a2d6f92f-cc9e-48b6-ab29-c97e6a6d34cd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:09.602383 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a2d6f92f-cc9e-48b6-ab29-c97e6a6d34cd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.808737 Aug 23 18:07:09.607149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:09.607743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:09.608187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:09.611525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lazy-loading 'fault' on Instance uuid d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:07:09.627768 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1841/3605] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:08 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:09.642154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-789d7a01-c592-4f8d-ae38-772b76c62582 req-f107b472-6ce1-40c3-9889-3cd077da0f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d5d14ef6-0b4d-493a-bf80-523fcb3c3b12", "name": "network-vif-deleted", "tag": "c8809d3c-5282-4081-bf4b-cdae3769ff62"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:09.667861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-789d7a01-c592-4f8d-ae38-772b76c62582 req-f107b472-6ce1-40c3-9889-3cd077da0f6b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:09.668366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-789d7a01-c592-4f8d-ae38-772b76c62582 req-f107b472-6ce1-40c3-9889-3cd077da0f6b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:09.670715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-789d7a01-c592-4f8d-ae38-772b76c62582 req-f107b472-6ce1-40c3-9889-3cd077da0f6b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:09.696636 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-789d7a01-c592-4f8d-ae38-772b76c62582 req-f107b472-6ce1-40c3-9889-3cd077da0f6b service nova] Creating event network-vif-deleted:c8809d3c-5282-4081-bf4b-cdae3769ff62 for instance d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 on n-h2-850468-16 Aug 23 18:07:09.710473 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-789d7a01-c592-4f8d-ae38-772b76c62582 req-f107b472-6ce1-40c3-9889-3cd077da0f6b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080711 Aug 23 18:07:09.715160 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1842/3606] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:09.732180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:09.735572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a01e60fe-d8d4-4d1c-952f-1ac45c0e0a3f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:09.736709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a01e60fe-d8d4-4d1c-952f-1ac45c0e0a3f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:09.741539 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b89adec9-1a1d-4ede-9942-4a5e8db642df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 200 len: 1304 microversion: 2.1 time: 0.270348 Aug 23 18:07:09.750963 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1765/3607] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:09 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 1304 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:09.751279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a01e60fe-d8d4-4d1c-952f-1ac45c0e0a3f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:09.751926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a01e60fe-d8d4-4d1c-952f-1ac45c0e0a3f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:09.752541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a01e60fe-d8d4-4d1c-952f-1ac45c0e0a3f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:09.753446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a01e60fe-d8d4-4d1c-952f-1ac45c0e0a3f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:09.756227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a01e60fe-d8d4-4d1c-952f-1ac45c0e0a3f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:09.756860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a01e60fe-d8d4-4d1c-952f-1ac45c0e0a3f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:09.766958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-814ce0c4-9bda-444b-bfda-a6c23243b32e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:09.767447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-814ce0c4-9bda-444b-bfda-a6c23243b32e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:09.893901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-814ce0c4-9bda-444b-bfda-a6c23243b32e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:09.902587 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-814ce0c4-9bda-444b-bfda-a6c23243b32e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1245 microversion: 2.1 time: 0.150432 Aug 23 18:07:09.915339 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1766/3608] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:09 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1245 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:10.113896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a01e60fe-d8d4-4d1c-952f-1ac45c0e0a3f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:10.133992 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a01e60fe-d8d4-4d1c-952f-1ac45c0e0a3f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1577 microversion: 2.1 time: 0.416140 Aug 23 18:07:10.135409 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1843/3609] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:09 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1577 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:10.159052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5667613e-41e3-47cb-92cc-d2cb120b745c tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:10.160494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5667613e-41e3-47cb-92cc-d2cb120b745c tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:10.167233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5667613e-41e3-47cb-92cc-d2cb120b745c tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:10.168144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5667613e-41e3-47cb-92cc-d2cb120b745c tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:10.169087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5667613e-41e3-47cb-92cc-d2cb120b745c tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:10.169966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5667613e-41e3-47cb-92cc-d2cb120b745c tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:10.170607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5667613e-41e3-47cb-92cc-d2cb120b745c tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:10.171190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5667613e-41e3-47cb-92cc-d2cb120b745c tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:10.360644 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5667613e-41e3-47cb-92cc-d2cb120b745c tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.205936 Aug 23 18:07:10.361955 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1767/3610] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:07:10 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb/os-interface => generated 285 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:10.637736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-091b38de-202b-43cc-b166-fa642ac1764c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:10.638596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-091b38de-202b-43cc-b166-fa642ac1764c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:10.663169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-091b38de-202b-43cc-b166-fa642ac1764c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:10.663169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-091b38de-202b-43cc-b166-fa642ac1764c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:10.663661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-091b38de-202b-43cc-b166-fa642ac1764c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:10.665385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-091b38de-202b-43cc-b166-fa642ac1764c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:10.670788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-091b38de-202b-43cc-b166-fa642ac1764c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:10.679303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-091b38de-202b-43cc-b166-fa642ac1764c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:10.775321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45e2925d-bbfd-4465-9650-b4a7af13ed0c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:10.775577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-45e2925d-bbfd-4465-9650-b4a7af13ed0c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: d5d14ef6-0b4d-493a-bf80-523fcb3c3b12] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:10.787490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45e2925d-bbfd-4465-9650-b4a7af13ed0c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:10.787985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45e2925d-bbfd-4465-9650-b4a7af13ed0c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:10.788422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45e2925d-bbfd-4465-9650-b4a7af13ed0c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:10.789665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45e2925d-bbfd-4465-9650-b4a7af13ed0c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:10.803359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45e2925d-bbfd-4465-9650-b4a7af13ed0c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:10.810503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45e2925d-bbfd-4465-9650-b4a7af13ed0c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:10.835890 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-45e2925d-bbfd-4465-9650-b4a7af13ed0c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] HTTP exception thrown: Instance d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 could not be found. Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45e2925d-bbfd-4465-9650-b4a7af13ed0c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Request method failure captured: Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 HTTP/1.1 Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRclNbYdR0eFODJ_6gZi5VIHKSY2u-8E8H4hfA8f-ge1IIwhU6aO_l_8gEC7b_ACoeW3lcd7tothzaqaQWkey9DJn8-wfvsioChy6mzXu2MsGWn84L9MdITPx7Uv1wI4yGSo4YMSxRei9t5KgsSsZAGOGN9V2qoh8n-wg4_Gdpuogd0 Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ea86d950d3924eec9e05e4b4cdb87c68 Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-VolumesActionsTest-575634286 Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ea86d950d3924eec9e05e4b4cdb87c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea86d950d3924eec9e05e4b4cdb87c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ea86d950d3924eec9e05e4b4cdb87c68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea86d950d3924eec9e05e4b4cdb87c68"}]}] Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-VolumesActionsTest-575634286 Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ea86d950d3924eec9e05e4b4cdb87c68 Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-VolumesActionsTest-575634286 Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-VolumesActionsTest-575634286-project Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f3b3185ff033439a88ad2577ef0133a8 Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-VolumesActionsTest-575634286-project Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 could not be found. Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'd5d14ef6-0b4d-493a-bf80-523fcb3c3b12'} Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 could not be found. Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 could not be found. Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:07:10.838309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:07:10.844210 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:07:10.844210 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:07:10.844210 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:07:10.844210 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:07:10.844210 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:07:10.844210 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 could not be found. Aug 23 18:07:10.844210 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:07:10.853726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45e2925d-bbfd-4465-9650-b4a7af13ed0c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Returning 404 to user: Instance d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:07:10.855076 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-45e2925d-bbfd-4465-9650-b4a7af13ed0c tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12" status: 404 len: 111 microversion: 2.1 time: 0.084995 Aug 23 18:07:10.863380 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1768/3611] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:10 2022] GET /compute/v2.1/servers/d5d14ef6-0b4d-493a-bf80-523fcb3c3b12 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:07:10.926520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-32d95acf-3f09-4f1e-96d0-1f0279041673 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:10.927442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-32d95acf-3f09-4f1e-96d0-1f0279041673 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:10.946794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32d95acf-3f09-4f1e-96d0-1f0279041673 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:10.947576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32d95acf-3f09-4f1e-96d0-1f0279041673 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:10.948217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32d95acf-3f09-4f1e-96d0-1f0279041673 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:10.949114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32d95acf-3f09-4f1e-96d0-1f0279041673 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:10.949744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32d95acf-3f09-4f1e-96d0-1f0279041673 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:10.950425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32d95acf-3f09-4f1e-96d0-1f0279041673 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:11.415744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-32d95acf-3f09-4f1e-96d0-1f0279041673 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:11.423813 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-32d95acf-3f09-4f1e-96d0-1f0279041673 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1241 microversion: 2.1 time: 0.501075 Aug 23 18:07:11.430872 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1769/3612] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:10 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1241 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:11.444149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1872859202", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "efca7801-4c49-4f2e-ba97-2ba72d461e4f"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:11.563303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] validate_networks() for [('efca7801-4c49-4f2e-ba97-2ba72d461e4f', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:07:11.642530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-091b38de-202b-43cc-b166-fa642ac1764c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:11.678447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-091b38de-202b-43cc-b166-fa642ac1764c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:11.678447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-091b38de-202b-43cc-b166-fa642ac1764c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:11.678447 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-091b38de-202b-43cc-b166-fa642ac1764c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 1.046748 Aug 23 18:07:11.682837 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1844/3613] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:10 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 1052 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:11.691017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e9ffb244-ed44-434c-8b5f-27e7a295a644 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'create', calling method: .version_select at 0x7f27df6e4700>, body: {"keypair": {"name": "tempest-keypair-1928435785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8sqlUi8kB5JRW7CpUOsDRQddtfmKC0p1Lcqe5ziBOj/D4KShsst/vJEvCuWLpl6AP3y7KfAClbPNRMUmiVYw+VQq7sHuevXZoc8mEscOQWaza1u4xwmUXPou7Qtf7kHQ=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:11.718442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-e9ffb244-ed44-434c-8b5f-27e7a295a644 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Getting quotas for project abd08de41b7e42c29d3e4e7c97dc9f2a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:07:11.726658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-e9ffb244-ed44-434c-8b5f-27e7a295a644 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Getting quotas for user 283c529ff2774efca184740ad6ccfdd5 and project abd08de41b7e42c29d3e4e7c97dc9f2a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:07:11.784182 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e9ffb244-ed44-434c-8b5f-27e7a295a644 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098370 Aug 23 18:07:11.786338 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1845/3614] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:07:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:12.448264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0496244a-45e1-4a94-9f3b-9949fc85d76a tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:12.449652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0496244a-45e1-4a94-9f3b-9949fc85d76a tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:12.466656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0496244a-45e1-4a94-9f3b-9949fc85d76a tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:12.473933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0496244a-45e1-4a94-9f3b-9949fc85d76a tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:12.477148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0496244a-45e1-4a94-9f3b-9949fc85d76a tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:12.479771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0496244a-45e1-4a94-9f3b-9949fc85d76a tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:12.480485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0496244a-45e1-4a94-9f3b-9949fc85d76a tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:12.483899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0496244a-45e1-4a94-9f3b-9949fc85d76a tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:12.488027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:07:12.489121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:07:12.489647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:07:12.490127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:07:12.490819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:07:12.528046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:12.528605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:12.529065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:12.530028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:12.530495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:12.530954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:12.643549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Getting quotas for project ea86d950d3924eec9e05e4b4cdb87c68. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:07:12.662149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Getting quotas for user f3b3185ff033439a88ad2577ef0133a8 and project ea86d950d3924eec9e05e4b4cdb87c68. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:07:12.690157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:07:12.696947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:07:12.768523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0496244a-45e1-4a94-9f3b-9949fc85d76a tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:12.785413 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0496244a-45e1-4a94-9f3b-9949fc85d76a tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1303 microversion: 2.1 time: 0.339076 Aug 23 18:07:12.787376 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1846/3615] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:12 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1303 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:12.805541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-617dac74-78ff-433e-af6d-407d268436bc tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:12.833654 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-36c1edfc-c660-48f5-a3cc-8797ec8e8db6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.401202 Aug 23 18:07:12.840062 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1770/3616] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:07:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1408 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:07:12.853972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-008de0fe-5da9-4c93-a9ff-b5e4cadfe285 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:12.854994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-008de0fe-5da9-4c93-a9ff-b5e4cadfe285 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:12.856023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-617dac74-78ff-433e-af6d-407d268436bc tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:12.912340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-617dac74-78ff-433e-af6d-407d268436bc tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:12.916892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-617dac74-78ff-433e-af6d-407d268436bc tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:12.918926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-617dac74-78ff-433e-af6d-407d268436bc tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:12.921671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-617dac74-78ff-433e-af6d-407d268436bc tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:12.927457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-617dac74-78ff-433e-af6d-407d268436bc tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:12.929013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-617dac74-78ff-433e-af6d-407d268436bc tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:13.093666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-008de0fe-5da9-4c93-a9ff-b5e4cadfe285 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:13.107680 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-008de0fe-5da9-4c93-a9ff-b5e4cadfe285 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1214 microversion: 2.1 time: 0.260058 Aug 23 18:07:13.111476 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1771/3617] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:12 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1214 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:13.411440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9fd759eb-8e33-4f7e-a80c-7ced72749fca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:13.412072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9fd759eb-8e33-4f7e-a80c-7ced72749fca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:13.440728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fd759eb-8e33-4f7e-a80c-7ced72749fca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:13.441227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fd759eb-8e33-4f7e-a80c-7ced72749fca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:13.444675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fd759eb-8e33-4f7e-a80c-7ced72749fca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:13.449550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fd759eb-8e33-4f7e-a80c-7ced72749fca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:13.452348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fd759eb-8e33-4f7e-a80c-7ced72749fca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:13.452832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fd759eb-8e33-4f7e-a80c-7ced72749fca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:13.698036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-617dac74-78ff-433e-af6d-407d268436bc tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:13.718713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-617dac74-78ff-433e-af6d-407d268436bc tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:13.722174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-617dac74-78ff-433e-af6d-407d268436bc tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:13.726332 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-617dac74-78ff-433e-af6d-407d268436bc tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.932341 Aug 23 18:07:13.729202 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1847/3618] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:12 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:13.736927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-37e0ef78-140c-418a-a259-650037c0b3b6 req-f7560c84-e26a-43c7-a006-e0643fc8cfa7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb", "tag": "25acea94-b112-429c-a10e-d1e3da5a4dbc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:13.774475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-37e0ef78-140c-418a-a259-650037c0b3b6 req-f7560c84-e26a-43c7-a006-e0643fc8cfa7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:13.790350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-37e0ef78-140c-418a-a259-650037c0b3b6 req-f7560c84-e26a-43c7-a006-e0643fc8cfa7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:13.792747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-37e0ef78-140c-418a-a259-650037c0b3b6 req-f7560c84-e26a-43c7-a006-e0643fc8cfa7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:13.840761 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-37e0ef78-140c-418a-a259-650037c0b3b6 req-f7560c84-e26a-43c7-a006-e0643fc8cfa7 service nova] Creating event network-changed:25acea94-b112-429c-a10e-d1e3da5a4dbc for instance 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb on n-h1-850468-16 Aug 23 18:07:13.862032 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-37e0ef78-140c-418a-a259-650037c0b3b6 req-f7560c84-e26a-43c7-a006-e0643fc8cfa7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.129375 Aug 23 18:07:13.862975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9fd759eb-8e33-4f7e-a80c-7ced72749fca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:13.864169 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1848/3619] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:13.928343 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9fd759eb-8e33-4f7e-a80c-7ced72749fca tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1577 microversion: 2.1 time: 0.521026 Aug 23 18:07:13.932526 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1772/3620] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:13 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1577 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:13.940574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0f12003d-8134-4e95-a0ce-5b0a1a380c3c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:13.941684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0f12003d-8134-4e95-a0ce-5b0a1a380c3c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:13.951926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f12003d-8134-4e95-a0ce-5b0a1a380c3c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:13.954276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f12003d-8134-4e95-a0ce-5b0a1a380c3c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:13.955662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f12003d-8134-4e95-a0ce-5b0a1a380c3c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:13.957314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f12003d-8134-4e95-a0ce-5b0a1a380c3c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:13.958030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f12003d-8134-4e95-a0ce-5b0a1a380c3c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:13.958785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f12003d-8134-4e95-a0ce-5b0a1a380c3c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:14.087004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5688b86c-574e-4b79-8376-883917ba4c0e tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Action: 'create', calling method: .version_select at 0x7f27df7c7550>, body: {"keypair": {"name": "tempest-keypair-1053118384", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJmmcu9U7P8T6J8R9gGMaJ3KY25iWDZoCkL3jmUbw5zSPuoPmxU5aFwVPe1MxOsffPmXdDkMwZOWHt4C7YALJTuh9AxwShMijsa9ZIOoL1LliKTt5uJ6+82xT3ngjWbq7g=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:14.160627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5688b86c-574e-4b79-8376-883917ba4c0e tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Getting quotas for project 2d4fff29f6fb4e4aa782d8b74a361d1a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:07:14.174459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5688b86c-574e-4b79-8376-883917ba4c0e tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Getting quotas for user 2d3bdd07adea4f508fdfa0189ec7a902 and project 2d4fff29f6fb4e4aa782d8b74a361d1a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:07:14.252458 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5688b86c-574e-4b79-8376-883917ba4c0e tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.380354 Aug 23 18:07:14.253259 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1849/3621] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:07:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:14.283184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef1fcaff-eace-4d2c-92b6-55fa9255de47 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:14.286627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef1fcaff-eace-4d2c-92b6-55fa9255de47 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:14.293247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0f12003d-8134-4e95-a0ce-5b0a1a380c3c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:14.305099 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0f12003d-8134-4e95-a0ce-5b0a1a380c3c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1303 microversion: 2.1 time: 0.367573 Aug 23 18:07:14.308820 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1773/3622] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:13 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1303 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:14.330017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef1fcaff-eace-4d2c-92b6-55fa9255de47 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:14.330527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef1fcaff-eace-4d2c-92b6-55fa9255de47 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:14.338953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef1fcaff-eace-4d2c-92b6-55fa9255de47 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:14.339849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef1fcaff-eace-4d2c-92b6-55fa9255de47 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:14.340702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef1fcaff-eace-4d2c-92b6-55fa9255de47 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:14.341466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef1fcaff-eace-4d2c-92b6-55fa9255de47 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:14.710016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef1fcaff-eace-4d2c-92b6-55fa9255de47 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:14.730368 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef1fcaff-eace-4d2c-92b6-55fa9255de47 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1210 microversion: 2.1 time: 0.464702 Aug 23 18:07:14.732431 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1850/3623] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:14 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1210 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:14.756660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bbda5166-5683-4fcc-954d-628deb991684 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:14.757234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bbda5166-5683-4fcc-954d-628deb991684 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:14.790364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbda5166-5683-4fcc-954d-628deb991684 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:14.790917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbda5166-5683-4fcc-954d-628deb991684 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:14.791426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbda5166-5683-4fcc-954d-628deb991684 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:14.792173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbda5166-5683-4fcc-954d-628deb991684 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:14.792644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbda5166-5683-4fcc-954d-628deb991684 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:14.796697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbda5166-5683-4fcc-954d-628deb991684 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:15.329376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cded98d0-d0e0-4644-ac9e-543be6c5970b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:15.330939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cded98d0-d0e0-4644-ac9e-543be6c5970b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:15.361376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cded98d0-d0e0-4644-ac9e-543be6c5970b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:15.363272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cded98d0-d0e0-4644-ac9e-543be6c5970b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:15.370964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cded98d0-d0e0-4644-ac9e-543be6c5970b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:15.375210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cded98d0-d0e0-4644-ac9e-543be6c5970b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:15.375955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cded98d0-d0e0-4644-ac9e-543be6c5970b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:15.384183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cded98d0-d0e0-4644-ac9e-543be6c5970b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:15.843232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cded98d0-d0e0-4644-ac9e-543be6c5970b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:15.851919 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cded98d0-d0e0-4644-ac9e-543be6c5970b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1303 microversion: 2.1 time: 0.526338 Aug 23 18:07:15.859369 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1851/3624] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:15 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1303 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:15.877396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dbae06b9-5016-43e1-945e-e7a1cc3904b4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:15.878090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dbae06b9-5016-43e1-945e-e7a1cc3904b4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:15.892594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbae06b9-5016-43e1-945e-e7a1cc3904b4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:15.893155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbae06b9-5016-43e1-945e-e7a1cc3904b4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:15.893521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbae06b9-5016-43e1-945e-e7a1cc3904b4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:15.910940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbae06b9-5016-43e1-945e-e7a1cc3904b4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:15.911438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbae06b9-5016-43e1-945e-e7a1cc3904b4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:15.911884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbae06b9-5016-43e1-945e-e7a1cc3904b4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:16.200101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dbae06b9-5016-43e1-945e-e7a1cc3904b4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:16.213740 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dbae06b9-5016-43e1-945e-e7a1cc3904b4 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1272 microversion: 2.1 time: 0.352923 Aug 23 18:07:16.214637 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1852/3625] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:15 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1272 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:16.873538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bbda5166-5683-4fcc-954d-628deb991684 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:16.883086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2e00eb92-7429-4c76-a081-c28bce90c7d6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:16.884397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2e00eb92-7429-4c76-a081-c28bce90c7d6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:16.899712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e00eb92-7429-4c76-a081-c28bce90c7d6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:16.910680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bbda5166-5683-4fcc-954d-628deb991684 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:16.911668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e00eb92-7429-4c76-a081-c28bce90c7d6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:16.915906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e00eb92-7429-4c76-a081-c28bce90c7d6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:16.922390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e00eb92-7429-4c76-a081-c28bce90c7d6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:16.926313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bbda5166-5683-4fcc-954d-628deb991684 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:16.927171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e00eb92-7429-4c76-a081-c28bce90c7d6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:16.933991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e00eb92-7429-4c76-a081-c28bce90c7d6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:16.935690 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bbda5166-5683-4fcc-954d-628deb991684 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 2.183982 Aug 23 18:07:16.941180 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1774/3626] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:14 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 2192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:17.148865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2e00eb92-7429-4c76-a081-c28bce90c7d6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:17.160247 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2e00eb92-7429-4c76-a081-c28bce90c7d6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1303 microversion: 2.1 time: 0.284446 Aug 23 18:07:17.171523 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1853/3627] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:16 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1303 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:17.235895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2084d086-0540-44ba-963b-88e6e55aa3c7 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:17.236529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2084d086-0540-44ba-963b-88e6e55aa3c7 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:17.248391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2084d086-0540-44ba-963b-88e6e55aa3c7 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:17.255379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2084d086-0540-44ba-963b-88e6e55aa3c7 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:17.256216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2084d086-0540-44ba-963b-88e6e55aa3c7 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:17.257151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2084d086-0540-44ba-963b-88e6e55aa3c7 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:17.267460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2084d086-0540-44ba-963b-88e6e55aa3c7 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:17.268754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2084d086-0540-44ba-963b-88e6e55aa3c7 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:17.526844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2084d086-0540-44ba-963b-88e6e55aa3c7 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:17.536104 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2084d086-0540-44ba-963b-88e6e55aa3c7 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1272 microversion: 2.1 time: 0.304667 Aug 23 18:07:17.539812 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1775/3628] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:17 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1272 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:17.969335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-acc2fd0d-aee1-4d8f-8622-094d58ea33bd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:17.970494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-acc2fd0d-aee1-4d8f-8622-094d58ea33bd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:18.016645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc2fd0d-aee1-4d8f-8622-094d58ea33bd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:18.017195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc2fd0d-aee1-4d8f-8622-094d58ea33bd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:18.017650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc2fd0d-aee1-4d8f-8622-094d58ea33bd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:18.018407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc2fd0d-aee1-4d8f-8622-094d58ea33bd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:18.018908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc2fd0d-aee1-4d8f-8622-094d58ea33bd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:18.019341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc2fd0d-aee1-4d8f-8622-094d58ea33bd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:18.195884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-17e38cf7-8553-4f30-a4e9-5ddfde3e8b02 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:18.196692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-17e38cf7-8553-4f30-a4e9-5ddfde3e8b02 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:18.208288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17e38cf7-8553-4f30-a4e9-5ddfde3e8b02 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:18.208795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17e38cf7-8553-4f30-a4e9-5ddfde3e8b02 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:18.209272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17e38cf7-8553-4f30-a4e9-5ddfde3e8b02 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:18.209960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17e38cf7-8553-4f30-a4e9-5ddfde3e8b02 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:18.213731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17e38cf7-8553-4f30-a4e9-5ddfde3e8b02 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:18.214196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17e38cf7-8553-4f30-a4e9-5ddfde3e8b02 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:18.738499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-acc2fd0d-aee1-4d8f-8622-094d58ea33bd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:18.742590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:18.760177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-17e38cf7-8553-4f30-a4e9-5ddfde3e8b02 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:18.763485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-acc2fd0d-aee1-4d8f-8622-094d58ea33bd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:18.774582 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-17e38cf7-8553-4f30-a4e9-5ddfde3e8b02 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.584742 Aug 23 18:07:18.786566 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1776/3629] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:18 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:18.786953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-acc2fd0d-aee1-4d8f-8622-094d58ea33bd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:18.786953 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-acc2fd0d-aee1-4d8f-8622-094d58ea33bd tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.813356 Aug 23 18:07:18.787190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6105cfd1-a2fc-4067-b49d-790ea94c5bbf tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:18.787304 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1854/3630] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:17 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:18.787412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6105cfd1-a2fc-4067-b49d-790ea94c5bbf tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:18.799628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6105cfd1-a2fc-4067-b49d-790ea94c5bbf tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:18.811062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6105cfd1-a2fc-4067-b49d-790ea94c5bbf tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:18.811772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6105cfd1-a2fc-4067-b49d-790ea94c5bbf tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:18.815363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6105cfd1-a2fc-4067-b49d-790ea94c5bbf tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:18.815904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6105cfd1-a2fc-4067-b49d-790ea94c5bbf tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:18.816352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6105cfd1-a2fc-4067-b49d-790ea94c5bbf tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:18.953999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6105cfd1-a2fc-4067-b49d-790ea94c5bbf tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:18.964027 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6105cfd1-a2fc-4067-b49d-790ea94c5bbf tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1272 microversion: 2.1 time: 0.186492 Aug 23 18:07:18.969785 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1777/3631] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:18 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1272 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:19.800476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-664ad7fe-c19c-4172-9853-20027efe0982 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:19.801425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-664ad7fe-c19c-4172-9853-20027efe0982 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:19.808205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-60071723-05d0-4474-b72e-5f0a3868bd17 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:19.809529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-60071723-05d0-4474-b72e-5f0a3868bd17 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:19.825388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60071723-05d0-4474-b72e-5f0a3868bd17 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:19.826270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60071723-05d0-4474-b72e-5f0a3868bd17 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:19.826964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60071723-05d0-4474-b72e-5f0a3868bd17 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:19.827897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60071723-05d0-4474-b72e-5f0a3868bd17 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:19.828307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-664ad7fe-c19c-4172-9853-20027efe0982 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:19.828937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60071723-05d0-4474-b72e-5f0a3868bd17 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:19.829562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60071723-05d0-4474-b72e-5f0a3868bd17 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:19.831761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-664ad7fe-c19c-4172-9853-20027efe0982 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:19.832364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-664ad7fe-c19c-4172-9853-20027efe0982 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:19.833252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-664ad7fe-c19c-4172-9853-20027efe0982 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:19.833889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-664ad7fe-c19c-4172-9853-20027efe0982 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:19.837303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-664ad7fe-c19c-4172-9853-20027efe0982 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:21.009831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-664ad7fe-c19c-4172-9853-20027efe0982 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:21.018780 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-664ad7fe-c19c-4172-9853-20027efe0982 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 1.223135 Aug 23 18:07:21.019340 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1855/3632] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:19 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 1225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:21.025322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4fe2c478-65f2-48ec-b0da-8ee812737c6d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:21.026365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4fe2c478-65f2-48ec-b0da-8ee812737c6d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:21.041931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4fe2c478-65f2-48ec-b0da-8ee812737c6d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:21.042780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4fe2c478-65f2-48ec-b0da-8ee812737c6d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:21.043394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4fe2c478-65f2-48ec-b0da-8ee812737c6d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:21.044925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4fe2c478-65f2-48ec-b0da-8ee812737c6d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:21.046764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4fe2c478-65f2-48ec-b0da-8ee812737c6d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:21.047418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4fe2c478-65f2-48ec-b0da-8ee812737c6d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:21.106319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-60071723-05d0-4474-b72e-5f0a3868bd17 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:21.115952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-60071723-05d0-4474-b72e-5f0a3868bd17 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:21.117963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-60071723-05d0-4474-b72e-5f0a3868bd17 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:21.119399 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-60071723-05d0-4474-b72e-5f0a3868bd17 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 1.317347 Aug 23 18:07:21.120468 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1778/3633] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:19 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 1320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:07:21.126127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1501755279", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "eff190ee-6bd0-44c2-a8f1-02bb9034c43b"}], "security_groups": [{"name": "tempest-securitygroup--471360749"}], "key_name": "tempest-keypair-1928435785", "user_data": "}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:21.218277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4fe2c478-65f2-48ec-b0da-8ee812737c6d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:21.226684 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4fe2c478-65f2-48ec-b0da-8ee812737c6d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1314 microversion: 2.1 time: 0.205868 Aug 23 18:07:21.228039 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1856/3634] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:21 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:21.232033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4094c672-06c1-46fe-a355-0bebe55e8749 req-e4c9c8d4-7234-476a-a10f-69031c975592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc566e04-087f-4056-9c3d-bf0146a95db4", "tag": "1b3c8c48-9533-4e7b-890d-a36a8ffc7dc5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:21.244243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4094c672-06c1-46fe-a355-0bebe55e8749 req-e4c9c8d4-7234-476a-a10f-69031c975592 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:21.244726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4094c672-06c1-46fe-a355-0bebe55e8749 req-e4c9c8d4-7234-476a-a10f-69031c975592 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:21.245160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4094c672-06c1-46fe-a355-0bebe55e8749 req-e4c9c8d4-7234-476a-a10f-69031c975592 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:21.257320 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4094c672-06c1-46fe-a355-0bebe55e8749 req-e4c9c8d4-7234-476a-a10f-69031c975592 service nova] Creating event network-changed:1b3c8c48-9533-4e7b-890d-a36a8ffc7dc5 for instance bc566e04-087f-4056-9c3d-bf0146a95db4 on n-h2-850468-16 Aug 23 18:07:21.263099 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4094c672-06c1-46fe-a355-0bebe55e8749 req-e4c9c8d4-7234-476a-a10f-69031c975592 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034285 Aug 23 18:07:21.264266 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1857/3635] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:21.390441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] validate_networks() for [('eff190ee-6bd0-44c2-a8f1-02bb9034c43b', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:07:22.047566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-78c7dae7-f56a-4ac2-a142-8f9cf3e63816 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:22.048642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-78c7dae7-f56a-4ac2-a142-8f9cf3e63816 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:22.059168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78c7dae7-f56a-4ac2-a142-8f9cf3e63816 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:22.059664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78c7dae7-f56a-4ac2-a142-8f9cf3e63816 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:22.060102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78c7dae7-f56a-4ac2-a142-8f9cf3e63816 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:22.060843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78c7dae7-f56a-4ac2-a142-8f9cf3e63816 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:22.061297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78c7dae7-f56a-4ac2-a142-8f9cf3e63816 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:22.061718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78c7dae7-f56a-4ac2-a142-8f9cf3e63816 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:22.231482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-78c7dae7-f56a-4ac2-a142-8f9cf3e63816 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:22.241161 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-78c7dae7-f56a-4ac2-a142-8f9cf3e63816 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.202259 Aug 23 18:07:22.250664 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1858/3636] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:22 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:22.256954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0583a387-f10a-4030-bda9-113a76d0913b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:22.261195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0583a387-f10a-4030-bda9-113a76d0913b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:22.267682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0583a387-f10a-4030-bda9-113a76d0913b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:22.268706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0583a387-f10a-4030-bda9-113a76d0913b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:22.269390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0583a387-f10a-4030-bda9-113a76d0913b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:22.270593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0583a387-f10a-4030-bda9-113a76d0913b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:22.271318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0583a387-f10a-4030-bda9-113a76d0913b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:22.271970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0583a387-f10a-4030-bda9-113a76d0913b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:22.581744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:22.749587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:07:22.750276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:07:22.751007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:07:22.751590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:07:22.752197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:07:22.776537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:22.777042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:22.777494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:22.778247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:22.778762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:22.779234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:22.850522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Getting quotas for project abd08de41b7e42c29d3e4e7c97dc9f2a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:07:22.900730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:22.902157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Getting quotas for user 283c529ff2774efca184740ad6ccfdd5 and project abd08de41b7e42c29d3e4e7c97dc9f2a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:07:22.936716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:07:22.939722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:07:23.053826 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66a8623b-c14c-4084-b68c-5b2597b48fc7 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.931563 Aug 23 18:07:23.066856 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1779/3637] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:07:21 2022] POST /compute/v2.1/servers => generated 408 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:07:23.074583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e0a8b32c-0571-42da-aa3d-5a955bda9cb6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:23.086484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e0a8b32c-0571-42da-aa3d-5a955bda9cb6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:23.124876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0a8b32c-0571-42da-aa3d-5a955bda9cb6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:23.125295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0a8b32c-0571-42da-aa3d-5a955bda9cb6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:23.125746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0a8b32c-0571-42da-aa3d-5a955bda9cb6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:23.126466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0a8b32c-0571-42da-aa3d-5a955bda9cb6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:23.126957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0a8b32c-0571-42da-aa3d-5a955bda9cb6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:23.127391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0a8b32c-0571-42da-aa3d-5a955bda9cb6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:23.321377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0583a387-f10a-4030-bda9-113a76d0913b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:23.344518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0583a387-f10a-4030-bda9-113a76d0913b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:23.352945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0583a387-f10a-4030-bda9-113a76d0913b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:23.354912 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0583a387-f10a-4030-bda9-113a76d0913b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 1.103008 Aug 23 18:07:23.369530 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1859/3638] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:22 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:23.383663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "e85cff2f-9073-445b-a1cb-abf36ecbeeba"}], "security_groups": [{"name": "tempest-securitygroup--17602553"}], "key_name": "tempest-keypair-1053118384", "user_data": "}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:23.932230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] validate_networks() for [('e85cff2f-9073-445b-a1cb-abf36ecbeeba', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:07:23.970415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e0a8b32c-0571-42da-aa3d-5a955bda9cb6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:23.989855 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e0a8b32c-0571-42da-aa3d-5a955bda9cb6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1314 microversion: 2.1 time: 0.921726 Aug 23 18:07:23.995969 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1780/3639] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:23 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:24.014023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-334d63ec-ecfb-4eed-9a83-b49a4d06cb48 req-9c8e97f8-773a-4991-982e-05011fe5ced5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07d6db62-3d07-4a6d-8b0a-320ccdf38c9f", "tag": "bd1f63fe-cc46-467b-add7-f9ee6bd2ca42"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:24.054652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-334d63ec-ecfb-4eed-9a83-b49a4d06cb48 req-9c8e97f8-773a-4991-982e-05011fe5ced5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:24.055816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-334d63ec-ecfb-4eed-9a83-b49a4d06cb48 req-9c8e97f8-773a-4991-982e-05011fe5ced5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:24.056626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-334d63ec-ecfb-4eed-9a83-b49a4d06cb48 req-9c8e97f8-773a-4991-982e-05011fe5ced5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:24.076939 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-334d63ec-ecfb-4eed-9a83-b49a4d06cb48 req-9c8e97f8-773a-4991-982e-05011fe5ced5 service nova] Creating event network-changed:bd1f63fe-cc46-467b-add7-f9ee6bd2ca42 for instance 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f on n-h1-850468-16 Aug 23 18:07:24.088440 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-334d63ec-ecfb-4eed-9a83-b49a4d06cb48 req-9c8e97f8-773a-4991-982e-05011fe5ced5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088465 Aug 23 18:07:24.090350 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1781/3640] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:24.108886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-763ac514-2e40-4b76-8032-2e2cb91779f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:24.109724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-763ac514-2e40-4b76-8032-2e2cb91779f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:24.199776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:24.261586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-763ac514-2e40-4b76-8032-2e2cb91779f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:24.280686 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-763ac514-2e40-4b76-8032-2e2cb91779f4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1246 microversion: 2.1 time: 0.188419 Aug 23 18:07:24.281290 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1782/3641] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:24 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1246 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:24.285874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc744870-6b27-423f-9f21-948ce0ce8d1c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:24.286468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc744870-6b27-423f-9f21-948ce0ce8d1c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:24.302734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc744870-6b27-423f-9f21-948ce0ce8d1c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:24.303551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc744870-6b27-423f-9f21-948ce0ce8d1c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:24.304939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc744870-6b27-423f-9f21-948ce0ce8d1c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:24.305822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc744870-6b27-423f-9f21-948ce0ce8d1c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:24.306453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc744870-6b27-423f-9f21-948ce0ce8d1c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:24.307195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc744870-6b27-423f-9f21-948ce0ce8d1c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:24.604528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bc744870-6b27-423f-9f21-948ce0ce8d1c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:24.625487 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc744870-6b27-423f-9f21-948ce0ce8d1c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.343024 Aug 23 18:07:24.628304 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1783/3642] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:24 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:24.639950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b3ead090-80bd-48a9-8618-81989f6f23b7 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:24.647792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b3ead090-80bd-48a9-8618-81989f6f23b7 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:24.663088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ead090-80bd-48a9-8618-81989f6f23b7 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:24.668162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ead090-80bd-48a9-8618-81989f6f23b7 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:24.668912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ead090-80bd-48a9-8618-81989f6f23b7 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:24.676247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ead090-80bd-48a9-8618-81989f6f23b7 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:24.678144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ead090-80bd-48a9-8618-81989f6f23b7 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:24.680900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ead090-80bd-48a9-8618-81989f6f23b7 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:24.699548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:24.941839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:07:24.942669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:07:24.948612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:07:24.949118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:07:24.949559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:07:24.980902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:24.981653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:24.982065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:24.982860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:24.983322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:24.983965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:25.040184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b3ead090-80bd-48a9-8618-81989f6f23b7 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:25.051612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Getting quotas for project 2d4fff29f6fb4e4aa782d8b74a361d1a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:07:25.057972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b3ead090-80bd-48a9-8618-81989f6f23b7 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:25.063767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b3ead090-80bd-48a9-8618-81989f6f23b7 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:25.066867 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b3ead090-80bd-48a9-8618-81989f6f23b7 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.437232 Aug 23 18:07:25.070061 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1784/3643] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:24 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:25.081954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7a51d3ac-4488-4d96-92da-8650d7b6a0be tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:25.083456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Getting quotas for user 2d3bdd07adea4f508fdfa0189ec7a902 and project 2d4fff29f6fb4e4aa782d8b74a361d1a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:07:25.083619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7a51d3ac-4488-4d96-92da-8650d7b6a0be tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:25.099945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a51d3ac-4488-4d96-92da-8650d7b6a0be tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:25.102014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a51d3ac-4488-4d96-92da-8650d7b6a0be tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:25.105450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a51d3ac-4488-4d96-92da-8650d7b6a0be tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:25.108378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a51d3ac-4488-4d96-92da-8650d7b6a0be tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:25.109478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a51d3ac-4488-4d96-92da-8650d7b6a0be tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:25.110357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:25.111861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a51d3ac-4488-4d96-92da-8650d7b6a0be tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:25.159233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:07:25.161689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:07:25.275579 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef245c91-6b0a-4d5a-b27c-f4994f5703b6 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 1.904605 Aug 23 18:07:25.279739 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1860/3644] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:07:23 2022] POST /compute/v2.1/servers => generated 407 bytes in 1909 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:07:25.296010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ae41ed0-6556-41ed-9dbf-f4dfe7d68da3 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:25.301343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8ae41ed0-6556-41ed-9dbf-f4dfe7d68da3 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:25.421535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8ae41ed0-6556-41ed-9dbf-f4dfe7d68da3 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:25.438361 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8ae41ed0-6556-41ed-9dbf-f4dfe7d68da3 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1226 microversion: 2.1 time: 0.153723 Aug 23 18:07:25.443588 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1861/3645] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:25 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1226 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:25.449241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cafedcb0-3376-4fea-943f-1bce15da29ee tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:25.455889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cafedcb0-3376-4fea-943f-1bce15da29ee tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:25.461964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7a51d3ac-4488-4d96-92da-8650d7b6a0be tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:25.471887 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7a51d3ac-4488-4d96-92da-8650d7b6a0be tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1314 microversion: 2.1 time: 0.399929 Aug 23 18:07:25.473102 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1785/3646] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:25 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1314 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:25.484817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cafedcb0-3376-4fea-943f-1bce15da29ee tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:25.490584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cafedcb0-3376-4fea-943f-1bce15da29ee tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:25.491363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cafedcb0-3376-4fea-943f-1bce15da29ee tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:25.492651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cafedcb0-3376-4fea-943f-1bce15da29ee tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:25.493353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cafedcb0-3376-4fea-943f-1bce15da29ee tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:25.494046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cafedcb0-3376-4fea-943f-1bce15da29ee tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:25.612380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cafedcb0-3376-4fea-943f-1bce15da29ee tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:25.627287 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cafedcb0-3376-4fea-943f-1bce15da29ee tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1298 microversion: 2.1 time: 0.182418 Aug 23 18:07:25.628778 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1862/3647] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:25 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1298 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:25.652154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9533153c-f8ad-48b6-aaf4-c3b03cadaa07 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:25.653094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9533153c-f8ad-48b6-aaf4-c3b03cadaa07 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:25.661223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9533153c-f8ad-48b6-aaf4-c3b03cadaa07 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:25.662769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9533153c-f8ad-48b6-aaf4-c3b03cadaa07 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:25.664563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9533153c-f8ad-48b6-aaf4-c3b03cadaa07 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:25.667063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9533153c-f8ad-48b6-aaf4-c3b03cadaa07 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:25.668036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9533153c-f8ad-48b6-aaf4-c3b03cadaa07 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:25.668711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9533153c-f8ad-48b6-aaf4-c3b03cadaa07 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:25.939773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9533153c-f8ad-48b6-aaf4-c3b03cadaa07 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:25.950586 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9533153c-f8ad-48b6-aaf4-c3b03cadaa07 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.307014 Aug 23 18:07:25.951488 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1786/3648] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:25 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:26.108721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1f32097d-7395-4737-b500-1130fcb907be tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:26.112087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1f32097d-7395-4737-b500-1130fcb907be tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:26.122477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f32097d-7395-4737-b500-1130fcb907be tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:26.123356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f32097d-7395-4737-b500-1130fcb907be tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:26.124029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f32097d-7395-4737-b500-1130fcb907be tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:26.125588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f32097d-7395-4737-b500-1130fcb907be tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:26.126787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f32097d-7395-4737-b500-1130fcb907be tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:26.127562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f32097d-7395-4737-b500-1130fcb907be tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:26.475687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fcba64cb-4787-4467-b8af-5fba12f19f0c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:26.478777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fcba64cb-4787-4467-b8af-5fba12f19f0c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:26.505198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcba64cb-4787-4467-b8af-5fba12f19f0c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:26.510168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcba64cb-4787-4467-b8af-5fba12f19f0c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:26.512348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcba64cb-4787-4467-b8af-5fba12f19f0c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:26.521155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcba64cb-4787-4467-b8af-5fba12f19f0c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:26.522012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcba64cb-4787-4467-b8af-5fba12f19f0c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:26.525561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcba64cb-4787-4467-b8af-5fba12f19f0c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:26.698315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fcba64cb-4787-4467-b8af-5fba12f19f0c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:26.714325 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fcba64cb-4787-4467-b8af-5fba12f19f0c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1230 microversion: 2.1 time: 0.252784 Aug 23 18:07:26.714949 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1787/3649] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:26 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1230 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:26.741115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1f32097d-7395-4737-b500-1130fcb907be tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:26.758933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1f32097d-7395-4737-b500-1130fcb907be tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:26.763116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1f32097d-7395-4737-b500-1130fcb907be tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:26.765590 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1f32097d-7395-4737-b500-1130fcb907be tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.662973 Aug 23 18:07:26.767805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ccf092ea-3ff5-4d65-8927-a364584d1766 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:26.768742 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1863/3650] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:26 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:26.776668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ccf092ea-3ff5-4d65-8927-a364584d1766 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:26.790311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2781c3b5-f33d-46ce-9ea2-2f525a66d055 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:26.794339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2781c3b5-f33d-46ce-9ea2-2f525a66d055 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:26.807852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccf092ea-3ff5-4d65-8927-a364584d1766 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:26.809911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccf092ea-3ff5-4d65-8927-a364584d1766 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:26.810600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccf092ea-3ff5-4d65-8927-a364584d1766 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:26.814840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccf092ea-3ff5-4d65-8927-a364584d1766 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:26.815831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccf092ea-3ff5-4d65-8927-a364584d1766 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:26.819541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccf092ea-3ff5-4d65-8927-a364584d1766 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:26.821327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2781c3b5-f33d-46ce-9ea2-2f525a66d055 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:26.821841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2781c3b5-f33d-46ce-9ea2-2f525a66d055 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:26.828747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2781c3b5-f33d-46ce-9ea2-2f525a66d055 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:26.831471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2781c3b5-f33d-46ce-9ea2-2f525a66d055 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:26.832187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2781c3b5-f33d-46ce-9ea2-2f525a66d055 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:26.839264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2781c3b5-f33d-46ce-9ea2-2f525a66d055 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:27.026711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2781c3b5-f33d-46ce-9ea2-2f525a66d055 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:27.037855 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2781c3b5-f33d-46ce-9ea2-2f525a66d055 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1306 microversion: 2.1 time: 0.265234 Aug 23 18:07:27.040060 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1864/3651] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:26 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1306 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:27.047026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0a1f46eb-aae2-422e-abee-446f1f57730b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:27.047975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0a1f46eb-aae2-422e-abee-446f1f57730b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:27.056695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a1f46eb-aae2-422e-abee-446f1f57730b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:27.057871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a1f46eb-aae2-422e-abee-446f1f57730b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:27.058756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a1f46eb-aae2-422e-abee-446f1f57730b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:27.060396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a1f46eb-aae2-422e-abee-446f1f57730b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:27.061077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a1f46eb-aae2-422e-abee-446f1f57730b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:27.062104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a1f46eb-aae2-422e-abee-446f1f57730b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:27.420936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0a1f46eb-aae2-422e-abee-446f1f57730b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:27.437540 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0a1f46eb-aae2-422e-abee-446f1f57730b tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.393801 Aug 23 18:07:27.452619 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1865/3652] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:27 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:27.527387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ccf092ea-3ff5-4d65-8927-a364584d1766 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:27.557239 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ccf092ea-3ff5-4d65-8927-a364584d1766 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1314 microversion: 2.1 time: 0.834140 Aug 23 18:07:27.562739 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1788/3653] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:26 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1314 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:27.736801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-da310c15-f21c-4b52-9cc4-2806953120f2 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:27.738715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-da310c15-f21c-4b52-9cc4-2806953120f2 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:27.757850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da310c15-f21c-4b52-9cc4-2806953120f2 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:27.768396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da310c15-f21c-4b52-9cc4-2806953120f2 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:27.769931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da310c15-f21c-4b52-9cc4-2806953120f2 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:27.770751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da310c15-f21c-4b52-9cc4-2806953120f2 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:27.771227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da310c15-f21c-4b52-9cc4-2806953120f2 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:27.771658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da310c15-f21c-4b52-9cc4-2806953120f2 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:27.798987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-958c50be-bd3a-437f-8d93-8aaa42537d24 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:27.800512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-958c50be-bd3a-437f-8d93-8aaa42537d24 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:27.810711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-958c50be-bd3a-437f-8d93-8aaa42537d24 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:27.811505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-958c50be-bd3a-437f-8d93-8aaa42537d24 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:27.812196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-958c50be-bd3a-437f-8d93-8aaa42537d24 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:27.813123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-958c50be-bd3a-437f-8d93-8aaa42537d24 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:27.813774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-958c50be-bd3a-437f-8d93-8aaa42537d24 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:27.814374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-958c50be-bd3a-437f-8d93-8aaa42537d24 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:27.912752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-da310c15-f21c-4b52-9cc4-2806953120f2 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:27.960226 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-da310c15-f21c-4b52-9cc4-2806953120f2 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1278 microversion: 2.1 time: 0.227781 Aug 23 18:07:27.986972 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1866/3654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:27 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1278 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:28.061260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4440af5e-4a4e-4115-9cb3-b48c8905390b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:28.061879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4440af5e-4a4e-4115-9cb3-b48c8905390b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:28.077872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4440af5e-4a4e-4115-9cb3-b48c8905390b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:28.084120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4440af5e-4a4e-4115-9cb3-b48c8905390b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:28.101748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4440af5e-4a4e-4115-9cb3-b48c8905390b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:28.103753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4440af5e-4a4e-4115-9cb3-b48c8905390b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:28.104946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4440af5e-4a4e-4115-9cb3-b48c8905390b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:28.113251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4440af5e-4a4e-4115-9cb3-b48c8905390b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:28.277091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4440af5e-4a4e-4115-9cb3-b48c8905390b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:28.294639 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4440af5e-4a4e-4115-9cb3-b48c8905390b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1304 microversion: 2.1 time: 0.236805 Aug 23 18:07:28.296498 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1867/3655] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:28 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1304 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:28.464666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-958c50be-bd3a-437f-8d93-8aaa42537d24 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:28.469846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae5dd8a3-0bf3-41a5-999f-cb77a49ef3fa tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:28.471958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae5dd8a3-0bf3-41a5-999f-cb77a49ef3fa tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:28.480311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-958c50be-bd3a-437f-8d93-8aaa42537d24 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:28.483390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-958c50be-bd3a-437f-8d93-8aaa42537d24 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:28.484492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae5dd8a3-0bf3-41a5-999f-cb77a49ef3fa tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:28.485346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae5dd8a3-0bf3-41a5-999f-cb77a49ef3fa tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:28.487631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae5dd8a3-0bf3-41a5-999f-cb77a49ef3fa tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:28.487799 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-958c50be-bd3a-437f-8d93-8aaa42537d24 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.691190 Aug 23 18:07:28.488498 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1789/3656] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:27 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:28.489516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae5dd8a3-0bf3-41a5-999f-cb77a49ef3fa tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:28.490071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae5dd8a3-0bf3-41a5-999f-cb77a49ef3fa tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:28.490633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae5dd8a3-0bf3-41a5-999f-cb77a49ef3fa tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:28.593005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0ec4ba03-1ae9-4c48-ad38-edf549e7b1df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:28.595167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0ec4ba03-1ae9-4c48-ad38-edf549e7b1df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:28.602660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ec4ba03-1ae9-4c48-ad38-edf549e7b1df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:28.603530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ec4ba03-1ae9-4c48-ad38-edf549e7b1df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:28.605066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ec4ba03-1ae9-4c48-ad38-edf549e7b1df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:28.606190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ec4ba03-1ae9-4c48-ad38-edf549e7b1df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:28.606908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ec4ba03-1ae9-4c48-ad38-edf549e7b1df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:28.607565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ec4ba03-1ae9-4c48-ad38-edf549e7b1df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:28.654850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ae5dd8a3-0bf3-41a5-999f-cb77a49ef3fa tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:28.667074 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae5dd8a3-0bf3-41a5-999f-cb77a49ef3fa tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.206983 Aug 23 18:07:28.667849 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1868/3657] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:28 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:28.834071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0ec4ba03-1ae9-4c48-ad38-edf549e7b1df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:28.842880 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0ec4ba03-1ae9-4c48-ad38-edf549e7b1df tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1314 microversion: 2.1 time: 0.253912 Aug 23 18:07:28.843552 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1790/3658] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:28 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:28.998772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa972662-67f4-4242-920d-6d9e93f315e0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:29.000808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa972662-67f4-4242-920d-6d9e93f315e0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:29.013577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa972662-67f4-4242-920d-6d9e93f315e0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:29.016527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa972662-67f4-4242-920d-6d9e93f315e0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:29.017252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa972662-67f4-4242-920d-6d9e93f315e0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:29.018381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa972662-67f4-4242-920d-6d9e93f315e0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:29.019020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa972662-67f4-4242-920d-6d9e93f315e0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:29.019567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa972662-67f4-4242-920d-6d9e93f315e0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:29.098572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa972662-67f4-4242-920d-6d9e93f315e0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:29.108600 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa972662-67f4-4242-920d-6d9e93f315e0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1278 microversion: 2.1 time: 0.115008 Aug 23 18:07:29.110135 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1869/3659] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:28 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1278 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:29.111009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-602a4793-8fce-4b13-895a-a929d57726f1 req-dabb28c1-4551-4501-9c67-c4de0ce2ff2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-plugged", "status": "completed", "tag": "9c28fa0d-aebc-4d70-8e94-d3f630cc158d"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:29.127251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-602a4793-8fce-4b13-895a-a929d57726f1 req-dabb28c1-4551-4501-9c67-c4de0ce2ff2b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:29.128040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-602a4793-8fce-4b13-895a-a929d57726f1 req-dabb28c1-4551-4501-9c67-c4de0ce2ff2b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:29.128691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-602a4793-8fce-4b13-895a-a929d57726f1 req-dabb28c1-4551-4501-9c67-c4de0ce2ff2b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:29.154229 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-602a4793-8fce-4b13-895a-a929d57726f1 req-dabb28c1-4551-4501-9c67-c4de0ce2ff2b service nova] Creating event network-vif-plugged:9c28fa0d-aebc-4d70-8e94-d3f630cc158d for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:07:29.161338 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-602a4793-8fce-4b13-895a-a929d57726f1 req-dabb28c1-4551-4501-9c67-c4de0ce2ff2b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055656 Aug 23 18:07:29.162083 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1791/3660] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:07:29.317697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dddb5b29-5f79-4a51-850e-4550b8de647e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:29.318326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dddb5b29-5f79-4a51-850e-4550b8de647e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:29.328106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dddb5b29-5f79-4a51-850e-4550b8de647e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:29.328619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dddb5b29-5f79-4a51-850e-4550b8de647e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:29.329057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dddb5b29-5f79-4a51-850e-4550b8de647e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:29.329773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dddb5b29-5f79-4a51-850e-4550b8de647e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:29.331384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dddb5b29-5f79-4a51-850e-4550b8de647e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:29.333816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dddb5b29-5f79-4a51-850e-4550b8de647e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:29.486474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dddb5b29-5f79-4a51-850e-4550b8de647e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:29.497023 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dddb5b29-5f79-4a51-850e-4550b8de647e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.183396 Aug 23 18:07:29.519183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e53f04e-c855-438f-8de0-ae555b591fdb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:29.519966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4e53f04e-c855-438f-8de0-ae555b591fdb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:29.522735 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1870/3661] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:29 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:29.528834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e53f04e-c855-438f-8de0-ae555b591fdb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:29.529558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e53f04e-c855-438f-8de0-ae555b591fdb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:29.530231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e53f04e-c855-438f-8de0-ae555b591fdb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:29.531212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e53f04e-c855-438f-8de0-ae555b591fdb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:29.531767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e53f04e-c855-438f-8de0-ae555b591fdb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:29.532287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e53f04e-c855-438f-8de0-ae555b591fdb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:29.687099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5b7dcaca-0f79-4f7d-a06d-680f92b631ff tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:29.688059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5b7dcaca-0f79-4f7d-a06d-680f92b631ff tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:29.695425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b7dcaca-0f79-4f7d-a06d-680f92b631ff tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:29.696183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b7dcaca-0f79-4f7d-a06d-680f92b631ff tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:29.696804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b7dcaca-0f79-4f7d-a06d-680f92b631ff tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:29.697823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b7dcaca-0f79-4f7d-a06d-680f92b631ff tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:29.698450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b7dcaca-0f79-4f7d-a06d-680f92b631ff tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:29.700072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b7dcaca-0f79-4f7d-a06d-680f92b631ff tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:29.767807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e53f04e-c855-438f-8de0-ae555b591fdb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:29.784099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e53f04e-c855-438f-8de0-ae555b591fdb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:29.788140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e53f04e-c855-438f-8de0-ae555b591fdb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:29.789611 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e53f04e-c855-438f-8de0-ae555b591fdb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.275260 Aug 23 18:07:29.794434 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1792/3662] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:29 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:29.868406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d489f87-afdf-4826-b3ea-98bbb08623e6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:29.869425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2d489f87-afdf-4826-b3ea-98bbb08623e6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:29.878402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d489f87-afdf-4826-b3ea-98bbb08623e6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:29.879339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d489f87-afdf-4826-b3ea-98bbb08623e6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:29.879955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d489f87-afdf-4826-b3ea-98bbb08623e6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:29.880857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d489f87-afdf-4826-b3ea-98bbb08623e6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:29.881473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d489f87-afdf-4826-b3ea-98bbb08623e6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:29.882059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d489f87-afdf-4826-b3ea-98bbb08623e6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:29.900617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5b7dcaca-0f79-4f7d-a06d-680f92b631ff tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:29.909235 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5b7dcaca-0f79-4f7d-a06d-680f92b631ff tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.225923 Aug 23 18:07:29.910149 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1871/3663] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:29 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:30.067247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2d489f87-afdf-4826-b3ea-98bbb08623e6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:30.076867 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2d489f87-afdf-4826-b3ea-98bbb08623e6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1314 microversion: 2.1 time: 0.215998 Aug 23 18:07:30.077763 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1793/3664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:29 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:30.129391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-424ea622-c37d-44ba-971e-6a3a36eb8fbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:30.130016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-424ea622-c37d-44ba-971e-6a3a36eb8fbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:30.137007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-424ea622-c37d-44ba-971e-6a3a36eb8fbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:30.137507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-424ea622-c37d-44ba-971e-6a3a36eb8fbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:30.137954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-424ea622-c37d-44ba-971e-6a3a36eb8fbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:30.138693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-424ea622-c37d-44ba-971e-6a3a36eb8fbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:30.139153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-424ea622-c37d-44ba-971e-6a3a36eb8fbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:30.139584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-424ea622-c37d-44ba-971e-6a3a36eb8fbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:30.206422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-424ea622-c37d-44ba-971e-6a3a36eb8fbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:30.214660 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-424ea622-c37d-44ba-971e-6a3a36eb8fbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1278 microversion: 2.1 time: 0.089233 Aug 23 18:07:30.215244 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1872/3665] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:30 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:30.519908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-79a4c9b2-ead5-4e67-86a2-5c0d702cf8e2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:30.520816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-79a4c9b2-ead5-4e67-86a2-5c0d702cf8e2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:30.528625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79a4c9b2-ead5-4e67-86a2-5c0d702cf8e2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:30.529110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79a4c9b2-ead5-4e67-86a2-5c0d702cf8e2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:30.529540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79a4c9b2-ead5-4e67-86a2-5c0d702cf8e2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:30.530228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79a4c9b2-ead5-4e67-86a2-5c0d702cf8e2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:30.530707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79a4c9b2-ead5-4e67-86a2-5c0d702cf8e2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:30.532340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79a4c9b2-ead5-4e67-86a2-5c0d702cf8e2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:30.668584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-79a4c9b2-ead5-4e67-86a2-5c0d702cf8e2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:30.676510 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-79a4c9b2-ead5-4e67-86a2-5c0d702cf8e2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.160708 Aug 23 18:07:30.677087 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1794/3666] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:30 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:30.817394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-73465f51-3437-407c-a72e-8584f608171b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:30.818010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-73465f51-3437-407c-a72e-8584f608171b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:30.829878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73465f51-3437-407c-a72e-8584f608171b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:30.830376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73465f51-3437-407c-a72e-8584f608171b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:30.830857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73465f51-3437-407c-a72e-8584f608171b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:30.831728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73465f51-3437-407c-a72e-8584f608171b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:30.832562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73465f51-3437-407c-a72e-8584f608171b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:30.833365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73465f51-3437-407c-a72e-8584f608171b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:30.931892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec4b5ee1-a168-4a0e-a83f-c1003654139c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:30.932518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ec4b5ee1-a168-4a0e-a83f-c1003654139c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:30.939412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec4b5ee1-a168-4a0e-a83f-c1003654139c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:30.940476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec4b5ee1-a168-4a0e-a83f-c1003654139c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:30.941467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec4b5ee1-a168-4a0e-a83f-c1003654139c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:30.942471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec4b5ee1-a168-4a0e-a83f-c1003654139c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:30.943152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec4b5ee1-a168-4a0e-a83f-c1003654139c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:30.943778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec4b5ee1-a168-4a0e-a83f-c1003654139c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:31.035713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73465f51-3437-407c-a72e-8584f608171b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:31.040499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:31.047405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73465f51-3437-407c-a72e-8584f608171b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:31.048996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73465f51-3437-407c-a72e-8584f608171b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:31.050167 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-73465f51-3437-407c-a72e-8584f608171b tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.236775 Aug 23 18:07:31.050759 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1873/3667] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:30 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:31.099060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-df02c90b-b147-42a7-bc90-db389bd994e8 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:31.100240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-df02c90b-b147-42a7-bc90-db389bd994e8 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:31.103824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec4b5ee1-a168-4a0e-a83f-c1003654139c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:31.108573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df02c90b-b147-42a7-bc90-db389bd994e8 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:31.109329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df02c90b-b147-42a7-bc90-db389bd994e8 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:31.110028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df02c90b-b147-42a7-bc90-db389bd994e8 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:31.110960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df02c90b-b147-42a7-bc90-db389bd994e8 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:31.111663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df02c90b-b147-42a7-bc90-db389bd994e8 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:31.112281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df02c90b-b147-42a7-bc90-db389bd994e8 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:31.120108 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec4b5ee1-a168-4a0e-a83f-c1003654139c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.192996 Aug 23 18:07:31.123774 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1795/3668] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:30 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:31.182337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-fe9466ac-db6d-4717-97b9-8b00560f4b9f req-1585da92-f580-4282-998e-0872e148217a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-plugged", "status": "completed", "tag": "1eee6fec-aebe-4ef5-b406-7ef3e9925c14"}, {"server_uuid": "07d6db62-3d07-4a6d-8b0a-320ccdf38c9f", "name": "network-vif-plugged", "status": "completed", "tag": "bd1f63fe-cc46-467b-add7-f9ee6bd2ca42"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:31.193551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fe9466ac-db6d-4717-97b9-8b00560f4b9f req-1585da92-f580-4282-998e-0872e148217a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:31.194418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fe9466ac-db6d-4717-97b9-8b00560f4b9f req-1585da92-f580-4282-998e-0872e148217a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:31.195190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fe9466ac-db6d-4717-97b9-8b00560f4b9f req-1585da92-f580-4282-998e-0872e148217a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:31.213404 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-fe9466ac-db6d-4717-97b9-8b00560f4b9f req-1585da92-f580-4282-998e-0872e148217a service nova] Creating event network-vif-plugged:1eee6fec-aebe-4ef5-b406-7ef3e9925c14 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:07:31.214199 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-fe9466ac-db6d-4717-97b9-8b00560f4b9f req-1585da92-f580-4282-998e-0872e148217a service nova] Creating event network-vif-plugged:bd1f63fe-cc46-467b-add7-f9ee6bd2ca42 for instance 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f on n-h1-850468-16 Aug 23 18:07:31.229440 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-fe9466ac-db6d-4717-97b9-8b00560f4b9f req-1585da92-f580-4282-998e-0872e148217a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.050291 Aug 23 18:07:31.230653 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1796/3669] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:07:31.237960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0047f5f3-597c-416a-9d04-b2289bf96935 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:31.238838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0047f5f3-597c-416a-9d04-b2289bf96935 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:31.251675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0047f5f3-597c-416a-9d04-b2289bf96935 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:31.252870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0047f5f3-597c-416a-9d04-b2289bf96935 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:31.254896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0047f5f3-597c-416a-9d04-b2289bf96935 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:31.255655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0047f5f3-597c-416a-9d04-b2289bf96935 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:31.256136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0047f5f3-597c-416a-9d04-b2289bf96935 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:31.256659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0047f5f3-597c-416a-9d04-b2289bf96935 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:31.401311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-df02c90b-b147-42a7-bc90-db389bd994e8 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:31.415474 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-df02c90b-b147-42a7-bc90-db389bd994e8 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1314 microversion: 2.1 time: 0.320186 Aug 23 18:07:31.416399 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1874/3670] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:31 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:31.517262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0047f5f3-597c-416a-9d04-b2289bf96935 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:31.531844 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0047f5f3-597c-416a-9d04-b2289bf96935 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1286 microversion: 2.1 time: 0.298699 Aug 23 18:07:31.532919 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1797/3671] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:31 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1286 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:31.698225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d166e238-32cb-42cf-8049-8bd08963e492 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:31.699201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d166e238-32cb-42cf-8049-8bd08963e492 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:31.709795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d166e238-32cb-42cf-8049-8bd08963e492 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:31.710792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d166e238-32cb-42cf-8049-8bd08963e492 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:31.713044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d166e238-32cb-42cf-8049-8bd08963e492 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:31.713983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d166e238-32cb-42cf-8049-8bd08963e492 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:31.716341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d166e238-32cb-42cf-8049-8bd08963e492 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:31.716944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d166e238-32cb-42cf-8049-8bd08963e492 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:31.962365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d166e238-32cb-42cf-8049-8bd08963e492 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:31.986696 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d166e238-32cb-42cf-8049-8bd08963e492 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.289544 Aug 23 18:07:31.989046 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1875/3672] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:31 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:32.065040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-47eae54c-0249-4923-ab7e-69565cce13e4 req-2f440b15-05f0-4e02-bace-ecfaf047216f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0d2e07-d2d2-422d-a262-279197b79569", "tag": "014ffa42-ca3f-428d-888e-5c4fca13ce84"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:32.074266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fde3d32e-7d1e-4556-9402-e4eaa86d057e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:32.074854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fde3d32e-7d1e-4556-9402-e4eaa86d057e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:32.078012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-47eae54c-0249-4923-ab7e-69565cce13e4 req-2f440b15-05f0-4e02-bace-ecfaf047216f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:32.078801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-47eae54c-0249-4923-ab7e-69565cce13e4 req-2f440b15-05f0-4e02-bace-ecfaf047216f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:32.079630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-47eae54c-0249-4923-ab7e-69565cce13e4 req-2f440b15-05f0-4e02-bace-ecfaf047216f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:32.088151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fde3d32e-7d1e-4556-9402-e4eaa86d057e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:32.088651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fde3d32e-7d1e-4556-9402-e4eaa86d057e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:32.089090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fde3d32e-7d1e-4556-9402-e4eaa86d057e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:32.089800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fde3d32e-7d1e-4556-9402-e4eaa86d057e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:32.090255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fde3d32e-7d1e-4556-9402-e4eaa86d057e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:32.090965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fde3d32e-7d1e-4556-9402-e4eaa86d057e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:32.097461 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-47eae54c-0249-4923-ab7e-69565cce13e4 req-2f440b15-05f0-4e02-bace-ecfaf047216f service nova] Creating event network-changed:014ffa42-ca3f-428d-888e-5c4fca13ce84 for instance 8f0d2e07-d2d2-422d-a262-279197b79569 on n-h2-850468-16 Aug 23 18:07:32.106050 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-47eae54c-0249-4923-ab7e-69565cce13e4 req-2f440b15-05f0-4e02-bace-ecfaf047216f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045978 Aug 23 18:07:32.107230 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1798/3673] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:32.142647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-08e1633e-d26e-4af0-90ad-689dcacda760 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:32.144122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-08e1633e-d26e-4af0-90ad-689dcacda760 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:32.165776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08e1633e-d26e-4af0-90ad-689dcacda760 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:32.166564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08e1633e-d26e-4af0-90ad-689dcacda760 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:32.167238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08e1633e-d26e-4af0-90ad-689dcacda760 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:32.171210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08e1633e-d26e-4af0-90ad-689dcacda760 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:32.172084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08e1633e-d26e-4af0-90ad-689dcacda760 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:32.172504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08e1633e-d26e-4af0-90ad-689dcacda760 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:32.396578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-08e1633e-d26e-4af0-90ad-689dcacda760 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:32.399685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fde3d32e-7d1e-4556-9402-e4eaa86d057e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:32.407349 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-08e1633e-d26e-4af0-90ad-689dcacda760 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.269579 Aug 23 18:07:32.411917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fde3d32e-7d1e-4556-9402-e4eaa86d057e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:32.414169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fde3d32e-7d1e-4556-9402-e4eaa86d057e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:32.415478 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fde3d32e-7d1e-4556-9402-e4eaa86d057e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.345953 Aug 23 18:07:32.430565 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1799/3674] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:32 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:32.430919 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1876/3675] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:32 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:32.436788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-24d9740a-d497-427c-bb38-7d36206e1398 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:32.437746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-24d9740a-d497-427c-bb38-7d36206e1398 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:32.444033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24d9740a-d497-427c-bb38-7d36206e1398 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:32.444835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24d9740a-d497-427c-bb38-7d36206e1398 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:32.445493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24d9740a-d497-427c-bb38-7d36206e1398 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:32.446476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24d9740a-d497-427c-bb38-7d36206e1398 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:32.447271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24d9740a-d497-427c-bb38-7d36206e1398 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:32.447914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24d9740a-d497-427c-bb38-7d36206e1398 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:32.554777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fd29e11c-4dc2-48d1-97d8-e40ee5015e9c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:32.555406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fd29e11c-4dc2-48d1-97d8-e40ee5015e9c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:32.561805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd29e11c-4dc2-48d1-97d8-e40ee5015e9c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:32.562300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd29e11c-4dc2-48d1-97d8-e40ee5015e9c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:32.562766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd29e11c-4dc2-48d1-97d8-e40ee5015e9c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:32.563474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd29e11c-4dc2-48d1-97d8-e40ee5015e9c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:32.571715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd29e11c-4dc2-48d1-97d8-e40ee5015e9c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:32.572425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd29e11c-4dc2-48d1-97d8-e40ee5015e9c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:32.689586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-24d9740a-d497-427c-bb38-7d36206e1398 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:32.700263 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-24d9740a-d497-427c-bb38-7d36206e1398 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1314 microversion: 2.1 time: 0.267606 Aug 23 18:07:32.701508 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1800/3676] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:32 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:32.793394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fd29e11c-4dc2-48d1-97d8-e40ee5015e9c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:32.802856 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fd29e11c-4dc2-48d1-97d8-e40ee5015e9c tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1350 microversion: 2.1 time: 0.251942 Aug 23 18:07:32.803443 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1877/3677] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:32 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1350 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:33.010114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-381e5dbc-6e53-4892-8ef4-8c67a0af9464 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:33.010788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-381e5dbc-6e53-4892-8ef4-8c67a0af9464 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:33.013418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:33.019594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-381e5dbc-6e53-4892-8ef4-8c67a0af9464 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:33.020117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-381e5dbc-6e53-4892-8ef4-8c67a0af9464 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:33.020802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-381e5dbc-6e53-4892-8ef4-8c67a0af9464 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:33.021526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-381e5dbc-6e53-4892-8ef4-8c67a0af9464 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:33.021987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-381e5dbc-6e53-4892-8ef4-8c67a0af9464 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:33.022420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-381e5dbc-6e53-4892-8ef4-8c67a0af9464 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:33.181891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-381e5dbc-6e53-4892-8ef4-8c67a0af9464 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:33.189697 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-381e5dbc-6e53-4892-8ef4-8c67a0af9464 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.184253 Aug 23 18:07:33.190273 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1801/3678] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:33 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:33.245625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-82678869-8c04-48eb-b9c4-5e0dfa208446 req-4b8a40ba-b144-446c-812c-93a8ab5be0ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-plugged", "status": "completed", "tag": "a1a07c6e-8c7d-4734-a891-22a469b9c832"}, {"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-plugged", "status": "completed", "tag": "3a378893-dcd4-44a5-a7c5-f85909c867a9"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:33.257979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-82678869-8c04-48eb-b9c4-5e0dfa208446 req-4b8a40ba-b144-446c-812c-93a8ab5be0ae service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:33.258643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-82678869-8c04-48eb-b9c4-5e0dfa208446 req-4b8a40ba-b144-446c-812c-93a8ab5be0ae service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:33.259330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-82678869-8c04-48eb-b9c4-5e0dfa208446 req-4b8a40ba-b144-446c-812c-93a8ab5be0ae service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:33.277412 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-82678869-8c04-48eb-b9c4-5e0dfa208446 req-4b8a40ba-b144-446c-812c-93a8ab5be0ae service nova] Creating event network-vif-plugged:a1a07c6e-8c7d-4734-a891-22a469b9c832 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:07:33.279264 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-82678869-8c04-48eb-b9c4-5e0dfa208446 req-4b8a40ba-b144-446c-812c-93a8ab5be0ae service nova] Creating event network-vif-plugged:3a378893-dcd4-44a5-a7c5-f85909c867a9 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:07:33.286241 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-82678869-8c04-48eb-b9c4-5e0dfa208446 req-4b8a40ba-b144-446c-812c-93a8ab5be0ae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.044633 Aug 23 18:07:33.288360 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1878/3679] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:33.429496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2c29a1d7-94f1-4d91-b0f0-5f2a55ceeda7 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:33.429968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2c29a1d7-94f1-4d91-b0f0-5f2a55ceeda7 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:33.436121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c29a1d7-94f1-4d91-b0f0-5f2a55ceeda7 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:33.436627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c29a1d7-94f1-4d91-b0f0-5f2a55ceeda7 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:33.437066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c29a1d7-94f1-4d91-b0f0-5f2a55ceeda7 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:33.437903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c29a1d7-94f1-4d91-b0f0-5f2a55ceeda7 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:33.438361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c29a1d7-94f1-4d91-b0f0-5f2a55ceeda7 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:33.438808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c29a1d7-94f1-4d91-b0f0-5f2a55ceeda7 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:33.443319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7624fbc-7204-4f8c-b5d2-1f5231a56e0c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:33.444100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d7624fbc-7204-4f8c-b5d2-1f5231a56e0c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:33.450895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7624fbc-7204-4f8c-b5d2-1f5231a56e0c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:33.451388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7624fbc-7204-4f8c-b5d2-1f5231a56e0c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:33.451828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7624fbc-7204-4f8c-b5d2-1f5231a56e0c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:33.452525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7624fbc-7204-4f8c-b5d2-1f5231a56e0c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:33.453008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7624fbc-7204-4f8c-b5d2-1f5231a56e0c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:33.453580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7624fbc-7204-4f8c-b5d2-1f5231a56e0c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:33.608640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2c29a1d7-94f1-4d91-b0f0-5f2a55ceeda7 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:33.611100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:33.618605 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2c29a1d7-94f1-4d91-b0f0-5f2a55ceeda7 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.193137 Aug 23 18:07:33.630580 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1802/3680] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:33 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:33.675694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7624fbc-7204-4f8c-b5d2-1f5231a56e0c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:33.684998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7624fbc-7204-4f8c-b5d2-1f5231a56e0c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:33.686629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7624fbc-7204-4f8c-b5d2-1f5231a56e0c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:33.687802 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7624fbc-7204-4f8c-b5d2-1f5231a56e0c tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.248801 Aug 23 18:07:33.688379 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1879/3681] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:33 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:07:33.721434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d8d40ed8-c2d4-4e21-bbc6-b389ff6e03c5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:33.722134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d8d40ed8-c2d4-4e21-bbc6-b389ff6e03c5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:33.729317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8d40ed8-c2d4-4e21-bbc6-b389ff6e03c5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:33.729804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8d40ed8-c2d4-4e21-bbc6-b389ff6e03c5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:33.730243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8d40ed8-c2d4-4e21-bbc6-b389ff6e03c5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:33.730955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8d40ed8-c2d4-4e21-bbc6-b389ff6e03c5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:33.731408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8d40ed8-c2d4-4e21-bbc6-b389ff6e03c5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:33.731833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8d40ed8-c2d4-4e21-bbc6-b389ff6e03c5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:33.833194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d2f3392b-b325-40a7-90d9-e751c14ed008 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:33.833816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d2f3392b-b325-40a7-90d9-e751c14ed008 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:33.841440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2f3392b-b325-40a7-90d9-e751c14ed008 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:33.842208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2f3392b-b325-40a7-90d9-e751c14ed008 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:33.842872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2f3392b-b325-40a7-90d9-e751c14ed008 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:33.843591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2f3392b-b325-40a7-90d9-e751c14ed008 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:33.844062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2f3392b-b325-40a7-90d9-e751c14ed008 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:33.844487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2f3392b-b325-40a7-90d9-e751c14ed008 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:33.875157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d8d40ed8-c2d4-4e21-bbc6-b389ff6e03c5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:33.883840 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d8d40ed8-c2d4-4e21-bbc6-b389ff6e03c5 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1497 microversion: 2.1 time: 0.166247 Aug 23 18:07:33.884753 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1803/3682] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:33 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1497 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:33.988521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d2f3392b-b325-40a7-90d9-e751c14ed008 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:33.998791 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d2f3392b-b325-40a7-90d9-e751c14ed008 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1350 microversion: 2.1 time: 0.169105 Aug 23 18:07:33.999482 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1880/3683] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:33 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1350 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:34.216087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e732a93a-6726-484e-9761-f003f0020e60 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:34.217491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e732a93a-6726-484e-9761-f003f0020e60 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:34.231453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e732a93a-6726-484e-9761-f003f0020e60 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:34.231800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e732a93a-6726-484e-9761-f003f0020e60 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:34.232232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e732a93a-6726-484e-9761-f003f0020e60 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:34.233104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e732a93a-6726-484e-9761-f003f0020e60 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:34.233567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e732a93a-6726-484e-9761-f003f0020e60 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:34.233994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e732a93a-6726-484e-9761-f003f0020e60 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:34.267166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=28 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:34.420923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f52f2f5a-0c3a-4265-b01d-77c1666b9694 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:34.421435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f52f2f5a-0c3a-4265-b01d-77c1666b9694 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:34.430986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f52f2f5a-0c3a-4265-b01d-77c1666b9694 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:34.431666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f52f2f5a-0c3a-4265-b01d-77c1666b9694 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:34.432106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f52f2f5a-0c3a-4265-b01d-77c1666b9694 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:34.432873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f52f2f5a-0c3a-4265-b01d-77c1666b9694 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:34.433325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f52f2f5a-0c3a-4265-b01d-77c1666b9694 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:34.433953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f52f2f5a-0c3a-4265-b01d-77c1666b9694 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:34.464165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f52f2f5a-0c3a-4265-b01d-77c1666b9694 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:07:34.518671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e732a93a-6726-484e-9761-f003f0020e60 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:34.531882 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e732a93a-6726-484e-9761-f003f0020e60 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.322837 Aug 23 18:07:34.532512 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1804/3684] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:34 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:34.569170 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f52f2f5a-0c3a-4265-b01d-77c1666b9694 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "DELETE /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 204 len: 0 microversion: 2.1 time: 0.151880 Aug 23 18:07:34.574989 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1881/3685] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:07:34 2022] DELETE /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:07:34.581200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4ae963c8-4eb6-4f54-aa21-f4a089ceae38 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:34.582049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4ae963c8-4eb6-4f54-aa21-f4a089ceae38 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:34.588936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ae963c8-4eb6-4f54-aa21-f4a089ceae38 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:34.589704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ae963c8-4eb6-4f54-aa21-f4a089ceae38 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:34.590333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ae963c8-4eb6-4f54-aa21-f4a089ceae38 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:34.591481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ae963c8-4eb6-4f54-aa21-f4a089ceae38 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:34.592108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ae963c8-4eb6-4f54-aa21-f4a089ceae38 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:34.592705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ae963c8-4eb6-4f54-aa21-f4a089ceae38 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:34.641905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d8903c20-418d-4660-ad96-d69ee5fcd6d2 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:34.642529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d8903c20-418d-4660-ad96-d69ee5fcd6d2 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:34.649302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8903c20-418d-4660-ad96-d69ee5fcd6d2 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:34.650103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8903c20-418d-4660-ad96-d69ee5fcd6d2 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:34.651240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8903c20-418d-4660-ad96-d69ee5fcd6d2 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:34.652787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8903c20-418d-4660-ad96-d69ee5fcd6d2 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:34.653134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8903c20-418d-4660-ad96-d69ee5fcd6d2 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:34.653611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8903c20-418d-4660-ad96-d69ee5fcd6d2 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:34.852590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ae963c8-4eb6-4f54-aa21-f4a089ceae38 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:34.864157 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4ae963c8-4eb6-4f54-aa21-f4a089ceae38 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1503 microversion: 2.1 time: 0.287841 Aug 23 18:07:34.865683 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1805/3686] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:34 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1503 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:34.873143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6e83e17-a5a8-460f-9dda-7514368270e1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:34.874262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6e83e17-a5a8-460f-9dda-7514368270e1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:34.881684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6e83e17-a5a8-460f-9dda-7514368270e1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:34.883192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6e83e17-a5a8-460f-9dda-7514368270e1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:34.884261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6e83e17-a5a8-460f-9dda-7514368270e1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:34.885206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6e83e17-a5a8-460f-9dda-7514368270e1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:34.885870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6e83e17-a5a8-460f-9dda-7514368270e1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:34.886521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6e83e17-a5a8-460f-9dda-7514368270e1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:34.937507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d8903c20-418d-4660-ad96-d69ee5fcd6d2 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:34.947702 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d8903c20-418d-4660-ad96-d69ee5fcd6d2 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.310609 Aug 23 18:07:34.948713 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1882/3687] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:34 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:35.027045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4e84d02d-7773-4b71-843b-96fcb1ea9da8 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:35.027669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4e84d02d-7773-4b71-843b-96fcb1ea9da8 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:35.034106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:35.045419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e84d02d-7773-4b71-843b-96fcb1ea9da8 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:35.046133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e84d02d-7773-4b71-843b-96fcb1ea9da8 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:35.046813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e84d02d-7773-4b71-843b-96fcb1ea9da8 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:35.047758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e84d02d-7773-4b71-843b-96fcb1ea9da8 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:35.048384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e84d02d-7773-4b71-843b-96fcb1ea9da8 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:35.048983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e84d02d-7773-4b71-843b-96fcb1ea9da8 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:35.209024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f6e83e17-a5a8-460f-9dda-7514368270e1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:35.226809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f6e83e17-a5a8-460f-9dda-7514368270e1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:35.228503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f6e83e17-a5a8-460f-9dda-7514368270e1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:35.229834 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6e83e17-a5a8-460f-9dda-7514368270e1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.361368 Aug 23 18:07:35.230439 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1806/3688] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:34 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:35.241106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-d02f5af1-00f8-475b-85f4-5400a5b579cb req-bc9497e0-c9a9-410c-8277-a78e01b9eb5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8584cf-eace-4edc-af85-971d327a419d", "tag": "b6d3c76a-fa31-40bc-a8d0-0843167898dd"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:35.252342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d02f5af1-00f8-475b-85f4-5400a5b579cb req-bc9497e0-c9a9-410c-8277-a78e01b9eb5f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:35.253080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d02f5af1-00f8-475b-85f4-5400a5b579cb req-bc9497e0-c9a9-410c-8277-a78e01b9eb5f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:35.253681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d02f5af1-00f8-475b-85f4-5400a5b579cb req-bc9497e0-c9a9-410c-8277-a78e01b9eb5f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:35.270527 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-d02f5af1-00f8-475b-85f4-5400a5b579cb req-bc9497e0-c9a9-410c-8277-a78e01b9eb5f service nova] Creating event network-changed:b6d3c76a-fa31-40bc-a8d0-0843167898dd for instance 8c8584cf-eace-4edc-af85-971d327a419d on n-h2-850468-16 Aug 23 18:07:35.277929 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-d02f5af1-00f8-475b-85f4-5400a5b579cb req-bc9497e0-c9a9-410c-8277-a78e01b9eb5f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045986 Aug 23 18:07:35.278969 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1807/3689] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:35.347973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4e84d02d-7773-4b71-843b-96fcb1ea9da8 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:35.357726 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4e84d02d-7773-4b71-843b-96fcb1ea9da8 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1350 microversion: 2.1 time: 0.337306 Aug 23 18:07:35.358513 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1883/3690] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:35 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1350 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:35.556145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8e8263d5-6a88-4260-8f25-fbe3841d2aa0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:35.556977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8e8263d5-6a88-4260-8f25-fbe3841d2aa0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:35.563295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e8263d5-6a88-4260-8f25-fbe3841d2aa0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:35.563789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e8263d5-6a88-4260-8f25-fbe3841d2aa0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:35.564237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e8263d5-6a88-4260-8f25-fbe3841d2aa0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:35.564939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e8263d5-6a88-4260-8f25-fbe3841d2aa0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:35.565399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e8263d5-6a88-4260-8f25-fbe3841d2aa0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:35.565831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e8263d5-6a88-4260-8f25-fbe3841d2aa0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:35.710079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8e8263d5-6a88-4260-8f25-fbe3841d2aa0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:35.718135 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8e8263d5-6a88-4260-8f25-fbe3841d2aa0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.167321 Aug 23 18:07:35.718894 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1808/3691] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:35 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:35.886123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f40304d-42a3-49f7-a4da-63eaaf7385b6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:35.886769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0f40304d-42a3-49f7-a4da-63eaaf7385b6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:35.888615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:35.894628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f40304d-42a3-49f7-a4da-63eaaf7385b6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:35.895201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f40304d-42a3-49f7-a4da-63eaaf7385b6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:35.895642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f40304d-42a3-49f7-a4da-63eaaf7385b6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:35.896346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f40304d-42a3-49f7-a4da-63eaaf7385b6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:35.896814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f40304d-42a3-49f7-a4da-63eaaf7385b6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:35.897243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f40304d-42a3-49f7-a4da-63eaaf7385b6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:35.969268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-14e46d2a-0b0f-4947-95eb-3e29cd64dfdd tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:35.970310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-14e46d2a-0b0f-4947-95eb-3e29cd64dfdd tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:35.978310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14e46d2a-0b0f-4947-95eb-3e29cd64dfdd tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:35.979088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14e46d2a-0b0f-4947-95eb-3e29cd64dfdd tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:35.979695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14e46d2a-0b0f-4947-95eb-3e29cd64dfdd tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:35.981404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14e46d2a-0b0f-4947-95eb-3e29cd64dfdd tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:35.982419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14e46d2a-0b0f-4947-95eb-3e29cd64dfdd tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:35.983202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14e46d2a-0b0f-4947-95eb-3e29cd64dfdd tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:36.065837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0f40304d-42a3-49f7-a4da-63eaaf7385b6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:36.075216 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0f40304d-42a3-49f7-a4da-63eaaf7385b6 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1503 microversion: 2.1 time: 0.193660 Aug 23 18:07:36.075918 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1884/3692] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:35 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:36.193366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-14e46d2a-0b0f-4947-95eb-3e29cd64dfdd tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:36.205198 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-14e46d2a-0b0f-4947-95eb-3e29cd64dfdd tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.240445 Aug 23 18:07:36.206389 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1809/3693] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:35 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:36.254199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7137687-25bb-459c-9a35-d5c2345d11b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:36.255818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c7137687-25bb-459c-9a35-d5c2345d11b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:36.263104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7137687-25bb-459c-9a35-d5c2345d11b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:36.263898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7137687-25bb-459c-9a35-d5c2345d11b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:36.264561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7137687-25bb-459c-9a35-d5c2345d11b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:36.265619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7137687-25bb-459c-9a35-d5c2345d11b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:36.266285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7137687-25bb-459c-9a35-d5c2345d11b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:36.267020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7137687-25bb-459c-9a35-d5c2345d11b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:36.381836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-50896507-d5b1-4ce4-ae1e-b6653e455018 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:36.383312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-50896507-d5b1-4ce4-ae1e-b6653e455018 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:36.393419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-50896507-d5b1-4ce4-ae1e-b6653e455018 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:36.393916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-50896507-d5b1-4ce4-ae1e-b6653e455018 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:36.394354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-50896507-d5b1-4ce4-ae1e-b6653e455018 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:36.395096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-50896507-d5b1-4ce4-ae1e-b6653e455018 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:36.395548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-50896507-d5b1-4ce4-ae1e-b6653e455018 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:36.401911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-50896507-d5b1-4ce4-ae1e-b6653e455018 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:36.574873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c7137687-25bb-459c-9a35-d5c2345d11b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:36.594564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c7137687-25bb-459c-9a35-d5c2345d11b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:36.607127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c7137687-25bb-459c-9a35-d5c2345d11b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:36.608656 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c7137687-25bb-459c-9a35-d5c2345d11b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.358535 Aug 23 18:07:36.609732 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1885/3694] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:36 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:36.641639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-70f67720-b3b8-44ee-bc6f-577d411aab02 req-21294c26-c9d3-4d23-ad17-f2c42702ffe9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-plugged", "status": "completed", "tag": "6a403b9a-dd76-4743-b4c7-d8a95b097009"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:36.653233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-70f67720-b3b8-44ee-bc6f-577d411aab02 req-21294c26-c9d3-4d23-ad17-f2c42702ffe9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:36.653833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-70f67720-b3b8-44ee-bc6f-577d411aab02 req-21294c26-c9d3-4d23-ad17-f2c42702ffe9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:36.654339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-70f67720-b3b8-44ee-bc6f-577d411aab02 req-21294c26-c9d3-4d23-ad17-f2c42702ffe9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:36.668458 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-70f67720-b3b8-44ee-bc6f-577d411aab02 req-21294c26-c9d3-4d23-ad17-f2c42702ffe9 service nova] Creating event network-vif-plugged:6a403b9a-dd76-4743-b4c7-d8a95b097009 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:07:36.690423 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-70f67720-b3b8-44ee-bc6f-577d411aab02 req-21294c26-c9d3-4d23-ad17-f2c42702ffe9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079069 Aug 23 18:07:36.691840 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1886/3695] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:36.742136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d8a45671-26f1-4ad9-a895-6bbc7e5b1782 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:36.743630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d8a45671-26f1-4ad9-a895-6bbc7e5b1782 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:36.749239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-50896507-d5b1-4ce4-ae1e-b6653e455018 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:36.752910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8a45671-26f1-4ad9-a895-6bbc7e5b1782 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:36.757497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8a45671-26f1-4ad9-a895-6bbc7e5b1782 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:36.757768 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-50896507-d5b1-4ce4-ae1e-b6653e455018 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1350 microversion: 2.1 time: 0.379825 Aug 23 18:07:36.758787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8a45671-26f1-4ad9-a895-6bbc7e5b1782 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:36.759784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8a45671-26f1-4ad9-a895-6bbc7e5b1782 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:36.760543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8a45671-26f1-4ad9-a895-6bbc7e5b1782 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:36.761198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8a45671-26f1-4ad9-a895-6bbc7e5b1782 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:36.770933 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1810/3696] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:36 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1350 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:36.962368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d8a45671-26f1-4ad9-a895-6bbc7e5b1782 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:36.970796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-eec6f772-6d7d-40f4-85ad-d93fe36805bf req-010fde79-49a9-4c80-a24b-addae1f32988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07d6db62-3d07-4a6d-8b0a-320ccdf38c9f", "name": "network-vif-deleted", "tag": "bd1f63fe-cc46-467b-add7-f9ee6bd2ca42"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:36.991202 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d8a45671-26f1-4ad9-a895-6bbc7e5b1782 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.253642 Aug 23 18:07:37.008910 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1887/3697] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:36 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:37.011894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-eec6f772-6d7d-40f4-85ad-d93fe36805bf req-010fde79-49a9-4c80-a24b-addae1f32988 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:37.012377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-eec6f772-6d7d-40f4-85ad-d93fe36805bf req-010fde79-49a9-4c80-a24b-addae1f32988 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:37.012807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-eec6f772-6d7d-40f4-85ad-d93fe36805bf req-010fde79-49a9-4c80-a24b-addae1f32988 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:37.037129 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-eec6f772-6d7d-40f4-85ad-d93fe36805bf req-010fde79-49a9-4c80-a24b-addae1f32988 service nova] Creating event network-vif-deleted:bd1f63fe-cc46-467b-add7-f9ee6bd2ca42 for instance 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f on n-h1-850468-16 Aug 23 18:07:37.046728 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-eec6f772-6d7d-40f4-85ad-d93fe36805bf req-010fde79-49a9-4c80-a24b-addae1f32988 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081449 Aug 23 18:07:37.059015 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1811/3698] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:07:37.099511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:37.100266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:37.107934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:37.110037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:37.111084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:37.112066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:37.112577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:37.113158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:37.156885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:37.157867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:37.158320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:37.158835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lazy-loading 'fault' on Instance uuid 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:07:37.213286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3b3185ff033439a88ad2577ef0133a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea86d950d3924eec9e05e4b4cdb87c68', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:37.228286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8cb04291-dfb6-45e8-9fbc-af87699ae0e0 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:37.229253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8cb04291-dfb6-45e8-9fbc-af87699ae0e0 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:37.233001 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-83318210-aaeb-4a7c-87c0-ab9f209a606d tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 200 len: 1304 microversion: 2.1 time: 0.137480 Aug 23 18:07:37.233609 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1888/3699] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:37 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:37.238246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8cb04291-dfb6-45e8-9fbc-af87699ae0e0 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:37.238998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8cb04291-dfb6-45e8-9fbc-af87699ae0e0 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:37.250932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8cb04291-dfb6-45e8-9fbc-af87699ae0e0 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:37.252439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8cb04291-dfb6-45e8-9fbc-af87699ae0e0 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:37.253097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8cb04291-dfb6-45e8-9fbc-af87699ae0e0 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:37.253890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8cb04291-dfb6-45e8-9fbc-af87699ae0e0 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:37.421096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8cb04291-dfb6-45e8-9fbc-af87699ae0e0 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:37.430412 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8cb04291-dfb6-45e8-9fbc-af87699ae0e0 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.206998 Aug 23 18:07:37.431224 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1812/3700] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:37 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:37.641482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dba96bcd-da9a-4618-94a2-030c8dc996fb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:37.642493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dba96bcd-da9a-4618-94a2-030c8dc996fb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:37.652956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dba96bcd-da9a-4618-94a2-030c8dc996fb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:37.655646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dba96bcd-da9a-4618-94a2-030c8dc996fb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:37.657060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dba96bcd-da9a-4618-94a2-030c8dc996fb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:37.658462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dba96bcd-da9a-4618-94a2-030c8dc996fb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:37.659970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dba96bcd-da9a-4618-94a2-030c8dc996fb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:37.661820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dba96bcd-da9a-4618-94a2-030c8dc996fb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:37.781401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0f6eeb2f-88fe-4941-bb66-12e76b7639a9 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:37.782036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0f6eeb2f-88fe-4941-bb66-12e76b7639a9 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:37.789952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f6eeb2f-88fe-4941-bb66-12e76b7639a9 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:37.790447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f6eeb2f-88fe-4941-bb66-12e76b7639a9 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:37.790936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f6eeb2f-88fe-4941-bb66-12e76b7639a9 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:37.792027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f6eeb2f-88fe-4941-bb66-12e76b7639a9 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:37.792824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f6eeb2f-88fe-4941-bb66-12e76b7639a9 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:37.793260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f6eeb2f-88fe-4941-bb66-12e76b7639a9 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:37.986224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dba96bcd-da9a-4618-94a2-030c8dc996fb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:37.989351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:38.010795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dba96bcd-da9a-4618-94a2-030c8dc996fb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:38.013395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dba96bcd-da9a-4618-94a2-030c8dc996fb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:38.014897 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dba96bcd-da9a-4618-94a2-030c8dc996fb tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.379692 Aug 23 18:07:38.024074 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1889/3701] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:37 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:38.046357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f3030a1-d91d-4a3a-9bed-45b60eeb2c9e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:38.046971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5f3030a1-d91d-4a3a-9bed-45b60eeb2c9e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:38.053501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f3030a1-d91d-4a3a-9bed-45b60eeb2c9e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:38.054811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f3030a1-d91d-4a3a-9bed-45b60eeb2c9e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:38.055628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f3030a1-d91d-4a3a-9bed-45b60eeb2c9e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:38.056569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f3030a1-d91d-4a3a-9bed-45b60eeb2c9e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:38.057285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f3030a1-d91d-4a3a-9bed-45b60eeb2c9e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:38.057897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f3030a1-d91d-4a3a-9bed-45b60eeb2c9e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:38.227056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f3030a1-d91d-4a3a-9bed-45b60eeb2c9e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:38.235230 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5f3030a1-d91d-4a3a-9bed-45b60eeb2c9e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.193853 Aug 23 18:07:38.235808 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1890/3702] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:38 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:38.255575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a5511c6-d07e-46bc-8831-53e28bdf2aa1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:38.256488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8a5511c6-d07e-46bc-8831-53e28bdf2aa1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] [instance: 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:38.262955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5511c6-d07e-46bc-8831-53e28bdf2aa1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:38.263447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5511c6-d07e-46bc-8831-53e28bdf2aa1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:38.263894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5511c6-d07e-46bc-8831-53e28bdf2aa1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:38.264791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5511c6-d07e-46bc-8831-53e28bdf2aa1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:38.265252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5511c6-d07e-46bc-8831-53e28bdf2aa1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:38.265683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a5511c6-d07e-46bc-8831-53e28bdf2aa1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:38.280220 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8a5511c6-d07e-46bc-8831-53e28bdf2aa1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] HTTP exception thrown: Instance 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f could not be found. Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a5511c6-d07e-46bc-8831-53e28bdf2aa1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Request method failure captured: Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f HTTP/1.1 Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRclNbYdR0eFODJ_6gZi5VIHKSY2u-8E8H4hfA8f-ge1IIwhU6aO_l_8gEC7b_ACoeW3lcd7tothzaqaQWkey9DJn8-wfvsioChy6mzXu2MsGWn84L9MdITPx7Uv1wI4yGSo4YMSxRei9t5KgsSsZAGOGN9V2qoh8n-wg4_Gdpuogd0 Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ea86d950d3924eec9e05e4b4cdb87c68 Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-VolumesActionsTest-575634286 Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ea86d950d3924eec9e05e4b4cdb87c68"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea86d950d3924eec9e05e4b4cdb87c68"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ea86d950d3924eec9e05e4b4cdb87c68"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ea86d950d3924eec9e05e4b4cdb87c68"}]}] Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-VolumesActionsTest-575634286 Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ea86d950d3924eec9e05e4b4cdb87c68 Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-VolumesActionsTest-575634286 Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-VolumesActionsTest-575634286-project Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f3b3185ff033439a88ad2577ef0133a8 Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-VolumesActionsTest-575634286-project Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f could not be found. Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '07d6db62-3d07-4a6d-8b0a-320ccdf38c9f'} Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f could not be found. Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f could not be found. Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:07:38.281920 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:07:38.293866 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:07:38.293866 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:07:38.293866 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:07:38.293866 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:07:38.293866 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:07:38.293866 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f could not be found. Aug 23 18:07:38.293866 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:07:38.293866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a5511c6-d07e-46bc-8831-53e28bdf2aa1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] Returning 404 to user: Instance 07d6db62-3d07-4a6d-8b0a-320ccdf38c9f could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:07:38.293866 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8a5511c6-d07e-46bc-8831-53e28bdf2aa1 tempest-VolumesActionsTest-575634286 tempest-VolumesActionsTest-575634286-project] 10.222.0.61 "GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f" status: 404 len: 111 microversion: 2.1 time: 0.031698 Aug 23 18:07:38.293866 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1891/3703] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:38 2022] GET /compute/v2.1/servers/07d6db62-3d07-4a6d-8b0a-320ccdf38c9f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:07:38.300209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0f6eeb2f-88fe-4941-bb66-12e76b7639a9 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:38.308838 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0f6eeb2f-88fe-4941-bb66-12e76b7639a9 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1350 microversion: 2.1 time: 0.533073 Aug 23 18:07:38.309338 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1813/3704] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:37 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1350 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:38.452220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae1912c5-035a-4391-a5c0-eb92bf846457 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:38.453064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae1912c5-035a-4391-a5c0-eb92bf846457 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:38.459665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae1912c5-035a-4391-a5c0-eb92bf846457 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:38.461174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae1912c5-035a-4391-a5c0-eb92bf846457 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:38.461621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae1912c5-035a-4391-a5c0-eb92bf846457 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:38.462335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae1912c5-035a-4391-a5c0-eb92bf846457 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:38.462827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae1912c5-035a-4391-a5c0-eb92bf846457 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:38.463452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae1912c5-035a-4391-a5c0-eb92bf846457 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:38.647302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ae1912c5-035a-4391-a5c0-eb92bf846457 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:38.657144 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae1912c5-035a-4391-a5c0-eb92bf846457 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.209230 Aug 23 18:07:38.658123 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1892/3705] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:38 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:38.720670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-40a1d0a6-97e0-406c-a2b8-6f763bf44d25 req-5248bae2-bfb8-47b4-8b56-4f5317f3cca5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-plugged", "status": "completed", "tag": "766e8ecd-c0de-42b0-afc9-f573d08d79cc"}, {"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-plugged", "status": "completed", "tag": "5997e602-944a-4dfe-a4ef-1adf63e98362"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:38.730596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-40a1d0a6-97e0-406c-a2b8-6f763bf44d25 req-5248bae2-bfb8-47b4-8b56-4f5317f3cca5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:38.731049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-40a1d0a6-97e0-406c-a2b8-6f763bf44d25 req-5248bae2-bfb8-47b4-8b56-4f5317f3cca5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:38.731483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-40a1d0a6-97e0-406c-a2b8-6f763bf44d25 req-5248bae2-bfb8-47b4-8b56-4f5317f3cca5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:38.743762 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-40a1d0a6-97e0-406c-a2b8-6f763bf44d25 req-5248bae2-bfb8-47b4-8b56-4f5317f3cca5 service nova] Creating event network-vif-plugged:766e8ecd-c0de-42b0-afc9-f573d08d79cc for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:07:38.744282 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-40a1d0a6-97e0-406c-a2b8-6f763bf44d25 req-5248bae2-bfb8-47b4-8b56-4f5317f3cca5 service nova] Creating event network-vif-plugged:5997e602-944a-4dfe-a4ef-1adf63e98362 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:07:38.750034 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-40a1d0a6-97e0-406c-a2b8-6f763bf44d25 req-5248bae2-bfb8-47b4-8b56-4f5317f3cca5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032884 Aug 23 18:07:38.750514 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1814/3706] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:39.051676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-97fbee9e-94c4-4ba0-8231-366edede1254 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:39.053080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-97fbee9e-94c4-4ba0-8231-366edede1254 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:39.060131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97fbee9e-94c4-4ba0-8231-366edede1254 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:39.060621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97fbee9e-94c4-4ba0-8231-366edede1254 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:39.061077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97fbee9e-94c4-4ba0-8231-366edede1254 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:39.061769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97fbee9e-94c4-4ba0-8231-366edede1254 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:39.062229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97fbee9e-94c4-4ba0-8231-366edede1254 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:39.062709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97fbee9e-94c4-4ba0-8231-366edede1254 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:39.262076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-400fe974-5f6a-474a-8538-4a156b686a4d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:39.264247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-400fe974-5f6a-474a-8538-4a156b686a4d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:39.271848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-400fe974-5f6a-474a-8538-4a156b686a4d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:39.272338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-400fe974-5f6a-474a-8538-4a156b686a4d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:39.272803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97fbee9e-94c4-4ba0-8231-366edede1254 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:39.273636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-400fe974-5f6a-474a-8538-4a156b686a4d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:39.274365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-400fe974-5f6a-474a-8538-4a156b686a4d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:39.275037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-400fe974-5f6a-474a-8538-4a156b686a4d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:39.275681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-400fe974-5f6a-474a-8538-4a156b686a4d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:39.284899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97fbee9e-94c4-4ba0-8231-366edede1254 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:39.286865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97fbee9e-94c4-4ba0-8231-366edede1254 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:39.289282 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-97fbee9e-94c4-4ba0-8231-366edede1254 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.241963 Aug 23 18:07:39.290023 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1893/3707] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:39 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:07:39.334057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-642467dc-ce08-49eb-b5a9-3e165aa88785 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:39.335004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-642467dc-ce08-49eb-b5a9-3e165aa88785 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:39.343645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-642467dc-ce08-49eb-b5a9-3e165aa88785 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:39.344243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-642467dc-ce08-49eb-b5a9-3e165aa88785 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:39.344755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-642467dc-ce08-49eb-b5a9-3e165aa88785 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:39.345594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-642467dc-ce08-49eb-b5a9-3e165aa88785 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:39.346096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-642467dc-ce08-49eb-b5a9-3e165aa88785 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:39.346842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-642467dc-ce08-49eb-b5a9-3e165aa88785 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:39.496799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-642467dc-ce08-49eb-b5a9-3e165aa88785 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:39.504459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-400fe974-5f6a-474a-8538-4a156b686a4d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:39.506170 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-642467dc-ce08-49eb-b5a9-3e165aa88785 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1350 microversion: 2.1 time: 0.179581 Aug 23 18:07:39.508528 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1894/3708] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:39 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1350 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:39.514343 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-400fe974-5f6a-474a-8538-4a156b686a4d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.258703 Aug 23 18:07:39.516425 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1815/3709] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:39 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:07:39.683347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-87373a05-9321-420a-b61e-fd32b8a0eea6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:39.684065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-87373a05-9321-420a-b61e-fd32b8a0eea6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:39.690638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87373a05-9321-420a-b61e-fd32b8a0eea6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:39.691292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87373a05-9321-420a-b61e-fd32b8a0eea6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:39.691824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87373a05-9321-420a-b61e-fd32b8a0eea6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:39.692645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87373a05-9321-420a-b61e-fd32b8a0eea6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:39.693200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87373a05-9321-420a-b61e-fd32b8a0eea6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:39.693756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87373a05-9321-420a-b61e-fd32b8a0eea6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:39.880721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-87373a05-9321-420a-b61e-fd32b8a0eea6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:39.890687 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-87373a05-9321-420a-b61e-fd32b8a0eea6 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.212803 Aug 23 18:07:39.898652 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1895/3710] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:39 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:40.313402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66c29166-bdf6-4557-b4d6-03016b1a863a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:40.314020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66c29166-bdf6-4557-b4d6-03016b1a863a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:40.323266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c29166-bdf6-4557-b4d6-03016b1a863a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:40.323766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c29166-bdf6-4557-b4d6-03016b1a863a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:40.324205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c29166-bdf6-4557-b4d6-03016b1a863a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:40.327738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c29166-bdf6-4557-b4d6-03016b1a863a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:40.331135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c29166-bdf6-4557-b4d6-03016b1a863a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:40.331767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66c29166-bdf6-4557-b4d6-03016b1a863a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:40.529970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3f0539a7-257e-4121-955b-56d9b4d2a5f0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:40.530789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3f0539a7-257e-4121-955b-56d9b4d2a5f0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:40.565737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f0539a7-257e-4121-955b-56d9b4d2a5f0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:40.567819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f0539a7-257e-4121-955b-56d9b4d2a5f0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:40.571300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f0539a7-257e-4121-955b-56d9b4d2a5f0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:40.574810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f0539a7-257e-4121-955b-56d9b4d2a5f0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:40.575779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f0539a7-257e-4121-955b-56d9b4d2a5f0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:40.577719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f0539a7-257e-4121-955b-56d9b4d2a5f0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:40.846870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66c29166-bdf6-4557-b4d6-03016b1a863a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:40.871159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66c29166-bdf6-4557-b4d6-03016b1a863a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:40.876039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66c29166-bdf6-4557-b4d6-03016b1a863a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:40.879419 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66c29166-bdf6-4557-b4d6-03016b1a863a tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.569929 Aug 23 18:07:40.899817 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1816/3711] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:40 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:40.918286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6219a1ac-1569-452e-b36d-3ab64f5fc6ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:40.919476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6219a1ac-1569-452e-b36d-3ab64f5fc6ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:40.932332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6219a1ac-1569-452e-b36d-3ab64f5fc6ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:40.934085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6219a1ac-1569-452e-b36d-3ab64f5fc6ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:40.934784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6219a1ac-1569-452e-b36d-3ab64f5fc6ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:40.938997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6219a1ac-1569-452e-b36d-3ab64f5fc6ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:40.939680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6219a1ac-1569-452e-b36d-3ab64f5fc6ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:40.940317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6219a1ac-1569-452e-b36d-3ab64f5fc6ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:41.255199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6219a1ac-1569-452e-b36d-3ab64f5fc6ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:41.272976 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6219a1ac-1569-452e-b36d-3ab64f5fc6ce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.371109 Aug 23 18:07:41.275208 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1817/3712] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:40 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:41.282820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-6e797b74-c0be-47f2-b256-bc8784a3bd95 req-a3ec1215-c25f-4e2f-a4d5-8e8311a4fe8f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc566e04-087f-4056-9c3d-bf0146a95db4", "name": "network-vif-plugged", "status": "completed", "tag": "1b3c8c48-9533-4e7b-890d-a36a8ffc7dc5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:41.308153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6e797b74-c0be-47f2-b256-bc8784a3bd95 req-a3ec1215-c25f-4e2f-a4d5-8e8311a4fe8f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:41.309361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6e797b74-c0be-47f2-b256-bc8784a3bd95 req-a3ec1215-c25f-4e2f-a4d5-8e8311a4fe8f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:41.309976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6e797b74-c0be-47f2-b256-bc8784a3bd95 req-a3ec1215-c25f-4e2f-a4d5-8e8311a4fe8f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:41.311077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3f0539a7-257e-4121-955b-56d9b4d2a5f0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:41.332895 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3f0539a7-257e-4121-955b-56d9b4d2a5f0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1350 microversion: 2.1 time: 0.806969 Aug 23 18:07:41.348961 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-6e797b74-c0be-47f2-b256-bc8784a3bd95 req-a3ec1215-c25f-4e2f-a4d5-8e8311a4fe8f service nova] Creating event network-vif-plugged:1b3c8c48-9533-4e7b-890d-a36a8ffc7dc5 for instance bc566e04-087f-4056-9c3d-bf0146a95db4 on n-h2-850468-16 Aug 23 18:07:41.352866 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1896/3713] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:40 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1350 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:41.363872 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-6e797b74-c0be-47f2-b256-bc8784a3bd95 req-a3ec1215-c25f-4e2f-a4d5-8e8311a4fe8f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087086 Aug 23 18:07:41.365943 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1818/3714] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:41.389482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-813e10e4-0030-447e-93a2-b3e9d071582c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:41.391320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-813e10e4-0030-447e-93a2-b3e9d071582c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:41.404747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-813e10e4-0030-447e-93a2-b3e9d071582c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:41.405259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-813e10e4-0030-447e-93a2-b3e9d071582c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:41.405710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-813e10e4-0030-447e-93a2-b3e9d071582c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:41.406656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-813e10e4-0030-447e-93a2-b3e9d071582c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:41.407125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-813e10e4-0030-447e-93a2-b3e9d071582c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:41.407563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-813e10e4-0030-447e-93a2-b3e9d071582c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:41.742888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-813e10e4-0030-447e-93a2-b3e9d071582c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:41.757598 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-813e10e4-0030-447e-93a2-b3e9d071582c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.399340 Aug 23 18:07:41.759797 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1897/3715] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:41 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:41.924318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5616db2b-874b-4c7e-9206-37a8399e3e56 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:41.925326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5616db2b-874b-4c7e-9206-37a8399e3e56 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:41.932909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5616db2b-874b-4c7e-9206-37a8399e3e56 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:41.933710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5616db2b-874b-4c7e-9206-37a8399e3e56 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:41.934324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5616db2b-874b-4c7e-9206-37a8399e3e56 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:41.935255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5616db2b-874b-4c7e-9206-37a8399e3e56 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:41.935887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5616db2b-874b-4c7e-9206-37a8399e3e56 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:41.936506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5616db2b-874b-4c7e-9206-37a8399e3e56 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:42.212776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5616db2b-874b-4c7e-9206-37a8399e3e56 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:42.225042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5616db2b-874b-4c7e-9206-37a8399e3e56 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:42.226962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5616db2b-874b-4c7e-9206-37a8399e3e56 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:42.229195 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5616db2b-874b-4c7e-9206-37a8399e3e56 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1875 microversion: 2.32 time: 0.309222 Aug 23 18:07:42.230333 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1819/3716] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:41 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1875 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:42.301167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5499d442-60ae-444e-8f0e-b0d0623f6bbf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:42.302124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5499d442-60ae-444e-8f0e-b0d0623f6bbf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:42.312468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5499d442-60ae-444e-8f0e-b0d0623f6bbf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:42.313424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5499d442-60ae-444e-8f0e-b0d0623f6bbf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:42.314297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5499d442-60ae-444e-8f0e-b0d0623f6bbf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:42.315056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5499d442-60ae-444e-8f0e-b0d0623f6bbf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:42.315528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5499d442-60ae-444e-8f0e-b0d0623f6bbf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:42.315970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5499d442-60ae-444e-8f0e-b0d0623f6bbf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:42.360726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d45dc03c-1516-4bcc-ade3-83dd9285d2a1 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:42.362237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d45dc03c-1516-4bcc-ade3-83dd9285d2a1 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:42.369028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d45dc03c-1516-4bcc-ade3-83dd9285d2a1 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:42.369957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d45dc03c-1516-4bcc-ade3-83dd9285d2a1 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:42.374435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d45dc03c-1516-4bcc-ade3-83dd9285d2a1 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:42.375478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d45dc03c-1516-4bcc-ade3-83dd9285d2a1 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:42.376123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d45dc03c-1516-4bcc-ade3-83dd9285d2a1 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:42.376746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d45dc03c-1516-4bcc-ade3-83dd9285d2a1 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:42.654849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d45dc03c-1516-4bcc-ade3-83dd9285d2a1 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:42.673169 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d45dc03c-1516-4bcc-ade3-83dd9285d2a1 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1350 microversion: 2.1 time: 0.317166 Aug 23 18:07:42.687115 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1820/3717] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:42 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1350 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:42.687828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5499d442-60ae-444e-8f0e-b0d0623f6bbf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:42.687828 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5499d442-60ae-444e-8f0e-b0d0623f6bbf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.389573 Aug 23 18:07:42.689744 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1898/3718] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:42 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:42.779006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1f503ee-8f23-4e67-bd50-93b90de5d9f1 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:42.779684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d1f503ee-8f23-4e67-bd50-93b90de5d9f1 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:42.789206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f503ee-8f23-4e67-bd50-93b90de5d9f1 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:42.789748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f503ee-8f23-4e67-bd50-93b90de5d9f1 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:42.790192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f503ee-8f23-4e67-bd50-93b90de5d9f1 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:42.791921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f503ee-8f23-4e67-bd50-93b90de5d9f1 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:42.793231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f503ee-8f23-4e67-bd50-93b90de5d9f1 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:42.793734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f503ee-8f23-4e67-bd50-93b90de5d9f1 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:43.088467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d1f503ee-8f23-4e67-bd50-93b90de5d9f1 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:43.097801 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d1f503ee-8f23-4e67-bd50-93b90de5d9f1 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.322423 Aug 23 18:07:43.111660 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1821/3719] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:42 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:43.255974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-66542332-1075-4a24-96a4-22dc67459d12 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:43.257206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-66542332-1075-4a24-96a4-22dc67459d12 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:43.266689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66542332-1075-4a24-96a4-22dc67459d12 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:43.268939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66542332-1075-4a24-96a4-22dc67459d12 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:43.269563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66542332-1075-4a24-96a4-22dc67459d12 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:43.270480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66542332-1075-4a24-96a4-22dc67459d12 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:43.273787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66542332-1075-4a24-96a4-22dc67459d12 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:43.274265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66542332-1075-4a24-96a4-22dc67459d12 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:43.647890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-66542332-1075-4a24-96a4-22dc67459d12 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:43.663215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-66542332-1075-4a24-96a4-22dc67459d12 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:43.664751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-66542332-1075-4a24-96a4-22dc67459d12 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:43.666153 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-66542332-1075-4a24-96a4-22dc67459d12 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2824 microversion: 2.32 time: 0.414351 Aug 23 18:07:43.667661 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1899/3720] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:07:43 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2824 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:43.694936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8c1ec94e-0ec5-4e77-ba07-6f9d2b2ee782 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:43.696324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8c1ec94e-0ec5-4e77-ba07-6f9d2b2ee782 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:43.697489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8313c4ba-4697-44a3-8c16-7d024ea7bdbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:43.698392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8313c4ba-4697-44a3-8c16-7d024ea7bdbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:43.706736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8313c4ba-4697-44a3-8c16-7d024ea7bdbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:43.707542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8313c4ba-4697-44a3-8c16-7d024ea7bdbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:43.708443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8313c4ba-4697-44a3-8c16-7d024ea7bdbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:43.712802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8313c4ba-4697-44a3-8c16-7d024ea7bdbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:43.713678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8313c4ba-4697-44a3-8c16-7d024ea7bdbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:43.714341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8313c4ba-4697-44a3-8c16-7d024ea7bdbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:43.724431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c1ec94e-0ec5-4e77-ba07-6f9d2b2ee782 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:43.726803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c1ec94e-0ec5-4e77-ba07-6f9d2b2ee782 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:43.727263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c1ec94e-0ec5-4e77-ba07-6f9d2b2ee782 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:43.727997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c1ec94e-0ec5-4e77-ba07-6f9d2b2ee782 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:43.728460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c1ec94e-0ec5-4e77-ba07-6f9d2b2ee782 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:43.728889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c1ec94e-0ec5-4e77-ba07-6f9d2b2ee782 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:43.741863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:43.909452 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8c1ec94e-0ec5-4e77-ba07-6f9d2b2ee782 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.219598 Aug 23 18:07:43.911025 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1822/3721] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Aug 23 18:07:43 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e/os-interface => generated 1829 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:07:43.918788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b6b39122-1572-42b9-a118-d1251646e4f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:43.919703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b6b39122-1572-42b9-a118-d1251646e4f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:43.934656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6b39122-1572-42b9-a118-d1251646e4f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:43.935237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6b39122-1572-42b9-a118-d1251646e4f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:43.935678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6b39122-1572-42b9-a118-d1251646e4f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:43.936422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6b39122-1572-42b9-a118-d1251646e4f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:43.936882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6b39122-1572-42b9-a118-d1251646e4f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:43.937311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6b39122-1572-42b9-a118-d1251646e4f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:43.971180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8313c4ba-4697-44a3-8c16-7d024ea7bdbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:43.993230 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8313c4ba-4697-44a3-8c16-7d024ea7bdbe tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1350 microversion: 2.1 time: 0.291367 Aug 23 18:07:43.994571 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1900/3722] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:43 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1350 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:44.122725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7998b06-aee5-4110-945b-5117f7914466 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:44.123650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c7998b06-aee5-4110-945b-5117f7914466 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:44.136752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7998b06-aee5-4110-945b-5117f7914466 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:44.137201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7998b06-aee5-4110-945b-5117f7914466 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:44.138617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7998b06-aee5-4110-945b-5117f7914466 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:44.139698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7998b06-aee5-4110-945b-5117f7914466 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:44.141626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7998b06-aee5-4110-945b-5117f7914466 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:44.142479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7998b06-aee5-4110-945b-5117f7914466 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:44.435978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b6b39122-1572-42b9-a118-d1251646e4f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:44.445712 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b6b39122-1572-42b9-a118-d1251646e4f3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.533246 Aug 23 18:07:44.446319 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1823/3723] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:43 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:44.464316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c7998b06-aee5-4110-945b-5117f7914466 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:44.476259 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c7998b06-aee5-4110-945b-5117f7914466 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1371 microversion: 2.1 time: 0.360309 Aug 23 18:07:44.490199 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1901/3724] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:44 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1371 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:45.025710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c0dc30b5-570e-4f08-87bb-9c6bb4a801d5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:45.028787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c0dc30b5-570e-4f08-87bb-9c6bb4a801d5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:45.037078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:45.040020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0dc30b5-570e-4f08-87bb-9c6bb4a801d5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:45.040724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0dc30b5-570e-4f08-87bb-9c6bb4a801d5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:45.041627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0dc30b5-570e-4f08-87bb-9c6bb4a801d5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:45.042673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0dc30b5-570e-4f08-87bb-9c6bb4a801d5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:45.043307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0dc30b5-570e-4f08-87bb-9c6bb4a801d5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:45.044090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0dc30b5-570e-4f08-87bb-9c6bb4a801d5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:45.252830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c0dc30b5-570e-4f08-87bb-9c6bb4a801d5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:45.271089 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c0dc30b5-570e-4f08-87bb-9c6bb4a801d5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1350 microversion: 2.1 time: 0.245665 Aug 23 18:07:45.273542 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1824/3725] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:45 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1350 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:45.301302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4944987c-09d8-43e5-b97f-1e1fb2083c6e req-fe310c0d-9ac7-4e9d-90fc-42e8c7e9df7f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8584cf-eace-4edc-af85-971d327a419d", "name": "network-vif-plugged", "status": "completed", "tag": "b6d3c76a-fa31-40bc-a8d0-0843167898dd"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:45.330959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:45.336368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4944987c-09d8-43e5-b97f-1e1fb2083c6e req-fe310c0d-9ac7-4e9d-90fc-42e8c7e9df7f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:45.339488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4944987c-09d8-43e5-b97f-1e1fb2083c6e req-fe310c0d-9ac7-4e9d-90fc-42e8c7e9df7f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:45.339957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4944987c-09d8-43e5-b97f-1e1fb2083c6e req-fe310c0d-9ac7-4e9d-90fc-42e8c7e9df7f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:45.360604 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4944987c-09d8-43e5-b97f-1e1fb2083c6e req-fe310c0d-9ac7-4e9d-90fc-42e8c7e9df7f service nova] Creating event network-vif-plugged:b6d3c76a-fa31-40bc-a8d0-0843167898dd for instance 8c8584cf-eace-4edc-af85-971d327a419d on n-h2-850468-16 Aug 23 18:07:45.368516 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4944987c-09d8-43e5-b97f-1e1fb2083c6e req-fe310c0d-9ac7-4e9d-90fc-42e8c7e9df7f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070749 Aug 23 18:07:45.369166 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1902/3726] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:45.468439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-966cd5b7-a2a3-460b-b359-7becbbd8e1df tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:45.469471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-966cd5b7-a2a3-460b-b359-7becbbd8e1df tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:45.484905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-966cd5b7-a2a3-460b-b359-7becbbd8e1df tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:45.485962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-966cd5b7-a2a3-460b-b359-7becbbd8e1df tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:45.486871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-966cd5b7-a2a3-460b-b359-7becbbd8e1df tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:45.487995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-966cd5b7-a2a3-460b-b359-7becbbd8e1df tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:45.488872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-966cd5b7-a2a3-460b-b359-7becbbd8e1df tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:45.489537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-966cd5b7-a2a3-460b-b359-7becbbd8e1df tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:45.498852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8b783ce8-caf8-42d4-ba01-9e71a7b411bc tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:45.499592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8b783ce8-caf8-42d4-ba01-9e71a7b411bc tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:45.526505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b783ce8-caf8-42d4-ba01-9e71a7b411bc tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:45.526960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b783ce8-caf8-42d4-ba01-9e71a7b411bc tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:45.527414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b783ce8-caf8-42d4-ba01-9e71a7b411bc tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:45.528143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b783ce8-caf8-42d4-ba01-9e71a7b411bc tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:45.528623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b783ce8-caf8-42d4-ba01-9e71a7b411bc tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:45.541268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b783ce8-caf8-42d4-ba01-9e71a7b411bc tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:45.847439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8b783ce8-caf8-42d4-ba01-9e71a7b411bc tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:45.856741 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8b783ce8-caf8-42d4-ba01-9e71a7b411bc tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1556 microversion: 2.1 time: 0.362884 Aug 23 18:07:45.857410 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1903/3727] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:45 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1556 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:45.882217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ed81cc68-fbf6-40a1-a213-c0b12618fea5 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:45.882994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ed81cc68-fbf6-40a1-a213-c0b12618fea5 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:45.894188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed81cc68-fbf6-40a1-a213-c0b12618fea5 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:45.894481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed81cc68-fbf6-40a1-a213-c0b12618fea5 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:45.895025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed81cc68-fbf6-40a1-a213-c0b12618fea5 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:45.895748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed81cc68-fbf6-40a1-a213-c0b12618fea5 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:45.896214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed81cc68-fbf6-40a1-a213-c0b12618fea5 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:45.896667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed81cc68-fbf6-40a1-a213-c0b12618fea5 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:45.998336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-966cd5b7-a2a3-460b-b359-7becbbd8e1df tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:46.008707 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-966cd5b7-a2a3-460b-b359-7becbbd8e1df tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.545793 Aug 23 18:07:46.009623 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1825/3728] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:45 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:46.014467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-21350154-e7b8-4c7a-adf4-7f4ce5aa1403 req-bf5419a4-52a7-4cc0-bc46-e78b02c4fa75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "tag": "1eee6fec-aebe-4ef5-b406-7ef3e9925c14"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:46.041935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-21350154-e7b8-4c7a-adf4-7f4ce5aa1403 req-bf5419a4-52a7-4cc0-bc46-e78b02c4fa75 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:46.043858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-21350154-e7b8-4c7a-adf4-7f4ce5aa1403 req-bf5419a4-52a7-4cc0-bc46-e78b02c4fa75 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:46.046239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-21350154-e7b8-4c7a-adf4-7f4ce5aa1403 req-bf5419a4-52a7-4cc0-bc46-e78b02c4fa75 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:46.052731 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ed81cc68-fbf6-40a1-a213-c0b12618fea5 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.174531 Aug 23 18:07:46.054415 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1904/3729] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:07:45 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4/os-interface => generated 284 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:07:46.098484 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-21350154-e7b8-4c7a-adf4-7f4ce5aa1403 req-bf5419a4-52a7-4cc0-bc46-e78b02c4fa75 service nova] Creating event network-changed:1eee6fec-aebe-4ef5-b406-7ef3e9925c14 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:07:46.107414 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-21350154-e7b8-4c7a-adf4-7f4ce5aa1403 req-bf5419a4-52a7-4cc0-bc46-e78b02c4fa75 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096409 Aug 23 18:07:46.108036 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1826/3730] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:46.307320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d174386a-3b95-494c-9148-194a4a6ba3af tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:46.308157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d174386a-3b95-494c-9148-194a4a6ba3af tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:46.329844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d174386a-3b95-494c-9148-194a4a6ba3af tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:46.330771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d174386a-3b95-494c-9148-194a4a6ba3af tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:46.331410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d174386a-3b95-494c-9148-194a4a6ba3af tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:46.332311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d174386a-3b95-494c-9148-194a4a6ba3af tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:46.334054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d174386a-3b95-494c-9148-194a4a6ba3af tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:46.337311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d174386a-3b95-494c-9148-194a4a6ba3af tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:46.631539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d174386a-3b95-494c-9148-194a4a6ba3af tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:46.649999 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d174386a-3b95-494c-9148-194a4a6ba3af tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1350 microversion: 2.1 time: 0.359082 Aug 23 18:07:46.650633 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1905/3731] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:46 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1350 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:47.031064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dbe72c89-8fa8-4666-ab0b-c516a68c6d7f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:47.031930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dbe72c89-8fa8-4666-ab0b-c516a68c6d7f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:47.046932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbe72c89-8fa8-4666-ab0b-c516a68c6d7f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:47.048487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbe72c89-8fa8-4666-ab0b-c516a68c6d7f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:47.049320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbe72c89-8fa8-4666-ab0b-c516a68c6d7f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:47.050454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbe72c89-8fa8-4666-ab0b-c516a68c6d7f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:47.051941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbe72c89-8fa8-4666-ab0b-c516a68c6d7f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:47.052644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbe72c89-8fa8-4666-ab0b-c516a68c6d7f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:47.431113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4b227c57-a275-405c-b329-0fb15cfe970f req-e9813c1c-7e54-4f91-ad34-b498e46895e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f0d2e07-d2d2-422d-a262-279197b79569", "name": "network-vif-plugged", "status": "completed", "tag": "014ffa42-ca3f-428d-888e-5c4fca13ce84"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:47.473926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4b227c57-a275-405c-b329-0fb15cfe970f req-e9813c1c-7e54-4f91-ad34-b498e46895e0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:47.474467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4b227c57-a275-405c-b329-0fb15cfe970f req-e9813c1c-7e54-4f91-ad34-b498e46895e0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:47.474946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4b227c57-a275-405c-b329-0fb15cfe970f req-e9813c1c-7e54-4f91-ad34-b498e46895e0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:47.521690 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4b227c57-a275-405c-b329-0fb15cfe970f req-e9813c1c-7e54-4f91-ad34-b498e46895e0 service nova] Creating event network-vif-plugged:014ffa42-ca3f-428d-888e-5c4fca13ce84 for instance 8f0d2e07-d2d2-422d-a262-279197b79569 on n-h2-850468-16 Aug 23 18:07:47.551719 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4b227c57-a275-405c-b329-0fb15cfe970f req-e9813c1c-7e54-4f91-ad34-b498e46895e0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129430 Aug 23 18:07:47.552486 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1906/3732] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:47.575304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dbe72c89-8fa8-4666-ab0b-c516a68c6d7f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:47.589360 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dbe72c89-8fa8-4666-ab0b-c516a68c6d7f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.561822 Aug 23 18:07:47.594027 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1827/3733] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:47 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:47.673892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-76cdd46d-e4de-4fb6-8bc6-4aeb637f1492 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:47.674691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-76cdd46d-e4de-4fb6-8bc6-4aeb637f1492 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:47.691891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76cdd46d-e4de-4fb6-8bc6-4aeb637f1492 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:47.693134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76cdd46d-e4de-4fb6-8bc6-4aeb637f1492 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:47.698593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76cdd46d-e4de-4fb6-8bc6-4aeb637f1492 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:47.699505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76cdd46d-e4de-4fb6-8bc6-4aeb637f1492 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:47.700099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76cdd46d-e4de-4fb6-8bc6-4aeb637f1492 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:47.700637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76cdd46d-e4de-4fb6-8bc6-4aeb637f1492 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:48.115433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-76cdd46d-e4de-4fb6-8bc6-4aeb637f1492 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:48.127353 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-76cdd46d-e4de-4fb6-8bc6-4aeb637f1492 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1539 microversion: 2.1 time: 0.457726 Aug 23 18:07:48.128492 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1907/3734] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:47 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1539 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:48.154638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-482b006b-ef11-4c7d-9c8d-bac1d5d86551 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:48.155285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-482b006b-ef11-4c7d-9c8d-bac1d5d86551 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:48.188679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-482b006b-ef11-4c7d-9c8d-bac1d5d86551 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:48.189176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-482b006b-ef11-4c7d-9c8d-bac1d5d86551 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:48.189621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-482b006b-ef11-4c7d-9c8d-bac1d5d86551 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:48.190315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-482b006b-ef11-4c7d-9c8d-bac1d5d86551 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:48.190791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-482b006b-ef11-4c7d-9c8d-bac1d5d86551 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:48.191213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-482b006b-ef11-4c7d-9c8d-bac1d5d86551 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:48.400509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6a4a2c3f-7576-470f-b6e6-27f0166701fb req-c6f9677c-8e7c-4696-b112-6826bd463174 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc566e04-087f-4056-9c3d-bf0146a95db4", "tag": "1b3c8c48-9533-4e7b-890d-a36a8ffc7dc5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:48.450319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6a4a2c3f-7576-470f-b6e6-27f0166701fb req-c6f9677c-8e7c-4696-b112-6826bd463174 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:48.454585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6a4a2c3f-7576-470f-b6e6-27f0166701fb req-c6f9677c-8e7c-4696-b112-6826bd463174 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:48.456901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6a4a2c3f-7576-470f-b6e6-27f0166701fb req-c6f9677c-8e7c-4696-b112-6826bd463174 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:48.497697 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6a4a2c3f-7576-470f-b6e6-27f0166701fb req-c6f9677c-8e7c-4696-b112-6826bd463174 service nova] Creating event network-changed:1b3c8c48-9533-4e7b-890d-a36a8ffc7dc5 for instance bc566e04-087f-4056-9c3d-bf0146a95db4 on n-h2-850468-16 Aug 23 18:07:48.507475 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-482b006b-ef11-4c7d-9c8d-bac1d5d86551 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.357048 Aug 23 18:07:48.508773 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1828/3735] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:07:48 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d/os-interface => generated 284 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:48.512435 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6a4a2c3f-7576-470f-b6e6-27f0166701fb req-c6f9677c-8e7c-4696-b112-6826bd463174 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119901 Aug 23 18:07:48.516666 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1908/3736] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:07:48.619237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c7a0df33-0af3-41c2-af8a-3aa377692dac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:48.619849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7a0df33-0af3-41c2-af8a-3aa377692dac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:48.636956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7a0df33-0af3-41c2-af8a-3aa377692dac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:48.637492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7a0df33-0af3-41c2-af8a-3aa377692dac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:48.638438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7a0df33-0af3-41c2-af8a-3aa377692dac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:48.640853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7a0df33-0af3-41c2-af8a-3aa377692dac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:48.641342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7a0df33-0af3-41c2-af8a-3aa377692dac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:48.641782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7a0df33-0af3-41c2-af8a-3aa377692dac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:48.955971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c7a0df33-0af3-41c2-af8a-3aa377692dac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:48.965870 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c7a0df33-0af3-41c2-af8a-3aa377692dac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1371 microversion: 2.1 time: 0.352821 Aug 23 18:07:48.966465 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1829/3737] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:48 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1371 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:49.989313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f6a76a58-464f-4c24-8e05-884def7e222c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:49.990028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f6a76a58-464f-4c24-8e05-884def7e222c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:50.005221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6a76a58-464f-4c24-8e05-884def7e222c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:50.008288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6a76a58-464f-4c24-8e05-884def7e222c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:50.009280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6a76a58-464f-4c24-8e05-884def7e222c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:50.011646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6a76a58-464f-4c24-8e05-884def7e222c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:50.012318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6a76a58-464f-4c24-8e05-884def7e222c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:50.013301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6a76a58-464f-4c24-8e05-884def7e222c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:50.069764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:07:50.511133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f6a76a58-464f-4c24-8e05-884def7e222c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:07:50.541776 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f6a76a58-464f-4c24-8e05-884def7e222c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1564 microversion: 2.1 time: 0.555776 Aug 23 18:07:50.542767 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1909/3738] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:07:49 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1564 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:07:50.565695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-60cfcce6-d373-4283-9ad6-12f7228748f8 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:07:50.566956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-60cfcce6-d373-4283-9ad6-12f7228748f8 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:07:50.576996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60cfcce6-d373-4283-9ad6-12f7228748f8 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:50.577630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60cfcce6-d373-4283-9ad6-12f7228748f8 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:50.578162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60cfcce6-d373-4283-9ad6-12f7228748f8 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:50.579107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60cfcce6-d373-4283-9ad6-12f7228748f8 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:50.579946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60cfcce6-d373-4283-9ad6-12f7228748f8 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:50.580616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60cfcce6-d373-4283-9ad6-12f7228748f8 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:50.700238 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-60cfcce6-d373-4283-9ad6-12f7228748f8 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.138916 Aug 23 18:07:50.702670 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1830/3739] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:07:50 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:07:50.791548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-a1283360-5c75-4e5b-88e4-399aedb14315 req-03250c00-fc6a-4839-b047-acf0feff5eb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c8584cf-eace-4edc-af85-971d327a419d", "tag": "b6d3c76a-fa31-40bc-a8d0-0843167898dd"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:50.802558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a1283360-5c75-4e5b-88e4-399aedb14315 req-03250c00-fc6a-4839-b047-acf0feff5eb7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:50.803681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a1283360-5c75-4e5b-88e4-399aedb14315 req-03250c00-fc6a-4839-b047-acf0feff5eb7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:50.804571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a1283360-5c75-4e5b-88e4-399aedb14315 req-03250c00-fc6a-4839-b047-acf0feff5eb7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:50.821993 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-a1283360-5c75-4e5b-88e4-399aedb14315 req-03250c00-fc6a-4839-b047-acf0feff5eb7 service nova] Creating event network-changed:b6d3c76a-fa31-40bc-a8d0-0843167898dd for instance 8c8584cf-eace-4edc-af85-971d327a419d on n-h2-850468-16 Aug 23 18:07:50.841092 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-a1283360-5c75-4e5b-88e4-399aedb14315 req-03250c00-fc6a-4839-b047-acf0feff5eb7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047742 Aug 23 18:07:50.847668 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1910/3740] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:07:53.330939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-e80981e9-bb07-4ca5-91f0-54337aac46ad req-0d69aabb-1212-4caa-8d30-6b07c2e7c8bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0d2e07-d2d2-422d-a262-279197b79569", "tag": "014ffa42-ca3f-428d-888e-5c4fca13ce84"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:07:53.358149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e80981e9-bb07-4ca5-91f0-54337aac46ad req-0d69aabb-1212-4caa-8d30-6b07c2e7c8bc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:07:53.358978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e80981e9-bb07-4ca5-91f0-54337aac46ad req-0d69aabb-1212-4caa-8d30-6b07c2e7c8bc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:07:53.359592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e80981e9-bb07-4ca5-91f0-54337aac46ad req-0d69aabb-1212-4caa-8d30-6b07c2e7c8bc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:07:53.378138 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-e80981e9-bb07-4ca5-91f0-54337aac46ad req-0d69aabb-1212-4caa-8d30-6b07c2e7c8bc service nova] Creating event network-changed:014ffa42-ca3f-428d-888e-5c4fca13ce84 for instance 8f0d2e07-d2d2-422d-a262-279197b79569 on n-h2-850468-16 Aug 23 18:07:53.384264 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-e80981e9-bb07-4ca5-91f0-54337aac46ad req-0d69aabb-1212-4caa-8d30-6b07c2e7c8bc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058022 Aug 23 18:07:53.385238 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1831/3741] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:08:03.633825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=17 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:03.635212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=5 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:03.640977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d9f3305-f273-40ee-b604-b7f90104076e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:03.643968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8d9f3305-f273-40ee-b604-b7f90104076e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:03.654899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d9f3305-f273-40ee-b604-b7f90104076e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:03.656920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d9f3305-f273-40ee-b604-b7f90104076e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:03.657471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d9f3305-f273-40ee-b604-b7f90104076e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:03.658439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d9f3305-f273-40ee-b604-b7f90104076e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:03.659169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d9f3305-f273-40ee-b604-b7f90104076e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:03.659669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d9f3305-f273-40ee-b604-b7f90104076e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:03.821740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8d9f3305-f273-40ee-b604-b7f90104076e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:03.830600 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8d9f3305-f273-40ee-b604-b7f90104076e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.199737 Aug 23 18:08:03.831270 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1911/3742] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:03 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:03.853160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=15 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:03.854469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=45 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:03.859570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2dc0bdb3-43d7-4eab-a358-ad84e9a57ced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:03.860456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2dc0bdb3-43d7-4eab-a358-ad84e9a57ced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:03.869405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2dc0bdb3-43d7-4eab-a358-ad84e9a57ced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:03.869893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2dc0bdb3-43d7-4eab-a358-ad84e9a57ced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:03.870327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2dc0bdb3-43d7-4eab-a358-ad84e9a57ced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:03.871063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2dc0bdb3-43d7-4eab-a358-ad84e9a57ced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:03.871515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2dc0bdb3-43d7-4eab-a358-ad84e9a57ced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:03.871939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2dc0bdb3-43d7-4eab-a358-ad84e9a57ced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:04.029346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2dc0bdb3-43d7-4eab-a358-ad84e9a57ced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:04.041543 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2dc0bdb3-43d7-4eab-a358-ad84e9a57ced tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.191178 Aug 23 18:08:04.046276 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1832/3743] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:03 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:04.062398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f2beb0f-5d6e-40de-bfbd-1ee0c469bc5a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:04.062945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f2beb0f-5d6e-40de-bfbd-1ee0c469bc5a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:04.071434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f2beb0f-5d6e-40de-bfbd-1ee0c469bc5a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:04.071972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f2beb0f-5d6e-40de-bfbd-1ee0c469bc5a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:04.072565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f2beb0f-5d6e-40de-bfbd-1ee0c469bc5a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:04.073494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f2beb0f-5d6e-40de-bfbd-1ee0c469bc5a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:04.074149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f2beb0f-5d6e-40de-bfbd-1ee0c469bc5a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:04.074758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f2beb0f-5d6e-40de-bfbd-1ee0c469bc5a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:04.237441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f2beb0f-5d6e-40de-bfbd-1ee0c469bc5a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:04.248014 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f2beb0f-5d6e-40de-bfbd-1ee0c469bc5a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.189704 Aug 23 18:08:04.248596 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1912/3744] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:04 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:04.268468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb25cccc-4c8b-4ff2-b733-c7dfe3979ec4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:04.269266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eb25cccc-4c8b-4ff2-b733-c7dfe3979ec4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:04.277573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb25cccc-4c8b-4ff2-b733-c7dfe3979ec4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:04.278072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb25cccc-4c8b-4ff2-b733-c7dfe3979ec4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:04.278507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb25cccc-4c8b-4ff2-b733-c7dfe3979ec4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:04.279436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb25cccc-4c8b-4ff2-b733-c7dfe3979ec4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:04.279908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb25cccc-4c8b-4ff2-b733-c7dfe3979ec4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:04.280339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb25cccc-4c8b-4ff2-b733-c7dfe3979ec4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:04.432558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eb25cccc-4c8b-4ff2-b733-c7dfe3979ec4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:04.440762 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eb25cccc-4c8b-4ff2-b733-c7dfe3979ec4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.176401 Aug 23 18:08:04.441339 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1833/3745] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:04 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:04.571117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-250940332", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "ab5199d4-2532-451f-9ad2-38d9c898fa71"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:04.660271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] validate_networks() for [('ab5199d4-2532-451f-9ad2-38d9c898fa71', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:08:05.090683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:08:05.091104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:08:05.091803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:08:05.092285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:08:05.092771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:08:05.102866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:05.103636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:05.104138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:05.104940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:05.105472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:05.106080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:05.128832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Getting quotas for project ed54655c5a6442d680ee1cb81021ddd2. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:08:05.135548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Getting quotas for user 11cb3b659afa416bb3371795600189fb and project ed54655c5a6442d680ee1cb81021ddd2. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:08:05.150072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:08:05.152509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:08:05.218551 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cdbbe618-c0e5-45a6-a5d5-e014999175ba tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656708 Aug 23 18:08:05.219670 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1913/3746] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:08:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:08:05.231986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-36a4b106-44d0-4dc9-a0aa-78acffd2a2e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:05.233349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-36a4b106-44d0-4dc9-a0aa-78acffd2a2e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:05.298050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-36a4b106-44d0-4dc9-a0aa-78acffd2a2e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:05.307377 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-36a4b106-44d0-4dc9-a0aa-78acffd2a2e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1214 microversion: 2.1 time: 0.080618 Aug 23 18:08:05.309649 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1834/3747] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:05 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1214 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:06.338410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f18b9e9-8b25-4f97-bd1e-4e2b8637b43d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:06.341138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8f18b9e9-8b25-4f97-bd1e-4e2b8637b43d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:06.354192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f18b9e9-8b25-4f97-bd1e-4e2b8637b43d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:06.355121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f18b9e9-8b25-4f97-bd1e-4e2b8637b43d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:06.356003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f18b9e9-8b25-4f97-bd1e-4e2b8637b43d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:06.357105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f18b9e9-8b25-4f97-bd1e-4e2b8637b43d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:06.358321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f18b9e9-8b25-4f97-bd1e-4e2b8637b43d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:06.359267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f18b9e9-8b25-4f97-bd1e-4e2b8637b43d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:06.483173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8f18b9e9-8b25-4f97-bd1e-4e2b8637b43d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:06.496221 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f18b9e9-8b25-4f97-bd1e-4e2b8637b43d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1210 microversion: 2.1 time: 0.169726 Aug 23 18:08:06.501583 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1914/3748] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:06 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1210 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:07.530998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-255147f1-3a49-43de-99da-a005b90d4662 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:07.531899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-255147f1-3a49-43de-99da-a005b90d4662 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:07.543835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-255147f1-3a49-43de-99da-a005b90d4662 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:07.545059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-255147f1-3a49-43de-99da-a005b90d4662 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:07.545741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-255147f1-3a49-43de-99da-a005b90d4662 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:07.546734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-255147f1-3a49-43de-99da-a005b90d4662 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:07.547261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-255147f1-3a49-43de-99da-a005b90d4662 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:07.547910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-255147f1-3a49-43de-99da-a005b90d4662 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:07.703236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-255147f1-3a49-43de-99da-a005b90d4662 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:07.712456 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-255147f1-3a49-43de-99da-a005b90d4662 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1266 microversion: 2.1 time: 0.186016 Aug 23 18:08:07.713208 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1835/3749] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:07 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:08.739376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03ff0864-e731-4355-8add-e84a715bd357 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:08.754464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-03ff0864-e731-4355-8add-e84a715bd357 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:08.773801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03ff0864-e731-4355-8add-e84a715bd357 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:08.774368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03ff0864-e731-4355-8add-e84a715bd357 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:08.775093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03ff0864-e731-4355-8add-e84a715bd357 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:08.775829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03ff0864-e731-4355-8add-e84a715bd357 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:08.776293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03ff0864-e731-4355-8add-e84a715bd357 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:08.776727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03ff0864-e731-4355-8add-e84a715bd357 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:08.882180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-03ff0864-e731-4355-8add-e84a715bd357 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:08.895274 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-03ff0864-e731-4355-8add-e84a715bd357 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1272 microversion: 2.1 time: 0.162414 Aug 23 18:08:08.898557 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1915/3750] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:08 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1272 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:09.918825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4cd49e0c-bd6f-498f-aaba-641bc471da39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:09.920563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4cd49e0c-bd6f-498f-aaba-641bc471da39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:09.928915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd49e0c-bd6f-498f-aaba-641bc471da39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:09.929793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd49e0c-bd6f-498f-aaba-641bc471da39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:09.930605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd49e0c-bd6f-498f-aaba-641bc471da39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:09.931584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd49e0c-bd6f-498f-aaba-641bc471da39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:09.932265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd49e0c-bd6f-498f-aaba-641bc471da39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:09.932915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd49e0c-bd6f-498f-aaba-641bc471da39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:10.301640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4cd49e0c-bd6f-498f-aaba-641bc471da39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:10.312129 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4cd49e0c-bd6f-498f-aaba-641bc471da39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1314 microversion: 2.1 time: 0.396989 Aug 23 18:08:10.313198 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1836/3751] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:09 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:10.744930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-eaef8b83-cffc-49e2-92bc-c29aab3c8240 req-c40513cc-3d76-4a75-bd0b-8bdca2555e6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbc82eec-ccbf-40e5-aafb-d85a4945f473", "tag": "07a86c6c-d7ea-46ab-9df3-344686ec45fd"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:10.760570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eaef8b83-cffc-49e2-92bc-c29aab3c8240 req-c40513cc-3d76-4a75-bd0b-8bdca2555e6c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:10.761061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eaef8b83-cffc-49e2-92bc-c29aab3c8240 req-c40513cc-3d76-4a75-bd0b-8bdca2555e6c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:10.761512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eaef8b83-cffc-49e2-92bc-c29aab3c8240 req-c40513cc-3d76-4a75-bd0b-8bdca2555e6c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:10.780547 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-eaef8b83-cffc-49e2-92bc-c29aab3c8240 req-c40513cc-3d76-4a75-bd0b-8bdca2555e6c service nova] Creating event network-changed:07a86c6c-d7ea-46ab-9df3-344686ec45fd for instance fbc82eec-ccbf-40e5-aafb-d85a4945f473 on n-h1-850468-16 Aug 23 18:08:10.788588 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-eaef8b83-cffc-49e2-92bc-c29aab3c8240 req-c40513cc-3d76-4a75-bd0b-8bdca2555e6c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047926 Aug 23 18:08:10.789922 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1916/3752] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:08:11.333871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-caa92c85-9d99-48d6-bd56-e5d158a2fc43 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:11.334854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-caa92c85-9d99-48d6-bd56-e5d158a2fc43 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:11.343318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-caa92c85-9d99-48d6-bd56-e5d158a2fc43 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:11.346589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-caa92c85-9d99-48d6-bd56-e5d158a2fc43 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:11.347263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-caa92c85-9d99-48d6-bd56-e5d158a2fc43 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:11.348168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-caa92c85-9d99-48d6-bd56-e5d158a2fc43 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:11.348877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-caa92c85-9d99-48d6-bd56-e5d158a2fc43 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:11.349471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-caa92c85-9d99-48d6-bd56-e5d158a2fc43 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:11.619255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-caa92c85-9d99-48d6-bd56-e5d158a2fc43 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:11.632260 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-caa92c85-9d99-48d6-bd56-e5d158a2fc43 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1314 microversion: 2.1 time: 0.302429 Aug 23 18:08:11.633500 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1837/3753] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:11 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:12.656390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6c667b48-6939-45bc-8ba1-a11db2a5fee6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:12.657086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6c667b48-6939-45bc-8ba1-a11db2a5fee6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:12.666274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c667b48-6939-45bc-8ba1-a11db2a5fee6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:12.667073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c667b48-6939-45bc-8ba1-a11db2a5fee6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:12.667685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c667b48-6939-45bc-8ba1-a11db2a5fee6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:12.668926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c667b48-6939-45bc-8ba1-a11db2a5fee6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:12.669860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c667b48-6939-45bc-8ba1-a11db2a5fee6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:12.671224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c667b48-6939-45bc-8ba1-a11db2a5fee6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:12.860581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6c667b48-6939-45bc-8ba1-a11db2a5fee6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:12.869321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6c667b48-6939-45bc-8ba1-a11db2a5fee6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1314 microversion: 2.1 time: 0.218542 Aug 23 18:08:12.870188 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1917/3754] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:12 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:13.895107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3aee8b30-f8a4-4835-9199-5528cd526a44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:13.899375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3aee8b30-f8a4-4835-9199-5528cd526a44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:13.911489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aee8b30-f8a4-4835-9199-5528cd526a44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:13.912953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aee8b30-f8a4-4835-9199-5528cd526a44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:13.914107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aee8b30-f8a4-4835-9199-5528cd526a44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:13.915293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aee8b30-f8a4-4835-9199-5528cd526a44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:13.915758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aee8b30-f8a4-4835-9199-5528cd526a44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:13.916458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aee8b30-f8a4-4835-9199-5528cd526a44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:14.188296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3aee8b30-f8a4-4835-9199-5528cd526a44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:14.200650 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3aee8b30-f8a4-4835-9199-5528cd526a44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1314 microversion: 2.1 time: 0.313453 Aug 23 18:08:14.214888 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1838/3755] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:13 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:15.222525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-47210fc8-0b2a-4755-9894-88c4f18f58e5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:15.224299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-47210fc8-0b2a-4755-9894-88c4f18f58e5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:15.239643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:15.242418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:15.249985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47210fc8-0b2a-4755-9894-88c4f18f58e5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:15.251049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47210fc8-0b2a-4755-9894-88c4f18f58e5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:15.251728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47210fc8-0b2a-4755-9894-88c4f18f58e5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:15.254830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47210fc8-0b2a-4755-9894-88c4f18f58e5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:15.255556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47210fc8-0b2a-4755-9894-88c4f18f58e5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:15.257398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47210fc8-0b2a-4755-9894-88c4f18f58e5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:15.543393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-47210fc8-0b2a-4755-9894-88c4f18f58e5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:15.557630 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-47210fc8-0b2a-4755-9894-88c4f18f58e5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1314 microversion: 2.1 time: 0.339345 Aug 23 18:08:15.558857 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1918/3756] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:15 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:16.579976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d18128fd-469f-4731-b442-0833be79496b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:16.580733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d18128fd-469f-4731-b442-0833be79496b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:16.583513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:16.591316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d18128fd-469f-4731-b442-0833be79496b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:16.592302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d18128fd-469f-4731-b442-0833be79496b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:16.593054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d18128fd-469f-4731-b442-0833be79496b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:16.594024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d18128fd-469f-4731-b442-0833be79496b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:16.594794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d18128fd-469f-4731-b442-0833be79496b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:16.595474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d18128fd-469f-4731-b442-0833be79496b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:16.848740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d18128fd-469f-4731-b442-0833be79496b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:16.873490 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d18128fd-469f-4731-b442-0833be79496b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1314 microversion: 2.1 time: 0.297312 Aug 23 18:08:16.874708 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1839/3757] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:16 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:08:17.907463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7fcb8b95-34d0-45fa-958c-a82ed3158f1b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:17.908108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7fcb8b95-34d0-45fa-958c-a82ed3158f1b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:17.921707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fcb8b95-34d0-45fa-958c-a82ed3158f1b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:17.925547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fcb8b95-34d0-45fa-958c-a82ed3158f1b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:17.926052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fcb8b95-34d0-45fa-958c-a82ed3158f1b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:17.928441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fcb8b95-34d0-45fa-958c-a82ed3158f1b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:17.928441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fcb8b95-34d0-45fa-958c-a82ed3158f1b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:17.929418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fcb8b95-34d0-45fa-958c-a82ed3158f1b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:18.149384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-5aab67fc-e70b-49b4-a214-6947eac81781 req-cb377ff8-075f-428a-938b-41309ba5332e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc82eec-ccbf-40e5-aafb-d85a4945f473", "name": "network-vif-plugged", "status": "completed", "tag": "07a86c6c-d7ea-46ab-9df3-344686ec45fd"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:18.166326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5aab67fc-e70b-49b4-a214-6947eac81781 req-cb377ff8-075f-428a-938b-41309ba5332e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:18.167518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5aab67fc-e70b-49b4-a214-6947eac81781 req-cb377ff8-075f-428a-938b-41309ba5332e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:18.168742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5aab67fc-e70b-49b4-a214-6947eac81781 req-cb377ff8-075f-428a-938b-41309ba5332e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:18.188465 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5aab67fc-e70b-49b4-a214-6947eac81781 req-cb377ff8-075f-428a-938b-41309ba5332e service nova] Creating event network-vif-plugged:07a86c6c-d7ea-46ab-9df3-344686ec45fd for instance fbc82eec-ccbf-40e5-aafb-d85a4945f473 on n-h1-850468-16 Aug 23 18:08:18.198398 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-5aab67fc-e70b-49b4-a214-6947eac81781 req-cb377ff8-075f-428a-938b-41309ba5332e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053576 Aug 23 18:08:18.200320 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1840/3758] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:08:18.246642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7fcb8b95-34d0-45fa-958c-a82ed3158f1b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:18.280726 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7fcb8b95-34d0-45fa-958c-a82ed3158f1b tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1314 microversion: 2.1 time: 0.385349 Aug 23 18:08:18.283495 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1919/3759] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:17 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:19.309919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-01105299-2035-4599-a21b-f10e82fe9f6e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:19.311338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-01105299-2035-4599-a21b-f10e82fe9f6e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:19.321743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01105299-2035-4599-a21b-f10e82fe9f6e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:19.322276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01105299-2035-4599-a21b-f10e82fe9f6e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:19.322843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01105299-2035-4599-a21b-f10e82fe9f6e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:19.324317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01105299-2035-4599-a21b-f10e82fe9f6e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:19.325020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01105299-2035-4599-a21b-f10e82fe9f6e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:19.325709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01105299-2035-4599-a21b-f10e82fe9f6e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:19.502058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-01105299-2035-4599-a21b-f10e82fe9f6e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:19.512026 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-01105299-2035-4599-a21b-f10e82fe9f6e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1314 microversion: 2.1 time: 0.210683 Aug 23 18:08:19.512760 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1841/3760] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:19 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:20.533314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1da3bb08-3804-4ba2-9dee-c43575284fb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:20.533970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1da3bb08-3804-4ba2-9dee-c43575284fb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:20.541464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1da3bb08-3804-4ba2-9dee-c43575284fb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:20.541957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1da3bb08-3804-4ba2-9dee-c43575284fb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:20.542621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1da3bb08-3804-4ba2-9dee-c43575284fb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:20.543519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1da3bb08-3804-4ba2-9dee-c43575284fb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:20.544176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1da3bb08-3804-4ba2-9dee-c43575284fb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:20.544607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1da3bb08-3804-4ba2-9dee-c43575284fb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:20.692875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1da3bb08-3804-4ba2-9dee-c43575284fb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:20.701829 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1da3bb08-3804-4ba2-9dee-c43575284fb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1502 microversion: 2.1 time: 0.172515 Aug 23 18:08:20.702414 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1920/3761] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:20 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1502 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:20.723224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-565937ff-ee6a-46d9-b53e-d1ef309bb283 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:20.723792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-565937ff-ee6a-46d9-b53e-d1ef309bb283 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:20.730974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-565937ff-ee6a-46d9-b53e-d1ef309bb283 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:20.731467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-565937ff-ee6a-46d9-b53e-d1ef309bb283 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:20.732155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-565937ff-ee6a-46d9-b53e-d1ef309bb283 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:20.732863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-565937ff-ee6a-46d9-b53e-d1ef309bb283 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:20.733319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-565937ff-ee6a-46d9-b53e-d1ef309bb283 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:20.733745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-565937ff-ee6a-46d9-b53e-d1ef309bb283 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:20.901993 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.network.security_group_api [None req-565937ff-ee6a-46d9-b53e-d1ef309bb283 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Removing security group f5deab5e-b240-4fa8-91ab-cd839eb2b7df from port 07a86c6c-d7ea-46ab-9df3-344686ec45fd Aug 23 18:08:21.349094 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-565937ff-ee6a-46d9-b53e-d1ef309bb283 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473/action" status: 202 len: 0 microversion: 2.1 time: 0.629866 Aug 23 18:08:21.351935 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1842/3762] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:08:20 2022] POST /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473/action => generated 0 bytes in 633 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:08:21.362160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4eb75050-f9b3-4b85-bfd0-c606fd184596 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:21.366776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4eb75050-f9b3-4b85-bfd0-c606fd184596 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:21.381604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4eb75050-f9b3-4b85-bfd0-c606fd184596 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:21.393416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4eb75050-f9b3-4b85-bfd0-c606fd184596 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:21.402364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4eb75050-f9b3-4b85-bfd0-c606fd184596 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:21.403769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4eb75050-f9b3-4b85-bfd0-c606fd184596 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:21.404423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4eb75050-f9b3-4b85-bfd0-c606fd184596 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:21.405027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4eb75050-f9b3-4b85-bfd0-c606fd184596 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:21.425359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-31095f25-3745-4280-8640-75fbe2c4e9ac req-5225aec9-a34d-415a-91b0-5e905d999999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbc82eec-ccbf-40e5-aafb-d85a4945f473", "tag": "07a86c6c-d7ea-46ab-9df3-344686ec45fd"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:21.477690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-31095f25-3745-4280-8640-75fbe2c4e9ac req-5225aec9-a34d-415a-91b0-5e905d999999 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:21.478499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-31095f25-3745-4280-8640-75fbe2c4e9ac req-5225aec9-a34d-415a-91b0-5e905d999999 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:21.480022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-31095f25-3745-4280-8640-75fbe2c4e9ac req-5225aec9-a34d-415a-91b0-5e905d999999 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:21.499045 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-31095f25-3745-4280-8640-75fbe2c4e9ac req-5225aec9-a34d-415a-91b0-5e905d999999 service nova] Creating event network-changed:07a86c6c-d7ea-46ab-9df3-344686ec45fd for instance fbc82eec-ccbf-40e5-aafb-d85a4945f473 on n-h1-850468-16 Aug 23 18:08:21.511682 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-31095f25-3745-4280-8640-75fbe2c4e9ac req-5225aec9-a34d-415a-91b0-5e905d999999 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096950 Aug 23 18:08:21.513082 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1843/3763] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:08:21.805776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4eb75050-f9b3-4b85-bfd0-c606fd184596 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:21.815780 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4eb75050-f9b3-4b85-bfd0-c606fd184596 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1460 microversion: 2.1 time: 0.458655 Aug 23 18:08:21.816918 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1921/3764] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:21 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1460 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:21.839872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5cfb840b-c2fb-418c-bea1-54a95bba0718 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:21.841207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5cfb840b-c2fb-418c-bea1-54a95bba0718 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:21.848110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cfb840b-c2fb-418c-bea1-54a95bba0718 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:21.848980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cfb840b-c2fb-418c-bea1-54a95bba0718 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:21.850520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cfb840b-c2fb-418c-bea1-54a95bba0718 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:21.852294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cfb840b-c2fb-418c-bea1-54a95bba0718 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:21.853041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cfb840b-c2fb-418c-bea1-54a95bba0718 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:21.853903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cfb840b-c2fb-418c-bea1-54a95bba0718 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:22.063778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5cfb840b-c2fb-418c-bea1-54a95bba0718 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:22.076197 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5cfb840b-c2fb-418c-bea1-54a95bba0718 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.242554 Aug 23 18:08:22.076798 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1844/3765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:21 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:22.103482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-73abb613-566b-4f66-b8dd-821c5df1fefb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:22.104209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-73abb613-566b-4f66-b8dd-821c5df1fefb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:22.111261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73abb613-566b-4f66-b8dd-821c5df1fefb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:22.112336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73abb613-566b-4f66-b8dd-821c5df1fefb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:22.113062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73abb613-566b-4f66-b8dd-821c5df1fefb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:22.114161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73abb613-566b-4f66-b8dd-821c5df1fefb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:22.115781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73abb613-566b-4f66-b8dd-821c5df1fefb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:22.116490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73abb613-566b-4f66-b8dd-821c5df1fefb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:22.310817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73abb613-566b-4f66-b8dd-821c5df1fefb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:22.325029 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-73abb613-566b-4f66-b8dd-821c5df1fefb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.227757 Aug 23 18:08:22.340735 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1922/3766] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:22 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:22.347226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d6287d05-e060-4221-bb84-7d0f9b9572aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:22.348060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d6287d05-e060-4221-bb84-7d0f9b9572aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:22.360478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6287d05-e060-4221-bb84-7d0f9b9572aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:22.361251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6287d05-e060-4221-bb84-7d0f9b9572aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:22.361886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6287d05-e060-4221-bb84-7d0f9b9572aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:22.362946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6287d05-e060-4221-bb84-7d0f9b9572aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:22.363562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6287d05-e060-4221-bb84-7d0f9b9572aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:22.364150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6287d05-e060-4221-bb84-7d0f9b9572aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:22.545624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d6287d05-e060-4221-bb84-7d0f9b9572aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:22.554986 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d6287d05-e060-4221-bb84-7d0f9b9572aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.211913 Aug 23 18:08:22.555572 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1845/3767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:22 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:22.576944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f4034bb6-0d3e-4087-8720-1ef3686835b5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:22.577493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f4034bb6-0d3e-4087-8720-1ef3686835b5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:22.585010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4034bb6-0d3e-4087-8720-1ef3686835b5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:22.585789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4034bb6-0d3e-4087-8720-1ef3686835b5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:22.586244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4034bb6-0d3e-4087-8720-1ef3686835b5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:22.587999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4034bb6-0d3e-4087-8720-1ef3686835b5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:22.589986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4034bb6-0d3e-4087-8720-1ef3686835b5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:22.590898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4034bb6-0d3e-4087-8720-1ef3686835b5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:22.754692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f4034bb6-0d3e-4087-8720-1ef3686835b5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:22.765029 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f4034bb6-0d3e-4087-8720-1ef3686835b5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.192182 Aug 23 18:08:22.765733 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1923/3768] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:22 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:22.891663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-907393466", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "ab5199d4-2532-451f-9ad2-38d9c898fa71"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:22.963280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] validate_networks() for [('ab5199d4-2532-451f-9ad2-38d9c898fa71', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:08:23.513040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:08:23.513873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:08:23.514647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:08:23.515432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:08:23.516287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:08:23.552047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:23.553736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:23.557412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:23.558436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:23.559024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:23.559557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:23.580123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Getting quotas for project ed54655c5a6442d680ee1cb81021ddd2. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:08:23.585681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Getting quotas for user 11cb3b659afa416bb3371795600189fb and project ed54655c5a6442d680ee1cb81021ddd2. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:08:23.608110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:08:23.610512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:08:23.665402 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5b3e039c-0531-4a84-81b4-8b6ea43bc23e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.781280 Aug 23 18:08:23.671651 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1846/3769] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:08:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:08:23.676956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-50a8ee97-4526-4b6a-a056-2b8899a78ecb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:23.677831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-50a8ee97-4526-4b6a-a056-2b8899a78ecb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:23.745845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-50a8ee97-4526-4b6a-a056-2b8899a78ecb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:23.754483 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-50a8ee97-4526-4b6a-a056-2b8899a78ecb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1214 microversion: 2.1 time: 0.081519 Aug 23 18:08:23.755217 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1924/3770] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:23 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1214 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:24.776353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-05e4080a-28e5-420e-abb9-e2bb595a19e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:24.776966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-05e4080a-28e5-420e-abb9-e2bb595a19e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:24.785214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05e4080a-28e5-420e-abb9-e2bb595a19e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:24.785715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05e4080a-28e5-420e-abb9-e2bb595a19e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:24.786164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05e4080a-28e5-420e-abb9-e2bb595a19e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:24.787101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05e4080a-28e5-420e-abb9-e2bb595a19e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:24.787563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05e4080a-28e5-420e-abb9-e2bb595a19e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:24.787999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05e4080a-28e5-420e-abb9-e2bb595a19e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:24.855278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-05e4080a-28e5-420e-abb9-e2bb595a19e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:24.863243 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-05e4080a-28e5-420e-abb9-e2bb595a19e4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1266 microversion: 2.1 time: 0.091013 Aug 23 18:08:24.863821 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1847/3771] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:24 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:25.887496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-96828355-f447-4299-b99f-b5012fb2972f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:25.888653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-96828355-f447-4299-b99f-b5012fb2972f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:25.901565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96828355-f447-4299-b99f-b5012fb2972f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:25.902485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96828355-f447-4299-b99f-b5012fb2972f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:25.902958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96828355-f447-4299-b99f-b5012fb2972f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:25.903676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96828355-f447-4299-b99f-b5012fb2972f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:25.904195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96828355-f447-4299-b99f-b5012fb2972f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:25.904619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96828355-f447-4299-b99f-b5012fb2972f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:26.205329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-96828355-f447-4299-b99f-b5012fb2972f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:26.213959 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-96828355-f447-4299-b99f-b5012fb2972f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1314 microversion: 2.1 time: 0.331832 Aug 23 18:08:26.226609 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1925/3772] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:25 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:26.740250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-6a25df50-971a-4abb-b21e-2c340ad71148 req-05ec682c-ccd8-4d17-9f07-eba668590748 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "abd63f48-61c9-47c7-a848-14c894fd93b9", "tag": "df4503b0-060f-457c-8654-872684e34528"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:26.758135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6a25df50-971a-4abb-b21e-2c340ad71148 req-05ec682c-ccd8-4d17-9f07-eba668590748 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:26.758921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6a25df50-971a-4abb-b21e-2c340ad71148 req-05ec682c-ccd8-4d17-9f07-eba668590748 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:26.759555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6a25df50-971a-4abb-b21e-2c340ad71148 req-05ec682c-ccd8-4d17-9f07-eba668590748 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:26.773836 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-6a25df50-971a-4abb-b21e-2c340ad71148 req-05ec682c-ccd8-4d17-9f07-eba668590748 service nova] Creating event network-changed:df4503b0-060f-457c-8654-872684e34528 for instance abd63f48-61c9-47c7-a848-14c894fd93b9 on n-h2-850468-16 Aug 23 18:08:26.781560 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-6a25df50-971a-4abb-b21e-2c340ad71148 req-05ec682c-ccd8-4d17-9f07-eba668590748 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046049 Aug 23 18:08:26.782592 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1848/3773] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:08:27.240725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-557cc42a-0bd9-4355-88b9-75ba78e2b1ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:27.241346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-557cc42a-0bd9-4355-88b9-75ba78e2b1ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:27.259562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-557cc42a-0bd9-4355-88b9-75ba78e2b1ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:27.260065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-557cc42a-0bd9-4355-88b9-75ba78e2b1ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:27.260508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-557cc42a-0bd9-4355-88b9-75ba78e2b1ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:27.261225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-557cc42a-0bd9-4355-88b9-75ba78e2b1ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:27.261681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-557cc42a-0bd9-4355-88b9-75ba78e2b1ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:27.266579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-557cc42a-0bd9-4355-88b9-75ba78e2b1ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:27.449863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-557cc42a-0bd9-4355-88b9-75ba78e2b1ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:27.459523 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-557cc42a-0bd9-4355-88b9-75ba78e2b1ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1314 microversion: 2.1 time: 0.223735 Aug 23 18:08:27.460357 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1926/3774] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:27 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:28.483777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-19bf3ccc-66a8-4354-a99f-129974138d4e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:28.484696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-19bf3ccc-66a8-4354-a99f-129974138d4e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:28.492360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-19bf3ccc-66a8-4354-a99f-129974138d4e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:28.493318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-19bf3ccc-66a8-4354-a99f-129974138d4e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:28.493752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-19bf3ccc-66a8-4354-a99f-129974138d4e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:28.494658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-19bf3ccc-66a8-4354-a99f-129974138d4e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:28.495276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-19bf3ccc-66a8-4354-a99f-129974138d4e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:28.495865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-19bf3ccc-66a8-4354-a99f-129974138d4e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:28.670953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-19bf3ccc-66a8-4354-a99f-129974138d4e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:28.680379 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-19bf3ccc-66a8-4354-a99f-129974138d4e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1314 microversion: 2.1 time: 0.202549 Aug 23 18:08:28.695053 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1849/3775] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:28 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:29.702856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd5384b1-720d-4cad-869c-ec5cd5c9e3a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:29.703878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cd5384b1-720d-4cad-869c-ec5cd5c9e3a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:29.712983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd5384b1-720d-4cad-869c-ec5cd5c9e3a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:29.713554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd5384b1-720d-4cad-869c-ec5cd5c9e3a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:29.714518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd5384b1-720d-4cad-869c-ec5cd5c9e3a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:29.715322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd5384b1-720d-4cad-869c-ec5cd5c9e3a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:29.715322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd5384b1-720d-4cad-869c-ec5cd5c9e3a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:29.716005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd5384b1-720d-4cad-869c-ec5cd5c9e3a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:29.732422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7de875b0-0a91-433a-9494-6fb43c6ca7ac tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:29.743217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7de875b0-0a91-433a-9494-6fb43c6ca7ac tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:29.744507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7de875b0-0a91-433a-9494-6fb43c6ca7ac tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Searching by: {'deleted': False, 'project_id': '62607278cfa846a1b818bf8af91db1da'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:08:29.751335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7de875b0-0a91-433a-9494-6fb43c6ca7ac tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:29.752068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7de875b0-0a91-433a-9494-6fb43c6ca7ac tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:29.752675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7de875b0-0a91-433a-9494-6fb43c6ca7ac tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:29.753593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7de875b0-0a91-433a-9494-6fb43c6ca7ac tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:29.754354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7de875b0-0a91-433a-9494-6fb43c6ca7ac tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:29.754980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7de875b0-0a91-433a-9494-6fb43c6ca7ac tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:29.809402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-7de875b0-0a91-433a-9494-6fb43c6ca7ac tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:08:29.874318 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7de875b0-0a91-433a-9494-6fb43c6ca7ac tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 334 microversion: 2.1 time: 0.147723 Aug 23 18:08:29.874941 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1850/3776] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 18:08:29 2022] GET /compute/v2.1/servers => generated 334 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:08:29.899758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:29.911570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:29.912966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Searching by: {'deleted': False, 'project_id': '62607278cfa846a1b818bf8af91db1da'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:08:29.919406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:29.920224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:29.920593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:29.922534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:29.923640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:29.924585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:29.955494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cd5384b1-720d-4cad-869c-ec5cd5c9e3a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:29.966318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:08:29.966560 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd5384b1-720d-4cad-869c-ec5cd5c9e3a8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1314 microversion: 2.1 time: 0.268342 Aug 23 18:08:29.970571 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1927/3777] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:29 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1314 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:30.004222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:30.028601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:30.036021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:30.036984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:30.037592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:30.223500 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-74124376-8f28-449e-954d-b9d5f70d065f tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 1698 microversion: 2.1 time: 0.328326 Aug 23 18:08:30.228960 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1851/3778] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 18:08:29 2022] GET /compute/v2.1/servers/detail => generated 1698 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:30.247616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e796db4f-481a-443f-8d8d-9ff9c22ef522 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:30.258112 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e796db4f-481a-443f-8d8d-9ff9c22ef522 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015028 Aug 23 18:08:30.259208 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1928/3779] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 18:08:30 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:08:30.995423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aed8d4e6-084c-4be8-a793-cb84bddec4df tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:30.997410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aed8d4e6-084c-4be8-a793-cb84bddec4df tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:31.004873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aed8d4e6-084c-4be8-a793-cb84bddec4df tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:31.006075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aed8d4e6-084c-4be8-a793-cb84bddec4df tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:31.007524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aed8d4e6-084c-4be8-a793-cb84bddec4df tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:31.008489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aed8d4e6-084c-4be8-a793-cb84bddec4df tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:31.009014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aed8d4e6-084c-4be8-a793-cb84bddec4df tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:31.009755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aed8d4e6-084c-4be8-a793-cb84bddec4df tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:31.021793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9ec6b170-d575-4178-b835-d82b7424bea3 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:31.022725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9ec6b170-d575-4178-b835-d82b7424bea3 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:31.040965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ec6b170-d575-4178-b835-d82b7424bea3 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:31.041468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ec6b170-d575-4178-b835-d82b7424bea3 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:31.041974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ec6b170-d575-4178-b835-d82b7424bea3 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:31.042913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ec6b170-d575-4178-b835-d82b7424bea3 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:31.043479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ec6b170-d575-4178-b835-d82b7424bea3 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:31.043834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ec6b170-d575-4178-b835-d82b7424bea3 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:31.086367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9ec6b170-d575-4178-b835-d82b7424bea3 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:08:31.135694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:31.205661 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9ec6b170-d575-4178-b835-d82b7424bea3 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 204 len: 0 microversion: 2.1 time: 0.188059 Aug 23 18:08:31.209201 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1929/3780] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:08:31 2022] DELETE /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:08:31.227549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-88612548-e2b2-40e7-9f56-1d95a243c352 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:31.229435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-88612548-e2b2-40e7-9f56-1d95a243c352 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:31.243103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88612548-e2b2-40e7-9f56-1d95a243c352 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:31.243896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88612548-e2b2-40e7-9f56-1d95a243c352 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:31.245241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88612548-e2b2-40e7-9f56-1d95a243c352 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:31.246252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88612548-e2b2-40e7-9f56-1d95a243c352 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:31.247037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88612548-e2b2-40e7-9f56-1d95a243c352 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:31.247487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aed8d4e6-084c-4be8-a793-cb84bddec4df tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:31.247893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88612548-e2b2-40e7-9f56-1d95a243c352 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:31.265798 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aed8d4e6-084c-4be8-a793-cb84bddec4df tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1314 microversion: 2.1 time: 0.277802 Aug 23 18:08:31.266802 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1852/3781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:30 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:31.453617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-88612548-e2b2-40e7-9f56-1d95a243c352 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:31.477420 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-88612548-e2b2-40e7-9f56-1d95a243c352 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1701 microversion: 2.1 time: 0.262266 Aug 23 18:08:31.478440 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1930/3782] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:31 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1701 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:32.289993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-67ba44e4-9859-4ce7-86ba-7284c9f2be39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:32.291375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-67ba44e4-9859-4ce7-86ba-7284c9f2be39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:32.298456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67ba44e4-9859-4ce7-86ba-7284c9f2be39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:32.298996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67ba44e4-9859-4ce7-86ba-7284c9f2be39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:32.299439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67ba44e4-9859-4ce7-86ba-7284c9f2be39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:32.300141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67ba44e4-9859-4ce7-86ba-7284c9f2be39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:32.300595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67ba44e4-9859-4ce7-86ba-7284c9f2be39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:32.301047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67ba44e4-9859-4ce7-86ba-7284c9f2be39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:32.439353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-67ba44e4-9859-4ce7-86ba-7284c9f2be39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:32.447280 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-67ba44e4-9859-4ce7-86ba-7284c9f2be39 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1314 microversion: 2.1 time: 0.162091 Aug 23 18:08:32.447864 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1853/3783] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:32 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:32.501884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f4a8711e-6300-40cb-a659-634929a1e56e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:32.502733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f4a8711e-6300-40cb-a659-634929a1e56e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:32.510765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4a8711e-6300-40cb-a659-634929a1e56e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:32.511343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4a8711e-6300-40cb-a659-634929a1e56e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:32.511796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4a8711e-6300-40cb-a659-634929a1e56e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:32.512640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4a8711e-6300-40cb-a659-634929a1e56e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:32.513176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4a8711e-6300-40cb-a659-634929a1e56e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:32.513811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4a8711e-6300-40cb-a659-634929a1e56e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:32.666865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f4a8711e-6300-40cb-a659-634929a1e56e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:32.675883 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f4a8711e-6300-40cb-a659-634929a1e56e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1701 microversion: 2.1 time: 0.178180 Aug 23 18:08:32.676567 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1931/3784] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:32 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1701 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:33.469926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e5a81b05-d41b-4139-8e60-ff154e3411bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:33.470788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e5a81b05-d41b-4139-8e60-ff154e3411bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:33.485642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5a81b05-d41b-4139-8e60-ff154e3411bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:33.488982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5a81b05-d41b-4139-8e60-ff154e3411bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:33.489629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5a81b05-d41b-4139-8e60-ff154e3411bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:33.491233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5a81b05-d41b-4139-8e60-ff154e3411bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:33.492763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5a81b05-d41b-4139-8e60-ff154e3411bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:33.493659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5a81b05-d41b-4139-8e60-ff154e3411bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:33.701898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae802158-924f-4dc3-9a66-6b243e2bd36d tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:33.702826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae802158-924f-4dc3-9a66-6b243e2bd36d tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:33.706258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:33.722504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae802158-924f-4dc3-9a66-6b243e2bd36d tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:33.723616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae802158-924f-4dc3-9a66-6b243e2bd36d tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:33.724897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae802158-924f-4dc3-9a66-6b243e2bd36d tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:33.725947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae802158-924f-4dc3-9a66-6b243e2bd36d tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:33.726648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae802158-924f-4dc3-9a66-6b243e2bd36d tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:33.727674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae802158-924f-4dc3-9a66-6b243e2bd36d tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:33.764954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:33.845934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ae802158-924f-4dc3-9a66-6b243e2bd36d tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:33.856255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5a81b05-d41b-4139-8e60-ff154e3411bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:33.868026 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e5a81b05-d41b-4139-8e60-ff154e3411bd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1314 microversion: 2.1 time: 0.401197 Aug 23 18:08:33.872243 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae802158-924f-4dc3-9a66-6b243e2bd36d tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1633 microversion: 2.1 time: 0.176749 Aug 23 18:08:33.875614 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1854/3785] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:33 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1314 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:33.889785 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1932/3786] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:33 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1633 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:33.897863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-cabd9499-dd38-49cc-8713-1a8ab231acdb req-9d691d7d-8ca2-4d42-aad8-d93ff78901ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd63f48-61c9-47c7-a848-14c894fd93b9", "name": "network-vif-plugged", "status": "completed", "tag": "df4503b0-060f-457c-8654-872684e34528"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:33.924782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:33.929005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cabd9499-dd38-49cc-8713-1a8ab231acdb req-9d691d7d-8ca2-4d42-aad8-d93ff78901ee service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:33.930531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cabd9499-dd38-49cc-8713-1a8ab231acdb req-9d691d7d-8ca2-4d42-aad8-d93ff78901ee service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:33.932011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cabd9499-dd38-49cc-8713-1a8ab231acdb req-9d691d7d-8ca2-4d42-aad8-d93ff78901ee service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:33.955885 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-cabd9499-dd38-49cc-8713-1a8ab231acdb req-9d691d7d-8ca2-4d42-aad8-d93ff78901ee service nova] Creating event network-vif-plugged:df4503b0-060f-457c-8654-872684e34528 for instance abd63f48-61c9-47c7-a848-14c894fd93b9 on n-h2-850468-16 Aug 23 18:08:33.962288 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-cabd9499-dd38-49cc-8713-1a8ab231acdb req-9d691d7d-8ca2-4d42-aad8-d93ff78901ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084500 Aug 23 18:08:33.963397 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1855/3787] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:08:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:08:34.678355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c8a62a82-0e0f-48d5-bd09-b8f79e50bc9b req-3dd40f00-f675-4574-9cc2-07a47b600d82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb", "name": "network-vif-deleted", "tag": "25acea94-b112-429c-a10e-d1e3da5a4dbc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:34.688931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c8a62a82-0e0f-48d5-bd09-b8f79e50bc9b req-3dd40f00-f675-4574-9cc2-07a47b600d82 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:34.689627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c8a62a82-0e0f-48d5-bd09-b8f79e50bc9b req-3dd40f00-f675-4574-9cc2-07a47b600d82 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:34.690255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c8a62a82-0e0f-48d5-bd09-b8f79e50bc9b req-3dd40f00-f675-4574-9cc2-07a47b600d82 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:34.704433 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c8a62a82-0e0f-48d5-bd09-b8f79e50bc9b req-3dd40f00-f675-4574-9cc2-07a47b600d82 service nova] Creating event network-vif-deleted:25acea94-b112-429c-a10e-d1e3da5a4dbc for instance 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb on n-h1-850468-16 Aug 23 18:08:34.711631 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c8a62a82-0e0f-48d5-bd09-b8f79e50bc9b req-3dd40f00-f675-4574-9cc2-07a47b600d82 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037984 Aug 23 18:08:34.712396 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1933/3788] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:08:34.900262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c04a84d8-31f1-4fed-855d-c190bb530335 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:34.907152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:34.908450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c04a84d8-31f1-4fed-855d-c190bb530335 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:34.910591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:34.925852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:34.926451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c04a84d8-31f1-4fed-855d-c190bb530335 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:34.927807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c04a84d8-31f1-4fed-855d-c190bb530335 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:34.928607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c04a84d8-31f1-4fed-855d-c190bb530335 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:34.929254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c04a84d8-31f1-4fed-855d-c190bb530335 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:34.929438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:34.930127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:34.931057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:34.931510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:34.932005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:34.937259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c04a84d8-31f1-4fed-855d-c190bb530335 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:34.937734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c04a84d8-31f1-4fed-855d-c190bb530335 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:34.983577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:34.984058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:34.984704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:34.985138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lazy-loading 'fault' on Instance uuid 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:08:35.033779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45d01351a0604f539d16033483a387b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62607278cfa846a1b818bf8af91db1da', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:35.049436 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-312b5b46-4986-4542-aa46-3acb864df626 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 200 len: 1359 microversion: 2.1 time: 0.154340 Aug 23 18:08:35.051449 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1856/3789] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:34 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:35.129415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c04a84d8-31f1-4fed-855d-c190bb530335 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:35.138618 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c04a84d8-31f1-4fed-855d-c190bb530335 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1314 microversion: 2.1 time: 0.243146 Aug 23 18:08:35.139196 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1934/3790] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:34 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:36.075590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83f98aa5-b1c0-4a21-b13f-e908d29ff41e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:36.076862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-83f98aa5-b1c0-4a21-b13f-e908d29ff41e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] [instance: 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:36.085442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83f98aa5-b1c0-4a21-b13f-e908d29ff41e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:36.086184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83f98aa5-b1c0-4a21-b13f-e908d29ff41e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:36.086978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83f98aa5-b1c0-4a21-b13f-e908d29ff41e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:36.095456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83f98aa5-b1c0-4a21-b13f-e908d29ff41e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:36.095996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83f98aa5-b1c0-4a21-b13f-e908d29ff41e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:36.096482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83f98aa5-b1c0-4a21-b13f-e908d29ff41e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:36.119393 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-83f98aa5-b1c0-4a21-b13f-e908d29ff41e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] HTTP exception thrown: Instance 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb could not be found. Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83f98aa5-b1c0-4a21-b13f-e908d29ff41e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Request method failure captured: Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb HTTP/1.1 Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRcw_oEZfXyP0aNqw1PMRTNtoPb-vSa9qqqu_TPwUsfrLBi7g4wBHlJnWpoW3G4DG7oPu6iR8dmaN5VhTDX5RSURI-UptPnuZJpx6qG7xvzvd3FwuGt6sa0Tt0qGwOq8Cx-TChKwKidUdTcUj-uOf0El5L6yaDI3mGyiPgqWZy4usZA Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 62607278cfa846a1b818bf8af91db1da Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-368304261 Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_62607278cfa846a1b818bf8af91db1da"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62607278cfa846a1b818bf8af91db1da"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/62607278cfa846a1b818bf8af91db1da"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/62607278cfa846a1b818bf8af91db1da"}]}] Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-368304261 Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 62607278cfa846a1b818bf8af91db1da Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-368304261 Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-368304261-project Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 45d01351a0604f539d16033483a387b7 Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-368304261-project Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb could not be found. Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb'} Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb could not be found. Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb could not be found. Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:08:36.120934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:08:36.127184 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:08:36.127184 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:08:36.127184 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:08:36.127184 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:08:36.127184 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb could not be found. Aug 23 18:08:36.127184 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:08:36.128539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83f98aa5-b1c0-4a21-b13f-e908d29ff41e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Returning 404 to user: Instance 3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:08:36.129414 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-83f98aa5-b1c0-4a21-b13f-e908d29ff41e tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb" status: 404 len: 111 microversion: 2.1 time: 0.057716 Aug 23 18:08:36.129985 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1857/3791] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:36 2022] GET /compute/v2.1/servers/3f14e7ed-5cbc-4d17-933a-8361e3cf9dbb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:08:36.139177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-35a16f07-00f5-4f0e-a45b-5d539bfc0818 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] Calling method '.version_select at 0x7f27df894a60>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:36.169994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f1f0a097-7b88-461d-8d96-f6b9d87a1bf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:36.170365 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-35a16f07-00f5-4f0e-a45b-5d539bfc0818 tempest-ServersTestJSON-368304261 tempest-ServersTestJSON-368304261-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-894823886" status: 202 len: 0 microversion: 2.1 time: 0.034787 Aug 23 18:08:36.171283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f1f0a097-7b88-461d-8d96-f6b9d87a1bf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:36.176098 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1935/3792] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Aug 23 18:08:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-894823886 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:08:36.196484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1f0a097-7b88-461d-8d96-f6b9d87a1bf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:36.197503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1f0a097-7b88-461d-8d96-f6b9d87a1bf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:36.198201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1f0a097-7b88-461d-8d96-f6b9d87a1bf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:36.199222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1f0a097-7b88-461d-8d96-f6b9d87a1bf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:36.200013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1f0a097-7b88-461d-8d96-f6b9d87a1bf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:36.200612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1f0a097-7b88-461d-8d96-f6b9d87a1bf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:36.481728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f1f0a097-7b88-461d-8d96-f6b9d87a1bf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:36.492039 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f1f0a097-7b88-461d-8d96-f6b9d87a1bf2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1314 microversion: 2.1 time: 0.335129 Aug 23 18:08:36.493983 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1858/3793] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:36 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:37.514399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c9682dce-5b8b-4aa9-94f9-d046e700bbf7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:37.515655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c9682dce-5b8b-4aa9-94f9-d046e700bbf7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:37.523617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9682dce-5b8b-4aa9-94f9-d046e700bbf7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:37.524992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9682dce-5b8b-4aa9-94f9-d046e700bbf7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:37.525625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9682dce-5b8b-4aa9-94f9-d046e700bbf7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:37.526582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9682dce-5b8b-4aa9-94f9-d046e700bbf7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:37.527244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9682dce-5b8b-4aa9-94f9-d046e700bbf7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:37.527870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9682dce-5b8b-4aa9-94f9-d046e700bbf7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:37.765088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c9682dce-5b8b-4aa9-94f9-d046e700bbf7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:37.777256 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c9682dce-5b8b-4aa9-94f9-d046e700bbf7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1501 microversion: 2.1 time: 0.267730 Aug 23 18:08:37.778459 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1936/3794] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:37 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1501 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:37.798702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-01854525-f584-4e62-95a1-66fd7bb0a489 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:37.799824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-01854525-f584-4e62-95a1-66fd7bb0a489 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:37.808986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01854525-f584-4e62-95a1-66fd7bb0a489 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:37.809681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01854525-f584-4e62-95a1-66fd7bb0a489 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:37.810304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01854525-f584-4e62-95a1-66fd7bb0a489 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:37.811401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01854525-f584-4e62-95a1-66fd7bb0a489 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:37.812033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01854525-f584-4e62-95a1-66fd7bb0a489 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:37.813264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01854525-f584-4e62-95a1-66fd7bb0a489 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:37.904619 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-01854525-f584-4e62-95a1-66fd7bb0a489 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9/action" status: 202 len: 0 microversion: 2.1 time: 0.110128 Aug 23 18:08:37.907164 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1859/3795] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:08:37 2022] POST /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:08:37.915839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1e845c89-3fb8-4102-b9bc-8ec2fb27935d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:37.916790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1e845c89-3fb8-4102-b9bc-8ec2fb27935d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:37.934446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e845c89-3fb8-4102-b9bc-8ec2fb27935d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:37.935927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e845c89-3fb8-4102-b9bc-8ec2fb27935d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:37.936714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e845c89-3fb8-4102-b9bc-8ec2fb27935d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:37.937782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e845c89-3fb8-4102-b9bc-8ec2fb27935d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:37.938516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e845c89-3fb8-4102-b9bc-8ec2fb27935d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:37.939202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e845c89-3fb8-4102-b9bc-8ec2fb27935d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:38.325109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1e845c89-3fb8-4102-b9bc-8ec2fb27935d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:38.334582 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1e845c89-3fb8-4102-b9bc-8ec2fb27935d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1506 microversion: 2.1 time: 0.422966 Aug 23 18:08:38.342875 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1937/3796] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:37 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1506 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:39.368291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-abc9bcf1-e4d2-4044-bfd1-b260cc2b2af6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:39.368900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-abc9bcf1-e4d2-4044-bfd1-b260cc2b2af6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:39.386728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abc9bcf1-e4d2-4044-bfd1-b260cc2b2af6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:39.387546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abc9bcf1-e4d2-4044-bfd1-b260cc2b2af6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:39.388153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abc9bcf1-e4d2-4044-bfd1-b260cc2b2af6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:39.389085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abc9bcf1-e4d2-4044-bfd1-b260cc2b2af6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:39.389738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abc9bcf1-e4d2-4044-bfd1-b260cc2b2af6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:39.390323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abc9bcf1-e4d2-4044-bfd1-b260cc2b2af6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:39.850763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-abc9bcf1-e4d2-4044-bfd1-b260cc2b2af6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:39.867327 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-abc9bcf1-e4d2-4044-bfd1-b260cc2b2af6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1486 microversion: 2.1 time: 0.505033 Aug 23 18:08:39.867932 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1860/3797] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:39 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1486 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:39.890052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f25325b0-ee14-4ea8-a0a6-418dc8b6a6ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:39.891360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f25325b0-ee14-4ea8-a0a6-418dc8b6a6ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:39.906664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f25325b0-ee14-4ea8-a0a6-418dc8b6a6ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:39.907447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f25325b0-ee14-4ea8-a0a6-418dc8b6a6ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:39.908086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f25325b0-ee14-4ea8-a0a6-418dc8b6a6ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:39.909175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f25325b0-ee14-4ea8-a0a6-418dc8b6a6ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:39.909640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f25325b0-ee14-4ea8-a0a6-418dc8b6a6ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:39.910078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f25325b0-ee14-4ea8-a0a6-418dc8b6a6ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:39.962284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-f25325b0-ee14-4ea8-a0a6-418dc8b6a6ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lazy-loading 'flavor' on Instance uuid abd63f48-61c9-47c7-a848-14c894fd93b9 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:08:40.330085 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f25325b0-ee14-4ea8-a0a6-418dc8b6a6ed tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9/action" status: 202 len: 0 microversion: 2.1 time: 0.443344 Aug 23 18:08:40.331643 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1938/3798] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:08:39 2022] POST /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9/action => generated 0 bytes in 446 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:08:40.340188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2abd9441-3555-498c-88c6-b33285165b40 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:40.341353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2abd9441-3555-498c-88c6-b33285165b40 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:40.347328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:40.348653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:40.350845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2abd9441-3555-498c-88c6-b33285165b40 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:40.351652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2abd9441-3555-498c-88c6-b33285165b40 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:40.352406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2abd9441-3555-498c-88c6-b33285165b40 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:40.353363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2abd9441-3555-498c-88c6-b33285165b40 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:40.353996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2abd9441-3555-498c-88c6-b33285165b40 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:40.354624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2abd9441-3555-498c-88c6-b33285165b40 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:40.665087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2abd9441-3555-498c-88c6-b33285165b40 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:40.675390 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2abd9441-3555-498c-88c6-b33285165b40 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1492 microversion: 2.1 time: 0.338852 Aug 23 18:08:40.676277 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1861/3799] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:40 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1492 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:41.699632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-01cc0f5e-c3fc-4c05-8768-9d9759c5b62d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:41.700349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-01cc0f5e-c3fc-4c05-8768-9d9759c5b62d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:41.717066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01cc0f5e-c3fc-4c05-8768-9d9759c5b62d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:41.717606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01cc0f5e-c3fc-4c05-8768-9d9759c5b62d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:41.718060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01cc0f5e-c3fc-4c05-8768-9d9759c5b62d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:41.721298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01cc0f5e-c3fc-4c05-8768-9d9759c5b62d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:41.721824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01cc0f5e-c3fc-4c05-8768-9d9759c5b62d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:41.725782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01cc0f5e-c3fc-4c05-8768-9d9759c5b62d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:42.064600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-01cc0f5e-c3fc-4c05-8768-9d9759c5b62d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:42.092216 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-01cc0f5e-c3fc-4c05-8768-9d9759c5b62d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1492 microversion: 2.1 time: 0.397023 Aug 23 18:08:42.095232 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1939/3800] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:41 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1492 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:43.127351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5e5f40fd-2312-4a30-9259-7df31ef9e4f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:43.128915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5e5f40fd-2312-4a30-9259-7df31ef9e4f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:43.141874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e5f40fd-2312-4a30-9259-7df31ef9e4f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:43.144639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e5f40fd-2312-4a30-9259-7df31ef9e4f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:43.145278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e5f40fd-2312-4a30-9259-7df31ef9e4f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:43.147022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e5f40fd-2312-4a30-9259-7df31ef9e4f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:43.148149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e5f40fd-2312-4a30-9259-7df31ef9e4f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:43.148149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e5f40fd-2312-4a30-9259-7df31ef9e4f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:43.380820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5e5f40fd-2312-4a30-9259-7df31ef9e4f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:43.392287 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5e5f40fd-2312-4a30-9259-7df31ef9e4f4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1513 microversion: 2.1 time: 0.276612 Aug 23 18:08:43.392866 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1862/3801] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:43 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:44.418623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c7632f5-e3bd-4958-89bb-3980a6bb0e18 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:44.420053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4c7632f5-e3bd-4958-89bb-3980a6bb0e18 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:44.433262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c7632f5-e3bd-4958-89bb-3980a6bb0e18 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:44.446385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c7632f5-e3bd-4958-89bb-3980a6bb0e18 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:44.447380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c7632f5-e3bd-4958-89bb-3980a6bb0e18 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:44.448721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c7632f5-e3bd-4958-89bb-3980a6bb0e18 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:44.449422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c7632f5-e3bd-4958-89bb-3980a6bb0e18 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:44.450412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c7632f5-e3bd-4958-89bb-3980a6bb0e18 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:44.654516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4c7632f5-e3bd-4958-89bb-3980a6bb0e18 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:44.684710 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4c7632f5-e3bd-4958-89bb-3980a6bb0e18 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1513 microversion: 2.1 time: 0.272671 Aug 23 18:08:44.690170 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1940/3802] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:44 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1513 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:08:45.717896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-adaa347a-883c-4b2e-a7a0-5dce003d0064 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:45.718525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-adaa347a-883c-4b2e-a7a0-5dce003d0064 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:45.727607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adaa347a-883c-4b2e-a7a0-5dce003d0064 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:45.728098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adaa347a-883c-4b2e-a7a0-5dce003d0064 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:45.728537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adaa347a-883c-4b2e-a7a0-5dce003d0064 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:45.733017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adaa347a-883c-4b2e-a7a0-5dce003d0064 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:45.733660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adaa347a-883c-4b2e-a7a0-5dce003d0064 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:45.736627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adaa347a-883c-4b2e-a7a0-5dce003d0064 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:45.912244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-9b989077-82ce-4078-a1eb-638e76183c84 req-8af899d5-e995-439a-b1af-b1d12e014185 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd63f48-61c9-47c7-a848-14c894fd93b9", "name": "network-vif-plugged", "status": "completed", "tag": "df4503b0-060f-457c-8654-872684e34528"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:45.961770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9b989077-82ce-4078-a1eb-638e76183c84 req-8af899d5-e995-439a-b1af-b1d12e014185 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:45.962418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9b989077-82ce-4078-a1eb-638e76183c84 req-8af899d5-e995-439a-b1af-b1d12e014185 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:45.962921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9b989077-82ce-4078-a1eb-638e76183c84 req-8af899d5-e995-439a-b1af-b1d12e014185 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:45.987393 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-9b989077-82ce-4078-a1eb-638e76183c84 req-8af899d5-e995-439a-b1af-b1d12e014185 service nova] Creating event network-vif-plugged:df4503b0-060f-457c-8654-872684e34528 for instance abd63f48-61c9-47c7-a848-14c894fd93b9 on n-h2-850468-16 Aug 23 18:08:45.992778 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-9b989077-82ce-4078-a1eb-638e76183c84 req-8af899d5-e995-439a-b1af-b1d12e014185 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084921 Aug 23 18:08:45.993796 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1941/3803] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:08:46.214817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-adaa347a-883c-4b2e-a7a0-5dce003d0064 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:46.229727 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-adaa347a-883c-4b2e-a7a0-5dce003d0064 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1513 microversion: 2.1 time: 0.515771 Aug 23 18:08:46.238763 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1863/3804] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:45 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1513 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:47.254047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d789ecc-bc70-46a0-a69e-d86f9e6f48b0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:47.257256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8d789ecc-bc70-46a0-a69e-d86f9e6f48b0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:47.268946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d789ecc-bc70-46a0-a69e-d86f9e6f48b0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:47.271773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d789ecc-bc70-46a0-a69e-d86f9e6f48b0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:47.275801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d789ecc-bc70-46a0-a69e-d86f9e6f48b0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:47.277073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d789ecc-bc70-46a0-a69e-d86f9e6f48b0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:47.277073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d789ecc-bc70-46a0-a69e-d86f9e6f48b0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:47.277487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d789ecc-bc70-46a0-a69e-d86f9e6f48b0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:47.525972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8d789ecc-bc70-46a0-a69e-d86f9e6f48b0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:47.539136 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8d789ecc-bc70-46a0-a69e-d86f9e6f48b0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1513 microversion: 2.1 time: 0.290691 Aug 23 18:08:47.550047 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1942/3805] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:47 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:48.577421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0718eb0b-7495-4380-afaa-bb5ccff394eb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:48.578433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0718eb0b-7495-4380-afaa-bb5ccff394eb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:48.595557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0718eb0b-7495-4380-afaa-bb5ccff394eb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:48.596701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0718eb0b-7495-4380-afaa-bb5ccff394eb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:48.598174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0718eb0b-7495-4380-afaa-bb5ccff394eb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:48.600470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0718eb0b-7495-4380-afaa-bb5ccff394eb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:48.601971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0718eb0b-7495-4380-afaa-bb5ccff394eb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:48.603993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0718eb0b-7495-4380-afaa-bb5ccff394eb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:48.890033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0718eb0b-7495-4380-afaa-bb5ccff394eb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:48.904140 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0718eb0b-7495-4380-afaa-bb5ccff394eb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.332286 Aug 23 18:08:48.918189 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1864/3806] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:48 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:49.429972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-82aca21b-95b5-40b4-a380-ed6b5320d93e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:49.431993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-82aca21b-95b5-40b4-a380-ed6b5320d93e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:49.466958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82aca21b-95b5-40b4-a380-ed6b5320d93e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:49.468224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82aca21b-95b5-40b4-a380-ed6b5320d93e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:49.470288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82aca21b-95b5-40b4-a380-ed6b5320d93e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:49.476789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82aca21b-95b5-40b4-a380-ed6b5320d93e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:49.480011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82aca21b-95b5-40b4-a380-ed6b5320d93e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:49.480632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82aca21b-95b5-40b4-a380-ed6b5320d93e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:49.932550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a1636c49-68c0-491d-b1d9-7d57ad06fc9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:49.933162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a1636c49-68c0-491d-b1d9-7d57ad06fc9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:49.951225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1636c49-68c0-491d-b1d9-7d57ad06fc9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:49.954372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1636c49-68c0-491d-b1d9-7d57ad06fc9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:49.956480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1636c49-68c0-491d-b1d9-7d57ad06fc9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:49.957588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1636c49-68c0-491d-b1d9-7d57ad06fc9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:49.959813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1636c49-68c0-491d-b1d9-7d57ad06fc9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:49.967105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1636c49-68c0-491d-b1d9-7d57ad06fc9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:50.280260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a1636c49-68c0-491d-b1d9-7d57ad06fc9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:50.300966 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a1636c49-68c0-491d-b1d9-7d57ad06fc9f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.376224 Aug 23 18:08:50.304394 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1865/3807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:49 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:50.321233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-82aca21b-95b5-40b4-a380-ed6b5320d93e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:50.331694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-82aca21b-95b5-40b4-a380-ed6b5320d93e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:50.359267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-82aca21b-95b5-40b4-a380-ed6b5320d93e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:50.360613 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-82aca21b-95b5-40b4-a380-ed6b5320d93e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2942 microversion: 2.32 time: 0.936102 Aug 23 18:08:50.374679 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1943/3808] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:08:49 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2942 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:08:50.413998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-adbf15b6-1eb0-499d-8e8b-34a00a5371a8 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:50.415694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-adbf15b6-1eb0-499d-8e8b-34a00a5371a8 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:50.432348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adbf15b6-1eb0-499d-8e8b-34a00a5371a8 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:50.434522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adbf15b6-1eb0-499d-8e8b-34a00a5371a8 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:50.439384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adbf15b6-1eb0-499d-8e8b-34a00a5371a8 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:50.440716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adbf15b6-1eb0-499d-8e8b-34a00a5371a8 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:50.441291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adbf15b6-1eb0-499d-8e8b-34a00a5371a8 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:50.441820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adbf15b6-1eb0-499d-8e8b-34a00a5371a8 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:50.795543 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-adbf15b6-1eb0-499d-8e8b-34a00a5371a8 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e/os-interface" status: 200 len: 1829 microversion: 2.32 time: 0.395341 Aug 23 18:08:50.796278 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1866/3809] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Aug 23 18:08:50 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e/os-interface => generated 1829 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:08:51.155241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1144176847", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "2590bb5f-8ace-41d9-ae28-2d05e6f1fbab"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:08:51.330197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fdaebf29-bf3b-47e1-9f54-9590758439c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:51.331605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fdaebf29-bf3b-47e1-9f54-9590758439c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:51.349304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdaebf29-bf3b-47e1-9f54-9590758439c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:51.350685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdaebf29-bf3b-47e1-9f54-9590758439c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:51.351839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdaebf29-bf3b-47e1-9f54-9590758439c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:51.352799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdaebf29-bf3b-47e1-9f54-9590758439c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:51.353683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdaebf29-bf3b-47e1-9f54-9590758439c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:51.354672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdaebf29-bf3b-47e1-9f54-9590758439c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:51.657502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fdaebf29-bf3b-47e1-9f54-9590758439c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:51.672048 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fdaebf29-bf3b-47e1-9f54-9590758439c9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.349796 Aug 23 18:08:51.682638 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1867/3810] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:51 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:52.698914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f187f835-daac-4677-a73d-ea221a658d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:52.699704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f187f835-daac-4677-a73d-ea221a658d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:52.718573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f187f835-daac-4677-a73d-ea221a658d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:52.719469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f187f835-daac-4677-a73d-ea221a658d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:52.720154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f187f835-daac-4677-a73d-ea221a658d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:52.721039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f187f835-daac-4677-a73d-ea221a658d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:52.724828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f187f835-daac-4677-a73d-ea221a658d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:52.725437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f187f835-daac-4677-a73d-ea221a658d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:52.767446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:08:53.078123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f187f835-daac-4677-a73d-ea221a658d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:53.091988 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f187f835-daac-4677-a73d-ea221a658d70 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.400297 Aug 23 18:08:53.111757 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1868/3811] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:52 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:08:54.122141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6ee75667-34ee-4239-a74a-b7f5777656a1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:54.125762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6ee75667-34ee-4239-a74a-b7f5777656a1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:54.156871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ee75667-34ee-4239-a74a-b7f5777656a1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:54.159204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ee75667-34ee-4239-a74a-b7f5777656a1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:54.167648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ee75667-34ee-4239-a74a-b7f5777656a1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:54.169492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ee75667-34ee-4239-a74a-b7f5777656a1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:54.171376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ee75667-34ee-4239-a74a-b7f5777656a1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:54.173284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ee75667-34ee-4239-a74a-b7f5777656a1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:54.576039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6ee75667-34ee-4239-a74a-b7f5777656a1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:54.587845 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6ee75667-34ee-4239-a74a-b7f5777656a1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.474334 Aug 23 18:08:54.607310 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1869/3812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:54 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:55.625990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fdcd450e-a1c5-42a9-804a-08989e7fe3ff tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:55.627529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fdcd450e-a1c5-42a9-804a-08989e7fe3ff tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:55.668244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdcd450e-a1c5-42a9-804a-08989e7fe3ff tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:55.669161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdcd450e-a1c5-42a9-804a-08989e7fe3ff tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:55.669809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdcd450e-a1c5-42a9-804a-08989e7fe3ff tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:55.672349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdcd450e-a1c5-42a9-804a-08989e7fe3ff tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:55.673192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdcd450e-a1c5-42a9-804a-08989e7fe3ff tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:55.674497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdcd450e-a1c5-42a9-804a-08989e7fe3ff tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:55.945893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fdcd450e-a1c5-42a9-804a-08989e7fe3ff tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:55.960463 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fdcd450e-a1c5-42a9-804a-08989e7fe3ff tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.338923 Aug 23 18:08:55.961644 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1870/3813] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:55 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:56.987560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-58b18d13-6ca2-4a81-aa8e-7dfcc88a9df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:56.988238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-58b18d13-6ca2-4a81-aa8e-7dfcc88a9df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:57.012144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58b18d13-6ca2-4a81-aa8e-7dfcc88a9df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:57.012940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58b18d13-6ca2-4a81-aa8e-7dfcc88a9df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:57.013570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58b18d13-6ca2-4a81-aa8e-7dfcc88a9df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:57.014570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58b18d13-6ca2-4a81-aa8e-7dfcc88a9df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:57.015230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58b18d13-6ca2-4a81-aa8e-7dfcc88a9df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:57.015830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58b18d13-6ca2-4a81-aa8e-7dfcc88a9df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:57.592669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-58b18d13-6ca2-4a81-aa8e-7dfcc88a9df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:57.603773 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-58b18d13-6ca2-4a81-aa8e-7dfcc88a9df4 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.619809 Aug 23 18:08:57.605586 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1871/3814] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:56 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:08:58.642395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4bd65862-63b4-4334-8c4c-86aed6e16fb5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:58.644232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4bd65862-63b4-4334-8c4c-86aed6e16fb5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:58.653329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bd65862-63b4-4334-8c4c-86aed6e16fb5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:58.654173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bd65862-63b4-4334-8c4c-86aed6e16fb5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:58.654721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bd65862-63b4-4334-8c4c-86aed6e16fb5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:58.655658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bd65862-63b4-4334-8c4c-86aed6e16fb5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:58.656327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bd65862-63b4-4334-8c4c-86aed6e16fb5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:58.656983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bd65862-63b4-4334-8c4c-86aed6e16fb5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:58.905482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4bd65862-63b4-4334-8c4c-86aed6e16fb5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:08:58.930470 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4bd65862-63b4-4334-8c4c-86aed6e16fb5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.306098 Aug 23 18:08:58.931113 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1872/3815] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:58 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:08:59.952570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-16ecbef4-0fec-40a2-b649-c2aad7c23c7c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:08:59.953804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-16ecbef4-0fec-40a2-b649-c2aad7c23c7c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:08:59.964892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16ecbef4-0fec-40a2-b649-c2aad7c23c7c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:59.965929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16ecbef4-0fec-40a2-b649-c2aad7c23c7c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:59.966628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16ecbef4-0fec-40a2-b649-c2aad7c23c7c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:08:59.967582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16ecbef4-0fec-40a2-b649-c2aad7c23c7c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:08:59.968272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16ecbef4-0fec-40a2-b649-c2aad7c23c7c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:08:59.969369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16ecbef4-0fec-40a2-b649-c2aad7c23c7c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:00.173469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-16ecbef4-0fec-40a2-b649-c2aad7c23c7c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:00.188001 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-16ecbef4-0fec-40a2-b649-c2aad7c23c7c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.239094 Aug 23 18:09:00.188910 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1873/3816] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:08:59 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:00.327848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:01.191798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:01.211429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-902a1e6f-8938-4b6d-9e4e-5a93eb8e36cd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:01.212861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-902a1e6f-8938-4b6d-9e4e-5a93eb8e36cd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:01.224430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-902a1e6f-8938-4b6d-9e4e-5a93eb8e36cd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:01.225291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-902a1e6f-8938-4b6d-9e4e-5a93eb8e36cd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:01.225987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-902a1e6f-8938-4b6d-9e4e-5a93eb8e36cd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:01.226979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-902a1e6f-8938-4b6d-9e4e-5a93eb8e36cd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:01.227719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-902a1e6f-8938-4b6d-9e4e-5a93eb8e36cd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:01.228388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-902a1e6f-8938-4b6d-9e4e-5a93eb8e36cd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:01.445122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] validate_networks() for [('2590bb5f-8ace-41d9-ae28-2d05e6f1fbab', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:09:01.538883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-902a1e6f-8938-4b6d-9e4e-5a93eb8e36cd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:01.551620 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-902a1e6f-8938-4b6d-9e4e-5a93eb8e36cd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.343503 Aug 23 18:09:01.555405 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1874/3817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:01 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:09:02.438073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:09:02.438868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:09:02.439647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:09:02.440145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:09:02.440719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:09:02.453010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:02.453672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:02.454204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:02.455045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:02.455742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:02.456265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:02.482506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:09:02.488367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for user 2380358bc6a7496ead343b351bce816d and project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:09:02.503428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:09:02.507096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:09:02.564253 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-19d98875-6a10-4a1e-97fc-bbd527ffd483 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.689369 Aug 23 18:09:02.565604 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1944/3818] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:08:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 11691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:09:02.577505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95d0e741-227a-4d99-83f9-afa8427d3d39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:02.578099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-95d0e741-227a-4d99-83f9-afa8427d3d39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:02.592309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3bce5c7d-6f53-405c-a4f6-7df8b3aba2f7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:02.592923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3bce5c7d-6f53-405c-a4f6-7df8b3aba2f7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:02.622877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bce5c7d-6f53-405c-a4f6-7df8b3aba2f7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:02.623401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bce5c7d-6f53-405c-a4f6-7df8b3aba2f7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:02.623844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bce5c7d-6f53-405c-a4f6-7df8b3aba2f7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:02.624554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bce5c7d-6f53-405c-a4f6-7df8b3aba2f7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:02.625012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bce5c7d-6f53-405c-a4f6-7df8b3aba2f7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:02.625441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bce5c7d-6f53-405c-a4f6-7df8b3aba2f7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:02.704126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-95d0e741-227a-4d99-83f9-afa8427d3d39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:02.713028 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-95d0e741-227a-4d99-83f9-afa8427d3d39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1215 microversion: 2.1 time: 0.139489 Aug 23 18:09:02.727694 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1875/3819] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:02 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1215 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:02.845525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3bce5c7d-6f53-405c-a4f6-7df8b3aba2f7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:02.856392 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3bce5c7d-6f53-405c-a4f6-7df8b3aba2f7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.271509 Aug 23 18:09:02.856990 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1945/3820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:02 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:03.735990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e56420b5-402d-4b0c-b8f7-3e2666e12705 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:03.737207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e56420b5-402d-4b0c-b8f7-3e2666e12705 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:03.748380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e56420b5-402d-4b0c-b8f7-3e2666e12705 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:03.749285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e56420b5-402d-4b0c-b8f7-3e2666e12705 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:03.750463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e56420b5-402d-4b0c-b8f7-3e2666e12705 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:03.751365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e56420b5-402d-4b0c-b8f7-3e2666e12705 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:03.752194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e56420b5-402d-4b0c-b8f7-3e2666e12705 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:03.752853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e56420b5-402d-4b0c-b8f7-3e2666e12705 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:03.877852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa4bba0b-992d-4ef4-a6ff-c067bbc9c8b3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:03.878425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa4bba0b-992d-4ef4-a6ff-c067bbc9c8b3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:03.893409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa4bba0b-992d-4ef4-a6ff-c067bbc9c8b3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:03.893916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa4bba0b-992d-4ef4-a6ff-c067bbc9c8b3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:03.894365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa4bba0b-992d-4ef4-a6ff-c067bbc9c8b3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:03.895713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa4bba0b-992d-4ef4-a6ff-c067bbc9c8b3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:03.896246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa4bba0b-992d-4ef4-a6ff-c067bbc9c8b3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:03.896812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa4bba0b-992d-4ef4-a6ff-c067bbc9c8b3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:03.904733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e56420b5-402d-4b0c-b8f7-3e2666e12705 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:03.914053 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e56420b5-402d-4b0c-b8f7-3e2666e12705 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1211 microversion: 2.1 time: 0.181988 Aug 23 18:09:03.922692 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1876/3821] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:03 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1211 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:04.258484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa4bba0b-992d-4ef4-a6ff-c067bbc9c8b3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:04.269414 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa4bba0b-992d-4ef4-a6ff-c067bbc9c8b3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.395561 Aug 23 18:09:04.270073 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1946/3822] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:03 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:04.937951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c6aa9cc9-398c-477b-92d9-e2d20ba047f7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:04.938586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c6aa9cc9-398c-477b-92d9-e2d20ba047f7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:04.943267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=48 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:04.957007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6aa9cc9-398c-477b-92d9-e2d20ba047f7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:04.960596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6aa9cc9-398c-477b-92d9-e2d20ba047f7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:04.961106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6aa9cc9-398c-477b-92d9-e2d20ba047f7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:04.961866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6aa9cc9-398c-477b-92d9-e2d20ba047f7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:04.962325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6aa9cc9-398c-477b-92d9-e2d20ba047f7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:04.973411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6aa9cc9-398c-477b-92d9-e2d20ba047f7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:05.086968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c6aa9cc9-398c-477b-92d9-e2d20ba047f7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:05.096842 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c6aa9cc9-398c-477b-92d9-e2d20ba047f7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1285 microversion: 2.1 time: 0.162924 Aug 23 18:09:05.099331 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1877/3823] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:04 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:05.292935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-30b910ad-ccfe-401c-b11f-7a05f56a680f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:05.293645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-30b910ad-ccfe-401c-b11f-7a05f56a680f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:05.303784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30b910ad-ccfe-401c-b11f-7a05f56a680f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:05.305118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30b910ad-ccfe-401c-b11f-7a05f56a680f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:05.305771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30b910ad-ccfe-401c-b11f-7a05f56a680f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:05.306745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30b910ad-ccfe-401c-b11f-7a05f56a680f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:05.307461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30b910ad-ccfe-401c-b11f-7a05f56a680f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:05.308114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30b910ad-ccfe-401c-b11f-7a05f56a680f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:05.515729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-30b910ad-ccfe-401c-b11f-7a05f56a680f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:05.527544 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-30b910ad-ccfe-401c-b11f-7a05f56a680f tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.239125 Aug 23 18:09:05.531126 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1947/3824] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:05 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:06.119532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dfd98319-66cd-4668-9794-c163b95a3035 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:06.120169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dfd98319-66cd-4668-9794-c163b95a3035 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:06.127681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfd98319-66cd-4668-9794-c163b95a3035 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:06.128237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfd98319-66cd-4668-9794-c163b95a3035 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:06.128861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfd98319-66cd-4668-9794-c163b95a3035 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:06.129629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfd98319-66cd-4668-9794-c163b95a3035 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:06.130061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfd98319-66cd-4668-9794-c163b95a3035 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:06.130716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dfd98319-66cd-4668-9794-c163b95a3035 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:06.380783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dfd98319-66cd-4668-9794-c163b95a3035 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:06.389356 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dfd98319-66cd-4668-9794-c163b95a3035 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1315 microversion: 2.1 time: 0.274450 Aug 23 18:09:06.390562 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1878/3825] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:06 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:09:06.483400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-798ca9a1-88f1-43b4-9495-439bbbc8e120 req-2dea8bb0-0f3a-492d-b231-de0383056bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57ededd5-baef-4b7b-9c5b-72064a009fdc", "tag": "d5b1a992-c926-4f56-a621-fd86850403cd"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:06.496206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-798ca9a1-88f1-43b4-9495-439bbbc8e120 req-2dea8bb0-0f3a-492d-b231-de0383056bf8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:06.496957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-798ca9a1-88f1-43b4-9495-439bbbc8e120 req-2dea8bb0-0f3a-492d-b231-de0383056bf8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:06.497816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-798ca9a1-88f1-43b4-9495-439bbbc8e120 req-2dea8bb0-0f3a-492d-b231-de0383056bf8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:06.523308 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-798ca9a1-88f1-43b4-9495-439bbbc8e120 req-2dea8bb0-0f3a-492d-b231-de0383056bf8 service nova] Creating event network-changed:d5b1a992-c926-4f56-a621-fd86850403cd for instance 57ededd5-baef-4b7b-9c5b-72064a009fdc on n-h2-850468-16 Aug 23 18:09:06.530230 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-798ca9a1-88f1-43b4-9495-439bbbc8e120 req-2dea8bb0-0f3a-492d-b231-de0383056bf8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052815 Aug 23 18:09:06.531521 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1948/3826] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:09:06.555362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fe95fcf6-51b4-4076-9ecc-a00399fa4036 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:06.556406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe95fcf6-51b4-4076-9ecc-a00399fa4036 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:06.563552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe95fcf6-51b4-4076-9ecc-a00399fa4036 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:06.564462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe95fcf6-51b4-4076-9ecc-a00399fa4036 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:06.565169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe95fcf6-51b4-4076-9ecc-a00399fa4036 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:06.566137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe95fcf6-51b4-4076-9ecc-a00399fa4036 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:06.566980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe95fcf6-51b4-4076-9ecc-a00399fa4036 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:06.567828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe95fcf6-51b4-4076-9ecc-a00399fa4036 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:06.738263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fe95fcf6-51b4-4076-9ecc-a00399fa4036 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:06.746928 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fe95fcf6-51b4-4076-9ecc-a00399fa4036 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1505 microversion: 2.1 time: 0.196748 Aug 23 18:09:06.747463 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1879/3827] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:06 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1505 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:07.411740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48e732e1-15c8-42d7-be56-dd04fcf9cbe9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:07.412712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-48e732e1-15c8-42d7-be56-dd04fcf9cbe9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:07.419500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48e732e1-15c8-42d7-be56-dd04fcf9cbe9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:07.420095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48e732e1-15c8-42d7-be56-dd04fcf9cbe9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:07.420682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48e732e1-15c8-42d7-be56-dd04fcf9cbe9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:07.421448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48e732e1-15c8-42d7-be56-dd04fcf9cbe9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:07.422001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48e732e1-15c8-42d7-be56-dd04fcf9cbe9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:07.422558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48e732e1-15c8-42d7-be56-dd04fcf9cbe9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:07.571360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-48e732e1-15c8-42d7-be56-dd04fcf9cbe9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:07.580885 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48e732e1-15c8-42d7-be56-dd04fcf9cbe9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1315 microversion: 2.1 time: 0.173667 Aug 23 18:09:07.581607 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1949/3828] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:07 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:07.791070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ea8e699d-bbbd-4588-b6d4-0290270991fb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:07.792405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ea8e699d-bbbd-4588-b6d4-0290270991fb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:07.797573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-14776415-409c-4ab1-9269-820ad564e32b req-f1383abb-0f9d-444f-8b85-0d628c93da68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd63f48-61c9-47c7-a848-14c894fd93b9", "name": "network-vif-unplugged", "status": "completed", "tag": "df4503b0-060f-457c-8654-872684e34528"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:07.815416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea8e699d-bbbd-4588-b6d4-0290270991fb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:07.816129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea8e699d-bbbd-4588-b6d4-0290270991fb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:07.819124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea8e699d-bbbd-4588-b6d4-0290270991fb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:07.820311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea8e699d-bbbd-4588-b6d4-0290270991fb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:07.822751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea8e699d-bbbd-4588-b6d4-0290270991fb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:07.823512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea8e699d-bbbd-4588-b6d4-0290270991fb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:07.829087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-14776415-409c-4ab1-9269-820ad564e32b req-f1383abb-0f9d-444f-8b85-0d628c93da68 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:07.829885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-14776415-409c-4ab1-9269-820ad564e32b req-f1383abb-0f9d-444f-8b85-0d628c93da68 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:07.830688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-14776415-409c-4ab1-9269-820ad564e32b req-f1383abb-0f9d-444f-8b85-0d628c93da68 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:07.870153 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-14776415-409c-4ab1-9269-820ad564e32b req-f1383abb-0f9d-444f-8b85-0d628c93da68 service nova] Creating event network-vif-unplugged:df4503b0-060f-457c-8654-872684e34528 for instance abd63f48-61c9-47c7-a848-14c894fd93b9 on n-h2-850468-16 Aug 23 18:09:07.878143 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-14776415-409c-4ab1-9269-820ad564e32b req-f1383abb-0f9d-444f-8b85-0d628c93da68 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.110536 Aug 23 18:09:07.883913 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1950/3829] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:09:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:09:08.058759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ea8e699d-bbbd-4588-b6d4-0290270991fb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:08.070991 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ea8e699d-bbbd-4588-b6d4-0290270991fb tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1505 microversion: 2.1 time: 0.305508 Aug 23 18:09:08.072003 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1880/3830] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:07 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:08.606812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-58d5b3ca-868a-4ed7-a5f6-5d08578c59c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:08.607815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-58d5b3ca-868a-4ed7-a5f6-5d08578c59c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:08.647610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58d5b3ca-868a-4ed7-a5f6-5d08578c59c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:08.648272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58d5b3ca-868a-4ed7-a5f6-5d08578c59c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:08.648783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58d5b3ca-868a-4ed7-a5f6-5d08578c59c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:08.649918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58d5b3ca-868a-4ed7-a5f6-5d08578c59c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:08.650459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58d5b3ca-868a-4ed7-a5f6-5d08578c59c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:08.653615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58d5b3ca-868a-4ed7-a5f6-5d08578c59c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:08.991460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-58d5b3ca-868a-4ed7-a5f6-5d08578c59c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:09.009971 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-58d5b3ca-868a-4ed7-a5f6-5d08578c59c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1315 microversion: 2.1 time: 0.404383 Aug 23 18:09:09.026816 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1951/3831] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:08 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1315 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:09.099685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6a33029-1177-42fb-93f6-57ee23fb2385 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:09.100316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6a33029-1177-42fb-93f6-57ee23fb2385 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:09.118828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6a33029-1177-42fb-93f6-57ee23fb2385 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:09.131638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6a33029-1177-42fb-93f6-57ee23fb2385 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:09.136309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6a33029-1177-42fb-93f6-57ee23fb2385 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:09.137649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6a33029-1177-42fb-93f6-57ee23fb2385 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:09.138470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6a33029-1177-42fb-93f6-57ee23fb2385 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:09.140986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6a33029-1177-42fb-93f6-57ee23fb2385 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:09.294275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f6a33029-1177-42fb-93f6-57ee23fb2385 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:09.302767 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6a33029-1177-42fb-93f6-57ee23fb2385 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 200 len: 1508 microversion: 2.1 time: 0.213007 Aug 23 18:09:09.303354 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1881/3832] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:09 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 1508 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:09.324216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-66d0ea11-38d2-4dc2-a4ef-9c7a7a9fc99a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:09.324934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-66d0ea11-38d2-4dc2-a4ef-9c7a7a9fc99a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:09.331235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66d0ea11-38d2-4dc2-a4ef-9c7a7a9fc99a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:09.331836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66d0ea11-38d2-4dc2-a4ef-9c7a7a9fc99a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:09.332438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66d0ea11-38d2-4dc2-a4ef-9c7a7a9fc99a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:09.333229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66d0ea11-38d2-4dc2-a4ef-9c7a7a9fc99a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:09.333793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66d0ea11-38d2-4dc2-a4ef-9c7a7a9fc99a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:09.334370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-66d0ea11-38d2-4dc2-a4ef-9c7a7a9fc99a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:09.485284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-66d0ea11-38d2-4dc2-a4ef-9c7a7a9fc99a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:09.495630 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-66d0ea11-38d2-4dc2-a4ef-9c7a7a9fc99a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.175243 Aug 23 18:09:09.496427 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1952/3833] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:09 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:09.522661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-06483a17-2099-487e-ba75-0fdefa049197 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:09.523521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-06483a17-2099-487e-ba75-0fdefa049197 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:09.529593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06483a17-2099-487e-ba75-0fdefa049197 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:09.530290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06483a17-2099-487e-ba75-0fdefa049197 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:09.530772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06483a17-2099-487e-ba75-0fdefa049197 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:09.531487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06483a17-2099-487e-ba75-0fdefa049197 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:09.531950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06483a17-2099-487e-ba75-0fdefa049197 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:09.532381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06483a17-2099-487e-ba75-0fdefa049197 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:09.695709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-06483a17-2099-487e-ba75-0fdefa049197 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:09.704916 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-06483a17-2099-487e-ba75-0fdefa049197 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.186776 Aug 23 18:09:09.705484 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1882/3834] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:09 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:09.727207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-26f77d30-053b-4b26-a063-3344f56ddb79 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:09.727989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-26f77d30-053b-4b26-a063-3344f56ddb79 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:09.735047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26f77d30-053b-4b26-a063-3344f56ddb79 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:09.735540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26f77d30-053b-4b26-a063-3344f56ddb79 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:09.735992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26f77d30-053b-4b26-a063-3344f56ddb79 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:09.736855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26f77d30-053b-4b26-a063-3344f56ddb79 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:09.737326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26f77d30-053b-4b26-a063-3344f56ddb79 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:09.737911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26f77d30-053b-4b26-a063-3344f56ddb79 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:09.876644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-26f77d30-053b-4b26-a063-3344f56ddb79 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:09.884582 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-26f77d30-053b-4b26-a063-3344f56ddb79 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.162441 Aug 23 18:09:09.885167 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1953/3835] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:09 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:09.905351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cc23f797-a2a5-4519-8b33-a3fa81237378 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:09.906929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cc23f797-a2a5-4519-8b33-a3fa81237378 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:09.914756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc23f797-a2a5-4519-8b33-a3fa81237378 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:09.915259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc23f797-a2a5-4519-8b33-a3fa81237378 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:09.916201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc23f797-a2a5-4519-8b33-a3fa81237378 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:09.917094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc23f797-a2a5-4519-8b33-a3fa81237378 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:09.917567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc23f797-a2a5-4519-8b33-a3fa81237378 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:09.918058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc23f797-a2a5-4519-8b33-a3fa81237378 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:10.033517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-68d71b5a-6243-41c6-92be-1552999029ee tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:10.034146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-68d71b5a-6243-41c6-92be-1552999029ee tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:10.041378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68d71b5a-6243-41c6-92be-1552999029ee tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:10.041865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68d71b5a-6243-41c6-92be-1552999029ee tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:10.042314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68d71b5a-6243-41c6-92be-1552999029ee tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:10.043231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68d71b5a-6243-41c6-92be-1552999029ee tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:10.043533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68d71b5a-6243-41c6-92be-1552999029ee tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:10.043971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68d71b5a-6243-41c6-92be-1552999029ee tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:10.081360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cc23f797-a2a5-4519-8b33-a3fa81237378 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:10.090868 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cc23f797-a2a5-4519-8b33-a3fa81237378 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.188973 Aug 23 18:09:10.104531 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1883/3836] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:09 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:10.112353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb0b4b05-28a0-4352-bbf6-04a4a4de0b13 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:10.119784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb0b4b05-28a0-4352-bbf6-04a4a4de0b13 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:10.120284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb0b4b05-28a0-4352-bbf6-04a4a4de0b13 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:10.120731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb0b4b05-28a0-4352-bbf6-04a4a4de0b13 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:10.147198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eb0b4b05-28a0-4352-bbf6-04a4a4de0b13 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Going to try to stop instance {{(pid=128807) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 18:09:10.215301 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eb0b4b05-28a0-4352-bbf6-04a4a4de0b13 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.106857 Aug 23 18:09:10.216232 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1884/3837] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:09:10 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:09:10.226017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-68d71b5a-6243-41c6-92be-1552999029ee tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:10.226831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf8ebeb2-debd-495d-b3c3-1611064dbd90 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:10.227962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bf8ebeb2-debd-495d-b3c3-1611064dbd90 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:10.235201 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-68d71b5a-6243-41c6-92be-1552999029ee tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1315 microversion: 2.1 time: 0.205327 Aug 23 18:09:10.236200 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1954/3838] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:10 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:09:10.240976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8ebeb2-debd-495d-b3c3-1611064dbd90 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:10.241790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8ebeb2-debd-495d-b3c3-1611064dbd90 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:10.242424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8ebeb2-debd-495d-b3c3-1611064dbd90 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:10.243410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8ebeb2-debd-495d-b3c3-1611064dbd90 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:10.244037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8ebeb2-debd-495d-b3c3-1611064dbd90 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:10.244635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8ebeb2-debd-495d-b3c3-1611064dbd90 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:10.252965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:10.427664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bf8ebeb2-debd-495d-b3c3-1611064dbd90 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:10.436374 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bf8ebeb2-debd-495d-b3c3-1611064dbd90 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.215723 Aug 23 18:09:10.437314 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1885/3839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:10 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:11.258394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3022c08-a925-439f-9b12-6b62c2c47824 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:11.258996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f3022c08-a925-439f-9b12-6b62c2c47824 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:11.266521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3022c08-a925-439f-9b12-6b62c2c47824 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:11.267056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3022c08-a925-439f-9b12-6b62c2c47824 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:11.267559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3022c08-a925-439f-9b12-6b62c2c47824 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:11.268275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3022c08-a925-439f-9b12-6b62c2c47824 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:11.268743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3022c08-a925-439f-9b12-6b62c2c47824 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:11.269184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3022c08-a925-439f-9b12-6b62c2c47824 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:11.417006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f3022c08-a925-439f-9b12-6b62c2c47824 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:11.425321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f3022c08-a925-439f-9b12-6b62c2c47824 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1315 microversion: 2.1 time: 0.171803 Aug 23 18:09:11.426595 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1955/3840] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:11 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:11.457751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c44e87f1-401c-4c10-88c6-dcccaa82d822 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:11.458570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c44e87f1-401c-4c10-88c6-dcccaa82d822 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:11.467071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c44e87f1-401c-4c10-88c6-dcccaa82d822 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:11.467682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c44e87f1-401c-4c10-88c6-dcccaa82d822 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:11.468193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c44e87f1-401c-4c10-88c6-dcccaa82d822 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:11.468965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c44e87f1-401c-4c10-88c6-dcccaa82d822 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:11.469875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c44e87f1-401c-4c10-88c6-dcccaa82d822 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:11.470310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c44e87f1-401c-4c10-88c6-dcccaa82d822 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:11.609679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c44e87f1-401c-4c10-88c6-dcccaa82d822 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:11.618036 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c44e87f1-401c-4c10-88c6-dcccaa82d822 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.164717 Aug 23 18:09:11.618631 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1886/3841] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:11 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:12.447531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9b08a935-e964-4c94-94d7-ee853550fb46 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:12.448941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9b08a935-e964-4c94-94d7-ee853550fb46 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:12.456022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b08a935-e964-4c94-94d7-ee853550fb46 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:12.456773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b08a935-e964-4c94-94d7-ee853550fb46 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:12.457985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b08a935-e964-4c94-94d7-ee853550fb46 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:12.458759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b08a935-e964-4c94-94d7-ee853550fb46 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:12.459233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b08a935-e964-4c94-94d7-ee853550fb46 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:12.459674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9b08a935-e964-4c94-94d7-ee853550fb46 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:12.487254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:12.500405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:12.639437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e3df23d7-70d4-44e3-8fc4-bb0dd0735eb7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:12.640133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e3df23d7-70d4-44e3-8fc4-bb0dd0735eb7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:12.647885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3df23d7-70d4-44e3-8fc4-bb0dd0735eb7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:12.648456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3df23d7-70d4-44e3-8fc4-bb0dd0735eb7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:12.648972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3df23d7-70d4-44e3-8fc4-bb0dd0735eb7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:12.649896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3df23d7-70d4-44e3-8fc4-bb0dd0735eb7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:12.650845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3df23d7-70d4-44e3-8fc4-bb0dd0735eb7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:12.651346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3df23d7-70d4-44e3-8fc4-bb0dd0735eb7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:12.654412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9b08a935-e964-4c94-94d7-ee853550fb46 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:12.664089 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9b08a935-e964-4c94-94d7-ee853550fb46 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1315 microversion: 2.1 time: 0.220272 Aug 23 18:09:12.665005 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1956/3842] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:12 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:12.712966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:12.790148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e3df23d7-70d4-44e3-8fc4-bb0dd0735eb7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:12.798283 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e3df23d7-70d4-44e3-8fc4-bb0dd0735eb7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.162871 Aug 23 18:09:12.798889 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1887/3843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:12 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:09:13.685554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-896fb5e2-70e1-4742-a3c6-81d5846a3ebf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:13.690905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-896fb5e2-70e1-4742-a3c6-81d5846a3ebf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:13.716535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-896fb5e2-70e1-4742-a3c6-81d5846a3ebf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:13.717043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-896fb5e2-70e1-4742-a3c6-81d5846a3ebf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:13.717488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-896fb5e2-70e1-4742-a3c6-81d5846a3ebf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:13.718207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-896fb5e2-70e1-4742-a3c6-81d5846a3ebf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:13.718703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-896fb5e2-70e1-4742-a3c6-81d5846a3ebf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:13.719339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-896fb5e2-70e1-4742-a3c6-81d5846a3ebf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:13.821282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b191c91-efcf-4ae7-bc7d-6421d48b7bc1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:13.822468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4b191c91-efcf-4ae7-bc7d-6421d48b7bc1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:13.830340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b191c91-efcf-4ae7-bc7d-6421d48b7bc1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:13.831220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b191c91-efcf-4ae7-bc7d-6421d48b7bc1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:13.832410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b191c91-efcf-4ae7-bc7d-6421d48b7bc1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:13.833642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b191c91-efcf-4ae7-bc7d-6421d48b7bc1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:13.834478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b191c91-efcf-4ae7-bc7d-6421d48b7bc1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:13.835171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b191c91-efcf-4ae7-bc7d-6421d48b7bc1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:13.887079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-896fb5e2-70e1-4742-a3c6-81d5846a3ebf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:13.899102 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-896fb5e2-70e1-4742-a3c6-81d5846a3ebf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1315 microversion: 2.1 time: 0.216696 Aug 23 18:09:13.900359 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1957/3844] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:13 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:13.921789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-b6161049-d900-4ce6-8d33-fb33f350630c req-2acc9ccc-ac34-4604-bd68-6bbbeafbe5af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ededd5-baef-4b7b-9c5b-72064a009fdc", "name": "network-vif-plugged", "status": "completed", "tag": "d5b1a992-c926-4f56-a621-fd86850403cd"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:13.940737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b6161049-d900-4ce6-8d33-fb33f350630c req-2acc9ccc-ac34-4604-bd68-6bbbeafbe5af service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:13.941230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b6161049-d900-4ce6-8d33-fb33f350630c req-2acc9ccc-ac34-4604-bd68-6bbbeafbe5af service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:13.942733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b6161049-d900-4ce6-8d33-fb33f350630c req-2acc9ccc-ac34-4604-bd68-6bbbeafbe5af service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:13.961419 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b6161049-d900-4ce6-8d33-fb33f350630c req-2acc9ccc-ac34-4604-bd68-6bbbeafbe5af service nova] Creating event network-vif-plugged:d5b1a992-c926-4f56-a621-fd86850403cd for instance 57ededd5-baef-4b7b-9c5b-72064a009fdc on n-h2-850468-16 Aug 23 18:09:13.968867 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-b6161049-d900-4ce6-8d33-fb33f350630c req-2acc9ccc-ac34-4604-bd68-6bbbeafbe5af service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053353 Aug 23 18:09:13.970143 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1958/3845] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:09:14.008730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4b191c91-efcf-4ae7-bc7d-6421d48b7bc1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:14.018284 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b191c91-efcf-4ae7-bc7d-6421d48b7bc1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.203215 Aug 23 18:09:14.018916 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1888/3846] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:13 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:14.921853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d6242e20-e527-4811-aec9-152e93bff391 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:14.922593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d6242e20-e527-4811-aec9-152e93bff391 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:14.931778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6242e20-e527-4811-aec9-152e93bff391 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:14.932271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6242e20-e527-4811-aec9-152e93bff391 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:14.932710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6242e20-e527-4811-aec9-152e93bff391 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:14.933441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6242e20-e527-4811-aec9-152e93bff391 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:14.933878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6242e20-e527-4811-aec9-152e93bff391 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:14.934304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6242e20-e527-4811-aec9-152e93bff391 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:15.041778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c3a84e1-9e53-4872-9403-39e38dbaa06d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:15.043161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c3a84e1-9e53-4872-9403-39e38dbaa06d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:15.050465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c3a84e1-9e53-4872-9403-39e38dbaa06d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:15.052425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c3a84e1-9e53-4872-9403-39e38dbaa06d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:15.053134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c3a84e1-9e53-4872-9403-39e38dbaa06d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:15.054095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c3a84e1-9e53-4872-9403-39e38dbaa06d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:15.054917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c3a84e1-9e53-4872-9403-39e38dbaa06d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:15.055640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c3a84e1-9e53-4872-9403-39e38dbaa06d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:15.087288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d6242e20-e527-4811-aec9-152e93bff391 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:15.095924 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d6242e20-e527-4811-aec9-152e93bff391 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1315 microversion: 2.1 time: 0.178726 Aug 23 18:09:15.096501 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1959/3847] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:14 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:15.219693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c3a84e1-9e53-4872-9403-39e38dbaa06d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:15.228171 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c3a84e1-9e53-4872-9403-39e38dbaa06d tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.190187 Aug 23 18:09:15.228755 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1889/3848] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:15 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:16.117370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c8c30f3f-7071-4c54-8de5-4d3be6226cac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:16.118101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c8c30f3f-7071-4c54-8de5-4d3be6226cac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:16.125223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8c30f3f-7071-4c54-8de5-4d3be6226cac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:16.125799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8c30f3f-7071-4c54-8de5-4d3be6226cac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:16.126334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8c30f3f-7071-4c54-8de5-4d3be6226cac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:16.127141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8c30f3f-7071-4c54-8de5-4d3be6226cac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:16.127671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8c30f3f-7071-4c54-8de5-4d3be6226cac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:16.128170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8c30f3f-7071-4c54-8de5-4d3be6226cac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:16.250465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-831a980b-34fd-4ff1-9da8-454786bf7ec2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:16.251800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-831a980b-34fd-4ff1-9da8-454786bf7ec2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:16.260962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-831a980b-34fd-4ff1-9da8-454786bf7ec2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:16.261758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-831a980b-34fd-4ff1-9da8-454786bf7ec2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:16.262414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-831a980b-34fd-4ff1-9da8-454786bf7ec2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:16.263402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-831a980b-34fd-4ff1-9da8-454786bf7ec2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:16.264077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-831a980b-34fd-4ff1-9da8-454786bf7ec2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:16.264732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-831a980b-34fd-4ff1-9da8-454786bf7ec2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:16.272806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c8c30f3f-7071-4c54-8de5-4d3be6226cac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:16.283334 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c8c30f3f-7071-4c54-8de5-4d3be6226cac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1501 microversion: 2.1 time: 0.170215 Aug 23 18:09:16.298694 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1960/3849] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:16 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:16.314692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-710823cb-2c71-474e-aa50-ad7a3029f0b5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:16.315211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-710823cb-2c71-474e-aa50-ad7a3029f0b5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:16.323702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-710823cb-2c71-474e-aa50-ad7a3029f0b5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:16.324198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-710823cb-2c71-474e-aa50-ad7a3029f0b5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:16.324645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-710823cb-2c71-474e-aa50-ad7a3029f0b5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:16.325363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-710823cb-2c71-474e-aa50-ad7a3029f0b5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:16.325828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-710823cb-2c71-474e-aa50-ad7a3029f0b5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:16.326262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-710823cb-2c71-474e-aa50-ad7a3029f0b5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:16.369026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-710823cb-2c71-474e-aa50-ad7a3029f0b5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:09:16.453974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:16.482286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-831a980b-34fd-4ff1-9da8-454786bf7ec2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:16.492047 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-710823cb-2c71-474e-aa50-ad7a3029f0b5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 204 len: 0 microversion: 2.1 time: 0.181255 Aug 23 18:09:16.493042 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1961/3850] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:09:16 2022] DELETE /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:09:16.497861 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-831a980b-34fd-4ff1-9da8-454786bf7ec2 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.251242 Aug 23 18:09:16.498692 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1890/3851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:16 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:09:16.502714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3ac5007d-646b-43c2-8f4f-19b60680f000 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:16.503729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3ac5007d-646b-43c2-8f4f-19b60680f000 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:16.512793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ac5007d-646b-43c2-8f4f-19b60680f000 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:16.513693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ac5007d-646b-43c2-8f4f-19b60680f000 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:16.514219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ac5007d-646b-43c2-8f4f-19b60680f000 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:16.515030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ac5007d-646b-43c2-8f4f-19b60680f000 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:16.515492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ac5007d-646b-43c2-8f4f-19b60680f000 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:16.515919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ac5007d-646b-43c2-8f4f-19b60680f000 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:16.670454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3ac5007d-646b-43c2-8f4f-19b60680f000 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:16.680593 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3ac5007d-646b-43c2-8f4f-19b60680f000 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1507 microversion: 2.1 time: 0.182062 Aug 23 18:09:16.681259 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1962/3852] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:16 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:17.520602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c012fa90-e0fa-45e1-b4c0-d238f2175b36 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:17.521207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c012fa90-e0fa-45e1-b4c0-d238f2175b36 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:17.528574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c012fa90-e0fa-45e1-b4c0-d238f2175b36 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:17.529068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c012fa90-e0fa-45e1-b4c0-d238f2175b36 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:17.529511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c012fa90-e0fa-45e1-b4c0-d238f2175b36 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:17.530215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c012fa90-e0fa-45e1-b4c0-d238f2175b36 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:17.530895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c012fa90-e0fa-45e1-b4c0-d238f2175b36 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:17.531325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c012fa90-e0fa-45e1-b4c0-d238f2175b36 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:17.696865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c012fa90-e0fa-45e1-b4c0-d238f2175b36 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:17.701499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a97c3a94-8e32-4b7f-a9b4-48a75a37a052 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:17.702124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a97c3a94-8e32-4b7f-a9b4-48a75a37a052 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:17.706296 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c012fa90-e0fa-45e1-b4c0-d238f2175b36 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.190326 Aug 23 18:09:17.706972 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1891/3853] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:17 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:17.732968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a97c3a94-8e32-4b7f-a9b4-48a75a37a052 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:17.733405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a97c3a94-8e32-4b7f-a9b4-48a75a37a052 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:17.733852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a97c3a94-8e32-4b7f-a9b4-48a75a37a052 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:17.734603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a97c3a94-8e32-4b7f-a9b4-48a75a37a052 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:17.735068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a97c3a94-8e32-4b7f-a9b4-48a75a37a052 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:17.735503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a97c3a94-8e32-4b7f-a9b4-48a75a37a052 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:17.882124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a97c3a94-8e32-4b7f-a9b4-48a75a37a052 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:17.903141 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a97c3a94-8e32-4b7f-a9b4-48a75a37a052 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1507 microversion: 2.1 time: 0.205722 Aug 23 18:09:17.904030 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1963/3854] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:17 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:18.625873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-42e01aad-3311-442e-b4eb-251b5e928bb4 req-a19acc3f-aaf2-42e7-abaa-7291841b7d22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57ededd5-baef-4b7b-9c5b-72064a009fdc", "name": "network-vif-deleted", "tag": "d5b1a992-c926-4f56-a621-fd86850403cd"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:18.639937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-42e01aad-3311-442e-b4eb-251b5e928bb4 req-a19acc3f-aaf2-42e7-abaa-7291841b7d22 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:18.640401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-42e01aad-3311-442e-b4eb-251b5e928bb4 req-a19acc3f-aaf2-42e7-abaa-7291841b7d22 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:18.640826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-42e01aad-3311-442e-b4eb-251b5e928bb4 req-a19acc3f-aaf2-42e7-abaa-7291841b7d22 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:18.656466 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-42e01aad-3311-442e-b4eb-251b5e928bb4 req-a19acc3f-aaf2-42e7-abaa-7291841b7d22 service nova] Creating event network-vif-deleted:d5b1a992-c926-4f56-a621-fd86850403cd for instance 57ededd5-baef-4b7b-9c5b-72064a009fdc on n-h2-850468-16 Aug 23 18:09:18.663154 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-42e01aad-3311-442e-b4eb-251b5e928bb4 req-a19acc3f-aaf2-42e7-abaa-7291841b7d22 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040951 Aug 23 18:09:18.666353 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1892/3855] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:09:18.728292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5db2312b-e538-4a6f-a7af-6f19c9787787 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:18.729027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5db2312b-e538-4a6f-a7af-6f19c9787787 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:18.736363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5db2312b-e538-4a6f-a7af-6f19c9787787 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:18.737140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5db2312b-e538-4a6f-a7af-6f19c9787787 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:18.737784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5db2312b-e538-4a6f-a7af-6f19c9787787 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:18.739513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5db2312b-e538-4a6f-a7af-6f19c9787787 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:18.740161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5db2312b-e538-4a6f-a7af-6f19c9787787 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:18.740952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5db2312b-e538-4a6f-a7af-6f19c9787787 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:18.892560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5db2312b-e538-4a6f-a7af-6f19c9787787 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:18.901943 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5db2312b-e538-4a6f-a7af-6f19c9787787 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.177734 Aug 23 18:09:18.902552 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1964/3856] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:18 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:18.925277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:18.926368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:18.935648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:18.936148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:18.936619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:18.937333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:18.937797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:18.938227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:18.977541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:18.978332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:18.978805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:18.979261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lazy-loading 'fault' on Instance uuid 57ededd5-baef-4b7b-9c5b-72064a009fdc {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:09:19.028247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:19.038941 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b23547c2-f461-4f21-b4b5-61ba51d460c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 200 len: 1305 microversion: 2.1 time: 0.117726 Aug 23 18:09:19.040378 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1893/3857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:18 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 1305 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:19.923689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-780f5980-2882-4b51-9eb4-92323553a040 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:19.924687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-780f5980-2882-4b51-9eb4-92323553a040 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:19.935352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-780f5980-2882-4b51-9eb4-92323553a040 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:19.935352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-780f5980-2882-4b51-9eb4-92323553a040 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:19.935352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-780f5980-2882-4b51-9eb4-92323553a040 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:19.935352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-780f5980-2882-4b51-9eb4-92323553a040 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:19.935352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-780f5980-2882-4b51-9eb4-92323553a040 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:19.943073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-780f5980-2882-4b51-9eb4-92323553a040 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:20.065527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-70303a89-6812-4099-91bf-a7379ac75227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:20.066187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-70303a89-6812-4099-91bf-a7379ac75227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:20.076950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70303a89-6812-4099-91bf-a7379ac75227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:20.078116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70303a89-6812-4099-91bf-a7379ac75227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:20.078885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70303a89-6812-4099-91bf-a7379ac75227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:20.080078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70303a89-6812-4099-91bf-a7379ac75227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:20.081298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70303a89-6812-4099-91bf-a7379ac75227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:20.081987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70303a89-6812-4099-91bf-a7379ac75227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:20.088952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-780f5980-2882-4b51-9eb4-92323553a040 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:20.100814 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-780f5980-2882-4b51-9eb4-92323553a040 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1679 microversion: 2.1 time: 0.181169 Aug 23 18:09:20.101787 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-70303a89-6812-4099-91bf-a7379ac75227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-70303a89-6812-4099-91bf-a7379ac75227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc HTTP/1.1 Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '57ededd5-baef-4b7b-9c5b-72064a009fdc'} Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:20.104620 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:20.109972 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:20.109972 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:20.109972 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:20.109972 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:09:20.109972 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:09:20.109972 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:09:20.109972 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:20.115666 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1965/3858] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:19 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1679 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:20.120396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-70303a89-6812-4099-91bf-a7379ac75227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:09:20.121158 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-70303a89-6812-4099-91bf-a7379ac75227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 404 len: 111 microversion: 2.1 time: 0.061872 Aug 23 18:09:20.122482 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1894/3859] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:20 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:09:20.228573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2143094168", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "2590bb5f-8ace-41d9-ae28-2d05e6f1fbab"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:20.285210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] validate_networks() for [('2590bb5f-8ace-41d9-ae28-2d05e6f1fbab', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:09:21.123569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f9f7b073-9b23-47d2-9eeb-b2f1e3d41349 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:21.124291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f9f7b073-9b23-47d2-9eeb-b2f1e3d41349 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:21.131603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9f7b073-9b23-47d2-9eeb-b2f1e3d41349 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:21.132088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9f7b073-9b23-47d2-9eeb-b2f1e3d41349 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:21.132526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9f7b073-9b23-47d2-9eeb-b2f1e3d41349 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:21.133300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9f7b073-9b23-47d2-9eeb-b2f1e3d41349 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:21.133754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9f7b073-9b23-47d2-9eeb-b2f1e3d41349 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:21.134177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9f7b073-9b23-47d2-9eeb-b2f1e3d41349 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:21.157993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:09:21.158595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:09:21.158818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:09:21.159238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:09:21.159710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:09:21.172007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:21.172916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:21.173614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:21.174672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:21.175401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:21.176805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:21.195891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:09:21.203176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for user 2380358bc6a7496ead343b351bce816d and project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:09:21.219277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:09:21.222198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:09:21.277202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f9f7b073-9b23-47d2-9eeb-b2f1e3d41349 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:21.287973 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6612a7aa-ed04-476e-bfe7-3a8d56b83125 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.063379 Aug 23 18:09:21.288837 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1966/3860] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:09:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:09:21.300253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a26a3d82-9011-472e-b834-31ea614a9b83 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:21.301877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a26a3d82-9011-472e-b834-31ea614a9b83 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:21.303377 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f9f7b073-9b23-47d2-9eeb-b2f1e3d41349 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1656 microversion: 2.1 time: 0.183518 Aug 23 18:09:21.321300 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1895/3861] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:21 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1656 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:09:21.327923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a9cd2da-9971-49fa-9b17-824ca50825fd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:21.363056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a9cd2da-9971-49fa-9b17-824ca50825fd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:21.366384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a9cd2da-9971-49fa-9b17-824ca50825fd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:21.367093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a9cd2da-9971-49fa-9b17-824ca50825fd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:21.384263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a26a3d82-9011-472e-b834-31ea614a9b83 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:21.392100 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a26a3d82-9011-472e-b834-31ea614a9b83 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1215 microversion: 2.1 time: 0.096421 Aug 23 18:09:21.392701 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1967/3862] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:21 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:09:21.421303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6a9cd2da-9971-49fa-9b17-824ca50825fd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Going to try to start instance {{(pid=128807) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 18:09:21.495453 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a9cd2da-9971-49fa-9b17-824ca50825fd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.169492 Aug 23 18:09:21.500440 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1896/3863] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:09:21 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:09:21.511252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a94219c-995c-4a99-8d95-b016c5646a49 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:21.512597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6a94219c-995c-4a99-8d95-b016c5646a49 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:21.527182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a94219c-995c-4a99-8d95-b016c5646a49 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:21.528000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a94219c-995c-4a99-8d95-b016c5646a49 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:21.528869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a94219c-995c-4a99-8d95-b016c5646a49 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:21.529862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a94219c-995c-4a99-8d95-b016c5646a49 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:21.530385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a94219c-995c-4a99-8d95-b016c5646a49 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:21.530789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a94219c-995c-4a99-8d95-b016c5646a49 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:21.723797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6a94219c-995c-4a99-8d95-b016c5646a49 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:21.733898 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6a94219c-995c-4a99-8d95-b016c5646a49 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1665 microversion: 2.1 time: 0.231025 Aug 23 18:09:21.734907 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1968/3864] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:21 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1665 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:22.415079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d5fe49e1-0987-41e8-af9a-a82c6a90883b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:22.415933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d5fe49e1-0987-41e8-af9a-a82c6a90883b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:22.422798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5fe49e1-0987-41e8-af9a-a82c6a90883b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:22.423736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5fe49e1-0987-41e8-af9a-a82c6a90883b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:22.424284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5fe49e1-0987-41e8-af9a-a82c6a90883b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:22.425136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5fe49e1-0987-41e8-af9a-a82c6a90883b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:22.426282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5fe49e1-0987-41e8-af9a-a82c6a90883b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:22.426842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5fe49e1-0987-41e8-af9a-a82c6a90883b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:22.497790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d5fe49e1-0987-41e8-af9a-a82c6a90883b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:22.506662 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d5fe49e1-0987-41e8-af9a-a82c6a90883b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1267 microversion: 2.1 time: 0.097020 Aug 23 18:09:22.507239 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1897/3865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:22 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1267 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:22.759148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-515fa620-5268-446e-9132-c8bdc6398bc8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:22.760572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-515fa620-5268-446e-9132-c8bdc6398bc8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:22.772707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-515fa620-5268-446e-9132-c8bdc6398bc8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:22.773341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-515fa620-5268-446e-9132-c8bdc6398bc8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:22.773844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-515fa620-5268-446e-9132-c8bdc6398bc8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:22.774567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-515fa620-5268-446e-9132-c8bdc6398bc8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:22.775036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-515fa620-5268-446e-9132-c8bdc6398bc8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:22.775594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-515fa620-5268-446e-9132-c8bdc6398bc8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:22.998878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-515fa620-5268-446e-9132-c8bdc6398bc8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:23.008715 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-515fa620-5268-446e-9132-c8bdc6398bc8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1665 microversion: 2.1 time: 0.256214 Aug 23 18:09:23.009319 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1969/3866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:22 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1665 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:23.531921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0f6b8ace-f36b-4fcf-b372-4b60a6e255ad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:23.533861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0f6b8ace-f36b-4fcf-b372-4b60a6e255ad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:23.543433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f6b8ace-f36b-4fcf-b372-4b60a6e255ad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:23.544422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f6b8ace-f36b-4fcf-b372-4b60a6e255ad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:23.545174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f6b8ace-f36b-4fcf-b372-4b60a6e255ad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:23.546375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f6b8ace-f36b-4fcf-b372-4b60a6e255ad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:23.547113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f6b8ace-f36b-4fcf-b372-4b60a6e255ad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:23.547783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f6b8ace-f36b-4fcf-b372-4b60a6e255ad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:23.797402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0f6b8ace-f36b-4fcf-b372-4b60a6e255ad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:23.807656 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0f6b8ace-f36b-4fcf-b372-4b60a6e255ad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1315 microversion: 2.1 time: 0.281503 Aug 23 18:09:23.808400 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1898/3867] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:23 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1315 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:24.031126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b25ed3da-1234-4c4f-b711-268fd45a0baf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:24.031748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b25ed3da-1234-4c4f-b711-268fd45a0baf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:24.039706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b25ed3da-1234-4c4f-b711-268fd45a0baf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:24.040200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b25ed3da-1234-4c4f-b711-268fd45a0baf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:24.040638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b25ed3da-1234-4c4f-b711-268fd45a0baf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:24.041350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b25ed3da-1234-4c4f-b711-268fd45a0baf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:24.041804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b25ed3da-1234-4c4f-b711-268fd45a0baf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:24.042233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b25ed3da-1234-4c4f-b711-268fd45a0baf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:24.186394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b25ed3da-1234-4c4f-b711-268fd45a0baf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:24.196006 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b25ed3da-1234-4c4f-b711-268fd45a0baf tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.168635 Aug 23 18:09:24.196819 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1970/3868] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:24 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:24.217903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b276c2c-ab03-4adc-804c-2bd4423f13f5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:24.218525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4b276c2c-ab03-4adc-804c-2bd4423f13f5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:24.225713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b276c2c-ab03-4adc-804c-2bd4423f13f5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:24.226134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b276c2c-ab03-4adc-804c-2bd4423f13f5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:24.226607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b276c2c-ab03-4adc-804c-2bd4423f13f5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:24.227327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b276c2c-ab03-4adc-804c-2bd4423f13f5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:24.227783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b276c2c-ab03-4adc-804c-2bd4423f13f5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:24.228208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b276c2c-ab03-4adc-804c-2bd4423f13f5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:24.501332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4b276c2c-ab03-4adc-804c-2bd4423f13f5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:24.511689 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b276c2c-ab03-4adc-804c-2bd4423f13f5 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.297879 Aug 23 18:09:24.512612 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1899/3869] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:24 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:24.541389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2785d9a-7deb-41f1-ac71-c72ba52cc892 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:24.542198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f2785d9a-7deb-41f1-ac71-c72ba52cc892 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:24.549379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2785d9a-7deb-41f1-ac71-c72ba52cc892 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:24.550021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2785d9a-7deb-41f1-ac71-c72ba52cc892 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:24.551244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2785d9a-7deb-41f1-ac71-c72ba52cc892 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:24.552530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2785d9a-7deb-41f1-ac71-c72ba52cc892 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:24.553257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2785d9a-7deb-41f1-ac71-c72ba52cc892 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:24.553847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2785d9a-7deb-41f1-ac71-c72ba52cc892 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:24.809044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f2785d9a-7deb-41f1-ac71-c72ba52cc892 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:24.820065 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f2785d9a-7deb-41f1-ac71-c72ba52cc892 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.283329 Aug 23 18:09:24.824063 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1971/3870] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:24 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:24.824235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2bf348e8-aaad-40b8-8aa2-0fa696a51cc6 req-c986d333-3ff2-4ac6-a3ba-2e754b340d7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95c517c5-e5ab-4249-ab03-e6b2fc0c8e67", "tag": "4f663bff-de08-40b6-ad3b-3dd1fecf560c"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:24.842367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f110fbb-642b-4374-87d2-04056f36d8c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:24.934196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7f110fbb-642b-4374-87d2-04056f36d8c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:24.934196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f110fbb-642b-4374-87d2-04056f36d8c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:24.935722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2bf348e8-aaad-40b8-8aa2-0fa696a51cc6 req-c986d333-3ff2-4ac6-a3ba-2e754b340d7a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:24.935901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f110fbb-642b-4374-87d2-04056f36d8c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:24.935972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2bf348e8-aaad-40b8-8aa2-0fa696a51cc6 req-c986d333-3ff2-4ac6-a3ba-2e754b340d7a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:24.935972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2bf348e8-aaad-40b8-8aa2-0fa696a51cc6 req-c986d333-3ff2-4ac6-a3ba-2e754b340d7a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:24.936086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f110fbb-642b-4374-87d2-04056f36d8c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:24.936086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f110fbb-642b-4374-87d2-04056f36d8c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:24.936086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f110fbb-642b-4374-87d2-04056f36d8c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:24.936086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f110fbb-642b-4374-87d2-04056f36d8c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:24.936379 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2bf348e8-aaad-40b8-8aa2-0fa696a51cc6 req-c986d333-3ff2-4ac6-a3ba-2e754b340d7a service nova] Creating event network-changed:4f663bff-de08-40b6-ad3b-3dd1fecf560c for instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 on n-h2-850468-16 Aug 23 18:09:24.936379 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2bf348e8-aaad-40b8-8aa2-0fa696a51cc6 req-c986d333-3ff2-4ac6-a3ba-2e754b340d7a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072321 Aug 23 18:09:24.936379 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1900/3871] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:09:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:09:24.936379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dc11d35e-8e3b-42ca-8381-0661333ceade tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:24.936379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dc11d35e-8e3b-42ca-8381-0661333ceade tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:24.936379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc11d35e-8e3b-42ca-8381-0661333ceade tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:24.936379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc11d35e-8e3b-42ca-8381-0661333ceade tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:24.936379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc11d35e-8e3b-42ca-8381-0661333ceade tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:24.936379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc11d35e-8e3b-42ca-8381-0661333ceade tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:24.936379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc11d35e-8e3b-42ca-8381-0661333ceade tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:24.936379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc11d35e-8e3b-42ca-8381-0661333ceade tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:25.043024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7f110fbb-642b-4374-87d2-04056f36d8c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:25.051514 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7f110fbb-642b-4374-87d2-04056f36d8c6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1315 microversion: 2.1 time: 0.213315 Aug 23 18:09:25.052105 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1972/3872] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:24 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:09:25.148394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dc11d35e-8e3b-42ca-8381-0661333ceade tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:25.156203 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dc11d35e-8e3b-42ca-8381-0661333ceade tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.263581 Aug 23 18:09:25.156781 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1901/3873] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:24 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:25.176027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d10adda3-1b39-4250-93e7-5d0c53c3ce65 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:25.176744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d10adda3-1b39-4250-93e7-5d0c53c3ce65 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:25.182839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d10adda3-1b39-4250-93e7-5d0c53c3ce65 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:25.183327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d10adda3-1b39-4250-93e7-5d0c53c3ce65 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:25.183760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d10adda3-1b39-4250-93e7-5d0c53c3ce65 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:25.184452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d10adda3-1b39-4250-93e7-5d0c53c3ce65 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:25.184904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d10adda3-1b39-4250-93e7-5d0c53c3ce65 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:25.185331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d10adda3-1b39-4250-93e7-5d0c53c3ce65 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:25.318233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d10adda3-1b39-4250-93e7-5d0c53c3ce65 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:25.326704 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d10adda3-1b39-4250-93e7-5d0c53c3ce65 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.154681 Aug 23 18:09:25.327437 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1973/3874] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:25 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:25.348366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-13b5c93a-c979-4c52-9dbd-e68b60a30bd0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:25.348912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-13b5c93a-c979-4c52-9dbd-e68b60a30bd0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:25.354984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13b5c93a-c979-4c52-9dbd-e68b60a30bd0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:25.355480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13b5c93a-c979-4c52-9dbd-e68b60a30bd0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:25.355924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13b5c93a-c979-4c52-9dbd-e68b60a30bd0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:25.356632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13b5c93a-c979-4c52-9dbd-e68b60a30bd0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:25.357095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13b5c93a-c979-4c52-9dbd-e68b60a30bd0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:25.357525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13b5c93a-c979-4c52-9dbd-e68b60a30bd0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:25.376058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:25.383424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-13b5c93a-c979-4c52-9dbd-e68b60a30bd0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lazy-loading 'flavor' on Instance uuid 9d81bbbc-0ed1-445b-a321-b2175e975725 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:09:25.451731 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-13b5c93a-c979-4c52-9dbd-e68b60a30bd0 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.107661 Aug 23 18:09:25.452565 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1902/3875] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:09:25 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:09:25.462108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-69a3bc69-f76f-4847-b0f1-dbb1b16d15aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:25.463644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-69a3bc69-f76f-4847-b0f1-dbb1b16d15aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:25.472003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69a3bc69-f76f-4847-b0f1-dbb1b16d15aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:25.473235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69a3bc69-f76f-4847-b0f1-dbb1b16d15aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:25.474159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69a3bc69-f76f-4847-b0f1-dbb1b16d15aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:25.474920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69a3bc69-f76f-4847-b0f1-dbb1b16d15aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:25.475386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69a3bc69-f76f-4847-b0f1-dbb1b16d15aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:25.475817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69a3bc69-f76f-4847-b0f1-dbb1b16d15aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:25.627537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-69a3bc69-f76f-4847-b0f1-dbb1b16d15aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:25.636730 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-69a3bc69-f76f-4847-b0f1-dbb1b16d15aa tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1677 microversion: 2.1 time: 0.179827 Aug 23 18:09:25.637412 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1974/3876] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:25 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:26.074763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7163cbd3-f375-41b1-b85e-4bd61089dd91 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:26.075398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7163cbd3-f375-41b1-b85e-4bd61089dd91 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:26.082366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7163cbd3-f375-41b1-b85e-4bd61089dd91 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:26.083031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7163cbd3-f375-41b1-b85e-4bd61089dd91 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:26.083474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7163cbd3-f375-41b1-b85e-4bd61089dd91 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:26.084175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7163cbd3-f375-41b1-b85e-4bd61089dd91 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:26.084633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7163cbd3-f375-41b1-b85e-4bd61089dd91 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:26.085204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7163cbd3-f375-41b1-b85e-4bd61089dd91 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:26.228461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7163cbd3-f375-41b1-b85e-4bd61089dd91 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:26.236445 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7163cbd3-f375-41b1-b85e-4bd61089dd91 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1315 microversion: 2.1 time: 0.166770 Aug 23 18:09:26.237032 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1903/3877] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:26 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:26.660439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c1af3d11-993f-435f-a002-afa8e20badb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:26.661353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c1af3d11-993f-435f-a002-afa8e20badb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:26.668587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1af3d11-993f-435f-a002-afa8e20badb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:26.669075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1af3d11-993f-435f-a002-afa8e20badb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:26.669513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1af3d11-993f-435f-a002-afa8e20badb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:26.670216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1af3d11-993f-435f-a002-afa8e20badb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:26.670691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1af3d11-993f-435f-a002-afa8e20badb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:26.671117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1af3d11-993f-435f-a002-afa8e20badb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:26.804713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c1af3d11-993f-435f-a002-afa8e20badb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:26.812743 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c1af3d11-993f-435f-a002-afa8e20badb8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1660 microversion: 2.1 time: 0.156876 Aug 23 18:09:26.813317 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1975/3878] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:26 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1660 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:26.835036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-39fc1ddd-254d-41b5-ac27-511d387a5d44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:26.835582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-39fc1ddd-254d-41b5-ac27-511d387a5d44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:26.841797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39fc1ddd-254d-41b5-ac27-511d387a5d44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:26.842281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39fc1ddd-254d-41b5-ac27-511d387a5d44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:26.842752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39fc1ddd-254d-41b5-ac27-511d387a5d44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:26.843447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39fc1ddd-254d-41b5-ac27-511d387a5d44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:26.843905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39fc1ddd-254d-41b5-ac27-511d387a5d44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:26.844333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39fc1ddd-254d-41b5-ac27-511d387a5d44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:26.914448 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-39fc1ddd-254d-41b5-ac27-511d387a5d44 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action" status: 202 len: 0 microversion: 2.1 time: 0.083668 Aug 23 18:09:26.915043 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1904/3879] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:09:26 2022] POST /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:09:26.923388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1ce67ab1-0dcd-4c9f-aec2-c4422c2ea8e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:26.924013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1ce67ab1-0dcd-4c9f-aec2-c4422c2ea8e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:26.927901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:26.931365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ce67ab1-0dcd-4c9f-aec2-c4422c2ea8e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:26.931884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ce67ab1-0dcd-4c9f-aec2-c4422c2ea8e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:26.932315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ce67ab1-0dcd-4c9f-aec2-c4422c2ea8e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:26.933027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ce67ab1-0dcd-4c9f-aec2-c4422c2ea8e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:26.933492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ce67ab1-0dcd-4c9f-aec2-c4422c2ea8e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:26.933925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ce67ab1-0dcd-4c9f-aec2-c4422c2ea8e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:27.087739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1ce67ab1-0dcd-4c9f-aec2-c4422c2ea8e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:27.095938 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1ce67ab1-0dcd-4c9f-aec2-c4422c2ea8e7 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1666 microversion: 2.1 time: 0.176583 Aug 23 18:09:27.096717 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1976/3880] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:26 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1666 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:27.258881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-894216ab-50a3-4afb-ac22-f488801c170a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:27.260448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-894216ab-50a3-4afb-ac22-f488801c170a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:27.269180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-894216ab-50a3-4afb-ac22-f488801c170a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:27.269882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-894216ab-50a3-4afb-ac22-f488801c170a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:27.270455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-894216ab-50a3-4afb-ac22-f488801c170a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:27.271431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-894216ab-50a3-4afb-ac22-f488801c170a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:27.271961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-894216ab-50a3-4afb-ac22-f488801c170a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:27.272847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-894216ab-50a3-4afb-ac22-f488801c170a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:27.496001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-894216ab-50a3-4afb-ac22-f488801c170a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:27.508691 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-894216ab-50a3-4afb-ac22-f488801c170a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1315 microversion: 2.1 time: 0.255057 Aug 23 18:09:27.509280 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1905/3881] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:27 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:28.117490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adf0169b-47d1-4b89-8e3b-75dfb0503c24 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:28.118202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-adf0169b-47d1-4b89-8e3b-75dfb0503c24 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:28.125277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adf0169b-47d1-4b89-8e3b-75dfb0503c24 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:28.125845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adf0169b-47d1-4b89-8e3b-75dfb0503c24 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:28.126356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adf0169b-47d1-4b89-8e3b-75dfb0503c24 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:28.127173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adf0169b-47d1-4b89-8e3b-75dfb0503c24 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:28.127707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adf0169b-47d1-4b89-8e3b-75dfb0503c24 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:28.128232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adf0169b-47d1-4b89-8e3b-75dfb0503c24 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:28.263501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-adf0169b-47d1-4b89-8e3b-75dfb0503c24 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:28.272790 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-adf0169b-47d1-4b89-8e3b-75dfb0503c24 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1666 microversion: 2.1 time: 0.159232 Aug 23 18:09:28.273686 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1977/3882] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:28 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1666 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:28.530216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7278f7ba-9ff3-4521-8412-7bd43136c852 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:28.531398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7278f7ba-9ff3-4521-8412-7bd43136c852 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:28.539072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7278f7ba-9ff3-4521-8412-7bd43136c852 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:28.539786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7278f7ba-9ff3-4521-8412-7bd43136c852 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:28.540358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7278f7ba-9ff3-4521-8412-7bd43136c852 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:28.541186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7278f7ba-9ff3-4521-8412-7bd43136c852 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:28.541773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7278f7ba-9ff3-4521-8412-7bd43136c852 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:28.542356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7278f7ba-9ff3-4521-8412-7bd43136c852 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:28.787134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7278f7ba-9ff3-4521-8412-7bd43136c852 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:28.796748 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7278f7ba-9ff3-4521-8412-7bd43136c852 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1315 microversion: 2.1 time: 0.269940 Aug 23 18:09:28.797462 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1906/3883] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:28 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:29.295460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-925410a7-cfe0-473b-86a5-c74b6a0bac1c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:29.296600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-925410a7-cfe0-473b-86a5-c74b6a0bac1c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:29.304897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-925410a7-cfe0-473b-86a5-c74b6a0bac1c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:29.305333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-925410a7-cfe0-473b-86a5-c74b6a0bac1c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:29.305985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-925410a7-cfe0-473b-86a5-c74b6a0bac1c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:29.306915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-925410a7-cfe0-473b-86a5-c74b6a0bac1c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:29.307698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-925410a7-cfe0-473b-86a5-c74b6a0bac1c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:29.308368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-925410a7-cfe0-473b-86a5-c74b6a0bac1c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:29.464303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-925410a7-cfe0-473b-86a5-c74b6a0bac1c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:29.473683 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-925410a7-cfe0-473b-86a5-c74b6a0bac1c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.182578 Aug 23 18:09:29.478578 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1978/3884] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:29 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:29.494916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fed9fedd-f5fb-44f7-bd0c-cf7d9be1a510 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:29.495739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fed9fedd-f5fb-44f7-bd0c-cf7d9be1a510 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:29.502445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fed9fedd-f5fb-44f7-bd0c-cf7d9be1a510 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:29.502951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fed9fedd-f5fb-44f7-bd0c-cf7d9be1a510 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:29.503557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fed9fedd-f5fb-44f7-bd0c-cf7d9be1a510 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:29.505503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fed9fedd-f5fb-44f7-bd0c-cf7d9be1a510 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:29.506034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fed9fedd-f5fb-44f7-bd0c-cf7d9be1a510 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:29.506518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fed9fedd-f5fb-44f7-bd0c-cf7d9be1a510 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:29.652791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fed9fedd-f5fb-44f7-bd0c-cf7d9be1a510 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:29.661608 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fed9fedd-f5fb-44f7-bd0c-cf7d9be1a510 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1669 microversion: 2.1 time: 0.170835 Aug 23 18:09:29.662227 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1907/3885] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:29 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1669 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:29.683867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:29.684742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:29.694584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:29.695285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:29.695745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:29.696468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:29.696940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:29.697379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:29.734289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:09:29.737553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:29.742732 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.compute.api [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Working on deleting snapshot 872eea08-bef5-41ac-b560-7e87d7cdc5b2 from shelved instance... Aug 23 18:09:29.820127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cd97072-cec6-4933-9ef4-347a90bd3783 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:29.820747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0cd97072-cec6-4933-9ef4-347a90bd3783 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:29.831043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cd97072-cec6-4933-9ef4-347a90bd3783 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:29.832741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cd97072-cec6-4933-9ef4-347a90bd3783 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:29.833394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cd97072-cec6-4933-9ef4-347a90bd3783 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:29.834320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cd97072-cec6-4933-9ef4-347a90bd3783 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:29.835034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cd97072-cec6-4933-9ef4-347a90bd3783 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:29.835581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cd97072-cec6-4933-9ef4-347a90bd3783 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:29.998677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0cd97072-cec6-4933-9ef4-347a90bd3783 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:30.011504 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0cd97072-cec6-4933-9ef4-347a90bd3783 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1315 microversion: 2.1 time: 0.195175 Aug 23 18:09:30.012851 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1908/3886] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:29 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:30.522084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Doing local delete in cell 410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) {{(pid=128808) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 23 18:09:30.523902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:30.523902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:30.523902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:30.525261 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.compute.api [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 23 18:09:30.530354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] deallocate_for_instance() {{(pid=128808) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 23 18:09:31.037943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4339c48b-27a5-471d-9ff5-b3b2c93e6e67 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:31.039641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4339c48b-27a5-471d-9ff5-b3b2c93e6e67 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:31.066133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4339c48b-27a5-471d-9ff5-b3b2c93e6e67 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:31.066720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4339c48b-27a5-471d-9ff5-b3b2c93e6e67 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:31.069390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4339c48b-27a5-471d-9ff5-b3b2c93e6e67 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:31.069390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4339c48b-27a5-471d-9ff5-b3b2c93e6e67 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:31.069390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4339c48b-27a5-471d-9ff5-b3b2c93e6e67 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:31.070425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4339c48b-27a5-471d-9ff5-b3b2c93e6e67 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:31.182747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Updating instance_info_cache with network_info: [] {{(pid=128808) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 18:09:31.185921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:31.338365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4339c48b-27a5-471d-9ff5-b3b2c93e6e67 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:31.351655 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4339c48b-27a5-471d-9ff5-b3b2c93e6e67 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1315 microversion: 2.1 time: 0.320073 Aug 23 18:09:31.352465 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1909/3887] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:31 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:09:31.357289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-8a7844fe-2010-466e-a07d-c3c89813e9aa req-53ee964b-3f36-4e85-a24c-6a48f4f2798a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "abd63f48-61c9-47c7-a848-14c894fd93b9", "name": "network-vif-deleted", "tag": "df4503b0-060f-457c-8654-872684e34528"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:31.381467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8a7844fe-2010-466e-a07d-c3c89813e9aa req-53ee964b-3f36-4e85-a24c-6a48f4f2798a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:31.382350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8a7844fe-2010-466e-a07d-c3c89813e9aa req-53ee964b-3f36-4e85-a24c-6a48f4f2798a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:31.382963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8a7844fe-2010-466e-a07d-c3c89813e9aa req-53ee964b-3f36-4e85-a24c-6a48f4f2798a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:31.389343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:31.396439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.compute.server_external_events [req-8a7844fe-2010-466e-a07d-c3c89813e9aa req-53ee964b-3f36-4e85-a24c-6a48f4f2798a service nova] Unable to find a host for instance abd63f48-61c9-47c7-a848-14c894fd93b9. Dropping event network-vif-deleted {{(pid=128807) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 18:09:31.397573 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-8a7844fe-2010-466e-a07d-c3c89813e9aa req-53ee964b-3f36-4e85-a24c-6a48f4f2798a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.043791 Aug 23 18:09:31.399234 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1910/3888] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 46 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 18:09:31.672111 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-42e7a26c-3185-422c-a88a-bc218b8079f8 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "DELETE /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 204 len: 0 microversion: 2.1 time: 1.992227 Aug 23 18:09:31.672834 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1979/3889] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:09:29 2022] DELETE /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 0 bytes in 1993 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:09:31.681834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-852f5cce-07b3-450e-98e9-69e31e84b51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:31.682459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-852f5cce-07b3-450e-98e9-69e31e84b51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: abd63f48-61c9-47c7-a848-14c894fd93b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:31.688970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-852f5cce-07b3-450e-98e9-69e31e84b51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:31.689642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-852f5cce-07b3-450e-98e9-69e31e84b51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:31.690080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-852f5cce-07b3-450e-98e9-69e31e84b51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:31.691596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-852f5cce-07b3-450e-98e9-69e31e84b51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:31.692223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-852f5cce-07b3-450e-98e9-69e31e84b51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:31.692785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-852f5cce-07b3-450e-98e9-69e31e84b51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:31.708274 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-852f5cce-07b3-450e-98e9-69e31e84b51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] HTTP exception thrown: Instance abd63f48-61c9-47c7-a848-14c894fd93b9 could not be found. Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-852f5cce-07b3-450e-98e9-69e31e84b51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Request method failure captured: Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 HTTP/1.1 Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRWUjVu1gQ57GIBhn5ficd1q4sunvbDMhg4jnpM49H5FOoGa8tQBKtFGb1X8myXD8BTADCdwVkFlKLPo8JzqRSWAH_0-WFVVtdSi-oyHnTOx-jP9SlEg8K7_nGTPKY37ckiDWUMDyWBa1CjIHb-akSJyS9B7B9QrxhdVDPqk43Fm-B8 Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ed54655c5a6442d680ee1cb81021ddd2 Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed54655c5a6442d680ee1cb81021ddd2"}]}] Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ed54655c5a6442d680ee1cb81021ddd2 Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerActionsTestJSON-2018628031-project Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 11cb3b659afa416bb3371795600189fb Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerActionsTestJSON-2018628031-project Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance abd63f48-61c9-47c7-a848-14c894fd93b9 could not be found. Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'abd63f48-61c9-47c7-a848-14c894fd93b9'} Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance abd63f48-61c9-47c7-a848-14c894fd93b9 could not be found. Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance abd63f48-61c9-47c7-a848-14c894fd93b9 could not be found. Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:31.710407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:31.714134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:31.714134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:31.714134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:31.714134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:09:31.714134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:09:31.714134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance abd63f48-61c9-47c7-a848-14c894fd93b9 could not be found. Aug 23 18:09:31.714134 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:31.714134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-852f5cce-07b3-450e-98e9-69e31e84b51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Returning 404 to user: Instance abd63f48-61c9-47c7-a848-14c894fd93b9 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:09:31.714134 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-852f5cce-07b3-450e-98e9-69e31e84b51e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9" status: 404 len: 111 microversion: 2.1 time: 0.033789 Aug 23 18:09:31.715871 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1911/3890] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:31 2022] GET /compute/v2.1/servers/abd63f48-61c9-47c7-a848-14c894fd93b9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:09:31.721206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d28eff4b-4c32-4088-a246-c35fb2ac6a82 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:31.721762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d28eff4b-4c32-4088-a246-c35fb2ac6a82 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:31.732069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d28eff4b-4c32-4088-a246-c35fb2ac6a82 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:31.732626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d28eff4b-4c32-4088-a246-c35fb2ac6a82 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:31.733078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d28eff4b-4c32-4088-a246-c35fb2ac6a82 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:31.734026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d28eff4b-4c32-4088-a246-c35fb2ac6a82 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:31.734492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d28eff4b-4c32-4088-a246-c35fb2ac6a82 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:31.734960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d28eff4b-4c32-4088-a246-c35fb2ac6a82 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:31.765099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d28eff4b-4c32-4088-a246-c35fb2ac6a82 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:09:31.952592 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d28eff4b-4c32-4088-a246-c35fb2ac6a82 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 204 len: 0 microversion: 2.1 time: 0.235324 Aug 23 18:09:31.954590 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1980/3891] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:09:31 2022] DELETE /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:09:31.966139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-57a9519b-431a-4d34-9eec-ddb5eee72fe3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:31.967017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-57a9519b-431a-4d34-9eec-ddb5eee72fe3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:31.974048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57a9519b-431a-4d34-9eec-ddb5eee72fe3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:31.974816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57a9519b-431a-4d34-9eec-ddb5eee72fe3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:31.975398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57a9519b-431a-4d34-9eec-ddb5eee72fe3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:31.976391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57a9519b-431a-4d34-9eec-ddb5eee72fe3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:31.976995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57a9519b-431a-4d34-9eec-ddb5eee72fe3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:31.977420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57a9519b-431a-4d34-9eec-ddb5eee72fe3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:32.133811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-57a9519b-431a-4d34-9eec-ddb5eee72fe3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:32.145482 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-57a9519b-431a-4d34-9eec-ddb5eee72fe3 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1466 microversion: 2.1 time: 0.184522 Aug 23 18:09:32.146394 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1912/3892] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:31 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1466 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:32.150665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-71ecaa53-24ac-49a5-b5e3-3f8ec6b2c34d req-ca59e83d-f0f3-4132-8cce-65097b4757cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c517c5-e5ab-4249-ab03-e6b2fc0c8e67", "name": "network-vif-plugged", "status": "completed", "tag": "4f663bff-de08-40b6-ad3b-3dd1fecf560c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:32.166175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-71ecaa53-24ac-49a5-b5e3-3f8ec6b2c34d req-ca59e83d-f0f3-4132-8cce-65097b4757cd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:32.168389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-71ecaa53-24ac-49a5-b5e3-3f8ec6b2c34d req-ca59e83d-f0f3-4132-8cce-65097b4757cd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:32.169132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-71ecaa53-24ac-49a5-b5e3-3f8ec6b2c34d req-ca59e83d-f0f3-4132-8cce-65097b4757cd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:32.184073 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-71ecaa53-24ac-49a5-b5e3-3f8ec6b2c34d req-ca59e83d-f0f3-4132-8cce-65097b4757cd service nova] Creating event network-vif-plugged:4f663bff-de08-40b6-ad3b-3dd1fecf560c for instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 on n-h2-850468-16 Aug 23 18:09:32.190278 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-71ecaa53-24ac-49a5-b5e3-3f8ec6b2c34d req-ca59e83d-f0f3-4132-8cce-65097b4757cd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044091 Aug 23 18:09:32.191898 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1981/3893] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:09:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:09:32.374725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-65d4881b-d164-4cbf-9267-b01cf2c5d248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:32.375354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-65d4881b-d164-4cbf-9267-b01cf2c5d248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:32.383573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65d4881b-d164-4cbf-9267-b01cf2c5d248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:32.384497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65d4881b-d164-4cbf-9267-b01cf2c5d248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:32.385523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65d4881b-d164-4cbf-9267-b01cf2c5d248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:32.387381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65d4881b-d164-4cbf-9267-b01cf2c5d248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:32.387381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65d4881b-d164-4cbf-9267-b01cf2c5d248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:32.387381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65d4881b-d164-4cbf-9267-b01cf2c5d248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:32.531459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-65d4881b-d164-4cbf-9267-b01cf2c5d248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:32.539741 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-65d4881b-d164-4cbf-9267-b01cf2c5d248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1315 microversion: 2.1 time: 0.169332 Aug 23 18:09:32.554012 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1913/3894] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:32 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1315 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:33.174864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d2e68057-0d32-4880-8f57-e5f8d7d30520 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:33.176393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d2e68057-0d32-4880-8f57-e5f8d7d30520 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:33.182846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2e68057-0d32-4880-8f57-e5f8d7d30520 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:33.183336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2e68057-0d32-4880-8f57-e5f8d7d30520 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:33.183774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2e68057-0d32-4880-8f57-e5f8d7d30520 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:33.184468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2e68057-0d32-4880-8f57-e5f8d7d30520 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:33.184920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2e68057-0d32-4880-8f57-e5f8d7d30520 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:33.185344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2e68057-0d32-4880-8f57-e5f8d7d30520 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:33.275694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d2e68057-0d32-4880-8f57-e5f8d7d30520 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:33.285079 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d2e68057-0d32-4880-8f57-e5f8d7d30520 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1466 microversion: 2.1 time: 0.114963 Aug 23 18:09:33.286112 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1982/3895] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:33 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1466 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:33.561304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9179d8c7-59cb-446b-877d-da118acab0bb tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:33.562034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9179d8c7-59cb-446b-877d-da118acab0bb tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:33.569706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9179d8c7-59cb-446b-877d-da118acab0bb tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:33.570272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9179d8c7-59cb-446b-877d-da118acab0bb tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:33.570865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9179d8c7-59cb-446b-877d-da118acab0bb tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:33.571624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9179d8c7-59cb-446b-877d-da118acab0bb tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:33.572192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9179d8c7-59cb-446b-877d-da118acab0bb tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:33.572674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9179d8c7-59cb-446b-877d-da118acab0bb tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:33.806572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9179d8c7-59cb-446b-877d-da118acab0bb tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:33.814737 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9179d8c7-59cb-446b-877d-da118acab0bb tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1315 microversion: 2.1 time: 0.257187 Aug 23 18:09:33.817097 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1914/3896] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:33 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1315 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:34.044080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4134e7f4-1bc1-4115-a3d8-8dc81cc49e47 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c89616ae-726f-4741-a18e-6508e0529f18"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:34.046792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4134e7f4-1bc1-4115-a3d8-8dc81cc49e47 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:34.053455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-3be35f56-e464-4630-bf87-23bf25e9de9f req-2f2255e8-3370-4575-b552-08a812136f70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbc82eec-ccbf-40e5-aafb-d85a4945f473", "name": "network-vif-deleted", "tag": "07a86c6c-d7ea-46ab-9df3-344686ec45fd"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:34.054037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4134e7f4-1bc1-4115-a3d8-8dc81cc49e47 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:34.054757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4134e7f4-1bc1-4115-a3d8-8dc81cc49e47 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:34.055353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4134e7f4-1bc1-4115-a3d8-8dc81cc49e47 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:34.056226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4134e7f4-1bc1-4115-a3d8-8dc81cc49e47 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:34.056834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4134e7f4-1bc1-4115-a3d8-8dc81cc49e47 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:34.057580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4134e7f4-1bc1-4115-a3d8-8dc81cc49e47 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:34.065063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3be35f56-e464-4630-bf87-23bf25e9de9f req-2f2255e8-3370-4575-b552-08a812136f70 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:34.065608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3be35f56-e464-4630-bf87-23bf25e9de9f req-2f2255e8-3370-4575-b552-08a812136f70 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:34.066072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3be35f56-e464-4630-bf87-23bf25e9de9f req-2f2255e8-3370-4575-b552-08a812136f70 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:34.089101 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-3be35f56-e464-4630-bf87-23bf25e9de9f req-2f2255e8-3370-4575-b552-08a812136f70 service nova] Creating event network-vif-deleted:07a86c6c-d7ea-46ab-9df3-344686ec45fd for instance fbc82eec-ccbf-40e5-aafb-d85a4945f473 on n-h1-850468-16 Aug 23 18:09:34.094691 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-3be35f56-e464-4630-bf87-23bf25e9de9f req-2f2255e8-3370-4575-b552-08a812136f70 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045818 Aug 23 18:09:34.095445 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1915/3897] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:09:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:09:34.309172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:34.310278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:34.318742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:34.319598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:34.320376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:34.321389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:34.322307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:34.323020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:34.365820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:34.366379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:34.366930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:34.367385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lazy-loading 'fault' on Instance uuid fbc82eec-ccbf-40e5-aafb-d85a4945f473 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:09:34.403083 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4134e7f4-1bc1-4115-a3d8-8dc81cc49e47 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "POST /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363359 Aug 23 18:09:34.403861 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1983/3898] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:09:34 2022] POST /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4/os-volume_attachments => generated 194 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:09:34.440728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:34.452200 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a3dfd2d8-15c3-419b-964a-9be6b62d5ef1 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 200 len: 1304 microversion: 2.1 time: 0.148577 Aug 23 18:09:34.452940 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1916/3899] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:34 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:34.595663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8c7e915c-e7ff-446c-b598-dd3f8b15c1fc tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:34.596363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8c7e915c-e7ff-446c-b598-dd3f8b15c1fc tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:34.603661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c7e915c-e7ff-446c-b598-dd3f8b15c1fc tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:34.604217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c7e915c-e7ff-446c-b598-dd3f8b15c1fc tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:34.604737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c7e915c-e7ff-446c-b598-dd3f8b15c1fc tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:34.605527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c7e915c-e7ff-446c-b598-dd3f8b15c1fc tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:34.606193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c7e915c-e7ff-446c-b598-dd3f8b15c1fc tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:34.606833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c7e915c-e7ff-446c-b598-dd3f8b15c1fc tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:34.642953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8c7e915c-e7ff-446c-b598-dd3f8b15c1fc tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:09:34.744619 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8c7e915c-e7ff-446c-b598-dd3f8b15c1fc tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 204 len: 0 microversion: 2.1 time: 0.153677 Aug 23 18:09:34.745419 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1984/3900] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:09:34 2022] DELETE /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:09:34.754059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f09d5990-bde7-48c9-a81c-20579bb3c3e4 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:34.754746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f09d5990-bde7-48c9-a81c-20579bb3c3e4 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:34.765980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f09d5990-bde7-48c9-a81c-20579bb3c3e4 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:34.766479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f09d5990-bde7-48c9-a81c-20579bb3c3e4 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:34.766951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f09d5990-bde7-48c9-a81c-20579bb3c3e4 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:34.767658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f09d5990-bde7-48c9-a81c-20579bb3c3e4 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:34.774177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f09d5990-bde7-48c9-a81c-20579bb3c3e4 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:34.774640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f09d5990-bde7-48c9-a81c-20579bb3c3e4 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:34.837605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e4fa792f-7838-4191-88e1-69951cd5b682 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:34.838389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e4fa792f-7838-4191-88e1-69951cd5b682 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:34.846114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4fa792f-7838-4191-88e1-69951cd5b682 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:34.846641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4fa792f-7838-4191-88e1-69951cd5b682 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:34.847771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4fa792f-7838-4191-88e1-69951cd5b682 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:34.848761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4fa792f-7838-4191-88e1-69951cd5b682 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:34.855292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4fa792f-7838-4191-88e1-69951cd5b682 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:34.855756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4fa792f-7838-4191-88e1-69951cd5b682 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:34.967941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f09d5990-bde7-48c9-a81c-20579bb3c3e4 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:34.978486 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f09d5990-bde7-48c9-a81c-20579bb3c3e4 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1664 microversion: 2.1 time: 0.228075 Aug 23 18:09:34.979989 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1917/3901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:34 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1664 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:35.040844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e4fa792f-7838-4191-88e1-69951cd5b682 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:35.049164 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e4fa792f-7838-4191-88e1-69951cd5b682 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1501 microversion: 2.1 time: 0.216020 Aug 23 18:09:35.049954 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1985/3902] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:34 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1501 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:35.473777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-595ee5ed-96c4-4401-9e7e-8691b4314564 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:35.474763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-595ee5ed-96c4-4401-9e7e-8691b4314564 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: fbc82eec-ccbf-40e5-aafb-d85a4945f473] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:35.476976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=86 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:35.482768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-595ee5ed-96c4-4401-9e7e-8691b4314564 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:35.483515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-595ee5ed-96c4-4401-9e7e-8691b4314564 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:35.484044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-595ee5ed-96c4-4401-9e7e-8691b4314564 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:35.484844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-595ee5ed-96c4-4401-9e7e-8691b4314564 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:35.485377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-595ee5ed-96c4-4401-9e7e-8691b4314564 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:35.486058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-595ee5ed-96c4-4401-9e7e-8691b4314564 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:35.491917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:35.502945 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-595ee5ed-96c4-4401-9e7e-8691b4314564 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] HTTP exception thrown: Instance fbc82eec-ccbf-40e5-aafb-d85a4945f473 could not be found. Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-595ee5ed-96c4-4401-9e7e-8691b4314564 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Request method failure captured: Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 HTTP/1.1 Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRWUjVu1gQ57GIBhn5ficd1q4sunvbDMhg4jnpM49H5FOoGa8tQBKtFGb1X8myXD8BTADCdwVkFlKLPo8JzqRSWAH_0-WFVVtdSi-oyHnTOx-jP9SlEg8K7_nGTPKY37ckiDWUMDyWBa1CjIHb-akSJyS9B7B9QrxhdVDPqk43Fm-B8 Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ed54655c5a6442d680ee1cb81021ddd2 Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed54655c5a6442d680ee1cb81021ddd2"}]}] Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ed54655c5a6442d680ee1cb81021ddd2 Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerActionsTestJSON-2018628031-project Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 11cb3b659afa416bb3371795600189fb Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerActionsTestJSON-2018628031-project Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance fbc82eec-ccbf-40e5-aafb-d85a4945f473 could not be found. Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'fbc82eec-ccbf-40e5-aafb-d85a4945f473'} Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fbc82eec-ccbf-40e5-aafb-d85a4945f473 could not be found. Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fbc82eec-ccbf-40e5-aafb-d85a4945f473 could not be found. Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:35.505374 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:35.509415 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:35.509415 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:35.509415 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:35.509415 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:09:35.509415 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:09:35.509415 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fbc82eec-ccbf-40e5-aafb-d85a4945f473 could not be found. Aug 23 18:09:35.509415 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:35.509957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-595ee5ed-96c4-4401-9e7e-8691b4314564 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Returning 404 to user: Instance fbc82eec-ccbf-40e5-aafb-d85a4945f473 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:09:35.511003 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-595ee5ed-96c4-4401-9e7e-8691b4314564 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473" status: 404 len: 111 microversion: 2.1 time: 0.041610 Aug 23 18:09:35.516580 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1918/3903] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:35 2022] GET /compute/v2.1/servers/fbc82eec-ccbf-40e5-aafb-d85a4945f473 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:09:35.523929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8813ba2-55d5-498f-acb9-53225505a58e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:35.524731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8813ba2-55d5-498f-acb9-53225505a58e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:35.536170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8813ba2-55d5-498f-acb9-53225505a58e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:35.536729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8813ba2-55d5-498f-acb9-53225505a58e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:35.537235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8813ba2-55d5-498f-acb9-53225505a58e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:35.538424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8813ba2-55d5-498f-acb9-53225505a58e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:35.538935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8813ba2-55d5-498f-acb9-53225505a58e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:35.539674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8813ba2-55d5-498f-acb9-53225505a58e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:35.563718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=20,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2,nova_cell1:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:35.576325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8813ba2-55d5-498f-acb9-53225505a58e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:09:35.665358 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8813ba2-55d5-498f-acb9-53225505a58e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "DELETE /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 204 len: 0 microversion: 2.1 time: 0.148031 Aug 23 18:09:35.665983 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1986/3904] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:09:35 2022] DELETE /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:09:35.674916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-018fe8a7-fb13-4575-9cc4-dc2afe04558c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:35.675777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-018fe8a7-fb13-4575-9cc4-dc2afe04558c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:35.683102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-018fe8a7-fb13-4575-9cc4-dc2afe04558c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:35.683557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-018fe8a7-fb13-4575-9cc4-dc2afe04558c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:35.683991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-018fe8a7-fb13-4575-9cc4-dc2afe04558c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:35.684692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-018fe8a7-fb13-4575-9cc4-dc2afe04558c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:35.685173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-018fe8a7-fb13-4575-9cc4-dc2afe04558c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:35.685596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-018fe8a7-fb13-4575-9cc4-dc2afe04558c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:35.825061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-018fe8a7-fb13-4575-9cc4-dc2afe04558c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:35.834184 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-018fe8a7-fb13-4575-9cc4-dc2afe04558c tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1507 microversion: 2.1 time: 0.163702 Aug 23 18:09:35.834770 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1919/3905] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:35 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:36.002051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5e9f6387-6263-4e5a-b6ec-11b3ace781b5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:36.002809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5e9f6387-6263-4e5a-b6ec-11b3ace781b5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:36.009856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e9f6387-6263-4e5a-b6ec-11b3ace781b5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:36.010370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e9f6387-6263-4e5a-b6ec-11b3ace781b5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:36.010838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e9f6387-6263-4e5a-b6ec-11b3ace781b5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:36.011622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e9f6387-6263-4e5a-b6ec-11b3ace781b5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:36.012086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e9f6387-6263-4e5a-b6ec-11b3ace781b5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:36.012511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e9f6387-6263-4e5a-b6ec-11b3ace781b5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:36.120130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a71b23f9-270e-49aa-baef-5ecb13428495 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "feb0e5d3-f849-4758-83a9-7e3e39f4c59f"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:36.122599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a71b23f9-270e-49aa-baef-5ecb13428495 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:36.129022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a71b23f9-270e-49aa-baef-5ecb13428495 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:36.129514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a71b23f9-270e-49aa-baef-5ecb13428495 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:36.129950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a71b23f9-270e-49aa-baef-5ecb13428495 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:36.130898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a71b23f9-270e-49aa-baef-5ecb13428495 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:36.131310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a71b23f9-270e-49aa-baef-5ecb13428495 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:36.131739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a71b23f9-270e-49aa-baef-5ecb13428495 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:36.185878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5e9f6387-6263-4e5a-b6ec-11b3ace781b5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:36.198845 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5e9f6387-6263-4e5a-b6ec-11b3ace781b5 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1664 microversion: 2.1 time: 0.201031 Aug 23 18:09:36.200080 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1987/3906] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:35 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1664 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:36.477230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-208bd668-ee39-4d99-b3a3-2a3aa548e9c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d417e4ec-9a48-4361-ba3d-f547f66a5a03"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:36.479704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-208bd668-ee39-4d99-b3a3-2a3aa548e9c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:36.485753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-208bd668-ee39-4d99-b3a3-2a3aa548e9c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:36.486291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-208bd668-ee39-4d99-b3a3-2a3aa548e9c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:36.486828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-208bd668-ee39-4d99-b3a3-2a3aa548e9c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:36.487572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-208bd668-ee39-4d99-b3a3-2a3aa548e9c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:36.488661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-208bd668-ee39-4d99-b3a3-2a3aa548e9c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:36.489105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-208bd668-ee39-4d99-b3a3-2a3aa548e9c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:36.761942 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a71b23f9-270e-49aa-baef-5ecb13428495 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.645705 Aug 23 18:09:36.763307 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1920/3907] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:09:36 2022] POST /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments => generated 194 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:09:36.858178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-39860dea-6662-46a3-b18b-aebf99e49de6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:36.859012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-39860dea-6662-46a3-b18b-aebf99e49de6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:36.889311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39860dea-6662-46a3-b18b-aebf99e49de6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:36.889928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39860dea-6662-46a3-b18b-aebf99e49de6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:36.890409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39860dea-6662-46a3-b18b-aebf99e49de6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:36.891339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39860dea-6662-46a3-b18b-aebf99e49de6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:36.891620 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-208bd668-ee39-4d99-b3a3-2a3aa548e9c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "POST /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.418269 Aug 23 18:09:36.892073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39860dea-6662-46a3-b18b-aebf99e49de6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:36.892320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39860dea-6662-46a3-b18b-aebf99e49de6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:36.896827 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1988/3908] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:09:36 2022] POST /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67/os-volume_attachments => generated 194 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:09:37.224423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-01666f90-de17-44de-9f28-0a21987ae92b tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:37.225256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-01666f90-de17-44de-9f28-0a21987ae92b tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:37.239206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01666f90-de17-44de-9f28-0a21987ae92b tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:37.239712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01666f90-de17-44de-9f28-0a21987ae92b tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:37.243751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01666f90-de17-44de-9f28-0a21987ae92b tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:37.247378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01666f90-de17-44de-9f28-0a21987ae92b tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:37.247867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01666f90-de17-44de-9f28-0a21987ae92b tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:37.248369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01666f90-de17-44de-9f28-0a21987ae92b tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:37.429249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-01666f90-de17-44de-9f28-0a21987ae92b tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:37.438166 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-01666f90-de17-44de-9f28-0a21987ae92b tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1664 microversion: 2.1 time: 0.219990 Aug 23 18:09:37.446687 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1989/3909] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:37 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1664 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:09:37.526644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-39860dea-6662-46a3-b18b-aebf99e49de6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:37.537221 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-39860dea-6662-46a3-b18b-aebf99e49de6 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1507 microversion: 2.1 time: 0.684774 Aug 23 18:09:37.538404 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1921/3910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:36 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1507 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:09:38.083948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-650e5490-a709-40ed-966a-3832af0614b0 req-12c66bf9-38b4-45d0-9688-c4bcd17006d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c8584cf-eace-4edc-af85-971d327a419d", "name": "network-vif-deleted", "tag": "b6d3c76a-fa31-40bc-a8d0-0843167898dd"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:38.097680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-650e5490-a709-40ed-966a-3832af0614b0 req-12c66bf9-38b4-45d0-9688-c4bcd17006d4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:38.098702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-650e5490-a709-40ed-966a-3832af0614b0 req-12c66bf9-38b4-45d0-9688-c4bcd17006d4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:38.099587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-650e5490-a709-40ed-966a-3832af0614b0 req-12c66bf9-38b4-45d0-9688-c4bcd17006d4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:38.129709 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-650e5490-a709-40ed-966a-3832af0614b0 req-12c66bf9-38b4-45d0-9688-c4bcd17006d4 service nova] Creating event network-vif-deleted:b6d3c76a-fa31-40bc-a8d0-0843167898dd for instance 8c8584cf-eace-4edc-af85-971d327a419d on n-h2-850468-16 Aug 23 18:09:38.140157 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-650e5490-a709-40ed-966a-3832af0614b0 req-12c66bf9-38b4-45d0-9688-c4bcd17006d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060663 Aug 23 18:09:38.141465 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1990/3911] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:09:38.461417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:38.462984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:38.471749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:38.473267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:38.473948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:38.475330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:38.476002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:38.476623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:38.533838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:38.535162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:38.546067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:38.546783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lazy-loading 'fault' on Instance uuid 8c8584cf-eace-4edc-af85-971d327a419d {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:09:38.560071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a8c4fb3a-373c-4fc1-9b65-f586bb23dbc9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:38.560955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a8c4fb3a-373c-4fc1-9b65-f586bb23dbc9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:38.579771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8c4fb3a-373c-4fc1-9b65-f586bb23dbc9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:38.580450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8c4fb3a-373c-4fc1-9b65-f586bb23dbc9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:38.580998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8c4fb3a-373c-4fc1-9b65-f586bb23dbc9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:38.582154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8c4fb3a-373c-4fc1-9b65-f586bb23dbc9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:38.582868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8c4fb3a-373c-4fc1-9b65-f586bb23dbc9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:38.583786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8c4fb3a-373c-4fc1-9b65-f586bb23dbc9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:38.671848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a8c4fb3a-373c-4fc1-9b65-f586bb23dbc9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:38.681028 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a8c4fb3a-373c-4fc1-9b65-f586bb23dbc9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 200 len: 1465 microversion: 2.1 time: 0.125676 Aug 23 18:09:38.681914 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1991/3912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:38 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 1465 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:09:38.696983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d3bdd07adea4f508fdfa0189ec7a902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d4fff29f6fb4e4aa782d8b74a361d1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:38.704793 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d5aa4ea2-ca7b-448a-86e3-dbc302ecd85f tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 200 len: 1316 microversion: 2.1 time: 0.248486 Aug 23 18:09:38.705357 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1922/3913] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:38 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:39.704733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c88ff14d-c822-4157-9506-935de25aba84 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:39.705352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c88ff14d-c822-4157-9506-935de25aba84 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 91d1f815-6923-4e40-b5de-f829a0ca663d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:39.712494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c88ff14d-c822-4157-9506-935de25aba84 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:39.712981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c88ff14d-c822-4157-9506-935de25aba84 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:39.713428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c88ff14d-c822-4157-9506-935de25aba84 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:39.714128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c88ff14d-c822-4157-9506-935de25aba84 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:39.714602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c88ff14d-c822-4157-9506-935de25aba84 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:39.715029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c88ff14d-c822-4157-9506-935de25aba84 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:39.729108 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-c88ff14d-c822-4157-9506-935de25aba84 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] HTTP exception thrown: Instance 91d1f815-6923-4e40-b5de-f829a0ca663d could not be found. Aug 23 18:09:39.730673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d7e9d311-e0af-4d04-a510-c258c3531bc0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c88ff14d-c822-4157-9506-935de25aba84 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Request method failure captured: Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d HTTP/1.1 Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRWUjVu1gQ57GIBhn5ficd1q4sunvbDMhg4jnpM49H5FOoGa8tQBKtFGb1X8myXD8BTADCdwVkFlKLPo8JzqRSWAH_0-WFVVtdSi-oyHnTOx-jP9SlEg8K7_nGTPKY37ckiDWUMDyWBa1CjIHb-akSJyS9B7B9QrxhdVDPqk43Fm-B8 Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ed54655c5a6442d680ee1cb81021ddd2 Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed54655c5a6442d680ee1cb81021ddd2"}]}] Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ed54655c5a6442d680ee1cb81021ddd2 Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerActionsTestJSON-2018628031-project Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 11cb3b659afa416bb3371795600189fb Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerActionsTestJSON-2018628031-project Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 91d1f815-6923-4e40-b5de-f829a0ca663d could not be found. Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '91d1f815-6923-4e40-b5de-f829a0ca663d'} Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91d1f815-6923-4e40-b5de-f829a0ca663d could not be found. Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91d1f815-6923-4e40-b5de-f829a0ca663d could not be found. Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:39.731139 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:09:39.734121 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:39.734121 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:39.734121 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:39.734121 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:09:39.734121 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:09:39.734121 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91d1f815-6923-4e40-b5de-f829a0ca663d could not be found. Aug 23 18:09:39.734121 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:09:39.734121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c88ff14d-c822-4157-9506-935de25aba84 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Returning 404 to user: Instance 91d1f815-6923-4e40-b5de-f829a0ca663d could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:09:39.734121 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c88ff14d-c822-4157-9506-935de25aba84 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d" status: 404 len: 111 microversion: 2.1 time: 0.031784 Aug 23 18:09:39.734121 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1992/3914] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:39 2022] GET /compute/v2.1/servers/91d1f815-6923-4e40-b5de-f829a0ca663d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:09:39.736143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d7e9d311-e0af-4d04-a510-c258c3531bc0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] [instance: 8c8584cf-eace-4edc-af85-971d327a419d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:39.741162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-645d1615-177b-40f6-a6a2-163688b57e21 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:39.741687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-645d1615-177b-40f6-a6a2-163688b57e21 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:39.743974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e9d311-e0af-4d04-a510-c258c3531bc0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:39.744769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e9d311-e0af-4d04-a510-c258c3531bc0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:39.745278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e9d311-e0af-4d04-a510-c258c3531bc0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:39.746057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e9d311-e0af-4d04-a510-c258c3531bc0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:39.746781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e9d311-e0af-4d04-a510-c258c3531bc0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:39.747282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7e9d311-e0af-4d04-a510-c258c3531bc0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:39.747654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-645d1615-177b-40f6-a6a2-163688b57e21 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:39.748140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-645d1615-177b-40f6-a6a2-163688b57e21 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:39.748578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-645d1615-177b-40f6-a6a2-163688b57e21 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:39.749279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-645d1615-177b-40f6-a6a2-163688b57e21 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:39.749732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-645d1615-177b-40f6-a6a2-163688b57e21 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:39.750151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-645d1615-177b-40f6-a6a2-163688b57e21 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:39.763568 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-d7e9d311-e0af-4d04-a510-c258c3531bc0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] HTTP exception thrown: Instance 8c8584cf-eace-4edc-af85-971d327a419d could not be found. Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d7e9d311-e0af-4d04-a510-c258c3531bc0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Request method failure captured: Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d HTTP/1.1 Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRdR3T7oW13ySsexksTXh-G-iiRlyw-DjnvjErBi09Gyz_mV0kCaUw1J0tXEhk0A55_WXHdnn93IZYbFfBDF0krSl68qmogzLU5fOZHL_gOC1ivpdqkMhzIg-jyqHA_DHEaOL4_38QQp3QbaHFib1-EhfqRDsjbPz6VGeZQ4F5qPt78 Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 2d4fff29f6fb4e4aa782d8b74a361d1a Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestFqdnHostnames-424228351 Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d4fff29f6fb4e4aa782d8b74a361d1a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d4fff29f6fb4e4aa782d8b74a361d1a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d4fff29f6fb4e4aa782d8b74a361d1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d4fff29f6fb4e4aa782d8b74a361d1a"}]}] Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestFqdnHostnames-424228351 Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 2d4fff29f6fb4e4aa782d8b74a361d1a Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-424228351 Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestFqdnHostnames-424228351-project Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2d3bdd07adea4f508fdfa0189ec7a902 Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestFqdnHostnames-424228351-project Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 8c8584cf-eace-4edc-af85-971d327a419d could not be found. Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '8c8584cf-eace-4edc-af85-971d327a419d'} Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c8584cf-eace-4edc-af85-971d327a419d could not be found. Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c8584cf-eace-4edc-af85-971d327a419d could not be found. Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:39.765446 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:39.768629 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:39.768629 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:39.768629 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:39.768629 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:09:39.768629 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:09:39.768629 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c8584cf-eace-4edc-af85-971d327a419d could not be found. Aug 23 18:09:39.768629 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:39.770477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d7e9d311-e0af-4d04-a510-c258c3531bc0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Returning 404 to user: Instance 8c8584cf-eace-4edc-af85-971d327a419d could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:09:39.771532 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d7e9d311-e0af-4d04-a510-c258c3531bc0 tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d" status: 404 len: 111 microversion: 2.1 time: 0.045154 Aug 23 18:09:39.772309 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1923/3915] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:39 2022] GET /compute/v2.1/servers/8c8584cf-eace-4edc-af85-971d327a419d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:09:39.777656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-645d1615-177b-40f6-a6a2-163688b57e21 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:09:39.781506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-201e0709-13e1-4079-a204-e0be3658f36a tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] Calling method '.version_select at 0x7f27dfa0ce50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:39.804317 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-201e0709-13e1-4079-a204-e0be3658f36a tempest-ServersTestFqdnHostnames-424228351 tempest-ServersTestFqdnHostnames-424228351-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053118384" status: 202 len: 0 microversion: 2.1 time: 0.027523 Aug 23 18:09:39.805096 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1924/3916] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 18:09:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1053118384 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:09:39.870047 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-645d1615-177b-40f6-a6a2-163688b57e21 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "DELETE /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 204 len: 0 microversion: 2.1 time: 0.132631 Aug 23 18:09:39.871155 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1993/3917] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:09:39 2022] DELETE /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:09:39.880756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d7da4606-2689-485a-a600-22328ef9ae56 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:39.881973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d7da4606-2689-485a-a600-22328ef9ae56 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:39.890961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7da4606-2689-485a-a600-22328ef9ae56 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:39.891383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7da4606-2689-485a-a600-22328ef9ae56 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:39.891897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7da4606-2689-485a-a600-22328ef9ae56 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:39.892684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7da4606-2689-485a-a600-22328ef9ae56 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:39.893206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7da4606-2689-485a-a600-22328ef9ae56 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:39.894420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7da4606-2689-485a-a600-22328ef9ae56 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:40.164235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d7da4606-2689-485a-a600-22328ef9ae56 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:40.174442 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d7da4606-2689-485a-a600-22328ef9ae56 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1495 microversion: 2.1 time: 0.298706 Aug 23 18:09:40.176625 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1925/3918] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:39 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1495 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:40.192788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-663d1254-7d62-403a-8c75-9d4bd49636e4 req-8017771f-d5ca-498a-80e3-3472da557bef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91d1f815-6923-4e40-b5de-f829a0ca663d", "name": "network-vif-deleted", "tag": "dd24fd67-d5f4-425a-bcd3-10fbbf054506"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:40.205139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-663d1254-7d62-403a-8c75-9d4bd49636e4 req-8017771f-d5ca-498a-80e3-3472da557bef service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:40.205634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-663d1254-7d62-403a-8c75-9d4bd49636e4 req-8017771f-d5ca-498a-80e3-3472da557bef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:40.206075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-663d1254-7d62-403a-8c75-9d4bd49636e4 req-8017771f-d5ca-498a-80e3-3472da557bef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:40.220654 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-663d1254-7d62-403a-8c75-9d4bd49636e4 req-8017771f-d5ca-498a-80e3-3472da557bef service nova] Creating event network-vif-deleted:dd24fd67-d5f4-425a-bcd3-10fbbf054506 for instance 91d1f815-6923-4e40-b5de-f829a0ca663d on n-h1-850468-16 Aug 23 18:09:40.226878 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-663d1254-7d62-403a-8c75-9d4bd49636e4 req-8017771f-d5ca-498a-80e3-3472da557bef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039620 Aug 23 18:09:40.227604 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1994/3919] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:09:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:09:41.199603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:41.201151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:41.209960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:41.210919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:41.211658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:41.212485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:41.213034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:41.213920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:41.252062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:41.252551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:41.252983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:41.254156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lazy-loading 'fault' on Instance uuid 431ff681-8a42-4440-b060-27bac6fb4ecb {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:09:41.321773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:41.329728 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff5ad3dd-96a6-4efe-ba48-dc8bc7b99f4a tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 200 len: 1305 microversion: 2.1 time: 0.135668 Aug 23 18:09:41.330863 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1926/3920] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:41 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 1305 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:42.243710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-60836521-2d98-4987-9923-0381e5f3a5cf req-85e08c28-25e0-4b84-8cbb-ebb0086660a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431ff681-8a42-4440-b060-27bac6fb4ecb", "name": "network-vif-deleted", "tag": "79e72ec6-2dad-439f-8c32-0b34ee6277fe"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:42.256091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-60836521-2d98-4987-9923-0381e5f3a5cf req-85e08c28-25e0-4b84-8cbb-ebb0086660a3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:42.257019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-60836521-2d98-4987-9923-0381e5f3a5cf req-85e08c28-25e0-4b84-8cbb-ebb0086660a3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:42.257663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-60836521-2d98-4987-9923-0381e5f3a5cf req-85e08c28-25e0-4b84-8cbb-ebb0086660a3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:42.269154 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-60836521-2d98-4987-9923-0381e5f3a5cf req-85e08c28-25e0-4b84-8cbb-ebb0086660a3 service nova] Creating event network-vif-deleted:79e72ec6-2dad-439f-8c32-0b34ee6277fe for instance 431ff681-8a42-4440-b060-27bac6fb4ecb on n-h1-850468-16 Aug 23 18:09:42.274360 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-60836521-2d98-4987-9923-0381e5f3a5cf req-85e08c28-25e0-4b84-8cbb-ebb0086660a3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035155 Aug 23 18:09:42.275061 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1995/3921] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:09:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:09:42.352234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dc46e70d-4e7d-47a5-9491-8c8600752414 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:42.353022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dc46e70d-4e7d-47a5-9491-8c8600752414 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 431ff681-8a42-4440-b060-27bac6fb4ecb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:42.360261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc46e70d-4e7d-47a5-9491-8c8600752414 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:42.361030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc46e70d-4e7d-47a5-9491-8c8600752414 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:42.361966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc46e70d-4e7d-47a5-9491-8c8600752414 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:42.364123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc46e70d-4e7d-47a5-9491-8c8600752414 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:42.364673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc46e70d-4e7d-47a5-9491-8c8600752414 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:42.365216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc46e70d-4e7d-47a5-9491-8c8600752414 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:42.383280 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-dc46e70d-4e7d-47a5-9491-8c8600752414 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] HTTP exception thrown: Instance 431ff681-8a42-4440-b060-27bac6fb4ecb could not be found. Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dc46e70d-4e7d-47a5-9491-8c8600752414 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Request method failure captured: Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb HTTP/1.1 Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRWUjVu1gQ57GIBhn5ficd1q4sunvbDMhg4jnpM49H5FOoGa8tQBKtFGb1X8myXD8BTADCdwVkFlKLPo8JzqRSWAH_0-WFVVtdSi-oyHnTOx-jP9SlEg8K7_nGTPKY37ckiDWUMDyWBa1CjIHb-akSJyS9B7B9QrxhdVDPqk43Fm-B8 Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ed54655c5a6442d680ee1cb81021ddd2 Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed54655c5a6442d680ee1cb81021ddd2"}]}] Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ed54655c5a6442d680ee1cb81021ddd2 Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerActionsTestJSON-2018628031-project Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 11cb3b659afa416bb3371795600189fb Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerActionsTestJSON-2018628031-project Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 431ff681-8a42-4440-b060-27bac6fb4ecb could not be found. Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '431ff681-8a42-4440-b060-27bac6fb4ecb'} Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 431ff681-8a42-4440-b060-27bac6fb4ecb could not be found. Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 431ff681-8a42-4440-b060-27bac6fb4ecb could not be found. Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:42.385830 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:42.388864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:42.388864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:42.388864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:42.388864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:09:42.388864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:09:42.388864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 431ff681-8a42-4440-b060-27bac6fb4ecb could not be found. Aug 23 18:09:42.388864 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:42.390522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dc46e70d-4e7d-47a5-9491-8c8600752414 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Returning 404 to user: Instance 431ff681-8a42-4440-b060-27bac6fb4ecb could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:09:42.391621 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dc46e70d-4e7d-47a5-9491-8c8600752414 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb" status: 404 len: 111 microversion: 2.1 time: 0.043784 Aug 23 18:09:42.392975 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1927/3922] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:42 2022] GET /compute/v2.1/servers/431ff681-8a42-4440-b060-27bac6fb4ecb => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:09:42.403069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-019fdc8b-444a-4395-8e6e-8f21d906e554 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:42.403903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-019fdc8b-444a-4395-8e6e-8f21d906e554 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:42.411416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-019fdc8b-444a-4395-8e6e-8f21d906e554 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:42.411913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-019fdc8b-444a-4395-8e6e-8f21d906e554 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:42.412480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-019fdc8b-444a-4395-8e6e-8f21d906e554 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:42.413206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-019fdc8b-444a-4395-8e6e-8f21d906e554 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:42.413670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-019fdc8b-444a-4395-8e6e-8f21d906e554 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:42.414103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-019fdc8b-444a-4395-8e6e-8f21d906e554 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:42.442083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-019fdc8b-444a-4395-8e6e-8f21d906e554 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:09:42.556048 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-019fdc8b-444a-4395-8e6e-8f21d906e554 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 204 len: 0 microversion: 2.1 time: 0.157552 Aug 23 18:09:42.559610 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1996/3923] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:09:42 2022] DELETE /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:09:42.568272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ce6645de-e677-4a3a-a9d6-396cf170207e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:42.569390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ce6645de-e677-4a3a-a9d6-396cf170207e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:42.577074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce6645de-e677-4a3a-a9d6-396cf170207e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:42.577970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce6645de-e677-4a3a-a9d6-396cf170207e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:42.579162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce6645de-e677-4a3a-a9d6-396cf170207e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:42.580264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce6645de-e677-4a3a-a9d6-396cf170207e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:42.581000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce6645de-e677-4a3a-a9d6-396cf170207e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:42.581684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce6645de-e677-4a3a-a9d6-396cf170207e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:42.751348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ce6645de-e677-4a3a-a9d6-396cf170207e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:42.761479 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ce6645de-e677-4a3a-a9d6-396cf170207e tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1675 microversion: 2.1 time: 0.198273 Aug 23 18:09:42.762670 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1928/3924] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:42 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1675 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:43.784048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48888ae3-02d7-4c9f-8a9f-6f3287ebecad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:43.794053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-48888ae3-02d7-4c9f-8a9f-6f3287ebecad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:43.810147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48888ae3-02d7-4c9f-8a9f-6f3287ebecad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:43.810727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48888ae3-02d7-4c9f-8a9f-6f3287ebecad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:43.811281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48888ae3-02d7-4c9f-8a9f-6f3287ebecad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:43.812458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48888ae3-02d7-4c9f-8a9f-6f3287ebecad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:43.813039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48888ae3-02d7-4c9f-8a9f-6f3287ebecad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:43.813776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48888ae3-02d7-4c9f-8a9f-6f3287ebecad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:44.083228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-48888ae3-02d7-4c9f-8a9f-6f3287ebecad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:44.094257 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48888ae3-02d7-4c9f-8a9f-6f3287ebecad tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1675 microversion: 2.1 time: 0.314410 Aug 23 18:09:44.109961 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1997/3925] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:43 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1675 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:45.118504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eedda1ff-1675-4ae4-bfb0-432507977c99 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:45.119499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eedda1ff-1675-4ae4-bfb0-432507977c99 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:45.130304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eedda1ff-1675-4ae4-bfb0-432507977c99 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:45.134490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eedda1ff-1675-4ae4-bfb0-432507977c99 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:45.136455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eedda1ff-1675-4ae4-bfb0-432507977c99 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:45.138963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eedda1ff-1675-4ae4-bfb0-432507977c99 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:45.143292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eedda1ff-1675-4ae4-bfb0-432507977c99 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:45.144559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eedda1ff-1675-4ae4-bfb0-432507977c99 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:45.322505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eedda1ff-1675-4ae4-bfb0-432507977c99 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '11cb3b659afa416bb3371795600189fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed54655c5a6442d680ee1cb81021ddd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:45.342790 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eedda1ff-1675-4ae4-bfb0-432507977c99 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 200 len: 1608 microversion: 2.1 time: 0.217655 Aug 23 18:09:45.357298 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1929/3926] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:45 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 1608 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:45.508831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f33cbcd3-8cf0-4827-8db2-3a9585a4fb17 req-be923468-e7c4-498b-a084-8db248a9ec73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d81bbbc-0ed1-445b-a321-b2175e975725", "name": "network-vif-deleted", "tag": "c9a2077a-21a0-4f0d-846d-bbb4743c4fa4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:45.523656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f33cbcd3-8cf0-4827-8db2-3a9585a4fb17 req-be923468-e7c4-498b-a084-8db248a9ec73 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:45.524592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f33cbcd3-8cf0-4827-8db2-3a9585a4fb17 req-be923468-e7c4-498b-a084-8db248a9ec73 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:45.525149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f33cbcd3-8cf0-4827-8db2-3a9585a4fb17 req-be923468-e7c4-498b-a084-8db248a9ec73 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:45.539853 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f33cbcd3-8cf0-4827-8db2-3a9585a4fb17 req-be923468-e7c4-498b-a084-8db248a9ec73 service nova] Creating event network-vif-deleted:c9a2077a-21a0-4f0d-846d-bbb4743c4fa4 for instance 9d81bbbc-0ed1-445b-a321-b2175e975725 on n-h1-850468-16 Aug 23 18:09:45.547034 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f33cbcd3-8cf0-4827-8db2-3a9585a4fb17 req-be923468-e7c4-498b-a084-8db248a9ec73 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043888 Aug 23 18:09:45.550667 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1998/3927] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:09:46.370443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cb3816d-eb50-4cf1-bbce-cf1fa08b12dd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:46.375265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0cb3816d-eb50-4cf1-bbce-cf1fa08b12dd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] [instance: 9d81bbbc-0ed1-445b-a321-b2175e975725] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:46.406458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cb3816d-eb50-4cf1-bbce-cf1fa08b12dd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:46.409121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cb3816d-eb50-4cf1-bbce-cf1fa08b12dd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:46.411602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cb3816d-eb50-4cf1-bbce-cf1fa08b12dd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:46.414681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cb3816d-eb50-4cf1-bbce-cf1fa08b12dd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:46.416140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cb3816d-eb50-4cf1-bbce-cf1fa08b12dd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:46.417427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cb3816d-eb50-4cf1-bbce-cf1fa08b12dd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:46.454882 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-0cb3816d-eb50-4cf1-bbce-cf1fa08b12dd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] HTTP exception thrown: Instance 9d81bbbc-0ed1-445b-a321-b2175e975725 could not be found. Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cb3816d-eb50-4cf1-bbce-cf1fa08b12dd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Request method failure captured: Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 HTTP/1.1 Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRWUjVu1gQ57GIBhn5ficd1q4sunvbDMhg4jnpM49H5FOoGa8tQBKtFGb1X8myXD8BTADCdwVkFlKLPo8JzqRSWAH_0-WFVVtdSi-oyHnTOx-jP9SlEg8K7_nGTPKY37ckiDWUMDyWBa1CjIHb-akSJyS9B7B9QrxhdVDPqk43Fm-B8 Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ed54655c5a6442d680ee1cb81021ddd2 Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ed54655c5a6442d680ee1cb81021ddd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ed54655c5a6442d680ee1cb81021ddd2"}]}] Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ed54655c5a6442d680ee1cb81021ddd2 Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerActionsTestJSON-2018628031 Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerActionsTestJSON-2018628031-project Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 11cb3b659afa416bb3371795600189fb Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerActionsTestJSON-2018628031-project Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 9d81bbbc-0ed1-445b-a321-b2175e975725 could not be found. Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '9d81bbbc-0ed1-445b-a321-b2175e975725'} Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d81bbbc-0ed1-445b-a321-b2175e975725 could not be found. Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d81bbbc-0ed1-445b-a321-b2175e975725 could not be found. Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:09:46.459248 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:46.467310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:09:46.467310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:09:46.467310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:09:46.467310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:09:46.467310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:09:46.467310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d81bbbc-0ed1-445b-a321-b2175e975725 could not be found. Aug 23 18:09:46.467310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:09:46.469697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cb3816d-eb50-4cf1-bbce-cf1fa08b12dd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Returning 404 to user: Instance 9d81bbbc-0ed1-445b-a321-b2175e975725 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:09:46.472469 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0cb3816d-eb50-4cf1-bbce-cf1fa08b12dd tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725" status: 404 len: 111 microversion: 2.1 time: 0.109400 Aug 23 18:09:46.483125 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1930/3928] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:46 2022] GET /compute/v2.1/servers/9d81bbbc-0ed1-445b-a321-b2175e975725 => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:09:46.499328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6b19ec94-1132-45e5-a603-d56dc9f739a9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] Calling method '.version_select at 0x7f27ec4660d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:46.577475 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6b19ec94-1132-45e5-a603-d56dc9f739a9 tempest-ServerActionsTestJSON-2018628031 tempest-ServerActionsTestJSON-2018628031-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309354575" status: 202 len: 0 microversion: 2.1 time: 0.095970 Aug 23 18:09:46.579707 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 1999/3929] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 18:09:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1309354575 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:09:53.915174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8081c87e-b980-478c-ab8c-edd908d20744 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:53.919604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8081c87e-b980-478c-ab8c-edd908d20744 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:53.934387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8081c87e-b980-478c-ab8c-edd908d20744 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:53.938029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8081c87e-b980-478c-ab8c-edd908d20744 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:53.939420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8081c87e-b980-478c-ab8c-edd908d20744 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:53.944536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8081c87e-b980-478c-ab8c-edd908d20744 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:53.945035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8081c87e-b980-478c-ab8c-edd908d20744 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:53.945488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8081c87e-b980-478c-ab8c-edd908d20744 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:53.999632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-8081c87e-b980-478c-ab8c-edd908d20744 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lazy-loading 'flavor' on Instance uuid 8f0d2e07-d2d2-422d-a262-279197b79569 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:09:54.325053 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8081c87e-b980-478c-ab8c-edd908d20744 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/action" status: 200 len: 32 microversion: 2.1 time: 0.416886 Aug 23 18:09:54.327623 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1931/3930] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:09:53 2022] POST /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/action => generated 32 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:09:54.341419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fa901847-b953-4d03-8071-51f8f8a9760b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:54.342232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fa901847-b953-4d03-8071-51f8f8a9760b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:54.357770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa901847-b953-4d03-8071-51f8f8a9760b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:54.359185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa901847-b953-4d03-8071-51f8f8a9760b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:54.361124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa901847-b953-4d03-8071-51f8f8a9760b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:54.363696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa901847-b953-4d03-8071-51f8f8a9760b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:54.365260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa901847-b953-4d03-8071-51f8f8a9760b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:54.368002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa901847-b953-4d03-8071-51f8f8a9760b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:54.696589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fa901847-b953-4d03-8071-51f8f8a9760b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:54.703409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:54.718391 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fa901847-b953-4d03-8071-51f8f8a9760b tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.385414 Aug 23 18:09:54.719711 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2000/3931] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:54 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:55.750105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c1e59ff5-f543-495f-b40e-e4717f840f33 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:55.752427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c1e59ff5-f543-495f-b40e-e4717f840f33 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:55.794611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1e59ff5-f543-495f-b40e-e4717f840f33 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:55.802726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1e59ff5-f543-495f-b40e-e4717f840f33 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:55.804570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1e59ff5-f543-495f-b40e-e4717f840f33 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:55.805952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1e59ff5-f543-495f-b40e-e4717f840f33 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:55.805952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1e59ff5-f543-495f-b40e-e4717f840f33 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:55.806367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1e59ff5-f543-495f-b40e-e4717f840f33 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:56.415155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c1e59ff5-f543-495f-b40e-e4717f840f33 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:56.442110 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c1e59ff5-f543-495f-b40e-e4717f840f33 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.699352 Aug 23 18:09:56.445576 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1932/3932] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:55 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:56.962817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1e8340ea-fc02-4a2c-9234-d1d10a8f5901 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:56.965229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1e8340ea-fc02-4a2c-9234-d1d10a8f5901 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:56.983035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=6,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:56.991466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e8340ea-fc02-4a2c-9234-d1d10a8f5901 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:56.992896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e8340ea-fc02-4a2c-9234-d1d10a8f5901 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:56.993585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e8340ea-fc02-4a2c-9234-d1d10a8f5901 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:56.994519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e8340ea-fc02-4a2c-9234-d1d10a8f5901 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:56.995424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e8340ea-fc02-4a2c-9234-d1d10a8f5901 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:56.996013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e8340ea-fc02-4a2c-9234-d1d10a8f5901 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:57.053368 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1e8340ea-fc02-4a2c-9234-d1d10a8f5901 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100988 Aug 23 18:09:57.060228 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2001/3933] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:09:56 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:09:57.064943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-736950d8-945e-48e8-9278-c60056bfbbfe tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:57.065567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-736950d8-945e-48e8-9278-c60056bfbbfe tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:57.079821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-736950d8-945e-48e8-9278-c60056bfbbfe tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:57.080525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-736950d8-945e-48e8-9278-c60056bfbbfe tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:57.081634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-736950d8-945e-48e8-9278-c60056bfbbfe tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:57.084523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-736950d8-945e-48e8-9278-c60056bfbbfe tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:57.085176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-736950d8-945e-48e8-9278-c60056bfbbfe tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:57.085763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-736950d8-945e-48e8-9278-c60056bfbbfe tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:57.384282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-736950d8-945e-48e8-9278-c60056bfbbfe tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lazy-loading 'services' on Instance uuid bc566e04-087f-4056-9c3d-bf0146a95db4 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:09:57.465869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-618d1692-f751-428c-890a-8fa067e70fce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:57.467058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-618d1692-f751-428c-890a-8fa067e70fce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:57.478362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-618d1692-f751-428c-890a-8fa067e70fce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:57.478746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-618d1692-f751-428c-890a-8fa067e70fce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:57.479175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-618d1692-f751-428c-890a-8fa067e70fce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:57.488726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-618d1692-f751-428c-890a-8fa067e70fce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:57.489549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-618d1692-f751-428c-890a-8fa067e70fce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:57.489997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-618d1692-f751-428c-890a-8fa067e70fce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:57.532564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:09:57.546601 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-736950d8-945e-48e8-9278-c60056bfbbfe tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4/os-volume_attachments/c89616ae-726f-4741-a18e-6508e0529f18" status: 202 len: 0 microversion: 2.1 time: 0.485456 Aug 23 18:09:57.548023 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1933/3934] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 18:09:57 2022] DELETE /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4/os-volume_attachments/c89616ae-726f-4741-a18e-6508e0529f18 => generated 0 bytes in 488 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:09:57.905625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-618d1692-f751-428c-890a-8fa067e70fce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:57.918443 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-618d1692-f751-428c-890a-8fa067e70fce tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.456895 Aug 23 18:09:57.930574 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2002/3935] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:57 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:09:58.845606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1712008933", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "c52e452b-74d4-45f4-aca0-734ddc82f788"}, {"uuid": "e0b96b18-facd-4c82-a783-f5e6e4bc2716"}, {"uuid": "c52e452b-74d4-45f4-aca0-734ddc82f788"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:09:58.960886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-215f36c0-3f5f-4da7-b246-9d23bf8a64ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:09:58.967268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-215f36c0-3f5f-4da7-b246-9d23bf8a64ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:09:58.971762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] validate_networks() for [('c52e452b-74d4-45f4-aca0-734ddc82f788', None, None, None, None, None), ('e0b96b18-facd-4c82-a783-f5e6e4bc2716', None, None, None, None, None), ('c52e452b-74d4-45f4-aca0-734ddc82f788', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:09:58.979356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-215f36c0-3f5f-4da7-b246-9d23bf8a64ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:58.980215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-215f36c0-3f5f-4da7-b246-9d23bf8a64ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:58.981749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-215f36c0-3f5f-4da7-b246-9d23bf8a64ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:58.983578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-215f36c0-3f5f-4da7-b246-9d23bf8a64ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:09:58.984576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-215f36c0-3f5f-4da7-b246-9d23bf8a64ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:09:58.985289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-215f36c0-3f5f-4da7-b246-9d23bf8a64ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:09:59.225614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-215f36c0-3f5f-4da7-b246-9d23bf8a64ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:09:59.239936 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-215f36c0-3f5f-4da7-b246-9d23bf8a64ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.300456 Aug 23 18:09:59.242881 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2003/3936] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:09:58 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:00.262697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b15bf20e-5512-4cdf-8459-53c6dfa715c9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:00.263626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b15bf20e-5512-4cdf-8459-53c6dfa715c9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:00.274730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b15bf20e-5512-4cdf-8459-53c6dfa715c9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:00.278175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b15bf20e-5512-4cdf-8459-53c6dfa715c9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:00.281190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b15bf20e-5512-4cdf-8459-53c6dfa715c9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:00.282087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b15bf20e-5512-4cdf-8459-53c6dfa715c9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:00.282710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b15bf20e-5512-4cdf-8459-53c6dfa715c9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:00.285159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b15bf20e-5512-4cdf-8459-53c6dfa715c9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:00.610728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b15bf20e-5512-4cdf-8459-53c6dfa715c9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:00.625039 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b15bf20e-5512-4cdf-8459-53c6dfa715c9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.367458 Aug 23 18:10:00.628090 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2004/3937] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:00 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:01.169887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:10:01.170634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:10:01.171288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:10:01.171739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:10:01.172254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:10:01.193634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:01.194409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:01.194969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:01.195834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:01.201686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:01.202299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:01.236606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Getting quotas for project 91018678aa474eee8e5f6c5249ec012e. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:10:01.244592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Getting quotas for user 673168b77fc84b9e93cccc69a6cb5948 and project 91018678aa474eee8e5f6c5249ec012e. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:10:01.271620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:10:01.275032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:10:01.391000 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d35ae5f-a57d-43a4-9568-aeb815ac2e6b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.552427 Aug 23 18:10:01.399761 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1934/3938] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:09:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:10:01.406430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-033902d4-8361-4c4c-8386-d711f3f2a327 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:01.407099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-033902d4-8361-4c4c-8386-d711f3f2a327 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:01.758193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-033902d4-8361-4c4c-8386-d711f3f2a327 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:01.780258 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-033902d4-8361-4c4c-8386-d711f3f2a327 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1213 microversion: 2.1 time: 0.379467 Aug 23 18:10:01.786861 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2005/3939] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:01 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1213 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:02.026191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7204d26a-6e9f-4f46-9de1-81929a9e53e4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:02.026869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7204d26a-6e9f-4f46-9de1-81929a9e53e4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:02.039365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7204d26a-6e9f-4f46-9de1-81929a9e53e4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:02.039883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7204d26a-6e9f-4f46-9de1-81929a9e53e4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:02.041467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7204d26a-6e9f-4f46-9de1-81929a9e53e4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:02.042258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7204d26a-6e9f-4f46-9de1-81929a9e53e4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:02.043751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7204d26a-6e9f-4f46-9de1-81929a9e53e4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:02.044222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7204d26a-6e9f-4f46-9de1-81929a9e53e4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:02.338925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7204d26a-6e9f-4f46-9de1-81929a9e53e4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:02.355679 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7204d26a-6e9f-4f46-9de1-81929a9e53e4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.707831 Aug 23 18:10:02.370866 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1935/3940] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:01 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:02.801667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-52f1572c-c49d-4faa-a901-4ea6e3d3e2a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:02.802507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-52f1572c-c49d-4faa-a901-4ea6e3d3e2a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:02.819325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f1572c-c49d-4faa-a901-4ea6e3d3e2a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:02.819906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f1572c-c49d-4faa-a901-4ea6e3d3e2a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:02.820427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f1572c-c49d-4faa-a901-4ea6e3d3e2a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:02.821868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f1572c-c49d-4faa-a901-4ea6e3d3e2a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:02.824157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f1572c-c49d-4faa-a901-4ea6e3d3e2a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:02.824787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f1572c-c49d-4faa-a901-4ea6e3d3e2a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:02.941030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-52f1572c-c49d-4faa-a901-4ea6e3d3e2a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:02.953353 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-52f1572c-c49d-4faa-a901-4ea6e3d3e2a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1265 microversion: 2.1 time: 0.155701 Aug 23 18:10:02.954233 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2006/3941] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:02 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:03.382172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f1e9fa64-effa-40a4-8acb-f274c0a6d035 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:03.383005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f1e9fa64-effa-40a4-8acb-f274c0a6d035 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:03.404935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1e9fa64-effa-40a4-8acb-f274c0a6d035 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:03.406999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1e9fa64-effa-40a4-8acb-f274c0a6d035 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:03.414571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1e9fa64-effa-40a4-8acb-f274c0a6d035 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:03.415728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1e9fa64-effa-40a4-8acb-f274c0a6d035 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:03.424065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1e9fa64-effa-40a4-8acb-f274c0a6d035 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:03.427249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1e9fa64-effa-40a4-8acb-f274c0a6d035 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:03.985148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4ba8da32-e903-4cfa-b480-0891435ce0a9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:03.985842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4ba8da32-e903-4cfa-b480-0891435ce0a9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:04.008832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ba8da32-e903-4cfa-b480-0891435ce0a9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:04.019951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ba8da32-e903-4cfa-b480-0891435ce0a9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:04.020666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ba8da32-e903-4cfa-b480-0891435ce0a9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:04.024559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ba8da32-e903-4cfa-b480-0891435ce0a9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:04.025060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ba8da32-e903-4cfa-b480-0891435ce0a9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:04.025507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ba8da32-e903-4cfa-b480-0891435ce0a9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:04.198904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f1e9fa64-effa-40a4-8acb-f274c0a6d035 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:04.215903 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f1e9fa64-effa-40a4-8acb-f274c0a6d035 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.839979 Aug 23 18:10:04.220232 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1936/3942] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:03 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:04.221120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4ba8da32-e903-4cfa-b480-0891435ce0a9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:04.239638 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4ba8da32-e903-4cfa-b480-0891435ce0a9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1271 microversion: 2.1 time: 0.258717 Aug 23 18:10:04.264752 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2007/3943] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:03 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1271 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:05.244895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ea479c77-9301-479a-9628-4819c7a7be30 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:05.246224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ea479c77-9301-479a-9628-4819c7a7be30 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:05.271921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a50c91b6-ea20-42eb-b691-5e6b8ca513bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:05.272689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a50c91b6-ea20-42eb-b691-5e6b8ca513bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:05.278513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea479c77-9301-479a-9628-4819c7a7be30 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:05.287131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea479c77-9301-479a-9628-4819c7a7be30 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:05.288119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea479c77-9301-479a-9628-4819c7a7be30 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:05.289486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a50c91b6-ea20-42eb-b691-5e6b8ca513bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:05.290447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea479c77-9301-479a-9628-4819c7a7be30 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:05.291623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea479c77-9301-479a-9628-4819c7a7be30 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:05.295258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a50c91b6-ea20-42eb-b691-5e6b8ca513bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:05.297734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a50c91b6-ea20-42eb-b691-5e6b8ca513bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:05.302938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a50c91b6-ea20-42eb-b691-5e6b8ca513bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:05.304189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a50c91b6-ea20-42eb-b691-5e6b8ca513bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:05.306683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea479c77-9301-479a-9628-4819c7a7be30 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:05.307983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a50c91b6-ea20-42eb-b691-5e6b8ca513bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:05.544108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a50c91b6-ea20-42eb-b691-5e6b8ca513bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:05.562498 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a50c91b6-ea20-42eb-b691-5e6b8ca513bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1271 microversion: 2.1 time: 0.290630 Aug 23 18:10:05.576217 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2008/3944] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:05 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1271 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:06.029353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f37607cd-c7d4-4ada-b99c-ee35d323a139 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:06.029977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f37607cd-c7d4-4ada-b99c-ee35d323a139 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:06.059791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f37607cd-c7d4-4ada-b99c-ee35d323a139 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:06.061268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f37607cd-c7d4-4ada-b99c-ee35d323a139 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:06.064557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f37607cd-c7d4-4ada-b99c-ee35d323a139 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:06.068984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f37607cd-c7d4-4ada-b99c-ee35d323a139 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:06.070927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f37607cd-c7d4-4ada-b99c-ee35d323a139 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:06.071548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f37607cd-c7d4-4ada-b99c-ee35d323a139 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:06.155709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f37607cd-c7d4-4ada-b99c-ee35d323a139 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:10:06.412994 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f37607cd-c7d4-4ada-b99c-ee35d323a139 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 204 len: 0 microversion: 2.1 time: 0.389312 Aug 23 18:10:06.417737 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2009/3945] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:10:06 2022] DELETE /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:10:06.437442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7b85629-bed4-4b53-a310-424abaec148d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:06.442257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d7b85629-bed4-4b53-a310-424abaec148d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:06.503549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7b85629-bed4-4b53-a310-424abaec148d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:06.504074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7b85629-bed4-4b53-a310-424abaec148d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:06.504523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7b85629-bed4-4b53-a310-424abaec148d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:06.505263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7b85629-bed4-4b53-a310-424abaec148d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:06.509231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7b85629-bed4-4b53-a310-424abaec148d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:06.514092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7b85629-bed4-4b53-a310-424abaec148d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:06.606257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ea479c77-9301-479a-9628-4819c7a7be30 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:06.619713 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ea479c77-9301-479a-9628-4819c7a7be30 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 1.379934 Aug 23 18:10:06.620299 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1937/3946] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:05 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:06.642249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f5533f62-4ff3-4099-b043-b5098c01755c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:06.644742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f5533f62-4ff3-4099-b043-b5098c01755c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:06.667137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:06.668960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f5533f62-4ff3-4099-b043-b5098c01755c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:06.673190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f5533f62-4ff3-4099-b043-b5098c01755c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:06.673863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f5533f62-4ff3-4099-b043-b5098c01755c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:06.686492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f5533f62-4ff3-4099-b043-b5098c01755c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:06.687429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f5533f62-4ff3-4099-b043-b5098c01755c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:06.688038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f5533f62-4ff3-4099-b043-b5098c01755c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:06.926679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7b85629-bed4-4b53-a310-424abaec148d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:06.941991 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7b85629-bed4-4b53-a310-424abaec148d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1553 microversion: 2.1 time: 0.515707 Aug 23 18:10:06.944634 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2010/3947] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:06 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1553 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:07.356993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f5533f62-4ff3-4099-b043-b5098c01755c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:07.369734 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f5533f62-4ff3-4099-b043-b5098c01755c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1313 microversion: 2.1 time: 0.743098 Aug 23 18:10:07.375509 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1938/3948] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:06 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1313 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:07.645675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-47aef5a6-4378-417e-a907-8ba9b715c379 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:07.646946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-47aef5a6-4378-417e-a907-8ba9b715c379 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:07.660648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47aef5a6-4378-417e-a907-8ba9b715c379 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:07.664891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47aef5a6-4378-417e-a907-8ba9b715c379 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:07.665514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47aef5a6-4378-417e-a907-8ba9b715c379 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:07.667400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47aef5a6-4378-417e-a907-8ba9b715c379 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:07.674648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47aef5a6-4378-417e-a907-8ba9b715c379 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:07.675735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47aef5a6-4378-417e-a907-8ba9b715c379 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:07.916379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-47aef5a6-4378-417e-a907-8ba9b715c379 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:07.935950 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-47aef5a6-4378-417e-a907-8ba9b715c379 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.292615 Aug 23 18:10:07.941151 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2011/3949] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:07 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:07.967205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e5774637-ebe2-4fb5-b879-cad5c917e2af tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:07.967948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e5774637-ebe2-4fb5-b879-cad5c917e2af tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:07.988726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5774637-ebe2-4fb5-b879-cad5c917e2af tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:07.991795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5774637-ebe2-4fb5-b879-cad5c917e2af tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:07.992567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5774637-ebe2-4fb5-b879-cad5c917e2af tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:07.993871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5774637-ebe2-4fb5-b879-cad5c917e2af tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:07.994870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5774637-ebe2-4fb5-b879-cad5c917e2af tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:07.998037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5774637-ebe2-4fb5-b879-cad5c917e2af tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:08.392522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-000755b9-875d-4686-80a9-4d76d1f68a84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:08.393694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-000755b9-875d-4686-80a9-4d76d1f68a84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:08.402445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-000755b9-875d-4686-80a9-4d76d1f68a84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:08.402972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-000755b9-875d-4686-80a9-4d76d1f68a84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:08.405880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-000755b9-875d-4686-80a9-4d76d1f68a84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:08.406649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-000755b9-875d-4686-80a9-4d76d1f68a84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:08.407119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-000755b9-875d-4686-80a9-4d76d1f68a84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:08.407551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-000755b9-875d-4686-80a9-4d76d1f68a84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:08.832018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-000755b9-875d-4686-80a9-4d76d1f68a84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:08.847073 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-000755b9-875d-4686-80a9-4d76d1f68a84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1313 microversion: 2.1 time: 0.457451 Aug 23 18:10:08.848190 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2012/3950] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:08 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1313 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:08.858166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8e6fa0e-3407-492e-9f22-437b79615111 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:08.860500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8e6fa0e-3407-492e-9f22-437b79615111 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:08.881637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8e6fa0e-3407-492e-9f22-437b79615111 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:08.882045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8e6fa0e-3407-492e-9f22-437b79615111 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:08.882483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8e6fa0e-3407-492e-9f22-437b79615111 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:08.883232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8e6fa0e-3407-492e-9f22-437b79615111 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:08.883683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8e6fa0e-3407-492e-9f22-437b79615111 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:08.890339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8e6fa0e-3407-492e-9f22-437b79615111 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:08.970058 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8e6fa0e-3407-492e-9f22-437b79615111 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.118910 Aug 23 18:10:08.970677 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2013/3951] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:10:08 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4/os-volume_attachments => generated 25 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:10:08.976274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-811e6773-7c36-4e46-81b0-5b8eb5e08008 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:08.977268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-811e6773-7c36-4e46-81b0-5b8eb5e08008 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:08.984322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-811e6773-7c36-4e46-81b0-5b8eb5e08008 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:08.984969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-811e6773-7c36-4e46-81b0-5b8eb5e08008 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:08.988800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-811e6773-7c36-4e46-81b0-5b8eb5e08008 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:09.003493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-811e6773-7c36-4e46-81b0-5b8eb5e08008 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:09.004267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-811e6773-7c36-4e46-81b0-5b8eb5e08008 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:09.005214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-811e6773-7c36-4e46-81b0-5b8eb5e08008 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:09.100135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5774637-ebe2-4fb5-b879-cad5c917e2af tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:09.116616 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e5774637-ebe2-4fb5-b879-cad5c917e2af tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1553 microversion: 2.1 time: 1.156074 Aug 23 18:10:09.129108 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1939/3952] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:07 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1553 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:09.151894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a20a8ded-a5e8-4045-90d3-bea580509177 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:09.166255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a20a8ded-a5e8-4045-90d3-bea580509177 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:09.182949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a20a8ded-a5e8-4045-90d3-bea580509177 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:09.183079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a20a8ded-a5e8-4045-90d3-bea580509177 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:09.185615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a20a8ded-a5e8-4045-90d3-bea580509177 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:09.186696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a20a8ded-a5e8-4045-90d3-bea580509177 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:09.187321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a20a8ded-a5e8-4045-90d3-bea580509177 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:09.188045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a20a8ded-a5e8-4045-90d3-bea580509177 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:09.278978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-811e6773-7c36-4e46-81b0-5b8eb5e08008 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:09.288948 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-811e6773-7c36-4e46-81b0-5b8eb5e08008 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.316369 Aug 23 18:10:09.294091 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2014/3953] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:08 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:09.338397 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a20a8ded-a5e8-4045-90d3-bea580509177 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.203866 Aug 23 18:10:09.346781 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1940/3954] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:10:09 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4/os-volume_attachments => generated 25 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:10:09.438183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-95e10041-0e45-41fd-ad58-627aa921da1e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:09.438954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-95e10041-0e45-41fd-ad58-627aa921da1e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:09.445851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95e10041-0e45-41fd-ad58-627aa921da1e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:09.446340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95e10041-0e45-41fd-ad58-627aa921da1e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:09.446805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95e10041-0e45-41fd-ad58-627aa921da1e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:09.447511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95e10041-0e45-41fd-ad58-627aa921da1e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:09.447968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95e10041-0e45-41fd-ad58-627aa921da1e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:09.463342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95e10041-0e45-41fd-ad58-627aa921da1e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:09.500573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-95e10041-0e45-41fd-ad58-627aa921da1e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:10:09.565121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:09.683657 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-95e10041-0e45-41fd-ad58-627aa921da1e tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 204 len: 0 microversion: 2.1 time: 0.249046 Aug 23 18:10:09.684947 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2015/3955] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:10:09 2022] DELETE /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:10:09.698217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b68d72c8-133a-49eb-bc71-2fd1bf33712d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:09.699608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b68d72c8-133a-49eb-bc71-2fd1bf33712d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:09.711156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b68d72c8-133a-49eb-bc71-2fd1bf33712d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:09.712431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b68d72c8-133a-49eb-bc71-2fd1bf33712d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:09.713085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b68d72c8-133a-49eb-bc71-2fd1bf33712d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:09.716974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b68d72c8-133a-49eb-bc71-2fd1bf33712d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:09.717695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b68d72c8-133a-49eb-bc71-2fd1bf33712d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:09.718678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b68d72c8-133a-49eb-bc71-2fd1bf33712d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:09.882885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-387ff91f-cc6c-4f86-8955-4587be8b8622 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:09.885284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-387ff91f-cc6c-4f86-8955-4587be8b8622 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:09.903339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-387ff91f-cc6c-4f86-8955-4587be8b8622 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:09.903766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-387ff91f-cc6c-4f86-8955-4587be8b8622 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:09.904396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-387ff91f-cc6c-4f86-8955-4587be8b8622 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:09.905275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-387ff91f-cc6c-4f86-8955-4587be8b8622 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:09.905888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-387ff91f-cc6c-4f86-8955-4587be8b8622 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:09.906472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-387ff91f-cc6c-4f86-8955-4587be8b8622 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:10.104757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-387ff91f-cc6c-4f86-8955-4587be8b8622 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:10.114051 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-387ff91f-cc6c-4f86-8955-4587be8b8622 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1334 microversion: 2.1 time: 0.248928 Aug 23 18:10:10.114973 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2016/3956] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:09 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1334 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:10.141978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fb4ded1e-b610-4087-825f-ff39a7387e2a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:10.142248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fb4ded1e-b610-4087-825f-ff39a7387e2a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:10.175688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb4ded1e-b610-4087-825f-ff39a7387e2a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:10.179211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb4ded1e-b610-4087-825f-ff39a7387e2a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:10.179857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb4ded1e-b610-4087-825f-ff39a7387e2a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:10.180778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb4ded1e-b610-4087-825f-ff39a7387e2a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:10.183120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb4ded1e-b610-4087-825f-ff39a7387e2a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:10.183628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb4ded1e-b610-4087-825f-ff39a7387e2a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:10.280886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b68d72c8-133a-49eb-bc71-2fd1bf33712d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:10.290517 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b68d72c8-133a-49eb-bc71-2fd1bf33712d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1681 microversion: 2.1 time: 0.597935 Aug 23 18:10:10.294440 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1941/3957] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:09 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1681 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:10.333809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-36102006-e2c0-49af-ad1c-d802b74aabd4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:10.336127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-36102006-e2c0-49af-ad1c-d802b74aabd4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:10.350096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36102006-e2c0-49af-ad1c-d802b74aabd4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:10.351673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36102006-e2c0-49af-ad1c-d802b74aabd4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:10.352268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36102006-e2c0-49af-ad1c-d802b74aabd4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:10.353453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36102006-e2c0-49af-ad1c-d802b74aabd4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:10.354060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36102006-e2c0-49af-ad1c-d802b74aabd4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:10.354662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36102006-e2c0-49af-ad1c-d802b74aabd4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:10.464372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb4ded1e-b610-4087-825f-ff39a7387e2a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:10.488187 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fb4ded1e-b610-4087-825f-ff39a7387e2a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1553 microversion: 2.1 time: 0.352263 Aug 23 18:10:10.489217 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2017/3958] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:10 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1553 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:10.831040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-36102006-e2c0-49af-ad1c-d802b74aabd4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:10.843759 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-36102006-e2c0-49af-ad1c-d802b74aabd4 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.532129 Aug 23 18:10:10.844530 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1942/3959] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:10 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:10.860096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-fde26e9e-1209-499f-9d2c-bbc2ff24f513 req-45cce138-c2e9-4d66-916d-e83e3c4b24c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95c517c5-e5ab-4249-ab03-e6b2fc0c8e67", "name": "network-vif-deleted", "tag": "4f663bff-de08-40b6-ad3b-3dd1fecf560c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:10.873292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fde26e9e-1209-499f-9d2c-bbc2ff24f513 req-45cce138-c2e9-4d66-916d-e83e3c4b24c6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:10.873991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fde26e9e-1209-499f-9d2c-bbc2ff24f513 req-45cce138-c2e9-4d66-916d-e83e3c4b24c6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:10.874789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fde26e9e-1209-499f-9d2c-bbc2ff24f513 req-45cce138-c2e9-4d66-916d-e83e3c4b24c6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:10.889546 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-fde26e9e-1209-499f-9d2c-bbc2ff24f513 req-45cce138-c2e9-4d66-916d-e83e3c4b24c6 service nova] Creating event network-vif-deleted:4f663bff-de08-40b6-ad3b-3dd1fecf560c for instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 on n-h2-850468-16 Aug 23 18:10:10.900233 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-fde26e9e-1209-499f-9d2c-bbc2ff24f513 req-45cce138-c2e9-4d66-916d-e83e3c4b24c6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045563 Aug 23 18:10:10.901282 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2018/3960] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:11.136624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1840aaec-095c-49b0-9536-7f69c6031234 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:11.138038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1840aaec-095c-49b0-9536-7f69c6031234 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:11.156535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1840aaec-095c-49b0-9536-7f69c6031234 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:11.159136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1840aaec-095c-49b0-9536-7f69c6031234 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:11.159588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1840aaec-095c-49b0-9536-7f69c6031234 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:11.160333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1840aaec-095c-49b0-9536-7f69c6031234 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:11.160786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1840aaec-095c-49b0-9536-7f69c6031234 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:11.161210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1840aaec-095c-49b0-9536-7f69c6031234 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:11.231761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:11.254125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:11.319521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-84fb31fc-c60d-4c2c-b1d1-ff5ec300cf5f tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:11.320123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-84fb31fc-c60d-4c2c-b1d1-ff5ec300cf5f tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:11.343681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84fb31fc-c60d-4c2c-b1d1-ff5ec300cf5f tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:11.345457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84fb31fc-c60d-4c2c-b1d1-ff5ec300cf5f tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:11.346015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84fb31fc-c60d-4c2c-b1d1-ff5ec300cf5f tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:11.347536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84fb31fc-c60d-4c2c-b1d1-ff5ec300cf5f tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:11.352504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84fb31fc-c60d-4c2c-b1d1-ff5ec300cf5f tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:11.353157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84fb31fc-c60d-4c2c-b1d1-ff5ec300cf5f tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:11.560602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1840aaec-095c-49b0-9536-7f69c6031234 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:11.570860 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1840aaec-095c-49b0-9536-7f69c6031234 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1334 microversion: 2.1 time: 0.437551 Aug 23 18:10:11.586873 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1943/3961] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:11 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1334 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:11.702900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-83285962", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "df3059a1-55a7-4986-a4c0-b4964b2c36cb"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:11.737917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-84fb31fc-c60d-4c2c-b1d1-ff5ec300cf5f tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:11.750373 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-84fb31fc-c60d-4c2c-b1d1-ff5ec300cf5f tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1681 microversion: 2.1 time: 0.438438 Aug 23 18:10:11.757587 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2019/3962] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:11 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1681 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:11.766903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c008eda-bdff-4d02-aa13-0e8a89a5c09b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:11.786843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4c008eda-bdff-4d02-aa13-0e8a89a5c09b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:11.795205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:11.808363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c008eda-bdff-4d02-aa13-0e8a89a5c09b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:11.810124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] validate_networks() for [('df3059a1-55a7-4986-a4c0-b4964b2c36cb', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:10:11.820883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c008eda-bdff-4d02-aa13-0e8a89a5c09b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:11.822966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c008eda-bdff-4d02-aa13-0e8a89a5c09b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:11.825163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c008eda-bdff-4d02-aa13-0e8a89a5c09b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:11.827140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c008eda-bdff-4d02-aa13-0e8a89a5c09b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:11.827768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c008eda-bdff-4d02-aa13-0e8a89a5c09b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:11.984701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4c008eda-bdff-4d02-aa13-0e8a89a5c09b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:11.997668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4c008eda-bdff-4d02-aa13-0e8a89a5c09b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1346 microversion: 2.1 time: 0.235488 Aug 23 18:10:12.012049 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2020/3963] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:11 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1346 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:12.019984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-810d3bf0-7b17-4b18-a005-78928d6e99a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:12.021007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-810d3bf0-7b17-4b18-a005-78928d6e99a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:12.035368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-810d3bf0-7b17-4b18-a005-78928d6e99a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:12.040151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-810d3bf0-7b17-4b18-a005-78928d6e99a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:12.041774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-810d3bf0-7b17-4b18-a005-78928d6e99a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:12.044520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-810d3bf0-7b17-4b18-a005-78928d6e99a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:12.048262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-810d3bf0-7b17-4b18-a005-78928d6e99a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:12.051550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-810d3bf0-7b17-4b18-a005-78928d6e99a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:12.457765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-810d3bf0-7b17-4b18-a005-78928d6e99a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:12.476247 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-810d3bf0-7b17-4b18-a005-78928d6e99a3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.462561 Aug 23 18:10:12.478559 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2021/3964] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:12 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:12.595048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-65232eae-baba-44cc-a7b6-cb38889360ce tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:12.595660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-65232eae-baba-44cc-a7b6-cb38889360ce tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:12.605136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65232eae-baba-44cc-a7b6-cb38889360ce tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:12.605635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65232eae-baba-44cc-a7b6-cb38889360ce tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:12.606074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65232eae-baba-44cc-a7b6-cb38889360ce tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:12.619705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65232eae-baba-44cc-a7b6-cb38889360ce tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:12.622603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65232eae-baba-44cc-a7b6-cb38889360ce tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:12.625365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65232eae-baba-44cc-a7b6-cb38889360ce tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:12.893761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:10:12.894785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:10:12.895445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:10:12.896000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:10:12.896557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:10:12.910630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:12.915922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:12.916557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:12.917847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:12.918455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:12.934568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:12.988641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Getting quotas for project c5f36d50f2274c02b1d7697f0774c55d. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:10:12.995643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Getting quotas for user 1d37a4b52c4e43919328c3414f0680f5 and project c5f36d50f2274c02b1d7697f0774c55d. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:10:13.011720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:10:13.014289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:10:13.068597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65232eae-baba-44cc-a7b6-cb38889360ce tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:13.080100 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-65232eae-baba-44cc-a7b6-cb38889360ce tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.489281 Aug 23 18:10:13.085951 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2022/3965] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:12 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:13.109754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c1edeb1c-532a-4bb9-977a-177428e01b0d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:13.114883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c1edeb1c-532a-4bb9-977a-177428e01b0d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:13.140415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1edeb1c-532a-4bb9-977a-177428e01b0d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:13.140994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1edeb1c-532a-4bb9-977a-177428e01b0d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:13.141483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1edeb1c-532a-4bb9-977a-177428e01b0d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:13.142223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1edeb1c-532a-4bb9-977a-177428e01b0d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:13.147110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1edeb1c-532a-4bb9-977a-177428e01b0d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:13.147583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1edeb1c-532a-4bb9-977a-177428e01b0d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:13.161704 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b10b0ca9-3065-49ff-b596-f5cfad1d2c1b tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.573345 Aug 23 18:10:13.165550 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1944/3966] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:10:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:10:13.172972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd36bd8b-933a-4cec-baa8-764b238baee8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:13.173596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd36bd8b-933a-4cec-baa8-764b238baee8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:13.191894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd36bd8b-933a-4cec-baa8-764b238baee8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:13.192483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd36bd8b-933a-4cec-baa8-764b238baee8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:13.192922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd36bd8b-933a-4cec-baa8-764b238baee8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:13.193638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd36bd8b-933a-4cec-baa8-764b238baee8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:13.194088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd36bd8b-933a-4cec-baa8-764b238baee8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:13.200626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd36bd8b-933a-4cec-baa8-764b238baee8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:13.395836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bd36bd8b-933a-4cec-baa8-764b238baee8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:13.412036 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd36bd8b-933a-4cec-baa8-764b238baee8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1346 microversion: 2.1 time: 0.245224 Aug 23 18:10:13.412830 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1945/3967] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:13 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1346 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:13.424805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7aee621a-9685-4116-a6e3-335fbeddb216 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:13.430746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7aee621a-9685-4116-a6e3-335fbeddb216 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:13.568531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c1edeb1c-532a-4bb9-977a-177428e01b0d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:13.579339 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c1edeb1c-532a-4bb9-977a-177428e01b0d tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1681 microversion: 2.1 time: 0.492295 Aug 23 18:10:13.590684 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2023/3968] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:13 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1681 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:13.593000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a49afb81-2ece-424c-ae0b-dc89c95eecc2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:13.594783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a49afb81-2ece-424c-ae0b-dc89c95eecc2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:13.609287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a49afb81-2ece-424c-ae0b-dc89c95eecc2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:13.609960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a49afb81-2ece-424c-ae0b-dc89c95eecc2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:13.610581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a49afb81-2ece-424c-ae0b-dc89c95eecc2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:13.612190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a49afb81-2ece-424c-ae0b-dc89c95eecc2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:13.612811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a49afb81-2ece-424c-ae0b-dc89c95eecc2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:13.613377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7aee621a-9685-4116-a6e3-335fbeddb216 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:13.614608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a49afb81-2ece-424c-ae0b-dc89c95eecc2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:13.630485 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7aee621a-9685-4116-a6e3-335fbeddb216 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1215 microversion: 2.1 time: 0.216408 Aug 23 18:10:13.646247 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1946/3969] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:13 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:14.010144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4e50f88c-e06c-458c-b20d-39dceab7fe02 req-42572a3e-22e7-4c81-9f52-a569dacb0634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e416c1-52c3-4451-8edb-1f86e6709a61", "tag": "4a7be3cc-a4b5-4ba2-be03-94e6af4c85cc"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:14.028921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a49afb81-2ece-424c-ae0b-dc89c95eecc2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:14.040922 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a49afb81-2ece-424c-ae0b-dc89c95eecc2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.458730 Aug 23 18:10:14.043644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4e50f88c-e06c-458c-b20d-39dceab7fe02 req-42572a3e-22e7-4c81-9f52-a569dacb0634 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:14.044724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4e50f88c-e06c-458c-b20d-39dceab7fe02 req-42572a3e-22e7-4c81-9f52-a569dacb0634 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:14.044724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4e50f88c-e06c-458c-b20d-39dceab7fe02 req-42572a3e-22e7-4c81-9f52-a569dacb0634 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:14.048337 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2024/3970] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:13 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:14.091684 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4e50f88c-e06c-458c-b20d-39dceab7fe02 req-42572a3e-22e7-4c81-9f52-a569dacb0634 service nova] Creating event network-changed:4a7be3cc-a4b5-4ba2-be03-94e6af4c85cc for instance a0e416c1-52c3-4451-8edb-1f86e6709a61 on n-h1-850468-16 Aug 23 18:10:14.110228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0eb34f27-59d3-4113-9fb7-da3fe730d7a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:14.113691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0eb34f27-59d3-4113-9fb7-da3fe730d7a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:14.124350 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4e50f88c-e06c-458c-b20d-39dceab7fe02 req-42572a3e-22e7-4c81-9f52-a569dacb0634 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118307 Aug 23 18:10:14.127915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0eb34f27-59d3-4113-9fb7-da3fe730d7a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:14.128384 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1947/3971] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:14.129414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0eb34f27-59d3-4113-9fb7-da3fe730d7a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:14.130142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0eb34f27-59d3-4113-9fb7-da3fe730d7a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:14.131209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0eb34f27-59d3-4113-9fb7-da3fe730d7a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:14.131874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0eb34f27-59d3-4113-9fb7-da3fe730d7a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:14.133871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0eb34f27-59d3-4113-9fb7-da3fe730d7a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:14.437064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d67b3a98-feba-4405-af45-47cbb20aab60 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:14.439909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d67b3a98-feba-4405-af45-47cbb20aab60 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:14.477267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d67b3a98-feba-4405-af45-47cbb20aab60 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:14.477267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d67b3a98-feba-4405-af45-47cbb20aab60 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:14.477267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d67b3a98-feba-4405-af45-47cbb20aab60 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:14.477267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d67b3a98-feba-4405-af45-47cbb20aab60 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:14.477267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d67b3a98-feba-4405-af45-47cbb20aab60 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:14.478243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d67b3a98-feba-4405-af45-47cbb20aab60 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:14.623005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0eb34f27-59d3-4113-9fb7-da3fe730d7a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:14.640465 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0eb34f27-59d3-4113-9fb7-da3fe730d7a2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.535185 Aug 23 18:10:14.666577 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2025/3972] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:14 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:14.666577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-edad0470-98d7-4ec7-b95a-64426b71a1a0 req-06ad131c-a5fe-488b-89ca-50f0c980e33c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc566e04-087f-4056-9c3d-bf0146a95db4", "name": "network-vif-deleted", "tag": "1b3c8c48-9533-4e7b-890d-a36a8ffc7dc5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:14.718415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-edad0470-98d7-4ec7-b95a-64426b71a1a0 req-06ad131c-a5fe-488b-89ca-50f0c980e33c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:14.724785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-edad0470-98d7-4ec7-b95a-64426b71a1a0 req-06ad131c-a5fe-488b-89ca-50f0c980e33c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:14.726217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-edad0470-98d7-4ec7-b95a-64426b71a1a0 req-06ad131c-a5fe-488b-89ca-50f0c980e33c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:14.780319 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-edad0470-98d7-4ec7-b95a-64426b71a1a0 req-06ad131c-a5fe-488b-89ca-50f0c980e33c service nova] Creating event network-vif-deleted:1b3c8c48-9533-4e7b-890d-a36a8ffc7dc5 for instance bc566e04-087f-4056-9c3d-bf0146a95db4 on n-h2-850468-16 Aug 23 18:10:14.809932 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-edad0470-98d7-4ec7-b95a-64426b71a1a0 req-06ad131c-a5fe-488b-89ca-50f0c980e33c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152576 Aug 23 18:10:14.812324 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2026/3973] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:14.823588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:14.824517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:14.836759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:14.838206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:14.838845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:14.841582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:14.842231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:14.842845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:14.901792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:14.902287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:14.902758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:14.903276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lazy-loading 'fault' on Instance uuid bc566e04-087f-4056-9c3d-bf0146a95db4 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:10:14.948824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d67b3a98-feba-4405-af45-47cbb20aab60 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:14.963530 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d67b3a98-feba-4405-af45-47cbb20aab60 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1346 microversion: 2.1 time: 0.530825 Aug 23 18:10:14.972840 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1948/3974] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:14 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1346 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:14.983513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8f5c84b3-aa2a-4999-bbdf-8d9748a9eceb tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:14.984152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8f5c84b3-aa2a-4999-bbdf-8d9748a9eceb tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:15.018967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f5c84b3-aa2a-4999-bbdf-8d9748a9eceb tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:15.019955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f5c84b3-aa2a-4999-bbdf-8d9748a9eceb tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:15.019955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f5c84b3-aa2a-4999-bbdf-8d9748a9eceb tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:15.028506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95a73eec1ec44dfe9f6c6cfdfec8ad57', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7dd15dea3fb4e4bb5f051b71f529e97', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:15.039408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f5c84b3-aa2a-4999-bbdf-8d9748a9eceb tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:15.046020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f5c84b3-aa2a-4999-bbdf-8d9748a9eceb tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:15.046506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f5c84b3-aa2a-4999-bbdf-8d9748a9eceb tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:15.051361 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-908a7045-0a91-44ac-8500-715938e77f09 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 200 len: 1331 microversion: 2.1 time: 0.230355 Aug 23 18:10:15.055957 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2027/3975] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:14 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 1331 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:15.071353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-27d49451-7210-438e-9977-e2b2de1b0586 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:15.072201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-27d49451-7210-438e-9977-e2b2de1b0586 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:15.098655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27d49451-7210-438e-9977-e2b2de1b0586 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:15.099194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27d49451-7210-438e-9977-e2b2de1b0586 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:15.099646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27d49451-7210-438e-9977-e2b2de1b0586 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:15.100388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27d49451-7210-438e-9977-e2b2de1b0586 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:15.100837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27d49451-7210-438e-9977-e2b2de1b0586 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:15.101267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27d49451-7210-438e-9977-e2b2de1b0586 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:15.320519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8f5c84b3-aa2a-4999-bbdf-8d9748a9eceb tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:15.341291 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8f5c84b3-aa2a-4999-bbdf-8d9748a9eceb tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1267 microversion: 2.1 time: 0.372405 Aug 23 18:10:15.341933 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1949/3976] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:14 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1267 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:15.551257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-27d49451-7210-438e-9977-e2b2de1b0586 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:15.565477 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-27d49451-7210-438e-9977-e2b2de1b0586 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.501630 Aug 23 18:10:15.566944 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2028/3977] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:15 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:15.678606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6c137230-bc85-47ec-a663-ca3e0c88bcf2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:15.679756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6c137230-bc85-47ec-a663-ca3e0c88bcf2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:15.702286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c137230-bc85-47ec-a663-ca3e0c88bcf2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:15.702820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c137230-bc85-47ec-a663-ca3e0c88bcf2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:15.703293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c137230-bc85-47ec-a663-ca3e0c88bcf2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:15.703979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c137230-bc85-47ec-a663-ca3e0c88bcf2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:15.704446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c137230-bc85-47ec-a663-ca3e0c88bcf2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:15.704875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c137230-bc85-47ec-a663-ca3e0c88bcf2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:15.993180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8aa42276-7ebf-4688-ab88-7af111865b9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:15.993823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8aa42276-7ebf-4688-ab88-7af111865b9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:16.010151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8aa42276-7ebf-4688-ab88-7af111865b9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:16.010693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8aa42276-7ebf-4688-ab88-7af111865b9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:16.017234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8aa42276-7ebf-4688-ab88-7af111865b9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:16.018683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8aa42276-7ebf-4688-ab88-7af111865b9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:16.021177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8aa42276-7ebf-4688-ab88-7af111865b9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:16.021808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8aa42276-7ebf-4688-ab88-7af111865b9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:16.177737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8aa42276-7ebf-4688-ab88-7af111865b9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:16.198915 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8aa42276-7ebf-4688-ab88-7af111865b9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1346 microversion: 2.1 time: 0.212116 Aug 23 18:10:16.204049 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2029/3978] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:15 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1346 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:16.223166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-96887b10-5a84-46d2-89da-1d92a839d315 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:16.224091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-96887b10-5a84-46d2-89da-1d92a839d315 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:16.245899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96887b10-5a84-46d2-89da-1d92a839d315 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:16.247485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96887b10-5a84-46d2-89da-1d92a839d315 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:16.253582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96887b10-5a84-46d2-89da-1d92a839d315 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:16.255619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96887b10-5a84-46d2-89da-1d92a839d315 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:16.259299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96887b10-5a84-46d2-89da-1d92a839d315 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:16.260040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96887b10-5a84-46d2-89da-1d92a839d315 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:16.312693 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-96887b10-5a84-46d2-89da-1d92a839d315 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] HTTP exception thrown: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-96887b10-5a84-46d2-89da-1d92a839d315 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Request method failure captured: Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 HTTP/1.1 Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRcM7Mdj0RnR1TuiGNJs7NCW9H9tqqBWZ-j5easXJcuKTfShWn8nQuGsAMcdhJYMXBFL0_u5szd4FqUpacIjkGbepXvBUaHE75N9kM1ibdr7Bq67Tg69i4yMpQntWsWuk8HAJNpmzYovVxrYNmt8MmDb4IUI8ck-LEQjrpaFoD-xXhc Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: c7dd15dea3fb4e4bb5f051b71f529e97 Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-340352509 Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c7dd15dea3fb4e4bb5f051b71f529e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c7dd15dea3fb4e4bb5f051b71f529e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c7dd15dea3fb4e4bb5f051b71f529e97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c7dd15dea3fb4e4bb5f051b71f529e97"}]}] Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-340352509 Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: c7dd15dea3fb4e4bb5f051b71f529e97 Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-340352509 Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AttachSCSIVolumeTestJSON-340352509-project Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 95a73eec1ec44dfe9f6c6cfdfec8ad57 Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-340352509-project Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'bc566e04-087f-4056-9c3d-bf0146a95db4'} Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:16.315244 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:16.319016 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:16.319016 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:16.319016 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:16.319016 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:10:16.319016 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:10:16.319016 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:16.319016 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:16.325313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-96887b10-5a84-46d2-89da-1d92a839d315 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Returning 404 to user: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:10:16.326397 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-96887b10-5a84-46d2-89da-1d92a839d315 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 404 len: 111 microversion: 2.1 time: 0.121210 Aug 23 18:10:16.327464 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2030/3979] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:16 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 111 bytes in 123 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:10:16.336189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cb130ae7-c9ac-4e41-bf9c-e9670c422d78 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '.version_select at 0x7f27ec6201f0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:16.403125 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cb130ae7-c9ac-4e41-bf9c-e9670c422d78 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-734650675" status: 202 len: 0 microversion: 2.1 time: 0.070754 Aug 23 18:10:16.408381 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2031/3980] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Aug 23 18:10:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-734650675 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:10:16.420271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e3de7889-698f-4259-b320-b0b6b245ea5f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:16.420909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e3de7889-698f-4259-b320-b0b6b245ea5f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:16.440610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3de7889-698f-4259-b320-b0b6b245ea5f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:16.441070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3de7889-698f-4259-b320-b0b6b245ea5f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:16.441507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3de7889-698f-4259-b320-b0b6b245ea5f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:16.442607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3de7889-698f-4259-b320-b0b6b245ea5f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:16.443213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3de7889-698f-4259-b320-b0b6b245ea5f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:16.443808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3de7889-698f-4259-b320-b0b6b245ea5f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:16.657432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e3de7889-698f-4259-b320-b0b6b245ea5f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:16.668024 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e3de7889-698f-4259-b320-b0b6b245ea5f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1273 microversion: 2.1 time: 0.259084 Aug 23 18:10:16.674885 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2032/3981] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:16 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1273 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:16.687764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5e9494f6-0c4e-44fd-b170-217d0e8114ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:16.689439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5e9494f6-0c4e-44fd-b170-217d0e8114ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:16.715822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e9494f6-0c4e-44fd-b170-217d0e8114ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:16.718777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e9494f6-0c4e-44fd-b170-217d0e8114ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:16.719601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e9494f6-0c4e-44fd-b170-217d0e8114ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:16.721730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e9494f6-0c4e-44fd-b170-217d0e8114ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:16.725065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e9494f6-0c4e-44fd-b170-217d0e8114ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:16.725714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e9494f6-0c4e-44fd-b170-217d0e8114ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:17.182924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5e9494f6-0c4e-44fd-b170-217d0e8114ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:17.201041 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5e9494f6-0c4e-44fd-b170-217d0e8114ff tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.523941 Aug 23 18:10:17.205640 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2033/3982] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:16 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:17.226300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-103c2bc9-1247-4cac-9deb-3af19f12f6ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:17.227240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-103c2bc9-1247-4cac-9deb-3af19f12f6ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:17.239277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-103c2bc9-1247-4cac-9deb-3af19f12f6ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:17.240988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-103c2bc9-1247-4cac-9deb-3af19f12f6ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:17.241589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-103c2bc9-1247-4cac-9deb-3af19f12f6ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:17.243616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-103c2bc9-1247-4cac-9deb-3af19f12f6ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:17.245412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-103c2bc9-1247-4cac-9deb-3af19f12f6ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:17.246030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-103c2bc9-1247-4cac-9deb-3af19f12f6ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:17.324674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c137230-bc85-47ec-a663-ca3e0c88bcf2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:17.329701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:17.343409 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6c137230-bc85-47ec-a663-ca3e0c88bcf2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 1.670482 Aug 23 18:10:17.347127 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1950/3983] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:15 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 1675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:17.686006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-103c2bc9-1247-4cac-9deb-3af19f12f6ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:17.697374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-080dc69d-e20c-48d1-ab46-9cc50d189712 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:17.698229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-080dc69d-e20c-48d1-ab46-9cc50d189712 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:17.707316 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-103c2bc9-1247-4cac-9deb-3af19f12f6ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1346 microversion: 2.1 time: 0.482873 Aug 23 18:10:17.707316 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2034/3984] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:17 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1346 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:17.747582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-080dc69d-e20c-48d1-ab46-9cc50d189712 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:17.749986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-080dc69d-e20c-48d1-ab46-9cc50d189712 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:17.750636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-080dc69d-e20c-48d1-ab46-9cc50d189712 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:17.752772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-080dc69d-e20c-48d1-ab46-9cc50d189712 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:17.757583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-080dc69d-e20c-48d1-ab46-9cc50d189712 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:17.758226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-080dc69d-e20c-48d1-ab46-9cc50d189712 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:17.954391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-080dc69d-e20c-48d1-ab46-9cc50d189712 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:17.964810 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-080dc69d-e20c-48d1-ab46-9cc50d189712 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1273 microversion: 2.1 time: 0.272786 Aug 23 18:10:17.985603 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1951/3985] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:17 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1273 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:18.227436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-880f409c-45cc-44a1-ab52-12b61437a50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:18.228211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-880f409c-45cc-44a1-ab52-12b61437a50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:18.245385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-880f409c-45cc-44a1-ab52-12b61437a50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:18.245888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-880f409c-45cc-44a1-ab52-12b61437a50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:18.246327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-880f409c-45cc-44a1-ab52-12b61437a50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:18.252706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-880f409c-45cc-44a1-ab52-12b61437a50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:18.253527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-880f409c-45cc-44a1-ab52-12b61437a50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:18.254133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-880f409c-45cc-44a1-ab52-12b61437a50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:18.365523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-457e3a9c-cccd-4e2a-ae2e-212825355322 req-bc3512fc-136b-4c8c-878d-5bf92e81178e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e416c1-52c3-4451-8edb-1f86e6709a61", "tag": "84e01b73-4166-423a-8088-4acd7d53dfa1"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:18.379621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-457e3a9c-cccd-4e2a-ae2e-212825355322 req-bc3512fc-136b-4c8c-878d-5bf92e81178e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:18.380416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-457e3a9c-cccd-4e2a-ae2e-212825355322 req-bc3512fc-136b-4c8c-878d-5bf92e81178e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:18.381087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-457e3a9c-cccd-4e2a-ae2e-212825355322 req-bc3512fc-136b-4c8c-878d-5bf92e81178e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:18.405146 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-457e3a9c-cccd-4e2a-ae2e-212825355322 req-bc3512fc-136b-4c8c-878d-5bf92e81178e service nova] Creating event network-changed:84e01b73-4166-423a-8088-4acd7d53dfa1 for instance a0e416c1-52c3-4451-8edb-1f86e6709a61 on n-h1-850468-16 Aug 23 18:10:18.411686 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-457e3a9c-cccd-4e2a-ae2e-212825355322 req-bc3512fc-136b-4c8c-878d-5bf92e81178e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050837 Aug 23 18:10:18.426385 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1952/3986] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:18.456013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8b9f3b38-467b-4a64-a13e-4741c61ae2e7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:18.457131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8b9f3b38-467b-4a64-a13e-4741c61ae2e7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:18.467290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9f3b38-467b-4a64-a13e-4741c61ae2e7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:18.468015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9f3b38-467b-4a64-a13e-4741c61ae2e7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:18.469224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9f3b38-467b-4a64-a13e-4741c61ae2e7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:18.470159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9f3b38-467b-4a64-a13e-4741c61ae2e7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:18.471646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9f3b38-467b-4a64-a13e-4741c61ae2e7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:18.472246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b9f3b38-467b-4a64-a13e-4741c61ae2e7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:18.635702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-880f409c-45cc-44a1-ab52-12b61437a50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:18.647366 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-880f409c-45cc-44a1-ab52-12b61437a50c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.424170 Aug 23 18:10:18.653824 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2035/3987] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:18 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:18.729582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f47d6e32-7a9c-4a6f-b213-a37e1d5be3da tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:18.730171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f47d6e32-7a9c-4a6f-b213-a37e1d5be3da tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:18.739238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f47d6e32-7a9c-4a6f-b213-a37e1d5be3da tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:18.742329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f47d6e32-7a9c-4a6f-b213-a37e1d5be3da tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:18.742813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f47d6e32-7a9c-4a6f-b213-a37e1d5be3da tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:18.745049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f47d6e32-7a9c-4a6f-b213-a37e1d5be3da tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:18.746695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f47d6e32-7a9c-4a6f-b213-a37e1d5be3da tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:18.748412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f47d6e32-7a9c-4a6f-b213-a37e1d5be3da tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:18.886649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f47d6e32-7a9c-4a6f-b213-a37e1d5be3da tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:18.900308 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f47d6e32-7a9c-4a6f-b213-a37e1d5be3da tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1346 microversion: 2.1 time: 0.174683 Aug 23 18:10:18.916962 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2036/3988] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:18 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1346 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:18.994040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f2d5801-dadf-477e-8a54-1bcac98a9104 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:18.994785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4f2d5801-dadf-477e-8a54-1bcac98a9104 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:19.001601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f2d5801-dadf-477e-8a54-1bcac98a9104 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:19.004730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f2d5801-dadf-477e-8a54-1bcac98a9104 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:19.004962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f2d5801-dadf-477e-8a54-1bcac98a9104 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:19.005683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f2d5801-dadf-477e-8a54-1bcac98a9104 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:19.006162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f2d5801-dadf-477e-8a54-1bcac98a9104 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:19.006612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f2d5801-dadf-477e-8a54-1bcac98a9104 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:19.086447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8b9f3b38-467b-4a64-a13e-4741c61ae2e7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:19.108233 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8b9f3b38-467b-4a64-a13e-4741c61ae2e7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.679519 Aug 23 18:10:19.109133 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1953/3989] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:18 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:19.293868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4f2d5801-dadf-477e-8a54-1bcac98a9104 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:19.334873 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4f2d5801-dadf-477e-8a54-1bcac98a9104 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1315 microversion: 2.1 time: 0.344801 Aug 23 18:10:19.339576 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2037/3990] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:18 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:19.672152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-202bd646-4372-4422-8bb0-ad1d5d17e788 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:19.672774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-202bd646-4372-4422-8bb0-ad1d5d17e788 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:19.681873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-202bd646-4372-4422-8bb0-ad1d5d17e788 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:19.688345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-202bd646-4372-4422-8bb0-ad1d5d17e788 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:19.689018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-202bd646-4372-4422-8bb0-ad1d5d17e788 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:19.690488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-202bd646-4372-4422-8bb0-ad1d5d17e788 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:19.691139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-202bd646-4372-4422-8bb0-ad1d5d17e788 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:19.693042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-202bd646-4372-4422-8bb0-ad1d5d17e788 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:19.698473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:19.926211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5c168772-693e-447b-9a0b-5191cbe8e26d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:19.927380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5c168772-693e-447b-9a0b-5191cbe8e26d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:19.935922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c168772-693e-447b-9a0b-5191cbe8e26d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:19.937699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c168772-693e-447b-9a0b-5191cbe8e26d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:19.940615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c168772-693e-447b-9a0b-5191cbe8e26d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:19.941523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c168772-693e-447b-9a0b-5191cbe8e26d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:19.943077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c168772-693e-447b-9a0b-5191cbe8e26d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:19.943874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c168772-693e-447b-9a0b-5191cbe8e26d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:20.014857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5c168772-693e-447b-9a0b-5191cbe8e26d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:20.031965 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5c168772-693e-447b-9a0b-5191cbe8e26d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1346 microversion: 2.1 time: 0.109753 Aug 23 18:10:20.046486 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2038/3991] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:19 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1346 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:20.130235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-02242f8e-c7ca-4664-9011-3222bf1edec0 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:20.131412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-02242f8e-c7ca-4664-9011-3222bf1edec0 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:20.138622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02242f8e-c7ca-4664-9011-3222bf1edec0 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:20.139124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02242f8e-c7ca-4664-9011-3222bf1edec0 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:20.139572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02242f8e-c7ca-4664-9011-3222bf1edec0 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:20.140309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02242f8e-c7ca-4664-9011-3222bf1edec0 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:20.145614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02242f8e-c7ca-4664-9011-3222bf1edec0 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:20.146468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02242f8e-c7ca-4664-9011-3222bf1edec0 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:20.214385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-202bd646-4372-4422-8bb0-ad1d5d17e788 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:20.228707 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-202bd646-4372-4422-8bb0-ad1d5d17e788 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1734 microversion: 2.1 time: 0.559953 Aug 23 18:10:20.252980 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1954/3992] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:19 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1734 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:20.337751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-02242f8e-c7ca-4664-9011-3222bf1edec0 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:20.347634 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-02242f8e-c7ca-4664-9011-3222bf1edec0 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.221985 Aug 23 18:10:20.360595 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2039/3993] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:20 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:20.362331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2f760d1a-3559-47a6-aaf7-ca2820fadd50 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:20.363093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2f760d1a-3559-47a6-aaf7-ca2820fadd50 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:20.370230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f760d1a-3559-47a6-aaf7-ca2820fadd50 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:20.372014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f760d1a-3559-47a6-aaf7-ca2820fadd50 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:20.373737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f760d1a-3559-47a6-aaf7-ca2820fadd50 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:20.376373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f760d1a-3559-47a6-aaf7-ca2820fadd50 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:20.378186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f760d1a-3559-47a6-aaf7-ca2820fadd50 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:20.378748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f760d1a-3559-47a6-aaf7-ca2820fadd50 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:20.799315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2f760d1a-3559-47a6-aaf7-ca2820fadd50 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:20.807882 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2f760d1a-3559-47a6-aaf7-ca2820fadd50 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1315 microversion: 2.1 time: 0.450407 Aug 23 18:10:20.823577 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1955/3994] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:20 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:21.042155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-1685b870-b4ca-42d1-a989-a9c3edaffd81 req-cdea4691-53ea-4991-b26c-e30fa187f247 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0e416c1-52c3-4451-8edb-1f86e6709a61", "tag": "105b1931-952d-4863-a0d4-bb595623be7a"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:21.054433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:21.055589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:21.057194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1685b870-b4ca-42d1-a989-a9c3edaffd81 req-cdea4691-53ea-4991-b26c-e30fa187f247 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.057755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1685b870-b4ca-42d1-a989-a9c3edaffd81 req-cdea4691-53ea-4991-b26c-e30fa187f247 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.058241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1685b870-b4ca-42d1-a989-a9c3edaffd81 req-cdea4691-53ea-4991-b26c-e30fa187f247 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.064931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.067094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.068047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.069310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.069998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.071469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.076292 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-1685b870-b4ca-42d1-a989-a9c3edaffd81 req-cdea4691-53ea-4991-b26c-e30fa187f247 service nova] Creating event network-changed:105b1931-952d-4863-a0d4-bb595623be7a for instance a0e416c1-52c3-4451-8edb-1f86e6709a61 on n-h1-850468-16 Aug 23 18:10:21.082868 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-1685b870-b4ca-42d1-a989-a9c3edaffd81 req-cdea4691-53ea-4991-b26c-e30fa187f247 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050238 Aug 23 18:10:21.083971 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2040/3995] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:21.135091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.136076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.136733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.137367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lazy-loading 'fault' on Instance uuid 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:10:21.260648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-68529d5b-c4ac-4c58-ba57-4dc71d57d3ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:21.260812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-68529d5b-c4ac-4c58-ba57-4dc71d57d3ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:21.273296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68529d5b-c4ac-4c58-ba57-4dc71d57d3ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.274047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68529d5b-c4ac-4c58-ba57-4dc71d57d3ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.275648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68529d5b-c4ac-4c58-ba57-4dc71d57d3ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.279927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68529d5b-c4ac-4c58-ba57-4dc71d57d3ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.280614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68529d5b-c4ac-4c58-ba57-4dc71d57d3ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.281208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68529d5b-c4ac-4c58-ba57-4dc71d57d3ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.588194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-68529d5b-c4ac-4c58-ba57-4dc71d57d3ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:21.599881 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-68529d5b-c4ac-4c58-ba57-4dc71d57d3ac tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1714 microversion: 2.1 time: 0.345450 Aug 23 18:10:21.601434 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2041/3996] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:21 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1714 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:21.607333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5d4abcdf-c2a5-4806-8a12-a21182cb7f1d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:21.608284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5d4abcdf-c2a5-4806-8a12-a21182cb7f1d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:21.616984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:21.637516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d4abcdf-c2a5-4806-8a12-a21182cb7f1d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.639415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d4abcdf-c2a5-4806-8a12-a21182cb7f1d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.641418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d4abcdf-c2a5-4806-8a12-a21182cb7f1d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.646286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d4abcdf-c2a5-4806-8a12-a21182cb7f1d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.648569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d4abcdf-c2a5-4806-8a12-a21182cb7f1d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.649437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d4abcdf-c2a5-4806-8a12-a21182cb7f1d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.658233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:21.676774 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a3e374b1-c5e5-4b2f-8c61-a2d093d45243 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 200 len: 1305 microversion: 2.1 time: 0.626847 Aug 23 18:10:21.677370 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1956/3997] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:21 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 1305 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:21.703205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-06022e8f-149c-491f-8121-c2aecb4be048 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:21.703721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-06022e8f-149c-491f-8121-c2aecb4be048 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:21.711998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06022e8f-149c-491f-8121-c2aecb4be048 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.712500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06022e8f-149c-491f-8121-c2aecb4be048 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.712951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06022e8f-149c-491f-8121-c2aecb4be048 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.713681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06022e8f-149c-491f-8121-c2aecb4be048 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.714149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06022e8f-149c-491f-8121-c2aecb4be048 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.714621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06022e8f-149c-491f-8121-c2aecb4be048 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.879577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5d4abcdf-c2a5-4806-8a12-a21182cb7f1d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:21.888532 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-06022e8f-149c-491f-8121-c2aecb4be048 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] HTTP exception thrown: Cannot 'detach_volume' instance 8f0d2e07-d2d2-422d-a262-279197b79569 while it is in vm_state rescued Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-06022e8f-149c-491f-8121-c2aecb4be048 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Request method failure captured: Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments/feb0e5d3-f849-4758-83a9-7e3e39f4c59f HTTP/1.1 Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRbMS5n_NsGau0vnGI0iBrS85eKgyFW2-flo5AMEagzFwHXr8y830jIBRx2ycNUqbit5tulaOzYGG8jmEgWnoI2Kij-0Ap1FvDFmaX_VNZTOBEswqTbIxjk8xyB5l_Bmsy2gQs8ixm2uUwN9H5qHjYOcvdPlZGrIYQD4Gm01UoxEIk4 Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}] Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 283c529ff2774efca184740ad6ccfdd5 Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: exception: Cannot 'detach_volume' instance 8f0d2e07-d2d2-422d-a262-279197b79569 while it is in vm_state rescued Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': '8f0d2e07-d2d2-422d-a262-279197b79569', 'id': 'feb0e5d3-f849-4758-83a9-7e3e39f4c59f'} Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8f0d2e07-d2d2-422d-a262-279197b79569 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 8f0d2e07-d2d2-422d-a262-279197b79569 while it is in vm_state rescued Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:21.891282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:21.896934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:21.896934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:21.896934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:10:21.896934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:10:21.896934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 8f0d2e07-d2d2-422d-a262-279197b79569 while it is in vm_state rescued Aug 23 18:10:21.896934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:21.901027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-06022e8f-149c-491f-8121-c2aecb4be048 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Returning 409 to user: Cannot 'detach_volume' instance 8f0d2e07-d2d2-422d-a262-279197b79569 while it is in vm_state rescued {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:10:21.902522 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-06022e8f-149c-491f-8121-c2aecb4be048 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments/feb0e5d3-f849-4758-83a9-7e3e39f4c59f" status: 409 len: 152 microversion: 2.1 time: 0.203292 Aug 23 18:10:21.903897 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1957/3998] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 18:10:21 2022] DELETE /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments/feb0e5d3-f849-4758-83a9-7e3e39f4c59f => generated 152 bytes in 205 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 23 18:10:21.904953 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5d4abcdf-c2a5-4806-8a12-a21182cb7f1d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.288144 Aug 23 18:10:21.912571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ef2af801-c544-4610-be54-3e97e84ac8f5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:21.913625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ef2af801-c544-4610-be54-3e97e84ac8f5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:21.929518 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2042/3999] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:21 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:21.929518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3d749573-f5eb-48d0-a6f5-f9d76d1344be tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:21.929518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3d749573-f5eb-48d0-a6f5-f9d76d1344be tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:21.932349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef2af801-c544-4610-be54-3e97e84ac8f5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.936895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d749573-f5eb-48d0-a6f5-f9d76d1344be tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.937478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d749573-f5eb-48d0-a6f5-f9d76d1344be tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.938014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d749573-f5eb-48d0-a6f5-f9d76d1344be tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.938174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef2af801-c544-4610-be54-3e97e84ac8f5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.938805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef2af801-c544-4610-be54-3e97e84ac8f5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.939452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d749573-f5eb-48d0-a6f5-f9d76d1344be tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.939452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d749573-f5eb-48d0-a6f5-f9d76d1344be tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.939961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d749573-f5eb-48d0-a6f5-f9d76d1344be tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:21.940264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef2af801-c544-4610-be54-3e97e84ac8f5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:21.941088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef2af801-c544-4610-be54-3e97e84ac8f5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:21.941676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef2af801-c544-4610-be54-3e97e84ac8f5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:22.043557 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3d749573-f5eb-48d0-a6f5-f9d76d1344be tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/action" status: 202 len: 0 microversion: 2.1 time: 0.119470 Aug 23 18:10:22.048301 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2043/4000] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:10:21 2022] POST /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:10:22.063675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-65215ce2-a749-47ac-b01c-e3c08531c9fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:22.066780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-65215ce2-a749-47ac-b01c-e3c08531c9fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:22.102862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65215ce2-a749-47ac-b01c-e3c08531c9fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:22.103368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65215ce2-a749-47ac-b01c-e3c08531c9fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:22.104580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65215ce2-a749-47ac-b01c-e3c08531c9fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:22.108132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65215ce2-a749-47ac-b01c-e3c08531c9fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:22.108638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65215ce2-a749-47ac-b01c-e3c08531c9fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:22.109091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65215ce2-a749-47ac-b01c-e3c08531c9fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:22.254663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ef2af801-c544-4610-be54-3e97e84ac8f5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:22.277889 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ef2af801-c544-4610-be54-3e97e84ac8f5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1315 microversion: 2.1 time: 0.372490 Aug 23 18:10:22.279086 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1958/4001] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:21 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1315 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:22.520159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65215ce2-a749-47ac-b01c-e3c08531c9fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:22.529484 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-65215ce2-a749-47ac-b01c-e3c08531c9fd tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1722 microversion: 2.1 time: 0.478995 Aug 23 18:10:22.534829 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2044/4002] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:22 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1722 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:22.701869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-262bfe8e-cb4d-463e-94b2-c819f767feb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:22.702491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-262bfe8e-cb4d-463e-94b2-c819f767feb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:22.737734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-262bfe8e-cb4d-463e-94b2-c819f767feb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:22.744607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-262bfe8e-cb4d-463e-94b2-c819f767feb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:22.746246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-262bfe8e-cb4d-463e-94b2-c819f767feb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:22.747819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-262bfe8e-cb4d-463e-94b2-c819f767feb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:22.747905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-262bfe8e-cb4d-463e-94b2-c819f767feb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:22.748297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-262bfe8e-cb4d-463e-94b2-c819f767feb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:22.784202 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-262bfe8e-cb4d-463e-94b2-c819f767feb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-262bfe8e-cb4d-463e-94b2-c819f767feb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 HTTP/1.1 Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '95c517c5-e5ab-4249-ab03-e6b2fc0c8e67'} Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:22.788064 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:22.792180 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:22.792180 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:22.792180 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:22.792180 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:10:22.792180 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:10:22.792180 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:10:22.792180 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:22.793424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-262bfe8e-cb4d-463e-94b2-c819f767feb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:10:22.795839 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-262bfe8e-cb4d-463e-94b2-c819f767feb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 404 len: 111 microversion: 2.1 time: 0.097908 Aug 23 18:10:22.798424 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1959/4003] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:22 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:10:22.946755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c185612d-f678-4385-99ec-b1e066be2d66 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:22.952196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-515777a7-3579-43f1-9eb7-181e0e4512bc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:22.954499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-515777a7-3579-43f1-9eb7-181e0e4512bc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:22.956024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c185612d-f678-4385-99ec-b1e066be2d66 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:22.965318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c185612d-f678-4385-99ec-b1e066be2d66 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:22.968145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c185612d-f678-4385-99ec-b1e066be2d66 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:22.968809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c185612d-f678-4385-99ec-b1e066be2d66 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:22.969993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:22.971290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c185612d-f678-4385-99ec-b1e066be2d66 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:22.972928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c185612d-f678-4385-99ec-b1e066be2d66 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:22.974522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-515777a7-3579-43f1-9eb7-181e0e4512bc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:22.975239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c185612d-f678-4385-99ec-b1e066be2d66 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:22.978900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-515777a7-3579-43f1-9eb7-181e0e4512bc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:22.979630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-515777a7-3579-43f1-9eb7-181e0e4512bc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:22.980754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-515777a7-3579-43f1-9eb7-181e0e4512bc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:22.981408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-515777a7-3579-43f1-9eb7-181e0e4512bc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:22.985335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-515777a7-3579-43f1-9eb7-181e0e4512bc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:23.019068 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-515777a7-3579-43f1-9eb7-181e0e4512bc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-515777a7-3579-43f1-9eb7-181e0e4512bc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67/os-volume_attachments HTTP/1.1 Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': '95c517c5-e5ab-4249-ab03-e6b2fc0c8e67'} Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:10:23.025091 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-515777a7-3579-43f1-9eb7-181e0e4512bc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-515777a7-3579-43f1-9eb7-181e0e4512bc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.078744 Aug 23 18:10:23.033298 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1960/4004] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:10:22 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67/os-volume_attachments => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:10:23.219850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2cfb0e25-486f-4770-9326-cf083695167a req-0616d585-f468-4d73-9aed-ec2903597810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee815ebc-effc-47e7-b0c4-590b10b5cd28", "tag": "21ccea57-b191-4ddd-a4e2-aa9c59963daa"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:23.241120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2cfb0e25-486f-4770-9326-cf083695167a req-0616d585-f468-4d73-9aed-ec2903597810 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:23.244233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2cfb0e25-486f-4770-9326-cf083695167a req-0616d585-f468-4d73-9aed-ec2903597810 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:23.244860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2cfb0e25-486f-4770-9326-cf083695167a req-0616d585-f468-4d73-9aed-ec2903597810 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:23.276744 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2cfb0e25-486f-4770-9326-cf083695167a req-0616d585-f468-4d73-9aed-ec2903597810 service nova] Creating event network-changed:21ccea57-b191-4ddd-a4e2-aa9c59963daa for instance ee815ebc-effc-47e7-b0c4-590b10b5cd28 on n-h1-850468-16 Aug 23 18:10:23.294532 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2cfb0e25-486f-4770-9326-cf083695167a req-0616d585-f468-4d73-9aed-ec2903597810 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075341 Aug 23 18:10:23.295868 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1961/4005] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:23.308673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-593d0765-f97e-4a2c-b844-e89ac59b2829 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:23.310099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-593d0765-f97e-4a2c-b844-e89ac59b2829 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:23.318916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c185612d-f678-4385-99ec-b1e066be2d66 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:23.327739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-593d0765-f97e-4a2c-b844-e89ac59b2829 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:23.328571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-593d0765-f97e-4a2c-b844-e89ac59b2829 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:23.339258 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c185612d-f678-4385-99ec-b1e066be2d66 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.397068 Aug 23 18:10:23.342962 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2045/4006] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:22 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:23.343922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-593d0765-f97e-4a2c-b844-e89ac59b2829 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:23.346993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-593d0765-f97e-4a2c-b844-e89ac59b2829 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:23.347669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-593d0765-f97e-4a2c-b844-e89ac59b2829 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:23.348255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-593d0765-f97e-4a2c-b844-e89ac59b2829 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:23.349265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1138307331", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "2590bb5f-8ace-41d9-ae28-2d05e6f1fbab"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:23.429126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] validate_networks() for [('2590bb5f-8ace-41d9-ae28-2d05e6f1fbab', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:10:23.629959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:23.847304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-593d0765-f97e-4a2c-b844-e89ac59b2829 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:23.855598 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-593d0765-f97e-4a2c-b844-e89ac59b2829 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1315 microversion: 2.1 time: 0.554415 Aug 23 18:10:23.870141 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1962/4007] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:23 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1315 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:23.875459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-74f2ae8e-19d4-4b24-b826-6e516fcac8ae tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:23.876380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-74f2ae8e-19d4-4b24-b826-6e516fcac8ae tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:23.883386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74f2ae8e-19d4-4b24-b826-6e516fcac8ae tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:23.884281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74f2ae8e-19d4-4b24-b826-6e516fcac8ae tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:23.884955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74f2ae8e-19d4-4b24-b826-6e516fcac8ae tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:23.886050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74f2ae8e-19d4-4b24-b826-6e516fcac8ae tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:23.886853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74f2ae8e-19d4-4b24-b826-6e516fcac8ae tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:23.887359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:10:23.887765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74f2ae8e-19d4-4b24-b826-6e516fcac8ae tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:23.888526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:10:23.889023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:10:23.889551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:10:23.890194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:10:23.903339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:23.904056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:23.904504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:23.905241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:23.905705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:23.906231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:23.979313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:10:23.985583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for user 2380358bc6a7496ead343b351bce816d and project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:10:24.003677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:10:24.006229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: e7a4ffd8-f481-4500-a171-bcca6c2cb59a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:10:24.065130 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-91d89293-d6b0-4334-a658-77a2ae87601e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.720085 Aug 23 18:10:24.072807 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2046/4008] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:10:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:10:24.078474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-05ed7e5a-4bd4-44a3-b61e-0983e7804e14 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:24.079226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-05ed7e5a-4bd4-44a3-b61e-0983e7804e14 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: e7a4ffd8-f481-4500-a171-bcca6c2cb59a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:24.088440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-74f2ae8e-19d4-4b24-b826-6e516fcac8ae tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:24.108222 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-74f2ae8e-19d4-4b24-b826-6e516fcac8ae tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1722 microversion: 2.1 time: 0.235262 Aug 23 18:10:24.111781 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1963/4009] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:23 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1722 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:24.182367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-05ed7e5a-4bd4-44a3-b61e-0983e7804e14 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:24.186509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c17943e3-23b3-4eb4-87bc-4ce8c842e767 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:24.187040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c17943e3-23b3-4eb4-87bc-4ce8c842e767 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:24.191259 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-05ed7e5a-4bd4-44a3-b61e-0983e7804e14 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a" status: 200 len: 1215 microversion: 2.1 time: 0.117208 Aug 23 18:10:24.191919 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2047/4010] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:24 2022] GET /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a => generated 1215 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:24.195772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c17943e3-23b3-4eb4-87bc-4ce8c842e767 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:24.196806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c17943e3-23b3-4eb4-87bc-4ce8c842e767 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:24.197832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c17943e3-23b3-4eb4-87bc-4ce8c842e767 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:24.198858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c17943e3-23b3-4eb4-87bc-4ce8c842e767 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:24.199515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c17943e3-23b3-4eb4-87bc-4ce8c842e767 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:24.200800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c17943e3-23b3-4eb4-87bc-4ce8c842e767 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:24.218416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aee16a49-3381-483f-8950-637b7de64111 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:24.218995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aee16a49-3381-483f-8950-637b7de64111 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: e7a4ffd8-f481-4500-a171-bcca6c2cb59a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:24.228876 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-c17943e3-23b3-4eb4-87bc-4ce8c842e767 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] HTTP exception thrown: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c17943e3-23b3-4eb4-87bc-4ce8c842e767 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Request method failure captured: Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 HTTP/1.1 Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRcM7Mdj0RnR1TuiGNJs7NCW9H9tqqBWZ-j5easXJcuKTfShWn8nQuGsAMcdhJYMXBFL0_u5szd4FqUpacIjkGbepXvBUaHE75N9kM1ibdr7Bq67Tg69i4yMpQntWsWuk8HAJNpmzYovVxrYNmt8MmDb4IUI8ck-LEQjrpaFoD-xXhc Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: c7dd15dea3fb4e4bb5f051b71f529e97 Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-340352509 Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c7dd15dea3fb4e4bb5f051b71f529e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c7dd15dea3fb4e4bb5f051b71f529e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c7dd15dea3fb4e4bb5f051b71f529e97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c7dd15dea3fb4e4bb5f051b71f529e97"}]}] Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-340352509 Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: c7dd15dea3fb4e4bb5f051b71f529e97 Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-340352509 Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachSCSIVolumeTestJSON-340352509-project Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 95a73eec1ec44dfe9f6c6cfdfec8ad57 Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-340352509-project Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'bc566e04-087f-4056-9c3d-bf0146a95db4'} Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:10:24.230880 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:10:24.234081 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:24.234081 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.234081 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:24.234081 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.234081 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:24.234081 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:24.234081 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:24.234081 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:10:24.234081 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:10:24.234081 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:24.234081 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.235545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c17943e3-23b3-4eb4-87bc-4ce8c842e767 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Returning 404 to user: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:10:24.237089 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c17943e3-23b3-4eb4-87bc-4ce8c842e767 tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 404 len: 111 microversion: 2.1 time: 0.053793 Aug 23 18:10:24.238637 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1964/4011] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:10:24 2022] DELETE /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:10:24.249401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d94a05a-2419-482f-b26c-4198adcbd75c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:24.251321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d94a05a-2419-482f-b26c-4198adcbd75c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] [instance: bc566e04-087f-4056-9c3d-bf0146a95db4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:24.262332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d94a05a-2419-482f-b26c-4198adcbd75c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:24.263147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d94a05a-2419-482f-b26c-4198adcbd75c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:24.263672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d94a05a-2419-482f-b26c-4198adcbd75c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:24.264614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d94a05a-2419-482f-b26c-4198adcbd75c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:24.265198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d94a05a-2419-482f-b26c-4198adcbd75c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:24.265349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aee16a49-3381-483f-8950-637b7de64111 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: e7a4ffd8-f481-4500-a171-bcca6c2cb59a] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:10:24.268263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d94a05a-2419-482f-b26c-4198adcbd75c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:24.296553 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-7d94a05a-2419-482f-b26c-4198adcbd75c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] HTTP exception thrown: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d94a05a-2419-482f-b26c-4198adcbd75c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Request method failure captured: Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 HTTP/1.1 Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRcM7Mdj0RnR1TuiGNJs7NCW9H9tqqBWZ-j5easXJcuKTfShWn8nQuGsAMcdhJYMXBFL0_u5szd4FqUpacIjkGbepXvBUaHE75N9kM1ibdr7Bq67Tg69i4yMpQntWsWuk8HAJNpmzYovVxrYNmt8MmDb4IUI8ck-LEQjrpaFoD-xXhc Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: c7dd15dea3fb4e4bb5f051b71f529e97 Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-340352509 Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c7dd15dea3fb4e4bb5f051b71f529e97"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c7dd15dea3fb4e4bb5f051b71f529e97"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c7dd15dea3fb4e4bb5f051b71f529e97"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c7dd15dea3fb4e4bb5f051b71f529e97"}]}] Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-340352509 Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: c7dd15dea3fb4e4bb5f051b71f529e97 Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-340352509 Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachSCSIVolumeTestJSON-340352509-project Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 95a73eec1ec44dfe9f6c6cfdfec8ad57 Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-340352509-project Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'bc566e04-087f-4056-9c3d-bf0146a95db4'} Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:24.300609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.304044 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:24.304044 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:24.304044 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:24.304044 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:10:24.304044 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:10:24.304044 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. Aug 23 18:10:24.304044 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.305838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d94a05a-2419-482f-b26c-4198adcbd75c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] Returning 404 to user: Instance bc566e04-087f-4056-9c3d-bf0146a95db4 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:10:24.307659 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d94a05a-2419-482f-b26c-4198adcbd75c tempest-AttachSCSIVolumeTestJSON-340352509 tempest-AttachSCSIVolumeTestJSON-340352509-project] 10.222.0.61 "GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4" status: 404 len: 111 microversion: 2.1 time: 0.063758 Aug 23 18:10:24.316021 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1965/4012] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:24 2022] GET /compute/v2.1/servers/bc566e04-087f-4056-9c3d-bf0146a95db4 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:10:24.367986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-53bfbd8e-8a9f-45dc-b01b-644c4260b052 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:24.369013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-53bfbd8e-8a9f-45dc-b01b-644c4260b052 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:24.376733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53bfbd8e-8a9f-45dc-b01b-644c4260b052 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:24.378477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53bfbd8e-8a9f-45dc-b01b-644c4260b052 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:24.379251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53bfbd8e-8a9f-45dc-b01b-644c4260b052 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:24.380134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53bfbd8e-8a9f-45dc-b01b-644c4260b052 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:24.381488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53bfbd8e-8a9f-45dc-b01b-644c4260b052 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:24.382076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53bfbd8e-8a9f-45dc-b01b-644c4260b052 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:24.481024 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aee16a49-3381-483f-8950-637b7de64111 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a" status: 204 len: 0 microversion: 2.1 time: 0.271863 Aug 23 18:10:24.482264 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2048/4013] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:10:24 2022] DELETE /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:10:24.492009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c9c98f6c-79c1-472a-b1a5-f7a5cc7cf850 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:24.492696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c9c98f6c-79c1-472a-b1a5-f7a5cc7cf850 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: e7a4ffd8-f481-4500-a171-bcca6c2cb59a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:24.530194 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-c9c98f6c-79c1-472a-b1a5-f7a5cc7cf850 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c9c98f6c-79c1-472a-b1a5-f7a5cc7cf850 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a HTTP/1.1 Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'e7a4ffd8-f481-4500-a171-bcca6c2cb59a'} Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2919, in _get_instance Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2931, in _get_instance Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:24.564618 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c9c98f6c-79c1-472a-b1a5-f7a5cc7cf850 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c9c98f6c-79c1-472a-b1a5-f7a5cc7cf850 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a" status: 404 len: 111 microversion: 2.1 time: 0.079033 Aug 23 18:10:24.567994 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2049/4014] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:24 2022] GET /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:10:24.651396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-177496545", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "2590bb5f-8ace-41d9-ae28-2d05e6f1fbab"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:24.730860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] validate_networks() for [('2590bb5f-8ace-41d9-ae28-2d05e6f1fbab', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:10:24.759642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-53bfbd8e-8a9f-45dc-b01b-644c4260b052 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:24.777474 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-53bfbd8e-8a9f-45dc-b01b-644c4260b052 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.409372 Aug 23 18:10:24.790595 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1966/4015] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:24 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:24.879219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-79aec084-a624-489c-8da0-592941a1bab5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:24.880126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-79aec084-a624-489c-8da0-592941a1bab5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:24.891622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79aec084-a624-489c-8da0-592941a1bab5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:24.895311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79aec084-a624-489c-8da0-592941a1bab5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:24.896053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79aec084-a624-489c-8da0-592941a1bab5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:24.896985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79aec084-a624-489c-8da0-592941a1bab5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:24.898887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79aec084-a624-489c-8da0-592941a1bab5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:24.899508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79aec084-a624-489c-8da0-592941a1bab5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:25.287972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:10:25.288646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:10:25.289563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:10:25.290051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:10:25.290533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:10:25.303577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:25.304311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:25.304891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:25.306193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:25.306764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:25.307306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:25.327738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-79aec084-a624-489c-8da0-592941a1bab5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:25.328694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:10:25.335447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for user 2380358bc6a7496ead343b351bce816d and project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:10:25.343196 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-79aec084-a624-489c-8da0-592941a1bab5 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1315 microversion: 2.1 time: 0.462675 Aug 23 18:10:25.356682 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1967/4016] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:24 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1315 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:25.356682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-df18d055-7c7f-4967-acd6-88e775aefa16 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:25.356682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-df18d055-7c7f-4967-acd6-88e775aefa16 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:25.357015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df18d055-7c7f-4967-acd6-88e775aefa16 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:25.357392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df18d055-7c7f-4967-acd6-88e775aefa16 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:25.358012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df18d055-7c7f-4967-acd6-88e775aefa16 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:25.359184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df18d055-7c7f-4967-acd6-88e775aefa16 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:25.359868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df18d055-7c7f-4967-acd6-88e775aefa16 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:25.360516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df18d055-7c7f-4967-acd6-88e775aefa16 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:25.364601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:10:25.368099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:10:25.448909 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0855c8a6-25b0-422e-9094-e8c13d85633d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801437 Aug 23 18:10:25.450332 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2050/4017] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:10:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:10:25.463648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f055a8f7-ef76-49ea-8f34-526235fc245c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:25.464247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f055a8f7-ef76-49ea-8f34-526235fc245c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:25.573374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f055a8f7-ef76-49ea-8f34-526235fc245c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:25.582047 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f055a8f7-ef76-49ea-8f34-526235fc245c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1214 microversion: 2.1 time: 0.123955 Aug 23 18:10:25.583804 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2051/4018] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:25 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1214 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:25.678828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-df18d055-7c7f-4967-acd6-88e775aefa16 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:25.687680 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-df18d055-7c7f-4967-acd6-88e775aefa16 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1722 microversion: 2.1 time: 0.342186 Aug 23 18:10:25.688280 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1968/4019] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:25 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1722 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:25.802646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7a3ebb9c-c96c-4398-ae1a-06f0e02b2dd4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:25.804024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7a3ebb9c-c96c-4398-ae1a-06f0e02b2dd4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:25.811773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a3ebb9c-c96c-4398-ae1a-06f0e02b2dd4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:25.812531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a3ebb9c-c96c-4398-ae1a-06f0e02b2dd4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:25.813180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a3ebb9c-c96c-4398-ae1a-06f0e02b2dd4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:25.814281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a3ebb9c-c96c-4398-ae1a-06f0e02b2dd4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:25.815323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a3ebb9c-c96c-4398-ae1a-06f0e02b2dd4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:25.816150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a3ebb9c-c96c-4398-ae1a-06f0e02b2dd4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:26.079646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a3ebb9c-c96c-4398-ae1a-06f0e02b2dd4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:26.089167 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7a3ebb9c-c96c-4398-ae1a-06f0e02b2dd4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.294386 Aug 23 18:10:26.089822 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2052/4020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:25 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:26.365102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-60f19e67-3f3a-4ef9-bb9a-f7a46bd3c9e6 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:26.365649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-60f19e67-3f3a-4ef9-bb9a-f7a46bd3c9e6 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:26.372729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60f19e67-3f3a-4ef9-bb9a-f7a46bd3c9e6 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:26.373511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60f19e67-3f3a-4ef9-bb9a-f7a46bd3c9e6 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:26.374114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60f19e67-3f3a-4ef9-bb9a-f7a46bd3c9e6 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:26.375036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60f19e67-3f3a-4ef9-bb9a-f7a46bd3c9e6 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:26.375656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60f19e67-3f3a-4ef9-bb9a-f7a46bd3c9e6 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:26.376245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60f19e67-3f3a-4ef9-bb9a-f7a46bd3c9e6 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:26.608346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-be8ddac4-2f99-4c88-b18a-89106b67acf0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:26.608971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-be8ddac4-2f99-4c88-b18a-89106b67acf0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:26.623793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be8ddac4-2f99-4c88-b18a-89106b67acf0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:26.624297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be8ddac4-2f99-4c88-b18a-89106b67acf0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:26.624900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be8ddac4-2f99-4c88-b18a-89106b67acf0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:26.625626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be8ddac4-2f99-4c88-b18a-89106b67acf0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:26.626081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be8ddac4-2f99-4c88-b18a-89106b67acf0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:26.626781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be8ddac4-2f99-4c88-b18a-89106b67acf0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:26.714407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-be8ddac4-2f99-4c88-b18a-89106b67acf0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:26.723097 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-be8ddac4-2f99-4c88-b18a-89106b67acf0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1266 microversion: 2.1 time: 0.118513 Aug 23 18:10:26.738294 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2053/4021] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:26 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:26.743706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-983a5aaf-4330-424c-bc0a-9a79afd3e9e0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:26.744336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-983a5aaf-4330-424c-bc0a-9a79afd3e9e0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:26.755555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-983a5aaf-4330-424c-bc0a-9a79afd3e9e0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:26.756248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-983a5aaf-4330-424c-bc0a-9a79afd3e9e0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:26.756856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-983a5aaf-4330-424c-bc0a-9a79afd3e9e0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:26.758082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-983a5aaf-4330-424c-bc0a-9a79afd3e9e0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:26.758737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-983a5aaf-4330-424c-bc0a-9a79afd3e9e0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:26.759318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-983a5aaf-4330-424c-bc0a-9a79afd3e9e0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:26.790854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-60f19e67-3f3a-4ef9-bb9a-f7a46bd3c9e6 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:26.799290 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-60f19e67-3f3a-4ef9-bb9a-f7a46bd3c9e6 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1315 microversion: 2.1 time: 0.438523 Aug 23 18:10:26.812656 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1969/4022] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:26 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1315 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:27.030013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-983a5aaf-4330-424c-bc0a-9a79afd3e9e0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:27.043975 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-983a5aaf-4330-424c-bc0a-9a79afd3e9e0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1728 microversion: 2.1 time: 0.299787 Aug 23 18:10:27.058963 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2054/4023] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:26 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1728 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:27.072029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-efac1121-293f-43f2-bc34-e754c366de08 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:27.072944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-efac1121-293f-43f2-bc34-e754c366de08 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:27.083290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efac1121-293f-43f2-bc34-e754c366de08 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:27.084082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efac1121-293f-43f2-bc34-e754c366de08 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:27.084756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efac1121-293f-43f2-bc34-e754c366de08 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:27.086272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efac1121-293f-43f2-bc34-e754c366de08 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:27.086771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efac1121-293f-43f2-bc34-e754c366de08 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:27.087357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efac1121-293f-43f2-bc34-e754c366de08 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:27.109338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e7f9fdf7-ae9d-42ef-972e-efcd565f2538 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:27.110238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e7f9fdf7-ae9d-42ef-972e-efcd565f2538 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:27.121127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7f9fdf7-ae9d-42ef-972e-efcd565f2538 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:27.122041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7f9fdf7-ae9d-42ef-972e-efcd565f2538 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:27.123207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7f9fdf7-ae9d-42ef-972e-efcd565f2538 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:27.125211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7f9fdf7-ae9d-42ef-972e-efcd565f2538 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:27.126214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7f9fdf7-ae9d-42ef-972e-efcd565f2538 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:27.127993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7f9fdf7-ae9d-42ef-972e-efcd565f2538 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:27.400653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e7f9fdf7-ae9d-42ef-972e-efcd565f2538 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:27.436547 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e7f9fdf7-ae9d-42ef-972e-efcd565f2538 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.331085 Aug 23 18:10:27.437498 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2055/4024] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:27 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:27.622606 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-efac1121-293f-43f2-bc34-e754c366de08 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.554684 Aug 23 18:10:27.624739 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1970/4025] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:10:27 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-interface => generated 284 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:27.746401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e8dc776c-372a-4e3f-8d76-802ef379134f tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:27.747053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e8dc776c-372a-4e3f-8d76-802ef379134f tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:27.757928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8dc776c-372a-4e3f-8d76-802ef379134f tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:27.758943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8dc776c-372a-4e3f-8d76-802ef379134f tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:27.759594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8dc776c-372a-4e3f-8d76-802ef379134f tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:27.760557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8dc776c-372a-4e3f-8d76-802ef379134f tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:27.761160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8dc776c-372a-4e3f-8d76-802ef379134f tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:27.761731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8dc776c-372a-4e3f-8d76-802ef379134f tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:27.795699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:27.821346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-30eade6e-c6f3-471f-a0cf-8c80d90de90f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:27.822250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-30eade6e-c6f3-471f-a0cf-8c80d90de90f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:27.828839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30eade6e-c6f3-471f-a0cf-8c80d90de90f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:27.829576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30eade6e-c6f3-471f-a0cf-8c80d90de90f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:27.830199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30eade6e-c6f3-471f-a0cf-8c80d90de90f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:27.831115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30eade6e-c6f3-471f-a0cf-8c80d90de90f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:27.831753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30eade6e-c6f3-471f-a0cf-8c80d90de90f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:27.832336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30eade6e-c6f3-471f-a0cf-8c80d90de90f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:27.901524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8dc776c-372a-4e3f-8d76-802ef379134f tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:27.911818 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e8dc776c-372a-4e3f-8d76-802ef379134f tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1272 microversion: 2.1 time: 0.170017 Aug 23 18:10:27.926216 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2056/4026] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:27 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1272 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:28.296643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-30eade6e-c6f3-471f-a0cf-8c80d90de90f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:28.310066 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-30eade6e-c6f3-471f-a0cf-8c80d90de90f tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1315 microversion: 2.1 time: 0.493234 Aug 23 18:10:28.315486 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1971/4027] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:27 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1315 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:28.458192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1d87838d-be2f-4569-a1d2-835b680a8daa tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:28.458847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1d87838d-be2f-4569-a1d2-835b680a8daa tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:28.470228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d87838d-be2f-4569-a1d2-835b680a8daa tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:28.472292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d87838d-be2f-4569-a1d2-835b680a8daa tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:28.485118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d87838d-be2f-4569-a1d2-835b680a8daa tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:28.488886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d87838d-be2f-4569-a1d2-835b680a8daa tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:28.489422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d87838d-be2f-4569-a1d2-835b680a8daa tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:28.489882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d87838d-be2f-4569-a1d2-835b680a8daa tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:28.795756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d87838d-be2f-4569-a1d2-835b680a8daa tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:28.808196 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1d87838d-be2f-4569-a1d2-835b680a8daa tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.354556 Aug 23 18:10:28.810948 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2057/4028] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:28 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:28.947408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a0f0807a-4d52-4eb9-952d-03c75bd6705a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:28.951630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a0f0807a-4d52-4eb9-952d-03c75bd6705a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:28.964916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0f0807a-4d52-4eb9-952d-03c75bd6705a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:28.966838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0f0807a-4d52-4eb9-952d-03c75bd6705a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:28.967462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0f0807a-4d52-4eb9-952d-03c75bd6705a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:28.969051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0f0807a-4d52-4eb9-952d-03c75bd6705a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:28.969719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0f0807a-4d52-4eb9-952d-03c75bd6705a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:28.970871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0f0807a-4d52-4eb9-952d-03c75bd6705a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:29.235031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-24012ff1-09e5-4a99-a842-e5cb98bf3e5c req-f5c830aa-8f16-4ee0-8539-117748c5ff1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b77fc1af-38e5-484e-bdd0-8f4d4f2bb045", "tag": "536af02d-8689-48d1-9623-d2544cc7db26"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:29.269212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-24012ff1-09e5-4a99-a842-e5cb98bf3e5c req-f5c830aa-8f16-4ee0-8539-117748c5ff1b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:29.281326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-24012ff1-09e5-4a99-a842-e5cb98bf3e5c req-f5c830aa-8f16-4ee0-8539-117748c5ff1b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:29.283088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-24012ff1-09e5-4a99-a842-e5cb98bf3e5c req-f5c830aa-8f16-4ee0-8539-117748c5ff1b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:29.307228 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-24012ff1-09e5-4a99-a842-e5cb98bf3e5c req-f5c830aa-8f16-4ee0-8539-117748c5ff1b service nova] Creating event network-changed:536af02d-8689-48d1-9623-d2544cc7db26 for instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 on n-h2-850468-16 Aug 23 18:10:29.315566 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-24012ff1-09e5-4a99-a842-e5cb98bf3e5c req-f5c830aa-8f16-4ee0-8539-117748c5ff1b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085639 Aug 23 18:10:29.316739 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2058/4029] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:29.347973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a723b980-bbd3-462a-b2e3-8f792c0d1649 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:29.348638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a723b980-bbd3-462a-b2e3-8f792c0d1649 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:29.365177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a723b980-bbd3-462a-b2e3-8f792c0d1649 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:29.372019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a723b980-bbd3-462a-b2e3-8f792c0d1649 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:29.373292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a723b980-bbd3-462a-b2e3-8f792c0d1649 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:29.374487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a723b980-bbd3-462a-b2e3-8f792c0d1649 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:29.375109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a723b980-bbd3-462a-b2e3-8f792c0d1649 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:29.375905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a723b980-bbd3-462a-b2e3-8f792c0d1649 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:29.387625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a0f0807a-4d52-4eb9-952d-03c75bd6705a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:29.406498 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a0f0807a-4d52-4eb9-952d-03c75bd6705a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1314 microversion: 2.1 time: 0.476636 Aug 23 18:10:29.426454 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1972/4030] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:28 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:29.733534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a723b980-bbd3-462a-b2e3-8f792c0d1649 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:29.740765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1b015a04-a021-473b-9075-e58064fe365f req-c11872cc-d0a2-4432-b41e-a492b3eaadaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee815ebc-effc-47e7-b0c4-590b10b5cd28", "name": "network-vif-plugged", "status": "completed", "tag": "21ccea57-b191-4ddd-a4e2-aa9c59963daa"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:29.759020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1b015a04-a021-473b-9075-e58064fe365f req-c11872cc-d0a2-4432-b41e-a492b3eaadaa service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:29.759955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1b015a04-a021-473b-9075-e58064fe365f req-c11872cc-d0a2-4432-b41e-a492b3eaadaa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:29.760496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1b015a04-a021-473b-9075-e58064fe365f req-c11872cc-d0a2-4432-b41e-a492b3eaadaa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:29.762135 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a723b980-bbd3-462a-b2e3-8f792c0d1649 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1315 microversion: 2.1 time: 0.405719 Aug 23 18:10:29.763168 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2059/4031] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:29 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1315 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:29.818498 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1b015a04-a021-473b-9075-e58064fe365f req-c11872cc-d0a2-4432-b41e-a492b3eaadaa service nova] Creating event network-vif-plugged:21ccea57-b191-4ddd-a4e2-aa9c59963daa for instance ee815ebc-effc-47e7-b0c4-590b10b5cd28 on n-h1-850468-16 Aug 23 18:10:29.826023 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1b015a04-a021-473b-9075-e58064fe365f req-c11872cc-d0a2-4432-b41e-a492b3eaadaa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089990 Aug 23 18:10:29.827020 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1973/4032] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:10:29.872772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-935d24fb-fd0f-414f-9aba-018ccd26b036 req-47d477a3-3e4f-40de-aeee-3bd3ce0d5a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0d2e07-d2d2-422d-a262-279197b79569", "tag": "014ffa42-ca3f-428d-888e-5c4fca13ce84"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:29.904025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-935d24fb-fd0f-414f-9aba-018ccd26b036 req-47d477a3-3e4f-40de-aeee-3bd3ce0d5a58 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:29.904025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-935d24fb-fd0f-414f-9aba-018ccd26b036 req-47d477a3-3e4f-40de-aeee-3bd3ce0d5a58 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:29.904306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-935d24fb-fd0f-414f-9aba-018ccd26b036 req-47d477a3-3e4f-40de-aeee-3bd3ce0d5a58 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:29.916301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-80bf8aa2-e8b8-4337-b2a6-13fe3df38a80 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:29.917517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-80bf8aa2-e8b8-4337-b2a6-13fe3df38a80 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:29.933349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80bf8aa2-e8b8-4337-b2a6-13fe3df38a80 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:29.934764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80bf8aa2-e8b8-4337-b2a6-13fe3df38a80 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:29.936063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80bf8aa2-e8b8-4337-b2a6-13fe3df38a80 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:29.937470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80bf8aa2-e8b8-4337-b2a6-13fe3df38a80 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:29.937626 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-935d24fb-fd0f-414f-9aba-018ccd26b036 req-47d477a3-3e4f-40de-aeee-3bd3ce0d5a58 service nova] Creating event network-changed:014ffa42-ca3f-428d-888e-5c4fca13ce84 for instance 8f0d2e07-d2d2-422d-a262-279197b79569 on n-h2-850468-16 Aug 23 18:10:29.938360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80bf8aa2-e8b8-4337-b2a6-13fe3df38a80 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:29.940858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80bf8aa2-e8b8-4337-b2a6-13fe3df38a80 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:29.949652 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-935d24fb-fd0f-414f-9aba-018ccd26b036 req-47d477a3-3e4f-40de-aeee-3bd3ce0d5a58 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081181 Aug 23 18:10:29.952207 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2060/4033] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:30.439474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f4f2b51f-46a5-45ba-8eb9-1377b612a4d6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:30.440857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f4f2b51f-46a5-45ba-8eb9-1377b612a4d6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:30.449796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4f2b51f-46a5-45ba-8eb9-1377b612a4d6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:30.450530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4f2b51f-46a5-45ba-8eb9-1377b612a4d6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:30.451236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4f2b51f-46a5-45ba-8eb9-1377b612a4d6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:30.456833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4f2b51f-46a5-45ba-8eb9-1377b612a4d6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:30.457548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4f2b51f-46a5-45ba-8eb9-1377b612a4d6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:30.458450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4f2b51f-46a5-45ba-8eb9-1377b612a4d6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:30.683545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f4f2b51f-46a5-45ba-8eb9-1377b612a4d6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:30.699523 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f4f2b51f-46a5-45ba-8eb9-1377b612a4d6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1314 microversion: 2.1 time: 0.268828 Aug 23 18:10:30.700399 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2061/4034] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:30 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:30.791789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b2af0f37-8ef5-449f-96c2-77518a8b2d3d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:30.792697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b2af0f37-8ef5-449f-96c2-77518a8b2d3d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:30.804215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2af0f37-8ef5-449f-96c2-77518a8b2d3d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:30.804887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2af0f37-8ef5-449f-96c2-77518a8b2d3d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:30.805475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2af0f37-8ef5-449f-96c2-77518a8b2d3d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:30.806352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2af0f37-8ef5-449f-96c2-77518a8b2d3d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:30.807421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2af0f37-8ef5-449f-96c2-77518a8b2d3d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:30.808107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2af0f37-8ef5-449f-96c2-77518a8b2d3d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:31.016336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b2af0f37-8ef5-449f-96c2-77518a8b2d3d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:31.033273 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b2af0f37-8ef5-449f-96c2-77518a8b2d3d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1315 microversion: 2.1 time: 0.248164 Aug 23 18:10:31.034194 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2062/4035] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:30 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:31.064930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-80bf8aa2-e8b8-4337-b2a6-13fe3df38a80 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:31.071773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:31.075033 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-80bf8aa2-e8b8-4337-b2a6-13fe3df38a80 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 1.168212 Aug 23 18:10:31.099062 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1974/4036] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:29 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 1194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:31.729911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1a30f5c-f086-4acc-8401-728510432c9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:31.731996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d1a30f5c-f086-4acc-8401-728510432c9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:31.745110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1a30f5c-f086-4acc-8401-728510432c9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:31.745871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1a30f5c-f086-4acc-8401-728510432c9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:31.746489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1a30f5c-f086-4acc-8401-728510432c9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:31.747796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1a30f5c-f086-4acc-8401-728510432c9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:31.748416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1a30f5c-f086-4acc-8401-728510432c9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:31.749003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1a30f5c-f086-4acc-8401-728510432c9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:31.950093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d1a30f5c-f086-4acc-8401-728510432c9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:31.960881 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d1a30f5c-f086-4acc-8401-728510432c9c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1314 microversion: 2.1 time: 0.243082 Aug 23 18:10:31.966866 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2063/4037] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:31 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:32.061362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86ad4cee-d496-4c59-b434-48c58fd6f698 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:32.062626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-86ad4cee-d496-4c59-b434-48c58fd6f698 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:32.073934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-0332f29c-464f-4a61-bda5-4f71cd97338c req-26545d61-83c1-4fa5-a6f8-b645beda69ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f0d2e07-d2d2-422d-a262-279197b79569", "tag": "014ffa42-ca3f-428d-888e-5c4fca13ce84"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:32.099800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86ad4cee-d496-4c59-b434-48c58fd6f698 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:32.100873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86ad4cee-d496-4c59-b434-48c58fd6f698 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:32.101537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86ad4cee-d496-4c59-b434-48c58fd6f698 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:32.102730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86ad4cee-d496-4c59-b434-48c58fd6f698 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:32.103424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86ad4cee-d496-4c59-b434-48c58fd6f698 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:32.103972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0332f29c-464f-4a61-bda5-4f71cd97338c req-26545d61-83c1-4fa5-a6f8-b645beda69ef service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:32.105029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0332f29c-464f-4a61-bda5-4f71cd97338c req-26545d61-83c1-4fa5-a6f8-b645beda69ef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:32.106320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86ad4cee-d496-4c59-b434-48c58fd6f698 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:32.107009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0332f29c-464f-4a61-bda5-4f71cd97338c req-26545d61-83c1-4fa5-a6f8-b645beda69ef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:32.144906 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-0332f29c-464f-4a61-bda5-4f71cd97338c req-26545d61-83c1-4fa5-a6f8-b645beda69ef service nova] Creating event network-changed:014ffa42-ca3f-428d-888e-5c4fca13ce84 for instance 8f0d2e07-d2d2-422d-a262-279197b79569 on n-h2-850468-16 Aug 23 18:10:32.155054 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-0332f29c-464f-4a61-bda5-4f71cd97338c req-26545d61-83c1-4fa5-a6f8-b645beda69ef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084531 Aug 23 18:10:32.160087 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2064/4038] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:32.196438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-86d1a143-5cfd-4d03-8aaf-f9df5b62f329 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:32.197780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-86d1a143-5cfd-4d03-8aaf-f9df5b62f329 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:32.231933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86d1a143-5cfd-4d03-8aaf-f9df5b62f329 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:32.232464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86d1a143-5cfd-4d03-8aaf-f9df5b62f329 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:32.233394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86d1a143-5cfd-4d03-8aaf-f9df5b62f329 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:32.234159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86d1a143-5cfd-4d03-8aaf-f9df5b62f329 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:32.234708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86d1a143-5cfd-4d03-8aaf-f9df5b62f329 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:32.235148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86d1a143-5cfd-4d03-8aaf-f9df5b62f329 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:32.639520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-86d1a143-5cfd-4d03-8aaf-f9df5b62f329 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:32.648919 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-86d1a143-5cfd-4d03-8aaf-f9df5b62f329 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.486994 Aug 23 18:10:32.649531 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2065/4039] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:32 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:32.807753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-86ad4cee-d496-4c59-b434-48c58fd6f698 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:32.815860 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-86ad4cee-d496-4c59-b434-48c58fd6f698 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1315 microversion: 2.1 time: 0.758364 Aug 23 18:10:32.818890 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1975/4040] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:32 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1315 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:32.994066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7c2b6a3-0b86-467e-aa60-ae259c31a24d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:32.994738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b7c2b6a3-0b86-467e-aa60-ae259c31a24d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:33.022164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7c2b6a3-0b86-467e-aa60-ae259c31a24d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:33.022686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7c2b6a3-0b86-467e-aa60-ae259c31a24d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:33.023134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7c2b6a3-0b86-467e-aa60-ae259c31a24d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:33.023849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7c2b6a3-0b86-467e-aa60-ae259c31a24d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:33.024316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7c2b6a3-0b86-467e-aa60-ae259c31a24d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:33.024744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7c2b6a3-0b86-467e-aa60-ae259c31a24d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:33.314770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b7c2b6a3-0b86-467e-aa60-ae259c31a24d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:33.324601 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b7c2b6a3-0b86-467e-aa60-ae259c31a24d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1314 microversion: 2.1 time: 0.338155 Aug 23 18:10:33.325273 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2066/4041] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:32 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:33.671054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-08440394-6027-4705-b848-4e717cec1991 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:33.672363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-08440394-6027-4705-b848-4e717cec1991 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:33.687604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08440394-6027-4705-b848-4e717cec1991 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:33.691252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08440394-6027-4705-b848-4e717cec1991 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:33.691916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08440394-6027-4705-b848-4e717cec1991 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:33.692990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08440394-6027-4705-b848-4e717cec1991 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:33.693643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08440394-6027-4705-b848-4e717cec1991 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:33.694316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08440394-6027-4705-b848-4e717cec1991 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:33.836978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7fb91dec-47e6-48b9-b7e0-f3312ef18892 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:33.837719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7fb91dec-47e6-48b9-b7e0-f3312ef18892 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:33.847184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:33.854191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fb91dec-47e6-48b9-b7e0-f3312ef18892 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:33.854929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fb91dec-47e6-48b9-b7e0-f3312ef18892 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:33.858271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fb91dec-47e6-48b9-b7e0-f3312ef18892 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:33.859317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fb91dec-47e6-48b9-b7e0-f3312ef18892 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:33.862374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fb91dec-47e6-48b9-b7e0-f3312ef18892 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:33.862972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7fb91dec-47e6-48b9-b7e0-f3312ef18892 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.098821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-08440394-6027-4705-b848-4e717cec1991 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:34.109726 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-08440394-6027-4705-b848-4e717cec1991 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.442709 Aug 23 18:10:34.110616 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1976/4042] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:33 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:34.224506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7fb91dec-47e6-48b9-b7e0-f3312ef18892 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:34.248395 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7fb91dec-47e6-48b9-b7e0-f3312ef18892 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1502 microversion: 2.1 time: 0.415548 Aug 23 18:10:34.249025 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2067/4043] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:33 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1502 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:34.277574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a8c4a3b1-e19a-445e-8a7e-4dcfe113c50d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:34.278304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a8c4a3b1-e19a-445e-8a7e-4dcfe113c50d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:34.288518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8c4a3b1-e19a-445e-8a7e-4dcfe113c50d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:34.289296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8c4a3b1-e19a-445e-8a7e-4dcfe113c50d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:34.289964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8c4a3b1-e19a-445e-8a7e-4dcfe113c50d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.291918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8c4a3b1-e19a-445e-8a7e-4dcfe113c50d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:34.292681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8c4a3b1-e19a-445e-8a7e-4dcfe113c50d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:34.293316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8c4a3b1-e19a-445e-8a7e-4dcfe113c50d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.336926 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a8c4a3b1-e19a-445e-8a7e-4dcfe113c50d tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28/ips" status: 200 len: 107 microversion: 2.1 time: 0.066106 Aug 23 18:10:34.339493 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1977/4044] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:10:34 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28/ips => generated 107 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:34.351566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dac57c5d-8fad-4cca-a2db-a143386e136b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:34.352312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dac57c5d-8fad-4cca-a2db-a143386e136b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:34.362373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8c8629d1-ccc4-4301-8220-e615fba49959 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:34.363038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8c8629d1-ccc4-4301-8220-e615fba49959 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:34.364080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dac57c5d-8fad-4cca-a2db-a143386e136b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:34.364684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dac57c5d-8fad-4cca-a2db-a143386e136b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:34.365432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dac57c5d-8fad-4cca-a2db-a143386e136b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.366288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dac57c5d-8fad-4cca-a2db-a143386e136b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:34.368432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dac57c5d-8fad-4cca-a2db-a143386e136b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:34.368973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dac57c5d-8fad-4cca-a2db-a143386e136b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.371511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c8629d1-ccc4-4301-8220-e615fba49959 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:34.384031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c8629d1-ccc4-4301-8220-e615fba49959 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:34.385022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c8629d1-ccc4-4301-8220-e615fba49959 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.385819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c8629d1-ccc4-4301-8220-e615fba49959 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:34.386517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c8629d1-ccc4-4301-8220-e615fba49959 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:34.387021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c8629d1-ccc4-4301-8220-e615fba49959 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.421715 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8c8629d1-ccc4-4301-8220-e615fba49959 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28/ips" status: 200 len: 107 microversion: 2.1 time: 0.067525 Aug 23 18:10:34.422667 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1978/4045] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:10:34 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28/ips => generated 107 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:34.440974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b4290b0f-b5fe-414e-a2d2-65f2d4efd685 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:34.443721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b4290b0f-b5fe-414e-a2d2-65f2d4efd685 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:34.454310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:34.457475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4290b0f-b5fe-414e-a2d2-65f2d4efd685 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:34.458236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4290b0f-b5fe-414e-a2d2-65f2d4efd685 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:34.458744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4290b0f-b5fe-414e-a2d2-65f2d4efd685 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.459841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4290b0f-b5fe-414e-a2d2-65f2d4efd685 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:34.460696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4290b0f-b5fe-414e-a2d2-65f2d4efd685 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:34.461186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4290b0f-b5fe-414e-a2d2-65f2d4efd685 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.490810 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b4290b0f-b5fe-414e-a2d2-65f2d4efd685 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28/ips/tempest-ServerAddressesTestJSON-61747409-network" status: 200 len: 92 microversion: 2.1 time: 0.059820 Aug 23 18:10:34.498113 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1979/4046] 10.222.0.61 () {58 vars in 1395 bytes} [Tue Aug 23 18:10:34 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28/ips/tempest-ServerAddressesTestJSON-61747409-network => generated 92 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:10:34.504022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c3637c80-abcf-4791-ae9f-33299ee733ee tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:34.505667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c3637c80-abcf-4791-ae9f-33299ee733ee tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:34.515715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3637c80-abcf-4791-ae9f-33299ee733ee tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:34.516219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3637c80-abcf-4791-ae9f-33299ee733ee tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:34.516886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3637c80-abcf-4791-ae9f-33299ee733ee tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.517424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3637c80-abcf-4791-ae9f-33299ee733ee tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:34.517888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3637c80-abcf-4791-ae9f-33299ee733ee tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:34.518533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3637c80-abcf-4791-ae9f-33299ee733ee tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.564707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c3637c80-abcf-4791-ae9f-33299ee733ee tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:10:34.670038 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c3637c80-abcf-4791-ae9f-33299ee733ee tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 204 len: 0 microversion: 2.1 time: 0.169566 Aug 23 18:10:34.670812 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1980/4047] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:10:34 2022] DELETE /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:10:34.682356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-747f6ac5-5a06-4988-85c8-f21361014503 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:34.683194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-747f6ac5-5a06-4988-85c8-f21361014503 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:34.691212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-747f6ac5-5a06-4988-85c8-f21361014503 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:34.691790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-747f6ac5-5a06-4988-85c8-f21361014503 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:34.692433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-747f6ac5-5a06-4988-85c8-f21361014503 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.693383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-747f6ac5-5a06-4988-85c8-f21361014503 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:34.694136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-747f6ac5-5a06-4988-85c8-f21361014503 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:34.694818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-747f6ac5-5a06-4988-85c8-f21361014503 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:34.709607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dac57c5d-8fad-4cca-a2db-a143386e136b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:34.723862 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dac57c5d-8fad-4cca-a2db-a143386e136b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1314 microversion: 2.1 time: 0.381783 Aug 23 18:10:34.724825 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2068/4048] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:34 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:34.952951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-747f6ac5-5a06-4988-85c8-f21361014503 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:34.964381 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-747f6ac5-5a06-4988-85c8-f21361014503 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1508 microversion: 2.1 time: 0.288327 Aug 23 18:10:34.964970 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1981/4049] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:34 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1508 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:35.131655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d0728485-730c-4017-9507-a6b8bfc71243 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:35.132925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d0728485-730c-4017-9507-a6b8bfc71243 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:35.139961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0728485-730c-4017-9507-a6b8bfc71243 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:35.140646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0728485-730c-4017-9507-a6b8bfc71243 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:35.141249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0728485-730c-4017-9507-a6b8bfc71243 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:35.143231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0728485-730c-4017-9507-a6b8bfc71243 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:35.144101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0728485-730c-4017-9507-a6b8bfc71243 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:35.144685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0728485-730c-4017-9507-a6b8bfc71243 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:35.319028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:35.393282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d0728485-730c-4017-9507-a6b8bfc71243 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:35.403748 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d0728485-730c-4017-9507-a6b8bfc71243 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.276083 Aug 23 18:10:35.418948 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2069/4050] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:35 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:35.744920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e4939aa-68df-4a7c-8d8e-1b53a7cef75a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:35.745423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e4939aa-68df-4a7c-8d8e-1b53a7cef75a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:35.754288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e4939aa-68df-4a7c-8d8e-1b53a7cef75a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:35.754902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e4939aa-68df-4a7c-8d8e-1b53a7cef75a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:35.755423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e4939aa-68df-4a7c-8d8e-1b53a7cef75a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:35.756566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e4939aa-68df-4a7c-8d8e-1b53a7cef75a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:35.757088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e4939aa-68df-4a7c-8d8e-1b53a7cef75a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:35.757779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e4939aa-68df-4a7c-8d8e-1b53a7cef75a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:35.974716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e4939aa-68df-4a7c-8d8e-1b53a7cef75a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:35.985597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b9f3d97-7fda-41a9-94da-38f744773073 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:35.986885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b9f3d97-7fda-41a9-94da-38f744773073 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:36.004186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=18 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:36.007043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b9f3d97-7fda-41a9-94da-38f744773073 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:36.007308 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e4939aa-68df-4a7c-8d8e-1b53a7cef75a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1314 microversion: 2.1 time: 0.260235 Aug 23 18:10:36.009013 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1982/4051] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:35 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:36.010460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b9f3d97-7fda-41a9-94da-38f744773073 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:36.011254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b9f3d97-7fda-41a9-94da-38f744773073 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:36.012184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b9f3d97-7fda-41a9-94da-38f744773073 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:36.012625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b9f3d97-7fda-41a9-94da-38f744773073 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:36.014676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b9f3d97-7fda-41a9-94da-38f744773073 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:36.180960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-16b29762-7756-410f-8526-e7c3bb54d8c3 req-4b5880a8-f565-4cd1-be18-784717ed4591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e416c1-52c3-4451-8edb-1f86e6709a61", "name": "network-vif-plugged", "status": "completed", "tag": "84e01b73-4166-423a-8088-4acd7d53dfa1"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:36.213601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-16b29762-7756-410f-8526-e7c3bb54d8c3 req-4b5880a8-f565-4cd1-be18-784717ed4591 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:36.220549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-16b29762-7756-410f-8526-e7c3bb54d8c3 req-4b5880a8-f565-4cd1-be18-784717ed4591 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:36.221434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-16b29762-7756-410f-8526-e7c3bb54d8c3 req-4b5880a8-f565-4cd1-be18-784717ed4591 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:36.250583 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-16b29762-7756-410f-8526-e7c3bb54d8c3 req-4b5880a8-f565-4cd1-be18-784717ed4591 service nova] Creating event network-vif-plugged:84e01b73-4166-423a-8088-4acd7d53dfa1 for instance a0e416c1-52c3-4451-8edb-1f86e6709a61 on n-h1-850468-16 Aug 23 18:10:36.260641 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-16b29762-7756-410f-8526-e7c3bb54d8c3 req-4b5880a8-f565-4cd1-be18-784717ed4591 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084703 Aug 23 18:10:36.266482 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1983/4052] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:10:36.289523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b9f3d97-7fda-41a9-94da-38f744773073 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:36.301683 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b9f3d97-7fda-41a9-94da-38f744773073 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1508 microversion: 2.1 time: 0.319723 Aug 23 18:10:36.315719 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2070/4053] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:35 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1508 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:36.432748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a05a2aa5-2317-4107-82be-f48318dbb4b4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:36.433803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a05a2aa5-2317-4107-82be-f48318dbb4b4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:36.459208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a05a2aa5-2317-4107-82be-f48318dbb4b4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:36.459800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a05a2aa5-2317-4107-82be-f48318dbb4b4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:36.460255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a05a2aa5-2317-4107-82be-f48318dbb4b4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:36.460997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a05a2aa5-2317-4107-82be-f48318dbb4b4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:36.461607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a05a2aa5-2317-4107-82be-f48318dbb4b4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:36.462284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a05a2aa5-2317-4107-82be-f48318dbb4b4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:36.813672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a05a2aa5-2317-4107-82be-f48318dbb4b4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:36.858962 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a05a2aa5-2317-4107-82be-f48318dbb4b4 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.437099 Aug 23 18:10:36.863246 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1984/4054] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:36 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:37.031024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b5c2605a-c4b9-4af5-8183-631b635f5152 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:37.032286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b5c2605a-c4b9-4af5-8183-631b635f5152 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:37.049393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5c2605a-c4b9-4af5-8183-631b635f5152 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:37.051886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5c2605a-c4b9-4af5-8183-631b635f5152 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:37.052745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5c2605a-c4b9-4af5-8183-631b635f5152 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:37.055631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5c2605a-c4b9-4af5-8183-631b635f5152 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:37.056259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5c2605a-c4b9-4af5-8183-631b635f5152 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:37.058623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5c2605a-c4b9-4af5-8183-631b635f5152 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:37.124071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-d6087d29-5aff-4d9a-a8cc-41f084037d44 req-c6aca313-9265-4ab4-93c0-8cb1ab277cc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee815ebc-effc-47e7-b0c4-590b10b5cd28", "name": "network-vif-deleted", "tag": "21ccea57-b191-4ddd-a4e2-aa9c59963daa"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:37.154755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d6087d29-5aff-4d9a-a8cc-41f084037d44 req-c6aca313-9265-4ab4-93c0-8cb1ab277cc2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:37.155592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d6087d29-5aff-4d9a-a8cc-41f084037d44 req-c6aca313-9265-4ab4-93c0-8cb1ab277cc2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:37.156215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d6087d29-5aff-4d9a-a8cc-41f084037d44 req-c6aca313-9265-4ab4-93c0-8cb1ab277cc2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:37.190419 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-d6087d29-5aff-4d9a-a8cc-41f084037d44 req-c6aca313-9265-4ab4-93c0-8cb1ab277cc2 service nova] Creating event network-vif-deleted:21ccea57-b191-4ddd-a4e2-aa9c59963daa for instance ee815ebc-effc-47e7-b0c4-590b10b5cd28 on n-h1-850468-16 Aug 23 18:10:37.207065 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-d6087d29-5aff-4d9a-a8cc-41f084037d44 req-c6aca313-9265-4ab4-93c0-8cb1ab277cc2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088895 Aug 23 18:10:37.208155 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1985/4055] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:10:37.337927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:37.339117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:37.355859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:37.356374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:37.356894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:37.362900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:37.366182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:37.366830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:37.447271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:37.447977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:37.448606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:37.449373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lazy-loading 'fault' on Instance uuid ee815ebc-effc-47e7-b0c4-590b10b5cd28 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:10:37.516517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d37a4b52c4e43919328c3414f0680f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5f36d50f2274c02b1d7697f0774c55d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:37.526397 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81dbc235-d210-4595-9d52-245ea39b1b4a tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 200 len: 1305 microversion: 2.1 time: 0.193347 Aug 23 18:10:37.541012 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1986/4056] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:37 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 1305 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:37.632501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b5c2605a-c4b9-4af5-8183-631b635f5152 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:37.655733 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b5c2605a-c4b9-4af5-8183-631b635f5152 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1314 microversion: 2.1 time: 0.628942 Aug 23 18:10:37.658378 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2071/4057] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:37 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1314 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:37.881703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec45732c-f89e-4403-b877-72c1f34b749f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:37.882934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ec45732c-f89e-4403-b877-72c1f34b749f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:37.889930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec45732c-f89e-4403-b877-72c1f34b749f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:37.890415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec45732c-f89e-4403-b877-72c1f34b749f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:37.890898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec45732c-f89e-4403-b877-72c1f34b749f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:37.891613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec45732c-f89e-4403-b877-72c1f34b749f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:37.895495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec45732c-f89e-4403-b877-72c1f34b749f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:37.896130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec45732c-f89e-4403-b877-72c1f34b749f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:38.312615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-1e67b6e1-4375-45ec-be6f-cbf7a0406829 req-2a860dc5-2715-4019-8011-6fac44c703d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b77fc1af-38e5-484e-bdd0-8f4d4f2bb045", "name": "network-vif-plugged", "status": "completed", "tag": "536af02d-8689-48d1-9623-d2544cc7db26"}, {"server_uuid": "a0e416c1-52c3-4451-8edb-1f86e6709a61", "name": "network-vif-plugged", "status": "completed", "tag": "105b1931-952d-4863-a0d4-bb595623be7a"}, {"server_uuid": "a0e416c1-52c3-4451-8edb-1f86e6709a61", "name": "network-vif-plugged", "status": "completed", "tag": "4a7be3cc-a4b5-4ba2-be03-94e6af4c85cc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:38.332134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1e67b6e1-4375-45ec-be6f-cbf7a0406829 req-2a860dc5-2715-4019-8011-6fac44c703d0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:38.332936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1e67b6e1-4375-45ec-be6f-cbf7a0406829 req-2a860dc5-2715-4019-8011-6fac44c703d0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:38.333583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1e67b6e1-4375-45ec-be6f-cbf7a0406829 req-2a860dc5-2715-4019-8011-6fac44c703d0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:38.353577 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-1e67b6e1-4375-45ec-be6f-cbf7a0406829 req-2a860dc5-2715-4019-8011-6fac44c703d0 service nova] Creating event network-vif-plugged:536af02d-8689-48d1-9623-d2544cc7db26 for instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 on n-h2-850468-16 Aug 23 18:10:38.354400 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-1e67b6e1-4375-45ec-be6f-cbf7a0406829 req-2a860dc5-2715-4019-8011-6fac44c703d0 service nova] Creating event network-vif-plugged:105b1931-952d-4863-a0d4-bb595623be7a for instance a0e416c1-52c3-4451-8edb-1f86e6709a61 on n-h1-850468-16 Aug 23 18:10:38.355134 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-1e67b6e1-4375-45ec-be6f-cbf7a0406829 req-2a860dc5-2715-4019-8011-6fac44c703d0 service nova] Creating event network-vif-plugged:4a7be3cc-a4b5-4ba2-be03-94e6af4c85cc for instance a0e416c1-52c3-4451-8edb-1f86e6709a61 on n-h1-850468-16 Aug 23 18:10:38.365156 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-1e67b6e1-4375-45ec-be6f-cbf7a0406829 req-2a860dc5-2715-4019-8011-6fac44c703d0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056987 Aug 23 18:10:38.366294 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2072/4058] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:10:38.525299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec45732c-f89e-4403-b877-72c1f34b749f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:38.537880 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec45732c-f89e-4403-b877-72c1f34b749f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.661855 Aug 23 18:10:38.538722 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1987/4059] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:37 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:38.557555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-215a2773-81ca-4c7d-990c-bf51b07dddf7 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:38.558345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-215a2773-81ca-4c7d-990c-bf51b07dddf7 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] [instance: ee815ebc-effc-47e7-b0c4-590b10b5cd28] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:38.566725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-215a2773-81ca-4c7d-990c-bf51b07dddf7 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:38.567506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-215a2773-81ca-4c7d-990c-bf51b07dddf7 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:38.568194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-215a2773-81ca-4c7d-990c-bf51b07dddf7 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:38.569024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-215a2773-81ca-4c7d-990c-bf51b07dddf7 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:38.569606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-215a2773-81ca-4c7d-990c-bf51b07dddf7 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:38.570146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-215a2773-81ca-4c7d-990c-bf51b07dddf7 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:38.586305 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-215a2773-81ca-4c7d-990c-bf51b07dddf7 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] HTTP exception thrown: Instance ee815ebc-effc-47e7-b0c4-590b10b5cd28 could not be found. Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-215a2773-81ca-4c7d-990c-bf51b07dddf7 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Request method failure captured: Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 HTTP/1.1 Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRgDR4pOvuLcj4YMaJE9fzt310-haHrESlYTf1n2Ikg6u2Xaj6Lszlx98LbKF7W_5-IkasQ5DSsYQOB0rvaWgXCn19F5Fh_78Ysm6AIuv7qgoUaLayGciXFMmupMdOHltsqYA3YoOz6lepm1hGWxp6nqxAH8I2K6OLawuFOXa1FiLLc Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: c5f36d50f2274c02b1d7697f0774c55d Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerAddressesTestJSON-577776038 Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c5f36d50f2274c02b1d7697f0774c55d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c5f36d50f2274c02b1d7697f0774c55d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c5f36d50f2274c02b1d7697f0774c55d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c5f36d50f2274c02b1d7697f0774c55d"}]}] Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerAddressesTestJSON-577776038 Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: c5f36d50f2274c02b1d7697f0774c55d Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerAddressesTestJSON-577776038 Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerAddressesTestJSON-577776038-project Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 1d37a4b52c4e43919328c3414f0680f5 Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerAddressesTestJSON-577776038-project Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance ee815ebc-effc-47e7-b0c4-590b10b5cd28 could not be found. Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'ee815ebc-effc-47e7-b0c4-590b10b5cd28'} Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee815ebc-effc-47e7-b0c4-590b10b5cd28 could not be found. Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee815ebc-effc-47e7-b0c4-590b10b5cd28 could not be found. Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:38.588454 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:38.592698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:38.592698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:38.592698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:38.592698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:10:38.592698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:10:38.592698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee815ebc-effc-47e7-b0c4-590b10b5cd28 could not be found. Aug 23 18:10:38.592698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:38.592698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-215a2773-81ca-4c7d-990c-bf51b07dddf7 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] Returning 404 to user: Instance ee815ebc-effc-47e7-b0c4-590b10b5cd28 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:10:38.592698 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-215a2773-81ca-4c7d-990c-bf51b07dddf7 tempest-ServerAddressesTestJSON-577776038 tempest-ServerAddressesTestJSON-577776038-project] 10.222.0.61 "GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28" status: 404 len: 111 microversion: 2.1 time: 0.036963 Aug 23 18:10:38.592698 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2073/4060] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:38 2022] GET /compute/v2.1/servers/ee815ebc-effc-47e7-b0c4-590b10b5cd28 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:10:38.681027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a1c341e6-14b2-4be5-9bed-1f321c76045e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:38.681910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a1c341e6-14b2-4be5-9bed-1f321c76045e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:38.688402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1c341e6-14b2-4be5-9bed-1f321c76045e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:38.689167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1c341e6-14b2-4be5-9bed-1f321c76045e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:38.690174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1c341e6-14b2-4be5-9bed-1f321c76045e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:38.691111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1c341e6-14b2-4be5-9bed-1f321c76045e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:38.691739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1c341e6-14b2-4be5-9bed-1f321c76045e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:38.692324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1c341e6-14b2-4be5-9bed-1f321c76045e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:39.024841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a1c341e6-14b2-4be5-9bed-1f321c76045e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:39.036103 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a1c341e6-14b2-4be5-9bed-1f321c76045e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1314 microversion: 2.1 time: 0.358935 Aug 23 18:10:39.051838 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1988/4061] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:38 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:39.559502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-29ca9c04-8f11-4319-9647-f1cf9e6d17bd tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:39.560115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-29ca9c04-8f11-4319-9647-f1cf9e6d17bd tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:39.575091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-29ca9c04-8f11-4319-9647-f1cf9e6d17bd tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:39.577624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-29ca9c04-8f11-4319-9647-f1cf9e6d17bd tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:39.577624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-29ca9c04-8f11-4319-9647-f1cf9e6d17bd tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:39.577624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-29ca9c04-8f11-4319-9647-f1cf9e6d17bd tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:39.577912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-29ca9c04-8f11-4319-9647-f1cf9e6d17bd tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:39.578461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-29ca9c04-8f11-4319-9647-f1cf9e6d17bd tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:39.968054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-29ca9c04-8f11-4319-9647-f1cf9e6d17bd tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:39.981438 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-29ca9c04-8f11-4319-9647-f1cf9e6d17bd tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1355 microversion: 2.1 time: 0.423192 Aug 23 18:10:39.986893 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2074/4062] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:39 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1355 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:40.058807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d33c9ffe-ec3d-4e02-be7e-e0d05f9f9ede tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:40.060267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d33c9ffe-ec3d-4e02-be7e-e0d05f9f9ede tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:40.072887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d33c9ffe-ec3d-4e02-be7e-e0d05f9f9ede tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:40.075721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d33c9ffe-ec3d-4e02-be7e-e0d05f9f9ede tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:40.076381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d33c9ffe-ec3d-4e02-be7e-e0d05f9f9ede tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:40.078955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d33c9ffe-ec3d-4e02-be7e-e0d05f9f9ede tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:40.081401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d33c9ffe-ec3d-4e02-be7e-e0d05f9f9ede tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:40.082031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d33c9ffe-ec3d-4e02-be7e-e0d05f9f9ede tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:40.370337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d33c9ffe-ec3d-4e02-be7e-e0d05f9f9ede tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:40.380901 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d33c9ffe-ec3d-4e02-be7e-e0d05f9f9ede tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1314 microversion: 2.1 time: 0.325904 Aug 23 18:10:40.381509 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1989/4063] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:40 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:41.012967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0c27aa58-17de-4958-a8bc-03a08e938443 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:41.015340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0c27aa58-17de-4958-a8bc-03a08e938443 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:41.026136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c27aa58-17de-4958-a8bc-03a08e938443 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:41.027013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c27aa58-17de-4958-a8bc-03a08e938443 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:41.027696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c27aa58-17de-4958-a8bc-03a08e938443 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:41.029208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c27aa58-17de-4958-a8bc-03a08e938443 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:41.030427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c27aa58-17de-4958-a8bc-03a08e938443 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:41.034431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c27aa58-17de-4958-a8bc-03a08e938443 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:41.324321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0c27aa58-17de-4958-a8bc-03a08e938443 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:41.350616 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0c27aa58-17de-4958-a8bc-03a08e938443 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1805 microversion: 2.1 time: 0.348111 Aug 23 18:10:41.352814 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2075/4064] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:40 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1805 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:41.379421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ea4b6259-68b9-4efe-93e3-a936705a9539 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:41.379926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ea4b6259-68b9-4efe-93e3-a936705a9539 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:41.408232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce922242-c333-4b8d-80d2-4ee5033f7408 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:41.408871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ce922242-c333-4b8d-80d2-4ee5033f7408 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:41.425119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea4b6259-68b9-4efe-93e3-a936705a9539 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:41.425643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea4b6259-68b9-4efe-93e3-a936705a9539 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:41.426098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea4b6259-68b9-4efe-93e3-a936705a9539 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:41.426864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea4b6259-68b9-4efe-93e3-a936705a9539 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:41.427332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea4b6259-68b9-4efe-93e3-a936705a9539 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:41.427764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea4b6259-68b9-4efe-93e3-a936705a9539 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:41.428524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce922242-c333-4b8d-80d2-4ee5033f7408 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:41.429020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce922242-c333-4b8d-80d2-4ee5033f7408 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:41.429459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce922242-c333-4b8d-80d2-4ee5033f7408 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:41.430176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce922242-c333-4b8d-80d2-4ee5033f7408 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:41.430661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce922242-c333-4b8d-80d2-4ee5033f7408 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:41.431088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce922242-c333-4b8d-80d2-4ee5033f7408 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:41.473258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:41.577153 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ea4b6259-68b9-4efe-93e3-a936705a9539 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61/ips" status: 200 len: 218 microversion: 2.1 time: 0.197629 Aug 23 18:10:41.583138 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1990/4065] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:10:41 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61/ips => generated 218 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:41.625392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8a435294-fc1b-49d0-abd3-28e4cfff7b35 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:41.638588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8a435294-fc1b-49d0-abd3-28e4cfff7b35 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:41.656441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a435294-fc1b-49d0-abd3-28e4cfff7b35 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:41.657186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a435294-fc1b-49d0-abd3-28e4cfff7b35 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:41.657998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a435294-fc1b-49d0-abd3-28e4cfff7b35 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:41.673913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a435294-fc1b-49d0-abd3-28e4cfff7b35 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:41.686778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a435294-fc1b-49d0-abd3-28e4cfff7b35 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:41.688247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a435294-fc1b-49d0-abd3-28e4cfff7b35 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:41.837342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8a435294-fc1b-49d0-abd3-28e4cfff7b35 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:10:41.896488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:41.991220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ce922242-c333-4b8d-80d2-4ee5033f7408 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:41.991602 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8a435294-fc1b-49d0-abd3-28e4cfff7b35 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 204 len: 0 microversion: 2.1 time: 0.401253 Aug 23 18:10:41.992567 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1991/4066] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:10:41 2022] DELETE /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:10:42.001203 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce922242-c333-4b8d-80d2-4ee5033f7408 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1501 microversion: 2.1 time: 0.600639 Aug 23 18:10:42.002007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d863524c-1c27-4a28-b63d-6dec8f4f4aa8 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:42.002786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d863524c-1c27-4a28-b63d-6dec8f4f4aa8 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:42.005795 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2076/4067] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:41 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1501 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:42.019981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d863524c-1c27-4a28-b63d-6dec8f4f4aa8 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:42.020793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d863524c-1c27-4a28-b63d-6dec8f4f4aa8 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:42.022105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d863524c-1c27-4a28-b63d-6dec8f4f4aa8 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:42.024195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d863524c-1c27-4a28-b63d-6dec8f4f4aa8 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:42.025863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d863524c-1c27-4a28-b63d-6dec8f4f4aa8 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:42.026328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d863524c-1c27-4a28-b63d-6dec8f4f4aa8 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:42.028249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7034534-1555-4dfa-bead-6c37674fdec9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:42.029184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b7034534-1555-4dfa-bead-6c37674fdec9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:42.050879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7034534-1555-4dfa-bead-6c37674fdec9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:42.060359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7034534-1555-4dfa-bead-6c37674fdec9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:42.062859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7034534-1555-4dfa-bead-6c37674fdec9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:42.063786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7034534-1555-4dfa-bead-6c37674fdec9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:42.068923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7034534-1555-4dfa-bead-6c37674fdec9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:42.073140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7034534-1555-4dfa-bead-6c37674fdec9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:42.267956 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b7034534-1555-4dfa-bead-6c37674fdec9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "POST /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045/action" status: 202 len: 0 microversion: 2.1 time: 0.244466 Aug 23 18:10:42.268616 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2077/4068] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:10:42 2022] POST /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:10:42.277862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f4560387-d1f2-499a-8179-991ac199c470 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:42.279626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f4560387-d1f2-499a-8179-991ac199c470 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:42.301346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4560387-d1f2-499a-8179-991ac199c470 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:42.302233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4560387-d1f2-499a-8179-991ac199c470 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:42.304117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4560387-d1f2-499a-8179-991ac199c470 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:42.307470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4560387-d1f2-499a-8179-991ac199c470 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:42.310656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4560387-d1f2-499a-8179-991ac199c470 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:42.311366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4560387-d1f2-499a-8179-991ac199c470 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:42.816035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f4560387-d1f2-499a-8179-991ac199c470 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:42.843956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d863524c-1c27-4a28-b63d-6dec8f4f4aa8 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:42.857455 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f4560387-d1f2-499a-8179-991ac199c470 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1506 microversion: 2.1 time: 0.584085 Aug 23 18:10:42.867304 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2078/4069] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:42 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1506 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:42.880622 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d863524c-1c27-4a28-b63d-6dec8f4f4aa8 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1811 microversion: 2.1 time: 0.883729 Aug 23 18:10:42.905530 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1992/4070] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:41 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1811 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:43.888266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-420dee04-d86a-46b9-9ecd-cbc19f91476a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:43.889049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-420dee04-d86a-46b9-9ecd-cbc19f91476a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:43.902451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-420dee04-d86a-46b9-9ecd-cbc19f91476a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:43.902974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-420dee04-d86a-46b9-9ecd-cbc19f91476a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:43.903438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-420dee04-d86a-46b9-9ecd-cbc19f91476a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:43.904146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-420dee04-d86a-46b9-9ecd-cbc19f91476a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:43.904612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-420dee04-d86a-46b9-9ecd-cbc19f91476a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:43.905046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-420dee04-d86a-46b9-9ecd-cbc19f91476a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:43.919874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8def04f1-5b6f-431a-bb30-85089bfba954 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:43.921142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8def04f1-5b6f-431a-bb30-85089bfba954 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:43.939556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8def04f1-5b6f-431a-bb30-85089bfba954 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:43.940287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8def04f1-5b6f-431a-bb30-85089bfba954 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:43.940738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8def04f1-5b6f-431a-bb30-85089bfba954 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:43.941464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8def04f1-5b6f-431a-bb30-85089bfba954 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:43.941922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8def04f1-5b6f-431a-bb30-85089bfba954 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:43.942346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8def04f1-5b6f-431a-bb30-85089bfba954 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:44.242508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-420dee04-d86a-46b9-9ecd-cbc19f91476a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:44.251649 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-420dee04-d86a-46b9-9ecd-cbc19f91476a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1486 microversion: 2.1 time: 0.367350 Aug 23 18:10:44.266235 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2079/4071] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:43 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1486 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:44.280627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e2d84dc-db02-4f9d-9a76-d8a51ea8cc75 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:44.281375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e2d84dc-db02-4f9d-9a76-d8a51ea8cc75 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:44.308058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e2d84dc-db02-4f9d-9a76-d8a51ea8cc75 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:44.308762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e2d84dc-db02-4f9d-9a76-d8a51ea8cc75 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:44.309352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e2d84dc-db02-4f9d-9a76-d8a51ea8cc75 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:44.310259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e2d84dc-db02-4f9d-9a76-d8a51ea8cc75 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:44.313407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e2d84dc-db02-4f9d-9a76-d8a51ea8cc75 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:44.314444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e2d84dc-db02-4f9d-9a76-d8a51ea8cc75 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:44.383265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e2d84dc-db02-4f9d-9a76-d8a51ea8cc75 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:10:44.549253 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e2d84dc-db02-4f9d-9a76-d8a51ea8cc75 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 204 len: 0 microversion: 2.1 time: 0.272071 Aug 23 18:10:44.550751 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2080/4072] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:10:44 2022] DELETE /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:10:44.562095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae1f5677-5388-43a8-ab4e-960e8230e286 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:44.563064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae1f5677-5388-43a8-ab4e-960e8230e286 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:44.571857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae1f5677-5388-43a8-ab4e-960e8230e286 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:44.572726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae1f5677-5388-43a8-ab4e-960e8230e286 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:44.573332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae1f5677-5388-43a8-ab4e-960e8230e286 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:44.574278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae1f5677-5388-43a8-ab4e-960e8230e286 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:44.575661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae1f5677-5388-43a8-ab4e-960e8230e286 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:44.576304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae1f5677-5388-43a8-ab4e-960e8230e286 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:44.590972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8def04f1-5b6f-431a-bb30-85089bfba954 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:44.629366 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8def04f1-5b6f-431a-bb30-85089bfba954 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1811 microversion: 2.1 time: 0.712177 Aug 23 18:10:44.632761 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1993/4073] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:43 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1811 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:44.897998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ae1f5677-5388-43a8-ab4e-960e8230e286 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:44.908643 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae1f5677-5388-43a8-ab4e-960e8230e286 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1492 microversion: 2.1 time: 0.353749 Aug 23 18:10:44.919664 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2081/4074] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:44 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1492 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:45.655219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-385aadee-4f62-432b-a16e-adf1ac0a576c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:45.656424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-385aadee-4f62-432b-a16e-adf1ac0a576c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:45.667522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-385aadee-4f62-432b-a16e-adf1ac0a576c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:45.674204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-385aadee-4f62-432b-a16e-adf1ac0a576c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:45.674893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-385aadee-4f62-432b-a16e-adf1ac0a576c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:45.680315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-385aadee-4f62-432b-a16e-adf1ac0a576c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:45.681660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-385aadee-4f62-432b-a16e-adf1ac0a576c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:45.682256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-385aadee-4f62-432b-a16e-adf1ac0a576c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:45.693273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-34ac4654-ce59-42fb-b9d6-63959e2dd318 req-2ced62ef-47da-4b76-8720-56dafefeecb2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e416c1-52c3-4451-8edb-1f86e6709a61", "name": "network-vif-deleted", "tag": "105b1931-952d-4863-a0d4-bb595623be7a"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:45.716420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-34ac4654-ce59-42fb-b9d6-63959e2dd318 req-2ced62ef-47da-4b76-8720-56dafefeecb2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:45.716921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-34ac4654-ce59-42fb-b9d6-63959e2dd318 req-2ced62ef-47da-4b76-8720-56dafefeecb2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:45.717353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-34ac4654-ce59-42fb-b9d6-63959e2dd318 req-2ced62ef-47da-4b76-8720-56dafefeecb2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:45.765242 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-34ac4654-ce59-42fb-b9d6-63959e2dd318 req-2ced62ef-47da-4b76-8720-56dafefeecb2 service nova] Creating event network-vif-deleted:105b1931-952d-4863-a0d4-bb595623be7a for instance a0e416c1-52c3-4451-8edb-1f86e6709a61 on n-h1-850468-16 Aug 23 18:10:45.786294 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-34ac4654-ce59-42fb-b9d6-63959e2dd318 req-2ced62ef-47da-4b76-8720-56dafefeecb2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097769 Aug 23 18:10:45.787302 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2082/4075] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:45.933196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-28078eec-abf8-4742-84e2-a441803bcc74 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:45.937497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-28078eec-abf8-4742-84e2-a441803bcc74 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:45.945481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28078eec-abf8-4742-84e2-a441803bcc74 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:45.955790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28078eec-abf8-4742-84e2-a441803bcc74 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:45.956395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28078eec-abf8-4742-84e2-a441803bcc74 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:45.957121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28078eec-abf8-4742-84e2-a441803bcc74 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:45.957584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28078eec-abf8-4742-84e2-a441803bcc74 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:45.958027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28078eec-abf8-4742-84e2-a441803bcc74 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:46.240066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-385aadee-4f62-432b-a16e-adf1ac0a576c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:46.251556 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-385aadee-4f62-432b-a16e-adf1ac0a576c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1790 microversion: 2.1 time: 0.599435 Aug 23 18:10:46.253233 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1994/4076] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:45 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1790 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:46.263570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-994896626", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "ee26c33c-261c-41fa-9dc6-f32617ff9b5a"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:46.355504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] validate_networks() for [('ee26c33c-261c-41fa-9dc6-f32617ff9b5a', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:10:46.670683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-28078eec-abf8-4742-84e2-a441803bcc74 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:46.680364 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-28078eec-abf8-4742-84e2-a441803bcc74 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1492 microversion: 2.1 time: 0.751418 Aug 23 18:10:46.685053 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2083/4077] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:45 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1492 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:47.264318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:10:47.265364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:10:47.266092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:10:47.268428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:10:47.274804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:10:47.275953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-86660ac6-d656-4d2b-b925-1c7c59aff26c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:47.277252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-86660ac6-d656-4d2b-b925-1c7c59aff26c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:47.289965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86660ac6-d656-4d2b-b925-1c7c59aff26c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:47.290842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86660ac6-d656-4d2b-b925-1c7c59aff26c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:47.292037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86660ac6-d656-4d2b-b925-1c7c59aff26c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:47.294820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86660ac6-d656-4d2b-b925-1c7c59aff26c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:47.295471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86660ac6-d656-4d2b-b925-1c7c59aff26c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:47.298393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86660ac6-d656-4d2b-b925-1c7c59aff26c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:47.299512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:47.300475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:47.302267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:47.304341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:47.304890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:47.305491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:47.353895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Getting quotas for project 9e278101a495492392fa362c67532636. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:10:47.368870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Getting quotas for user e9247aeda1a84edd9408d95a6e9290cd and project 9e278101a495492392fa362c67532636. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:10:47.398865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:10:47.403480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:10:47.542835 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bb997f8d-c11b-48b5-8d6a-938644a87ac2 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.281922 Aug 23 18:10:47.552904 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1995/4078] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:10:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1290 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:10:47.569792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4df17c8e-efb7-4884-8414-ed01590b5985 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:47.571719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4df17c8e-efb7-4884-8414-ed01590b5985 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:47.713539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-86660ac6-d656-4d2b-b925-1c7c59aff26c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:47.746196 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-86660ac6-d656-4d2b-b925-1c7c59aff26c tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 200 len: 1656 microversion: 2.1 time: 0.473850 Aug 23 18:10:47.755026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4df17c8e-efb7-4884-8414-ed01590b5985 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:47.766727 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2084/4079] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:47 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 1656 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:47.770479 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4df17c8e-efb7-4884-8414-ed01590b5985 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1218 microversion: 2.1 time: 0.213029 Aug 23 18:10:47.772587 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1996/4080] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:47 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1218 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:47.790619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c61b56ab-ae72-4a63-a18f-5d75c9ae7248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:47.792493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c61b56ab-ae72-4a63-a18f-5d75c9ae7248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:47.810400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c61b56ab-ae72-4a63-a18f-5d75c9ae7248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:47.811241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c61b56ab-ae72-4a63-a18f-5d75c9ae7248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:47.811705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c61b56ab-ae72-4a63-a18f-5d75c9ae7248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:47.814834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c61b56ab-ae72-4a63-a18f-5d75c9ae7248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:47.817044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c61b56ab-ae72-4a63-a18f-5d75c9ae7248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:47.817804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c61b56ab-ae72-4a63-a18f-5d75c9ae7248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:47.862680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-012fe53f-cb28-468c-9c66-bfa90e26f944 req-22d5d12a-5e8d-4ca2-9b77-a2f6870d0aab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0e416c1-52c3-4451-8edb-1f86e6709a61", "name": "network-vif-deleted", "tag": "4a7be3cc-a4b5-4ba2-be03-94e6af4c85cc"}, {"server_uuid": "a0e416c1-52c3-4451-8edb-1f86e6709a61", "name": "network-vif-deleted", "tag": "84e01b73-4166-423a-8088-4acd7d53dfa1"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:47.885260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-012fe53f-cb28-468c-9c66-bfa90e26f944 req-22d5d12a-5e8d-4ca2-9b77-a2f6870d0aab service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:47.886127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-012fe53f-cb28-468c-9c66-bfa90e26f944 req-22d5d12a-5e8d-4ca2-9b77-a2f6870d0aab service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:47.886843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-012fe53f-cb28-468c-9c66-bfa90e26f944 req-22d5d12a-5e8d-4ca2-9b77-a2f6870d0aab service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:47.951939 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-012fe53f-cb28-468c-9c66-bfa90e26f944 req-22d5d12a-5e8d-4ca2-9b77-a2f6870d0aab service nova] Creating event network-vif-deleted:4a7be3cc-a4b5-4ba2-be03-94e6af4c85cc for instance a0e416c1-52c3-4451-8edb-1f86e6709a61 on n-h1-850468-16 Aug 23 18:10:47.955081 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-012fe53f-cb28-468c-9c66-bfa90e26f944 req-22d5d12a-5e8d-4ca2-9b77-a2f6870d0aab service nova] Creating event network-vif-deleted:84e01b73-4166-423a-8088-4acd7d53dfa1 for instance a0e416c1-52c3-4451-8edb-1f86e6709a61 on n-h1-850468-16 Aug 23 18:10:47.967143 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-012fe53f-cb28-468c-9c66-bfa90e26f944 req-22d5d12a-5e8d-4ca2-9b77-a2f6870d0aab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.110663 Aug 23 18:10:47.968852 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1997/4081] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:10:48.176255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c61b56ab-ae72-4a63-a18f-5d75c9ae7248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:48.187687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-8e0ae408-7188-47d3-8861-69d782e2b16e req-d417e473-7961-4d34-a90e-5a23f2625923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b77fc1af-38e5-484e-bdd0-8f4d4f2bb045", "name": "network-vif-deleted", "tag": "536af02d-8689-48d1-9623-d2544cc7db26"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:48.188391 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c61b56ab-ae72-4a63-a18f-5d75c9ae7248 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1450 microversion: 2.1 time: 0.420187 Aug 23 18:10:48.189560 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2085/4082] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:47 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1450 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:48.209713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8e0ae408-7188-47d3-8861-69d782e2b16e req-d417e473-7961-4d34-a90e-5a23f2625923 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:48.210602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8e0ae408-7188-47d3-8861-69d782e2b16e req-d417e473-7961-4d34-a90e-5a23f2625923 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:48.211188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8e0ae408-7188-47d3-8861-69d782e2b16e req-d417e473-7961-4d34-a90e-5a23f2625923 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:48.235041 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-8e0ae408-7188-47d3-8861-69d782e2b16e req-d417e473-7961-4d34-a90e-5a23f2625923 service nova] Creating event network-vif-deleted:536af02d-8689-48d1-9623-d2544cc7db26 for instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 on n-h2-850468-16 Aug 23 18:10:48.244608 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-8e0ae408-7188-47d3-8861-69d782e2b16e req-d417e473-7961-4d34-a90e-5a23f2625923 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060057 Aug 23 18:10:48.245259 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1998/4083] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:48.771599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fdf4fd08-4c18-4c76-b702-cde6681638d2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:48.773096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fdf4fd08-4c18-4c76-b702-cde6681638d2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:48.789461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdf4fd08-4c18-4c76-b702-cde6681638d2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:48.790817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdf4fd08-4c18-4c76-b702-cde6681638d2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:48.792413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdf4fd08-4c18-4c76-b702-cde6681638d2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:48.794564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e58531a0-7d2d-4874-9ac3-20d689bf4c53 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:48.795349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e58531a0-7d2d-4874-9ac3-20d689bf4c53 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:48.800669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdf4fd08-4c18-4c76-b702-cde6681638d2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:48.801494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdf4fd08-4c18-4c76-b702-cde6681638d2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:48.802195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdf4fd08-4c18-4c76-b702-cde6681638d2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:48.825522 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-fdf4fd08-4c18-4c76-b702-cde6681638d2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] HTTP exception thrown: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:10:48.825754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e58531a0-7d2d-4874-9ac3-20d689bf4c53 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:48.826202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e58531a0-7d2d-4874-9ac3-20d689bf4c53 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:48.826665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e58531a0-7d2d-4874-9ac3-20d689bf4c53 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fdf4fd08-4c18-4c76-b702-cde6681638d2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Request method failure captured: Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 HTTP/1.1 Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRfyiVGnTCBtRVmoVs-_pg0U-0JJ9US3NAlEh6Onz1hZxb4CipSXHpqhhDWdq0qs6UkOK7r4BhIYUJ28Ia7HwRS2AoSrV2elPenEDh5yVl_2lteRfNMYNz12S1fymE_gp6Mq1ab4cFx4kcyrvB7um1XM6ADjtgY7ev9wN2KEfBI8Fu0 Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 91018678aa474eee8e5f6c5249ec012e Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestMultiNic-197890916 Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/91018678aa474eee8e5f6c5249ec012e"}]}] Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestMultiNic-197890916 Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 91018678aa474eee8e5f6c5249ec012e Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestMultiNic-197890916 Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestMultiNic-197890916-project Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 673168b77fc84b9e93cccc69a6cb5948 Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestMultiNic-197890916-project Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'a0e416c1-52c3-4451-8edb-1f86e6709a61'} Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:48.828237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:48.834685 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:48.834685 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:48.834685 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:48.834685 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:10:48.834685 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:10:48.834685 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:10:48.834685 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:48.836320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e58531a0-7d2d-4874-9ac3-20d689bf4c53 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:48.836539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e58531a0-7d2d-4874-9ac3-20d689bf4c53 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:48.836986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e58531a0-7d2d-4874-9ac3-20d689bf4c53 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:48.841231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fdf4fd08-4c18-4c76-b702-cde6681638d2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Returning 404 to user: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:10:48.843449 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fdf4fd08-4c18-4c76-b702-cde6681638d2 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 404 len: 111 microversion: 2.1 time: 0.076851 Aug 23 18:10:48.849257 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2086/4084] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:48 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:10:49.075383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e58531a0-7d2d-4874-9ac3-20d689bf4c53 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:49.088641 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e58531a0-7d2d-4874-9ac3-20d689bf4c53 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1222 microversion: 2.1 time: 0.298862 Aug 23 18:10:49.094276 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 1999/4085] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:48 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1222 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:49.212829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:49.213495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:49.228930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:49.229443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:49.229894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:49.231010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:49.231648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:49.232235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:49.279096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:49.284722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:49.285626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:49.286292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lazy-loading 'fault' on Instance uuid b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:10:49.449428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:49.460172 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7eb7bc45-4103-4a0d-a881-e5fad1caa73b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 200 len: 1304 microversion: 2.1 time: 0.250953 Aug 23 18:10:49.461511 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2087/4086] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:49 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 1304 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:50.116078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-29595ed2-6dc8-47c5-b6c8-d5817d0aff22 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:50.116861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-29595ed2-6dc8-47c5-b6c8-d5817d0aff22 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:50.140234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29595ed2-6dc8-47c5-b6c8-d5817d0aff22 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:50.146343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29595ed2-6dc8-47c5-b6c8-d5817d0aff22 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:50.147004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29595ed2-6dc8-47c5-b6c8-d5817d0aff22 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:50.147871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29595ed2-6dc8-47c5-b6c8-d5817d0aff22 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:50.148580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29595ed2-6dc8-47c5-b6c8-d5817d0aff22 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:50.150188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29595ed2-6dc8-47c5-b6c8-d5817d0aff22 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:50.400074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-29595ed2-6dc8-47c5-b6c8-d5817d0aff22 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:50.412503 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-29595ed2-6dc8-47c5-b6c8-d5817d0aff22 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1276 microversion: 2.1 time: 0.300619 Aug 23 18:10:50.414384 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2000/4087] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:50 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1276 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:50.483777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04586e31-6087-4338-865b-fd03f5094e34 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:50.484420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-04586e31-6087-4338-865b-fd03f5094e34 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:50.494569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04586e31-6087-4338-865b-fd03f5094e34 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:50.502357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04586e31-6087-4338-865b-fd03f5094e34 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:50.503097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04586e31-6087-4338-865b-fd03f5094e34 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:50.504103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04586e31-6087-4338-865b-fd03f5094e34 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:50.504731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04586e31-6087-4338-865b-fd03f5094e34 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:50.505323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04586e31-6087-4338-865b-fd03f5094e34 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:50.536057 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-04586e31-6087-4338-865b-fd03f5094e34 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04586e31-6087-4338-865b-fd03f5094e34 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 HTTP/1.1 Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'b77fc1af-38e5-484e-bdd0-8f4d4f2bb045'} Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:10:50.537983 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:50.542097 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:10:50.542097 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:10:50.542097 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:10:50.542097 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:10:50.542097 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:10:50.542097 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:10:50.542097 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:10:50.542097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04586e31-6087-4338-865b-fd03f5094e34 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:10:50.542097 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-04586e31-6087-4338-865b-fd03f5094e34 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 404 len: 111 microversion: 2.1 time: 0.061100 Aug 23 18:10:50.542097 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2088/4088] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:50 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:10:50.778734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1500377958", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "2590bb5f-8ace-41d9-ae28-2d05e6f1fbab"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:50.898282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] validate_networks() for [('2590bb5f-8ace-41d9-ae28-2d05e6f1fbab', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:10:50.993651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0e959b00-bbed-4e22-b9cb-4741059434e9 tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] Action: 'create', calling method: .version_select at 0x7f27dfa000d0>, body: {"pool": null} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:51.952935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:10:51.954090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:10:51.954844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:10:51.955473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:10:51.956098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:10:51.967872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:51.968609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:51.969848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:51.970968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:51.971675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:51.972316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:52.003100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:10:52.012776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for user 2380358bc6a7496ead343b351bce816d and project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:10:52.043294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:10:52.046030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:10:52.100619 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-06b829c4-458f-43b1-83f0-0e24b8b67f61 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.327102 Aug 23 18:10:52.109392 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2089/4089] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:10:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:10:52.115702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f66f5e50-4750-4158-9582-a184d634bff4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:52.117203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f66f5e50-4750-4158-9582-a184d634bff4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:52.127550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f66f5e50-4750-4158-9582-a184d634bff4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:52.128963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f66f5e50-4750-4158-9582-a184d634bff4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:52.129976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f66f5e50-4750-4158-9582-a184d634bff4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:52.131825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f66f5e50-4750-4158-9582-a184d634bff4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:52.133323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f66f5e50-4750-4158-9582-a184d634bff4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:52.134014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f66f5e50-4750-4158-9582-a184d634bff4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:52.285786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f66f5e50-4750-4158-9582-a184d634bff4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:52.306499 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f66f5e50-4750-4158-9582-a184d634bff4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1276 microversion: 2.1 time: 0.194693 Aug 23 18:10:52.314846 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2090/4090] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:52 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1276 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:52.335708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-34b781b9-cf3a-45e4-8b30-aaeb63672441 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:52.336769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-34b781b9-cf3a-45e4-8b30-aaeb63672441 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:52.993900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-34b781b9-cf3a-45e4-8b30-aaeb63672441 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:53.006105 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-34b781b9-cf3a-45e4-8b30-aaeb63672441 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1215 microversion: 2.1 time: 0.686049 Aug 23 18:10:53.007001 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2091/4091] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:52 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1215 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:53.333405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-792a7844-be36-4382-8662-554c893f4370 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:53.334365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-792a7844-be36-4382-8662-554c893f4370 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:53.363977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-792a7844-be36-4382-8662-554c893f4370 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:53.364484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-792a7844-be36-4382-8662-554c893f4370 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:53.365414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-792a7844-be36-4382-8662-554c893f4370 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:53.371837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-792a7844-be36-4382-8662-554c893f4370 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:53.372936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-792a7844-be36-4382-8662-554c893f4370 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:53.373400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-792a7844-be36-4382-8662-554c893f4370 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:53.846317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-792a7844-be36-4382-8662-554c893f4370 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:53.879175 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-792a7844-be36-4382-8662-554c893f4370 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1318 microversion: 2.1 time: 0.552314 Aug 23 18:10:53.892901 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2092/4092] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:53 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1318 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:54.028530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3be8a55-0f73-4a1a-9031-7ac9abd82dc8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:54.029187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f3be8a55-0f73-4a1a-9031-7ac9abd82dc8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:54.044657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3be8a55-0f73-4a1a-9031-7ac9abd82dc8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:54.045919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3be8a55-0f73-4a1a-9031-7ac9abd82dc8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:54.055286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3be8a55-0f73-4a1a-9031-7ac9abd82dc8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:54.056299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3be8a55-0f73-4a1a-9031-7ac9abd82dc8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:54.056939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3be8a55-0f73-4a1a-9031-7ac9abd82dc8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:54.059005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3be8a55-0f73-4a1a-9031-7ac9abd82dc8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:54.132856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:54.375696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f3be8a55-0f73-4a1a-9031-7ac9abd82dc8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:54.389760 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f3be8a55-0f73-4a1a-9031-7ac9abd82dc8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1275 microversion: 2.1 time: 0.364743 Aug 23 18:10:54.404134 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2093/4093] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:54 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1275 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:54.903774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7ccab44-8e43-4508-9167-e1256e7a1ce5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:54.904706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b7ccab44-8e43-4508-9167-e1256e7a1ce5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:54.916564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7ccab44-8e43-4508-9167-e1256e7a1ce5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:54.919523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7ccab44-8e43-4508-9167-e1256e7a1ce5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:54.920160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7ccab44-8e43-4508-9167-e1256e7a1ce5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:54.922004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7ccab44-8e43-4508-9167-e1256e7a1ce5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:54.924507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7ccab44-8e43-4508-9167-e1256e7a1ce5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:54.925115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7ccab44-8e43-4508-9167-e1256e7a1ce5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:55.288212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b7ccab44-8e43-4508-9167-e1256e7a1ce5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:55.298178 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b7ccab44-8e43-4508-9167-e1256e7a1ce5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1318 microversion: 2.1 time: 0.399384 Aug 23 18:10:55.302335 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2094/4094] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:54 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:55.663375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db85c0e2-c546-4306-a2f7-8c70a1f157ee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:55.664328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-db85c0e2-c546-4306-a2f7-8c70a1f157ee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:55.683976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db85c0e2-c546-4306-a2f7-8c70a1f157ee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:55.685118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db85c0e2-c546-4306-a2f7-8c70a1f157ee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:55.685845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db85c0e2-c546-4306-a2f7-8c70a1f157ee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:55.693140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db85c0e2-c546-4306-a2f7-8c70a1f157ee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:55.694267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db85c0e2-c546-4306-a2f7-8c70a1f157ee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:55.694989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db85c0e2-c546-4306-a2f7-8c70a1f157ee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:55.758676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-db85c0e2-c546-4306-a2f7-8c70a1f157ee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:10:56.015171 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-db85c0e2-c546-4306-a2f7-8c70a1f157ee tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 204 len: 0 microversion: 2.32 time: 0.644032 Aug 23 18:10:56.018319 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2095/4095] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:10:55 2022] DELETE /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 0 bytes in 648 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 18:10:56.036286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aed5023e-14a8-425c-8e82-c3eb79326f72 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:56.038053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aed5023e-14a8-425c-8e82-c3eb79326f72 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:56.055556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aed5023e-14a8-425c-8e82-c3eb79326f72 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:56.056070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aed5023e-14a8-425c-8e82-c3eb79326f72 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:56.056525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aed5023e-14a8-425c-8e82-c3eb79326f72 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:56.057988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aed5023e-14a8-425c-8e82-c3eb79326f72 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:56.058461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aed5023e-14a8-425c-8e82-c3eb79326f72 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:56.060722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aed5023e-14a8-425c-8e82-c3eb79326f72 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:56.435429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aed5023e-14a8-425c-8e82-c3eb79326f72 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:56.447791 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aed5023e-14a8-425c-8e82-c3eb79326f72 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1315 microversion: 2.1 time: 0.426857 Aug 23 18:10:56.456297 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2096/4096] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:56 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1315 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:56.474986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-102ae025-15a7-4acd-af1c-c02d3050b674 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:56.476037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-102ae025-15a7-4acd-af1c-c02d3050b674 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:56.487087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-102ae025-15a7-4acd-af1c-c02d3050b674 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:56.488634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-102ae025-15a7-4acd-af1c-c02d3050b674 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:56.488792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-102ae025-15a7-4acd-af1c-c02d3050b674 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:56.489816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-102ae025-15a7-4acd-af1c-c02d3050b674 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:56.490487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-102ae025-15a7-4acd-af1c-c02d3050b674 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:56.491136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-102ae025-15a7-4acd-af1c-c02d3050b674 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:56.602949 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0e959b00-bbed-4e22-b9cb-4741059434e9 tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.887959 Aug 23 18:10:56.604225 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2001/4097] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Aug 23 18:10:50 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:56.611181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-34a41935-eab9-48ea-b18d-232c1e0a9bbc req-4b362597-9cd0-43b5-bc04-1b63a75f44f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ed6c1be2-7bf0-4c16-a14d-46116f1a6509", "tag": "b80341b3-8af4-48b9-8bf9-0ee25e7a336e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:56.662967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-34a41935-eab9-48ea-b18d-232c1e0a9bbc req-4b362597-9cd0-43b5-bc04-1b63a75f44f1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:56.663603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-34a41935-eab9-48ea-b18d-232c1e0a9bbc req-4b362597-9cd0-43b5-bc04-1b63a75f44f1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:56.664060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-34a41935-eab9-48ea-b18d-232c1e0a9bbc req-4b362597-9cd0-43b5-bc04-1b63a75f44f1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:56.684988 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-34a41935-eab9-48ea-b18d-232c1e0a9bbc req-4b362597-9cd0-43b5-bc04-1b63a75f44f1 service nova] Creating event network-changed:b80341b3-8af4-48b9-8bf9-0ee25e7a336e for instance ed6c1be2-7bf0-4c16-a14d-46116f1a6509 on n-h1-850468-16 Aug 23 18:10:56.691425 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-34a41935-eab9-48ea-b18d-232c1e0a9bbc req-4b362597-9cd0-43b5-bc04-1b63a75f44f1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085335 Aug 23 18:10:56.692139 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2002/4098] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:56.697490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4ed59305-717f-4c34-bdab-b10f8ea31fd1 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:56.700547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4ed59305-717f-4c34-bdab-b10f8ea31fd1 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:56.710156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ed59305-717f-4c34-bdab-b10f8ea31fd1 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:56.711447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ed59305-717f-4c34-bdab-b10f8ea31fd1 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:56.712250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ed59305-717f-4c34-bdab-b10f8ea31fd1 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:56.713008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ed59305-717f-4c34-bdab-b10f8ea31fd1 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:56.713706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ed59305-717f-4c34-bdab-b10f8ea31fd1 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:56.714421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ed59305-717f-4c34-bdab-b10f8ea31fd1 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:56.807765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-102ae025-15a7-4acd-af1c-c02d3050b674 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:56.819005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-102ae025-15a7-4acd-af1c-c02d3050b674 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:56.820689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-102ae025-15a7-4acd-af1c-c02d3050b674 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:56.821966 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-102ae025-15a7-4acd-af1c-c02d3050b674 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2948 microversion: 2.32 time: 0.364247 Aug 23 18:10:56.823215 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2097/4099] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:10:56 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2948 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:10:56.827965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f74acf16-eb89-43c9-9ee9-0ede38a17015 tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] Action: 'create', calling method: .version_select at 0x7f27ec80d670>, body: {"pool": null} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:57.322011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:57.400210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ed59305-717f-4c34-bdab-b10f8ea31fd1 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:57.412541 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4ed59305-717f-4c34-bdab-b10f8ea31fd1 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1318 microversion: 2.1 time: 0.718937 Aug 23 18:10:57.417708 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2003/4100] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:56 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1318 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:57.479979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-356efc76-ccc0-4f68-8da3-48bec332b58c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:57.480594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-356efc76-ccc0-4f68-8da3-48bec332b58c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:57.512594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-356efc76-ccc0-4f68-8da3-48bec332b58c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:57.513368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-356efc76-ccc0-4f68-8da3-48bec332b58c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:57.513969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-356efc76-ccc0-4f68-8da3-48bec332b58c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:57.515080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-356efc76-ccc0-4f68-8da3-48bec332b58c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:57.515699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-356efc76-ccc0-4f68-8da3-48bec332b58c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:57.517408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-356efc76-ccc0-4f68-8da3-48bec332b58c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:57.762710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:10:57.911620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-356efc76-ccc0-4f68-8da3-48bec332b58c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:57.921189 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-356efc76-ccc0-4f68-8da3-48bec332b58c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1315 microversion: 2.1 time: 0.447542 Aug 23 18:10:57.922658 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2004/4101] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:57 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:57.928971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f25e4d38-3c3f-4fe4-b8c9-f282ad67d197 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:57.929600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f25e4d38-3c3f-4fe4-b8c9-f282ad67d197 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:57.936809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f25e4d38-3c3f-4fe4-b8c9-f282ad67d197 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:57.937547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f25e4d38-3c3f-4fe4-b8c9-f282ad67d197 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:57.938211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f25e4d38-3c3f-4fe4-b8c9-f282ad67d197 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:57.939629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f25e4d38-3c3f-4fe4-b8c9-f282ad67d197 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:57.940319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f25e4d38-3c3f-4fe4-b8c9-f282ad67d197 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:57.942755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f25e4d38-3c3f-4fe4-b8c9-f282ad67d197 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:58.371710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f25e4d38-3c3f-4fe4-b8c9-f282ad67d197 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:58.402644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f25e4d38-3c3f-4fe4-b8c9-f282ad67d197 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:58.405671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f25e4d38-3c3f-4fe4-b8c9-f282ad67d197 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:58.421208 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f25e4d38-3c3f-4fe4-b8c9-f282ad67d197 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2948 microversion: 2.32 time: 0.496345 Aug 23 18:10:58.426089 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2005/4102] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:10:57 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2948 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:10:58.447446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aab6c9f3-517f-46d5-b89c-f23990f55c1e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:58.448754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aab6c9f3-517f-46d5-b89c-f23990f55c1e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:58.459711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aab6c9f3-517f-46d5-b89c-f23990f55c1e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:58.460901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aab6c9f3-517f-46d5-b89c-f23990f55c1e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:58.460901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aab6c9f3-517f-46d5-b89c-f23990f55c1e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:58.461671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aab6c9f3-517f-46d5-b89c-f23990f55c1e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:58.462234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aab6c9f3-517f-46d5-b89c-f23990f55c1e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:58.462977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aab6c9f3-517f-46d5-b89c-f23990f55c1e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:58.806914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aab6c9f3-517f-46d5-b89c-f23990f55c1e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:58.819629 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aab6c9f3-517f-46d5-b89c-f23990f55c1e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1318 microversion: 2.1 time: 0.382339 Aug 23 18:10:58.831915 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2006/4103] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:58 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1318 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:10:58.842431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-2036029363", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "80ad689d-be3d-4d54-8a6f-58f46a38995f"}, {"uuid": "8f5c920d-7e8d-4c0b-ba85-a175165e29f1"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:10:58.925411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] validate_networks() for [('80ad689d-be3d-4d54-8a6f-58f46a38995f', None, None, None, None, None), ('8f5c920d-7e8d-4c0b-ba85-a175165e29f1', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:10:58.962496 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f74acf16-eb89-43c9-9ee9-0ede38a17015 tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.138169 Aug 23 18:10:58.963845 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2098/4104] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Aug 23 18:10:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:10:58.981459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5c20d198-4f85-45c7-917f-ae29b4e866a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:10:58.982121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5c20d198-4f85-45c7-917f-ae29b4e866a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:10:58.996166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c20d198-4f85-45c7-917f-ae29b4e866a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:58.997754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c20d198-4f85-45c7-917f-ae29b4e866a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:58.998648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c20d198-4f85-45c7-917f-ae29b4e866a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:58.999760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c20d198-4f85-45c7-917f-ae29b4e866a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:10:59.000370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c20d198-4f85-45c7-917f-ae29b4e866a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:10:59.000981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c20d198-4f85-45c7-917f-ae29b4e866a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:10:59.216070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5c20d198-4f85-45c7-917f-ae29b4e866a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:10:59.228476 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5c20d198-4f85-45c7-917f-ae29b4e866a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1315 microversion: 2.1 time: 0.263129 Aug 23 18:10:59.229932 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2099/4105] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:10:58 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:10:59.239541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2f9a697-735e-47d3-a8dd-65fd1f8e8ba5 tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] Action: 'create', calling method: .version_select at 0x7f27ec466ca0>, body: {"pool": null} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:01.183601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:11:01.184317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:11:01.184648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:11:01.185414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:11:01.186030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:11:01.196721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:01.197635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:01.198418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:01.199362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:01.199972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:01.200568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:01.223741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Getting quotas for project 91018678aa474eee8e5f6c5249ec012e. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:11:01.229509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Getting quotas for user 673168b77fc84b9e93cccc69a6cb5948 and project 91018678aa474eee8e5f6c5249ec012e. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:11:01.244025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:11:01.246818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:11:01.303862 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-97b099fd-46e9-4252-b524-4e079e292260 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.470494 Aug 23 18:11:01.308274 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2007/4106] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:10:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:11:01.321293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ee6891f3-a46f-415b-8314-59db944320c0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:01.326968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ee6891f3-a46f-415b-8314-59db944320c0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:01.329542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:01.336749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee6891f3-a46f-415b-8314-59db944320c0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:01.337488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee6891f3-a46f-415b-8314-59db944320c0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:01.338097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee6891f3-a46f-415b-8314-59db944320c0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:01.338994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee6891f3-a46f-415b-8314-59db944320c0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:01.339781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee6891f3-a46f-415b-8314-59db944320c0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:01.340771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee6891f3-a46f-415b-8314-59db944320c0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:01.921850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ee6891f3-a46f-415b-8314-59db944320c0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:01.947165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ee6891f3-a46f-415b-8314-59db944320c0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:01.949915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ee6891f3-a46f-415b-8314-59db944320c0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:01.952586 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ee6891f3-a46f-415b-8314-59db944320c0 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2948 microversion: 2.32 time: 0.640939 Aug 23 18:11:01.954724 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2008/4107] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:01 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2948 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:01.965661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6b8344d9-f42f-46ae-89b3-018dd2af94fc tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:01.965859 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f2f9a697-735e-47d3-a8dd-65fd1f8e8ba5 tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.733878 Aug 23 18:11:01.966463 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2100/4108] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Aug 23 18:10:59 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2736 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:01.971423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-a54f8adc-cb2d-4349-9c47-d2160691532a req-c874123a-55c0-4162-be33-71b5a69d8c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "210941bf-76d0-4c84-a56c-f3b4e6679e8c", "tag": "473d8513-68ee-4307-bd65-283eeb1b9620"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:01.980005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6b8344d9-f42f-46ae-89b3-018dd2af94fc tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:01.988765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b8344d9-f42f-46ae-89b3-018dd2af94fc tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:01.993924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b8344d9-f42f-46ae-89b3-018dd2af94fc tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:01.995656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b8344d9-f42f-46ae-89b3-018dd2af94fc tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:01.997737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b8344d9-f42f-46ae-89b3-018dd2af94fc tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:01.998221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b8344d9-f42f-46ae-89b3-018dd2af94fc tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:01.999103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b8344d9-f42f-46ae-89b3-018dd2af94fc tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:01.999779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:02.002817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a54f8adc-cb2d-4349-9c47-d2160691532a req-c874123a-55c0-4162-be33-71b5a69d8c56 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:02.003749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a54f8adc-cb2d-4349-9c47-d2160691532a req-c874123a-55c0-4162-be33-71b5a69d8c56 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:02.004663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a54f8adc-cb2d-4349-9c47-d2160691532a req-c874123a-55c0-4162-be33-71b5a69d8c56 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:02.036345 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-a54f8adc-cb2d-4349-9c47-d2160691532a req-c874123a-55c0-4162-be33-71b5a69d8c56 service nova] Creating event network-changed:473d8513-68ee-4307-bd65-283eeb1b9620 for instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c on n-h2-850468-16 Aug 23 18:11:02.046211 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-a54f8adc-cb2d-4349-9c47-d2160691532a req-c874123a-55c0-4162-be33-71b5a69d8c56 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078293 Aug 23 18:11:02.047289 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2101/4109] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:02.058492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-514b81e6-89c9-49b0-bf76-29835e36d9fe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:02.075158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-514b81e6-89c9-49b0-bf76-29835e36d9fe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:02.086378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-514b81e6-89c9-49b0-bf76-29835e36d9fe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:02.087251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-514b81e6-89c9-49b0-bf76-29835e36d9fe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:02.091640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-514b81e6-89c9-49b0-bf76-29835e36d9fe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:02.092965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-514b81e6-89c9-49b0-bf76-29835e36d9fe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:02.093580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-514b81e6-89c9-49b0-bf76-29835e36d9fe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:02.094171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-514b81e6-89c9-49b0-bf76-29835e36d9fe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:02.332676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6b8344d9-f42f-46ae-89b3-018dd2af94fc tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:02.342109 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6b8344d9-f42f-46ae-89b3-018dd2af94fc tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1318 microversion: 2.1 time: 0.385978 Aug 23 18:11:02.343283 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2009/4110] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:01 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1318 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:02.346868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-514b81e6-89c9-49b0-bf76-29835e36d9fe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:02.349223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-764f56ad-3cb5-4968-9890-6cb83b1789c7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:02.350076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-764f56ad-3cb5-4968-9890-6cb83b1789c7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:02.355642 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-514b81e6-89c9-49b0-bf76-29835e36d9fe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1315 microversion: 2.1 time: 0.306198 Aug 23 18:11:02.369482 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2102/4111] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:02 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1315 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:02.374155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-764f56ad-3cb5-4968-9890-6cb83b1789c7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:02.374967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-764f56ad-3cb5-4968-9890-6cb83b1789c7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:02.378812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-764f56ad-3cb5-4968-9890-6cb83b1789c7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:02.380306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-764f56ad-3cb5-4968-9890-6cb83b1789c7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:02.384736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-764f56ad-3cb5-4968-9890-6cb83b1789c7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:02.385470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-764f56ad-3cb5-4968-9890-6cb83b1789c7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:02.439647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-378185763", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "3f0f465c-2c1a-40aa-bae9-aea6e930d7da"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:02.472961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-764f56ad-3cb5-4968-9890-6cb83b1789c7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:02.482057 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-764f56ad-3cb5-4968-9890-6cb83b1789c7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1209 microversion: 2.1 time: 0.137268 Aug 23 18:11:02.483538 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2010/4112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:02 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1209 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:02.489127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-915fb66c-2f70-4fed-accd-38a92d48026b tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] Action: 'create', calling method: .version_select at 0x7f27dfaf64c0>, body: {"pool": null} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:02.688867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] validate_networks() for [('3f0f465c-2c1a-40aa-bae9-aea6e930d7da', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:11:03.002385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:03.267848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:11:03.268274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:11:03.268842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:11:03.269254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:11:03.269665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:11:03.274008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:03.286138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:03.287031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:03.287675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:03.290331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:03.290331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:03.290331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:03.313895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Getting quotas for project c0c32c51a6114dcf984888c230664e26. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:11:03.320305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Getting quotas for user ed44000309354b61950aaabd6521bab1 and project c0c32c51a6114dcf984888c230664e26. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:11:03.338813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:11:03.341775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:11:03.427000 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a0df673e-5478-4c68-a74f-b633969142bd tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.069333 Aug 23 18:11:03.428013 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2103/4113] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:11:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:11:03.433168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-550af343-c7e7-42dc-b2f2-4dff37a3adbf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:03.434054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-550af343-c7e7-42dc-b2f2-4dff37a3adbf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:03.440922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-550af343-c7e7-42dc-b2f2-4dff37a3adbf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:03.452948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-550af343-c7e7-42dc-b2f2-4dff37a3adbf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:03.453770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-550af343-c7e7-42dc-b2f2-4dff37a3adbf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:03.455309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-550af343-c7e7-42dc-b2f2-4dff37a3adbf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:03.456212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-550af343-c7e7-42dc-b2f2-4dff37a3adbf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:03.457363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-550af343-c7e7-42dc-b2f2-4dff37a3adbf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:03.900460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-550af343-c7e7-42dc-b2f2-4dff37a3adbf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:03.914808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-550af343-c7e7-42dc-b2f2-4dff37a3adbf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:03.916738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-550af343-c7e7-42dc-b2f2-4dff37a3adbf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:03.918280 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-550af343-c7e7-42dc-b2f2-4dff37a3adbf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2927 microversion: 2.32 time: 0.489131 Aug 23 18:11:03.933425 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2104/4114] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:03 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2927 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:03.945512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-293e8e7d-c942-4a03-8874-52c1a7dfe846 req-c627abd2-ea56-4d88-a591-50097329242b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6c1be2-7bf0-4c16-a14d-46116f1a6509", "name": "network-vif-plugged", "status": "completed", "tag": "b80341b3-8af4-48b9-8bf9-0ee25e7a336e"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:03.960562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-293e8e7d-c942-4a03-8874-52c1a7dfe846 req-c627abd2-ea56-4d88-a591-50097329242b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:03.962138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-293e8e7d-c942-4a03-8874-52c1a7dfe846 req-c627abd2-ea56-4d88-a591-50097329242b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:03.962876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-293e8e7d-c942-4a03-8874-52c1a7dfe846 req-c627abd2-ea56-4d88-a591-50097329242b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:03.976622 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-293e8e7d-c942-4a03-8874-52c1a7dfe846 req-c627abd2-ea56-4d88-a591-50097329242b service nova] Creating event network-vif-plugged:b80341b3-8af4-48b9-8bf9-0ee25e7a336e for instance ed6c1be2-7bf0-4c16-a14d-46116f1a6509 on n-h1-850468-16 Aug 23 18:11:03.985943 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-293e8e7d-c942-4a03-8874-52c1a7dfe846 req-c627abd2-ea56-4d88-a591-50097329242b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043599 Aug 23 18:11:03.987442 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2105/4115] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:03.995128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e7373c20-15fd-4e37-a650-8976633c1ee9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:03.996014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e7373c20-15fd-4e37-a650-8976633c1ee9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:04.005368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7373c20-15fd-4e37-a650-8976633c1ee9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:04.007089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7373c20-15fd-4e37-a650-8976633c1ee9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:04.007734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7373c20-15fd-4e37-a650-8976633c1ee9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:04.008585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7373c20-15fd-4e37-a650-8976633c1ee9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:04.009439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7373c20-15fd-4e37-a650-8976633c1ee9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:04.010108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7373c20-15fd-4e37-a650-8976633c1ee9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:04.260736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e7373c20-15fd-4e37-a650-8976633c1ee9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:04.277052 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e7373c20-15fd-4e37-a650-8976633c1ee9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1318 microversion: 2.1 time: 0.284271 Aug 23 18:11:04.282375 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2106/4116] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:03 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1318 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:04.311101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-de45357c-a160-43cf-844c-db06d1112231 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:04.313783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-de45357c-a160-43cf-844c-db06d1112231 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:04.328602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de45357c-a160-43cf-844c-db06d1112231 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:04.329962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de45357c-a160-43cf-844c-db06d1112231 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:04.330674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de45357c-a160-43cf-844c-db06d1112231 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:04.331557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de45357c-a160-43cf-844c-db06d1112231 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:04.332214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de45357c-a160-43cf-844c-db06d1112231 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:04.332864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de45357c-a160-43cf-844c-db06d1112231 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:04.633078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-de45357c-a160-43cf-844c-db06d1112231 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:04.645890 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-de45357c-a160-43cf-844c-db06d1112231 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1315 microversion: 2.1 time: 0.343476 Aug 23 18:11:04.648787 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2107/4117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:04 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1315 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:04.654489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a1296c27-1ccf-4a1e-9edb-4e130732c803 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:04.655674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a1296c27-1ccf-4a1e-9edb-4e130732c803 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:04.663014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1296c27-1ccf-4a1e-9edb-4e130732c803 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:04.663741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1296c27-1ccf-4a1e-9edb-4e130732c803 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:04.664386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1296c27-1ccf-4a1e-9edb-4e130732c803 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:04.677489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1296c27-1ccf-4a1e-9edb-4e130732c803 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:04.678004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1296c27-1ccf-4a1e-9edb-4e130732c803 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:04.680166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1296c27-1ccf-4a1e-9edb-4e130732c803 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:04.759199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a1296c27-1ccf-4a1e-9edb-4e130732c803 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:04.769309 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a1296c27-1ccf-4a1e-9edb-4e130732c803 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1276 microversion: 2.1 time: 0.119198 Aug 23 18:11:04.787254 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2108/4118] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:04 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1276 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:04.793187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6f57fbc8-7340-4dc7-bd39-ecdf9b83b97d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:04.794024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6f57fbc8-7340-4dc7-bd39-ecdf9b83b97d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:04.801592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f57fbc8-7340-4dc7-bd39-ecdf9b83b97d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:04.802271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f57fbc8-7340-4dc7-bd39-ecdf9b83b97d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:04.802774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f57fbc8-7340-4dc7-bd39-ecdf9b83b97d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:04.803649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f57fbc8-7340-4dc7-bd39-ecdf9b83b97d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:04.804871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f57fbc8-7340-4dc7-bd39-ecdf9b83b97d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:04.805418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f57fbc8-7340-4dc7-bd39-ecdf9b83b97d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:04.897462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6f57fbc8-7340-4dc7-bd39-ecdf9b83b97d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:04.908729 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6f57fbc8-7340-4dc7-bd39-ecdf9b83b97d tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1271 microversion: 2.1 time: 0.119706 Aug 23 18:11:04.909296 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2109/4119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:04 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:04.947045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-29d1aaf9-2d56-4c78-bfc3-24b04a001370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:04.947672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-29d1aaf9-2d56-4c78-bfc3-24b04a001370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:04.955118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-29d1aaf9-2d56-4c78-bfc3-24b04a001370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:04.956073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-29d1aaf9-2d56-4c78-bfc3-24b04a001370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:04.956693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-29d1aaf9-2d56-4c78-bfc3-24b04a001370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:04.957614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-29d1aaf9-2d56-4c78-bfc3-24b04a001370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:04.958223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-29d1aaf9-2d56-4c78-bfc3-24b04a001370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:04.958853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-29d1aaf9-2d56-4c78-bfc3-24b04a001370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:05.246673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-29d1aaf9-2d56-4c78-bfc3-24b04a001370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:05.264694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-29d1aaf9-2d56-4c78-bfc3-24b04a001370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:05.267167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-29d1aaf9-2d56-4c78-bfc3-24b04a001370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:05.279605 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-29d1aaf9-2d56-4c78-bfc3-24b04a001370 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2927 microversion: 2.32 time: 0.336338 Aug 23 18:11:05.280425 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2110/4120] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:04 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2927 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:11:05.309705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4a251162-57ef-4fcd-b101-69705bd26469 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:05.310331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4a251162-57ef-4fcd-b101-69705bd26469 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:05.329053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a251162-57ef-4fcd-b101-69705bd26469 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:05.331068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a251162-57ef-4fcd-b101-69705bd26469 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:05.332766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a251162-57ef-4fcd-b101-69705bd26469 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:05.333746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a251162-57ef-4fcd-b101-69705bd26469 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:05.334711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a251162-57ef-4fcd-b101-69705bd26469 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:05.336238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a251162-57ef-4fcd-b101-69705bd26469 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:05.552212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4a251162-57ef-4fcd-b101-69705bd26469 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:05.560934 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4a251162-57ef-4fcd-b101-69705bd26469 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1318 microversion: 2.1 time: 0.255839 Aug 23 18:11:05.562241 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2111/4121] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:05 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:11:05.670847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-386e7e82-9991-4a5c-8c21-3623a4bed4fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:05.671484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-386e7e82-9991-4a5c-8c21-3623a4bed4fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:05.684434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-386e7e82-9991-4a5c-8c21-3623a4bed4fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:05.685388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-386e7e82-9991-4a5c-8c21-3623a4bed4fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:05.687247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-386e7e82-9991-4a5c-8c21-3623a4bed4fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:05.689919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-386e7e82-9991-4a5c-8c21-3623a4bed4fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:05.693859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-386e7e82-9991-4a5c-8c21-3623a4bed4fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:05.694406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-386e7e82-9991-4a5c-8c21-3623a4bed4fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:05.697227 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-915fb66c-2f70-4fed-accd-38a92d48026b tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 3.212241 Aug 23 18:11:05.699571 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2011/4122] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Aug 23 18:11:02 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 3215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:05.712419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-05244111-489e-43ab-8338-9f793c76fe8b tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] Calling method '.version_select at 0x7f27ec9ec670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:05.738499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:06.229365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-386e7e82-9991-4a5c-8c21-3623a4bed4fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:06.245605 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-386e7e82-9991-4a5c-8c21-3623a4bed4fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1315 microversion: 2.1 time: 0.578610 Aug 23 18:11:06.251190 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2112/4123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:05 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:06.264472 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-05244111-489e-43ab-8338-9f793c76fe8b tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/82f37c28-8b51-4f96-851d-05b73bc28c68" status: 200 len: 142 microversion: 2.1 time: 0.556036 Aug 23 18:11:06.265604 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2012/4124] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Aug 23 18:11:05 2022] GET /compute/v2.1/os-floating-ips/82f37c28-8b51-4f96-851d-05b73bc28c68 => generated 142 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:06.269785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-88979682-bb85-4fbe-8493-07b8c3153bf2 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:06.270530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-88979682-bb85-4fbe-8493-07b8c3153bf2 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:06.279210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f727f771-711d-4891-b27a-36ebec61407f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:06.279844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f727f771-711d-4891-b27a-36ebec61407f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:06.291121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f727f771-711d-4891-b27a-36ebec61407f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:06.295155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88979682-bb85-4fbe-8493-07b8c3153bf2 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:06.297097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88979682-bb85-4fbe-8493-07b8c3153bf2 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:06.298522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88979682-bb85-4fbe-8493-07b8c3153bf2 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:06.299511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88979682-bb85-4fbe-8493-07b8c3153bf2 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:06.300137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88979682-bb85-4fbe-8493-07b8c3153bf2 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:06.300729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88979682-bb85-4fbe-8493-07b8c3153bf2 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:06.304644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f727f771-711d-4891-b27a-36ebec61407f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:06.305159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f727f771-711d-4891-b27a-36ebec61407f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:06.305946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f727f771-711d-4891-b27a-36ebec61407f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:06.306438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f727f771-711d-4891-b27a-36ebec61407f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:06.306909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f727f771-711d-4891-b27a-36ebec61407f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:06.602816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-88979682-bb85-4fbe-8493-07b8c3153bf2 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:06.615981 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-88979682-bb85-4fbe-8493-07b8c3153bf2 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1324 microversion: 2.1 time: 0.363177 Aug 23 18:11:06.616855 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2113/4125] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:06 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1324 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:06.621614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-398f4de3-ec2f-48da-a27a-156be8c3c6e9 req-aab2f790-ff98-4135-b72f-62159016f99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-unplugged", "status": "completed", "tag": "a1a07c6e-8c7d-4734-a891-22a469b9c832"}, {"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-unplugged", "status": "completed", "tag": "3a378893-dcd4-44a5-a7c5-f85909c867a9"}, {"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-unplugged", "status": "completed", "tag": "1eee6fec-aebe-4ef5-b406-7ef3e9925c14"}, {"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-unplugged", "status": "completed", "tag": "5997e602-944a-4dfe-a4ef-1adf63e98362"}, {"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-unplugged", "status": "completed", "tag": "6a403b9a-dd76-4743-b4c7-d8a95b097009"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:06.661884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-398f4de3-ec2f-48da-a27a-156be8c3c6e9 req-aab2f790-ff98-4135-b72f-62159016f99a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:06.662518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-398f4de3-ec2f-48da-a27a-156be8c3c6e9 req-aab2f790-ff98-4135-b72f-62159016f99a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:06.663084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-398f4de3-ec2f-48da-a27a-156be8c3c6e9 req-aab2f790-ff98-4135-b72f-62159016f99a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:06.682801 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-398f4de3-ec2f-48da-a27a-156be8c3c6e9 req-aab2f790-ff98-4135-b72f-62159016f99a service nova] Creating event network-vif-unplugged:a1a07c6e-8c7d-4734-a891-22a469b9c832 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:11:06.683567 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-398f4de3-ec2f-48da-a27a-156be8c3c6e9 req-aab2f790-ff98-4135-b72f-62159016f99a service nova] Creating event network-vif-unplugged:3a378893-dcd4-44a5-a7c5-f85909c867a9 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:11:06.684147 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-398f4de3-ec2f-48da-a27a-156be8c3c6e9 req-aab2f790-ff98-4135-b72f-62159016f99a service nova] Creating event network-vif-unplugged:1eee6fec-aebe-4ef5-b406-7ef3e9925c14 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:11:06.685670 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-398f4de3-ec2f-48da-a27a-156be8c3c6e9 req-aab2f790-ff98-4135-b72f-62159016f99a service nova] Creating event network-vif-unplugged:5997e602-944a-4dfe-a4ef-1adf63e98362 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:11:06.687222 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-398f4de3-ec2f-48da-a27a-156be8c3c6e9 req-aab2f790-ff98-4135-b72f-62159016f99a service nova] Creating event network-vif-unplugged:6a403b9a-dd76-4743-b4c7-d8a95b097009 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:11:06.695921 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-398f4de3-ec2f-48da-a27a-156be8c3c6e9 req-aab2f790-ff98-4135-b72f-62159016f99a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.077584 Aug 23 18:11:06.697290 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2114/4126] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:06.704710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b3d26ff9-8d1f-4d6b-9146-07a7c2dcd686 tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] Calling method '.version_select at 0x7f27dfa825e0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:06.746813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f727f771-711d-4891-b27a-36ebec61407f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:06.770570 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f727f771-711d-4891-b27a-36ebec61407f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1313 microversion: 2.1 time: 0.503623 Aug 23 18:11:06.778804 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2013/4127] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:06 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1313 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:06.784496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d24c10ef-85cc-4a0f-afea-81f514ec61ae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:06.785289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d24c10ef-85cc-4a0f-afea-81f514ec61ae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:06.799277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d24c10ef-85cc-4a0f-afea-81f514ec61ae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:06.800111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d24c10ef-85cc-4a0f-afea-81f514ec61ae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:06.800703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d24c10ef-85cc-4a0f-afea-81f514ec61ae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:06.801614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d24c10ef-85cc-4a0f-afea-81f514ec61ae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:06.802280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d24c10ef-85cc-4a0f-afea-81f514ec61ae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:06.802889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d24c10ef-85cc-4a0f-afea-81f514ec61ae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:06.823572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:07.400711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d24c10ef-85cc-4a0f-afea-81f514ec61ae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:07.422179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d24c10ef-85cc-4a0f-afea-81f514ec61ae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:07.433089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d24c10ef-85cc-4a0f-afea-81f514ec61ae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:07.438824 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d24c10ef-85cc-4a0f-afea-81f514ec61ae tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2860 microversion: 2.32 time: 0.658573 Aug 23 18:11:07.455397 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2014/4128] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:06 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2860 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:07.467426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a17bd096-fa65-417a-9553-81ec4c99e607 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:07.468548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a17bd096-fa65-417a-9553-81ec4c99e607 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:07.477811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a17bd096-fa65-417a-9553-81ec4c99e607 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:07.478706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a17bd096-fa65-417a-9553-81ec4c99e607 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:07.479410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a17bd096-fa65-417a-9553-81ec4c99e607 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:07.480685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a17bd096-fa65-417a-9553-81ec4c99e607 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:07.481384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a17bd096-fa65-417a-9553-81ec4c99e607 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:07.482049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a17bd096-fa65-417a-9553-81ec4c99e607 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:07.917213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a17bd096-fa65-417a-9553-81ec4c99e607 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:07.935501 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a17bd096-fa65-417a-9553-81ec4c99e607 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1507 microversion: 2.1 time: 0.478106 Aug 23 18:11:07.937384 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2015/4129] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:07 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1507 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:07.946218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-cb489ecf-d40a-4dbd-9fb3-5e2041186f25 req-8467c9f0-e284-4039-9eb3-4f22d24f29ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-deleted", "tag": "6a403b9a-dd76-4743-b4c7-d8a95b097009"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:07.991903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cb489ecf-d40a-4dbd-9fb3-5e2041186f25 req-8467c9f0-e284-4039-9eb3-4f22d24f29ff service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:07.992385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cb489ecf-d40a-4dbd-9fb3-5e2041186f25 req-8467c9f0-e284-4039-9eb3-4f22d24f29ff service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:07.995223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cb489ecf-d40a-4dbd-9fb3-5e2041186f25 req-8467c9f0-e284-4039-9eb3-4f22d24f29ff service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:08.063912 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-cb489ecf-d40a-4dbd-9fb3-5e2041186f25 req-8467c9f0-e284-4039-9eb3-4f22d24f29ff service nova] Creating event network-vif-deleted:6a403b9a-dd76-4743-b4c7-d8a95b097009 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:11:08.114897 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-cb489ecf-d40a-4dbd-9fb3-5e2041186f25 req-8467c9f0-e284-4039-9eb3-4f22d24f29ff service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.176419 Aug 23 18:11:08.118486 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2016/4130] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:08.131676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bdd46482-fe23-47d2-b875-8209987db130 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:08.132590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bdd46482-fe23-47d2-b875-8209987db130 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:08.141890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bdd46482-fe23-47d2-b875-8209987db130 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:08.142354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bdd46482-fe23-47d2-b875-8209987db130 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:08.143132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bdd46482-fe23-47d2-b875-8209987db130 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:08.144159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bdd46482-fe23-47d2-b875-8209987db130 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:08.144823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bdd46482-fe23-47d2-b875-8209987db130 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:08.145453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bdd46482-fe23-47d2-b875-8209987db130 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:08.690669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bdd46482-fe23-47d2-b875-8209987db130 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:08.703300 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bdd46482-fe23-47d2-b875-8209987db130 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1315 microversion: 2.1 time: 0.582810 Aug 23 18:11:08.705724 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2017/4131] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:08 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1315 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:08.721009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-320313a8-6e4c-489c-88fd-820d1169ef76 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:08.721990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-320313a8-6e4c-489c-88fd-820d1169ef76 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:08.741871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-320313a8-6e4c-489c-88fd-820d1169ef76 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:08.742365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-320313a8-6e4c-489c-88fd-820d1169ef76 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:08.744313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-320313a8-6e4c-489c-88fd-820d1169ef76 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:08.745067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-320313a8-6e4c-489c-88fd-820d1169ef76 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:08.745533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-320313a8-6e4c-489c-88fd-820d1169ef76 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:08.745966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-320313a8-6e4c-489c-88fd-820d1169ef76 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:08.825402 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b3d26ff9-8d1f-4d6b-9146-07a7c2dcd686 tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/82f37c28-8b51-4f96-851d-05b73bc28c68" status: 202 len: 0 microversion: 2.1 time: 2.124513 Aug 23 18:11:08.827195 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2115/4132] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 18:11:06 2022] DELETE /compute/v2.1/os-floating-ips/82f37c28-8b51-4f96-851d-05b73bc28c68 => generated 0 bytes in 2129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:11:08.837612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8195bbe5-661a-40e6-92f6-d98a453adb94 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:08.838515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8195bbe5-661a-40e6-92f6-d98a453adb94 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:08.859542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8195bbe5-661a-40e6-92f6-d98a453adb94 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:08.878502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8195bbe5-661a-40e6-92f6-d98a453adb94 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:08.879088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8195bbe5-661a-40e6-92f6-d98a453adb94 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:08.880980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8195bbe5-661a-40e6-92f6-d98a453adb94 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:08.882462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8195bbe5-661a-40e6-92f6-d98a453adb94 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:08.883605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8195bbe5-661a-40e6-92f6-d98a453adb94 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:09.235814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-320313a8-6e4c-489c-88fd-820d1169ef76 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:09.250089 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-320313a8-6e4c-489c-88fd-820d1169ef76 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1324 microversion: 2.1 time: 0.543037 Aug 23 18:11:09.263883 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2018/4133] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:08 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1324 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:09.263883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-5e87918e-62d6-462a-a7a2-9c8cabc6ac6f req-da2532cc-7294-4b82-813b-0a69092cf5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd", "tag": "c5695077-ef76-4af1-af94-420232e98b43"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:09.281445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5e87918e-62d6-462a-a7a2-9c8cabc6ac6f req-da2532cc-7294-4b82-813b-0a69092cf5b8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:09.282387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5e87918e-62d6-462a-a7a2-9c8cabc6ac6f req-da2532cc-7294-4b82-813b-0a69092cf5b8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:09.287116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5e87918e-62d6-462a-a7a2-9c8cabc6ac6f req-da2532cc-7294-4b82-813b-0a69092cf5b8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:09.294004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8195bbe5-661a-40e6-92f6-d98a453adb94 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:09.313939 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8195bbe5-661a-40e6-92f6-d98a453adb94 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1334 microversion: 2.1 time: 0.483216 Aug 23 18:11:09.315231 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2116/4134] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:08 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1334 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:09.320877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b1d1495b-df98-4ebe-b5c9-ffbef5ffb5a2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:09.321774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b1d1495b-df98-4ebe-b5c9-ffbef5ffb5a2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:09.331566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1d1495b-df98-4ebe-b5c9-ffbef5ffb5a2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:09.332456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1d1495b-df98-4ebe-b5c9-ffbef5ffb5a2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:09.333201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1d1495b-df98-4ebe-b5c9-ffbef5ffb5a2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:09.334180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1d1495b-df98-4ebe-b5c9-ffbef5ffb5a2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:09.335155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1d1495b-df98-4ebe-b5c9-ffbef5ffb5a2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:09.335372 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5e87918e-62d6-462a-a7a2-9c8cabc6ac6f req-da2532cc-7294-4b82-813b-0a69092cf5b8 service nova] Creating event network-changed:c5695077-ef76-4af1-af94-420232e98b43 for instance fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd on n-h2-850468-16 Aug 23 18:11:09.336196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1d1495b-df98-4ebe-b5c9-ffbef5ffb5a2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:09.341213 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-5e87918e-62d6-462a-a7a2-9c8cabc6ac6f req-da2532cc-7294-4b82-813b-0a69092cf5b8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087770 Aug 23 18:11:09.342443 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2019/4135] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:09.349826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-c8b47c31-4f82-4db1-a8b3-0cabae99b05b req-d7f076e3-f9f2-40ac-bafb-d3942dd8442d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-unplugged", "status": "completed", "tag": "766e8ecd-c0de-42b0-afc9-f573d08d79cc"}, {"server_uuid": "210941bf-76d0-4c84-a56c-f3b4e6679e8c", "name": "network-vif-plugged", "status": "completed", "tag": "473d8513-68ee-4307-bd65-283eeb1b9620"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:09.362391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c8b47c31-4f82-4db1-a8b3-0cabae99b05b req-d7f076e3-f9f2-40ac-bafb-d3942dd8442d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:09.363266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c8b47c31-4f82-4db1-a8b3-0cabae99b05b req-d7f076e3-f9f2-40ac-bafb-d3942dd8442d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:09.363908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c8b47c31-4f82-4db1-a8b3-0cabae99b05b req-d7f076e3-f9f2-40ac-bafb-d3942dd8442d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:09.379861 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-c8b47c31-4f82-4db1-a8b3-0cabae99b05b req-d7f076e3-f9f2-40ac-bafb-d3942dd8442d service nova] Creating event network-vif-unplugged:766e8ecd-c0de-42b0-afc9-f573d08d79cc for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:11:09.380772 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-c8b47c31-4f82-4db1-a8b3-0cabae99b05b req-d7f076e3-f9f2-40ac-bafb-d3942dd8442d service nova] Creating event network-vif-plugged:473d8513-68ee-4307-bd65-283eeb1b9620 for instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c on n-h2-850468-16 Aug 23 18:11:09.392818 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-c8b47c31-4f82-4db1-a8b3-0cabae99b05b req-d7f076e3-f9f2-40ac-bafb-d3942dd8442d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.047019 Aug 23 18:11:09.394446 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2020/4136] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:09.401909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4cdde560-c78d-4fb4-8baa-7831c92ffcef tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] Calling method '.version_select at 0x7f27dfd7bc10>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:09.530094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b1d1495b-df98-4ebe-b5c9-ffbef5ffb5a2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:09.541942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b1d1495b-df98-4ebe-b5c9-ffbef5ffb5a2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:09.543798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b1d1495b-df98-4ebe-b5c9-ffbef5ffb5a2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:09.545063 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b1d1495b-df98-4ebe-b5c9-ffbef5ffb5a2 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2700 microversion: 2.32 time: 0.228486 Aug 23 18:11:09.558759 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2117/4137] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:09 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2700 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:09.725952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-01d91ae3-72f9-4cc8-8af2-bbde27af172d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:09.726874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-01d91ae3-72f9-4cc8-8af2-bbde27af172d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:09.734432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01d91ae3-72f9-4cc8-8af2-bbde27af172d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:09.736601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01d91ae3-72f9-4cc8-8af2-bbde27af172d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:09.737045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01d91ae3-72f9-4cc8-8af2-bbde27af172d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:09.737818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01d91ae3-72f9-4cc8-8af2-bbde27af172d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:09.738276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01d91ae3-72f9-4cc8-8af2-bbde27af172d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:09.738736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01d91ae3-72f9-4cc8-8af2-bbde27af172d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:09.898601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-01d91ae3-72f9-4cc8-8af2-bbde27af172d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:09.915334 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-01d91ae3-72f9-4cc8-8af2-bbde27af172d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1315 microversion: 2.1 time: 0.192530 Aug 23 18:11:09.923332 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2118/4138] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:09 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1315 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:11:09.949761 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4cdde560-c78d-4fb4-8baa-7831c92ffcef tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.553746 Aug 23 18:11:09.950784 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2021/4139] 10.222.0.61 () {58 vars in 1164 bytes} [Tue Aug 23 18:11:09 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:11:09.962480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-24a3c036-7e1f-49ce-9a99-e6cc58d166ee tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] Calling method '.version_select at 0x7f27ec87b430>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:10.205440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-bb43cef1-adb2-4783-85bf-eecd3538d21a req-c5e2a086-1b94-4445-9317-eca24b03c03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-deleted", "tag": "766e8ecd-c0de-42b0-afc9-f573d08d79cc"}, {"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-deleted", "tag": "5997e602-944a-4dfe-a4ef-1adf63e98362"}, {"name": "network-changed", "server_uuid": "dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75", "tag": "6bbe04dd-e186-40e2-9354-48726f413eb2"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:10.218429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bb43cef1-adb2-4783-85bf-eecd3538d21a req-c5e2a086-1b94-4445-9317-eca24b03c03c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:10.219202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bb43cef1-adb2-4783-85bf-eecd3538d21a req-c5e2a086-1b94-4445-9317-eca24b03c03c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:10.219836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bb43cef1-adb2-4783-85bf-eecd3538d21a req-c5e2a086-1b94-4445-9317-eca24b03c03c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:10.222130 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-24a3c036-7e1f-49ce-9a99-e6cc58d166ee tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips" status: 200 len: 399 microversion: 2.1 time: 0.264025 Aug 23 18:11:10.222871 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2119/4140] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Aug 23 18:11:09 2022] GET /compute/v2.1/os-floating-ips => generated 399 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:10.238238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-34182fe9-121d-4c12-beb5-33bbe002b08b tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] Calling method '.version_select at 0x7f27ec80de50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:10.244851 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-bb43cef1-adb2-4783-85bf-eecd3538d21a req-c5e2a086-1b94-4445-9317-eca24b03c03c service nova] Creating event network-vif-deleted:766e8ecd-c0de-42b0-afc9-f573d08d79cc for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:11:10.245371 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-bb43cef1-adb2-4783-85bf-eecd3538d21a req-c5e2a086-1b94-4445-9317-eca24b03c03c service nova] Creating event network-vif-deleted:5997e602-944a-4dfe-a4ef-1adf63e98362 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:11:10.246169 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-bb43cef1-adb2-4783-85bf-eecd3538d21a req-c5e2a086-1b94-4445-9317-eca24b03c03c service nova] Creating event network-changed:6bbe04dd-e186-40e2-9354-48726f413eb2 for instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 on n-h1-850468-16 Aug 23 18:11:10.257146 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-bb43cef1-adb2-4783-85bf-eecd3538d21a req-c5e2a086-1b94-4445-9317-eca24b03c03c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 521 microversion: 2.1 time: 0.058117 Aug 23 18:11:10.258473 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2022/4141] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 521 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:10.280351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dd8b98d2-98bc-4be8-b381-93b43712b918 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:10.281859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dd8b98d2-98bc-4be8-b381-93b43712b918 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:10.300567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd8b98d2-98bc-4be8-b381-93b43712b918 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:10.302015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd8b98d2-98bc-4be8-b381-93b43712b918 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:10.302734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd8b98d2-98bc-4be8-b381-93b43712b918 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:10.303687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd8b98d2-98bc-4be8-b381-93b43712b918 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:10.304350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd8b98d2-98bc-4be8-b381-93b43712b918 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:10.304955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd8b98d2-98bc-4be8-b381-93b43712b918 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:10.678112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dd8b98d2-98bc-4be8-b381-93b43712b918 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:10.688893 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dd8b98d2-98bc-4be8-b381-93b43712b918 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1324 microversion: 2.1 time: 0.415461 Aug 23 18:11:10.690089 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2023/4142] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:10 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1324 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:10.696302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d4294cd0-2442-4dff-9433-96416999c814 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:10.696925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d4294cd0-2442-4dff-9433-96416999c814 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:10.703215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4294cd0-2442-4dff-9433-96416999c814 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:10.703907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4294cd0-2442-4dff-9433-96416999c814 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:10.704505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4294cd0-2442-4dff-9433-96416999c814 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:10.705363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4294cd0-2442-4dff-9433-96416999c814 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:10.706006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4294cd0-2442-4dff-9433-96416999c814 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:10.706866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4294cd0-2442-4dff-9433-96416999c814 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:11.035150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d4294cd0-2442-4dff-9433-96416999c814 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:11.045226 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d4294cd0-2442-4dff-9433-96416999c814 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1334 microversion: 2.1 time: 0.353318 Aug 23 18:11:11.045900 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2024/4143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:10 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1334 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:11.051512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81806b55-fdf2-46ee-b014-98f0983b79ed tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:11.052375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-81806b55-fdf2-46ee-b014-98f0983b79ed tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:11.058862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81806b55-fdf2-46ee-b014-98f0983b79ed tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:11.059574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81806b55-fdf2-46ee-b014-98f0983b79ed tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:11.060252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81806b55-fdf2-46ee-b014-98f0983b79ed tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:11.061193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81806b55-fdf2-46ee-b014-98f0983b79ed tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:11.061877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81806b55-fdf2-46ee-b014-98f0983b79ed tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:11.062396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81806b55-fdf2-46ee-b014-98f0983b79ed tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:11.111321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-34182fe9-121d-4c12-beb5-33bbe002b08b tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/bda5129f-53d4-4f8b-95d1-8c44c9001a9e" status: 202 len: 0 microversion: 2.1 time: 0.878330 Aug 23 18:11:11.112218 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2120/4144] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 18:11:10 2022] DELETE /compute/v2.1/os-floating-ips/bda5129f-53d4-4f8b-95d1-8c44c9001a9e => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:11:11.118125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ec5acb8-f396-4818-95f5-9e1ad82294a4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:11.118873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8ec5acb8-f396-4818-95f5-9e1ad82294a4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:11.131106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ec5acb8-f396-4818-95f5-9e1ad82294a4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:11.131613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ec5acb8-f396-4818-95f5-9e1ad82294a4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:11.132060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ec5acb8-f396-4818-95f5-9e1ad82294a4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:11.133227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ec5acb8-f396-4818-95f5-9e1ad82294a4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:11.133692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ec5acb8-f396-4818-95f5-9e1ad82294a4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:11.134164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ec5acb8-f396-4818-95f5-9e1ad82294a4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:11.214311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:11.240242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:11.306772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8ec5acb8-f396-4818-95f5-9e1ad82294a4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:11.318311 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8ec5acb8-f396-4818-95f5-9e1ad82294a4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1315 microversion: 2.1 time: 0.205007 Aug 23 18:11:11.332325 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2121/4145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:11 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:11.332325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-be86174c-6bdb-4f84-9900-143c1100ec65 tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] Calling method '.version_select at 0x7f27df835700>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:11.333592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81806b55-fdf2-46ee-b014-98f0983b79ed tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:11.343542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81806b55-fdf2-46ee-b014-98f0983b79ed tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:11.346066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81806b55-fdf2-46ee-b014-98f0983b79ed tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:11.347322 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81806b55-fdf2-46ee-b014-98f0983b79ed tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2654 microversion: 2.32 time: 0.300198 Aug 23 18:11:11.347948 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2025/4146] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:11 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2654 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:11.709459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c63cf48-f7c9-4a8e-81b1-e2cee7259f2a tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:11.710080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c63cf48-f7c9-4a8e-81b1-e2cee7259f2a tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:11.717813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c63cf48-f7c9-4a8e-81b1-e2cee7259f2a tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:11.718310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c63cf48-f7c9-4a8e-81b1-e2cee7259f2a tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:11.718850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c63cf48-f7c9-4a8e-81b1-e2cee7259f2a tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:11.720279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c63cf48-f7c9-4a8e-81b1-e2cee7259f2a tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:11.720737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c63cf48-f7c9-4a8e-81b1-e2cee7259f2a tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:11.721168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c63cf48-f7c9-4a8e-81b1-e2cee7259f2a tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:12.034602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c63cf48-f7c9-4a8e-81b1-e2cee7259f2a tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:12.052408 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c63cf48-f7c9-4a8e-81b1-e2cee7259f2a tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1324 microversion: 2.1 time: 0.346685 Aug 23 18:11:12.055718 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2026/4147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:11 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1324 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:11:12.068240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4cf9c9ec-fc72-4f19-9282-7813317fb7ec tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:12.077980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4cf9c9ec-fc72-4f19-9282-7813317fb7ec tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:12.085126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cf9c9ec-fc72-4f19-9282-7813317fb7ec tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:12.085680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cf9c9ec-fc72-4f19-9282-7813317fb7ec tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:12.087819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cf9c9ec-fc72-4f19-9282-7813317fb7ec tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:12.089598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cf9c9ec-fc72-4f19-9282-7813317fb7ec tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:12.093275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cf9c9ec-fc72-4f19-9282-7813317fb7ec tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:12.093916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cf9c9ec-fc72-4f19-9282-7813317fb7ec tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:12.496648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4cf9c9ec-fc72-4f19-9282-7813317fb7ec tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:12.508932 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4cf9c9ec-fc72-4f19-9282-7813317fb7ec tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1334 microversion: 2.1 time: 0.447281 Aug 23 18:11:12.523019 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2027/4148] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:12 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1334 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:12.530920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-16428e6d-1860-4915-9db4-6a905d539447 req-ca1456d8-76f6-4d75-908d-bfcefe24ab87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75", "tag": "e096e09e-b1c2-4dc0-a75f-934bb26df03f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:12.546889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-16428e6d-1860-4915-9db4-6a905d539447 req-ca1456d8-76f6-4d75-908d-bfcefe24ab87 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:12.548845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-16428e6d-1860-4915-9db4-6a905d539447 req-ca1456d8-76f6-4d75-908d-bfcefe24ab87 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:12.549504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-16428e6d-1860-4915-9db4-6a905d539447 req-ca1456d8-76f6-4d75-908d-bfcefe24ab87 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:12.565757 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-16428e6d-1860-4915-9db4-6a905d539447 req-ca1456d8-76f6-4d75-908d-bfcefe24ab87 service nova] Creating event network-changed:e096e09e-b1c2-4dc0-a75f-934bb26df03f for instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 on n-h1-850468-16 Aug 23 18:11:12.572538 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-16428e6d-1860-4915-9db4-6a905d539447 req-ca1456d8-76f6-4d75-908d-bfcefe24ab87 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053734 Aug 23 18:11:12.573312 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2028/4149] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:12.584534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4279c422-933d-44e1-96c2-35bffac96d20 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:12.585529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4279c422-933d-44e1-96c2-35bffac96d20 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:12.590142 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-be86174c-6bdb-4f84-9900-143c1100ec65 tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/1ec9929a-fe75-47f9-8730-5d6a04b21174" status: 202 len: 0 microversion: 2.1 time: 1.269155 Aug 23 18:11:12.598673 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2122/4150] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 18:11:11 2022] DELETE /compute/v2.1/os-floating-ips/1ec9929a-fe75-47f9-8730-5d6a04b21174 => generated 0 bytes in 1279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:11:12.599748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4279c422-933d-44e1-96c2-35bffac96d20 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:12.600248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4279c422-933d-44e1-96c2-35bffac96d20 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:12.600699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4279c422-933d-44e1-96c2-35bffac96d20 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:12.603005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4279c422-933d-44e1-96c2-35bffac96d20 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:12.603468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4279c422-933d-44e1-96c2-35bffac96d20 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:12.604542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e4ea924e-1892-4f92-b0ef-f4e6f888b82d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:12.605325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e4ea924e-1892-4f92-b0ef-f4e6f888b82d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:12.605865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4279c422-933d-44e1-96c2-35bffac96d20 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:12.654147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4ea924e-1892-4f92-b0ef-f4e6f888b82d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:12.654669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4ea924e-1892-4f92-b0ef-f4e6f888b82d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:12.655116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4ea924e-1892-4f92-b0ef-f4e6f888b82d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:12.655845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4ea924e-1892-4f92-b0ef-f4e6f888b82d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:12.656284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4ea924e-1892-4f92-b0ef-f4e6f888b82d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:12.657584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4ea924e-1892-4f92-b0ef-f4e6f888b82d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:12.873760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e4ea924e-1892-4f92-b0ef-f4e6f888b82d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:12.884317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e4ea924e-1892-4f92-b0ef-f4e6f888b82d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:12.886131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e4ea924e-1892-4f92-b0ef-f4e6f888b82d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:12.892760 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e4ea924e-1892-4f92-b0ef-f4e6f888b82d tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2339 microversion: 2.32 time: 0.288316 Aug 23 18:11:12.893801 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2123/4151] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:12 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2339 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:12.909469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-34cb45d6-d000-4d35-b238-873f69d64a95 tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] Calling method '.version_select at 0x7f27ec5f7d30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:12.951713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4279c422-933d-44e1-96c2-35bffac96d20 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:12.960509 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4279c422-933d-44e1-96c2-35bffac96d20 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1315 microversion: 2.1 time: 0.385158 Aug 23 18:11:12.961114 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2029/4152] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:12 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1315 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:13.076672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1e19012-2e8b-412d-8faf-bfb5b394f11f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:13.077903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d1e19012-2e8b-412d-8faf-bfb5b394f11f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:13.084876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e19012-2e8b-412d-8faf-bfb5b394f11f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:13.085388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e19012-2e8b-412d-8faf-bfb5b394f11f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:13.085841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e19012-2e8b-412d-8faf-bfb5b394f11f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:13.086666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e19012-2e8b-412d-8faf-bfb5b394f11f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:13.087140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e19012-2e8b-412d-8faf-bfb5b394f11f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:13.087574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e19012-2e8b-412d-8faf-bfb5b394f11f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:13.302855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:13.328292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:13.386177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d1e19012-2e8b-412d-8faf-bfb5b394f11f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:13.398679 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d1e19012-2e8b-412d-8faf-bfb5b394f11f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1324 microversion: 2.1 time: 0.326030 Aug 23 18:11:13.400818 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2030/4153] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:13 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:13.539695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3505ceb2-480e-4849-88a1-5e3ea01b53d6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:13.541008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3505ceb2-480e-4849-88a1-5e3ea01b53d6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:13.551460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3505ceb2-480e-4849-88a1-5e3ea01b53d6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:13.553263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3505ceb2-480e-4849-88a1-5e3ea01b53d6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:13.555594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3505ceb2-480e-4849-88a1-5e3ea01b53d6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:13.557329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3505ceb2-480e-4849-88a1-5e3ea01b53d6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:13.558422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3505ceb2-480e-4849-88a1-5e3ea01b53d6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:13.560454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3505ceb2-480e-4849-88a1-5e3ea01b53d6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:13.843083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3505ceb2-480e-4849-88a1-5e3ea01b53d6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:13.857060 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3505ceb2-480e-4849-88a1-5e3ea01b53d6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1334 microversion: 2.1 time: 0.328820 Aug 23 18:11:13.871430 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2031/4154] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:13 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1334 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:13.920649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a07aee0d-3619-4887-afa9-3830c216de49 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:13.921335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a07aee0d-3619-4887-afa9-3830c216de49 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:13.931336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a07aee0d-3619-4887-afa9-3830c216de49 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:13.931749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a07aee0d-3619-4887-afa9-3830c216de49 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:13.932449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a07aee0d-3619-4887-afa9-3830c216de49 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:13.933228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a07aee0d-3619-4887-afa9-3830c216de49 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:13.934107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a07aee0d-3619-4887-afa9-3830c216de49 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:13.934662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a07aee0d-3619-4887-afa9-3830c216de49 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:14.143122 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-34cb45d6-d000-4d35-b238-873f69d64a95 tempest-FloatingIPDetailsTestJSON-1011055766 tempest-FloatingIPDetailsTestJSON-1011055766-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/7b8ae8d7-ddcc-4bc1-9137-f7ec6de51b7d" status: 202 len: 0 microversion: 2.1 time: 1.247809 Aug 23 18:11:14.145953 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2124/4155] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 18:11:12 2022] DELETE /compute/v2.1/os-floating-ips/7b8ae8d7-ddcc-4bc1-9137-f7ec6de51b7d => generated 0 bytes in 1251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:11:14.157276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcb27133-af6d-457f-8194-40fd5ee673ca tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:14.159315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fcb27133-af6d-457f-8194-40fd5ee673ca tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:14.170124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcb27133-af6d-457f-8194-40fd5ee673ca tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:14.171056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcb27133-af6d-457f-8194-40fd5ee673ca tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:14.171840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcb27133-af6d-457f-8194-40fd5ee673ca tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:14.173647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcb27133-af6d-457f-8194-40fd5ee673ca tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:14.174307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcb27133-af6d-457f-8194-40fd5ee673ca tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:14.175184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcb27133-af6d-457f-8194-40fd5ee673ca tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:14.441993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fcb27133-af6d-457f-8194-40fd5ee673ca tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:14.488232 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fcb27133-af6d-457f-8194-40fd5ee673ca tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1501 microversion: 2.1 time: 0.336234 Aug 23 18:11:14.490744 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2125/4156] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:14 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1501 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:14.505961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5c5dd5e-c2f8-4c6e-8526-0b6cdcd0badc tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:14.506815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e5c5dd5e-c2f8-4c6e-8526-0b6cdcd0badc tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:14.513626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a07aee0d-3619-4887-afa9-3830c216de49 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:14.517350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c5dd5e-c2f8-4c6e-8526-0b6cdcd0badc tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:14.518194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c5dd5e-c2f8-4c6e-8526-0b6cdcd0badc tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:14.519301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c5dd5e-c2f8-4c6e-8526-0b6cdcd0badc tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:14.520210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c5dd5e-c2f8-4c6e-8526-0b6cdcd0badc tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:14.520668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c5dd5e-c2f8-4c6e-8526-0b6cdcd0badc tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:14.521102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5c5dd5e-c2f8-4c6e-8526-0b6cdcd0badc tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:14.528706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a07aee0d-3619-4887-afa9-3830c216de49 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:14.530219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a07aee0d-3619-4887-afa9-3830c216de49 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:14.540910 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a07aee0d-3619-4887-afa9-3830c216de49 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2339 microversion: 2.32 time: 0.626473 Aug 23 18:11:14.541848 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2032/4157] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:13 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2339 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:14.546830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56c11db5-783e-4e31-ad46-368745e6fc48 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:14.547614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-56c11db5-783e-4e31-ad46-368745e6fc48 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:14.559794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56c11db5-783e-4e31-ad46-368745e6fc48 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:14.560504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56c11db5-783e-4e31-ad46-368745e6fc48 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:14.561126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56c11db5-783e-4e31-ad46-368745e6fc48 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:14.562000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56c11db5-783e-4e31-ad46-368745e6fc48 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:14.563178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56c11db5-783e-4e31-ad46-368745e6fc48 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:14.563779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56c11db5-783e-4e31-ad46-368745e6fc48 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:14.588069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-56c11db5-783e-4e31-ad46-368745e6fc48 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lazy-loading 'flavor' on Instance uuid 210941bf-76d0-4c84-a56c-f3b4e6679e8c {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:11:14.692248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:14.817843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e5c5dd5e-c2f8-4c6e-8526-0b6cdcd0badc tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:14.838620 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e5c5dd5e-c2f8-4c6e-8526-0b6cdcd0badc tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1324 microversion: 2.1 time: 0.343170 Aug 23 18:11:14.838620 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2126/4158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:14 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1324 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:14.863686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-93ffb3f9-6f59-40b6-a39e-9d3fdcc4c5bd req-acc2f585-9a16-44e0-85fb-77210c3d0bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-deleted", "tag": "a1a07c6e-8c7d-4734-a891-22a469b9c832"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:14.933961 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-56c11db5-783e-4e31-ad46-368745e6fc48 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "POST /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c/action" status: 202 len: 0 microversion: 2.1 time: 0.390243 Aug 23 18:11:14.936716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-93ffb3f9-6f59-40b6-a39e-9d3fdcc4c5bd req-acc2f585-9a16-44e0-85fb-77210c3d0bc3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:14.937205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-93ffb3f9-6f59-40b6-a39e-9d3fdcc4c5bd req-acc2f585-9a16-44e0-85fb-77210c3d0bc3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:14.937548 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2033/4159] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:11:14 2022] POST /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:11:14.946116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-93ffb3f9-6f59-40b6-a39e-9d3fdcc4c5bd req-acc2f585-9a16-44e0-85fb-77210c3d0bc3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:14.952034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-114328cf-1796-43a8-a059-99c37f25ba27 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:14.952751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-114328cf-1796-43a8-a059-99c37f25ba27 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:14.980015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-114328cf-1796-43a8-a059-99c37f25ba27 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:14.981128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-114328cf-1796-43a8-a059-99c37f25ba27 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:14.981791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-114328cf-1796-43a8-a059-99c37f25ba27 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:14.985688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-114328cf-1796-43a8-a059-99c37f25ba27 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:14.985953 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-93ffb3f9-6f59-40b6-a39e-9d3fdcc4c5bd req-acc2f585-9a16-44e0-85fb-77210c3d0bc3 service nova] Creating event network-vif-deleted:a1a07c6e-8c7d-4734-a891-22a469b9c832 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:11:14.986805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-114328cf-1796-43a8-a059-99c37f25ba27 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:14.987699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-114328cf-1796-43a8-a059-99c37f25ba27 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:15.005677 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-93ffb3f9-6f59-40b6-a39e-9d3fdcc4c5bd req-acc2f585-9a16-44e0-85fb-77210c3d0bc3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151914 Aug 23 18:11:15.006519 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2127/4160] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:15.015584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a6317b19-189e-40f8-a8a7-9c743b3afc63 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:15.016835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a6317b19-189e-40f8-a8a7-9c743b3afc63 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:15.024459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6317b19-189e-40f8-a8a7-9c743b3afc63 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:15.024617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6317b19-189e-40f8-a8a7-9c743b3afc63 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:15.024996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6317b19-189e-40f8-a8a7-9c743b3afc63 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:15.025869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6317b19-189e-40f8-a8a7-9c743b3afc63 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:15.026338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6317b19-189e-40f8-a8a7-9c743b3afc63 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:15.026814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6317b19-189e-40f8-a8a7-9c743b3afc63 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:15.283907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-114328cf-1796-43a8-a059-99c37f25ba27 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:15.295280 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-114328cf-1796-43a8-a059-99c37f25ba27 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1334 microversion: 2.1 time: 0.353706 Aug 23 18:11:15.310745 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2034/4161] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:14 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1334 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:15.541456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a6317b19-189e-40f8-a8a7-9c743b3afc63 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:15.566975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-575b5593-8af3-4a23-b36a-4ea5137766f3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:15.569662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-575b5593-8af3-4a23-b36a-4ea5137766f3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:15.582371 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a6317b19-189e-40f8-a8a7-9c743b3afc63 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.570017 Aug 23 18:11:15.588310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-575b5593-8af3-4a23-b36a-4ea5137766f3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:15.588770 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2128/4162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:15 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:15.592030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-575b5593-8af3-4a23-b36a-4ea5137766f3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:15.592833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-575b5593-8af3-4a23-b36a-4ea5137766f3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:15.594525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-575b5593-8af3-4a23-b36a-4ea5137766f3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:15.597589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-575b5593-8af3-4a23-b36a-4ea5137766f3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:15.598199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-575b5593-8af3-4a23-b36a-4ea5137766f3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:15.850584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-575b5593-8af3-4a23-b36a-4ea5137766f3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:15.863621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-69b497e1-3233-49b1-b4db-7594c7d96466 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:15.864737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-69b497e1-3233-49b1-b4db-7594c7d96466 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:15.871708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-575b5593-8af3-4a23-b36a-4ea5137766f3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:15.886620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69b497e1-3233-49b1-b4db-7594c7d96466 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:15.888430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69b497e1-3233-49b1-b4db-7594c7d96466 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:15.889438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69b497e1-3233-49b1-b4db-7594c7d96466 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:15.891227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-575b5593-8af3-4a23-b36a-4ea5137766f3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:15.893246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69b497e1-3233-49b1-b4db-7594c7d96466 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:15.895118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69b497e1-3233-49b1-b4db-7594c7d96466 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:15.898646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69b497e1-3233-49b1-b4db-7594c7d96466 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:15.900861 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-575b5593-8af3-4a23-b36a-4ea5137766f3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2159 microversion: 2.32 time: 0.338220 Aug 23 18:11:15.911326 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2035/4163] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:15 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2159 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:11:16.322633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-98e3a426-a792-4e7a-82a6-b44b1930e291 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:16.324577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-98e3a426-a792-4e7a-82a6-b44b1930e291 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:16.347245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98e3a426-a792-4e7a-82a6-b44b1930e291 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:16.349611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98e3a426-a792-4e7a-82a6-b44b1930e291 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:16.352652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98e3a426-a792-4e7a-82a6-b44b1930e291 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:16.354421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98e3a426-a792-4e7a-82a6-b44b1930e291 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:16.355531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98e3a426-a792-4e7a-82a6-b44b1930e291 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:16.358177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98e3a426-a792-4e7a-82a6-b44b1930e291 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:16.952379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-98e3a426-a792-4e7a-82a6-b44b1930e291 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:16.967867 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-98e3a426-a792-4e7a-82a6-b44b1930e291 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1334 microversion: 2.1 time: 0.653219 Aug 23 18:11:16.968694 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2036/4164] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:16 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1334 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:16.984801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6918db1c-a708-47f3-90c9-bd745d9f3c81 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:16.987150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6918db1c-a708-47f3-90c9-bd745d9f3c81 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:16.997223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6918db1c-a708-47f3-90c9-bd745d9f3c81 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:16.997733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6918db1c-a708-47f3-90c9-bd745d9f3c81 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:16.998178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6918db1c-a708-47f3-90c9-bd745d9f3c81 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:16.999398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6918db1c-a708-47f3-90c9-bd745d9f3c81 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:16.999872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6918db1c-a708-47f3-90c9-bd745d9f3c81 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:17.000888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6918db1c-a708-47f3-90c9-bd745d9f3c81 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:17.303637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6918db1c-a708-47f3-90c9-bd745d9f3c81 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:17.317072 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6918db1c-a708-47f3-90c9-bd745d9f3c81 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.346596 Aug 23 18:11:17.318305 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2037/4165] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:16 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:17.325509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-58a96073-7cb1-4d1e-8aa3-98c43a56bdfa tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:17.325932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-58a96073-7cb1-4d1e-8aa3-98c43a56bdfa tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:17.343415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58a96073-7cb1-4d1e-8aa3-98c43a56bdfa tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:17.347580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58a96073-7cb1-4d1e-8aa3-98c43a56bdfa tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:17.348248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58a96073-7cb1-4d1e-8aa3-98c43a56bdfa tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:17.349158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58a96073-7cb1-4d1e-8aa3-98c43a56bdfa tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:17.349778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58a96073-7cb1-4d1e-8aa3-98c43a56bdfa tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:17.350395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58a96073-7cb1-4d1e-8aa3-98c43a56bdfa tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:17.463622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-58a96073-7cb1-4d1e-8aa3-98c43a56bdfa tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:17.474471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-58a96073-7cb1-4d1e-8aa3-98c43a56bdfa tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:17.476008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-58a96073-7cb1-4d1e-8aa3-98c43a56bdfa tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:17.477299 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-58a96073-7cb1-4d1e-8aa3-98c43a56bdfa tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 2159 microversion: 2.32 time: 0.155759 Aug 23 18:11:17.486566 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2038/4166] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:17 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 2159 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:17.486566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-5b64e206-371b-4d75-9f23-1eaa38adeeea req-b2787b33-b861-48d9-9ae8-8070acc86d61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e113c065-7175-4e41-8f1c-ce90969bd01e", "name": "network-vif-deleted", "tag": "1eee6fec-aebe-4ef5-b406-7ef3e9925c14"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:17.497710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5b64e206-371b-4d75-9f23-1eaa38adeeea req-b2787b33-b861-48d9-9ae8-8070acc86d61 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:17.497710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5b64e206-371b-4d75-9f23-1eaa38adeeea req-b2787b33-b861-48d9-9ae8-8070acc86d61 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:17.497710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5b64e206-371b-4d75-9f23-1eaa38adeeea req-b2787b33-b861-48d9-9ae8-8070acc86d61 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:17.504697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-69b497e1-3233-49b1-b4db-7594c7d96466 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:17.507039 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5b64e206-371b-4d75-9f23-1eaa38adeeea req-b2787b33-b861-48d9-9ae8-8070acc86d61 service nova] Creating event network-vif-deleted:1eee6fec-aebe-4ef5-b406-7ef3e9925c14 for instance e113c065-7175-4e41-8f1c-ce90969bd01e on n-h2-850468-16 Aug 23 18:11:17.512544 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-5b64e206-371b-4d75-9f23-1eaa38adeeea req-b2787b33-b861-48d9-9ae8-8070acc86d61 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032990 Aug 23 18:11:17.516956 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2039/4167] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:17.518099 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-69b497e1-3233-49b1-b4db-7594c7d96466 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1324 microversion: 2.1 time: 1.659381 Aug 23 18:11:17.518817 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2129/4168] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:15 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1324 bytes in 1661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:11:17.989547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93b5220b-0789-48f6-8547-53d0127b865b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:17.991363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-93b5220b-0789-48f6-8547-53d0127b865b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:18.002460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b5220b-0789-48f6-8547-53d0127b865b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:18.003250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b5220b-0789-48f6-8547-53d0127b865b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:18.003846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b5220b-0789-48f6-8547-53d0127b865b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:18.004726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b5220b-0789-48f6-8547-53d0127b865b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:18.005334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b5220b-0789-48f6-8547-53d0127b865b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:18.006302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b5220b-0789-48f6-8547-53d0127b865b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:18.180276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-93b5220b-0789-48f6-8547-53d0127b865b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:18.191995 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93b5220b-0789-48f6-8547-53d0127b865b tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1334 microversion: 2.1 time: 0.207231 Aug 23 18:11:18.193334 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2040/4169] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:17 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1334 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:18.345549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-143921c1-21de-47c5-8b1d-2f16f048aefe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:18.346788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-143921c1-21de-47c5-8b1d-2f16f048aefe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:18.363921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-143921c1-21de-47c5-8b1d-2f16f048aefe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:18.365861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-143921c1-21de-47c5-8b1d-2f16f048aefe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:18.366576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-143921c1-21de-47c5-8b1d-2f16f048aefe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:18.368420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-143921c1-21de-47c5-8b1d-2f16f048aefe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:18.369301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-143921c1-21de-47c5-8b1d-2f16f048aefe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:18.372274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-143921c1-21de-47c5-8b1d-2f16f048aefe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:18.506787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9df38702-97f0-44c3-9032-adf1fc4df753 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:18.507414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9df38702-97f0-44c3-9032-adf1fc4df753 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:18.518448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9df38702-97f0-44c3-9032-adf1fc4df753 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:18.518981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9df38702-97f0-44c3-9032-adf1fc4df753 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:18.523079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9df38702-97f0-44c3-9032-adf1fc4df753 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:18.524185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9df38702-97f0-44c3-9032-adf1fc4df753 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:18.524678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9df38702-97f0-44c3-9032-adf1fc4df753 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:18.525129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9df38702-97f0-44c3-9032-adf1fc4df753 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:18.676128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9df38702-97f0-44c3-9032-adf1fc4df753 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:18.693529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9df38702-97f0-44c3-9032-adf1fc4df753 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:18.697638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9df38702-97f0-44c3-9032-adf1fc4df753 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:18.699364 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9df38702-97f0-44c3-9032-adf1fc4df753 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.197195 Aug 23 18:11:18.702002 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2041/4170] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:18 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:18.710342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9e83a169-a8c1-41af-acc6-2a8e06d988da tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:18.717763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9e83a169-a8c1-41af-acc6-2a8e06d988da tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:18.733184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-143921c1-21de-47c5-8b1d-2f16f048aefe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:18.737660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e83a169-a8c1-41af-acc6-2a8e06d988da tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:18.742418 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-143921c1-21de-47c5-8b1d-2f16f048aefe tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.404964 Aug 23 18:11:18.752848 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2130/4171] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:18 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:18.753047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e83a169-a8c1-41af-acc6-2a8e06d988da tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:18.753047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e83a169-a8c1-41af-acc6-2a8e06d988da tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:18.753047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e83a169-a8c1-41af-acc6-2a8e06d988da tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:18.753047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e83a169-a8c1-41af-acc6-2a8e06d988da tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:18.753047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e83a169-a8c1-41af-acc6-2a8e06d988da tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:19.028025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9e83a169-a8c1-41af-acc6-2a8e06d988da tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:19.041860 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9e83a169-a8c1-41af-acc6-2a8e06d988da tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1324 microversion: 2.1 time: 0.338444 Aug 23 18:11:19.043488 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2042/4172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:18 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1324 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:19.171753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-9d6ef014-ec4e-409c-a883-bf92aace9794 req-f743d24f-cd71-46fa-aff0-250c49e42ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd", "name": "network-vif-plugged", "status": "completed", "tag": "c5695077-ef76-4af1-af94-420232e98b43"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:19.189180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9d6ef014-ec4e-409c-a883-bf92aace9794 req-f743d24f-cd71-46fa-aff0-250c49e42ece service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:19.192514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9d6ef014-ec4e-409c-a883-bf92aace9794 req-f743d24f-cd71-46fa-aff0-250c49e42ece service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:19.193363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9d6ef014-ec4e-409c-a883-bf92aace9794 req-f743d24f-cd71-46fa-aff0-250c49e42ece service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:19.213366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a4ee08a-2730-4a57-a4d7-6b5daa78426f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:19.214255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6a4ee08a-2730-4a57-a4d7-6b5daa78426f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:19.217951 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-9d6ef014-ec4e-409c-a883-bf92aace9794 req-f743d24f-cd71-46fa-aff0-250c49e42ece service nova] Creating event network-vif-plugged:c5695077-ef76-4af1-af94-420232e98b43 for instance fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd on n-h2-850468-16 Aug 23 18:11:19.227677 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-9d6ef014-ec4e-409c-a883-bf92aace9794 req-f743d24f-cd71-46fa-aff0-250c49e42ece service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058882 Aug 23 18:11:19.230300 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2131/4173] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:19.234112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a4ee08a-2730-4a57-a4d7-6b5daa78426f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:19.237123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a4ee08a-2730-4a57-a4d7-6b5daa78426f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:19.237579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a4ee08a-2730-4a57-a4d7-6b5daa78426f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:19.238324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a4ee08a-2730-4a57-a4d7-6b5daa78426f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:19.240989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a4ee08a-2730-4a57-a4d7-6b5daa78426f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:19.247463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a4ee08a-2730-4a57-a4d7-6b5daa78426f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:19.486035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a4ee08a-2730-4a57-a4d7-6b5daa78426f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:19.496562 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a4ee08a-2730-4a57-a4d7-6b5daa78426f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1334 microversion: 2.1 time: 0.286962 Aug 23 18:11:19.497203 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2043/4174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:19 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1334 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:19.727732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ff4b501f-7b7f-4ec3-ae1d-96f4dc8713b4 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:19.728447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ff4b501f-7b7f-4ec3-ae1d-96f4dc8713b4 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:19.736869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff4b501f-7b7f-4ec3-ae1d-96f4dc8713b4 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:19.737490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff4b501f-7b7f-4ec3-ae1d-96f4dc8713b4 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:19.737729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff4b501f-7b7f-4ec3-ae1d-96f4dc8713b4 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:19.738450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff4b501f-7b7f-4ec3-ae1d-96f4dc8713b4 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:19.740620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff4b501f-7b7f-4ec3-ae1d-96f4dc8713b4 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:19.741916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff4b501f-7b7f-4ec3-ae1d-96f4dc8713b4 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:19.773696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9db7d9eb-009c-405b-be55-134f27eece09 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:19.776485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9db7d9eb-009c-405b-be55-134f27eece09 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:19.793989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9db7d9eb-009c-405b-be55-134f27eece09 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:19.800522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9db7d9eb-009c-405b-be55-134f27eece09 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:19.803212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9db7d9eb-009c-405b-be55-134f27eece09 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:19.806091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9db7d9eb-009c-405b-be55-134f27eece09 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:19.812371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9db7d9eb-009c-405b-be55-134f27eece09 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:19.813413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9db7d9eb-009c-405b-be55-134f27eece09 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:19.894429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ff4b501f-7b7f-4ec3-ae1d-96f4dc8713b4 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:19.908797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ff4b501f-7b7f-4ec3-ae1d-96f4dc8713b4 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:19.922448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ff4b501f-7b7f-4ec3-ae1d-96f4dc8713b4 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:19.924069 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ff4b501f-7b7f-4ec3-ae1d-96f4dc8713b4 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.202210 Aug 23 18:11:19.925590 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2132/4175] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:19 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:11:20.082121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3fc7f255-d1ae-4f12-929e-ae6b9fb032aa tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:20.085316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3fc7f255-d1ae-4f12-929e-ae6b9fb032aa tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:20.103853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fc7f255-d1ae-4f12-929e-ae6b9fb032aa tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:20.104359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fc7f255-d1ae-4f12-929e-ae6b9fb032aa tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:20.104805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fc7f255-d1ae-4f12-929e-ae6b9fb032aa tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:20.105531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fc7f255-d1ae-4f12-929e-ae6b9fb032aa tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:20.107539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fc7f255-d1ae-4f12-929e-ae6b9fb032aa tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:20.107539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fc7f255-d1ae-4f12-929e-ae6b9fb032aa tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:20.301499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9db7d9eb-009c-405b-be55-134f27eece09 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:20.336037 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9db7d9eb-009c-405b-be55-134f27eece09 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.575362 Aug 23 18:11:20.353167 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2044/4176] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:19 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:20.518855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c31fb8df-e6ad-4c28-b0a3-09fe094e2019 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:20.519536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c31fb8df-e6ad-4c28-b0a3-09fe094e2019 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:20.529514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c31fb8df-e6ad-4c28-b0a3-09fe094e2019 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:20.539923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c31fb8df-e6ad-4c28-b0a3-09fe094e2019 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:20.540538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c31fb8df-e6ad-4c28-b0a3-09fe094e2019 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:20.541690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c31fb8df-e6ad-4c28-b0a3-09fe094e2019 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:20.545017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c31fb8df-e6ad-4c28-b0a3-09fe094e2019 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:20.545724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c31fb8df-e6ad-4c28-b0a3-09fe094e2019 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:20.673276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3fc7f255-d1ae-4f12-929e-ae6b9fb032aa tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:20.686199 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3fc7f255-d1ae-4f12-929e-ae6b9fb032aa tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1324 microversion: 2.1 time: 0.621995 Aug 23 18:11:20.692373 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2133/4177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:20 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1324 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:20.807785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c31fb8df-e6ad-4c28-b0a3-09fe094e2019 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:20.817176 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c31fb8df-e6ad-4c28-b0a3-09fe094e2019 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1334 microversion: 2.1 time: 0.303369 Aug 23 18:11:20.824503 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2045/4178] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:20 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1334 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:20.949879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-da4d513f-77b0-48a3-92f7-f16c651f7caf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:20.951697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-da4d513f-77b0-48a3-92f7-f16c651f7caf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:20.971509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da4d513f-77b0-48a3-92f7-f16c651f7caf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:20.972378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da4d513f-77b0-48a3-92f7-f16c651f7caf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:20.974491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da4d513f-77b0-48a3-92f7-f16c651f7caf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:20.975823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da4d513f-77b0-48a3-92f7-f16c651f7caf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:20.976767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da4d513f-77b0-48a3-92f7-f16c651f7caf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:20.977410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da4d513f-77b0-48a3-92f7-f16c651f7caf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:21.106201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-da4d513f-77b0-48a3-92f7-f16c651f7caf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:21.121293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-da4d513f-77b0-48a3-92f7-f16c651f7caf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:21.130839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-da4d513f-77b0-48a3-92f7-f16c651f7caf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:21.135928 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-da4d513f-77b0-48a3-92f7-f16c651f7caf tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.189487 Aug 23 18:11:21.137175 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2134/4179] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:20 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:21.260736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-8701391d-8a47-4f10-87c4-8cdea535c360 req-80aab20f-7df7-460b-8f13-9c44eecf29bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75", "name": "network-vif-plugged", "status": "completed", "tag": "6bbe04dd-e186-40e2-9354-48726f413eb2"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:21.289253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8701391d-8a47-4f10-87c4-8cdea535c360 req-80aab20f-7df7-460b-8f13-9c44eecf29bc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:21.289767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8701391d-8a47-4f10-87c4-8cdea535c360 req-80aab20f-7df7-460b-8f13-9c44eecf29bc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:21.291765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8701391d-8a47-4f10-87c4-8cdea535c360 req-80aab20f-7df7-460b-8f13-9c44eecf29bc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:21.332841 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-8701391d-8a47-4f10-87c4-8cdea535c360 req-80aab20f-7df7-460b-8f13-9c44eecf29bc service nova] Creating event network-vif-plugged:6bbe04dd-e186-40e2-9354-48726f413eb2 for instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 on n-h1-850468-16 Aug 23 18:11:21.362207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-87551271-e6f0-4280-b511-197880f60006 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:21.364691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-87551271-e6f0-4280-b511-197880f60006 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:21.373574 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-8701391d-8a47-4f10-87c4-8cdea535c360 req-80aab20f-7df7-460b-8f13-9c44eecf29bc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116989 Aug 23 18:11:21.376256 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2046/4180] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:21.377650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87551271-e6f0-4280-b511-197880f60006 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:21.378297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87551271-e6f0-4280-b511-197880f60006 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:21.379062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87551271-e6f0-4280-b511-197880f60006 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:21.379661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87551271-e6f0-4280-b511-197880f60006 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:21.380224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87551271-e6f0-4280-b511-197880f60006 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:21.381023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87551271-e6f0-4280-b511-197880f60006 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:21.616412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-87551271-e6f0-4280-b511-197880f60006 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:21.630037 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-87551271-e6f0-4280-b511-197880f60006 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.272023 Aug 23 18:11:21.643078 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2135/4181] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:21 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:21.714249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-80d99ac3-20c4-4418-8566-52ff707c688f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:21.715269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-80d99ac3-20c4-4418-8566-52ff707c688f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:21.722682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80d99ac3-20c4-4418-8566-52ff707c688f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:21.723467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80d99ac3-20c4-4418-8566-52ff707c688f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:21.723965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80d99ac3-20c4-4418-8566-52ff707c688f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:21.724898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80d99ac3-20c4-4418-8566-52ff707c688f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:21.725548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80d99ac3-20c4-4418-8566-52ff707c688f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:21.726184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80d99ac3-20c4-4418-8566-52ff707c688f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:21.851232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-45ad6253-aeeb-4f72-9ae5-ccb66a4bd85a tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:21.851861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-45ad6253-aeeb-4f72-9ae5-ccb66a4bd85a tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:21.868243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45ad6253-aeeb-4f72-9ae5-ccb66a4bd85a tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:21.869397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45ad6253-aeeb-4f72-9ae5-ccb66a4bd85a tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:21.870322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45ad6253-aeeb-4f72-9ae5-ccb66a4bd85a tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:21.871319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45ad6253-aeeb-4f72-9ae5-ccb66a4bd85a tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:21.871931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45ad6253-aeeb-4f72-9ae5-ccb66a4bd85a tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:21.872509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45ad6253-aeeb-4f72-9ae5-ccb66a4bd85a tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:21.880123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:21.939710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-80d99ac3-20c4-4418-8566-52ff707c688f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:21.947925 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-80d99ac3-20c4-4418-8566-52ff707c688f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1522 microversion: 2.1 time: 0.238237 Aug 23 18:11:21.949104 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2047/4182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:21 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:21.975415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9614c4d7-b172-43eb-97b9-13d1bb0f07f9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:21.976387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9614c4d7-b172-43eb-97b9-13d1bb0f07f9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:21.983560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9614c4d7-b172-43eb-97b9-13d1bb0f07f9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:21.984283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9614c4d7-b172-43eb-97b9-13d1bb0f07f9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:21.985181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9614c4d7-b172-43eb-97b9-13d1bb0f07f9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:21.986603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9614c4d7-b172-43eb-97b9-13d1bb0f07f9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:21.987247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9614c4d7-b172-43eb-97b9-13d1bb0f07f9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:21.987910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9614c4d7-b172-43eb-97b9-13d1bb0f07f9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:22.015208 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-9614c4d7-b172-43eb-97b9-13d1bb0f07f9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] HTTP exception thrown: Instance is not a member of specified network Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9614c4d7-b172-43eb-97b9-13d1bb0f07f9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Request method failure captured: Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd/ips/invalid HTTP/1.1 Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRg1ld2XHb1I_rZ_WLN4rB30Lvhnq2j38UtCV2fWzq3_jw-8wEY1k22xhUBSN9yuaJDuC_SjdZP78vP9cuEf5BjPgXw2R2D2CHHrk0HUtJiKWiT9v7xOS1Lj0Fs8MIv7Mrqant0n5gM0GOYnwaLTFgfIOrV5gSunxLGaHRvX1NRenKc Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: c0c32c51a6114dcf984888c230664e26 Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2005717141 Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c0c32c51a6114dcf984888c230664e26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c0c32c51a6114dcf984888c230664e26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c0c32c51a6114dcf984888c230664e26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c0c32c51a6114dcf984888c230664e26"}]}] Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2005717141 Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: c0c32c51a6114dcf984888c230664e26 Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2005717141 Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerAddressesNegativeTestJSON-2005717141-project Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: ed44000309354b61950aaabd6521bab1 Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2005717141-project Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance is not a member of specified network Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': 'fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd', 'id': 'invalid'} Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Aug 23 18:11:22.031855 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:22.037515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9614c4d7-b172-43eb-97b9-13d1bb0f07f9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Returning 404 to user: Instance is not a member of specified network {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:22.038698 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9614c4d7-b172-43eb-97b9-13d1bb0f07f9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.067511 Aug 23 18:11:22.039590 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2048/4183] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:11:21 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd/ips/invalid => generated 91 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:11:22.053290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a9f63ff-677d-4474-8eef-a0768789c87e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:22.056251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a9f63ff-677d-4474-8eef-a0768789c87e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Failed to fetch instance by id 999 {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 18:11:22.058905 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-9a9f63ff-677d-4474-8eef-a0768789c87e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] HTTP exception thrown: Instance 999 could not be found. Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a9f63ff-677d-4474-8eef-a0768789c87e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Request method failure captured: Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRg1ld2XHb1I_rZ_WLN4rB30Lvhnq2j38UtCV2fWzq3_jw-8wEY1k22xhUBSN9yuaJDuC_SjdZP78vP9cuEf5BjPgXw2R2D2CHHrk0HUtJiKWiT9v7xOS1Lj0Fs8MIv7Mrqant0n5gM0GOYnwaLTFgfIOrV5gSunxLGaHRvX1NRenKc Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: c0c32c51a6114dcf984888c230664e26 Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2005717141 Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c0c32c51a6114dcf984888c230664e26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c0c32c51a6114dcf984888c230664e26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c0c32c51a6114dcf984888c230664e26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c0c32c51a6114dcf984888c230664e26"}]}] Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2005717141 Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: c0c32c51a6114dcf984888c230664e26 Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2005717141 Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerAddressesNegativeTestJSON-2005717141-project Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: ed44000309354b61950aaabd6521bab1 Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2005717141-project Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 999 could not be found. Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': '999'} Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Aug 23 18:11:22.060681 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:22.068802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a9f63ff-677d-4474-8eef-a0768789c87e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Returning 404 to user: Instance 999 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:22.070100 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a9f63ff-677d-4474-8eef-a0768789c87e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.024301 Aug 23 18:11:22.072192 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2049/4184] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Aug 23 18:11:22 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:11:22.086382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dd79ef32-9349-4754-ab4e-6e51909cd52d tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:22.089196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dd79ef32-9349-4754-ab4e-6e51909cd52d tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:22.090203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45ad6253-aeeb-4f72-9ae5-ccb66a4bd85a tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:22.097014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd79ef32-9349-4754-ab4e-6e51909cd52d tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:22.097781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd79ef32-9349-4754-ab4e-6e51909cd52d tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:22.098436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd79ef32-9349-4754-ab4e-6e51909cd52d tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:22.099361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd79ef32-9349-4754-ab4e-6e51909cd52d tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:22.099973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd79ef32-9349-4754-ab4e-6e51909cd52d tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:22.100592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd79ef32-9349-4754-ab4e-6e51909cd52d tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:22.101365 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-45ad6253-aeeb-4f72-9ae5-ccb66a4bd85a tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1334 microversion: 2.1 time: 0.253975 Aug 23 18:11:22.110785 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2136/4185] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:21 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1334 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:22.130984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dd79ef32-9349-4754-ab4e-6e51909cd52d tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:11:22.165097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-062f2a1b-4ac2-4852-b69c-22292d3d1fde tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:22.166173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-062f2a1b-4ac2-4852-b69c-22292d3d1fde tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:22.174284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-062f2a1b-4ac2-4852-b69c-22292d3d1fde tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:22.175082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-062f2a1b-4ac2-4852-b69c-22292d3d1fde tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:22.177782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-062f2a1b-4ac2-4852-b69c-22292d3d1fde tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:22.178529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-062f2a1b-4ac2-4852-b69c-22292d3d1fde tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:22.179051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-062f2a1b-4ac2-4852-b69c-22292d3d1fde tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:22.179495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-062f2a1b-4ac2-4852-b69c-22292d3d1fde tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:22.261451 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dd79ef32-9349-4754-ab4e-6e51909cd52d tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "DELETE /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 204 len: 0 microversion: 2.1 time: 0.180690 Aug 23 18:11:22.263065 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2050/4186] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:11:22 2022] DELETE /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:11:22.274063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0e91649e-9ac9-4083-a8e7-fb534caf3989 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:22.275189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0e91649e-9ac9-4083-a8e7-fb534caf3989 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:22.278884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-062f2a1b-4ac2-4852-b69c-22292d3d1fde tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:22.284069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e91649e-9ac9-4083-a8e7-fb534caf3989 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:22.284989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e91649e-9ac9-4083-a8e7-fb534caf3989 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:22.285643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e91649e-9ac9-4083-a8e7-fb534caf3989 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:22.286616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e91649e-9ac9-4083-a8e7-fb534caf3989 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:22.287291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e91649e-9ac9-4083-a8e7-fb534caf3989 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:22.287902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e91649e-9ac9-4083-a8e7-fb534caf3989 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:22.294763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:22.300369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-062f2a1b-4ac2-4852-b69c-22292d3d1fde tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:22.302003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-062f2a1b-4ac2-4852-b69c-22292d3d1fde tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:22.303366 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-062f2a1b-4ac2-4852-b69c-22292d3d1fde tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.143335 Aug 23 18:11:22.304177 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2137/4187] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:22 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:22.475448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0e91649e-9ac9-4083-a8e7-fb534caf3989 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:22.487143 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0e91649e-9ac9-4083-a8e7-fb534caf3989 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1528 microversion: 2.1 time: 0.219032 Aug 23 18:11:22.488926 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2051/4188] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:22 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1528 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:22.652569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0a16989a-7d9f-4d03-9ebb-05fcf3c87050 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:22.653182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0a16989a-7d9f-4d03-9ebb-05fcf3c87050 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:22.662744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a16989a-7d9f-4d03-9ebb-05fcf3c87050 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:22.663361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a16989a-7d9f-4d03-9ebb-05fcf3c87050 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:22.664502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a16989a-7d9f-4d03-9ebb-05fcf3c87050 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:22.665331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a16989a-7d9f-4d03-9ebb-05fcf3c87050 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:22.665954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a16989a-7d9f-4d03-9ebb-05fcf3c87050 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:22.666816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a16989a-7d9f-4d03-9ebb-05fcf3c87050 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:22.873132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0a16989a-7d9f-4d03-9ebb-05fcf3c87050 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:22.884590 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0a16989a-7d9f-4d03-9ebb-05fcf3c87050 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.236352 Aug 23 18:11:22.896438 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2138/4189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:22 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:23.127274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6b78c421-3c95-4ffe-8a53-aa91b9f20ea6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:23.128304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6b78c421-3c95-4ffe-8a53-aa91b9f20ea6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:23.134908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b78c421-3c95-4ffe-8a53-aa91b9f20ea6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:23.135809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b78c421-3c95-4ffe-8a53-aa91b9f20ea6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:23.136539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b78c421-3c95-4ffe-8a53-aa91b9f20ea6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:23.137583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b78c421-3c95-4ffe-8a53-aa91b9f20ea6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:23.138380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b78c421-3c95-4ffe-8a53-aa91b9f20ea6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:23.138944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b78c421-3c95-4ffe-8a53-aa91b9f20ea6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:23.329337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-228b6a61-45c6-40a1-b3c3-fcd02b7bb7f1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:23.330879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-228b6a61-45c6-40a1-b3c3-fcd02b7bb7f1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:23.338352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-228b6a61-45c6-40a1-b3c3-fcd02b7bb7f1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:23.339217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-228b6a61-45c6-40a1-b3c3-fcd02b7bb7f1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:23.339877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-228b6a61-45c6-40a1-b3c3-fcd02b7bb7f1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:23.341067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-228b6a61-45c6-40a1-b3c3-fcd02b7bb7f1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:23.341745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-228b6a61-45c6-40a1-b3c3-fcd02b7bb7f1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:23.342377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-228b6a61-45c6-40a1-b3c3-fcd02b7bb7f1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:23.438139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-228b6a61-45c6-40a1-b3c3-fcd02b7bb7f1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:23.454274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6b78c421-3c95-4ffe-8a53-aa91b9f20ea6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:23.465346 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6b78c421-3c95-4ffe-8a53-aa91b9f20ea6 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1334 microversion: 2.1 time: 0.345600 Aug 23 18:11:23.466570 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2052/4190] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:23 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1334 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:23.469401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-228b6a61-45c6-40a1-b3c3-fcd02b7bb7f1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:23.471310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-228b6a61-45c6-40a1-b3c3-fcd02b7bb7f1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:23.473058 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-228b6a61-45c6-40a1-b3c3-fcd02b7bb7f1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.148238 Aug 23 18:11:23.473980 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2139/4191] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:23 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:11:23.478401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-81652ff6-a5d9-474a-99ca-4a85c489481e req-598b90b1-18a9-4ea8-88a2-7a37b436aee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75", "name": "network-vif-plugged", "status": "completed", "tag": "e096e09e-b1c2-4dc0-a75f-934bb26df03f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:23.488547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-81652ff6-a5d9-474a-99ca-4a85c489481e req-598b90b1-18a9-4ea8-88a2-7a37b436aee0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:23.489329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-81652ff6-a5d9-474a-99ca-4a85c489481e req-598b90b1-18a9-4ea8-88a2-7a37b436aee0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:23.490002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-81652ff6-a5d9-474a-99ca-4a85c489481e req-598b90b1-18a9-4ea8-88a2-7a37b436aee0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:23.507455 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-81652ff6-a5d9-474a-99ca-4a85c489481e req-598b90b1-18a9-4ea8-88a2-7a37b436aee0 service nova] Creating event network-vif-plugged:e096e09e-b1c2-4dc0-a75f-934bb26df03f for instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 on n-h1-850468-16 Aug 23 18:11:23.512916 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-81652ff6-a5d9-474a-99ca-4a85c489481e req-598b90b1-18a9-4ea8-88a2-7a37b436aee0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045204 Aug 23 18:11:23.513752 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2053/4192] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:23.517919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2da11457-b1f8-43a4-bf10-c7ee6a856074 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:23.518694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2da11457-b1f8-43a4-bf10-c7ee6a856074 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:23.539524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2da11457-b1f8-43a4-bf10-c7ee6a856074 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:23.540369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2da11457-b1f8-43a4-bf10-c7ee6a856074 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:23.541704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2da11457-b1f8-43a4-bf10-c7ee6a856074 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:23.543293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2da11457-b1f8-43a4-bf10-c7ee6a856074 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:23.544441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2da11457-b1f8-43a4-bf10-c7ee6a856074 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:23.545230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2da11457-b1f8-43a4-bf10-c7ee6a856074 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:23.841887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2da11457-b1f8-43a4-bf10-c7ee6a856074 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:23.855880 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2da11457-b1f8-43a4-bf10-c7ee6a856074 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1528 microversion: 2.1 time: 0.346356 Aug 23 18:11:23.857339 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2140/4193] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:23 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1528 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:23.908303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c9713e2e-c179-4d11-8d14-65a07675ad8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:23.909349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c9713e2e-c179-4d11-8d14-65a07675ad8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:23.919795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9713e2e-c179-4d11-8d14-65a07675ad8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:23.920593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9713e2e-c179-4d11-8d14-65a07675ad8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:23.923010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9713e2e-c179-4d11-8d14-65a07675ad8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:23.924385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9713e2e-c179-4d11-8d14-65a07675ad8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:23.925195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9713e2e-c179-4d11-8d14-65a07675ad8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:23.925817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9713e2e-c179-4d11-8d14-65a07675ad8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:24.111263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c9713e2e-c179-4d11-8d14-65a07675ad8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:24.122651 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c9713e2e-c179-4d11-8d14-65a07675ad8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.218518 Aug 23 18:11:24.123614 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2054/4194] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:23 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:24.488476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f0ef8160-04fe-408e-a360-213b540bf4ab tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:24.489090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f0ef8160-04fe-408e-a360-213b540bf4ab tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:24.499084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c2b43020-1bc4-462b-bbfe-8b5bfac5a0f9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:24.501024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c2b43020-1bc4-462b-bbfe-8b5bfac5a0f9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:24.514564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0ef8160-04fe-408e-a360-213b540bf4ab tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:24.515455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b43020-1bc4-462b-bbfe-8b5bfac5a0f9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:24.517951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0ef8160-04fe-408e-a360-213b540bf4ab tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:24.518533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0ef8160-04fe-408e-a360-213b540bf4ab tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:24.521204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0ef8160-04fe-408e-a360-213b540bf4ab tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:24.521703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0ef8160-04fe-408e-a360-213b540bf4ab tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:24.522152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0ef8160-04fe-408e-a360-213b540bf4ab tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:24.527702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b43020-1bc4-462b-bbfe-8b5bfac5a0f9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:24.528285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b43020-1bc4-462b-bbfe-8b5bfac5a0f9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:24.529065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b43020-1bc4-462b-bbfe-8b5bfac5a0f9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:24.529549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b43020-1bc4-462b-bbfe-8b5bfac5a0f9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:24.529990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b43020-1bc4-462b-bbfe-8b5bfac5a0f9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:24.698804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c2b43020-1bc4-462b-bbfe-8b5bfac5a0f9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:24.717000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c2b43020-1bc4-462b-bbfe-8b5bfac5a0f9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:24.721663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c2b43020-1bc4-462b-bbfe-8b5bfac5a0f9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:24.722969 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c2b43020-1bc4-462b-bbfe-8b5bfac5a0f9 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.229011 Aug 23 18:11:24.726464 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2055/4195] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:24 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:24.876597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e2fcfb51-79e8-4cc5-96cc-585f0a195760 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:24.877095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e2fcfb51-79e8-4cc5-96cc-585f0a195760 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:24.894413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2fcfb51-79e8-4cc5-96cc-585f0a195760 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:24.894951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2fcfb51-79e8-4cc5-96cc-585f0a195760 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:24.895403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2fcfb51-79e8-4cc5-96cc-585f0a195760 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:24.896136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2fcfb51-79e8-4cc5-96cc-585f0a195760 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:24.897458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2fcfb51-79e8-4cc5-96cc-585f0a195760 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:24.897910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2fcfb51-79e8-4cc5-96cc-585f0a195760 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:25.107875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f0ef8160-04fe-408e-a360-213b540bf4ab tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:25.121763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-e2fcfb51-79e8-4cc5-96cc-585f0a195760 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lazy-loading 'services' on Instance uuid 8f0d2e07-d2d2-422d-a262-279197b79569 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:11:25.137190 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f0ef8160-04fe-408e-a360-213b540bf4ab tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1334 microversion: 2.1 time: 0.651830 Aug 23 18:11:25.141163 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2141/4196] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:24 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1334 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:25.166915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2d697b4b-fd16-4a5c-b547-1ac4c86d901f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:25.171549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2d697b4b-fd16-4a5c-b547-1ac4c86d901f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:25.198244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d697b4b-fd16-4a5c-b547-1ac4c86d901f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:25.200584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d697b4b-fd16-4a5c-b547-1ac4c86d901f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:25.204770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d697b4b-fd16-4a5c-b547-1ac4c86d901f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:25.207908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d697b4b-fd16-4a5c-b547-1ac4c86d901f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:25.210984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d697b4b-fd16-4a5c-b547-1ac4c86d901f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:25.212291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d697b4b-fd16-4a5c-b547-1ac4c86d901f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:25.349147 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e2fcfb51-79e8-4cc5-96cc-585f0a195760 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments/feb0e5d3-f849-4758-83a9-7e3e39f4c59f" status: 202 len: 0 microversion: 2.1 time: 0.475909 Aug 23 18:11:25.354173 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2056/4197] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 18:11:24 2022] DELETE /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments/feb0e5d3-f849-4758-83a9-7e3e39f4c59f => generated 0 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:11:25.361413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2cd4b241-5e7a-46cb-9887-ba18f5276e34 req-8b333cf1-cdfd-443c-8ba8-4e9d2e0185f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd", "name": "network-vif-deleted", "tag": "c5695077-ef76-4af1-af94-420232e98b43"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:25.379539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2cd4b241-5e7a-46cb-9887-ba18f5276e34 req-8b333cf1-cdfd-443c-8ba8-4e9d2e0185f4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:25.380163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2cd4b241-5e7a-46cb-9887-ba18f5276e34 req-8b333cf1-cdfd-443c-8ba8-4e9d2e0185f4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:25.380716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2cd4b241-5e7a-46cb-9887-ba18f5276e34 req-8b333cf1-cdfd-443c-8ba8-4e9d2e0185f4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:25.401184 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2cd4b241-5e7a-46cb-9887-ba18f5276e34 req-8b333cf1-cdfd-443c-8ba8-4e9d2e0185f4 service nova] Creating event network-vif-deleted:c5695077-ef76-4af1-af94-420232e98b43 for instance fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd on n-h2-850468-16 Aug 23 18:11:25.408510 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2cd4b241-5e7a-46cb-9887-ba18f5276e34 req-8b333cf1-cdfd-443c-8ba8-4e9d2e0185f4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052366 Aug 23 18:11:25.409493 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2057/4198] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:25.422704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a7a1beee-9043-4159-a7e0-d059d8adfbe4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:25.426438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a7a1beee-9043-4159-a7e0-d059d8adfbe4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:25.434993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7a1beee-9043-4159-a7e0-d059d8adfbe4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:25.435546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7a1beee-9043-4159-a7e0-d059d8adfbe4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:25.436120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7a1beee-9043-4159-a7e0-d059d8adfbe4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:25.436941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7a1beee-9043-4159-a7e0-d059d8adfbe4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:25.437787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7a1beee-9043-4159-a7e0-d059d8adfbe4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:25.438371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7a1beee-9043-4159-a7e0-d059d8adfbe4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:25.461656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2d697b4b-fd16-4a5c-b547-1ac4c86d901f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:25.484455 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2d697b4b-fd16-4a5c-b547-1ac4c86d901f tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1309 microversion: 2.1 time: 0.339230 Aug 23 18:11:25.485756 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2142/4199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:25 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1309 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:25.494618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-72586684-3177-4084-9bd4-038c5054d187 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:25.508617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-72586684-3177-4084-9bd4-038c5054d187 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:25.523033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72586684-3177-4084-9bd4-038c5054d187 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:25.536976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72586684-3177-4084-9bd4-038c5054d187 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:25.541389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72586684-3177-4084-9bd4-038c5054d187 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:25.548261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72586684-3177-4084-9bd4-038c5054d187 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:25.549845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72586684-3177-4084-9bd4-038c5054d187 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:25.550577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72586684-3177-4084-9bd4-038c5054d187 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:25.604976 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-72586684-3177-4084-9bd4-038c5054d187 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.117488 Aug 23 18:11:25.606344 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2143/4200] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:11:25 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:25.691771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a7a1beee-9043-4159-a7e0-d059d8adfbe4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:25.702177 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a7a1beee-9043-4159-a7e0-d059d8adfbe4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.289699 Aug 23 18:11:25.703192 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2058/4201] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:25 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:25.762567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cf8d6d17-ce4e-4686-8d7f-15ce537f128e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:25.774752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cf8d6d17-ce4e-4686-8d7f-15ce537f128e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:25.779964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf8d6d17-ce4e-4686-8d7f-15ce537f128e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:25.783988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf8d6d17-ce4e-4686-8d7f-15ce537f128e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:25.783988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf8d6d17-ce4e-4686-8d7f-15ce537f128e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:25.783988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf8d6d17-ce4e-4686-8d7f-15ce537f128e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:25.783988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf8d6d17-ce4e-4686-8d7f-15ce537f128e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:25.783988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf8d6d17-ce4e-4686-8d7f-15ce537f128e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:25.947716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cf8d6d17-ce4e-4686-8d7f-15ce537f128e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:25.965232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cf8d6d17-ce4e-4686-8d7f-15ce537f128e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:25.968505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cf8d6d17-ce4e-4686-8d7f-15ce537f128e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:25.971159 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cf8d6d17-ce4e-4686-8d7f-15ce537f128e tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.212747 Aug 23 18:11:25.972252 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2144/4202] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:25 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:26.162177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8c10c4bd-f94a-4196-add8-45d727e45c9f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:26.166791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8c10c4bd-f94a-4196-add8-45d727e45c9f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:26.169080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:26.182390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c10c4bd-f94a-4196-add8-45d727e45c9f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.183085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c10c4bd-f94a-4196-add8-45d727e45c9f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.183643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c10c4bd-f94a-4196-add8-45d727e45c9f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:26.184495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c10c4bd-f94a-4196-add8-45d727e45c9f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.188617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c10c4bd-f94a-4196-add8-45d727e45c9f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.189221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c10c4bd-f94a-4196-add8-45d727e45c9f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:26.472270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8c10c4bd-f94a-4196-add8-45d727e45c9f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:26.485884 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8c10c4bd-f94a-4196-add8-45d727e45c9f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1669 microversion: 2.1 time: 0.326395 Aug 23 18:11:26.507009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:26.508278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:26.508728 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2059/4203] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:26 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1669 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:26.514843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fcca526e-78fb-45db-b313-1ee82bd39377 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:26.515706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fcca526e-78fb-45db-b313-1ee82bd39377 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:26.520347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.523529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.524243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:26.525207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.526431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.527135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:26.535507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcca526e-78fb-45db-b313-1ee82bd39377 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.540954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcca526e-78fb-45db-b313-1ee82bd39377 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.541932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcca526e-78fb-45db-b313-1ee82bd39377 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:26.542997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcca526e-78fb-45db-b313-1ee82bd39377 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.543608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcca526e-78fb-45db-b313-1ee82bd39377 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.544336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcca526e-78fb-45db-b313-1ee82bd39377 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:26.599957 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fcca526e-78fb-45db-b313-1ee82bd39377 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75/ips" status: 200 len: 179 microversion: 2.1 time: 0.089953 Aug 23 18:11:26.607477 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2060/4204] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:11:26 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75/ips => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:26.613991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a4321ae4-8893-450f-be1a-9beafb2e5c84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:26.614442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.614970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.615377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a4321ae4-8893-450f-be1a-9beafb2e5c84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:26.615506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:26.615865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lazy-loading 'fault' on Instance uuid fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:11:26.622821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4321ae4-8893-450f-be1a-9beafb2e5c84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.623596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4321ae4-8893-450f-be1a-9beafb2e5c84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.624219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4321ae4-8893-450f-be1a-9beafb2e5c84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:26.626070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4321ae4-8893-450f-be1a-9beafb2e5c84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.626902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4321ae4-8893-450f-be1a-9beafb2e5c84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.628413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4321ae4-8893-450f-be1a-9beafb2e5c84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:26.663148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a4321ae4-8893-450f-be1a-9beafb2e5c84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:11:26.782014 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a4321ae4-8893-450f-be1a-9beafb2e5c84 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 204 len: 0 microversion: 2.1 time: 0.172429 Aug 23 18:11:26.787219 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2061/4205] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:11:26 2022] DELETE /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:11:26.797577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cb3b415b-ce02-4b4e-a9e5-c404e13e00a9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:26.800872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cb3b415b-ce02-4b4e-a9e5-c404e13e00a9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:26.809113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3b415b-ce02-4b4e-a9e5-c404e13e00a9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.809879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3b415b-ce02-4b4e-a9e5-c404e13e00a9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.810521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3b415b-ce02-4b4e-a9e5-c404e13e00a9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:26.811521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3b415b-ce02-4b4e-a9e5-c404e13e00a9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.812147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3b415b-ce02-4b4e-a9e5-c404e13e00a9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.813303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3b415b-ce02-4b4e-a9e5-c404e13e00a9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:26.854086 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cb3b415b-ce02-4b4e-a9e5-c404e13e00a9 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064289 Aug 23 18:11:26.854967 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2062/4206] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:11:26 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:26.861186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f175ecef-e47e-4836-a719-9be3259ae8fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:26.862217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f175ecef-e47e-4836-a719-9be3259ae8fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:26.869379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f175ecef-e47e-4836-a719-9be3259ae8fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.870234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f175ecef-e47e-4836-a719-9be3259ae8fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.871102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f175ecef-e47e-4836-a719-9be3259ae8fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:26.872084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f175ecef-e47e-4836-a719-9be3259ae8fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:26.873048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f175ecef-e47e-4836-a719-9be3259ae8fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:26.873764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f175ecef-e47e-4836-a719-9be3259ae8fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:27.111501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f175ecef-e47e-4836-a719-9be3259ae8fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:27.122508 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f175ecef-e47e-4836-a719-9be3259ae8fa tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.265709 Aug 23 18:11:27.123142 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2063/4207] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:26 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:27.128291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e640d3cf-8bb7-4db2-bad5-d7b13f9917bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:27.129001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e640d3cf-8bb7-4db2-bad5-d7b13f9917bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:27.138675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e640d3cf-8bb7-4db2-bad5-d7b13f9917bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:27.139179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e640d3cf-8bb7-4db2-bad5-d7b13f9917bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:27.139625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e640d3cf-8bb7-4db2-bad5-d7b13f9917bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:27.140900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e640d3cf-8bb7-4db2-bad5-d7b13f9917bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:27.145847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e640d3cf-8bb7-4db2-bad5-d7b13f9917bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:27.146322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e640d3cf-8bb7-4db2-bad5-d7b13f9917bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:27.196552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed44000309354b61950aaabd6521bab1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0c32c51a6114dcf984888c230664e26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:27.210876 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d20b52df-b995-4e94-ad5a-60395c5596b9 tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 200 len: 1314 microversion: 2.1 time: 0.707589 Aug 23 18:11:27.214352 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2145/4208] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:26 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:27.224585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f274caa7-a932-4e24-9259-d982cb3400a3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:27.232941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f274caa7-a932-4e24-9259-d982cb3400a3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:27.246797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f274caa7-a932-4e24-9259-d982cb3400a3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:27.247660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f274caa7-a932-4e24-9259-d982cb3400a3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:27.248317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f274caa7-a932-4e24-9259-d982cb3400a3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:27.249229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f274caa7-a932-4e24-9259-d982cb3400a3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:27.251185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f274caa7-a932-4e24-9259-d982cb3400a3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:27.251832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f274caa7-a932-4e24-9259-d982cb3400a3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:27.388319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f274caa7-a932-4e24-9259-d982cb3400a3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:27.405397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f274caa7-a932-4e24-9259-d982cb3400a3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:27.410966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f274caa7-a932-4e24-9259-d982cb3400a3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:27.415239 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f274caa7-a932-4e24-9259-d982cb3400a3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.199322 Aug 23 18:11:27.426843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e640d3cf-8bb7-4db2-bad5-d7b13f9917bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:27.428142 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2146/4209] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:27 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:27.434341 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e640d3cf-8bb7-4db2-bad5-d7b13f9917bc tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1675 microversion: 2.1 time: 0.310018 Aug 23 18:11:27.448754 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2064/4210] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:27 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1675 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:27.868296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b19cbab7-b95b-4b4e-8274-1173aa0ed263 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:27.871500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b19cbab7-b95b-4b4e-8274-1173aa0ed263 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:27.889388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b19cbab7-b95b-4b4e-8274-1173aa0ed263 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:27.891273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b19cbab7-b95b-4b4e-8274-1173aa0ed263 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:27.892448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b19cbab7-b95b-4b4e-8274-1173aa0ed263 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:27.899226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b19cbab7-b95b-4b4e-8274-1173aa0ed263 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:27.900100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b19cbab7-b95b-4b4e-8274-1173aa0ed263 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:27.900790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b19cbab7-b95b-4b4e-8274-1173aa0ed263 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:27.974489 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b19cbab7-b95b-4b4e-8274-1173aa0ed263 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.111163 Aug 23 18:11:27.981850 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2147/4211] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:11:27 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments => generated 197 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:28.144891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-503d062d-3eb5-4051-a2d9-619f8c667411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:28.145621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-503d062d-3eb5-4051-a2d9-619f8c667411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:28.159823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-503d062d-3eb5-4051-a2d9-619f8c667411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:28.160352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-503d062d-3eb5-4051-a2d9-619f8c667411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:28.160804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-503d062d-3eb5-4051-a2d9-619f8c667411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:28.165973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-503d062d-3eb5-4051-a2d9-619f8c667411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:28.167483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-503d062d-3eb5-4051-a2d9-619f8c667411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:28.171793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-503d062d-3eb5-4051-a2d9-619f8c667411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:28.242320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a125c7a7-2795-4727-ad7f-6502b1ff2a3e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:28.243164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a125c7a7-2795-4727-ad7f-6502b1ff2a3e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] [instance: fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:28.255111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a125c7a7-2795-4727-ad7f-6502b1ff2a3e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:28.255839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a125c7a7-2795-4727-ad7f-6502b1ff2a3e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:28.256363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a125c7a7-2795-4727-ad7f-6502b1ff2a3e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:28.258292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a125c7a7-2795-4727-ad7f-6502b1ff2a3e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:28.260079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a125c7a7-2795-4727-ad7f-6502b1ff2a3e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:28.262351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a125c7a7-2795-4727-ad7f-6502b1ff2a3e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:28.299171 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-a125c7a7-2795-4727-ad7f-6502b1ff2a3e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] HTTP exception thrown: Instance fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd could not be found. Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a125c7a7-2795-4727-ad7f-6502b1ff2a3e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Request method failure captured: Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd HTTP/1.1 Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRg1ld2XHb1I_rZ_WLN4rB30Lvhnq2j38UtCV2fWzq3_jw-8wEY1k22xhUBSN9yuaJDuC_SjdZP78vP9cuEf5BjPgXw2R2D2CHHrk0HUtJiKWiT9v7xOS1Lj0Fs8MIv7Mrqant0n5gM0GOYnwaLTFgfIOrV5gSunxLGaHRvX1NRenKc Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: c0c32c51a6114dcf984888c230664e26 Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-2005717141 Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c0c32c51a6114dcf984888c230664e26"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c0c32c51a6114dcf984888c230664e26"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c0c32c51a6114dcf984888c230664e26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c0c32c51a6114dcf984888c230664e26"}]}] Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-2005717141 Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: c0c32c51a6114dcf984888c230664e26 Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-2005717141 Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerAddressesNegativeTestJSON-2005717141-project Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: ed44000309354b61950aaabd6521bab1 Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-2005717141-project Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd could not be found. Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd'} Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd could not be found. Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd could not be found. Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:28.303119 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:28.307327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:28.307327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:28.307327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:28.307327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:28.307327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:28.307327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:28.307327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd could not be found. Aug 23 18:11:28.307327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:28.307327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a125c7a7-2795-4727-ad7f-6502b1ff2a3e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] Returning 404 to user: Instance fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:28.307327 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a125c7a7-2795-4727-ad7f-6502b1ff2a3e tempest-ServerAddressesNegativeTestJSON-2005717141 tempest-ServerAddressesNegativeTestJSON-2005717141-project] 10.222.0.61 "GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd" status: 404 len: 111 microversion: 2.1 time: 0.067099 Aug 23 18:11:28.319772 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2148/4212] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:28 2022] GET /compute/v2.1/servers/fb8fb98a-c9f5-4cd6-80bb-b0538d1883cd => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:11:28.443203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0fb1e6bc-757c-46cb-ad42-289c61b78f07 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:28.443956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0fb1e6bc-757c-46cb-ad42-289c61b78f07 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:28.455738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fb1e6bc-757c-46cb-ad42-289c61b78f07 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:28.456258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fb1e6bc-757c-46cb-ad42-289c61b78f07 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:28.460701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fb1e6bc-757c-46cb-ad42-289c61b78f07 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:28.462350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fb1e6bc-757c-46cb-ad42-289c61b78f07 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:28.462883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fb1e6bc-757c-46cb-ad42-289c61b78f07 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:28.463332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fb1e6bc-757c-46cb-ad42-289c61b78f07 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:28.726054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0fb1e6bc-757c-46cb-ad42-289c61b78f07 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:28.747413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0fb1e6bc-757c-46cb-ad42-289c61b78f07 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:28.761465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-503d062d-3eb5-4051-a2d9-619f8c667411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:28.761967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0fb1e6bc-757c-46cb-ad42-289c61b78f07 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:28.764042 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0fb1e6bc-757c-46cb-ad42-289c61b78f07 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.326061 Aug 23 18:11:28.775604 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2149/4213] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:28 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:28.775770 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-503d062d-3eb5-4051-a2d9-619f8c667411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.634918 Aug 23 18:11:28.785511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-425e30e7-b803-4363-ac60-a1d814144610 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:28.785511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-425e30e7-b803-4363-ac60-a1d814144610 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:28.790941 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2065/4214] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:28 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:28.791196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-425e30e7-b803-4363-ac60-a1d814144610 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:28.791703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-425e30e7-b803-4363-ac60-a1d814144610 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:28.792145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-425e30e7-b803-4363-ac60-a1d814144610 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:28.792910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-425e30e7-b803-4363-ac60-a1d814144610 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:28.793373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-425e30e7-b803-4363-ac60-a1d814144610 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:28.796133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-425e30e7-b803-4363-ac60-a1d814144610 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:29.001725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96aa064a-fa44-43f7-a47b-1c1e489eb00c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:29.026347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-96aa064a-fa44-43f7-a47b-1c1e489eb00c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:29.038372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96aa064a-fa44-43f7-a47b-1c1e489eb00c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:29.039442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96aa064a-fa44-43f7-a47b-1c1e489eb00c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:29.040115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96aa064a-fa44-43f7-a47b-1c1e489eb00c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:29.041674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96aa064a-fa44-43f7-a47b-1c1e489eb00c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:29.042352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96aa064a-fa44-43f7-a47b-1c1e489eb00c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:29.043728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96aa064a-fa44-43f7-a47b-1c1e489eb00c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:29.103648 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-96aa064a-fa44-43f7-a47b-1c1e489eb00c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120504 Aug 23 18:11:29.113707 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2066/4215] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:11:28 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:11:29.186903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-425e30e7-b803-4363-ac60-a1d814144610 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:29.192366 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-425e30e7-b803-4363-ac60-a1d814144610 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1675 microversion: 2.1 time: 0.419241 Aug 23 18:11:29.198822 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2150/4216] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:28 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1675 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:29.797637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e182e91c-2f38-459e-a2e5-653aa71f18a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:29.798258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e182e91c-2f38-459e-a2e5-653aa71f18a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:29.798741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4525c017-2638-44a4-8815-9f65e68892b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:29.799496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4525c017-2638-44a4-8815-9f65e68892b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:29.801399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:29.814101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e182e91c-2f38-459e-a2e5-653aa71f18a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:29.814526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e182e91c-2f38-459e-a2e5-653aa71f18a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:29.815287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e182e91c-2f38-459e-a2e5-653aa71f18a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:29.816085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e182e91c-2f38-459e-a2e5-653aa71f18a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:29.816549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e182e91c-2f38-459e-a2e5-653aa71f18a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:29.816980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e182e91c-2f38-459e-a2e5-653aa71f18a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:29.824371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4525c017-2638-44a4-8815-9f65e68892b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:29.824893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4525c017-2638-44a4-8815-9f65e68892b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:29.825348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4525c017-2638-44a4-8815-9f65e68892b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:29.826085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4525c017-2638-44a4-8815-9f65e68892b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:29.826568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4525c017-2638-44a4-8815-9f65e68892b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:29.827015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4525c017-2638-44a4-8815-9f65e68892b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:29.892168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:29.960912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4525c017-2638-44a4-8815-9f65e68892b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:29.982733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4525c017-2638-44a4-8815-9f65e68892b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:29.989549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4525c017-2638-44a4-8815-9f65e68892b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:29.992624 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4525c017-2638-44a4-8815-9f65e68892b3 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.202848 Aug 23 18:11:29.993222 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2067/4217] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:29 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:30.116600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b02a4717-264f-45b4-9c86-3fb1f81ff57d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:30.119158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b02a4717-264f-45b4-9c86-3fb1f81ff57d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:30.139012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b02a4717-264f-45b4-9c86-3fb1f81ff57d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:30.139548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b02a4717-264f-45b4-9c86-3fb1f81ff57d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:30.142278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b02a4717-264f-45b4-9c86-3fb1f81ff57d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:30.143386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b02a4717-264f-45b4-9c86-3fb1f81ff57d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:30.143583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b02a4717-264f-45b4-9c86-3fb1f81ff57d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:30.144148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b02a4717-264f-45b4-9c86-3fb1f81ff57d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:30.245332 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b02a4717-264f-45b4-9c86-3fb1f81ff57d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133326 Aug 23 18:11:30.253280 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2068/4218] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:11:30 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:11:30.264655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-29428cd5-dcb7-4170-a257-f4f4b80d409f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:30.265343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-29428cd5-dcb7-4170-a257-f4f4b80d409f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:30.283006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29428cd5-dcb7-4170-a257-f4f4b80d409f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:30.283524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29428cd5-dcb7-4170-a257-f4f4b80d409f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:30.283972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29428cd5-dcb7-4170-a257-f4f4b80d409f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:30.285468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29428cd5-dcb7-4170-a257-f4f4b80d409f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:30.285959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29428cd5-dcb7-4170-a257-f4f4b80d409f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:30.286444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29428cd5-dcb7-4170-a257-f4f4b80d409f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:30.332773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e182e91c-2f38-459e-a2e5-653aa71f18a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:30.347741 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e182e91c-2f38-459e-a2e5-653aa71f18a6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.550305 Aug 23 18:11:30.348642 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2151/4219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:29 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:30.747971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6a67978b-4343-4400-a868-ee0d041b73a6 req-3e97ce7b-7a8c-4915-a600-9d4fcd6bd3dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75", "name": "network-vif-deleted", "tag": "e096e09e-b1c2-4dc0-a75f-934bb26df03f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:30.786209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6a67978b-4343-4400-a868-ee0d041b73a6 req-3e97ce7b-7a8c-4915-a600-9d4fcd6bd3dc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:30.788626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6a67978b-4343-4400-a868-ee0d041b73a6 req-3e97ce7b-7a8c-4915-a600-9d4fcd6bd3dc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:30.789840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6a67978b-4343-4400-a868-ee0d041b73a6 req-3e97ce7b-7a8c-4915-a600-9d4fcd6bd3dc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:30.836434 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6a67978b-4343-4400-a868-ee0d041b73a6 req-3e97ce7b-7a8c-4915-a600-9d4fcd6bd3dc service nova] Creating event network-vif-deleted:e096e09e-b1c2-4dc0-a75f-934bb26df03f for instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 on n-h1-850468-16 Aug 23 18:11:30.848303 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6a67978b-4343-4400-a868-ee0d041b73a6 req-3e97ce7b-7a8c-4915-a600-9d4fcd6bd3dc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104829 Aug 23 18:11:30.851080 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2152/4220] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:11:31.018114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-17d5c77c-f59c-4654-a7c5-bf3bea33849f tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:31.019128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-17d5c77c-f59c-4654-a7c5-bf3bea33849f tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:31.054419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d5c77c-f59c-4654-a7c5-bf3bea33849f tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:31.054419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d5c77c-f59c-4654-a7c5-bf3bea33849f tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:31.054791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d5c77c-f59c-4654-a7c5-bf3bea33849f tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:31.058116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d5c77c-f59c-4654-a7c5-bf3bea33849f tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:31.063202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d5c77c-f59c-4654-a7c5-bf3bea33849f tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:31.063820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d5c77c-f59c-4654-a7c5-bf3bea33849f tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:31.090202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-29428cd5-dcb7-4170-a257-f4f4b80d409f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:31.103743 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-29428cd5-dcb7-4170-a257-f4f4b80d409f tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1654 microversion: 2.1 time: 0.849231 Aug 23 18:11:31.104331 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2069/4221] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:30 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1654 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:31.252271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-17d5c77c-f59c-4654-a7c5-bf3bea33849f tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:31.261577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-52e16dc0-04fa-4fa8-ba13-bddb10012aef tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:31.264807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-52e16dc0-04fa-4fa8-ba13-bddb10012aef tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:31.266730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:31.273841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-17d5c77c-f59c-4654-a7c5-bf3bea33849f tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:31.275418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-17d5c77c-f59c-4654-a7c5-bf3bea33849f tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:31.287954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52e16dc0-04fa-4fa8-ba13-bddb10012aef tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:31.288783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52e16dc0-04fa-4fa8-ba13-bddb10012aef tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:31.289552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52e16dc0-04fa-4fa8-ba13-bddb10012aef tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:31.291194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52e16dc0-04fa-4fa8-ba13-bddb10012aef tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:31.291578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52e16dc0-04fa-4fa8-ba13-bddb10012aef tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:31.292288 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-17d5c77c-f59c-4654-a7c5-bf3bea33849f tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.280012 Aug 23 18:11:31.292412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52e16dc0-04fa-4fa8-ba13-bddb10012aef tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:31.293244 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2153/4222] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:31 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:11:31.372234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-697aba74-2af4-4b96-a2f8-fe6c6da91e52 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:31.373115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-697aba74-2af4-4b96-a2f8-fe6c6da91e52 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:31.391311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-697aba74-2af4-4b96-a2f8-fe6c6da91e52 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:31.398457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-697aba74-2af4-4b96-a2f8-fe6c6da91e52 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:31.402971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-697aba74-2af4-4b96-a2f8-fe6c6da91e52 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:31.407580 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-52e16dc0-04fa-4fa8-ba13-bddb10012aef tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145758 Aug 23 18:11:31.412439 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2070/4223] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:11:31 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments => generated 197 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:31.412632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-697aba74-2af4-4b96-a2f8-fe6c6da91e52 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:31.412632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-697aba74-2af4-4b96-a2f8-fe6c6da91e52 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:31.412632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-697aba74-2af4-4b96-a2f8-fe6c6da91e52 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:31.812493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-697aba74-2af4-4b96-a2f8-fe6c6da91e52 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:31.823454 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-697aba74-2af4-4b96-a2f8-fe6c6da91e52 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.457702 Aug 23 18:11:31.842784 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2154/4224] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:31 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:11:32.127435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d00a101-b01e-487d-818d-b0983a2822b9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:32.128290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d00a101-b01e-487d-818d-b0983a2822b9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:32.143317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d00a101-b01e-487d-818d-b0983a2822b9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:32.144106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d00a101-b01e-487d-818d-b0983a2822b9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:32.146656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d00a101-b01e-487d-818d-b0983a2822b9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:32.147739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d00a101-b01e-487d-818d-b0983a2822b9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:32.148573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d00a101-b01e-487d-818d-b0983a2822b9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:32.149283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d00a101-b01e-487d-818d-b0983a2822b9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:32.321687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7892b1eb-7857-497b-9439-9ffeb8d6a934 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:32.322645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7892b1eb-7857-497b-9439-9ffeb8d6a934 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:32.334472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7892b1eb-7857-497b-9439-9ffeb8d6a934 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:32.335003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7892b1eb-7857-497b-9439-9ffeb8d6a934 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:32.335444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7892b1eb-7857-497b-9439-9ffeb8d6a934 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:32.336153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7892b1eb-7857-497b-9439-9ffeb8d6a934 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:32.340078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7892b1eb-7857-497b-9439-9ffeb8d6a934 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:32.340801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7892b1eb-7857-497b-9439-9ffeb8d6a934 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:32.500426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7892b1eb-7857-497b-9439-9ffeb8d6a934 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:32.519240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7892b1eb-7857-497b-9439-9ffeb8d6a934 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:32.520902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7892b1eb-7857-497b-9439-9ffeb8d6a934 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:32.523893 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7892b1eb-7857-497b-9439-9ffeb8d6a934 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.206520 Aug 23 18:11:32.524486 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2155/4225] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:32 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:32.538507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-65436607-3825-44f3-a20f-8e9d780ff431 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:32.545736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-65436607-3825-44f3-a20f-8e9d780ff431 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:32.553794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65436607-3825-44f3-a20f-8e9d780ff431 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:32.554308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65436607-3825-44f3-a20f-8e9d780ff431 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:32.554814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65436607-3825-44f3-a20f-8e9d780ff431 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:32.555545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65436607-3825-44f3-a20f-8e9d780ff431 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:32.556007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65436607-3825-44f3-a20f-8e9d780ff431 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:32.556538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65436607-3825-44f3-a20f-8e9d780ff431 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:32.652014 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-65436607-3825-44f3-a20f-8e9d780ff431 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126351 Aug 23 18:11:32.653105 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2156/4226] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:11:32 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments => generated 197 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:32.852638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4a2cd088-b8ac-4e9f-8d7f-65f53b178ac6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:32.853283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4a2cd088-b8ac-4e9f-8d7f-65f53b178ac6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:32.872425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a2cd088-b8ac-4e9f-8d7f-65f53b178ac6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:32.872914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a2cd088-b8ac-4e9f-8d7f-65f53b178ac6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:32.873363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a2cd088-b8ac-4e9f-8d7f-65f53b178ac6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:32.874100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a2cd088-b8ac-4e9f-8d7f-65f53b178ac6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:32.874575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a2cd088-b8ac-4e9f-8d7f-65f53b178ac6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:32.875635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a2cd088-b8ac-4e9f-8d7f-65f53b178ac6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:33.216179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4a2cd088-b8ac-4e9f-8d7f-65f53b178ac6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:33.228766 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4a2cd088-b8ac-4e9f-8d7f-65f53b178ac6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.380144 Aug 23 18:11:33.229872 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2157/4227] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:32 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:33.245679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-9412eb15-5c1b-4f96-8499-1301dd0ec77e req-3a72326c-e28a-460a-be4e-5bfd52c67afb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75", "name": "network-vif-deleted", "tag": "6bbe04dd-e186-40e2-9354-48726f413eb2"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:33.259046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6d00a101-b01e-487d-818d-b0983a2822b9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '673168b77fc84b9e93cccc69a6cb5948', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '91018678aa474eee8e5f6c5249ec012e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:33.276924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9412eb15-5c1b-4f96-8499-1301dd0ec77e req-3a72326c-e28a-460a-be4e-5bfd52c67afb service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:33.278804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9412eb15-5c1b-4f96-8499-1301dd0ec77e req-3a72326c-e28a-460a-be4e-5bfd52c67afb service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:33.279261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9412eb15-5c1b-4f96-8499-1301dd0ec77e req-3a72326c-e28a-460a-be4e-5bfd52c67afb service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:33.293270 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-9412eb15-5c1b-4f96-8499-1301dd0ec77e req-3a72326c-e28a-460a-be4e-5bfd52c67afb service nova] Creating event network-vif-deleted:6bbe04dd-e186-40e2-9354-48726f413eb2 for instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 on n-h1-850468-16 Aug 23 18:11:33.294968 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d00a101-b01e-487d-818d-b0983a2822b9 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 200 len: 1496 microversion: 2.1 time: 1.170714 Aug 23 18:11:33.299425 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2071/4228] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:32 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 1496 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:33.299601 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-9412eb15-5c1b-4f96-8499-1301dd0ec77e req-3a72326c-e28a-460a-be4e-5bfd52c67afb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064083 Aug 23 18:11:33.300538 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2158/4229] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:33.551925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-89ff1222-754b-47da-a84a-3c42d7fbff57 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:33.553198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-89ff1222-754b-47da-a84a-3c42d7fbff57 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:33.564271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89ff1222-754b-47da-a84a-3c42d7fbff57 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:33.565378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89ff1222-754b-47da-a84a-3c42d7fbff57 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:33.566096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89ff1222-754b-47da-a84a-3c42d7fbff57 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:33.567220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89ff1222-754b-47da-a84a-3c42d7fbff57 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:33.568655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89ff1222-754b-47da-a84a-3c42d7fbff57 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:33.569319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89ff1222-754b-47da-a84a-3c42d7fbff57 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:33.665895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2319b7a1-97ea-4f6e-a710-41e8c1846a23 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:33.674010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2319b7a1-97ea-4f6e-a710-41e8c1846a23 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:33.699717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2319b7a1-97ea-4f6e-a710-41e8c1846a23 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:33.700426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2319b7a1-97ea-4f6e-a710-41e8c1846a23 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:33.701255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2319b7a1-97ea-4f6e-a710-41e8c1846a23 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:33.702191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2319b7a1-97ea-4f6e-a710-41e8c1846a23 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:33.702956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2319b7a1-97ea-4f6e-a710-41e8c1846a23 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:33.703548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2319b7a1-97ea-4f6e-a710-41e8c1846a23 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:33.820106 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2319b7a1-97ea-4f6e-a710-41e8c1846a23 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155831 Aug 23 18:11:33.826957 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2159/4230] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:11:33 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments => generated 197 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:33.873344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-89ff1222-754b-47da-a84a-3c42d7fbff57 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:33.888336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-89ff1222-754b-47da-a84a-3c42d7fbff57 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:33.889883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-89ff1222-754b-47da-a84a-3c42d7fbff57 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:33.893856 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-89ff1222-754b-47da-a84a-3c42d7fbff57 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.349679 Aug 23 18:11:33.894467 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2072/4231] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:33 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:34.192241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9b71903d-7b10-4f99-93b7-ae86f77acf7e tempest-FloatingIPDetailsNegativeTestJSON-547748215 tempest-FloatingIPDetailsNegativeTestJSON-547748215-project] Calling method '.version_select at 0x7f27dfa92700>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:34.254118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e1da5658-48ba-43ec-ad08-d9bd1637a956 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:34.255308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e1da5658-48ba-43ec-ad08-d9bd1637a956 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:34.272212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1da5658-48ba-43ec-ad08-d9bd1637a956 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:34.276205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1da5658-48ba-43ec-ad08-d9bd1637a956 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:34.277185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1da5658-48ba-43ec-ad08-d9bd1637a956 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:34.278249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1da5658-48ba-43ec-ad08-d9bd1637a956 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:34.278981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1da5658-48ba-43ec-ad08-d9bd1637a956 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:34.286471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1da5658-48ba-43ec-ad08-d9bd1637a956 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:34.316273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG neutronclient.v2_0.client [None req-9b71903d-7b10-4f99-93b7-ae86f77acf7e tempest-FloatingIPDetailsNegativeTestJSON-547748215 tempest-FloatingIPDetailsNegativeTestJSON-547748215-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 9605866e-c8f1-4573-8e12-adf7f64c7985 could not be found", "detail": ""}} {{(pid=128808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:11:34.318098 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-9b71903d-7b10-4f99-93b7-ae86f77acf7e tempest-FloatingIPDetailsNegativeTestJSON-547748215 tempest-FloatingIPDetailsNegativeTestJSON-547748215-project] HTTP exception thrown: Floating IP not found for ID 9605866e-c8f1-4573-8e12-adf7f64c7985 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9b71903d-7b10-4f99-93b7-ae86f77acf7e tempest-FloatingIPDetailsNegativeTestJSON-547748215 tempest-FloatingIPDetailsNegativeTestJSON-547748215-project] Request method failure captured: Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-floating-ips/9605866e-c8f1-4573-8e12-adf7f64c7985 HTTP/1.1 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRhVs8rR6pW1o1cOWqQN8pBrjSQPVAw7KX0l2HiBRjfVR5HnkmJcXOPKTtOecsSzgBXiZBlAcjSZM5cLx-tTTLFUvn-nFTfohh1cS2HZ6Mp5MGjQLb6P45RLNMuwB-Eu7Ekqco9GWzt3RO5vv0VV-fVzoRflt7C78p66LS-FFP33ylE Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ab6a6a2cdbc441049acdef8b5773eae8 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-547748215 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ab6a6a2cdbc441049acdef8b5773eae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab6a6a2cdbc441049acdef8b5773eae8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ab6a6a2cdbc441049acdef8b5773eae8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ab6a6a2cdbc441049acdef8b5773eae8"}]}] Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-547748215 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ab6a6a2cdbc441049acdef8b5773eae8 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-547748215 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-547748215-project Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 7e54d7a97e704d2abd542399e101ca51 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-547748215-project Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: exception: Floating IP not found for ID 9605866e-c8f1-4573-8e12-adf7f64c7985 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '9605866e-c8f1-4573-8e12-adf7f64c7985'} Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1006, in show_floatingip Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 9605866e-c8f1-4573-8e12-adf7f64c7985 could not be found Aug 23 18:11:34.342058 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4caac68f-f076-47bf-bfe3-0395a6fbe786'] Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2830, in get_floating_ip Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 9605866e-c8f1-4573-8e12-adf7f64c7985. Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 9605866e-c8f1-4573-8e12-adf7f64c7985 Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 9605866e-c8f1-4573-8e12-adf7f64c7985 Aug 23 18:11:34.346070 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:34.350056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9b71903d-7b10-4f99-93b7-ae86f77acf7e tempest-FloatingIPDetailsNegativeTestJSON-547748215 tempest-FloatingIPDetailsNegativeTestJSON-547748215-project] Returning 404 to user: Floating IP not found for ID 9605866e-c8f1-4573-8e12-adf7f64c7985 {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:34.351886 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9b71903d-7b10-4f99-93b7-ae86f77acf7e tempest-FloatingIPDetailsNegativeTestJSON-547748215 tempest-FloatingIPDetailsNegativeTestJSON-547748215-project] 10.222.0.61 "GET /compute/v2.1/os-floating-ips/9605866e-c8f1-4573-8e12-adf7f64c7985" status: 404 len: 111 microversion: 2.1 time: 0.431407 Aug 23 18:11:34.353084 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2160/4232] 10.222.0.61 () {58 vars in 1260 bytes} [Tue Aug 23 18:11:33 2022] GET /compute/v2.1/os-floating-ips/9605866e-c8f1-4573-8e12-adf7f64c7985 => generated 111 bytes in 433 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:11:34.377847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-25917b3a-24b4-41e3-a551-628d17bc98e5 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:34.378848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-25917b3a-24b4-41e3-a551-628d17bc98e5 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:34.403266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25917b3a-24b4-41e3-a551-628d17bc98e5 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:34.404076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25917b3a-24b4-41e3-a551-628d17bc98e5 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:34.404709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25917b3a-24b4-41e3-a551-628d17bc98e5 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:34.405677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25917b3a-24b4-41e3-a551-628d17bc98e5 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:34.406368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25917b3a-24b4-41e3-a551-628d17bc98e5 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:34.406990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25917b3a-24b4-41e3-a551-628d17bc98e5 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:34.441567 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-25917b3a-24b4-41e3-a551-628d17bc98e5 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] HTTP exception thrown: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-25917b3a-24b4-41e3-a551-628d17bc98e5 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Request method failure captured: Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 HTTP/1.1 Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRfyiVGnTCBtRVmoVs-_pg0U-0JJ9US3NAlEh6Onz1hZxb4CipSXHpqhhDWdq0qs6UkOK7r4BhIYUJ28Ia7HwRS2AoSrV2elPenEDh5yVl_2lteRfNMYNz12S1fymE_gp6Mq1ab4cFx4kcyrvB7um1XM6ADjtgY7ev9wN2KEfBI8Fu0 Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 91018678aa474eee8e5f6c5249ec012e Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/91018678aa474eee8e5f6c5249ec012e"}]}] Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 91018678aa474eee8e5f6c5249ec012e Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestMultiNic-197890916-project Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 673168b77fc84b9e93cccc69a6cb5948 Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestMultiNic-197890916-project Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75'} Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:34.444110 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:34.447710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:34.447710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:34.447710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:34.447710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:34.447710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:34.447710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:34.447710 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:34.449737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-25917b3a-24b4-41e3-a551-628d17bc98e5 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Returning 404 to user: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:34.450922 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-25917b3a-24b4-41e3-a551-628d17bc98e5 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 404 len: 111 microversion: 2.1 time: 0.096707 Aug 23 18:11:34.456350 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2161/4233] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:34 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:11:34.830169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e1da5658-48ba-43ec-ad08-d9bd1637a956 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:34.834355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-232be451-e9db-4fdd-9d8e-5fd07676fe10 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:34.837616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-232be451-e9db-4fdd-9d8e-5fd07676fe10 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:34.855796 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e1da5658-48ba-43ec-ad08-d9bd1637a956 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.606696 Aug 23 18:11:34.860956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-232be451-e9db-4fdd-9d8e-5fd07676fe10 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:34.863562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-232be451-e9db-4fdd-9d8e-5fd07676fe10 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:34.864251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-232be451-e9db-4fdd-9d8e-5fd07676fe10 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:34.866107 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2073/4234] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:34 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:11:34.867181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-232be451-e9db-4fdd-9d8e-5fd07676fe10 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:34.867902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-232be451-e9db-4fdd-9d8e-5fd07676fe10 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:34.870892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-232be451-e9db-4fdd-9d8e-5fd07676fe10 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:34.921162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f8a2e082-ba5f-4ab3-98f2-318ae0c760ea tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:34.922567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f8a2e082-ba5f-4ab3-98f2-318ae0c760ea tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:34.933898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8a2e082-ba5f-4ab3-98f2-318ae0c760ea tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:34.949500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8a2e082-ba5f-4ab3-98f2-318ae0c760ea tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:34.950192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8a2e082-ba5f-4ab3-98f2-318ae0c760ea tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:34.958468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8a2e082-ba5f-4ab3-98f2-318ae0c760ea tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:34.959005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8a2e082-ba5f-4ab3-98f2-318ae0c760ea tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:34.959454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8a2e082-ba5f-4ab3-98f2-318ae0c760ea tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:34.992969 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-232be451-e9db-4fdd-9d8e-5fd07676fe10 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.157519 Aug 23 18:11:34.997807 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2162/4235] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:11:34 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments => generated 197 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:11:35.142155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f8a2e082-ba5f-4ab3-98f2-318ae0c760ea tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:35.158784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f8a2e082-ba5f-4ab3-98f2-318ae0c760ea tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:35.161384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f8a2e082-ba5f-4ab3-98f2-318ae0c760ea tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:35.162999 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f8a2e082-ba5f-4ab3-98f2-318ae0c760ea tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.246652 Aug 23 18:11:35.164443 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2074/4236] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:34 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:11:35.883150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-763be078-bbb4-40e6-a206-2913fbbb9cdc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:35.883766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-763be078-bbb4-40e6-a206-2913fbbb9cdc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:35.906831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-763be078-bbb4-40e6-a206-2913fbbb9cdc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:35.907747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-763be078-bbb4-40e6-a206-2913fbbb9cdc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:35.908505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-763be078-bbb4-40e6-a206-2913fbbb9cdc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:35.909401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-763be078-bbb4-40e6-a206-2913fbbb9cdc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:35.910029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-763be078-bbb4-40e6-a206-2913fbbb9cdc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:35.911219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-763be078-bbb4-40e6-a206-2913fbbb9cdc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:36.005733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9867d1e8-a41c-4c0a-8815-5c7b843e45aa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:36.016889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9867d1e8-a41c-4c0a-8815-5c7b843e45aa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:36.037702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9867d1e8-a41c-4c0a-8815-5c7b843e45aa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:36.038207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9867d1e8-a41c-4c0a-8815-5c7b843e45aa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:36.054979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9867d1e8-a41c-4c0a-8815-5c7b843e45aa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:36.055961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9867d1e8-a41c-4c0a-8815-5c7b843e45aa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:36.056456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9867d1e8-a41c-4c0a-8815-5c7b843e45aa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:36.057861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9867d1e8-a41c-4c0a-8815-5c7b843e45aa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:36.135611 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9867d1e8-a41c-4c0a-8815-5c7b843e45aa tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.133880 Aug 23 18:11:36.138588 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2075/4237] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:11:36 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:36.194484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-98e64202-a1c4-4276-883b-f7359e3a8520 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:36.195860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-98e64202-a1c4-4276-883b-f7359e3a8520 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:36.212607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98e64202-a1c4-4276-883b-f7359e3a8520 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:36.213387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98e64202-a1c4-4276-883b-f7359e3a8520 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:36.214005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98e64202-a1c4-4276-883b-f7359e3a8520 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:36.214947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98e64202-a1c4-4276-883b-f7359e3a8520 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:36.215833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98e64202-a1c4-4276-883b-f7359e3a8520 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:36.216735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-98e64202-a1c4-4276-883b-f7359e3a8520 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:36.619634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-98e64202-a1c4-4276-883b-f7359e3a8520 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:36.633477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-98e64202-a1c4-4276-883b-f7359e3a8520 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:36.637951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-98e64202-a1c4-4276-883b-f7359e3a8520 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:36.639279 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-98e64202-a1c4-4276-883b-f7359e3a8520 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.450192 Aug 23 18:11:36.642111 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2076/4238] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:36 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:36.768082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-763be078-bbb4-40e6-a206-2913fbbb9cdc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:36.785026 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-763be078-bbb4-40e6-a206-2913fbbb9cdc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.905786 Aug 23 18:11:36.789035 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2163/4239] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:35 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:36.980021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c78c1651-158a-4a27-88cd-ee4b9aa3f3ab tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5732a99-229c-4933-b4a0-b1b1856b7a39", "device": "/dev/sdb"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:36.983184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c78c1651-158a-4a27-88cd-ee4b9aa3f3ab tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:37.004873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c78c1651-158a-4a27-88cd-ee4b9aa3f3ab tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.005678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c78c1651-158a-4a27-88cd-ee4b9aa3f3ab tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.009754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c78c1651-158a-4a27-88cd-ee4b9aa3f3ab tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.013826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c78c1651-158a-4a27-88cd-ee4b9aa3f3ab tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.014516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c78c1651-158a-4a27-88cd-ee4b9aa3f3ab tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.027114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c78c1651-158a-4a27-88cd-ee4b9aa3f3ab tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.154742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6e3fefe-d9ca-4e06-95c7-bbb668d6a315 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:37.163095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6e3fefe-d9ca-4e06-95c7-bbb668d6a315 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:37.211198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6e3fefe-d9ca-4e06-95c7-bbb668d6a315 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.212130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6e3fefe-d9ca-4e06-95c7-bbb668d6a315 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.212666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6e3fefe-d9ca-4e06-95c7-bbb668d6a315 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.213428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6e3fefe-d9ca-4e06-95c7-bbb668d6a315 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.213893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6e3fefe-d9ca-4e06-95c7-bbb668d6a315 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.214323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6e3fefe-d9ca-4e06-95c7-bbb668d6a315 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.321062 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6e3fefe-d9ca-4e06-95c7-bbb668d6a315 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.176065 Aug 23 18:11:37.324205 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2164/4240] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:11:37 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569/os-volume_attachments => generated 25 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:11:37.479569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a06441d-9cbf-40e2-acc9-b605283b10cf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:37.482131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8a06441d-9cbf-40e2-acc9-b605283b10cf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:37.508069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a06441d-9cbf-40e2-acc9-b605283b10cf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.508903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a06441d-9cbf-40e2-acc9-b605283b10cf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.513954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a06441d-9cbf-40e2-acc9-b605283b10cf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.514827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a06441d-9cbf-40e2-acc9-b605283b10cf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.515638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a06441d-9cbf-40e2-acc9-b605283b10cf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.516534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a06441d-9cbf-40e2-acc9-b605283b10cf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.567377 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8a06441d-9cbf-40e2-acc9-b605283b10cf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] HTTP exception thrown: Cannot 'reboot' instance ed1a8703-4973-4c42-859a-5734d134f015 while it is in vm_state rescued Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a06441d-9cbf-40e2-acc9-b605283b10cf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Request method failure captured: Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015/action HTTP/1.1 Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 28 Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRbMS5n_NsGau0vnGI0iBrS85eKgyFW2-flo5AMEagzFwHXr8y830jIBRx2ycNUqbit5tulaOzYGG8jmEgWnoI2Kij-0Ap1FvDFmaX_VNZTOBEswqTbIxjk8xyB5l_Bmsy2gQs8ixm2uUwN9H5qHjYOcvdPlZGrIYQD4Gm01UoxEIk4 Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}] Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 283c529ff2774efca184740ad6ccfdd5 Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: {"reboot": {"type": "HARD"}} Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: exception: Cannot 'reboot' instance ed1a8703-4973-4c42-859a-5734d134f015 while it is in vm_state rescued Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'ed1a8703-4973-4c42-859a-5734d134f015', 'body': {'reboot': {'type': 'HARD'}}} Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3539, in reboot Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed1a8703-4973-4c42-859a-5734d134f015 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:11:37.570448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:11:37.574153 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance ed1a8703-4973-4c42-859a-5734d134f015 while it is in vm_state rescued Aug 23 18:11:37.574153 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:37.574153 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:37.574153 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:37.574153 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:37.574153 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:37.574153 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:37.574153 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:37.574153 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:37.574153 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance ed1a8703-4973-4c42-859a-5734d134f015 while it is in vm_state rescued Aug 23 18:11:37.574153 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:37.574153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a06441d-9cbf-40e2-acc9-b605283b10cf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Returning 409 to user: Cannot 'reboot' instance ed1a8703-4973-4c42-859a-5734d134f015 while it is in vm_state rescued {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:37.574993 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8a06441d-9cbf-40e2-acc9-b605283b10cf tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015/action" status: 409 len: 145 microversion: 2.1 time: 0.102243 Aug 23 18:11:37.580804 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2165/4241] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:11:37 2022] POST /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015/action => generated 145 bytes in 109 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:11:37.597077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04390271-d598-4a27-b2fb-bbe45af1f720 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:37.604794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-04390271-d598-4a27-b2fb-bbe45af1f720 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:37.625118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04390271-d598-4a27-b2fb-bbe45af1f720 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.626983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04390271-d598-4a27-b2fb-bbe45af1f720 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.627512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04390271-d598-4a27-b2fb-bbe45af1f720 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.631523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04390271-d598-4a27-b2fb-bbe45af1f720 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.632219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04390271-d598-4a27-b2fb-bbe45af1f720 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.633711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04390271-d598-4a27-b2fb-bbe45af1f720 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.723012 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-04390271-d598-4a27-b2fb-bbe45af1f720 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] HTTP exception thrown: Cannot 'rebuild' instance ed1a8703-4973-4c42-859a-5734d134f015 while it is in vm_state rescued Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04390271-d598-4a27-b2fb-bbe45af1f720 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Request method failure captured: Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015/action HTTP/1.1 Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 65 Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRbMS5n_NsGau0vnGI0iBrS85eKgyFW2-flo5AMEagzFwHXr8y830jIBRx2ycNUqbit5tulaOzYGG8jmEgWnoI2Kij-0Ap1FvDFmaX_VNZTOBEswqTbIxjk8xyB5l_Bmsy2gQs8ixm2uUwN9H5qHjYOcvdPlZGrIYQD4Gm01UoxEIk4 Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}] Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 283c529ff2774efca184740ad6ccfdd5 Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: exception: Cannot 'rebuild' instance ed1a8703-4973-4c42-859a-5734d134f015 while it is in vm_state rescued Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'ed1a8703-4973-4c42-859a-5734d134f015', 'body': {'rebuild': {'imageRef': '126e0038-c91e-4894-b027-98e76f88a186'}}} Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1220, in _action_rebuild Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ed1a8703-4973-4c42-859a-5734d134f015 in vm_state rescued. Cannot rebuild while the instance is in this state. Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:11:37.726156 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1228, in _action_rebuild Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance ed1a8703-4973-4c42-859a-5734d134f015 while it is in vm_state rescued Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance ed1a8703-4973-4c42-859a-5734d134f015 while it is in vm_state rescued Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:37.729555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04390271-d598-4a27-b2fb-bbe45af1f720 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Returning 409 to user: Cannot 'rebuild' instance ed1a8703-4973-4c42-859a-5734d134f015 while it is in vm_state rescued {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:37.731450 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-04390271-d598-4a27-b2fb-bbe45af1f720 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "POST /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015/action" status: 409 len: 146 microversion: 2.1 time: 0.147919 Aug 23 18:11:37.735473 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2166/4242] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:11:37 2022] POST /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015/action => generated 146 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:11:37.747959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c3569d34-6122-42ca-972f-c9e633520881 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:37.754423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c3569d34-6122-42ca-972f-c9e633520881 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:37.768543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3569d34-6122-42ca-972f-c9e633520881 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.769049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3569d34-6122-42ca-972f-c9e633520881 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.769492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3569d34-6122-42ca-972f-c9e633520881 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.770213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3569d34-6122-42ca-972f-c9e633520881 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.770691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3569d34-6122-42ca-972f-c9e633520881 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.771114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3569d34-6122-42ca-972f-c9e633520881 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.774632 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c78c1651-158a-4a27-88cd-ee4b9aa3f3ab tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "POST /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.803683 Aug 23 18:11:37.782599 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2077/4243] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:11:36 2022] POST /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509/os-volume_attachments => generated 194 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:37.794038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d53650b-321f-4cc9-9428-24fb1ea82845 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:37.794938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d53650b-321f-4cc9-9428-24fb1ea82845 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:37.827665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d53650b-321f-4cc9-9428-24fb1ea82845 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.829234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d53650b-321f-4cc9-9428-24fb1ea82845 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.829867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d53650b-321f-4cc9-9428-24fb1ea82845 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.831359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d53650b-321f-4cc9-9428-24fb1ea82845 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.832052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d53650b-321f-4cc9-9428-24fb1ea82845 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.832832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d53650b-321f-4cc9-9428-24fb1ea82845 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.879499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d53650b-321f-4cc9-9428-24fb1ea82845 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:11:37.923299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c3569d34-6122-42ca-972f-c9e633520881 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:37.934504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c3569d34-6122-42ca-972f-c9e633520881 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:37.945868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c3569d34-6122-42ca-972f-c9e633520881 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:37.947489 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c3569d34-6122-42ca-972f-c9e633520881 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.209604 Aug 23 18:11:37.950305 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2167/4244] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:37 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:37.960960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c2844771-e8e6-40ba-ad53-abaeaec6d2c5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:37.963338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c2844771-e8e6-40ba-ad53-abaeaec6d2c5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:37.990307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2844771-e8e6-40ba-ad53-abaeaec6d2c5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.992310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2844771-e8e6-40ba-ad53-abaeaec6d2c5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.992833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2844771-e8e6-40ba-ad53-abaeaec6d2c5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:37.995056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2844771-e8e6-40ba-ad53-abaeaec6d2c5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:37.995542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2844771-e8e6-40ba-ad53-abaeaec6d2c5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:37.995988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2844771-e8e6-40ba-ad53-abaeaec6d2c5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:38.092346 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d53650b-321f-4cc9-9428-24fb1ea82845 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 204 len: 0 microversion: 2.1 time: 0.307821 Aug 23 18:11:38.097167 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2078/4245] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:11:37 2022] DELETE /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:11:38.107170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49289b41-f42d-4975-ad9a-8ff176d5587e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:38.108458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49289b41-f42d-4975-ad9a-8ff176d5587e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:38.137377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49289b41-f42d-4975-ad9a-8ff176d5587e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:38.137884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49289b41-f42d-4975-ad9a-8ff176d5587e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:38.138333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49289b41-f42d-4975-ad9a-8ff176d5587e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:38.139097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49289b41-f42d-4975-ad9a-8ff176d5587e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:38.139565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49289b41-f42d-4975-ad9a-8ff176d5587e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:38.152285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49289b41-f42d-4975-ad9a-8ff176d5587e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:38.700255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c2844771-e8e6-40ba-ad53-abaeaec6d2c5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:38.720778 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c2844771-e8e6-40ba-ad53-abaeaec6d2c5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.769170 Aug 23 18:11:38.721945 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2168/4246] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:37 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:38.976267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dbe8310c-d802-4ba2-8742-023f2d4cfb16 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:38.977102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dbe8310c-d802-4ba2-8742-023f2d4cfb16 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:38.984225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbe8310c-d802-4ba2-8742-023f2d4cfb16 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:38.995364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbe8310c-d802-4ba2-8742-023f2d4cfb16 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:38.996198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbe8310c-d802-4ba2-8742-023f2d4cfb16 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:38.997195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbe8310c-d802-4ba2-8742-023f2d4cfb16 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:38.997835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbe8310c-d802-4ba2-8742-023f2d4cfb16 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:38.998428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbe8310c-d802-4ba2-8742-023f2d4cfb16 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:39.252558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dbe8310c-d802-4ba2-8742-023f2d4cfb16 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:39.276791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dbe8310c-d802-4ba2-8742-023f2d4cfb16 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:39.279362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dbe8310c-d802-4ba2-8742-023f2d4cfb16 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:39.281707 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dbe8310c-d802-4ba2-8742-023f2d4cfb16 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.309375 Aug 23 18:11:39.283549 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2169/4247] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:38 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:39.379531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-49289b41-f42d-4975-ad9a-8ff176d5587e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:39.397511 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49289b41-f42d-4975-ad9a-8ff176d5587e tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1688 microversion: 2.1 time: 1.293908 Aug 23 18:11:39.399543 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2079/4248] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:38 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1688 bytes in 1298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:39.422245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8f42a23-fd2e-43d1-b307-48161b1d02c1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:39.423418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8f42a23-fd2e-43d1-b307-48161b1d02c1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:39.431456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8f42a23-fd2e-43d1-b307-48161b1d02c1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:39.433401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8f42a23-fd2e-43d1-b307-48161b1d02c1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:39.434150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8f42a23-fd2e-43d1-b307-48161b1d02c1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:39.435133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8f42a23-fd2e-43d1-b307-48161b1d02c1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:39.436608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8f42a23-fd2e-43d1-b307-48161b1d02c1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:39.437736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8f42a23-fd2e-43d1-b307-48161b1d02c1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:39.459306 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b8f42a23-fd2e-43d1-b307-48161b1d02c1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] HTTP exception thrown: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8f42a23-fd2e-43d1-b307-48161b1d02c1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Request method failure captured: Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 HTTP/1.1 Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRfyiVGnTCBtRVmoVs-_pg0U-0JJ9US3NAlEh6Onz1hZxb4CipSXHpqhhDWdq0qs6UkOK7r4BhIYUJ28Ia7HwRS2AoSrV2elPenEDh5yVl_2lteRfNMYNz12S1fymE_gp6Mq1ab4cFx4kcyrvB7um1XM6ADjtgY7ev9wN2KEfBI8Fu0 Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 91018678aa474eee8e5f6c5249ec012e Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/91018678aa474eee8e5f6c5249ec012e"}]}] Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 91018678aa474eee8e5f6c5249ec012e Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestMultiNic-197890916-project Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 673168b77fc84b9e93cccc69a6cb5948 Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestMultiNic-197890916-project Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75'} Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:11:39.461603 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8f42a23-fd2e-43d1-b307-48161b1d02c1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Returning 404 to user: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:39.465099 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8f42a23-fd2e-43d1-b307-48161b1d02c1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "DELETE /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 404 len: 111 microversion: 2.1 time: 0.046968 Aug 23 18:11:39.470297 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2170/4249] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:11:39 2022] DELETE /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:11:39.473547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c6cc0761-f9d2-41e5-8e72-c659f68bee28 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:39.474296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c6cc0761-f9d2-41e5-8e72-c659f68bee28 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:39.480971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6cc0761-f9d2-41e5-8e72-c659f68bee28 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:39.481472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6cc0761-f9d2-41e5-8e72-c659f68bee28 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:39.481921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6cc0761-f9d2-41e5-8e72-c659f68bee28 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:39.482738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6cc0761-f9d2-41e5-8e72-c659f68bee28 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:39.483206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6cc0761-f9d2-41e5-8e72-c659f68bee28 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:39.483737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6cc0761-f9d2-41e5-8e72-c659f68bee28 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:39.500203 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-c6cc0761-f9d2-41e5-8e72-c659f68bee28 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] HTTP exception thrown: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c6cc0761-f9d2-41e5-8e72-c659f68bee28 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Request method failure captured: Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 HTTP/1.1 Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRfyiVGnTCBtRVmoVs-_pg0U-0JJ9US3NAlEh6Onz1hZxb4CipSXHpqhhDWdq0qs6UkOK7r4BhIYUJ28Ia7HwRS2AoSrV2elPenEDh5yVl_2lteRfNMYNz12S1fymE_gp6Mq1ab4cFx4kcyrvB7um1XM6ADjtgY7ev9wN2KEfBI8Fu0 Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 91018678aa474eee8e5f6c5249ec012e Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/91018678aa474eee8e5f6c5249ec012e"}]}] Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 91018678aa474eee8e5f6c5249ec012e Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestMultiNic-197890916-project Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 673168b77fc84b9e93cccc69a6cb5948 Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestMultiNic-197890916-project Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75'} Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:39.502013 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.505729 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:39.505729 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:39.505729 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:39.505729 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:39.505729 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:39.505729 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. Aug 23 18:11:39.505729 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.505729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c6cc0761-f9d2-41e5-8e72-c659f68bee28 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Returning 404 to user: Instance dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:39.505729 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c6cc0761-f9d2-41e5-8e72-c659f68bee28 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75" status: 404 len: 111 microversion: 2.1 time: 0.033891 Aug 23 18:11:39.505729 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2080/4250] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:39 2022] GET /compute/v2.1/servers/dfcaf2e5-c661-4cfb-b304-cb5f3bb86e75 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:11:39.512791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bbf2b96e-7828-45c3-a057-f7320d2cc7a7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:39.513363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bbf2b96e-7828-45c3-a057-f7320d2cc7a7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:39.520848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbf2b96e-7828-45c3-a057-f7320d2cc7a7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:39.521337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbf2b96e-7828-45c3-a057-f7320d2cc7a7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:39.522093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbf2b96e-7828-45c3-a057-f7320d2cc7a7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:39.523039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbf2b96e-7828-45c3-a057-f7320d2cc7a7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:39.523664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbf2b96e-7828-45c3-a057-f7320d2cc7a7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:39.524238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbf2b96e-7828-45c3-a057-f7320d2cc7a7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:39.551968 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-bbf2b96e-7828-45c3-a057-f7320d2cc7a7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] HTTP exception thrown: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bbf2b96e-7828-45c3-a057-f7320d2cc7a7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Request method failure captured: Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 HTTP/1.1 Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRfyiVGnTCBtRVmoVs-_pg0U-0JJ9US3NAlEh6Onz1hZxb4CipSXHpqhhDWdq0qs6UkOK7r4BhIYUJ28Ia7HwRS2AoSrV2elPenEDh5yVl_2lteRfNMYNz12S1fymE_gp6Mq1ab4cFx4kcyrvB7um1XM6ADjtgY7ev9wN2KEfBI8Fu0 Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 91018678aa474eee8e5f6c5249ec012e Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/91018678aa474eee8e5f6c5249ec012e"}]}] Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 91018678aa474eee8e5f6c5249ec012e Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestMultiNic-197890916-project Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 673168b77fc84b9e93cccc69a6cb5948 Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestMultiNic-197890916-project Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'a0e416c1-52c3-4451-8edb-1f86e6709a61'} Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:11:39.565448 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:11:39.569327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:11:39.569327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.569327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:39.569327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.569327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:39.569327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:39.569327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:39.569327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:39.569327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:39.569327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:11:39.569327 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.569327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bbf2b96e-7828-45c3-a057-f7320d2cc7a7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Returning 404 to user: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:39.571745 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bbf2b96e-7828-45c3-a057-f7320d2cc7a7 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 404 len: 111 microversion: 2.1 time: 0.063018 Aug 23 18:11:39.572539 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2171/4251] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:11:39 2022] DELETE /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:11:39.584158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-256c5237-161e-47bf-806b-3e081f8606b1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:39.584801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-256c5237-161e-47bf-806b-3e081f8606b1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] [instance: a0e416c1-52c3-4451-8edb-1f86e6709a61] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:39.595198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-256c5237-161e-47bf-806b-3e081f8606b1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:39.595962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-256c5237-161e-47bf-806b-3e081f8606b1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:39.596401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-256c5237-161e-47bf-806b-3e081f8606b1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:39.597132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-256c5237-161e-47bf-806b-3e081f8606b1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:39.597597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-256c5237-161e-47bf-806b-3e081f8606b1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:39.598035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-256c5237-161e-47bf-806b-3e081f8606b1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:39.623410 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-256c5237-161e-47bf-806b-3e081f8606b1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] HTTP exception thrown: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-256c5237-161e-47bf-806b-3e081f8606b1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Request method failure captured: Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 HTTP/1.1 Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRfyiVGnTCBtRVmoVs-_pg0U-0JJ9US3NAlEh6Onz1hZxb4CipSXHpqhhDWdq0qs6UkOK7r4BhIYUJ28Ia7HwRS2AoSrV2elPenEDh5yVl_2lteRfNMYNz12S1fymE_gp6Mq1ab4cFx4kcyrvB7um1XM6ADjtgY7ev9wN2KEfBI8Fu0 Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 91018678aa474eee8e5f6c5249ec012e Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/91018678aa474eee8e5f6c5249ec012e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/91018678aa474eee8e5f6c5249ec012e"}]}] Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 91018678aa474eee8e5f6c5249ec012e Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestMultiNic-197890916 Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestMultiNic-197890916-project Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 673168b77fc84b9e93cccc69a6cb5948 Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestMultiNic-197890916-project Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'a0e416c1-52c3-4451-8edb-1f86e6709a61'} Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:39.627077 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.631516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:39.631516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:39.631516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:39.631516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:39.631516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:39.631516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. Aug 23 18:11:39.631516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:39.631516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-256c5237-161e-47bf-806b-3e081f8606b1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] Returning 404 to user: Instance a0e416c1-52c3-4451-8edb-1f86e6709a61 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:39.631516 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-256c5237-161e-47bf-806b-3e081f8606b1 tempest-ServersTestMultiNic-197890916 tempest-ServersTestMultiNic-197890916-project] 10.222.0.61 "GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61" status: 404 len: 111 microversion: 2.1 time: 0.050704 Aug 23 18:11:39.636865 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2081/4252] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:39 2022] GET /compute/v2.1/servers/a0e416c1-52c3-4451-8edb-1f86e6709a61 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:11:39.743236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-171a0935-e027-4723-a46c-5f854933e3b9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:39.743930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-171a0935-e027-4723-a46c-5f854933e3b9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:39.753119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-171a0935-e027-4723-a46c-5f854933e3b9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:39.753541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-171a0935-e027-4723-a46c-5f854933e3b9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:39.753996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-171a0935-e027-4723-a46c-5f854933e3b9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:39.757972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-171a0935-e027-4723-a46c-5f854933e3b9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:39.758526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-171a0935-e027-4723-a46c-5f854933e3b9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:39.759002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-171a0935-e027-4723-a46c-5f854933e3b9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:40.130635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-171a0935-e027-4723-a46c-5f854933e3b9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:40.140915 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-171a0935-e027-4723-a46c-5f854933e3b9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.401184 Aug 23 18:11:40.141518 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2172/4253] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:39 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:11:40.310091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d312667-4f3c-4fd9-9fdf-bdac374d8575 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:40.310764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d312667-4f3c-4fd9-9fdf-bdac374d8575 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:40.327055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d312667-4f3c-4fd9-9fdf-bdac374d8575 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:40.328212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d312667-4f3c-4fd9-9fdf-bdac374d8575 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:40.328677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d312667-4f3c-4fd9-9fdf-bdac374d8575 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:40.329538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d312667-4f3c-4fd9-9fdf-bdac374d8575 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:40.330009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d312667-4f3c-4fd9-9fdf-bdac374d8575 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:40.330450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d312667-4f3c-4fd9-9fdf-bdac374d8575 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:40.335256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:40.425820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae3d4e3c-8ca7-4125-abde-20980f18bf9f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:40.426454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae3d4e3c-8ca7-4125-abde-20980f18bf9f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:40.434369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae3d4e3c-8ca7-4125-abde-20980f18bf9f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:40.434901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae3d4e3c-8ca7-4125-abde-20980f18bf9f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:40.435349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae3d4e3c-8ca7-4125-abde-20980f18bf9f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:40.436069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae3d4e3c-8ca7-4125-abde-20980f18bf9f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:40.436535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae3d4e3c-8ca7-4125-abde-20980f18bf9f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:40.437539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae3d4e3c-8ca7-4125-abde-20980f18bf9f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:40.523053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5d312667-4f3c-4fd9-9fdf-bdac374d8575 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:40.542426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5d312667-4f3c-4fd9-9fdf-bdac374d8575 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:40.548654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5d312667-4f3c-4fd9-9fdf-bdac374d8575 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:40.550350 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d312667-4f3c-4fd9-9fdf-bdac374d8575 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.244362 Aug 23 18:11:40.568232 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2082/4254] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:40 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:40.751389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ae3d4e3c-8ca7-4125-abde-20980f18bf9f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:40.764373 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae3d4e3c-8ca7-4125-abde-20980f18bf9f tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1688 microversion: 2.1 time: 0.342952 Aug 23 18:11:40.765370 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2173/4255] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:40 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1688 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:11:41.166830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff8f41c8-8f43-42fa-ae42-ac024e070073 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:41.167750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff8f41c8-8f43-42fa-ae42-ac024e070073 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:41.186372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff8f41c8-8f43-42fa-ae42-ac024e070073 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:41.201380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff8f41c8-8f43-42fa-ae42-ac024e070073 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:41.201380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff8f41c8-8f43-42fa-ae42-ac024e070073 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:41.201380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff8f41c8-8f43-42fa-ae42-ac024e070073 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:41.201380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff8f41c8-8f43-42fa-ae42-ac024e070073 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:41.201380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff8f41c8-8f43-42fa-ae42-ac024e070073 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:41.577197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-28965739-13aa-40ae-a52f-a3ac63435f89 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:41.578651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-28965739-13aa-40ae-a52f-a3ac63435f89 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:41.592363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28965739-13aa-40ae-a52f-a3ac63435f89 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:41.592869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28965739-13aa-40ae-a52f-a3ac63435f89 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:41.593371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28965739-13aa-40ae-a52f-a3ac63435f89 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:41.600386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28965739-13aa-40ae-a52f-a3ac63435f89 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:41.600979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28965739-13aa-40ae-a52f-a3ac63435f89 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:41.605694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28965739-13aa-40ae-a52f-a3ac63435f89 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:41.645773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff8f41c8-8f43-42fa-ae42-ac024e070073 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:41.667808 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff8f41c8-8f43-42fa-ae42-ac024e070073 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.508153 Aug 23 18:11:41.668825 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2083/4256] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:41 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:41.786212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b3ef2849-3d09-44e3-89ba-126a12738f62 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:41.787725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b3ef2849-3d09-44e3-89ba-126a12738f62 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:41.805860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ef2849-3d09-44e3-89ba-126a12738f62 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:41.806727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ef2849-3d09-44e3-89ba-126a12738f62 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:41.807779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ef2849-3d09-44e3-89ba-126a12738f62 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:41.808763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ef2849-3d09-44e3-89ba-126a12738f62 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:41.809435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ef2849-3d09-44e3-89ba-126a12738f62 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:41.810077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ef2849-3d09-44e3-89ba-126a12738f62 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:41.838082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-28965739-13aa-40ae-a52f-a3ac63435f89 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:41.844243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:41.869306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-28965739-13aa-40ae-a52f-a3ac63435f89 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:41.871299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-28965739-13aa-40ae-a52f-a3ac63435f89 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:41.875271 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-28965739-13aa-40ae-a52f-a3ac63435f89 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.301579 Aug 23 18:11:41.878136 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2174/4257] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:41 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:42.537803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b3ef2849-3d09-44e3-89ba-126a12738f62 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:42.553349 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b3ef2849-3d09-44e3-89ba-126a12738f62 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1688 microversion: 2.1 time: 0.771559 Aug 23 18:11:42.554673 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2084/4258] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:41 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1688 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:42.697436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-311af0fd-3d43-4a78-8926-3f5f9792bb18 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:42.698630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-311af0fd-3d43-4a78-8926-3f5f9792bb18 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:42.708697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311af0fd-3d43-4a78-8926-3f5f9792bb18 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:42.709446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311af0fd-3d43-4a78-8926-3f5f9792bb18 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:42.710035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311af0fd-3d43-4a78-8926-3f5f9792bb18 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:42.711183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311af0fd-3d43-4a78-8926-3f5f9792bb18 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:42.711867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311af0fd-3d43-4a78-8926-3f5f9792bb18 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:42.712436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311af0fd-3d43-4a78-8926-3f5f9792bb18 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:42.890398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-311af0fd-3d43-4a78-8926-3f5f9792bb18 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:42.901212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-634882c7-3d21-4972-8031-8cda707a1432 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:42.902953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-634882c7-3d21-4972-8031-8cda707a1432 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:42.914244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-634882c7-3d21-4972-8031-8cda707a1432 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:42.914767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-634882c7-3d21-4972-8031-8cda707a1432 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:42.918087 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-311af0fd-3d43-4a78-8926-3f5f9792bb18 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.227586 Aug 23 18:11:42.918698 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2175/4259] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:42 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:42.919401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-634882c7-3d21-4972-8031-8cda707a1432 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:42.920275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-634882c7-3d21-4972-8031-8cda707a1432 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:42.920876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-634882c7-3d21-4972-8031-8cda707a1432 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:42.923652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-634882c7-3d21-4972-8031-8cda707a1432 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:43.051289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-634882c7-3d21-4972-8031-8cda707a1432 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:43.061688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-634882c7-3d21-4972-8031-8cda707a1432 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:43.064857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-634882c7-3d21-4972-8031-8cda707a1432 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:43.066340 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-634882c7-3d21-4972-8031-8cda707a1432 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1873 microversion: 2.32 time: 0.169036 Aug 23 18:11:43.067456 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2085/4260] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:42 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1873 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:11:43.578996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33fbb33c-18b0-46e0-9c80-ec1af33c1ea3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:43.580384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33fbb33c-18b0-46e0-9c80-ec1af33c1ea3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:43.597216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33fbb33c-18b0-46e0-9c80-ec1af33c1ea3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:43.597970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33fbb33c-18b0-46e0-9c80-ec1af33c1ea3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:43.598862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33fbb33c-18b0-46e0-9c80-ec1af33c1ea3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:43.599761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33fbb33c-18b0-46e0-9c80-ec1af33c1ea3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:43.603181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33fbb33c-18b0-46e0-9c80-ec1af33c1ea3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:43.603945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33fbb33c-18b0-46e0-9c80-ec1af33c1ea3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:43.943158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9537ad94-294d-4eb7-b8cb-440aeaa8cb3e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:43.944983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9537ad94-294d-4eb7-b8cb-440aeaa8cb3e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:43.956865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9537ad94-294d-4eb7-b8cb-440aeaa8cb3e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:43.960924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9537ad94-294d-4eb7-b8cb-440aeaa8cb3e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:43.961601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9537ad94-294d-4eb7-b8cb-440aeaa8cb3e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:43.963727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9537ad94-294d-4eb7-b8cb-440aeaa8cb3e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:43.965196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9537ad94-294d-4eb7-b8cb-440aeaa8cb3e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:43.967426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9537ad94-294d-4eb7-b8cb-440aeaa8cb3e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:44.163231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-33fbb33c-18b0-46e0-9c80-ec1af33c1ea3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:44.176450 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-33fbb33c-18b0-46e0-9c80-ec1af33c1ea3 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1688 microversion: 2.1 time: 0.604178 Aug 23 18:11:44.177459 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2176/4261] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:43 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1688 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:44.195005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:44.195906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:44.202268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:44.203632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:44.204300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:44.205329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:44.206651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:44.207314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:44.282737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:44.283577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:44.284231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:44.290484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lazy-loading 'fault' on Instance uuid e113c065-7175-4e41-8f1c-ce90969bd01e {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:11:44.390465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9537ad94-294d-4eb7-b8cb-440aeaa8cb3e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:44.407102 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9537ad94-294d-4eb7-b8cb-440aeaa8cb3e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.469191 Aug 23 18:11:44.423937 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2086/4262] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:43 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:44.456152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:44.471956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:44.474077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '30dc491d4aea4ed68055d6ecdf355626', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6311e21dbe2940cbadac9f3bb3a3116c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:44.484862 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-89258e58-e7fb-4b74-8c88-8a2e2d69b074 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 200 len: 1640 microversion: 2.32 time: 0.302869 Aug 23 18:11:44.485930 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2177/4263] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:44 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 1640 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:11:45.201475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-610f75b9-09ef-4bc2-a0f0-3042f57aab52 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:45.203801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-610f75b9-09ef-4bc2-a0f0-3042f57aab52 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:45.221608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-610f75b9-09ef-4bc2-a0f0-3042f57aab52 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:45.223768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-610f75b9-09ef-4bc2-a0f0-3042f57aab52 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:45.226811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-610f75b9-09ef-4bc2-a0f0-3042f57aab52 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:45.227970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-610f75b9-09ef-4bc2-a0f0-3042f57aab52 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:45.230677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-610f75b9-09ef-4bc2-a0f0-3042f57aab52 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:45.231606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-610f75b9-09ef-4bc2-a0f0-3042f57aab52 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:45.334271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8f316240-e584-41b3-9750-0136fad49743 tempest-ListImagesTestJSON-1393089582 tempest-ListImagesTestJSON-1393089582-project] Calling method '.version_select at 0x7f27f1be4e50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:45.432512 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8f316240-e584-41b3-9750-0136fad49743 tempest-ListImagesTestJSON-1393089582 tempest-ListImagesTestJSON-1393089582-project] 10.222.0.61 "GET /compute/v2.1/images/126e0038-c91e-4894-b027-98e76f88a186" status: 200 len: 784 microversion: 2.1 time: 0.371771 Aug 23 18:11:45.433757 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2087/4264] 10.222.0.61 () {58 vars in 1233 bytes} [Tue Aug 23 18:11:45 2022] GET /compute/v2.1/images/126e0038-c91e-4894-b027-98e76f88a186 => generated 784 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:45.449406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-57514e50-6859-4e75-aff8-8c04b500158a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:45.450912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-57514e50-6859-4e75-aff8-8c04b500158a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:45.495146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57514e50-6859-4e75-aff8-8c04b500158a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:45.496097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57514e50-6859-4e75-aff8-8c04b500158a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:45.496869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57514e50-6859-4e75-aff8-8c04b500158a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:45.509790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57514e50-6859-4e75-aff8-8c04b500158a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:45.510719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57514e50-6859-4e75-aff8-8c04b500158a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:45.511337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57514e50-6859-4e75-aff8-8c04b500158a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:45.697295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-610f75b9-09ef-4bc2-a0f0-3042f57aab52 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:45.718496 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-610f75b9-09ef-4bc2-a0f0-3042f57aab52 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 200 len: 1621 microversion: 2.1 time: 0.519534 Aug 23 18:11:45.723330 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2178/4265] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:45 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 1621 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:45.738959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef1ff271-a9e9-46dd-8052-8ce63cc71f85 tempest-ListImagesTestJSON-1393089582 tempest-ListImagesTestJSON-1393089582-project] Calling method '.version_select at 0x7f27dfa824c0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:45.834785 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef1ff271-a9e9-46dd-8052-8ce63cc71f85 tempest-ListImagesTestJSON-1393089582 tempest-ListImagesTestJSON-1393089582-project] 10.222.0.61 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.110057 Aug 23 18:11:45.838831 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2179/4266] 10.222.0.61 () {58 vars in 1122 bytes} [Tue Aug 23 18:11:45 2022] GET /compute/v2.1/images => generated 445 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:45.849121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd612b8c-054d-4666-803f-72725cf5d1d1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:45.852911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cd612b8c-054d-4666-803f-72725cf5d1d1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:45.904680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd612b8c-054d-4666-803f-72725cf5d1d1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:45.911359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd612b8c-054d-4666-803f-72725cf5d1d1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:45.914374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd612b8c-054d-4666-803f-72725cf5d1d1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:45.918934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd612b8c-054d-4666-803f-72725cf5d1d1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:45.919385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd612b8c-054d-4666-803f-72725cf5d1d1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:45.919850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd612b8c-054d-4666-803f-72725cf5d1d1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:45.959760 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-cd612b8c-054d-4666-803f-72725cf5d1d1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] HTTP exception thrown: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd612b8c-054d-4666-803f-72725cf5d1d1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Request method failure captured: Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e HTTP/1.1 Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRalno-LCSNo2Ego7kdtGb5X_RPyWB6p1PLsmK1J6Zd5ZasSspzvVOI6nywYCvtjcWgLE-2Tr066HnZQbczIwMSCjHgls43azEUAKNB521M7644Rgzffe_TirnprA0p2KC5X9m-t2W_caO6MS2AX6YoR_hVLpL2HoqKmzZADDLULR8s Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.32 Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 6311e21dbe2940cbadac9f3bb3a3116c Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TaggedBootDevicesTest-127813416 Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6311e21dbe2940cbadac9f3bb3a3116c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6311e21dbe2940cbadac9f3bb3a3116c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6311e21dbe2940cbadac9f3bb3a3116c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6311e21dbe2940cbadac9f3bb3a3116c"}]}] Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TaggedBootDevicesTest-127813416 Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 6311e21dbe2940cbadac9f3bb3a3116c Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TaggedBootDevicesTest-127813416 Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TaggedBootDevicesTest-127813416-project Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 30dc491d4aea4ed68055d6ecdf355626 Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TaggedBootDevicesTest-127813416-project Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'e113c065-7175-4e41-8f1c-ce90969bd01e'} Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:45.974997 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:45.979409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:45.979409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:45.979409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:45.979409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:45.979409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:45.979409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:45.979409 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:45.981424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd612b8c-054d-4666-803f-72725cf5d1d1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Returning 404 to user: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:45.986999 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd612b8c-054d-4666-803f-72725cf5d1d1 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 404 len: 111 microversion: 2.32 time: 0.146806 Aug 23 18:11:45.991703 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2180/4267] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:45 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:11:46.186798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6f3386d2-ac51-4650-9726-be3dfe02a8c7 req-bea6c2e2-0598-491a-8ac6-168ac4b1c7cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f0d2e07-d2d2-422d-a262-279197b79569", "name": "network-vif-deleted", "tag": "014ffa42-ca3f-428d-888e-5c4fca13ce84"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:46.209638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-57514e50-6859-4e75-aff8-8c04b500158a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:46.213723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6f3386d2-ac51-4650-9726-be3dfe02a8c7 req-bea6c2e2-0598-491a-8ac6-168ac4b1c7cb service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:46.214246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6f3386d2-ac51-4650-9726-be3dfe02a8c7 req-bea6c2e2-0598-491a-8ac6-168ac4b1c7cb service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:46.216832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6f3386d2-ac51-4650-9726-be3dfe02a8c7 req-bea6c2e2-0598-491a-8ac6-168ac4b1c7cb service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:46.224849 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-57514e50-6859-4e75-aff8-8c04b500158a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1507 microversion: 2.1 time: 0.789202 Aug 23 18:11:46.242738 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2088/4268] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:45 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1507 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:46.248589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bbb817f3-108d-45c2-b618-f4dfd4e8eb99 tempest-ListImagesTestJSON-1393089582 tempest-ListImagesTestJSON-1393089582-project] Calling method '.version_select at 0x7f27f1cb68b0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:46.256002 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6f3386d2-ac51-4650-9726-be3dfe02a8c7 req-bea6c2e2-0598-491a-8ac6-168ac4b1c7cb service nova] Creating event network-vif-deleted:014ffa42-ca3f-428d-888e-5c4fca13ce84 for instance 8f0d2e07-d2d2-422d-a262-279197b79569 on n-h2-850468-16 Aug 23 18:11:46.268590 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6f3386d2-ac51-4650-9726-be3dfe02a8c7 req-bea6c2e2-0598-491a-8ac6-168ac4b1c7cb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.275033 Aug 23 18:11:46.269219 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2181/4269] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:46.274385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aab21e66-9fc4-49fa-80dd-17df839f4fa6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '.version_select at 0x7f27ec7e0d30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:46.323541 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bbb817f3-108d-45c2-b618-f4dfd4e8eb99 tempest-ListImagesTestJSON-1393089582 tempest-ListImagesTestJSON-1393089582-project] 10.222.0.61 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.079522 Aug 23 18:11:46.324701 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2089/4270] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 18:11:46 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:46.341178 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aab21e66-9fc4-49fa-80dd-17df839f4fa6 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1622703101" status: 204 len: 0 microversion: 2.32 time: 0.070437 Aug 23 18:11:46.342705 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2182/4271] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 18:11:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1622703101 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:11:46.754445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2f6ba9b7-0ebf-415f-b920-9d5a0c9de34c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:46.755119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2f6ba9b7-0ebf-415f-b920-9d5a0c9de34c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: 8f0d2e07-d2d2-422d-a262-279197b79569] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:46.791476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f6ba9b7-0ebf-415f-b920-9d5a0c9de34c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:46.794289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f6ba9b7-0ebf-415f-b920-9d5a0c9de34c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:46.794784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f6ba9b7-0ebf-415f-b920-9d5a0c9de34c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:46.795558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f6ba9b7-0ebf-415f-b920-9d5a0c9de34c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:46.803524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f6ba9b7-0ebf-415f-b920-9d5a0c9de34c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:46.804013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f6ba9b7-0ebf-415f-b920-9d5a0c9de34c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:46.858125 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2f6ba9b7-0ebf-415f-b920-9d5a0c9de34c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] HTTP exception thrown: Instance 8f0d2e07-d2d2-422d-a262-279197b79569 could not be found. Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2f6ba9b7-0ebf-415f-b920-9d5a0c9de34c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Request method failure captured: Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 HTTP/1.1 Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRbMS5n_NsGau0vnGI0iBrS85eKgyFW2-flo5AMEagzFwHXr8y830jIBRx2ycNUqbit5tulaOzYGG8jmEgWnoI2Kij-0Ap1FvDFmaX_VNZTOBEswqTbIxjk8xyB5l_Bmsy2gQs8ixm2uUwN9H5qHjYOcvdPlZGrIYQD4Gm01UoxEIk4 Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}] Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 283c529ff2774efca184740ad6ccfdd5 Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 8f0d2e07-d2d2-422d-a262-279197b79569 could not be found. Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '8f0d2e07-d2d2-422d-a262-279197b79569'} Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f0d2e07-d2d2-422d-a262-279197b79569 could not be found. Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f0d2e07-d2d2-422d-a262-279197b79569 could not be found. Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:46.864774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:46.869452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:46.869452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:46.869452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:46.869452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:46.869452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:46.869452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:46.869452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f0d2e07-d2d2-422d-a262-279197b79569 could not be found. Aug 23 18:11:46.869452 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:46.869452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2f6ba9b7-0ebf-415f-b920-9d5a0c9de34c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Returning 404 to user: Instance 8f0d2e07-d2d2-422d-a262-279197b79569 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:46.869452 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2f6ba9b7-0ebf-415f-b920-9d5a0c9de34c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569" status: 404 len: 111 microversion: 2.1 time: 0.128345 Aug 23 18:11:46.871597 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2090/4272] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:46 2022] GET /compute/v2.1/servers/8f0d2e07-d2d2-422d-a262-279197b79569 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:11:46.881899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1c04131-373f-49cc-b5ae-0b712647d19d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '.version_select at 0x7f27dfa318b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:46.947243 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d1c04131-373f-49cc-b5ae-0b712647d19d tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928435785" status: 202 len: 0 microversion: 2.1 time: 0.070803 Aug 23 18:11:46.948001 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2183/4273] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 18:11:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1928435785 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:11:47.257264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-89518133-c751-4f66-8cad-1f5426daea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:47.258516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-89518133-c751-4f66-8cad-1f5426daea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:47.280346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89518133-c751-4f66-8cad-1f5426daea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:47.282277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89518133-c751-4f66-8cad-1f5426daea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:47.288030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89518133-c751-4f66-8cad-1f5426daea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:47.288988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89518133-c751-4f66-8cad-1f5426daea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:47.289917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89518133-c751-4f66-8cad-1f5426daea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:47.290907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89518133-c751-4f66-8cad-1f5426daea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:47.822443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-89518133-c751-4f66-8cad-1f5426daea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:47.836662 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-89518133-c751-4f66-8cad-1f5426daea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1528 microversion: 2.1 time: 0.589217 Aug 23 18:11:47.837595 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2091/4274] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:47 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1528 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:48.865759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-52b65bae-87f3-4a53-b79e-4201dec3825b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:48.867178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-52b65bae-87f3-4a53-b79e-4201dec3825b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:48.895045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52b65bae-87f3-4a53-b79e-4201dec3825b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:48.895856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52b65bae-87f3-4a53-b79e-4201dec3825b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:48.896455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52b65bae-87f3-4a53-b79e-4201dec3825b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:48.901732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52b65bae-87f3-4a53-b79e-4201dec3825b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:48.907383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52b65bae-87f3-4a53-b79e-4201dec3825b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:48.908192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52b65bae-87f3-4a53-b79e-4201dec3825b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:49.441501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-52b65bae-87f3-4a53-b79e-4201dec3825b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:49.456051 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-52b65bae-87f3-4a53-b79e-4201dec3825b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1528 microversion: 2.1 time: 0.599615 Aug 23 18:11:49.472305 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2184/4275] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:48 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1528 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:50.488243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-af119eac-3a8b-4f97-8152-bb66d768300c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:50.489109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-af119eac-3a8b-4f97-8152-bb66d768300c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:50.504927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af119eac-3a8b-4f97-8152-bb66d768300c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:50.505897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af119eac-3a8b-4f97-8152-bb66d768300c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:50.507807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af119eac-3a8b-4f97-8152-bb66d768300c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:50.509695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af119eac-3a8b-4f97-8152-bb66d768300c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:50.511106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af119eac-3a8b-4f97-8152-bb66d768300c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:50.513040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af119eac-3a8b-4f97-8152-bb66d768300c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:51.054316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-af119eac-3a8b-4f97-8152-bb66d768300c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:51.066823 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-af119eac-3a8b-4f97-8152-bb66d768300c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1528 microversion: 2.1 time: 0.584809 Aug 23 18:11:51.067420 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2092/4276] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:50 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1528 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:52.090163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f190bd0e-a6bf-46af-8301-0c87319b0cad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:52.092573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f190bd0e-a6bf-46af-8301-0c87319b0cad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:52.110952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f190bd0e-a6bf-46af-8301-0c87319b0cad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:52.111673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f190bd0e-a6bf-46af-8301-0c87319b0cad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:52.112294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f190bd0e-a6bf-46af-8301-0c87319b0cad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:52.113629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f190bd0e-a6bf-46af-8301-0c87319b0cad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:52.114564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f190bd0e-a6bf-46af-8301-0c87319b0cad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:52.115171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f190bd0e-a6bf-46af-8301-0c87319b0cad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:52.806724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f190bd0e-a6bf-46af-8301-0c87319b0cad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:52.817825 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f190bd0e-a6bf-46af-8301-0c87319b0cad tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1528 microversion: 2.1 time: 0.731398 Aug 23 18:11:52.821286 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2185/4277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:52 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1528 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:53.842242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5fa761ac-d82d-48c1-be56-12fd2e805bd1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:53.843426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5fa761ac-d82d-48c1-be56-12fd2e805bd1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:53.857711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5fa761ac-d82d-48c1-be56-12fd2e805bd1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:53.858219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5fa761ac-d82d-48c1-be56-12fd2e805bd1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:53.859258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5fa761ac-d82d-48c1-be56-12fd2e805bd1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:53.859990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5fa761ac-d82d-48c1-be56-12fd2e805bd1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:53.860451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5fa761ac-d82d-48c1-be56-12fd2e805bd1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:53.860887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5fa761ac-d82d-48c1-be56-12fd2e805bd1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:54.600192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5fa761ac-d82d-48c1-be56-12fd2e805bd1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:54.627357 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5fa761ac-d82d-48c1-be56-12fd2e805bd1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 0.786670 Aug 23 18:11:54.635033 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2093/4278] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:53 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:54.973895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3f9bd4e0-0651-4fc6-99bb-ab9ca27ee60e req-fd95f187-bf3c-424d-a13b-5dba1ba7b0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210941bf-76d0-4c84-a56c-f3b4e6679e8c", "name": "network-vif-plugged", "status": "completed", "tag": "473d8513-68ee-4307-bd65-283eeb1b9620"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:11:55.015529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3f9bd4e0-0651-4fc6-99bb-ab9ca27ee60e req-fd95f187-bf3c-424d-a13b-5dba1ba7b0f9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:55.016278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3f9bd4e0-0651-4fc6-99bb-ab9ca27ee60e req-fd95f187-bf3c-424d-a13b-5dba1ba7b0f9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:55.017802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3f9bd4e0-0651-4fc6-99bb-ab9ca27ee60e req-fd95f187-bf3c-424d-a13b-5dba1ba7b0f9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:55.046525 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3f9bd4e0-0651-4fc6-99bb-ab9ca27ee60e req-fd95f187-bf3c-424d-a13b-5dba1ba7b0f9 service nova] Creating event network-vif-plugged:473d8513-68ee-4307-bd65-283eeb1b9620 for instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c on n-h2-850468-16 Aug 23 18:11:55.065226 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3f9bd4e0-0651-4fc6-99bb-ab9ca27ee60e req-fd95f187-bf3c-424d-a13b-5dba1ba7b0f9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.530856 Aug 23 18:11:55.067147 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2186/4279] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:11:55.653202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cb9de828-3776-4ca5-9ae9-d9156d4d8ff2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:55.653840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cb9de828-3776-4ca5-9ae9-d9156d4d8ff2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:55.664745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb9de828-3776-4ca5-9ae9-d9156d4d8ff2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:55.665248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb9de828-3776-4ca5-9ae9-d9156d4d8ff2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:55.665695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb9de828-3776-4ca5-9ae9-d9156d4d8ff2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:55.666422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb9de828-3776-4ca5-9ae9-d9156d4d8ff2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:55.666913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb9de828-3776-4ca5-9ae9-d9156d4d8ff2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:55.667451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb9de828-3776-4ca5-9ae9-d9156d4d8ff2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:56.828131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cb9de828-3776-4ca5-9ae9-d9156d4d8ff2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:56.839459 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cb9de828-3776-4ca5-9ae9-d9156d4d8ff2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 1.190550 Aug 23 18:11:56.855311 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2094/4280] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:55 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:57.882129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-57d3c2cf-2a05-40a1-83c7-9fa4c6d10958 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:57.891736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-57d3c2cf-2a05-40a1-83c7-9fa4c6d10958 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:57.911792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57d3c2cf-2a05-40a1-83c7-9fa4c6d10958 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:57.912301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57d3c2cf-2a05-40a1-83c7-9fa4c6d10958 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:57.912758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57d3c2cf-2a05-40a1-83c7-9fa4c6d10958 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:57.923529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57d3c2cf-2a05-40a1-83c7-9fa4c6d10958 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:57.924077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57d3c2cf-2a05-40a1-83c7-9fa4c6d10958 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:57.926854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57d3c2cf-2a05-40a1-83c7-9fa4c6d10958 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:59.110050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-57d3c2cf-2a05-40a1-83c7-9fa4c6d10958 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:11:59.129002 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-57d3c2cf-2a05-40a1-83c7-9fa4c6d10958 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 1.251065 Aug 23 18:11:59.149658 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2187/4281] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:11:57 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:11:59.528818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e16c134-fea9-4d96-9ad0-e49677bc7fbe tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:59.529368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e16c134-fea9-4d96-9ad0-e49677bc7fbe tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:59.546916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:11:59.548465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e16c134-fea9-4d96-9ad0-e49677bc7fbe tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:59.548964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e16c134-fea9-4d96-9ad0-e49677bc7fbe tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:59.549417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e16c134-fea9-4d96-9ad0-e49677bc7fbe tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:59.550154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e16c134-fea9-4d96-9ad0-e49677bc7fbe tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:59.569918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e16c134-fea9-4d96-9ad0-e49677bc7fbe tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:59.570749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e16c134-fea9-4d96-9ad0-e49677bc7fbe tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:59.637440 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-7e16c134-fea9-4d96-9ad0-e49677bc7fbe tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] HTTP exception thrown: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e16c134-fea9-4d96-9ad0-e49677bc7fbe tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Request method failure captured: Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e HTTP/1.1 Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRalno-LCSNo2Ego7kdtGb5X_RPyWB6p1PLsmK1J6Zd5ZasSspzvVOI6nywYCvtjcWgLE-2Tr066HnZQbczIwMSCjHgls43azEUAKNB521M7644Rgzffe_TirnprA0p2KC5X9m-t2W_caO6MS2AX6YoR_hVLpL2HoqKmzZADDLULR8s Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.32 Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 6311e21dbe2940cbadac9f3bb3a3116c Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TaggedBootDevicesTest-127813416 Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6311e21dbe2940cbadac9f3bb3a3116c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6311e21dbe2940cbadac9f3bb3a3116c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6311e21dbe2940cbadac9f3bb3a3116c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6311e21dbe2940cbadac9f3bb3a3116c"}]}] Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TaggedBootDevicesTest-127813416 Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 6311e21dbe2940cbadac9f3bb3a3116c Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TaggedBootDevicesTest-127813416 Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TaggedBootDevicesTest-127813416-project Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 30dc491d4aea4ed68055d6ecdf355626 Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TaggedBootDevicesTest-127813416-project Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'e113c065-7175-4e41-8f1c-ce90969bd01e'} Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:11:59.644087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:11:59.648774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:59.648774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:59.648774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:59.648774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:59.648774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:59.648774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:59.648774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:59.648774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:59.648774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:59.648774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:59.648774 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:11:59.650730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e16c134-fea9-4d96-9ad0-e49677bc7fbe tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Returning 404 to user: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:59.651767 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e16c134-fea9-4d96-9ad0-e49677bc7fbe tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 404 len: 111 microversion: 2.32 time: 0.126968 Aug 23 18:11:59.654790 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2095/4282] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:11:59 2022] DELETE /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:11:59.661500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-68761d3d-1886-4142-bb47-4ed2c7a55033 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:11:59.662135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-68761d3d-1886-4142-bb47-4ed2c7a55033 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] [instance: e113c065-7175-4e41-8f1c-ce90969bd01e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:11:59.680015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68761d3d-1886-4142-bb47-4ed2c7a55033 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:59.680520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68761d3d-1886-4142-bb47-4ed2c7a55033 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:59.680974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68761d3d-1886-4142-bb47-4ed2c7a55033 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:59.681723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68761d3d-1886-4142-bb47-4ed2c7a55033 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:11:59.682198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68761d3d-1886-4142-bb47-4ed2c7a55033 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:11:59.694130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68761d3d-1886-4142-bb47-4ed2c7a55033 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:11:59.772158 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-68761d3d-1886-4142-bb47-4ed2c7a55033 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] HTTP exception thrown: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-68761d3d-1886-4142-bb47-4ed2c7a55033 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Request method failure captured: Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e HTTP/1.1 Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRalno-LCSNo2Ego7kdtGb5X_RPyWB6p1PLsmK1J6Zd5ZasSspzvVOI6nywYCvtjcWgLE-2Tr066HnZQbczIwMSCjHgls43azEUAKNB521M7644Rgzffe_TirnprA0p2KC5X9m-t2W_caO6MS2AX6YoR_hVLpL2HoqKmzZADDLULR8s Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.32 Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 6311e21dbe2940cbadac9f3bb3a3116c Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TaggedBootDevicesTest-127813416 Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6311e21dbe2940cbadac9f3bb3a3116c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6311e21dbe2940cbadac9f3bb3a3116c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6311e21dbe2940cbadac9f3bb3a3116c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6311e21dbe2940cbadac9f3bb3a3116c"}]}] Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TaggedBootDevicesTest-127813416 Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 6311e21dbe2940cbadac9f3bb3a3116c Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TaggedBootDevicesTest-127813416 Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TaggedBootDevicesTest-127813416-project Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 30dc491d4aea4ed68055d6ecdf355626 Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TaggedBootDevicesTest-127813416-project Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'e113c065-7175-4e41-8f1c-ce90969bd01e'} Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:11:59.773891 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:59.778392 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:11:59.778392 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:11:59.778392 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:11:59.778392 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:11:59.778392 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:11:59.778392 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. Aug 23 18:11:59.778392 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:11:59.778392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-68761d3d-1886-4142-bb47-4ed2c7a55033 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] Returning 404 to user: Instance e113c065-7175-4e41-8f1c-ce90969bd01e could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:11:59.796157 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-68761d3d-1886-4142-bb47-4ed2c7a55033 tempest-TaggedBootDevicesTest-127813416 tempest-TaggedBootDevicesTest-127813416-project] 10.222.0.61 "GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e" status: 404 len: 111 microversion: 2.32 time: 0.138404 Aug 23 18:11:59.803740 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2188/4283] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:11:59 2022] GET /compute/v2.1/servers/e113c065-7175-4e41-8f1c-ce90969bd01e => generated 111 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:12:00.157034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d323b95b-0f41-4c08-b657-45dafb3796a3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:00.157545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d323b95b-0f41-4c08-b657-45dafb3796a3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:00.185892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d323b95b-0f41-4c08-b657-45dafb3796a3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:00.187095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d323b95b-0f41-4c08-b657-45dafb3796a3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:00.187895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d323b95b-0f41-4c08-b657-45dafb3796a3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:00.188633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d323b95b-0f41-4c08-b657-45dafb3796a3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:00.202292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d323b95b-0f41-4c08-b657-45dafb3796a3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:00.203160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d323b95b-0f41-4c08-b657-45dafb3796a3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:01.913762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d323b95b-0f41-4c08-b657-45dafb3796a3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:01.938115 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d323b95b-0f41-4c08-b657-45dafb3796a3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 1.774238 Aug 23 18:12:01.938811 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2096/4284] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:00 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 1791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:02.959818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-311b7f53-b9d1-4a2a-b1ed-bec1018aa98a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:02.960601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-311b7f53-b9d1-4a2a-b1ed-bec1018aa98a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:02.963627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:12:03.004590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311b7f53-b9d1-4a2a-b1ed-bec1018aa98a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:03.005104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311b7f53-b9d1-4a2a-b1ed-bec1018aa98a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:03.005551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311b7f53-b9d1-4a2a-b1ed-bec1018aa98a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:03.006280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311b7f53-b9d1-4a2a-b1ed-bec1018aa98a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:03.006769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311b7f53-b9d1-4a2a-b1ed-bec1018aa98a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:03.007199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-311b7f53-b9d1-4a2a-b1ed-bec1018aa98a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:03.650036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-311b7f53-b9d1-4a2a-b1ed-bec1018aa98a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:03.665779 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-311b7f53-b9d1-4a2a-b1ed-bec1018aa98a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 0.709220 Aug 23 18:12:03.688150 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2189/4285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:02 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:04.712104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-520ad57b-fda5-4051-90b3-93fa3cc22832 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:04.712735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-520ad57b-fda5-4051-90b3-93fa3cc22832 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:04.730923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-520ad57b-fda5-4051-90b3-93fa3cc22832 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:04.734916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-520ad57b-fda5-4051-90b3-93fa3cc22832 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:04.735403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-520ad57b-fda5-4051-90b3-93fa3cc22832 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:04.736236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-520ad57b-fda5-4051-90b3-93fa3cc22832 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:04.736714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-520ad57b-fda5-4051-90b3-93fa3cc22832 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:04.737158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-520ad57b-fda5-4051-90b3-93fa3cc22832 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:05.810872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33c180a3-7b73-473c-9f1e-ea1ca6d79162 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:05.815807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33c180a3-7b73-473c-9f1e-ea1ca6d79162 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:05.835523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33c180a3-7b73-473c-9f1e-ea1ca6d79162 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:05.849628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33c180a3-7b73-473c-9f1e-ea1ca6d79162 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:05.850795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33c180a3-7b73-473c-9f1e-ea1ca6d79162 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:05.851737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33c180a3-7b73-473c-9f1e-ea1ca6d79162 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:05.853368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33c180a3-7b73-473c-9f1e-ea1ca6d79162 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:05.854016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33c180a3-7b73-473c-9f1e-ea1ca6d79162 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:05.956162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33c180a3-7b73-473c-9f1e-ea1ca6d79162 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:12:06.195293 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-33c180a3-7b73-473c-9f1e-ea1ca6d79162 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 204 len: 0 microversion: 2.1 time: 0.393695 Aug 23 18:12:06.196765 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2190/4286] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:12:05 2022] DELETE /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:12:06.206395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0e7a080a-cfe7-44ec-b967-81bfe27f5ee0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:06.207506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0e7a080a-cfe7-44ec-b967-81bfe27f5ee0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:06.225116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e7a080a-cfe7-44ec-b967-81bfe27f5ee0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:06.225867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e7a080a-cfe7-44ec-b967-81bfe27f5ee0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:06.226511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e7a080a-cfe7-44ec-b967-81bfe27f5ee0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:06.227724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e7a080a-cfe7-44ec-b967-81bfe27f5ee0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:06.228333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e7a080a-cfe7-44ec-b967-81bfe27f5ee0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:06.229437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e7a080a-cfe7-44ec-b967-81bfe27f5ee0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:06.325270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-520ad57b-fda5-4051-90b3-93fa3cc22832 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:06.341864 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-520ad57b-fda5-4051-90b3-93fa3cc22832 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 1.628942 Aug 23 18:12:06.346578 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2097/4287] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:04 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 1640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:06.875989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0e7a080a-cfe7-44ec-b967-81bfe27f5ee0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:06.889665 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0e7a080a-cfe7-44ec-b967-81bfe27f5ee0 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1508 microversion: 2.1 time: 0.688138 Aug 23 18:12:06.894257 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2191/4288] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:06 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1508 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:12:07.365512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e113ddef-6021-49a5-9101-752d693c6da5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:07.366798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e113ddef-6021-49a5-9101-752d693c6da5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:07.380811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e113ddef-6021-49a5-9101-752d693c6da5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:07.381592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e113ddef-6021-49a5-9101-752d693c6da5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:07.382209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e113ddef-6021-49a5-9101-752d693c6da5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:07.385711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e113ddef-6021-49a5-9101-752d693c6da5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:07.386413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e113ddef-6021-49a5-9101-752d693c6da5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:07.387043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e113ddef-6021-49a5-9101-752d693c6da5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:07.916779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-be20edae-8e8f-4c01-9b01-175dbfa23206 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:07.918348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-be20edae-8e8f-4c01-9b01-175dbfa23206 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:07.940041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be20edae-8e8f-4c01-9b01-175dbfa23206 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:07.940557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be20edae-8e8f-4c01-9b01-175dbfa23206 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:07.941013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be20edae-8e8f-4c01-9b01-175dbfa23206 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:07.945963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be20edae-8e8f-4c01-9b01-175dbfa23206 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:07.946500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be20edae-8e8f-4c01-9b01-175dbfa23206 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:07.947175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-be20edae-8e8f-4c01-9b01-175dbfa23206 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:09.131283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-be20edae-8e8f-4c01-9b01-175dbfa23206 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:09.154269 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-be20edae-8e8f-4c01-9b01-175dbfa23206 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1508 microversion: 2.1 time: 1.242167 Aug 23 18:12:09.160468 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2192/4289] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:07 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1508 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:09.806304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-880476187", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "b1c47b81-fba0-46d5-92e0-ad89fa024a37"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:10.032096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] validate_networks() for [('b1c47b81-fba0-46d5-92e0-ad89fa024a37', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:12:10.115883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e113ddef-6021-49a5-9101-752d693c6da5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:10.136799 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e113ddef-6021-49a5-9101-752d693c6da5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 2.776859 Aug 23 18:12:10.148626 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2098/4290] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:07 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 2789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:10.184180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2fa085be-aad0-4b8d-83af-9cff1c92f670 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:10.185181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2fa085be-aad0-4b8d-83af-9cff1c92f670 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:10.207269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fa085be-aad0-4b8d-83af-9cff1c92f670 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:10.207794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fa085be-aad0-4b8d-83af-9cff1c92f670 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:10.208252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fa085be-aad0-4b8d-83af-9cff1c92f670 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:10.232389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fa085be-aad0-4b8d-83af-9cff1c92f670 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:10.240026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fa085be-aad0-4b8d-83af-9cff1c92f670 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:10.240702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fa085be-aad0-4b8d-83af-9cff1c92f670 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:10.955905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2fa085be-aad0-4b8d-83af-9cff1c92f670 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:10.993965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=85 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:12:11.003649 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2fa085be-aad0-4b8d-83af-9cff1c92f670 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 200 len: 1466 microversion: 2.1 time: 0.823678 Aug 23 18:12:11.021781 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2099/4291] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:10 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 1466 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:11.035342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-9f467fdb-e1ac-4ed3-974f-ac6564e7814e req-f5e10fe9-05a3-45a5-a0d1-2102460a9cd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed1a8703-4973-4c42-859a-5734d134f015", "name": "network-vif-deleted", "tag": "28cb5722-a367-4d3b-a963-3b1846155944"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:11.119763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9f467fdb-e1ac-4ed3-974f-ac6564e7814e req-f5e10fe9-05a3-45a5-a0d1-2102460a9cd6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:11.129273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9f467fdb-e1ac-4ed3-974f-ac6564e7814e req-f5e10fe9-05a3-45a5-a0d1-2102460a9cd6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:11.146046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9f467fdb-e1ac-4ed3-974f-ac6564e7814e req-f5e10fe9-05a3-45a5-a0d1-2102460a9cd6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:11.240954 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-9f467fdb-e1ac-4ed3-974f-ac6564e7814e req-f5e10fe9-05a3-45a5-a0d1-2102460a9cd6 service nova] Creating event network-vif-deleted:28cb5722-a367-4d3b-a963-3b1846155944 for instance ed1a8703-4973-4c42-859a-5734d134f015 on n-h1-850468-16 Aug 23 18:12:11.269707 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-9f467fdb-e1ac-4ed3-974f-ac6564e7814e req-f5e10fe9-05a3-45a5-a0d1-2102460a9cd6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244843 Aug 23 18:12:11.279108 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2100/4292] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:11.321710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e381c3a6-5a12-4925-b78a-c40e54525461 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:11.337214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e381c3a6-5a12-4925-b78a-c40e54525461 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:11.382702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e381c3a6-5a12-4925-b78a-c40e54525461 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:11.383185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e381c3a6-5a12-4925-b78a-c40e54525461 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:11.383629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e381c3a6-5a12-4925-b78a-c40e54525461 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:11.384359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e381c3a6-5a12-4925-b78a-c40e54525461 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:11.384815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e381c3a6-5a12-4925-b78a-c40e54525461 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:11.385240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e381c3a6-5a12-4925-b78a-c40e54525461 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:13.543904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e381c3a6-5a12-4925-b78a-c40e54525461 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:13.556738 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e381c3a6-5a12-4925-b78a-c40e54525461 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 2.275444 Aug 23 18:12:13.567608 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2101/4293] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:11 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 2286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:13.579645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-42566ff8-ffa9-4392-81a3-b1a57e17c944 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:13.644851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-42566ff8-ffa9-4392-81a3-b1a57e17c944 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ed1a8703-4973-4c42-859a-5734d134f015] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:13.667217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42566ff8-ffa9-4392-81a3-b1a57e17c944 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:13.671299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42566ff8-ffa9-4392-81a3-b1a57e17c944 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:13.677612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42566ff8-ffa9-4392-81a3-b1a57e17c944 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:13.681369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42566ff8-ffa9-4392-81a3-b1a57e17c944 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:13.682058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42566ff8-ffa9-4392-81a3-b1a57e17c944 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:13.689175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:12:13.689723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:12:13.690075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:12:13.690732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:12:13.691214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:12:13.694632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42566ff8-ffa9-4392-81a3-b1a57e17c944 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:13.731240 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-42566ff8-ffa9-4392-81a3-b1a57e17c944 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] HTTP exception thrown: Instance ed1a8703-4973-4c42-859a-5734d134f015 could not be found. Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-42566ff8-ffa9-4392-81a3-b1a57e17c944 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Request method failure captured: Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 HTTP/1.1 Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRbMS5n_NsGau0vnGI0iBrS85eKgyFW2-flo5AMEagzFwHXr8y830jIBRx2ycNUqbit5tulaOzYGG8jmEgWnoI2Kij-0Ap1FvDFmaX_VNZTOBEswqTbIxjk8xyB5l_Bmsy2gQs8ixm2uUwN9H5qHjYOcvdPlZGrIYQD4Gm01UoxEIk4 Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}] Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 283c529ff2774efca184740ad6ccfdd5 Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance ed1a8703-4973-4c42-859a-5734d134f015 could not be found. Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'ed1a8703-4973-4c42-859a-5734d134f015'} Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed1a8703-4973-4c42-859a-5734d134f015 could not be found. Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed1a8703-4973-4c42-859a-5734d134f015 could not be found. Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:13.741950 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:13.746809 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:13.746809 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:13.746809 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:13.746809 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:13.746809 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:12:13.746809 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:12:13.746809 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed1a8703-4973-4c42-859a-5734d134f015 could not be found. Aug 23 18:12:13.746809 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:13.750531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-42566ff8-ffa9-4392-81a3-b1a57e17c944 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Returning 404 to user: Instance ed1a8703-4973-4c42-859a-5734d134f015 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:12:13.751976 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-42566ff8-ffa9-4392-81a3-b1a57e17c944 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015" status: 404 len: 111 microversion: 2.1 time: 0.183056 Aug 23 18:12:13.753517 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2102/4294] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:13 2022] GET /compute/v2.1/servers/ed1a8703-4973-4c42-859a-5734d134f015 => generated 111 bytes in 185 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:12:13.768933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9b38b1a9-09fc-4b17-8b5a-35c28cfaa1d2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:13.769602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:13.771710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:13.772351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:13.773370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:13.776866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:13.777296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9b38b1a9-09fc-4b17-8b5a-35c28cfaa1d2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:13.779090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:13.806291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b38b1a9-09fc-4b17-8b5a-35c28cfaa1d2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:13.807161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b38b1a9-09fc-4b17-8b5a-35c28cfaa1d2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:13.808663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b38b1a9-09fc-4b17-8b5a-35c28cfaa1d2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:13.810146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b38b1a9-09fc-4b17-8b5a-35c28cfaa1d2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:13.812785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b38b1a9-09fc-4b17-8b5a-35c28cfaa1d2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:13.814016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b38b1a9-09fc-4b17-8b5a-35c28cfaa1d2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:13.830736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:12:13.924488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Getting quotas for project afd51ecb28e844cf9257ceb2a5b2e838. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:12:13.945779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9b38b1a9-09fc-4b17-8b5a-35c28cfaa1d2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:12:13.953667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Getting quotas for user ff7b85ba5ca242cfac2a2f6f197bad23 and project afd51ecb28e844cf9257ceb2a5b2e838. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:12:14.055309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:12:14.063734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:12:14.285280 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9b38b1a9-09fc-4b17-8b5a-35c28cfaa1d2 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 204 len: 0 microversion: 2.1 time: 0.525950 Aug 23 18:12:14.286023 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2103/4295] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:12:13 2022] DELETE /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 0 bytes in 528 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:12:14.322096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ba31c4ab-c84f-48bc-9757-e44ed2879224 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:14.323582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ba31c4ab-c84f-48bc-9757-e44ed2879224 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:14.329425 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-418484dd-ab4d-4f0a-a494-eb501ce2fbb0 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.962788 Aug 23 18:12:14.350057 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2193/4296] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:12:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 4984 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:12:14.364628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-34dce80b-45cb-40ed-a5ec-322ea048389e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:14.370429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-34dce80b-45cb-40ed-a5ec-322ea048389e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:14.375868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba31c4ab-c84f-48bc-9757-e44ed2879224 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:14.377407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba31c4ab-c84f-48bc-9757-e44ed2879224 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:14.379577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba31c4ab-c84f-48bc-9757-e44ed2879224 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:14.387232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba31c4ab-c84f-48bc-9757-e44ed2879224 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:14.387936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba31c4ab-c84f-48bc-9757-e44ed2879224 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:14.410633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba31c4ab-c84f-48bc-9757-e44ed2879224 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:14.703378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-34dce80b-45cb-40ed-a5ec-322ea048389e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:14.712838 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-34dce80b-45cb-40ed-a5ec-322ea048389e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1224 microversion: 2.1 time: 0.357727 Aug 23 18:12:14.725783 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2194/4297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:14 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1224 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:14.748073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-762aaca5-6ba8-47fa-b001-d0d2f4edb901 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:14.765060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-762aaca5-6ba8-47fa-b001-d0d2f4edb901 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:14.795572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-762aaca5-6ba8-47fa-b001-d0d2f4edb901 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:14.797450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-762aaca5-6ba8-47fa-b001-d0d2f4edb901 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:14.801105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-762aaca5-6ba8-47fa-b001-d0d2f4edb901 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:14.803089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-762aaca5-6ba8-47fa-b001-d0d2f4edb901 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:14.806085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-762aaca5-6ba8-47fa-b001-d0d2f4edb901 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:14.809059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-762aaca5-6ba8-47fa-b001-d0d2f4edb901 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:15.894467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ba31c4ab-c84f-48bc-9757-e44ed2879224 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:15.905575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-762aaca5-6ba8-47fa-b001-d0d2f4edb901 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:15.918776 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ba31c4ab-c84f-48bc-9757-e44ed2879224 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1521 microversion: 2.1 time: 1.617298 Aug 23 18:12:15.919679 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2104/4298] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:14 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1521 bytes in 1629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:15.923451 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-762aaca5-6ba8-47fa-b001-d0d2f4edb901 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 1.195654 Aug 23 18:12:15.943451 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2195/4299] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:14 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 1216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:15.954918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93beed52-e821-4637-aadd-1f663f9fa1d2 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:15.960734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-93beed52-e821-4637-aadd-1f663f9fa1d2 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:16.206660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-65f03507-aa0e-4db8-a708-2cb916e16cf7 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27f1c5a8b0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-255468174", "description": "tempest-description-1473417648"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:16.246074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93beed52-e821-4637-aadd-1f663f9fa1d2 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:16.259687 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93beed52-e821-4637-aadd-1f663f9fa1d2 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1224 microversion: 2.1 time: 0.314364 Aug 23 18:12:16.260009 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2196/4300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:15 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1224 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:16.931297 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-65f03507-aa0e-4db8-a708-2cb916e16cf7 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.008504 Aug 23 18:12:16.932342 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2105/4301] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:12:15 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:16.946516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7e279f6b-fcfc-4fa8-9099-6a4a4f089384 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:16.947807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7e279f6b-fcfc-4fa8-9099-6a4a4f089384 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:16.948380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-586df16a-7d7c-4ffc-9dac-331e9e0e9986 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27f1b809d0>, body: {"security_group_rule": {"parent_group_id": "03dce1b7-cd8e-4587-9eb1-1dbca997d8b4", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:16.971138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e279f6b-fcfc-4fa8-9099-6a4a4f089384 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:16.971644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e279f6b-fcfc-4fa8-9099-6a4a4f089384 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:16.977327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e279f6b-fcfc-4fa8-9099-6a4a4f089384 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:16.981282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e279f6b-fcfc-4fa8-9099-6a4a4f089384 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:16.988084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e279f6b-fcfc-4fa8-9099-6a4a4f089384 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:16.990182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e279f6b-fcfc-4fa8-9099-6a4a4f089384 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:18.195886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7e279f6b-fcfc-4fa8-9099-6a4a4f089384 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:18.210377 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7e279f6b-fcfc-4fa8-9099-6a4a4f089384 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1521 microversion: 2.1 time: 1.269456 Aug 23 18:12:18.211038 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2197/4302] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:16 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1521 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:18.224979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d45ba320-8dfc-4fda-90fd-112b47f75d12 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:18.225628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d45ba320-8dfc-4fda-90fd-112b47f75d12 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:18.250000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d45ba320-8dfc-4fda-90fd-112b47f75d12 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:18.250509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d45ba320-8dfc-4fda-90fd-112b47f75d12 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:18.259277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d45ba320-8dfc-4fda-90fd-112b47f75d12 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:18.260267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d45ba320-8dfc-4fda-90fd-112b47f75d12 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:18.260761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d45ba320-8dfc-4fda-90fd-112b47f75d12 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:18.261200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d45ba320-8dfc-4fda-90fd-112b47f75d12 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:18.791779 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-586df16a-7d7c-4ffc-9dac-331e9e0e9986 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.847926 Aug 23 18:12:18.793328 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2106/4303] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 18:12:16 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1850 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:18.815984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4606f2f3-45d4-4dec-8406-7dd47721ebc6 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:18.818103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4606f2f3-45d4-4dec-8406-7dd47721ebc6 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:18.838282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4606f2f3-45d4-4dec-8406-7dd47721ebc6 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:18.839252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4606f2f3-45d4-4dec-8406-7dd47721ebc6 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:18.840846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4606f2f3-45d4-4dec-8406-7dd47721ebc6 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:18.844843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4606f2f3-45d4-4dec-8406-7dd47721ebc6 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:18.848060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4606f2f3-45d4-4dec-8406-7dd47721ebc6 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:18.850188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4606f2f3-45d4-4dec-8406-7dd47721ebc6 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:19.012428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4606f2f3-45d4-4dec-8406-7dd47721ebc6 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:19.026940 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4606f2f3-45d4-4dec-8406-7dd47721ebc6 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1282 microversion: 2.1 time: 0.231589 Aug 23 18:12:19.027906 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2107/4304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:18 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1282 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:19.037727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7754398e-501e-493d-9920-502c969accde tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27f1ab8670>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-473812700", "description": "tempest-description-1276030408"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:19.041216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d45ba320-8dfc-4fda-90fd-112b47f75d12 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:19.057357 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d45ba320-8dfc-4fda-90fd-112b47f75d12 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 0.845239 Aug 23 18:12:19.063760 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2198/4305] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:18 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:19.094877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-9bfe8e35-5da6-41cb-a85b-fe90cbac4edd req-0be928f4-aa7a-45d6-8514-464ff3030266 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea6af0b0-dd81-47c9-ba04-42c3612b8eec", "name": "network-vif-deleted", "tag": "f01e6452-6754-4b61-9a8a-6d65fe07fa27"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:19.140478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9bfe8e35-5da6-41cb-a85b-fe90cbac4edd req-0be928f4-aa7a-45d6-8514-464ff3030266 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:19.140879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9bfe8e35-5da6-41cb-a85b-fe90cbac4edd req-0be928f4-aa7a-45d6-8514-464ff3030266 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:19.141326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9bfe8e35-5da6-41cb-a85b-fe90cbac4edd req-0be928f4-aa7a-45d6-8514-464ff3030266 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:19.214630 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-9bfe8e35-5da6-41cb-a85b-fe90cbac4edd req-0be928f4-aa7a-45d6-8514-464ff3030266 service nova] Creating event network-vif-deleted:f01e6452-6754-4b61-9a8a-6d65fe07fa27 for instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec on n-h1-850468-16 Aug 23 18:12:19.228639 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-9bfe8e35-5da6-41cb-a85b-fe90cbac4edd req-0be928f4-aa7a-45d6-8514-464ff3030266 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163183 Aug 23 18:12:19.230857 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2199/4306] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:12:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:19.244768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:19.245509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:19.258927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:19.260975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:19.265445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:19.266942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:19.267650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:19.268319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:19.354148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:19.356875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:19.358954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:19.359882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lazy-loading 'fault' on Instance uuid ea6af0b0-dd81-47c9-ba04-42c3612b8eec {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:12:19.620133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '283c529ff2774efca184740ad6ccfdd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abd08de41b7e42c29d3e4e7c97dc9f2a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:19.630400 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d143e983-27dc-4f26-81ed-f361c32abc54 tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 200 len: 1312 microversion: 2.1 time: 0.395042 Aug 23 18:12:19.634879 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2200/4307] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:19 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 1312 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:19.840926 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7754398e-501e-493d-9920-502c969accde tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.809514 Aug 23 18:12:19.842915 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2108/4308] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:12:19 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:19.856369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-42151c87-b936-4313-a7fe-4c97f8ef4a9b tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27df6fbca0>, body: {"security_group_rule": {"parent_group_id": "cdf4ebb0-0a6d-4a10-a323-b1d11bad8f2a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:20.060025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-01f43325-4f01-4b26-a80f-e8ba6988d636 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:20.063000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-01f43325-4f01-4b26-a80f-e8ba6988d636 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:20.100526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01f43325-4f01-4b26-a80f-e8ba6988d636 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:20.105967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01f43325-4f01-4b26-a80f-e8ba6988d636 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:20.113388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01f43325-4f01-4b26-a80f-e8ba6988d636 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:20.114108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01f43325-4f01-4b26-a80f-e8ba6988d636 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:20.114826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01f43325-4f01-4b26-a80f-e8ba6988d636 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:20.115429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01f43325-4f01-4b26-a80f-e8ba6988d636 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:20.384120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-01f43325-4f01-4b26-a80f-e8ba6988d636 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:20.403195 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-01f43325-4f01-4b26-a80f-e8ba6988d636 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1282 microversion: 2.1 time: 0.352492 Aug 23 18:12:20.412280 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2109/4309] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:20 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1282 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:20.418139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7ca0f2a9-2718-48fa-9a06-b0094d87e2b6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:20.432021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7ca0f2a9-2718-48fa-9a06-b0094d87e2b6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:20.462283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ca0f2a9-2718-48fa-9a06-b0094d87e2b6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:20.464801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ca0f2a9-2718-48fa-9a06-b0094d87e2b6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:20.465651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ca0f2a9-2718-48fa-9a06-b0094d87e2b6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:20.471391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ca0f2a9-2718-48fa-9a06-b0094d87e2b6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:20.472810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ca0f2a9-2718-48fa-9a06-b0094d87e2b6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:20.473971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ca0f2a9-2718-48fa-9a06-b0094d87e2b6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:20.505306 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-42151c87-b936-4313-a7fe-4c97f8ef4a9b tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.653561 Aug 23 18:12:20.515961 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2201/4310] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 18:12:19 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:20.521902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f649a477-d1a6-42ef-a6ca-c1bc814d6ed4 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27df6a8310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1217924734", "description": "tempest-description-1014280163"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:20.867022 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f649a477-d1a6-42ef-a6ca-c1bc814d6ed4 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 0.349086 Aug 23 18:12:20.867871 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2202/4311] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:12:20 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:21.001630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-575437110", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "295a3bda-bebc-4688-88ff-6279d1c1f7c4"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:21.108810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] validate_networks() for [('295a3bda-bebc-4688-88ff-6279d1c1f7c4', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:12:21.120540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7ca0f2a9-2718-48fa-9a06-b0094d87e2b6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:21.135154 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7ca0f2a9-2718-48fa-9a06-b0094d87e2b6 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 0.720777 Aug 23 18:12:21.142959 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2110/4312] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:20 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:21.148249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5cb0310b-2783-4b56-a71f-acce5ad4f01c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:21.159569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5cb0310b-2783-4b56-a71f-acce5ad4f01c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] [instance: ea6af0b0-dd81-47c9-ba04-42c3612b8eec] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:21.174431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cb0310b-2783-4b56-a71f-acce5ad4f01c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:21.176925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cb0310b-2783-4b56-a71f-acce5ad4f01c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:21.188496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cb0310b-2783-4b56-a71f-acce5ad4f01c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:21.189525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cb0310b-2783-4b56-a71f-acce5ad4f01c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:21.190267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cb0310b-2783-4b56-a71f-acce5ad4f01c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:21.190985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cb0310b-2783-4b56-a71f-acce5ad4f01c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:21.234749 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-5cb0310b-2783-4b56-a71f-acce5ad4f01c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] HTTP exception thrown: Instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec could not be found. Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5cb0310b-2783-4b56-a71f-acce5ad4f01c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Request method failure captured: Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec HTTP/1.1 Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRbMS5n_NsGau0vnGI0iBrS85eKgyFW2-flo5AMEagzFwHXr8y830jIBRx2ycNUqbit5tulaOzYGG8jmEgWnoI2Kij-0Ap1FvDFmaX_VNZTOBEswqTbIxjk8xyB5l_Bmsy2gQs8ixm2uUwN9H5qHjYOcvdPlZGrIYQD4Gm01UoxEIk4 Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/abd08de41b7e42c29d3e4e7c97dc9f2a"}]}] Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: abd08de41b7e42c29d3e4e7c97dc9f2a Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1969892182 Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 283c529ff2774efca184740ad6ccfdd5 Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1969892182-project Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec could not be found. Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'ea6af0b0-dd81-47c9-ba04-42c3612b8eec'} Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec could not be found. Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec could not be found. Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:21.236865 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:21.240562 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:21.240562 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:21.240562 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:21.240562 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:21.240562 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:12:21.240562 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:12:21.240562 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec could not be found. Aug 23 18:12:21.240562 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:21.250752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5cb0310b-2783-4b56-a71f-acce5ad4f01c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] Returning 404 to user: Instance ea6af0b0-dd81-47c9-ba04-42c3612b8eec could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:12:21.252066 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5cb0310b-2783-4b56-a71f-acce5ad4f01c tempest-ServerRescueNegativeTestJSON-1969892182 tempest-ServerRescueNegativeTestJSON-1969892182-project] 10.222.0.61 "GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec" status: 404 len: 111 microversion: 2.1 time: 0.107759 Aug 23 18:12:21.253269 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2111/4313] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:21 2022] GET /compute/v2.1/servers/ea6af0b0-dd81-47c9-ba04-42c3612b8eec => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:12:21.264110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c8c863a-e10f-4696-8e1f-aa36fcf6d26f tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27ecdf41f0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-424547494", "description": "tempest-description-2062354454"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:21.941247 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c8c863a-e10f-4696-8e1f-aa36fcf6d26f tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.686609 Aug 23 18:12:21.944081 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2112/4314] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:12:21 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:21.949747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-db8470b4-5c4d-482a-9a20-eade71f361a4 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:21.950842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-db8470b4-5c4d-482a-9a20-eade71f361a4 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:21.994689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db8470b4-5c4d-482a-9a20-eade71f361a4 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:21.995341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db8470b4-5c4d-482a-9a20-eade71f361a4 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:21.995795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db8470b4-5c4d-482a-9a20-eade71f361a4 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:21.996529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db8470b4-5c4d-482a-9a20-eade71f361a4 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:21.996988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db8470b4-5c4d-482a-9a20-eade71f361a4 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:21.997418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db8470b4-5c4d-482a-9a20-eade71f361a4 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:22.242605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-db8470b4-5c4d-482a-9a20-eade71f361a4 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:22.252643 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-db8470b4-5c4d-482a-9a20-eade71f361a4 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1324 microversion: 2.1 time: 0.307187 Aug 23 18:12:22.269016 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2113/4315] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:21 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1324 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:22.271163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5a0d2cb1-2d85-4621-9650-e510d52d2c46 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27f1cbef70>, body: {"security_group_rule": {"parent_group_id": "3174380e-af65-44d8-9578-e4ad12c6adc7", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "ee07c69d-2c39-4532-97bf-9cc45b9b825c"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:23.417407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:12:23.417963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:12:23.418308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:12:23.418802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:12:23.419225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:12:23.448544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:23.448971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:23.449422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:23.450172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:23.478160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:23.485609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:23.598897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Getting quotas for project a8700859a7684d38a8add30fcc865803. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:12:23.642123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Getting quotas for user 28a8c2a48c3a49038700235b8af9a2fd and project a8700859a7684d38a8add30fcc865803. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:12:23.705271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:12:23.707806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:12:23.906162 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5a0d2cb1-2d85-4621-9650-e510d52d2c46 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.638763 Aug 23 18:12:23.907495 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2114/4316] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 18:12:22 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1641 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:23.912355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-641e2f11-9ae8-4152-93cf-705a3bc9a39d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:23.919002 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b7b85ead-b1ac-47a8-ac78-8b685c3c6c29 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.032404 Aug 23 18:12:23.919669 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2203/4317] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:12:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 3051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:12:23.924795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-641e2f11-9ae8-4152-93cf-705a3bc9a39d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:23.951851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-96094e56-de7a-448a-b8cd-3a67b876fe2e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:23.952782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-96094e56-de7a-448a-b8cd-3a67b876fe2e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:23.961440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641e2f11-9ae8-4152-93cf-705a3bc9a39d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:23.963819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641e2f11-9ae8-4152-93cf-705a3bc9a39d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:23.964309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641e2f11-9ae8-4152-93cf-705a3bc9a39d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:23.965084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641e2f11-9ae8-4152-93cf-705a3bc9a39d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:23.965825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641e2f11-9ae8-4152-93cf-705a3bc9a39d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:23.966270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641e2f11-9ae8-4152-93cf-705a3bc9a39d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:23.977279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96094e56-de7a-448a-b8cd-3a67b876fe2e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:23.977784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96094e56-de7a-448a-b8cd-3a67b876fe2e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:23.978229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96094e56-de7a-448a-b8cd-3a67b876fe2e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:23.978988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96094e56-de7a-448a-b8cd-3a67b876fe2e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:23.979446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96094e56-de7a-448a-b8cd-3a67b876fe2e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:23.979882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96094e56-de7a-448a-b8cd-3a67b876fe2e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:24.840907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-641e2f11-9ae8-4152-93cf-705a3bc9a39d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:24.881874 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-641e2f11-9ae8-4152-93cf-705a3bc9a39d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 0.954018 Aug 23 18:12:24.882882 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2115/4318] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:23 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:24.914816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ef5a99be-595d-41d0-9baf-76e373b19a54 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27dfa92820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1197223062", "description": "tempest-description-486746759"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:25.976744 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ef5a99be-595d-41d0-9baf-76e373b19a54 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.092726 Aug 23 18:12:25.977683 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2116/4319] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:12:24 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:25.984331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4363cd8f-eb94-45ad-b5f3-33266ae15881 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:25.984331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4363cd8f-eb94-45ad-b5f3-33266ae15881 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:26.013065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4363cd8f-eb94-45ad-b5f3-33266ae15881 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:26.013442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4363cd8f-eb94-45ad-b5f3-33266ae15881 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:26.027165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4363cd8f-eb94-45ad-b5f3-33266ae15881 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:26.033926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4363cd8f-eb94-45ad-b5f3-33266ae15881 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:26.034458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4363cd8f-eb94-45ad-b5f3-33266ae15881 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:26.038461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4363cd8f-eb94-45ad-b5f3-33266ae15881 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:26.361053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4363cd8f-eb94-45ad-b5f3-33266ae15881 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:26.370049 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4363cd8f-eb94-45ad-b5f3-33266ae15881 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1279 microversion: 2.1 time: 0.391168 Aug 23 18:12:26.385061 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2117/4320] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:25 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1279 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:26.407525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-91f73693-2f56-4c8d-a2ad-195b5ef10057 req-6b9500fd-be1a-476c-a2d7-3c2fc3ad5310 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0", "tag": "78604204-348d-41a4-8443-09bf1f947ce5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:26.461416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-91f73693-2f56-4c8d-a2ad-195b5ef10057 req-6b9500fd-be1a-476c-a2d7-3c2fc3ad5310 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:26.462227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-91f73693-2f56-4c8d-a2ad-195b5ef10057 req-6b9500fd-be1a-476c-a2d7-3c2fc3ad5310 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:26.466039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-91f73693-2f56-4c8d-a2ad-195b5ef10057 req-6b9500fd-be1a-476c-a2d7-3c2fc3ad5310 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:26.525548 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-91f73693-2f56-4c8d-a2ad-195b5ef10057 req-6b9500fd-be1a-476c-a2d7-3c2fc3ad5310 service nova] Creating event network-changed:78604204-348d-41a4-8443-09bf1f947ce5 for instance b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 on n-h1-850468-16 Aug 23 18:12:26.529898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-96094e56-de7a-448a-b8cd-3a67b876fe2e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:26.547598 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-91f73693-2f56-4c8d-a2ad-195b5ef10057 req-6b9500fd-be1a-476c-a2d7-3c2fc3ad5310 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160456 Aug 23 18:12:26.549806 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-96094e56-de7a-448a-b8cd-3a67b876fe2e tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1324 microversion: 2.1 time: 2.614463 Aug 23 18:12:26.554212 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2118/4321] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:26.555589 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2204/4322] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:23 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1324 bytes in 2635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:26.568954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7b072efa-0be2-4b67-84b0-0450f769c9f1 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27df835310>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1055236555", "description": "tempest-description-2083885683"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:26.577059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-545a89ad-a727-48ee-8c61-48d3d5bbcea4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:26.584936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-545a89ad-a727-48ee-8c61-48d3d5bbcea4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:26.636193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-545a89ad-a727-48ee-8c61-48d3d5bbcea4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:26.637072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-545a89ad-a727-48ee-8c61-48d3d5bbcea4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:26.637231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-545a89ad-a727-48ee-8c61-48d3d5bbcea4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:26.638000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-545a89ad-a727-48ee-8c61-48d3d5bbcea4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:26.638501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-545a89ad-a727-48ee-8c61-48d3d5bbcea4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:26.643715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-545a89ad-a727-48ee-8c61-48d3d5bbcea4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:27.354488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-545a89ad-a727-48ee-8c61-48d3d5bbcea4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:27.363152 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-545a89ad-a727-48ee-8c61-48d3d5bbcea4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 0.807530 Aug 23 18:12:27.363749 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2119/4323] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:26 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:27.396470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa45848c-3423-4b6f-b430-63393f8ae50a tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:27.413934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fa45848c-3423-4b6f-b430-63393f8ae50a tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:27.430172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa45848c-3423-4b6f-b430-63393f8ae50a tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:27.430709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa45848c-3423-4b6f-b430-63393f8ae50a tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:27.431178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa45848c-3423-4b6f-b430-63393f8ae50a tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:27.431868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa45848c-3423-4b6f-b430-63393f8ae50a tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:27.444800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa45848c-3423-4b6f-b430-63393f8ae50a tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:27.445270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa45848c-3423-4b6f-b430-63393f8ae50a tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:27.862987 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7b072efa-0be2-4b67-84b0-0450f769c9f1 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.305230 Aug 23 18:12:27.863921 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2205/4324] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:12:26 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:27.868731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93bc5893-91d8-4e74-8793-98ffad508d8b tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:27.869357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-93bc5893-91d8-4e74-8793-98ffad508d8b tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:27.885196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93bc5893-91d8-4e74-8793-98ffad508d8b tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:27.885702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93bc5893-91d8-4e74-8793-98ffad508d8b tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:27.886157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93bc5893-91d8-4e74-8793-98ffad508d8b tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:27.886906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93bc5893-91d8-4e74-8793-98ffad508d8b tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:27.887372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93bc5893-91d8-4e74-8793-98ffad508d8b tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:27.887805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93bc5893-91d8-4e74-8793-98ffad508d8b tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:28.512154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fa45848c-3423-4b6f-b430-63393f8ae50a tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:28.535112 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fa45848c-3423-4b6f-b430-63393f8ae50a tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1285 microversion: 2.1 time: 1.145949 Aug 23 18:12:28.539181 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2120/4325] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:27 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1285 bytes in 1153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:28.548238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93bc5893-91d8-4e74-8793-98ffad508d8b tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:28.566885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-455efe2b-f432-492d-99dc-4c41a35f5b00 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27dfa625e0>, body: {"security_group_rule": {"parent_group_id": "b30be5d3-7666-40b8-aceb-9139c315782b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "d5cb58ae-0ec2-4283-afa7-b567cc89954c"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:28.574861 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93bc5893-91d8-4e74-8793-98ffad508d8b tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1324 microversion: 2.1 time: 0.708928 Aug 23 18:12:28.593401 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2206/4326] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:27 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1324 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:28.624330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-31b158df-4843-44a9-ac29-84d3ddddcadf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:28.627339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-31b158df-4843-44a9-ac29-84d3ddddcadf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:28.673719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31b158df-4843-44a9-ac29-84d3ddddcadf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:28.674225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31b158df-4843-44a9-ac29-84d3ddddcadf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:28.674705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31b158df-4843-44a9-ac29-84d3ddddcadf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:28.675432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31b158df-4843-44a9-ac29-84d3ddddcadf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:28.675899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31b158df-4843-44a9-ac29-84d3ddddcadf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:28.676332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31b158df-4843-44a9-ac29-84d3ddddcadf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:29.180080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-31b158df-4843-44a9-ac29-84d3ddddcadf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:29.199698 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-31b158df-4843-44a9-ac29-84d3ddddcadf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 0.604763 Aug 23 18:12:29.200493 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2207/4327] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:28 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:29.558239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4185f393-0765-4d06-a4eb-d6cbf7a547f3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:29.559099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4185f393-0765-4d06-a4eb-d6cbf7a547f3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:29.569789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4185f393-0765-4d06-a4eb-d6cbf7a547f3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:29.571735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4185f393-0765-4d06-a4eb-d6cbf7a547f3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:29.573632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4185f393-0765-4d06-a4eb-d6cbf7a547f3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:29.575243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4185f393-0765-4d06-a4eb-d6cbf7a547f3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:29.576077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4185f393-0765-4d06-a4eb-d6cbf7a547f3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:29.577784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4185f393-0765-4d06-a4eb-d6cbf7a547f3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:29.896394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4185f393-0765-4d06-a4eb-d6cbf7a547f3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:29.913350 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4185f393-0765-4d06-a4eb-d6cbf7a547f3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1285 microversion: 2.1 time: 0.359857 Aug 23 18:12:29.932506 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2208/4328] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:29 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1285 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:12:29.932506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-535ac0e6-b676-4bbc-a8e4-b835c8dcfc26 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:29.932506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-535ac0e6-b676-4bbc-a8e4-b835c8dcfc26 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:29.946030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-535ac0e6-b676-4bbc-a8e4-b835c8dcfc26 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:29.946568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-535ac0e6-b676-4bbc-a8e4-b835c8dcfc26 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:29.947034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-535ac0e6-b676-4bbc-a8e4-b835c8dcfc26 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:29.951287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-535ac0e6-b676-4bbc-a8e4-b835c8dcfc26 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:29.951932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-535ac0e6-b676-4bbc-a8e4-b835c8dcfc26 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:29.952533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-535ac0e6-b676-4bbc-a8e4-b835c8dcfc26 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:30.474779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-535ac0e6-b676-4bbc-a8e4-b835c8dcfc26 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:30.484669 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-535ac0e6-b676-4bbc-a8e4-b835c8dcfc26 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1324 microversion: 2.1 time: 0.566113 Aug 23 18:12:30.498747 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2209/4329] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:29 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1324 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:30.520958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b1e1692-e06c-4656-9af7-bd92d79d58e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:30.521872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b1e1692-e06c-4656-9af7-bd92d79d58e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:30.540522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b1e1692-e06c-4656-9af7-bd92d79d58e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:30.541609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b1e1692-e06c-4656-9af7-bd92d79d58e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:30.544096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b1e1692-e06c-4656-9af7-bd92d79d58e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:30.549619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b1e1692-e06c-4656-9af7-bd92d79d58e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:30.553647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b1e1692-e06c-4656-9af7-bd92d79d58e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:30.554119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b1e1692-e06c-4656-9af7-bd92d79d58e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:31.134916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b1e1692-e06c-4656-9af7-bd92d79d58e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:31.149621 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b1e1692-e06c-4656-9af7-bd92d79d58e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 0.649346 Aug 23 18:12:31.155433 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2210/4330] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:30 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:31.172628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d281d221-aca0-4192-94d8-86f62a35d5b3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:31.173530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d281d221-aca0-4192-94d8-86f62a35d5b3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:31.191928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d281d221-aca0-4192-94d8-86f62a35d5b3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:31.193137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d281d221-aca0-4192-94d8-86f62a35d5b3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:31.195686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d281d221-aca0-4192-94d8-86f62a35d5b3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:31.197183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d281d221-aca0-4192-94d8-86f62a35d5b3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:31.199956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d281d221-aca0-4192-94d8-86f62a35d5b3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:31.201911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d281d221-aca0-4192-94d8-86f62a35d5b3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:31.539637 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-455efe2b-f432-492d-99dc-4c41a35f5b00 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 331 microversion: 2.1 time: 2.998714 Aug 23 18:12:31.540263 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2121/4331] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 18:12:28 2022] POST /compute/v2.1/os-security-group-rules => generated 331 bytes in 3000 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:31.545982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-75d34903-216e-49d8-b4cf-773d4d59a156 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:31.546904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-75d34903-216e-49d8-b4cf-773d4d59a156 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:31.565924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:12:31.601703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75d34903-216e-49d8-b4cf-773d4d59a156 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:31.602340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75d34903-216e-49d8-b4cf-773d4d59a156 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:31.602840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75d34903-216e-49d8-b4cf-773d4d59a156 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:31.611199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75d34903-216e-49d8-b4cf-773d4d59a156 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:31.611730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75d34903-216e-49d8-b4cf-773d4d59a156 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:31.612197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75d34903-216e-49d8-b4cf-773d4d59a156 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:31.908069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d281d221-aca0-4192-94d8-86f62a35d5b3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:31.926567 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d281d221-aca0-4192-94d8-86f62a35d5b3 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1327 microversion: 2.1 time: 0.760481 Aug 23 18:12:31.928367 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2211/4332] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:31 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1327 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:31.940476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-17c3bce8-76a3-4627-9d2a-366db9afe002 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Calling method '.version_select at 0x7f27ec404dc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:32.911950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-75d34903-216e-49d8-b4cf-773d4d59a156 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:32.923831 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-75d34903-216e-49d8-b4cf-773d4d59a156 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1324 microversion: 2.1 time: 1.381795 Aug 23 18:12:32.924763 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2122/4333] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:31 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1324 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:32.953077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-417df265-a6a5-45d3-84b3-96b9ebd1cb35 req-1e40b607-b222-4199-905b-dc36cc8e8b85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0", "name": "network-vif-plugged", "status": "completed", "tag": "78604204-348d-41a4-8443-09bf1f947ce5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:32.982836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-417df265-a6a5-45d3-84b3-96b9ebd1cb35 req-1e40b607-b222-4199-905b-dc36cc8e8b85 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:32.983726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-417df265-a6a5-45d3-84b3-96b9ebd1cb35 req-1e40b607-b222-4199-905b-dc36cc8e8b85 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:32.987138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-417df265-a6a5-45d3-84b3-96b9ebd1cb35 req-1e40b607-b222-4199-905b-dc36cc8e8b85 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:33.020507 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-417df265-a6a5-45d3-84b3-96b9ebd1cb35 req-1e40b607-b222-4199-905b-dc36cc8e8b85 service nova] Creating event network-vif-plugged:78604204-348d-41a4-8443-09bf1f947ce5 for instance b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 on n-h1-850468-16 Aug 23 18:12:33.095195 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-417df265-a6a5-45d3-84b3-96b9ebd1cb35 req-1e40b607-b222-4199-905b-dc36cc8e8b85 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168619 Aug 23 18:12:33.096110 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2123/4334] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:12:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:33.105753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2462c25b-48f1-47db-8d5c-7cfab4464cf8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:33.123702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2462c25b-48f1-47db-8d5c-7cfab4464cf8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:33.130287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2462c25b-48f1-47db-8d5c-7cfab4464cf8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:33.131123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2462c25b-48f1-47db-8d5c-7cfab4464cf8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:33.131752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2462c25b-48f1-47db-8d5c-7cfab4464cf8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:33.135225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2462c25b-48f1-47db-8d5c-7cfab4464cf8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:33.135225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2462c25b-48f1-47db-8d5c-7cfab4464cf8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:33.135225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2462c25b-48f1-47db-8d5c-7cfab4464cf8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:33.184217 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-17c3bce8-76a3-4627-9d2a-366db9afe002 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/d5cb58ae-0ec2-4283-afa7-b567cc89954c" status: 202 len: 0 microversion: 2.1 time: 1.252042 Aug 23 18:12:33.184937 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2212/4335] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:12:31 2022] DELETE /compute/v2.1/os-security-groups/d5cb58ae-0ec2-4283-afa7-b567cc89954c => generated 0 bytes in 1253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:12:33.191630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-24914329-8670-416b-932b-0ae247c023c5 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:33.192662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-24914329-8670-416b-932b-0ae247c023c5 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:33.208300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:12:33.231779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24914329-8670-416b-932b-0ae247c023c5 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:33.233056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24914329-8670-416b-932b-0ae247c023c5 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:33.235026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24914329-8670-416b-932b-0ae247c023c5 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:33.236052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24914329-8670-416b-932b-0ae247c023c5 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:33.239654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24914329-8670-416b-932b-0ae247c023c5 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:33.240605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24914329-8670-416b-932b-0ae247c023c5 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:33.550690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:12:33.573240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-24914329-8670-416b-932b-0ae247c023c5 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:33.606321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-24914329-8670-416b-932b-0ae247c023c5 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1327 microversion: 2.1 time: 0.416851 Aug 23 18:12:33.630446 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2213/4336] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:33 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1327 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:33.637546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1b70381d-0e77-4eeb-82ba-ce2a8abd2f5a tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Calling method '.version_select at 0x7f27ec9034c0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:33.679092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=16 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:12:33.814956 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1b70381d-0e77-4eeb-82ba-ce2a8abd2f5a tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/b30be5d3-7666-40b8-aceb-9139c315782b" status: 200 len: 247 microversion: 2.1 time: 0.182654 Aug 23 18:12:33.818258 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2214/4337] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 18:12:33 2022] GET /compute/v2.1/os-security-groups/b30be5d3-7666-40b8-aceb-9139c315782b => generated 247 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:33.835178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2525cd4e-bba6-444f-a2b7-8c0b3e6c963a tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27df702ca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1313619940", "description": "tempest-description-853138267"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:34.118700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2462c25b-48f1-47db-8d5c-7cfab4464cf8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:34.134858 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2462c25b-48f1-47db-8d5c-7cfab4464cf8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1523 microversion: 2.1 time: 1.029401 Aug 23 18:12:34.136150 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2124/4338] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:33 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1523 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:34.152429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2aa4fa92-9cd3-4db3-9d86-8e9b50b2be22 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:34.157356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2aa4fa92-9cd3-4db3-9d86-8e9b50b2be22 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:34.181577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2aa4fa92-9cd3-4db3-9d86-8e9b50b2be22 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:34.182091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2aa4fa92-9cd3-4db3-9d86-8e9b50b2be22 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:34.182781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2aa4fa92-9cd3-4db3-9d86-8e9b50b2be22 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:34.188422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2aa4fa92-9cd3-4db3-9d86-8e9b50b2be22 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:34.189231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2aa4fa92-9cd3-4db3-9d86-8e9b50b2be22 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:34.189839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2aa4fa92-9cd3-4db3-9d86-8e9b50b2be22 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:34.248161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:12:34.553980 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2525cd4e-bba6-444f-a2b7-8c0b3e6c963a tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.723289 Aug 23 18:12:34.555829 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2215/4339] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:12:33 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:34.561284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-d059fbc7-8296-41e0-941c-038f966555b7 req-6a65c4f6-f0fb-43de-bfb2-807c85078209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d61fbe90-3dd6-4f04-875d-3698c0b59e8c", "tag": "9b5a8182-498f-4605-8e3e-3da36d734aee"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:34.574366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d059fbc7-8296-41e0-941c-038f966555b7 req-6a65c4f6-f0fb-43de-bfb2-807c85078209 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:34.576286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d059fbc7-8296-41e0-941c-038f966555b7 req-6a65c4f6-f0fb-43de-bfb2-807c85078209 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:34.577082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d059fbc7-8296-41e0-941c-038f966555b7 req-6a65c4f6-f0fb-43de-bfb2-807c85078209 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:34.592574 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-d059fbc7-8296-41e0-941c-038f966555b7 req-6a65c4f6-f0fb-43de-bfb2-807c85078209 service nova] Creating event network-changed:9b5a8182-498f-4605-8e3e-3da36d734aee for instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c on n-h2-850468-16 Aug 23 18:12:34.601272 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-d059fbc7-8296-41e0-941c-038f966555b7 req-6a65c4f6-f0fb-43de-bfb2-807c85078209 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041700 Aug 23 18:12:34.604715 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2216/4340] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:34.611322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d397c6fd-3158-4796-93eb-efcd921bae07 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:34.611887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d397c6fd-3158-4796-93eb-efcd921bae07 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:34.621611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d397c6fd-3158-4796-93eb-efcd921bae07 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:34.622120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d397c6fd-3158-4796-93eb-efcd921bae07 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:34.622580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d397c6fd-3158-4796-93eb-efcd921bae07 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:34.623346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d397c6fd-3158-4796-93eb-efcd921bae07 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:34.623810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d397c6fd-3158-4796-93eb-efcd921bae07 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:34.624276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d397c6fd-3158-4796-93eb-efcd921bae07 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:34.746897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2aa4fa92-9cd3-4db3-9d86-8e9b50b2be22 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:34.747399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-d397c6fd-3158-4796-93eb-efcd921bae07 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lazy-loading 'services' on Instance uuid ed6c1be2-7bf0-4c16-a14d-46116f1a6509 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:12:34.763264 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2aa4fa92-9cd3-4db3-9d86-8e9b50b2be22 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1324 microversion: 2.1 time: 0.624923 Aug 23 18:12:34.765072 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2125/4341] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:34 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1324 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:34.771567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5dc9ad35-73ea-4a8d-a974-5acd1798db5b tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27dfa62280>, body: {"security_group_rule": {"parent_group_id": "6fd24753-fcdd-4441-8b09-414aa0c698d0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:34.853553 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d397c6fd-3158-4796-93eb-efcd921bae07 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509/os-volume_attachments/a5732a99-229c-4933-b4a0-b1b1856b7a39" status: 202 len: 0 microversion: 2.1 time: 0.246650 Aug 23 18:12:34.857854 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2217/4342] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 18:12:34 2022] DELETE /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509/os-volume_attachments/a5732a99-229c-4933-b4a0-b1b1856b7a39 => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:12:34.878303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8afd27f0-53bb-46de-80a2-d43ff9b41023 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:34.879809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8afd27f0-53bb-46de-80a2-d43ff9b41023 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:34.887956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8afd27f0-53bb-46de-80a2-d43ff9b41023 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:34.889336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8afd27f0-53bb-46de-80a2-d43ff9b41023 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:34.889990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8afd27f0-53bb-46de-80a2-d43ff9b41023 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:34.890980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8afd27f0-53bb-46de-80a2-d43ff9b41023 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:34.891792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8afd27f0-53bb-46de-80a2-d43ff9b41023 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:34.892435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8afd27f0-53bb-46de-80a2-d43ff9b41023 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:35.383364 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5dc9ad35-73ea-4a8d-a974-5acd1798db5b tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.616781 Aug 23 18:12:35.391354 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2126/4343] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 18:12:34 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:35.396873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-30f7cdab-972d-4bab-803e-8b08fab5f6b1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:35.397577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-30f7cdab-972d-4bab-803e-8b08fab5f6b1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:35.413830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30f7cdab-972d-4bab-803e-8b08fab5f6b1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:35.415653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30f7cdab-972d-4bab-803e-8b08fab5f6b1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:35.416101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30f7cdab-972d-4bab-803e-8b08fab5f6b1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:35.419150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30f7cdab-972d-4bab-803e-8b08fab5f6b1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:35.422588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30f7cdab-972d-4bab-803e-8b08fab5f6b1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:35.423080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30f7cdab-972d-4bab-803e-8b08fab5f6b1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:35.560118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8afd27f0-53bb-46de-80a2-d43ff9b41023 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:35.568908 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8afd27f0-53bb-46de-80a2-d43ff9b41023 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1327 microversion: 2.1 time: 0.698720 Aug 23 18:12:35.569951 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2218/4344] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:34 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1327 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:35.576203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5d55522d-921f-48eb-95e9-128f9871b53e tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Action: 'create', calling method: .version_select at 0x7f27df6a34c0>, body: {"security_group_rule": {"parent_group_id": "6fd24753-fcdd-4441-8b09-414aa0c698d0", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:35.720618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-30f7cdab-972d-4bab-803e-8b08fab5f6b1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:35.732523 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-30f7cdab-972d-4bab-803e-8b08fab5f6b1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1505 microversion: 2.1 time: 0.338174 Aug 23 18:12:35.732523 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2127/4345] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:35 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1505 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:35.786286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-10c38a42-d0da-4850-a718-fe88ab8ead08 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:35.787020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-10c38a42-d0da-4850-a718-fe88ab8ead08 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:35.794737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10c38a42-d0da-4850-a718-fe88ab8ead08 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:35.795334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10c38a42-d0da-4850-a718-fe88ab8ead08 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:35.795780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10c38a42-d0da-4850-a718-fe88ab8ead08 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:35.799759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10c38a42-d0da-4850-a718-fe88ab8ead08 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:35.800288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10c38a42-d0da-4850-a718-fe88ab8ead08 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:35.800803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10c38a42-d0da-4850-a718-fe88ab8ead08 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:36.022307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-10c38a42-d0da-4850-a718-fe88ab8ead08 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:36.033647 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-10c38a42-d0da-4850-a718-fe88ab8ead08 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1521 microversion: 2.1 time: 0.252986 Aug 23 18:12:36.035133 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2128/4346] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:35 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1521 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:36.064834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e581a8f2-f227-481a-9589-d87cf7c3e556 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:36.066056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e581a8f2-f227-481a-9589-d87cf7c3e556 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:36.085830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e581a8f2-f227-481a-9589-d87cf7c3e556 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:36.086419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e581a8f2-f227-481a-9589-d87cf7c3e556 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:36.086912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e581a8f2-f227-481a-9589-d87cf7c3e556 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:36.088761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e581a8f2-f227-481a-9589-d87cf7c3e556 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:36.090722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e581a8f2-f227-481a-9589-d87cf7c3e556 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:36.091441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e581a8f2-f227-481a-9589-d87cf7c3e556 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:36.146021 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5d55522d-921f-48eb-95e9-128f9871b53e tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.574581 Aug 23 18:12:36.146643 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2219/4347] 10.222.0.61 () {60 vars in 1195 bytes} [Tue Aug 23 18:12:35 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:36.161768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1bbce5b-1a86-4c0f-aa0d-74819ae10ba3 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Calling method '.version_select at 0x7f27ec845160>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:36.165866 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-e581a8f2-f227-481a-9589-d87cf7c3e556 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] HTTP exception thrown: Action 999 not found Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e581a8f2-f227-481a-9589-d87cf7c3e556 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Request method failure captured: Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0/os-instance-actions/999 HTTP/1.1 Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRh4lhRWcuWpwZB0vNy4cxmSNid8SYgJG3pwi3dULzMFHo5AQhjD-xKEIJoLsPbGKPQtJhHT9nN0DxgkStIaqAxwKXCOazRJ-OxYwVVxJFbFQMa_wf0-PQURslSsrhDxctmVaCkc8VznQgmWfBVREsujSGLMlUD5Xf-6scLVqfBimxQ Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: afd51ecb28e844cf9257ceb2a5b2e838 Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1556818653 Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_afd51ecb28e844cf9257ceb2a5b2e838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/afd51ecb28e844cf9257ceb2a5b2e838"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/afd51ecb28e844cf9257ceb2a5b2e838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/afd51ecb28e844cf9257ceb2a5b2e838"}]}] Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1556818653 Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: afd51ecb28e844cf9257ceb2a5b2e838 Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1556818653 Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-InstanceActionsNegativeTestJSON-1556818653-project Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: ff7b85ba5ca242cfac2a2f6f197bad23 Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1556818653-project Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: exception: Action 999 not found Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': 'b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0', 'id': '999'} Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Aug 23 18:12:36.172193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:36.180710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e581a8f2-f227-481a-9589-d87cf7c3e556 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Returning 404 to user: Action 999 not found {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:12:36.180710 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e581a8f2-f227-481a-9589-d87cf7c3e556 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.121714 Aug 23 18:12:36.180710 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2129/4348] 10.222.0.61 () {58 vars in 1308 bytes} [Tue Aug 23 18:12:36 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0/os-instance-actions/999 => generated 66 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:12:36.197003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-692d7983-9f66-4310-9e3d-db42654ed085 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '.version_select at 0x7f27f1cbe0d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:36.197518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-692d7983-9f66-4310-9e3d-db42654ed085 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: 1b3cf991-6175-4be3-996f-56e54327fc0a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:36.209092 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-692d7983-9f66-4310-9e3d-db42654ed085 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] HTTP exception thrown: Instance 1b3cf991-6175-4be3-996f-56e54327fc0a could not be found. Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-692d7983-9f66-4310-9e3d-db42654ed085 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Request method failure captured: Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/1b3cf991-6175-4be3-996f-56e54327fc0a/os-instance-actions HTTP/1.1 Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRh4lhRWcuWpwZB0vNy4cxmSNid8SYgJG3pwi3dULzMFHo5AQhjD-xKEIJoLsPbGKPQtJhHT9nN0DxgkStIaqAxwKXCOazRJ-OxYwVVxJFbFQMa_wf0-PQURslSsrhDxctmVaCkc8VznQgmWfBVREsujSGLMlUD5Xf-6scLVqfBimxQ Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: afd51ecb28e844cf9257ceb2a5b2e838 Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1556818653 Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_afd51ecb28e844cf9257ceb2a5b2e838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/afd51ecb28e844cf9257ceb2a5b2e838"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/afd51ecb28e844cf9257ceb2a5b2e838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/afd51ecb28e844cf9257ceb2a5b2e838"}]}] Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1556818653 Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: afd51ecb28e844cf9257ceb2a5b2e838 Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1556818653 Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-InstanceActionsNegativeTestJSON-1556818653-project Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: ff7b85ba5ca242cfac2a2f6f197bad23 Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1556818653-project Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 1b3cf991-6175-4be3-996f-56e54327fc0a could not be found. Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': '1b3cf991-6175-4be3-996f-56e54327fc0a'} Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1b3cf991-6175-4be3-996f-56e54327fc0a could not be found. Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:12:36.212094 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:12:36.218832 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1b3cf991-6175-4be3-996f-56e54327fc0a could not be found. Aug 23 18:12:36.218832 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:36.218832 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:36.218832 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:36.218832 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:36.218832 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:36.218832 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:36.218832 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:12:36.218832 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:12:36.218832 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1b3cf991-6175-4be3-996f-56e54327fc0a could not be found. Aug 23 18:12:36.218832 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:36.221067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-692d7983-9f66-4310-9e3d-db42654ed085 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Returning 404 to user: Instance 1b3cf991-6175-4be3-996f-56e54327fc0a could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:12:36.222319 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-692d7983-9f66-4310-9e3d-db42654ed085 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/1b3cf991-6175-4be3-996f-56e54327fc0a/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.030596 Aug 23 18:12:36.226971 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2130/4349] 10.222.0.61 () {58 vars in 1296 bytes} [Tue Aug 23 18:12:36 2022] GET /compute/v2.1/servers/1b3cf991-6175-4be3-996f-56e54327fc0a/os-instance-actions => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:12:36.233034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95d0d0ef-0759-4db3-b92b-cfb9818f60ed tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:36.233539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-95d0d0ef-0759-4db3-b92b-cfb9818f60ed tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:36.243228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95d0d0ef-0759-4db3-b92b-cfb9818f60ed tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:36.244479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95d0d0ef-0759-4db3-b92b-cfb9818f60ed tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:36.247243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95d0d0ef-0759-4db3-b92b-cfb9818f60ed tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:36.248765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95d0d0ef-0759-4db3-b92b-cfb9818f60ed tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:36.249477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95d0d0ef-0759-4db3-b92b-cfb9818f60ed tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:36.250076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95d0d0ef-0759-4db3-b92b-cfb9818f60ed tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:36.267557 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d1bbce5b-1a86-4c0f-aa0d-74819ae10ba3 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "GET /compute/v2.1/os-security-groups/6fd24753-fcdd-4441-8b09-414aa0c698d0" status: 200 len: 664 microversion: 2.1 time: 0.112992 Aug 23 18:12:36.275675 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2220/4350] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 18:12:36 2022] GET /compute/v2.1/os-security-groups/6fd24753-fcdd-4441-8b09-414aa0c698d0 => generated 664 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:36.282059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-41031ca1-e3eb-4411-a25c-fb7d5a72e303 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Calling method '.version_select at 0x7f27df6aa310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:36.299978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-95d0d0ef-0759-4db3-b92b-cfb9818f60ed tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:12:36.439368 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-95d0d0ef-0759-4db3-b92b-cfb9818f60ed tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 204 len: 0 microversion: 2.1 time: 0.211048 Aug 23 18:12:36.441801 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2131/4351] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:12:36 2022] DELETE /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:12:36.457433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7a9e808a-8d25-402b-8a0f-92760d7b3ab1 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:36.458609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7a9e808a-8d25-402b-8a0f-92760d7b3ab1 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:36.473227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9e808a-8d25-402b-8a0f-92760d7b3ab1 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:36.474064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9e808a-8d25-402b-8a0f-92760d7b3ab1 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:36.474522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9e808a-8d25-402b-8a0f-92760d7b3ab1 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:36.475268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9e808a-8d25-402b-8a0f-92760d7b3ab1 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:36.476059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9e808a-8d25-402b-8a0f-92760d7b3ab1 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:36.476672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9e808a-8d25-402b-8a0f-92760d7b3ab1 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:36.691953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7a9e808a-8d25-402b-8a0f-92760d7b3ab1 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:36.706404 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7a9e808a-8d25-402b-8a0f-92760d7b3ab1 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1527 microversion: 2.1 time: 0.261056 Aug 23 18:12:36.707087 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2132/4352] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:36 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1527 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:36.724095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8035b7bf-5d30-4c03-9e94-a0e53667a90b tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:36.724833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8035b7bf-5d30-4c03-9e94-a0e53667a90b tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:36.737366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8035b7bf-5d30-4c03-9e94-a0e53667a90b tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:36.738437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8035b7bf-5d30-4c03-9e94-a0e53667a90b tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:36.740328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8035b7bf-5d30-4c03-9e94-a0e53667a90b tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:36.741359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8035b7bf-5d30-4c03-9e94-a0e53667a90b tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:36.742612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8035b7bf-5d30-4c03-9e94-a0e53667a90b tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:36.746470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8035b7bf-5d30-4c03-9e94-a0e53667a90b tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:36.749464 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-41031ca1-e3eb-4411-a25c-fb7d5a72e303 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-group-rules/bc4ba16d-d993-49f1-a539-e2571cbc6b06" status: 202 len: 0 microversion: 2.1 time: 0.471971 Aug 23 18:12:36.754582 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2221/4353] 10.222.0.61 () {58 vars in 1287 bytes} [Tue Aug 23 18:12:36 2022] DELETE /compute/v2.1/os-security-group-rules/bc4ba16d-d993-49f1-a539-e2571cbc6b06 => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:12:36.760591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7263631a-1708-44d0-9a5f-f01e5266f204 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:36.763459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7263631a-1708-44d0-9a5f-f01e5266f204 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:36.773286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7263631a-1708-44d0-9a5f-f01e5266f204 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:36.774224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7263631a-1708-44d0-9a5f-f01e5266f204 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:36.774939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7263631a-1708-44d0-9a5f-f01e5266f204 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:36.775900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7263631a-1708-44d0-9a5f-f01e5266f204 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:36.777444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7263631a-1708-44d0-9a5f-f01e5266f204 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:36.778530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7263631a-1708-44d0-9a5f-f01e5266f204 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:36.802865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:12:36.921073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8035b7bf-5d30-4c03-9e94-a0e53667a90b tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:36.932557 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8035b7bf-5d30-4c03-9e94-a0e53667a90b tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1327 microversion: 2.1 time: 0.219142 Aug 23 18:12:36.933362 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2133/4354] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:36 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1327 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:36.938789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81a6f9f7-d750-4b46-858d-f4eeac146808 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Calling method '.version_select at 0x7f27ecb253a0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:37.065563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7263631a-1708-44d0-9a5f-f01e5266f204 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:37.086406 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7263631a-1708-44d0-9a5f-f01e5266f204 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1505 microversion: 2.1 time: 0.333375 Aug 23 18:12:37.088909 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2222/4355] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:36 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1505 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:37.332614 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81a6f9f7-d750-4b46-858d-f4eeac146808 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/6fd24753-fcdd-4441-8b09-414aa0c698d0" status: 202 len: 0 microversion: 2.1 time: 0.398131 Aug 23 18:12:37.333184 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2134/4356] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:12:36 2022] DELETE /compute/v2.1/os-security-groups/6fd24753-fcdd-4441-8b09-414aa0c698d0 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:12:37.342433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-050d0439-f95d-4f43-acf7-a504036564e9 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Calling method '.version_select at 0x7f27ec903670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:37.366374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG neutronclient.v2_0.client [None req-050d0439-f95d-4f43-acf7-a504036564e9 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group d5cb58ae-0ec2-4283-afa7-b567cc89954c does not exist", "detail": ""}} {{(pid=128808) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Aug 23 18:12:37.367112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.security_group_api [None req-050d0439-f95d-4f43-acf7-a504036564e9 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Neutron security group d5cb58ae-0ec2-4283-afa7-b567cc89954c not found {{(pid=128808) get /opt/stack/nova/nova/network/security_group_api.py:313}} Aug 23 18:12:37.367954 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-050d0439-f95d-4f43-acf7-a504036564e9 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] HTTP exception thrown: Security group d5cb58ae-0ec2-4283-afa7-b567cc89954c does not exist Aug 23 18:12:37.367954 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-4063457b-32f4-4b69-81ef-53adbf5dc8ef'] Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-050d0439-f95d-4f43-acf7-a504036564e9 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Request method failure captured: Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/os-security-groups/d5cb58ae-0ec2-4283-afa7-b567cc89954c HTTP/1.1 Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRh-hjNNMTz11cX1VxTolA2Mtumt-C8_3tt5nh5jyuSzDXfLESIKugPbflcenBT7kd1TZ3ztmM-fkHoDYdO1ZYduq9gmanM5vsQ4VC6g0RzSkYoFWc8tGgv3r4SgUsaXoiWgcLyScckJHeC62YEIjUhjiPr87QZ56-QDjdllWBYrS7M Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d6257fdc3d6b4eccbbadcd28167e16d3 Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-686705821 Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d6257fdc3d6b4eccbbadcd28167e16d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d6257fdc3d6b4eccbbadcd28167e16d3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d6257fdc3d6b4eccbbadcd28167e16d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d6257fdc3d6b4eccbbadcd28167e16d3"}]}] Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-SecurityGroupRulesTestJSON-686705821 Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d6257fdc3d6b4eccbbadcd28167e16d3 Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-686705821 Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-SecurityGroupRulesTestJSON-686705821-project Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4063a4feab9c4f89bad035188cff84e0 Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-SecurityGroupRulesTestJSON-686705821-project Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: exception: Security group d5cb58ae-0ec2-4283-afa7-b567cc89954c does not exist Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-4063457b-32f4-4b69-81ef-53adbf5dc8ef'] Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'd5cb58ae-0ec2-4283-afa7-b567cc89954c'} Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1040, in show_security_group Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Aug 23 18:12:37.370132 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group d5cb58ae-0ec2-4283-afa7-b567cc89954c does not exist Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4063457b-32f4-4b69-81ef-53adbf5dc8ef'] Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group d5cb58ae-0ec2-4283-afa7-b567cc89954c does not exist Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4063457b-32f4-4b69-81ef-53adbf5dc8ef'] Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group d5cb58ae-0ec2-4283-afa7-b567cc89954c does not exist Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4063457b-32f4-4b69-81ef-53adbf5dc8ef'] Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group d5cb58ae-0ec2-4283-afa7-b567cc89954c does not exist Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4063457b-32f4-4b69-81ef-53adbf5dc8ef'] Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-050d0439-f95d-4f43-acf7-a504036564e9 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Returning 404 to user: Security group d5cb58ae-0ec2-4283-afa7-b567cc89954c does not exist Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: Neutron server returns request_ids: ['req-4063457b-32f4-4b69-81ef-53adbf5dc8ef'] {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:12:37.375489 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-050d0439-f95d-4f43-acf7-a504036564e9 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/d5cb58ae-0ec2-4283-afa7-b567cc89954c" status: 404 len: 194 microversion: 2.1 time: 0.036772 Aug 23 18:12:37.378752 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2223/4357] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:12:37 2022] DELETE /compute/v2.1/os-security-groups/d5cb58ae-0ec2-4283-afa7-b567cc89954c => generated 194 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:12:37.384568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49757ad8-70c8-440d-bded-162509aaeed9 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Calling method '.version_select at 0x7f27ecaa7430>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:37.727632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-46474308-1405-4f64-a9ed-0c7e2fc8d404 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:37.728613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-46474308-1405-4f64-a9ed-0c7e2fc8d404 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:37.739955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46474308-1405-4f64-a9ed-0c7e2fc8d404 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:37.740833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46474308-1405-4f64-a9ed-0c7e2fc8d404 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:37.741506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46474308-1405-4f64-a9ed-0c7e2fc8d404 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:37.743019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46474308-1405-4f64-a9ed-0c7e2fc8d404 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:37.743739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46474308-1405-4f64-a9ed-0c7e2fc8d404 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:37.744398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-46474308-1405-4f64-a9ed-0c7e2fc8d404 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:38.085793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-46474308-1405-4f64-a9ed-0c7e2fc8d404 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:38.099894 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-46474308-1405-4f64-a9ed-0c7e2fc8d404 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1527 microversion: 2.1 time: 0.376219 Aug 23 18:12:38.100500 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2224/4358] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:37 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1527 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:38.119193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ad8f5083-5ed8-48ce-884e-d5a38d53c151 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:38.120612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ad8f5083-5ed8-48ce-884e-d5a38d53c151 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:38.136917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad8f5083-5ed8-48ce-884e-d5a38d53c151 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:38.138054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad8f5083-5ed8-48ce-884e-d5a38d53c151 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:38.139560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad8f5083-5ed8-48ce-884e-d5a38d53c151 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:38.140555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad8f5083-5ed8-48ce-884e-d5a38d53c151 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:38.141227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad8f5083-5ed8-48ce-884e-d5a38d53c151 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:38.142113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad8f5083-5ed8-48ce-884e-d5a38d53c151 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:38.375200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ad8f5083-5ed8-48ce-884e-d5a38d53c151 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:38.393365 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ad8f5083-5ed8-48ce-884e-d5a38d53c151 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1327 microversion: 2.1 time: 0.289490 Aug 23 18:12:38.394312 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2225/4359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:38 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1327 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:38.409930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7ab5a070-c6a4-4aa5-bad3-c6244c5dbc38 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:38.410661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7ab5a070-c6a4-4aa5-bad3-c6244c5dbc38 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:38.422692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ab5a070-c6a4-4aa5-bad3-c6244c5dbc38 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:38.423444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ab5a070-c6a4-4aa5-bad3-c6244c5dbc38 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:38.424032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ab5a070-c6a4-4aa5-bad3-c6244c5dbc38 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:38.424928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ab5a070-c6a4-4aa5-bad3-c6244c5dbc38 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:38.425545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ab5a070-c6a4-4aa5-bad3-c6244c5dbc38 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:38.426146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ab5a070-c6a4-4aa5-bad3-c6244c5dbc38 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:38.476218 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49757ad8-70c8-440d-bded-162509aaeed9 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/b30be5d3-7666-40b8-aceb-9139c315782b" status: 202 len: 0 microversion: 2.1 time: 1.095403 Aug 23 18:12:38.480885 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2135/4360] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:12:37 2022] DELETE /compute/v2.1/os-security-groups/b30be5d3-7666-40b8-aceb-9139c315782b => generated 0 bytes in 1098 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:12:38.487108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-271d077f-0b5b-47b1-a62b-3d53c8fed549 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Calling method '.version_select at 0x7f27ec9ecaf0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:38.581897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7ab5a070-c6a4-4aa5-bad3-c6244c5dbc38 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:38.598692 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7ab5a070-c6a4-4aa5-bad3-c6244c5dbc38 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1505 microversion: 2.1 time: 0.203411 Aug 23 18:12:38.599288 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2226/4361] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:38 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:39.124230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-515fe89b-e863-4224-b7a9-076989d9b0cf tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:39.125688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-515fe89b-e863-4224-b7a9-076989d9b0cf tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:39.140138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-515fe89b-e863-4224-b7a9-076989d9b0cf tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:39.143692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-515fe89b-e863-4224-b7a9-076989d9b0cf tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:39.144336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-515fe89b-e863-4224-b7a9-076989d9b0cf tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:39.145222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-515fe89b-e863-4224-b7a9-076989d9b0cf tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:39.148871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-515fe89b-e863-4224-b7a9-076989d9b0cf tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:39.149887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-515fe89b-e863-4224-b7a9-076989d9b0cf tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:39.473545 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-271d077f-0b5b-47b1-a62b-3d53c8fed549 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/ee07c69d-2c39-4532-97bf-9cc45b9b825c" status: 202 len: 0 microversion: 2.1 time: 0.991287 Aug 23 18:12:39.477777 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2136/4362] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:12:38 2022] DELETE /compute/v2.1/os-security-groups/ee07c69d-2c39-4532-97bf-9cc45b9b825c => generated 0 bytes in 996 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:12:39.478461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-515fe89b-e863-4224-b7a9-076989d9b0cf tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:39.483453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b6b7e144-2dfb-49c5-b945-1001460fc997 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:39.484098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b6b7e144-2dfb-49c5-b945-1001460fc997 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:39.491291 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-515fe89b-e863-4224-b7a9-076989d9b0cf tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1527 microversion: 2.1 time: 0.371718 Aug 23 18:12:39.492497 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2227/4363] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:39 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1527 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:39.504857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6b7e144-2dfb-49c5-b945-1001460fc997 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:39.505373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6b7e144-2dfb-49c5-b945-1001460fc997 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:39.505824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6b7e144-2dfb-49c5-b945-1001460fc997 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:39.506608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6b7e144-2dfb-49c5-b945-1001460fc997 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:39.507033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6b7e144-2dfb-49c5-b945-1001460fc997 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:39.508598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6b7e144-2dfb-49c5-b945-1001460fc997 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:39.511091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6f00e999-fe24-4149-bee5-25225c1632dc tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Calling method '.version_select at 0x7f27df702e50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:39.836475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b6b7e144-2dfb-49c5-b945-1001460fc997 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:39.851900 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b6b7e144-2dfb-49c5-b945-1001460fc997 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1327 microversion: 2.1 time: 0.372057 Aug 23 18:12:39.855200 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2137/4364] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:39 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1327 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:39.887637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c3fa7c3-66bd-4354-b0b8-1b3c258eac22 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:39.889533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5c3fa7c3-66bd-4354-b0b8-1b3c258eac22 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:39.917889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c3fa7c3-66bd-4354-b0b8-1b3c258eac22 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:39.920739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c3fa7c3-66bd-4354-b0b8-1b3c258eac22 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:39.921439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c3fa7c3-66bd-4354-b0b8-1b3c258eac22 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:39.922395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c3fa7c3-66bd-4354-b0b8-1b3c258eac22 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:39.923094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c3fa7c3-66bd-4354-b0b8-1b3c258eac22 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:39.925581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c3fa7c3-66bd-4354-b0b8-1b3c258eac22 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:40.166074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5c3fa7c3-66bd-4354-b0b8-1b3c258eac22 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:40.176949 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5c3fa7c3-66bd-4354-b0b8-1b3c258eac22 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1505 microversion: 2.1 time: 0.306196 Aug 23 18:12:40.188894 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2138/4365] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:39 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:40.194973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-809c88dd-37ec-4ae3-bd09-8fd04b46e1b4 req-95f50215-3d0a-44b0-8087-9be515e8092d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0", "name": "network-vif-deleted", "tag": "78604204-348d-41a4-8443-09bf1f947ce5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:40.214741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-809c88dd-37ec-4ae3-bd09-8fd04b46e1b4 req-95f50215-3d0a-44b0-8087-9be515e8092d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:40.215935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-809c88dd-37ec-4ae3-bd09-8fd04b46e1b4 req-95f50215-3d0a-44b0-8087-9be515e8092d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:40.217178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-809c88dd-37ec-4ae3-bd09-8fd04b46e1b4 req-95f50215-3d0a-44b0-8087-9be515e8092d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:40.233370 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-809c88dd-37ec-4ae3-bd09-8fd04b46e1b4 req-95f50215-3d0a-44b0-8087-9be515e8092d service nova] Creating event network-vif-deleted:78604204-348d-41a4-8443-09bf1f947ce5 for instance b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 on n-h1-850468-16 Aug 23 18:12:40.239192 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-809c88dd-37ec-4ae3-bd09-8fd04b46e1b4 req-95f50215-3d0a-44b0-8087-9be515e8092d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048718 Aug 23 18:12:40.240519 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2139/4366] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:40.247600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-789277ff-d4bf-4840-bafd-cfb289351f85 req-9f4353da-00a1-46a2-90e7-92d891315c9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210941bf-76d0-4c84-a56c-f3b4e6679e8c", "name": "network-vif-unplugged", "status": "completed", "tag": "473d8513-68ee-4307-bd65-283eeb1b9620"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:40.258964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-789277ff-d4bf-4840-bafd-cfb289351f85 req-9f4353da-00a1-46a2-90e7-92d891315c9d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:40.260594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-789277ff-d4bf-4840-bafd-cfb289351f85 req-9f4353da-00a1-46a2-90e7-92d891315c9d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:40.261346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-789277ff-d4bf-4840-bafd-cfb289351f85 req-9f4353da-00a1-46a2-90e7-92d891315c9d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:40.276202 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-789277ff-d4bf-4840-bafd-cfb289351f85 req-9f4353da-00a1-46a2-90e7-92d891315c9d service nova] Creating event network-vif-unplugged:473d8513-68ee-4307-bd65-283eeb1b9620 for instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c on n-h2-850468-16 Aug 23 18:12:40.283883 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-789277ff-d4bf-4840-bafd-cfb289351f85 req-9f4353da-00a1-46a2-90e7-92d891315c9d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041505 Aug 23 18:12:40.285532 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2140/4367] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:40.437431 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6f00e999-fe24-4149-bee5-25225c1632dc tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/3174380e-af65-44d8-9578-e4ad12c6adc7" status: 202 len: 0 microversion: 2.1 time: 0.943498 Aug 23 18:12:40.439727 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2228/4368] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:12:39 2022] DELETE /compute/v2.1/os-security-groups/3174380e-af65-44d8-9578-e4ad12c6adc7 => generated 0 bytes in 946 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:12:40.452839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e01a60cf-8bba-4cff-bee6-6c4dc04ff3c4 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Calling method '.version_select at 0x7f27ec0eeee0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:40.518985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:40.519872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:40.538839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:40.543475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:40.545894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:40.547381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:40.548015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:40.548626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:40.636235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:40.636744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:40.637193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:40.638277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lazy-loading 'fault' on Instance uuid b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:12:40.688380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff7b85ba5ca242cfac2a2f6f197bad23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd51ecb28e844cf9257ceb2a5b2e838', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:40.717675 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7a21ac86-7bbb-4e17-972f-1fc7e2ad1c9d tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 200 len: 1314 microversion: 2.1 time: 0.204039 Aug 23 18:12:40.718633 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2229/4369] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:40 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:12:40.885024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d031536e-6a6c-41d8-962c-c616c8b60869 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:40.886658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d031536e-6a6c-41d8-962c-c616c8b60869 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:40.897144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d031536e-6a6c-41d8-962c-c616c8b60869 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:40.898059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d031536e-6a6c-41d8-962c-c616c8b60869 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:40.898726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d031536e-6a6c-41d8-962c-c616c8b60869 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:40.900686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d031536e-6a6c-41d8-962c-c616c8b60869 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:40.901314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d031536e-6a6c-41d8-962c-c616c8b60869 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:40.902344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d031536e-6a6c-41d8-962c-c616c8b60869 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:41.165575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d031536e-6a6c-41d8-962c-c616c8b60869 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:41.215037 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d031536e-6a6c-41d8-962c-c616c8b60869 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1327 microversion: 2.1 time: 0.336235 Aug 23 18:12:41.217448 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2230/4370] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:40 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1327 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:12:41.238356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-de910595-cfd3-41bc-b72c-a1b2f1ef0150 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:41.242984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-de910595-cfd3-41bc-b72c-a1b2f1ef0150 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:41.261302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de910595-cfd3-41bc-b72c-a1b2f1ef0150 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:41.264388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de910595-cfd3-41bc-b72c-a1b2f1ef0150 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:41.266938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de910595-cfd3-41bc-b72c-a1b2f1ef0150 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:41.276029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de910595-cfd3-41bc-b72c-a1b2f1ef0150 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:41.277126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de910595-cfd3-41bc-b72c-a1b2f1ef0150 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:41.278104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de910595-cfd3-41bc-b72c-a1b2f1ef0150 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:41.544410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-de910595-cfd3-41bc-b72c-a1b2f1ef0150 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:41.556885 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-de910595-cfd3-41bc-b72c-a1b2f1ef0150 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1505 microversion: 2.1 time: 0.328599 Aug 23 18:12:41.557689 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2231/4371] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:41 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1505 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:41.745709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9356515e-0461-42d7-8d35-c9bacdab2346 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:41.747061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9356515e-0461-42d7-8d35-c9bacdab2346 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] [instance: b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:41.747274 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:12:41.748720 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 18:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-security-groups/cdf4ebb0-0a6d-4a10-a323-b1d11bad8f2a (ip 10.222.0.61) !!! Aug 23 18:12:41.758118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9356515e-0461-42d7-8d35-c9bacdab2346 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:41.759918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9356515e-0461-42d7-8d35-c9bacdab2346 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:41.760406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9356515e-0461-42d7-8d35-c9bacdab2346 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:41.762379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9356515e-0461-42d7-8d35-c9bacdab2346 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:41.762947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9356515e-0461-42d7-8d35-c9bacdab2346 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:41.764161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9356515e-0461-42d7-8d35-c9bacdab2346 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:41.775976 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e01a60cf-8bba-4cff-bee6-6c4dc04ff3c4 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/cdf4ebb0-0a6d-4a10-a323-b1d11bad8f2a" status: 202 len: 0 microversion: 2.1 time: 1.330963 Aug 23 18:12:41.777517 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2141/4372] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:12:40 2022] DELETE /compute/v2.1/os-security-groups/cdf4ebb0-0a6d-4a10-a323-b1d11bad8f2a => generated 0 bytes in 1333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:12:41.786614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-11674232-ae3a-4bab-bf49-6390502331c6 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] Calling method '.version_select at 0x7f27f1b80dc0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:41.810892 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-9356515e-0461-42d7-8d35-c9bacdab2346 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] HTTP exception thrown: Instance b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 could not be found. Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9356515e-0461-42d7-8d35-c9bacdab2346 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Request method failure captured: Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 HTTP/1.1 Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRh4lhRWcuWpwZB0vNy4cxmSNid8SYgJG3pwi3dULzMFHo5AQhjD-xKEIJoLsPbGKPQtJhHT9nN0DxgkStIaqAxwKXCOazRJ-OxYwVVxJFbFQMa_wf0-PQURslSsrhDxctmVaCkc8VznQgmWfBVREsujSGLMlUD5Xf-6scLVqfBimxQ Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: afd51ecb28e844cf9257ceb2a5b2e838 Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1556818653 Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_afd51ecb28e844cf9257ceb2a5b2e838"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/afd51ecb28e844cf9257ceb2a5b2e838"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/afd51ecb28e844cf9257ceb2a5b2e838"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/afd51ecb28e844cf9257ceb2a5b2e838"}]}] Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1556818653 Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: afd51ecb28e844cf9257ceb2a5b2e838 Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1556818653 Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-InstanceActionsNegativeTestJSON-1556818653-project Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: ff7b85ba5ca242cfac2a2f6f197bad23 Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1556818653-project Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 could not be found. Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0'} Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 could not be found. Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 could not be found. Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:41.814906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:41.820647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:41.820647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:41.820647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:41.820647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:41.820647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:12:41.820647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:12:41.820647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 could not be found. Aug 23 18:12:41.820647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:41.820647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9356515e-0461-42d7-8d35-c9bacdab2346 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] Returning 404 to user: Instance b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:12:41.827901 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9356515e-0461-42d7-8d35-c9bacdab2346 tempest-InstanceActionsNegativeTestJSON-1556818653 tempest-InstanceActionsNegativeTestJSON-1556818653-project] 10.222.0.61 "GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0" status: 404 len: 111 microversion: 2.1 time: 0.086130 Aug 23 18:12:41.866687 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2232/4373] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:41 2022] GET /compute/v2.1/servers/b9cc7da6-9fef-4a06-ab4a-ac7af6fa18f0 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:12:42.255497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-708f7519-0b55-4100-812b-4c6e358f4ac8 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:42.256124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-708f7519-0b55-4100-812b-4c6e358f4ac8 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:42.263528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-708f7519-0b55-4100-812b-4c6e358f4ac8 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:42.264578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-708f7519-0b55-4100-812b-4c6e358f4ac8 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:42.265198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-708f7519-0b55-4100-812b-4c6e358f4ac8 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:42.266099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-708f7519-0b55-4100-812b-4c6e358f4ac8 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:42.266769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-708f7519-0b55-4100-812b-4c6e358f4ac8 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:42.267361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-708f7519-0b55-4100-812b-4c6e358f4ac8 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:42.503884 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-11674232-ae3a-4bab-bf49-6390502331c6 tempest-SecurityGroupRulesTestJSON-686705821 tempest-SecurityGroupRulesTestJSON-686705821-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/03dce1b7-cd8e-4587-9eb1-1dbca997d8b4" status: 202 len: 0 microversion: 2.1 time: 0.722067 Aug 23 18:12:42.504477 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2142/4374] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:12:41 2022] DELETE /compute/v2.1/os-security-groups/03dce1b7-cd8e-4587-9eb1-1dbca997d8b4 => generated 0 bytes in 724 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:12:42.509035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-db28d296-9fc9-414e-b82f-4e69a4a8776c req-01be7203-f0e5-41e9-b72e-432c3ebbe389 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61fbe90-3dd6-4f04-875d-3698c0b59e8c", "name": "network-vif-plugged", "status": "completed", "tag": "9b5a8182-498f-4605-8e3e-3da36d734aee"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:42.526697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-db28d296-9fc9-414e-b82f-4e69a4a8776c req-01be7203-f0e5-41e9-b72e-432c3ebbe389 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:42.527183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-db28d296-9fc9-414e-b82f-4e69a4a8776c req-01be7203-f0e5-41e9-b72e-432c3ebbe389 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:42.527612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-db28d296-9fc9-414e-b82f-4e69a4a8776c req-01be7203-f0e5-41e9-b72e-432c3ebbe389 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:42.541911 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-db28d296-9fc9-414e-b82f-4e69a4a8776c req-01be7203-f0e5-41e9-b72e-432c3ebbe389 service nova] Creating event network-vif-plugged:9b5a8182-498f-4605-8e3e-3da36d734aee for instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c on n-h2-850468-16 Aug 23 18:12:42.550304 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-db28d296-9fc9-414e-b82f-4e69a4a8776c req-01be7203-f0e5-41e9-b72e-432c3ebbe389 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044440 Aug 23 18:12:42.553400 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2143/4375] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:42.580564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ba5a4e0-432f-41a3-990d-40f9dd63ded9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:42.581864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9ba5a4e0-432f-41a3-990d-40f9dd63ded9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:42.599050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ba5a4e0-432f-41a3-990d-40f9dd63ded9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:42.599548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ba5a4e0-432f-41a3-990d-40f9dd63ded9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:42.599991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ba5a4e0-432f-41a3-990d-40f9dd63ded9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:42.609393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ba5a4e0-432f-41a3-990d-40f9dd63ded9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:42.609929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ba5a4e0-432f-41a3-990d-40f9dd63ded9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:42.610381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ba5a4e0-432f-41a3-990d-40f9dd63ded9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:43.008198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-708f7519-0b55-4100-812b-4c6e358f4ac8 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:43.016914 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-708f7519-0b55-4100-812b-4c6e358f4ac8 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1327 microversion: 2.1 time: 0.765118 Aug 23 18:12:43.017513 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2233/4376] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:42 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1327 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:43.030957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51f588a4-c020-4599-943a-87e9180db6c6 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:43.031473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51f588a4-c020-4599-943a-87e9180db6c6 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:43.042269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51f588a4-c020-4599-943a-87e9180db6c6 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:43.055406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51f588a4-c020-4599-943a-87e9180db6c6 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:43.056156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51f588a4-c020-4599-943a-87e9180db6c6 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:43.057112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51f588a4-c020-4599-943a-87e9180db6c6 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:43.057592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51f588a4-c020-4599-943a-87e9180db6c6 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:43.058004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51f588a4-c020-4599-943a-87e9180db6c6 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:43.106486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51f588a4-c020-4599-943a-87e9180db6c6 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:12:43.230953 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51f588a4-c020-4599-943a-87e9180db6c6 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 204 len: 0 microversion: 2.1 time: 0.211954 Aug 23 18:12:43.231920 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2234/4377] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:12:43 2022] DELETE /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:12:43.242939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2f40e0da-3765-4ddd-8a6e-ed71a8c6b0ff tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:43.244118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2f40e0da-3765-4ddd-8a6e-ed71a8c6b0ff tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:43.252896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f40e0da-3765-4ddd-8a6e-ed71a8c6b0ff tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:43.253755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f40e0da-3765-4ddd-8a6e-ed71a8c6b0ff tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:43.254345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f40e0da-3765-4ddd-8a6e-ed71a8c6b0ff tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:43.255356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f40e0da-3765-4ddd-8a6e-ed71a8c6b0ff tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:43.255905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f40e0da-3765-4ddd-8a6e-ed71a8c6b0ff tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:43.256544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f40e0da-3765-4ddd-8a6e-ed71a8c6b0ff tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:43.532452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9ba5a4e0-432f-41a3-990d-40f9dd63ded9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:43.542442 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9ba5a4e0-432f-41a3-990d-40f9dd63ded9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 200 len: 1448 microversion: 2.1 time: 0.967120 Aug 23 18:12:43.548616 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2144/4378] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:42 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 1448 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:43.572168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:43.572925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:43.583097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:43.586306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:43.586971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:43.587933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:43.589594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:43.592096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:43.629293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:12:43.644965 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.compute.api [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Working on deleting snapshot 4d4ab17d-0748-4b18-ae9e-5a483cc217c7 from shelved instance... Aug 23 18:12:43.740948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2f40e0da-3765-4ddd-8a6e-ed71a8c6b0ff tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:43.755016 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2f40e0da-3765-4ddd-8a6e-ed71a8c6b0ff tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1513 microversion: 2.1 time: 0.517099 Aug 23 18:12:43.766563 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2235/4379] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:43 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1513 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:44.037579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a841e2b3-d1fa-4a21-b468-602a3620c4d4 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:44.038198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a841e2b3-d1fa-4a21-b468-602a3620c4d4 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:44.044768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a841e2b3-d1fa-4a21-b468-602a3620c4d4 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:44.045597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a841e2b3-d1fa-4a21-b468-602a3620c4d4 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:44.046901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a841e2b3-d1fa-4a21-b468-602a3620c4d4 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:44.047854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a841e2b3-d1fa-4a21-b468-602a3620c4d4 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:44.048527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a841e2b3-d1fa-4a21-b468-602a3620c4d4 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:44.049534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a841e2b3-d1fa-4a21-b468-602a3620c4d4 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:44.456639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Doing local delete in cell 410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) {{(pid=128807) _delete /opt/stack/nova/nova/compute/api.py:2533}} Aug 23 18:12:44.457738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:44.458469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:44.459094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:44.460015 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.compute.api [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Aug 23 18:12:44.471543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] deallocate_for_instance() {{(pid=128807) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1783}} Aug 23 18:12:44.648698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a841e2b3-d1fa-4a21-b468-602a3620c4d4 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:44.664253 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a841e2b3-d1fa-4a21-b468-602a3620c4d4 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1327 microversion: 2.1 time: 0.630140 Aug 23 18:12:44.665016 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2236/4380] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:44 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1327 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:44.784097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b7c8d7d-a705-4d0c-822c-4ec73f092866 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:44.784795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b7c8d7d-a705-4d0c-822c-4ec73f092866 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:44.798124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7c8d7d-a705-4d0c-822c-4ec73f092866 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:44.799981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7c8d7d-a705-4d0c-822c-4ec73f092866 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:44.800718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7c8d7d-a705-4d0c-822c-4ec73f092866 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:44.807040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7c8d7d-a705-4d0c-822c-4ec73f092866 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:44.807781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7c8d7d-a705-4d0c-822c-4ec73f092866 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:44.808939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b7c8d7d-a705-4d0c-822c-4ec73f092866 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:45.337866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b7c8d7d-a705-4d0c-822c-4ec73f092866 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:45.359468 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b7c8d7d-a705-4d0c-822c-4ec73f092866 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1513 microversion: 2.1 time: 0.583890 Aug 23 18:12:45.382287 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2237/4381] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:44 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1513 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:12:45.687382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e435215-fdea-4746-939a-03b0c9aa82bd tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:45.688017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e435215-fdea-4746-939a-03b0c9aa82bd tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:45.700208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e435215-fdea-4746-939a-03b0c9aa82bd tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:45.701271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e435215-fdea-4746-939a-03b0c9aa82bd tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:45.701719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e435215-fdea-4746-939a-03b0c9aa82bd tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:45.702449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e435215-fdea-4746-939a-03b0c9aa82bd tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:45.714055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e435215-fdea-4746-939a-03b0c9aa82bd tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:45.718757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e435215-fdea-4746-939a-03b0c9aa82bd tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:45.799245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Updating instance_info_cache with network_info: [] {{(pid=128807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 18:12:46.218495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:12:46.416687 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-922e60fb-0a55-4e0e-b8eb-c2a0714e2341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 204 len: 0 microversion: 2.1 time: 2.848238 Aug 23 18:12:46.421082 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2145/4382] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:12:43 2022] DELETE /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 0 bytes in 2850 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:12:46.430200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ae3e4f33-41bd-4b78-916e-b33ec8705df2 req-b79f8d92-013d-415f-9d2e-09fff6aab8c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "210941bf-76d0-4c84-a56c-f3b4e6679e8c", "name": "network-vif-deleted", "tag": "473d8513-68ee-4307-bd65-283eeb1b9620"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:46.458150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ae3e4f33-41bd-4b78-916e-b33ec8705df2 req-b79f8d92-013d-415f-9d2e-09fff6aab8c2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:46.458671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ae3e4f33-41bd-4b78-916e-b33ec8705df2 req-b79f8d92-013d-415f-9d2e-09fff6aab8c2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:46.459248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ae3e4f33-41bd-4b78-916e-b33ec8705df2 req-b79f8d92-013d-415f-9d2e-09fff6aab8c2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:46.473032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.compute.server_external_events [req-ae3e4f33-41bd-4b78-916e-b33ec8705df2 req-b79f8d92-013d-415f-9d2e-09fff6aab8c2 service nova] Unable to find a host for instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c. Dropping event network-vif-deleted {{(pid=128807) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 18:12:46.474094 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ae3e4f33-41bd-4b78-916e-b33ec8705df2 req-b79f8d92-013d-415f-9d2e-09fff6aab8c2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.053402 Aug 23 18:12:46.475156 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2146/4383] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 55 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 18:12:46.480007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:46.480631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:46.487446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:46.487863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:46.488302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:46.489003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:46.489761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:46.490189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:46.528260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:46.529660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:46.530342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:46.531068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lazy-loading 'fault' on Instance uuid ed6c1be2-7bf0-4c16-a14d-46116f1a6509 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:12:46.585834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:46.595497 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-09803c46-c091-4c14-bbbf-1205676965f4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 200 len: 1308 microversion: 2.1 time: 0.119126 Aug 23 18:12:46.596857 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2147/4384] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:46 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 1308 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:46.603067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-76231bc7-0b21-4702-ba59-1c6e3bdd5cd2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:46.603690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-76231bc7-0b21-4702-ba59-1c6e3bdd5cd2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:46.614093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76231bc7-0b21-4702-ba59-1c6e3bdd5cd2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:46.614889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76231bc7-0b21-4702-ba59-1c6e3bdd5cd2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:46.615520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76231bc7-0b21-4702-ba59-1c6e3bdd5cd2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:46.617281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76231bc7-0b21-4702-ba59-1c6e3bdd5cd2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:46.618899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76231bc7-0b21-4702-ba59-1c6e3bdd5cd2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:46.619511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76231bc7-0b21-4702-ba59-1c6e3bdd5cd2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:46.642272 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-76231bc7-0b21-4702-ba59-1c6e3bdd5cd2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-76231bc7-0b21-4702-ba59-1c6e3bdd5cd2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c HTTP/1.1 Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '210941bf-76d0-4c84-a56c-f3b4e6679e8c'} Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:46.644145 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:46.662101 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:46.662101 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:46.662101 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:46.662101 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:12:46.662101 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:12:46.662101 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:12:46.662101 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:46.662101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-76231bc7-0b21-4702-ba59-1c6e3bdd5cd2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:12:46.662101 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-76231bc7-0b21-4702-ba59-1c6e3bdd5cd2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 404 len: 111 microversion: 2.1 time: 0.047872 Aug 23 18:12:46.662101 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2148/4385] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:46 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:12:46.896061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-904260807", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "2590bb5f-8ace-41d9-ae28-2d05e6f1fbab"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:47.007235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] validate_networks() for [('2590bb5f-8ace-41d9-ae28-2d05e6f1fbab', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:12:47.209761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8e435215-fdea-4746-939a-03b0c9aa82bd tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:47.232610 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e435215-fdea-4746-939a-03b0c9aa82bd tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1527 microversion: 2.1 time: 1.550501 Aug 23 18:12:47.235169 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2238/4386] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:45 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1527 bytes in 1555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:47.259566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ed848fa0-0d87-4e94-8fa9-9129215cdaff tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:47.269643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ed848fa0-0d87-4e94-8fa9-9129215cdaff tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:47.288710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed848fa0-0d87-4e94-8fa9-9129215cdaff tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:47.289733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed848fa0-0d87-4e94-8fa9-9129215cdaff tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:47.294910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed848fa0-0d87-4e94-8fa9-9129215cdaff tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:47.296711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed848fa0-0d87-4e94-8fa9-9129215cdaff tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:47.298300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed848fa0-0d87-4e94-8fa9-9129215cdaff tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:47.299150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed848fa0-0d87-4e94-8fa9-9129215cdaff tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:48.378983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ed848fa0-0d87-4e94-8fa9-9129215cdaff tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:48.394064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:12:48.398219 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ed848fa0-0d87-4e94-8fa9-9129215cdaff tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1527 microversion: 2.1 time: 1.144907 Aug 23 18:12:48.400376 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2239/4387] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:47 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1527 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:48.409835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f6a0a4e-ceb9-4db2-b887-79122c84f66a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:48.412895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0f6a0a4e-ceb9-4db2-b887-79122c84f66a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: ed6c1be2-7bf0-4c16-a14d-46116f1a6509] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:48.433790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f6a0a4e-ceb9-4db2-b887-79122c84f66a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:48.434511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f6a0a4e-ceb9-4db2-b887-79122c84f66a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:48.436404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f6a0a4e-ceb9-4db2-b887-79122c84f66a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:48.436909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:12:48.437367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:12:48.437718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f6a0a4e-ceb9-4db2-b887-79122c84f66a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:48.437869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:12:48.438564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:12:48.439161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:12:48.439338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f6a0a4e-ceb9-4db2-b887-79122c84f66a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:48.440136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f6a0a4e-ceb9-4db2-b887-79122c84f66a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:48.452080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:48.453598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:48.454560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:48.455798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:48.456439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:48.457856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:48.486084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:12:48.491144 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-0f6a0a4e-ceb9-4db2-b887-79122c84f66a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] HTTP exception thrown: Instance ed6c1be2-7bf0-4c16-a14d-46116f1a6509 could not be found. Aug 23 18:12:48.492730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for user 2380358bc6a7496ead343b351bce816d and project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f6a0a4e-ceb9-4db2-b887-79122c84f66a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Request method failure captured: Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 HTTP/1.1 Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRfRrC6abzuROug8r882K5DvWKG2RBxPXdElUYKqDbKsiy1k2y9xz_1U81Ew6FS4QqwBGRx5-GQmCLy2pXtEGWsLjg9Jdx5y2661MhdwHcIY4nxaARYzjwlEcyceUsEyoNbI40AaF19KbkJByzmH6T3JS2HuFRs3MUIkWAM0vh_rJaY Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 9e278101a495492392fa362c67532636 Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1826063488 Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9e278101a495492392fa362c67532636"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9e278101a495492392fa362c67532636"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9e278101a495492392fa362c67532636"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9e278101a495492392fa362c67532636"}]}] Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-VolumesSnapshotTestJSON-1826063488 Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 9e278101a495492392fa362c67532636 Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1826063488 Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-VolumesSnapshotTestJSON-1826063488-project Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: e9247aeda1a84edd9408d95a6e9290cd Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-VolumesSnapshotTestJSON-1826063488-project Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance ed6c1be2-7bf0-4c16-a14d-46116f1a6509 could not be found. Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'ed6c1be2-7bf0-4c16-a14d-46116f1a6509'} Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed6c1be2-7bf0-4c16-a14d-46116f1a6509 could not be found. Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed6c1be2-7bf0-4c16-a14d-46116f1a6509 could not be found. Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:48.501362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:48.506135 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:48.506135 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:48.506135 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:48.506135 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:12:48.506135 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:12:48.506135 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed6c1be2-7bf0-4c16-a14d-46116f1a6509 could not be found. Aug 23 18:12:48.506135 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:48.514762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f6a0a4e-ceb9-4db2-b887-79122c84f66a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Returning 404 to user: Instance ed6c1be2-7bf0-4c16-a14d-46116f1a6509 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:12:48.515956 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0f6a0a4e-ceb9-4db2-b887-79122c84f66a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509" status: 404 len: 111 microversion: 2.1 time: 0.113598 Aug 23 18:12:48.517946 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2240/4388] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:48 2022] GET /compute/v2.1/servers/ed6c1be2-7bf0-4c16-a14d-46116f1a6509 => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:12:48.518628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:12:48.521120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:12:48.679306 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fe0eb7cb-794a-4077-b8e6-2283dca84859 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.787371 Aug 23 18:12:48.681153 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2149/4389] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:12:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 1790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:12:48.689105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-047c2580-9ffe-4be0-ba10-d6c1c236f534 req-7960228c-6709-413b-a31f-d204cb72d0da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ed6c1be2-7bf0-4c16-a14d-46116f1a6509", "name": "network-vif-deleted", "tag": "b80341b3-8af4-48b9-8bf9-0ee25e7a336e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:48.722428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-047c2580-9ffe-4be0-ba10-d6c1c236f534 req-7960228c-6709-413b-a31f-d204cb72d0da service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:48.723936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-047c2580-9ffe-4be0-ba10-d6c1c236f534 req-7960228c-6709-413b-a31f-d204cb72d0da service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:48.724503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-047c2580-9ffe-4be0-ba10-d6c1c236f534 req-7960228c-6709-413b-a31f-d204cb72d0da service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:48.739502 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-047c2580-9ffe-4be0-ba10-d6c1c236f534 req-7960228c-6709-413b-a31f-d204cb72d0da service nova] Creating event network-vif-deleted:b80341b3-8af4-48b9-8bf9-0ee25e7a336e for instance ed6c1be2-7bf0-4c16-a14d-46116f1a6509 on n-h1-850468-16 Aug 23 18:12:48.766320 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-047c2580-9ffe-4be0-ba10-d6c1c236f534 req-7960228c-6709-413b-a31f-d204cb72d0da service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079305 Aug 23 18:12:48.769833 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2150/4390] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:48.782472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dfffe715-d2e2-457f-9952-1682e26f3987 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:48.783792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dfffe715-d2e2-457f-9952-1682e26f3987 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:48.912561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-73f1f374-70b7-4162-af5b-f068fa7074b0 tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:48.920934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-73f1f374-70b7-4162-af5b-f068fa7074b0 tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:48.933125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f1f374-70b7-4162-af5b-f068fa7074b0 tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:48.933894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f1f374-70b7-4162-af5b-f068fa7074b0 tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:48.934563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f1f374-70b7-4162-af5b-f068fa7074b0 tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:48.936235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f1f374-70b7-4162-af5b-f068fa7074b0 tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:48.936871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f1f374-70b7-4162-af5b-f068fa7074b0 tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:48.937494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f1f374-70b7-4162-af5b-f068fa7074b0 tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:49.003230 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-73f1f374-70b7-4162-af5b-f068fa7074b0 tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] HTTP exception thrown: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-73f1f374-70b7-4162-af5b-f068fa7074b0 tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Request method failure captured: Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c HTTP/1.1 Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRiD1Ng5rUOsgw7FPfrRjFyTgNbFBdfg3VsfIW2q0PLQWKdNEl8LPGqylep1ISTGv9vByg81QuKt7uyav0NLpCBWzeoBFmLXbwy7_6ym_kDz1PkrswCwnwzd2Y5wiCarE_vimwej43RzcXIglCUF4TWs3lECIQrRgSwOsGgSPeUKX4U Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 6bc73a5bb86a48119352d6221f5511a0 Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-19376983 Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6bc73a5bb86a48119352d6221f5511a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6bc73a5bb86a48119352d6221f5511a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6bc73a5bb86a48119352d6221f5511a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6bc73a5bb86a48119352d6221f5511a0"}]}] Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-19376983 Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 6bc73a5bb86a48119352d6221f5511a0 Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-19376983 Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestMultiTenantJSON-19376983-project Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 705ed072c1ef4fc68a33e2fe915d4829 Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-19376983-project Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'd61fbe90-3dd6-4f04-875d-3698c0b59e8c'} Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:12:49.008264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-73f1f374-70b7-4162-af5b-f068fa7074b0 tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Returning 404 to user: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:12:49.011892 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-73f1f374-70b7-4162-af5b-f068fa7074b0 tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 404 len: 111 microversion: 2.1 time: 0.490558 Aug 23 18:12:49.021976 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2241/4391] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:12:48 2022] DELETE /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 111 bytes in 501 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:12:49.041552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b5e1c4fd-6b16-4ebb-8dc2-cc0454d1cab1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:49.045158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b5e1c4fd-6b16-4ebb-8dc2-cc0454d1cab1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:49.061888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5e1c4fd-6b16-4ebb-8dc2-cc0454d1cab1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:49.064737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5e1c4fd-6b16-4ebb-8dc2-cc0454d1cab1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:49.067309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5e1c4fd-6b16-4ebb-8dc2-cc0454d1cab1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:49.071047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5e1c4fd-6b16-4ebb-8dc2-cc0454d1cab1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:49.072051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5e1c4fd-6b16-4ebb-8dc2-cc0454d1cab1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:49.072758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5e1c4fd-6b16-4ebb-8dc2-cc0454d1cab1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:49.104097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dfffe715-d2e2-457f-9952-1682e26f3987 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:49.116129 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dfffe715-d2e2-457f-9952-1682e26f3987 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1214 microversion: 2.1 time: 0.342722 Aug 23 18:12:49.134305 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2151/4392] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:48 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1214 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:50.000940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b5e1c4fd-6b16-4ebb-8dc2-cc0454d1cab1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:50.043363 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b5e1c4fd-6b16-4ebb-8dc2-cc0454d1cab1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1527 microversion: 2.1 time: 1.016393 Aug 23 18:12:50.047738 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2242/4393] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:49 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1527 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:50.081064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-464f0ac7-1cab-4690-b119-184396b650fe tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Action: 'update', calling method: >, body: {"server": {"name": "d61fbe90-3dd6-4f04-875d-3698c0b59e8c_new"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:50.084961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-464f0ac7-1cab-4690-b119-184396b650fe tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:50.103979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-464f0ac7-1cab-4690-b119-184396b650fe tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:50.104723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-464f0ac7-1cab-4690-b119-184396b650fe tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:50.105475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-464f0ac7-1cab-4690-b119-184396b650fe tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:50.106396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-464f0ac7-1cab-4690-b119-184396b650fe tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:50.111595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-464f0ac7-1cab-4690-b119-184396b650fe tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:50.113284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-464f0ac7-1cab-4690-b119-184396b650fe tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:50.145963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ddb41c0b-e6a9-45b6-b6ef-5cc5454c3c8e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:50.147072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ddb41c0b-e6a9-45b6-b6ef-5cc5454c3c8e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:50.167266 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-464f0ac7-1cab-4690-b119-184396b650fe tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] HTTP exception thrown: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:50.167645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb41c0b-e6a9-45b6-b6ef-5cc5454c3c8e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:50.181112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb41c0b-e6a9-45b6-b6ef-5cc5454c3c8e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:50.189079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb41c0b-e6a9-45b6-b6ef-5cc5454c3c8e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-464f0ac7-1cab-4690-b119-184396b650fe tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Request method failure captured: Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: request: PUT /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c HTTP/1.1 Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 64 Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRiD1Ng5rUOsgw7FPfrRjFyTgNbFBdfg3VsfIW2q0PLQWKdNEl8LPGqylep1ISTGv9vByg81QuKt7uyav0NLpCBWzeoBFmLXbwy7_6ym_kDz1PkrswCwnwzd2Y5wiCarE_vimwej43RzcXIglCUF4TWs3lECIQrRgSwOsGgSPeUKX4U Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 6bc73a5bb86a48119352d6221f5511a0 Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-19376983 Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6bc73a5bb86a48119352d6221f5511a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6bc73a5bb86a48119352d6221f5511a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6bc73a5bb86a48119352d6221f5511a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6bc73a5bb86a48119352d6221f5511a0"}]}] Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-19376983 Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 6bc73a5bb86a48119352d6221f5511a0 Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-19376983 Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestMultiTenantJSON-19376983-project Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 705ed072c1ef4fc68a33e2fe915d4829 Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-19376983-project Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "d61fbe90-3dd6-4f04-875d-3698c0b59e8c_new"}} Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'd61fbe90-3dd6-4f04-875d-3698c0b59e8c', 'body': {'server': {'name': 'd61fbe90-3dd6-4f04-875d-3698c0b59e8c_new'}}} Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 18:12:50.189538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:50.194461 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:50.198353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb41c0b-e6a9-45b6-b6ef-5cc5454c3c8e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:50.198780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-464f0ac7-1cab-4690-b119-184396b650fe tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] Returning 404 to user: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:12:50.199900 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-464f0ac7-1cab-4690-b119-184396b650fe tempest-ServersNegativeTestMultiTenantJSON-19376983 tempest-ServersNegativeTestMultiTenantJSON-19376983-project] 10.222.0.61 "PUT /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 404 len: 111 microversion: 2.1 time: 0.130364 Aug 23 18:12:50.201026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb41c0b-e6a9-45b6-b6ef-5cc5454c3c8e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:50.202020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb41c0b-e6a9-45b6-b6ef-5cc5454c3c8e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:50.206074 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2152/4394] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Aug 23 18:12:50 2022] PUT /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 111 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:12:50.224349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5117a056-f4ee-4c9f-9a03-a7834f80a4ec tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:50.230325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5117a056-f4ee-4c9f-9a03-a7834f80a4ec tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:50.244941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5117a056-f4ee-4c9f-9a03-a7834f80a4ec tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:50.269351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5117a056-f4ee-4c9f-9a03-a7834f80a4ec tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:50.269953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5117a056-f4ee-4c9f-9a03-a7834f80a4ec tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:50.270786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5117a056-f4ee-4c9f-9a03-a7834f80a4ec tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:50.271268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5117a056-f4ee-4c9f-9a03-a7834f80a4ec tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:50.289496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5117a056-f4ee-4c9f-9a03-a7834f80a4ec tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:50.358464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5117a056-f4ee-4c9f-9a03-a7834f80a4ec tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:12:50.394099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ddb41c0b-e6a9-45b6-b6ef-5cc5454c3c8e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:50.407904 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ddb41c0b-e6a9-45b6-b6ef-5cc5454c3c8e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1266 microversion: 2.1 time: 0.270058 Aug 23 18:12:50.408754 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2243/4395] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:50 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:50.554684 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5117a056-f4ee-4c9f-9a03-a7834f80a4ec tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 204 len: 0 microversion: 2.1 time: 0.343807 Aug 23 18:12:50.555602 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2153/4396] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:12:50 2022] DELETE /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:12:50.564957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-543b90e3-96b3-4c83-8fe4-ae2221f0ce02 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:50.565815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-543b90e3-96b3-4c83-8fe4-ae2221f0ce02 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:50.576776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-543b90e3-96b3-4c83-8fe4-ae2221f0ce02 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:50.579065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-543b90e3-96b3-4c83-8fe4-ae2221f0ce02 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:50.579683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-543b90e3-96b3-4c83-8fe4-ae2221f0ce02 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:50.582036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-543b90e3-96b3-4c83-8fe4-ae2221f0ce02 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:50.582706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-543b90e3-96b3-4c83-8fe4-ae2221f0ce02 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:50.585219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-543b90e3-96b3-4c83-8fe4-ae2221f0ce02 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:51.211819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-543b90e3-96b3-4c83-8fe4-ae2221f0ce02 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:51.228161 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-543b90e3-96b3-4c83-8fe4-ae2221f0ce02 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1533 microversion: 2.1 time: 0.667352 Aug 23 18:12:51.242441 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2244/4397] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:50 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1533 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:51.432160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96dc75cc-b971-4610-a278-c99e1f03a0c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:51.433464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-96dc75cc-b971-4610-a278-c99e1f03a0c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:51.447236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96dc75cc-b971-4610-a278-c99e1f03a0c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:51.451853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96dc75cc-b971-4610-a278-c99e1f03a0c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:51.452316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96dc75cc-b971-4610-a278-c99e1f03a0c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:51.453128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96dc75cc-b971-4610-a278-c99e1f03a0c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:51.453522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96dc75cc-b971-4610-a278-c99e1f03a0c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:51.454188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96dc75cc-b971-4610-a278-c99e1f03a0c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:51.774883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-96dc75cc-b971-4610-a278-c99e1f03a0c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:51.784381 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-96dc75cc-b971-4610-a278-c99e1f03a0c2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1272 microversion: 2.1 time: 0.356629 Aug 23 18:12:51.784973 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2154/4398] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:51 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1272 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:52.252514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e012699e-58d7-49f2-b731-1c1a2be5067d tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:52.254035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e012699e-58d7-49f2-b731-1c1a2be5067d tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:52.264251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e012699e-58d7-49f2-b731-1c1a2be5067d tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:52.266573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e012699e-58d7-49f2-b731-1c1a2be5067d tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:52.267259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e012699e-58d7-49f2-b731-1c1a2be5067d tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:52.272858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e012699e-58d7-49f2-b731-1c1a2be5067d tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:52.273592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e012699e-58d7-49f2-b731-1c1a2be5067d tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:52.274647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e012699e-58d7-49f2-b731-1c1a2be5067d tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:52.677220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-669530227", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:52.792638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] validate_networks() for [('597d3f38-9c5d-451f-81bf-3e3fa931aa6a', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:12:52.855075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e012699e-58d7-49f2-b731-1c1a2be5067d tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:52.865912 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e012699e-58d7-49f2-b731-1c1a2be5067d tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1533 microversion: 2.1 time: 0.620402 Aug 23 18:12:52.867967 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2245/4399] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:52 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1533 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:52.873850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-52f0e736-7233-42f5-844d-f13657b08570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:52.874752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-52f0e736-7233-42f5-844d-f13657b08570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:52.892193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f0e736-7233-42f5-844d-f13657b08570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:52.892998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f0e736-7233-42f5-844d-f13657b08570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:52.899040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f0e736-7233-42f5-844d-f13657b08570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:52.899888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f0e736-7233-42f5-844d-f13657b08570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:52.900593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f0e736-7233-42f5-844d-f13657b08570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:52.901304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f0e736-7233-42f5-844d-f13657b08570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:53.072835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-52f0e736-7233-42f5-844d-f13657b08570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:53.087093 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-52f0e736-7233-42f5-844d-f13657b08570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1272 microversion: 2.1 time: 0.217707 Aug 23 18:12:53.087692 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2246/4400] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:52 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1272 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:53.891769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-49ba82de-66b7-45e3-9755-0e11fff71bf1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:53.892492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-49ba82de-66b7-45e3-9755-0e11fff71bf1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:53.909574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49ba82de-66b7-45e3-9755-0e11fff71bf1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:53.919360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49ba82de-66b7-45e3-9755-0e11fff71bf1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:53.919949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49ba82de-66b7-45e3-9755-0e11fff71bf1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:53.920831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49ba82de-66b7-45e3-9755-0e11fff71bf1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:53.921584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49ba82de-66b7-45e3-9755-0e11fff71bf1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:53.922294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49ba82de-66b7-45e3-9755-0e11fff71bf1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:54.511800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-49ba82de-66b7-45e3-9755-0e11fff71bf1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:54.527136 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-49ba82de-66b7-45e3-9755-0e11fff71bf1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1533 microversion: 2.1 time: 0.636876 Aug 23 18:12:54.528016 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2247/4401] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:53 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1533 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:12:54.536193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ede2a77-d183-49bb-98ad-e4708c940e21 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:54.537233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2ede2a77-d183-49bb-98ad-e4708c940e21 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:54.557862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ede2a77-d183-49bb-98ad-e4708c940e21 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:54.563971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ede2a77-d183-49bb-98ad-e4708c940e21 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:54.564889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ede2a77-d183-49bb-98ad-e4708c940e21 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:54.567300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ede2a77-d183-49bb-98ad-e4708c940e21 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:54.569046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ede2a77-d183-49bb-98ad-e4708c940e21 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:54.569732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ede2a77-d183-49bb-98ad-e4708c940e21 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:55.047775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:12:55.048854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:12:55.049461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:12:55.050794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:12:55.052233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:12:55.136068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:55.140327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:55.142185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:55.146601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:55.147345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:55.147961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:55.149592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2ede2a77-d183-49bb-98ad-e4708c940e21 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:55.161254 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2ede2a77-d183-49bb-98ad-e4708c940e21 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1314 microversion: 2.1 time: 0.629063 Aug 23 18:12:55.179057 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2248/4402] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:54 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1314 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:55.186772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Getting quotas for project a2600f90b7734756a397c658ae140e6e. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:12:55.204122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Getting quotas for user f03bc0a9e89240dbbe6b7c556449b912 and project a2600f90b7734756a397c658ae140e6e. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:12:55.213489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:12:55.250345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:12:55.253408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:12:55.417734 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49e466f4-7142-4c54-86cb-72a1b1f9beba tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.880403 Aug 23 18:12:55.419478 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2155/4403] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:12:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 2882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:12:55.450056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d0015dd0-8f1a-48bd-b462-0e1b63223e37 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:55.455226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d0015dd0-8f1a-48bd-b462-0e1b63223e37 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:55.554848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dbb6c892-5192-4cfe-82c9-5a5ae45257aa tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:55.555472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dbb6c892-5192-4cfe-82c9-5a5ae45257aa tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:55.581156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbb6c892-5192-4cfe-82c9-5a5ae45257aa tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:55.581700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbb6c892-5192-4cfe-82c9-5a5ae45257aa tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:55.586424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbb6c892-5192-4cfe-82c9-5a5ae45257aa tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:55.596342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbb6c892-5192-4cfe-82c9-5a5ae45257aa tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:55.596951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbb6c892-5192-4cfe-82c9-5a5ae45257aa tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:55.600065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbb6c892-5192-4cfe-82c9-5a5ae45257aa tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:55.790814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d0015dd0-8f1a-48bd-b462-0e1b63223e37 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:55.809201 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d0015dd0-8f1a-48bd-b462-0e1b63223e37 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1216 microversion: 2.1 time: 0.381457 Aug 23 18:12:55.813940 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2249/4404] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:55 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1216 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:56.067396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dbb6c892-5192-4cfe-82c9-5a5ae45257aa tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28a8c2a48c3a49038700235b8af9a2fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8700859a7684d38a8add30fcc865803', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:56.081487 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dbb6c892-5192-4cfe-82c9-5a5ae45257aa tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 200 len: 1491 microversion: 2.1 time: 0.531818 Aug 23 18:12:56.084173 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2156/4405] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:55 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 1491 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:12:56.141754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-279bedd8-5a65-4b85-abcb-ad7101df60c2 req-ffbdfe4e-561c-4371-b848-4f3335e5a682 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d61fbe90-3dd6-4f04-875d-3698c0b59e8c", "name": "network-vif-deleted", "tag": "9b5a8182-498f-4605-8e3e-3da36d734aee"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:56.190244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2301ec9a-e42d-4c73-9d05-e8e83aa81d41 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:56.190893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2301ec9a-e42d-4c73-9d05-e8e83aa81d41 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:56.211092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2301ec9a-e42d-4c73-9d05-e8e83aa81d41 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:56.216748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2301ec9a-e42d-4c73-9d05-e8e83aa81d41 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:56.221673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2301ec9a-e42d-4c73-9d05-e8e83aa81d41 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:56.227280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2301ec9a-e42d-4c73-9d05-e8e83aa81d41 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:56.227783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2301ec9a-e42d-4c73-9d05-e8e83aa81d41 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:56.231063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2301ec9a-e42d-4c73-9d05-e8e83aa81d41 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:56.246829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-279bedd8-5a65-4b85-abcb-ad7101df60c2 req-ffbdfe4e-561c-4371-b848-4f3335e5a682 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:56.249231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-279bedd8-5a65-4b85-abcb-ad7101df60c2 req-ffbdfe4e-561c-4371-b848-4f3335e5a682 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:56.252726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-279bedd8-5a65-4b85-abcb-ad7101df60c2 req-ffbdfe4e-561c-4371-b848-4f3335e5a682 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:56.311056 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-279bedd8-5a65-4b85-abcb-ad7101df60c2 req-ffbdfe4e-561c-4371-b848-4f3335e5a682 service nova] Creating event network-vif-deleted:9b5a8182-498f-4605-8e3e-3da36d734aee for instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c on n-h2-850468-16 Aug 23 18:12:56.327178 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-279bedd8-5a65-4b85-abcb-ad7101df60c2 req-ffbdfe4e-561c-4371-b848-4f3335e5a682 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.197007 Aug 23 18:12:56.336536 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2250/4406] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:56.850384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2cf54fa3-acb0-410a-958d-3564b24ce377 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:56.851198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2cf54fa3-acb0-410a-958d-3564b24ce377 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:56.897380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2cf54fa3-acb0-410a-958d-3564b24ce377 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:56.897897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2cf54fa3-acb0-410a-958d-3564b24ce377 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:56.908186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2cf54fa3-acb0-410a-958d-3564b24ce377 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:56.912663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2cf54fa3-acb0-410a-958d-3564b24ce377 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:56.913884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2cf54fa3-acb0-410a-958d-3564b24ce377 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:56.915253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2cf54fa3-acb0-410a-958d-3564b24ce377 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:56.982184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2301ec9a-e42d-4c73-9d05-e8e83aa81d41 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:56.990230 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2301ec9a-e42d-4c73-9d05-e8e83aa81d41 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1314 microversion: 2.1 time: 0.805702 Aug 23 18:12:56.999108 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2157/4407] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:56 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1314 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:57.081396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2cf54fa3-acb0-410a-958d-3564b24ce377 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:57.093400 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2cf54fa3-acb0-410a-958d-3564b24ce377 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1220 microversion: 2.1 time: 0.264568 Aug 23 18:12:57.105396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c560bf31-4b96-493d-bf65-1bec67b75fb1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:57.106915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c560bf31-4b96-493d-bf65-1bec67b75fb1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] [instance: d61fbe90-3dd6-4f04-875d-3698c0b59e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:57.107051 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2251/4408] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:56 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1220 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:12:57.124880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c560bf31-4b96-493d-bf65-1bec67b75fb1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:57.126157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c560bf31-4b96-493d-bf65-1bec67b75fb1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:57.127015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c560bf31-4b96-493d-bf65-1bec67b75fb1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:57.127766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c560bf31-4b96-493d-bf65-1bec67b75fb1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:57.128442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c560bf31-4b96-493d-bf65-1bec67b75fb1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:57.128625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c560bf31-4b96-493d-bf65-1bec67b75fb1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:57.222873 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-c560bf31-4b96-493d-bf65-1bec67b75fb1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] HTTP exception thrown: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c560bf31-4b96-493d-bf65-1bec67b75fb1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Request method failure captured: Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c HTTP/1.1 Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRhqjj5xqhkO_uU8z-CAwmWxriDl_Z6or9zQkwvN_SKAXLDdZ7Q3K8GLjvHsr7G13E_fQu1vmSOTjV7hcM6YbinaQwbsjz1Z7noDZrMc3IJa-3c1yFUkmkWQJjaga6DwdwyxZmhlKWtx-w1y0CBCMo46-TdbfIt0GlD2SNJtpfG9Hf4 Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a8700859a7684d38a8add30fcc865803 Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-51872278 Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a8700859a7684d38a8add30fcc865803"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8700859a7684d38a8add30fcc865803"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a8700859a7684d38a8add30fcc865803"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a8700859a7684d38a8add30fcc865803"}]}] Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-51872278 Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a8700859a7684d38a8add30fcc865803 Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-51872278 Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestMultiTenantJSON-51872278-project Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 28a8c2a48c3a49038700235b8af9a2fd Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-51872278-project Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'd61fbe90-3dd6-4f04-875d-3698c0b59e8c'} Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:57.228160 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:12:57.236745 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:57.236745 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:12:57.236745 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:12:57.236745 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:12:57.236745 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:12:57.236745 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:12:57.236745 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. Aug 23 18:12:57.236745 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:12:57.241150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c560bf31-4b96-493d-bf65-1bec67b75fb1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] Returning 404 to user: Instance d61fbe90-3dd6-4f04-875d-3698c0b59e8c could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:12:57.243093 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c560bf31-4b96-493d-bf65-1bec67b75fb1 tempest-ServersNegativeTestMultiTenantJSON-51872278 tempest-ServersNegativeTestMultiTenantJSON-51872278-project] 10.222.0.61 "GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c" status: 404 len: 111 microversion: 2.1 time: 0.141448 Aug 23 18:12:57.245130 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2158/4409] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:57 2022] GET /compute/v2.1/servers/d61fbe90-3dd6-4f04-875d-3698c0b59e8c => generated 111 bytes in 144 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:12:58.021648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ab62bab9-5fda-46d4-9cee-c642727707ab tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:58.023163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab62bab9-5fda-46d4-9cee-c642727707ab tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:58.038204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab62bab9-5fda-46d4-9cee-c642727707ab tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:58.039399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab62bab9-5fda-46d4-9cee-c642727707ab tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:58.041636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab62bab9-5fda-46d4-9cee-c642727707ab tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:58.046488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab62bab9-5fda-46d4-9cee-c642727707ab tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:58.052403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab62bab9-5fda-46d4-9cee-c642727707ab tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:58.052916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab62bab9-5fda-46d4-9cee-c642727707ab tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:58.533283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1211657703", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": "none"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:58.639387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:12:58.639699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:12:58.640180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:12:58.640591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:12:58.641302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:12:58.664980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ab62bab9-5fda-46d4-9cee-c642727707ab tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:58.673666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:58.674164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:58.675049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:58.675411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:58.675945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:58.676322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:58.680446 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ab62bab9-5fda-46d4-9cee-c642727707ab tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1314 microversion: 2.1 time: 0.662910 Aug 23 18:12:58.684132 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2252/4410] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:58 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1314 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:58.696104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fda3272a-681e-4793-b8a9-77d960a4c03f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:58.698992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fda3272a-681e-4793-b8a9-77d960a4c03f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:58.718528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fda3272a-681e-4793-b8a9-77d960a4c03f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:58.719416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fda3272a-681e-4793-b8a9-77d960a4c03f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:58.722625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fda3272a-681e-4793-b8a9-77d960a4c03f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:58.724567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Getting quotas for project 1eb6ebd974214cad903412e234924217. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:12:58.725534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fda3272a-681e-4793-b8a9-77d960a4c03f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:58.726378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fda3272a-681e-4793-b8a9-77d960a4c03f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:58.728021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fda3272a-681e-4793-b8a9-77d960a4c03f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:58.730801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Getting quotas for user 54a8ed42f2144b5eb97158fe72e742c8 and project 1eb6ebd974214cad903412e234924217. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:12:58.748899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:12:58.751988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:12:58.814452 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-589b59db-931b-44b9-923c-544a8c3feab3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.781531 Aug 23 18:12:58.815371 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2159/4411] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 18:12:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 783 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 18:12:58.827993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-be27a26a-d35b-405b-9a37-85c974cfe13f req-c5fca729-3aaa-461e-86ad-7f52c54baac7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a13e98f6-a5db-421f-abac-17f208932ac9", "tag": "67bb558d-6261-4216-9cd3-99b2ea563a05"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:58.864592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-be27a26a-d35b-405b-9a37-85c974cfe13f req-c5fca729-3aaa-461e-86ad-7f52c54baac7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:58.865531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-be27a26a-d35b-405b-9a37-85c974cfe13f req-c5fca729-3aaa-461e-86ad-7f52c54baac7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:58.866424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-be27a26a-d35b-405b-9a37-85c974cfe13f req-c5fca729-3aaa-461e-86ad-7f52c54baac7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:58.875650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fda3272a-681e-4793-b8a9-77d960a4c03f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:58.884848 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-be27a26a-d35b-405b-9a37-85c974cfe13f req-c5fca729-3aaa-461e-86ad-7f52c54baac7 service nova] Creating event network-changed:67bb558d-6261-4216-9cd3-99b2ea563a05 for instance a13e98f6-a5db-421f-abac-17f208932ac9 on n-h1-850468-16 Aug 23 18:12:58.896934 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-be27a26a-d35b-405b-9a37-85c974cfe13f req-c5fca729-3aaa-461e-86ad-7f52c54baac7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078120 Aug 23 18:12:58.901262 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2160/4412] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:12:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:12:58.902987 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fda3272a-681e-4793-b8a9-77d960a4c03f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1274 microversion: 2.1 time: 0.214539 Aug 23 18:12:58.913125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6586b732-ce63-4010-8b25-56a0036eb1f3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:58.915098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6586b732-ce63-4010-8b25-56a0036eb1f3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:58.920084 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2253/4413] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:58 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1274 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:12:59.146261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6586b732-ce63-4010-8b25-56a0036eb1f3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:59.156896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6586b732-ce63-4010-8b25-56a0036eb1f3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:59.161870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6586b732-ce63-4010-8b25-56a0036eb1f3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:12:59.173198 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6586b732-ce63-4010-8b25-56a0036eb1f3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 200 len: 1281 microversion: 2.47 time: 0.262054 Aug 23 18:12:59.174647 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2161/4414] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:12:58 2022] GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 1281 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:12:59.647490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-480410120", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "ee26c33c-261c-41fa-9dc6-f32617ff9b5a"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:12:59.709756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8d1717e9-03eb-4d49-853b-c3644b5212bd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:12:59.711157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8d1717e9-03eb-4d49-853b-c3644b5212bd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:12:59.724008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d1717e9-03eb-4d49-853b-c3644b5212bd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:59.726696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d1717e9-03eb-4d49-853b-c3644b5212bd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:59.727186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d1717e9-03eb-4d49-853b-c3644b5212bd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:59.727933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d1717e9-03eb-4d49-853b-c3644b5212bd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:12:59.730433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d1717e9-03eb-4d49-853b-c3644b5212bd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:12:59.731122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d1717e9-03eb-4d49-853b-c3644b5212bd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:12:59.735847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] validate_networks() for [('ee26c33c-261c-41fa-9dc6-f32617ff9b5a', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:13:00.274699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8d1717e9-03eb-4d49-853b-c3644b5212bd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:00.283828 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8d1717e9-03eb-4d49-853b-c3644b5212bd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1314 microversion: 2.1 time: 0.578864 Aug 23 18:13:00.284661 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2162/4415] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:12:59 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1314 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:00.300374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c280ab20-4684-4b2a-89f4-f5f82b955bb4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:00.300995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c280ab20-4684-4b2a-89f4-f5f82b955bb4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:00.308581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c280ab20-4684-4b2a-89f4-f5f82b955bb4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:00.309147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c280ab20-4684-4b2a-89f4-f5f82b955bb4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:00.309656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c280ab20-4684-4b2a-89f4-f5f82b955bb4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:00.310863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c280ab20-4684-4b2a-89f4-f5f82b955bb4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:00.311327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c280ab20-4684-4b2a-89f4-f5f82b955bb4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:00.311766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c280ab20-4684-4b2a-89f4-f5f82b955bb4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:01.017410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c280ab20-4684-4b2a-89f4-f5f82b955bb4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:01.029579 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c280ab20-4684-4b2a-89f4-f5f82b955bb4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1316 microversion: 2.1 time: 0.743581 Aug 23 18:13:01.031890 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2163/4416] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:00 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1316 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:01.037454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e1c2ce5a-38df-4e98-9c65-cb6f5b19e505 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:01.038233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e1c2ce5a-38df-4e98-9c65-cb6f5b19e505 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:01.045720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1c2ce5a-38df-4e98-9c65-cb6f5b19e505 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:01.046435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1c2ce5a-38df-4e98-9c65-cb6f5b19e505 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:01.047658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1c2ce5a-38df-4e98-9c65-cb6f5b19e505 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:01.050092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1c2ce5a-38df-4e98-9c65-cb6f5b19e505 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:01.051978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1c2ce5a-38df-4e98-9c65-cb6f5b19e505 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:01.053112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1c2ce5a-38df-4e98-9c65-cb6f5b19e505 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:01.093144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:13:01.094194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:13:01.095818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:13:01.096413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:13:01.097002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:13:01.111103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:01.112476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:01.113182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:01.114261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:01.114908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:01.115507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:01.142128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Getting quotas for project 9e278101a495492392fa362c67532636. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:13:01.148147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Getting quotas for user e9247aeda1a84edd9408d95a6e9290cd and project 9e278101a495492392fa362c67532636. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:13:01.164176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:13:01.167013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:13:01.189670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e1c2ce5a-38df-4e98-9c65-cb6f5b19e505 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:01.199260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e1c2ce5a-38df-4e98-9c65-cb6f5b19e505 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:01.201654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e1c2ce5a-38df-4e98-9c65-cb6f5b19e505 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:01.203844 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e1c2ce5a-38df-4e98-9c65-cb6f5b19e505 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 200 len: 1339 microversion: 2.47 time: 0.170753 Aug 23 18:13:01.204754 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2164/4417] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:13:01 2022] GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 1339 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:13:01.239686 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4b35acea-733f-4ba2-a520-1f309a927fc4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.615016 Aug 23 18:13:01.240401 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2254/4418] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:12:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 1617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:13:01.251661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-16427697-9876-4b8a-b959-25907c04edc7 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:01.252628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-16427697-9876-4b8a-b959-25907c04edc7 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:01.312229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-837ca2a0-9a17-4f4b-ac2a-202e862f2184 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:01.313183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-837ca2a0-9a17-4f4b-ac2a-202e862f2184 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:01.330095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-837ca2a0-9a17-4f4b-ac2a-202e862f2184 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:01.330639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-837ca2a0-9a17-4f4b-ac2a-202e862f2184 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:01.331092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-837ca2a0-9a17-4f4b-ac2a-202e862f2184 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:01.332293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-837ca2a0-9a17-4f4b-ac2a-202e862f2184 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:01.332808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-837ca2a0-9a17-4f4b-ac2a-202e862f2184 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:01.333247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-837ca2a0-9a17-4f4b-ac2a-202e862f2184 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:01.460920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-16427697-9876-4b8a-b959-25907c04edc7 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:01.470442 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-16427697-9876-4b8a-b959-25907c04edc7 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1218 microversion: 2.1 time: 0.222675 Aug 23 18:13:01.483418 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2165/4419] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:01 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1218 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:01.681538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-837ca2a0-9a17-4f4b-ac2a-202e862f2184 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:01.691792 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-837ca2a0-9a17-4f4b-ac2a-202e862f2184 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1314 microversion: 2.1 time: 0.387423 Aug 23 18:13:01.692387 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2255/4420] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:01 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1314 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:02.052390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-09ec9c7b-3197-429c-933b-acb79d768ca6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:02.053081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-09ec9c7b-3197-429c-933b-acb79d768ca6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:02.103174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09ec9c7b-3197-429c-933b-acb79d768ca6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:02.107914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09ec9c7b-3197-429c-933b-acb79d768ca6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:02.109528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09ec9c7b-3197-429c-933b-acb79d768ca6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:02.114505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09ec9c7b-3197-429c-933b-acb79d768ca6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:02.116113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09ec9c7b-3197-429c-933b-acb79d768ca6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:02.116771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09ec9c7b-3197-429c-933b-acb79d768ca6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:02.160803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:UPDATE=13,nova_cell1:SELECT=84,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:02.233278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bb549bb8-1c7a-435a-aa2e-9ca549838fb2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:02.234519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bb549bb8-1c7a-435a-aa2e-9ca549838fb2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:02.247050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb549bb8-1c7a-435a-aa2e-9ca549838fb2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:02.247551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb549bb8-1c7a-435a-aa2e-9ca549838fb2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:02.247991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb549bb8-1c7a-435a-aa2e-9ca549838fb2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:02.248704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb549bb8-1c7a-435a-aa2e-9ca549838fb2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:02.249221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb549bb8-1c7a-435a-aa2e-9ca549838fb2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:02.249706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb549bb8-1c7a-435a-aa2e-9ca549838fb2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:02.541869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bb549bb8-1c7a-435a-aa2e-9ca549838fb2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:02.558765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bb549bb8-1c7a-435a-aa2e-9ca549838fb2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:02.566229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bb549bb8-1c7a-435a-aa2e-9ca549838fb2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:02.569201 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bb549bb8-1c7a-435a-aa2e-9ca549838fb2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 200 len: 1339 microversion: 2.47 time: 0.339874 Aug 23 18:13:02.569818 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2256/4421] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:13:02 2022] GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 1339 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:13:02.631135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-245e6be6-1780-4f7b-a0aa-a18846a788ac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:02.633024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-245e6be6-1780-4f7b-a0aa-a18846a788ac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:02.651820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-245e6be6-1780-4f7b-a0aa-a18846a788ac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:02.653709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-245e6be6-1780-4f7b-a0aa-a18846a788ac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:02.654951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-245e6be6-1780-4f7b-a0aa-a18846a788ac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:02.655903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-245e6be6-1780-4f7b-a0aa-a18846a788ac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:02.656615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-245e6be6-1780-4f7b-a0aa-a18846a788ac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:02.657909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-245e6be6-1780-4f7b-a0aa-a18846a788ac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:02.787493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-09ec9c7b-3197-429c-933b-acb79d768ca6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:02.796323 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-09ec9c7b-3197-429c-933b-acb79d768ca6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1316 microversion: 2.1 time: 0.747785 Aug 23 18:13:02.801065 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2166/4422] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:02 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1316 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:02.819838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6b61c7db-7572-4f89-839a-297c68fcb25b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:02.820708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6b61c7db-7572-4f89-839a-297c68fcb25b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:02.828785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b61c7db-7572-4f89-839a-297c68fcb25b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:02.829561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b61c7db-7572-4f89-839a-297c68fcb25b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:02.830217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b61c7db-7572-4f89-839a-297c68fcb25b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:02.831189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b61c7db-7572-4f89-839a-297c68fcb25b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:02.832150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b61c7db-7572-4f89-839a-297c68fcb25b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:02.832794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b61c7db-7572-4f89-839a-297c68fcb25b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:03.017739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-245e6be6-1780-4f7b-a0aa-a18846a788ac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:03.035126 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-245e6be6-1780-4f7b-a0aa-a18846a788ac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1270 microversion: 2.1 time: 0.459821 Aug 23 18:13:03.056474 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2257/4423] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:02 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1270 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:03.272164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6b61c7db-7572-4f89-839a-297c68fcb25b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:03.280215 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6b61c7db-7572-4f89-839a-297c68fcb25b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1314 microversion: 2.1 time: 0.464308 Aug 23 18:13:03.284384 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2167/4424] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:02 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:03.313140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-fc727473-dbff-4f5c-a433-ce5ca4c7bd57 req-342c6e33-5ea0-47d6-b8eb-80367d2fd869 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f1cad0fb-87b4-403c-9881-64ce147502fd", "tag": "933227f8-f35c-4a4d-8cd9-453f1505d7a3"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:03.332486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:03.335803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fc727473-dbff-4f5c-a433-ce5ca4c7bd57 req-342c6e33-5ea0-47d6-b8eb-80367d2fd869 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:03.336763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fc727473-dbff-4f5c-a433-ce5ca4c7bd57 req-342c6e33-5ea0-47d6-b8eb-80367d2fd869 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:03.337431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fc727473-dbff-4f5c-a433-ce5ca4c7bd57 req-342c6e33-5ea0-47d6-b8eb-80367d2fd869 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:03.360099 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-fc727473-dbff-4f5c-a433-ce5ca4c7bd57 req-342c6e33-5ea0-47d6-b8eb-80367d2fd869 service nova] Creating event network-changed:933227f8-f35c-4a4d-8cd9-453f1505d7a3 for instance f1cad0fb-87b4-403c-9881-64ce147502fd on n-h2-850468-16 Aug 23 18:13:03.367266 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-fc727473-dbff-4f5c-a433-ce5ca4c7bd57 req-342c6e33-5ea0-47d6-b8eb-80367d2fd869 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059871 Aug 23 18:13:03.369238 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2258/4425] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:13:03.598447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4ddac636-00a7-4a88-83b3-12dff8906cf3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:03.599449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4ddac636-00a7-4a88-83b3-12dff8906cf3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:03.613332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ddac636-00a7-4a88-83b3-12dff8906cf3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:03.614032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ddac636-00a7-4a88-83b3-12dff8906cf3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:03.614558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ddac636-00a7-4a88-83b3-12dff8906cf3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:03.615554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ddac636-00a7-4a88-83b3-12dff8906cf3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:03.616227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ddac636-00a7-4a88-83b3-12dff8906cf3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:03.616868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ddac636-00a7-4a88-83b3-12dff8906cf3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:03.824662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e92313c7-51a7-4081-8582-b5fe3ab0323c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:03.826122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e92313c7-51a7-4081-8582-b5fe3ab0323c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:03.859152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ddac636-00a7-4a88-83b3-12dff8906cf3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:03.867098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e92313c7-51a7-4081-8582-b5fe3ab0323c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:03.869215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e92313c7-51a7-4081-8582-b5fe3ab0323c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:03.870835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e92313c7-51a7-4081-8582-b5fe3ab0323c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:03.872447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e92313c7-51a7-4081-8582-b5fe3ab0323c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:03.873127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ddac636-00a7-4a88-83b3-12dff8906cf3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:03.874218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e92313c7-51a7-4081-8582-b5fe3ab0323c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:03.874712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e92313c7-51a7-4081-8582-b5fe3ab0323c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:03.876979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ddac636-00a7-4a88-83b3-12dff8906cf3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:03.878174 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4ddac636-00a7-4a88-83b3-12dff8906cf3 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 200 len: 1339 microversion: 2.47 time: 0.283678 Aug 23 18:13:03.880244 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2168/4426] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:13:03 2022] GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 1339 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:13:04.061716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b65fe1cb-d86f-437e-85b2-35ea4ee89168 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:04.062659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b65fe1cb-d86f-437e-85b2-35ea4ee89168 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:04.074572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b65fe1cb-d86f-437e-85b2-35ea4ee89168 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:04.077453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b65fe1cb-d86f-437e-85b2-35ea4ee89168 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:04.078147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b65fe1cb-d86f-437e-85b2-35ea4ee89168 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:04.079134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b65fe1cb-d86f-437e-85b2-35ea4ee89168 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:04.080251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b65fe1cb-d86f-437e-85b2-35ea4ee89168 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:04.081302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b65fe1cb-d86f-437e-85b2-35ea4ee89168 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:04.239323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b65fe1cb-d86f-437e-85b2-35ea4ee89168 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:04.249915 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b65fe1cb-d86f-437e-85b2-35ea4ee89168 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1276 microversion: 2.1 time: 0.192744 Aug 23 18:13:04.250827 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2169/4427] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:04 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1276 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:04.311483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ea55a6b-03c8-41af-aa2f-adf2304666c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:04.313061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8ea55a6b-03c8-41af-aa2f-adf2304666c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:04.323822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ea55a6b-03c8-41af-aa2f-adf2304666c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:04.324569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ea55a6b-03c8-41af-aa2f-adf2304666c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:04.325993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ea55a6b-03c8-41af-aa2f-adf2304666c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:04.328801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ea55a6b-03c8-41af-aa2f-adf2304666c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:04.329537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ea55a6b-03c8-41af-aa2f-adf2304666c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:04.330207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ea55a6b-03c8-41af-aa2f-adf2304666c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:04.435256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e92313c7-51a7-4081-8582-b5fe3ab0323c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:04.456181 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e92313c7-51a7-4081-8582-b5fe3ab0323c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1316 microversion: 2.1 time: 0.636211 Aug 23 18:13:04.461778 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2259/4428] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:03 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1316 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:04.696658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8ea55a6b-03c8-41af-aa2f-adf2304666c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:04.708418 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8ea55a6b-03c8-41af-aa2f-adf2304666c4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1314 microversion: 2.1 time: 0.402676 Aug 23 18:13:04.710871 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2170/4429] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:04 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:04.912570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f9528d28-4c63-4de3-b3b2-44b112ca0159 req-63499d00-44d2-4c57-99e4-e02d132740c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13e98f6-a5db-421f-abac-17f208932ac9", "name": "network-vif-plugged", "status": "completed", "tag": "67bb558d-6261-4216-9cd3-99b2ea563a05"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:04.913208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5bf215e3-35a3-4781-bfb4-569c38c81e41 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:04.915347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5bf215e3-35a3-4781-bfb4-569c38c81e41 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:04.933673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f9528d28-4c63-4de3-b3b2-44b112ca0159 req-63499d00-44d2-4c57-99e4-e02d132740c8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:04.934090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bf215e3-35a3-4781-bfb4-569c38c81e41 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:04.935398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f9528d28-4c63-4de3-b3b2-44b112ca0159 req-63499d00-44d2-4c57-99e4-e02d132740c8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:04.936081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f9528d28-4c63-4de3-b3b2-44b112ca0159 req-63499d00-44d2-4c57-99e4-e02d132740c8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:04.936329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bf215e3-35a3-4781-bfb4-569c38c81e41 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:04.936794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bf215e3-35a3-4781-bfb4-569c38c81e41 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:04.939009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bf215e3-35a3-4781-bfb4-569c38c81e41 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:04.940880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bf215e3-35a3-4781-bfb4-569c38c81e41 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:04.942262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bf215e3-35a3-4781-bfb4-569c38c81e41 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:04.962899 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f9528d28-4c63-4de3-b3b2-44b112ca0159 req-63499d00-44d2-4c57-99e4-e02d132740c8 service nova] Creating event network-vif-plugged:67bb558d-6261-4216-9cd3-99b2ea563a05 for instance a13e98f6-a5db-421f-abac-17f208932ac9 on n-h1-850468-16 Aug 23 18:13:04.983763 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f9528d28-4c63-4de3-b3b2-44b112ca0159 req-63499d00-44d2-4c57-99e4-e02d132740c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084519 Aug 23 18:13:04.987011 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2260/4430] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:13:05.205057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5bf215e3-35a3-4781-bfb4-569c38c81e41 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:05.221861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5bf215e3-35a3-4781-bfb4-569c38c81e41 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:05.223666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5bf215e3-35a3-4781-bfb4-569c38c81e41 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:05.224828 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5bf215e3-35a3-4781-bfb4-569c38c81e41 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 200 len: 1339 microversion: 2.47 time: 0.322522 Aug 23 18:13:05.225563 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2171/4431] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:13:04 2022] GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 1339 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:13:05.272493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00d30a1a-c4fe-457f-ac3f-767831523460 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:05.274636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-00d30a1a-c4fe-457f-ac3f-767831523460 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:05.305056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00d30a1a-c4fe-457f-ac3f-767831523460 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:05.306262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00d30a1a-c4fe-457f-ac3f-767831523460 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:05.306867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00d30a1a-c4fe-457f-ac3f-767831523460 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:05.307861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00d30a1a-c4fe-457f-ac3f-767831523460 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:05.308430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00d30a1a-c4fe-457f-ac3f-767831523460 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:05.308967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00d30a1a-c4fe-457f-ac3f-767831523460 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:05.355601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:05.480975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-105688c2-e5f8-4f4b-a57a-c16d89abbe8c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:05.482451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-105688c2-e5f8-4f4b-a57a-c16d89abbe8c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:05.501093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-105688c2-e5f8-4f4b-a57a-c16d89abbe8c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:05.502607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-105688c2-e5f8-4f4b-a57a-c16d89abbe8c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:05.503262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-105688c2-e5f8-4f4b-a57a-c16d89abbe8c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:05.509369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-105688c2-e5f8-4f4b-a57a-c16d89abbe8c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:05.510281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-105688c2-e5f8-4f4b-a57a-c16d89abbe8c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:05.512271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-105688c2-e5f8-4f4b-a57a-c16d89abbe8c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:05.629317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-00d30a1a-c4fe-457f-ac3f-767831523460 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:05.646695 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-00d30a1a-c4fe-457f-ac3f-767831523460 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1276 microversion: 2.1 time: 0.376439 Aug 23 18:13:05.663567 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2261/4432] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:05 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1276 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:05.729458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8fa0cba1-aac5-48b4-9194-dbed996cee15 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:05.730470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8fa0cba1-aac5-48b4-9194-dbed996cee15 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:05.743923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fa0cba1-aac5-48b4-9194-dbed996cee15 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:05.745115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fa0cba1-aac5-48b4-9194-dbed996cee15 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:05.745724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fa0cba1-aac5-48b4-9194-dbed996cee15 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:05.746637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fa0cba1-aac5-48b4-9194-dbed996cee15 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:05.748065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fa0cba1-aac5-48b4-9194-dbed996cee15 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:05.748675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fa0cba1-aac5-48b4-9194-dbed996cee15 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:06.158665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8fa0cba1-aac5-48b4-9194-dbed996cee15 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:06.176125 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8fa0cba1-aac5-48b4-9194-dbed996cee15 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1314 microversion: 2.1 time: 0.448020 Aug 23 18:13:06.179113 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2262/4433] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:05 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1314 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:06.253205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-75fffb27-3eb7-481a-b737-cb0939466e9c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:06.253857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-75fffb27-3eb7-481a-b737-cb0939466e9c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:06.269972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75fffb27-3eb7-481a-b737-cb0939466e9c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:06.271088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75fffb27-3eb7-481a-b737-cb0939466e9c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:06.272945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75fffb27-3eb7-481a-b737-cb0939466e9c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:06.277563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75fffb27-3eb7-481a-b737-cb0939466e9c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:06.280078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75fffb27-3eb7-481a-b737-cb0939466e9c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:06.281559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75fffb27-3eb7-481a-b737-cb0939466e9c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:06.461687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-75fffb27-3eb7-481a-b737-cb0939466e9c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:06.500888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-75fffb27-3eb7-481a-b737-cb0939466e9c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:06.504842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-75fffb27-3eb7-481a-b737-cb0939466e9c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:06.509829 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-75fffb27-3eb7-481a-b737-cb0939466e9c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 200 len: 1360 microversion: 2.47 time: 0.260267 Aug 23 18:13:06.511246 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2263/4434] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:13:06 2022] GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 1360 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:13:06.538607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b2afbe5a-cebf-480e-9dcc-ca6432d8d560 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-651143755"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:06.542254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b2afbe5a-cebf-480e-9dcc-ca6432d8d560 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:06.562172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2afbe5a-cebf-480e-9dcc-ca6432d8d560 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:06.567941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2afbe5a-cebf-480e-9dcc-ca6432d8d560 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:06.568671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2afbe5a-cebf-480e-9dcc-ca6432d8d560 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:06.571356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2afbe5a-cebf-480e-9dcc-ca6432d8d560 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:06.571998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2afbe5a-cebf-480e-9dcc-ca6432d8d560 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:06.574113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2afbe5a-cebf-480e-9dcc-ca6432d8d560 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:06.897923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-105688c2-e5f8-4f4b-a57a-c16d89abbe8c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:06.907563 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-105688c2-e5f8-4f4b-a57a-c16d89abbe8c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1316 microversion: 2.1 time: 1.430288 Aug 23 18:13:06.913363 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2172/4435] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:05 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1316 bytes in 1437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:06.926799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47d671f4-a371-403b-94e9-6a9c8d82362f tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:06.927616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-47d671f4-a371-403b-94e9-6a9c8d82362f tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:06.937678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47d671f4-a371-403b-94e9-6a9c8d82362f tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:06.947338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47d671f4-a371-403b-94e9-6a9c8d82362f tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:06.948046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47d671f4-a371-403b-94e9-6a9c8d82362f tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:06.948976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47d671f4-a371-403b-94e9-6a9c8d82362f tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:06.949589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47d671f4-a371-403b-94e9-6a9c8d82362f tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:06.951158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47d671f4-a371-403b-94e9-6a9c8d82362f tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:07.014000 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b2afbe5a-cebf-480e-9dcc-ca6432d8d560 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "POST /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865/action" status: 202 len: 52 microversion: 2.47 time: 0.478942 Aug 23 18:13:07.025148 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2264/4436] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 18:13:06 2022] POST /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865/action => generated 52 bytes in 483 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Aug 23 18:13:07.050329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bada5c9d-6e6b-41a7-a0ff-c69ffe633365 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:07.051821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bada5c9d-6e6b-41a7-a0ff-c69ffe633365 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:07.068877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bada5c9d-6e6b-41a7-a0ff-c69ffe633365 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:07.069534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bada5c9d-6e6b-41a7-a0ff-c69ffe633365 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:07.070242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bada5c9d-6e6b-41a7-a0ff-c69ffe633365 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:07.071527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bada5c9d-6e6b-41a7-a0ff-c69ffe633365 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:07.072177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bada5c9d-6e6b-41a7-a0ff-c69ffe633365 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:07.072793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bada5c9d-6e6b-41a7-a0ff-c69ffe633365 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:07.132980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bada5c9d-6e6b-41a7-a0ff-c69ffe633365 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:13:07.328860 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bada5c9d-6e6b-41a7-a0ff-c69ffe633365 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 204 len: 0 microversion: 2.47 time: 0.301548 Aug 23 18:13:07.329543 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2265/4437] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:13:07 2022] DELETE /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:13:07.338558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b392f996-7e6a-4b38-b8b2-bc2e854b4cb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:07.342717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b392f996-7e6a-4b38-b8b2-bc2e854b4cb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:07.359702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b392f996-7e6a-4b38-b8b2-bc2e854b4cb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:07.360558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b392f996-7e6a-4b38-b8b2-bc2e854b4cb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:07.361235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b392f996-7e6a-4b38-b8b2-bc2e854b4cb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:07.362342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b392f996-7e6a-4b38-b8b2-bc2e854b4cb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:07.363043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b392f996-7e6a-4b38-b8b2-bc2e854b4cb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:07.363681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b392f996-7e6a-4b38-b8b2-bc2e854b4cb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:07.607476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-47d671f4-a371-403b-94e9-6a9c8d82362f tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:07.620743 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-47d671f4-a371-403b-94e9-6a9c8d82362f tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1318 microversion: 2.1 time: 0.706085 Aug 23 18:13:07.621612 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2173/4438] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:06 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1318 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:07.627298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e22dc64-5816-461e-ae32-7ce220da22c1 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:07.630498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e22dc64-5816-461e-ae32-7ce220da22c1 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:07.645662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e22dc64-5816-461e-ae32-7ce220da22c1 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:07.648499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e22dc64-5816-461e-ae32-7ce220da22c1 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:07.651075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e22dc64-5816-461e-ae32-7ce220da22c1 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:07.652016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e22dc64-5816-461e-ae32-7ce220da22c1 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:07.653831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e22dc64-5816-461e-ae32-7ce220da22c1 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:07.660548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e22dc64-5816-461e-ae32-7ce220da22c1 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:07.895370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b392f996-7e6a-4b38-b8b2-bc2e854b4cb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:07.906788 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b392f996-7e6a-4b38-b8b2-bc2e854b4cb1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1314 microversion: 2.1 time: 0.572905 Aug 23 18:13:07.907384 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2266/4439] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:07 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:07.937131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-22b4d852-8c44-4fe7-a732-61f3de30ee8b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:07.938034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-22b4d852-8c44-4fe7-a732-61f3de30ee8b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:07.951950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22b4d852-8c44-4fe7-a732-61f3de30ee8b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:07.956452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22b4d852-8c44-4fe7-a732-61f3de30ee8b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:07.957096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22b4d852-8c44-4fe7-a732-61f3de30ee8b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:07.958012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22b4d852-8c44-4fe7-a732-61f3de30ee8b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:07.958665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22b4d852-8c44-4fe7-a732-61f3de30ee8b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:07.959277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22b4d852-8c44-4fe7-a732-61f3de30ee8b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:08.169566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e22dc64-5816-461e-ae32-7ce220da22c1 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:08.191937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e22dc64-5816-461e-ae32-7ce220da22c1 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:08.194001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e22dc64-5816-461e-ae32-7ce220da22c1 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:08.195597 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e22dc64-5816-461e-ae32-7ce220da22c1 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 200 len: 1366 microversion: 2.47 time: 0.572023 Aug 23 18:13:08.210884 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2174/4440] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:13:07 2022] GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 1366 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:13:08.226666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-22b4d852-8c44-4fe7-a732-61f3de30ee8b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:08.238847 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-22b4d852-8c44-4fe7-a732-61f3de30ee8b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1316 microversion: 2.1 time: 0.307450 Aug 23 18:13:08.240086 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2267/4441] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:07 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1316 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:08.642534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cb25fb4-3970-4714-934c-b7e78622888a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:08.666509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0cb25fb4-3970-4714-934c-b7e78622888a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:08.689846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cb25fb4-3970-4714-934c-b7e78622888a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:08.693505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cb25fb4-3970-4714-934c-b7e78622888a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:08.698494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cb25fb4-3970-4714-934c-b7e78622888a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:08.699402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cb25fb4-3970-4714-934c-b7e78622888a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:08.700003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cb25fb4-3970-4714-934c-b7e78622888a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:08.700732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cb25fb4-3970-4714-934c-b7e78622888a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:08.728953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:08.931583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ee810bec-1ff5-4204-8afc-f9d1e18fce62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:08.932439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ee810bec-1ff5-4204-8afc-f9d1e18fce62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:08.945253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee810bec-1ff5-4204-8afc-f9d1e18fce62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:08.945917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee810bec-1ff5-4204-8afc-f9d1e18fce62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:08.946533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee810bec-1ff5-4204-8afc-f9d1e18fce62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:08.947424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee810bec-1ff5-4204-8afc-f9d1e18fce62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:08.948031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee810bec-1ff5-4204-8afc-f9d1e18fce62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:08.948646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee810bec-1ff5-4204-8afc-f9d1e18fce62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:09.209936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ee810bec-1ff5-4204-8afc-f9d1e18fce62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:09.220214 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ee810bec-1ff5-4204-8afc-f9d1e18fce62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1500 microversion: 2.1 time: 0.292554 Aug 23 18:13:09.227713 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2268/4442] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:08 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1500 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:09.238883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-61b1b234-8dcb-49ca-8c90-ec7432e9fb6c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:09.242670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-61b1b234-8dcb-49ca-8c90-ec7432e9fb6c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:09.251599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61b1b234-8dcb-49ca-8c90-ec7432e9fb6c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:09.252472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61b1b234-8dcb-49ca-8c90-ec7432e9fb6c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:09.253156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61b1b234-8dcb-49ca-8c90-ec7432e9fb6c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:09.254185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61b1b234-8dcb-49ca-8c90-ec7432e9fb6c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:09.254913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61b1b234-8dcb-49ca-8c90-ec7432e9fb6c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:09.256812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61b1b234-8dcb-49ca-8c90-ec7432e9fb6c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:09.375613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-61b1b234-8dcb-49ca-8c90-ec7432e9fb6c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:09.396946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-61b1b234-8dcb-49ca-8c90-ec7432e9fb6c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:09.400421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-61b1b234-8dcb-49ca-8c90-ec7432e9fb6c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:09.401976 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-61b1b234-8dcb-49ca-8c90-ec7432e9fb6c tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 200 len: 1366 microversion: 2.47 time: 0.172587 Aug 23 18:13:09.402795 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2269/4443] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:13:09 2022] GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:13:09.414441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c02b7a9a-b599-4369-869c-dd7f1806ea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:09.429879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c02b7a9a-b599-4369-869c-dd7f1806ea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:09.430824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c02b7a9a-b599-4369-869c-dd7f1806ea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:09.431211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c02b7a9a-b599-4369-869c-dd7f1806ea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:09.487211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c02b7a9a-b599-4369-869c-dd7f1806ea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Going to try to stop instance {{(pid=128808) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 18:13:09.557190 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c02b7a9a-b599-4369-869c-dd7f1806ea40 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "POST /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9/action" status: 202 len: 0 microversion: 2.1 time: 0.152065 Aug 23 18:13:09.558693 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2270/4444] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:13:09 2022] POST /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9/action => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:13:09.571354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aee56376-4635-4ba9-bc5a-ed68d994b8ce tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:09.576982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aee56376-4635-4ba9-bc5a-ed68d994b8ce tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:09.590279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aee56376-4635-4ba9-bc5a-ed68d994b8ce tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:09.591483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aee56376-4635-4ba9-bc5a-ed68d994b8ce tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:09.593324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aee56376-4635-4ba9-bc5a-ed68d994b8ce tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:09.594610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aee56376-4635-4ba9-bc5a-ed68d994b8ce tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:09.596064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aee56376-4635-4ba9-bc5a-ed68d994b8ce tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:09.597269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aee56376-4635-4ba9-bc5a-ed68d994b8ce tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:09.916734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0cb25fb4-3970-4714-934c-b7e78622888a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:09.932629 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0cb25fb4-3970-4714-934c-b7e78622888a tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1318 microversion: 2.1 time: 1.295064 Aug 23 18:13:09.937402 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2175/4445] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:08 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1318 bytes in 1300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:09.942535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2cdf286f-7bb1-4442-9f4e-555643f6eb84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:09.943182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2cdf286f-7bb1-4442-9f4e-555643f6eb84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:09.954993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cdf286f-7bb1-4442-9f4e-555643f6eb84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:09.958739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cdf286f-7bb1-4442-9f4e-555643f6eb84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:09.959427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cdf286f-7bb1-4442-9f4e-555643f6eb84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:09.961347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cdf286f-7bb1-4442-9f4e-555643f6eb84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:09.962024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cdf286f-7bb1-4442-9f4e-555643f6eb84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:09.967684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cdf286f-7bb1-4442-9f4e-555643f6eb84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:10.001189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aee56376-4635-4ba9-bc5a-ed68d994b8ce tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:10.009609 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aee56376-4635-4ba9-bc5a-ed68d994b8ce tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1316 microversion: 2.1 time: 0.448456 Aug 23 18:13:10.013289 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2271/4446] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:09 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1316 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:10.020031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8984a2aa-b3ef-4c5c-a927-ee66e50002e2 req-2446b6da-0df5-4281-a99b-7e18491ca8d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3b668ab-533f-4dca-8ebe-a622745ec9f6", "tag": "7c5d205a-7b37-4b4f-af1b-6529f04a4ea5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:10.046057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8984a2aa-b3ef-4c5c-a927-ee66e50002e2 req-2446b6da-0df5-4281-a99b-7e18491ca8d1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:10.047957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8984a2aa-b3ef-4c5c-a927-ee66e50002e2 req-2446b6da-0df5-4281-a99b-7e18491ca8d1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:10.054334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8984a2aa-b3ef-4c5c-a927-ee66e50002e2 req-2446b6da-0df5-4281-a99b-7e18491ca8d1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:10.080858 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8984a2aa-b3ef-4c5c-a927-ee66e50002e2 req-2446b6da-0df5-4281-a99b-7e18491ca8d1 service nova] Creating event network-changed:7c5d205a-7b37-4b4f-af1b-6529f04a4ea5 for instance c3b668ab-533f-4dca-8ebe-a622745ec9f6 on n-h1-850468-16 Aug 23 18:13:10.089495 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8984a2aa-b3ef-4c5c-a927-ee66e50002e2 req-2446b6da-0df5-4281-a99b-7e18491ca8d1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072965 Aug 23 18:13:10.091907 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2272/4447] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:13:10.438787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-23b1072b-c245-4854-bf28-42f0dc331f11 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:10.439979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-23b1072b-c245-4854-bf28-42f0dc331f11 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:10.464800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23b1072b-c245-4854-bf28-42f0dc331f11 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:10.467265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23b1072b-c245-4854-bf28-42f0dc331f11 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:10.468245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23b1072b-c245-4854-bf28-42f0dc331f11 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:10.469680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23b1072b-c245-4854-bf28-42f0dc331f11 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:10.486772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23b1072b-c245-4854-bf28-42f0dc331f11 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:10.487558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23b1072b-c245-4854-bf28-42f0dc331f11 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:10.660034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-23b1072b-c245-4854-bf28-42f0dc331f11 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:10.677020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-23b1072b-c245-4854-bf28-42f0dc331f11 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:10.678835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-23b1072b-c245-4854-bf28-42f0dc331f11 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:10.680746 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-23b1072b-c245-4854-bf28-42f0dc331f11 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 200 len: 1366 microversion: 2.47 time: 0.254025 Aug 23 18:13:10.681908 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2273/4448] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:13:10 2022] GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:13:10.702957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2cdf286f-7bb1-4442-9f4e-555643f6eb84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:10.717458 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2cdf286f-7bb1-4442-9f4e-555643f6eb84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.778524 Aug 23 18:13:10.718975 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2176/4449] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:09 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:10.956796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7999084f-60f3-4ae3-8528-1053027839e8 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:10.957426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7999084f-60f3-4ae3-8528-1053027839e8 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:10.964667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7999084f-60f3-4ae3-8528-1053027839e8 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:10.965166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7999084f-60f3-4ae3-8528-1053027839e8 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:10.966322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7999084f-60f3-4ae3-8528-1053027839e8 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:10.966965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7999084f-60f3-4ae3-8528-1053027839e8 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:10.967415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7999084f-60f3-4ae3-8528-1053027839e8 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:10.967840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7999084f-60f3-4ae3-8528-1053027839e8 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:11.045816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf2a78eb-c097-4dfc-88ae-3fefd98d6ca0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:11.049040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf2a78eb-c097-4dfc-88ae-3fefd98d6ca0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:11.060225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf2a78eb-c097-4dfc-88ae-3fefd98d6ca0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:11.060736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf2a78eb-c097-4dfc-88ae-3fefd98d6ca0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:11.061716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf2a78eb-c097-4dfc-88ae-3fefd98d6ca0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:11.062642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf2a78eb-c097-4dfc-88ae-3fefd98d6ca0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:11.063658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf2a78eb-c097-4dfc-88ae-3fefd98d6ca0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:11.064263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf2a78eb-c097-4dfc-88ae-3fefd98d6ca0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:11.128646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:11.159302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:11.193345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7999084f-60f3-4ae3-8528-1053027839e8 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:11.199378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:11.204724 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7999084f-60f3-4ae3-8528-1053027839e8 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1318 microversion: 2.1 time: 0.251782 Aug 23 18:13:11.205739 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2274/4450] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:10 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:11.466958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=24 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:11.711217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c71407f9-99d2-4782-83bd-3cb0c4f0a8eb tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:11.711921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c71407f9-99d2-4782-83bd-3cb0c4f0a8eb tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:11.721639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c71407f9-99d2-4782-83bd-3cb0c4f0a8eb tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:11.722502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c71407f9-99d2-4782-83bd-3cb0c4f0a8eb tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:11.729108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c71407f9-99d2-4782-83bd-3cb0c4f0a8eb tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:11.730611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c71407f9-99d2-4782-83bd-3cb0c4f0a8eb tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:11.731864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c71407f9-99d2-4782-83bd-3cb0c4f0a8eb tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:11.734240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c71407f9-99d2-4782-83bd-3cb0c4f0a8eb tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:11.747884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf2a78eb-c097-4dfc-88ae-3fefd98d6ca0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:11.769319 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf2a78eb-c097-4dfc-88ae-3fefd98d6ca0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1316 microversion: 2.1 time: 0.731900 Aug 23 18:13:11.777927 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2177/4451] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:11 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1316 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:11.788765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e30e818-a1fc-4a74-a340-0cc37a4f076a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:11.790820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e30e818-a1fc-4a74-a340-0cc37a4f076a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:11.800122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e30e818-a1fc-4a74-a340-0cc37a4f076a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:11.802199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e30e818-a1fc-4a74-a340-0cc37a4f076a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:11.802925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e30e818-a1fc-4a74-a340-0cc37a4f076a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:11.804503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e30e818-a1fc-4a74-a340-0cc37a4f076a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:11.805191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e30e818-a1fc-4a74-a340-0cc37a4f076a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:11.806103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e30e818-a1fc-4a74-a340-0cc37a4f076a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:11.923701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c71407f9-99d2-4782-83bd-3cb0c4f0a8eb tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:11.935538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c71407f9-99d2-4782-83bd-3cb0c4f0a8eb tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:11.937436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c71407f9-99d2-4782-83bd-3cb0c4f0a8eb tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:11.938944 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c71407f9-99d2-4782-83bd-3cb0c4f0a8eb tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 200 len: 1366 microversion: 2.47 time: 0.233701 Aug 23 18:13:11.942938 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2275/4452] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:13:11 2022] GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:13:12.226851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1dd33c16-fd25-46b6-b037-e51913c7b31c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:12.227806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1dd33c16-fd25-46b6-b037-e51913c7b31c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:12.242843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd33c16-fd25-46b6-b037-e51913c7b31c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:12.245016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd33c16-fd25-46b6-b037-e51913c7b31c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:12.245729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd33c16-fd25-46b6-b037-e51913c7b31c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:12.249055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd33c16-fd25-46b6-b037-e51913c7b31c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:12.250594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd33c16-fd25-46b6-b037-e51913c7b31c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:12.251362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd33c16-fd25-46b6-b037-e51913c7b31c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:12.254886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7e30e818-a1fc-4a74-a340-0cc37a4f076a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:12.264600 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e30e818-a1fc-4a74-a340-0cc37a4f076a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.485026 Aug 23 18:13:12.269269 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2178/4453] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:11 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:12.784571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1dd33c16-fd25-46b6-b037-e51913c7b31c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:12.792740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-16495fe2-188a-4828-8367-22a0587082d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:12.793505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-16495fe2-188a-4828-8367-22a0587082d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:12.799216 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1dd33c16-fd25-46b6-b037-e51913c7b31c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1318 microversion: 2.1 time: 0.577533 Aug 23 18:13:12.799812 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2276/4454] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:12 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1318 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:12.803416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16495fe2-188a-4828-8367-22a0587082d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:12.805194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16495fe2-188a-4828-8367-22a0587082d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:12.806724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16495fe2-188a-4828-8367-22a0587082d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:12.809231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16495fe2-188a-4828-8367-22a0587082d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:12.809973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16495fe2-188a-4828-8367-22a0587082d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:12.811625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16495fe2-188a-4828-8367-22a0587082d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:12.963657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:12.964299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:12.976804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:12.977305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:12.985247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:12.986430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:12.986834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:12.987250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:13.048078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:13.048578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:13.049014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:13.049467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lazy-loading 'fault' on Instance uuid a1513306-bdab-4757-8967-b2ecab9cd865 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:13:13.143751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:13.159216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:13.162063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '54a8ed42f2144b5eb97158fe72e742c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1eb6ebd974214cad903412e234924217', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:13.164023 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-485a673f-17f7-40f0-bf18-df4a1f1fe907 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 200 len: 1371 microversion: 2.47 time: 0.204101 Aug 23 18:13:13.165194 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2277/4455] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:13:12 2022] GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 1371 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:13:13.292808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-61f14679-d80a-4102-b61e-716373ae19a2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:13.294623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-61f14679-d80a-4102-b61e-716373ae19a2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:13.306562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61f14679-d80a-4102-b61e-716373ae19a2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:13.307472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61f14679-d80a-4102-b61e-716373ae19a2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:13.310857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61f14679-d80a-4102-b61e-716373ae19a2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:13.313079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61f14679-d80a-4102-b61e-716373ae19a2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:13.314533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61f14679-d80a-4102-b61e-716373ae19a2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:13.317021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61f14679-d80a-4102-b61e-716373ae19a2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:13.409867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-16495fe2-188a-4828-8367-22a0587082d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:13.427000 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-16495fe2-188a-4828-8367-22a0587082d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1316 microversion: 2.1 time: 0.638428 Aug 23 18:13:13.427952 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2179/4456] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:12 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1316 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:13.713000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-61f14679-d80a-4102-b61e-716373ae19a2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:13.724356 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-61f14679-d80a-4102-b61e-716373ae19a2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.435760 Aug 23 18:13:13.725716 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2278/4457] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:13 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:13.822739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3339308b-3882-449b-9fe6-d7f6c2c57b00 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:13.823366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3339308b-3882-449b-9fe6-d7f6c2c57b00 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:13.849481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3339308b-3882-449b-9fe6-d7f6c2c57b00 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:13.850185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3339308b-3882-449b-9fe6-d7f6c2c57b00 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:13.850848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3339308b-3882-449b-9fe6-d7f6c2c57b00 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:13.851776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3339308b-3882-449b-9fe6-d7f6c2c57b00 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:13.852394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3339308b-3882-449b-9fe6-d7f6c2c57b00 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:13.852983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3339308b-3882-449b-9fe6-d7f6c2c57b00 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:14.043181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1ac6813e-1ec8-44f2-9552-453ead6ab79d tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Action: 'create', calling method: .version_select at 0x7f27df6aa310>, body: {"keypair": {"name": "tempest-keypair-1125848974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKNCjaxVbhSDeU/Nuh50/HR1aiPcbpc1D1UL8T7XbI94wv4VE6z3RKSeNkMHnybUoYKX9W/HsOdE3zxqJcurnIf9T4gz1jEkfQ9mOtsHS1DI6FN0hQo8jvqSOrhmFxAojg=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:14.098439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-1ac6813e-1ec8-44f2-9552-453ead6ab79d tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Getting quotas for project 1b9a8cc730ec452daede3d0640e264d7. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:13:14.116664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-1ac6813e-1ec8-44f2-9552-453ead6ab79d tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Getting quotas for user f5d4ecb2510a43f5bb7d983e65f3d49a and project 1b9a8cc730ec452daede3d0640e264d7. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:13:14.209432 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1ac6813e-1ec8-44f2-9552-453ead6ab79d tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.370767 Aug 23 18:13:14.213104 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2279/4458] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:13:13 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:13:14.224154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b742e6e5-3d28-427e-a6a1-4c935abbb7d2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:14.224781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b742e6e5-3d28-427e-a6a1-4c935abbb7d2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] [instance: a1513306-bdab-4757-8967-b2ecab9cd865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:14.232725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b742e6e5-3d28-427e-a6a1-4c935abbb7d2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:14.233235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b742e6e5-3d28-427e-a6a1-4c935abbb7d2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:14.233680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b742e6e5-3d28-427e-a6a1-4c935abbb7d2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:14.235300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b742e6e5-3d28-427e-a6a1-4c935abbb7d2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:14.236096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b742e6e5-3d28-427e-a6a1-4c935abbb7d2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:14.236543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b742e6e5-3d28-427e-a6a1-4c935abbb7d2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:14.257397 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b742e6e5-3d28-427e-a6a1-4c935abbb7d2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] HTTP exception thrown: Instance a1513306-bdab-4757-8967-b2ecab9cd865 could not be found. Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b742e6e5-3d28-427e-a6a1-4c935abbb7d2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Request method failure captured: Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 HTTP/1.1 Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRipq9AIuOt0ot3QCvv1EaFc8egEA2wt7skN2yPJ493CCVHlUxaQV3UGBZfQB-s1APAuWvQ6ziiLHNre7LbI9AODL5ZcBHp6MeoAN19rwaZ_y342ssZl0Y1PhNGQKRciV3KcIXa1XFeQMJpLI-xVS6tIme-9F46OSu-wKPitShlIwOw Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.47 Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 1eb6ebd974214cad903412e234924217 Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersAaction247Test-1252870691 Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1eb6ebd974214cad903412e234924217"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1eb6ebd974214cad903412e234924217"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1eb6ebd974214cad903412e234924217"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1eb6ebd974214cad903412e234924217"}]}] Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersAaction247Test-1252870691 Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 1eb6ebd974214cad903412e234924217 Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersAaction247Test-1252870691 Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersAaction247Test-1252870691-project Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 54a8ed42f2144b5eb97158fe72e742c8 Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersAaction247Test-1252870691-project Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance a1513306-bdab-4757-8967-b2ecab9cd865 could not be found. Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'a1513306-bdab-4757-8967-b2ecab9cd865'} Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a1513306-bdab-4757-8967-b2ecab9cd865 could not be found. Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a1513306-bdab-4757-8967-b2ecab9cd865 could not be found. Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:14.259250 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:13:14.264355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:14.264355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:13:14.264355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:13:14.264355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:13:14.264355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:13:14.264355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:13:14.264355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a1513306-bdab-4757-8967-b2ecab9cd865 could not be found. Aug 23 18:13:14.264355 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:14.264355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b742e6e5-3d28-427e-a6a1-4c935abbb7d2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] Returning 404 to user: Instance a1513306-bdab-4757-8967-b2ecab9cd865 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:13:14.264355 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b742e6e5-3d28-427e-a6a1-4c935abbb7d2 tempest-ServersAaction247Test-1252870691 tempest-ServersAaction247Test-1252870691-project] 10.222.0.61 "GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865" status: 404 len: 111 microversion: 2.47 time: 0.046512 Aug 23 18:13:14.265357 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2280/4459] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:13:14 2022] GET /compute/v2.1/servers/a1513306-bdab-4757-8967-b2ecab9cd865 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:13:14.318671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3339308b-3882-449b-9fe6-d7f6c2c57b00 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:14.343910 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3339308b-3882-449b-9fe6-d7f6c2c57b00 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1318 microversion: 2.1 time: 0.522520 Aug 23 18:13:14.347571 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2180/4460] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:13 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:14.453447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-28deedd6-c0fd-4cc2-928e-7e8b72a58d12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:14.455747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-28deedd6-c0fd-4cc2-928e-7e8b72a58d12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:14.477015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28deedd6-c0fd-4cc2-928e-7e8b72a58d12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:14.483145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28deedd6-c0fd-4cc2-928e-7e8b72a58d12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:14.483664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28deedd6-c0fd-4cc2-928e-7e8b72a58d12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:14.484544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28deedd6-c0fd-4cc2-928e-7e8b72a58d12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:14.485048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28deedd6-c0fd-4cc2-928e-7e8b72a58d12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:14.485524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28deedd6-c0fd-4cc2-928e-7e8b72a58d12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:14.747008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5ffa6546-f591-4490-aa42-408e98944c27 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:14.748369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5ffa6546-f591-4490-aa42-408e98944c27 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:14.758358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ffa6546-f591-4490-aa42-408e98944c27 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:14.760686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ffa6546-f591-4490-aa42-408e98944c27 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:14.761448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ffa6546-f591-4490-aa42-408e98944c27 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:14.764529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ffa6546-f591-4490-aa42-408e98944c27 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:14.765859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ffa6546-f591-4490-aa42-408e98944c27 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:14.767155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ffa6546-f591-4490-aa42-408e98944c27 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:15.227497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-28deedd6-c0fd-4cc2-928e-7e8b72a58d12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:15.239326 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-28deedd6-c0fd-4cc2-928e-7e8b72a58d12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1316 microversion: 2.1 time: 0.793170 Aug 23 18:13:15.259045 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2281/4461] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:14 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1316 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:15.369346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-60245adf-35d9-480c-bc65-5f607e25cfac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:15.369966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-60245adf-35d9-480c-bc65-5f607e25cfac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:15.383436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60245adf-35d9-480c-bc65-5f607e25cfac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:15.384744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60245adf-35d9-480c-bc65-5f607e25cfac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:15.384744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60245adf-35d9-480c-bc65-5f607e25cfac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:15.385731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60245adf-35d9-480c-bc65-5f607e25cfac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:15.386344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60245adf-35d9-480c-bc65-5f607e25cfac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:15.387002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60245adf-35d9-480c-bc65-5f607e25cfac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:15.699425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-60245adf-35d9-480c-bc65-5f607e25cfac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:15.719739 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-60245adf-35d9-480c-bc65-5f607e25cfac tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1318 microversion: 2.1 time: 0.354254 Aug 23 18:13:15.730574 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2282/4462] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:15 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1318 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:15.806612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5ffa6546-f591-4490-aa42-408e98944c27 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:15.822240 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5ffa6546-f591-4490-aa42-408e98944c27 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 1.076619 Aug 23 18:13:15.825788 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2181/4463] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:14 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:16.260525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6ceef1dc-7fee-4e2a-a594-0b82f5fe3074 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:16.263621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6ceef1dc-7fee-4e2a-a594-0b82f5fe3074 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:16.272916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ceef1dc-7fee-4e2a-a594-0b82f5fe3074 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:16.287187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ceef1dc-7fee-4e2a-a594-0b82f5fe3074 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:16.289065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ceef1dc-7fee-4e2a-a594-0b82f5fe3074 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:16.290957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ceef1dc-7fee-4e2a-a594-0b82f5fe3074 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:16.291814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ceef1dc-7fee-4e2a-a594-0b82f5fe3074 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:16.296514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ceef1dc-7fee-4e2a-a594-0b82f5fe3074 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:16.402431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-af8ec762-3c9f-404c-bb6e-963a792a8ded req-f3d493ec-187a-49a2-9542-46645e198317 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cad0fb-87b4-403c-9881-64ce147502fd", "name": "network-vif-plugged", "status": "completed", "tag": "933227f8-f35c-4a4d-8cd9-453f1505d7a3"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:16.435457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-af8ec762-3c9f-404c-bb6e-963a792a8ded req-f3d493ec-187a-49a2-9542-46645e198317 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:16.436231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-af8ec762-3c9f-404c-bb6e-963a792a8ded req-f3d493ec-187a-49a2-9542-46645e198317 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:16.440343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-af8ec762-3c9f-404c-bb6e-963a792a8ded req-f3d493ec-187a-49a2-9542-46645e198317 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:16.493905 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-af8ec762-3c9f-404c-bb6e-963a792a8ded req-f3d493ec-187a-49a2-9542-46645e198317 service nova] Creating event network-vif-plugged:933227f8-f35c-4a4d-8cd9-453f1505d7a3 for instance f1cad0fb-87b4-403c-9881-64ce147502fd on n-h2-850468-16 Aug 23 18:13:16.515661 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-af8ec762-3c9f-404c-bb6e-963a792a8ded req-f3d493ec-187a-49a2-9542-46645e198317 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129448 Aug 23 18:13:16.530672 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2182/4464] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 23 18:13:16.747412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9bc21c06-b08a-47a1-8e77-d70fbc5f0090 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:16.748603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9bc21c06-b08a-47a1-8e77-d70fbc5f0090 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:16.763527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6ceef1dc-7fee-4e2a-a594-0b82f5fe3074 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:16.768923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bc21c06-b08a-47a1-8e77-d70fbc5f0090 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:16.770723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bc21c06-b08a-47a1-8e77-d70fbc5f0090 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:16.771354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bc21c06-b08a-47a1-8e77-d70fbc5f0090 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:16.772865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bc21c06-b08a-47a1-8e77-d70fbc5f0090 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:16.773733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bc21c06-b08a-47a1-8e77-d70fbc5f0090 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:16.775030 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6ceef1dc-7fee-4e2a-a594-0b82f5fe3074 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1316 microversion: 2.1 time: 0.518290 Aug 23 18:13:16.775629 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2283/4465] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:16 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1316 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:16.777010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bc21c06-b08a-47a1-8e77-d70fbc5f0090 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:16.844692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a685e188-f469-4bf2-b1f2-9289c789ff39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:16.845316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a685e188-f469-4bf2-b1f2-9289c789ff39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:16.862154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a685e188-f469-4bf2-b1f2-9289c789ff39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:16.862684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a685e188-f469-4bf2-b1f2-9289c789ff39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:16.863137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a685e188-f469-4bf2-b1f2-9289c789ff39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:16.863854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a685e188-f469-4bf2-b1f2-9289c789ff39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:16.864314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a685e188-f469-4bf2-b1f2-9289c789ff39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:16.864799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a685e188-f469-4bf2-b1f2-9289c789ff39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:17.470194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a685e188-f469-4bf2-b1f2-9289c789ff39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:17.485522 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a685e188-f469-4bf2-b1f2-9289c789ff39 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.642382 Aug 23 18:13:17.487888 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2284/4466] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:16 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:17.782529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9bc21c06-b08a-47a1-8e77-d70fbc5f0090 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:17.785853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:17.795291 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9bc21c06-b08a-47a1-8e77-d70fbc5f0090 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1318 microversion: 2.1 time: 1.054018 Aug 23 18:13:17.798736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ab672ad7-d09b-4c5c-8de8-2be6f046c823 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:17.799039 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2183/4467] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:16 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1318 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:17.799767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab672ad7-d09b-4c5c-8de8-2be6f046c823 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:17.818705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab672ad7-d09b-4c5c-8de8-2be6f046c823 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:17.819515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab672ad7-d09b-4c5c-8de8-2be6f046c823 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:17.820130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab672ad7-d09b-4c5c-8de8-2be6f046c823 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:17.822254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab672ad7-d09b-4c5c-8de8-2be6f046c823 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:17.823094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab672ad7-d09b-4c5c-8de8-2be6f046c823 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:17.823909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab672ad7-d09b-4c5c-8de8-2be6f046c823 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:18.390571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ab672ad7-d09b-4c5c-8de8-2be6f046c823 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:18.434445 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ab672ad7-d09b-4c5c-8de8-2be6f046c823 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1316 microversion: 2.1 time: 0.639781 Aug 23 18:13:18.436622 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2285/4468] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:17 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1316 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:18.513489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cf2ecc6-d8a0-4592-8d65-019bcad965e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:18.514514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0cf2ecc6-d8a0-4592-8d65-019bcad965e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:18.563086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cf2ecc6-d8a0-4592-8d65-019bcad965e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:18.563791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cf2ecc6-d8a0-4592-8d65-019bcad965e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:18.566844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cf2ecc6-d8a0-4592-8d65-019bcad965e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:18.569296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cf2ecc6-d8a0-4592-8d65-019bcad965e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:18.570007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cf2ecc6-d8a0-4592-8d65-019bcad965e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:18.572288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cf2ecc6-d8a0-4592-8d65-019bcad965e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:18.819791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c381ddb5-4cef-4da5-8eab-0badaedfc858 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:18.820519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c381ddb5-4cef-4da5-8eab-0badaedfc858 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:18.834725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c381ddb5-4cef-4da5-8eab-0badaedfc858 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:18.835768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c381ddb5-4cef-4da5-8eab-0badaedfc858 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:18.836213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c381ddb5-4cef-4da5-8eab-0badaedfc858 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:18.836931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c381ddb5-4cef-4da5-8eab-0badaedfc858 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:18.837391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c381ddb5-4cef-4da5-8eab-0badaedfc858 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:18.837824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c381ddb5-4cef-4da5-8eab-0badaedfc858 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:18.868006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0cf2ecc6-d8a0-4592-8d65-019bcad965e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:18.881413 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0cf2ecc6-d8a0-4592-8d65-019bcad965e2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.373446 Aug 23 18:13:18.883462 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2184/4469] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:18 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:19.456822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3c1bf46e-5523-40b0-a87c-4db8c16e8fff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:19.457795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3c1bf46e-5523-40b0-a87c-4db8c16e8fff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:19.473999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c1bf46e-5523-40b0-a87c-4db8c16e8fff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:19.474507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c1bf46e-5523-40b0-a87c-4db8c16e8fff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:19.475018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c1bf46e-5523-40b0-a87c-4db8c16e8fff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:19.475711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c1bf46e-5523-40b0-a87c-4db8c16e8fff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:19.476172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c1bf46e-5523-40b0-a87c-4db8c16e8fff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:19.476611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c1bf46e-5523-40b0-a87c-4db8c16e8fff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:19.728078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3c1bf46e-5523-40b0-a87c-4db8c16e8fff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:19.743587 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3c1bf46e-5523-40b0-a87c-4db8c16e8fff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.290522 Aug 23 18:13:19.750669 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2185/4470] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:19 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:19.896256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1873930971", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:20.001189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] validate_networks() for [('597d3f38-9c5d-451f-81bf-3e3fa931aa6a', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:13:20.050057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c381ddb5-4cef-4da5-8eab-0badaedfc858 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:20.060346 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c381ddb5-4cef-4da5-8eab-0badaedfc858 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1318 microversion: 2.1 time: 1.246465 Aug 23 18:13:20.064110 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2286/4471] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:18 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1318 bytes in 1251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:20.073207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cb1b00e5-916d-4d57-8ad8-6a80b4b7d84e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:20.074076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cb1b00e5-916d-4d57-8ad8-6a80b4b7d84e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:20.098579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb1b00e5-916d-4d57-8ad8-6a80b4b7d84e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:20.099319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb1b00e5-916d-4d57-8ad8-6a80b4b7d84e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:20.099930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb1b00e5-916d-4d57-8ad8-6a80b4b7d84e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:20.102170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb1b00e5-916d-4d57-8ad8-6a80b4b7d84e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:20.104283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb1b00e5-916d-4d57-8ad8-6a80b4b7d84e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:20.104925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cb1b00e5-916d-4d57-8ad8-6a80b4b7d84e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:20.604755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cb1b00e5-916d-4d57-8ad8-6a80b4b7d84e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:20.654021 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cb1b00e5-916d-4d57-8ad8-6a80b4b7d84e tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.585665 Aug 23 18:13:20.670706 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2287/4472] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:20 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:21.098045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7652c6a9-7f90-4d9a-b1d4-215c36061adf tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:21.100549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7652c6a9-7f90-4d9a-b1d4-215c36061adf tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:21.118467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7652c6a9-7f90-4d9a-b1d4-215c36061adf tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:21.119919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7652c6a9-7f90-4d9a-b1d4-215c36061adf tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:21.121842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7652c6a9-7f90-4d9a-b1d4-215c36061adf tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:21.124037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7652c6a9-7f90-4d9a-b1d4-215c36061adf tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:21.128291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7652c6a9-7f90-4d9a-b1d4-215c36061adf tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:21.128972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7652c6a9-7f90-4d9a-b1d4-215c36061adf tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:21.703440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7652c6a9-7f90-4d9a-b1d4-215c36061adf tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:21.721597 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7652c6a9-7f90-4d9a-b1d4-215c36061adf tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1318 microversion: 2.1 time: 0.635714 Aug 23 18:13:21.725119 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2288/4473] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:21 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1318 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:21.736509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8706d625-1dc3-4fb1-8661-ebf5a014b401 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:21.751692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8706d625-1dc3-4fb1-8661-ebf5a014b401 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:21.768247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8706d625-1dc3-4fb1-8661-ebf5a014b401 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:21.771455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8706d625-1dc3-4fb1-8661-ebf5a014b401 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:21.772007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8706d625-1dc3-4fb1-8661-ebf5a014b401 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:21.773918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8706d625-1dc3-4fb1-8661-ebf5a014b401 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:21.777464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8706d625-1dc3-4fb1-8661-ebf5a014b401 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:21.778303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8706d625-1dc3-4fb1-8661-ebf5a014b401 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:22.240689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8706d625-1dc3-4fb1-8661-ebf5a014b401 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:22.255028 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8706d625-1dc3-4fb1-8661-ebf5a014b401 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.527999 Aug 23 18:13:22.257949 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2289/4474] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:21 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:22.277939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-92b89311-df5e-41e8-a778-800b83e9d66b req-3b505291-8e88-4c39-839d-7a01fe513e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b668ab-533f-4dca-8ebe-a622745ec9f6", "name": "network-vif-plugged", "status": "completed", "tag": "7c5d205a-7b37-4b4f-af1b-6529f04a4ea5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:22.298379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-92b89311-df5e-41e8-a778-800b83e9d66b req-3b505291-8e88-4c39-839d-7a01fe513e9e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:22.300147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-92b89311-df5e-41e8-a778-800b83e9d66b req-3b505291-8e88-4c39-839d-7a01fe513e9e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:22.300818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-92b89311-df5e-41e8-a778-800b83e9d66b req-3b505291-8e88-4c39-839d-7a01fe513e9e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:22.337441 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-92b89311-df5e-41e8-a778-800b83e9d66b req-3b505291-8e88-4c39-839d-7a01fe513e9e service nova] Creating event network-vif-plugged:7c5d205a-7b37-4b4f-af1b-6529f04a4ea5 for instance c3b668ab-533f-4dca-8ebe-a622745ec9f6 on n-h1-850468-16 Aug 23 18:13:22.353326 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-92b89311-df5e-41e8-a778-800b83e9d66b req-3b505291-8e88-4c39-839d-7a01fe513e9e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093624 Aug 23 18:13:22.354050 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2290/4475] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:13:22.746269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5836504d-bf3a-407d-865b-6d32b0466ab5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:22.748516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5836504d-bf3a-407d-865b-6d32b0466ab5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:22.763663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5836504d-bf3a-407d-865b-6d32b0466ab5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:22.764170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5836504d-bf3a-407d-865b-6d32b0466ab5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:22.764747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5836504d-bf3a-407d-865b-6d32b0466ab5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:22.765335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5836504d-bf3a-407d-865b-6d32b0466ab5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:22.765795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5836504d-bf3a-407d-865b-6d32b0466ab5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:22.766229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5836504d-bf3a-407d-865b-6d32b0466ab5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:22.843042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:13:22.844031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:13:22.845051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:13:22.845619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:13:22.846191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:13:22.866193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:22.867485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:22.868305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:22.871032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:22.872608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:22.875090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:22.955252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Getting quotas for project a2600f90b7734756a397c658ae140e6e. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:13:22.971461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Getting quotas for user f03bc0a9e89240dbbe6b7c556449b912 and project a2600f90b7734756a397c658ae140e6e. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:13:23.019977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:13:23.023784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:13:23.061277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:23.112853 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c7c6d4ac-8086-4b6b-857a-3c4f03c9a688 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.224281 Aug 23 18:13:23.116215 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2186/4476] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:13:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 3229 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:13:23.127363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-14a8bb10-63b3-48b1-b88d-9b353dcd92c3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:23.130480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-14a8bb10-63b3-48b1-b88d-9b353dcd92c3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:23.167155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5836504d-bf3a-407d-865b-6d32b0466ab5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:23.196031 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5836504d-bf3a-407d-865b-6d32b0466ab5 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1318 microversion: 2.1 time: 0.454012 Aug 23 18:13:23.203542 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2291/4477] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:22 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1318 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:23.277511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3a1daa4e-2c07-4851-9e62-67c83f8112d2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:23.279641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3a1daa4e-2c07-4851-9e62-67c83f8112d2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:23.279916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-14a8bb10-63b3-48b1-b88d-9b353dcd92c3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:23.295154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a1daa4e-2c07-4851-9e62-67c83f8112d2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:23.295577 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-14a8bb10-63b3-48b1-b88d-9b353dcd92c3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1217 microversion: 2.1 time: 0.172648 Aug 23 18:13:23.295698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a1daa4e-2c07-4851-9e62-67c83f8112d2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:23.296090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a1daa4e-2c07-4851-9e62-67c83f8112d2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:23.297688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a1daa4e-2c07-4851-9e62-67c83f8112d2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:23.298697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a1daa4e-2c07-4851-9e62-67c83f8112d2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:23.299145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a1daa4e-2c07-4851-9e62-67c83f8112d2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:23.302892 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2187/4478] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:23 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1217 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:23.576868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3a1daa4e-2c07-4851-9e62-67c83f8112d2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:23.594094 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3a1daa4e-2c07-4851-9e62-67c83f8112d2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.319247 Aug 23 18:13:23.595310 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2292/4479] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:23 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:24.223680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7dba119f-2e87-47ec-b623-36c511bec929 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:24.224326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7dba119f-2e87-47ec-b623-36c511bec929 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:24.239586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dba119f-2e87-47ec-b623-36c511bec929 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:24.240027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dba119f-2e87-47ec-b623-36c511bec929 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:24.246152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dba119f-2e87-47ec-b623-36c511bec929 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:24.247870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dba119f-2e87-47ec-b623-36c511bec929 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:24.253373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dba119f-2e87-47ec-b623-36c511bec929 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:24.255149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dba119f-2e87-47ec-b623-36c511bec929 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:24.326243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f684ff1-faed-487d-a9f7-97aab4aca80d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:24.327693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8f684ff1-faed-487d-a9f7-97aab4aca80d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:24.330817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:24.357820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f684ff1-faed-487d-a9f7-97aab4aca80d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:24.358334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f684ff1-faed-487d-a9f7-97aab4aca80d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:24.358832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f684ff1-faed-487d-a9f7-97aab4aca80d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:24.359525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f684ff1-faed-487d-a9f7-97aab4aca80d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:24.359988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f684ff1-faed-487d-a9f7-97aab4aca80d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:24.360420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f684ff1-faed-487d-a9f7-97aab4aca80d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:24.427662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:24.628837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8f684ff1-faed-487d-a9f7-97aab4aca80d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:24.638132 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f684ff1-faed-487d-a9f7-97aab4aca80d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1221 microversion: 2.1 time: 0.316528 Aug 23 18:13:24.678643 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2293/4480] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:24 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1221 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:24.697868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e36ea6be-073b-422a-80ac-3e4267009ab8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:24.703439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e36ea6be-073b-422a-80ac-3e4267009ab8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:24.726318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e36ea6be-073b-422a-80ac-3e4267009ab8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:24.729201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e36ea6be-073b-422a-80ac-3e4267009ab8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:24.729999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e36ea6be-073b-422a-80ac-3e4267009ab8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:24.731812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e36ea6be-073b-422a-80ac-3e4267009ab8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:24.736828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e36ea6be-073b-422a-80ac-3e4267009ab8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:24.737646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e36ea6be-073b-422a-80ac-3e4267009ab8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:25.037287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7dba119f-2e87-47ec-b623-36c511bec929 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:25.064996 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7dba119f-2e87-47ec-b623-36c511bec929 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1318 microversion: 2.1 time: 0.846492 Aug 23 18:13:25.065993 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2188/4481] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:24 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1318 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:25.232527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e36ea6be-073b-422a-80ac-3e4267009ab8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:25.247608 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e36ea6be-073b-422a-80ac-3e4267009ab8 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.565875 Aug 23 18:13:25.266135 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2294/4482] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:24 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:25.681908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5cecc39d-af5f-4244-a638-2fde9e4ed22c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:25.682847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5cecc39d-af5f-4244-a638-2fde9e4ed22c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:25.714691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cecc39d-af5f-4244-a638-2fde9e4ed22c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:25.721540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cecc39d-af5f-4244-a638-2fde9e4ed22c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:25.725546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cecc39d-af5f-4244-a638-2fde9e4ed22c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:25.726623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cecc39d-af5f-4244-a638-2fde9e4ed22c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:25.727319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cecc39d-af5f-4244-a638-2fde9e4ed22c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:25.727972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cecc39d-af5f-4244-a638-2fde9e4ed22c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:26.091207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-85dbf238-3eb0-48cf-9bb1-b26f93b21d2c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:26.092348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-85dbf238-3eb0-48cf-9bb1-b26f93b21d2c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:26.124502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85dbf238-3eb0-48cf-9bb1-b26f93b21d2c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:26.125150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85dbf238-3eb0-48cf-9bb1-b26f93b21d2c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:26.125619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85dbf238-3eb0-48cf-9bb1-b26f93b21d2c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:26.126386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85dbf238-3eb0-48cf-9bb1-b26f93b21d2c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:26.134862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85dbf238-3eb0-48cf-9bb1-b26f93b21d2c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:26.135509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85dbf238-3eb0-48cf-9bb1-b26f93b21d2c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:26.423688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5cecc39d-af5f-4244-a638-2fde9e4ed22c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:26.440568 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5cecc39d-af5f-4244-a638-2fde9e4ed22c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1287 microversion: 2.1 time: 0.759395 Aug 23 18:13:26.446845 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2189/4483] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:25 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1287 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:26.476978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5a18816b-5199-492d-80ac-8b80885b8975 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:26.481640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5a18816b-5199-492d-80ac-8b80885b8975 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:26.523541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a18816b-5199-492d-80ac-8b80885b8975 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:26.524044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a18816b-5199-492d-80ac-8b80885b8975 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:26.536300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a18816b-5199-492d-80ac-8b80885b8975 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:26.539605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a18816b-5199-492d-80ac-8b80885b8975 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:26.545151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a18816b-5199-492d-80ac-8b80885b8975 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:26.545568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a18816b-5199-492d-80ac-8b80885b8975 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:26.732817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-85dbf238-3eb0-48cf-9bb1-b26f93b21d2c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:26.742290 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-85dbf238-3eb0-48cf-9bb1-b26f93b21d2c tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1506 microversion: 2.1 time: 0.655420 Aug 23 18:13:26.747722 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2295/4484] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:26 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1506 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:26.770373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c4e1e26a-81ab-47eb-9b84-b78ad41f8ff9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d341950-2ee6-4301-99e5-b60e895fe6e3", "device": "/dev/sdb"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:26.775127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c4e1e26a-81ab-47eb-9b84-b78ad41f8ff9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:26.802391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4e1e26a-81ab-47eb-9b84-b78ad41f8ff9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:26.803632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4e1e26a-81ab-47eb-9b84-b78ad41f8ff9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:26.807702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4e1e26a-81ab-47eb-9b84-b78ad41f8ff9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:26.810249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4e1e26a-81ab-47eb-9b84-b78ad41f8ff9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:26.811758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4e1e26a-81ab-47eb-9b84-b78ad41f8ff9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:26.812667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4e1e26a-81ab-47eb-9b84-b78ad41f8ff9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:26.944823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5a18816b-5199-492d-80ac-8b80885b8975 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:26.956121 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5a18816b-5199-492d-80ac-8b80885b8975 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.507248 Aug 23 18:13:26.974450 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2190/4485] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:26 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:27.443690 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c4e1e26a-81ab-47eb-9b84-b78ad41f8ff9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "POST /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.679347 Aug 23 18:13:27.444335 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2296/4486] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:13:26 2022] POST /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6/os-volume_attachments => generated 194 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:13:27.467605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d0aee48-343f-4b91-ad77-7e6a1cf54c1c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:27.468616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d0aee48-343f-4b91-ad77-7e6a1cf54c1c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:27.541386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d0aee48-343f-4b91-ad77-7e6a1cf54c1c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:27.544393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d0aee48-343f-4b91-ad77-7e6a1cf54c1c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:27.545116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d0aee48-343f-4b91-ad77-7e6a1cf54c1c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:27.546087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d0aee48-343f-4b91-ad77-7e6a1cf54c1c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:27.548494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d0aee48-343f-4b91-ad77-7e6a1cf54c1c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:27.549123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d0aee48-343f-4b91-ad77-7e6a1cf54c1c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:27.984886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ab2b26e7-23b5-497a-b973-8a59edf7c997 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:27.985880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab2b26e7-23b5-497a-b973-8a59edf7c997 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:28.029959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab2b26e7-23b5-497a-b973-8a59edf7c997 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:28.030550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab2b26e7-23b5-497a-b973-8a59edf7c997 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:28.031016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab2b26e7-23b5-497a-b973-8a59edf7c997 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:28.031790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab2b26e7-23b5-497a-b973-8a59edf7c997 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:28.032239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab2b26e7-23b5-497a-b973-8a59edf7c997 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:28.032671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab2b26e7-23b5-497a-b973-8a59edf7c997 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:28.380531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5d0aee48-343f-4b91-ad77-7e6a1cf54c1c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:28.428723 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d0aee48-343f-4b91-ad77-7e6a1cf54c1c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1317 microversion: 2.1 time: 0.961689 Aug 23 18:13:28.433104 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2191/4487] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:27 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1317 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:28.850810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ab2b26e7-23b5-497a-b973-8a59edf7c997 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:28.868318 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ab2b26e7-23b5-497a-b973-8a59edf7c997 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.890050 Aug 23 18:13:28.869486 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2297/4488] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:27 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:29.455641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e984227-57ca-4068-be9e-0229d5d3ea47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:29.456276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e984227-57ca-4068-be9e-0229d5d3ea47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:29.469745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e984227-57ca-4068-be9e-0229d5d3ea47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:29.473547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e984227-57ca-4068-be9e-0229d5d3ea47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:29.474000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e984227-57ca-4068-be9e-0229d5d3ea47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:29.475767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e984227-57ca-4068-be9e-0229d5d3ea47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:29.477754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e984227-57ca-4068-be9e-0229d5d3ea47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:29.478208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e984227-57ca-4068-be9e-0229d5d3ea47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:29.895308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-75f14f70-c300-4995-a048-c7d29f59b9ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:29.896784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-75f14f70-c300-4995-a048-c7d29f59b9ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:29.918875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75f14f70-c300-4995-a048-c7d29f59b9ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:29.923066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75f14f70-c300-4995-a048-c7d29f59b9ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:29.929338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75f14f70-c300-4995-a048-c7d29f59b9ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:29.931162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75f14f70-c300-4995-a048-c7d29f59b9ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:29.932649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75f14f70-c300-4995-a048-c7d29f59b9ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:29.933370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75f14f70-c300-4995-a048-c7d29f59b9ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:30.344664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e984227-57ca-4068-be9e-0229d5d3ea47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:30.358065 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e984227-57ca-4068-be9e-0229d5d3ea47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1317 microversion: 2.1 time: 0.908478 Aug 23 18:13:30.377213 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2192/4489] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:29 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1317 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:31.288672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-1366118140", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "bcef2581-80d0-47e5-8b8b-34343a6facf5"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:31.470223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-75f14f70-c300-4995-a048-c7d29f59b9ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:31.478643 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-75f14f70-c300-4995-a048-c7d29f59b9ae tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 1.587272 Aug 23 18:13:31.498011 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2298/4490] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:29 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:31.517663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8b9dba1b-8d69-4103-94c4-dce5d99f8b77 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:31.518307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8b9dba1b-8d69-4103-94c4-dce5d99f8b77 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:31.520798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:31.550392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b9dba1b-8d69-4103-94c4-dce5d99f8b77 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:31.550933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b9dba1b-8d69-4103-94c4-dce5d99f8b77 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:31.554042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b9dba1b-8d69-4103-94c4-dce5d99f8b77 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:31.556971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b9dba1b-8d69-4103-94c4-dce5d99f8b77 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:31.557464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b9dba1b-8d69-4103-94c4-dce5d99f8b77 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:31.557911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b9dba1b-8d69-4103-94c4-dce5d99f8b77 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:32.057598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8b9dba1b-8d69-4103-94c4-dce5d99f8b77 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:32.072052 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8b9dba1b-8d69-4103-94c4-dce5d99f8b77 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1317 microversion: 2.1 time: 0.575116 Aug 23 18:13:32.073455 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2299/4491] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:31 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1317 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:32.366524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5a0e6e57-1666-42a9-b9f1-728cb9ef5616 req-c6aae00e-21f1-481d-a126-d9ca738deb07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d0004ed-3c7a-48da-a704-d0a2b3c43077", "tag": "b013dd2a-ed86-4f05-a146-b945b859433d"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:32.388556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5a0e6e57-1666-42a9-b9f1-728cb9ef5616 req-c6aae00e-21f1-481d-a126-d9ca738deb07 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:32.389056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5a0e6e57-1666-42a9-b9f1-728cb9ef5616 req-c6aae00e-21f1-481d-a126-d9ca738deb07 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:32.390066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5a0e6e57-1666-42a9-b9f1-728cb9ef5616 req-c6aae00e-21f1-481d-a126-d9ca738deb07 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:32.404060 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5a0e6e57-1666-42a9-b9f1-728cb9ef5616 req-c6aae00e-21f1-481d-a126-d9ca738deb07 service nova] Creating event network-changed:b013dd2a-ed86-4f05-a146-b945b859433d for instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 on n-h2-850468-16 Aug 23 18:13:32.415865 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5a0e6e57-1666-42a9-b9f1-728cb9ef5616 req-c6aae00e-21f1-481d-a126-d9ca738deb07 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.244622 Aug 23 18:13:32.417339 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2300/4492] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:13:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:13:32.516859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c65f3ba-614b-4784-963e-59cce9839c62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:32.518401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1c65f3ba-614b-4784-963e-59cce9839c62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:32.533527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c65f3ba-614b-4784-963e-59cce9839c62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:32.534926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c65f3ba-614b-4784-963e-59cce9839c62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:32.535551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c65f3ba-614b-4784-963e-59cce9839c62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:32.536432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c65f3ba-614b-4784-963e-59cce9839c62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:32.537071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c65f3ba-614b-4784-963e-59cce9839c62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:32.537676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c65f3ba-614b-4784-963e-59cce9839c62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:32.908578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:33.093068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c65f3ba-614b-4784-963e-59cce9839c62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:33.105746 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c65f3ba-614b-4784-963e-59cce9839c62 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.595416 Aug 23 18:13:33.109451 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2301/4493] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:32 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:33.133632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-381faa22-22da-4143-a3de-67b0c8cf6b08 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:33.134980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-381faa22-22da-4143-a3de-67b0c8cf6b08 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:33.175947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-381faa22-22da-4143-a3de-67b0c8cf6b08 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:33.176815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-381faa22-22da-4143-a3de-67b0c8cf6b08 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:33.178724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-381faa22-22da-4143-a3de-67b0c8cf6b08 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:33.181583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-381faa22-22da-4143-a3de-67b0c8cf6b08 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:33.191411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-381faa22-22da-4143-a3de-67b0c8cf6b08 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:33.192141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-381faa22-22da-4143-a3de-67b0c8cf6b08 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:33.285254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:33.795448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-381faa22-22da-4143-a3de-67b0c8cf6b08 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:33.820603 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-381faa22-22da-4143-a3de-67b0c8cf6b08 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1317 microversion: 2.1 time: 0.707971 Aug 23 18:13:33.821245 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2302/4494] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:33 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1317 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:34.133521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1049b5d4-3e50-4e3f-9d7d-6b5fb707ffd9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:34.134964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1049b5d4-3e50-4e3f-9d7d-6b5fb707ffd9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:34.155736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1049b5d4-3e50-4e3f-9d7d-6b5fb707ffd9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:34.155736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1049b5d4-3e50-4e3f-9d7d-6b5fb707ffd9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:34.156091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1049b5d4-3e50-4e3f-9d7d-6b5fb707ffd9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:34.156827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1049b5d4-3e50-4e3f-9d7d-6b5fb707ffd9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:34.163578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1049b5d4-3e50-4e3f-9d7d-6b5fb707ffd9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:34.164607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1049b5d4-3e50-4e3f-9d7d-6b5fb707ffd9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:34.946240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1049b5d4-3e50-4e3f-9d7d-6b5fb707ffd9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:34.971459 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1049b5d4-3e50-4e3f-9d7d-6b5fb707ffd9 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1510 microversion: 2.1 time: 0.842108 Aug 23 18:13:35.000257 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2303/4495] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:34 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1510 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:35.007943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ebfc664d-46bf-4383-a5fe-5ab560a8ce38 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:35.008994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ebfc664d-46bf-4383-a5fe-5ab560a8ce38 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:35.039321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebfc664d-46bf-4383-a5fe-5ab560a8ce38 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:35.041962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebfc664d-46bf-4383-a5fe-5ab560a8ce38 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:35.044784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebfc664d-46bf-4383-a5fe-5ab560a8ce38 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:35.046273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebfc664d-46bf-4383-a5fe-5ab560a8ce38 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:35.047157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebfc664d-46bf-4383-a5fe-5ab560a8ce38 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:35.053133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebfc664d-46bf-4383-a5fe-5ab560a8ce38 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:35.625331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ebfc664d-46bf-4383-a5fe-5ab560a8ce38 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:35.643737 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ebfc664d-46bf-4383-a5fe-5ab560a8ce38 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1317 microversion: 2.1 time: 0.641939 Aug 23 18:13:35.644345 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2304/4496] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:35 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1317 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:35.992867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-49e265e2-0332-45aa-818d-4ea2d85d0dd3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:35.994273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-49e265e2-0332-45aa-818d-4ea2d85d0dd3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:36.008797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49e265e2-0332-45aa-818d-4ea2d85d0dd3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:36.009576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49e265e2-0332-45aa-818d-4ea2d85d0dd3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:36.010189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49e265e2-0332-45aa-818d-4ea2d85d0dd3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:36.011102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49e265e2-0332-45aa-818d-4ea2d85d0dd3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:36.012515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49e265e2-0332-45aa-818d-4ea2d85d0dd3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:36.015155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49e265e2-0332-45aa-818d-4ea2d85d0dd3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:36.444177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-49e265e2-0332-45aa-818d-4ea2d85d0dd3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:36.456728 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-49e265e2-0332-45aa-818d-4ea2d85d0dd3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1487 microversion: 2.1 time: 0.467665 Aug 23 18:13:36.480898 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2305/4497] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:35 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1487 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:36.496724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d775ed8-93c3-4fad-9397-175cb332a593 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:36.499357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7d775ed8-93c3-4fad-9397-175cb332a593 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:36.520817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d775ed8-93c3-4fad-9397-175cb332a593 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:36.521967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d775ed8-93c3-4fad-9397-175cb332a593 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:36.522965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d775ed8-93c3-4fad-9397-175cb332a593 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:36.525195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d775ed8-93c3-4fad-9397-175cb332a593 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:36.527588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d775ed8-93c3-4fad-9397-175cb332a593 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:36.528490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d775ed8-93c3-4fad-9397-175cb332a593 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:36.598269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7d775ed8-93c3-4fad-9397-175cb332a593 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:13:36.890858 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7d775ed8-93c3-4fad-9397-175cb332a593 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 204 len: 0 microversion: 2.1 time: 0.400325 Aug 23 18:13:36.892773 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2306/4498] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:13:36 2022] DELETE /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:13:36.898496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d53a2ddb-8138-4491-8f85-192d68ac1f95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:36.899789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d53a2ddb-8138-4491-8f85-192d68ac1f95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:36.912478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d53a2ddb-8138-4491-8f85-192d68ac1f95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:36.914175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d53a2ddb-8138-4491-8f85-192d68ac1f95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:36.914757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d53a2ddb-8138-4491-8f85-192d68ac1f95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:36.915517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d53a2ddb-8138-4491-8f85-192d68ac1f95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:36.916075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d53a2ddb-8138-4491-8f85-192d68ac1f95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:36.916888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d53a2ddb-8138-4491-8f85-192d68ac1f95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:38.226132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d53a2ddb-8138-4491-8f85-192d68ac1f95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:38.234194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:38.240874 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d53a2ddb-8138-4491-8f85-192d68ac1f95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1317 microversion: 2.1 time: 1.346724 Aug 23 18:13:38.241901 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2307/4499] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:36 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1317 bytes in 1349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:38.253552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-542d29d0-c2b7-4986-bb06-c35d047f3d5d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:38.261110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-542d29d0-c2b7-4986-bb06-c35d047f3d5d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:38.309041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-542d29d0-c2b7-4986-bb06-c35d047f3d5d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:38.311697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-542d29d0-c2b7-4986-bb06-c35d047f3d5d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:38.312499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-542d29d0-c2b7-4986-bb06-c35d047f3d5d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:38.315726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-542d29d0-c2b7-4986-bb06-c35d047f3d5d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:38.316397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-542d29d0-c2b7-4986-bb06-c35d047f3d5d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:38.318435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-542d29d0-c2b7-4986-bb06-c35d047f3d5d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:38.658707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-542d29d0-c2b7-4986-bb06-c35d047f3d5d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:38.679565 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-542d29d0-c2b7-4986-bb06-c35d047f3d5d tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1493 microversion: 2.1 time: 0.435495 Aug 23 18:13:38.680983 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2308/4500] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:38 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1493 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:39.363841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-89d07b85-ce3c-4237-8e61-c82f8539a1e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:39.365165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-89d07b85-ce3c-4237-8e61-c82f8539a1e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:39.381611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89d07b85-ce3c-4237-8e61-c82f8539a1e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:39.382305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89d07b85-ce3c-4237-8e61-c82f8539a1e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:39.382950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89d07b85-ce3c-4237-8e61-c82f8539a1e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:39.383832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89d07b85-ce3c-4237-8e61-c82f8539a1e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:39.384445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89d07b85-ce3c-4237-8e61-c82f8539a1e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:39.385023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-89d07b85-ce3c-4237-8e61-c82f8539a1e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:39.818910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-89d07b85-ce3c-4237-8e61-c82f8539a1e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:39.836403 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-89d07b85-ce3c-4237-8e61-c82f8539a1e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1317 microversion: 2.1 time: 0.476418 Aug 23 18:13:39.837617 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2309/4501] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:39 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1317 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:39.853235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-72fa709c-1887-46d3-93f5-cc45b0d21f9a req-2862220b-efef-4818-9bb6-9a793b568be3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a13e98f6-a5db-421f-abac-17f208932ac9", "name": "network-vif-deleted", "tag": "67bb558d-6261-4216-9cd3-99b2ea563a05"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:39.879102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-72fa709c-1887-46d3-93f5-cc45b0d21f9a req-2862220b-efef-4818-9bb6-9a793b568be3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:39.879711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-72fa709c-1887-46d3-93f5-cc45b0d21f9a req-2862220b-efef-4818-9bb6-9a793b568be3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:39.880256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-72fa709c-1887-46d3-93f5-cc45b0d21f9a req-2862220b-efef-4818-9bb6-9a793b568be3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:39.907574 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-72fa709c-1887-46d3-93f5-cc45b0d21f9a req-2862220b-efef-4818-9bb6-9a793b568be3 service nova] Creating event network-vif-deleted:67bb558d-6261-4216-9cd3-99b2ea563a05 for instance a13e98f6-a5db-421f-abac-17f208932ac9 on n-h1-850468-16 Aug 23 18:13:39.920234 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-72fa709c-1887-46d3-93f5-cc45b0d21f9a req-2862220b-efef-4818-9bb6-9a793b568be3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080371 Aug 23 18:13:39.922410 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2310/4502] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:13:39.938665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:39.940492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:39.969471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:39.972530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:39.977437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:39.979477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:39.991269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:39.991269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:40.061270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:40.061793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:40.062240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:40.062813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lazy-loading 'fault' on Instance uuid a13e98f6-a5db-421f-abac-17f208932ac9 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:13:40.131892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:40.145459 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 200 len: 1304 microversion: 2.1 time: 0.218265 Aug 23 18:13:40.146719 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2311/4503] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:39 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 1304 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:40.256780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:40.258208 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1ab410b2-a776-4d9b-b4ee-78092f6867d3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001857 Aug 23 18:13:40.259242 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2312/4504] 10.222.0.61 () {56 vars in 886 bytes} [Tue Aug 23 18:13:40 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 23 18:13:40.350067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=45 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:40.859996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7c38b949-5fe1-4c1d-9e36-e52673cdfa9c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:40.861871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7c38b949-5fe1-4c1d-9e36-e52673cdfa9c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:40.873511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c38b949-5fe1-4c1d-9e36-e52673cdfa9c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:40.874773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c38b949-5fe1-4c1d-9e36-e52673cdfa9c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:40.875440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c38b949-5fe1-4c1d-9e36-e52673cdfa9c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:40.876378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c38b949-5fe1-4c1d-9e36-e52673cdfa9c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:40.876864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c38b949-5fe1-4c1d-9e36-e52673cdfa9c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:40.877454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c38b949-5fe1-4c1d-9e36-e52673cdfa9c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:41.158229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7c38b949-5fe1-4c1d-9e36-e52673cdfa9c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:41.188837 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7c38b949-5fe1-4c1d-9e36-e52673cdfa9c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1317 microversion: 2.1 time: 0.332257 Aug 23 18:13:41.189766 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2313/4505] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:40 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1317 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:13:41.194879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d3d7f61-de17-4135-93fd-422489672e99 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:41.195494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8d3d7f61-de17-4135-93fd-422489672e99 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:41.233162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d3d7f61-de17-4135-93fd-422489672e99 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:41.234348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d3d7f61-de17-4135-93fd-422489672e99 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:41.235121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d3d7f61-de17-4135-93fd-422489672e99 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:41.236094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d3d7f61-de17-4135-93fd-422489672e99 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:41.236708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d3d7f61-de17-4135-93fd-422489672e99 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:41.237299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d3d7f61-de17-4135-93fd-422489672e99 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:41.283310 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8d3d7f61-de17-4135-93fd-422489672e99 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d3d7f61-de17-4135-93fd-422489672e99 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 HTTP/1.1 Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'a13e98f6-a5db-421f-abac-17f208932ac9'} Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:13:41.289886 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:41.295457 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:13:41.295457 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:13:41.295457 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:13:41.295457 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:13:41.295457 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:13:41.295457 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:13:41.295457 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:41.295457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d3d7f61-de17-4135-93fd-422489672e99 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:13:41.295457 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8d3d7f61-de17-4135-93fd-422489672e99 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 404 len: 111 microversion: 2.1 time: 0.101747 Aug 23 18:13:41.295457 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2314/4506] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:41 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:13:41.315028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=16 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:41.450378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1134964878", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "2590bb5f-8ace-41d9-ae28-2d05e6f1fbab"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:49.020585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] validate_networks() for [('2590bb5f-8ace-41d9-ae28-2d05e6f1fbab', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:13:49.027072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] validate_networks() for [('bcef2581-80d0-47e5-8b8b-34343a6facf5', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:13:49.560039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:13:49.560949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:13:49.561992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:13:49.563170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:13:49.563773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:13:49.576016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:49.576775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:49.577393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:49.578316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:49.578818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:49.579422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:49.619780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:13:49.633056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Getting quotas for user 2380358bc6a7496ead343b351bce816d and project d335c62baa6846ff86d9b1c2941c4d56. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:13:49.658191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:13:49.661287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:13:49.773598 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-08185bf0-7a49-4151-984f-4fb976551189 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.325906 Aug 23 18:13:49.775302 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2315/4507] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:13:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 8330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:13:49.801161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-526e2ffa-25e6-4f9a-99e5-d42f7bb19ae3 req-268974da-0a14-41a2-9432-64ad607a4101 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0004ed-3c7a-48da-a704-d0a2b3c43077", "name": "network-vif-plugged", "status": "completed", "tag": "b013dd2a-ed86-4f05-a146-b945b859433d"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:49.826022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-526e2ffa-25e6-4f9a-99e5-d42f7bb19ae3 req-268974da-0a14-41a2-9432-64ad607a4101 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:49.826866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-526e2ffa-25e6-4f9a-99e5-d42f7bb19ae3 req-268974da-0a14-41a2-9432-64ad607a4101 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:49.827375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-526e2ffa-25e6-4f9a-99e5-d42f7bb19ae3 req-268974da-0a14-41a2-9432-64ad607a4101 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:49.893582 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-526e2ffa-25e6-4f9a-99e5-d42f7bb19ae3 req-268974da-0a14-41a2-9432-64ad607a4101 service nova] Creating event network-vif-plugged:b013dd2a-ed86-4f05-a146-b945b859433d for instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 on n-h2-850468-16 Aug 23 18:13:49.905231 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-526e2ffa-25e6-4f9a-99e5-d42f7bb19ae3 req-268974da-0a14-41a2-9432-64ad607a4101 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127845 Aug 23 18:13:49.906004 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2316/4508] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:13:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:13:49.909063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:13:49.909493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:13:49.910491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:13:49.910943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:13:49.911576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:13:49.926458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:49.928284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:49.928739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:49.929506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:49.929997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:49.941014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:49.945647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c9f3e45c-6fbe-4cac-9b98-f1835fd24bc8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:49.950632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c9f3e45c-6fbe-4cac-9b98-f1835fd24bc8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:49.974593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9f3e45c-6fbe-4cac-9b98-f1835fd24bc8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:49.978262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9f3e45c-6fbe-4cac-9b98-f1835fd24bc8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:49.978862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9f3e45c-6fbe-4cac-9b98-f1835fd24bc8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:49.980010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9f3e45c-6fbe-4cac-9b98-f1835fd24bc8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:49.980743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9f3e45c-6fbe-4cac-9b98-f1835fd24bc8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:49.981364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9f3e45c-6fbe-4cac-9b98-f1835fd24bc8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:49.982468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:13:50.016794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for user 6e80c3f1c008459faa3ac74ea5984eea and project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:13:50.041497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:13:50.044310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:13:50.184216 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c758aaab-5320-442d-8616-f53b91b8d863 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 19.195637 Aug 23 18:13:50.187739 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2193/4509] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:13:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 19200 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:13:50.259000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c9f3e45c-6fbe-4cac-9b98-f1835fd24bc8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:50.269757 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c9f3e45c-6fbe-4cac-9b98-f1835fd24bc8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1317 microversion: 2.1 time: 0.342093 Aug 23 18:13:50.273912 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2317/4510] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:49 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1317 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:50.281811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04ceaa4f-5af1-4c06-909f-d790cd5dd172 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:50.282801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-04ceaa4f-5af1-4c06-909f-d790cd5dd172 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:50.430435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-04ceaa4f-5af1-4c06-909f-d790cd5dd172 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:50.453729 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-04ceaa4f-5af1-4c06-909f-d790cd5dd172 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1215 microversion: 2.1 time: 0.178008 Aug 23 18:13:50.457098 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2318/4511] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:50 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1215 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:50.473463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-495e9b62-1454-4815-8c60-8054c05061a3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:50.475573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-495e9b62-1454-4815-8c60-8054c05061a3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:50.533427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5170b159-33fc-41a6-a5a1-68f49918e3ba tempest-ExtensionsTest-1736717900 tempest-ExtensionsTest-1736717900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:50.537553 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5170b159-33fc-41a6-a5a1-68f49918e3ba tempest-ExtensionsTest-1736717900 tempest-ExtensionsTest-1736717900-project] 10.222.0.61 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.347558 Aug 23 18:13:50.540057 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2194/4512] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Aug 23 18:13:50 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:13:50.557184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de48fecf-93af-4dbb-a5a4-08efe6457c2a tempest-ExtensionsTest-1736717900 tempest-ExtensionsTest-1736717900-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:50.564283 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-de48fecf-93af-4dbb-a5a4-08efe6457c2a tempest-ExtensionsTest-1736717900 tempest-ExtensionsTest-1736717900-project] 10.222.0.61 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.018479 Aug 23 18:13:50.567295 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2195/4513] 10.222.0.61 () {58 vars in 1134 bytes} [Tue Aug 23 18:13:50 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:13:50.578420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-495e9b62-1454-4815-8c60-8054c05061a3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:50.598751 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-495e9b62-1454-4815-8c60-8054c05061a3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1193 microversion: 2.1 time: 0.138612 Aug 23 18:13:50.600683 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2319/4514] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:50 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1193 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:51.298500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eff0a43c-6dab-4928-b869-9b4dc7500312 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:51.300208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eff0a43c-6dab-4928-b869-9b4dc7500312 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:51.317899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eff0a43c-6dab-4928-b869-9b4dc7500312 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:51.318406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eff0a43c-6dab-4928-b869-9b4dc7500312 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:51.323004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eff0a43c-6dab-4928-b869-9b4dc7500312 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:51.324784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eff0a43c-6dab-4928-b869-9b4dc7500312 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:51.325360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eff0a43c-6dab-4928-b869-9b4dc7500312 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:51.325812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eff0a43c-6dab-4928-b869-9b4dc7500312 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:51.790187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eff0a43c-6dab-4928-b869-9b4dc7500312 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:51.806834 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eff0a43c-6dab-4928-b869-9b4dc7500312 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1317 microversion: 2.1 time: 0.514179 Aug 23 18:13:51.821899 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2196/4515] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:51 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1317 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:51.842838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e2ebcf86-e75b-42c0-bc29-18a51a3a0ae5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:51.845110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e2ebcf86-e75b-42c0-bc29-18a51a3a0ae5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:51.858359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2ebcf86-e75b-42c0-bc29-18a51a3a0ae5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:51.859307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2ebcf86-e75b-42c0-bc29-18a51a3a0ae5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:51.860167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2ebcf86-e75b-42c0-bc29-18a51a3a0ae5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:51.861551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2ebcf86-e75b-42c0-bc29-18a51a3a0ae5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:51.862769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2ebcf86-e75b-42c0-bc29-18a51a3a0ae5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:51.864219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2ebcf86-e75b-42c0-bc29-18a51a3a0ae5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:52.054597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1d5a06b6-a111-4e53-811d-5a9877cfe56b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:52.055332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1d5a06b6-a111-4e53-811d-5a9877cfe56b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:52.075175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e2ebcf86-e75b-42c0-bc29-18a51a3a0ae5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:52.099739 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e2ebcf86-e75b-42c0-bc29-18a51a3a0ae5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1245 microversion: 2.1 time: 0.276414 Aug 23 18:13:52.105537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d5a06b6-a111-4e53-811d-5a9877cfe56b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:52.123648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d5a06b6-a111-4e53-811d-5a9877cfe56b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:52.125147 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2197/4516] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:51 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1245 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:52.127191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d5a06b6-a111-4e53-811d-5a9877cfe56b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:52.128953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d5a06b6-a111-4e53-811d-5a9877cfe56b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:52.134922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d5a06b6-a111-4e53-811d-5a9877cfe56b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:52.135672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d5a06b6-a111-4e53-811d-5a9877cfe56b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:52.255294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d5a06b6-a111-4e53-811d-5a9877cfe56b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:52.275880 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1d5a06b6-a111-4e53-811d-5a9877cfe56b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1273 microversion: 2.1 time: 0.800420 Aug 23 18:13:52.278373 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2320/4517] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:51 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1273 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:52.835672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7528533b-a69f-4a66-af41-25453f7c080c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:52.836990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7528533b-a69f-4a66-af41-25453f7c080c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:52.846288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7528533b-a69f-4a66-af41-25453f7c080c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:52.848096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7528533b-a69f-4a66-af41-25453f7c080c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:52.848792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7528533b-a69f-4a66-af41-25453f7c080c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:52.852337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7528533b-a69f-4a66-af41-25453f7c080c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:52.878148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7528533b-a69f-4a66-af41-25453f7c080c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:52.880146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7528533b-a69f-4a66-af41-25453f7c080c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:53.129112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3c1ca909-87eb-4039-82bb-39675639755f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:53.130565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3c1ca909-87eb-4039-82bb-39675639755f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:53.148645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c1ca909-87eb-4039-82bb-39675639755f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:53.150094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c1ca909-87eb-4039-82bb-39675639755f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:53.150925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c1ca909-87eb-4039-82bb-39675639755f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:53.152514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c1ca909-87eb-4039-82bb-39675639755f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:53.153567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c1ca909-87eb-4039-82bb-39675639755f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:53.154346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c1ca909-87eb-4039-82bb-39675639755f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:53.224089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7528533b-a69f-4a66-af41-25453f7c080c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:53.239020 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7528533b-a69f-4a66-af41-25453f7c080c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1507 microversion: 2.1 time: 0.407402 Aug 23 18:13:53.254101 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2198/4518] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:52 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:53.266883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd3c2b4f-fa8a-45f0-8c67-f4553c1a7712 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:53.268082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd3c2b4f-fa8a-45f0-8c67-f4553c1a7712 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:53.277453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd3c2b4f-fa8a-45f0-8c67-f4553c1a7712 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:53.278761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd3c2b4f-fa8a-45f0-8c67-f4553c1a7712 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:53.279454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd3c2b4f-fa8a-45f0-8c67-f4553c1a7712 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:53.280704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd3c2b4f-fa8a-45f0-8c67-f4553c1a7712 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:53.281382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd3c2b4f-fa8a-45f0-8c67-f4553c1a7712 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:53.282195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd3c2b4f-fa8a-45f0-8c67-f4553c1a7712 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:53.282447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3c1ca909-87eb-4039-82bb-39675639755f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:53.297257 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3c1ca909-87eb-4039-82bb-39675639755f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1251 microversion: 2.1 time: 0.172232 Aug 23 18:13:53.307010 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2321/4519] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:53 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1251 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:53.326033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ed5cdacf-eb10-4197-9dae-9bb37c888227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:53.327183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ed5cdacf-eb10-4197-9dae-9bb37c888227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:53.346606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd3c2b4f-fa8a-45f0-8c67-f4553c1a7712 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:13:53.358449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed5cdacf-eb10-4197-9dae-9bb37c888227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:53.359389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed5cdacf-eb10-4197-9dae-9bb37c888227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:53.363870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed5cdacf-eb10-4197-9dae-9bb37c888227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:53.367073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed5cdacf-eb10-4197-9dae-9bb37c888227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:53.369339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed5cdacf-eb10-4197-9dae-9bb37c888227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:53.370048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed5cdacf-eb10-4197-9dae-9bb37c888227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:53.551107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ed5cdacf-eb10-4197-9dae-9bb37c888227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:53.563578 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ed5cdacf-eb10-4197-9dae-9bb37c888227 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1273 microversion: 2.1 time: 0.254460 Aug 23 18:13:53.571298 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2322/4520] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:53 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:53.614257 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd3c2b4f-fa8a-45f0-8c67-f4553c1a7712 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 204 len: 0 microversion: 2.1 time: 0.355067 Aug 23 18:13:53.616248 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2199/4521] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:13:53 2022] DELETE /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:13:53.638940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-84ac31ac-eb1a-4ca5-bd05-5d4f3edaf6fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:53.639418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-84ac31ac-eb1a-4ca5-bd05-5d4f3edaf6fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:53.665236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84ac31ac-eb1a-4ca5-bd05-5d4f3edaf6fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:53.666707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84ac31ac-eb1a-4ca5-bd05-5d4f3edaf6fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:53.668191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84ac31ac-eb1a-4ca5-bd05-5d4f3edaf6fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:53.677463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84ac31ac-eb1a-4ca5-bd05-5d4f3edaf6fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:53.678454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84ac31ac-eb1a-4ca5-bd05-5d4f3edaf6fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:53.679085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84ac31ac-eb1a-4ca5-bd05-5d4f3edaf6fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:53.974449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-84ac31ac-eb1a-4ca5-bd05-5d4f3edaf6fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:53.984861 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-84ac31ac-eb1a-4ca5-bd05-5d4f3edaf6fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1513 microversion: 2.1 time: 0.358285 Aug 23 18:13:53.985441 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2323/4522] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:53 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1513 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:54.325066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e737e3e2-c069-44d5-93ed-f5e78a647895 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:54.327554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e737e3e2-c069-44d5-93ed-f5e78a647895 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:54.356312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e737e3e2-c069-44d5-93ed-f5e78a647895 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:54.357133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e737e3e2-c069-44d5-93ed-f5e78a647895 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:54.358358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e737e3e2-c069-44d5-93ed-f5e78a647895 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:54.361107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e737e3e2-c069-44d5-93ed-f5e78a647895 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:54.362895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e737e3e2-c069-44d5-93ed-f5e78a647895 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:54.364305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e737e3e2-c069-44d5-93ed-f5e78a647895 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:54.597403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b011a1a5-3f42-432a-83eb-c04da1ca757c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:54.598351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b011a1a5-3f42-432a-83eb-c04da1ca757c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:54.621467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b011a1a5-3f42-432a-83eb-c04da1ca757c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:54.626423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b011a1a5-3f42-432a-83eb-c04da1ca757c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:54.627426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b011a1a5-3f42-432a-83eb-c04da1ca757c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:54.628949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b011a1a5-3f42-432a-83eb-c04da1ca757c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:54.629798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b011a1a5-3f42-432a-83eb-c04da1ca757c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:54.630383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b011a1a5-3f42-432a-83eb-c04da1ca757c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:55.052480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b011a1a5-3f42-432a-83eb-c04da1ca757c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:55.058512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e737e3e2-c069-44d5-93ed-f5e78a647895 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:55.076871 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b011a1a5-3f42-432a-83eb-c04da1ca757c tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1315 microversion: 2.1 time: 0.483181 Aug 23 18:13:55.077491 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2324/4523] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:54 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1315 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:55.091341 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e737e3e2-c069-44d5-93ed-f5e78a647895 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1293 microversion: 2.1 time: 0.759263 Aug 23 18:13:55.091341 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2200/4524] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:54 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1293 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:55.105558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8827e12c-b107-40aa-b223-f6daf03fba92 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:55.111190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8827e12c-b107-40aa-b223-f6daf03fba92 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:55.137672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8827e12c-b107-40aa-b223-f6daf03fba92 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:55.148599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8827e12c-b107-40aa-b223-f6daf03fba92 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:55.149068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8827e12c-b107-40aa-b223-f6daf03fba92 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:55.149838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8827e12c-b107-40aa-b223-f6daf03fba92 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:55.158659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8827e12c-b107-40aa-b223-f6daf03fba92 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:55.161072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8827e12c-b107-40aa-b223-f6daf03fba92 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:55.963579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8827e12c-b107-40aa-b223-f6daf03fba92 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:55.976238 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8827e12c-b107-40aa-b223-f6daf03fba92 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1513 microversion: 2.1 time: 0.892504 Aug 23 18:13:55.977036 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2325/4525] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:55 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1513 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:56.107002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-44d01a98-6d86-4fee-81e9-391d5e0535cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:56.107738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-44d01a98-6d86-4fee-81e9-391d5e0535cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:56.109220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1e97b732-5fba-4773-803c-037d7a126d3a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:56.109987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1e97b732-5fba-4773-803c-037d7a126d3a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:56.124628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e97b732-5fba-4773-803c-037d7a126d3a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:56.125129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e97b732-5fba-4773-803c-037d7a126d3a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:56.125575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e97b732-5fba-4773-803c-037d7a126d3a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:56.130232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44d01a98-6d86-4fee-81e9-391d5e0535cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:56.131290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e97b732-5fba-4773-803c-037d7a126d3a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:56.131818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e97b732-5fba-4773-803c-037d7a126d3a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:56.132245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e97b732-5fba-4773-803c-037d7a126d3a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:56.132390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44d01a98-6d86-4fee-81e9-391d5e0535cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:56.132807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44d01a98-6d86-4fee-81e9-391d5e0535cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:56.135608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44d01a98-6d86-4fee-81e9-391d5e0535cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:56.140345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44d01a98-6d86-4fee-81e9-391d5e0535cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:56.140814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44d01a98-6d86-4fee-81e9-391d5e0535cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:56.494457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1e97b732-5fba-4773-803c-037d7a126d3a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:56.514826 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1e97b732-5fba-4773-803c-037d7a126d3a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1293 microversion: 2.1 time: 0.404572 Aug 23 18:13:56.514826 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2326/4526] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:56 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1293 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:56.532361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-81f5bba0-c948-4229-a37f-56846a4b8c2d req-fe0f8570-1dab-493d-8616-763718e5c9f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d0004ed-3c7a-48da-a704-d0a2b3c43077", "name": "network-vif-deleted", "tag": "b013dd2a-ed86-4f05-a146-b945b859433d"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:56.563656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-81f5bba0-c948-4229-a37f-56846a4b8c2d req-fe0f8570-1dab-493d-8616-763718e5c9f3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:56.568374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-81f5bba0-c948-4229-a37f-56846a4b8c2d req-fe0f8570-1dab-493d-8616-763718e5c9f3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:56.569088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-81f5bba0-c948-4229-a37f-56846a4b8c2d req-fe0f8570-1dab-493d-8616-763718e5c9f3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:56.611215 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-81f5bba0-c948-4229-a37f-56846a4b8c2d req-fe0f8570-1dab-493d-8616-763718e5c9f3 service nova] Creating event network-vif-deleted:b013dd2a-ed86-4f05-a146-b945b859433d for instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 on n-h2-850468-16 Aug 23 18:13:56.678426 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-81f5bba0-c948-4229-a37f-56846a4b8c2d req-fe0f8570-1dab-493d-8616-763718e5c9f3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.167182 Aug 23 18:13:56.693200 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2327/4527] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:13:57.000041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:57.001204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:57.025489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:57.030849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:57.032414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:57.035140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:57.035915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:57.037959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:57.150998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:57.153039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:57.157599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:57.159513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lazy-loading 'fault' on Instance uuid 0d0004ed-3c7a-48da-a704-d0a2b3c43077 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:13:57.260456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:57.269668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e81bed26-cff4-4f93-9fee-c4dd904eb481 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 200 len: 1307 microversion: 2.1 time: 0.275931 Aug 23 18:13:57.277677 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2328/4528] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:56 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 1307 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:57.431192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-44d01a98-6d86-4fee-81e9-391d5e0535cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:57.449612 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-44d01a98-6d86-4fee-81e9-391d5e0535cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1315 microversion: 2.1 time: 1.355939 Aug 23 18:13:57.450927 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2201/4529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:56 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1315 bytes in 1358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:57.534035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-84149ddf-165d-4c3b-86f9-af6c1e9d0bae tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:57.536916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-84149ddf-165d-4c3b-86f9-af6c1e9d0bae tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:57.552975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84149ddf-165d-4c3b-86f9-af6c1e9d0bae tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:57.553868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84149ddf-165d-4c3b-86f9-af6c1e9d0bae tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:57.555510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84149ddf-165d-4c3b-86f9-af6c1e9d0bae tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:57.558891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84149ddf-165d-4c3b-86f9-af6c1e9d0bae tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:57.559667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84149ddf-165d-4c3b-86f9-af6c1e9d0bae tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:57.562777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84149ddf-165d-4c3b-86f9-af6c1e9d0bae tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:57.563351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-adc6430a-5515-470d-b7c3-cd6752add801 req-67a2fbc8-e4d3-4941-9d75-06129f213507 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c846eb-9fa4-4156-9fd7-44976362c45f", "tag": "a38ad55b-08c4-42f1-9429-6943dea1b607"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:57.581182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-adc6430a-5515-470d-b7c3-cd6752add801 req-67a2fbc8-e4d3-4941-9d75-06129f213507 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:57.581671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-adc6430a-5515-470d-b7c3-cd6752add801 req-67a2fbc8-e4d3-4941-9d75-06129f213507 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:57.582106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-adc6430a-5515-470d-b7c3-cd6752add801 req-67a2fbc8-e4d3-4941-9d75-06129f213507 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:57.616280 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-adc6430a-5515-470d-b7c3-cd6752add801 req-67a2fbc8-e4d3-4941-9d75-06129f213507 service nova] Creating event network-changed:a38ad55b-08c4-42f1-9429-6943dea1b607 for instance 06c846eb-9fa4-4156-9fd7-44976362c45f on n-h1-850468-16 Aug 23 18:13:57.634747 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-adc6430a-5515-470d-b7c3-cd6752add801 req-67a2fbc8-e4d3-4941-9d75-06129f213507 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078188 Aug 23 18:13:57.638143 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2202/4530] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:13:57.791862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-84149ddf-165d-4c3b-86f9-af6c1e9d0bae tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:57.806422 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-84149ddf-165d-4c3b-86f9-af6c1e9d0bae tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1293 microversion: 2.1 time: 0.277477 Aug 23 18:13:57.807046 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2329/4531] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:57 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1293 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:58.300906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ab56fc59-83f5-495f-a60e-4f324d8edb33 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:58.302932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ab56fc59-83f5-495f-a60e-4f324d8edb33 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:58.328307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab56fc59-83f5-495f-a60e-4f324d8edb33 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:58.332214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab56fc59-83f5-495f-a60e-4f324d8edb33 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:58.333408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab56fc59-83f5-495f-a60e-4f324d8edb33 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:58.334858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab56fc59-83f5-495f-a60e-4f324d8edb33 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:58.335850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab56fc59-83f5-495f-a60e-4f324d8edb33 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:58.336942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab56fc59-83f5-495f-a60e-4f324d8edb33 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:58.387059 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-ab56fc59-83f5-495f-a60e-4f324d8edb33 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ab56fc59-83f5-495f-a60e-4f324d8edb33 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 HTTP/1.1 Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '0d0004ed-3c7a-48da-a704-d0a2b3c43077'} Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:13:58.388913 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:13:58.394731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:13:58.394731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:13:58.394731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:13:58.394731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:13:58.394731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:13:58.394731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:13:58.394731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:13:58.394731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ab56fc59-83f5-495f-a60e-4f324d8edb33 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:13:58.394731 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ab56fc59-83f5-495f-a60e-4f324d8edb33 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 404 len: 111 microversion: 2.1 time: 0.102474 Aug 23 18:13:58.394731 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2203/4532] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:58 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:13:58.404844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1806fe29-9be0-4f80-8cde-e49afaa4829e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:58.406486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1806fe29-9be0-4f80-8cde-e49afaa4829e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:58.421667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1806fe29-9be0-4f80-8cde-e49afaa4829e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:58.427338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1806fe29-9be0-4f80-8cde-e49afaa4829e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:58.428568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1806fe29-9be0-4f80-8cde-e49afaa4829e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:58.429955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1806fe29-9be0-4f80-8cde-e49afaa4829e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:58.434517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1806fe29-9be0-4f80-8cde-e49afaa4829e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:58.436374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1806fe29-9be0-4f80-8cde-e49afaa4829e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:58.449595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:58.472415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1a36863-47bc-471f-a023-938fc8ee14a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:58.473085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d1a36863-47bc-471f-a023-938fc8ee14a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:58.487439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1a36863-47bc-471f-a023-938fc8ee14a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:58.488778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1a36863-47bc-471f-a023-938fc8ee14a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:58.489242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1a36863-47bc-471f-a023-938fc8ee14a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:58.489979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1a36863-47bc-471f-a023-938fc8ee14a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:58.490436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1a36863-47bc-471f-a023-938fc8ee14a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:58.491317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1a36863-47bc-471f-a023-938fc8ee14a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:58.789727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1806fe29-9be0-4f80-8cde-e49afaa4829e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:58.801099 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1806fe29-9be0-4f80-8cde-e49afaa4829e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.402271 Aug 23 18:13:58.801613 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2330/4533] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:58 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:58.841143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7e5b55a0-597b-47fc-b883-cad020136dde tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:58.846414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7e5b55a0-597b-47fc-b883-cad020136dde tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:58.870832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e5b55a0-597b-47fc-b883-cad020136dde tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:58.872726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e5b55a0-597b-47fc-b883-cad020136dde tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:58.875127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e5b55a0-597b-47fc-b883-cad020136dde tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:58.876308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e5b55a0-597b-47fc-b883-cad020136dde tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:58.877481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e5b55a0-597b-47fc-b883-cad020136dde tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:58.878403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e5b55a0-597b-47fc-b883-cad020136dde tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:59.168400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7e5b55a0-597b-47fc-b883-cad020136dde tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:59.180233 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7e5b55a0-597b-47fc-b883-cad020136dde tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1293 microversion: 2.1 time: 0.349574 Aug 23 18:13:59.201526 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2331/4534] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:58 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1293 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:59.216983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9a82efb0-b45b-4439-aed9-9a744495be32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9a82efb0-b45b-4439-aed9-9a744495be32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 163 Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": 12345, "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'server': {'name': 12345, 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'networks': [{'uuid': '597d3f38-9c5d-451f-81bf-3e3fa931aa6a'}]}}} Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 12345 Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:13:59.231630 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:13:59.235836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:13:59.235836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 23 18:13:59.235836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:59.235836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:13:59.235836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:59.235836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:13:59.235836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:13:59.235836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:13:59.235836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:13:59.235836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:13:59.235836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Aug 23 18:13:59.235836 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:13:59.237780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9a82efb0-b45b-4439-aed9-9a744495be32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:13:59.238979 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9a82efb0-b45b-4439-aed9-9a744495be32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.035907 Aug 23 18:13:59.239771 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2332/4535] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:13:59 2022] POST /compute/v2.1/servers => generated 127 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:13:59.248483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-64dbff79-ba36-41a6-9732-16b446a564df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:59.254207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-64dbff79-ba36-41a6-9732-16b446a564df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:59.276022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64dbff79-ba36-41a6-9732-16b446a564df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:59.276929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64dbff79-ba36-41a6-9732-16b446a564df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:59.277535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64dbff79-ba36-41a6-9732-16b446a564df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:59.278422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64dbff79-ba36-41a6-9732-16b446a564df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:59.279075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64dbff79-ba36-41a6-9732-16b446a564df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:59.279669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64dbff79-ba36-41a6-9732-16b446a564df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:59.322390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d1a36863-47bc-471f-a023-938fc8ee14a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:59.355601 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d1a36863-47bc-471f-a023-938fc8ee14a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1315 microversion: 2.1 time: 0.874651 Aug 23 18:13:59.357646 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2204/4536] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:58 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1315 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:59.526218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-64dbff79-ba36-41a6-9732-16b446a564df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:59.535707 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-64dbff79-ba36-41a6-9732-16b446a564df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.291541 Aug 23 18:13:59.538284 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2333/4537] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:59 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:13:59.563128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1a119f3e-f01d-4977-a65e-3e5f18876922 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:13:59.563750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1a119f3e-f01d-4977-a65e-3e5f18876922 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:13:59.577455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a119f3e-f01d-4977-a65e-3e5f18876922 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:59.577854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a119f3e-f01d-4977-a65e-3e5f18876922 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:59.578297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a119f3e-f01d-4977-a65e-3e5f18876922 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:59.581581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a119f3e-f01d-4977-a65e-3e5f18876922 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:59.581929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a119f3e-f01d-4977-a65e-3e5f18876922 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:59.582608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a119f3e-f01d-4977-a65e-3e5f18876922 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:59.701666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7e139138-6226-4367-9375-40e6c35a0484 req-794c1815-cf66-4ea5-9499-3f0dcf26f7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0e35640-9377-487d-85e3-96ef4549659b", "tag": "8bcd1bd5-1d30-437d-bc07-1b0c8f010179"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:13:59.720764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:13:59.723493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7e139138-6226-4367-9375-40e6c35a0484 req-794c1815-cf66-4ea5-9499-3f0dcf26f7f7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:13:59.730704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7e139138-6226-4367-9375-40e6c35a0484 req-794c1815-cf66-4ea5-9499-3f0dcf26f7f7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:13:59.731561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7e139138-6226-4367-9375-40e6c35a0484 req-794c1815-cf66-4ea5-9499-3f0dcf26f7f7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:13:59.749195 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7e139138-6226-4367-9375-40e6c35a0484 req-794c1815-cf66-4ea5-9499-3f0dcf26f7f7 service nova] Creating event network-changed:8bcd1bd5-1d30-437d-bc07-1b0c8f010179 for instance c0e35640-9377-487d-85e3-96ef4549659b on n-h1-850468-16 Aug 23 18:13:59.755572 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7e139138-6226-4367-9375-40e6c35a0484 req-794c1815-cf66-4ea5-9499-3f0dcf26f7f7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058651 Aug 23 18:13:59.768102 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2334/4538] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:13:59.873667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1a119f3e-f01d-4977-a65e-3e5f18876922 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:13:59.887526 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1a119f3e-f01d-4977-a65e-3e5f18876922 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.329905 Aug 23 18:13:59.890609 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2205/4539] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:13:59 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:00.210253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ec669904-e52a-4573-938d-44591b553f6b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:00.211028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ec669904-e52a-4573-938d-44591b553f6b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:00.222619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec669904-e52a-4573-938d-44591b553f6b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:00.224759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec669904-e52a-4573-938d-44591b553f6b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:00.227541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec669904-e52a-4573-938d-44591b553f6b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:00.228564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec669904-e52a-4573-938d-44591b553f6b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:00.229194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec669904-e52a-4573-938d-44591b553f6b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:00.235086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec669904-e52a-4573-938d-44591b553f6b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:00.392827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-89556841-c4cd-4629-98fa-f60544782480 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:00.396376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-89556841-c4cd-4629-98fa-f60544782480 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:00.442718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:00.449418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:00.456367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89556841-c4cd-4629-98fa-f60544782480 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:00.458880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89556841-c4cd-4629-98fa-f60544782480 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:00.461660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89556841-c4cd-4629-98fa-f60544782480 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:00.464827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89556841-c4cd-4629-98fa-f60544782480 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:00.468069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89556841-c4cd-4629-98fa-f60544782480 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:00.469143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89556841-c4cd-4629-98fa-f60544782480 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:00.596209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=10 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:00.601927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ec669904-e52a-4573-938d-44591b553f6b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:00.609986 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ec669904-e52a-4573-938d-44591b553f6b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1293 microversion: 2.1 time: 0.404554 Aug 23 18:14:00.624722 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2335/4540] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:00 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1293 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:00.919006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-89556841-c4cd-4629-98fa-f60544782480 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:00.931284 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-89556841-c4cd-4629-98fa-f60544782480 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1315 microversion: 2.1 time: 0.554244 Aug 23 18:14:00.931284 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2206/4541] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:00 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1315 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:01.555484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d75dbe28-5771-43a3-8561-d8e65bc70ec9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:01.555790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d75dbe28-5771-43a3-8561-d8e65bc70ec9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:01.560055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:01.569002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d75dbe28-5771-43a3-8561-d8e65bc70ec9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:01.569771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d75dbe28-5771-43a3-8561-d8e65bc70ec9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:01.570790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d75dbe28-5771-43a3-8561-d8e65bc70ec9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:01.571932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d75dbe28-5771-43a3-8561-d8e65bc70ec9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:01.573983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d75dbe28-5771-43a3-8561-d8e65bc70ec9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:01.574941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d75dbe28-5771-43a3-8561-d8e65bc70ec9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:01.636801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-26828a17-279c-4956-873b-88c505a612a6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:01.638420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-26828a17-279c-4956-873b-88c505a612a6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:01.649597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26828a17-279c-4956-873b-88c505a612a6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:01.650348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26828a17-279c-4956-873b-88c505a612a6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:01.655247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26828a17-279c-4956-873b-88c505a612a6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:01.656443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26828a17-279c-4956-873b-88c505a612a6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:01.657149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26828a17-279c-4956-873b-88c505a612a6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:01.658358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26828a17-279c-4956-873b-88c505a612a6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:01.744084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-d75dbe28-5771-43a3-8561-d8e65bc70ec9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lazy-loading 'services' on Instance uuid c3b668ab-533f-4dca-8ebe-a622745ec9f6 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:14:01.857727 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d75dbe28-5771-43a3-8561-d8e65bc70ec9 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6/os-volume_attachments/9d341950-2ee6-4301-99e5-b60e895fe6e3" status: 202 len: 0 microversion: 2.1 time: 0.305423 Aug 23 18:14:01.858635 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2336/4542] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 18:14:01 2022] DELETE /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6/os-volume_attachments/9d341950-2ee6-4301-99e5-b60e895fe6e3 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:14:01.891977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-26828a17-279c-4956-873b-88c505a612a6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:01.917682 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-26828a17-279c-4956-873b-88c505a612a6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1293 microversion: 2.1 time: 0.288903 Aug 23 18:14:01.919012 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2207/4543] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:01 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1293 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:01.968074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fd213ce0-9fe1-4eec-954e-a6e1fd1aebf5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:01.969589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fd213ce0-9fe1-4eec-954e-a6e1fd1aebf5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:01.985188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd213ce0-9fe1-4eec-954e-a6e1fd1aebf5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:01.988436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd213ce0-9fe1-4eec-954e-a6e1fd1aebf5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:01.989201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd213ce0-9fe1-4eec-954e-a6e1fd1aebf5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:01.990120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd213ce0-9fe1-4eec-954e-a6e1fd1aebf5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:01.991744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd213ce0-9fe1-4eec-954e-a6e1fd1aebf5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:01.993660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd213ce0-9fe1-4eec-954e-a6e1fd1aebf5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:02.063870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1781908032", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "1d723ff7-1b48-4195-9f27-f719c9cc3c0c"}], "security_groups": [{"name": "tempest-securitygroup--1599871767"}], "key_name": "tempest-keypair-1125848974", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "6147471c-f03e-4e40-8f5c-af6467df3534", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:02.229131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fd213ce0-9fe1-4eec-954e-a6e1fd1aebf5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:02.237371 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fd213ce0-9fe1-4eec-954e-a6e1fd1aebf5 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1315 microversion: 2.1 time: 0.279319 Aug 23 18:14:02.238416 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2337/4544] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:01 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1315 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:02.251559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] validate_networks() for [('1d723ff7-1b48-4195-9f27-f719c9cc3c0c', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:14:02.641700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Getting quotas for project 1b9a8cc730ec452daede3d0640e264d7. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:14:02.647447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Getting quotas for user f5d4ecb2510a43f5bb7d983e65f3d49a and project 1b9a8cc730ec452daede3d0640e264d7. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:14:02.664400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:14:02.664999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:14:02.665486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:14:02.665901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:14:02.666475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:14:02.675883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:02.676547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:02.677164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:02.678093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:02.678583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:02.679030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:02.707504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Getting quotas for project 1b9a8cc730ec452daede3d0640e264d7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:14:02.720958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Getting quotas for user f5d4ecb2510a43f5bb7d983e65f3d49a and project 1b9a8cc730ec452daede3d0640e264d7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:14:02.797999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:14:02.800299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6147471c-f03e-4e40-8f5c-af6467df3534',volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:14:02.940534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f0e795ce-269c-45e8-a0e3-80831823ad89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:02.941724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f0e795ce-269c-45e8-a0e3-80831823ad89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:02.953960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0e795ce-269c-45e8-a0e3-80831823ad89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:02.954463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0e795ce-269c-45e8-a0e3-80831823ad89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:02.954936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0e795ce-269c-45e8-a0e3-80831823ad89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:02.955656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0e795ce-269c-45e8-a0e3-80831823ad89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:02.956111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0e795ce-269c-45e8-a0e3-80831823ad89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:02.956539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0e795ce-269c-45e8-a0e3-80831823ad89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:03.052397 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-505ff74d-4441-4652-9cc6-7f2c6f9661b5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 407 microversion: 2.1 time: 0.998793 Aug 23 18:14:03.052397 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2208/4545] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:02 2022] POST /compute/v2.1/servers => generated 407 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:14:03.065062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fd165af8-9fa3-4fe6-a420-c27f7e16623b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1341882855", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "8a892680-ce39-4a76-90f9-360ac383770b", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:03.169231 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-fd165af8-9fa3-4fe6-a420-c27f7e16623b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Block Device 8a892680-ce39-4a76-90f9-360ac383770b is not bootable. Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fd165af8-9fa3-4fe6-a420-c27f7e16623b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 358 Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1341882855", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "8a892680-ce39-4a76-90f9-360ac383770b", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: exception: Block Device 8a892680-ce39-4a76-90f9-360ac383770b is not bootable. Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1341882855', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '8a892680-ce39-4a76-90f9-360ac383770b'}], 'networks': [{'uuid': '597d3f38-9c5d-451f-81bf-3e3fa931aa6a'}]}}} Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1659, in _create_instance Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 8a892680-ce39-4a76-90f9-360ac383770b is not bootable. Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:03.180720 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 8a892680-ce39-4a76-90f9-360ac383770b is not bootable. Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 8a892680-ce39-4a76-90f9-360ac383770b is not bootable. Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fd165af8-9fa3-4fe6-a420-c27f7e16623b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Block Device 8a892680-ce39-4a76-90f9-360ac383770b is not bootable. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fd165af8-9fa3-4fe6-a420-c27f7e16623b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.129544 Aug 23 18:14:03.186000 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2209/4546] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:03 2022] POST /compute/v2.1/servers => generated 110 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:14:03.192194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f0e795ce-269c-45e8-a0e3-80831823ad89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:03.194016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ceede4a1-5740-4cdb-9f9b-1d7e7eea6b32 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:03.199222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ceede4a1-5740-4cdb-9f9b-1d7e7eea6b32 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:03.218364 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f0e795ce-269c-45e8-a0e3-80831823ad89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1293 microversion: 2.1 time: 0.279253 Aug 23 18:14:03.220378 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2338/4547] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:02 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1293 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:03.236041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ac43f7e-6157-44d0-8934-3e07544e5f34 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:03.236892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8ac43f7e-6157-44d0-8934-3e07544e5f34 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:03.248508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac43f7e-6157-44d0-8934-3e07544e5f34 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:03.249405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac43f7e-6157-44d0-8934-3e07544e5f34 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:03.250013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac43f7e-6157-44d0-8934-3e07544e5f34 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:03.252077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac43f7e-6157-44d0-8934-3e07544e5f34 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:03.253301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac43f7e-6157-44d0-8934-3e07544e5f34 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:03.253906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac43f7e-6157-44d0-8934-3e07544e5f34 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:03.288612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ceede4a1-5740-4cdb-9f9b-1d7e7eea6b32 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:03.301819 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ceede4a1-5740-4cdb-9f9b-1d7e7eea6b32 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1122 microversion: 2.1 time: 0.115142 Aug 23 18:14:03.303034 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2210/4548] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:03 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1122 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:03.309212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-893db115-7800-4798-b8d7-9044dff0b751 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:03.310124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-893db115-7800-4798-b8d7-9044dff0b751 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:03.322654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-893db115-7800-4798-b8d7-9044dff0b751 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:03.327692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-893db115-7800-4798-b8d7-9044dff0b751 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:03.330679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-893db115-7800-4798-b8d7-9044dff0b751 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:03.332402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-893db115-7800-4798-b8d7-9044dff0b751 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:03.333149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-893db115-7800-4798-b8d7-9044dff0b751 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:03.334038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-893db115-7800-4798-b8d7-9044dff0b751 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:03.474320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8ac43f7e-6157-44d0-8934-3e07544e5f34 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:03.483882 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8ac43f7e-6157-44d0-8934-3e07544e5f34 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.252097 Aug 23 18:14:03.486257 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2339/4549] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:03 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:03.509044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fe9bd0ea-f7b7-4799-9efc-51b272ae9526 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:03.509959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fe9bd0ea-f7b7-4799-9efc-51b272ae9526 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:03.517403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe9bd0ea-f7b7-4799-9efc-51b272ae9526 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:03.518283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe9bd0ea-f7b7-4799-9efc-51b272ae9526 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:03.519365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe9bd0ea-f7b7-4799-9efc-51b272ae9526 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:03.521575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe9bd0ea-f7b7-4799-9efc-51b272ae9526 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:03.523404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe9bd0ea-f7b7-4799-9efc-51b272ae9526 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:03.524155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe9bd0ea-f7b7-4799-9efc-51b272ae9526 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:03.789003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-893db115-7800-4798-b8d7-9044dff0b751 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:03.801710 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-893db115-7800-4798-b8d7-9044dff0b751 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1315 microversion: 2.1 time: 0.497333 Aug 23 18:14:03.807098 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2211/4550] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:03 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1315 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:03.835475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fe9bd0ea-f7b7-4799-9efc-51b272ae9526 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:03.844828 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fe9bd0ea-f7b7-4799-9efc-51b272ae9526 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.339655 Aug 23 18:14:03.849550 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2340/4551] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:03 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:04.241415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-946cd24e-6b06-4895-864e-ff1b73738f11 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:04.242038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-946cd24e-6b06-4895-864e-ff1b73738f11 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:04.259970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-946cd24e-6b06-4895-864e-ff1b73738f11 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:04.262029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-946cd24e-6b06-4895-864e-ff1b73738f11 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:04.263243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-946cd24e-6b06-4895-864e-ff1b73738f11 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:04.267142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-946cd24e-6b06-4895-864e-ff1b73738f11 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:04.269924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-946cd24e-6b06-4895-864e-ff1b73738f11 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:04.270486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-946cd24e-6b06-4895-864e-ff1b73738f11 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:04.324287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c11d324a-6636-47a5-9027-4ecf64456ff5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:04.325230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c11d324a-6636-47a5-9027-4ecf64456ff5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:04.338332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c11d324a-6636-47a5-9027-4ecf64456ff5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:04.356745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c11d324a-6636-47a5-9027-4ecf64456ff5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:04.357289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c11d324a-6636-47a5-9027-4ecf64456ff5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:04.358066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c11d324a-6636-47a5-9027-4ecf64456ff5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:04.358567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c11d324a-6636-47a5-9027-4ecf64456ff5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:04.359008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c11d324a-6636-47a5-9027-4ecf64456ff5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:04.700532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c11d324a-6636-47a5-9027-4ecf64456ff5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:04.709775 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c11d324a-6636-47a5-9027-4ecf64456ff5 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1164 microversion: 2.1 time: 0.390121 Aug 23 18:14:04.710369 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2341/4552] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:04 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1164 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:04.822950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bf9a226e-ff0e-4570-8544-39f537c129f2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:04.824919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bf9a226e-ff0e-4570-8544-39f537c129f2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:04.835368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf9a226e-ff0e-4570-8544-39f537c129f2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:04.836205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf9a226e-ff0e-4570-8544-39f537c129f2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:04.836849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf9a226e-ff0e-4570-8544-39f537c129f2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:04.839349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf9a226e-ff0e-4570-8544-39f537c129f2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:04.842482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf9a226e-ff0e-4570-8544-39f537c129f2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:04.849130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf9a226e-ff0e-4570-8544-39f537c129f2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:05.129919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bf9a226e-ff0e-4570-8544-39f537c129f2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:05.144874 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bf9a226e-ff0e-4570-8544-39f537c129f2 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1315 microversion: 2.1 time: 0.325730 Aug 23 18:14:05.147329 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2342/4553] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:04 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1315 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:05.175724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-946cd24e-6b06-4895-864e-ff1b73738f11 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:05.184362 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-946cd24e-6b06-4895-864e-ff1b73738f11 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1293 microversion: 2.1 time: 0.946800 Aug 23 18:14:05.203558 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2212/4554] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:04 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1293 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:05.780074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aaa793d3-0bcf-41cb-bc24-efc873848e0c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:05.780709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aaa793d3-0bcf-41cb-bc24-efc873848e0c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:05.799455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaa793d3-0bcf-41cb-bc24-efc873848e0c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:05.803584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaa793d3-0bcf-41cb-bc24-efc873848e0c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:05.805136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaa793d3-0bcf-41cb-bc24-efc873848e0c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:05.809298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaa793d3-0bcf-41cb-bc24-efc873848e0c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:05.813058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaa793d3-0bcf-41cb-bc24-efc873848e0c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:05.815475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaa793d3-0bcf-41cb-bc24-efc873848e0c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:06.077639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aaa793d3-0bcf-41cb-bc24-efc873848e0c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:06.095440 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aaa793d3-0bcf-41cb-bc24-efc873848e0c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1238 microversion: 2.1 time: 0.351459 Aug 23 18:14:06.096517 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2343/4555] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:05 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1238 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:06.169954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6294fe20-c8f4-4915-861f-568682af9225 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:06.170645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6294fe20-c8f4-4915-861f-568682af9225 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:06.210355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ada5f20a-11bb-4647-880d-524b93dcd994 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:06.211251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ada5f20a-11bb-4647-880d-524b93dcd994 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:06.212312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6294fe20-c8f4-4915-861f-568682af9225 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:06.212918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6294fe20-c8f4-4915-861f-568682af9225 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:06.213372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6294fe20-c8f4-4915-861f-568682af9225 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:06.217399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6294fe20-c8f4-4915-861f-568682af9225 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:06.217892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6294fe20-c8f4-4915-861f-568682af9225 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:06.218339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6294fe20-c8f4-4915-861f-568682af9225 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:06.221941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ada5f20a-11bb-4647-880d-524b93dcd994 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:06.222526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ada5f20a-11bb-4647-880d-524b93dcd994 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:06.222988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ada5f20a-11bb-4647-880d-524b93dcd994 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:06.231697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ada5f20a-11bb-4647-880d-524b93dcd994 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:06.232433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ada5f20a-11bb-4647-880d-524b93dcd994 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:06.233658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ada5f20a-11bb-4647-880d-524b93dcd994 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:06.549685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6294fe20-c8f4-4915-861f-568682af9225 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:06.563544 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6294fe20-c8f4-4915-861f-568682af9225 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1315 microversion: 2.1 time: 0.399732 Aug 23 18:14:06.565446 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2213/4556] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:06 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:06.570266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-7752f142-6705-4202-986b-8c252a8024b8 req-c7346413-d37a-46d9-9281-2e0564a4123b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c846eb-9fa4-4156-9fd7-44976362c45f", "name": "network-vif-plugged", "status": "completed", "tag": "a38ad55b-08c4-42f1-9429-6943dea1b607"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:06.584591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7752f142-6705-4202-986b-8c252a8024b8 req-c7346413-d37a-46d9-9281-2e0564a4123b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:06.586207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7752f142-6705-4202-986b-8c252a8024b8 req-c7346413-d37a-46d9-9281-2e0564a4123b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:06.587001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7752f142-6705-4202-986b-8c252a8024b8 req-c7346413-d37a-46d9-9281-2e0564a4123b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:06.606392 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-7752f142-6705-4202-986b-8c252a8024b8 req-c7346413-d37a-46d9-9281-2e0564a4123b service nova] Creating event network-vif-plugged:a38ad55b-08c4-42f1-9429-6943dea1b607 for instance 06c846eb-9fa4-4156-9fd7-44976362c45f on n-h1-850468-16 Aug 23 18:14:06.615077 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-7752f142-6705-4202-986b-8c252a8024b8 req-c7346413-d37a-46d9-9281-2e0564a4123b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047732 Aug 23 18:14:06.616165 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2214/4557] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:14:06.940058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ada5f20a-11bb-4647-880d-524b93dcd994 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:06.951275 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ada5f20a-11bb-4647-880d-524b93dcd994 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1293 microversion: 2.1 time: 0.744772 Aug 23 18:14:06.952690 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2344/4558] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:06 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1293 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:07.125461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cb12c1b4-5502-4e47-89b1-5af3d8b35448 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:07.127113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cb12c1b4-5502-4e47-89b1-5af3d8b35448 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:07.138434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb12c1b4-5502-4e47-89b1-5af3d8b35448 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:07.139379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb12c1b4-5502-4e47-89b1-5af3d8b35448 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:07.140312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb12c1b4-5502-4e47-89b1-5af3d8b35448 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:07.147392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb12c1b4-5502-4e47-89b1-5af3d8b35448 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:07.147902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb12c1b4-5502-4e47-89b1-5af3d8b35448 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:07.148358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb12c1b4-5502-4e47-89b1-5af3d8b35448 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:07.156031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:07.428098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cb12c1b4-5502-4e47-89b1-5af3d8b35448 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:07.445348 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cb12c1b4-5502-4e47-89b1-5af3d8b35448 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1306 microversion: 2.1 time: 0.325681 Aug 23 18:14:07.447247 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2215/4559] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:07 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1306 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:07.593283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b847a04c-d4b3-4fac-b70e-7f50a2f39504 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:07.593863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b847a04c-d4b3-4fac-b70e-7f50a2f39504 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:07.610950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b847a04c-d4b3-4fac-b70e-7f50a2f39504 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:07.613922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b847a04c-d4b3-4fac-b70e-7f50a2f39504 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:07.614681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b847a04c-d4b3-4fac-b70e-7f50a2f39504 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:07.615625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b847a04c-d4b3-4fac-b70e-7f50a2f39504 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:07.618922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b847a04c-d4b3-4fac-b70e-7f50a2f39504 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:07.619613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b847a04c-d4b3-4fac-b70e-7f50a2f39504 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:07.895980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b847a04c-d4b3-4fac-b70e-7f50a2f39504 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:07.912893 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b847a04c-d4b3-4fac-b70e-7f50a2f39504 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1315 microversion: 2.1 time: 0.329046 Aug 23 18:14:07.914813 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2345/4560] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:07 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1315 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:07.988500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-914565e6-08d9-43bf-9ad8-5184d4b61aff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:07.992638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-914565e6-08d9-43bf-9ad8-5184d4b61aff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:08.014212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-914565e6-08d9-43bf-9ad8-5184d4b61aff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:08.023612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-914565e6-08d9-43bf-9ad8-5184d4b61aff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:08.024090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-914565e6-08d9-43bf-9ad8-5184d4b61aff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:08.024848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-914565e6-08d9-43bf-9ad8-5184d4b61aff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:08.025313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-914565e6-08d9-43bf-9ad8-5184d4b61aff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:08.027167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-914565e6-08d9-43bf-9ad8-5184d4b61aff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:08.288021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-914565e6-08d9-43bf-9ad8-5184d4b61aff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:08.305061 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-914565e6-08d9-43bf-9ad8-5184d4b61aff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1293 microversion: 2.1 time: 0.333445 Aug 23 18:14:08.305884 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2216/4561] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:07 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1293 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:08.470671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fe31980a-c5fa-4ba0-90fd-702e96e59e4f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:08.472793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fe31980a-c5fa-4ba0-90fd-702e96e59e4f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:08.485150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe31980a-c5fa-4ba0-90fd-702e96e59e4f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:08.485977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe31980a-c5fa-4ba0-90fd-702e96e59e4f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:08.488794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe31980a-c5fa-4ba0-90fd-702e96e59e4f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:08.490562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe31980a-c5fa-4ba0-90fd-702e96e59e4f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:08.491345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe31980a-c5fa-4ba0-90fd-702e96e59e4f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:08.492311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe31980a-c5fa-4ba0-90fd-702e96e59e4f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:08.649599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-03f98e88-53be-42ac-93ab-965f6d9ec868 req-735c1d87-4205-4c5f-8e2d-0766c92ba7f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e35640-9377-487d-85e3-96ef4549659b", "name": "network-vif-plugged", "status": "completed", "tag": "8bcd1bd5-1d30-437d-bc07-1b0c8f010179"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:08.664121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-03f98e88-53be-42ac-93ab-965f6d9ec868 req-735c1d87-4205-4c5f-8e2d-0766c92ba7f8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:08.664668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-03f98e88-53be-42ac-93ab-965f6d9ec868 req-735c1d87-4205-4c5f-8e2d-0766c92ba7f8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:08.665107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-03f98e88-53be-42ac-93ab-965f6d9ec868 req-735c1d87-4205-4c5f-8e2d-0766c92ba7f8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:08.681836 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-03f98e88-53be-42ac-93ab-965f6d9ec868 req-735c1d87-4205-4c5f-8e2d-0766c92ba7f8 service nova] Creating event network-vif-plugged:8bcd1bd5-1d30-437d-bc07-1b0c8f010179 for instance c0e35640-9377-487d-85e3-96ef4549659b on n-h1-850468-16 Aug 23 18:14:08.690116 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-03f98e88-53be-42ac-93ab-965f6d9ec868 req-735c1d87-4205-4c5f-8e2d-0766c92ba7f8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045076 Aug 23 18:14:08.695643 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2217/4562] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:14:08.817235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-5228c651-7d46-425a-a2b1-f93e6b0fd2c8 req-781c306e-cbc0-466f-bb22-bf9c3d855f76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8908344b-041b-4181-8b33-2a5e191df614", "tag": "a4ce8cad-bebb-43fd-9c4f-086034d53e3e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:08.821549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fe31980a-c5fa-4ba0-90fd-702e96e59e4f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:08.837711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5228c651-7d46-425a-a2b1-f93e6b0fd2c8 req-781c306e-cbc0-466f-bb22-bf9c3d855f76 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:08.838213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5228c651-7d46-425a-a2b1-f93e6b0fd2c8 req-781c306e-cbc0-466f-bb22-bf9c3d855f76 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:08.841559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5228c651-7d46-425a-a2b1-f93e6b0fd2c8 req-781c306e-cbc0-466f-bb22-bf9c3d855f76 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:08.851764 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fe31980a-c5fa-4ba0-90fd-702e96e59e4f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1306 microversion: 2.1 time: 0.388648 Aug 23 18:14:08.856183 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2346/4563] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:08 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1306 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:08.861906 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5228c651-7d46-425a-a2b1-f93e6b0fd2c8 req-781c306e-cbc0-466f-bb22-bf9c3d855f76 service nova] Creating event network-changed:a4ce8cad-bebb-43fd-9c4f-086034d53e3e for instance 8908344b-041b-4181-8b33-2a5e191df614 on n-h2-850468-16 Aug 23 18:14:08.868446 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-5228c651-7d46-425a-a2b1-f93e6b0fd2c8 req-781c306e-cbc0-466f-bb22-bf9c3d855f76 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060547 Aug 23 18:14:08.869596 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2218/4564] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:14:08.939735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4478ead0-5efe-4dcb-b429-e251c769d872 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:08.940379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4478ead0-5efe-4dcb-b429-e251c769d872 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:08.953000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4478ead0-5efe-4dcb-b429-e251c769d872 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:08.953679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4478ead0-5efe-4dcb-b429-e251c769d872 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:08.954285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4478ead0-5efe-4dcb-b429-e251c769d872 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:08.956493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4478ead0-5efe-4dcb-b429-e251c769d872 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:08.958426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4478ead0-5efe-4dcb-b429-e251c769d872 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:08.960980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4478ead0-5efe-4dcb-b429-e251c769d872 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:09.193592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4478ead0-5efe-4dcb-b429-e251c769d872 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:09.196049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:09.206720 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4478ead0-5efe-4dcb-b429-e251c769d872 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1502 microversion: 2.1 time: 0.273412 Aug 23 18:14:09.225931 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2347/4565] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:08 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1502 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:09.234803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4565a5cd-29d5-4ceb-aa22-a63540bd47d1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:09.235728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4565a5cd-29d5-4ceb-aa22-a63540bd47d1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:09.245226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4565a5cd-29d5-4ceb-aa22-a63540bd47d1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:09.247642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4565a5cd-29d5-4ceb-aa22-a63540bd47d1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:09.258893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4565a5cd-29d5-4ceb-aa22-a63540bd47d1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:09.259727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4565a5cd-29d5-4ceb-aa22-a63540bd47d1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:09.260217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4565a5cd-29d5-4ceb-aa22-a63540bd47d1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:09.261424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4565a5cd-29d5-4ceb-aa22-a63540bd47d1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:09.304122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-4565a5cd-29d5-4ceb-aa22-a63540bd47d1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lazy-loading 'flavor' on Instance uuid 06c846eb-9fa4-4156-9fd7-44976362c45f {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:14:09.329295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ed83ddf7-6dbc-4abf-b351-fa4458c69ec0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:09.330067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ed83ddf7-6dbc-4abf-b351-fa4458c69ec0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:09.336933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed83ddf7-6dbc-4abf-b351-fa4458c69ec0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:09.337360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed83ddf7-6dbc-4abf-b351-fa4458c69ec0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:09.337847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed83ddf7-6dbc-4abf-b351-fa4458c69ec0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:09.341272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed83ddf7-6dbc-4abf-b351-fa4458c69ec0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:09.341932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed83ddf7-6dbc-4abf-b351-fa4458c69ec0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:09.342534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed83ddf7-6dbc-4abf-b351-fa4458c69ec0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:09.433072 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4565a5cd-29d5-4ceb-aa22-a63540bd47d1 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "POST /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f/action" status: 202 len: 0 microversion: 2.1 time: 0.204736 Aug 23 18:14:09.434694 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2219/4566] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:09 2022] POST /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f/action => generated 0 bytes in 208 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:14:09.446483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a10f922-379f-453f-a64b-c118440f8d49 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:09.447602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6a10f922-379f-453f-a64b-c118440f8d49 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:09.458863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a10f922-379f-453f-a64b-c118440f8d49 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:09.460496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a10f922-379f-453f-a64b-c118440f8d49 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:09.461097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a10f922-379f-453f-a64b-c118440f8d49 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:09.463334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a10f922-379f-453f-a64b-c118440f8d49 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:09.464713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a10f922-379f-453f-a64b-c118440f8d49 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:09.465737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a10f922-379f-453f-a64b-c118440f8d49 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:09.646575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ed83ddf7-6dbc-4abf-b351-fa4458c69ec0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:09.659252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a10f922-379f-453f-a64b-c118440f8d49 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:09.663140 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ed83ddf7-6dbc-4abf-b351-fa4458c69ec0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1293 microversion: 2.1 time: 0.337607 Aug 23 18:14:09.663740 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2348/4567] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:09 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1293 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:09.668803 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a10f922-379f-453f-a64b-c118440f8d49 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1510 microversion: 2.1 time: 0.228322 Aug 23 18:14:09.682943 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2220/4568] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:09 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:09.875528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-314978e5-c026-4b95-9363-0dc30cd74a2a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:09.876544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-314978e5-c026-4b95-9363-0dc30cd74a2a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:09.890887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-314978e5-c026-4b95-9363-0dc30cd74a2a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:09.892494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-314978e5-c026-4b95-9363-0dc30cd74a2a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:09.893502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-314978e5-c026-4b95-9363-0dc30cd74a2a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:09.895013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-314978e5-c026-4b95-9363-0dc30cd74a2a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:09.895676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-314978e5-c026-4b95-9363-0dc30cd74a2a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:09.896522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-314978e5-c026-4b95-9363-0dc30cd74a2a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:10.159776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-314978e5-c026-4b95-9363-0dc30cd74a2a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:10.185092 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-314978e5-c026-4b95-9363-0dc30cd74a2a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1306 microversion: 2.1 time: 0.315599 Aug 23 18:14:10.198956 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2349/4569] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:09 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1306 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:10.650290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d6f73d83-71d2-49b0-9e18-4f7d6ae7015b tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:10.650823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d6f73d83-71d2-49b0-9e18-4f7d6ae7015b tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:10.686337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b90b5451-60a6-453f-8078-01e9a1ffa8ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:10.688516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6f73d83-71d2-49b0-9e18-4f7d6ae7015b tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:10.688910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b90b5451-60a6-453f-8078-01e9a1ffa8ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:10.689012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6f73d83-71d2-49b0-9e18-4f7d6ae7015b tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:10.689224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6f73d83-71d2-49b0-9e18-4f7d6ae7015b tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:10.689959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6f73d83-71d2-49b0-9e18-4f7d6ae7015b tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:10.690589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6f73d83-71d2-49b0-9e18-4f7d6ae7015b tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:10.695762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6f73d83-71d2-49b0-9e18-4f7d6ae7015b tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:10.697383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b90b5451-60a6-453f-8078-01e9a1ffa8ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:10.699355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b90b5451-60a6-453f-8078-01e9a1ffa8ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:10.700033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b90b5451-60a6-453f-8078-01e9a1ffa8ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:10.703192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b90b5451-60a6-453f-8078-01e9a1ffa8ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:10.705169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b90b5451-60a6-453f-8078-01e9a1ffa8ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:10.705829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b90b5451-60a6-453f-8078-01e9a1ffa8ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:10.841330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d6f73d83-71d2-49b0-9e18-4f7d6ae7015b tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:14:10.944245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:10.981997 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d6f73d83-71d2-49b0-9e18-4f7d6ae7015b tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 204 len: 0 microversion: 2.1 time: 0.336704 Aug 23 18:14:10.983208 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2221/4570] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:14:10 2022] DELETE /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:14:10.995219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e8ce3d7a-ffc5-4ef5-9961-e019bfcb865a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:10.996344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e8ce3d7a-ffc5-4ef5-9961-e019bfcb865a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:11.003183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8ce3d7a-ffc5-4ef5-9961-e019bfcb865a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:11.003964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8ce3d7a-ffc5-4ef5-9961-e019bfcb865a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:11.004649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8ce3d7a-ffc5-4ef5-9961-e019bfcb865a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:11.005571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8ce3d7a-ffc5-4ef5-9961-e019bfcb865a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:11.006263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8ce3d7a-ffc5-4ef5-9961-e019bfcb865a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:11.006816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8ce3d7a-ffc5-4ef5-9961-e019bfcb865a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:11.159496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b90b5451-60a6-453f-8078-01e9a1ffa8ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:11.175488 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b90b5451-60a6-453f-8078-01e9a1ffa8ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1474 microversion: 2.1 time: 0.494579 Aug 23 18:14:11.176939 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2350/4571] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:10 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1474 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:11.193228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2b348917-3272-4bd0-9431-b2cb41ae2ebf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1164244540", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "126e0038-c91e-4894-b027-98e76f88a186", "destination_type": "local"}, {"source_type": "volume", "uuid": "5b497b8f-c112-4e75-ab73-2da94c8ca09b", "destination_type": "invalid"}], "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2b348917-3272-4bd0-9431-b2cb41ae2ebf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 495 Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1164244540", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "126e0038-c91e-4894-b027-98e76f88a186", "destination_type": "local"}, {"source_type": "volume", "uuid": "5b497b8f-c112-4e75-ab73-2da94c8ca09b", "destination_type": "invalid"}], "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1164244540', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '126e0038-c91e-4894-b027-98e76f88a186', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': '5b497b8f-c112-4e75-ab73-2da94c8ca09b', 'destination_type': 'invalid'}], 'networks': [{'uuid': '597d3f38-9c5d-451f-81bf-3e3fa931aa6a'}]}}} Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'invalid' Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:11.207687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:11.211219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2b348917-3272-4bd0-9431-b2cb41ae2ebf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:11.221433 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2b348917-3272-4bd0-9431-b2cb41ae2ebf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.030463 Aug 23 18:14:11.222386 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2351/4572] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:11 2022] POST /compute/v2.1/servers => generated 155 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:14:11.236626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0c0a597d-fce3-46c1-b18e-a5604d28f511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:11.237259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0c0a597d-fce3-46c1-b18e-a5604d28f511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:11.237894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e8ce3d7a-ffc5-4ef5-9961-e019bfcb865a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:11.248804 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e8ce3d7a-ffc5-4ef5-9961-e019bfcb865a tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1493 microversion: 2.1 time: 0.264044 Aug 23 18:14:11.249532 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2222/4573] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:10 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1493 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:11.249665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c0a597d-fce3-46c1-b18e-a5604d28f511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:11.250133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c0a597d-fce3-46c1-b18e-a5604d28f511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:11.250837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c0a597d-fce3-46c1-b18e-a5604d28f511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:11.251679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c0a597d-fce3-46c1-b18e-a5604d28f511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:11.252154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c0a597d-fce3-46c1-b18e-a5604d28f511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:11.252745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c0a597d-fce3-46c1-b18e-a5604d28f511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:11.259652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3c4421b8-f480-4c9f-b12f-6dd6604bc5cd tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:11.261433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3c4421b8-f480-4c9f-b12f-6dd6604bc5cd tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:11.272774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c4421b8-f480-4c9f-b12f-6dd6604bc5cd tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:11.273763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c4421b8-f480-4c9f-b12f-6dd6604bc5cd tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:11.275103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c4421b8-f480-4c9f-b12f-6dd6604bc5cd tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:11.277693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c4421b8-f480-4c9f-b12f-6dd6604bc5cd tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:11.278698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c4421b8-f480-4c9f-b12f-6dd6604bc5cd tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:11.279347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c4421b8-f480-4c9f-b12f-6dd6604bc5cd tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:11.529772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3c4421b8-f480-4c9f-b12f-6dd6604bc5cd tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:11.546179 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3c4421b8-f480-4c9f-b12f-6dd6604bc5cd tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1306 microversion: 2.1 time: 0.294900 Aug 23 18:14:11.546814 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2223/4574] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:11 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1306 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:11.552146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-586a4503-4952-4150-98d4-b0f77b1ee695 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:11.552906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-586a4503-4952-4150-98d4-b0f77b1ee695 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:11.559885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-586a4503-4952-4150-98d4-b0f77b1ee695 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:11.560393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-586a4503-4952-4150-98d4-b0f77b1ee695 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:11.561388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-586a4503-4952-4150-98d4-b0f77b1ee695 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:11.561726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-586a4503-4952-4150-98d4-b0f77b1ee695 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:11.562190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-586a4503-4952-4150-98d4-b0f77b1ee695 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:11.562884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-586a4503-4952-4150-98d4-b0f77b1ee695 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:11.648297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0c0a597d-fce3-46c1-b18e-a5604d28f511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:11.658815 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0c0a597d-fce3-46c1-b18e-a5604d28f511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1512 microversion: 2.1 time: 0.433125 Aug 23 18:14:11.668942 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2352/4575] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:11 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1512 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:11.687187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-99980143-0e11-4415-a9da-3d30533cea92 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:11.688386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-99980143-0e11-4415-a9da-3d30533cea92 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:11.704409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99980143-0e11-4415-a9da-3d30533cea92 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:11.705160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99980143-0e11-4415-a9da-3d30533cea92 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:11.705787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99980143-0e11-4415-a9da-3d30533cea92 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:11.706741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99980143-0e11-4415-a9da-3d30533cea92 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:11.707385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99980143-0e11-4415-a9da-3d30533cea92 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:11.707977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99980143-0e11-4415-a9da-3d30533cea92 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:11.735191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-586a4503-4952-4150-98d4-b0f77b1ee695 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:11.745562 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-586a4503-4952-4150-98d4-b0f77b1ee695 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.196893 Aug 23 18:14:11.754707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-99980143-0e11-4415-a9da-3d30533cea92 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:14:11.765309 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2224/4576] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:11 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:11.775158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1568526550", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:11.868918 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-99980143-0e11-4415-a9da-3d30533cea92 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 204 len: 0 microversion: 2.1 time: 0.189893 Aug 23 18:14:11.869946 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2353/4577] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:14:11 2022] DELETE /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:14:11.877466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ab95c1f8-2493-49a1-81a3-8e8b29289ec6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:11.882744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab95c1f8-2493-49a1-81a3-8e8b29289ec6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:11.898771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] validate_networks() for [('bcef2581-80d0-47e5-8b8b-34343a6facf5', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:14:11.905299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab95c1f8-2493-49a1-81a3-8e8b29289ec6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:11.905804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab95c1f8-2493-49a1-81a3-8e8b29289ec6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:11.906250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab95c1f8-2493-49a1-81a3-8e8b29289ec6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:11.907036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab95c1f8-2493-49a1-81a3-8e8b29289ec6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:11.908249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab95c1f8-2493-49a1-81a3-8e8b29289ec6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:11.908879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab95c1f8-2493-49a1-81a3-8e8b29289ec6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.174851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ab95c1f8-2493-49a1-81a3-8e8b29289ec6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:12.184909 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ab95c1f8-2493-49a1-81a3-8e8b29289ec6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.311758 Aug 23 18:14:12.186374 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2354/4578] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:11 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:12.191787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-de188530-11d6-4a2d-8a0e-c139f4907d8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:12.192586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-de188530-11d6-4a2d-8a0e-c139f4907d8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:12.199249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de188530-11d6-4a2d-8a0e-c139f4907d8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:12.199966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de188530-11d6-4a2d-8a0e-c139f4907d8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:12.200576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de188530-11d6-4a2d-8a0e-c139f4907d8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.201692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de188530-11d6-4a2d-8a0e-c139f4907d8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:12.202405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de188530-11d6-4a2d-8a0e-c139f4907d8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:12.203026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de188530-11d6-4a2d-8a0e-c139f4907d8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.410775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-de188530-11d6-4a2d-8a0e-c139f4907d8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:12.420429 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-de188530-11d6-4a2d-8a0e-c139f4907d8b tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1499 microversion: 2.1 time: 0.232635 Aug 23 18:14:12.421633 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2355/4579] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:12 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1499 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:12.426632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a49874b1-bcad-475c-82cb-93fa68ce15a8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-617606390", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a49874b1-bcad-475c-82cb-93fa68ce15a8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 491 Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-617606390", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-617606390', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '597d3f38-9c5d-451f-81bf-3e3fa931aa6a'}]}}} Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:12.436045 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a49874b1-bcad-475c-82cb-93fa68ce15a8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a49874b1-bcad-475c-82cb-93fa68ce15a8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.014855 Aug 23 18:14:12.439466 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2356/4580] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:12 2022] POST /compute/v2.1/servers => generated 624 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:14:12.448073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ec89a97-b283-4cb5-8835-7a8bb6db7233 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:12.448971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8ec89a97-b283-4cb5-8835-7a8bb6db7233 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:12.458835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ec89a97-b283-4cb5-8835-7a8bb6db7233 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:12.459728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ec89a97-b283-4cb5-8835-7a8bb6db7233 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:12.460399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ec89a97-b283-4cb5-8835-7a8bb6db7233 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.461359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ec89a97-b283-4cb5-8835-7a8bb6db7233 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:12.462065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ec89a97-b283-4cb5-8835-7a8bb6db7233 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:12.462780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ec89a97-b283-4cb5-8835-7a8bb6db7233 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.545997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:14:12.547774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:14:12.548618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:14:12.549515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:14:12.549946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:14:12.562787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:12.564395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:12.564395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.565017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:12.565652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:12.566328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.592115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:14:12.601457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for user 6e80c3f1c008459faa3ac74ea5984eea and project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:14:12.630968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:14:12.633723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 4c05b516-7563-4e2d-8185-9d3ca7dbdadc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:14:12.644280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8ec89a97-b283-4cb5-8835-7a8bb6db7233 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:12.655097 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8ec89a97-b283-4cb5-8835-7a8bb6db7233 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.210937 Aug 23 18:14:12.671367 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2357/4581] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:12 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:12.684353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-734673f3-185f-44dc-a109-5dd697846e79 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:12.685325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-734673f3-185f-44dc-a109-5dd697846e79 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:12.694082 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-78ead52e-df3e-4451-9771-ab87e8bb8b28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.927314 Aug 23 18:14:12.694880 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2225/4582] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:14:12.700343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-63f2344d-b1c8-49ee-ac0c-2e42beb95990 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:12.702397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-63f2344d-b1c8-49ee-ac0c-2e42beb95990 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:12.703186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-734673f3-185f-44dc-a109-5dd697846e79 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:12.703746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-734673f3-185f-44dc-a109-5dd697846e79 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:12.704127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-734673f3-185f-44dc-a109-5dd697846e79 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.704845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-734673f3-185f-44dc-a109-5dd697846e79 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:12.705747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-734673f3-185f-44dc-a109-5dd697846e79 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:12.705747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-734673f3-185f-44dc-a109-5dd697846e79 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.709334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63f2344d-b1c8-49ee-ac0c-2e42beb95990 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:12.710930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63f2344d-b1c8-49ee-ac0c-2e42beb95990 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:12.711393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63f2344d-b1c8-49ee-ac0c-2e42beb95990 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.712112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63f2344d-b1c8-49ee-ac0c-2e42beb95990 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:12.712582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63f2344d-b1c8-49ee-ac0c-2e42beb95990 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:12.713007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63f2344d-b1c8-49ee-ac0c-2e42beb95990 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.878277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-734673f3-185f-44dc-a109-5dd697846e79 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:12.888177 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-734673f3-185f-44dc-a109-5dd697846e79 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1306 microversion: 2.1 time: 0.214489 Aug 23 18:14:12.892630 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2358/4583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:12 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1306 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:12.906048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-026a4755-7ba4-4b98-90af-82516985693e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:12.906180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-026a4755-7ba4-4b98-90af-82516985693e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:12.919998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-026a4755-7ba4-4b98-90af-82516985693e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:12.920692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-026a4755-7ba4-4b98-90af-82516985693e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:12.921323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-026a4755-7ba4-4b98-90af-82516985693e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.922184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-026a4755-7ba4-4b98-90af-82516985693e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:12.922828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-026a4755-7ba4-4b98-90af-82516985693e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:12.923742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-026a4755-7ba4-4b98-90af-82516985693e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:12.929993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-63f2344d-b1c8-49ee-ac0c-2e42beb95990 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:12.942046 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-63f2344d-b1c8-49ee-ac0c-2e42beb95990 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.245773 Aug 23 18:14:12.943419 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2226/4584] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:12 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:12.950971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-87b6585f-7834-4008-8fe4-be4cfe81fca8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:12.951837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-87b6585f-7834-4008-8fe4-be4cfe81fca8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 4c05b516-7563-4e2d-8185-9d3ca7dbdadc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:12.975536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-87b6585f-7834-4008-8fe4-be4cfe81fca8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 4c05b516-7563-4e2d-8185-9d3ca7dbdadc] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:14:13.219042 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-87b6585f-7834-4008-8fe4-be4cfe81fca8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4c05b516-7563-4e2d-8185-9d3ca7dbdadc" status: 204 len: 0 microversion: 2.1 time: 0.273234 Aug 23 18:14:13.222997 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2227/4585] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:14:12 2022] DELETE /compute/v2.1/servers/4c05b516-7563-4e2d-8185-9d3ca7dbdadc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:14:13.227246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-11186aa2-6b29-4296-9598-b645bce19772 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-11186aa2-6b29-4296-9598-b645bce19772 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 416 Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'networks': [{'uuid': '597d3f38-9c5d-451f-81bf-3e3fa931aa6a'}]}}} Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:13.242580 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:13.247768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-11186aa2-6b29-4296-9598-b645bce19772 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:13.254560 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-11186aa2-6b29-4296-9598-b645bce19772 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.024630 Aug 23 18:14:13.254560 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2228/4586] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:13 2022] POST /compute/v2.1/servers => generated 619 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:14:13.263038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2824d803-d640-47d4-9a6d-f8f250646306 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:13.265782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2824d803-d640-47d4-9a6d-f8f250646306 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 4c05b516-7563-4e2d-8185-9d3ca7dbdadc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:13.270883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-026a4755-7ba4-4b98-90af-82516985693e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:13.280020 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2824d803-d640-47d4-9a6d-f8f250646306 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:14:13.283165 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-026a4755-7ba4-4b98-90af-82516985693e tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1512 microversion: 2.1 time: 0.389402 Aug 23 18:14:13.284062 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2359/4587] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:12 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1512 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2824d803-d640-47d4-9a6d-f8f250646306 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/4c05b516-7563-4e2d-8185-9d3ca7dbdadc HTTP/1.1 Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '4c05b516-7563-4e2d-8185-9d3ca7dbdadc'} Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:13.293665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:13.302392 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:13.302392 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:13.302392 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:13.302392 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:14:13.302392 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:13.302392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2824d803-d640-47d4-9a6d-f8f250646306 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:13.302392 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2824d803-d640-47d4-9a6d-f8f250646306 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/4c05b516-7563-4e2d-8185-9d3ca7dbdadc" status: 404 len: 111 microversion: 2.1 time: 0.035638 Aug 23 18:14:13.304216 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2229/4588] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:13 2022] GET /compute/v2.1/servers/4c05b516-7563-4e2d-8185-9d3ca7dbdadc => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:13.316556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-04ede742-d92a-498f-a635-080855e1fbd5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:13.317208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-04ede742-d92a-498f-a635-080855e1fbd5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:13.332758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04ede742-d92a-498f-a635-080855e1fbd5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:13.337482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04ede742-d92a-498f-a635-080855e1fbd5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:13.337942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04ede742-d92a-498f-a635-080855e1fbd5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:13.345151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04ede742-d92a-498f-a635-080855e1fbd5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:13.345745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04ede742-d92a-498f-a635-080855e1fbd5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:13.346154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04ede742-d92a-498f-a635-080855e1fbd5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:13.442343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b270853-d616-4820-aad9-23e7463d5570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:13.443539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3b270853-d616-4820-aad9-23e7463d5570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:13.457764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b270853-d616-4820-aad9-23e7463d5570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:13.458262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b270853-d616-4820-aad9-23e7463d5570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:13.460327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b270853-d616-4820-aad9-23e7463d5570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:13.461051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b270853-d616-4820-aad9-23e7463d5570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:13.462870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b270853-d616-4820-aad9-23e7463d5570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:13.464893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b270853-d616-4820-aad9-23e7463d5570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:13.657403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3b270853-d616-4820-aad9-23e7463d5570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:13.666319 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3b270853-d616-4820-aad9-23e7463d5570 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1499 microversion: 2.1 time: 0.227782 Aug 23 18:14:13.684195 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2360/4589] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:13 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1499 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:13.684195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-373352421", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "bcef2581-80d0-47e5-8b8b-34343a6facf5"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:13.769938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] validate_networks() for [('bcef2581-80d0-47e5-8b8b-34343a6facf5', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:14:13.795543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-04ede742-d92a-498f-a635-080855e1fbd5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:13.805400 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-04ede742-d92a-498f-a635-080855e1fbd5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.499917 Aug 23 18:14:13.807133 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2230/4590] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:13 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:13.845299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-34d16a92-e58a-43be-9d8d-a976ba593fa6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:13.851327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-34d16a92-e58a-43be-9d8d-a976ba593fa6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:13.860599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34d16a92-e58a-43be-9d8d-a976ba593fa6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:13.861309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34d16a92-e58a-43be-9d8d-a976ba593fa6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:13.861949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34d16a92-e58a-43be-9d8d-a976ba593fa6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:13.862941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34d16a92-e58a-43be-9d8d-a976ba593fa6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:13.863608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34d16a92-e58a-43be-9d8d-a976ba593fa6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:13.864305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34d16a92-e58a-43be-9d8d-a976ba593fa6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:14.467916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:14:14.468347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:14:14.469080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:14:14.469435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:14:14.469977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:14:14.480891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:14.481382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:14.481818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:14.482564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:14.483159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:14.483595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:14.505011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:14:14.512201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for user 6e80c3f1c008459faa3ac74ea5984eea and project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:14:14.528003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:14:14.531517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:14:14.594131 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9c993dd7-c7c2-46d7-83e8-2887ada38344 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.918592 Aug 23 18:14:14.598672 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2361/4591] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:14:14.603158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3c1a4ba3-e42d-4ad1-97c5-bcb3357e895a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:14.604395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3c1a4ba3-e42d-4ad1-97c5-bcb3357e895a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:14.615185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c1a4ba3-e42d-4ad1-97c5-bcb3357e895a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:14.615916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c1a4ba3-e42d-4ad1-97c5-bcb3357e895a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:14.616506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c1a4ba3-e42d-4ad1-97c5-bcb3357e895a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:14.617840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c1a4ba3-e42d-4ad1-97c5-bcb3357e895a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:14.622334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c1a4ba3-e42d-4ad1-97c5-bcb3357e895a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:14.623099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c1a4ba3-e42d-4ad1-97c5-bcb3357e895a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:14.811546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3c1a4ba3-e42d-4ad1-97c5-bcb3357e895a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:14.823738 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3c1a4ba3-e42d-4ad1-97c5-bcb3357e895a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1306 microversion: 2.1 time: 0.227488 Aug 23 18:14:14.825327 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2362/4592] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:14 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1306 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:14.834913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-007ff37a-9f6e-45b1-9cb2-d2c6550e11b4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:14.834913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-007ff37a-9f6e-45b1-9cb2-d2c6550e11b4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:14.845619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-007ff37a-9f6e-45b1-9cb2-d2c6550e11b4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:14.846199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-007ff37a-9f6e-45b1-9cb2-d2c6550e11b4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:14.851036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-007ff37a-9f6e-45b1-9cb2-d2c6550e11b4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:14.851844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-007ff37a-9f6e-45b1-9cb2-d2c6550e11b4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:14.852331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-007ff37a-9f6e-45b1-9cb2-d2c6550e11b4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:14.852768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-007ff37a-9f6e-45b1-9cb2-d2c6550e11b4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:15.110569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-007ff37a-9f6e-45b1-9cb2-d2c6550e11b4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:15.122839 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-007ff37a-9f6e-45b1-9cb2-d2c6550e11b4 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1512 microversion: 2.1 time: 0.295447 Aug 23 18:14:15.123775 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2363/4593] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:14 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1512 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:15.128999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bcc25022-fa94-4b80-a270-43e9d90469a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:15.129851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bcc25022-fa94-4b80-a270-43e9d90469a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:15.212871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bcc25022-fa94-4b80-a270-43e9d90469a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:15.215230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-34d16a92-e58a-43be-9d8d-a976ba593fa6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:15.225212 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bcc25022-fa94-4b80-a270-43e9d90469a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1220 microversion: 2.1 time: 0.098706 Aug 23 18:14:15.226251 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2364/4594] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:15 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1220 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:15.232452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-94ad8748-c574-467c-b2d2-95c666626381 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:15.233920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-94ad8748-c574-467c-b2d2-95c666626381 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:15.243533 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-34d16a92-e58a-43be-9d8d-a976ba593fa6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 1.396418 Aug 23 18:14:15.244205 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2231/4595] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:13 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 1415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:15.279747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94ad8748-c574-467c-b2d2-95c666626381 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:15.280151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94ad8748-c574-467c-b2d2-95c666626381 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:15.280519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94ad8748-c574-467c-b2d2-95c666626381 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:15.281392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94ad8748-c574-467c-b2d2-95c666626381 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:15.284355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94ad8748-c574-467c-b2d2-95c666626381 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:15.284868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94ad8748-c574-467c-b2d2-95c666626381 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:15.481578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f5e76673-71da-4ed6-a275-b37df3ff7d02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1716423303", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": -1, "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:15.513709 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-f5e76673-71da-4ed6-a275-b37df3ff7d02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Flavor -1 could not be found. Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f5e76673-71da-4ed6-a275-b37df3ff7d02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 206 Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1716423303", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": -1, "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: exception: Flavor -1 could not be found. Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1716423303', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': -1, 'networks': [{'uuid': '597d3f38-9c5d-451f-81bf-3e3fa931aa6a'}]}}} Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:15.515896 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Aug 23 18:14:15.519675 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:15.522236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f5e76673-71da-4ed6-a275-b37df3ff7d02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:15.523385 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f5e76673-71da-4ed6-a275-b37df3ff7d02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.046922 Aug 23 18:14:15.524512 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2232/4596] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:15 2022] POST /compute/v2.1/servers => generated 73 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 18:14:15.544761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8031ff60-82a8-4090-957f-5e0bfaa0cc55 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:15.550200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8031ff60-82a8-4090-957f-5e0bfaa0cc55 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:15.569399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8031ff60-82a8-4090-957f-5e0bfaa0cc55 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:15.571754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8031ff60-82a8-4090-957f-5e0bfaa0cc55 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:15.572840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8031ff60-82a8-4090-957f-5e0bfaa0cc55 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:15.575611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8031ff60-82a8-4090-957f-5e0bfaa0cc55 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:15.576373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8031ff60-82a8-4090-957f-5e0bfaa0cc55 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:15.578084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8031ff60-82a8-4090-957f-5e0bfaa0cc55 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:15.623136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-94ad8748-c574-467c-b2d2-95c666626381 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:15.642234 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-94ad8748-c574-467c-b2d2-95c666626381 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1499 microversion: 2.1 time: 0.414307 Aug 23 18:14:15.644017 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2365/4597] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:15 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1499 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:15.858002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e28ffa24-654c-46c6-a41e-bacb4534df3b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:15.858654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e28ffa24-654c-46c6-a41e-bacb4534df3b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:15.910721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e28ffa24-654c-46c6-a41e-bacb4534df3b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:15.911503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e28ffa24-654c-46c6-a41e-bacb4534df3b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:15.911968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e28ffa24-654c-46c6-a41e-bacb4534df3b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:15.912753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e28ffa24-654c-46c6-a41e-bacb4534df3b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:15.913216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e28ffa24-654c-46c6-a41e-bacb4534df3b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:15.913642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e28ffa24-654c-46c6-a41e-bacb4534df3b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:16.021379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8031ff60-82a8-4090-957f-5e0bfaa0cc55 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:16.034669 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8031ff60-82a8-4090-957f-5e0bfaa0cc55 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.504462 Aug 23 18:14:16.039427 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2233/4598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:15 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:16.105876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9082eee3-266a-45d5-8911-a2d735e5c9c7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:16.106983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9082eee3-266a-45d5-8911-a2d735e5c9c7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:16.121749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9082eee3-266a-45d5-8911-a2d735e5c9c7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:16.123833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9082eee3-266a-45d5-8911-a2d735e5c9c7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:16.126264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9082eee3-266a-45d5-8911-a2d735e5c9c7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:16.127611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9082eee3-266a-45d5-8911-a2d735e5c9c7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:16.128324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9082eee3-266a-45d5-8911-a2d735e5c9c7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:16.129241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9082eee3-266a-45d5-8911-a2d735e5c9c7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:16.210641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:16.649341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9082eee3-266a-45d5-8911-a2d735e5c9c7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:16.664011 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9082eee3-266a-45d5-8911-a2d735e5c9c7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.577611 Aug 23 18:14:16.664693 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2234/4599] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:16 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:16.689233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:16.691581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:16.700107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:16.726499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:16.727318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:16.735410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:16.736572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:16.737213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:16.737806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:16.823973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:16.824476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:16.826697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:16.827172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lazy-loading 'fault' on Instance uuid c3b668ab-533f-4dca-8ebe-a622745ec9f6 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:14:16.945461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:16.964046 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-04bf7195-a0f5-4992-af4a-2d33ba9b8255 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1308 microversion: 2.1 time: 0.289488 Aug 23 18:14:16.965715 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2235/4600] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:16 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1308 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:16.993859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-981920bf-03b4-4fe5-9f00-b3e5dad03825 req-7cb508d0-8945-4817-86eb-cd8440029ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3b668ab-533f-4dca-8ebe-a622745ec9f6", "name": "network-vif-deleted", "tag": "7c5d205a-7b37-4b4f-af1b-6529f04a4ea5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:17.016171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-981920bf-03b4-4fe5-9f00-b3e5dad03825 req-7cb508d0-8945-4817-86eb-cd8440029ff8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:17.018245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-981920bf-03b4-4fe5-9f00-b3e5dad03825 req-7cb508d0-8945-4817-86eb-cd8440029ff8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:17.020245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-981920bf-03b4-4fe5-9f00-b3e5dad03825 req-7cb508d0-8945-4817-86eb-cd8440029ff8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:17.046518 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-981920bf-03b4-4fe5-9f00-b3e5dad03825 req-7cb508d0-8945-4817-86eb-cd8440029ff8 service nova] Creating event network-vif-deleted:7c5d205a-7b37-4b4f-af1b-6529f04a4ea5 for instance c3b668ab-533f-4dca-8ebe-a622745ec9f6 on n-h1-850468-16 Aug 23 18:14:17.063412 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-981920bf-03b4-4fe5-9f00-b3e5dad03825 req-7cb508d0-8945-4817-86eb-cd8440029ff8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094567 Aug 23 18:14:17.067945 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2236/4601] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:14:17.081235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c48017e-a63e-4cfc-b404-614c0195a442 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:17.083274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1c48017e-a63e-4cfc-b404-614c0195a442 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:17.092704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c48017e-a63e-4cfc-b404-614c0195a442 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:17.093374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c48017e-a63e-4cfc-b404-614c0195a442 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:17.094099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c48017e-a63e-4cfc-b404-614c0195a442 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:17.095021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c48017e-a63e-4cfc-b404-614c0195a442 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:17.095633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c48017e-a63e-4cfc-b404-614c0195a442 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:17.096208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c48017e-a63e-4cfc-b404-614c0195a442 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:17.172888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1c48017e-a63e-4cfc-b404-614c0195a442 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:17.181040 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c48017e-a63e-4cfc-b404-614c0195a442 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1272 microversion: 2.1 time: 0.111453 Aug 23 18:14:17.182009 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2237/4602] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:17 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1272 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:17.202068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:17.202941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:17.209376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:17.210085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:17.210875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:17.211730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:17.212342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:17.212916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:17.269272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:17.269978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:17.275714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:17.277200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lazy-loading 'fault' on Instance uuid 06c846eb-9fa4-4156-9fd7-44976362c45f {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:14:17.351181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e28ffa24-654c-46c6-a41e-bacb4534df3b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:17.357835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2380358bc6a7496ead343b351bce816d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd335c62baa6846ff86d9b1c2941c4d56', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:17.372171 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c2b044a0-868a-473a-8645-ca96328ad0dd tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 200 len: 1305 microversion: 2.1 time: 0.175968 Aug 23 18:14:17.372837 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2238/4603] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:17 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 1305 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:17.380840 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e28ffa24-654c-46c6-a41e-bacb4534df3b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1306 microversion: 2.1 time: 1.535008 Aug 23 18:14:17.384909 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2366/4604] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:15 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1306 bytes in 1540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:17.392289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dffe548e-fe07-4e59-9c22-ef3aef034699 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-556475746", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dffe548e-fe07-4e59-9c22-ef3aef034699 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 172 Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-556475746", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-556475746', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '597d3f38-9c5d-451f-81bf-3e3fa931aa6a'}]}}} Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi -1 Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:14:17.398592 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Aug 23 18:14:17.407933 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:17.412676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dffe548e-fe07-4e59-9c22-ef3aef034699 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:17.412676 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dffe548e-fe07-4e59-9c22-ef3aef034699 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.032525 Aug 23 18:14:17.413315 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2239/4605] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:17 2022] POST /compute/v2.1/servers => generated 145 bytes in 40 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:14:17.423678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0af5bc79-f052-4e7d-96c7-0bc3adf6c48b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:17.424314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0af5bc79-f052-4e7d-96c7-0bc3adf6c48b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:17.431984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0af5bc79-f052-4e7d-96c7-0bc3adf6c48b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:17.432685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0af5bc79-f052-4e7d-96c7-0bc3adf6c48b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:17.433232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0af5bc79-f052-4e7d-96c7-0bc3adf6c48b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:17.434173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0af5bc79-f052-4e7d-96c7-0bc3adf6c48b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:17.434667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0af5bc79-f052-4e7d-96c7-0bc3adf6c48b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:17.435277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0af5bc79-f052-4e7d-96c7-0bc3adf6c48b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:17.755229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0af5bc79-f052-4e7d-96c7-0bc3adf6c48b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:17.766395 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0af5bc79-f052-4e7d-96c7-0bc3adf6c48b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.348123 Aug 23 18:14:17.783689 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2367/4606] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:17 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:17.789896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ebbafd02-7c2c-4063-9eff-41063689c1cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:17.790582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ebbafd02-7c2c-4063-9eff-41063689c1cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:17.799749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebbafd02-7c2c-4063-9eff-41063689c1cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:17.802764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebbafd02-7c2c-4063-9eff-41063689c1cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:17.802764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebbafd02-7c2c-4063-9eff-41063689c1cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:17.802764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebbafd02-7c2c-4063-9eff-41063689c1cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:17.802764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebbafd02-7c2c-4063-9eff-41063689c1cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:17.802764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebbafd02-7c2c-4063-9eff-41063689c1cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:17.956292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ebbafd02-7c2c-4063-9eff-41063689c1cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:17.989467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:17.990669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:18.003756 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ebbafd02-7c2c-4063-9eff-41063689c1cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.218657 Aug 23 18:14:18.004348 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2240/4607] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:17 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:18.037369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.037594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.038087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.042785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.046343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.047613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.114271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec69e650-2782-4c50-9bc0-bf11e9572b7a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2119314217", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:18.132691 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-ec69e650-2782-4c50-9bc0-bf11e9572b7a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec69e650-2782-4c50-9bc0-bf11e9572b7a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 216 Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2119314217", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2119314217', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._validate_network_id( Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.134288 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:18.138775 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.138775 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:18.138775 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:18.138775 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:18.138775 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:18.138775 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:18.138775 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Aug 23 18:14:18.138775 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.148843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec69e650-2782-4c50-9bc0-bf11e9572b7a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:18.151865 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec69e650-2782-4c50-9bc0-bf11e9572b7a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.041017 Aug 23 18:14:18.155440 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2241/4608] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:18 2022] POST /compute/v2.1/servers => generated 123 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:14:18.163210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.163994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.164167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6634aaaf-2311-4dd5-8e73-182cd873aee1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:18.164813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.165100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6634aaaf-2311-4dd5-8e73-182cd873aee1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:18.165326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lazy-loading 'fault' on Instance uuid c3b668ab-533f-4dca-8ebe-a622745ec9f6 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:14:18.193978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6634aaaf-2311-4dd5-8e73-182cd873aee1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.196185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6634aaaf-2311-4dd5-8e73-182cd873aee1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.197390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6634aaaf-2311-4dd5-8e73-182cd873aee1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.222662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6634aaaf-2311-4dd5-8e73-182cd873aee1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.225848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6634aaaf-2311-4dd5-8e73-182cd873aee1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.226369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6634aaaf-2311-4dd5-8e73-182cd873aee1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.319740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9247aeda1a84edd9408d95a6e9290cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e278101a495492392fa362c67532636', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:18.373959 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2199ac4f-f2c5-418f-80ae-6480fa1ea478 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 200 len: 1308 microversion: 2.1 time: 0.359039 Aug 23 18:14:18.374640 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2368/4609] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:17 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 1308 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:18.408290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f415ce6-5056-44ad-8e06-8ea35eb9fe5b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:18.410643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4f415ce6-5056-44ad-8e06-8ea35eb9fe5b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:18.428594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f415ce6-5056-44ad-8e06-8ea35eb9fe5b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.433345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f415ce6-5056-44ad-8e06-8ea35eb9fe5b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.433870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f415ce6-5056-44ad-8e06-8ea35eb9fe5b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.439840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f415ce6-5056-44ad-8e06-8ea35eb9fe5b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.440733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f415ce6-5056-44ad-8e06-8ea35eb9fe5b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.442068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6634aaaf-2311-4dd5-8e73-182cd873aee1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:18.442501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f415ce6-5056-44ad-8e06-8ea35eb9fe5b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.453078 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6634aaaf-2311-4dd5-8e73-182cd873aee1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.293515 Aug 23 18:14:18.453676 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2242/4610] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:18 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:18.458127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-57798259-566e-43fb-b9ff-be3d63efd6df tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:18.459046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-57798259-566e-43fb-b9ff-be3d63efd6df tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:18.466416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57798259-566e-43fb-b9ff-be3d63efd6df tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.467156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57798259-566e-43fb-b9ff-be3d63efd6df tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.469252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57798259-566e-43fb-b9ff-be3d63efd6df tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.470133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57798259-566e-43fb-b9ff-be3d63efd6df tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.474956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57798259-566e-43fb-b9ff-be3d63efd6df tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.475817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57798259-566e-43fb-b9ff-be3d63efd6df tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.505559 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-57798259-566e-43fb-b9ff-be3d63efd6df tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-57798259-566e-43fb-b9ff-be3d63efd6df tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f HTTP/1.1 Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '06c846eb-9fa4-4156-9fd7-44976362c45f'} Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:18.507470 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.512529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:18.512529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:18.512529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:18.512529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:18.512529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:18.512529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.512529 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.516058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-57798259-566e-43fb-b9ff-be3d63efd6df tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:18.519266 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-57798259-566e-43fb-b9ff-be3d63efd6df tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 404 len: 111 microversion: 2.1 time: 0.064617 Aug 23 18:14:18.527501 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2243/4611] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:18 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:18.532587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1504094e-181b-49b0-820a-b1615820848c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:18.533514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1504094e-181b-49b0-820a-b1615820848c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:18.539933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1504094e-181b-49b0-820a-b1615820848c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.540745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1504094e-181b-49b0-820a-b1615820848c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.541525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1504094e-181b-49b0-820a-b1615820848c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.542510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1504094e-181b-49b0-820a-b1615820848c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.543213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1504094e-181b-49b0-820a-b1615820848c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.543863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1504094e-181b-49b0-820a-b1615820848c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.705210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4f415ce6-5056-44ad-8e06-8ea35eb9fe5b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:18.719523 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4f415ce6-5056-44ad-8e06-8ea35eb9fe5b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1272 microversion: 2.1 time: 0.322780 Aug 23 18:14:18.720728 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2369/4612] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:18 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1272 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:18.725476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d307f0ef-62be-485c-9354-b12abd980664 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:18.733531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d307f0ef-62be-485c-9354-b12abd980664 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:18.750783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d307f0ef-62be-485c-9354-b12abd980664 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.751677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d307f0ef-62be-485c-9354-b12abd980664 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.752302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d307f0ef-62be-485c-9354-b12abd980664 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.753196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d307f0ef-62be-485c-9354-b12abd980664 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.753822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d307f0ef-62be-485c-9354-b12abd980664 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.754618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d307f0ef-62be-485c-9354-b12abd980664 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.848327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1504094e-181b-49b0-820a-b1615820848c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:18.859359 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1504094e-181b-49b0-820a-b1615820848c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1294 microversion: 2.1 time: 0.330409 Aug 23 18:14:18.861783 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2244/4613] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:18 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1294 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:18.867367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2bbda555-7507-4383-bc1b-df3ed7788b37 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:18.868469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2bbda555-7507-4383-bc1b-df3ed7788b37 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:18.882503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bbda555-7507-4383-bc1b-df3ed7788b37 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.883121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bbda555-7507-4383-bc1b-df3ed7788b37 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.883864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bbda555-7507-4383-bc1b-df3ed7788b37 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.884636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bbda555-7507-4383-bc1b-df3ed7788b37 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.885946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bbda555-7507-4383-bc1b-df3ed7788b37 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.886744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bbda555-7507-4383-bc1b-df3ed7788b37 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.918876 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2bbda555-7507-4383-bc1b-df3ed7788b37 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2bbda555-7507-4383-bc1b-df3ed7788b37 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f HTTP/1.1 Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '06c846eb-9fa4-4156-9fd7-44976362c45f'} Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:18.927095 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:18.932369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.932369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.932369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:18.932369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.932369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:18.932369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:18.932369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:18.932369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:18.932369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:18.932369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.932369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.936322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2bbda555-7507-4383-bc1b-df3ed7788b37 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:18.938098 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2bbda555-7507-4383-bc1b-df3ed7788b37 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 404 len: 111 microversion: 2.1 time: 0.075033 Aug 23 18:14:18.941189 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2245/4614] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:14:18 2022] DELETE /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:18.953704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7bdbdfc8-fda9-4fe7-a554-40abc033dfb3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:18.954380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7bdbdfc8-fda9-4fe7-a554-40abc033dfb3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 06c846eb-9fa4-4156-9fd7-44976362c45f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:18.970575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bdbdfc8-fda9-4fe7-a554-40abc033dfb3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.971228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bdbdfc8-fda9-4fe7-a554-40abc033dfb3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.971737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bdbdfc8-fda9-4fe7-a554-40abc033dfb3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.972559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bdbdfc8-fda9-4fe7-a554-40abc033dfb3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:18.973878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bdbdfc8-fda9-4fe7-a554-40abc033dfb3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:18.974585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bdbdfc8-fda9-4fe7-a554-40abc033dfb3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:18.996003 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-7bdbdfc8-fda9-4fe7-a554-40abc033dfb3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7bdbdfc8-fda9-4fe7-a554-40abc033dfb3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f HTTP/1.1 Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '06c846eb-9fa4-4156-9fd7-44976362c45f'} Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:18.997941 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.004254 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.004254 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.004254 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.004254 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:19.004254 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:19.004254 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. Aug 23 18:14:19.004254 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.004254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7bdbdfc8-fda9-4fe7-a554-40abc033dfb3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 06c846eb-9fa4-4156-9fd7-44976362c45f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:19.004254 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7bdbdfc8-fda9-4fe7-a554-40abc033dfb3 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f" status: 404 len: 111 microversion: 2.1 time: 0.053296 Aug 23 18:14:19.004254 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2246/4615] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:18 2022] GET /compute/v2.1/servers/06c846eb-9fa4-4156-9fd7-44976362c45f => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:19.008619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ea186e19-521e-4ee1-9fbc-1d133ec76341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:19.010137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ea186e19-521e-4ee1-9fbc-1d133ec76341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:19.017833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea186e19-521e-4ee1-9fbc-1d133ec76341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.018330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea186e19-521e-4ee1-9fbc-1d133ec76341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.023702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea186e19-521e-4ee1-9fbc-1d133ec76341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.025218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea186e19-521e-4ee1-9fbc-1d133ec76341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.027316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea186e19-521e-4ee1-9fbc-1d133ec76341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.027750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea186e19-521e-4ee1-9fbc-1d133ec76341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.046933 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-ea186e19-521e-4ee1-9fbc-1d133ec76341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ea186e19-521e-4ee1-9fbc-1d133ec76341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 HTTP/1.1 Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'a13e98f6-a5db-421f-abac-17f208932ac9'} Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:19.049731 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:19.053688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:14:19.053688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.053688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.053688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.053688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.053688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.053688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.053688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:19.053688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:19.053688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:14:19.053688 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.055942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ea186e19-521e-4ee1-9fbc-1d133ec76341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:19.057036 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ea186e19-521e-4ee1-9fbc-1d133ec76341 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 404 len: 111 microversion: 2.1 time: 0.052652 Aug 23 18:14:19.058055 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2247/4616] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:14:19 2022] DELETE /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:19.077747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b5efa07f-7c49-4380-a0c8-5835ae6b37e4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:19.078389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b5efa07f-7c49-4380-a0c8-5835ae6b37e4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: a13e98f6-a5db-421f-abac-17f208932ac9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:19.098115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5efa07f-7c49-4380-a0c8-5835ae6b37e4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.098698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5efa07f-7c49-4380-a0c8-5835ae6b37e4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.099150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5efa07f-7c49-4380-a0c8-5835ae6b37e4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.099890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5efa07f-7c49-4380-a0c8-5835ae6b37e4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.100355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5efa07f-7c49-4380-a0c8-5835ae6b37e4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.100997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5efa07f-7c49-4380-a0c8-5835ae6b37e4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.126245 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-b5efa07f-7c49-4380-a0c8-5835ae6b37e4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b5efa07f-7c49-4380-a0c8-5835ae6b37e4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 HTTP/1.1 Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'a13e98f6-a5db-421f-abac-17f208932ac9'} Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.138567 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.146224 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.146224 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.146224 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.146224 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:19.146224 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:19.146224 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. Aug 23 18:14:19.146224 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.146224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b5efa07f-7c49-4380-a0c8-5835ae6b37e4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance a13e98f6-a5db-421f-abac-17f208932ac9 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:19.146224 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b5efa07f-7c49-4380-a0c8-5835ae6b37e4 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9" status: 404 len: 111 microversion: 2.1 time: 0.070521 Aug 23 18:14:19.146224 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2248/4617] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:19 2022] GET /compute/v2.1/servers/a13e98f6-a5db-421f-abac-17f208932ac9 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:19.148182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-cf5a0c8e-0c59-4b13-b6f0-d2e3604b7aaf req-f323fb6c-512c-4590-a2cb-e98c157fc55d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c846eb-9fa4-4156-9fd7-44976362c45f", "name": "network-vif-deleted", "tag": "a38ad55b-08c4-42f1-9429-6943dea1b607"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:19.165651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cf5a0c8e-0c59-4b13-b6f0-d2e3604b7aaf req-f323fb6c-512c-4590-a2cb-e98c157fc55d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.166438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cf5a0c8e-0c59-4b13-b6f0-d2e3604b7aaf req-f323fb6c-512c-4590-a2cb-e98c157fc55d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.167947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cf5a0c8e-0c59-4b13-b6f0-d2e3604b7aaf req-f323fb6c-512c-4590-a2cb-e98c157fc55d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.189594 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-cf5a0c8e-0c59-4b13-b6f0-d2e3604b7aaf req-f323fb6c-512c-4590-a2cb-e98c157fc55d service nova] Creating event network-vif-deleted:a38ad55b-08c4-42f1-9429-6943dea1b607 for instance 06c846eb-9fa4-4156-9fd7-44976362c45f on n-h1-850468-16 Aug 23 18:14:19.210180 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-cf5a0c8e-0c59-4b13-b6f0-d2e3604b7aaf req-f323fb6c-512c-4590-a2cb-e98c157fc55d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069502 Aug 23 18:14:19.211743 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2249/4618] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:14:19.221101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c5bf151-6ba0-4777-99ba-a3249d944763 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:19.222260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c5bf151-6ba0-4777-99ba-a3249d944763 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:19.230008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c5bf151-6ba0-4777-99ba-a3249d944763 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.230510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c5bf151-6ba0-4777-99ba-a3249d944763 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.230988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c5bf151-6ba0-4777-99ba-a3249d944763 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.231698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c5bf151-6ba0-4777-99ba-a3249d944763 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.232153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c5bf151-6ba0-4777-99ba-a3249d944763 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.232572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c5bf151-6ba0-4777-99ba-a3249d944763 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.249667 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-4c5bf151-6ba0-4777-99ba-a3249d944763 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c5bf151-6ba0-4777-99ba-a3249d944763 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c HTTP/1.1 Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '210941bf-76d0-4c84-a56c-f3b4e6679e8c'} Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:19.251538 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:19.255662 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:14:19.255662 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.255662 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.255662 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.255662 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.255662 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.255662 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.255662 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:19.255662 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:19.255662 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:14:19.255662 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.257216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c5bf151-6ba0-4777-99ba-a3249d944763 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:19.257571 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c5bf151-6ba0-4777-99ba-a3249d944763 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 404 len: 111 microversion: 2.1 time: 0.044515 Aug 23 18:14:19.262217 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2250/4619] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:14:19 2022] DELETE /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:19.308494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ca0479df-3cc0-4076-be68-e3c0f71e0411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:19.309691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ca0479df-3cc0-4076-be68-e3c0f71e0411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 210941bf-76d0-4c84-a56c-f3b4e6679e8c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:19.325336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0479df-3cc0-4076-be68-e3c0f71e0411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.326465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0479df-3cc0-4076-be68-e3c0f71e0411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.329219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0479df-3cc0-4076-be68-e3c0f71e0411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.331557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0479df-3cc0-4076-be68-e3c0f71e0411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.333487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0479df-3cc0-4076-be68-e3c0f71e0411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.335222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0479df-3cc0-4076-be68-e3c0f71e0411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.358215 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-ca0479df-3cc0-4076-be68-e3c0f71e0411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ca0479df-3cc0-4076-be68-e3c0f71e0411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c HTTP/1.1 Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '210941bf-76d0-4c84-a56c-f3b4e6679e8c'} Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.367657 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.373317 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.373317 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.373317 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.373317 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:19.373317 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:19.373317 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. Aug 23 18:14:19.373317 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.375984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ca0479df-3cc0-4076-be68-e3c0f71e0411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 210941bf-76d0-4c84-a56c-f3b4e6679e8c could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:19.377677 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ca0479df-3cc0-4076-be68-e3c0f71e0411 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c" status: 404 len: 111 microversion: 2.1 time: 0.109188 Aug 23 18:14:19.381862 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2251/4620] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:19 2022] GET /compute/v2.1/servers/210941bf-76d0-4c84-a56c-f3b4e6679e8c => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:19.394466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a4cb06d9-d1fe-4ec1-a3b1-f2cd098d46ac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:19.395813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a4cb06d9-d1fe-4ec1-a3b1-f2cd098d46ac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:19.409901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4cb06d9-d1fe-4ec1-a3b1-f2cd098d46ac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.410482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4cb06d9-d1fe-4ec1-a3b1-f2cd098d46ac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.411070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4cb06d9-d1fe-4ec1-a3b1-f2cd098d46ac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.411886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4cb06d9-d1fe-4ec1-a3b1-f2cd098d46ac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.415499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4cb06d9-d1fe-4ec1-a3b1-f2cd098d46ac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.416840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4cb06d9-d1fe-4ec1-a3b1-f2cd098d46ac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.438264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d307f0ef-62be-485c-9354-b12abd980664 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:19.447576 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-a4cb06d9-d1fe-4ec1-a3b1-f2cd098d46ac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a4cb06d9-d1fe-4ec1-a3b1-f2cd098d46ac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 HTTP/1.1 Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'b77fc1af-38e5-484e-bdd0-8f4d4f2bb045'} Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:19.449487 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:19.453579 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:14:19.453579 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.453579 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.453579 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.453579 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.453579 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.453579 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.453579 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:19.453579 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:19.453579 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:14:19.453579 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.454231 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d307f0ef-62be-485c-9354-b12abd980664 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.731555 Aug 23 18:14:19.454231 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2370/4621] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:18 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:19.456430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a4cb06d9-d1fe-4ec1-a3b1-f2cd098d46ac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:19.457544 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a4cb06d9-d1fe-4ec1-a3b1-f2cd098d46ac tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 404 len: 111 microversion: 2.1 time: 0.073372 Aug 23 18:14:19.458945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9d968bb7-e522-4513-b351-97eadec79511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:19.461607 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2252/4622] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:14:19 2022] DELETE /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:19.462429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9d968bb7-e522-4513-b351-97eadec79511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] [instance: c3b668ab-533f-4dca-8ebe-a622745ec9f6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:19.467848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5cf58ff7-a618-457e-87fe-eb34188169e7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:19.468824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5cf58ff7-a618-457e-87fe-eb34188169e7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: b77fc1af-38e5-484e-bdd0-8f4d4f2bb045] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:19.475848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cf58ff7-a618-457e-87fe-eb34188169e7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.476716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cf58ff7-a618-457e-87fe-eb34188169e7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.477421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cf58ff7-a618-457e-87fe-eb34188169e7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.478367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cf58ff7-a618-457e-87fe-eb34188169e7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.482152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d968bb7-e522-4513-b351-97eadec79511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.482721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d968bb7-e522-4513-b351-97eadec79511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.483208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d968bb7-e522-4513-b351-97eadec79511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.483879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d968bb7-e522-4513-b351-97eadec79511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.484525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d968bb7-e522-4513-b351-97eadec79511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.485269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d968bb7-e522-4513-b351-97eadec79511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.487948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cf58ff7-a618-457e-87fe-eb34188169e7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.488662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cf58ff7-a618-457e-87fe-eb34188169e7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.506349 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-5cf58ff7-a618-457e-87fe-eb34188169e7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5cf58ff7-a618-457e-87fe-eb34188169e7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 HTTP/1.1 Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'b77fc1af-38e5-484e-bdd0-8f4d4f2bb045'} Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.508388 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.512309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.512309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.512309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.512309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:19.512309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:19.512309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. Aug 23 18:14:19.512309 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.512730 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-9d968bb7-e522-4513-b351-97eadec79511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] HTTP exception thrown: Instance c3b668ab-533f-4dca-8ebe-a622745ec9f6 could not be found. Aug 23 18:14:19.514886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5cf58ff7-a618-457e-87fe-eb34188169e7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:19.516044 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5cf58ff7-a618-457e-87fe-eb34188169e7 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045" status: 404 len: 111 microversion: 2.1 time: 0.053386 Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9d968bb7-e522-4513-b351-97eadec79511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Request method failure captured: Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 HTTP/1.1 Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRfRrC6abzuROug8r882K5DvWKG2RBxPXdElUYKqDbKsiy1k2y9xz_1U81Ew6FS4QqwBGRx5-GQmCLy2pXtEGWsLjg9Jdx5y2661MhdwHcIY4nxaARYzjwlEcyceUsEyoNbI40AaF19KbkJByzmH6T3JS2HuFRs3MUIkWAM0vh_rJaY Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 9e278101a495492392fa362c67532636 Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1826063488 Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_9e278101a495492392fa362c67532636"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9e278101a495492392fa362c67532636"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/9e278101a495492392fa362c67532636"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/9e278101a495492392fa362c67532636"}]}] Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-VolumesSnapshotTestJSON-1826063488 Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 9e278101a495492392fa362c67532636 Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1826063488 Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-VolumesSnapshotTestJSON-1826063488-project Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: e9247aeda1a84edd9408d95a6e9290cd Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-VolumesSnapshotTestJSON-1826063488-project Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance c3b668ab-533f-4dca-8ebe-a622745ec9f6 could not be found. Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'c3b668ab-533f-4dca-8ebe-a622745ec9f6'} Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3b668ab-533f-4dca-8ebe-a622745ec9f6 could not be found. Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3b668ab-533f-4dca-8ebe-a622745ec9f6 could not be found. Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.520118 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.524693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.524693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.524693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.524693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:19.524693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:19.524693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3b668ab-533f-4dca-8ebe-a622745ec9f6 could not be found. Aug 23 18:14:19.524693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.527134 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2253/4623] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:19 2022] GET /compute/v2.1/servers/b77fc1af-38e5-484e-bdd0-8f4d4f2bb045 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:19.527294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9d968bb7-e522-4513-b351-97eadec79511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] Returning 404 to user: Instance c3b668ab-533f-4dca-8ebe-a622745ec9f6 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:19.527294 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9d968bb7-e522-4513-b351-97eadec79511 tempest-VolumesSnapshotTestJSON-1826063488 tempest-VolumesSnapshotTestJSON-1826063488-project] 10.222.0.61 "GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6" status: 404 len: 111 microversion: 2.1 time: 0.066684 Aug 23 18:14:19.530825 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2371/4624] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:19 2022] GET /compute/v2.1/servers/c3b668ab-533f-4dca-8ebe-a622745ec9f6 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:19.535753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-72a92cb1-a61e-4fb6-b9f6-f4b28a472a84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:19.537042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-72a92cb1-a61e-4fb6-b9f6-f4b28a472a84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: e7a4ffd8-f481-4500-a171-bcca6c2cb59a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:19.547855 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-72a92cb1-a61e-4fb6-b9f6-f4b28a472a84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-72a92cb1-a61e-4fb6-b9f6-f4b28a472a84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a HTTP/1.1 Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'e7a4ffd8-f481-4500-a171-bcca6c2cb59a'} Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.549906 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.553785 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.553785 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.553785 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.553785 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.553785 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:19.553785 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:19.553785 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:14:19.553785 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.555791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-72a92cb1-a61e-4fb6-b9f6-f4b28a472a84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:19.557627 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-72a92cb1-a61e-4fb6-b9f6-f4b28a472a84 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a" status: 404 len: 111 microversion: 2.1 time: 0.028214 Aug 23 18:14:19.558421 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2254/4625] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:14:19 2022] DELETE /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:19.570460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1242630-94cc-4df7-9a32-729b39972651 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:19.571264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d1242630-94cc-4df7-9a32-729b39972651 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: e7a4ffd8-f481-4500-a171-bcca6c2cb59a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:19.581945 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-d1242630-94cc-4df7-9a32-729b39972651 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1242630-94cc-4df7-9a32-729b39972651 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a HTTP/1.1 Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'e7a4ffd8-f481-4500-a171-bcca6c2cb59a'} Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:19.585258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:19.590021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:19.590021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:19.590021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:19.590021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. Aug 23 18:14:19.590021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:19.590021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1242630-94cc-4df7-9a32-729b39972651 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance e7a4ffd8-f481-4500-a171-bcca6c2cb59a could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:19.590021 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d1242630-94cc-4df7-9a32-729b39972651 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a" status: 404 len: 111 microversion: 2.1 time: 0.025476 Aug 23 18:14:19.590021 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2372/4626] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:19 2022] GET /compute/v2.1/servers/e7a4ffd8-f481-4500-a171-bcca6c2cb59a => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:19.716223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c152abf9-d552-4cab-a60e-7648ba400b6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1618740454", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "key_name": "tempest-key-218178248", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:19.741185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-535c8645-a750-40d7-9e4a-0bfc58266c0f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:19.741975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-535c8645-a750-40d7-9e4a-0bfc58266c0f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:19.764793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-535c8645-a750-40d7-9e4a-0bfc58266c0f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.766034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-535c8645-a750-40d7-9e4a-0bfc58266c0f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.768592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-535c8645-a750-40d7-9e4a-0bfc58266c0f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.769591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-535c8645-a750-40d7-9e4a-0bfc58266c0f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:19.771363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-535c8645-a750-40d7-9e4a-0bfc58266c0f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:19.772773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-535c8645-a750-40d7-9e4a-0bfc58266c0f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:19.833534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-c152abf9-d552-4cab-a60e-7648ba400b6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] validate_networks() for [('597d3f38-9c5d-451f-81bf-3e3fa931aa6a', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:14:19.941405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-535c8645-a750-40d7-9e4a-0bfc58266c0f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:19.958367 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-535c8645-a750-40d7-9e4a-0bfc58266c0f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1278 microversion: 2.1 time: 0.221101 Aug 23 18:14:19.964479 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2373/4627] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:19 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1278 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:19.988679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-24d41c1f-df65-4fd2-8036-eb02bc07f864 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:19.990727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-24d41c1f-df65-4fd2-8036-eb02bc07f864 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:20.011963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24d41c1f-df65-4fd2-8036-eb02bc07f864 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:20.012991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24d41c1f-df65-4fd2-8036-eb02bc07f864 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:20.013634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24d41c1f-df65-4fd2-8036-eb02bc07f864 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:20.014640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24d41c1f-df65-4fd2-8036-eb02bc07f864 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:20.016852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24d41c1f-df65-4fd2-8036-eb02bc07f864 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:20.017539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24d41c1f-df65-4fd2-8036-eb02bc07f864 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:20.305258 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-c152abf9-d552-4cab-a60e-7648ba400b6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Invalid key_name provided. Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c152abf9-d552-4cab-a60e-7648ba400b6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 246 Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1618740454", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "key_name": "tempest-key-218178248", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid key_name provided. Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1618740454', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'key_name': 'tempest-key-218178248', 'networks': [{'uuid': '597d3f38-9c5d-451f-81bf-3e3fa931aa6a'}]}}} Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1076, in _validate_and_build_base_options Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-218178248 not found for user f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:20.308266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c152abf9-d552-4cab-a60e-7648ba400b6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Invalid key_name provided. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:20.313292 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c152abf9-d552-4cab-a60e-7648ba400b6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.602002 Aug 23 18:14:20.317909 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2255/4628] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:19 2022] POST /compute/v2.1/servers => generated 70 bytes in 610 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 18:14:20.334323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1decf866-c7a7-49bd-8be5-7e4c6bf9e854 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:20.335029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1decf866-c7a7-49bd-8be5-7e4c6bf9e854 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:20.342350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:20.359736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1decf866-c7a7-49bd-8be5-7e4c6bf9e854 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:20.361797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1decf866-c7a7-49bd-8be5-7e4c6bf9e854 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:20.362433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1decf866-c7a7-49bd-8be5-7e4c6bf9e854 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:20.363953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1decf866-c7a7-49bd-8be5-7e4c6bf9e854 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:20.365876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1decf866-c7a7-49bd-8be5-7e4c6bf9e854 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:20.369655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1decf866-c7a7-49bd-8be5-7e4c6bf9e854 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:20.684906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1decf866-c7a7-49bd-8be5-7e4c6bf9e854 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:20.702659 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1decf866-c7a7-49bd-8be5-7e4c6bf9e854 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.381560 Aug 23 18:14:20.706705 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2256/4629] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:20 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:20.727290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b79f445-2411-491f-8fae-d270a0808a6b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:20.728276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7b79f445-2411-491f-8fae-d270a0808a6b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:20.744979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b79f445-2411-491f-8fae-d270a0808a6b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:20.746917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b79f445-2411-491f-8fae-d270a0808a6b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:20.748123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b79f445-2411-491f-8fae-d270a0808a6b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:20.749689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b79f445-2411-491f-8fae-d270a0808a6b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:20.751635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b79f445-2411-491f-8fae-d270a0808a6b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:20.753005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b79f445-2411-491f-8fae-d270a0808a6b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:21.235458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7b79f445-2411-491f-8fae-d270a0808a6b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:21.261484 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7b79f445-2411-491f-8fae-d270a0808a6b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.539426 Aug 23 18:14:21.274617 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2257/4630] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:20 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:21.274617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9929f134-e15c-4c47-bd61-8af0e22eef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:21.277827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9929f134-e15c-4c47-bd61-8af0e22eef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:21.296032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9929f134-e15c-4c47-bd61-8af0e22eef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:21.297346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9929f134-e15c-4c47-bd61-8af0e22eef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:21.301192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9929f134-e15c-4c47-bd61-8af0e22eef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:21.301797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9929f134-e15c-4c47-bd61-8af0e22eef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:21.302280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9929f134-e15c-4c47-bd61-8af0e22eef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:21.302893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9929f134-e15c-4c47-bd61-8af0e22eef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:21.651346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9929f134-e15c-4c47-bd61-8af0e22eef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:21.660051 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9929f134-e15c-4c47-bd61-8af0e22eef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1320 microversion: 2.1 time: 0.393819 Aug 23 18:14:21.661841 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2258/4631] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:21 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1320 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:21.669817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c1eb3af4-8225-4771-8f03-fa97acdb2e4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1852517221", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:21.806091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-24d41c1f-df65-4fd2-8036-eb02bc07f864 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:21.829073 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-24d41c1f-df65-4fd2-8036-eb02bc07f864 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1294 microversion: 2.1 time: 1.861995 Aug 23 18:14:21.829800 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2374/4632] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:19 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1294 bytes in 1865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:21.912040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.security_group_api [None req-c1eb3af4-8225-4771-8f03-fa97acdb2e4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Neutron security group does_not_exist not found {{(pid=128807) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Aug 23 18:14:21.913062 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-c1eb3af4-8225-4771-8f03-fa97acdb2e4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c1eb3af4-8225-4771-8f03-fa97acdb2e4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 258 Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1852517221", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: exception: Unable to find security_group with name or id 'does_not_exist' Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1852517221', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '597d3f38-9c5d-451f-81bf-3e3fa931aa6a'}]}}} Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Aug 23 18:14:21.965350 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 197, in wrapper Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2193, in create Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._create_instance( Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1669, in _create_instance Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1061, in _validate_and_build_base_options Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 508, in _check_requested_secgroups Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:21.969561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c1eb3af4-8225-4771-8f03-fa97acdb2e4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:21.973224 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c1eb3af4-8225-4771-8f03-fa97acdb2e4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.304487 Aug 23 18:14:21.973224 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2259/4633] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:21 2022] POST /compute/v2.1/servers => generated 106 bytes in 306 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:14:21.978620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-101c5c9e-c903-4bb1-b2d2-9412baf6adca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:21.979857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-101c5c9e-c903-4bb1-b2d2-9412baf6adca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:22.018800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-101c5c9e-c903-4bb1-b2d2-9412baf6adca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:22.019404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-101c5c9e-c903-4bb1-b2d2-9412baf6adca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:22.025025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-101c5c9e-c903-4bb1-b2d2-9412baf6adca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:22.026435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-101c5c9e-c903-4bb1-b2d2-9412baf6adca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:22.030853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-101c5c9e-c903-4bb1-b2d2-9412baf6adca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:22.031535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-101c5c9e-c903-4bb1-b2d2-9412baf6adca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:22.686133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:22.691133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3015db07-4b54-49af-90ad-c2f8dfccb779 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:22.692130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3015db07-4b54-49af-90ad-c2f8dfccb779 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:22.703873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3015db07-4b54-49af-90ad-c2f8dfccb779 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:22.705284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3015db07-4b54-49af-90ad-c2f8dfccb779 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:22.707618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3015db07-4b54-49af-90ad-c2f8dfccb779 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:22.710632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3015db07-4b54-49af-90ad-c2f8dfccb779 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:22.711197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3015db07-4b54-49af-90ad-c2f8dfccb779 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:22.712773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3015db07-4b54-49af-90ad-c2f8dfccb779 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:22.778583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-101c5c9e-c903-4bb1-b2d2-9412baf6adca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:22.795439 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-101c5c9e-c903-4bb1-b2d2-9412baf6adca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.822076 Aug 23 18:14:22.795963 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2375/4634] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:21 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:22.821049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-738926e5-10c9-4acd-b744-a529411db283 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:22.821721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-738926e5-10c9-4acd-b744-a529411db283 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:22.824324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:22.841161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-738926e5-10c9-4acd-b744-a529411db283 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:22.841671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-738926e5-10c9-4acd-b744-a529411db283 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:22.842118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-738926e5-10c9-4acd-b744-a529411db283 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:22.846800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-738926e5-10c9-4acd-b744-a529411db283 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:22.847319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-738926e5-10c9-4acd-b744-a529411db283 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:22.847770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-738926e5-10c9-4acd-b744-a529411db283 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:23.087534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=20 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:23.315119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3015db07-4b54-49af-90ad-c2f8dfccb779 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:23.328827 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3015db07-4b54-49af-90ad-c2f8dfccb779 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1320 microversion: 2.1 time: 0.639588 Aug 23 18:14:23.330322 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2260/4635] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:22 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1320 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:23.356011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-758ae501-1c4b-4b4f-a649-bcede42b66d3 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:23.356681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-758ae501-1c4b-4b4f-a649-bcede42b66d3 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:23.370488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-758ae501-1c4b-4b4f-a649-bcede42b66d3 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:23.371081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-758ae501-1c4b-4b4f-a649-bcede42b66d3 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:23.371522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-758ae501-1c4b-4b4f-a649-bcede42b66d3 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:23.376456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-758ae501-1c4b-4b4f-a649-bcede42b66d3 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:23.377037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-758ae501-1c4b-4b4f-a649-bcede42b66d3 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:23.377491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-758ae501-1c4b-4b4f-a649-bcede42b66d3 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:23.575345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-738926e5-10c9-4acd-b744-a529411db283 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:23.595058 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-738926e5-10c9-4acd-b744-a529411db283 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.779177 Aug 23 18:14:23.614903 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2376/4636] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:22 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:23.627217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5308edf-1d48-46fa-a192-1c2feafa2629 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:23.628405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e5308edf-1d48-46fa-a192-1c2feafa2629 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 786057fc-9170-4bb4-9645-8d52ae56f89c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:23.640239 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-e5308edf-1d48-46fa-a192-1c2feafa2629 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 786057fc-9170-4bb4-9645-8d52ae56f89c could not be found. Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5308edf-1d48-46fa-a192-1c2feafa2629 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/786057fc-9170-4bb4-9645-8d52ae56f89c HTTP/1.1 Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 786057fc-9170-4bb4-9645-8d52ae56f89c could not be found. Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '786057fc-9170-4bb4-9645-8d52ae56f89c'} Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 786057fc-9170-4bb4-9645-8d52ae56f89c could not be found. Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 786057fc-9170-4bb4-9645-8d52ae56f89c could not be found. Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:23.642104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:23.646020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:23.646020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:23.646020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:23.646020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:23.646020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:23.646020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:23.646020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 786057fc-9170-4bb4-9645-8d52ae56f89c could not be found. Aug 23 18:14:23.646020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:23.650440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5308edf-1d48-46fa-a192-1c2feafa2629 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 786057fc-9170-4bb4-9645-8d52ae56f89c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:23.651772 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e5308edf-1d48-46fa-a192-1c2feafa2629 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "DELETE /compute/v2.1/servers/786057fc-9170-4bb4-9645-8d52ae56f89c" status: 404 len: 111 microversion: 2.1 time: 0.033461 Aug 23 18:14:23.656990 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2377/4637] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:14:23 2022] DELETE /compute/v2.1/servers/786057fc-9170-4bb4-9645-8d52ae56f89c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:23.664297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1bd822b6-d7f6-4e85-9b12-921fe9075fc7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:23.665237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1bd822b6-d7f6-4e85-9b12-921fe9075fc7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:23.676591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bd822b6-d7f6-4e85-9b12-921fe9075fc7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:23.678374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bd822b6-d7f6-4e85-9b12-921fe9075fc7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:23.679321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bd822b6-d7f6-4e85-9b12-921fe9075fc7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:23.680945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bd822b6-d7f6-4e85-9b12-921fe9075fc7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:23.681696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bd822b6-d7f6-4e85-9b12-921fe9075fc7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:23.682948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bd822b6-d7f6-4e85-9b12-921fe9075fc7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:23.983546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-758ae501-1c4b-4b4f-a649-bcede42b66d3 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:23.992959 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-758ae501-1c4b-4b4f-a649-bcede42b66d3 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1294 microversion: 2.1 time: 0.660597 Aug 23 18:14:23.998228 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2261/4638] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:23 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1294 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:24.184056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1bd822b6-d7f6-4e85-9b12-921fe9075fc7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:24.207579 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1bd822b6-d7f6-4e85-9b12-921fe9075fc7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.535191 Aug 23 18:14:24.231302 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2378/4639] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:23 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:24.231827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1581a6ae-8e22-4482-b915-bd0b1e58ca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:24.232854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1581a6ae-8e22-4482-b915-bd0b1e58ca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:24.247375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1581a6ae-8e22-4482-b915-bd0b1e58ca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:24.248699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1581a6ae-8e22-4482-b915-bd0b1e58ca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:24.249570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1581a6ae-8e22-4482-b915-bd0b1e58ca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:24.269000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1581a6ae-8e22-4482-b915-bd0b1e58ca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:24.272613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1581a6ae-8e22-4482-b915-bd0b1e58ca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:24.273084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1581a6ae-8e22-4482-b915-bd0b1e58ca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:24.352752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c2db4cff-a16d-4348-9508-1c444df3866f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:24.354444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c2db4cff-a16d-4348-9508-1c444df3866f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:24.373472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2db4cff-a16d-4348-9508-1c444df3866f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:24.373472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2db4cff-a16d-4348-9508-1c444df3866f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:24.373472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2db4cff-a16d-4348-9508-1c444df3866f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:24.373472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2db4cff-a16d-4348-9508-1c444df3866f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:24.373472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2db4cff-a16d-4348-9508-1c444df3866f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:24.373472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2db4cff-a16d-4348-9508-1c444df3866f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:24.495025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:24.626777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1581a6ae-8e22-4482-b915-bd0b1e58ca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:24.630641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:24.644956 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1581a6ae-8e22-4482-b915-bd0b1e58ca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.419678 Aug 23 18:14:24.646513 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2262/4640] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:24 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:24.652704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-39b53082-04c8-4b92-82c3-2fef28c39ea3 req-0ebee399-73cd-4e1c-bc75-7901abe389b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "839bd8e1-c38c-4cb8-ac70-9f26284fe291", "tag": "76802691-863f-4d93-8a0a-b47bc6e65812"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:24.702068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-39b53082-04c8-4b92-82c3-2fef28c39ea3 req-0ebee399-73cd-4e1c-bc75-7901abe389b1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:24.705614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-39b53082-04c8-4b92-82c3-2fef28c39ea3 req-0ebee399-73cd-4e1c-bc75-7901abe389b1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:24.712641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-39b53082-04c8-4b92-82c3-2fef28c39ea3 req-0ebee399-73cd-4e1c-bc75-7901abe389b1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:24.746770 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-39b53082-04c8-4b92-82c3-2fef28c39ea3 req-0ebee399-73cd-4e1c-bc75-7901abe389b1 service nova] Creating event network-changed:76802691-863f-4d93-8a0a-b47bc6e65812 for instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 on n-h2-850468-16 Aug 23 18:14:24.755557 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-39b53082-04c8-4b92-82c3-2fef28c39ea3 req-0ebee399-73cd-4e1c-bc75-7901abe389b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106937 Aug 23 18:14:24.756767 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2263/4641] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:14:24.763243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6f07ffdd-22f1-46da-a642-631326d959cf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:24.768557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6f07ffdd-22f1-46da-a642-631326d959cf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Failed to fetch instance by id 9223372036854775808 {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 18:14:24.770127 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-6f07ffdd-22f1-46da-a642-631326d959cf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6f07ffdd-22f1-46da-a642-631326d959cf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 9223372036854775808 could not be found. Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '9223372036854775808'} Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:24.781236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:24.785065 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:24.785065 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:24.785065 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:24.785065 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Aug 23 18:14:24.785065 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:24.787003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6f07ffdd-22f1-46da-a642-631326d959cf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:24.788080 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6f07ffdd-22f1-46da-a642-631326d959cf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.030028 Aug 23 18:14:24.789198 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2264/4642] 10.222.0.61 () {58 vars in 1188 bytes} [Tue Aug 23 18:14:24 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:14:24.803648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8737c0d8-7025-43b6-80bc-3317beeba98b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:24.808548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8737c0d8-7025-43b6-80bc-3317beeba98b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:24.824808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8737c0d8-7025-43b6-80bc-3317beeba98b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:24.828028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8737c0d8-7025-43b6-80bc-3317beeba98b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:24.836433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8737c0d8-7025-43b6-80bc-3317beeba98b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:24.837603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8737c0d8-7025-43b6-80bc-3317beeba98b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:24.843604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8737c0d8-7025-43b6-80bc-3317beeba98b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:24.844073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8737c0d8-7025-43b6-80bc-3317beeba98b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:24.974150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c2db4cff-a16d-4348-9508-1c444df3866f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:24.994128 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c2db4cff-a16d-4348-9508-1c444df3866f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1320 microversion: 2.1 time: 0.637153 Aug 23 18:14:24.996535 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2379/4643] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:24 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1320 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:25.020633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cc90040b-3a23-4d50-a8f4-8665a0824f67 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:25.021598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cc90040b-3a23-4d50-a8f4-8665a0824f67 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:25.031264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc90040b-3a23-4d50-a8f4-8665a0824f67 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:25.034871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc90040b-3a23-4d50-a8f4-8665a0824f67 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:25.035465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc90040b-3a23-4d50-a8f4-8665a0824f67 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:25.036362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc90040b-3a23-4d50-a8f4-8665a0824f67 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:25.036901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc90040b-3a23-4d50-a8f4-8665a0824f67 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:25.046874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc90040b-3a23-4d50-a8f4-8665a0824f67 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:25.223132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:25.464920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8737c0d8-7025-43b6-80bc-3317beeba98b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:25.474141 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8737c0d8-7025-43b6-80bc-3317beeba98b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.674799 Aug 23 18:14:25.485203 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2265/4644] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:24 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:25.508831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86d3f420-9370-4b54-9755-ae2175719d8e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:25.509448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-86d3f420-9370-4b54-9755-ae2175719d8e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:25.530325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86d3f420-9370-4b54-9755-ae2175719d8e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:25.532002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86d3f420-9370-4b54-9755-ae2175719d8e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:25.533995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86d3f420-9370-4b54-9755-ae2175719d8e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:25.533995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86d3f420-9370-4b54-9755-ae2175719d8e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:25.533995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86d3f420-9370-4b54-9755-ae2175719d8e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:25.534947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86d3f420-9370-4b54-9755-ae2175719d8e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:25.803958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cc90040b-3a23-4d50-a8f4-8665a0824f67 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:25.844734 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cc90040b-3a23-4d50-a8f4-8665a0824f67 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1294 microversion: 2.1 time: 0.827985 Aug 23 18:14:25.855062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-86d3f420-9370-4b54-9755-ae2175719d8e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:25.859638 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2380/4645] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:25 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1294 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:25.869521 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-86d3f420-9370-4b54-9755-ae2175719d8e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.366193 Aug 23 18:14:25.870949 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2266/4646] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:25 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:25.885051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a6670309-dd1e-4f93-8e21-d1aa13459711 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Action: 'create', calling method: .version_select at 0x7f27df59e790>, body: {"keypair": {"name": "tempest-keypair-750123781", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFf8xZkVuicgEZ8sv1kOLicFRmZ//XQvXc0PUk/OQHMqGzt8QKUMRHYFWrypwyjuY6AsFllMXA0qtt0w4zbVwdKFrJF9V8duTwF7RE+3w70qTnNWuXQvPWJwdX8czn+j2Q=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:25.892759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5bc663b3-5798-48d3-9b01-6ad7d8f67c13 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:25.896735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5bc663b3-5798-48d3-9b01-6ad7d8f67c13 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Failed to fetch instance by id -1 {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2968}} Aug 23 18:14:25.897278 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-5bc663b3-5798-48d3-9b01-6ad7d8f67c13 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance -1 could not be found. Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5bc663b3-5798-48d3-9b01-6ad7d8f67c13 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance -1 could not be found. Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '-1'} Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2969, in get Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:25.898837 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:25.903703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:25.903703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:25.903703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Aug 23 18:14:25.903703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:25.925765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5bc663b3-5798-48d3-9b01-6ad7d8f67c13 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance -1 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:25.926674 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5bc663b3-5798-48d3-9b01-6ad7d8f67c13 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.037894 Aug 23 18:14:25.927737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a6670309-dd1e-4f93-8e21-d1aa13459711 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Getting quotas for project 95a8ab289dd4486993a639a3fa206ca4. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:14:25.933132 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2267/4647] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 18:14:25 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 23 18:14:25.939991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a6670309-dd1e-4f93-8e21-d1aa13459711 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Getting quotas for user b65c0b1d85b64207a9fe0d69b6635844 and project 95a8ab289dd4486993a639a3fa206ca4. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:14:25.946013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eec215eb-e184-4143-a5a5-8172e77e9abc tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:25.947857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eec215eb-e184-4143-a5a5-8172e77e9abc tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:25.969567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eec215eb-e184-4143-a5a5-8172e77e9abc tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:25.971235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eec215eb-e184-4143-a5a5-8172e77e9abc tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:25.973444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eec215eb-e184-4143-a5a5-8172e77e9abc tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:25.974343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eec215eb-e184-4143-a5a5-8172e77e9abc tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:25.974628 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a6670309-dd1e-4f93-8e21-d1aa13459711 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.113722 Aug 23 18:14:25.975491 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2381/4648] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Aug 23 18:14:25 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 115 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 18:14:25.975983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eec215eb-e184-4143-a5a5-8172e77e9abc tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:25.976518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eec215eb-e184-4143-a5a5-8172e77e9abc tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.021764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4aa5da16-08b2-49dd-bcc9-4c30fa42e5dc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:26.023621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4aa5da16-08b2-49dd-bcc9-4c30fa42e5dc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:26.041898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa5da16-08b2-49dd-bcc9-4c30fa42e5dc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.043052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa5da16-08b2-49dd-bcc9-4c30fa42e5dc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.045639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa5da16-08b2-49dd-bcc9-4c30fa42e5dc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.046714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa5da16-08b2-49dd-bcc9-4c30fa42e5dc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.048455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa5da16-08b2-49dd-bcc9-4c30fa42e5dc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.049120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4aa5da16-08b2-49dd-bcc9-4c30fa42e5dc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.255007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eec215eb-e184-4143-a5a5-8172e77e9abc tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:26.265413 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eec215eb-e184-4143-a5a5-8172e77e9abc tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.325657 Aug 23 18:14:26.266308 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2268/4649] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:25 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:26.279467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4aa5da16-08b2-49dd-bcc9-4c30fa42e5dc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:26.289558 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4aa5da16-08b2-49dd-bcc9-4c30fa42e5dc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1320 microversion: 2.1 time: 0.274228 Aug 23 18:14:26.290315 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2382/4650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:26 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1320 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:26.293021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2993469a-8ee2-4b17-a872-225da66d09fb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:26.294309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2993469a-8ee2-4b17-a872-225da66d09fb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:26.303429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2993469a-8ee2-4b17-a872-225da66d09fb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.308275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2993469a-8ee2-4b17-a872-225da66d09fb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.311586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2993469a-8ee2-4b17-a872-225da66d09fb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.312886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2993469a-8ee2-4b17-a872-225da66d09fb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.313729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2993469a-8ee2-4b17-a872-225da66d09fb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.316723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2993469a-8ee2-4b17-a872-225da66d09fb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.515955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f52abf2b-4b9a-4593-871f-0c4013a76918 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:26.516471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f52abf2b-4b9a-4593-871f-0c4013a76918 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:26.523720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f52abf2b-4b9a-4593-871f-0c4013a76918 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.524490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f52abf2b-4b9a-4593-871f-0c4013a76918 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.525291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f52abf2b-4b9a-4593-871f-0c4013a76918 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.526789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f52abf2b-4b9a-4593-871f-0c4013a76918 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.527924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f52abf2b-4b9a-4593-871f-0c4013a76918 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.528581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f52abf2b-4b9a-4593-871f-0c4013a76918 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.536523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2993469a-8ee2-4b17-a872-225da66d09fb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:26.549442 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2993469a-8ee2-4b17-a872-225da66d09fb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.262506 Aug 23 18:14:26.551533 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2269/4651] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:26 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:26.557982 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-f52abf2b-4b9a-4593-871f-0c4013a76918 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f52abf2b-4b9a-4593-871f-0c4013a76918 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 HTTP/1.1 Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '95c517c5-e5ab-4249-ab03-e6b2fc0c8e67'} Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:26.560052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:26.563829 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:14:26.563829 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.563829 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:26.563829 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.563829 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.563829 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:26.563829 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:26.563829 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:26.563829 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:26.563829 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:14:26.563829 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.565780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f52abf2b-4b9a-4593-871f-0c4013a76918 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:26.566917 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f52abf2b-4b9a-4593-871f-0c4013a76918 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 404 len: 111 microversion: 2.1 time: 0.055155 Aug 23 18:14:26.568338 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2383/4652] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:14:26 2022] DELETE /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:26.578169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ed0eb11-7a9a-4840-9e5b-9394f440232c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:26.579482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1ed0eb11-7a9a-4840-9e5b-9394f440232c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 04911b01-06fb-49c4-91ec-714710a29a68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:26.589790 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-1ed0eb11-7a9a-4840-9e5b-9394f440232c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 04911b01-06fb-49c4-91ec-714710a29a68 could not be found. Aug 23 18:14:26.596035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4d2e8091-32ed-48c3-a3e4-64ad410257cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:26.597150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4d2e8091-32ed-48c3-a3e4-64ad410257cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ed0eb11-7a9a-4840-9e5b-9394f440232c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/04911b01-06fb-49c4-91ec-714710a29a68/action HTTP/1.1 Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 19 Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: {"forceDelete": {}} Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 04911b01-06fb-49c4-91ec-714710a29a68 could not be found. Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '04911b01-06fb-49c4-91ec-714710a29a68', 'body': {'forceDelete': {}}} Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 04911b01-06fb-49c4-91ec-714710a29a68 could not be found. Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 04911b01-06fb-49c4-91ec-714710a29a68 could not be found. Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:26.601486 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:26.606110 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:26.606110 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:26.606110 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 04911b01-06fb-49c4-91ec-714710a29a68 could not be found. Aug 23 18:14:26.606110 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.606110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ed0eb11-7a9a-4840-9e5b-9394f440232c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 04911b01-06fb-49c4-91ec-714710a29a68 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:26.606110 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1ed0eb11-7a9a-4840-9e5b-9394f440232c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/04911b01-06fb-49c4-91ec-714710a29a68/action" status: 404 len: 111 microversion: 2.1 time: 0.031717 Aug 23 18:14:26.609005 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2270/4653] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:26 2022] POST /compute/v2.1/servers/04911b01-06fb-49c4-91ec-714710a29a68/action => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:26.611279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d2e8091-32ed-48c3-a3e4-64ad410257cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.612025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d2e8091-32ed-48c3-a3e4-64ad410257cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.620182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-80cae5f7-f871-406c-b9b2-727c5089510c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:26.621152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-80cae5f7-f871-406c-b9b2-727c5089510c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:26.625325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d2e8091-32ed-48c3-a3e4-64ad410257cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.626391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d2e8091-32ed-48c3-a3e4-64ad410257cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.627168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d2e8091-32ed-48c3-a3e4-64ad410257cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.639134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d2e8091-32ed-48c3-a3e4-64ad410257cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.642923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80cae5f7-f871-406c-b9b2-727c5089510c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.643437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80cae5f7-f871-406c-b9b2-727c5089510c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.643888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80cae5f7-f871-406c-b9b2-727c5089510c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.644619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80cae5f7-f871-406c-b9b2-727c5089510c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.647252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80cae5f7-f871-406c-b9b2-727c5089510c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.647731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80cae5f7-f871-406c-b9b2-727c5089510c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.658779 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-4d2e8091-32ed-48c3-a3e4-64ad410257cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4d2e8091-32ed-48c3-a3e4-64ad410257cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 HTTP/1.1 Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '95c517c5-e5ab-4249-ab03-e6b2fc0c8e67'} Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:26.660868 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.664806 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.664806 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:26.664806 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:26.664806 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:26.664806 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:26.664806 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. Aug 23 18:14:26.664806 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.667316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4d2e8091-32ed-48c3-a3e4-64ad410257cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:26.668485 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4d2e8091-32ed-48c3-a3e4-64ad410257cc tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67" status: 404 len: 111 microversion: 2.1 time: 0.082975 Aug 23 18:14:26.669591 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2384/4654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:26 2022] GET /compute/v2.1/servers/95c517c5-e5ab-4249-ab03-e6b2fc0c8e67 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:26.679106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-416cc618-e053-4511-9cfc-06a58cec46a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:26.679886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-416cc618-e053-4511-9cfc-06a58cec46a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:26.688034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-416cc618-e053-4511-9cfc-06a58cec46a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.688879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-416cc618-e053-4511-9cfc-06a58cec46a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.689562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-416cc618-e053-4511-9cfc-06a58cec46a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.690571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-416cc618-e053-4511-9cfc-06a58cec46a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.691389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-416cc618-e053-4511-9cfc-06a58cec46a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.692163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-416cc618-e053-4511-9cfc-06a58cec46a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.710637 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-416cc618-e053-4511-9cfc-06a58cec46a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-416cc618-e053-4511-9cfc-06a58cec46a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc HTTP/1.1 Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '57ededd5-baef-4b7b-9c5b-72064a009fdc'} Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:26.712725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:26.718376 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:14:26.718376 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.718376 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:26.718376 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.718376 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.718376 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:26.718376 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:26.718376 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:26.718376 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:26.718376 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:14:26.718376 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.720842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-416cc618-e053-4511-9cfc-06a58cec46a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:26.721942 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-416cc618-e053-4511-9cfc-06a58cec46a0 tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "DELETE /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 404 len: 111 microversion: 2.1 time: 0.048413 Aug 23 18:14:26.723085 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2385/4655] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:14:26 2022] DELETE /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:14:26.733507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f296b1e0-4bbf-41ba-b71f-94493ccadbaf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:26.734860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f296b1e0-4bbf-41ba-b71f-94493ccadbaf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] [instance: 57ededd5-baef-4b7b-9c5b-72064a009fdc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:26.743046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f296b1e0-4bbf-41ba-b71f-94493ccadbaf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.743874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f296b1e0-4bbf-41ba-b71f-94493ccadbaf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.744828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f296b1e0-4bbf-41ba-b71f-94493ccadbaf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.745849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f296b1e0-4bbf-41ba-b71f-94493ccadbaf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.746526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f296b1e0-4bbf-41ba-b71f-94493ccadbaf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.747243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f296b1e0-4bbf-41ba-b71f-94493ccadbaf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.764382 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-f296b1e0-4bbf-41ba-b71f-94493ccadbaf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] HTTP exception thrown: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f296b1e0-4bbf-41ba-b71f-94493ccadbaf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Request method failure captured: Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc HTTP/1.1 Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBReyp_3nVGwl3ewmI5tXYBnKwZy_aYolkGBX2v30wyLzm6tMUS53o_2Xg9iJhaPTeW-AxzT0ZnyDk4y6Ty5ejOtzcmZjD0PK1wO7GEEU51KmB2n6VmLS0NkyYyTg3Dkc3qciM3Y7TynGhAyFMrB5ylWuapgRQILdvNCT2X-Qcqael6U Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/d335c62baa6846ff86d9b1c2941c4d56"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/d335c62baa6846ff86d9b1c2941c4d56"}]}] Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: d335c62baa6846ff86d9b1c2941c4d56 Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersTestJSON-1174378567 Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2380358bc6a7496ead343b351bce816d Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersTestJSON-1174378567-project Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '57ededd5-baef-4b7b-9c5b-72064a009fdc'} Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:26.767235 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.773154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:26.773154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:26.773154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:26.773154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:26.773154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:26.773154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. Aug 23 18:14:26.773154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:26.773154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f296b1e0-4bbf-41ba-b71f-94493ccadbaf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] Returning 404 to user: Instance 57ededd5-baef-4b7b-9c5b-72064a009fdc could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:26.782198 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f296b1e0-4bbf-41ba-b71f-94493ccadbaf tempest-DeleteServersTestJSON-1174378567 tempest-DeleteServersTestJSON-1174378567-project] 10.222.0.61 "GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc" status: 404 len: 111 microversion: 2.1 time: 0.055063 Aug 23 18:14:26.786061 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2386/4656] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:26 2022] GET /compute/v2.1/servers/57ededd5-baef-4b7b-9c5b-72064a009fdc => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:14:26.864125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-80cae5f7-f871-406c-b9b2-727c5089510c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:26.878713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5798486-ad1f-469e-8aeb-416c5ad7fd21 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:26.880354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e5798486-ad1f-469e-8aeb-416c5ad7fd21 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:26.901793 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-80cae5f7-f871-406c-b9b2-727c5089510c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.290567 Aug 23 18:14:26.903617 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2271/4657] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:26 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:26.904968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5798486-ad1f-469e-8aeb-416c5ad7fd21 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.905736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5798486-ad1f-469e-8aeb-416c5ad7fd21 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.906742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5798486-ad1f-469e-8aeb-416c5ad7fd21 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.907786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5798486-ad1f-469e-8aeb-416c5ad7fd21 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.908856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5798486-ad1f-469e-8aeb-416c5ad7fd21 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.910322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5798486-ad1f-469e-8aeb-416c5ad7fd21 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.933031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2caeb61c-08af-477b-8de1-ba559801d4a9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:26.934413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2caeb61c-08af-477b-8de1-ba559801d4a9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:26.942936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2caeb61c-08af-477b-8de1-ba559801d4a9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.943995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2caeb61c-08af-477b-8de1-ba559801d4a9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.944694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2caeb61c-08af-477b-8de1-ba559801d4a9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:26.945754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2caeb61c-08af-477b-8de1-ba559801d4a9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:26.946450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2caeb61c-08af-477b-8de1-ba559801d4a9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:26.947235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2caeb61c-08af-477b-8de1-ba559801d4a9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:27.261834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e5798486-ad1f-469e-8aeb-416c5ad7fd21 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:27.269967 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e5798486-ad1f-469e-8aeb-416c5ad7fd21 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1294 microversion: 2.1 time: 0.401604 Aug 23 18:14:27.270948 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2387/4658] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:26 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1294 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:27.311600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-349944fc-d9c9-44e6-9cf5-6fba5a3d60fc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:27.313001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-349944fc-d9c9-44e6-9cf5-6fba5a3d60fc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:27.320282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-349944fc-d9c9-44e6-9cf5-6fba5a3d60fc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:27.321064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-349944fc-d9c9-44e6-9cf5-6fba5a3d60fc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:27.321744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-349944fc-d9c9-44e6-9cf5-6fba5a3d60fc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:27.322698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-349944fc-d9c9-44e6-9cf5-6fba5a3d60fc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:27.323793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-349944fc-d9c9-44e6-9cf5-6fba5a3d60fc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:27.324461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-349944fc-d9c9-44e6-9cf5-6fba5a3d60fc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:27.491191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-349944fc-d9c9-44e6-9cf5-6fba5a3d60fc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:27.502067 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-349944fc-d9c9-44e6-9cf5-6fba5a3d60fc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1320 microversion: 2.1 time: 0.194332 Aug 23 18:14:27.502711 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2388/4659] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:27 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1320 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:27.559842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2caeb61c-08af-477b-8de1-ba559801d4a9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:27.569244 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2caeb61c-08af-477b-8de1-ba559801d4a9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.645743 Aug 23 18:14:27.572690 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2272/4660] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:26 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:27.600349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6cb0fc46-403a-4605-b51f-f92b80af1981 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:27.606172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6cb0fc46-403a-4605-b51f-f92b80af1981 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 91857fc4-fc2d-4e15-bf97-6c79bd3b944c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:27.613091 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-6cb0fc46-403a-4605-b51f-f92b80af1981 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 91857fc4-fc2d-4e15-bf97-6c79bd3b944c could not be found. Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6cb0fc46-403a-4605-b51f-f92b80af1981 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/91857fc4-fc2d-4e15-bf97-6c79bd3b944c/action HTTP/1.1 Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 39 Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: {"os-getConsoleOutput": {"length": 10}} Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 91857fc4-fc2d-4e15-bf97-6c79bd3b944c could not be found. Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '91857fc4-fc2d-4e15-bf97-6c79bd3b944c', 'body': {'os-getConsoleOutput': {'length': 10}}} Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 91857fc4-fc2d-4e15-bf97-6c79bd3b944c could not be found. Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 91857fc4-fc2d-4e15-bf97-6c79bd3b944c could not be found. Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:27.628348 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:27.633181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:27.633181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:27.633181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:27.633181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:27.633181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 91857fc4-fc2d-4e15-bf97-6c79bd3b944c could not be found. Aug 23 18:14:27.633181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:27.640382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6cb0fc46-403a-4605-b51f-f92b80af1981 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 91857fc4-fc2d-4e15-bf97-6c79bd3b944c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:27.641479 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6cb0fc46-403a-4605-b51f-f92b80af1981 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/91857fc4-fc2d-4e15-bf97-6c79bd3b944c/action" status: 404 len: 111 microversion: 2.1 time: 0.049661 Aug 23 18:14:27.648363 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2389/4661] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:27 2022] POST /compute/v2.1/servers/91857fc4-fc2d-4e15-bf97-6c79bd3b944c/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:27.652413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9b9cd1d5-d2e2-4024-9173-d3583387faab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:27.653178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9b9cd1d5-d2e2-4024-9173-d3583387faab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:27.660586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b9cd1d5-d2e2-4024-9173-d3583387faab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:27.661213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b9cd1d5-d2e2-4024-9173-d3583387faab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:27.661774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b9cd1d5-d2e2-4024-9173-d3583387faab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:27.662785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b9cd1d5-d2e2-4024-9173-d3583387faab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:27.663343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b9cd1d5-d2e2-4024-9173-d3583387faab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:27.663836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b9cd1d5-d2e2-4024-9173-d3583387faab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:28.014136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9b9cd1d5-d2e2-4024-9173-d3583387faab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:28.046367 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9b9cd1d5-d2e2-4024-9173-d3583387faab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.397142 Aug 23 18:14:28.048849 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2273/4662] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:27 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:28.077756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a09faee-f28e-4214-abb1-ee435fd7a133 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:28.078666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5a09faee-f28e-4214-abb1-ee435fd7a133 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:28.097202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a09faee-f28e-4214-abb1-ee435fd7a133 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:28.100874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a09faee-f28e-4214-abb1-ee435fd7a133 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:28.101663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a09faee-f28e-4214-abb1-ee435fd7a133 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:28.107279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a09faee-f28e-4214-abb1-ee435fd7a133 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:28.108528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a09faee-f28e-4214-abb1-ee435fd7a133 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:28.110221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a09faee-f28e-4214-abb1-ee435fd7a133 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:28.127137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:28.297579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4ccac49f-938a-49ca-a1a6-af206c91ea09 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:28.298473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4ccac49f-938a-49ca-a1a6-af206c91ea09 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:28.310487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ccac49f-938a-49ca-a1a6-af206c91ea09 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:28.313271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ccac49f-938a-49ca-a1a6-af206c91ea09 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:28.314203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ccac49f-938a-49ca-a1a6-af206c91ea09 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:28.315259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ccac49f-938a-49ca-a1a6-af206c91ea09 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:28.319304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ccac49f-938a-49ca-a1a6-af206c91ea09 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:28.319769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ccac49f-938a-49ca-a1a6-af206c91ea09 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:28.587168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5a09faee-f28e-4214-abb1-ee435fd7a133 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:28.600943 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a09faee-f28e-4214-abb1-ee435fd7a133 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.527494 Aug 23 18:14:28.602112 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2390/4663] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:28 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:28.608710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-633a15cd-bc54-4e5f-b192-deac6ba10555 req-2dcd17ae-91cc-455f-9519-e9c33af39816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8908344b-041b-4181-8b33-2a5e191df614", "name": "network-vif-plugged", "status": "completed", "tag": "a4ce8cad-bebb-43fd-9c4f-086034d53e3e"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:28.623884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-633a15cd-bc54-4e5f-b192-deac6ba10555 req-2dcd17ae-91cc-455f-9519-e9c33af39816 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:28.624654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-633a15cd-bc54-4e5f-b192-deac6ba10555 req-2dcd17ae-91cc-455f-9519-e9c33af39816 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:28.625257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-633a15cd-bc54-4e5f-b192-deac6ba10555 req-2dcd17ae-91cc-455f-9519-e9c33af39816 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:28.657818 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-633a15cd-bc54-4e5f-b192-deac6ba10555 req-2dcd17ae-91cc-455f-9519-e9c33af39816 service nova] Creating event network-vif-plugged:a4ce8cad-bebb-43fd-9c4f-086034d53e3e for instance 8908344b-041b-4181-8b33-2a5e191df614 on n-h2-850468-16 Aug 23 18:14:28.675769 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-633a15cd-bc54-4e5f-b192-deac6ba10555 req-2dcd17ae-91cc-455f-9519-e9c33af39816 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071510 Aug 23 18:14:28.678851 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2391/4664] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:14:28.701731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6762985c-9133-4e04-8ebc-2885e8f9b738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:28.702454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ccac49f-938a-49ca-a1a6-af206c91ea09 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:28.702962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6762985c-9133-4e04-8ebc-2885e8f9b738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:28.711225 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4ccac49f-938a-49ca-a1a6-af206c91ea09 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1294 microversion: 2.1 time: 0.423925 Aug 23 18:14:28.714877 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2274/4665] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:28 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1294 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:28.719902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9716fdba-0bf4-40f2-8cff-9565a6c1ff27 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:28.737568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9716fdba-0bf4-40f2-8cff-9565a6c1ff27 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: d4714761-5e3d-42a2-a3f1-3731c090e1c9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:28.746081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6762985c-9133-4e04-8ebc-2885e8f9b738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:28.747040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6762985c-9133-4e04-8ebc-2885e8f9b738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:28.747969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6762985c-9133-4e04-8ebc-2885e8f9b738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:28.748895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6762985c-9133-4e04-8ebc-2885e8f9b738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:28.749675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6762985c-9133-4e04-8ebc-2885e8f9b738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:28.751199 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-9716fdba-0bf4-40f2-8cff-9565a6c1ff27 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance d4714761-5e3d-42a2-a3f1-3731c090e1c9 could not be found. Aug 23 18:14:28.751673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6762985c-9133-4e04-8ebc-2885e8f9b738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9716fdba-0bf4-40f2-8cff-9565a6c1ff27 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/d4714761-5e3d-42a2-a3f1-3731c090e1c9 HTTP/1.1 Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance d4714761-5e3d-42a2-a3f1-3731c090e1c9 could not be found. Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'd4714761-5e3d-42a2-a3f1-3731c090e1c9'} Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4714761-5e3d-42a2-a3f1-3731c090e1c9 could not be found. Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4714761-5e3d-42a2-a3f1-3731c090e1c9 could not be found. Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:28.752752 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:28.757367 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:28.757367 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:28.757367 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:28.757367 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4714761-5e3d-42a2-a3f1-3731c090e1c9 could not be found. Aug 23 18:14:28.757367 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:28.763340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9716fdba-0bf4-40f2-8cff-9565a6c1ff27 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance d4714761-5e3d-42a2-a3f1-3731c090e1c9 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:28.764272 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9716fdba-0bf4-40f2-8cff-9565a6c1ff27 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/d4714761-5e3d-42a2-a3f1-3731c090e1c9" status: 404 len: 111 microversion: 2.1 time: 0.048121 Aug 23 18:14:28.764860 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2275/4666] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:28 2022] GET /compute/v2.1/servers/d4714761-5e3d-42a2-a3f1-3731c090e1c9 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:28.772899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5099c70b-87d5-43c6-baa1-6d55985d47d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:28.773705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5099c70b-87d5-43c6-baa1-6d55985d47d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:28.792230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5099c70b-87d5-43c6-baa1-6d55985d47d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:28.792764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5099c70b-87d5-43c6-baa1-6d55985d47d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:28.793224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5099c70b-87d5-43c6-baa1-6d55985d47d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:28.794150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5099c70b-87d5-43c6-baa1-6d55985d47d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:28.794648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5099c70b-87d5-43c6-baa1-6d55985d47d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:28.795090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5099c70b-87d5-43c6-baa1-6d55985d47d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:29.098932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5099c70b-87d5-43c6-baa1-6d55985d47d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:29.110768 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5099c70b-87d5-43c6-baa1-6d55985d47d7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.340548 Aug 23 18:14:29.123366 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2276/4667] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:28 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:29.140886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25056fde-6cf4-4b32-a70d-9b7a39e4dede tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:29.141959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-25056fde-6cf4-4b32-a70d-9b7a39e4dede tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:29.149910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6762985c-9133-4e04-8ebc-2885e8f9b738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:29.151250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25056fde-6cf4-4b32-a70d-9b7a39e4dede tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:29.152288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25056fde-6cf4-4b32-a70d-9b7a39e4dede tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:29.153165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25056fde-6cf4-4b32-a70d-9b7a39e4dede tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:29.155202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25056fde-6cf4-4b32-a70d-9b7a39e4dede tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:29.155945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25056fde-6cf4-4b32-a70d-9b7a39e4dede tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:29.157150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25056fde-6cf4-4b32-a70d-9b7a39e4dede tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:29.163966 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6762985c-9133-4e04-8ebc-2885e8f9b738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1320 microversion: 2.1 time: 0.480835 Aug 23 18:14:29.164858 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2392/4668] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:28 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1320 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:29.545605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-25056fde-6cf4-4b32-a70d-9b7a39e4dede tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:29.558348 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-25056fde-6cf4-4b32-a70d-9b7a39e4dede tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.422446 Aug 23 18:14:29.566782 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2277/4669] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:29 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:29.733670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-57424631-2b8f-4a65-a1eb-30eac912e6a0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:29.734476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-57424631-2b8f-4a65-a1eb-30eac912e6a0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:29.740171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8f57468-9b2c-4302-b180-6540e2736e54 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1403869294", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:29.749760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57424631-2b8f-4a65-a1eb-30eac912e6a0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:29.751224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57424631-2b8f-4a65-a1eb-30eac912e6a0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:29.753229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57424631-2b8f-4a65-a1eb-30eac912e6a0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:29.753988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57424631-2b8f-4a65-a1eb-30eac912e6a0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:29.754466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57424631-2b8f-4a65-a1eb-30eac912e6a0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:29.764204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57424631-2b8f-4a65-a1eb-30eac912e6a0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8f57468-9b2c-4302-b180-6540e2736e54 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 238 Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1403869294", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1403869294', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '597d3f38-9c5d-451f-81bf-3e3fa931aa6a'}]}}} Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 236, in is_ipv4 Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:29.769814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Aug 23 18:14:29.776739 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:29.780366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8f57468-9b2c-4302-b180-6540e2736e54 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:29.781954 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c8f57468-9b2c-4302-b180-6540e2736e54 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.045603 Aug 23 18:14:29.782704 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2278/4670] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:29 2022] POST /compute/v2.1/servers => generated 139 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:14:29.792222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b9fd09b6-bc93-4e3c-82ba-d266ff5c391c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:29.803632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b9fd09b6-bc93-4e3c-82ba-d266ff5c391c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:29.822856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9fd09b6-bc93-4e3c-82ba-d266ff5c391c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:29.823482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9fd09b6-bc93-4e3c-82ba-d266ff5c391c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:29.823936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9fd09b6-bc93-4e3c-82ba-d266ff5c391c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:29.824677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9fd09b6-bc93-4e3c-82ba-d266ff5c391c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:29.825147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9fd09b6-bc93-4e3c-82ba-d266ff5c391c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:29.825582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9fd09b6-bc93-4e3c-82ba-d266ff5c391c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:30.109334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-57424631-2b8f-4a65-a1eb-30eac912e6a0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:30.120569 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-57424631-2b8f-4a65-a1eb-30eac912e6a0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1294 microversion: 2.1 time: 0.392794 Aug 23 18:14:30.139182 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2393/4671] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:29 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1294 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:30.152977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-705253161", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c6dd936c-81f4-43a2-8978-06dfdb954c39"}, {"port": "3e0b7dcf-3e88-405c-abd5-d6403cd681d8", "tag": "port-1"}, {"port": "e4c1ae5d-4bd7-4ff2-ac13-c687df447854", "tag": "port-2"}, {"uuid": "3d0ad488-ad4c-423d-bcbd-297c79bf59b7", "tag": "net-1"}, {"uuid": "3d0ad488-ad4c-423d-bcbd-297c79bf59b7"}, {"uuid": "63896586-2195-453b-b5e4-78d9a886103b", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "63896586-2195-453b-b5e4-78d9a886103b", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "24312d98-af2d-48c6-a6c5-50ad17638d32", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "aad6a4f1-62d7-4f31-9dc1-4ed8eec9b014", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "0b72526b-24fb-41c8-a1bb-a9339f8293b4", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2129323701"}], "key_name": "tempest-keypair-750123781", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:30.420177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] validate_networks() for [('c6dd936c-81f4-43a2-8978-06dfdb954c39', None, None, None, None, None), (None, None, '3e0b7dcf-3e88-405c-abd5-d6403cd681d8', None, None, None), (None, None, 'e4c1ae5d-4bd7-4ff2-ac13-c687df447854', None, None, None), ('3d0ad488-ad4c-423d-bcbd-297c79bf59b7', None, None, None, None, None), ('3d0ad488-ad4c-423d-bcbd-297c79bf59b7', None, None, None, None, None), ('63896586-2195-453b-b5e4-78d9a886103b', '10.2.2.100', None, None, None, None), ('63896586-2195-453b-b5e4-78d9a886103b', '10.2.2.200', None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:14:30.606324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b9fd09b6-bc93-4e3c-82ba-d266ff5c391c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:30.624574 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b9fd09b6-bc93-4e3c-82ba-d266ff5c391c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.837255 Aug 23 18:14:30.627304 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2279/4672] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:29 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:30.638524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6916bcd3-d271-4663-941c-fbc9ba27fa7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:30.656794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6916bcd3-d271-4663-941c-fbc9ba27fa7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:30.664640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6916bcd3-d271-4663-941c-fbc9ba27fa7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:30.665390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6916bcd3-d271-4663-941c-fbc9ba27fa7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:30.666665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6916bcd3-d271-4663-941c-fbc9ba27fa7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:30.669886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6916bcd3-d271-4663-941c-fbc9ba27fa7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:30.670596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6916bcd3-d271-4663-941c-fbc9ba27fa7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:30.671209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6916bcd3-d271-4663-941c-fbc9ba27fa7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:31.119065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6916bcd3-d271-4663-941c-fbc9ba27fa7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:31.137999 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6916bcd3-d271-4663-941c-fbc9ba27fa7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1320 microversion: 2.1 time: 0.507661 Aug 23 18:14:31.138606 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2280/4673] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:30 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1320 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:31.148418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-55fcb83d-d0b5-49e9-85d7-aa6f26e992b5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:31.152841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-55fcb83d-d0b5-49e9-85d7-aa6f26e992b5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:31.161821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55fcb83d-d0b5-49e9-85d7-aa6f26e992b5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:31.162611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55fcb83d-d0b5-49e9-85d7-aa6f26e992b5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:31.163301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55fcb83d-d0b5-49e9-85d7-aa6f26e992b5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:31.170644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55fcb83d-d0b5-49e9-85d7-aa6f26e992b5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:31.171404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55fcb83d-d0b5-49e9-85d7-aa6f26e992b5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:31.172084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55fcb83d-d0b5-49e9-85d7-aa6f26e992b5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:31.616562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-55fcb83d-d0b5-49e9-85d7-aa6f26e992b5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:31.660170 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-55fcb83d-d0b5-49e9-85d7-aa6f26e992b5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.516926 Aug 23 18:14:31.679143 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2281/4674] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:31 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:31.727717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-170faa3a-f904-41e8-b30e-ac13c751239b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:31.730686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-170faa3a-f904-41e8-b30e-ac13c751239b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:31.759139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-170faa3a-f904-41e8-b30e-ac13c751239b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:31.759741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-170faa3a-f904-41e8-b30e-ac13c751239b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:31.760743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-170faa3a-f904-41e8-b30e-ac13c751239b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:31.761795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-170faa3a-f904-41e8-b30e-ac13c751239b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:31.766652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-170faa3a-f904-41e8-b30e-ac13c751239b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:31.767869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-170faa3a-f904-41e8-b30e-ac13c751239b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:32.372835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-170faa3a-f904-41e8-b30e-ac13c751239b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:32.385781 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-170faa3a-f904-41e8-b30e-ac13c751239b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1485 microversion: 2.1 time: 0.701487 Aug 23 18:14:32.386992 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2282/4675] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:31 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1485 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:32.406435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4663e2e4-7d75-4546-998f-1799b0f2c7ed tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1149740384", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4663e2e4-7d75-4546-998f-1799b0f2c7ed tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 235 Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1149740384", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1149740384', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '597d3f38-9c5d-451f-81bf-3e3fa931aa6a'}]}}} Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = func(instance) Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 243, in is_ipv6 Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'notvalid' Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:32.421440 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Aug 23 18:14:32.426179 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:32.431451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4663e2e4-7d75-4546-998f-1799b0f2c7ed tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:32.432915 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4663e2e4-7d75-4546-998f-1799b0f2c7ed tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.041166 Aug 23 18:14:32.455969 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2283/4676] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:32 2022] POST /compute/v2.1/servers => generated 133 bytes in 69 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:14:32.464888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-292f5c62-37c0-4e73-8824-0e3df0cd28e0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:32.468699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-292f5c62-37c0-4e73-8824-0e3df0cd28e0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:32.489015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-292f5c62-37c0-4e73-8824-0e3df0cd28e0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:32.490587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-292f5c62-37c0-4e73-8824-0e3df0cd28e0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:32.491280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-292f5c62-37c0-4e73-8824-0e3df0cd28e0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:32.492347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-292f5c62-37c0-4e73-8824-0e3df0cd28e0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:32.493031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-292f5c62-37c0-4e73-8824-0e3df0cd28e0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:32.501631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-292f5c62-37c0-4e73-8824-0e3df0cd28e0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:32.888216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-292f5c62-37c0-4e73-8824-0e3df0cd28e0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:32.898255 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-292f5c62-37c0-4e73-8824-0e3df0cd28e0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1320 microversion: 2.1 time: 0.440151 Aug 23 18:14:32.899121 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2284/4677] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:32 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1320 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:32.904327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9617a6a6-f49b-438e-ba70-9e489353523c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:32.905099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9617a6a6-f49b-438e-ba70-9e489353523c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:32.911641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9617a6a6-f49b-438e-ba70-9e489353523c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:32.912394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9617a6a6-f49b-438e-ba70-9e489353523c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:32.913065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9617a6a6-f49b-438e-ba70-9e489353523c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:32.913993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9617a6a6-f49b-438e-ba70-9e489353523c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:32.914729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9617a6a6-f49b-438e-ba70-9e489353523c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:32.915381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9617a6a6-f49b-438e-ba70-9e489353523c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:33.017292 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9617a6a6-f49b-438e-ba70-9e489353523c tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116715 Aug 23 18:14:33.018668 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2285/4678] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:14:32 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:14:33.023637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-519227d6-b461-413b-8803-95813413f007 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:33.024613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-519227d6-b461-413b-8803-95813413f007 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:33.041877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-519227d6-b461-413b-8803-95813413f007 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:33.044694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-519227d6-b461-413b-8803-95813413f007 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:33.047245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-519227d6-b461-413b-8803-95813413f007 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:33.048468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-519227d6-b461-413b-8803-95813413f007 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:33.053671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-519227d6-b461-413b-8803-95813413f007 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:33.054311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-519227d6-b461-413b-8803-95813413f007 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:33.102733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:33.566292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-519227d6-b461-413b-8803-95813413f007 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:33.577844 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-519227d6-b461-413b-8803-95813413f007 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.557868 Aug 23 18:14:33.581816 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2286/4679] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:33 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:33.609039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5f830c31-545f-4672-94c4-2199127c69aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:33.609706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5f830c31-545f-4672-94c4-2199127c69aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:33.649352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f830c31-545f-4672-94c4-2199127c69aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:33.662799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f830c31-545f-4672-94c4-2199127c69aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:33.663594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f830c31-545f-4672-94c4-2199127c69aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:33.664599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f830c31-545f-4672-94c4-2199127c69aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:33.665284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f830c31-545f-4672-94c4-2199127c69aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:33.666354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f830c31-545f-4672-94c4-2199127c69aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:34.111064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5f830c31-545f-4672-94c4-2199127c69aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:34.129347 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5f830c31-545f-4672-94c4-2199127c69aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.524194 Aug 23 18:14:34.138080 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2287/4680] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:33 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:34.158139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-af1477b4-257a-447e-ad8a-3994fd165576 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:34.159119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-af1477b4-257a-447e-ad8a-3994fd165576 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:34.167137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af1477b4-257a-447e-ad8a-3994fd165576 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:34.168241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af1477b4-257a-447e-ad8a-3994fd165576 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:34.169331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af1477b4-257a-447e-ad8a-3994fd165576 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:34.170970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af1477b4-257a-447e-ad8a-3994fd165576 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:34.171348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af1477b4-257a-447e-ad8a-3994fd165576 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:34.172174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af1477b4-257a-447e-ad8a-3994fd165576 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:34.551745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-af1477b4-257a-447e-ad8a-3994fd165576 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:34.578626 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-af1477b4-257a-447e-ad8a-3994fd165576 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1320 microversion: 2.1 time: 0.438525 Aug 23 18:14:34.601116 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2288/4681] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:34 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1320 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:34.673215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d5aeb3d5-81c7-4259-816e-0ace64869c36 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:34.673771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d5aeb3d5-81c7-4259-816e-0ace64869c36 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 5bc2d341-5b0d-46fb-baa4-9eb208e1c81b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:34.699491 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-d5aeb3d5-81c7-4259-816e-0ace64869c36 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 5bc2d341-5b0d-46fb-baa4-9eb208e1c81b could not be found. Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d5aeb3d5-81c7-4259-816e-0ace64869c36 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/5bc2d341-5b0d-46fb-baa4-9eb208e1c81b/action HTTP/1.1 Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 13 Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: {"pause": {}} Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 5bc2d341-5b0d-46fb-baa4-9eb208e1c81b could not be found. Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '5bc2d341-5b0d-46fb-baa4-9eb208e1c81b', 'body': {'pause': {}}} Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5bc2d341-5b0d-46fb-baa4-9eb208e1c81b could not be found. Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5bc2d341-5b0d-46fb-baa4-9eb208e1c81b could not be found. Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:34.738508 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:34.745987 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:34.745987 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:34.745987 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5bc2d341-5b0d-46fb-baa4-9eb208e1c81b could not be found. Aug 23 18:14:34.745987 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:34.748283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d5aeb3d5-81c7-4259-816e-0ace64869c36 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 5bc2d341-5b0d-46fb-baa4-9eb208e1c81b could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:34.749713 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d5aeb3d5-81c7-4259-816e-0ace64869c36 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/5bc2d341-5b0d-46fb-baa4-9eb208e1c81b/action" status: 404 len: 111 microversion: 2.1 time: 0.146800 Aug 23 18:14:34.758617 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2289/4682] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:34 2022] POST /compute/v2.1/servers/5bc2d341-5b0d-46fb-baa4-9eb208e1c81b/action => generated 111 bytes in 156 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:34.774464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ffd8c862-9e1e-41f3-8550-618d76829862 req-9a4a6fc8-b18f-42e6-8a31-791a9e4b5d43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839bd8e1-c38c-4cb8-ac70-9f26284fe291", "name": "network-vif-plugged", "status": "completed", "tag": "76802691-863f-4d93-8a0a-b47bc6e65812"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:34.801408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ffd8c862-9e1e-41f3-8550-618d76829862 req-9a4a6fc8-b18f-42e6-8a31-791a9e4b5d43 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:34.802124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ffd8c862-9e1e-41f3-8550-618d76829862 req-9a4a6fc8-b18f-42e6-8a31-791a9e4b5d43 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:34.802835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ffd8c862-9e1e-41f3-8550-618d76829862 req-9a4a6fc8-b18f-42e6-8a31-791a9e4b5d43 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:34.831530 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ffd8c862-9e1e-41f3-8550-618d76829862 req-9a4a6fc8-b18f-42e6-8a31-791a9e4b5d43 service nova] Creating event network-vif-plugged:76802691-863f-4d93-8a0a-b47bc6e65812 for instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 on n-h2-850468-16 Aug 23 18:14:34.839205 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ffd8c862-9e1e-41f3-8550-618d76829862 req-9a4a6fc8-b18f-42e6-8a31-791a9e4b5d43 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075804 Aug 23 18:14:34.841243 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2290/4683] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:14:34.870077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dafed50f-6a4a-494a-8725-593da7c59851 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:34.887546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dafed50f-6a4a-494a-8725-593da7c59851 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:34.936358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dafed50f-6a4a-494a-8725-593da7c59851 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:34.938138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dafed50f-6a4a-494a-8725-593da7c59851 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:34.938678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dafed50f-6a4a-494a-8725-593da7c59851 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:34.941013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dafed50f-6a4a-494a-8725-593da7c59851 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:34.942677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dafed50f-6a4a-494a-8725-593da7c59851 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:34.943189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dafed50f-6a4a-494a-8725-593da7c59851 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:35.261384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dafed50f-6a4a-494a-8725-593da7c59851 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:35.272963 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dafed50f-6a4a-494a-8725-593da7c59851 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.427627 Aug 23 18:14:35.273555 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2291/4684] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:34 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:35.296239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66d99529-5466-41f2-b061-dd1850efe84a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:35.296824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66d99529-5466-41f2-b061-dd1850efe84a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:35.309557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66d99529-5466-41f2-b061-dd1850efe84a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:35.309987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66d99529-5466-41f2-b061-dd1850efe84a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:35.311047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66d99529-5466-41f2-b061-dd1850efe84a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:35.315624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66d99529-5466-41f2-b061-dd1850efe84a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:35.316292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66d99529-5466-41f2-b061-dd1850efe84a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:35.316903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66d99529-5466-41f2-b061-dd1850efe84a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:35.769047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66d99529-5466-41f2-b061-dd1850efe84a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:35.782589 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66d99529-5466-41f2-b061-dd1850efe84a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.490134 Aug 23 18:14:35.794568 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2292/4685] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:35 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:35.794568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c3c20d31-3307-4d70-b0cd-bfc4b3f27906 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:35.794568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c3c20d31-3307-4d70-b0cd-bfc4b3f27906 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:35.808303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3c20d31-3307-4d70-b0cd-bfc4b3f27906 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:35.808793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3c20d31-3307-4d70-b0cd-bfc4b3f27906 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:35.810960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3c20d31-3307-4d70-b0cd-bfc4b3f27906 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:35.811788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3c20d31-3307-4d70-b0cd-bfc4b3f27906 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:35.812261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3c20d31-3307-4d70-b0cd-bfc4b3f27906 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:35.812688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3c20d31-3307-4d70-b0cd-bfc4b3f27906 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:35.920229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:14:35.921221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:14:35.921876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:14:35.922562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:14:35.923073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:14:35.936886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:35.937762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:35.938461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:35.939468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:35.940167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:35.940821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:35.960771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Getting quotas for project 95a8ab289dd4486993a639a3fa206ca4. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:14:35.967207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Getting quotas for user b65c0b1d85b64207a9fe0d69b6635844 and project 95a8ab289dd4486993a639a3fa206ca4. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:14:36.039363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c3c20d31-3307-4d70-b0cd-bfc4b3f27906 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:36.050263 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c3c20d31-3307-4d70-b0cd-bfc4b3f27906 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1485 microversion: 2.1 time: 0.264662 Aug 23 18:14:36.050951 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2293/4686] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:35 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1485 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:36.055326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-d6c3bebb-a14b-4166-8a6a-078ee4d4618c req-788f1eb0-4c3b-4e87-aada-3246ac253c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8908344b-041b-4181-8b33-2a5e191df614", "tag": "a4ce8cad-bebb-43fd-9c4f-086034d53e3e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:36.081994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d6c3bebb-a14b-4166-8a6a-078ee4d4618c req-788f1eb0-4c3b-4e87-aada-3246ac253c2a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:36.082418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d6c3bebb-a14b-4166-8a6a-078ee4d4618c req-788f1eb0-4c3b-4e87-aada-3246ac253c2a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:36.082911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d6c3bebb-a14b-4166-8a6a-078ee4d4618c req-788f1eb0-4c3b-4e87-aada-3246ac253c2a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:36.111985 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-d6c3bebb-a14b-4166-8a6a-078ee4d4618c req-788f1eb0-4c3b-4e87-aada-3246ac253c2a service nova] Creating event network-changed:a4ce8cad-bebb-43fd-9c4f-086034d53e3e for instance 8908344b-041b-4181-8b33-2a5e191df614 on n-h2-850468-16 Aug 23 18:14:36.124770 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-d6c3bebb-a14b-4166-8a6a-078ee4d4618c req-788f1eb0-4c3b-4e87-aada-3246ac253c2a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072645 Aug 23 18:14:36.135504 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2294/4687] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:14:36.141115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d576af6e-8341-4baa-9e4e-1b3607829ebc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:36.141815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d576af6e-8341-4baa-9e4e-1b3607829ebc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:36.158020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d576af6e-8341-4baa-9e4e-1b3607829ebc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:36.158513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d576af6e-8341-4baa-9e4e-1b3607829ebc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:36.158972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d576af6e-8341-4baa-9e4e-1b3607829ebc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:36.159686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d576af6e-8341-4baa-9e4e-1b3607829ebc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:36.160138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d576af6e-8341-4baa-9e4e-1b3607829ebc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:36.160607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d576af6e-8341-4baa-9e4e-1b3607829ebc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:36.321792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:14:36.325946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='24312d98-af2d-48c6-a6c5-50ad17638d32',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='aad6a4f1-62d7-4f31-9dc1-4ed8eec9b014',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0b72526b-24fb-41c8-a1bb-a9339f8293b4',volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:14:36.475336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d576af6e-8341-4baa-9e4e-1b3607829ebc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:36.488781 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d576af6e-8341-4baa-9e4e-1b3607829ebc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1320 microversion: 2.1 time: 0.351590 Aug 23 18:14:36.489432 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2295/4688] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:36 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1320 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:36.499162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-65bb90c9-b796-4040-b8c8-5b1b02392763 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:36.501283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-65bb90c9-b796-4040-b8c8-5b1b02392763 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:36.519058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65bb90c9-b796-4040-b8c8-5b1b02392763 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:36.526590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65bb90c9-b796-4040-b8c8-5b1b02392763 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:36.527706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65bb90c9-b796-4040-b8c8-5b1b02392763 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:36.529020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65bb90c9-b796-4040-b8c8-5b1b02392763 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:36.529870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65bb90c9-b796-4040-b8c8-5b1b02392763 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:36.530605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65bb90c9-b796-4040-b8c8-5b1b02392763 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:36.735077 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-65bb90c9-b796-4040-b8c8-5b1b02392763 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 202 len: 0 microversion: 2.1 time: 0.244335 Aug 23 18:14:36.739347 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2296/4689] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:36 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:14:36.757303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3c2677e5-e6fa-4da8-bcb2-82e38d4dbf47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:36.758433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3c2677e5-e6fa-4da8-bcb2-82e38d4dbf47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:36.789322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c2677e5-e6fa-4da8-bcb2-82e38d4dbf47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:36.794945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c2677e5-e6fa-4da8-bcb2-82e38d4dbf47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:36.799943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c2677e5-e6fa-4da8-bcb2-82e38d4dbf47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:36.801181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c2677e5-e6fa-4da8-bcb2-82e38d4dbf47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:36.801681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c2677e5-e6fa-4da8-bcb2-82e38d4dbf47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:36.802140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c2677e5-e6fa-4da8-bcb2-82e38d4dbf47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:37.240337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3c2677e5-e6fa-4da8-bcb2-82e38d4dbf47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:37.253522 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3c2677e5-e6fa-4da8-bcb2-82e38d4dbf47 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1510 microversion: 2.1 time: 0.511908 Aug 23 18:14:37.254251 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2297/4690] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:36 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1510 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:37.293017 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-62e9cbad-065d-413c-b0e6-3a0e0bd5fb9f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 7.153238 Aug 23 18:14:37.295267 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2394/4691] 10.222.0.61 () {62 vars in 1189 bytes} [Tue Aug 23 18:14:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 7156 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 18:14:37.312832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a3955990-d9fd-42bf-ad5d-f3a9a40628b6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:37.313859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a3955990-d9fd-42bf-ad5d-f3a9a40628b6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:37.418624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a3955990-d9fd-42bf-ad5d-f3a9a40628b6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:37.429203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a3955990-d9fd-42bf-ad5d-f3a9a40628b6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:37.431269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a3955990-d9fd-42bf-ad5d-f3a9a40628b6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:37.440491 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a3955990-d9fd-42bf-ad5d-f3a9a40628b6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1284 microversion: 2.42 time: 0.127243 Aug 23 18:14:37.441360 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2298/4692] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:37 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:14:37.512884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-96d3a416-73c5-4602-bd44-f537a43c7ba2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:37.513852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-96d3a416-73c5-4602-bd44-f537a43c7ba2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:37.527269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96d3a416-73c5-4602-bd44-f537a43c7ba2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:37.528147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96d3a416-73c5-4602-bd44-f537a43c7ba2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:37.528813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96d3a416-73c5-4602-bd44-f537a43c7ba2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:37.530651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96d3a416-73c5-4602-bd44-f537a43c7ba2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:37.533207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96d3a416-73c5-4602-bd44-f537a43c7ba2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:37.533801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-96d3a416-73c5-4602-bd44-f537a43c7ba2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:37.852100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-96d3a416-73c5-4602-bd44-f537a43c7ba2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:37.876021 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-96d3a416-73c5-4602-bd44-f537a43c7ba2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1500 microversion: 2.1 time: 0.362622 Aug 23 18:14:37.894767 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2395/4693] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:37 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1500 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:37.899444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fb56c397-5565-437a-a53a-513a1a5cbb89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:37.900242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fb56c397-5565-437a-a53a-513a1a5cbb89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:37.913262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb56c397-5565-437a-a53a-513a1a5cbb89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:37.913768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb56c397-5565-437a-a53a-513a1a5cbb89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:37.914196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb56c397-5565-437a-a53a-513a1a5cbb89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:37.922824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb56c397-5565-437a-a53a-513a1a5cbb89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:37.923616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb56c397-5565-437a-a53a-513a1a5cbb89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:37.924209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb56c397-5565-437a-a53a-513a1a5cbb89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:38.238817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fb56c397-5565-437a-a53a-513a1a5cbb89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:38.248002 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fb56c397-5565-437a-a53a-513a1a5cbb89 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1500 microversion: 2.1 time: 0.352211 Aug 23 18:14:38.248599 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2299/4694] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:37 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1500 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:38.272616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e086790-fa46-40a0-abec-f6bda2c5bb69 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:38.273302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e086790-fa46-40a0-abec-f6bda2c5bb69 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:38.279928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d5bc24cc-8d16-4b31-851b-65452c717ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:38.280566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d5bc24cc-8d16-4b31-851b-65452c717ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:38.287223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5bc24cc-8d16-4b31-851b-65452c717ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:38.287475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5bc24cc-8d16-4b31-851b-65452c717ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:38.287921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5bc24cc-8d16-4b31-851b-65452c717ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:38.288630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5bc24cc-8d16-4b31-851b-65452c717ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:38.294174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e086790-fa46-40a0-abec-f6bda2c5bb69 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:38.296282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e086790-fa46-40a0-abec-f6bda2c5bb69 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:38.310155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e086790-fa46-40a0-abec-f6bda2c5bb69 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:38.310155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e086790-fa46-40a0-abec-f6bda2c5bb69 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:38.310155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e086790-fa46-40a0-abec-f6bda2c5bb69 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:38.310628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5bc24cc-8d16-4b31-851b-65452c717ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:38.310628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5bc24cc-8d16-4b31-851b-65452c717ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:38.310852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e086790-fa46-40a0-abec-f6bda2c5bb69 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:38.413855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e086790-fa46-40a0-abec-f6bda2c5bb69 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:14:38.487641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d5bc24cc-8d16-4b31-851b-65452c717ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:38.503141 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d5bc24cc-8d16-4b31-851b-65452c717ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1490 microversion: 2.1 time: 0.227564 Aug 23 18:14:38.519437 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2300/4695] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:38 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1490 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:38.525799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-57e1ff36-2798-4388-995e-227e33dab2db tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:38.526680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-57e1ff36-2798-4388-995e-227e33dab2db tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:38.598898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-57e1ff36-2798-4388-995e-227e33dab2db tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:38.609358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-57e1ff36-2798-4388-995e-227e33dab2db tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:38.611183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-57e1ff36-2798-4388-995e-227e33dab2db tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:38.612521 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-57e1ff36-2798-4388-995e-227e33dab2db tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1284 microversion: 2.42 time: 0.091567 Aug 23 18:14:38.613551 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2301/4696] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:38 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:14:38.620156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6688050c-69b6-4367-b234-1715f346f852 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:38.621082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6688050c-69b6-4367-b234-1715f346f852 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:38.627327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6688050c-69b6-4367-b234-1715f346f852 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:38.628038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6688050c-69b6-4367-b234-1715f346f852 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:38.628632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6688050c-69b6-4367-b234-1715f346f852 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:38.629504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6688050c-69b6-4367-b234-1715f346f852 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:38.629961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6688050c-69b6-4367-b234-1715f346f852 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:38.630578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6688050c-69b6-4367-b234-1715f346f852 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:38.656932 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e086790-fa46-40a0-abec-f6bda2c5bb69 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 204 len: 0 microversion: 2.1 time: 0.388471 Aug 23 18:14:38.661581 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2396/4697] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:14:38 2022] DELETE /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:14:38.671919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-18e83491-c1a6-44c9-8f30-51084571100c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:38.672987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-18e83491-c1a6-44c9-8f30-51084571100c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:38.676088 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-6688050c-69b6-4367-b234-1715f346f852 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Cannot 'pause' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state paused Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6688050c-69b6-4367-b234-1715f346f852 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action HTTP/1.1 Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 13 Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: {"pause": {}} Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: exception: Cannot 'pause' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state paused Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f1cad0fb-87b4-403c-9881-64ce147502fd', 'body': {'pause': {}}} Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1cad0fb-87b4-403c-9881-64ce147502fd in vm_state paused. Cannot pause while the instance is in this state. Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state paused Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:38.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:38.682769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:38.682769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:38.682769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:38.682769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state paused Aug 23 18:14:38.682769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:38.682769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6688050c-69b6-4367-b234-1715f346f852 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 409 to user: Cannot 'pause' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state paused {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:38.686279 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6688050c-69b6-4367-b234-1715f346f852 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 409 len: 143 microversion: 2.1 time: 0.071098 Aug 23 18:14:38.693325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18e83491-c1a6-44c9-8f30-51084571100c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:38.694050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18e83491-c1a6-44c9-8f30-51084571100c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:38.694386 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2302/4698] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:38 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 143 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:14:38.698683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18e83491-c1a6-44c9-8f30-51084571100c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:38.699633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18e83491-c1a6-44c9-8f30-51084571100c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:38.703842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18e83491-c1a6-44c9-8f30-51084571100c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:38.704299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18e83491-c1a6-44c9-8f30-51084571100c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:38.707156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b4284eb2-f5a8-487e-bdac-a6e22c4aa653 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:38.710795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b4284eb2-f5a8-487e-bdac-a6e22c4aa653 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:38.723978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4284eb2-f5a8-487e-bdac-a6e22c4aa653 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:38.725103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4284eb2-f5a8-487e-bdac-a6e22c4aa653 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:38.725773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4284eb2-f5a8-487e-bdac-a6e22c4aa653 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:38.726797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4284eb2-f5a8-487e-bdac-a6e22c4aa653 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:38.727608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4284eb2-f5a8-487e-bdac-a6e22c4aa653 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:38.730366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4284eb2-f5a8-487e-bdac-a6e22c4aa653 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:38.859884 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b4284eb2-f5a8-487e-bdac-a6e22c4aa653 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 202 len: 0 microversion: 2.1 time: 0.161754 Aug 23 18:14:38.861996 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2303/4699] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:38 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:14:38.882439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47163faf-9488-48da-b18b-92c5f4520203 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:38.883882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-47163faf-9488-48da-b18b-92c5f4520203 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:38.892642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47163faf-9488-48da-b18b-92c5f4520203 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:38.893534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47163faf-9488-48da-b18b-92c5f4520203 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:38.894320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47163faf-9488-48da-b18b-92c5f4520203 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:38.895278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47163faf-9488-48da-b18b-92c5f4520203 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:38.896011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47163faf-9488-48da-b18b-92c5f4520203 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:38.896751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47163faf-9488-48da-b18b-92c5f4520203 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:39.004685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-18e83491-c1a6-44c9-8f30-51084571100c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:39.028451 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-18e83491-c1a6-44c9-8f30-51084571100c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1506 microversion: 2.1 time: 0.363884 Aug 23 18:14:39.043116 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2397/4700] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:38 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1506 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:39.469507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-47163faf-9488-48da-b18b-92c5f4520203 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:39.480485 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-47163faf-9488-48da-b18b-92c5f4520203 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1497 microversion: 2.1 time: 0.612637 Aug 23 18:14:39.481683 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2304/4701] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:38 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1497 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:39.651771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-44aae0c3-7c6e-4e0b-a56d-87981917e095 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:39.653323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-44aae0c3-7c6e-4e0b-a56d-87981917e095 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:39.675324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44aae0c3-7c6e-4e0b-a56d-87981917e095 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:39.677166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44aae0c3-7c6e-4e0b-a56d-87981917e095 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:39.677715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44aae0c3-7c6e-4e0b-a56d-87981917e095 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:39.679410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44aae0c3-7c6e-4e0b-a56d-87981917e095 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:39.679963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44aae0c3-7c6e-4e0b-a56d-87981917e095 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:39.680534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44aae0c3-7c6e-4e0b-a56d-87981917e095 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:39.783833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-44aae0c3-7c6e-4e0b-a56d-87981917e095 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:39.807366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-44aae0c3-7c6e-4e0b-a56d-87981917e095 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:39.810501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-44aae0c3-7c6e-4e0b-a56d-87981917e095 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:39.812017 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-44aae0c3-7c6e-4e0b-a56d-87981917e095 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1574 microversion: 2.42 time: 0.171915 Aug 23 18:14:39.834492 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2398/4702] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:39 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1574 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:14:40.058074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cbbd90f7-bc99-45be-bc9e-58e3e52fc4f8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:40.060029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cbbd90f7-bc99-45be-bc9e-58e3e52fc4f8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:40.103361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cbbd90f7-bc99-45be-bc9e-58e3e52fc4f8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:40.106032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cbbd90f7-bc99-45be-bc9e-58e3e52fc4f8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:40.108598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cbbd90f7-bc99-45be-bc9e-58e3e52fc4f8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:40.109643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cbbd90f7-bc99-45be-bc9e-58e3e52fc4f8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:40.113360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cbbd90f7-bc99-45be-bc9e-58e3e52fc4f8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:40.121691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cbbd90f7-bc99-45be-bc9e-58e3e52fc4f8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:40.515939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fa7cde4d-1cb6-4570-acf5-775bef0cd473 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:40.516858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fa7cde4d-1cb6-4570-acf5-775bef0cd473 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:40.530258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa7cde4d-1cb6-4570-acf5-775bef0cd473 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:40.531178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa7cde4d-1cb6-4570-acf5-775bef0cd473 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:40.532776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa7cde4d-1cb6-4570-acf5-775bef0cd473 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:40.533934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa7cde4d-1cb6-4570-acf5-775bef0cd473 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:40.535101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa7cde4d-1cb6-4570-acf5-775bef0cd473 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:40.537499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa7cde4d-1cb6-4570-acf5-775bef0cd473 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:40.553703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cbbd90f7-bc99-45be-bc9e-58e3e52fc4f8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:40.561712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:40.576100 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cbbd90f7-bc99-45be-bc9e-58e3e52fc4f8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1506 microversion: 2.1 time: 0.524943 Aug 23 18:14:40.593813 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2305/4703] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:40 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1506 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:40.838246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b34132b0-8df2-43d3-8494-1ce414d88943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:40.839454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b34132b0-8df2-43d3-8494-1ce414d88943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:40.856732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b34132b0-8df2-43d3-8494-1ce414d88943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:40.864766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b34132b0-8df2-43d3-8494-1ce414d88943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:40.865648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b34132b0-8df2-43d3-8494-1ce414d88943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:40.868342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b34132b0-8df2-43d3-8494-1ce414d88943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:40.870167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b34132b0-8df2-43d3-8494-1ce414d88943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:40.871459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b34132b0-8df2-43d3-8494-1ce414d88943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:41.074373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b34132b0-8df2-43d3-8494-1ce414d88943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:41.086967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b34132b0-8df2-43d3-8494-1ce414d88943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:41.094720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b34132b0-8df2-43d3-8494-1ce414d88943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:41.098280 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b34132b0-8df2-43d3-8494-1ce414d88943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1592 microversion: 2.42 time: 0.264637 Aug 23 18:14:41.100777 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2306/4704] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:40 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1592 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:14:41.435247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fa7cde4d-1cb6-4570-acf5-775bef0cd473 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:41.453448 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fa7cde4d-1cb6-4570-acf5-775bef0cd473 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.946090 Aug 23 18:14:41.454146 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2399/4705] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:40 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:41.488860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6354d0ad-7ff6-4a8a-a85f-c050b70a1f3c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:41.491245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6354d0ad-7ff6-4a8a-a85f-c050b70a1f3c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:41.506344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6354d0ad-7ff6-4a8a-a85f-c050b70a1f3c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:41.506984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6354d0ad-7ff6-4a8a-a85f-c050b70a1f3c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:41.507499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6354d0ad-7ff6-4a8a-a85f-c050b70a1f3c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:41.510631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6354d0ad-7ff6-4a8a-a85f-c050b70a1f3c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:41.513043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6354d0ad-7ff6-4a8a-a85f-c050b70a1f3c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:41.513571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6354d0ad-7ff6-4a8a-a85f-c050b70a1f3c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:41.598289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2fe36bc9-3f6c-47be-aa06-2fc91ecfd7ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:41.599220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2fe36bc9-3f6c-47be-aa06-2fc91ecfd7ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:41.628475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2fe36bc9-3f6c-47be-aa06-2fc91ecfd7ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:41.629221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2fe36bc9-3f6c-47be-aa06-2fc91ecfd7ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:41.629836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2fe36bc9-3f6c-47be-aa06-2fc91ecfd7ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:41.630961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2fe36bc9-3f6c-47be-aa06-2fc91ecfd7ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:41.631623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2fe36bc9-3f6c-47be-aa06-2fc91ecfd7ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:41.632946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2fe36bc9-3f6c-47be-aa06-2fc91ecfd7ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:41.814578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2fe36bc9-3f6c-47be-aa06-2fc91ecfd7ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:41.838116 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2fe36bc9-3f6c-47be-aa06-2fc91ecfd7ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 200 len: 1464 microversion: 2.1 time: 0.241614 Aug 23 18:14:41.841140 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2400/4706] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:41 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 1464 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:41.851181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-17d64293-29e5-47cc-ab52-fb0828b39151 req-c31287db-f363-48b8-99d4-60e4795ba8c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "839bd8e1-c38c-4cb8-ac70-9f26284fe291", "name": "network-vif-deleted", "tag": "76802691-863f-4d93-8a0a-b47bc6e65812"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:41.891891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-17d64293-29e5-47cc-ab52-fb0828b39151 req-c31287db-f363-48b8-99d4-60e4795ba8c6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:41.892807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-17d64293-29e5-47cc-ab52-fb0828b39151 req-c31287db-f363-48b8-99d4-60e4795ba8c6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:41.894282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-17d64293-29e5-47cc-ab52-fb0828b39151 req-c31287db-f363-48b8-99d4-60e4795ba8c6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:41.928202 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-17d64293-29e5-47cc-ab52-fb0828b39151 req-c31287db-f363-48b8-99d4-60e4795ba8c6 service nova] Creating event network-vif-deleted:76802691-863f-4d93-8a0a-b47bc6e65812 for instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 on n-h2-850468-16 Aug 23 18:14:41.957496 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-17d64293-29e5-47cc-ab52-fb0828b39151 req-c31287db-f363-48b8-99d4-60e4795ba8c6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112614 Aug 23 18:14:41.958458 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2401/4707] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:14:42.149675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c848705f-7760-40f4-bdc8-afdd09486a64 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:42.154830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c848705f-7760-40f4-bdc8-afdd09486a64 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:42.180590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c848705f-7760-40f4-bdc8-afdd09486a64 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:42.181299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c848705f-7760-40f4-bdc8-afdd09486a64 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:42.182438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c848705f-7760-40f4-bdc8-afdd09486a64 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:42.187494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c848705f-7760-40f4-bdc8-afdd09486a64 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:42.189383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c848705f-7760-40f4-bdc8-afdd09486a64 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:42.189853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c848705f-7760-40f4-bdc8-afdd09486a64 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:42.193786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6354d0ad-7ff6-4a8a-a85f-c050b70a1f3c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:42.221608 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6354d0ad-7ff6-4a8a-a85f-c050b70a1f3c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.745076 Aug 23 18:14:42.240205 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2307/4708] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:41 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:42.247984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bee75d01-f469-403b-b4a6-dcc08feba2f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:42.250583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bee75d01-f469-403b-b4a6-dcc08feba2f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:42.252843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:42.261722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bee75d01-f469-403b-b4a6-dcc08feba2f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:42.262611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bee75d01-f469-403b-b4a6-dcc08feba2f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:42.265280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bee75d01-f469-403b-b4a6-dcc08feba2f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:42.266588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bee75d01-f469-403b-b4a6-dcc08feba2f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:42.267427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bee75d01-f469-403b-b4a6-dcc08feba2f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:42.268098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bee75d01-f469-403b-b4a6-dcc08feba2f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:42.286218 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-bee75d01-f469-403b-b4a6-dcc08feba2f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bee75d01-f469-403b-b4a6-dcc08feba2f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077/action HTTP/1.1 Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 28 Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: {"reboot": {"type": "SOFT"}} Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '0d0004ed-3c7a-48da-a704-d0a2b3c43077', 'body': {'reboot': {'type': 'SOFT'}}} Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:42.288631 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:42.296481 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:14:42.296481 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:42.296481 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:42.296481 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:42.296481 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:42.296481 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:42.296481 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:42.296481 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:42.296481 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:42.296481 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:14:42.296481 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:42.296481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bee75d01-f469-403b-b4a6-dcc08feba2f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:42.299554 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bee75d01-f469-403b-b4a6-dcc08feba2f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077/action" status: 404 len: 111 microversion: 2.1 time: 0.056509 Aug 23 18:14:42.301949 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2308/4709] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:42 2022] POST /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077/action => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:42.311311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4072173b-277c-4563-a6a5-5240f8756d31 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:42.318275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4072173b-277c-4563-a6a5-5240f8756d31 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:42.338064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4072173b-277c-4563-a6a5-5240f8756d31 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:42.338911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4072173b-277c-4563-a6a5-5240f8756d31 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:42.339373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4072173b-277c-4563-a6a5-5240f8756d31 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:42.340250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4072173b-277c-4563-a6a5-5240f8756d31 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:42.340894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4072173b-277c-4563-a6a5-5240f8756d31 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:42.341329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4072173b-277c-4563-a6a5-5240f8756d31 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:42.387990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c848705f-7760-40f4-bdc8-afdd09486a64 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:42.408120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c848705f-7760-40f4-bdc8-afdd09486a64 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:42.414734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c848705f-7760-40f4-bdc8-afdd09486a64 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:42.422717 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c848705f-7760-40f4-bdc8-afdd09486a64 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1592 microversion: 2.42 time: 0.294531 Aug 23 18:14:42.425431 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2402/4710] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:42 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1592 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:14:42.636917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4072173b-277c-4563-a6a5-5240f8756d31 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:42.648692 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4072173b-277c-4563-a6a5-5240f8756d31 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.339763 Aug 23 18:14:42.649592 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2309/4711] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:42 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:42.678013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd958bf7-3a86-4aa9-9342-d237a03045c4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:42.679441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cd958bf7-3a86-4aa9-9342-d237a03045c4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:42.693257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd958bf7-3a86-4aa9-9342-d237a03045c4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:42.695258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd958bf7-3a86-4aa9-9342-d237a03045c4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:42.696258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd958bf7-3a86-4aa9-9342-d237a03045c4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:42.700646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd958bf7-3a86-4aa9-9342-d237a03045c4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:42.701504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd958bf7-3a86-4aa9-9342-d237a03045c4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:42.702209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd958bf7-3a86-4aa9-9342-d237a03045c4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:42.869419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-164ce1a0-8cd9-4b9b-b626-c7deeb93f1a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:42.870662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-164ce1a0-8cd9-4b9b-b626-c7deeb93f1a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:42.886923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-164ce1a0-8cd9-4b9b-b626-c7deeb93f1a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:42.898010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-164ce1a0-8cd9-4b9b-b626-c7deeb93f1a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:42.901975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-164ce1a0-8cd9-4b9b-b626-c7deeb93f1a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:42.904570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-164ce1a0-8cd9-4b9b-b626-c7deeb93f1a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:42.910741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-164ce1a0-8cd9-4b9b-b626-c7deeb93f1a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:42.911540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-164ce1a0-8cd9-4b9b-b626-c7deeb93f1a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:42.945008 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-164ce1a0-8cd9-4b9b-b626-c7deeb93f1a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-164ce1a0-8cd9-4b9b-b626-c7deeb93f1a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 HTTP/1.1 Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '839bd8e1-c38c-4cb8-ac70-9f26284fe291'} Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:42.985609 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:42.989758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:42.989758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:42.989758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:42.989758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:42.989758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:42.989758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:14:42.989758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:42.996149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-164ce1a0-8cd9-4b9b-b626-c7deeb93f1a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:42.997039 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-164ce1a0-8cd9-4b9b-b626-c7deeb93f1a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 404 len: 111 microversion: 2.1 time: 0.137081 Aug 23 18:14:43.016372 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2310/4712] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:42 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 111 bytes in 157 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:43.034381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f41b121e-3c8f-4171-ab8e-8d92f87bac98 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'create', calling method: .version_select at 0x7f27df935ee0>, body: {"keypair": {"name": "tempest-key-931518767", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHt+zFJBJ2xZTWqQibyCtGxevlH0W+SogDR8dRJpF1MF2isy4GLp67UD3w1sm0K3PI+JhqcMGlJosxteRNqVPN8X4fcfkav0TJq9xs92Y8ifuxxCnvA0nopeUxiL1VtRXg=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:43.140972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-f41b121e-3c8f-4171-ab8e-8d92f87bac98 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for project 27a6a20a50ef474db0b83487eb029629. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:14:43.196591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-f41b121e-3c8f-4171-ab8e-8d92f87bac98 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for user 6e80c3f1c008459faa3ac74ea5984eea and project 27a6a20a50ef474db0b83487eb029629. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:14:43.221576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cd958bf7-3a86-4aa9-9342-d237a03045c4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:43.235364 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd958bf7-3a86-4aa9-9342-d237a03045c4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.562554 Aug 23 18:14:43.250695 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2403/4713] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:42 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:43.284232 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f41b121e-3c8f-4171-ab8e-8d92f87bac98 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.266849 Aug 23 18:14:43.285016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-59069295-52fb-4956-a816-d46517473e7c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:43.288060 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2311/4714] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:14:43 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:14:43.293270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-59069295-52fb-4956-a816-d46517473e7c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 20797b96-abc9-404f-a438-d7b9e570a2cb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:43.305914 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-59069295-52fb-4956-a816-d46517473e7c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 20797b96-abc9-404f-a438-d7b9e570a2cb could not be found. Aug 23 18:14:43.307664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aaf14976-fdab-49b9-9643-0589e785c6f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '.version_select at 0x7f27df95a1f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-59069295-52fb-4956-a816-d46517473e7c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/20797b96-abc9-404f-a438-d7b9e570a2cb/action HTTP/1.1 Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 28 Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: {"reboot": {"type": "SOFT"}} Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 20797b96-abc9-404f-a438-d7b9e570a2cb could not be found. Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '20797b96-abc9-404f-a438-d7b9e570a2cb', 'body': {'reboot': {'type': 'SOFT'}}} Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 20797b96-abc9-404f-a438-d7b9e570a2cb could not be found. Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 20797b96-abc9-404f-a438-d7b9e570a2cb could not be found. Aug 23 18:14:43.313040 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:43.318077 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:43.318077 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:43.318077 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:43.318077 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:43.318077 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:43.318077 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:43.318077 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:43.318077 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 20797b96-abc9-404f-a438-d7b9e570a2cb could not be found. Aug 23 18:14:43.318077 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:43.324279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-59069295-52fb-4956-a816-d46517473e7c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 20797b96-abc9-404f-a438-d7b9e570a2cb could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:43.325672 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-59069295-52fb-4956-a816-d46517473e7c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/20797b96-abc9-404f-a438-d7b9e570a2cb/action" status: 404 len: 111 microversion: 2.1 time: 0.067620 Aug 23 18:14:43.335441 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2404/4715] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:43 2022] POST /compute/v2.1/servers/20797b96-abc9-404f-a438-d7b9e570a2cb/action => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:43.336709 n-d-850468-16 devstack@n-api.service[128807]: WARNING oslo_db.sqlalchemy.utils [None req-aaf14976-fdab-49b9-9643-0589e785c6f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Unique keys not in sort_keys. The sorting order may be unstable. Aug 23 18:14:43.355406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c5b28337-0312-4606-a89d-97e32db3d235 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:43.359919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c5b28337-0312-4606-a89d-97e32db3d235 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:43.377639 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aaf14976-fdab-49b9-9643-0589e785c6f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.081942 Aug 23 18:14:43.390072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5b28337-0312-4606-a89d-97e32db3d235 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:43.390622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5b28337-0312-4606-a89d-97e32db3d235 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:43.392675 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2312/4716] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 18:14:43 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:14:43.408783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5b28337-0312-4606-a89d-97e32db3d235 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:43.421498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5b28337-0312-4606-a89d-97e32db3d235 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:43.423718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5b28337-0312-4606-a89d-97e32db3d235 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:43.427863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5b28337-0312-4606-a89d-97e32db3d235 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:43.457111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e3b537e7-706a-4850-b987-ff98f5b314c4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:43.457736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e3b537e7-706a-4850-b987-ff98f5b314c4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:43.485368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3b537e7-706a-4850-b987-ff98f5b314c4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:43.485884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3b537e7-706a-4850-b987-ff98f5b314c4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:43.486430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3b537e7-706a-4850-b987-ff98f5b314c4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:43.487228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3b537e7-706a-4850-b987-ff98f5b314c4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:43.487689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3b537e7-706a-4850-b987-ff98f5b314c4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:43.488176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e3b537e7-706a-4850-b987-ff98f5b314c4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:44.068045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e3b537e7-706a-4850-b987-ff98f5b314c4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:44.088282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e3b537e7-706a-4850-b987-ff98f5b314c4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:44.093964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e3b537e7-706a-4850-b987-ff98f5b314c4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:44.096471 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e3b537e7-706a-4850-b987-ff98f5b314c4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1660 microversion: 2.42 time: 0.645532 Aug 23 18:14:44.113032 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2313/4717] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:43 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1660 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:14:44.126048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-685869367", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "key_name": "tempest-key-931518767", "networks": [{"uuid": "bcef2581-80d0-47e5-8b8b-34343a6facf5"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:44.190604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c5b28337-0312-4606-a89d-97e32db3d235 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:44.199977 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c5b28337-0312-4606-a89d-97e32db3d235 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.863155 Aug 23 18:14:44.202735 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2405/4718] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:43 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:44.229331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-82715565-9f06-4cb9-bbdf-736ee2d892f3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:44.229954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-82715565-9f06-4cb9-bbdf-736ee2d892f3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:44.238411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82715565-9f06-4cb9-bbdf-736ee2d892f3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:44.238843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82715565-9f06-4cb9-bbdf-736ee2d892f3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:44.239282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82715565-9f06-4cb9-bbdf-736ee2d892f3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:44.240744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82715565-9f06-4cb9-bbdf-736ee2d892f3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:44.253394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82715565-9f06-4cb9-bbdf-736ee2d892f3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:44.255064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82715565-9f06-4cb9-bbdf-736ee2d892f3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:44.325176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] validate_networks() for [('bcef2581-80d0-47e5-8b8b-34343a6facf5', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:14:44.794265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-82715565-9f06-4cb9-bbdf-736ee2d892f3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:44.808550 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-82715565-9f06-4cb9-bbdf-736ee2d892f3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.588622 Aug 23 18:14:44.827350 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2406/4719] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:44 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:44.842784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-37e3ebde-fa96-4fe4-b592-869a8d3107d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:44.845767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-37e3ebde-fa96-4fe4-b592-869a8d3107d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:44.865939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37e3ebde-fa96-4fe4-b592-869a8d3107d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:44.867965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37e3ebde-fa96-4fe4-b592-869a8d3107d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:44.870285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37e3ebde-fa96-4fe4-b592-869a8d3107d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:44.871390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37e3ebde-fa96-4fe4-b592-869a8d3107d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:44.873274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37e3ebde-fa96-4fe4-b592-869a8d3107d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:44.890756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37e3ebde-fa96-4fe4-b592-869a8d3107d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:44.925160 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-37e3ebde-fa96-4fe4-b592-869a8d3107d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-37e3ebde-fa96-4fe4-b592-869a8d3107d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077/action HTTP/1.1 Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 65 Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '0d0004ed-3c7a-48da-a704-d0a2b3c43077', 'body': {'rebuild': {'imageRef': '126e0038-c91e-4894-b027-98e76f88a186'}}} Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 23 18:14:44.929109 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:14:44.933979 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:44.936728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-37e3ebde-fa96-4fe4-b592-869a8d3107d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:44.939312 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-37e3ebde-fa96-4fe4-b592-869a8d3107d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077/action" status: 404 len: 111 microversion: 2.1 time: 0.110870 Aug 23 18:14:44.946234 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2407/4720] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:44 2022] POST /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077/action => generated 111 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:44.959629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-519cd5c3-48f5-4382-9b96-1f0c5f329aab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:44.966361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-519cd5c3-48f5-4382-9b96-1f0c5f329aab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:44.992054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-519cd5c3-48f5-4382-9b96-1f0c5f329aab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:44.992865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-519cd5c3-48f5-4382-9b96-1f0c5f329aab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:44.996937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-519cd5c3-48f5-4382-9b96-1f0c5f329aab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:44.998463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-519cd5c3-48f5-4382-9b96-1f0c5f329aab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:44.999204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-519cd5c3-48f5-4382-9b96-1f0c5f329aab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:44.999882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-519cd5c3-48f5-4382-9b96-1f0c5f329aab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:45.379464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-519cd5c3-48f5-4382-9b96-1f0c5f329aab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:45.383393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:45.410328 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-519cd5c3-48f5-4382-9b96-1f0c5f329aab tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.459023 Aug 23 18:14:45.414085 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2408/4721] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:44 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:45.456647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2020813a-57a4-44f2-8a08-4d6f152d3a22 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:45.459099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2020813a-57a4-44f2-8a08-4d6f152d3a22 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:45.483173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2020813a-57a4-44f2-8a08-4d6f152d3a22 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:45.485195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2020813a-57a4-44f2-8a08-4d6f152d3a22 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:45.485665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2020813a-57a4-44f2-8a08-4d6f152d3a22 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:45.486425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2020813a-57a4-44f2-8a08-4d6f152d3a22 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:45.492721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2020813a-57a4-44f2-8a08-4d6f152d3a22 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:45.493243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2020813a-57a4-44f2-8a08-4d6f152d3a22 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:45.911838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:14:45.913044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:14:45.914529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:14:45.915276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:14:45.916560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:14:45.937822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:45.947363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:45.950858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:45.952055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:45.952881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:45.953799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:45.954372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:45.976086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=10 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:46.021355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:14:46.034976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for user 6e80c3f1c008459faa3ac74ea5984eea and project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:14:46.074269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:14:46.080528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:14:46.207995 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ee33cda8-59ae-4bfa-900a-6ab464e6aec5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.093546 Aug 23 18:14:46.208661 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2314/4722] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 2095 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:14:46.231936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f079e43f-3271-4d1b-b971-c2d7a138889a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:46.237120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f079e43f-3271-4d1b-b971-c2d7a138889a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:46.249887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f079e43f-3271-4d1b-b971-c2d7a138889a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:46.251332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f079e43f-3271-4d1b-b971-c2d7a138889a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:46.252074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f079e43f-3271-4d1b-b971-c2d7a138889a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:46.253050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f079e43f-3271-4d1b-b971-c2d7a138889a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:46.253680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f079e43f-3271-4d1b-b971-c2d7a138889a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:46.254294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f079e43f-3271-4d1b-b971-c2d7a138889a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:46.719465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f079e43f-3271-4d1b-b971-c2d7a138889a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:46.724118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2020813a-57a4-44f2-8a08-4d6f152d3a22 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:46.731554 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f079e43f-3271-4d1b-b971-c2d7a138889a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.503734 Aug 23 18:14:46.739248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2020813a-57a4-44f2-8a08-4d6f152d3a22 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:46.740599 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2315/4723] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:46 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:46.740787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2020813a-57a4-44f2-8a08-4d6f152d3a22 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:46.744468 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2020813a-57a4-44f2-8a08-4d6f152d3a22 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1707 microversion: 2.42 time: 1.309239 Aug 23 18:14:46.748618 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2409/4724] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:45 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1707 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:14:46.758333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6fcf9f0-c0f6-405c-ba25-63740eeb2ffe tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:46.759547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6fcf9f0-c0f6-405c-ba25-63740eeb2ffe tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:46.763585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3c7c28e-e9b3-406c-9a62-a7d2984598a7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:46.766599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f3c7c28e-e9b3-406c-9a62-a7d2984598a7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: e745040a-4937-4df5-ab8d-7853f64cedb9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:46.769484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:46.776690 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-f3c7c28e-e9b3-406c-9a62-a7d2984598a7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance e745040a-4937-4df5-ab8d-7853f64cedb9 could not be found. Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3c7c28e-e9b3-406c-9a62-a7d2984598a7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/e745040a-4937-4df5-ab8d-7853f64cedb9/action HTTP/1.1 Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 65 Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance e745040a-4937-4df5-ab8d-7853f64cedb9 could not be found. Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'e745040a-4937-4df5-ab8d-7853f64cedb9', 'body': {'rebuild': {'imageRef': '126e0038-c91e-4894-b027-98e76f88a186'}}} Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e745040a-4937-4df5-ab8d-7853f64cedb9 could not be found. Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Aug 23 18:14:46.780267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e745040a-4937-4df5-ab8d-7853f64cedb9 could not be found. Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e745040a-4937-4df5-ab8d-7853f64cedb9 could not be found. Aug 23 18:14:46.784168 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:46.786487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3c7c28e-e9b3-406c-9a62-a7d2984598a7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance e745040a-4937-4df5-ab8d-7853f64cedb9 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:46.787644 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f3c7c28e-e9b3-406c-9a62-a7d2984598a7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/e745040a-4937-4df5-ab8d-7853f64cedb9/action" status: 404 len: 111 microversion: 2.1 time: 0.030645 Aug 23 18:14:46.792419 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2410/4725] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:46 2022] POST /compute/v2.1/servers/e745040a-4937-4df5-ab8d-7853f64cedb9/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:46.800559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03eb5e9f-5a88-4af4-8188-c062c356657b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:46.803086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-03eb5e9f-5a88-4af4-8188-c062c356657b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:46.811694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03eb5e9f-5a88-4af4-8188-c062c356657b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:46.812553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03eb5e9f-5a88-4af4-8188-c062c356657b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:46.813369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03eb5e9f-5a88-4af4-8188-c062c356657b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:46.814326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03eb5e9f-5a88-4af4-8188-c062c356657b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:46.815147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03eb5e9f-5a88-4af4-8188-c062c356657b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:46.816177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03eb5e9f-5a88-4af4-8188-c062c356657b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:47.021616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f6fcf9f0-c0f6-405c-ba25-63740eeb2ffe tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:47.032339 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6fcf9f0-c0f6-405c-ba25-63740eeb2ffe tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1227 microversion: 2.1 time: 0.290159 Aug 23 18:14:47.034088 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2316/4726] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:46 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1227 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:47.151089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-03eb5e9f-5a88-4af4-8188-c062c356657b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:47.169177 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-03eb5e9f-5a88-4af4-8188-c062c356657b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.373720 Aug 23 18:14:47.170305 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2411/4727] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:46 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:47.191936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bcc38182-4a36-430a-a412-2dc081d1921e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:47.199054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bcc38182-4a36-430a-a412-2dc081d1921e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:47.217123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bcc38182-4a36-430a-a412-2dc081d1921e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:47.218966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bcc38182-4a36-430a-a412-2dc081d1921e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:47.221141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bcc38182-4a36-430a-a412-2dc081d1921e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:47.226114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bcc38182-4a36-430a-a412-2dc081d1921e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:47.227008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bcc38182-4a36-430a-a412-2dc081d1921e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:47.231172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bcc38182-4a36-430a-a412-2dc081d1921e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:47.778967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8fd5b94c-75e2-435e-b3fe-f43d32c367f8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:47.780355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8fd5b94c-75e2-435e-b3fe-f43d32c367f8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:47.814500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fd5b94c-75e2-435e-b3fe-f43d32c367f8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:47.815203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fd5b94c-75e2-435e-b3fe-f43d32c367f8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:47.815676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fd5b94c-75e2-435e-b3fe-f43d32c367f8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:47.816435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fd5b94c-75e2-435e-b3fe-f43d32c367f8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:47.816908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fd5b94c-75e2-435e-b3fe-f43d32c367f8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:47.817350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8fd5b94c-75e2-435e-b3fe-f43d32c367f8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:48.052971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bcc38182-4a36-430a-a412-2dc081d1921e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:48.070351 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bcc38182-4a36-430a-a412-2dc081d1921e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.882283 Aug 23 18:14:48.070994 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2317/4728] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:47 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:48.112472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5b6a7834-2641-4361-ba95-6675b3ae9502 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:48.113687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5b6a7834-2641-4361-ba95-6675b3ae9502 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:48.128067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b6a7834-2641-4361-ba95-6675b3ae9502 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:48.131563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b6a7834-2641-4361-ba95-6675b3ae9502 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:48.133716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b6a7834-2641-4361-ba95-6675b3ae9502 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:48.135483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b6a7834-2641-4361-ba95-6675b3ae9502 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:48.138094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b6a7834-2641-4361-ba95-6675b3ae9502 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:48.139151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b6a7834-2641-4361-ba95-6675b3ae9502 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:48.191636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8fd5b94c-75e2-435e-b3fe-f43d32c367f8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:48.210667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8fd5b94c-75e2-435e-b3fe-f43d32c367f8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:48.215375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8fd5b94c-75e2-435e-b3fe-f43d32c367f8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:48.220642 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8fd5b94c-75e2-435e-b3fe-f43d32c367f8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1754 microversion: 2.42 time: 0.448408 Aug 23 18:14:48.225857 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2412/4729] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:47 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1754 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:14:48.237030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b3a67943-e635-49fc-a712-c60b388b674a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:48.238789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b3a67943-e635-49fc-a712-c60b388b674a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 1dc8bc71-a236-4e3a-a2f5-155d1f9cec2c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:48.247641 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b3a67943-e635-49fc-a712-c60b388b674a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 1dc8bc71-a236-4e3a-a2f5-155d1f9cec2c could not be found. Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b3a67943-e635-49fc-a712-c60b388b674a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/1dc8bc71-a236-4e3a-a2f5-155d1f9cec2c/action HTTP/1.1 Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 15 Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: {"restore": {}} Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 1dc8bc71-a236-4e3a-a2f5-155d1f9cec2c could not be found. Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '1dc8bc71-a236-4e3a-a2f5-155d1f9cec2c', 'body': {'restore': {}}} Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1dc8bc71-a236-4e3a-a2f5-155d1f9cec2c could not be found. Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1dc8bc71-a236-4e3a-a2f5-155d1f9cec2c could not be found. Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:48.250006 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:48.254187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:48.254187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:48.254187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1dc8bc71-a236-4e3a-a2f5-155d1f9cec2c could not be found. Aug 23 18:14:48.254187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:48.256475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b3a67943-e635-49fc-a712-c60b388b674a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 1dc8bc71-a236-4e3a-a2f5-155d1f9cec2c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:48.257707 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b3a67943-e635-49fc-a712-c60b388b674a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/1dc8bc71-a236-4e3a-a2f5-155d1f9cec2c/action" status: 404 len: 111 microversion: 2.1 time: 0.030429 Aug 23 18:14:48.258483 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2413/4730] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:48 2022] POST /compute/v2.1/servers/1dc8bc71-a236-4e3a-a2f5-155d1f9cec2c/action => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:48.269761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-82382ca6-19f3-4890-9c75-c3f7d4df71b1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:48.270894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-82382ca6-19f3-4890-9c75-c3f7d4df71b1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:48.280787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82382ca6-19f3-4890-9c75-c3f7d4df71b1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:48.281873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82382ca6-19f3-4890-9c75-c3f7d4df71b1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:48.282373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82382ca6-19f3-4890-9c75-c3f7d4df71b1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:48.286447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82382ca6-19f3-4890-9c75-c3f7d4df71b1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:48.286447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82382ca6-19f3-4890-9c75-c3f7d4df71b1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:48.297091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82382ca6-19f3-4890-9c75-c3f7d4df71b1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:48.659499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-82382ca6-19f3-4890-9c75-c3f7d4df71b1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:48.672388 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-82382ca6-19f3-4890-9c75-c3f7d4df71b1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.408266 Aug 23 18:14:48.673620 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2414/4731] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:48 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:48.697938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac7a61d4-d13f-4c66-8a96-a8ee5293b9db tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:48.699289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac7a61d4-d13f-4c66-8a96-a8ee5293b9db tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:48.714437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7a61d4-d13f-4c66-8a96-a8ee5293b9db tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:48.715276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7a61d4-d13f-4c66-8a96-a8ee5293b9db tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:48.718770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7a61d4-d13f-4c66-8a96-a8ee5293b9db tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:48.719608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7a61d4-d13f-4c66-8a96-a8ee5293b9db tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:48.720079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7a61d4-d13f-4c66-8a96-a8ee5293b9db tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:48.720516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7a61d4-d13f-4c66-8a96-a8ee5293b9db tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:48.986694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac7a61d4-d13f-4c66-8a96-a8ee5293b9db tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:48.989807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5b6a7834-2641-4361-ba95-6675b3ae9502 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:48.998944 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5b6a7834-2641-4361-ba95-6675b3ae9502 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1279 microversion: 2.1 time: 0.909146 Aug 23 18:14:49.002519 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac7a61d4-d13f-4c66-8a96-a8ee5293b9db tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.309467 Aug 23 18:14:49.003365 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2318/4732] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:48 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1279 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:49.004374 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2415/4733] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:48 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:49.035987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d2e30ff1-e000-43d8-ba8a-c6fc8f25b4aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:49.036525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d2e30ff1-e000-43d8-ba8a-c6fc8f25b4aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:49.052471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2e30ff1-e000-43d8-ba8a-c6fc8f25b4aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:49.056194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2e30ff1-e000-43d8-ba8a-c6fc8f25b4aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:49.057379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2e30ff1-e000-43d8-ba8a-c6fc8f25b4aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:49.058279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2e30ff1-e000-43d8-ba8a-c6fc8f25b4aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:49.059011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2e30ff1-e000-43d8-ba8a-c6fc8f25b4aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:49.059631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2e30ff1-e000-43d8-ba8a-c6fc8f25b4aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:49.144822 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-d2e30ff1-e000-43d8-ba8a-c6fc8f25b4aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Cannot 'restore' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d2e30ff1-e000-43d8-ba8a-c6fc8f25b4aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action HTTP/1.1 Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 15 Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: {"restore": {}} Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: exception: Cannot 'restore' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f1cad0fb-87b4-403c-9881-64ce147502fd', 'body': {'restore': {}}} Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1cad0fb-87b4-403c-9881-64ce147502fd in vm_state active. Cannot restore while the instance is in this state. Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:49.148485 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:49.155969 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:49.155969 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:49.155969 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:49.155969 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:14:49.155969 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:49.155969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d2e30ff1-e000-43d8-ba8a-c6fc8f25b4aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 409 to user: Cannot 'restore' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:49.156813 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d2e30ff1-e000-43d8-ba8a-c6fc8f25b4aa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 409 len: 145 microversion: 2.1 time: 0.123636 Aug 23 18:14:49.160396 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2319/4734] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:49 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 145 bytes in 126 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:14:49.170277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6d5ab1fc-b0b6-444f-8205-40883a6f5c6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:49.171840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6d5ab1fc-b0b6-444f-8205-40883a6f5c6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:49.195128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d5ab1fc-b0b6-444f-8205-40883a6f5c6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:49.202506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d5ab1fc-b0b6-444f-8205-40883a6f5c6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:49.203319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d5ab1fc-b0b6-444f-8205-40883a6f5c6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:49.204462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d5ab1fc-b0b6-444f-8205-40883a6f5c6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:49.205135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d5ab1fc-b0b6-444f-8205-40883a6f5c6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:49.207482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d5ab1fc-b0b6-444f-8205-40883a6f5c6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:49.258164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2f8923b5-7b9f-4651-9534-1cea4e74168b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:49.260150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2f8923b5-7b9f-4651-9534-1cea4e74168b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:49.281748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f8923b5-7b9f-4651-9534-1cea4e74168b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:49.287064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f8923b5-7b9f-4651-9534-1cea4e74168b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:49.288910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f8923b5-7b9f-4651-9534-1cea4e74168b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:49.293087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f8923b5-7b9f-4651-9534-1cea4e74168b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:49.294995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f8923b5-7b9f-4651-9534-1cea4e74168b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:49.296725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f8923b5-7b9f-4651-9534-1cea4e74168b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:49.609082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6d5ab1fc-b0b6-444f-8205-40883a6f5c6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:49.619893 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6d5ab1fc-b0b6-444f-8205-40883a6f5c6d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.455782 Aug 23 18:14:49.637227 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2416/4735] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:49 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:49.646203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4290e222-1c21-4411-8d42-e6722026fea1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:49.652696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4290e222-1c21-4411-8d42-e6722026fea1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:49.666318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4290e222-1c21-4411-8d42-e6722026fea1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:49.668528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4290e222-1c21-4411-8d42-e6722026fea1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:49.669189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4290e222-1c21-4411-8d42-e6722026fea1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:49.671430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4290e222-1c21-4411-8d42-e6722026fea1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:49.674712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4290e222-1c21-4411-8d42-e6722026fea1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:49.675475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4290e222-1c21-4411-8d42-e6722026fea1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:50.102652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4290e222-1c21-4411-8d42-e6722026fea1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:50.119702 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4290e222-1c21-4411-8d42-e6722026fea1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.480519 Aug 23 18:14:50.139712 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2417/4736] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:49 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:50.150019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ddd30a1e-39c7-4680-b8b3-b0e14b6c0839 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:50.159755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ddd30a1e-39c7-4680-b8b3-b0e14b6c0839 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:50.182458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddd30a1e-39c7-4680-b8b3-b0e14b6c0839 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:50.192769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddd30a1e-39c7-4680-b8b3-b0e14b6c0839 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:50.193446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddd30a1e-39c7-4680-b8b3-b0e14b6c0839 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:50.199243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddd30a1e-39c7-4680-b8b3-b0e14b6c0839 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:50.200905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddd30a1e-39c7-4680-b8b3-b0e14b6c0839 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:50.201537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddd30a1e-39c7-4680-b8b3-b0e14b6c0839 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:50.374430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2f8923b5-7b9f-4651-9534-1cea4e74168b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:50.392705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2f8923b5-7b9f-4651-9534-1cea4e74168b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:50.394364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2f8923b5-7b9f-4651-9534-1cea4e74168b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:50.395658 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2f8923b5-7b9f-4651-9534-1cea4e74168b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1754 microversion: 2.42 time: 1.149591 Aug 23 18:14:50.397231 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2320/4737] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:49 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1754 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:14:50.403201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f243b74b-8b6f-41fa-941b-f3e47946bd32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:50.404020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f243b74b-8b6f-41fa-941b-f3e47946bd32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: e50c7638-bf63-4082-bf86-2748c5c25c22] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:50.404310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ddd30a1e-39c7-4680-b8b3-b0e14b6c0839 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:50.411380 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-f243b74b-8b6f-41fa-941b-f3e47946bd32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance e50c7638-bf63-4082-bf86-2748c5c25c22 could not be found. Aug 23 18:14:50.417274 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ddd30a1e-39c7-4680-b8b3-b0e14b6c0839 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1285 microversion: 2.1 time: 0.270123 Aug 23 18:14:50.417978 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2418/4738] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:50 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1285 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f243b74b-8b6f-41fa-941b-f3e47946bd32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/e50c7638-bf63-4082-bf86-2748c5c25c22/action HTTP/1.1 Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 14 Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: {"resume": {}} Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance e50c7638-bf63-4082-bf86-2748c5c25c22 could not be found. Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'e50c7638-bf63-4082-bf86-2748c5c25c22', 'body': {'resume': {}}} Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e50c7638-bf63-4082-bf86-2748c5c25c22 could not be found. Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e50c7638-bf63-4082-bf86-2748c5c25c22 could not be found. Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:50.418581 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:50.422975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:50.422975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:50.422975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e50c7638-bf63-4082-bf86-2748c5c25c22 could not be found. Aug 23 18:14:50.422975 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:50.425556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f243b74b-8b6f-41fa-941b-f3e47946bd32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance e50c7638-bf63-4082-bf86-2748c5c25c22 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:50.428553 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f243b74b-8b6f-41fa-941b-f3e47946bd32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/e50c7638-bf63-4082-bf86-2748c5c25c22/action" status: 404 len: 111 microversion: 2.1 time: 0.028437 Aug 23 18:14:50.438325 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2321/4739] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:50 2022] POST /compute/v2.1/servers/e50c7638-bf63-4082-bf86-2748c5c25c22/action => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:50.440958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7ac4ddf-690a-49d0-bf1e-b989779df99e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:50.441980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b7ac4ddf-690a-49d0-bf1e-b989779df99e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:50.460641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7ac4ddf-690a-49d0-bf1e-b989779df99e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:50.461697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7ac4ddf-690a-49d0-bf1e-b989779df99e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:50.462925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7ac4ddf-690a-49d0-bf1e-b989779df99e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:50.464197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7ac4ddf-690a-49d0-bf1e-b989779df99e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:50.465049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7ac4ddf-690a-49d0-bf1e-b989779df99e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:50.466068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7ac4ddf-690a-49d0-bf1e-b989779df99e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:50.712461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b7ac4ddf-690a-49d0-bf1e-b989779df99e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:50.721779 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b7ac4ddf-690a-49d0-bf1e-b989779df99e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.286767 Aug 23 18:14:50.722373 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2419/4740] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:50 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:50.749751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c02d4b6b-4efb-4aa3-bd3f-699027f650dd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:50.750634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c02d4b6b-4efb-4aa3-bd3f-699027f650dd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:50.758054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c02d4b6b-4efb-4aa3-bd3f-699027f650dd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:50.764446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c02d4b6b-4efb-4aa3-bd3f-699027f650dd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:50.765078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c02d4b6b-4efb-4aa3-bd3f-699027f650dd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:50.766015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c02d4b6b-4efb-4aa3-bd3f-699027f650dd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:50.769665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c02d4b6b-4efb-4aa3-bd3f-699027f650dd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:50.770348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c02d4b6b-4efb-4aa3-bd3f-699027f650dd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:51.424549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-072e95f2-0d4a-4e81-8aa8-84890c87bf36 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:51.429242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-072e95f2-0d4a-4e81-8aa8-84890c87bf36 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:51.440515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-072e95f2-0d4a-4e81-8aa8-84890c87bf36 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:51.441031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-072e95f2-0d4a-4e81-8aa8-84890c87bf36 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:51.441488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-072e95f2-0d4a-4e81-8aa8-84890c87bf36 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:51.442276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-072e95f2-0d4a-4e81-8aa8-84890c87bf36 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:51.442784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-072e95f2-0d4a-4e81-8aa8-84890c87bf36 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:51.443261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-072e95f2-0d4a-4e81-8aa8-84890c87bf36 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:51.670436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-072e95f2-0d4a-4e81-8aa8-84890c87bf36 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:51.684097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-072e95f2-0d4a-4e81-8aa8-84890c87bf36 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:51.685621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-072e95f2-0d4a-4e81-8aa8-84890c87bf36 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:51.690992 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-072e95f2-0d4a-4e81-8aa8-84890c87bf36 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1754 microversion: 2.42 time: 0.266850 Aug 23 18:14:51.692161 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2420/4741] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:51 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1754 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:14:51.703014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcf4cd58-8679-404f-a29c-f7ae3db00a5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:51.704802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fcf4cd58-8679-404f-a29c-f7ae3db00a5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:51.718843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c02d4b6b-4efb-4aa3-bd3f-699027f650dd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:51.723279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcf4cd58-8679-404f-a29c-f7ae3db00a5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:51.724124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcf4cd58-8679-404f-a29c-f7ae3db00a5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:51.725104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcf4cd58-8679-404f-a29c-f7ae3db00a5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:51.726116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcf4cd58-8679-404f-a29c-f7ae3db00a5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:51.727439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcf4cd58-8679-404f-a29c-f7ae3db00a5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:51.729167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcf4cd58-8679-404f-a29c-f7ae3db00a5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:51.731100 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c02d4b6b-4efb-4aa3-bd3f-699027f650dd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.986419 Aug 23 18:14:51.742993 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2322/4742] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:50 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 989 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:51.756424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e7977fd2-6c11-4a39-abf5-1faea5fa1ea4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:51.757185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e7977fd2-6c11-4a39-abf5-1faea5fa1ea4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:51.767042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7977fd2-6c11-4a39-abf5-1faea5fa1ea4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:51.767698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7977fd2-6c11-4a39-abf5-1faea5fa1ea4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:51.768235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7977fd2-6c11-4a39-abf5-1faea5fa1ea4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:51.769203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7977fd2-6c11-4a39-abf5-1faea5fa1ea4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:51.769906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7977fd2-6c11-4a39-abf5-1faea5fa1ea4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:51.771358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7977fd2-6c11-4a39-abf5-1faea5fa1ea4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:51.825525 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-e7977fd2-6c11-4a39-abf5-1faea5fa1ea4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Cannot 'resume' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e7977fd2-6c11-4a39-abf5-1faea5fa1ea4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action HTTP/1.1 Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 14 Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: {"resume": {}} Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: exception: Cannot 'resume' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f1cad0fb-87b4-403c-9881-64ce147502fd', 'body': {'resume': {}}} Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1cad0fb-87b4-403c-9881-64ce147502fd in vm_state active. Cannot resume while the instance is in this state. Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:51.832266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:51.843594 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:51.843594 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:51.843594 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:51.843594 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:14:51.843594 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:51.843594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e7977fd2-6c11-4a39-abf5-1faea5fa1ea4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 409 to user: Cannot 'resume' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:51.843594 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e7977fd2-6c11-4a39-abf5-1faea5fa1ea4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 409 len: 144 microversion: 2.1 time: 0.086706 Aug 23 18:14:51.846209 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2323/4743] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:51 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 144 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 23 18:14:51.854867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cc334ddb-deea-4558-89b3-cfcf94c093e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:51.855640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cc334ddb-deea-4558-89b3-cfcf94c093e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:51.862184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc334ddb-deea-4558-89b3-cfcf94c093e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:51.863046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc334ddb-deea-4558-89b3-cfcf94c093e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:51.863728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc334ddb-deea-4558-89b3-cfcf94c093e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:51.864694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc334ddb-deea-4558-89b3-cfcf94c093e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:51.865395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc334ddb-deea-4558-89b3-cfcf94c093e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:51.865514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fcf4cd58-8679-404f-a29c-f7ae3db00a5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:51.866193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc334ddb-deea-4558-89b3-cfcf94c093e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:51.877154 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fcf4cd58-8679-404f-a29c-f7ae3db00a5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1285 microversion: 2.1 time: 0.183190 Aug 23 18:14:51.890569 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2421/4744] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:51 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1285 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:52.541601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cc334ddb-deea-4558-89b3-cfcf94c093e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:52.552705 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cc334ddb-deea-4558-89b3-cfcf94c093e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.702141 Aug 23 18:14:52.558100 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2324/4745] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:51 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:52.592748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-358c72f4-d352-4306-89d8-e85ba7fc2de2 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:52.595346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-358c72f4-d352-4306-89d8-e85ba7fc2de2 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:52.611110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-358c72f4-d352-4306-89d8-e85ba7fc2de2 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:52.612613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-358c72f4-d352-4306-89d8-e85ba7fc2de2 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:52.613294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-358c72f4-d352-4306-89d8-e85ba7fc2de2 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:52.614327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-358c72f4-d352-4306-89d8-e85ba7fc2de2 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:52.615240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-358c72f4-d352-4306-89d8-e85ba7fc2de2 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:52.615924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-358c72f4-d352-4306-89d8-e85ba7fc2de2 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:52.724652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a200d5b1-6763-46b1-b144-49f31d5b0eb4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:52.727294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a200d5b1-6763-46b1-b144-49f31d5b0eb4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:52.740680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a200d5b1-6763-46b1-b144-49f31d5b0eb4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:52.746290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a200d5b1-6763-46b1-b144-49f31d5b0eb4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:52.747076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a200d5b1-6763-46b1-b144-49f31d5b0eb4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:52.748072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a200d5b1-6763-46b1-b144-49f31d5b0eb4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:52.748768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a200d5b1-6763-46b1-b144-49f31d5b0eb4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:52.749441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a200d5b1-6763-46b1-b144-49f31d5b0eb4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:52.844236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-358c72f4-d352-4306-89d8-e85ba7fc2de2 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:52.872601 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-358c72f4-d352-4306-89d8-e85ba7fc2de2 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.288321 Aug 23 18:14:52.874227 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2422/4746] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:52 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:52.901919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-edeac91a-9d12-49dc-ad54-de3775d4bf01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:52.902581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-edeac91a-9d12-49dc-ad54-de3775d4bf01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:52.910895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edeac91a-9d12-49dc-ad54-de3775d4bf01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:52.911720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edeac91a-9d12-49dc-ad54-de3775d4bf01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:52.912613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edeac91a-9d12-49dc-ad54-de3775d4bf01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:52.924326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edeac91a-9d12-49dc-ad54-de3775d4bf01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:52.926328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edeac91a-9d12-49dc-ad54-de3775d4bf01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:52.927006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edeac91a-9d12-49dc-ad54-de3775d4bf01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:53.128469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-edeac91a-9d12-49dc-ad54-de3775d4bf01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:53.139423 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-edeac91a-9d12-49dc-ad54-de3775d4bf01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1327 microversion: 2.1 time: 0.242737 Aug 23 18:14:53.142266 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2423/4747] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:52 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1327 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:53.147714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e883b8e3-14d7-4f8a-b73e-9465d2763531 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e883b8e3-14d7-4f8a-b73e-9465d2763531 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 160 Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": "", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "597d3f38-9c5d-451f-81bf-3e3fa931aa6a"}]}} Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'server': {'name': '', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'networks': [{'uuid': '597d3f38-9c5d-451f-81bf-3e3fa931aa6a'}]}}} Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi '' Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:14:53.153104 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:14:53.158240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:14:53.158240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 23 18:14:53.158240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:53.158240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:53.158240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:53.158240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:53.158240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:53.158240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:53.158240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:14:53.158240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:14:53.158240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 23 18:14:53.158240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:14:53.183688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e883b8e3-14d7-4f8a-b73e-9465d2763531 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:53.184804 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e883b8e3-14d7-4f8a-b73e-9465d2763531 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.041241 Aug 23 18:14:53.190252 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2424/4748] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:53 2022] POST /compute/v2.1/servers => generated 108 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:14:53.197206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a7d4dac-cd7a-4f37-b79e-4e92f665c869 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:53.198412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8a7d4dac-cd7a-4f37-b79e-4e92f665c869 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:53.210749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a7d4dac-cd7a-4f37-b79e-4e92f665c869 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:53.211578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a7d4dac-cd7a-4f37-b79e-4e92f665c869 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:53.212445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a7d4dac-cd7a-4f37-b79e-4e92f665c869 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:53.213400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a7d4dac-cd7a-4f37-b79e-4e92f665c869 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:53.214049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a7d4dac-cd7a-4f37-b79e-4e92f665c869 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:53.214712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a7d4dac-cd7a-4f37-b79e-4e92f665c869 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:53.416929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8a7d4dac-cd7a-4f37-b79e-4e92f665c869 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:53.429722 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8a7d4dac-cd7a-4f37-b79e-4e92f665c869 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.237997 Aug 23 18:14:53.447752 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2425/4749] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:53 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:53.458703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e520c6dd-7dac-4ea0-a12c-3985a20a6152 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:53.459329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e520c6dd-7dac-4ea0-a12c-3985a20a6152 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:53.477538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e520c6dd-7dac-4ea0-a12c-3985a20a6152 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:53.478658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e520c6dd-7dac-4ea0-a12c-3985a20a6152 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:53.479111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e520c6dd-7dac-4ea0-a12c-3985a20a6152 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:53.479840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e520c6dd-7dac-4ea0-a12c-3985a20a6152 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:53.484686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e520c6dd-7dac-4ea0-a12c-3985a20a6152 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:53.485163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e520c6dd-7dac-4ea0-a12c-3985a20a6152 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:53.522210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a200d5b1-6763-46b1-b144-49f31d5b0eb4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:53.535696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a200d5b1-6763-46b1-b144-49f31d5b0eb4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:53.537280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a200d5b1-6763-46b1-b144-49f31d5b0eb4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:53.538452 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a200d5b1-6763-46b1-b144-49f31d5b0eb4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1754 microversion: 2.42 time: 0.822281 Aug 23 18:14:53.552242 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2325/4750] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:52 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1754 bytes in 837 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:14:53.717716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e520c6dd-7dac-4ea0-a12c-3985a20a6152 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:53.727405 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e520c6dd-7dac-4ea0-a12c-3985a20a6152 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.272502 Aug 23 18:14:53.744374 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2426/4751] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:53 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:53.753250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0879150e-4520-4c22-a7be-cfb054ee7b7e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:53.754396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0879150e-4520-4c22-a7be-cfb054ee7b7e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 8e68be27-1578-4d48-a33f-44db55727b52] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:53.761626 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-0879150e-4520-4c22-a7be-cfb054ee7b7e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 8e68be27-1578-4d48-a33f-44db55727b52 could not be found. Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0879150e-4520-4c22-a7be-cfb054ee7b7e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/8e68be27-1578-4d48-a33f-44db55727b52/action HTTP/1.1 Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 14 Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: {"shelve": {}} Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 8e68be27-1578-4d48-a33f-44db55727b52 could not be found. Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '8e68be27-1578-4d48-a33f-44db55727b52', 'body': {'shelve': {}}} Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e68be27-1578-4d48-a33f-44db55727b52 could not be found. Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e68be27-1578-4d48-a33f-44db55727b52 could not be found. Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:14:53.769181 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:14:53.775850 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:14:53.775850 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:14:53.775850 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e68be27-1578-4d48-a33f-44db55727b52 could not be found. Aug 23 18:14:53.775850 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:14:53.777233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0879150e-4520-4c22-a7be-cfb054ee7b7e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 8e68be27-1578-4d48-a33f-44db55727b52 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:14:53.778439 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0879150e-4520-4c22-a7be-cfb054ee7b7e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/8e68be27-1578-4d48-a33f-44db55727b52/action" status: 404 len: 111 microversion: 2.1 time: 0.029118 Aug 23 18:14:53.779699 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2326/4752] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:53 2022] POST /compute/v2.1/servers/8e68be27-1578-4d48-a33f-44db55727b52/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:14:53.788964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c8809c58-8478-41b0-b8dc-a8a51b3b896c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:53.789895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c8809c58-8478-41b0-b8dc-a8a51b3b896c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:53.798976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8809c58-8478-41b0-b8dc-a8a51b3b896c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:53.799992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8809c58-8478-41b0-b8dc-a8a51b3b896c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:53.800650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8809c58-8478-41b0-b8dc-a8a51b3b896c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:53.801567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8809c58-8478-41b0-b8dc-a8a51b3b896c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:53.802261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8809c58-8478-41b0-b8dc-a8a51b3b896c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:53.803276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8809c58-8478-41b0-b8dc-a8a51b3b896c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:54.154041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c8809c58-8478-41b0-b8dc-a8a51b3b896c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:54.162138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-70a16370-d29a-40fe-b9f1-9cfff5d64880 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:54.162876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-70a16370-d29a-40fe-b9f1-9cfff5d64880 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:54.176377 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c8809c58-8478-41b0-b8dc-a8a51b3b896c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.392304 Aug 23 18:14:54.177354 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2427/4753] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:53 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:54.180538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70a16370-d29a-40fe-b9f1-9cfff5d64880 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:54.181842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70a16370-d29a-40fe-b9f1-9cfff5d64880 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:54.184308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70a16370-d29a-40fe-b9f1-9cfff5d64880 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:54.187968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70a16370-d29a-40fe-b9f1-9cfff5d64880 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:54.188658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70a16370-d29a-40fe-b9f1-9cfff5d64880 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:54.189338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70a16370-d29a-40fe-b9f1-9cfff5d64880 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:54.205879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae6012d2-296c-4a71-88a5-59dad5e539ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:54.206998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae6012d2-296c-4a71-88a5-59dad5e539ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:54.220115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae6012d2-296c-4a71-88a5-59dad5e539ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:54.226178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae6012d2-296c-4a71-88a5-59dad5e539ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:54.226950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae6012d2-296c-4a71-88a5-59dad5e539ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:54.228514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae6012d2-296c-4a71-88a5-59dad5e539ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:54.236527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae6012d2-296c-4a71-88a5-59dad5e539ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:54.237342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae6012d2-296c-4a71-88a5-59dad5e539ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:54.275708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:54.510241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ae6012d2-296c-4a71-88a5-59dad5e539ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:54.524904 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae6012d2-296c-4a71-88a5-59dad5e539ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.321479 Aug 23 18:14:54.537505 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2428/4754] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:54 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:54.562378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fbc83880-39ef-4f80-883a-b14f31d674f1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:54.563119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fbc83880-39ef-4f80-883a-b14f31d674f1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:54.579964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fbc83880-39ef-4f80-883a-b14f31d674f1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:54.580472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fbc83880-39ef-4f80-883a-b14f31d674f1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:54.580920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fbc83880-39ef-4f80-883a-b14f31d674f1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:54.581649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fbc83880-39ef-4f80-883a-b14f31d674f1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:54.582159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fbc83880-39ef-4f80-883a-b14f31d674f1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:54.582725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fbc83880-39ef-4f80-883a-b14f31d674f1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:54.997769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fbc83880-39ef-4f80-883a-b14f31d674f1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:55.020042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fbc83880-39ef-4f80-883a-b14f31d674f1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:55.026367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fbc83880-39ef-4f80-883a-b14f31d674f1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:55.029480 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fbc83880-39ef-4f80-883a-b14f31d674f1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1801 microversion: 2.42 time: 0.469897 Aug 23 18:14:55.032291 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2429/4755] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:54 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1801 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:14:55.042853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ba5a4105-795c-467e-b07b-c7a35c46523f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:55.043362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ba5a4105-795c-467e-b07b-c7a35c46523f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:55.054989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba5a4105-795c-467e-b07b-c7a35c46523f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:55.058567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba5a4105-795c-467e-b07b-c7a35c46523f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:55.059208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba5a4105-795c-467e-b07b-c7a35c46523f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:55.060146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba5a4105-795c-467e-b07b-c7a35c46523f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:55.060790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba5a4105-795c-467e-b07b-c7a35c46523f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:55.061405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba5a4105-795c-467e-b07b-c7a35c46523f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:55.094076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-ba5a4105-795c-467e-b07b-c7a35c46523f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lazy-loading 'flavor' on Instance uuid f1cad0fb-87b4-403c-9881-64ce147502fd {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:14:55.373343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-70a16370-d29a-40fe-b9f1-9cfff5d64880 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:55.426256 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-70a16370-d29a-40fe-b9f1-9cfff5d64880 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1327 microversion: 2.1 time: 1.266203 Aug 23 18:14:55.429994 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2327/4756] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:54 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1327 bytes in 1273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:55.488327 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ba5a4105-795c-467e-b07b-c7a35c46523f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 202 len: 0 microversion: 2.1 time: 0.454366 Aug 23 18:14:55.490311 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2430/4757] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:14:55 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:14:55.507991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95bcc33b-c07b-428f-9c7f-02b0c3a6deda tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:55.512728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-95bcc33b-c07b-428f-9c7f-02b0c3a6deda tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:55.539898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95bcc33b-c07b-428f-9c7f-02b0c3a6deda tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:55.564134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95bcc33b-c07b-428f-9c7f-02b0c3a6deda tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:55.566986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95bcc33b-c07b-428f-9c7f-02b0c3a6deda tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:55.568433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95bcc33b-c07b-428f-9c7f-02b0c3a6deda tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:55.568963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95bcc33b-c07b-428f-9c7f-02b0c3a6deda tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:55.569943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95bcc33b-c07b-428f-9c7f-02b0c3a6deda tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:55.984231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:56.054832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-45cdba98-4f78-4a16-b8dd-f3a404e96dc8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:56.060891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-45cdba98-4f78-4a16-b8dd-f3a404e96dc8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:56.092431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-95bcc33b-c07b-428f-9c7f-02b0c3a6deda tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:56.092643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45cdba98-4f78-4a16-b8dd-f3a404e96dc8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:56.093070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45cdba98-4f78-4a16-b8dd-f3a404e96dc8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:56.093519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45cdba98-4f78-4a16-b8dd-f3a404e96dc8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:56.094256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45cdba98-4f78-4a16-b8dd-f3a404e96dc8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:56.094747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45cdba98-4f78-4a16-b8dd-f3a404e96dc8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:56.095248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45cdba98-4f78-4a16-b8dd-f3a404e96dc8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:56.116759 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-95bcc33b-c07b-428f-9c7f-02b0c3a6deda tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1511 microversion: 2.1 time: 0.615476 Aug 23 18:14:56.123447 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2328/4758] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:55 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1511 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:56.454723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f88dbc99-421d-4492-82bc-27659f99dd82 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:56.456279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f88dbc99-421d-4492-82bc-27659f99dd82 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:56.470888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f88dbc99-421d-4492-82bc-27659f99dd82 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:56.471632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f88dbc99-421d-4492-82bc-27659f99dd82 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:56.472231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f88dbc99-421d-4492-82bc-27659f99dd82 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:56.479704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f88dbc99-421d-4492-82bc-27659f99dd82 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:56.480383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f88dbc99-421d-4492-82bc-27659f99dd82 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:56.481051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f88dbc99-421d-4492-82bc-27659f99dd82 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:56.538163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45cdba98-4f78-4a16-b8dd-f3a404e96dc8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:56.549545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45cdba98-4f78-4a16-b8dd-f3a404e96dc8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:56.563621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45cdba98-4f78-4a16-b8dd-f3a404e96dc8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:56.568112 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-45cdba98-4f78-4a16-b8dd-f3a404e96dc8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1801 microversion: 2.42 time: 0.514776 Aug 23 18:14:56.582568 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2431/4759] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:56 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1801 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:14:57.031569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=16 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:57.032205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-894ffa05-4a75-430a-8c38-22bc5a2e96bb req-08a47a3e-58fe-43f0-baba-9ecb7e506ba5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8220873b-1b5e-457b-911a-1cd53303f7d9", "tag": "d88b6e2d-26aa-4d23-b6b8-904a2c1ea687"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:57.086301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-894ffa05-4a75-430a-8c38-22bc5a2e96bb req-08a47a3e-58fe-43f0-baba-9ecb7e506ba5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:57.089659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-894ffa05-4a75-430a-8c38-22bc5a2e96bb req-08a47a3e-58fe-43f0-baba-9ecb7e506ba5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:57.099025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-894ffa05-4a75-430a-8c38-22bc5a2e96bb req-08a47a3e-58fe-43f0-baba-9ecb7e506ba5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:57.134797 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-894ffa05-4a75-430a-8c38-22bc5a2e96bb req-08a47a3e-58fe-43f0-baba-9ecb7e506ba5 service nova] Creating event network-changed:d88b6e2d-26aa-4d23-b6b8-904a2c1ea687 for instance 8220873b-1b5e-457b-911a-1cd53303f7d9 on n-h1-850468-16 Aug 23 18:14:57.145733 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-894ffa05-4a75-430a-8c38-22bc5a2e96bb req-08a47a3e-58fe-43f0-baba-9ecb7e506ba5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.120916 Aug 23 18:14:57.150780 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2432/4760] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:14:57.162349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8c6acfd-7d69-476d-87bf-8f4ed015c2fe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:57.166859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8c6acfd-7d69-476d-87bf-8f4ed015c2fe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:57.182427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8c6acfd-7d69-476d-87bf-8f4ed015c2fe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:57.186641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8c6acfd-7d69-476d-87bf-8f4ed015c2fe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:57.190022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8c6acfd-7d69-476d-87bf-8f4ed015c2fe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:57.197979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8c6acfd-7d69-476d-87bf-8f4ed015c2fe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:57.198772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8c6acfd-7d69-476d-87bf-8f4ed015c2fe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:57.201400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8c6acfd-7d69-476d-87bf-8f4ed015c2fe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:57.719444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f88dbc99-421d-4492-82bc-27659f99dd82 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:57.734765 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f88dbc99-421d-4492-82bc-27659f99dd82 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1327 microversion: 2.1 time: 1.284243 Aug 23 18:14:57.735928 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2329/4761] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:56 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1327 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:57.754222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d8691661-095f-4a0d-8210-9ec36c4c5cd1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:57.754222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d8691661-095f-4a0d-8210-9ec36c4c5cd1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:57.770421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8691661-095f-4a0d-8210-9ec36c4c5cd1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:57.771107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8691661-095f-4a0d-8210-9ec36c4c5cd1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:57.775500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8691661-095f-4a0d-8210-9ec36c4c5cd1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:57.776719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8691661-095f-4a0d-8210-9ec36c4c5cd1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:57.777416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8691661-095f-4a0d-8210-9ec36c4c5cd1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:57.784310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8691661-095f-4a0d-8210-9ec36c4c5cd1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:57.791168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:14:57.930407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8c6acfd-7d69-476d-87bf-8f4ed015c2fe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:57.940681 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8c6acfd-7d69-476d-87bf-8f4ed015c2fe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1511 microversion: 2.1 time: 0.786796 Aug 23 18:14:57.951758 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2433/4762] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:57 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1511 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:58.413358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d8691661-095f-4a0d-8210-9ec36c4c5cd1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:58.441386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d8691661-095f-4a0d-8210-9ec36c4c5cd1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:58.442938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d8691661-095f-4a0d-8210-9ec36c4c5cd1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:58.444135 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d8691661-095f-4a0d-8210-9ec36c4c5cd1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1848 microversion: 2.42 time: 0.706977 Aug 23 18:14:58.457888 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2330/4763] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:57 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1848 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:14:58.759013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7ef28ede-3a93-4f4c-9d85-1c20c01bf5fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:58.759805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7ef28ede-3a93-4f4c-9d85-1c20c01bf5fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:58.771259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ef28ede-3a93-4f4c-9d85-1c20c01bf5fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:58.771758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ef28ede-3a93-4f4c-9d85-1c20c01bf5fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:58.772198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ef28ede-3a93-4f4c-9d85-1c20c01bf5fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:58.779250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ef28ede-3a93-4f4c-9d85-1c20c01bf5fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:58.779769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ef28ede-3a93-4f4c-9d85-1c20c01bf5fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:58.780224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ef28ede-3a93-4f4c-9d85-1c20c01bf5fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:58.819514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-2123412789", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "9aef36ae-8f20-4cdd-9f12-7033d5646009"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:14:58.937692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] validate_networks() for [('9aef36ae-8f20-4cdd-9f12-7033d5646009', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:14:59.456797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7ef28ede-3a93-4f4c-9d85-1c20c01bf5fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:59.482771 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7ef28ede-3a93-4f4c-9d85-1c20c01bf5fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1327 microversion: 2.1 time: 0.727210 Aug 23 18:14:59.484083 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2331/4764] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:58 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1327 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:14:59.489061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6dafd308-baf9-4015-90aa-5ab4a3d56b32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:59.489934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6dafd308-baf9-4015-90aa-5ab4a3d56b32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:59.507771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dafd308-baf9-4015-90aa-5ab4a3d56b32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:59.508536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dafd308-baf9-4015-90aa-5ab4a3d56b32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:59.509756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dafd308-baf9-4015-90aa-5ab4a3d56b32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:59.510700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dafd308-baf9-4015-90aa-5ab4a3d56b32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:59.511350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dafd308-baf9-4015-90aa-5ab4a3d56b32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:59.511939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dafd308-baf9-4015-90aa-5ab4a3d56b32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:59.934573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6dafd308-baf9-4015-90aa-5ab4a3d56b32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:14:59.937633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:14:59.939094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:14:59.939352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:14:59.939770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:14:59.940207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:14:59.957974 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6dafd308-baf9-4015-90aa-5ab4a3d56b32 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1511 microversion: 2.1 time: 0.465990 Aug 23 18:14:59.960064 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2332/4765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:14:59 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1511 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:14:59.965286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ef77e5a5-5df2-40f3-8fb9-29146ed8244c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:14:59.966257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ef77e5a5-5df2-40f3-8fb9-29146ed8244c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:14:59.970938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:59.971434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:59.972818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:14:59.975958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:14:59.979882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:14:59.982683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:00.006224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef77e5a5-5df2-40f3-8fb9-29146ed8244c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:00.019355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef77e5a5-5df2-40f3-8fb9-29146ed8244c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:00.021802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef77e5a5-5df2-40f3-8fb9-29146ed8244c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:00.022471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef77e5a5-5df2-40f3-8fb9-29146ed8244c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:00.024664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef77e5a5-5df2-40f3-8fb9-29146ed8244c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:00.028990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef77e5a5-5df2-40f3-8fb9-29146ed8244c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:00.069960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Getting quotas for project aef96dcb236245a9941a1a675349d488. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:15:00.095597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Getting quotas for user f25058d9281b470ab93d69d03170df41 and project aef96dcb236245a9941a1a675349d488. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:15:00.154001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Going to run 3 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:15:00.156421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: ee31abc5-c0cf-4333-8a58-d8c5a174d41e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:15:00.257826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 241aa9bc-9119-44f1-a747-084625b73f3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=ee31abc5-c0cf-4333-8a58-d8c5a174d41e,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:15:00.337242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=241aa9bc-9119-44f1-a747-084625b73f3c,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:15:00.507978 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-404b06cf-165b-4eda-9ca3-0ebf65f1f840 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.087681 Aug 23 18:15:00.515540 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2434/4766] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 2092 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:15:00.529446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7a7680c3-86c4-4eeb-a1ae-4d4b6137efc3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:00.530364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7a7680c3-86c4-4eeb-a1ae-4d4b6137efc3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:00.551257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a7680c3-86c4-4eeb-a1ae-4d4b6137efc3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:00.551820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a7680c3-86c4-4eeb-a1ae-4d4b6137efc3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:00.556095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a7680c3-86c4-4eeb-a1ae-4d4b6137efc3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:00.560471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a7680c3-86c4-4eeb-a1ae-4d4b6137efc3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:00.564373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a7680c3-86c4-4eeb-a1ae-4d4b6137efc3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:00.564880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a7680c3-86c4-4eeb-a1ae-4d4b6137efc3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:01.036274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a7680c3-86c4-4eeb-a1ae-4d4b6137efc3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:01.047952 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7a7680c3-86c4-4eeb-a1ae-4d4b6137efc3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1327 microversion: 2.1 time: 0.534458 Aug 23 18:15:01.050760 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2435/4767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:00 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1327 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:01.059180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f7f4161-7786-4625-9ab3-e27143fa7dae tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:01.090103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7f7f4161-7786-4625-9ab3-e27143fa7dae tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:01.099719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7f7f4161-7786-4625-9ab3-e27143fa7dae tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Searching by: {'deleted': False, 'project_id': 'aef96dcb236245a9941a1a675349d488'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:15:01.130583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f7f4161-7786-4625-9ab3-e27143fa7dae tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:01.131449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f7f4161-7786-4625-9ab3-e27143fa7dae tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:01.132066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f7f4161-7786-4625-9ab3-e27143fa7dae tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:01.132998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f7f4161-7786-4625-9ab3-e27143fa7dae tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:01.133715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f7f4161-7786-4625-9ab3-e27143fa7dae tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:01.135046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f7f4161-7786-4625-9ab3-e27143fa7dae tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:01.166735 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7f7f4161-7786-4625-9ab3-e27143fa7dae tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.114641 Aug 23 18:15:01.168020 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2436/4768] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 18:15:01 2022] GET /compute/v2.1/servers => generated 1018 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:01.172985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b4dd2290-c5b6-4184-af0f-672257f221c1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:01.174033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b4dd2290-c5b6-4184-af0f-672257f221c1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:01.178965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ef77e5a5-5df2-40f3-8fb9-29146ed8244c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:01.190776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4dd2290-c5b6-4184-af0f-672257f221c1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:01.192474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4dd2290-c5b6-4184-af0f-672257f221c1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:01.197753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4dd2290-c5b6-4184-af0f-672257f221c1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:01.198877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4dd2290-c5b6-4184-af0f-672257f221c1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:01.199581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4dd2290-c5b6-4184-af0f-672257f221c1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:01.200229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b4dd2290-c5b6-4184-af0f-672257f221c1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:01.205175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ef77e5a5-5df2-40f3-8fb9-29146ed8244c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:01.210787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ef77e5a5-5df2-40f3-8fb9-29146ed8244c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:01.213435 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ef77e5a5-5df2-40f3-8fb9-29146ed8244c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1848 microversion: 2.42 time: 1.252309 Aug 23 18:15:01.214963 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2333/4769] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:14:59 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1848 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:01.263145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3cbf2828-d32d-4755-a96d-015eb8d5db64 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:01.263820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3cbf2828-d32d-4755-a96d-015eb8d5db64 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:01.423458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3cbf2828-d32d-4755-a96d-015eb8d5db64 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:01.431884 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3cbf2828-d32d-4755-a96d-015eb8d5db64 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1223 microversion: 2.1 time: 0.194310 Aug 23 18:15:01.435893 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2334/4770] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:01 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1223 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:01.445756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-dc76dd34-f735-416d-84f8-5b7491d2b004 req-3c7944e8-4ad3-42b9-ac1c-93c76e3da573 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "tag": "7044c5c8-0b1d-4f05-bb0b-77bde6537776"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:01.471547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dc76dd34-f735-416d-84f8-5b7491d2b004 req-3c7944e8-4ad3-42b9-ac1c-93c76e3da573 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:01.472424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dc76dd34-f735-416d-84f8-5b7491d2b004 req-3c7944e8-4ad3-42b9-ac1c-93c76e3da573 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:01.478367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dc76dd34-f735-416d-84f8-5b7491d2b004 req-3c7944e8-4ad3-42b9-ac1c-93c76e3da573 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:01.490420 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-dc76dd34-f735-416d-84f8-5b7491d2b004 req-3c7944e8-4ad3-42b9-ac1c-93c76e3da573 service nova] Creating event network-changed:7044c5c8-0b1d-4f05-bb0b-77bde6537776 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:15:01.496936 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-dc76dd34-f735-416d-84f8-5b7491d2b004 req-3c7944e8-4ad3-42b9-ac1c-93c76e3da573 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058042 Aug 23 18:15:01.499010 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2335/4771] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:01.547331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b4dd2290-c5b6-4184-af0f-672257f221c1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:01.556057 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b4dd2290-c5b6-4184-af0f-672257f221c1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1511 microversion: 2.1 time: 0.386765 Aug 23 18:15:01.559047 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2437/4772] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:01 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1511 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:02.080468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e2901cf4-f8f6-479d-9127-7bb809993c57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:02.085211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e2901cf4-f8f6-479d-9127-7bb809993c57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:02.117026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2901cf4-f8f6-479d-9127-7bb809993c57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:02.124329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2901cf4-f8f6-479d-9127-7bb809993c57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:02.141178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2901cf4-f8f6-479d-9127-7bb809993c57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:02.143717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2901cf4-f8f6-479d-9127-7bb809993c57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:02.144076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2901cf4-f8f6-479d-9127-7bb809993c57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:02.146235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2901cf4-f8f6-479d-9127-7bb809993c57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:02.240019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c4e7ebd3-4622-4f89-b534-f8434f0cbf05 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:02.241304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c4e7ebd3-4622-4f89-b534-f8434f0cbf05 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:02.262565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4e7ebd3-4622-4f89-b534-f8434f0cbf05 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:02.270914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4e7ebd3-4622-4f89-b534-f8434f0cbf05 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:02.277299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4e7ebd3-4622-4f89-b534-f8434f0cbf05 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:02.285671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4e7ebd3-4622-4f89-b534-f8434f0cbf05 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:02.296288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4e7ebd3-4622-4f89-b534-f8434f0cbf05 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:02.296862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4e7ebd3-4622-4f89-b534-f8434f0cbf05 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:02.906523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c4e7ebd3-4622-4f89-b534-f8434f0cbf05 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:02.925035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c4e7ebd3-4622-4f89-b534-f8434f0cbf05 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:02.933575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c4e7ebd3-4622-4f89-b534-f8434f0cbf05 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:02.939363 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c4e7ebd3-4622-4f89-b534-f8434f0cbf05 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1848 microversion: 2.42 time: 0.701547 Aug 23 18:15:02.941677 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2438/4773] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:02 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1848 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:15:02.957994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-999aec6e-e8a4-441f-a0f8-e30dcb200e08 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:02.958647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-999aec6e-e8a4-441f-a0f8-e30dcb200e08 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:03.211422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-999aec6e-e8a4-441f-a0f8-e30dcb200e08 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:03.221395 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-999aec6e-e8a4-441f-a0f8-e30dcb200e08 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1223 microversion: 2.1 time: 0.278495 Aug 23 18:15:03.221989 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2439/4774] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:02 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1223 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:03.255394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-19297cdc-4d66-4a8c-9947-462bf445bc0d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:03.263841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-19297cdc-4d66-4a8c-9947-462bf445bc0d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:03.274322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19297cdc-4d66-4a8c-9947-462bf445bc0d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:03.274850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19297cdc-4d66-4a8c-9947-462bf445bc0d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:03.293300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19297cdc-4d66-4a8c-9947-462bf445bc0d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:03.296587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19297cdc-4d66-4a8c-9947-462bf445bc0d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:03.297317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19297cdc-4d66-4a8c-9947-462bf445bc0d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:03.297536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19297cdc-4d66-4a8c-9947-462bf445bc0d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:03.497647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e2901cf4-f8f6-479d-9127-7bb809993c57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:03.513985 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e2901cf4-f8f6-479d-9127-7bb809993c57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1327 microversion: 2.1 time: 1.443717 Aug 23 18:15:03.519146 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2336/4775] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:02 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1327 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:03.862515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-19297cdc-4d66-4a8c-9947-462bf445bc0d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:03.884318 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-19297cdc-4d66-4a8c-9947-462bf445bc0d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1511 microversion: 2.1 time: 0.646713 Aug 23 18:15:03.887689 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2440/4776] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:03 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1511 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:03.980977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-22939702-dfc1-43d8-bd74-db802923c88f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:03.981674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-22939702-dfc1-43d8-bd74-db802923c88f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:03.995966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22939702-dfc1-43d8-bd74-db802923c88f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:03.996554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22939702-dfc1-43d8-bd74-db802923c88f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:04.021276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22939702-dfc1-43d8-bd74-db802923c88f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:04.028376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22939702-dfc1-43d8-bd74-db802923c88f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:04.031684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22939702-dfc1-43d8-bd74-db802923c88f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:04.032145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22939702-dfc1-43d8-bd74-db802923c88f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:04.250445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6c6ea575-7247-4ca3-ad01-871a55faa743 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:04.252108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6c6ea575-7247-4ca3-ad01-871a55faa743 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:04.265528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c6ea575-7247-4ca3-ad01-871a55faa743 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:04.266849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c6ea575-7247-4ca3-ad01-871a55faa743 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:04.268991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c6ea575-7247-4ca3-ad01-871a55faa743 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:04.271929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c6ea575-7247-4ca3-ad01-871a55faa743 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:04.272430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c6ea575-7247-4ca3-ad01-871a55faa743 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:04.272882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c6ea575-7247-4ca3-ad01-871a55faa743 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:04.662262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6c6ea575-7247-4ca3-ad01-871a55faa743 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:04.677785 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6c6ea575-7247-4ca3-ad01-871a55faa743 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1275 microversion: 2.1 time: 0.434560 Aug 23 18:15:04.678402 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2441/4777] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:04 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1275 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:04.709933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-06e6b16b-5144-4cca-b373-91188f5b8457 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:04.713037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-06e6b16b-5144-4cca-b373-91188f5b8457 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:04.738387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06e6b16b-5144-4cca-b373-91188f5b8457 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:04.738936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06e6b16b-5144-4cca-b373-91188f5b8457 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:04.739390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06e6b16b-5144-4cca-b373-91188f5b8457 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:04.740145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06e6b16b-5144-4cca-b373-91188f5b8457 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:04.740597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06e6b16b-5144-4cca-b373-91188f5b8457 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:04.749790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06e6b16b-5144-4cca-b373-91188f5b8457 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:05.192494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22939702-dfc1-43d8-bd74-db802923c88f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:05.246816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22939702-dfc1-43d8-bd74-db802923c88f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:05.254496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22939702-dfc1-43d8-bd74-db802923c88f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:05.264602 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-22939702-dfc1-43d8-bd74-db802923c88f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1848 microversion: 2.42 time: 1.301032 Aug 23 18:15:05.267566 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2337/4778] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:03 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1848 bytes in 1306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:05.290739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-207cbe11-27bf-4653-9173-a979d1b9b16b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:05.294722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-207cbe11-27bf-4653-9173-a979d1b9b16b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:05.325056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-207cbe11-27bf-4653-9173-a979d1b9b16b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:05.344211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-207cbe11-27bf-4653-9173-a979d1b9b16b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:05.346085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-207cbe11-27bf-4653-9173-a979d1b9b16b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:05.347173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-207cbe11-27bf-4653-9173-a979d1b9b16b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:05.350277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-207cbe11-27bf-4653-9173-a979d1b9b16b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:05.350946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-207cbe11-27bf-4653-9173-a979d1b9b16b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:05.580597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-06e6b16b-5144-4cca-b373-91188f5b8457 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:05.591634 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-06e6b16b-5144-4cca-b373-91188f5b8457 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1327 microversion: 2.1 time: 0.908612 Aug 23 18:15:05.596155 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2442/4779] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:04 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1327 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:05.701970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b356b93-1a69-44c8-aa9a-66395bf589a8 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:05.702749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3b356b93-1a69-44c8-aa9a-66395bf589a8 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:05.719753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b356b93-1a69-44c8-aa9a-66395bf589a8 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:05.720544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b356b93-1a69-44c8-aa9a-66395bf589a8 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:05.721155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b356b93-1a69-44c8-aa9a-66395bf589a8 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:05.722037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b356b93-1a69-44c8-aa9a-66395bf589a8 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:05.722691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b356b93-1a69-44c8-aa9a-66395bf589a8 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:05.723290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b356b93-1a69-44c8-aa9a-66395bf589a8 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:05.889147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3b356b93-1a69-44c8-aa9a-66395bf589a8 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:05.900814 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3b356b93-1a69-44c8-aa9a-66395bf589a8 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1281 microversion: 2.1 time: 0.202350 Aug 23 18:15:05.916353 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2443/4780] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:05 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1281 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:06.105894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-207cbe11-27bf-4653-9173-a979d1b9b16b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:06.117388 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-207cbe11-27bf-4653-9173-a979d1b9b16b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1511 microversion: 2.1 time: 0.848276 Aug 23 18:15:06.127172 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2338/4781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:05 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1511 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:06.296614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-885a9446-a037-4863-a8fa-b110a04ceac2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:06.297720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-885a9446-a037-4863-a8fa-b110a04ceac2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:06.314916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-885a9446-a037-4863-a8fa-b110a04ceac2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:06.315767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-885a9446-a037-4863-a8fa-b110a04ceac2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:06.317013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-885a9446-a037-4863-a8fa-b110a04ceac2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:06.319662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-885a9446-a037-4863-a8fa-b110a04ceac2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:06.320637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-885a9446-a037-4863-a8fa-b110a04ceac2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:06.322982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-885a9446-a037-4863-a8fa-b110a04ceac2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:06.462724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-eb9a2bec-8c63-43b8-bb56-4dc94373701b req-cbaa65d1-5136-4225-9be4-7276cc0d5a30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8220873b-1b5e-457b-911a-1cd53303f7d9", "name": "network-vif-plugged", "status": "completed", "tag": "d88b6e2d-26aa-4d23-b6b8-904a2c1ea687"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:06.496929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-eb9a2bec-8c63-43b8-bb56-4dc94373701b req-cbaa65d1-5136-4225-9be4-7276cc0d5a30 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:06.507511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-eb9a2bec-8c63-43b8-bb56-4dc94373701b req-cbaa65d1-5136-4225-9be4-7276cc0d5a30 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:06.508199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-eb9a2bec-8c63-43b8-bb56-4dc94373701b req-cbaa65d1-5136-4225-9be4-7276cc0d5a30 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:06.533960 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-eb9a2bec-8c63-43b8-bb56-4dc94373701b req-cbaa65d1-5136-4225-9be4-7276cc0d5a30 service nova] Creating event network-vif-plugged:d88b6e2d-26aa-4d23-b6b8-904a2c1ea687 for instance 8220873b-1b5e-457b-911a-1cd53303f7d9 on n-h1-850468-16 Aug 23 18:15:06.551179 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-eb9a2bec-8c63-43b8-bb56-4dc94373701b req-cbaa65d1-5136-4225-9be4-7276cc0d5a30 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091099 Aug 23 18:15:06.551179 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2339/4782] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:15:06.607259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-407438d5-acf0-435a-a598-ab3a9f781785 req-c0d15a1a-9462-43d1-be5e-9064b30fee5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "tag": "3e0b7dcf-3e88-405c-abd5-d6403cd681d8"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:06.643837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-407438d5-acf0-435a-a598-ab3a9f781785 req-c0d15a1a-9462-43d1-be5e-9064b30fee5a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:06.644918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-407438d5-acf0-435a-a598-ab3a9f781785 req-c0d15a1a-9462-43d1-be5e-9064b30fee5a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:06.645482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-407438d5-acf0-435a-a598-ab3a9f781785 req-c0d15a1a-9462-43d1-be5e-9064b30fee5a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:06.664656 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-407438d5-acf0-435a-a598-ab3a9f781785 req-c0d15a1a-9462-43d1-be5e-9064b30fee5a service nova] Creating event network-changed:3e0b7dcf-3e88-405c-abd5-d6403cd681d8 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:15:06.674591 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-407438d5-acf0-435a-a598-ab3a9f781785 req-c0d15a1a-9462-43d1-be5e-9064b30fee5a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107946 Aug 23 18:15:06.676155 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2340/4783] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:06.699837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8346696a-1919-48b3-baa8-c978f4a537c9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:06.700704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8346696a-1919-48b3-baa8-c978f4a537c9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:06.716045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8346696a-1919-48b3-baa8-c978f4a537c9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:06.716745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8346696a-1919-48b3-baa8-c978f4a537c9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:06.717393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8346696a-1919-48b3-baa8-c978f4a537c9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:06.718688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8346696a-1919-48b3-baa8-c978f4a537c9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:06.719415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8346696a-1919-48b3-baa8-c978f4a537c9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:06.720003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8346696a-1919-48b3-baa8-c978f4a537c9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:06.928042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-885a9446-a037-4863-a8fa-b110a04ceac2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:06.941344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-885a9446-a037-4863-a8fa-b110a04ceac2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:06.942897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-885a9446-a037-4863-a8fa-b110a04ceac2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:06.944304 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-885a9446-a037-4863-a8fa-b110a04ceac2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1869 microversion: 2.42 time: 0.654212 Aug 23 18:15:06.959135 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2444/4784] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:06 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1869 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:06.980548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-edc08b72-12e2-4c75-bb10-9a0009194f59 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:06.981251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-edc08b72-12e2-4c75-bb10-9a0009194f59 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:07.003935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edc08b72-12e2-4c75-bb10-9a0009194f59 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:07.004453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edc08b72-12e2-4c75-bb10-9a0009194f59 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:07.005027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edc08b72-12e2-4c75-bb10-9a0009194f59 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:07.005769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edc08b72-12e2-4c75-bb10-9a0009194f59 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:07.006239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edc08b72-12e2-4c75-bb10-9a0009194f59 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:07.006708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-edc08b72-12e2-4c75-bb10-9a0009194f59 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:07.210425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-edc08b72-12e2-4c75-bb10-9a0009194f59 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:07.223220 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-edc08b72-12e2-4c75-bb10-9a0009194f59 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1281 microversion: 2.1 time: 0.262611 Aug 23 18:15:07.224079 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2445/4785] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:06 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1281 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:07.241413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5eeae9bf-d9fb-46f4-b466-25a90760ae79 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:07.242305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5eeae9bf-d9fb-46f4-b466-25a90760ae79 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:07.254717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5eeae9bf-d9fb-46f4-b466-25a90760ae79 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:07.255545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5eeae9bf-d9fb-46f4-b466-25a90760ae79 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:07.256754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5eeae9bf-d9fb-46f4-b466-25a90760ae79 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:07.257682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5eeae9bf-d9fb-46f4-b466-25a90760ae79 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:07.262680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5eeae9bf-d9fb-46f4-b466-25a90760ae79 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:07.264147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5eeae9bf-d9fb-46f4-b466-25a90760ae79 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:07.269298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:07.655095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5eeae9bf-d9fb-46f4-b466-25a90760ae79 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:07.667022 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5eeae9bf-d9fb-46f4-b466-25a90760ae79 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1532 microversion: 2.1 time: 0.441499 Aug 23 18:15:07.668758 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2446/4786] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:07 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1532 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:07.943119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8346696a-1919-48b3-baa8-c978f4a537c9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:07.961312 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8346696a-1919-48b3-baa8-c978f4a537c9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1327 microversion: 2.1 time: 1.282067 Aug 23 18:15:07.967129 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2341/4787] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:06 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1327 bytes in 1290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:07.982528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-72432516-e9f0-4a53-8c0c-483826ff8b4b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:07.983798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-72432516-e9f0-4a53-8c0c-483826ff8b4b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:07.994086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72432516-e9f0-4a53-8c0c-483826ff8b4b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:07.994880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72432516-e9f0-4a53-8c0c-483826ff8b4b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:07.995384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72432516-e9f0-4a53-8c0c-483826ff8b4b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:07.996113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72432516-e9f0-4a53-8c0c-483826ff8b4b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:07.996671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72432516-e9f0-4a53-8c0c-483826ff8b4b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:07.997080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72432516-e9f0-4a53-8c0c-483826ff8b4b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:08.245611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8bba8591-aab0-4fd0-82e2-d4ad4e17f6c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:08.246356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8bba8591-aab0-4fd0-82e2-d4ad4e17f6c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:08.257939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8bba8591-aab0-4fd0-82e2-d4ad4e17f6c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:08.260982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8bba8591-aab0-4fd0-82e2-d4ad4e17f6c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:08.261670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8bba8591-aab0-4fd0-82e2-d4ad4e17f6c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:08.264612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8bba8591-aab0-4fd0-82e2-d4ad4e17f6c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:08.265288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8bba8591-aab0-4fd0-82e2-d4ad4e17f6c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:08.271632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8bba8591-aab0-4fd0-82e2-d4ad4e17f6c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:08.377609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-72432516-e9f0-4a53-8c0c-483826ff8b4b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:08.404855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-72432516-e9f0-4a53-8c0c-483826ff8b4b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:08.407722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-72432516-e9f0-4a53-8c0c-483826ff8b4b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:08.420769 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-72432516-e9f0-4a53-8c0c-483826ff8b4b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1869 microversion: 2.42 time: 0.440124 Aug 23 18:15:08.421628 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2447/4788] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:07 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1869 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:08.456615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8bba8591-aab0-4fd0-82e2-d4ad4e17f6c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:08.470716 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8bba8591-aab0-4fd0-82e2-d4ad4e17f6c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1281 microversion: 2.1 time: 0.227737 Aug 23 18:15:08.471989 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2342/4789] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:08 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1281 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:08.694326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-79b91856-52b1-4264-92e9-68a1975a48f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:08.695236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-79b91856-52b1-4264-92e9-68a1975a48f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:08.717807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-79b91856-52b1-4264-92e9-68a1975a48f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:08.719258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-79b91856-52b1-4264-92e9-68a1975a48f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:08.721050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-79b91856-52b1-4264-92e9-68a1975a48f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:08.724454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-79b91856-52b1-4264-92e9-68a1975a48f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:08.725768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-79b91856-52b1-4264-92e9-68a1975a48f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:08.726859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-79b91856-52b1-4264-92e9-68a1975a48f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:08.991467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8df917a3-9830-4c0d-b125-fd7b4a6b415e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:08.992220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8df917a3-9830-4c0d-b125-fd7b4a6b415e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:08.995981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:09.028153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8df917a3-9830-4c0d-b125-fd7b4a6b415e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:09.032449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8df917a3-9830-4c0d-b125-fd7b4a6b415e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:09.036184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8df917a3-9830-4c0d-b125-fd7b4a6b415e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:09.046280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8df917a3-9830-4c0d-b125-fd7b4a6b415e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:09.047883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8df917a3-9830-4c0d-b125-fd7b4a6b415e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:09.048648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8df917a3-9830-4c0d-b125-fd7b4a6b415e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:09.073310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-79b91856-52b1-4264-92e9-68a1975a48f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:09.089943 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-79b91856-52b1-4264-92e9-68a1975a48f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1532 microversion: 2.1 time: 0.400424 Aug 23 18:15:09.093397 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2448/4790] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:08 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1532 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:09.338167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-fdfd51d1-69ff-4da7-87f5-47a9a42b90cd req-45bab646-9dd7-41a9-8a54-6612d3452772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "tag": "e4c1ae5d-4bd7-4ff2-ac13-c687df447854"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:09.360298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:09.379411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fdfd51d1-69ff-4da7-87f5-47a9a42b90cd req-45bab646-9dd7-41a9-8a54-6612d3452772 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:09.380091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fdfd51d1-69ff-4da7-87f5-47a9a42b90cd req-45bab646-9dd7-41a9-8a54-6612d3452772 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:09.383133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fdfd51d1-69ff-4da7-87f5-47a9a42b90cd req-45bab646-9dd7-41a9-8a54-6612d3452772 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:09.416508 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-fdfd51d1-69ff-4da7-87f5-47a9a42b90cd req-45bab646-9dd7-41a9-8a54-6612d3452772 service nova] Creating event network-changed:e4c1ae5d-4bd7-4ff2-ac13-c687df447854 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:15:09.423167 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-fdfd51d1-69ff-4da7-87f5-47a9a42b90cd req-45bab646-9dd7-41a9-8a54-6612d3452772 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091271 Aug 23 18:15:09.427644 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2449/4791] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:09.450072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-191b764a-f1c8-4770-81ea-3219788ecca0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:09.451014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-191b764a-f1c8-4770-81ea-3219788ecca0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:09.469707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-191b764a-f1c8-4770-81ea-3219788ecca0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:09.483371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-191b764a-f1c8-4770-81ea-3219788ecca0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:09.484109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-191b764a-f1c8-4770-81ea-3219788ecca0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:09.485052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-191b764a-f1c8-4770-81ea-3219788ecca0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:09.485701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-191b764a-f1c8-4770-81ea-3219788ecca0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:09.486334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-191b764a-f1c8-4770-81ea-3219788ecca0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:09.689731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8df917a3-9830-4c0d-b125-fd7b4a6b415e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:09.698556 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8df917a3-9830-4c0d-b125-fd7b4a6b415e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1327 microversion: 2.1 time: 0.711680 Aug 23 18:15:09.699173 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2343/4792] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:08 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1327 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:09.720785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1d2e3793-d59b-41b0-818a-99b472d9d815 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:09.721413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1d2e3793-d59b-41b0-818a-99b472d9d815 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:09.753249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d2e3793-d59b-41b0-818a-99b472d9d815 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:09.753772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d2e3793-d59b-41b0-818a-99b472d9d815 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:09.757067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d2e3793-d59b-41b0-818a-99b472d9d815 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:09.764353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d2e3793-d59b-41b0-818a-99b472d9d815 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:09.764870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d2e3793-d59b-41b0-818a-99b472d9d815 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:09.765343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d2e3793-d59b-41b0-818a-99b472d9d815 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:09.908318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-191b764a-f1c8-4770-81ea-3219788ecca0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:09.921606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-191b764a-f1c8-4770-81ea-3219788ecca0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:09.923398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-191b764a-f1c8-4770-81ea-3219788ecca0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:09.925570 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-191b764a-f1c8-4770-81ea-3219788ecca0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1890 microversion: 2.42 time: 0.480914 Aug 23 18:15:09.927210 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2450/4793] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:09 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1890 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:15:10.072506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1d2e3793-d59b-41b0-818a-99b472d9d815 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:10.080783 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1d2e3793-d59b-41b0-818a-99b472d9d815 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1281 microversion: 2.1 time: 0.380604 Aug 23 18:15:10.083367 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2344/4794] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:09 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1281 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:10.119219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-df1c29ca-d3d4-4d2e-8955-aaf68f2540b6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:10.120482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-df1c29ca-d3d4-4d2e-8955-aaf68f2540b6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:10.141911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df1c29ca-d3d4-4d2e-8955-aaf68f2540b6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:10.145980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df1c29ca-d3d4-4d2e-8955-aaf68f2540b6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:10.147240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df1c29ca-d3d4-4d2e-8955-aaf68f2540b6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:10.148239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df1c29ca-d3d4-4d2e-8955-aaf68f2540b6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:10.150081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df1c29ca-d3d4-4d2e-8955-aaf68f2540b6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:10.153544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df1c29ca-d3d4-4d2e-8955-aaf68f2540b6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:10.538270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-df1c29ca-d3d4-4d2e-8955-aaf68f2540b6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:10.565208 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-df1c29ca-d3d4-4d2e-8955-aaf68f2540b6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1532 microversion: 2.1 time: 0.450316 Aug 23 18:15:10.568412 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2451/4795] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:10 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1532 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:10.720815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f61aa547-ae9c-4799-8e82-9db491fce321 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:10.721788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f61aa547-ae9c-4799-8e82-9db491fce321 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:10.739154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f61aa547-ae9c-4799-8e82-9db491fce321 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:10.741604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f61aa547-ae9c-4799-8e82-9db491fce321 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:10.742273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f61aa547-ae9c-4799-8e82-9db491fce321 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:10.746013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f61aa547-ae9c-4799-8e82-9db491fce321 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:10.746834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f61aa547-ae9c-4799-8e82-9db491fce321 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:10.747519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f61aa547-ae9c-4799-8e82-9db491fce321 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:10.954500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8764d4f8-54a7-4f86-b9b3-b83d6089890e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:10.956358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8764d4f8-54a7-4f86-b9b3-b83d6089890e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:10.978050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8764d4f8-54a7-4f86-b9b3-b83d6089890e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:10.979398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8764d4f8-54a7-4f86-b9b3-b83d6089890e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:10.982435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8764d4f8-54a7-4f86-b9b3-b83d6089890e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:10.983598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8764d4f8-54a7-4f86-b9b3-b83d6089890e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:10.984362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8764d4f8-54a7-4f86-b9b3-b83d6089890e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:10.985147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8764d4f8-54a7-4f86-b9b3-b83d6089890e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:11.148902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:11.432516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:11.457379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8764d4f8-54a7-4f86-b9b3-b83d6089890e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:11.473033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8764d4f8-54a7-4f86-b9b3-b83d6089890e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:11.474904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8764d4f8-54a7-4f86-b9b3-b83d6089890e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:11.479169 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8764d4f8-54a7-4f86-b9b3-b83d6089890e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1890 microversion: 2.42 time: 0.530325 Aug 23 18:15:11.490591 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2452/4796] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:10 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1890 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:11.499940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-21945a35-cb06-4fe2-b294-0e0313e5b345 req-86539f67-4c96-4eb1-824c-948f6a62f85f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cad0fb-87b4-403c-9881-64ce147502fd", "name": "network-vif-plugged", "status": "completed", "tag": "933227f8-f35c-4a4d-8cd9-453f1505d7a3"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:11.514945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-21945a35-cb06-4fe2-b294-0e0313e5b345 req-86539f67-4c96-4eb1-824c-948f6a62f85f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:11.522278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-21945a35-cb06-4fe2-b294-0e0313e5b345 req-86539f67-4c96-4eb1-824c-948f6a62f85f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:11.525836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-21945a35-cb06-4fe2-b294-0e0313e5b345 req-86539f67-4c96-4eb1-824c-948f6a62f85f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:11.565925 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-21945a35-cb06-4fe2-b294-0e0313e5b345 req-86539f67-4c96-4eb1-824c-948f6a62f85f service nova] Creating event network-vif-plugged:933227f8-f35c-4a4d-8cd9-453f1505d7a3 for instance f1cad0fb-87b4-403c-9881-64ce147502fd on n-h2-850468-16 Aug 23 18:15:11.572066 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-21945a35-cb06-4fe2-b294-0e0313e5b345 req-86539f67-4c96-4eb1-824c-948f6a62f85f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081038 Aug 23 18:15:11.573005 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2453/4797] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:11.580808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-10c8dd74-a093-4c49-ab5c-4109f9fc0d85 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:11.581812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-10c8dd74-a093-4c49-ab5c-4109f9fc0d85 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:11.596169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10c8dd74-a093-4c49-ab5c-4109f9fc0d85 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:11.601870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10c8dd74-a093-4c49-ab5c-4109f9fc0d85 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:11.602828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10c8dd74-a093-4c49-ab5c-4109f9fc0d85 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:11.605962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10c8dd74-a093-4c49-ab5c-4109f9fc0d85 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:11.608666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10c8dd74-a093-4c49-ab5c-4109f9fc0d85 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:11.609390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10c8dd74-a093-4c49-ab5c-4109f9fc0d85 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:12.083770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f61aa547-ae9c-4799-8e82-9db491fce321 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:12.096629 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f61aa547-ae9c-4799-8e82-9db491fce321 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1507 microversion: 2.1 time: 1.380183 Aug 23 18:15:12.097164 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2345/4798] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:10 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1507 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:12.108818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bbc97dec-08fe-4868-b457-6e24641afd04 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:12.110507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bbc97dec-08fe-4868-b457-6e24641afd04 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:12.124524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbc97dec-08fe-4868-b457-6e24641afd04 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:12.126421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbc97dec-08fe-4868-b457-6e24641afd04 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:12.127811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbc97dec-08fe-4868-b457-6e24641afd04 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:12.129463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbc97dec-08fe-4868-b457-6e24641afd04 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:12.130575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbc97dec-08fe-4868-b457-6e24641afd04 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:12.132793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbc97dec-08fe-4868-b457-6e24641afd04 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:12.148468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-10c8dd74-a093-4c49-ab5c-4109f9fc0d85 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:12.161771 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-10c8dd74-a093-4c49-ab5c-4109f9fc0d85 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1323 microversion: 2.1 time: 0.586928 Aug 23 18:15:12.163537 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2454/4799] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:11 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1323 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:12.170093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-347c64b0-6d94-412c-9703-c400c6546ca4 req-5bd0fcf5-d95a-44fe-a3e0-52bd1aaf9e85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee31abc5-c0cf-4333-8a58-d8c5a174d41e", "tag": "15fbf67e-03c7-48e5-8997-2f7146575424"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:12.197319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-347c64b0-6d94-412c-9703-c400c6546ca4 req-5bd0fcf5-d95a-44fe-a3e0-52bd1aaf9e85 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:12.197944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-347c64b0-6d94-412c-9703-c400c6546ca4 req-5bd0fcf5-d95a-44fe-a3e0-52bd1aaf9e85 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:12.198407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-347c64b0-6d94-412c-9703-c400c6546ca4 req-5bd0fcf5-d95a-44fe-a3e0-52bd1aaf9e85 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:12.218296 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-347c64b0-6d94-412c-9703-c400c6546ca4 req-5bd0fcf5-d95a-44fe-a3e0-52bd1aaf9e85 service nova] Creating event network-changed:15fbf67e-03c7-48e5-8997-2f7146575424 for instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e on n-h2-850468-16 Aug 23 18:15:12.225056 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-347c64b0-6d94-412c-9703-c400c6546ca4 req-5bd0fcf5-d95a-44fe-a3e0-52bd1aaf9e85 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057994 Aug 23 18:15:12.226031 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2455/4800] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:12.246146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-324a33d9-d920-4b77-a62c-533b3f0ca8df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:12.247060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-324a33d9-d920-4b77-a62c-533b3f0ca8df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:12.261599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-324a33d9-d920-4b77-a62c-533b3f0ca8df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:12.262181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-324a33d9-d920-4b77-a62c-533b3f0ca8df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:12.262883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-324a33d9-d920-4b77-a62c-533b3f0ca8df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:12.263721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-324a33d9-d920-4b77-a62c-533b3f0ca8df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:12.264404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-324a33d9-d920-4b77-a62c-533b3f0ca8df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:12.264856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-324a33d9-d920-4b77-a62c-533b3f0ca8df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:12.623691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-324a33d9-d920-4b77-a62c-533b3f0ca8df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:12.639804 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-324a33d9-d920-4b77-a62c-533b3f0ca8df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1507 microversion: 2.1 time: 0.412367 Aug 23 18:15:12.640658 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2456/4801] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:12 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1507 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:12.649983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6f173570-dfda-4792-a520-095f94953094 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:12.650745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6f173570-dfda-4792-a520-095f94953094 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:12.658277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f173570-dfda-4792-a520-095f94953094 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:12.658913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f173570-dfda-4792-a520-095f94953094 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:12.659470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f173570-dfda-4792-a520-095f94953094 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:12.660191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f173570-dfda-4792-a520-095f94953094 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:12.660716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f173570-dfda-4792-a520-095f94953094 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:12.661183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f173570-dfda-4792-a520-095f94953094 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:13.031210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bbc97dec-08fe-4868-b457-6e24641afd04 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:13.076377 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bbc97dec-08fe-4868-b457-6e24641afd04 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1532 microversion: 2.1 time: 0.975681 Aug 23 18:15:13.091373 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2346/4802] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:12 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1532 bytes in 983 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:13.103516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6933f9b6-8369-40f1-bc79-671220cd4f51 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:13.109571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6933f9b6-8369-40f1-bc79-671220cd4f51 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:13.120638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6933f9b6-8369-40f1-bc79-671220cd4f51 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:13.121450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6933f9b6-8369-40f1-bc79-671220cd4f51 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:13.122055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6933f9b6-8369-40f1-bc79-671220cd4f51 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:13.123679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6933f9b6-8369-40f1-bc79-671220cd4f51 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:13.124334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6933f9b6-8369-40f1-bc79-671220cd4f51 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:13.124978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6933f9b6-8369-40f1-bc79-671220cd4f51 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:13.192332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6933f9b6-8369-40f1-bc79-671220cd4f51 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:15:13.213577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6f173570-dfda-4792-a520-095f94953094 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:13.222957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:13.228221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6f173570-dfda-4792-a520-095f94953094 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:13.230506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6f173570-dfda-4792-a520-095f94953094 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:13.231954 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6f173570-dfda-4792-a520-095f94953094 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.589382 Aug 23 18:15:13.232724 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2457/4803] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:12 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:13.238427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-549ce77f-26e1-4e8f-86d3-30e53d08b2d3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:13.239860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-549ce77f-26e1-4e8f-86d3-30e53d08b2d3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:13.246514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-549ce77f-26e1-4e8f-86d3-30e53d08b2d3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:13.247218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-549ce77f-26e1-4e8f-86d3-30e53d08b2d3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:13.247723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-549ce77f-26e1-4e8f-86d3-30e53d08b2d3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:13.248772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-549ce77f-26e1-4e8f-86d3-30e53d08b2d3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:13.249422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-549ce77f-26e1-4e8f-86d3-30e53d08b2d3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:13.250043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-549ce77f-26e1-4e8f-86d3-30e53d08b2d3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:13.311689 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6933f9b6-8369-40f1-bc79-671220cd4f51 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 204 len: 0 microversion: 2.1 time: 0.218684 Aug 23 18:15:13.315785 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2347/4804] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:15:13 2022] DELETE /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:15:13.333178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-40287d42-b839-4d8b-8299-e2c95826c812 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:13.334605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-40287d42-b839-4d8b-8299-e2c95826c812 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:13.343910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-40287d42-b839-4d8b-8299-e2c95826c812 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:13.344615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-40287d42-b839-4d8b-8299-e2c95826c812 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:13.345104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-40287d42-b839-4d8b-8299-e2c95826c812 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:13.346050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-40287d42-b839-4d8b-8299-e2c95826c812 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:13.346380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-40287d42-b839-4d8b-8299-e2c95826c812 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:13.346856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-40287d42-b839-4d8b-8299-e2c95826c812 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:13.381058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:13.713003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-549ce77f-26e1-4e8f-86d3-30e53d08b2d3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:13.723823 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-549ce77f-26e1-4e8f-86d3-30e53d08b2d3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1323 microversion: 2.1 time: 0.489747 Aug 23 18:15:13.724716 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2458/4805] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:13 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1323 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:13.855207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-33dd0fe6-3a17-4892-9769-e72d8a1cfc3d req-4594ca43-a343-40ed-9112-0da13371f9d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "tag": "da6de964-c367-4565-80ba-9058c4151df9"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:13.890419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-33dd0fe6-3a17-4892-9769-e72d8a1cfc3d req-4594ca43-a343-40ed-9112-0da13371f9d5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:13.891336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-33dd0fe6-3a17-4892-9769-e72d8a1cfc3d req-4594ca43-a343-40ed-9112-0da13371f9d5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:13.892582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-33dd0fe6-3a17-4892-9769-e72d8a1cfc3d req-4594ca43-a343-40ed-9112-0da13371f9d5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:13.934492 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-33dd0fe6-3a17-4892-9769-e72d8a1cfc3d req-4594ca43-a343-40ed-9112-0da13371f9d5 service nova] Creating event network-changed:da6de964-c367-4565-80ba-9058c4151df9 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:15:13.950762 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-33dd0fe6-3a17-4892-9769-e72d8a1cfc3d req-4594ca43-a343-40ed-9112-0da13371f9d5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100069 Aug 23 18:15:13.952199 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2459/4806] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:14.058499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-40287d42-b839-4d8b-8299-e2c95826c812 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:14.079527 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-40287d42-b839-4d8b-8299-e2c95826c812 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1513 microversion: 2.1 time: 0.760605 Aug 23 18:15:14.094028 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2348/4807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:13 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1513 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:14.107690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bd881148-abcb-4c6c-ab7b-152a75856d52 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:14.108600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bd881148-abcb-4c6c-ab7b-152a75856d52 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:14.122407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd881148-abcb-4c6c-ab7b-152a75856d52 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:14.123119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd881148-abcb-4c6c-ab7b-152a75856d52 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:14.123371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd881148-abcb-4c6c-ab7b-152a75856d52 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:14.124608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd881148-abcb-4c6c-ab7b-152a75856d52 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:14.125081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd881148-abcb-4c6c-ab7b-152a75856d52 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:14.125517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd881148-abcb-4c6c-ab7b-152a75856d52 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:14.263724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e32b8503-194d-4639-b559-663f110be943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:14.263724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e32b8503-194d-4639-b559-663f110be943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:14.282808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e32b8503-194d-4639-b559-663f110be943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:14.284382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e32b8503-194d-4639-b559-663f110be943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:14.285757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e32b8503-194d-4639-b559-663f110be943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:14.286641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e32b8503-194d-4639-b559-663f110be943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:14.287745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e32b8503-194d-4639-b559-663f110be943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:14.288408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e32b8503-194d-4639-b559-663f110be943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:14.443128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bd881148-abcb-4c6c-ab7b-152a75856d52 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:14.455184 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bd881148-abcb-4c6c-ab7b-152a75856d52 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 0.352871 Aug 23 18:15:14.460103 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2460/4808] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:14 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:14.753196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a6e3c80-e1f8-453f-a9cd-efe42e86b896 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:14.754261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6a6e3c80-e1f8-453f-a9cd-efe42e86b896 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:14.767792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a6e3c80-e1f8-453f-a9cd-efe42e86b896 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:14.768902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a6e3c80-e1f8-453f-a9cd-efe42e86b896 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:14.769738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a6e3c80-e1f8-453f-a9cd-efe42e86b896 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:14.770666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a6e3c80-e1f8-453f-a9cd-efe42e86b896 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:14.771282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a6e3c80-e1f8-453f-a9cd-efe42e86b896 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:14.772041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a6e3c80-e1f8-453f-a9cd-efe42e86b896 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:14.951839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6a6e3c80-e1f8-453f-a9cd-efe42e86b896 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:14.966506 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6a6e3c80-e1f8-453f-a9cd-efe42e86b896 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1323 microversion: 2.1 time: 0.219137 Aug 23 18:15:14.967655 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2461/4809] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:14 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1323 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:15.101294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1dd8a169-9136-404e-90b9-799d836c0fdc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:15.101911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1dd8a169-9136-404e-90b9-799d836c0fdc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:15.108936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd8a169-9136-404e-90b9-799d836c0fdc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:15.109733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd8a169-9136-404e-90b9-799d836c0fdc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:15.110333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd8a169-9136-404e-90b9-799d836c0fdc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:15.111263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd8a169-9136-404e-90b9-799d836c0fdc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:15.111904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd8a169-9136-404e-90b9-799d836c0fdc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:15.112587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1dd8a169-9136-404e-90b9-799d836c0fdc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:15.326390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e32b8503-194d-4639-b559-663f110be943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:15.346886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e32b8503-194d-4639-b559-663f110be943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:15.356986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e32b8503-194d-4639-b559-663f110be943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:15.358944 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e32b8503-194d-4639-b559-663f110be943 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 1.101979 Aug 23 18:15:15.359812 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2349/4810] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:14 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:15.436683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1dd8a169-9136-404e-90b9-799d836c0fdc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:15.445474 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1dd8a169-9136-404e-90b9-799d836c0fdc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1513 microversion: 2.1 time: 0.348021 Aug 23 18:15:15.451431 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2462/4811] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:15 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1513 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:15.486766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a40c6181-5eea-4cff-8def-75d3049ee5fd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:15.487371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a40c6181-5eea-4cff-8def-75d3049ee5fd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:15.500803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a40c6181-5eea-4cff-8def-75d3049ee5fd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:15.503027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a40c6181-5eea-4cff-8def-75d3049ee5fd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:15.503691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a40c6181-5eea-4cff-8def-75d3049ee5fd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:15.505807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a40c6181-5eea-4cff-8def-75d3049ee5fd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:15.510141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a40c6181-5eea-4cff-8def-75d3049ee5fd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:15.510930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a40c6181-5eea-4cff-8def-75d3049ee5fd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:15.989545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-590739a3-ee02-49dd-8de0-12d8fdfe5c12 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:15.990177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-590739a3-ee02-49dd-8de0-12d8fdfe5c12 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:16.005448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-590739a3-ee02-49dd-8de0-12d8fdfe5c12 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:16.007287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-590739a3-ee02-49dd-8de0-12d8fdfe5c12 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:16.007766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-590739a3-ee02-49dd-8de0-12d8fdfe5c12 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:16.009309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-590739a3-ee02-49dd-8de0-12d8fdfe5c12 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:16.009787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-590739a3-ee02-49dd-8de0-12d8fdfe5c12 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:16.010372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-590739a3-ee02-49dd-8de0-12d8fdfe5c12 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:16.336168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a40c6181-5eea-4cff-8def-75d3049ee5fd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:16.346246 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a40c6181-5eea-4cff-8def-75d3049ee5fd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 0.863990 Aug 23 18:15:16.347619 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2350/4812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:15 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:16.367842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-935edff0-9cb8-4c51-9986-04bf115a15ce req-de4daa16-d1bf-4144-a7bf-3479618754eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "241aa9bc-9119-44f1-a747-084625b73f3c", "tag": "80a5ee8a-17ca-4f12-9bf3-43dcc96b6926"}, {"name": "network-changed", "server_uuid": "629a906b-d9dc-40cd-a05c-cf96c1982a26", "tag": "a3fcbe23-363f-40d7-8812-1b049179fc7e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:16.414170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-935edff0-9cb8-4c51-9986-04bf115a15ce req-de4daa16-d1bf-4144-a7bf-3479618754eb service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:16.415360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-935edff0-9cb8-4c51-9986-04bf115a15ce req-de4daa16-d1bf-4144-a7bf-3479618754eb service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:16.417623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-935edff0-9cb8-4c51-9986-04bf115a15ce req-de4daa16-d1bf-4144-a7bf-3479618754eb service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:16.444617 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-935edff0-9cb8-4c51-9986-04bf115a15ce req-de4daa16-d1bf-4144-a7bf-3479618754eb service nova] Creating event network-changed:80a5ee8a-17ca-4f12-9bf3-43dcc96b6926 for instance 241aa9bc-9119-44f1-a747-084625b73f3c on n-h1-850468-16 Aug 23 18:15:16.450621 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-935edff0-9cb8-4c51-9986-04bf115a15ce req-de4daa16-d1bf-4144-a7bf-3479618754eb service nova] Creating event network-changed:a3fcbe23-363f-40d7-8812-1b049179fc7e for instance 629a906b-d9dc-40cd-a05c-cf96c1982a26 on n-h2-850468-16 Aug 23 18:15:16.475423 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-935edff0-9cb8-4c51-9986-04bf115a15ce req-de4daa16-d1bf-4144-a7bf-3479618754eb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.126318 Aug 23 18:15:16.475654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-590739a3-ee02-49dd-8de0-12d8fdfe5c12 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:16.478560 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2351/4813] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:16.484223 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-590739a3-ee02-49dd-8de0-12d8fdfe5c12 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1323 microversion: 2.1 time: 0.498772 Aug 23 18:15:16.484824 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2463/4814] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:15 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1323 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:16.499455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-22a1c826-f068-406c-a701-a04fc66b2b62 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:16.503156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-22a1c826-f068-406c-a701-a04fc66b2b62 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:16.526843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-80d83954-1bea-4a1c-beed-f1e736707e0a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:16.528998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22a1c826-f068-406c-a701-a04fc66b2b62 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:16.531050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-80d83954-1bea-4a1c-beed-f1e736707e0a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:16.536207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22a1c826-f068-406c-a701-a04fc66b2b62 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:16.540798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22a1c826-f068-406c-a701-a04fc66b2b62 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:16.546085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22a1c826-f068-406c-a701-a04fc66b2b62 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:16.549261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22a1c826-f068-406c-a701-a04fc66b2b62 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:16.560600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22a1c826-f068-406c-a701-a04fc66b2b62 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:16.569360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80d83954-1bea-4a1c-beed-f1e736707e0a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:16.569851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80d83954-1bea-4a1c-beed-f1e736707e0a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:16.573686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80d83954-1bea-4a1c-beed-f1e736707e0a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:16.574797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80d83954-1bea-4a1c-beed-f1e736707e0a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:16.578856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80d83954-1bea-4a1c-beed-f1e736707e0a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:16.582423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80d83954-1bea-4a1c-beed-f1e736707e0a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:17.116333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22a1c826-f068-406c-a701-a04fc66b2b62 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:17.141828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22a1c826-f068-406c-a701-a04fc66b2b62 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:17.144494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22a1c826-f068-406c-a701-a04fc66b2b62 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:17.153383 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-22a1c826-f068-406c-a701-a04fc66b2b62 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.670435 Aug 23 18:15:17.154005 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2352/4815] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:16 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:17.371288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93b59f48-57e6-4b0c-b754-fb187986c7ee tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:17.373679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-93b59f48-57e6-4b0c-b754-fb187986c7ee tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:17.388835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b59f48-57e6-4b0c-b754-fb187986c7ee tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:17.389430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b59f48-57e6-4b0c-b754-fb187986c7ee tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:17.391934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b59f48-57e6-4b0c-b754-fb187986c7ee tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:17.394832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b59f48-57e6-4b0c-b754-fb187986c7ee tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:17.395568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b59f48-57e6-4b0c-b754-fb187986c7ee tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:17.397381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b59f48-57e6-4b0c-b754-fb187986c7ee tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:17.418889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-80d83954-1bea-4a1c-beed-f1e736707e0a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:17.435584 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-80d83954-1bea-4a1c-beed-f1e736707e0a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 200 len: 1513 microversion: 2.1 time: 0.925632 Aug 23 18:15:17.444001 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2464/4816] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:16 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 1513 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:17.512181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cccf4374-bec0-49c3-9416-a58a8b8ada3d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:17.513560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cccf4374-bec0-49c3-9416-a58a8b8ada3d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:17.533493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cccf4374-bec0-49c3-9416-a58a8b8ada3d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:17.534008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cccf4374-bec0-49c3-9416-a58a8b8ada3d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:17.534461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cccf4374-bec0-49c3-9416-a58a8b8ada3d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:17.535270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cccf4374-bec0-49c3-9416-a58a8b8ada3d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:17.543040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cccf4374-bec0-49c3-9416-a58a8b8ada3d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:17.543809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cccf4374-bec0-49c3-9416-a58a8b8ada3d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:17.640612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:17.977503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cccf4374-bec0-49c3-9416-a58a8b8ada3d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:17.995863 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cccf4374-bec0-49c3-9416-a58a8b8ada3d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1323 microversion: 2.1 time: 0.489005 Aug 23 18:15:18.012940 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2465/4817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:17 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1323 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:18.177613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fe75697e-c017-4ad8-8033-cd769f454b6c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:18.178321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fe75697e-c017-4ad8-8033-cd769f454b6c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:18.207558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe75697e-c017-4ad8-8033-cd769f454b6c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:18.210119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe75697e-c017-4ad8-8033-cd769f454b6c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:18.212692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe75697e-c017-4ad8-8033-cd769f454b6c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:18.217562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe75697e-c017-4ad8-8033-cd769f454b6c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:18.219455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe75697e-c017-4ad8-8033-cd769f454b6c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:18.220280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fe75697e-c017-4ad8-8033-cd769f454b6c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:18.682179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-93b59f48-57e6-4b0c-b754-fb187986c7ee tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:18.693934 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93b59f48-57e6-4b0c-b754-fb187986c7ee tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 1.328353 Aug 23 18:15:18.700469 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2353/4818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:17 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 1336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:18.719740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5956e4d9-ba23-4824-981e-58ef2fea598d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:18.720412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5956e4d9-ba23-4824-981e-58ef2fea598d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:18.761650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fe75697e-c017-4ad8-8033-cd769f454b6c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:18.776648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5956e4d9-ba23-4824-981e-58ef2fea598d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:18.782231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fe75697e-c017-4ad8-8033-cd769f454b6c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:18.796947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fe75697e-c017-4ad8-8033-cd769f454b6c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:18.798916 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fe75697e-c017-4ad8-8033-cd769f454b6c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.625328 Aug 23 18:15:18.799790 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2466/4819] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:18 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:15:18.815198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5956e4d9-ba23-4824-981e-58ef2fea598d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.036s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:18.815994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5956e4d9-ba23-4824-981e-58ef2fea598d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:18.822613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5956e4d9-ba23-4824-981e-58ef2fea598d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:18.823133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5956e4d9-ba23-4824-981e-58ef2fea598d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:18.832927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5956e4d9-ba23-4824-981e-58ef2fea598d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:18.887296 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-5956e4d9-ba23-4824-981e-58ef2fea598d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5956e4d9-ba23-4824-981e-58ef2fea598d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 HTTP/1.1 Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '8220873b-1b5e-457b-911a-1cd53303f7d9'} Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:18.893297 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:18.897469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:18.897469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:18.897469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:18.897469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:15:18.897469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:15:18.897469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:15:18.897469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:18.897469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5956e4d9-ba23-4824-981e-58ef2fea598d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:15:18.898320 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5956e4d9-ba23-4824-981e-58ef2fea598d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 404 len: 111 microversion: 2.1 time: 0.195973 Aug 23 18:15:18.902145 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2354/4820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:18 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 111 bytes in 200 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:15:18.911117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c08d9a8a-bf61-4615-9cb9-596747e78270 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '.version_select at 0x7f27dfa92280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:18.964440 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c08d9a8a-bf61-4615-9cb9-596747e78270 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-key-931518767" status: 202 len: 0 microversion: 2.1 time: 0.056459 Aug 23 18:15:18.966957 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2467/4821] 10.222.0.61 () {58 vars in 1206 bytes} [Tue Aug 23 18:15:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-931518767 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:15:18.970184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-909b6aea-dd88-46e2-a01b-1e4e751d9751 req-93101f66-178d-4941-ad6a-73c3a012ad5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8220873b-1b5e-457b-911a-1cd53303f7d9", "name": "network-vif-deleted", "tag": "d88b6e2d-26aa-4d23-b6b8-904a2c1ea687"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:18.991648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-909b6aea-dd88-46e2-a01b-1e4e751d9751 req-93101f66-178d-4941-ad6a-73c3a012ad5f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:18.996004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-909b6aea-dd88-46e2-a01b-1e4e751d9751 req-93101f66-178d-4941-ad6a-73c3a012ad5f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:18.998210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-909b6aea-dd88-46e2-a01b-1e4e751d9751 req-93101f66-178d-4941-ad6a-73c3a012ad5f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:19.021283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51981ad0-f59d-4133-94a5-51d2c285af80 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:19.023484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51981ad0-f59d-4133-94a5-51d2c285af80 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:19.030684 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-909b6aea-dd88-46e2-a01b-1e4e751d9751 req-93101f66-178d-4941-ad6a-73c3a012ad5f service nova] Creating event network-vif-deleted:d88b6e2d-26aa-4d23-b6b8-904a2c1ea687 for instance 8220873b-1b5e-457b-911a-1cd53303f7d9 on n-h1-850468-16 Aug 23 18:15:19.040093 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-909b6aea-dd88-46e2-a01b-1e4e751d9751 req-93101f66-178d-4941-ad6a-73c3a012ad5f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074230 Aug 23 18:15:19.040573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51981ad0-f59d-4133-94a5-51d2c285af80 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:19.041796 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2355/4822] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:19.072957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51981ad0-f59d-4133-94a5-51d2c285af80 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.024s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:19.074736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51981ad0-f59d-4133-94a5-51d2c285af80 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:19.076606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51981ad0-f59d-4133-94a5-51d2c285af80 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:19.084860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51981ad0-f59d-4133-94a5-51d2c285af80 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:19.088347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51981ad0-f59d-4133-94a5-51d2c285af80 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:19.320609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-801282042", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "bcef2581-80d0-47e5-8b8b-34343a6facf5"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:19.433063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] validate_networks() for [('bcef2581-80d0-47e5-8b8b-34343a6facf5', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:15:19.892143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-51981ad0-f59d-4133-94a5-51d2c285af80 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:19.902668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51981ad0-f59d-4133-94a5-51d2c285af80 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1323 microversion: 2.1 time: 0.886578 Aug 23 18:15:19.903524 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2468/4823] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:19 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1323 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:19.929093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-427d3c56-1e35-4695-b8c4-3216bb3334ca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:19.929980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-427d3c56-1e35-4695-b8c4-3216bb3334ca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:19.940660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-427d3c56-1e35-4695-b8c4-3216bb3334ca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:19.942016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-427d3c56-1e35-4695-b8c4-3216bb3334ca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:19.955187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-427d3c56-1e35-4695-b8c4-3216bb3334ca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:19.962877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-427d3c56-1e35-4695-b8c4-3216bb3334ca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:19.964132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-427d3c56-1e35-4695-b8c4-3216bb3334ca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:19.966153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-427d3c56-1e35-4695-b8c4-3216bb3334ca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:20.229982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:15:20.231733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:15:20.232644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:15:20.233108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:15:20.233580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:15:20.246111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:20.247044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:20.247724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:20.248768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:20.249503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:20.250346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:20.280761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:15:20.290877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for user 6e80c3f1c008459faa3ac74ea5984eea and project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:15:20.315420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:15:20.318669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:15:20.340798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-427d3c56-1e35-4695-b8c4-3216bb3334ca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:20.366494 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-427d3c56-1e35-4695-b8c4-3216bb3334ca tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 0.447476 Aug 23 18:15:20.381957 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2469/4824] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:19 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:20.381957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f4a3398-61f9-4e06-973f-98d1b0cb8dc2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:20.381957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0f4a3398-61f9-4e06-973f-98d1b0cb8dc2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:20.424194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f4a3398-61f9-4e06-973f-98d1b0cb8dc2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:20.439256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f4a3398-61f9-4e06-973f-98d1b0cb8dc2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:20.439743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f4a3398-61f9-4e06-973f-98d1b0cb8dc2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:20.440876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f4a3398-61f9-4e06-973f-98d1b0cb8dc2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:20.441143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f4a3398-61f9-4e06-973f-98d1b0cb8dc2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:20.441394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f4a3398-61f9-4e06-973f-98d1b0cb8dc2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:20.516012 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3c4e088d-fc27-4d36-a470-1e777528ec60 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.197665 Aug 23 18:15:20.522255 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2356/4825] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:15:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 1202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:15:20.529029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-24dbca35-6c11-48c6-b679-9f36164e42bd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:20.530674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-24dbca35-6c11-48c6-b679-9f36164e42bd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:20.634187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-24dbca35-6c11-48c6-b679-9f36164e42bd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:20.644907 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-24dbca35-6c11-48c6-b679-9f36164e42bd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1208 microversion: 2.1 time: 0.120941 Aug 23 18:15:20.647382 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2357/4826] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:20 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1208 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:20.746830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-de9299f5-028c-4c10-9798-87d7f1ec10e0 req-c423ea55-4066-4fcc-8ffa-9747602d20fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee31abc5-c0cf-4333-8a58-d8c5a174d41e", "name": "network-vif-plugged", "status": "completed", "tag": "15fbf67e-03c7-48e5-8997-2f7146575424"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:20.772813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-de9299f5-028c-4c10-9798-87d7f1ec10e0 req-c423ea55-4066-4fcc-8ffa-9747602d20fd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:20.773305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-de9299f5-028c-4c10-9798-87d7f1ec10e0 req-c423ea55-4066-4fcc-8ffa-9747602d20fd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:20.776716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-de9299f5-028c-4c10-9798-87d7f1ec10e0 req-c423ea55-4066-4fcc-8ffa-9747602d20fd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:20.807297 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-de9299f5-028c-4c10-9798-87d7f1ec10e0 req-c423ea55-4066-4fcc-8ffa-9747602d20fd service nova] Creating event network-vif-plugged:15fbf67e-03c7-48e5-8997-2f7146575424 for instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e on n-h2-850468-16 Aug 23 18:15:20.818274 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-de9299f5-028c-4c10-9798-87d7f1ec10e0 req-c423ea55-4066-4fcc-8ffa-9747602d20fd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075564 Aug 23 18:15:20.821134 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2358/4827] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:20.927609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fb4d3c29-350e-4e73-b4bc-dfe2aabf8d49 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:20.928582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fb4d3c29-350e-4e73-b4bc-dfe2aabf8d49 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:20.942359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb4d3c29-350e-4e73-b4bc-dfe2aabf8d49 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:20.942912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb4d3c29-350e-4e73-b4bc-dfe2aabf8d49 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:20.943338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb4d3c29-350e-4e73-b4bc-dfe2aabf8d49 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:20.944057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb4d3c29-350e-4e73-b4bc-dfe2aabf8d49 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:20.949013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb4d3c29-350e-4e73-b4bc-dfe2aabf8d49 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:20.949484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb4d3c29-350e-4e73-b4bc-dfe2aabf8d49 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:20.992997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0f4a3398-61f9-4e06-973f-98d1b0cb8dc2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:21.003678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0f4a3398-61f9-4e06-973f-98d1b0cb8dc2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:21.015560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0f4a3398-61f9-4e06-973f-98d1b0cb8dc2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:21.016978 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0f4a3398-61f9-4e06-973f-98d1b0cb8dc2 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.647686 Aug 23 18:15:21.022877 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2470/4828] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:20 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:21.218668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-84bfaefb-bd94-4247-8122-20d413bc7862 req-0695fcbc-80c1-42c2-a5bd-3b3f0163021e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "tag": "efc446c9-5ccd-4541-9891-7415a79be535"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:21.236067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-84bfaefb-bd94-4247-8122-20d413bc7862 req-0695fcbc-80c1-42c2-a5bd-3b3f0163021e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:21.239892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-84bfaefb-bd94-4247-8122-20d413bc7862 req-0695fcbc-80c1-42c2-a5bd-3b3f0163021e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:21.241517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-84bfaefb-bd94-4247-8122-20d413bc7862 req-0695fcbc-80c1-42c2-a5bd-3b3f0163021e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:21.269229 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-84bfaefb-bd94-4247-8122-20d413bc7862 req-0695fcbc-80c1-42c2-a5bd-3b3f0163021e service nova] Creating event network-changed:efc446c9-5ccd-4541-9891-7415a79be535 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:15:21.282043 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-84bfaefb-bd94-4247-8122-20d413bc7862 req-0695fcbc-80c1-42c2-a5bd-3b3f0163021e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067111 Aug 23 18:15:21.285094 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2471/4829] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:21.390980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0ee58bc4-41af-44ea-a3e8-a706207796d0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:21.419069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0ee58bc4-41af-44ea-a3e8-a706207796d0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:21.425141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0ee58bc4-41af-44ea-a3e8-a706207796d0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Searching by: {'deleted': False, 'project_id': '1b9a8cc730ec452daede3d0640e264d7'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:15:21.441843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ee58bc4-41af-44ea-a3e8-a706207796d0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:21.443206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ee58bc4-41af-44ea-a3e8-a706207796d0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:21.445861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ee58bc4-41af-44ea-a3e8-a706207796d0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:21.445861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ee58bc4-41af-44ea-a3e8-a706207796d0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:21.445861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ee58bc4-41af-44ea-a3e8-a706207796d0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:21.446521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ee58bc4-41af-44ea-a3e8-a706207796d0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:21.484580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-0ee58bc4-41af-44ea-a3e8-a706207796d0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:15:21.534059 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0ee58bc4-41af-44ea-a3e8-a706207796d0 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.151257 Aug 23 18:15:21.543447 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2472/4830] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 18:15:21 2022] GET /compute/v2.1/servers => generated 344 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:21.549063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-59be3969-c182-4da7-a317-e2e5f7a8e710 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:21.550114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-59be3969-c182-4da7-a317-e2e5f7a8e710 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:21.578469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59be3969-c182-4da7-a317-e2e5f7a8e710 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:21.580508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59be3969-c182-4da7-a317-e2e5f7a8e710 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:21.581162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59be3969-c182-4da7-a317-e2e5f7a8e710 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:21.582223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59be3969-c182-4da7-a317-e2e5f7a8e710 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:21.584392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59be3969-c182-4da7-a317-e2e5f7a8e710 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:21.585140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59be3969-c182-4da7-a317-e2e5f7a8e710 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:21.994954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fb4d3c29-350e-4e73-b4bc-dfe2aabf8d49 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:22.012959 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fb4d3c29-350e-4e73-b4bc-dfe2aabf8d49 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1323 microversion: 2.1 time: 1.090284 Aug 23 18:15:22.024748 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2359/4831] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:20 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1323 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:22.041759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:22.081584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:22.083074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Searching by: {'deleted': False, 'project_id': '1b9a8cc730ec452daede3d0640e264d7'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:15:22.100967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:22.102201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:22.118707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:22.125760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:22.127500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:22.129674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:22.214245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:15:22.313252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:22.330484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:22.333953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:22.334480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:22.576273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-59be3969-c182-4da7-a317-e2e5f7a8e710 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:22.596707 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-59be3969-c182-4da7-a317-e2e5f7a8e710 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 1.046010 Aug 23 18:15:22.601029 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2473/4832] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:21 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:22.638731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ff1725ef-ef9e-472f-b7c0-8135e9da1a87 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:22.639553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ff1725ef-ef9e-472f-b7c0-8135e9da1a87 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:22.648692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff1725ef-ef9e-472f-b7c0-8135e9da1a87 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:22.649630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff1725ef-ef9e-472f-b7c0-8135e9da1a87 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:22.650323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff1725ef-ef9e-472f-b7c0-8135e9da1a87 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:22.651294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff1725ef-ef9e-472f-b7c0-8135e9da1a87 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:22.651919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff1725ef-ef9e-472f-b7c0-8135e9da1a87 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:22.652518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff1725ef-ef9e-472f-b7c0-8135e9da1a87 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:22.854498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ff1725ef-ef9e-472f-b7c0-8135e9da1a87 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:22.865570 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ff1725ef-ef9e-472f-b7c0-8135e9da1a87 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1260 microversion: 2.1 time: 0.263242 Aug 23 18:15:22.866174 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2474/4833] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:22 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:22.881320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e64122f7-368f-4103-88e5-ec42c50442ed tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:22.882034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e64122f7-368f-4103-88e5-ec42c50442ed tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:22.899349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e64122f7-368f-4103-88e5-ec42c50442ed tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:22.901795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e64122f7-368f-4103-88e5-ec42c50442ed tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:22.902458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e64122f7-368f-4103-88e5-ec42c50442ed tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:22.904051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e64122f7-368f-4103-88e5-ec42c50442ed tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:22.907597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e64122f7-368f-4103-88e5-ec42c50442ed tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:22.908276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e64122f7-368f-4103-88e5-ec42c50442ed tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:23.230194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e64122f7-368f-4103-88e5-ec42c50442ed tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:23.244441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e64122f7-368f-4103-88e5-ec42c50442ed tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:23.246269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e64122f7-368f-4103-88e5-ec42c50442ed tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:23.247706 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e64122f7-368f-4103-88e5-ec42c50442ed tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.375750 Aug 23 18:15:23.248802 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2475/4834] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:22 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:23.254325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7920da31-c7da-44ee-864d-db5b2452c73c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:23.255176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7920da31-c7da-44ee-864d-db5b2452c73c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:23.262587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7920da31-c7da-44ee-864d-db5b2452c73c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:23.263496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7920da31-c7da-44ee-864d-db5b2452c73c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:23.264139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7920da31-c7da-44ee-864d-db5b2452c73c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:23.265043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7920da31-c7da-44ee-864d-db5b2452c73c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:23.265677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7920da31-c7da-44ee-864d-db5b2452c73c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:23.266273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7920da31-c7da-44ee-864d-db5b2452c73c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:23.416418 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-624df73b-a957-4ff5-9e20-0d362965c52a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 1605 microversion: 2.1 time: 1.388425 Aug 23 18:15:23.431214 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2360/4835] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 18:15:22 2022] GET /compute/v2.1/servers/detail => generated 1605 bytes in 1391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:23.445247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9c4f2045-f5a9-4114-b418-791efb90fdbb tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:23.469849 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9c4f2045-f5a9-4114-b418-791efb90fdbb tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.031472 Aug 23 18:15:23.474445 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2361/4836] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 18:15:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:23.625657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-677cdebe-8936-408d-b494-218b099abff1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:23.626355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-677cdebe-8936-408d-b494-218b099abff1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:23.637685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7920da31-c7da-44ee-864d-db5b2452c73c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:23.649266 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7920da31-c7da-44ee-864d-db5b2452c73c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1323 microversion: 2.1 time: 0.398566 Aug 23 18:15:23.650147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-677cdebe-8936-408d-b494-218b099abff1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:23.650839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-677cdebe-8936-408d-b494-218b099abff1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:23.653232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-677cdebe-8936-408d-b494-218b099abff1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:23.654909 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2476/4837] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:23 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1323 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:23.655565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-677cdebe-8936-408d-b494-218b099abff1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:23.659716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-677cdebe-8936-408d-b494-218b099abff1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:23.663013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-677cdebe-8936-408d-b494-218b099abff1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:23.850838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef86d0ce-da70-4eb7-a566-8741e34a4b0f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:23.851371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef86d0ce-da70-4eb7-a566-8741e34a4b0f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:23.861938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef86d0ce-da70-4eb7-a566-8741e34a4b0f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:23.862421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef86d0ce-da70-4eb7-a566-8741e34a4b0f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:23.862899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef86d0ce-da70-4eb7-a566-8741e34a4b0f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:23.880852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef86d0ce-da70-4eb7-a566-8741e34a4b0f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:23.885841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef86d0ce-da70-4eb7-a566-8741e34a4b0f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:23.887426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ef86d0ce-da70-4eb7-a566-8741e34a4b0f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:23.955538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef86d0ce-da70-4eb7-a566-8741e34a4b0f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:15:24.190610 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef86d0ce-da70-4eb7-a566-8741e34a4b0f tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 204 len: 0 microversion: 2.1 time: 0.339980 Aug 23 18:15:24.198628 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2477/4838] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:15:23 2022] DELETE /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:15:24.217968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-677cdebe-8936-408d-b494-218b099abff1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:24.223438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ad9cb83b-590b-48f6-b0b4-df47b1a3fc6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:24.231053 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-677cdebe-8936-408d-b494-218b099abff1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 0.610295 Aug 23 18:15:24.232442 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2362/4839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:23 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:24.239225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ad9cb83b-590b-48f6-b0b4-df47b1a3fc6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:24.246055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d673c47a-46ee-49bd-918f-ed2612119aeb tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:24.265274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad9cb83b-590b-48f6-b0b4-df47b1a3fc6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:24.265769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad9cb83b-590b-48f6-b0b4-df47b1a3fc6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:24.266215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad9cb83b-590b-48f6-b0b4-df47b1a3fc6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:24.268066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad9cb83b-590b-48f6-b0b4-df47b1a3fc6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:24.268066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad9cb83b-590b-48f6-b0b4-df47b1a3fc6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:24.268066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad9cb83b-590b-48f6-b0b4-df47b1a3fc6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:24.268387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d673c47a-46ee-49bd-918f-ed2612119aeb tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:24.280138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d673c47a-46ee-49bd-918f-ed2612119aeb tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:24.291792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d673c47a-46ee-49bd-918f-ed2612119aeb tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:24.292275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d673c47a-46ee-49bd-918f-ed2612119aeb tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:24.295169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d673c47a-46ee-49bd-918f-ed2612119aeb tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:24.295750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d673c47a-46ee-49bd-918f-ed2612119aeb tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:24.296123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d673c47a-46ee-49bd-918f-ed2612119aeb tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:24.455951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ad9cb83b-590b-48f6-b0b4-df47b1a3fc6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:24.473588 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ad9cb83b-590b-48f6-b0b4-df47b1a3fc6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1266 microversion: 2.1 time: 0.272815 Aug 23 18:15:24.478138 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2478/4840] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:24 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1266 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:24.487494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cc2d4c35-4023-44f9-9143-2d22745495b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:24.498260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cc2d4c35-4023-44f9-9143-2d22745495b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:24.506258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc2d4c35-4023-44f9-9143-2d22745495b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:24.507825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc2d4c35-4023-44f9-9143-2d22745495b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:24.509356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc2d4c35-4023-44f9-9143-2d22745495b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:24.511138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc2d4c35-4023-44f9-9143-2d22745495b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:24.511885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc2d4c35-4023-44f9-9143-2d22745495b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:24.512555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cc2d4c35-4023-44f9-9143-2d22745495b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:24.889361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cc2d4c35-4023-44f9-9143-2d22745495b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:24.908586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cc2d4c35-4023-44f9-9143-2d22745495b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:24.913724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cc2d4c35-4023-44f9-9143-2d22745495b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:24.925238 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cc2d4c35-4023-44f9-9143-2d22745495b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.437659 Aug 23 18:15:24.930934 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2479/4841] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:24 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:24.948344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c8a38615-a4e7-47d4-a4bc-e576c568252e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:24.949374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c8a38615-a4e7-47d4-a4bc-e576c568252e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:24.983053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8a38615-a4e7-47d4-a4bc-e576c568252e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:24.987277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8a38615-a4e7-47d4-a4bc-e576c568252e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:24.988202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8a38615-a4e7-47d4-a4bc-e576c568252e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:24.990532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8a38615-a4e7-47d4-a4bc-e576c568252e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:24.991408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8a38615-a4e7-47d4-a4bc-e576c568252e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:24.993892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8a38615-a4e7-47d4-a4bc-e576c568252e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:25.368940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c8a38615-a4e7-47d4-a4bc-e576c568252e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:25.400549 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c8a38615-a4e7-47d4-a4bc-e576c568252e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1323 microversion: 2.1 time: 0.467388 Aug 23 18:15:25.408509 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2480/4842] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:24 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1323 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:25.421011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-bb18c394-2088-4517-933a-9983adb8f941 req-124d5546-21ed-43ff-99a4-e53218ef4603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241aa9bc-9119-44f1-a747-084625b73f3c", "name": "network-vif-plugged", "status": "completed", "tag": "80a5ee8a-17ca-4f12-9bf3-43dcc96b6926"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:25.483769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bb18c394-2088-4517-933a-9983adb8f941 req-124d5546-21ed-43ff-99a4-e53218ef4603 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:25.484591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bb18c394-2088-4517-933a-9983adb8f941 req-124d5546-21ed-43ff-99a4-e53218ef4603 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:25.485299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bb18c394-2088-4517-933a-9983adb8f941 req-124d5546-21ed-43ff-99a4-e53218ef4603 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:25.535884 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-bb18c394-2088-4517-933a-9983adb8f941 req-124d5546-21ed-43ff-99a4-e53218ef4603 service nova] Creating event network-vif-plugged:80a5ee8a-17ca-4f12-9bf3-43dcc96b6926 for instance 241aa9bc-9119-44f1-a747-084625b73f3c on n-h1-850468-16 Aug 23 18:15:25.542500 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-bb18c394-2088-4517-933a-9983adb8f941 req-124d5546-21ed-43ff-99a4-e53218ef4603 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130627 Aug 23 18:15:25.547618 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2481/4843] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:25.554119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-84e2c5c6-c2f2-45aa-b68b-a966e8b7eefe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:25.555370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-84e2c5c6-c2f2-45aa-b68b-a966e8b7eefe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:25.566221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e2c5c6-c2f2-45aa-b68b-a966e8b7eefe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:25.566769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e2c5c6-c2f2-45aa-b68b-a966e8b7eefe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:25.567216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e2c5c6-c2f2-45aa-b68b-a966e8b7eefe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:25.567952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e2c5c6-c2f2-45aa-b68b-a966e8b7eefe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:25.568562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e2c5c6-c2f2-45aa-b68b-a966e8b7eefe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:25.569305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e2c5c6-c2f2-45aa-b68b-a966e8b7eefe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:25.592784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:25.874214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-84e2c5c6-c2f2-45aa-b68b-a966e8b7eefe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:25.886259 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-84e2c5c6-c2f2-45aa-b68b-a966e8b7eefe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 0.336920 Aug 23 18:15:25.892045 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2482/4844] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:25 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:25.908913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4a07b29f-f970-4c12-9068-9b0b06bce6ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:25.911822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4a07b29f-f970-4c12-9068-9b0b06bce6ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:25.929151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a07b29f-f970-4c12-9068-9b0b06bce6ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:25.934245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a07b29f-f970-4c12-9068-9b0b06bce6ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:25.935150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a07b29f-f970-4c12-9068-9b0b06bce6ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:25.935932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a07b29f-f970-4c12-9068-9b0b06bce6ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:25.937045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a07b29f-f970-4c12-9068-9b0b06bce6ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:25.937599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a07b29f-f970-4c12-9068-9b0b06bce6ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:26.020601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d673c47a-46ee-49bd-918f-ed2612119aeb tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:26.034497 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d673c47a-46ee-49bd-918f-ed2612119aeb tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1608 microversion: 2.1 time: 1.799167 Aug 23 18:15:26.035782 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2363/4845] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:24 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1608 bytes in 1802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:26.049229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6060e09c-ae73-4994-a684-215c737cddd6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:26.050192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6060e09c-ae73-4994-a684-215c737cddd6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:26.065588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6060e09c-ae73-4994-a684-215c737cddd6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:26.066427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6060e09c-ae73-4994-a684-215c737cddd6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:26.067274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6060e09c-ae73-4994-a684-215c737cddd6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:26.070394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6060e09c-ae73-4994-a684-215c737cddd6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:26.073829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6060e09c-ae73-4994-a684-215c737cddd6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:26.074459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6060e09c-ae73-4994-a684-215c737cddd6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:26.204918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4a07b29f-f970-4c12-9068-9b0b06bce6ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:26.214122 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4a07b29f-f970-4c12-9068-9b0b06bce6ad tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1266 microversion: 2.1 time: 0.320200 Aug 23 18:15:26.221619 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2483/4846] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:25 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:26.433650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3849a403-1f5b-42a3-a064-5d435e063c1d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:26.434209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3849a403-1f5b-42a3-a064-5d435e063c1d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:26.444130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3849a403-1f5b-42a3-a064-5d435e063c1d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:26.444623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3849a403-1f5b-42a3-a064-5d435e063c1d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:26.445076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3849a403-1f5b-42a3-a064-5d435e063c1d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:26.449588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3849a403-1f5b-42a3-a064-5d435e063c1d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:26.451544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3849a403-1f5b-42a3-a064-5d435e063c1d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:26.452025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3849a403-1f5b-42a3-a064-5d435e063c1d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:27.298558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6060e09c-ae73-4994-a684-215c737cddd6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:27.337709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6060e09c-ae73-4994-a684-215c737cddd6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:27.340895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6060e09c-ae73-4994-a684-215c737cddd6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:27.349156 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6060e09c-ae73-4994-a684-215c737cddd6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 1.305013 Aug 23 18:15:27.349812 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2364/4847] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:26 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 1313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:27.355698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e6801955-875f-4e9d-ae98-144cc335b8ad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:27.361088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e6801955-875f-4e9d-ae98-144cc335b8ad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:27.389119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6801955-875f-4e9d-ae98-144cc335b8ad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:27.389929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6801955-875f-4e9d-ae98-144cc335b8ad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:27.390603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6801955-875f-4e9d-ae98-144cc335b8ad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:27.391631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6801955-875f-4e9d-ae98-144cc335b8ad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:27.394036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6801955-875f-4e9d-ae98-144cc335b8ad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:27.395221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6801955-875f-4e9d-ae98-144cc335b8ad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:27.901285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3849a403-1f5b-42a3-a064-5d435e063c1d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:27.914959 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3849a403-1f5b-42a3-a064-5d435e063c1d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1323 microversion: 2.1 time: 1.485867 Aug 23 18:15:27.916257 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2484/4848] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:26 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1323 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:27.933721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5bf61ae4-34c6-42d0-bbe5-5a2772fd9289 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:27.934863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5bf61ae4-34c6-42d0-bbe5-5a2772fd9289 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:27.951042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5bf61ae4-34c6-42d0-bbe5-5a2772fd9289 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:27.953852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5bf61ae4-34c6-42d0-bbe5-5a2772fd9289 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:27.955728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5bf61ae4-34c6-42d0-bbe5-5a2772fd9289 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:27.957277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5bf61ae4-34c6-42d0-bbe5-5a2772fd9289 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:27.958327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5bf61ae4-34c6-42d0-bbe5-5a2772fd9289 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:27.960414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5bf61ae4-34c6-42d0-bbe5-5a2772fd9289 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:28.356925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e6801955-875f-4e9d-ae98-144cc335b8ad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:28.371728 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e6801955-875f-4e9d-ae98-144cc335b8ad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 1.019137 Aug 23 18:15:28.374568 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2365/4849] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:27 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:28.392849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-3759401f-3b54-439e-85d4-83624e80c435 req-cd3e3488-64a7-4068-92b5-57962eebdf68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "tag": "984fbe3f-942d-428e-b69a-4f736cedf9e1"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:28.444083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3759401f-3b54-439e-85d4-83624e80c435 req-cd3e3488-64a7-4068-92b5-57962eebdf68 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:28.444641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3759401f-3b54-439e-85d4-83624e80c435 req-cd3e3488-64a7-4068-92b5-57962eebdf68 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:28.446853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3759401f-3b54-439e-85d4-83624e80c435 req-cd3e3488-64a7-4068-92b5-57962eebdf68 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:28.485387 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-3759401f-3b54-439e-85d4-83624e80c435 req-cd3e3488-64a7-4068-92b5-57962eebdf68 service nova] Creating event network-changed:984fbe3f-942d-428e-b69a-4f736cedf9e1 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:15:28.510927 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-3759401f-3b54-439e-85d4-83624e80c435 req-cd3e3488-64a7-4068-92b5-57962eebdf68 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135049 Aug 23 18:15:28.521749 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2366/4850] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:28.575428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b87c3269-4674-4c60-809e-488cbb3a77c0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:28.576249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b87c3269-4674-4c60-809e-488cbb3a77c0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:28.598113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b87c3269-4674-4c60-809e-488cbb3a77c0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:28.598650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b87c3269-4674-4c60-809e-488cbb3a77c0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:28.599101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b87c3269-4674-4c60-809e-488cbb3a77c0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:28.608134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b87c3269-4674-4c60-809e-488cbb3a77c0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:28.608820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b87c3269-4674-4c60-809e-488cbb3a77c0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:28.609343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b87c3269-4674-4c60-809e-488cbb3a77c0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:29.540031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5bf61ae4-34c6-42d0-bbe5-5a2772fd9289 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:29.551401 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5bf61ae4-34c6-42d0-bbe5-5a2772fd9289 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1608 microversion: 2.1 time: 1.633851 Aug 23 18:15:29.554029 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2485/4851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:27 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1608 bytes in 1637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:29.563810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c787f700-1923-40bd-8e87-48e2b2206614 req-ad732bd0-1596-46d1-9f9d-06897c1af876 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629a906b-d9dc-40cd-a05c-cf96c1982a26", "name": "network-vif-plugged", "status": "completed", "tag": "a3fcbe23-363f-40d7-8812-1b049179fc7e"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:29.597845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c787f700-1923-40bd-8e87-48e2b2206614 req-ad732bd0-1596-46d1-9f9d-06897c1af876 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:29.598325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c787f700-1923-40bd-8e87-48e2b2206614 req-ad732bd0-1596-46d1-9f9d-06897c1af876 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:29.598795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c787f700-1923-40bd-8e87-48e2b2206614 req-ad732bd0-1596-46d1-9f9d-06897c1af876 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:29.632085 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c787f700-1923-40bd-8e87-48e2b2206614 req-ad732bd0-1596-46d1-9f9d-06897c1af876 service nova] Creating event network-vif-plugged:a3fcbe23-363f-40d7-8812-1b049179fc7e for instance 629a906b-d9dc-40cd-a05c-cf96c1982a26 on n-h2-850468-16 Aug 23 18:15:29.647003 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c787f700-1923-40bd-8e87-48e2b2206614 req-ad732bd0-1596-46d1-9f9d-06897c1af876 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091130 Aug 23 18:15:29.651322 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2486/4852] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:29.659628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6de970c-1c73-46dc-aac4-585a7f8f76b4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:29.660347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6de970c-1c73-46dc-aac4-585a7f8f76b4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:29.694193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6de970c-1c73-46dc-aac4-585a7f8f76b4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:29.694737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6de970c-1c73-46dc-aac4-585a7f8f76b4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:29.698629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6de970c-1c73-46dc-aac4-585a7f8f76b4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:29.699682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6de970c-1c73-46dc-aac4-585a7f8f76b4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:29.704629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6de970c-1c73-46dc-aac4-585a7f8f76b4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:29.705293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6de970c-1c73-46dc-aac4-585a7f8f76b4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:29.826958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b87c3269-4674-4c60-809e-488cbb3a77c0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:29.847733 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b87c3269-4674-4c60-809e-488cbb3a77c0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1308 microversion: 2.1 time: 1.321855 Aug 23 18:15:29.851369 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2367/4853] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:28 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1308 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:29.869954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5739d172-1702-4010-84a4-a9f4d2c00ab3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:29.870612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5739d172-1702-4010-84a4-a9f4d2c00ab3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:29.886214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5739d172-1702-4010-84a4-a9f4d2c00ab3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:29.887578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5739d172-1702-4010-84a4-a9f4d2c00ab3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:29.888282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5739d172-1702-4010-84a4-a9f4d2c00ab3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:29.889727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5739d172-1702-4010-84a4-a9f4d2c00ab3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:29.890921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5739d172-1702-4010-84a4-a9f4d2c00ab3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:29.891517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5739d172-1702-4010-84a4-a9f4d2c00ab3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:30.114902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6de970c-1c73-46dc-aac4-585a7f8f76b4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:30.127040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6de970c-1c73-46dc-aac4-585a7f8f76b4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:30.133629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6de970c-1c73-46dc-aac4-585a7f8f76b4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:30.135918 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6de970c-1c73-46dc-aac4-585a7f8f76b4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.483135 Aug 23 18:15:30.147376 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2487/4854] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:29 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:30.158582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f0477f3d-a557-4e29-a460-0cf5512b1034 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:30.159482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f0477f3d-a557-4e29-a460-0cf5512b1034 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:30.171859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0477f3d-a557-4e29-a460-0cf5512b1034 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:30.172587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0477f3d-a557-4e29-a460-0cf5512b1034 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:30.175922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0477f3d-a557-4e29-a460-0cf5512b1034 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:30.177156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0477f3d-a557-4e29-a460-0cf5512b1034 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:30.178718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0477f3d-a557-4e29-a460-0cf5512b1034 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:30.179331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0477f3d-a557-4e29-a460-0cf5512b1034 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:30.195600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5739d172-1702-4010-84a4-a9f4d2c00ab3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:30.208140 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5739d172-1702-4010-84a4-a9f4d2c00ab3 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1323 microversion: 2.1 time: 0.350934 Aug 23 18:15:30.211987 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2368/4855] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:29 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1323 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:30.576085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f663b474-d286-41ba-abad-773c6429856b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:30.576717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f663b474-d286-41ba-abad-773c6429856b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:30.585172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f663b474-d286-41ba-abad-773c6429856b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:30.594793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f663b474-d286-41ba-abad-773c6429856b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:30.596528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f663b474-d286-41ba-abad-773c6429856b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:30.597476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f663b474-d286-41ba-abad-773c6429856b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:30.598105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f663b474-d286-41ba-abad-773c6429856b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:30.598766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f663b474-d286-41ba-abad-773c6429856b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:30.692937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f0477f3d-a557-4e29-a460-0cf5512b1034 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:30.704630 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f0477f3d-a557-4e29-a460-0cf5512b1034 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 0.556137 Aug 23 18:15:30.706046 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2488/4856] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:30 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:30.711208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-27308333-02ba-42e1-b2de-764f9931198a req-a21e38b0-966e-4179-aed3-0b3cd6462df6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8908344b-041b-4181-8b33-2a5e191df614", "name": "network-vif-deleted", "tag": "a4ce8cad-bebb-43fd-9c4f-086034d53e3e"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:30.723860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-27308333-02ba-42e1-b2de-764f9931198a req-a21e38b0-966e-4179-aed3-0b3cd6462df6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:30.724712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-27308333-02ba-42e1-b2de-764f9931198a req-a21e38b0-966e-4179-aed3-0b3cd6462df6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:30.725413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-27308333-02ba-42e1-b2de-764f9931198a req-a21e38b0-966e-4179-aed3-0b3cd6462df6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:30.739192 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-27308333-02ba-42e1-b2de-764f9931198a req-a21e38b0-966e-4179-aed3-0b3cd6462df6 service nova] Creating event network-vif-deleted:a4ce8cad-bebb-43fd-9c4f-086034d53e3e for instance 8908344b-041b-4181-8b33-2a5e191df614 on n-h2-850468-16 Aug 23 18:15:30.745806 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-27308333-02ba-42e1-b2de-764f9931198a req-a21e38b0-966e-4179-aed3-0b3cd6462df6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038239 Aug 23 18:15:30.746711 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2489/4857] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:30.847664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f663b474-d286-41ba-abad-773c6429856b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:30.857635 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f663b474-d286-41ba-abad-773c6429856b tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1540 microversion: 2.1 time: 0.285690 Aug 23 18:15:30.859380 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2369/4858] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:30 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1540 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:30.875127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cf3c4902-d393-4119-b23b-4d923d16f8e2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:30.875954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cf3c4902-d393-4119-b23b-4d923d16f8e2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:30.893199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-9a5b950b-e8c8-42c8-9bc8-45c946151d6f req-2077b4a4-3d43-40ba-8b04-3c4328b37a36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "tag": "1748595a-c8aa-4422-ab33-d3f8d2ec00d2"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:30.903122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf3c4902-d393-4119-b23b-4d923d16f8e2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:30.903920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf3c4902-d393-4119-b23b-4d923d16f8e2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:30.904799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf3c4902-d393-4119-b23b-4d923d16f8e2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:30.905785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf3c4902-d393-4119-b23b-4d923d16f8e2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:30.909401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf3c4902-d393-4119-b23b-4d923d16f8e2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:30.911384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf3c4902-d393-4119-b23b-4d923d16f8e2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:30.932538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9a5b950b-e8c8-42c8-9bc8-45c946151d6f req-2077b4a4-3d43-40ba-8b04-3c4328b37a36 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:30.936003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9a5b950b-e8c8-42c8-9bc8-45c946151d6f req-2077b4a4-3d43-40ba-8b04-3c4328b37a36 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:30.937098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9a5b950b-e8c8-42c8-9bc8-45c946151d6f req-2077b4a4-3d43-40ba-8b04-3c4328b37a36 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:30.963086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:30.965846 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-9a5b950b-e8c8-42c8-9bc8-45c946151d6f req-2077b4a4-3d43-40ba-8b04-3c4328b37a36 service nova] Creating event network-changed:1748595a-c8aa-4422-ab33-d3f8d2ec00d2 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:15:30.977493 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-9a5b950b-e8c8-42c8-9bc8-45c946151d6f req-2077b4a4-3d43-40ba-8b04-3c4328b37a36 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089073 Aug 23 18:15:30.981153 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2370/4859] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 23 18:15:31.145153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cf3c4902-d393-4119-b23b-4d923d16f8e2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:31.157161 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cf3c4902-d393-4119-b23b-4d923d16f8e2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1308 microversion: 2.1 time: 0.286331 Aug 23 18:15:31.179583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7dce194b-ad34-4b7c-9185-00bf33a66f46 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:31.180740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7dce194b-ad34-4b7c-9185-00bf33a66f46 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:31.185911 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2490/4860] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:30 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1308 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:31.192710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dce194b-ad34-4b7c-9185-00bf33a66f46 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:31.193703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dce194b-ad34-4b7c-9185-00bf33a66f46 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:31.194409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dce194b-ad34-4b7c-9185-00bf33a66f46 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:31.195390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dce194b-ad34-4b7c-9185-00bf33a66f46 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:31.196471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dce194b-ad34-4b7c-9185-00bf33a66f46 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:31.197073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dce194b-ad34-4b7c-9185-00bf33a66f46 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:31.232348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b386921c-e06a-48af-9a98-f8373acb1b13 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:31.235539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b386921c-e06a-48af-9a98-f8373acb1b13 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:31.249129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b386921c-e06a-48af-9a98-f8373acb1b13 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:31.249645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b386921c-e06a-48af-9a98-f8373acb1b13 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:31.250095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b386921c-e06a-48af-9a98-f8373acb1b13 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:31.258680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b386921c-e06a-48af-9a98-f8373acb1b13 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:31.262654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b386921c-e06a-48af-9a98-f8373acb1b13 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:31.266459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b386921c-e06a-48af-9a98-f8373acb1b13 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:31.462844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:31.504735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b386921c-e06a-48af-9a98-f8373acb1b13 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:31.518810 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b386921c-e06a-48af-9a98-f8373acb1b13 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1323 microversion: 2.1 time: 0.285231 Aug 23 18:15:31.520021 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2491/4861] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:31 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1323 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:31.730925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0067126e-fec3-4c54-a364-713c65e59749 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:31.731764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0067126e-fec3-4c54-a364-713c65e59749 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:31.738740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0067126e-fec3-4c54-a364-713c65e59749 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:31.739244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0067126e-fec3-4c54-a364-713c65e59749 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:31.739692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0067126e-fec3-4c54-a364-713c65e59749 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:31.740411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0067126e-fec3-4c54-a364-713c65e59749 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:31.740877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0067126e-fec3-4c54-a364-713c65e59749 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:31.741312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0067126e-fec3-4c54-a364-713c65e59749 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:32.093898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7dce194b-ad34-4b7c-9185-00bf33a66f46 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:32.114043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7dce194b-ad34-4b7c-9185-00bf33a66f46 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:32.115596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7dce194b-ad34-4b7c-9185-00bf33a66f46 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:32.116788 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7dce194b-ad34-4b7c-9185-00bf33a66f46 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.943331 Aug 23 18:15:32.117397 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2371/4862] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:31 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:32.147943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5cd7862b-c670-4fad-8619-9c2d171a2d8e tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:32.149325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5cd7862b-c670-4fad-8619-9c2d171a2d8e tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:32.178659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:32.218856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cd7862b-c670-4fad-8619-9c2d171a2d8e tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:32.219371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cd7862b-c670-4fad-8619-9c2d171a2d8e tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:32.219818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cd7862b-c670-4fad-8619-9c2d171a2d8e tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:32.220543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cd7862b-c670-4fad-8619-9c2d171a2d8e tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:32.221097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cd7862b-c670-4fad-8619-9c2d171a2d8e tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:32.221427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cd7862b-c670-4fad-8619-9c2d171a2d8e tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:32.295786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0067126e-fec3-4c54-a364-713c65e59749 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:32.316659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=10 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:32.317389 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0067126e-fec3-4c54-a364-713c65e59749 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 0.589906 Aug 23 18:15:32.321879 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2492/4863] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:31 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:32.327306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6440c839-60b3-42f8-8bb3-7130ad765cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:32.342487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6440c839-60b3-42f8-8bb3-7130ad765cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:32.373907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6440c839-60b3-42f8-8bb3-7130ad765cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:32.375888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6440c839-60b3-42f8-8bb3-7130ad765cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:32.376531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6440c839-60b3-42f8-8bb3-7130ad765cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:32.380596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6440c839-60b3-42f8-8bb3-7130ad765cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:32.381654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6440c839-60b3-42f8-8bb3-7130ad765cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:32.387173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6440c839-60b3-42f8-8bb3-7130ad765cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:32.639907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5cd7862b-c670-4fad-8619-9c2d171a2d8e tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:32.650376 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5cd7862b-c670-4fad-8619-9c2d171a2d8e tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1253 microversion: 2.1 time: 0.531889 Aug 23 18:15:32.658785 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2372/4864] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:32 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1253 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:32.674387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07d753b1-0873-479e-8d3c-7ff0458c3bde tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:32.679402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07d753b1-0873-479e-8d3c-7ff0458c3bde tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:32.708139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07d753b1-0873-479e-8d3c-7ff0458c3bde tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:32.714658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07d753b1-0873-479e-8d3c-7ff0458c3bde tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:32.718100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07d753b1-0873-479e-8d3c-7ff0458c3bde tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:32.725268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07d753b1-0873-479e-8d3c-7ff0458c3bde tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:32.725966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07d753b1-0873-479e-8d3c-7ff0458c3bde tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:32.735791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07d753b1-0873-479e-8d3c-7ff0458c3bde tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:32.969076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6440c839-60b3-42f8-8bb3-7130ad765cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:32.982670 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6440c839-60b3-42f8-8bb3-7130ad765cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1308 microversion: 2.1 time: 0.659068 Aug 23 18:15:32.986804 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2493/4865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:32 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1308 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:33.036332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c05e8b08-6c8f-496b-8189-3841f9e8ac3d req-f471ea9d-d3b9-4ccb-b32b-52411e11feb8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "404a2173-45ea-493f-8fc8-153dfd7896fc", "tag": "4bf13e64-4b1b-44e6-9870-edd93b47ab8c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:33.059616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c05e8b08-6c8f-496b-8189-3841f9e8ac3d req-f471ea9d-d3b9-4ccb-b32b-52411e11feb8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:33.060106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c05e8b08-6c8f-496b-8189-3841f9e8ac3d req-f471ea9d-d3b9-4ccb-b32b-52411e11feb8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:33.060541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c05e8b08-6c8f-496b-8189-3841f9e8ac3d req-f471ea9d-d3b9-4ccb-b32b-52411e11feb8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:33.092957 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c05e8b08-6c8f-496b-8189-3841f9e8ac3d req-f471ea9d-d3b9-4ccb-b32b-52411e11feb8 service nova] Creating event network-changed:4bf13e64-4b1b-44e6-9870-edd93b47ab8c for instance 404a2173-45ea-493f-8fc8-153dfd7896fc on n-h1-850468-16 Aug 23 18:15:33.106652 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c05e8b08-6c8f-496b-8189-3841f9e8ac3d req-f471ea9d-d3b9-4ccb-b32b-52411e11feb8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074076 Aug 23 18:15:33.108390 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2494/4866] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:15:33.142706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9c68e429-6457-4b5b-8e21-b8afdef19570 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:33.143903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9c68e429-6457-4b5b-8e21-b8afdef19570 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:33.161671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:33.163508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c68e429-6457-4b5b-8e21-b8afdef19570 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:33.164038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c68e429-6457-4b5b-8e21-b8afdef19570 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:33.165768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c68e429-6457-4b5b-8e21-b8afdef19570 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:33.167470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c68e429-6457-4b5b-8e21-b8afdef19570 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:33.169003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c68e429-6457-4b5b-8e21-b8afdef19570 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:33.171011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c68e429-6457-4b5b-8e21-b8afdef19570 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:33.841798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9c68e429-6457-4b5b-8e21-b8afdef19570 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:33.864140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9c68e429-6457-4b5b-8e21-b8afdef19570 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:33.870238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9c68e429-6457-4b5b-8e21-b8afdef19570 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:33.875574 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9c68e429-6457-4b5b-8e21-b8afdef19570 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.734300 Aug 23 18:15:33.892273 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2495/4867] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:33 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:15:33.901811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9c192c4d-5196-49ed-a8e2-d0ab35771051 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:33.907405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9c192c4d-5196-49ed-a8e2-d0ab35771051 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:33.923724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c192c4d-5196-49ed-a8e2-d0ab35771051 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:33.924579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c192c4d-5196-49ed-a8e2-d0ab35771051 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:33.927697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c192c4d-5196-49ed-a8e2-d0ab35771051 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:33.929015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c192c4d-5196-49ed-a8e2-d0ab35771051 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:33.938837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c192c4d-5196-49ed-a8e2-d0ab35771051 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:33.940061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c192c4d-5196-49ed-a8e2-d0ab35771051 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:34.130171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-07d753b1-0873-479e-8d3c-7ff0458c3bde tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:34.146756 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-07d753b1-0873-479e-8d3c-7ff0458c3bde tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 200 len: 1516 microversion: 2.1 time: 1.486419 Aug 23 18:15:34.155467 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2373/4868] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:32 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 1516 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:34.181935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c3482946-112e-4853-a80f-071dec71672a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:34.186857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c3482946-112e-4853-a80f-071dec71672a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:34.208177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3482946-112e-4853-a80f-071dec71672a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:34.208692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3482946-112e-4853-a80f-071dec71672a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:34.209135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3482946-112e-4853-a80f-071dec71672a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:34.214866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3482946-112e-4853-a80f-071dec71672a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:34.215760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3482946-112e-4853-a80f-071dec71672a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:34.216217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3482946-112e-4853-a80f-071dec71672a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:34.280809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9c192c4d-5196-49ed-a8e2-d0ab35771051 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:34.292206 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9c192c4d-5196-49ed-a8e2-d0ab35771051 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 0.398098 Aug 23 18:15:34.292844 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2496/4869] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:33 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:34.314922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a57bfb9d-dc49-44d7-a8df-d1bff5ebe8ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:34.315547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a57bfb9d-dc49-44d7-a8df-d1bff5ebe8ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:34.337290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a57bfb9d-dc49-44d7-a8df-d1bff5ebe8ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:34.337794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a57bfb9d-dc49-44d7-a8df-d1bff5ebe8ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:34.338272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a57bfb9d-dc49-44d7-a8df-d1bff5ebe8ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:34.339071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a57bfb9d-dc49-44d7-a8df-d1bff5ebe8ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:34.339528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a57bfb9d-dc49-44d7-a8df-d1bff5ebe8ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:34.339949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a57bfb9d-dc49-44d7-a8df-d1bff5ebe8ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:34.466577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c3482946-112e-4853-a80f-071dec71672a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:34.475252 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c3482946-112e-4853-a80f-071dec71672a tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1253 microversion: 2.1 time: 0.318578 Aug 23 18:15:34.476166 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2374/4870] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:34 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1253 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:34.481124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1517b1c7-62a5-4df1-97dc-1711e6730563 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:34.484686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1517b1c7-62a5-4df1-97dc-1711e6730563 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 241aa9bc-9119-44f1-a747-084625b73f3c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:34.498784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1517b1c7-62a5-4df1-97dc-1711e6730563 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:34.501248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1517b1c7-62a5-4df1-97dc-1711e6730563 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:34.503141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1517b1c7-62a5-4df1-97dc-1711e6730563 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:34.504104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1517b1c7-62a5-4df1-97dc-1711e6730563 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:34.506406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1517b1c7-62a5-4df1-97dc-1711e6730563 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:34.507073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1517b1c7-62a5-4df1-97dc-1711e6730563 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:35.158317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a57bfb9d-dc49-44d7-a8df-d1bff5ebe8ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:35.171255 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a57bfb9d-dc49-44d7-a8df-d1bff5ebe8ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1308 microversion: 2.1 time: 0.876876 Aug 23 18:15:35.173364 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2497/4871] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:34 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1308 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:35.178152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6eff95a-9b15-451d-b37d-ccb58a736db9 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:35.178830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6eff95a-9b15-451d-b37d-ccb58a736db9 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:35.199781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6eff95a-9b15-451d-b37d-ccb58a736db9 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:35.200601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6eff95a-9b15-451d-b37d-ccb58a736db9 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:35.201055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6eff95a-9b15-451d-b37d-ccb58a736db9 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:35.201783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6eff95a-9b15-451d-b37d-ccb58a736db9 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:35.202248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6eff95a-9b15-451d-b37d-ccb58a736db9 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:35.210693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6eff95a-9b15-451d-b37d-ccb58a736db9 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:35.319251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1517b1c7-62a5-4df1-97dc-1711e6730563 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:35.341833 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1517b1c7-62a5-4df1-97dc-1711e6730563 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c" status: 200 len: 1515 microversion: 2.1 time: 0.864226 Aug 23 18:15:35.349072 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2375/4872] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:34 2022] GET /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c => generated 1515 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:35.359595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f0f742e6-19dd-4227-8271-7cd65a3fffb9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:35.371021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f0f742e6-19dd-4227-8271-7cd65a3fffb9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:35.398246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0f742e6-19dd-4227-8271-7cd65a3fffb9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:35.401654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0f742e6-19dd-4227-8271-7cd65a3fffb9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:35.402125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0f742e6-19dd-4227-8271-7cd65a3fffb9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:35.407221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0f742e6-19dd-4227-8271-7cd65a3fffb9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:35.411637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0f742e6-19dd-4227-8271-7cd65a3fffb9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:35.412290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0f742e6-19dd-4227-8271-7cd65a3fffb9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:35.746066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f0f742e6-19dd-4227-8271-7cd65a3fffb9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:35.748412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b6eff95a-9b15-451d-b37d-ccb58a736db9 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:35.754848 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f0f742e6-19dd-4227-8271-7cd65a3fffb9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 0.400486 Aug 23 18:15:35.755438 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2376/4873] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:35 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:35.767111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b6eff95a-9b15-451d-b37d-ccb58a736db9 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:35.768981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b6eff95a-9b15-451d-b37d-ccb58a736db9 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:35.772249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f996b755-cf1e-4492-a370-da429ae80f07 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:35.772447 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6eff95a-9b15-451d-b37d-ccb58a736db9 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.596154 Aug 23 18:15:35.787848 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2498/4874] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:35 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:35.787848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2dcf05cd-6969-4e90-bcde-d5786fc99234 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:35.787848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2dcf05cd-6969-4e90-bcde-d5786fc99234 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:35.789712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f996b755-cf1e-4492-a370-da429ae80f07 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: ee31abc5-c0cf-4333-8a58-d8c5a174d41e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:35.799557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2dcf05cd-6969-4e90-bcde-d5786fc99234 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:35.802505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2dcf05cd-6969-4e90-bcde-d5786fc99234 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:35.803115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2dcf05cd-6969-4e90-bcde-d5786fc99234 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:35.803974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2dcf05cd-6969-4e90-bcde-d5786fc99234 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:35.806336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2dcf05cd-6969-4e90-bcde-d5786fc99234 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:35.806902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f996b755-cf1e-4492-a370-da429ae80f07 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:35.807052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2dcf05cd-6969-4e90-bcde-d5786fc99234 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:35.808802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f996b755-cf1e-4492-a370-da429ae80f07 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:35.809708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f996b755-cf1e-4492-a370-da429ae80f07 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:35.811136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f996b755-cf1e-4492-a370-da429ae80f07 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:35.812933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f996b755-cf1e-4492-a370-da429ae80f07 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:35.813550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f996b755-cf1e-4492-a370-da429ae80f07 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:35.932761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2dcf05cd-6969-4e90-bcde-d5786fc99234 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:35.949554 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2dcf05cd-6969-4e90-bcde-d5786fc99234 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1253 microversion: 2.1 time: 0.174273 Aug 23 18:15:35.950526 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2499/4875] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:35 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1253 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:36.128750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f996b755-cf1e-4492-a370-da429ae80f07 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:36.144905 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f996b755-cf1e-4492-a370-da429ae80f07 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e" status: 200 len: 1516 microversion: 2.1 time: 0.383049 Aug 23 18:15:36.147068 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2377/4876] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:35 2022] GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e => generated 1516 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:36.169905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f111a014-be33-44e4-8dc7-27d33f413b97 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:36.170421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f111a014-be33-44e4-8dc7-27d33f413b97 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: ee31abc5-c0cf-4333-8a58-d8c5a174d41e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:36.184245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f111a014-be33-44e4-8dc7-27d33f413b97 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:36.193971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c54c329-6a15-49f9-927a-adae7c3428cb tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:36.194601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1c54c329-6a15-49f9-927a-adae7c3428cb tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:36.199509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f111a014-be33-44e4-8dc7-27d33f413b97 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:36.200072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f111a014-be33-44e4-8dc7-27d33f413b97 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:36.200837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f111a014-be33-44e4-8dc7-27d33f413b97 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:36.204225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f111a014-be33-44e4-8dc7-27d33f413b97 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:36.204767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f111a014-be33-44e4-8dc7-27d33f413b97 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:36.205820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c54c329-6a15-49f9-927a-adae7c3428cb tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:36.207229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c54c329-6a15-49f9-927a-adae7c3428cb tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:36.211928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c54c329-6a15-49f9-927a-adae7c3428cb tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:36.218162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c54c329-6a15-49f9-927a-adae7c3428cb tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:36.220389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c54c329-6a15-49f9-927a-adae7c3428cb tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:36.222236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c54c329-6a15-49f9-927a-adae7c3428cb tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:36.318220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f111a014-be33-44e4-8dc7-27d33f413b97 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: ee31abc5-c0cf-4333-8a58-d8c5a174d41e] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:15:36.347473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:36.500281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1c54c329-6a15-49f9-927a-adae7c3428cb tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:36.513554 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c54c329-6a15-49f9-927a-adae7c3428cb tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1308 microversion: 2.1 time: 0.323122 Aug 23 18:15:36.531232 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2378/4877] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:36 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1308 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:36.541933 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f111a014-be33-44e4-8dc7-27d33f413b97 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e" status: 204 len: 0 microversion: 2.1 time: 0.376005 Aug 23 18:15:36.546412 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2500/4878] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:15:36 2022] DELETE /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e => generated 0 bytes in 379 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:15:36.552286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-60ca9e35-e252-4fc5-9972-52dacf64e46c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:36.553897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-60ca9e35-e252-4fc5-9972-52dacf64e46c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: ee31abc5-c0cf-4333-8a58-d8c5a174d41e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:36.562475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60ca9e35-e252-4fc5-9972-52dacf64e46c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:36.563523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60ca9e35-e252-4fc5-9972-52dacf64e46c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:36.564515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60ca9e35-e252-4fc5-9972-52dacf64e46c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:36.565539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60ca9e35-e252-4fc5-9972-52dacf64e46c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:36.566223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60ca9e35-e252-4fc5-9972-52dacf64e46c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:36.566921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60ca9e35-e252-4fc5-9972-52dacf64e46c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:36.784230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f158306-9f20-4840-87ca-6be3260eea22 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:36.785025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7f158306-9f20-4840-87ca-6be3260eea22 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:36.798753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f158306-9f20-4840-87ca-6be3260eea22 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:36.799257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f158306-9f20-4840-87ca-6be3260eea22 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:36.799703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f158306-9f20-4840-87ca-6be3260eea22 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:36.800590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f158306-9f20-4840-87ca-6be3260eea22 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:36.801689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f158306-9f20-4840-87ca-6be3260eea22 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:36.802363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f158306-9f20-4840-87ca-6be3260eea22 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:36.831224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-60ca9e35-e252-4fc5-9972-52dacf64e46c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:36.845796 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-60ca9e35-e252-4fc5-9972-52dacf64e46c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e" status: 200 len: 1522 microversion: 2.1 time: 0.297590 Aug 23 18:15:36.846402 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2379/4879] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:36 2022] GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e => generated 1522 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:36.851491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a6b31cde-e20b-4355-a911-1611964b3062 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:36.852104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a6b31cde-e20b-4355-a911-1611964b3062 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:36.858408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6b31cde-e20b-4355-a911-1611964b3062 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:36.861673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6b31cde-e20b-4355-a911-1611964b3062 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:36.862223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6b31cde-e20b-4355-a911-1611964b3062 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:36.863002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6b31cde-e20b-4355-a911-1611964b3062 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:36.863468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6b31cde-e20b-4355-a911-1611964b3062 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:36.863900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6b31cde-e20b-4355-a911-1611964b3062 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:37.073885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7f158306-9f20-4840-87ca-6be3260eea22 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:37.086331 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7f158306-9f20-4840-87ca-6be3260eea22 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 0.307502 Aug 23 18:15:37.087515 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2501/4880] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:36 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:37.093485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6742a6b-84a1-426a-9d7f-65e9a0e8dce6 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:37.094505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6742a6b-84a1-426a-9d7f-65e9a0e8dce6 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:37.100907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6742a6b-84a1-426a-9d7f-65e9a0e8dce6 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:37.101659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6742a6b-84a1-426a-9d7f-65e9a0e8dce6 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:37.102444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6742a6b-84a1-426a-9d7f-65e9a0e8dce6 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:37.103466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6742a6b-84a1-426a-9d7f-65e9a0e8dce6 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:37.104120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6742a6b-84a1-426a-9d7f-65e9a0e8dce6 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:37.104879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6742a6b-84a1-426a-9d7f-65e9a0e8dce6 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:37.182284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a6b31cde-e20b-4355-a911-1611964b3062 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:37.185929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6742a6b-84a1-426a-9d7f-65e9a0e8dce6 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:37.197233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a6b31cde-e20b-4355-a911-1611964b3062 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:37.197560 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6742a6b-84a1-426a-9d7f-65e9a0e8dce6 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1253 microversion: 2.1 time: 0.107303 Aug 23 18:15:37.198359 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2502/4881] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:37 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1253 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:37.200874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a6b31cde-e20b-4355-a911-1611964b3062 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:37.202120 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a6b31cde-e20b-4355-a911-1611964b3062 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.354363 Aug 23 18:15:37.202946 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2380/4882] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:36 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:37.538295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-30e9f88d-177a-40bc-b9d6-afd59afd0c29 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:37.539741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-30e9f88d-177a-40bc-b9d6-afd59afd0c29 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:37.553534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30e9f88d-177a-40bc-b9d6-afd59afd0c29 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:37.555177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30e9f88d-177a-40bc-b9d6-afd59afd0c29 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:37.555741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30e9f88d-177a-40bc-b9d6-afd59afd0c29 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:37.556875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30e9f88d-177a-40bc-b9d6-afd59afd0c29 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:37.559759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30e9f88d-177a-40bc-b9d6-afd59afd0c29 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:37.560548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30e9f88d-177a-40bc-b9d6-afd59afd0c29 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:37.873599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b1e8e7d-e1dc-4dfb-bddd-0db8eac7466a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:37.874802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7b1e8e7d-e1dc-4dfb-bddd-0db8eac7466a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: ee31abc5-c0cf-4333-8a58-d8c5a174d41e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:37.882139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:37.884780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b1e8e7d-e1dc-4dfb-bddd-0db8eac7466a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:37.885561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b1e8e7d-e1dc-4dfb-bddd-0db8eac7466a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:37.886219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b1e8e7d-e1dc-4dfb-bddd-0db8eac7466a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:37.888163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b1e8e7d-e1dc-4dfb-bddd-0db8eac7466a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:37.889049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b1e8e7d-e1dc-4dfb-bddd-0db8eac7466a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:37.889827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b1e8e7d-e1dc-4dfb-bddd-0db8eac7466a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:37.920975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-30e9f88d-177a-40bc-b9d6-afd59afd0c29 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:37.934521 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-30e9f88d-177a-40bc-b9d6-afd59afd0c29 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1308 microversion: 2.1 time: 0.396000 Aug 23 18:15:37.938531 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2503/4883] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:37 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1308 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:38.112806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b13a06f4-cf84-4ee7-b575-da8e1edf2fe3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:38.113155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b13a06f4-cf84-4ee7-b575-da8e1edf2fe3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:38.125042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b13a06f4-cf84-4ee7-b575-da8e1edf2fe3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:38.125554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b13a06f4-cf84-4ee7-b575-da8e1edf2fe3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:38.126004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b13a06f4-cf84-4ee7-b575-da8e1edf2fe3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:38.126750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b13a06f4-cf84-4ee7-b575-da8e1edf2fe3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:38.127217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b13a06f4-cf84-4ee7-b575-da8e1edf2fe3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:38.127649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b13a06f4-cf84-4ee7-b575-da8e1edf2fe3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:38.278296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7b1e8e7d-e1dc-4dfb-bddd-0db8eac7466a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:38.288585 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7b1e8e7d-e1dc-4dfb-bddd-0db8eac7466a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e" status: 200 len: 1522 microversion: 2.1 time: 0.419804 Aug 23 18:15:38.302571 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2381/4884] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:37 2022] GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e => generated 1522 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:38.314170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ec8d86b-1a4c-46cd-8673-e0af9cf73436 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:38.315967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9ec8d86b-1a4c-46cd-8673-e0af9cf73436 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:38.331322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ec8d86b-1a4c-46cd-8673-e0af9cf73436 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:38.332951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ec8d86b-1a4c-46cd-8673-e0af9cf73436 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:38.333410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ec8d86b-1a4c-46cd-8673-e0af9cf73436 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:38.335058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ec8d86b-1a4c-46cd-8673-e0af9cf73436 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:38.335534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ec8d86b-1a4c-46cd-8673-e0af9cf73436 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:38.338003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ec8d86b-1a4c-46cd-8673-e0af9cf73436 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:38.476664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9ec8d86b-1a4c-46cd-8673-e0af9cf73436 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:38.491500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b13a06f4-cf84-4ee7-b575-da8e1edf2fe3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:38.491824 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9ec8d86b-1a4c-46cd-8673-e0af9cf73436 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1253 microversion: 2.1 time: 0.191953 Aug 23 18:15:38.493604 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2382/4885] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:38 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1253 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:38.502737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a36897d3-ff17-4810-8b09-91b707379ebe tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:38.507382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a36897d3-ff17-4810-8b09-91b707379ebe tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:38.519499 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b13a06f4-cf84-4ee7-b575-da8e1edf2fe3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 0.411111 Aug 23 18:15:38.522122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a36897d3-ff17-4810-8b09-91b707379ebe tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:38.524683 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2504/4886] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:38 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:38.527135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a36897d3-ff17-4810-8b09-91b707379ebe tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:38.527704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a36897d3-ff17-4810-8b09-91b707379ebe tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:38.528470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a36897d3-ff17-4810-8b09-91b707379ebe tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:38.530341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a36897d3-ff17-4810-8b09-91b707379ebe tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:38.530983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a36897d3-ff17-4810-8b09-91b707379ebe tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:38.956279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c543913f-76a5-46c9-a51c-964151106bff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:38.957478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c543913f-76a5-46c9-a51c-964151106bff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:38.972114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c543913f-76a5-46c9-a51c-964151106bff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:38.983599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c543913f-76a5-46c9-a51c-964151106bff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:38.984678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c543913f-76a5-46c9-a51c-964151106bff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:38.986744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c543913f-76a5-46c9-a51c-964151106bff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:38.987385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c543913f-76a5-46c9-a51c-964151106bff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:38.987980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c543913f-76a5-46c9-a51c-964151106bff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:39.025495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a36897d3-ff17-4810-8b09-91b707379ebe tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:39.040266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a36897d3-ff17-4810-8b09-91b707379ebe tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:39.044288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a36897d3-ff17-4810-8b09-91b707379ebe tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:39.048203 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a36897d3-ff17-4810-8b09-91b707379ebe tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.553257 Aug 23 18:15:39.069306 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2383/4887] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:38 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:39.315625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-077cade6-2472-4b4b-9cdb-9ea247561b1e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:39.316242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-077cade6-2472-4b4b-9cdb-9ea247561b1e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: ee31abc5-c0cf-4333-8a58-d8c5a174d41e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:39.341314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-077cade6-2472-4b4b-9cdb-9ea247561b1e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:39.341917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-077cade6-2472-4b4b-9cdb-9ea247561b1e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:39.342372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-077cade6-2472-4b4b-9cdb-9ea247561b1e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:39.343161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-077cade6-2472-4b4b-9cdb-9ea247561b1e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:39.343664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-077cade6-2472-4b4b-9cdb-9ea247561b1e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:39.344037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-077cade6-2472-4b4b-9cdb-9ea247561b1e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:39.738249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c543913f-76a5-46c9-a51c-964151106bff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:39.752852 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c543913f-76a5-46c9-a51c-964151106bff tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1308 microversion: 2.1 time: 0.799744 Aug 23 18:15:39.768184 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2505/4888] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:38 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1308 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:39.790977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:39.791619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:39.824343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:39.827806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:39.828279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:39.829036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:39.829507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:39.829940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:39.884813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-077cade6-2472-4b4b-9cdb-9ea247561b1e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:39.902802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:39.907209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:39.908475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:39.910155 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-077cade6-2472-4b4b-9cdb-9ea247561b1e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e" status: 200 len: 1522 microversion: 2.1 time: 0.598135 Aug 23 18:15:39.910776 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2384/4889] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:39 2022] GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e => generated 1522 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:39.924176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-011ac2d0-3cee-400e-9936-111310aa2d94 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:39.924942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lazy-loading 'fault' on Instance uuid 8908344b-041b-4181-8b33-2a5e191df614 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:15:39.931257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-011ac2d0-3cee-400e-9936-111310aa2d94 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:39.941933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-011ac2d0-3cee-400e-9936-111310aa2d94 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:39.942438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-011ac2d0-3cee-400e-9936-111310aa2d94 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:39.942911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-011ac2d0-3cee-400e-9936-111310aa2d94 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:39.943635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-011ac2d0-3cee-400e-9936-111310aa2d94 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:39.944096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-011ac2d0-3cee-400e-9936-111310aa2d94 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:39.944537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-011ac2d0-3cee-400e-9936-111310aa2d94 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:40.016473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f5d4ecb2510a43f5bb7d983e65f3d49a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1b9a8cc730ec452daede3d0640e264d7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:40.033393 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d9ab1a87-dc08-406e-ba7c-0c2ef7d2e423 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 200 len: 1258 microversion: 2.1 time: 0.268002 Aug 23 18:15:40.033997 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2506/4890] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:39 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 1258 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:40.077356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b773f510-da98-4a8f-8aa0-ef139acff9ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:40.077971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b773f510-da98-4a8f-8aa0-ef139acff9ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:40.085142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b773f510-da98-4a8f-8aa0-ef139acff9ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:40.091355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b773f510-da98-4a8f-8aa0-ef139acff9ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:40.095121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b773f510-da98-4a8f-8aa0-ef139acff9ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:40.096057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b773f510-da98-4a8f-8aa0-ef139acff9ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:40.103362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b773f510-da98-4a8f-8aa0-ef139acff9ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:40.103818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b773f510-da98-4a8f-8aa0-ef139acff9ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:40.313882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-011ac2d0-3cee-400e-9936-111310aa2d94 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:40.324714 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-011ac2d0-3cee-400e-9936-111310aa2d94 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1527 microversion: 2.1 time: 0.412826 Aug 23 18:15:40.344545 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2385/4891] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:39 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1527 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:40.358529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4b16b903-ca55-4556-8b1b-ab9d6928c631 req-77a8b914-4a8a-45c8-9d0a-93d06e222719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee31abc5-c0cf-4333-8a58-d8c5a174d41e", "name": "network-vif-deleted", "tag": "15fbf67e-03c7-48e5-8997-2f7146575424"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:40.390331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4b16b903-ca55-4556-8b1b-ab9d6928c631 req-77a8b914-4a8a-45c8-9d0a-93d06e222719 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:40.392151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4b16b903-ca55-4556-8b1b-ab9d6928c631 req-77a8b914-4a8a-45c8-9d0a-93d06e222719 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:40.394679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4b16b903-ca55-4556-8b1b-ab9d6928c631 req-77a8b914-4a8a-45c8-9d0a-93d06e222719 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:40.427451 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4b16b903-ca55-4556-8b1b-ab9d6928c631 req-77a8b914-4a8a-45c8-9d0a-93d06e222719 service nova] Creating event network-vif-deleted:15fbf67e-03c7-48e5-8997-2f7146575424 for instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e on n-h2-850468-16 Aug 23 18:15:40.442102 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4b16b903-ca55-4556-8b1b-ab9d6928c631 req-77a8b914-4a8a-45c8-9d0a-93d06e222719 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087887 Aug 23 18:15:40.449940 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2386/4892] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:40.676473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b773f510-da98-4a8f-8aa0-ef139acff9ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:40.689950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b773f510-da98-4a8f-8aa0-ef139acff9ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:40.693799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b773f510-da98-4a8f-8aa0-ef139acff9ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:40.696848 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b773f510-da98-4a8f-8aa0-ef139acff9ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.623288 Aug 23 18:15:40.698381 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2507/4893] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:40 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:15:40.779952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-053037de-fe97-40a4-a719-2bddd3b8a6cf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:40.780714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-053037de-fe97-40a4-a719-2bddd3b8a6cf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:40.809097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-053037de-fe97-40a4-a719-2bddd3b8a6cf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:40.811606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-053037de-fe97-40a4-a719-2bddd3b8a6cf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:40.812942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-053037de-fe97-40a4-a719-2bddd3b8a6cf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:40.815256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-053037de-fe97-40a4-a719-2bddd3b8a6cf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:40.815681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-053037de-fe97-40a4-a719-2bddd3b8a6cf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:40.823593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-053037de-fe97-40a4-a719-2bddd3b8a6cf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:40.932944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:40.933532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: ee31abc5-c0cf-4333-8a58-d8c5a174d41e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:40.956916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:40.957821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:40.958802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:40.960523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:40.961952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:40.964292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:41.042309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:41.042813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:41.043308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:41.043696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lazy-loading 'fault' on Instance uuid ee31abc5-c0cf-4333-8a58-d8c5a174d41e {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:15:41.177256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:41.193218 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-563b48c5-ff7a-45b4-83b8-05fbbfa9f2ac tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e" status: 200 len: 1313 microversion: 2.1 time: 0.265755 Aug 23 18:15:41.194062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-053037de-fe97-40a4-a719-2bddd3b8a6cf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:41.203692 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2508/4894] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:40 2022] GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:41.204408 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-053037de-fe97-40a4-a719-2bddd3b8a6cf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1308 microversion: 2.1 time: 0.429921 Aug 23 18:15:41.207197 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2387/4895] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:40 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1308 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:41.216286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c8e6c6ac-4128-4a0b-9080-8bd39b286746 req-790ac39d-d54f-4e2b-a67a-54ba43d28374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404a2173-45ea-493f-8fc8-153dfd7896fc", "name": "network-vif-plugged", "status": "completed", "tag": "4bf13e64-4b1b-44e6-9870-edd93b47ab8c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:41.219060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a55f4101-36fb-4d91-9204-d085d7689771 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:41.219690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a55f4101-36fb-4d91-9204-d085d7689771 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] [instance: 8908344b-041b-4181-8b33-2a5e191df614] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:41.241031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a55f4101-36fb-4d91-9204-d085d7689771 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:41.241538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a55f4101-36fb-4d91-9204-d085d7689771 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:41.241945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c8e6c6ac-4128-4a0b-9080-8bd39b286746 req-790ac39d-d54f-4e2b-a67a-54ba43d28374 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:41.242718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a55f4101-36fb-4d91-9204-d085d7689771 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:41.243389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c8e6c6ac-4128-4a0b-9080-8bd39b286746 req-790ac39d-d54f-4e2b-a67a-54ba43d28374 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:41.243581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a55f4101-36fb-4d91-9204-d085d7689771 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:41.244052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a55f4101-36fb-4d91-9204-d085d7689771 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:41.244493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a55f4101-36fb-4d91-9204-d085d7689771 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:41.244927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c8e6c6ac-4128-4a0b-9080-8bd39b286746 req-790ac39d-d54f-4e2b-a67a-54ba43d28374 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:41.259602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:41.270271 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c8e6c6ac-4128-4a0b-9080-8bd39b286746 req-790ac39d-d54f-4e2b-a67a-54ba43d28374 service nova] Creating event network-vif-plugged:4bf13e64-4b1b-44e6-9870-edd93b47ab8c for instance 404a2173-45ea-493f-8fc8-153dfd7896fc on n-h1-850468-16 Aug 23 18:15:41.276207 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c8e6c6ac-4128-4a0b-9080-8bd39b286746 req-790ac39d-d54f-4e2b-a67a-54ba43d28374 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071036 Aug 23 18:15:41.277045 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2509/4896] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:41.303571 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-a55f4101-36fb-4d91-9204-d085d7689771 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] HTTP exception thrown: Instance 8908344b-041b-4181-8b33-2a5e191df614 could not be found. Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a55f4101-36fb-4d91-9204-d085d7689771 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Request method failure captured: Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 HTTP/1.1 Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRi5q9iZshUwlRcnnHWj7ekYefLJrItw-4NujYywo9IRbCmAajuqV1HZK3iPlrDRMb0MST0Bxz8rlnwZIyU4-Ny_7KUUQ7DJMugZmRWtLNx9sLMYKZjhC0Gpimvj7HpkxNuh-D93gy75mju3K-E5usD_-kMxzGGa3Yi-hoctjyhT6vM Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 1b9a8cc730ec452daede3d0640e264d7 Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestBootFromVolume-68194150 Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1b9a8cc730ec452daede3d0640e264d7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1b9a8cc730ec452daede3d0640e264d7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1b9a8cc730ec452daede3d0640e264d7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1b9a8cc730ec452daede3d0640e264d7"}]}] Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestBootFromVolume-68194150 Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 1b9a8cc730ec452daede3d0640e264d7 Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestBootFromVolume-68194150 Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestBootFromVolume-68194150-project Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f5d4ecb2510a43f5bb7d983e65f3d49a Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestBootFromVolume-68194150-project Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 8908344b-041b-4181-8b33-2a5e191df614 could not be found. Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '8908344b-041b-4181-8b33-2a5e191df614'} Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8908344b-041b-4181-8b33-2a5e191df614 could not be found. Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8908344b-041b-4181-8b33-2a5e191df614 could not be found. Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:41.324310 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:41.329275 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:41.329275 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:41.329275 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:41.329275 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:15:41.329275 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:15:41.329275 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8908344b-041b-4181-8b33-2a5e191df614 could not be found. Aug 23 18:15:41.329275 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:41.333062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a55f4101-36fb-4d91-9204-d085d7689771 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Returning 404 to user: Instance 8908344b-041b-4181-8b33-2a5e191df614 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:15:41.334164 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a55f4101-36fb-4d91-9204-d085d7689771 tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614" status: 404 len: 111 microversion: 2.1 time: 0.125725 Aug 23 18:15:41.336450 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2388/4897] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:41 2022] GET /compute/v2.1/servers/8908344b-041b-4181-8b33-2a5e191df614 => generated 111 bytes in 127 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:15:41.345840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-14904741-95c1-4b9a-8deb-1b9761d93ccd tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] Calling method '.version_select at 0x7f27ecb104c0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:41.370236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f9b5e6a7-51d2-49ad-a871-ff154e12bec3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:41.371302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f9b5e6a7-51d2-49ad-a871-ff154e12bec3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:41.378904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9b5e6a7-51d2-49ad-a871-ff154e12bec3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:41.379722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9b5e6a7-51d2-49ad-a871-ff154e12bec3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:41.380377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9b5e6a7-51d2-49ad-a871-ff154e12bec3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:41.381332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9b5e6a7-51d2-49ad-a871-ff154e12bec3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:41.382003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9b5e6a7-51d2-49ad-a871-ff154e12bec3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:41.383400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9b5e6a7-51d2-49ad-a871-ff154e12bec3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:41.434132 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-14904741-95c1-4b9a-8deb-1b9761d93ccd tempest-ServersTestBootFromVolume-68194150 tempest-ServersTestBootFromVolume-68194150-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125848974" status: 202 len: 0 microversion: 2.1 time: 0.093224 Aug 23 18:15:41.435079 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2510/4898] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 18:15:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1125848974 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:15:41.721524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-73f696df-4825-437c-b89b-9b630e2cfd2c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:41.722515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-73f696df-4825-437c-b89b-9b630e2cfd2c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:41.738662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f696df-4825-437c-b89b-9b630e2cfd2c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:41.739454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f696df-4825-437c-b89b-9b630e2cfd2c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:41.740087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f696df-4825-437c-b89b-9b630e2cfd2c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:41.740977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f696df-4825-437c-b89b-9b630e2cfd2c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:41.741603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f696df-4825-437c-b89b-9b630e2cfd2c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:41.743307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f696df-4825-437c-b89b-9b630e2cfd2c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:41.800337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f9b5e6a7-51d2-49ad-a871-ff154e12bec3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:41.817020 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f9b5e6a7-51d2-49ad-a871-ff154e12bec3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1509 microversion: 2.1 time: 0.455215 Aug 23 18:15:41.842002 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2389/4899] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:41 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1509 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:42.216788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3453e490-0128-44b0-a28e-24b911dc2181 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:42.217506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3453e490-0128-44b0-a28e-24b911dc2181 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: ee31abc5-c0cf-4333-8a58-d8c5a174d41e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:42.233616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3453e490-0128-44b0-a28e-24b911dc2181 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:42.234531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3453e490-0128-44b0-a28e-24b911dc2181 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:42.236876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3453e490-0128-44b0-a28e-24b911dc2181 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:42.238572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3453e490-0128-44b0-a28e-24b911dc2181 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:42.239206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3453e490-0128-44b0-a28e-24b911dc2181 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:42.239802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3453e490-0128-44b0-a28e-24b911dc2181 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:42.259623 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-3453e490-0128-44b0-a28e-24b911dc2181 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] HTTP exception thrown: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3453e490-0128-44b0-a28e-24b911dc2181 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Request method failure captured: Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e HTTP/1.1 Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRkiSLxOfFHJ8e9nP-lS-clRGIOGyE91Q1FkVkiYpEVjP29o9n_dw_Vh5XolSSfW3qUIeT0BI8i2Lotc96l8ab69JQVEwmxY3gkyPBFBO30KFo3jqQbENW28hDY-QjcesYqRnAwLdrzkyPY3J-Ne_GW8tzxFlbK4uBZbc-H7cVe9B8E Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aef96dcb236245a9941a1a675349d488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}] Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f25058d9281b470ab93d69d03170df41 Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'ee31abc5-c0cf-4333-8a58-d8c5a174d41e'} Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:42.261840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:42.266636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:42.266636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:42.266636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:42.266636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:42.266636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:15:42.266636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:15:42.266636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:42.266636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:42.268231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3453e490-0128-44b0-a28e-24b911dc2181 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Returning 404 to user: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:15:42.269324 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3453e490-0128-44b0-a28e-24b911dc2181 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e" status: 404 len: 111 microversion: 2.1 time: 0.056878 Aug 23 18:15:42.270759 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2390/4900] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:42 2022] GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:15:42.281900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed65bb09-9d87-4a89-8083-78ffc03084f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:42.282930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ed65bb09-9d87-4a89-8083-78ffc03084f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:42.300632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed65bb09-9d87-4a89-8083-78ffc03084f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:42.302350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed65bb09-9d87-4a89-8083-78ffc03084f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:42.302967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed65bb09-9d87-4a89-8083-78ffc03084f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:42.303897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed65bb09-9d87-4a89-8083-78ffc03084f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:42.304550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed65bb09-9d87-4a89-8083-78ffc03084f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:42.305579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed65bb09-9d87-4a89-8083-78ffc03084f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:42.502387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ed65bb09-9d87-4a89-8083-78ffc03084f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:42.515013 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ed65bb09-9d87-4a89-8083-78ffc03084f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1308 microversion: 2.1 time: 0.243046 Aug 23 18:15:42.516902 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2391/4901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:42 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1308 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:42.526344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d7de39a0-ca3e-4964-9779-c5e32386ca5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:42.534843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d7de39a0-ca3e-4964-9779-c5e32386ca5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:42.535901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d7de39a0-ca3e-4964-9779-c5e32386ca5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'aef96dcb236245a9941a1a675349d488'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:15:42.545568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7de39a0-ca3e-4964-9779-c5e32386ca5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:42.546120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7de39a0-ca3e-4964-9779-c5e32386ca5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:42.546787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7de39a0-ca3e-4964-9779-c5e32386ca5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:42.547827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7de39a0-ca3e-4964-9779-c5e32386ca5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:42.548367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7de39a0-ca3e-4964-9779-c5e32386ca5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:42.548852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d7de39a0-ca3e-4964-9779-c5e32386ca5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:42.575434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73f696df-4825-437c-b89b-9b630e2cfd2c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:42.608220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73f696df-4825-437c-b89b-9b630e2cfd2c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:42.614474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73f696df-4825-437c-b89b-9b630e2cfd2c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:42.620884 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-73f696df-4825-437c-b89b-9b630e2cfd2c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.903409 Aug 23 18:15:42.621822 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2511/4902] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:41 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:15:42.704204 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d7de39a0-ca3e-4964-9779-c5e32386ca5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.186162 Aug 23 18:15:42.714026 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2392/4903] 10.222.0.61 () {58 vars in 1230 bytes} [Tue Aug 23 18:15:42 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:15:42.724436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-af3fc682-9e75-4b7b-bef9-75735eb2f4c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-af3fc682-9e75-4b7b-bef9-75735eb2f4c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Request method failure captured: Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRkiSLxOfFHJ8e9nP-lS-clRGIOGyE91Q1FkVkiYpEVjP29o9n_dw_Vh5XolSSfW3qUIeT0BI8i2Lotc96l8ab69JQVEwmxY3gkyPBFBO30KFo3jqQbENW28hDY-QjcesYqRnAwLdrzkyPY3J-Ne_GW8tzxFlbK4uBZbc-H7cVe9B8E Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aef96dcb236245a9941a1a675349d488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}] Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f25058d9281b470ab93d69d03170df41 Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: action_args: {} Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi '2011/01/01' Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 23 18:15:42.737539 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Aug 23 18:15:42.743832 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:42.752331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-af3fc682-9e75-4b7b-bef9-75735eb2f4c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:15:42.757370 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-af3fc682-9e75-4b7b-bef9-75735eb2f4c7 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.035777 Aug 23 18:15:42.765505 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2512/4904] 10.222.0.61 () {58 vars in 1182 bytes} [Tue Aug 23 18:15:42 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:15:42.770628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-578fd3af-f825-4577-9117-969044ec2cbe tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:42.777715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-578fd3af-f825-4577-9117-969044ec2cbe tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:42.778430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-578fd3af-f825-4577-9117-969044ec2cbe tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Searching by: {'deleted': False, 'project_id': 'aef96dcb236245a9941a1a675349d488'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:15:42.786429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-578fd3af-f825-4577-9117-969044ec2cbe tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:42.787043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-578fd3af-f825-4577-9117-969044ec2cbe tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:42.787497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-578fd3af-f825-4577-9117-969044ec2cbe tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:42.788265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-578fd3af-f825-4577-9117-969044ec2cbe tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:42.789390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-578fd3af-f825-4577-9117-969044ec2cbe tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:42.790094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-578fd3af-f825-4577-9117-969044ec2cbe tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:42.842363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-578fd3af-f825-4577-9117-969044ec2cbe tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:15:42.852161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-01578f6d-373c-46d0-a659-7b6bb16fbd4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:42.853069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-01578f6d-373c-46d0-a659-7b6bb16fbd4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:42.867034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01578f6d-373c-46d0-a659-7b6bb16fbd4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:42.874495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01578f6d-373c-46d0-a659-7b6bb16fbd4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:42.875302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01578f6d-373c-46d0-a659-7b6bb16fbd4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:42.876965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01578f6d-373c-46d0-a659-7b6bb16fbd4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:42.878745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01578f6d-373c-46d0-a659-7b6bb16fbd4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:42.884056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01578f6d-373c-46d0-a659-7b6bb16fbd4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:42.896804 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-578fd3af-f825-4577-9117-969044ec2cbe tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.130149 Aug 23 18:15:42.897592 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2393/4905] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 18:15:42 2022] GET /compute/v2.1/servers => generated 683 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:42.914220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56cf91ae-c6be-476b-b1af-d3570f94370d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:42.919270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-56cf91ae-c6be-476b-b1af-d3570f94370d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:42.919575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.compute.servers [None req-56cf91ae-c6be-476b-b1af-d3570f94370d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Removing options 'limit' from query {{(pid=128807) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1487}} Aug 23 18:15:42.923069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-56cf91ae-c6be-476b-b1af-d3570f94370d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Searching by: {'deleted': False, 'project_id': 'aef96dcb236245a9941a1a675349d488'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:15:42.938300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56cf91ae-c6be-476b-b1af-d3570f94370d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:42.938813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56cf91ae-c6be-476b-b1af-d3570f94370d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:42.939287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56cf91ae-c6be-476b-b1af-d3570f94370d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:42.940324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56cf91ae-c6be-476b-b1af-d3570f94370d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:42.941510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56cf91ae-c6be-476b-b1af-d3570f94370d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:42.941952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56cf91ae-c6be-476b-b1af-d3570f94370d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:42.994080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-56cf91ae-c6be-476b-b1af-d3570f94370d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:15:43.058152 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-56cf91ae-c6be-476b-b1af-d3570f94370d tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.147717 Aug 23 18:15:43.059356 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2394/4906] 10.222.0.61 () {58 vars in 1144 bytes} [Tue Aug 23 18:15:42 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:15:43.083147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1db5dbbf-24b1-44fb-95df-f099e253e299 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1db5dbbf-24b1-44fb-95df-f099e253e299 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Request method failure captured: Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRkiSLxOfFHJ8e9nP-lS-clRGIOGyE91Q1FkVkiYpEVjP29o9n_dw_Vh5XolSSfW3qUIeT0BI8i2Lotc96l8ab69JQVEwmxY3gkyPBFBO30KFo3jqQbENW28hDY-QjcesYqRnAwLdrzkyPY3J-Ne_GW8tzxFlbK4uBZbc-H7cVe9B8E Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aef96dcb236245a9941a1a675349d488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}] Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f25058d9281b470ab93d69d03170df41 Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: action_args: {} Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi '-1' Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 23 18:15:43.087378 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Aug 23 18:15:43.092885 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.098667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1db5dbbf-24b1-44fb-95df-f099e253e299 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:15:43.099803 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1db5dbbf-24b1-44fb-95df-f099e253e299 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.021662 Aug 23 18:15:43.106271 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2395/4907] 10.222.0.61 () {58 vars in 1142 bytes} [Tue Aug 23 18:15:43 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:15:43.117543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e8aef97-ce53-4b48-90f2-644f51cdbd74 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e8aef97-ce53-4b48-90f2-644f51cdbd74 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Request method failure captured: Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRkiSLxOfFHJ8e9nP-lS-clRGIOGyE91Q1FkVkiYpEVjP29o9n_dw_Vh5XolSSfW3qUIeT0BI8i2Lotc96l8ab69JQVEwmxY3gkyPBFBO30KFo3jqQbENW28hDY-QjcesYqRnAwLdrzkyPY3J-Ne_GW8tzxFlbK4uBZbc-H7cVe9B8E Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aef96dcb236245a9941a1a675349d488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}] Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f25058d9281b470ab93d69d03170df41 Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: action_args: {} Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'minimum': 0, Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance[0]: Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'testing' Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Aug 23 18:15:43.122839 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Aug 23 18:15:43.128026 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:43.130073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e8aef97-ce53-4b48-90f2-644f51cdbd74 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:15:43.131186 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e8aef97-ce53-4b48-90f2-644f51cdbd74 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.018238 Aug 23 18:15:43.132310 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2396/4908] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 18:15:43 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:15:43.150174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8911ecce-1f85-4da9-91a8-dc830cf1a5f4 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:43.165613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8911ecce-1f85-4da9-91a8-dc830cf1a5f4 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:43.169817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8911ecce-1f85-4da9-91a8-dc830cf1a5f4 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'aef96dcb236245a9941a1a675349d488'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:15:43.189886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.compute.servers [None req-8911ecce-1f85-4da9-91a8-dc830cf1a5f4 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Flavor 'non_existing_flavor' could not be found {{(pid=128807) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Aug 23 18:15:43.191312 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8911ecce-1f85-4da9-91a8-dc830cf1a5f4 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.051584 Aug 23 18:15:43.194932 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2397/4909] 10.222.0.61 () {58 vars in 1178 bytes} [Tue Aug 23 18:15:43 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 18:15:43.209784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c2813b4-daf0-4685-b29c-bb2eea909129 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:43.225232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0c2813b4-daf0-4685-b29c-bb2eea909129 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:43.228718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0c2813b4-daf0-4685-b29c-bb2eea909129 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'aef96dcb236245a9941a1a675349d488'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:15:43.244637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c2813b4-daf0-4685-b29c-bb2eea909129 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:43.256116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c2813b4-daf0-4685-b29c-bb2eea909129 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:43.256800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c2813b4-daf0-4685-b29c-bb2eea909129 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:43.261472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c2813b4-daf0-4685-b29c-bb2eea909129 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:43.263046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c2813b4-daf0-4685-b29c-bb2eea909129 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:43.266062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c2813b4-daf0-4685-b29c-bb2eea909129 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:43.482318 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c2813b4-daf0-4685-b29c-bb2eea909129 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.278457 Aug 23 18:15:43.491838 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2398/4910] 10.222.0.61 () {58 vars in 1174 bytes} [Tue Aug 23 18:15:43 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:15:43.499318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-3cf1e51f-f900-4157-b552-2af8ecb05975 req-4e860d37-1d26-4a65-9394-8b6f910c86ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cad0fb-87b4-403c-9881-64ce147502fd", "name": "network-vif-unplugged", "status": "completed", "tag": "933227f8-f35c-4a4d-8cd9-453f1505d7a3"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:43.511395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3cf1e51f-f900-4157-b552-2af8ecb05975 req-4e860d37-1d26-4a65-9394-8b6f910c86ea service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:43.512542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3cf1e51f-f900-4157-b552-2af8ecb05975 req-4e860d37-1d26-4a65-9394-8b6f910c86ea service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:43.513160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3cf1e51f-f900-4157-b552-2af8ecb05975 req-4e860d37-1d26-4a65-9394-8b6f910c86ea service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:43.528016 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-3cf1e51f-f900-4157-b552-2af8ecb05975 req-4e860d37-1d26-4a65-9394-8b6f910c86ea service nova] Creating event network-vif-unplugged:933227f8-f35c-4a4d-8cd9-453f1505d7a3 for instance f1cad0fb-87b4-403c-9881-64ce147502fd on n-h2-850468-16 Aug 23 18:15:43.534922 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-3cf1e51f-f900-4157-b552-2af8ecb05975 req-4e860d37-1d26-4a65-9394-8b6f910c86ea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040577 Aug 23 18:15:43.536149 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2399/4911] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:43.544430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7a75610f-3ec7-473a-8b51-a1b9c9c09b28 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:43.549944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7a75610f-3ec7-473a-8b51-a1b9c9c09b28 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:43.551029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7a75610f-3ec7-473a-8b51-a1b9c9c09b28 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'aef96dcb236245a9941a1a675349d488'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:15:43.561478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a75610f-3ec7-473a-8b51-a1b9c9c09b28 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:43.562205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a75610f-3ec7-473a-8b51-a1b9c9c09b28 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:43.563194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a75610f-3ec7-473a-8b51-a1b9c9c09b28 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:43.564672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a75610f-3ec7-473a-8b51-a1b9c9c09b28 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:43.565287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a75610f-3ec7-473a-8b51-a1b9c9c09b28 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:43.565871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a75610f-3ec7-473a-8b51-a1b9c9c09b28 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:43.651573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-01578f6d-373c-46d0-a659-7b6bb16fbd4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:43.660519 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-01578f6d-373c-46d0-a659-7b6bb16fbd4b tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1509 microversion: 2.1 time: 0.818432 Aug 23 18:15:43.666301 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2513/4912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:42 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1509 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:43.671619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-28a40f7a-e3d0-4c54-bb34-5b083275cda6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:43.672241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-28a40f7a-e3d0-4c54-bb34-5b083275cda6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:43.684559 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7a75610f-3ec7-473a-8b51-a1b9c9c09b28 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.146711 Aug 23 18:15:43.685516 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2400/4913] 10.222.0.61 () {58 vars in 1184 bytes} [Tue Aug 23 18:15:43 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:15:43.699066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28a40f7a-e3d0-4c54-bb34-5b083275cda6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:43.699572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28a40f7a-e3d0-4c54-bb34-5b083275cda6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:43.700016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28a40f7a-e3d0-4c54-bb34-5b083275cda6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:43.700736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28a40f7a-e3d0-4c54-bb34-5b083275cda6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:43.701199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28a40f7a-e3d0-4c54-bb34-5b083275cda6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:43.701630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28a40f7a-e3d0-4c54-bb34-5b083275cda6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:43.702729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4ece4b06-7ba1-4e19-825f-95e222dd1522 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:43.703818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4ece4b06-7ba1-4e19-825f-95e222dd1522 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:43.712498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ece4b06-7ba1-4e19-825f-95e222dd1522 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:43.713253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ece4b06-7ba1-4e19-825f-95e222dd1522 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:43.713878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ece4b06-7ba1-4e19-825f-95e222dd1522 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:43.715210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ece4b06-7ba1-4e19-825f-95e222dd1522 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:43.716597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ece4b06-7ba1-4e19-825f-95e222dd1522 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:43.717194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ece4b06-7ba1-4e19-825f-95e222dd1522 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:43.974948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-28a40f7a-e3d0-4c54-bb34-5b083275cda6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:43.998063 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-28a40f7a-e3d0-4c54-bb34-5b083275cda6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1488 microversion: 2.1 time: 0.328537 Aug 23 18:15:44.000734 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2514/4914] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:43 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1488 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:44.015924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:44.029596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:44.031118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Searching by: {'deleted': False, 'project_id': 'aef96dcb236245a9941a1a675349d488'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:15:44.041790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:44.042529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:44.043309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:44.044946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:44.045742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:44.048728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:44.124639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:15:44.229591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:44.247492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:44.248190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:44.248789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:44.317421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ece4b06-7ba1-4e19-825f-95e222dd1522 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:44.336128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ece4b06-7ba1-4e19-825f-95e222dd1522 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:44.337858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ece4b06-7ba1-4e19-825f-95e222dd1522 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:44.341366 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4ece4b06-7ba1-4e19-825f-95e222dd1522 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.641885 Aug 23 18:15:44.342042 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2401/4915] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:43 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:44.353646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-801282042", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "bcef2581-80d0-47e5-8b8b-34343a6facf5"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:44.454214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] validate_networks() for [('bcef2581-80d0-47e5-8b8b-34343a6facf5', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:15:44.590196 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-abd1be87-38e6-46af-8057-3251b0c5f2f0 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 3024 microversion: 2.1 time: 0.587859 Aug 23 18:15:44.603515 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2515/4916] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 18:15:44 2022] GET /compute/v2.1/servers/detail => generated 3024 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:44.622470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d15b2e6a-80e2-4c9e-8d96-75866f82dde2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:44.629024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d15b2e6a-80e2-4c9e-8d96-75866f82dde2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:44.631005 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d15b2e6a-80e2-4c9e-8d96-75866f82dde2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.014130 Aug 23 18:15:44.642363 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2516/4917] 10.222.0.61 () {58 vars in 1178 bytes} [Tue Aug 23 18:15:44 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 23 18:15:44.651044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8dc74a91-e6d3-4ba5-adab-44a150a67586 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:44.658084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8dc74a91-e6d3-4ba5-adab-44a150a67586 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:44.659445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8dc74a91-e6d3-4ba5-adab-44a150a67586 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Searching by: {'deleted': False, 'project_id': 'aef96dcb236245a9941a1a675349d488'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:15:44.665590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dc74a91-e6d3-4ba5-adab-44a150a67586 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:44.666690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dc74a91-e6d3-4ba5-adab-44a150a67586 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:44.667328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dc74a91-e6d3-4ba5-adab-44a150a67586 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:44.668228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dc74a91-e6d3-4ba5-adab-44a150a67586 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:44.668901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dc74a91-e6d3-4ba5-adab-44a150a67586 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:44.670361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dc74a91-e6d3-4ba5-adab-44a150a67586 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:44.725186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-8dc74a91-e6d3-4ba5-adab-44a150a67586 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:15:44.794984 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8dc74a91-e6d3-4ba5-adab-44a150a67586 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.151200 Aug 23 18:15:44.808763 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2517/4918] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 18:15:44 2022] GET /compute/v2.1/servers => generated 683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:44.820545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f596573f-6c8e-4a79-8433-471c2ccc0da6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:44.823447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f596573f-6c8e-4a79-8433-471c2ccc0da6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:44.842349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f596573f-6c8e-4a79-8433-471c2ccc0da6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:44.842878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f596573f-6c8e-4a79-8433-471c2ccc0da6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:44.843321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f596573f-6c8e-4a79-8433-471c2ccc0da6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:44.847920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f596573f-6c8e-4a79-8433-471c2ccc0da6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:44.850202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f596573f-6c8e-4a79-8433-471c2ccc0da6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:44.851952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f596573f-6c8e-4a79-8433-471c2ccc0da6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:44.865861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:45.360797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f596573f-6c8e-4a79-8433-471c2ccc0da6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:45.374985 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f596573f-6c8e-4a79-8433-471c2ccc0da6 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1509 microversion: 2.1 time: 0.561139 Aug 23 18:15:45.376935 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2518/4919] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:44 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1509 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:45.401248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bee1c514-4130-4898-b3e5-1c84d9a0c42f tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:45.401774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bee1c514-4130-4898-b3e5-1c84d9a0c42f tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: ee31abc5-c0cf-4333-8a58-d8c5a174d41e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:45.425231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bee1c514-4130-4898-b3e5-1c84d9a0c42f tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:45.427093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bee1c514-4130-4898-b3e5-1c84d9a0c42f tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:45.430974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bee1c514-4130-4898-b3e5-1c84d9a0c42f tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:45.437790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bee1c514-4130-4898-b3e5-1c84d9a0c42f tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:45.439445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bee1c514-4130-4898-b3e5-1c84d9a0c42f tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:45.441056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bee1c514-4130-4898-b3e5-1c84d9a0c42f tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:45.485906 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-bee1c514-4130-4898-b3e5-1c84d9a0c42f tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] HTTP exception thrown: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bee1c514-4130-4898-b3e5-1c84d9a0c42f tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Request method failure captured: Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e HTTP/1.1 Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRkiSLxOfFHJ8e9nP-lS-clRGIOGyE91Q1FkVkiYpEVjP29o9n_dw_Vh5XolSSfW3qUIeT0BI8i2Lotc96l8ab69JQVEwmxY3gkyPBFBO30KFo3jqQbENW28hDY-QjcesYqRnAwLdrzkyPY3J-Ne_GW8tzxFlbK4uBZbc-H7cVe9B8E Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aef96dcb236245a9941a1a675349d488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}] Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f25058d9281b470ab93d69d03170df41 Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'ee31abc5-c0cf-4333-8a58-d8c5a174d41e'} Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:15:45.496154 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bee1c514-4130-4898-b3e5-1c84d9a0c42f tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Returning 404 to user: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bee1c514-4130-4898-b3e5-1c84d9a0c42f tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e" status: 404 len: 111 microversion: 2.1 time: 0.120921 Aug 23 18:15:45.500352 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2519/4920] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:15:45 2022] DELETE /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e => generated 111 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:15:45.532464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd6eb0c5-b758-4b7e-a330-f192ad8957be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:45.534076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cd6eb0c5-b758-4b7e-a330-f192ad8957be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:45.550971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd6eb0c5-b758-4b7e-a330-f192ad8957be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:45.553015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd6eb0c5-b758-4b7e-a330-f192ad8957be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:45.554777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd6eb0c5-b758-4b7e-a330-f192ad8957be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:45.557747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd6eb0c5-b758-4b7e-a330-f192ad8957be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:45.558471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd6eb0c5-b758-4b7e-a330-f192ad8957be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:45.562568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd6eb0c5-b758-4b7e-a330-f192ad8957be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:45.806822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:15:45.807337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:15:45.807692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:15:45.808374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:15:45.809102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:15:45.827503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:45.828082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:45.829061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:45.832780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:45.833629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:45.834323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:45.882039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:15:45.892385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for user 6e80c3f1c008459faa3ac74ea5984eea and project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:15:45.923877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:15:45.926632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:15:46.045081 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b668d330-5f4f-417f-badb-afe5787b296b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.700172 Aug 23 18:15:46.051977 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2402/4921] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:15:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1709 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:15:46.073303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c1d1cd44-37bb-439b-aa85-cc46684f4df2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:46.074001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c1d1cd44-37bb-439b-aa85-cc46684f4df2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 241aa9bc-9119-44f1-a747-084625b73f3c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:46.087202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1d1cd44-37bb-439b-aa85-cc46684f4df2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:46.088061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1d1cd44-37bb-439b-aa85-cc46684f4df2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:46.088683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1d1cd44-37bb-439b-aa85-cc46684f4df2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:46.106085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cd6eb0c5-b758-4b7e-a330-f192ad8957be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:46.124495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cd6eb0c5-b758-4b7e-a330-f192ad8957be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:46.128034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1d1cd44-37bb-439b-aa85-cc46684f4df2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:46.128614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1d1cd44-37bb-439b-aa85-cc46684f4df2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.039s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:46.129064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1d1cd44-37bb-439b-aa85-cc46684f4df2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:46.129936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cd6eb0c5-b758-4b7e-a330-f192ad8957be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:46.137944 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd6eb0c5-b758-4b7e-a330-f192ad8957be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.633834 Aug 23 18:15:46.139275 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2520/4922] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:45 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:46.153279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f26a9380-6954-40f3-8f12-d46c14d6f0a3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:46.154165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f26a9380-6954-40f3-8f12-d46c14d6f0a3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:46.203810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c1d1cd44-37bb-439b-aa85-cc46684f4df2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 241aa9bc-9119-44f1-a747-084625b73f3c] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:15:46.302791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f26a9380-6954-40f3-8f12-d46c14d6f0a3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:46.320979 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f26a9380-6954-40f3-8f12-d46c14d6f0a3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1208 microversion: 2.1 time: 0.178408 Aug 23 18:15:46.325331 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2521/4923] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:46 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1208 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:46.403099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-792e5f5f-47a3-49f1-8ba4-310d0f840eaa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:46.405932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-792e5f5f-47a3-49f1-8ba4-310d0f840eaa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:46.418501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-792e5f5f-47a3-49f1-8ba4-310d0f840eaa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:46.420271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-792e5f5f-47a3-49f1-8ba4-310d0f840eaa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:46.420891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-792e5f5f-47a3-49f1-8ba4-310d0f840eaa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:46.422218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-792e5f5f-47a3-49f1-8ba4-310d0f840eaa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:46.422981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-792e5f5f-47a3-49f1-8ba4-310d0f840eaa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:46.424074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-792e5f5f-47a3-49f1-8ba4-310d0f840eaa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:46.449796 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c1d1cd44-37bb-439b-aa85-cc46684f4df2 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "DELETE /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c" status: 204 len: 0 microversion: 2.1 time: 0.396096 Aug 23 18:15:46.450694 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2403/4924] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:15:46 2022] DELETE /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c => generated 0 bytes in 398 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:15:46.462863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7c94a3e4-b8ef-493f-8e3a-d92721c683ad tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:46.465024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7c94a3e4-b8ef-493f-8e3a-d92721c683ad tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:46.481797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c94a3e4-b8ef-493f-8e3a-d92721c683ad tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:46.485186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c94a3e4-b8ef-493f-8e3a-d92721c683ad tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:46.486577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c94a3e4-b8ef-493f-8e3a-d92721c683ad tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:46.487999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c94a3e4-b8ef-493f-8e3a-d92721c683ad tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:46.490318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c94a3e4-b8ef-493f-8e3a-d92721c683ad tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:46.491006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c94a3e4-b8ef-493f-8e3a-d92721c683ad tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:46.599027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7c94a3e4-b8ef-493f-8e3a-d92721c683ad tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:15:47.006913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-792e5f5f-47a3-49f1-8ba4-310d0f840eaa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:47.024253 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-792e5f5f-47a3-49f1-8ba4-310d0f840eaa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1452 microversion: 2.1 time: 0.629432 Aug 23 18:15:47.038693 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2522/4925] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:46 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1452 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:47.049578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6709216-2430-44a7-8644-f41e2c2806ff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:47.050288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6709216-2430-44a7-8644-f41e2c2806ff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:47.076643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6709216-2430-44a7-8644-f41e2c2806ff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:47.077295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6709216-2430-44a7-8644-f41e2c2806ff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:47.081218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6709216-2430-44a7-8644-f41e2c2806ff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:47.082955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6709216-2430-44a7-8644-f41e2c2806ff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:47.083554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6709216-2430-44a7-8644-f41e2c2806ff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:47.090035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6709216-2430-44a7-8644-f41e2c2806ff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:47.197206 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7c94a3e4-b8ef-493f-8e3a-d92721c683ad tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "DELETE /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 204 len: 0 microversion: 2.1 time: 0.738530 Aug 23 18:15:47.199753 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2404/4926] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:15:46 2022] DELETE /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:15:47.227989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b73bac1-6295-4e54-b5f2-2c991c5d7098 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:47.230322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b73bac1-6295-4e54-b5f2-2c991c5d7098 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:47.244992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b73bac1-6295-4e54-b5f2-2c991c5d7098 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:47.245405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b73bac1-6295-4e54-b5f2-2c991c5d7098 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:47.245846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b73bac1-6295-4e54-b5f2-2c991c5d7098 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:47.250890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b73bac1-6295-4e54-b5f2-2c991c5d7098 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:47.252081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b73bac1-6295-4e54-b5f2-2c991c5d7098 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:47.252536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b73bac1-6295-4e54-b5f2-2c991c5d7098 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:47.517265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b6709216-2430-44a7-8644-f41e2c2806ff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:47.533237 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6709216-2430-44a7-8644-f41e2c2806ff tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1452 microversion: 2.1 time: 0.487984 Aug 23 18:15:47.540851 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2523/4927] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:47 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1452 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:47.547763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-87e7339f-00d5-43ad-bb09-62675083f54e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:47.548380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-87e7339f-00d5-43ad-bb09-62675083f54e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: ee31abc5-c0cf-4333-8a58-d8c5a174d41e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:47.566623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87e7339f-00d5-43ad-bb09-62675083f54e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:47.567176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87e7339f-00d5-43ad-bb09-62675083f54e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:47.567616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87e7339f-00d5-43ad-bb09-62675083f54e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:47.569338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87e7339f-00d5-43ad-bb09-62675083f54e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:47.569876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87e7339f-00d5-43ad-bb09-62675083f54e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:47.570481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87e7339f-00d5-43ad-bb09-62675083f54e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:47.615210 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-87e7339f-00d5-43ad-bb09-62675083f54e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] HTTP exception thrown: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-87e7339f-00d5-43ad-bb09-62675083f54e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Request method failure captured: Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e HTTP/1.1 Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRkiSLxOfFHJ8e9nP-lS-clRGIOGyE91Q1FkVkiYpEVjP29o9n_dw_Vh5XolSSfW3qUIeT0BI8i2Lotc96l8ab69JQVEwmxY3gkyPBFBO30KFo3jqQbENW28hDY-QjcesYqRnAwLdrzkyPY3J-Ne_GW8tzxFlbK4uBZbc-H7cVe9B8E Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aef96dcb236245a9941a1a675349d488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}] Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f25058d9281b470ab93d69d03170df41 Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'ee31abc5-c0cf-4333-8a58-d8c5a174d41e'} Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:47.621240 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:47.626777 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:47.626777 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:47.626777 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:47.626777 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:47.626777 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:15:47.626777 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:15:47.626777 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. Aug 23 18:15:47.626777 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:47.626777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-87e7339f-00d5-43ad-bb09-62675083f54e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Returning 404 to user: Instance ee31abc5-c0cf-4333-8a58-d8c5a174d41e could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:15:47.626777 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-87e7339f-00d5-43ad-bb09-62675083f54e tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e" status: 404 len: 111 microversion: 2.1 time: 0.080873 Aug 23 18:15:47.626777 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2524/4928] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:47 2022] GET /compute/v2.1/servers/ee31abc5-c0cf-4333-8a58-d8c5a174d41e => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:15:47.632430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33deb05d-f7f6-4026-b77f-d7ad3ac42ef3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:47.633351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33deb05d-f7f6-4026-b77f-d7ad3ac42ef3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:47.639706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33deb05d-f7f6-4026-b77f-d7ad3ac42ef3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:47.640197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33deb05d-f7f6-4026-b77f-d7ad3ac42ef3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:47.640629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33deb05d-f7f6-4026-b77f-d7ad3ac42ef3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:47.641325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33deb05d-f7f6-4026-b77f-d7ad3ac42ef3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:47.641961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33deb05d-f7f6-4026-b77f-d7ad3ac42ef3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:47.642571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33deb05d-f7f6-4026-b77f-d7ad3ac42ef3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:47.723698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-33deb05d-f7f6-4026-b77f-d7ad3ac42ef3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:47.735872 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-33deb05d-f7f6-4026-b77f-d7ad3ac42ef3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1212 microversion: 2.1 time: 0.110633 Aug 23 18:15:47.737023 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2525/4929] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:47 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1212 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:47.759024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:47.760932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:47.772588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:47.774376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:47.775586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:47.776787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:47.777511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:47.778154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:47.818595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lazy-loading 'flavor' on Instance uuid f1cad0fb-87b4-403c-9881-64ce147502fd {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:15:47.834617 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Cannot 'shelve' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state shelved_offloaded Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action HTTP/1.1 Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 14 Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: {"shelve": {}} Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: exception: Cannot 'shelve' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state shelved_offloaded Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f1cad0fb-87b4-403c-9881-64ce147502fd', 'body': {'shelve': {}}} Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 275, in inner Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1cad0fb-87b4-403c-9881-64ce147502fd in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 18:15:47.839292 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state shelved_offloaded Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state shelved_offloaded Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 409 to user: Cannot 'shelve' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state shelved_offloaded {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6668beb-a01b-4ee0-b2ec-fe939e27e7e9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 409 len: 155 microversion: 2.1 time: 0.101981 Aug 23 18:15:47.844078 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2526/4930] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:15:47 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 155 bytes in 104 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:15:47.848433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6138403f-8dbe-48d2-b953-c9064d358d5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:47.849197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6138403f-8dbe-48d2-b953-c9064d358d5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 241aa9bc-9119-44f1-a747-084625b73f3c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:47.859944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6138403f-8dbe-48d2-b953-c9064d358d5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:47.860461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6138403f-8dbe-48d2-b953-c9064d358d5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:47.861573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6138403f-8dbe-48d2-b953-c9064d358d5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:47.862881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6138403f-8dbe-48d2-b953-c9064d358d5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:47.864342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6138403f-8dbe-48d2-b953-c9064d358d5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:47.865579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6138403f-8dbe-48d2-b953-c9064d358d5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:48.059419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3b73bac1-6295-4e54-b5f2-2c991c5d7098 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:48.075033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3b73bac1-6295-4e54-b5f2-2c991c5d7098 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:48.078861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3b73bac1-6295-4e54-b5f2-2c991c5d7098 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:48.080088 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3b73bac1-6295-4e54-b5f2-2c991c5d7098 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.872768 Aug 23 18:15:48.085289 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2405/4931] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:47 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:48.095437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a47c5818-685d-4433-8060-02b8e66ac2df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:48.096302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a47c5818-685d-4433-8060-02b8e66ac2df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:48.111608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a47c5818-685d-4433-8060-02b8e66ac2df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:48.113612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6138403f-8dbe-48d2-b953-c9064d358d5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:48.115430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a47c5818-685d-4433-8060-02b8e66ac2df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:48.116095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a47c5818-685d-4433-8060-02b8e66ac2df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:48.117044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a47c5818-685d-4433-8060-02b8e66ac2df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:48.117524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a47c5818-685d-4433-8060-02b8e66ac2df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:48.123787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a47c5818-685d-4433-8060-02b8e66ac2df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:48.127378 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6138403f-8dbe-48d2-b953-c9064d358d5c tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c" status: 200 len: 1521 microversion: 2.1 time: 0.284372 Aug 23 18:15:48.128823 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2527/4932] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:47 2022] GET /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:48.213419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a47c5818-685d-4433-8060-02b8e66ac2df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128807) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 18:15:48.394391 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a47c5818-685d-4433-8060-02b8e66ac2df tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 202 len: 0 microversion: 2.1 time: 0.305135 Aug 23 18:15:48.397061 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2406/4933] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:15:48 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:15:48.404877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-36d2451d-22f5-4590-87f5-9d3ea5453358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:48.405587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-36d2451d-22f5-4590-87f5-9d3ea5453358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:48.418211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36d2451d-22f5-4590-87f5-9d3ea5453358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:48.420861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36d2451d-22f5-4590-87f5-9d3ea5453358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:48.423738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36d2451d-22f5-4590-87f5-9d3ea5453358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:48.424499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36d2451d-22f5-4590-87f5-9d3ea5453358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:48.424963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36d2451d-22f5-4590-87f5-9d3ea5453358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:48.430868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36d2451d-22f5-4590-87f5-9d3ea5453358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:48.757456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77d96207-5cc4-48ea-9f9e-274b4de1ace7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:48.758081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-77d96207-5cc4-48ea-9f9e-274b4de1ace7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:48.769037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77d96207-5cc4-48ea-9f9e-274b4de1ace7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:48.769531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77d96207-5cc4-48ea-9f9e-274b4de1ace7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:48.769980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77d96207-5cc4-48ea-9f9e-274b4de1ace7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:48.777241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77d96207-5cc4-48ea-9f9e-274b4de1ace7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:48.781718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77d96207-5cc4-48ea-9f9e-274b4de1ace7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:48.782179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77d96207-5cc4-48ea-9f9e-274b4de1ace7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:48.789919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-36d2451d-22f5-4590-87f5-9d3ea5453358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:48.809375 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-36d2451d-22f5-4590-87f5-9d3ea5453358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1460 microversion: 2.1 time: 0.408573 Aug 23 18:15:48.817207 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2528/4934] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:48 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1460 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:48.833234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:49.113750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-77d96207-5cc4-48ea-9f9e-274b4de1ace7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:49.121654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9bfa0acd-ebd0-4b78-8688-6c6699e64963 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:49.123542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9bfa0acd-ebd0-4b78-8688-6c6699e64963 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:49.127325 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-77d96207-5cc4-48ea-9f9e-274b4de1ace7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1260 microversion: 2.1 time: 0.373808 Aug 23 18:15:49.128357 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2407/4935] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:48 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1260 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:49.149846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-873fbe82-8dc4-4f83-9a2a-d4c03d66c219 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:49.150946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-873fbe82-8dc4-4f83-9a2a-d4c03d66c219 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 241aa9bc-9119-44f1-a747-084625b73f3c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:49.153461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bfa0acd-ebd0-4b78-8688-6c6699e64963 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:49.154008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bfa0acd-ebd0-4b78-8688-6c6699e64963 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:49.154981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bfa0acd-ebd0-4b78-8688-6c6699e64963 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:49.156657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bfa0acd-ebd0-4b78-8688-6c6699e64963 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:49.157288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bfa0acd-ebd0-4b78-8688-6c6699e64963 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:49.158009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bfa0acd-ebd0-4b78-8688-6c6699e64963 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:49.166044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-873fbe82-8dc4-4f83-9a2a-d4c03d66c219 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:49.166948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-873fbe82-8dc4-4f83-9a2a-d4c03d66c219 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:49.167611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-873fbe82-8dc4-4f83-9a2a-d4c03d66c219 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:49.168533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-873fbe82-8dc4-4f83-9a2a-d4c03d66c219 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:49.169218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-873fbe82-8dc4-4f83-9a2a-d4c03d66c219 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:49.180123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-873fbe82-8dc4-4f83-9a2a-d4c03d66c219 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:49.819746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-873fbe82-8dc4-4f83-9a2a-d4c03d66c219 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:49.832099 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-873fbe82-8dc4-4f83-9a2a-d4c03d66c219 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c" status: 200 len: 1521 microversion: 2.1 time: 0.686707 Aug 23 18:15:49.834034 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2408/4936] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:49 2022] GET /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c => generated 1521 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:49.841949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9bfa0acd-ebd0-4b78-8688-6c6699e64963 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:49.861484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8d0c8b2f-3a49-4f44-9911-1cb9697d761a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:49.862112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8d0c8b2f-3a49-4f44-9911-1cb9697d761a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:49.863220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9bfa0acd-ebd0-4b78-8688-6c6699e64963 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:49.869187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9bfa0acd-ebd0-4b78-8688-6c6699e64963 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:49.870460 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9bfa0acd-ebd0-4b78-8688-6c6699e64963 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.762681 Aug 23 18:15:49.871075 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2529/4937] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:49 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:49.874834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d0c8b2f-3a49-4f44-9911-1cb9697d761a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:49.875526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d0c8b2f-3a49-4f44-9911-1cb9697d761a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:49.875968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d0c8b2f-3a49-4f44-9911-1cb9697d761a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:49.876684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d0c8b2f-3a49-4f44-9911-1cb9697d761a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:49.877141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d0c8b2f-3a49-4f44-9911-1cb9697d761a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:49.877568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d0c8b2f-3a49-4f44-9911-1cb9697d761a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:50.153645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1e58036e-4964-4594-ad32-a651e7000264 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:50.154712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1e58036e-4964-4594-ad32-a651e7000264 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:50.170807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e58036e-4964-4594-ad32-a651e7000264 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:50.171871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e58036e-4964-4594-ad32-a651e7000264 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:50.172895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e58036e-4964-4594-ad32-a651e7000264 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:50.173919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e58036e-4964-4594-ad32-a651e7000264 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:50.174686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e58036e-4964-4594-ad32-a651e7000264 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:50.175984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e58036e-4964-4594-ad32-a651e7000264 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:50.407606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1e58036e-4964-4594-ad32-a651e7000264 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:50.418792 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1e58036e-4964-4594-ad32-a651e7000264 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1266 microversion: 2.1 time: 0.270965 Aug 23 18:15:50.420222 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2530/4938] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:50 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:50.491117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8d0c8b2f-3a49-4f44-9911-1cb9697d761a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:50.502188 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8d0c8b2f-3a49-4f44-9911-1cb9697d761a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1460 microversion: 2.1 time: 0.651464 Aug 23 18:15:50.514575 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2409/4939] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:49 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1460 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:50.626416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-0e561a3b-2e13-40d4-980f-8992eb863faa req-f0bc971d-433b-441a-88be-90335f6b2ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "629a906b-d9dc-40cd-a05c-cf96c1982a26", "name": "network-vif-deleted", "tag": "a3fcbe23-363f-40d7-8812-1b049179fc7e"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:50.685233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0e561a3b-2e13-40d4-980f-8992eb863faa req-f0bc971d-433b-441a-88be-90335f6b2ae2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:50.686252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0e561a3b-2e13-40d4-980f-8992eb863faa req-f0bc971d-433b-441a-88be-90335f6b2ae2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:50.687228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0e561a3b-2e13-40d4-980f-8992eb863faa req-f0bc971d-433b-441a-88be-90335f6b2ae2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:50.715963 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-0e561a3b-2e13-40d4-980f-8992eb863faa req-f0bc971d-433b-441a-88be-90335f6b2ae2 service nova] Creating event network-vif-deleted:a3fcbe23-363f-40d7-8812-1b049179fc7e for instance 629a906b-d9dc-40cd-a05c-cf96c1982a26 on n-h2-850468-16 Aug 23 18:15:50.723848 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-0e561a3b-2e13-40d4-980f-8992eb863faa req-f0bc971d-433b-441a-88be-90335f6b2ae2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131222 Aug 23 18:15:50.725024 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2531/4940] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:50.791296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2f6c2f34-9c08-4e0f-9bd6-47ddc10460c3 req-23d211ae-33d9-4b1d-be07-51dbb382d895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "241aa9bc-9119-44f1-a747-084625b73f3c", "name": "network-vif-deleted", "tag": "80a5ee8a-17ca-4f12-9bf3-43dcc96b6926"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:50.826708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2f6c2f34-9c08-4e0f-9bd6-47ddc10460c3 req-23d211ae-33d9-4b1d-be07-51dbb382d895 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:50.827414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2f6c2f34-9c08-4e0f-9bd6-47ddc10460c3 req-23d211ae-33d9-4b1d-be07-51dbb382d895 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:50.833549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2f6c2f34-9c08-4e0f-9bd6-47ddc10460c3 req-23d211ae-33d9-4b1d-be07-51dbb382d895 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:50.856817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d9d1ace8-640b-4e1f-a753-76ccc8beea1a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:50.859171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d9d1ace8-640b-4e1f-a753-76ccc8beea1a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 241aa9bc-9119-44f1-a747-084625b73f3c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:50.862677 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2f6c2f34-9c08-4e0f-9bd6-47ddc10460c3 req-23d211ae-33d9-4b1d-be07-51dbb382d895 service nova] Creating event network-vif-deleted:80a5ee8a-17ca-4f12-9bf3-43dcc96b6926 for instance 241aa9bc-9119-44f1-a747-084625b73f3c on n-h1-850468-16 Aug 23 18:15:50.875471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9d1ace8-640b-4e1f-a753-76ccc8beea1a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:50.876164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9d1ace8-640b-4e1f-a753-76ccc8beea1a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:50.876723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9d1ace8-640b-4e1f-a753-76ccc8beea1a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:50.878892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9d1ace8-640b-4e1f-a753-76ccc8beea1a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:50.880501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9d1ace8-640b-4e1f-a753-76ccc8beea1a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:50.881531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9d1ace8-640b-4e1f-a753-76ccc8beea1a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:50.886441 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2f6c2f34-9c08-4e0f-9bd6-47ddc10460c3 req-23d211ae-33d9-4b1d-be07-51dbb382d895 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100356 Aug 23 18:15:50.890483 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2410/4941] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:50.904862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc104b88-7978-4848-a55f-e4e1cc59969f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:50.907460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fc104b88-7978-4848-a55f-e4e1cc59969f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:50.920166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc104b88-7978-4848-a55f-e4e1cc59969f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:50.934783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc104b88-7978-4848-a55f-e4e1cc59969f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:50.935448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc104b88-7978-4848-a55f-e4e1cc59969f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:50.938319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc104b88-7978-4848-a55f-e4e1cc59969f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:50.943453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc104b88-7978-4848-a55f-e4e1cc59969f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:50.950254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc104b88-7978-4848-a55f-e4e1cc59969f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:51.128728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d9d1ace8-640b-4e1f-a753-76ccc8beea1a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f25058d9281b470ab93d69d03170df41', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aef96dcb236245a9941a1a675349d488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:51.146106 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d9d1ace8-640b-4e1f-a753-76ccc8beea1a tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c" status: 200 len: 1479 microversion: 2.1 time: 0.294868 Aug 23 18:15:51.163111 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2532/4942] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:50 2022] GET /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c => generated 1479 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:51.445444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1ae318b5-a047-4479-b042-01f2af03425d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:51.446636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1ae318b5-a047-4479-b042-01f2af03425d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:51.463520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ae318b5-a047-4479-b042-01f2af03425d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:51.464378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ae318b5-a047-4479-b042-01f2af03425d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:51.466420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ae318b5-a047-4479-b042-01f2af03425d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:51.467449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ae318b5-a047-4479-b042-01f2af03425d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:51.468215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ae318b5-a047-4479-b042-01f2af03425d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:51.472658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1ae318b5-a047-4479-b042-01f2af03425d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:51.556397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fc104b88-7978-4848-a55f-e4e1cc59969f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:51.566949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fc104b88-7978-4848-a55f-e4e1cc59969f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:51.568827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fc104b88-7978-4848-a55f-e4e1cc59969f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:51.570845 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fc104b88-7978-4848-a55f-e4e1cc59969f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.678899 Aug 23 18:15:51.571423 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2411/4943] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:50 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:51.591910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-80ed4705-dae8-40d4-a311-5b68a9a7f4b8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:51.592844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-80ed4705-dae8-40d4-a311-5b68a9a7f4b8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:51.599630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80ed4705-dae8-40d4-a311-5b68a9a7f4b8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:51.600383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80ed4705-dae8-40d4-a311-5b68a9a7f4b8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:51.601181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80ed4705-dae8-40d4-a311-5b68a9a7f4b8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:51.603033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80ed4705-dae8-40d4-a311-5b68a9a7f4b8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:51.603682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80ed4705-dae8-40d4-a311-5b68a9a7f4b8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:51.604289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-80ed4705-dae8-40d4-a311-5b68a9a7f4b8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:51.888926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1ae318b5-a047-4479-b042-01f2af03425d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:51.908679 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1ae318b5-a047-4479-b042-01f2af03425d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1266 microversion: 2.1 time: 0.466166 Aug 23 18:15:51.910353 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2533/4944] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:51 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1266 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:52.030164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-80ed4705-dae8-40d4-a311-5b68a9a7f4b8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:52.046156 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-80ed4705-dae8-40d4-a311-5b68a9a7f4b8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.458374 Aug 23 18:15:52.061431 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2412/4945] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:51 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:52.175288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83841bc6-8065-4c94-9b0f-473e056ae1e1 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:52.176315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-83841bc6-8065-4c94-9b0f-473e056ae1e1 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 241aa9bc-9119-44f1-a747-084625b73f3c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:52.183118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83841bc6-8065-4c94-9b0f-473e056ae1e1 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:52.183947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83841bc6-8065-4c94-9b0f-473e056ae1e1 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:52.184823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83841bc6-8065-4c94-9b0f-473e056ae1e1 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:52.185615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83841bc6-8065-4c94-9b0f-473e056ae1e1 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:52.186384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83841bc6-8065-4c94-9b0f-473e056ae1e1 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:52.187109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83841bc6-8065-4c94-9b0f-473e056ae1e1 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:52.208227 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-83841bc6-8065-4c94-9b0f-473e056ae1e1 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] HTTP exception thrown: Instance 241aa9bc-9119-44f1-a747-084625b73f3c could not be found. Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83841bc6-8065-4c94-9b0f-473e056ae1e1 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Request method failure captured: Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c HTTP/1.1 Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRkiSLxOfFHJ8e9nP-lS-clRGIOGyE91Q1FkVkiYpEVjP29o9n_dw_Vh5XolSSfW3qUIeT0BI8i2Lotc96l8ab69JQVEwmxY3gkyPBFBO30KFo3jqQbENW28hDY-QjcesYqRnAwLdrzkyPY3J-Ne_GW8tzxFlbK4uBZbc-H7cVe9B8E Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aef96dcb236245a9941a1a675349d488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}] Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f25058d9281b470ab93d69d03170df41 Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 241aa9bc-9119-44f1-a747-084625b73f3c could not be found. Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '241aa9bc-9119-44f1-a747-084625b73f3c'} Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 241aa9bc-9119-44f1-a747-084625b73f3c could not be found. Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 241aa9bc-9119-44f1-a747-084625b73f3c could not be found. Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:52.210029 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:52.215887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:52.215887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:52.215887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:52.215887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:52.215887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:15:52.215887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:15:52.215887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 241aa9bc-9119-44f1-a747-084625b73f3c could not be found. Aug 23 18:15:52.215887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:15:52.215887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83841bc6-8065-4c94-9b0f-473e056ae1e1 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Returning 404 to user: Instance 241aa9bc-9119-44f1-a747-084625b73f3c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:15:52.215887 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-83841bc6-8065-4c94-9b0f-473e056ae1e1 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c" status: 404 len: 111 microversion: 2.1 time: 0.043150 Aug 23 18:15:52.217394 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2534/4946] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:52 2022] GET /compute/v2.1/servers/241aa9bc-9119-44f1-a747-084625b73f3c => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:15:52.225850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2a501e60-da5b-4e74-81b4-33061e537747 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:52.227724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2a501e60-da5b-4e74-81b4-33061e537747 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] [instance: 629a906b-d9dc-40cd-a05c-cf96c1982a26] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:52.247722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a501e60-da5b-4e74-81b4-33061e537747 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:52.248646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a501e60-da5b-4e74-81b4-33061e537747 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:52.249094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a501e60-da5b-4e74-81b4-33061e537747 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:52.249827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a501e60-da5b-4e74-81b4-33061e537747 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:52.250291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a501e60-da5b-4e74-81b4-33061e537747 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:52.250753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a501e60-da5b-4e74-81b4-33061e537747 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:52.268157 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2a501e60-da5b-4e74-81b4-33061e537747 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] HTTP exception thrown: Instance 629a906b-d9dc-40cd-a05c-cf96c1982a26 could not be found. Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2a501e60-da5b-4e74-81b4-33061e537747 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Request method failure captured: Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 HTTP/1.1 Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRkiSLxOfFHJ8e9nP-lS-clRGIOGyE91Q1FkVkiYpEVjP29o9n_dw_Vh5XolSSfW3qUIeT0BI8i2Lotc96l8ab69JQVEwmxY3gkyPBFBO30KFo3jqQbENW28hDY-QjcesYqRnAwLdrzkyPY3J-Ne_GW8tzxFlbK4uBZbc-H7cVe9B8E Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/aef96dcb236245a9941a1a675349d488"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/aef96dcb236245a9941a1a675349d488"}]}] Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: aef96dcb236245a9941a1a675349d488 Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-1127928961 Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f25058d9281b470ab93d69d03170df41 Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ListServersNegativeTestJSON-1127928961-project Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 629a906b-d9dc-40cd-a05c-cf96c1982a26 could not be found. Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '629a906b-d9dc-40cd-a05c-cf96c1982a26'} Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 629a906b-d9dc-40cd-a05c-cf96c1982a26 could not be found. Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 629a906b-d9dc-40cd-a05c-cf96c1982a26 could not be found. Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:52.270323 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:15:52.275789 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:52.275789 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:15:52.275789 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:15:52.275789 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:15:52.275789 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:15:52.275789 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:15:52.275789 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 629a906b-d9dc-40cd-a05c-cf96c1982a26 could not be found. Aug 23 18:15:52.275789 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:15:52.285962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2a501e60-da5b-4e74-81b4-33061e537747 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] Returning 404 to user: Instance 629a906b-d9dc-40cd-a05c-cf96c1982a26 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:15:52.286910 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2a501e60-da5b-4e74-81b4-33061e537747 tempest-ListServersNegativeTestJSON-1127928961 tempest-ListServersNegativeTestJSON-1127928961-project] 10.222.0.61 "GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26" status: 404 len: 111 microversion: 2.1 time: 0.065522 Aug 23 18:15:52.287528 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2413/4947] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:52 2022] GET /compute/v2.1/servers/629a906b-d9dc-40cd-a05c-cf96c1982a26 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:15:52.594227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d5076805-21fa-4f0a-989a-049746d725fa tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:52.597356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d5076805-21fa-4f0a-989a-049746d725fa tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:52.608372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5076805-21fa-4f0a-989a-049746d725fa tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:52.609122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5076805-21fa-4f0a-989a-049746d725fa tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:52.609811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5076805-21fa-4f0a-989a-049746d725fa tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:52.616947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5076805-21fa-4f0a-989a-049746d725fa tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:52.618690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5076805-21fa-4f0a-989a-049746d725fa tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:52.619787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5076805-21fa-4f0a-989a-049746d725fa tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:52.934675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-17a09128-4113-4093-a761-2dbae3b6aa6f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:52.935256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-17a09128-4113-4093-a761-2dbae3b6aa6f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:52.946981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17a09128-4113-4093-a761-2dbae3b6aa6f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:52.948703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17a09128-4113-4093-a761-2dbae3b6aa6f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:52.949156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17a09128-4113-4093-a761-2dbae3b6aa6f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:52.951274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17a09128-4113-4093-a761-2dbae3b6aa6f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:52.951748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17a09128-4113-4093-a761-2dbae3b6aa6f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:52.955229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17a09128-4113-4093-a761-2dbae3b6aa6f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:53.496818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5076805-21fa-4f0a-989a-049746d725fa tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:53.511179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5076805-21fa-4f0a-989a-049746d725fa tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:53.514272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5076805-21fa-4f0a-989a-049746d725fa tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:53.516382 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d5076805-21fa-4f0a-989a-049746d725fa tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.926907 Aug 23 18:15:53.517228 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2535/4948] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:52 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:15:53.531711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db5a2fe0-ef7f-4fce-9cf0-92727462a138 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:53.531711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-db5a2fe0-ef7f-4fce-9cf0-92727462a138 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:53.547745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db5a2fe0-ef7f-4fce-9cf0-92727462a138 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:53.548466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db5a2fe0-ef7f-4fce-9cf0-92727462a138 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:53.549276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db5a2fe0-ef7f-4fce-9cf0-92727462a138 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:53.550173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db5a2fe0-ef7f-4fce-9cf0-92727462a138 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:53.551016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db5a2fe0-ef7f-4fce-9cf0-92727462a138 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:53.551609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db5a2fe0-ef7f-4fce-9cf0-92727462a138 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:53.671796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-17a09128-4113-4093-a761-2dbae3b6aa6f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:53.682042 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-17a09128-4113-4093-a761-2dbae3b6aa6f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 0.751531 Aug 23 18:15:53.683307 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2414/4949] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:52 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:54.545586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2b95e8f7-d22b-49aa-b50d-8c950c878d95 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:54.546229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2b95e8f7-d22b-49aa-b50d-8c950c878d95 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:54.553200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b95e8f7-d22b-49aa-b50d-8c950c878d95 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:54.553704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b95e8f7-d22b-49aa-b50d-8c950c878d95 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:54.554381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b95e8f7-d22b-49aa-b50d-8c950c878d95 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:54.555702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b95e8f7-d22b-49aa-b50d-8c950c878d95 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:54.556579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b95e8f7-d22b-49aa-b50d-8c950c878d95 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:54.557404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b95e8f7-d22b-49aa-b50d-8c950c878d95 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:54.626973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-db5a2fe0-ef7f-4fce-9cf0-92727462a138 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:54.641254 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-db5a2fe0-ef7f-4fce-9cf0-92727462a138 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 1.116488 Aug 23 18:15:54.642048 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2536/4950] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:53 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:54.703941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-112dce3b-2e26-4489-8aca-028cea266e4f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:54.704864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-112dce3b-2e26-4489-8aca-028cea266e4f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:54.717842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:54.720691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-112dce3b-2e26-4489-8aca-028cea266e4f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:54.721456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-112dce3b-2e26-4489-8aca-028cea266e4f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:54.723845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-112dce3b-2e26-4489-8aca-028cea266e4f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:54.724902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-112dce3b-2e26-4489-8aca-028cea266e4f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:54.727313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-112dce3b-2e26-4489-8aca-028cea266e4f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:54.727968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-112dce3b-2e26-4489-8aca-028cea266e4f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:55.155811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2b95e8f7-d22b-49aa-b50d-8c950c878d95 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:55.174646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2b95e8f7-d22b-49aa-b50d-8c950c878d95 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:55.182261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2b95e8f7-d22b-49aa-b50d-8c950c878d95 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:55.188792 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2b95e8f7-d22b-49aa-b50d-8c950c878d95 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.646196 Aug 23 18:15:55.193064 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2415/4951] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:54 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:15:55.505092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-112dce3b-2e26-4489-8aca-028cea266e4f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:55.531475 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-112dce3b-2e26-4489-8aca-028cea266e4f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 0.831455 Aug 23 18:15:55.539215 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2537/4952] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:54 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:15:55.669598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b9fa4f51-0f1c-43ce-a031-ae427d75d2d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:55.670224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b9fa4f51-0f1c-43ce-a031-ae427d75d2d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:55.688297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9fa4f51-0f1c-43ce-a031-ae427d75d2d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:55.688798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9fa4f51-0f1c-43ce-a031-ae427d75d2d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:55.689458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9fa4f51-0f1c-43ce-a031-ae427d75d2d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:55.690356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9fa4f51-0f1c-43ce-a031-ae427d75d2d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:55.691006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9fa4f51-0f1c-43ce-a031-ae427d75d2d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:55.691603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9fa4f51-0f1c-43ce-a031-ae427d75d2d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:55.852264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=12 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:55.916977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:55.974488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-45b12b1b-9981-49f7-a672-7283ba631aeb req-947a63d9-9dcc-449e-8008-b96ba50063a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0", "tag": "02da19a3-cc48-4c32-8ee5-46f26de6f79d"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:15:56.017018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-45b12b1b-9981-49f7-a672-7283ba631aeb req-947a63d9-9dcc-449e-8008-b96ba50063a3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:56.023369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-45b12b1b-9981-49f7-a672-7283ba631aeb req-947a63d9-9dcc-449e-8008-b96ba50063a3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:56.024449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-45b12b1b-9981-49f7-a672-7283ba631aeb req-947a63d9-9dcc-449e-8008-b96ba50063a3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:56.056207 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-45b12b1b-9981-49f7-a672-7283ba631aeb req-947a63d9-9dcc-449e-8008-b96ba50063a3 service nova] Creating event network-changed:02da19a3-cc48-4c32-8ee5-46f26de6f79d for instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 on n-h2-850468-16 Aug 23 18:15:56.071265 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-45b12b1b-9981-49f7-a672-7283ba631aeb req-947a63d9-9dcc-449e-8008-b96ba50063a3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098031 Aug 23 18:15:56.072712 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2538/4953] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:15:56.224455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9e206f23-8f3b-4998-a8f4-1e141a337f1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:56.225688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9e206f23-8f3b-4998-a8f4-1e141a337f1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:56.243237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:56.250904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e206f23-8f3b-4998-a8f4-1e141a337f1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:56.253923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e206f23-8f3b-4998-a8f4-1e141a337f1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:56.256905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e206f23-8f3b-4998-a8f4-1e141a337f1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:56.260416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e206f23-8f3b-4998-a8f4-1e141a337f1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:56.262686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e206f23-8f3b-4998-a8f4-1e141a337f1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:56.264006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e206f23-8f3b-4998-a8f4-1e141a337f1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:56.354895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:56.356006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:56.831255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b9fa4f51-0f1c-43ce-a031-ae427d75d2d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:56.850200 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b9fa4f51-0f1c-43ce-a031-ae427d75d2d5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 1.184767 Aug 23 18:15:56.857696 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2416/4954] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:55 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:56.877005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-da619f11-88e5-4e45-af26-96bde6e87b57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:56.878050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-da619f11-88e5-4e45-af26-96bde6e87b57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:56.892171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:15:56.901849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da619f11-88e5-4e45-af26-96bde6e87b57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:56.903446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da619f11-88e5-4e45-af26-96bde6e87b57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:56.905079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da619f11-88e5-4e45-af26-96bde6e87b57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:56.907035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da619f11-88e5-4e45-af26-96bde6e87b57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:56.908632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da619f11-88e5-4e45-af26-96bde6e87b57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:56.909319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da619f11-88e5-4e45-af26-96bde6e87b57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:57.184765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9e206f23-8f3b-4998-a8f4-1e141a337f1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:57.196005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9e206f23-8f3b-4998-a8f4-1e141a337f1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:57.208566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9e206f23-8f3b-4998-a8f4-1e141a337f1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:57.211619 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9e206f23-8f3b-4998-a8f4-1e141a337f1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.998274 Aug 23 18:15:57.215826 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2539/4955] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:56 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 1004 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:15:57.743057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-da619f11-88e5-4e45-af26-96bde6e87b57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:57.761357 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-da619f11-88e5-4e45-af26-96bde6e87b57 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 0.901834 Aug 23 18:15:57.762449 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2417/4956] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:56 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:57.877712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f9b56f9a-aceb-4d00-9c52-6e3c180b2beb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:57.878423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f9b56f9a-aceb-4d00-9c52-6e3c180b2beb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:57.906334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9b56f9a-aceb-4d00-9c52-6e3c180b2beb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:57.907230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9b56f9a-aceb-4d00-9c52-6e3c180b2beb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:57.909390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9b56f9a-aceb-4d00-9c52-6e3c180b2beb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:57.911305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9b56f9a-aceb-4d00-9c52-6e3c180b2beb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:57.914909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9b56f9a-aceb-4d00-9c52-6e3c180b2beb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:57.917184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9b56f9a-aceb-4d00-9c52-6e3c180b2beb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:58.238018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-174fb103-7a4d-4eee-8137-c1c60982c224 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:58.239408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-174fb103-7a4d-4eee-8137-c1c60982c224 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:58.253532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-174fb103-7a4d-4eee-8137-c1c60982c224 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:58.255545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-174fb103-7a4d-4eee-8137-c1c60982c224 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:58.258731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-174fb103-7a4d-4eee-8137-c1c60982c224 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:58.260506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-174fb103-7a4d-4eee-8137-c1c60982c224 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:58.261805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-174fb103-7a4d-4eee-8137-c1c60982c224 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:58.263737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-174fb103-7a4d-4eee-8137-c1c60982c224 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:59.156084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f9b56f9a-aceb-4d00-9c52-6e3c180b2beb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:59.174313 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f9b56f9a-aceb-4d00-9c52-6e3c180b2beb tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 1.300795 Aug 23 18:15:59.180117 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2540/4957] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:57 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 1307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:15:59.198012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2e96e6cf-36cc-4535-ba14-ef3e5bee0db5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:15:59.199151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2e96e6cf-36cc-4535-ba14-ef3e5bee0db5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:15:59.217612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e96e6cf-36cc-4535-ba14-ef3e5bee0db5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:59.219069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e96e6cf-36cc-4535-ba14-ef3e5bee0db5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:59.219582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e96e6cf-36cc-4535-ba14-ef3e5bee0db5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:59.220932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e96e6cf-36cc-4535-ba14-ef3e5bee0db5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:15:59.221855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e96e6cf-36cc-4535-ba14-ef3e5bee0db5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:15:59.222296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2e96e6cf-36cc-4535-ba14-ef3e5bee0db5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:15:59.232422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-174fb103-7a4d-4eee-8137-c1c60982c224 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:59.249097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-174fb103-7a4d-4eee-8137-c1c60982c224 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:59.252578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-174fb103-7a4d-4eee-8137-c1c60982c224 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:15:59.258861 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-174fb103-7a4d-4eee-8137-c1c60982c224 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 1.023869 Aug 23 18:15:59.260883 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2418/4958] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:15:58 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 1028 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:16:00.112924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2e96e6cf-36cc-4535-ba14-ef3e5bee0db5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:00.122215 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2e96e6cf-36cc-4535-ba14-ef3e5bee0db5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 0.940567 Aug 23 18:16:00.126451 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2541/4959] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:15:59 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:00.202417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a0dc76cf-7192-4576-8236-d30520409fec tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:00.203357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a0dc76cf-7192-4576-8236-d30520409fec tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:00.213108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0dc76cf-7192-4576-8236-d30520409fec tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:00.213923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0dc76cf-7192-4576-8236-d30520409fec tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:00.214566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0dc76cf-7192-4576-8236-d30520409fec tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:00.215762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0dc76cf-7192-4576-8236-d30520409fec tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:00.216392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0dc76cf-7192-4576-8236-d30520409fec tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:00.217015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0dc76cf-7192-4576-8236-d30520409fec tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:00.306269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7bb716f2-ea90-4a7b-9431-5cd4e2d08adc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:00.307601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7bb716f2-ea90-4a7b-9431-5cd4e2d08adc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:00.317228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7bb716f2-ea90-4a7b-9431-5cd4e2d08adc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:00.317964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7bb716f2-ea90-4a7b-9431-5cd4e2d08adc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:00.319426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7bb716f2-ea90-4a7b-9431-5cd4e2d08adc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:00.321097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7bb716f2-ea90-4a7b-9431-5cd4e2d08adc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:00.322494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7bb716f2-ea90-4a7b-9431-5cd4e2d08adc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:00.323454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7bb716f2-ea90-4a7b-9431-5cd4e2d08adc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:00.668788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a0dc76cf-7192-4576-8236-d30520409fec tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:00.697209 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a0dc76cf-7192-4576-8236-d30520409fec tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.496861 Aug 23 18:16:00.699675 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2419/4960] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:00 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:00.754589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7bb716f2-ea90-4a7b-9431-5cd4e2d08adc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:00.806738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7bb716f2-ea90-4a7b-9431-5cd4e2d08adc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:00.812316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7bb716f2-ea90-4a7b-9431-5cd4e2d08adc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:00.821352 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7bb716f2-ea90-4a7b-9431-5cd4e2d08adc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.528856 Aug 23 18:16:00.823866 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2542/4961] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:00 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:01.158202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b1be5698-9972-405a-aea2-01214c9ff185 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:01.158847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b1be5698-9972-405a-aea2-01214c9ff185 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:01.185693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1be5698-9972-405a-aea2-01214c9ff185 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:01.186606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1be5698-9972-405a-aea2-01214c9ff185 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:01.186970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1be5698-9972-405a-aea2-01214c9ff185 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:01.188242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1be5698-9972-405a-aea2-01214c9ff185 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:01.188783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1be5698-9972-405a-aea2-01214c9ff185 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:01.189213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b1be5698-9972-405a-aea2-01214c9ff185 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:01.727124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-015d1398-4747-4b40-9d2f-7d91acd64fa5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:01.728862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-015d1398-4747-4b40-9d2f-7d91acd64fa5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:01.739795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b1be5698-9972-405a-aea2-01214c9ff185 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:01.756362 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b1be5698-9972-405a-aea2-01214c9ff185 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 0.611822 Aug 23 18:16:01.764357 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2420/4962] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:01 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:01.767002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-015d1398-4747-4b40-9d2f-7d91acd64fa5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:01.767507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-015d1398-4747-4b40-9d2f-7d91acd64fa5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:01.767950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-015d1398-4747-4b40-9d2f-7d91acd64fa5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:01.769862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-015d1398-4747-4b40-9d2f-7d91acd64fa5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:01.770329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-015d1398-4747-4b40-9d2f-7d91acd64fa5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:01.770786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-015d1398-4747-4b40-9d2f-7d91acd64fa5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:01.852420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-30fb933a-64ce-4c32-9004-d1b2e96f7d94 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:01.853627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-30fb933a-64ce-4c32-9004-d1b2e96f7d94 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:01.869870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30fb933a-64ce-4c32-9004-d1b2e96f7d94 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:01.872302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30fb933a-64ce-4c32-9004-d1b2e96f7d94 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:01.872754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30fb933a-64ce-4c32-9004-d1b2e96f7d94 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:01.876850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30fb933a-64ce-4c32-9004-d1b2e96f7d94 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:01.877774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30fb933a-64ce-4c32-9004-d1b2e96f7d94 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:01.878238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30fb933a-64ce-4c32-9004-d1b2e96f7d94 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:02.142200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-015d1398-4747-4b40-9d2f-7d91acd64fa5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:02.161427 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-015d1398-4747-4b40-9d2f-7d91acd64fa5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.438654 Aug 23 18:16:02.162647 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2543/4963] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:01 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:02.340310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-30fb933a-64ce-4c32-9004-d1b2e96f7d94 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:02.401476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-30fb933a-64ce-4c32-9004-d1b2e96f7d94 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:02.413995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-30fb933a-64ce-4c32-9004-d1b2e96f7d94 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:02.419033 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-30fb933a-64ce-4c32-9004-d1b2e96f7d94 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.569087 Aug 23 18:16:02.424349 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2421/4964] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:01 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:02.626192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a33909b0-5a08-4fc9-8ab5-cb79de24caa9 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-715587821", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:02.639980 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-a33909b0-5a08-4fc9-8ab5-cb79de24caa9 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] HTTP exception thrown: min_count must be <= max_count Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a33909b0-5a08-4fc9-8ab5-cb79de24caa9 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Request method failure captured: Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 183 Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRlhXANdIeak2mRf8XehPqstNt9LUZZwX3HSb7VqJtvBmvRS_9dKUNmGM_CBfyWZ2gCyMGSb8vmowVqukREFXQQCWShiD38RYPLfCrmBaepyTt0Na0JCdpw36IW02GrLaTFKOzMLgOR6Xf0RQTZlFCc5GbcAnjRDJz9DXhPfF7scDzw Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: c4e32dcb2a2a44bebcae3b1c8fe57a92 Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}] Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: c4e32dcb2a2a44bebcae3b1c8fe57a92 Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-MultipleCreateNegativeTestJSON-1080418632-project Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4e37ef3894364e9892c245c1b519f22a Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1080418632-project Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-715587821", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "min_count": 3, "max_count": 2}} Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: exception: min_count must be <= max_count Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-715587821', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Aug 23 18:16:02.644989 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.650148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a33909b0-5a08-4fc9-8ab5-cb79de24caa9 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Returning 400 to user: min_count must be <= max_count {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:02.667224 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a33909b0-5a08-4fc9-8ab5-cb79de24caa9 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.484977 Aug 23 18:16:02.668445 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2544/4965] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:16:02 2022] POST /compute/v2.1/servers => generated 74 bytes in 505 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Aug 23 18:16:02.764506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6f163bc8-ce5e-4750-acb7-77a5983ef4a9 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-61280650", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "max_count": 0}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6f163bc8-ce5e-4750-acb7-77a5983ef4a9 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Request method failure captured: Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 166 Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRlhXANdIeak2mRf8XehPqstNt9LUZZwX3HSb7VqJtvBmvRS_9dKUNmGM_CBfyWZ2gCyMGSb8vmowVqukREFXQQCWShiD38RYPLfCrmBaepyTt0Na0JCdpw36IW02GrLaTFKOzMLgOR6Xf0RQTZlFCc5GbcAnjRDJz9DXhPfF7scDzw Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: c4e32dcb2a2a44bebcae3b1c8fe57a92 Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}] Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: c4e32dcb2a2a44bebcae3b1c8fe57a92 Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-MultipleCreateNegativeTestJSON-1080418632-project Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4e37ef3894364e9892c245c1b519f22a Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1080418632-project Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-61280650", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "max_count": 0}} Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-61280650', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'max_count': 0}}} Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 0 Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:16:02.772268 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Aug 23 18:16:02.777984 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.789848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3368e124-ddd2-48df-af44-158f37c6e521 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:02.791185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3368e124-ddd2-48df-af44-158f37c6e521 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:02.794523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6f163bc8-ce5e-4750-acb7-77a5983ef4a9 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:02.796455 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6f163bc8-ce5e-4750-acb7-77a5983ef4a9 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.039917 Aug 23 18:16:02.804582 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2422/4966] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:16:02 2022] POST /compute/v2.1/servers => generated 130 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:16:02.813231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3368e124-ddd2-48df-af44-158f37c6e521 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:02.813760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3368e124-ddd2-48df-af44-158f37c6e521 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:02.814201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3368e124-ddd2-48df-af44-158f37c6e521 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:02.821106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3368e124-ddd2-48df-af44-158f37c6e521 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:02.822498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3368e124-ddd2-48df-af44-158f37c6e521 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:02.823789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3368e124-ddd2-48df-af44-158f37c6e521 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:02.955935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9b26b70b-782e-49b7-a444-22ac5442c371 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-277524899", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "max_count": 2.5}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9b26b70b-782e-49b7-a444-22ac5442c371 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Request method failure captured: Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 169 Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRlhXANdIeak2mRf8XehPqstNt9LUZZwX3HSb7VqJtvBmvRS_9dKUNmGM_CBfyWZ2gCyMGSb8vmowVqukREFXQQCWShiD38RYPLfCrmBaepyTt0Na0JCdpw36IW02GrLaTFKOzMLgOR6Xf0RQTZlFCc5GbcAnjRDJz9DXhPfF7scDzw Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: c4e32dcb2a2a44bebcae3b1c8fe57a92 Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}] Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: c4e32dcb2a2a44bebcae3b1c8fe57a92 Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-MultipleCreateNegativeTestJSON-1080418632-project Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4e37ef3894364e9892c245c1b519f22a Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1080418632-project Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-277524899", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "max_count": 2.5}} Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-277524899', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'max_count': 2.5}}} Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 2.5 Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:16:02.967471 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:02.973231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9b26b70b-782e-49b7-a444-22ac5442c371 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:02.981712 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9b26b70b-782e-49b7-a444-22ac5442c371 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.029309 Aug 23 18:16:02.983906 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2423/4967] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:16:02 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 18:16:03.118729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ce402c9b-dc52-4111-808e-033948bb0e83 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-397057496", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "min_count": 0}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ce402c9b-dc52-4111-808e-033948bb0e83 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Request method failure captured: Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 167 Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRlhXANdIeak2mRf8XehPqstNt9LUZZwX3HSb7VqJtvBmvRS_9dKUNmGM_CBfyWZ2gCyMGSb8vmowVqukREFXQQCWShiD38RYPLfCrmBaepyTt0Na0JCdpw36IW02GrLaTFKOzMLgOR6Xf0RQTZlFCc5GbcAnjRDJz9DXhPfF7scDzw Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: c4e32dcb2a2a44bebcae3b1c8fe57a92 Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}] Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: c4e32dcb2a2a44bebcae3b1c8fe57a92 Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-MultipleCreateNegativeTestJSON-1080418632-project Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4e37ef3894364e9892c245c1b519f22a Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1080418632-project Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-397057496", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "min_count": 0}} Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-397057496', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'min_count': 0}}} Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 0 Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:16:03.136753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Aug 23 18:16:03.141751 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.146593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ce402c9b-dc52-4111-808e-033948bb0e83 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:03.150760 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ce402c9b-dc52-4111-808e-033948bb0e83 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.041311 Aug 23 18:16:03.151892 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2424/4968] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:16:03 2022] POST /compute/v2.1/servers => generated 130 bytes in 46 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 23 18:16:03.189537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d6474dd0-bb80-47ca-8a74-c6177f742be1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:03.190499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d6474dd0-bb80-47ca-8a74-c6177f742be1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:03.218226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6474dd0-bb80-47ca-8a74-c6177f742be1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:03.227377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6474dd0-bb80-47ca-8a74-c6177f742be1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:03.227837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6474dd0-bb80-47ca-8a74-c6177f742be1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:03.228624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6474dd0-bb80-47ca-8a74-c6177f742be1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:03.229098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6474dd0-bb80-47ca-8a74-c6177f742be1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:03.229613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6474dd0-bb80-47ca-8a74-c6177f742be1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:03.909347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3368e124-ddd2-48df-af44-158f37c6e521 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:03.926811 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3368e124-ddd2-48df-af44-158f37c6e521 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 1.145682 Aug 23 18:16:03.927984 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2545/4969] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:02 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 1147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:03.943735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2dedae4d-9a26-4b04-b6ba-f43d513e2032 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1799323377", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "min_count": 2.5}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2dedae4d-9a26-4b04-b6ba-f43d513e2032 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Request method failure captured: Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 170 Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRlhXANdIeak2mRf8XehPqstNt9LUZZwX3HSb7VqJtvBmvRS_9dKUNmGM_CBfyWZ2gCyMGSb8vmowVqukREFXQQCWShiD38RYPLfCrmBaepyTt0Na0JCdpw36IW02GrLaTFKOzMLgOR6Xf0RQTZlFCc5GbcAnjRDJz9DXhPfF7scDzw Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: c4e32dcb2a2a44bebcae3b1c8fe57a92 Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c4e32dcb2a2a44bebcae3b1c8fe57a92"}]}] Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: c4e32dcb2a2a44bebcae3b1c8fe57a92 Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-1080418632 Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-MultipleCreateNegativeTestJSON-1080418632-project Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4e37ef3894364e9892c245c1b519f22a Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-1080418632-project Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1799323377", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "min_count": 2.5}} Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1799323377', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'min_count': 2.5}}} Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'minLength': 1, Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'minimum': 1, Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 2.5 Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:16:03.949822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Aug 23 18:16:03.954490 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:03.956708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2dedae4d-9a26-4b04-b6ba-f43d513e2032 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:03.957798 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2dedae4d-9a26-4b04-b6ba-f43d513e2032 tempest-MultipleCreateNegativeTestJSON-1080418632 tempest-MultipleCreateNegativeTestJSON-1080418632-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.028610 Aug 23 18:16:03.958607 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2546/4970] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:16:03 2022] POST /compute/v2.1/servers => generated 139 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:16:03.981365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-861e2711-48d2-4062-b8dc-5bd3d32b0ee7 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:03.988556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-861e2711-48d2-4062-b8dc-5bd3d32b0ee7 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:03.999595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d6474dd0-bb80-47ca-8a74-c6177f742be1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:04.011106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-861e2711-48d2-4062-b8dc-5bd3d32b0ee7 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:04.011612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-861e2711-48d2-4062-b8dc-5bd3d32b0ee7 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:04.013854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-861e2711-48d2-4062-b8dc-5bd3d32b0ee7 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:04.014929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-861e2711-48d2-4062-b8dc-5bd3d32b0ee7 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:04.016629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-861e2711-48d2-4062-b8dc-5bd3d32b0ee7 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:04.017281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-861e2711-48d2-4062-b8dc-5bd3d32b0ee7 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:04.028571 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d6474dd0-bb80-47ca-8a74-c6177f742be1 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.837408 Aug 23 18:16:04.033303 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2425/4971] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:03 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:04.960702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f40ec615-ea8e-4e6d-a340-63edd09bf2c5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:04.961591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f40ec615-ea8e-4e6d-a340-63edd09bf2c5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:04.980836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f40ec615-ea8e-4e6d-a340-63edd09bf2c5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:04.983489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f40ec615-ea8e-4e6d-a340-63edd09bf2c5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:04.984233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f40ec615-ea8e-4e6d-a340-63edd09bf2c5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:04.987921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f40ec615-ea8e-4e6d-a340-63edd09bf2c5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:04.988828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f40ec615-ea8e-4e6d-a340-63edd09bf2c5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:04.990074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f40ec615-ea8e-4e6d-a340-63edd09bf2c5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:05.541889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-861e2711-48d2-4062-b8dc-5bd3d32b0ee7 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:05.567368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-861e2711-48d2-4062-b8dc-5bd3d32b0ee7 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:05.570311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-861e2711-48d2-4062-b8dc-5bd3d32b0ee7 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:05.579024 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-861e2711-48d2-4062-b8dc-5bd3d32b0ee7 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 1.618653 Aug 23 18:16:05.579637 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2547/4972] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:03 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:05.600104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b77711d1-1879-4b03-a1f9-471ae1d8c139 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:05.607464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b77711d1-1879-4b03-a1f9-471ae1d8c139 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:05.628092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b77711d1-1879-4b03-a1f9-471ae1d8c139 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:05.628604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b77711d1-1879-4b03-a1f9-471ae1d8c139 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:05.629369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b77711d1-1879-4b03-a1f9-471ae1d8c139 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:05.630336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b77711d1-1879-4b03-a1f9-471ae1d8c139 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:05.631060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b77711d1-1879-4b03-a1f9-471ae1d8c139 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:05.634529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b77711d1-1879-4b03-a1f9-471ae1d8c139 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:06.273687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f40ec615-ea8e-4e6d-a340-63edd09bf2c5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:06.289844 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f40ec615-ea8e-4e6d-a340-63edd09bf2c5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 1.333696 Aug 23 18:16:06.292223 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2426/4973] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:04 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:06.538473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b77711d1-1879-4b03-a1f9-471ae1d8c139 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:06.559480 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b77711d1-1879-4b03-a1f9-471ae1d8c139 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.978740 Aug 23 18:16:06.560424 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2548/4974] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:05 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 980 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:06.606734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a473c9f9-b1b0-4148-84dd-2533935aecf1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:06.607364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a473c9f9-b1b0-4148-84dd-2533935aecf1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:06.621259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a473c9f9-b1b0-4148-84dd-2533935aecf1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:06.621775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a473c9f9-b1b0-4148-84dd-2533935aecf1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:06.623448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a473c9f9-b1b0-4148-84dd-2533935aecf1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:06.624245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a473c9f9-b1b0-4148-84dd-2533935aecf1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:06.626988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a473c9f9-b1b0-4148-84dd-2533935aecf1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:06.628905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a473c9f9-b1b0-4148-84dd-2533935aecf1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:07.262411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a473c9f9-b1b0-4148-84dd-2533935aecf1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:07.278994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a473c9f9-b1b0-4148-84dd-2533935aecf1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:07.281897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a473c9f9-b1b0-4148-84dd-2533935aecf1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:07.288591 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a473c9f9-b1b0-4148-84dd-2533935aecf1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.687573 Aug 23 18:16:07.291015 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2427/4975] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:06 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:07.317314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-256c2a5b-8bf2-47a8-9445-8474a05b088f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:07.317953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-256c2a5b-8bf2-47a8-9445-8474a05b088f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:07.347590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-256c2a5b-8bf2-47a8-9445-8474a05b088f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:07.348194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-256c2a5b-8bf2-47a8-9445-8474a05b088f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:07.348632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-256c2a5b-8bf2-47a8-9445-8474a05b088f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:07.356318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-256c2a5b-8bf2-47a8-9445-8474a05b088f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:07.357837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-256c2a5b-8bf2-47a8-9445-8474a05b088f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:07.358296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-256c2a5b-8bf2-47a8-9445-8474a05b088f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:07.589793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf4b70d9-7b98-4aab-b492-9a9b5f6af1fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:07.590755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf4b70d9-7b98-4aab-b492-9a9b5f6af1fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:07.620259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4b70d9-7b98-4aab-b492-9a9b5f6af1fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:07.623889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4b70d9-7b98-4aab-b492-9a9b5f6af1fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:07.625363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4b70d9-7b98-4aab-b492-9a9b5f6af1fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:07.626828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4b70d9-7b98-4aab-b492-9a9b5f6af1fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:07.629538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4b70d9-7b98-4aab-b492-9a9b5f6af1fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:07.636535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4b70d9-7b98-4aab-b492-9a9b5f6af1fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:07.703330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:08.205422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf4b70d9-7b98-4aab-b492-9a9b5f6af1fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:08.218920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-256c2a5b-8bf2-47a8-9445-8474a05b088f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:08.221440 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf4b70d9-7b98-4aab-b492-9a9b5f6af1fa tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.634890 Aug 23 18:16:08.226941 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2428/4976] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:07 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:08.232698 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-256c2a5b-8bf2-47a8-9445-8474a05b088f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 0.919482 Aug 23 18:16:08.240252 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2549/4977] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:07 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:08.327734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9fd2b797-af54-44e9-8e7b-cdabcb825f26 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:08.328939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9fd2b797-af54-44e9-8e7b-cdabcb825f26 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:08.343932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fd2b797-af54-44e9-8e7b-cdabcb825f26 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:08.345528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fd2b797-af54-44e9-8e7b-cdabcb825f26 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:08.346164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fd2b797-af54-44e9-8e7b-cdabcb825f26 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:08.347653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fd2b797-af54-44e9-8e7b-cdabcb825f26 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:08.348318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fd2b797-af54-44e9-8e7b-cdabcb825f26 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:08.348946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fd2b797-af54-44e9-8e7b-cdabcb825f26 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:09.249198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6d0fab52-b33d-4107-ade4-bfa332ac6ffe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:09.250188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6d0fab52-b33d-4107-ade4-bfa332ac6ffe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:09.270358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d0fab52-b33d-4107-ade4-bfa332ac6ffe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:09.275058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d0fab52-b33d-4107-ade4-bfa332ac6ffe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:09.275653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d0fab52-b33d-4107-ade4-bfa332ac6ffe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:09.278442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d0fab52-b33d-4107-ade4-bfa332ac6ffe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:09.280502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d0fab52-b33d-4107-ade4-bfa332ac6ffe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:09.283139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d0fab52-b33d-4107-ade4-bfa332ac6ffe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:09.693440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9fd2b797-af54-44e9-8e7b-cdabcb825f26 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:09.706199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9fd2b797-af54-44e9-8e7b-cdabcb825f26 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:09.718137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9fd2b797-af54-44e9-8e7b-cdabcb825f26 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:09.720786 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9fd2b797-af54-44e9-8e7b-cdabcb825f26 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 1.397063 Aug 23 18:16:09.744813 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2429/4978] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:08 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 1422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:09.755226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-903e6120-35c5-4acd-9623-5094a5701907 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:09.762025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-903e6120-35c5-4acd-9623-5094a5701907 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:09.779255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6d0fab52-b33d-4107-ade4-bfa332ac6ffe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:09.800473 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6d0fab52-b33d-4107-ade4-bfa332ac6ffe tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.553061 Aug 23 18:16:09.801168 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2550/4979] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:09 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:09.802803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-903e6120-35c5-4acd-9623-5094a5701907 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:09.804438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-903e6120-35c5-4acd-9623-5094a5701907 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:09.807193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-903e6120-35c5-4acd-9623-5094a5701907 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:09.808139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-903e6120-35c5-4acd-9623-5094a5701907 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:09.810447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-903e6120-35c5-4acd-9623-5094a5701907 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:09.811345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-903e6120-35c5-4acd-9623-5094a5701907 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:10.243784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-903e6120-35c5-4acd-9623-5094a5701907 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:10.258427 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-903e6120-35c5-4acd-9623-5094a5701907 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 0.508736 Aug 23 18:16:10.259476 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2430/4980] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:09 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:10.752099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2019c95f-d2ee-4be3-9071-c1cfdfc2a4c5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:10.752720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2019c95f-d2ee-4be3-9071-c1cfdfc2a4c5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:10.768593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2019c95f-d2ee-4be3-9071-c1cfdfc2a4c5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:10.769507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2019c95f-d2ee-4be3-9071-c1cfdfc2a4c5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:10.770140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2019c95f-d2ee-4be3-9071-c1cfdfc2a4c5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:10.776248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2019c95f-d2ee-4be3-9071-c1cfdfc2a4c5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:10.776969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2019c95f-d2ee-4be3-9071-c1cfdfc2a4c5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:10.777722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2019c95f-d2ee-4be3-9071-c1cfdfc2a4c5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:10.821969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-746e85e4-8981-44ec-a34b-032d8803fd0e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:10.822782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-746e85e4-8981-44ec-a34b-032d8803fd0e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:10.832025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-746e85e4-8981-44ec-a34b-032d8803fd0e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:10.832791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-746e85e4-8981-44ec-a34b-032d8803fd0e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:10.833473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-746e85e4-8981-44ec-a34b-032d8803fd0e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:10.834477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-746e85e4-8981-44ec-a34b-032d8803fd0e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:10.835877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-746e85e4-8981-44ec-a34b-032d8803fd0e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:10.836543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-746e85e4-8981-44ec-a34b-032d8803fd0e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:11.238439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-746e85e4-8981-44ec-a34b-032d8803fd0e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:11.249895 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-746e85e4-8981-44ec-a34b-032d8803fd0e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.432370 Aug 23 18:16:11.251144 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2431/4981] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:10 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:11.284576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-63dc0df1-36c0-4f06-b1ce-a60b5ce77451 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:11.286525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-63dc0df1-36c0-4f06-b1ce-a60b5ce77451 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:11.294307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63dc0df1-36c0-4f06-b1ce-a60b5ce77451 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:11.295236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63dc0df1-36c0-4f06-b1ce-a60b5ce77451 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:11.296099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63dc0df1-36c0-4f06-b1ce-a60b5ce77451 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:11.297061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63dc0df1-36c0-4f06-b1ce-a60b5ce77451 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:11.297749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63dc0df1-36c0-4f06-b1ce-a60b5ce77451 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:11.298409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63dc0df1-36c0-4f06-b1ce-a60b5ce77451 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:11.639221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-63dc0df1-36c0-4f06-b1ce-a60b5ce77451 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:11.642677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2019c95f-d2ee-4be3-9071-c1cfdfc2a4c5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:11.654042 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-63dc0df1-36c0-4f06-b1ce-a60b5ce77451 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 0.373806 Aug 23 18:16:11.662453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2019c95f-d2ee-4be3-9071-c1cfdfc2a4c5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:11.663312 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2432/4982] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:11 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:11.664496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2019c95f-d2ee-4be3-9071-c1cfdfc2a4c5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:11.670118 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2019c95f-d2ee-4be3-9071-c1cfdfc2a4c5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.922010 Aug 23 18:16:11.672366 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2551/4983] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:10 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:11.761183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-100521d7-a3bb-4eca-8198-c8e8f4a5d000 req-f3c1a541-16a6-4486-b76f-6ea7a17f788a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0", "name": "network-vif-plugged", "status": "completed", "tag": "02da19a3-cc48-4c32-8ee5-46f26de6f79d"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:11.781738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-100521d7-a3bb-4eca-8198-c8e8f4a5d000 req-f3c1a541-16a6-4486-b76f-6ea7a17f788a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:11.782568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-100521d7-a3bb-4eca-8198-c8e8f4a5d000 req-f3c1a541-16a6-4486-b76f-6ea7a17f788a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:11.783185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-100521d7-a3bb-4eca-8198-c8e8f4a5d000 req-f3c1a541-16a6-4486-b76f-6ea7a17f788a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:11.797424 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-100521d7-a3bb-4eca-8198-c8e8f4a5d000 req-f3c1a541-16a6-4486-b76f-6ea7a17f788a service nova] Creating event network-vif-plugged:02da19a3-cc48-4c32-8ee5-46f26de6f79d for instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 on n-h2-850468-16 Aug 23 18:16:11.804319 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-100521d7-a3bb-4eca-8198-c8e8f4a5d000 req-f3c1a541-16a6-4486-b76f-6ea7a17f788a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047125 Aug 23 18:16:11.806319 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2433/4984] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:12.273784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-95504def-2e1a-45af-aac3-b305bef1da93 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:12.275153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-95504def-2e1a-45af-aac3-b305bef1da93 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:12.282900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95504def-2e1a-45af-aac3-b305bef1da93 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:12.283660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95504def-2e1a-45af-aac3-b305bef1da93 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:12.284780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95504def-2e1a-45af-aac3-b305bef1da93 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:12.285714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95504def-2e1a-45af-aac3-b305bef1da93 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:12.286353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95504def-2e1a-45af-aac3-b305bef1da93 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:12.286996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95504def-2e1a-45af-aac3-b305bef1da93 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:12.688367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0e1460f6-3159-4b0c-a46c-9330ac0b44e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:12.689068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0e1460f6-3159-4b0c-a46c-9330ac0b44e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:12.698167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e1460f6-3159-4b0c-a46c-9330ac0b44e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:12.698961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e1460f6-3159-4b0c-a46c-9330ac0b44e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:12.699653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e1460f6-3159-4b0c-a46c-9330ac0b44e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:12.700620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e1460f6-3159-4b0c-a46c-9330ac0b44e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:12.701685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e1460f6-3159-4b0c-a46c-9330ac0b44e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:12.702493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e1460f6-3159-4b0c-a46c-9330ac0b44e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:12.771177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-95504def-2e1a-45af-aac3-b305bef1da93 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:12.795707 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-95504def-2e1a-45af-aac3-b305bef1da93 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.527240 Aug 23 18:16:12.819639 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2552/4985] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:12 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:12.830902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3728751e-f73d-4ab4-a1ce-92497c0aa25c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:12.831727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3728751e-f73d-4ab4-a1ce-92497c0aa25c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:12.840074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3728751e-f73d-4ab4-a1ce-92497c0aa25c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:12.841124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3728751e-f73d-4ab4-a1ce-92497c0aa25c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:12.841755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3728751e-f73d-4ab4-a1ce-92497c0aa25c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:12.843699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3728751e-f73d-4ab4-a1ce-92497c0aa25c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:12.844385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3728751e-f73d-4ab4-a1ce-92497c0aa25c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:12.844985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3728751e-f73d-4ab4-a1ce-92497c0aa25c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:12.910797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0e1460f6-3159-4b0c-a46c-9330ac0b44e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:12.925286 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0e1460f6-3159-4b0c-a46c-9330ac0b44e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 0.240906 Aug 23 18:16:12.935528 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2434/4986] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:12 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:13.667274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3728751e-f73d-4ab4-a1ce-92497c0aa25c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:13.681505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3728751e-f73d-4ab4-a1ce-92497c0aa25c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:13.684178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3728751e-f73d-4ab4-a1ce-92497c0aa25c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:13.686901 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3728751e-f73d-4ab4-a1ce-92497c0aa25c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.865743 Aug 23 18:16:13.689133 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2553/4987] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:12 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:13.833504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-60e3c3b4-e5d6-40f6-a0e7-fe4fa2dfd620 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:13.835137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-60e3c3b4-e5d6-40f6-a0e7-fe4fa2dfd620 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:13.845454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60e3c3b4-e5d6-40f6-a0e7-fe4fa2dfd620 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:13.847108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60e3c3b4-e5d6-40f6-a0e7-fe4fa2dfd620 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:13.848547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60e3c3b4-e5d6-40f6-a0e7-fe4fa2dfd620 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:13.850693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60e3c3b4-e5d6-40f6-a0e7-fe4fa2dfd620 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:13.852962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60e3c3b4-e5d6-40f6-a0e7-fe4fa2dfd620 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:13.853538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60e3c3b4-e5d6-40f6-a0e7-fe4fa2dfd620 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:13.953834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6154aa9-14df-48f6-bf1b-763b7b0e0666 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:13.954984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6154aa9-14df-48f6-bf1b-763b7b0e0666 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:13.965024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6154aa9-14df-48f6-bf1b-763b7b0e0666 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:13.967121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6154aa9-14df-48f6-bf1b-763b7b0e0666 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:13.968176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6154aa9-14df-48f6-bf1b-763b7b0e0666 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:13.971572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6154aa9-14df-48f6-bf1b-763b7b0e0666 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:13.972859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6154aa9-14df-48f6-bf1b-763b7b0e0666 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:13.974037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6154aa9-14df-48f6-bf1b-763b7b0e0666 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:14.153913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-60e3c3b4-e5d6-40f6-a0e7-fe4fa2dfd620 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:14.176748 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-60e3c3b4-e5d6-40f6-a0e7-fe4fa2dfd620 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.347075 Aug 23 18:16:14.191175 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2435/4988] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:13 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:14.713187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f37811c8-e232-422f-86c1-e287e4c27284 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:14.714154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f37811c8-e232-422f-86c1-e287e4c27284 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:14.721380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f37811c8-e232-422f-86c1-e287e4c27284 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:14.723088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f37811c8-e232-422f-86c1-e287e4c27284 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:14.724288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f37811c8-e232-422f-86c1-e287e4c27284 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:14.725655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f37811c8-e232-422f-86c1-e287e4c27284 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:14.726682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f37811c8-e232-422f-86c1-e287e4c27284 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:14.727345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f37811c8-e232-422f-86c1-e287e4c27284 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:14.896175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b6154aa9-14df-48f6-bf1b-763b7b0e0666 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:14.913254 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6154aa9-14df-48f6-bf1b-763b7b0e0666 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 0.964424 Aug 23 18:16:14.915046 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2554/4989] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:13 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:15.050295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f37811c8-e232-422f-86c1-e287e4c27284 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:15.085644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f37811c8-e232-422f-86c1-e287e4c27284 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:15.087740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f37811c8-e232-422f-86c1-e287e4c27284 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:15.089344 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f37811c8-e232-422f-86c1-e287e4c27284 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.381034 Aug 23 18:16:15.107561 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2436/4990] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:14 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:15.199631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e8994576-532e-47a6-a499-a2fb22fc141a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:15.200596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e8994576-532e-47a6-a499-a2fb22fc141a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:15.219376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8994576-532e-47a6-a499-a2fb22fc141a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:15.219996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8994576-532e-47a6-a499-a2fb22fc141a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:15.220520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8994576-532e-47a6-a499-a2fb22fc141a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:15.221328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8994576-532e-47a6-a499-a2fb22fc141a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:15.221803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8994576-532e-47a6-a499-a2fb22fc141a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:15.222291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8994576-532e-47a6-a499-a2fb22fc141a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:15.939776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-abd90c2e-fce1-4fe6-b6b6-0ccf3e8957d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:15.940402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-abd90c2e-fce1-4fe6-b6b6-0ccf3e8957d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:15.951805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abd90c2e-fce1-4fe6-b6b6-0ccf3e8957d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:15.952306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abd90c2e-fce1-4fe6-b6b6-0ccf3e8957d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:15.964081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abd90c2e-fce1-4fe6-b6b6-0ccf3e8957d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:15.965114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abd90c2e-fce1-4fe6-b6b6-0ccf3e8957d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:15.966033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abd90c2e-fce1-4fe6-b6b6-0ccf3e8957d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:15.966668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abd90c2e-fce1-4fe6-b6b6-0ccf3e8957d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:16.241911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8994576-532e-47a6-a499-a2fb22fc141a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:16.252542 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e8994576-532e-47a6-a499-a2fb22fc141a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 1.057148 Aug 23 18:16:16.264510 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2555/4991] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:15 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 1070 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:16.276301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-268cdb38-ab35-4660-9fb6-d1b4bf8c7881 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:16.280129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-268cdb38-ab35-4660-9fb6-d1b4bf8c7881 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:16.323483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-268cdb38-ab35-4660-9fb6-d1b4bf8c7881 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:16.324404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-268cdb38-ab35-4660-9fb6-d1b4bf8c7881 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:16.325110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-268cdb38-ab35-4660-9fb6-d1b4bf8c7881 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:16.326810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-268cdb38-ab35-4660-9fb6-d1b4bf8c7881 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:16.332560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-268cdb38-ab35-4660-9fb6-d1b4bf8c7881 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:16.333484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-268cdb38-ab35-4660-9fb6-d1b4bf8c7881 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:16.408542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-abd90c2e-fce1-4fe6-b6b6-0ccf3e8957d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:16.423252 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-abd90c2e-fce1-4fe6-b6b6-0ccf3e8957d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1308 microversion: 2.1 time: 0.483226 Aug 23 18:16:16.424473 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2437/4992] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:15 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1308 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:17.109243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-268cdb38-ab35-4660-9fb6-d1b4bf8c7881 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:17.130983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-268cdb38-ab35-4660-9fb6-d1b4bf8c7881 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:17.133808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-268cdb38-ab35-4660-9fb6-d1b4bf8c7881 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:17.135611 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-268cdb38-ab35-4660-9fb6-d1b4bf8c7881 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.869853 Aug 23 18:16:17.136354 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2556/4993] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:16 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:17.278318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d1d4e7e-6359-4da2-8eeb-9d5037ccb1c5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:17.278935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d1d4e7e-6359-4da2-8eeb-9d5037ccb1c5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:17.302626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d1d4e7e-6359-4da2-8eeb-9d5037ccb1c5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:17.306057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d1d4e7e-6359-4da2-8eeb-9d5037ccb1c5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:17.306518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d1d4e7e-6359-4da2-8eeb-9d5037ccb1c5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:17.307286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d1d4e7e-6359-4da2-8eeb-9d5037ccb1c5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:17.307751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d1d4e7e-6359-4da2-8eeb-9d5037ccb1c5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:17.308184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d1d4e7e-6359-4da2-8eeb-9d5037ccb1c5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:17.448168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fb79baa7-f2fe-4ab3-9e04-66229e1337fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:17.449900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fb79baa7-f2fe-4ab3-9e04-66229e1337fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:17.466698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb79baa7-f2fe-4ab3-9e04-66229e1337fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:17.468084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb79baa7-f2fe-4ab3-9e04-66229e1337fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:17.483062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb79baa7-f2fe-4ab3-9e04-66229e1337fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:17.484716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb79baa7-f2fe-4ab3-9e04-66229e1337fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:17.485639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb79baa7-f2fe-4ab3-9e04-66229e1337fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:17.486303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb79baa7-f2fe-4ab3-9e04-66229e1337fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:17.599491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6d1d4e7e-6359-4da2-8eeb-9d5037ccb1c5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:17.610078 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d1d4e7e-6359-4da2-8eeb-9d5037ccb1c5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.337380 Aug 23 18:16:17.611368 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2438/4994] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:17 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:18.159036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-92b8d77f-008d-4507-8df7-2eae8117d588 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:18.159656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-92b8d77f-008d-4507-8df7-2eae8117d588 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:18.175190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92b8d77f-008d-4507-8df7-2eae8117d588 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:18.175687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92b8d77f-008d-4507-8df7-2eae8117d588 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:18.176135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92b8d77f-008d-4507-8df7-2eae8117d588 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:18.176858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92b8d77f-008d-4507-8df7-2eae8117d588 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:18.177317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92b8d77f-008d-4507-8df7-2eae8117d588 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:18.177746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92b8d77f-008d-4507-8df7-2eae8117d588 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:18.357481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb79baa7-f2fe-4ab3-9e04-66229e1337fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:18.363082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:18.378320 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fb79baa7-f2fe-4ab3-9e04-66229e1337fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1488 microversion: 2.1 time: 0.936628 Aug 23 18:16:18.383204 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2557/4995] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:17 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1488 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:18.409770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7590666b-0c04-47e8-8de5-b0197d6690a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:18.411656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7590666b-0c04-47e8-8de5-b0197d6690a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:18.426707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7590666b-0c04-47e8-8de5-b0197d6690a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:18.427227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7590666b-0c04-47e8-8de5-b0197d6690a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:18.431904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7590666b-0c04-47e8-8de5-b0197d6690a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:18.433515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7590666b-0c04-47e8-8de5-b0197d6690a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:18.434019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7590666b-0c04-47e8-8de5-b0197d6690a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:18.436093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7590666b-0c04-47e8-8de5-b0197d6690a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:18.655048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-92b8d77f-008d-4507-8df7-2eae8117d588 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:18.668975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-92b8d77f-008d-4507-8df7-2eae8117d588 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:18.680893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-92b8d77f-008d-4507-8df7-2eae8117d588 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:18.682464 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-92b8d77f-008d-4507-8df7-2eae8117d588 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.527392 Aug 23 18:16:18.698479 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2439/4996] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:18 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:16:18.704245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-900426a1-39b2-4ad2-91b0-200be31e5d86 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:18.705102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-900426a1-39b2-4ad2-91b0-200be31e5d86 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:18.711553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-900426a1-39b2-4ad2-91b0-200be31e5d86 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:18.712322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-900426a1-39b2-4ad2-91b0-200be31e5d86 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:18.712998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-900426a1-39b2-4ad2-91b0-200be31e5d86 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:18.713917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-900426a1-39b2-4ad2-91b0-200be31e5d86 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:18.714590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-900426a1-39b2-4ad2-91b0-200be31e5d86 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:18.715217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-900426a1-39b2-4ad2-91b0-200be31e5d86 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:19.095699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7590666b-0c04-47e8-8de5-b0197d6690a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:19.113823 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7590666b-0c04-47e8-8de5-b0197d6690a2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1488 microversion: 2.1 time: 0.711748 Aug 23 18:16:19.119640 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2558/4997] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:18 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1488 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:19.140140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-df0b7585-6df4-43a7-a05c-580ab2b3f5cc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:19.141065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-df0b7585-6df4-43a7-a05c-580ab2b3f5cc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:19.152259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df0b7585-6df4-43a7-a05c-580ab2b3f5cc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:19.154877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df0b7585-6df4-43a7-a05c-580ab2b3f5cc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:19.155696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df0b7585-6df4-43a7-a05c-580ab2b3f5cc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:19.156795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df0b7585-6df4-43a7-a05c-580ab2b3f5cc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:19.159408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df0b7585-6df4-43a7-a05c-580ab2b3f5cc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:19.160065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df0b7585-6df4-43a7-a05c-580ab2b3f5cc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:19.580329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-df0b7585-6df4-43a7-a05c-580ab2b3f5cc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:19.595534 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-df0b7585-6df4-43a7-a05c-580ab2b3f5cc tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1488 microversion: 2.1 time: 0.454988 Aug 23 18:16:19.596394 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2559/4998] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:19 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1488 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:19.621799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae0f722d-b594-47b0-ba79-2f59ab6f35b0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:19.622775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae0f722d-b594-47b0-ba79-2f59ab6f35b0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:19.630205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae0f722d-b594-47b0-ba79-2f59ab6f35b0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:19.633816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae0f722d-b594-47b0-ba79-2f59ab6f35b0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:19.636526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae0f722d-b594-47b0-ba79-2f59ab6f35b0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:19.638750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae0f722d-b594-47b0-ba79-2f59ab6f35b0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:19.644033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae0f722d-b594-47b0-ba79-2f59ab6f35b0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:19.644912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae0f722d-b594-47b0-ba79-2f59ab6f35b0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:19.714214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae0f722d-b594-47b0-ba79-2f59ab6f35b0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:16:19.910121 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae0f722d-b594-47b0-ba79-2f59ab6f35b0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 204 len: 0 microversion: 2.1 time: 0.291996 Aug 23 18:16:19.910783 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2560/4999] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:16:19 2022] DELETE /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:16:19.917355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2c5a5267-3fe5-4261-b00a-94cb61389dd0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:19.923500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2c5a5267-3fe5-4261-b00a-94cb61389dd0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:19.945514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c5a5267-3fe5-4261-b00a-94cb61389dd0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:19.947391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c5a5267-3fe5-4261-b00a-94cb61389dd0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:19.949816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c5a5267-3fe5-4261-b00a-94cb61389dd0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:19.955872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c5a5267-3fe5-4261-b00a-94cb61389dd0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:19.956447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c5a5267-3fe5-4261-b00a-94cb61389dd0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:19.958328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c5a5267-3fe5-4261-b00a-94cb61389dd0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:20.167875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-900426a1-39b2-4ad2-91b0-200be31e5d86 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:20.183572 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-900426a1-39b2-4ad2-91b0-200be31e5d86 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 1.482458 Aug 23 18:16:20.194661 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2440/5000] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:18 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:20.201676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ca0961c6-f6f5-4b8a-9646-33dea472272c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:20.211574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ca0961c6-f6f5-4b8a-9646-33dea472272c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:20.237476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0961c6-f6f5-4b8a-9646-33dea472272c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:20.242319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0961c6-f6f5-4b8a-9646-33dea472272c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:20.242935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0961c6-f6f5-4b8a-9646-33dea472272c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:20.243795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0961c6-f6f5-4b8a-9646-33dea472272c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:20.244371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0961c6-f6f5-4b8a-9646-33dea472272c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:20.244912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0961c6-f6f5-4b8a-9646-33dea472272c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:20.545493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ca0961c6-f6f5-4b8a-9646-33dea472272c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:20.574391 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ca0961c6-f6f5-4b8a-9646-33dea472272c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1494 microversion: 2.1 time: 0.387896 Aug 23 18:16:20.575784 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2441/5001] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:20 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1494 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:20.590950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-690e23b6-7426-4099-acac-c25c64a02979 req-c82db7b4-cee6-4aa1-89b4-ea41ceb86bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-plugged", "status": "completed", "tag": "e4c1ae5d-4bd7-4ff2-ac13-c687df447854"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:20.609649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-690e23b6-7426-4099-acac-c25c64a02979 req-c82db7b4-cee6-4aa1-89b4-ea41ceb86bf8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:20.611876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-690e23b6-7426-4099-acac-c25c64a02979 req-c82db7b4-cee6-4aa1-89b4-ea41ceb86bf8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:20.612366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-690e23b6-7426-4099-acac-c25c64a02979 req-c82db7b4-cee6-4aa1-89b4-ea41ceb86bf8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:20.650985 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-690e23b6-7426-4099-acac-c25c64a02979 req-c82db7b4-cee6-4aa1-89b4-ea41ceb86bf8 service nova] Creating event network-vif-plugged:e4c1ae5d-4bd7-4ff2-ac13-c687df447854 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:16:20.657896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2c5a5267-3fe5-4261-b00a-94cb61389dd0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:20.660863 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-690e23b6-7426-4099-acac-c25c64a02979 req-c82db7b4-cee6-4aa1-89b4-ea41ceb86bf8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079326 Aug 23 18:16:20.662522 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2442/5002] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:20.673246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2c5a5267-3fe5-4261-b00a-94cb61389dd0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:20.677162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2c5a5267-3fe5-4261-b00a-94cb61389dd0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:20.682139 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2c5a5267-3fe5-4261-b00a-94cb61389dd0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.768013 Aug 23 18:16:20.683134 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2561/5003] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:19 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:21.210335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-850a490e-57e6-412b-9bf1-8ebfeeb53178 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:21.212977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-850a490e-57e6-412b-9bf1-8ebfeeb53178 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:21.233434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-850a490e-57e6-412b-9bf1-8ebfeeb53178 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:21.236119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-850a490e-57e6-412b-9bf1-8ebfeeb53178 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:21.236928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-850a490e-57e6-412b-9bf1-8ebfeeb53178 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:21.237807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-850a490e-57e6-412b-9bf1-8ebfeeb53178 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:21.240380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-850a490e-57e6-412b-9bf1-8ebfeeb53178 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:21.241973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-850a490e-57e6-412b-9bf1-8ebfeeb53178 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:21.597701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-084e67b8-c4ab-4ff1-9233-d0b9d68ffa55 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:21.599203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-084e67b8-c4ab-4ff1-9233-d0b9d68ffa55 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:21.614754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-084e67b8-c4ab-4ff1-9233-d0b9d68ffa55 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:21.616137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-084e67b8-c4ab-4ff1-9233-d0b9d68ffa55 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:21.617596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-084e67b8-c4ab-4ff1-9233-d0b9d68ffa55 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:21.618529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-084e67b8-c4ab-4ff1-9233-d0b9d68ffa55 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:21.619191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-084e67b8-c4ab-4ff1-9233-d0b9d68ffa55 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:21.619781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-084e67b8-c4ab-4ff1-9233-d0b9d68ffa55 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:21.769359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-850a490e-57e6-412b-9bf1-8ebfeeb53178 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:21.780669 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-850a490e-57e6-412b-9bf1-8ebfeeb53178 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.576307 Aug 23 18:16:21.781269 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2443/5004] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:21 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:21.788611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5f85eea5-dab4-4fe4-838d-8f445c9169b8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:21.789453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5f85eea5-dab4-4fe4-838d-8f445c9169b8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:21.805329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f85eea5-dab4-4fe4-838d-8f445c9169b8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:21.806030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f85eea5-dab4-4fe4-838d-8f445c9169b8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:21.806652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f85eea5-dab4-4fe4-838d-8f445c9169b8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:21.807983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f85eea5-dab4-4fe4-838d-8f445c9169b8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:21.812511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f85eea5-dab4-4fe4-838d-8f445c9169b8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:21.814528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f85eea5-dab4-4fe4-838d-8f445c9169b8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:22.386039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5f85eea5-dab4-4fe4-838d-8f445c9169b8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:22.396133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5f85eea5-dab4-4fe4-838d-8f445c9169b8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:22.398778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5f85eea5-dab4-4fe4-838d-8f445c9169b8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:22.400346 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5f85eea5-dab4-4fe4-838d-8f445c9169b8 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.615871 Aug 23 18:16:22.401090 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2444/5005] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:21 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:22.657561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-084e67b8-c4ab-4ff1-9233-d0b9d68ffa55 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:22.670727 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-084e67b8-c4ab-4ff1-9233-d0b9d68ffa55 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1494 microversion: 2.1 time: 1.076777 Aug 23 18:16:22.676041 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2562/5006] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:21 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1494 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:22.760675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-89f49f1b-ef0e-418f-845b-1931ae7c0457 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-1808234858", "availability_zone": "foo_zone"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:22.763806 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:16:22.763806 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:16:22.765266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.aggregate [None req-89f49f1b-ef0e-418f-845b-1931ae7c0457 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Generated uuid 3220a59c-0773-4671-9e2e-3d434107e575 for aggregate {{(pid=128807) create /opt/stack/nova/nova/objects/aggregate.py:298}} Aug 23 18:16:22.804030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-12c2cd8f-aeb2-43ea-b996-34156d728c3a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:22.804822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-12c2cd8f-aeb2-43ea-b996-34156d728c3a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:22.810509 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-89f49f1b-ef0e-418f-845b-1931ae7c0457 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates" status: 200 len: 209 microversion: 2.1 time: 0.230659 Aug 23 18:16:22.811905 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2445/5007] 10.222.0.61 () {60 vars in 1164 bytes} [Tue Aug 23 18:16:22 2022] POST /compute/v2.1/os-aggregates => generated 209 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:22.819913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2cd8f-aeb2-43ea-b996-34156d728c3a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:22.823162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2cd8f-aeb2-43ea-b996-34156d728c3a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:22.825458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2cd8f-aeb2-43ea-b996-34156d728c3a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:22.825458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2cd8f-aeb2-43ea-b996-34156d728c3a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:22.827731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fb93435c-bee3-4660-a600-c91c9aef0491 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:22.828027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2cd8f-aeb2-43ea-b996-34156d728c3a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:22.828644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12c2cd8f-aeb2-43ea-b996-34156d728c3a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:22.838522 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:16:22.838522 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:16:22.888315 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fb93435c-bee3-4660-a600-c91c9aef0491 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 319 microversion: 2.1 time: 0.069359 Aug 23 18:16:22.896096 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2446/5008] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 18:16:22 2022] POST /compute/v2.1/os-aggregates/19/action => generated 319 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:16:22.901656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8d5ce494-8476-4c35-831e-8039a2cc1417 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:22.904529 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:16:22.904529 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:16:22.906870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d5ce494-8476-4c35-831e-8039a2cc1417 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:22.907577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d5ce494-8476-4c35-831e-8039a2cc1417 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:22.908051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d5ce494-8476-4c35-831e-8039a2cc1417 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:22.908859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d5ce494-8476-4c35-831e-8039a2cc1417 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:22.909274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d5ce494-8476-4c35-831e-8039a2cc1417 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:22.909680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d5ce494-8476-4c35-831e-8039a2cc1417 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:22.938078 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8d5ce494-8476-4c35-831e-8039a2cc1417 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] 10.222.0.61 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 382 microversion: 2.1 time: 0.040008 Aug 23 18:16:22.949926 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2447/5009] 10.222.0.61 () {58 vars in 1176 bytes} [Tue Aug 23 18:16:22 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 382 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:22.956106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-17e429ba-c741-4933-9501-59d63f8f4012 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:22.956868 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:index": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:16:22.956868 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:16:22.967891 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-17e429ba-c741-4933-9501-59d63f8f4012 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates" status: 200 len: 298 microversion: 2.1 time: 0.016405 Aug 23 18:16:22.971614 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2448/5010] 10.222.0.61 () {58 vars in 1143 bytes} [Tue Aug 23 18:16:22 2022] GET /compute/v2.1/os-aggregates => generated 298 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:22.981305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7380ad00-de1a-4ad0-b0a9-c7d26a6436f0 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h1-850468-16"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:22.984466 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:add_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:16:22.984466 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:16:22.995690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7380ad00-de1a-4ad0-b0a9-c7d26a6436f0 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:22.996425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7380ad00-de1a-4ad0-b0a9-c7d26a6436f0 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:22.997039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7380ad00-de1a-4ad0-b0a9-c7d26a6436f0 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:23.193273 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7380ad00-de1a-4ad0-b0a9-c7d26a6436f0 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 311 microversion: 2.1 time: 0.215204 Aug 23 18:16:23.195726 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2449/5011] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 18:16:22 2022] POST /compute/v2.1/os-aggregates/19/action => generated 311 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:16:23.210447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-186593bf-bf7e-4308-b438-669071015aee tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:23.211782 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:16:23.211782 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:16:23.223053 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-186593bf-bf7e-4308-b438-669071015aee tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 311 microversion: 2.1 time: 0.019599 Aug 23 18:16:23.231278 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2450/5012] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 18:16:23 2022] GET /compute/v2.1/os-aggregates/19 => generated 311 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:23.244449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-89f02fe4-5813-43b3-90c4-26c85bcc198b tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-1299335743", "availability_zone": "foo_zone"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:23.248792 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:update": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:16:23.248792 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:16:23.378946 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-89f02fe4-5813-43b3-90c4-26c85bcc198b tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] 10.222.0.61 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 343 microversion: 2.1 time: 0.146130 Aug 23 18:16:23.379567 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2451/5013] 10.222.0.61 () {60 vars in 1173 bytes} [Tue Aug 23 18:16:23 2022] PUT /compute/v2.1/os-aggregates/19 => generated 343 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:23.391162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b058e5a5-0f4d-4471-947e-b0cd139fe76a tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:23.395242 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:set_metadata": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:16:23.395242 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:16:23.423926 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b058e5a5-0f4d-4471-947e-b0cd139fe76a tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 357 microversion: 2.1 time: 0.036581 Aug 23 18:16:23.433030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-12c2cd8f-aeb2-43ea-b996-34156d728c3a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:23.433400 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2452/5014] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 18:16:23 2022] POST /compute/v2.1/os-aggregates/19/action => generated 357 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:23.438949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cd68f7a2-ff92-48ae-9e55-dc0d3212e41f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:23.439576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cd68f7a2-ff92-48ae-9e55-dc0d3212e41f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:23.449112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd68f7a2-ff92-48ae-9e55-dc0d3212e41f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:23.453335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd68f7a2-ff92-48ae-9e55-dc0d3212e41f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:23.454499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd68f7a2-ff92-48ae-9e55-dc0d3212e41f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:23.457874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd68f7a2-ff92-48ae-9e55-dc0d3212e41f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:23.458743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd68f7a2-ff92-48ae-9e55-dc0d3212e41f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:23.461875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd68f7a2-ff92-48ae-9e55-dc0d3212e41f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:23.463982 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-12c2cd8f-aeb2-43ea-b996-34156d728c3a tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 0.663792 Aug 23 18:16:23.464787 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2563/5015] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:22 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:23.494492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6da7f19f-4e6c-4f74-bb66-25f25bfa1ad0 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:23.495871 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:show": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:16:23.495871 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:16:23.523308 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6da7f19f-4e6c-4f74-bb66-25f25bfa1ad0 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] 10.222.0.61 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 357 microversion: 2.1 time: 0.034883 Aug 23 18:16:23.524128 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2564/5016] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 18:16:23 2022] GET /compute/v2.1/os-aggregates/19 => generated 357 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:23.528388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:23.546566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2af44b9c-7095-4837-89af-be94c3158f7f tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h1-850468-16"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:23.554831 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:remove_host": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:16:23.554831 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:16:23.579564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2af44b9c-7095-4837-89af-be94c3158f7f tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:23.583875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2af44b9c-7095-4837-89af-be94c3158f7f tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:23.587694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2af44b9c-7095-4837-89af-be94c3158f7f tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:23.920861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cd68f7a2-ff92-48ae-9e55-dc0d3212e41f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:23.940078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cd68f7a2-ff92-48ae-9e55-dc0d3212e41f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:23.944579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cd68f7a2-ff92-48ae-9e55-dc0d3212e41f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:23.945945 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cd68f7a2-ff92-48ae-9e55-dc0d3212e41f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1882 microversion: 2.42 time: 0.511299 Aug 23 18:16:23.950188 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2453/5017] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:23 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1882 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:23.963206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-28c3be09-a810-4095-b80c-1272926207f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:23.978966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-28c3be09-a810-4095-b80c-1272926207f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:23.984855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:24.000403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28c3be09-a810-4095-b80c-1272926207f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:24.001021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28c3be09-a810-4095-b80c-1272926207f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:24.002561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28c3be09-a810-4095-b80c-1272926207f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:24.004324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28c3be09-a810-4095-b80c-1272926207f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:24.005164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28c3be09-a810-4095-b80c-1272926207f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:24.009097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28c3be09-a810-4095-b80c-1272926207f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:24.076034 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2af44b9c-7095-4837-89af-be94c3158f7f tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] 10.222.0.61 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 341 microversion: 2.1 time: 0.544124 Aug 23 18:16:24.086064 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2565/5018] 10.222.0.61 () {60 vars in 1194 bytes} [Tue Aug 23 18:16:23 2022] POST /compute/v2.1/os-aggregates/19/action => generated 341 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:24.107482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f13758f-6b9e-4817-b362-b9a97bf7c6b6 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:24.108371 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-aggregates:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:16:24.108371 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:16:24.172205 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5f13758f-6b9e-4817-b362-b9a97bf7c6b6 tempest-TestAggregatesBasicOps-171640917 tempest-TestAggregatesBasicOps-171640917-project-admin] 10.222.0.61 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.084800 Aug 23 18:16:24.173210 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2566/5019] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 18:16:24 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Aug 23 18:16:24.400034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-28c3be09-a810-4095-b80c-1272926207f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:24.411602 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-28c3be09-a810-4095-b80c-1272926207f2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1494 microversion: 2.1 time: 0.459572 Aug 23 18:16:24.418149 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2454/5020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:23 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1494 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:24.487661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2f258d6b-c200-4e35-8961-88ede3d28936 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:24.488685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2f258d6b-c200-4e35-8961-88ede3d28936 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:24.504356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f258d6b-c200-4e35-8961-88ede3d28936 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:24.505137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f258d6b-c200-4e35-8961-88ede3d28936 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:24.506948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f258d6b-c200-4e35-8961-88ede3d28936 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:24.507997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f258d6b-c200-4e35-8961-88ede3d28936 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:24.510438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f258d6b-c200-4e35-8961-88ede3d28936 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:24.511212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2f258d6b-c200-4e35-8961-88ede3d28936 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:24.928155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f8b0e7c1-2421-4bae-a7b7-9c54998896c4 req-46015b8d-4b72-4bed-b3e8-ed28dfa649a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cad0fb-87b4-403c-9881-64ce147502fd", "name": "network-vif-plugged", "status": "completed", "tag": "933227f8-f35c-4a4d-8cd9-453f1505d7a3"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:24.947033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f8b0e7c1-2421-4bae-a7b7-9c54998896c4 req-46015b8d-4b72-4bed-b3e8-ed28dfa649a7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:24.949432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f8b0e7c1-2421-4bae-a7b7-9c54998896c4 req-46015b8d-4b72-4bed-b3e8-ed28dfa649a7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:24.950234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f8b0e7c1-2421-4bae-a7b7-9c54998896c4 req-46015b8d-4b72-4bed-b3e8-ed28dfa649a7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:24.974867 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f8b0e7c1-2421-4bae-a7b7-9c54998896c4 req-46015b8d-4b72-4bed-b3e8-ed28dfa649a7 service nova] Creating event network-vif-plugged:933227f8-f35c-4a4d-8cd9-453f1505d7a3 for instance f1cad0fb-87b4-403c-9881-64ce147502fd on n-h2-850468-16 Aug 23 18:16:25.025856 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f8b0e7c1-2421-4bae-a7b7-9c54998896c4 req-46015b8d-4b72-4bed-b3e8-ed28dfa649a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101924 Aug 23 18:16:25.027884 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2455/5021] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:16:25.042200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-54ca911d-2f2a-414a-9b10-7fa32262b27b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:25.043287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-54ca911d-2f2a-414a-9b10-7fa32262b27b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:25.086488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54ca911d-2f2a-414a-9b10-7fa32262b27b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:25.087157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54ca911d-2f2a-414a-9b10-7fa32262b27b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:25.087725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54ca911d-2f2a-414a-9b10-7fa32262b27b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:25.091912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54ca911d-2f2a-414a-9b10-7fa32262b27b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:25.094230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54ca911d-2f2a-414a-9b10-7fa32262b27b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:25.095820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54ca911d-2f2a-414a-9b10-7fa32262b27b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:25.533085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-54ca911d-2f2a-414a-9b10-7fa32262b27b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:25.548434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-54ca911d-2f2a-414a-9b10-7fa32262b27b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:25.554219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-54ca911d-2f2a-414a-9b10-7fa32262b27b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:25.557921 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-54ca911d-2f2a-414a-9b10-7fa32262b27b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.528416 Aug 23 18:16:25.561357 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2456/5022] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:25 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:25.577841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1f8eb17-06a8-4d68-a537-b694bc635d71 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:25.578795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d1f8eb17-06a8-4d68-a537-b694bc635d71 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:25.605175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f8eb17-06a8-4d68-a537-b694bc635d71 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:25.607189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f8eb17-06a8-4d68-a537-b694bc635d71 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:25.609064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f8eb17-06a8-4d68-a537-b694bc635d71 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:25.611100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f8eb17-06a8-4d68-a537-b694bc635d71 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:25.614494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f8eb17-06a8-4d68-a537-b694bc635d71 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:25.615183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f8eb17-06a8-4d68-a537-b694bc635d71 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:25.769402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2f258d6b-c200-4e35-8961-88ede3d28936 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:25.786294 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2f258d6b-c200-4e35-8961-88ede3d28936 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 1.302425 Aug 23 18:16:25.813065 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2567/5023] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:24 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 1330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:25.839583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-ba50dc4a-2223-4dda-89a9-976353c1280f req-2e2553e9-75ce-45fd-868e-6ca83a8f8d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0", "name": "network-vif-deleted", "tag": "02da19a3-cc48-4c32-8ee5-46f26de6f79d"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:25.852338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d1f8eb17-06a8-4d68-a537-b694bc635d71 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:25.863282 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d1f8eb17-06a8-4d68-a537-b694bc635d71 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 200 len: 1452 microversion: 2.1 time: 0.298060 Aug 23 18:16:25.867824 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2457/5024] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:25 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 1452 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:25.891920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ba50dc4a-2223-4dda-89a9-976353c1280f req-2e2553e9-75ce-45fd-868e-6ca83a8f8d1b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:25.892673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ba50dc4a-2223-4dda-89a9-976353c1280f req-2e2553e9-75ce-45fd-868e-6ca83a8f8d1b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:25.893369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ba50dc4a-2223-4dda-89a9-976353c1280f req-2e2553e9-75ce-45fd-868e-6ca83a8f8d1b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:25.939278 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-ba50dc4a-2223-4dda-89a9-976353c1280f req-2e2553e9-75ce-45fd-868e-6ca83a8f8d1b service nova] Creating event network-vif-deleted:02da19a3-cc48-4c32-8ee5-46f26de6f79d for instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 on n-h2-850468-16 Aug 23 18:16:25.949465 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-ba50dc4a-2223-4dda-89a9-976353c1280f req-2e2553e9-75ce-45fd-868e-6ca83a8f8d1b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134551 Aug 23 18:16:25.951222 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2568/5025] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:26.587441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91357976-61bb-4fd6-b477-098769d6c665 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:26.589608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-91357976-61bb-4fd6-b477-098769d6c665 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:26.610806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91357976-61bb-4fd6-b477-098769d6c665 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:26.611595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91357976-61bb-4fd6-b477-098769d6c665 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:26.614834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91357976-61bb-4fd6-b477-098769d6c665 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:26.617484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91357976-61bb-4fd6-b477-098769d6c665 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:26.619091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91357976-61bb-4fd6-b477-098769d6c665 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:26.620495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91357976-61bb-4fd6-b477-098769d6c665 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:26.826080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ff29b31e-7845-4f40-98ed-cfdcb9e167f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:26.827792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ff29b31e-7845-4f40-98ed-cfdcb9e167f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:26.841849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:26.855874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff29b31e-7845-4f40-98ed-cfdcb9e167f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:26.863200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff29b31e-7845-4f40-98ed-cfdcb9e167f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:26.863902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff29b31e-7845-4f40-98ed-cfdcb9e167f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:26.870090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff29b31e-7845-4f40-98ed-cfdcb9e167f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:26.872169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff29b31e-7845-4f40-98ed-cfdcb9e167f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:26.895124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff29b31e-7845-4f40-98ed-cfdcb9e167f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:27.562081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-91357976-61bb-4fd6-b477-098769d6c665 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:27.577705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-91357976-61bb-4fd6-b477-098769d6c665 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:27.579544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-91357976-61bb-4fd6-b477-098769d6c665 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:27.581038 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-91357976-61bb-4fd6-b477-098769d6c665 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 1.000592 Aug 23 18:16:27.596234 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2458/5026] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:26 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:27.607318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-92efda57-f84d-4ac3-a635-337a1e79b2bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:27.608474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-92efda57-f84d-4ac3-a635-337a1e79b2bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:27.617839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92efda57-f84d-4ac3-a635-337a1e79b2bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:27.618628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92efda57-f84d-4ac3-a635-337a1e79b2bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:27.619309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92efda57-f84d-4ac3-a635-337a1e79b2bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:27.620268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92efda57-f84d-4ac3-a635-337a1e79b2bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:27.620980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92efda57-f84d-4ac3-a635-337a1e79b2bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:27.621644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92efda57-f84d-4ac3-a635-337a1e79b2bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:27.647748 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-92efda57-f84d-4ac3-a635-337a1e79b2bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-92efda57-f84d-4ac3-a635-337a1e79b2bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 HTTP/1.1 Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0'} Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:27.649709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:27.657844 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:27.657844 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:27.657844 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:27.657844 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:27.657844 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:27.657844 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:16:27.657844 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:27.663054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-92efda57-f84d-4ac3-a635-337a1e79b2bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:27.665745 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-92efda57-f84d-4ac3-a635-337a1e79b2bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 404 len: 111 microversion: 2.1 time: 0.063023 Aug 23 18:16:27.666615 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2459/5027] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:27 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:27.686336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-621856bc-2d33-46a7-bd9e-77fd91634551 req-da56b6ac-f860-43a6-a719-210d3d5904d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-plugged", "status": "completed", "tag": "7044c5c8-0b1d-4f05-bb0b-77bde6537776"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:27.719673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-621856bc-2d33-46a7-bd9e-77fd91634551 req-da56b6ac-f860-43a6-a719-210d3d5904d6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:27.727279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-621856bc-2d33-46a7-bd9e-77fd91634551 req-da56b6ac-f860-43a6-a719-210d3d5904d6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:27.728952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-621856bc-2d33-46a7-bd9e-77fd91634551 req-da56b6ac-f860-43a6-a719-210d3d5904d6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:27.746349 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-621856bc-2d33-46a7-bd9e-77fd91634551 req-da56b6ac-f860-43a6-a719-210d3d5904d6 service nova] Creating event network-vif-plugged:7044c5c8-0b1d-4f05-bb0b-77bde6537776 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:16:27.752737 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-621856bc-2d33-46a7-bd9e-77fd91634551 req-da56b6ac-f860-43a6-a719-210d3d5904d6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084559 Aug 23 18:16:27.754286 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2460/5028] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:27.760611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07cbaed6-a75a-476e-b067-9f66ebc338f7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:27.761636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07cbaed6-a75a-476e-b067-9f66ebc338f7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:27.769647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07cbaed6-a75a-476e-b067-9f66ebc338f7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:27.770398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07cbaed6-a75a-476e-b067-9f66ebc338f7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:27.771159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07cbaed6-a75a-476e-b067-9f66ebc338f7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:27.772167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07cbaed6-a75a-476e-b067-9f66ebc338f7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:27.772864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07cbaed6-a75a-476e-b067-9f66ebc338f7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:27.773551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07cbaed6-a75a-476e-b067-9f66ebc338f7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:27.812122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07cbaed6-a75a-476e-b067-9f66ebc338f7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:16:27.840724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ff29b31e-7845-4f40-98ed-cfdcb9e167f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:27.878261 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ff29b31e-7845-4f40-98ed-cfdcb9e167f9 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1518 microversion: 2.1 time: 1.059618 Aug 23 18:16:27.892431 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2569/5029] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:26 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1518 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:28.060465 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-07cbaed6-a75a-476e-b067-9f66ebc338f7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 204 len: 0 microversion: 2.1 time: 0.304301 Aug 23 18:16:28.061047 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2461/5030] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:16:27 2022] DELETE /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:16:28.072846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-21cdeb78-a935-46c9-bd2e-bd1b700f7de8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:28.073485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-21cdeb78-a935-46c9-bd2e-bd1b700f7de8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:28.096359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21cdeb78-a935-46c9-bd2e-bd1b700f7de8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:28.104839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21cdeb78-a935-46c9-bd2e-bd1b700f7de8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:28.105374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21cdeb78-a935-46c9-bd2e-bd1b700f7de8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:28.106143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21cdeb78-a935-46c9-bd2e-bd1b700f7de8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:28.106655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21cdeb78-a935-46c9-bd2e-bd1b700f7de8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:28.107150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21cdeb78-a935-46c9-bd2e-bd1b700f7de8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:28.276565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-151174721", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:28.406677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] validate_networks() for [('47e9e3fc-2241-4d42-b358-a9873aaf6e0b', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:16:28.604482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-21cdeb78-a935-46c9-bd2e-bd1b700f7de8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:28.617841 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-21cdeb78-a935-46c9-bd2e-bd1b700f7de8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1494 microversion: 2.1 time: 0.552208 Aug 23 18:16:28.631561 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2570/5031] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:28 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1494 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:28.639743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a217cf8-8209-4ef2-ac85-3ef6da5ad175 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:28.640674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5a217cf8-8209-4ef2-ac85-3ef6da5ad175 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:28.651265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a217cf8-8209-4ef2-ac85-3ef6da5ad175 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:28.652008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a217cf8-8209-4ef2-ac85-3ef6da5ad175 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:28.652753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a217cf8-8209-4ef2-ac85-3ef6da5ad175 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:28.653786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a217cf8-8209-4ef2-ac85-3ef6da5ad175 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:28.654478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a217cf8-8209-4ef2-ac85-3ef6da5ad175 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:28.655297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a217cf8-8209-4ef2-ac85-3ef6da5ad175 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:29.029330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5a217cf8-8209-4ef2-ac85-3ef6da5ad175 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:29.056200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5a217cf8-8209-4ef2-ac85-3ef6da5ad175 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:29.061997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5a217cf8-8209-4ef2-ac85-3ef6da5ad175 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:29.070646 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a217cf8-8209-4ef2-ac85-3ef6da5ad175 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.436156 Aug 23 18:16:29.089500 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2571/5032] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:28 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:29.103835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5afb857c-e0ef-4a30-9b09-57490227a2cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:29.106733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5afb857c-e0ef-4a30-9b09-57490227a2cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:29.114024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5afb857c-e0ef-4a30-9b09-57490227a2cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:29.114646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5afb857c-e0ef-4a30-9b09-57490227a2cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:29.115161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5afb857c-e0ef-4a30-9b09-57490227a2cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:29.116714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5afb857c-e0ef-4a30-9b09-57490227a2cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:29.117426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5afb857c-e0ef-4a30-9b09-57490227a2cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:29.117933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5afb857c-e0ef-4a30-9b09-57490227a2cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:29.673617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5afb857c-e0ef-4a30-9b09-57490227a2cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:29.682302 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5afb857c-e0ef-4a30-9b09-57490227a2cd tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.589650 Aug 23 18:16:29.695879 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2572/5033] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:29 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:29.706202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e1e10037-0134-4577-8334-b21d6aa3c7e4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:29.707525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e1e10037-0134-4577-8334-b21d6aa3c7e4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:29.718983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1e10037-0134-4577-8334-b21d6aa3c7e4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:29.719574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1e10037-0134-4577-8334-b21d6aa3c7e4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:29.720082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1e10037-0134-4577-8334-b21d6aa3c7e4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:29.721226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1e10037-0134-4577-8334-b21d6aa3c7e4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:29.721766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1e10037-0134-4577-8334-b21d6aa3c7e4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:29.722261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1e10037-0134-4577-8334-b21d6aa3c7e4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:29.917739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e1e10037-0134-4577-8334-b21d6aa3c7e4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:29.927231 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e1e10037-0134-4577-8334-b21d6aa3c7e4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1494 microversion: 2.1 time: 0.230207 Aug 23 18:16:29.939743 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2573/5034] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:29 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1494 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:29.948627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4af846d9-feb6-4fae-97a8-02904307285e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:29.949690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4af846d9-feb6-4fae-97a8-02904307285e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:29.957234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4af846d9-feb6-4fae-97a8-02904307285e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:29.958004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4af846d9-feb6-4fae-97a8-02904307285e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:29.958451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4af846d9-feb6-4fae-97a8-02904307285e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:29.959916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4af846d9-feb6-4fae-97a8-02904307285e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:29.960571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4af846d9-feb6-4fae-97a8-02904307285e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:29.961051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4af846d9-feb6-4fae-97a8-02904307285e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:30.190432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4af846d9-feb6-4fae-97a8-02904307285e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:30.200979 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4af846d9-feb6-4fae-97a8-02904307285e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.260046 Aug 23 18:16:30.201584 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2574/5035] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:29 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:30.287566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5d5d886f-9fde-478b-9319-90d3f84a3892 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Action: 'create', calling method: .version_select at 0x7f27ec342040>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-1049725562", "policies": ["affinity"]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:30.313776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5d5d886f-9fde-478b-9319-90d3f84a3892 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:30.321632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5d5d886f-9fde-478b-9319-90d3f84a3892 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:30.367563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:16:30.369440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:16:30.371778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:16:30.372418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:16:30.373694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:16:30.396676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:30.400408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:30.400990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:30.403875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:30.404365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:30.406940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:30.429087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5d5d886f-9fde-478b-9319-90d3f84a3892 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:30.440313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5d5d886f-9fde-478b-9319-90d3f84a3892 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:30.473972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Getting quotas for project cdb247a14dad45d68fc17c1f9c93818d. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:30.492108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Getting quotas for user 1be0a9a69f7d4717943f603f69ca5f89 and project cdb247a14dad45d68fc17c1f9c93818d. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:30.493239 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5d5d886f-9fde-478b-9319-90d3f84a3892 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 184 microversion: 2.1 time: 0.287534 Aug 23 18:16:30.493913 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2575/5036] 10.222.0.61 () {60 vars in 1174 bytes} [Tue Aug 23 18:16:30 2022] POST /compute/v2.1/os-server-groups => generated 184 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:30.503137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2d90272-8d40-4df7-b7e9-f79e7f42fc27 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:30.507854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f2d90272-8d40-4df7-b7e9-f79e7f42fc27 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:30.530894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:16:30.535407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2d90272-8d40-4df7-b7e9-f79e7f42fc27 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:30.537401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2d90272-8d40-4df7-b7e9-f79e7f42fc27 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:30.538406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2d90272-8d40-4df7-b7e9-f79e7f42fc27 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:30.539747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:16:30.543339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2d90272-8d40-4df7-b7e9-f79e7f42fc27 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:30.544138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2d90272-8d40-4df7-b7e9-f79e7f42fc27 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:30.546261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2d90272-8d40-4df7-b7e9-f79e7f42fc27 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:30.624816 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-47d0493d-a06f-4cfc-a7b3-b624a95b86c9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.468201 Aug 23 18:16:30.626445 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2462/5037] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:16:28 2022] POST /compute/v2.1/servers => generated 383 bytes in 2470 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:16:30.633334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-671fa232-1d26-43e5-8f04-c90a3720c427 req-42f94ea0-ab29-4ed8-86fc-c3e78381a433 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-plugged", "status": "completed", "tag": "3e0b7dcf-3e88-405c-abd5-d6403cd681d8"}, {"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-plugged", "status": "completed", "tag": "da6de964-c367-4565-80ba-9058c4151df9"}, {"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-plugged", "status": "completed", "tag": "984fbe3f-942d-428e-b69a-4f736cedf9e1"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:30.648157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-671fa232-1d26-43e5-8f04-c90a3720c427 req-42f94ea0-ab29-4ed8-86fc-c3e78381a433 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:30.648991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-671fa232-1d26-43e5-8f04-c90a3720c427 req-42f94ea0-ab29-4ed8-86fc-c3e78381a433 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:30.649604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-671fa232-1d26-43e5-8f04-c90a3720c427 req-42f94ea0-ab29-4ed8-86fc-c3e78381a433 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:30.670392 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-671fa232-1d26-43e5-8f04-c90a3720c427 req-42f94ea0-ab29-4ed8-86fc-c3e78381a433 service nova] Creating event network-vif-plugged:3e0b7dcf-3e88-405c-abd5-d6403cd681d8 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:16:30.671418 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-671fa232-1d26-43e5-8f04-c90a3720c427 req-42f94ea0-ab29-4ed8-86fc-c3e78381a433 service nova] Creating event network-vif-plugged:da6de964-c367-4565-80ba-9058c4151df9 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:16:30.672108 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-671fa232-1d26-43e5-8f04-c90a3720c427 req-42f94ea0-ab29-4ed8-86fc-c3e78381a433 service nova] Creating event network-vif-plugged:984fbe3f-942d-428e-b69a-4f736cedf9e1 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:16:30.684674 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-671fa232-1d26-43e5-8f04-c90a3720c427 req-42f94ea0-ab29-4ed8-86fc-c3e78381a433 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.056517 Aug 23 18:16:30.685639 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2463/5038] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:30.693398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c47c06d6-fcf3-48fe-b3f5-60ac503cdb09 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:30.694979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c47c06d6-fcf3-48fe-b3f5-60ac503cdb09 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:30.707121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c47c06d6-fcf3-48fe-b3f5-60ac503cdb09 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:30.707936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c47c06d6-fcf3-48fe-b3f5-60ac503cdb09 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:30.708623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c47c06d6-fcf3-48fe-b3f5-60ac503cdb09 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:30.710018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c47c06d6-fcf3-48fe-b3f5-60ac503cdb09 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:30.710775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c47c06d6-fcf3-48fe-b3f5-60ac503cdb09 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:30.712297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c47c06d6-fcf3-48fe-b3f5-60ac503cdb09 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:31.286495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c47c06d6-fcf3-48fe-b3f5-60ac503cdb09 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:31.296381 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c47c06d6-fcf3-48fe-b3f5-60ac503cdb09 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.608920 Aug 23 18:16:31.299216 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2464/5039] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:30 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:31.342037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-33856f0e-c05e-456f-b463-d1aea06e09df tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Action: 'create', calling method: .version_select at 0x7f27dfc2e700>, body: {"server_group": {"name": "tempest-server-group-489825809", "policies": ["affinity"]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:31.387414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-33856f0e-c05e-456f-b463-d1aea06e09df tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:31.395276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f2d90272-8d40-4df7-b7e9-f79e7f42fc27 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:31.403393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-33856f0e-c05e-456f-b463-d1aea06e09df tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:31.407499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:31.416703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f2d90272-8d40-4df7-b7e9-f79e7f42fc27 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:31.423122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f2d90272-8d40-4df7-b7e9-f79e7f42fc27 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:31.426356 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f2d90272-8d40-4df7-b7e9-f79e7f42fc27 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.929985 Aug 23 18:16:31.427878 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2576/5040] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:30 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:31.444578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cbfe6a94-ead5-40a8-aa99-ac10949cb62c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:31.448157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cbfe6a94-ead5-40a8-aa99-ac10949cb62c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:31.528661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-33856f0e-c05e-456f-b463-d1aea06e09df tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:31.547657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-33856f0e-c05e-456f-b463-d1aea06e09df tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:31.639135 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-33856f0e-c05e-456f-b463-d1aea06e09df tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.281383 Aug 23 18:16:31.648919 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2465/5041] 10.222.0.61 () {60 vars in 1173 bytes} [Tue Aug 23 18:16:31 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:31.656164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:31.659003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:31.701756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:31.702264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:31.704282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:31.705050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:31.708679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:31.709838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:31.774876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cbfe6a94-ead5-40a8-aa99-ac10949cb62c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:31.794049 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cbfe6a94-ead5-40a8-aa99-ac10949cb62c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1222 microversion: 2.1 time: 0.359555 Aug 23 18:16:31.795063 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2577/5042] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:31 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1222 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:31.817521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:31.819811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:31.820272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:31.822808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lazy-loading 'fault' on Instance uuid 404a2173-45ea-493f-8fc8-153dfd7896fc {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:16:31.825930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-1f006c05-ebd7-4547-a26e-a76601246153 req-608a30b1-a94d-43f9-bf96-c2c5fac5dff1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "404a2173-45ea-493f-8fc8-153dfd7896fc", "name": "network-vif-deleted", "tag": "4bf13e64-4b1b-44e6-9870-edd93b47ab8c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:31.841864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1f006c05-ebd7-4547-a26e-a76601246153 req-608a30b1-a94d-43f9-bf96-c2c5fac5dff1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:31.842881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1f006c05-ebd7-4547-a26e-a76601246153 req-608a30b1-a94d-43f9-bf96-c2c5fac5dff1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:31.843922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1f006c05-ebd7-4547-a26e-a76601246153 req-608a30b1-a94d-43f9-bf96-c2c5fac5dff1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:31.865291 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-1f006c05-ebd7-4547-a26e-a76601246153 req-608a30b1-a94d-43f9-bf96-c2c5fac5dff1 service nova] Creating event network-vif-deleted:4bf13e64-4b1b-44e6-9870-edd93b47ab8c for instance 404a2173-45ea-493f-8fc8-153dfd7896fc on n-h1-850468-16 Aug 23 18:16:31.884231 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-1f006c05-ebd7-4547-a26e-a76601246153 req-608a30b1-a94d-43f9-bf96-c2c5fac5dff1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073572 Aug 23 18:16:31.888512 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2578/5043] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:31.900451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-14eaeca1-816e-436a-9af6-3ed441cd2447 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:31.920199 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-14eaeca1-816e-436a-9af6-3ed441cd2447 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 8ac54098-770e-407b-84f2-2bc5e3914d78 has no mapping to a cell. Aug 23 18:16:31.928711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-14eaeca1-816e-436a-9af6-3ed441cd2447 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/8ac54098-770e-407b-84f2-2bc5e3914d78/action HTTP/1.1 Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 15 Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: {"os-stop": {}} Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 8ac54098-770e-407b-84f2-2bc5e3914d78 has no mapping to a cell. Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '8ac54098-770e-407b-84f2-2bc5e3914d78', 'body': {'os-stop': {}}} Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1408, in _get_instance Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance 8ac54098-770e-407b-84f2-2bc5e3914d78 has no mapping to a cell. Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1441, in _stop_server Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1415, in _get_instance Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:31.940081 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ac54098-770e-407b-84f2-2bc5e3914d78 has no mapping to a cell. Aug 23 18:16:31.946267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:31.946267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:31.946267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:31.946267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:31.946267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:31.946267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:31.946267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:31.946267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:31.946267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ac54098-770e-407b-84f2-2bc5e3914d78 has no mapping to a cell. Aug 23 18:16:31.946267 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:31.946267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-14eaeca1-816e-436a-9af6-3ed441cd2447 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 8ac54098-770e-407b-84f2-2bc5e3914d78 has no mapping to a cell. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:31.946267 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-14eaeca1-816e-436a-9af6-3ed441cd2447 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/8ac54098-770e-407b-84f2-2bc5e3914d78/action" status: 404 len: 117 microversion: 2.1 time: 0.053276 Aug 23 18:16:31.948675 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2579/5044] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:16:31 2022] POST /compute/v2.1/servers/8ac54098-770e-407b-84f2-2bc5e3914d78/action => generated 117 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:31.963486 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81060d53-ed9b-4991-b036-3b0d5961c4ea tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 200 len: 1298 microversion: 2.1 time: 0.299211 Aug 23 18:16:31.963486 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2466/5045] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:31 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 1298 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:31.963486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7fefa057-25c4-4644-809f-add684534e72 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:31.963486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7fefa057-25c4-4644-809f-add684534e72 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:31.964146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f73bb2a-d17b-4f5f-ba88-f2317ac37d72 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Action: 'create', calling method: .version_select at 0x7f27ec3c1c10>, body: {"server_group": {"name": "tempest-server-group-489825809", "policies": ["affinity"]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:31.991908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-4f73bb2a-d17b-4f5f-ba88-f2317ac37d72 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:31.992404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7fefa057-25c4-4644-809f-add684534e72 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:31.993152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7fefa057-25c4-4644-809f-add684534e72 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:31.997723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7fefa057-25c4-4644-809f-add684534e72 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:31.999578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7fefa057-25c4-4644-809f-add684534e72 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:32.001137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7fefa057-25c4-4644-809f-add684534e72 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:32.001909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7fefa057-25c4-4644-809f-add684534e72 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:32.003348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-4f73bb2a-d17b-4f5f-ba88-f2317ac37d72 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:32.089668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-4f73bb2a-d17b-4f5f-ba88-f2317ac37d72 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:32.099070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-4f73bb2a-d17b-4f5f-ba88-f2317ac37d72 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:32.116974 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4f73bb2a-d17b-4f5f-ba88-f2317ac37d72 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.166097 Aug 23 18:16:32.118116 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2580/5046] 10.222.0.61 () {60 vars in 1173 bytes} [Tue Aug 23 18:16:31 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:32.148554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fb636565-6601-4b7b-a10d-b6d23345b633 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:32.251421 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fb636565-6601-4b7b-a10d-b6d23345b633 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/6b071450-c5d3-40e7-875d-798d88657a4d" status: 204 len: 0 microversion: 2.1 time: 0.116669 Aug 23 18:16:32.252820 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2581/5047] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Aug 23 18:16:32 2022] DELETE /compute/v2.1/os-server-groups/6b071450-c5d3-40e7-875d-798d88657a4d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:16:32.265190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ef2ec08-e4a5-43d5-8548-04c825c21acb tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:32.313563 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2ef2ec08-e4a5-43d5-8548-04c825c21acb tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 334 microversion: 2.1 time: 0.054783 Aug 23 18:16:32.314409 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2582/5048] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 18:16:32 2022] GET /compute/v2.1/os-server-groups => generated 334 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:32.326382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc6a722f-98fd-4091-8f17-5bf3c2bd986c tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:32.388072 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc6a722f-98fd-4091-8f17-5bf3c2bd986c tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/2e2f7038-438d-44ce-98e0-5ec71f2c5d44" status: 204 len: 0 microversion: 2.1 time: 0.065559 Aug 23 18:16:32.389620 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2583/5049] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Aug 23 18:16:32 2022] DELETE /compute/v2.1/os-server-groups/2e2f7038-438d-44ce-98e0-5ec71f2c5d44 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:16:32.399082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-650671a0-5e41-49eb-8fea-fc39f906fc4b tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:32.413732 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-650671a0-5e41-49eb-8fea-fc39f906fc4b tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.018931 Aug 23 18:16:32.415071 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2584/5050] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 18:16:32 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:32.428637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3c7ef3b-0e54-48ab-b376-c12068227cd0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Action: 'create', calling method: .version_select at 0x7f27ec38c430>, body: {"server_group": {"name": "tempest-server-group-783427726", "policies": ["affinity"]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:32.454469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=4,nova_api:DELETE=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:32.464379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d3c7ef3b-0e54-48ab-b376-c12068227cd0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:32.477662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d3c7ef3b-0e54-48ab-b376-c12068227cd0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:32.548639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d3c7ef3b-0e54-48ab-b376-c12068227cd0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:32.551539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7fefa057-25c4-4644-809f-add684534e72 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:32.561060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d3c7ef3b-0e54-48ab-b376-c12068227cd0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:32.564298 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7fefa057-25c4-4644-809f-add684534e72 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.608542 Aug 23 18:16:32.567352 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2467/5051] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:31 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:32.586231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-521bb53f-06a0-4fce-88a6-7be84b3988d6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:32.587158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-521bb53f-06a0-4fce-88a6-7be84b3988d6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:32.598326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-521bb53f-06a0-4fce-88a6-7be84b3988d6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:32.600888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-521bb53f-06a0-4fce-88a6-7be84b3988d6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:32.601445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-521bb53f-06a0-4fce-88a6-7be84b3988d6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:32.601848 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d3c7ef3b-0e54-48ab-b376-c12068227cd0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.177964 Aug 23 18:16:32.607724 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2585/5052] 10.222.0.61 () {60 vars in 1173 bytes} [Tue Aug 23 18:16:32 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:16:32.610792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-521bb53f-06a0-4fce-88a6-7be84b3988d6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:32.611526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-521bb53f-06a0-4fce-88a6-7be84b3988d6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:32.612287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c67c2618-dd02-4fc9-85c2-964c6a720291 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:32.619613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c67c2618-dd02-4fc9-85c2-964c6a720291 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:32.626810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c67c2618-dd02-4fc9-85c2-964c6a720291 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:32.632306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c67c2618-dd02-4fc9-85c2-964c6a720291 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:32.632306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c67c2618-dd02-4fc9-85c2-964c6a720291 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:32.632306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c67c2618-dd02-4fc9-85c2-964c6a720291 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:32.632306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c67c2618-dd02-4fc9-85c2-964c6a720291 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:32.633150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c67c2618-dd02-4fc9-85c2-964c6a720291 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:32.639909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-521bb53f-06a0-4fce-88a6-7be84b3988d6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:33.155480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c67c2618-dd02-4fc9-85c2-964c6a720291 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:33.168542 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c67c2618-dd02-4fc9-85c2-964c6a720291 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.563989 Aug 23 18:16:33.169721 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2586/5053] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:32 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:33.175101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-68d66a64-eced-4b8f-a235-595fa36ee590 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:33.216495 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-68d66a64-eced-4b8f-a235-595fa36ee590 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/d4861da2-332b-4902-83cb-cdda4b4eaab6" status: 204 len: 0 microversion: 2.1 time: 0.045469 Aug 23 18:16:33.217661 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2587/5054] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Aug 23 18:16:33 2022] DELETE /compute/v2.1/os-server-groups/d4861da2-332b-4902-83cb-cdda4b4eaab6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:16:33.225710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f33e8795-f7b2-4c85-b8b6-b75ae5ffb954 req-f6139556-7206-4301-8e2a-162916407b50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-plugged", "status": "completed", "tag": "efc446c9-5ccd-4541-9891-7415a79be535"}, {"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-plugged", "status": "completed", "tag": "1748595a-c8aa-4422-ab33-d3f8d2ec00d2"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:33.239808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f33e8795-f7b2-4c85-b8b6-b75ae5ffb954 req-f6139556-7206-4301-8e2a-162916407b50 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:33.241412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f33e8795-f7b2-4c85-b8b6-b75ae5ffb954 req-f6139556-7206-4301-8e2a-162916407b50 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:33.242413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f33e8795-f7b2-4c85-b8b6-b75ae5ffb954 req-f6139556-7206-4301-8e2a-162916407b50 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:33.256940 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f33e8795-f7b2-4c85-b8b6-b75ae5ffb954 req-f6139556-7206-4301-8e2a-162916407b50 service nova] Creating event network-vif-plugged:efc446c9-5ccd-4541-9891-7415a79be535 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:16:33.257899 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f33e8795-f7b2-4c85-b8b6-b75ae5ffb954 req-f6139556-7206-4301-8e2a-162916407b50 service nova] Creating event network-vif-plugged:1748595a-c8aa-4422-ab33-d3f8d2ec00d2 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:16:33.264502 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f33e8795-f7b2-4c85-b8b6-b75ae5ffb954 req-f6139556-7206-4301-8e2a-162916407b50 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045359 Aug 23 18:16:33.265969 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2588/5055] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:33 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:33.274069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2aad71a7-4718-4533-a9dc-a757c30ccbe3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:33.275507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2aad71a7-4718-4533-a9dc-a757c30ccbe3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:33.286110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aad71a7-4718-4533-a9dc-a757c30ccbe3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:33.286798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aad71a7-4718-4533-a9dc-a757c30ccbe3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:33.287710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aad71a7-4718-4533-a9dc-a757c30ccbe3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:33.289203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aad71a7-4718-4533-a9dc-a757c30ccbe3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:33.290040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aad71a7-4718-4533-a9dc-a757c30ccbe3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:33.290755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aad71a7-4718-4533-a9dc-a757c30ccbe3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:33.469487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2aad71a7-4718-4533-a9dc-a757c30ccbe3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:33.481243 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2aad71a7-4718-4533-a9dc-a757c30ccbe3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1280 microversion: 2.1 time: 0.213741 Aug 23 18:16:33.481856 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2589/5056] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:33 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1280 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:33.500282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ff05829b-59a9-42f1-bdb8-2c8896327598 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:33.500906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ff05829b-59a9-42f1-bdb8-2c8896327598 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:33.510918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff05829b-59a9-42f1-bdb8-2c8896327598 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:33.511418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff05829b-59a9-42f1-bdb8-2c8896327598 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:33.512185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff05829b-59a9-42f1-bdb8-2c8896327598 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:33.512575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff05829b-59a9-42f1-bdb8-2c8896327598 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:33.513040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff05829b-59a9-42f1-bdb8-2c8896327598 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:33.513469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff05829b-59a9-42f1-bdb8-2c8896327598 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:33.532657 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-ff05829b-59a9-42f1-bdb8-2c8896327598 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ff05829b-59a9-42f1-bdb8-2c8896327598 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc HTTP/1.1 Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '404a2173-45ea-493f-8fc8-153dfd7896fc'} Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:33.533673 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:33.541395 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:33.541395 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:33.541395 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:33.541395 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:33.541395 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:33.541395 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:16:33.541395 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:33.541395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ff05829b-59a9-42f1-bdb8-2c8896327598 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:33.541395 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ff05829b-59a9-42f1-bdb8-2c8896327598 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 404 len: 111 microversion: 2.1 time: 0.052391 Aug 23 18:16:33.550995 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2590/5057] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:33 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:33.561968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6ed6a5a8-2183-4e1c-a6bc-872bad722151 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:33.562531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6ed6a5a8-2183-4e1c-a6bc-872bad722151 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 4d318d3f-398a-41ed-b22d-2d95b6ff379e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:33.576200 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-6ed6a5a8-2183-4e1c-a6bc-872bad722151 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 4d318d3f-398a-41ed-b22d-2d95b6ff379e could not be found. Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6ed6a5a8-2183-4e1c-a6bc-872bad722151 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/4d318d3f-398a-41ed-b22d-2d95b6ff379e/action HTTP/1.1 Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 15 Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: {"suspend": {}} Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 4d318d3f-398a-41ed-b22d-2d95b6ff379e could not be found. Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '4d318d3f-398a-41ed-b22d-2d95b6ff379e', 'body': {'suspend': {}}} Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d318d3f-398a-41ed-b22d-2d95b6ff379e could not be found. Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d318d3f-398a-41ed-b22d-2d95b6ff379e could not be found. Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:33.585360 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:33.591004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:33.591004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:33.591004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d318d3f-398a-41ed-b22d-2d95b6ff379e could not be found. Aug 23 18:16:33.591004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:33.594202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6ed6a5a8-2183-4e1c-a6bc-872bad722151 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 4d318d3f-398a-41ed-b22d-2d95b6ff379e could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:33.595490 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6ed6a5a8-2183-4e1c-a6bc-872bad722151 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/4d318d3f-398a-41ed-b22d-2d95b6ff379e/action" status: 404 len: 111 microversion: 2.1 time: 0.037975 Aug 23 18:16:33.596376 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2591/5058] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:16:33 2022] POST /compute/v2.1/servers/4d318d3f-398a-41ed-b22d-2d95b6ff379e/action => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:33.608882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-66baa514-0cb9-443b-a8ba-01d15eb2e02f tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:33.637259 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-66baa514-0cb9-443b-a8ba-01d15eb2e02f tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.035490 Aug 23 18:16:33.644849 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2592/5059] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 18:16:33 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:33.651033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cf44e575-58de-408a-86a4-539558428ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:33.651729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cf44e575-58de-408a-86a4-539558428ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:33.661894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf44e575-58de-408a-86a4-539558428ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:33.668121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf44e575-58de-408a-86a4-539558428ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:33.668811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf44e575-58de-408a-86a4-539558428ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:33.669528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf44e575-58de-408a-86a4-539558428ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:33.670005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf44e575-58de-408a-86a4-539558428ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:33.670438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf44e575-58de-408a-86a4-539558428ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:34.034044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-521bb53f-06a0-4fce-88a6-7be84b3988d6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:34.046325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-521bb53f-06a0-4fce-88a6-7be84b3988d6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:34.051039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-521bb53f-06a0-4fce-88a6-7be84b3988d6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:34.055159 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-521bb53f-06a0-4fce-88a6-7be84b3988d6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 1.486608 Aug 23 18:16:34.077566 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2468/5060] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:32 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 1506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:34.088429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cf44e575-58de-408a-86a4-539558428ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:34.088994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-33f3cb79-1c73-458c-8305-526a3282fd23 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Action: 'create', calling method: .version_select at 0x7f27dfc41a60>, body: {"server_group": {"name": "tempest-server-group-1886513042", "policies": ["anti-affinity"]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:34.111585 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cf44e575-58de-408a-86a4-539558428ab5 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.466708 Aug 23 18:16:34.112642 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2593/5061] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:33 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:34.126837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-2059907980", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "bcef2581-80d0-47e5-8b8b-34343a6facf5"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:34.128779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-33f3cb79-1c73-458c-8305-526a3282fd23 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:34.151502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-33f3cb79-1c73-458c-8305-526a3282fd23 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:34.228153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] validate_networks() for [('bcef2581-80d0-47e5-8b8b-34343a6facf5', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:16:34.308505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-33f3cb79-1c73-458c-8305-526a3282fd23 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:34.323186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-33f3cb79-1c73-458c-8305-526a3282fd23 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_groups'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:34.333015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:34.393582 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-33f3cb79-1c73-458c-8305-526a3282fd23 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.313564 Aug 23 18:16:34.395081 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2469/5062] 10.222.0.61 () {60 vars in 1173 bytes} [Tue Aug 23 18:16:34 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:34.415876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-991d67f7-6579-4ad7-80b3-e2dfb0ef92a0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:34.417204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-991d67f7-6579-4ad7-80b3-e2dfb0ef92a0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:34.427107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-991d67f7-6579-4ad7-80b3-e2dfb0ef92a0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:34.429515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-991d67f7-6579-4ad7-80b3-e2dfb0ef92a0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:34.430786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-991d67f7-6579-4ad7-80b3-e2dfb0ef92a0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:34.431560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-991d67f7-6579-4ad7-80b3-e2dfb0ef92a0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:34.432204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-991d67f7-6579-4ad7-80b3-e2dfb0ef92a0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:34.432684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-991d67f7-6579-4ad7-80b3-e2dfb0ef92a0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:34.742310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-991d67f7-6579-4ad7-80b3-e2dfb0ef92a0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:34.754695 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-991d67f7-6579-4ad7-80b3-e2dfb0ef92a0 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.357231 Aug 23 18:16:34.756647 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2470/5063] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:34 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:34.776715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3369459c-23d2-4358-a2ad-f2b960f7a10a tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:34.843223 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3369459c-23d2-4358-a2ad-f2b960f7a10a tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/7ef95270-1da5-4a48-b894-7217c705584e" status: 204 len: 0 microversion: 2.1 time: 0.084138 Aug 23 18:16:34.844074 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2471/5064] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Aug 23 18:16:34 2022] DELETE /compute/v2.1/os-server-groups/7ef95270-1da5-4a48-b894-7217c705584e => generated 0 bytes in 87 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:16:34.849002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-79de2a1f-4985-4927-a168-7c80b0fe6591 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:34.851685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-79de2a1f-4985-4927-a168-7c80b0fe6591 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:34.866211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79de2a1f-4985-4927-a168-7c80b0fe6591 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:34.871278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79de2a1f-4985-4927-a168-7c80b0fe6591 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:34.873343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79de2a1f-4985-4927-a168-7c80b0fe6591 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:34.874632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79de2a1f-4985-4927-a168-7c80b0fe6591 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:34.875760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79de2a1f-4985-4927-a168-7c80b0fe6591 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:34.876792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79de2a1f-4985-4927-a168-7c80b0fe6591 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:34.999899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-79de2a1f-4985-4927-a168-7c80b0fe6591 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:35.012213 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-79de2a1f-4985-4927-a168-7c80b0fe6591 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1280 microversion: 2.1 time: 0.166116 Aug 23 18:16:35.028240 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2472/5065] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:34 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1280 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:35.035272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d61d71f0-174a-47a2-b261-859165191435 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:35.038622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d61d71f0-174a-47a2-b261-859165191435 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:35.049260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d61d71f0-174a-47a2-b261-859165191435 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:35.050074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d61d71f0-174a-47a2-b261-859165191435 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:35.051783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d61d71f0-174a-47a2-b261-859165191435 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:35.053757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d61d71f0-174a-47a2-b261-859165191435 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:35.054244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d61d71f0-174a-47a2-b261-859165191435 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:35.054722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d61d71f0-174a-47a2-b261-859165191435 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:35.111769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-d61d71f0-174a-47a2-b261-859165191435 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lazy-loading 'flavor' on Instance uuid f1cad0fb-87b4-403c-9881-64ce147502fd {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:16:35.158561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:35.264245 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d61d71f0-174a-47a2-b261-859165191435 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 202 len: 0 microversion: 2.1 time: 0.233366 Aug 23 18:16:35.267360 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2473/5066] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:16:35 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:16:35.292141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a193203b-97e6-4330-a81b-5fedcc7150ee tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:35.310004 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a193203b-97e6-4330-a81b-5fedcc7150ee tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.036114 Aug 23 18:16:35.310967 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2474/5067] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 18:16:35 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:35.323505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6c41adc4-7a4e-4518-8e66-2bac5626d439 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:35.324705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6c41adc4-7a4e-4518-8e66-2bac5626d439 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:35.347500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c41adc4-7a4e-4518-8e66-2bac5626d439 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:35.348014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c41adc4-7a4e-4518-8e66-2bac5626d439 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:35.348735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c41adc4-7a4e-4518-8e66-2bac5626d439 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:35.350092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c41adc4-7a4e-4518-8e66-2bac5626d439 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:35.350872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c41adc4-7a4e-4518-8e66-2bac5626d439 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:35.351418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c41adc4-7a4e-4518-8e66-2bac5626d439 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:35.774198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c41adc4-7a4e-4518-8e66-2bac5626d439 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:35.786412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c41adc4-7a4e-4518-8e66-2bac5626d439 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:35.791638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c41adc4-7a4e-4518-8e66-2bac5626d439 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:35.792901 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6c41adc4-7a4e-4518-8e66-2bac5626d439 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1878 microversion: 2.42 time: 0.480648 Aug 23 18:16:35.806571 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2475/5068] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:35 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1878 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:35.807039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:16:35.807039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:16:35.807039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:16:35.807039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:16:35.807039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:16:35.807898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f4963c6e-7455-417b-85d2-42bf10fdc01e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:35.807898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f4963c6e-7455-417b-85d2-42bf10fdc01e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:35.823141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:35.823801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4963c6e-7455-417b-85d2-42bf10fdc01e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:35.824397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4963c6e-7455-417b-85d2-42bf10fdc01e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:35.824844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4963c6e-7455-417b-85d2-42bf10fdc01e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:35.825559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:35.825691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4963c6e-7455-417b-85d2-42bf10fdc01e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:35.826036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4963c6e-7455-417b-85d2-42bf10fdc01e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:35.826351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:35.826483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4963c6e-7455-417b-85d2-42bf10fdc01e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:35.827895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:35.828633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:35.831056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:35.859026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:35.871053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for user 6e80c3f1c008459faa3ac74ea5984eea and project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:35.896456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:16:35.911879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:16:36.016250 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a45007fc-9475-4827-b13b-19988a31a03e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.901932 Aug 23 18:16:36.018043 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2594/5069] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:16:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1904 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:16:36.040731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-1262191119", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "4bf11fb5-43ab-4508-b2c0-7d749ffe0476"}]}, "os:scheduler_hints": {"group": "fbbc029b-637d-4e38-9bed-7b259c43d5e8"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:36.135677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] validate_networks() for [('4bf11fb5-43ab-4508-b2c0-7d749ffe0476', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:16:36.149729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f4963c6e-7455-417b-85d2-42bf10fdc01e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:36.161004 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f4963c6e-7455-417b-85d2-42bf10fdc01e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1513 microversion: 2.1 time: 0.362602 Aug 23 18:16:36.165142 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2476/5070] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:35 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1513 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:36.176342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-19c2736c-962b-4e3e-a547-53a7a2efed21 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:36.178785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-19c2736c-962b-4e3e-a547-53a7a2efed21 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:36.280092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-19c2736c-962b-4e3e-a547-53a7a2efed21 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:36.288283 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-19c2736c-962b-4e3e-a547-53a7a2efed21 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1209 microversion: 2.1 time: 0.121586 Aug 23 18:16:36.288891 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2477/5071] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:36 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1209 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:36.303704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f79ab6a1-5e89-4af4-9821-65280c949e19 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:36.304328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f79ab6a1-5e89-4af4-9821-65280c949e19 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:36.310737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f79ab6a1-5e89-4af4-9821-65280c949e19 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:36.311233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f79ab6a1-5e89-4af4-9821-65280c949e19 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:36.311671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f79ab6a1-5e89-4af4-9821-65280c949e19 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:36.312382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f79ab6a1-5e89-4af4-9821-65280c949e19 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:36.312833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f79ab6a1-5e89-4af4-9821-65280c949e19 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:36.313288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f79ab6a1-5e89-4af4-9821-65280c949e19 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:36.545377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f79ab6a1-5e89-4af4-9821-65280c949e19 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:36.559841 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f79ab6a1-5e89-4af4-9821-65280c949e19 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1322 microversion: 2.1 time: 0.269817 Aug 23 18:16:36.573123 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2478/5072] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:36 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1322 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:36.826283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f87f422f-16f3-4339-b0e2-b87c23bd7e1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:36.828553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f87f422f-16f3-4339-b0e2-b87c23bd7e1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:36.844596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f87f422f-16f3-4339-b0e2-b87c23bd7e1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:36.845744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f87f422f-16f3-4339-b0e2-b87c23bd7e1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:36.847422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f87f422f-16f3-4339-b0e2-b87c23bd7e1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:36.848581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f87f422f-16f3-4339-b0e2-b87c23bd7e1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:36.850267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f87f422f-16f3-4339-b0e2-b87c23bd7e1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:36.852949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f87f422f-16f3-4339-b0e2-b87c23bd7e1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:37.277135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f87f422f-16f3-4339-b0e2-b87c23bd7e1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:37.294107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f87f422f-16f3-4339-b0e2-b87c23bd7e1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:37.297916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f87f422f-16f3-4339-b0e2-b87c23bd7e1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:37.300396 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f87f422f-16f3-4339-b0e2-b87c23bd7e1b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 2836 microversion: 2.42 time: 0.481736 Aug 23 18:16:37.301743 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2479/5073] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:16:36 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 2836 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:37.353548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a99d5b35-964f-47a0-8819-1fd371abaf26 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:37.354307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a99d5b35-964f-47a0-8819-1fd371abaf26 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:37.370011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99d5b35-964f-47a0-8819-1fd371abaf26 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:37.370513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99d5b35-964f-47a0-8819-1fd371abaf26 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:37.372867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99d5b35-964f-47a0-8819-1fd371abaf26 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:37.374080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99d5b35-964f-47a0-8819-1fd371abaf26 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:37.374080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99d5b35-964f-47a0-8819-1fd371abaf26 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:37.376932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99d5b35-964f-47a0-8819-1fd371abaf26 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:37.632120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a99d5b35-964f-47a0-8819-1fd371abaf26 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:37.641815 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a99d5b35-964f-47a0-8819-1fd371abaf26 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1496 microversion: 2.1 time: 0.338666 Aug 23 18:16:37.642973 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2480/5074] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:37 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1496 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:37.649803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a27b1ad0-26e4-4e57-9f4d-03cc1c606973 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:37.650788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a27b1ad0-26e4-4e57-9f4d-03cc1c606973 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:37.659964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a27b1ad0-26e4-4e57-9f4d-03cc1c606973 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:37.660802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a27b1ad0-26e4-4e57-9f4d-03cc1c606973 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:37.661485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a27b1ad0-26e4-4e57-9f4d-03cc1c606973 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:37.663068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a27b1ad0-26e4-4e57-9f4d-03cc1c606973 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:37.664455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a27b1ad0-26e4-4e57-9f4d-03cc1c606973 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:37.665147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a27b1ad0-26e4-4e57-9f4d-03cc1c606973 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:37.759361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a27b1ad0-26e4-4e57-9f4d-03cc1c606973 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:37.768200 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a27b1ad0-26e4-4e57-9f4d-03cc1c606973 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1261 microversion: 2.1 time: 0.123712 Aug 23 18:16:37.769136 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2481/5075] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:37 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1261 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:37.784369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b8487599-4048-4098-9b96-46e6c95bc1bb tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:37.788854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b8487599-4048-4098-9b96-46e6c95bc1bb tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:37.795464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8487599-4048-4098-9b96-46e6c95bc1bb tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:37.796241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8487599-4048-4098-9b96-46e6c95bc1bb tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:37.796553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8487599-4048-4098-9b96-46e6c95bc1bb tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:37.797390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8487599-4048-4098-9b96-46e6c95bc1bb tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:37.797926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8487599-4048-4098-9b96-46e6c95bc1bb tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:37.798491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8487599-4048-4098-9b96-46e6c95bc1bb tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:37.960850 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b8487599-4048-4098-9b96-46e6c95bc1bb tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.190289 Aug 23 18:16:37.961779 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2482/5076] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Aug 23 18:16:37 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3/os-interface => generated 1831 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:16:37.966755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5dd06661-6d05-4576-9d26-1c727490006c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:37.967609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5dd06661-6d05-4576-9d26-1c727490006c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:37.977619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5dd06661-6d05-4576-9d26-1c727490006c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:37.978252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5dd06661-6d05-4576-9d26-1c727490006c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:37.979438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5dd06661-6d05-4576-9d26-1c727490006c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:37.979737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5dd06661-6d05-4576-9d26-1c727490006c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:37.980320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5dd06661-6d05-4576-9d26-1c727490006c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:37.981329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5dd06661-6d05-4576-9d26-1c727490006c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:38.027545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:16:38.028020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:16:38.028466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:16:38.029253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:16:38.029675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:16:38.047352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:38.047838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:38.048276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:38.049436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:38.050161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:38.050742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:38.070555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:38.076704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:38.094970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:16:38.097314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:16:38.174861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_group_members'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:38.181655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_group_members'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:38.229798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5dd06661-6d05-4576-9d26-1c727490006c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:38.230045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_group_members'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:16:38.237734 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5dd06661-6d05-4576-9d26-1c727490006c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1322 microversion: 2.1 time: 0.275086 Aug 23 18:16:38.238957 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2483/5077] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:37 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1322 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:38.253795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Getting quotas for user 8fcf9aa252b34e4cbb7d7e11693a6dab and project f6d9218910784aafae3d855cd5ce33f7. Resources: {'server_group_members'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:16:38.253795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=9,nova_api:DELETE=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:38.257955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:38.258772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:38.265242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:38.266045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:38.266773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:38.267717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:38.268402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:38.269083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:38.280011 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-91635066-778b-4206-8f10-2df076c70ed7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.260532 Aug 23 18:16:38.280683 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2595/5078] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:16:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:16:38.293682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eca80eb4-bf44-4802-9e7e-3958958f98b9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:38.294393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eca80eb4-bf44-4802-9e7e-3958958f98b9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:38.300097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lazy-loading 'flavor' on Instance uuid f1cad0fb-87b4-403c-9881-64ce147502fd {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:16:38.314485 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Cannot 'suspend' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state suspended Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action HTTP/1.1 Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 15 Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: {"suspend": {}} Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: exception: Cannot 'suspend' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state suspended Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f1cad0fb-87b4-403c-9881-64ce147502fd', 'body': {'suspend': {}}} Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 296, in inner Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 256, in inner Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1cad0fb-87b4-403c-9881-64ce147502fd in vm_state suspended. Cannot suspend while the instance is in this state. Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Aug 23 18:16:38.316459 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state suspended Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state suspended Aug 23 18:16:38.323190 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:38.326054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 409 to user: Cannot 'suspend' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state suspended {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:38.327208 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4fca11a5-4a7e-44af-a9bc-d225e351da96 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 409 len: 148 microversion: 2.1 time: 0.087093 Aug 23 18:16:38.328351 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2484/5079] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:16:38 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 148 bytes in 88 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:16:38.341169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d78793ab-4724-48fb-86c8-f3f3e0540037 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:38.341976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d78793ab-4724-48fb-86c8-f3f3e0540037 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:38.358305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d78793ab-4724-48fb-86c8-f3f3e0540037 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:38.359220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d78793ab-4724-48fb-86c8-f3f3e0540037 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:38.359897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d78793ab-4724-48fb-86c8-f3f3e0540037 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:38.361569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d78793ab-4724-48fb-86c8-f3f3e0540037 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:38.362257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d78793ab-4724-48fb-86c8-f3f3e0540037 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:38.363417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d78793ab-4724-48fb-86c8-f3f3e0540037 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:38.429869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eca80eb4-bf44-4802-9e7e-3958958f98b9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf9aa252b34e4cbb7d7e11693a6dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d9218910784aafae3d855cd5ce33f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:38.441368 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eca80eb4-bf44-4802-9e7e-3958958f98b9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 200 len: 1213 microversion: 2.1 time: 0.152171 Aug 23 18:16:38.445876 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2596/5080] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:38 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:38.469261 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d78793ab-4724-48fb-86c8-f3f3e0540037 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 202 len: 0 microversion: 2.1 time: 0.130562 Aug 23 18:16:38.473168 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2485/5081] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:16:38 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:16:38.480856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0cf9f8a0-44b9-4913-b061-768075daf60c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:38.481408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0cf9f8a0-44b9-4913-b061-768075daf60c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:38.493998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cf9f8a0-44b9-4913-b061-768075daf60c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:38.495714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cf9f8a0-44b9-4913-b061-768075daf60c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:38.496547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cf9f8a0-44b9-4913-b061-768075daf60c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:38.497753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cf9f8a0-44b9-4913-b061-768075daf60c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:38.498308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cf9f8a0-44b9-4913-b061-768075daf60c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:38.498895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cf9f8a0-44b9-4913-b061-768075daf60c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:38.792884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b6bff23d-5e1e-4bfb-bd81-f358ac47661a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:38.794209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b6bff23d-5e1e-4bfb-bd81-f358ac47661a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:38.812071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6bff23d-5e1e-4bfb-bd81-f358ac47661a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:38.813285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6bff23d-5e1e-4bfb-bd81-f358ac47661a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:38.814185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6bff23d-5e1e-4bfb-bd81-f358ac47661a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:38.816065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6bff23d-5e1e-4bfb-bd81-f358ac47661a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:38.816754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6bff23d-5e1e-4bfb-bd81-f358ac47661a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:38.817430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6bff23d-5e1e-4bfb-bd81-f358ac47661a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:39.024426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b6bff23d-5e1e-4bfb-bd81-f358ac47661a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:39.039599 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b6bff23d-5e1e-4bfb-bd81-f358ac47661a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1267 microversion: 2.1 time: 0.252030 Aug 23 18:16:39.040336 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2486/5082] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:38 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:39.267680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-31c416c6-dcc8-42da-9403-83cfc3d9553e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:39.269177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-31c416c6-dcc8-42da-9403-83cfc3d9553e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:39.281159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31c416c6-dcc8-42da-9403-83cfc3d9553e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:39.282837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31c416c6-dcc8-42da-9403-83cfc3d9553e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:39.283569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31c416c6-dcc8-42da-9403-83cfc3d9553e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:39.284629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31c416c6-dcc8-42da-9403-83cfc3d9553e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:39.285963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31c416c6-dcc8-42da-9403-83cfc3d9553e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:39.287750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31c416c6-dcc8-42da-9403-83cfc3d9553e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:39.371988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0cf9f8a0-44b9-4913-b061-768075daf60c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:39.385551 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0cf9f8a0-44b9-4913-b061-768075daf60c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1502 microversion: 2.1 time: 0.910450 Aug 23 18:16:39.388963 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2597/5083] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:38 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1502 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:39.395436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3cf1c58d-1866-4882-91b4-84dfcc18f017 req-f9559972-87ea-430d-8c1a-6089845f6b78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5480cb09-9eb4-48d7-8bbe-88de71af3b07", "tag": "ff840925-6785-4a00-a68f-0086858b81eb"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:39.410112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3cf1c58d-1866-4882-91b4-84dfcc18f017 req-f9559972-87ea-430d-8c1a-6089845f6b78 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:39.410987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3cf1c58d-1866-4882-91b4-84dfcc18f017 req-f9559972-87ea-430d-8c1a-6089845f6b78 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:39.418828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3cf1c58d-1866-4882-91b4-84dfcc18f017 req-f9559972-87ea-430d-8c1a-6089845f6b78 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:39.470663 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3cf1c58d-1866-4882-91b4-84dfcc18f017 req-f9559972-87ea-430d-8c1a-6089845f6b78 service nova] Creating event network-changed:ff840925-6785-4a00-a68f-0086858b81eb for instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 on n-h2-850468-16 Aug 23 18:16:39.478176 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3cf1c58d-1866-4882-91b4-84dfcc18f017 req-f9559972-87ea-430d-8c1a-6089845f6b78 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087415 Aug 23 18:16:39.480772 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2598/5084] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:39.489199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b1e9d1cc-3abb-47b5-9fa6-5d22f70c0f01 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:39.492298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b1e9d1cc-3abb-47b5-9fa6-5d22f70c0f01 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:39.500894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1e9d1cc-3abb-47b5-9fa6-5d22f70c0f01 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:39.501635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1e9d1cc-3abb-47b5-9fa6-5d22f70c0f01 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:39.502086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1e9d1cc-3abb-47b5-9fa6-5d22f70c0f01 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:39.502887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1e9d1cc-3abb-47b5-9fa6-5d22f70c0f01 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:39.503349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1e9d1cc-3abb-47b5-9fa6-5d22f70c0f01 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:39.504088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1e9d1cc-3abb-47b5-9fa6-5d22f70c0f01 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:39.543540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-31c416c6-dcc8-42da-9403-83cfc3d9553e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:39.555901 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-31c416c6-dcc8-42da-9403-83cfc3d9553e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1322 microversion: 2.1 time: 0.298198 Aug 23 18:16:39.567134 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2487/5085] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:39 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1322 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:39.676933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b1e9d1cc-3abb-47b5-9fa6-5d22f70c0f01 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf9aa252b34e4cbb7d7e11693a6dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d9218910784aafae3d855cd5ce33f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:39.686727 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b1e9d1cc-3abb-47b5-9fa6-5d22f70c0f01 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 200 len: 1265 microversion: 2.1 time: 0.203753 Aug 23 18:16:39.687313 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2599/5086] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:39 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 1265 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:40.068779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97b70e67-1f26-4eb1-8c25-825502d48c37 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:40.070153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-97b70e67-1f26-4eb1-8c25-825502d48c37 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:40.088503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97b70e67-1f26-4eb1-8c25-825502d48c37 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:40.092278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97b70e67-1f26-4eb1-8c25-825502d48c37 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:40.093512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97b70e67-1f26-4eb1-8c25-825502d48c37 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:40.103778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97b70e67-1f26-4eb1-8c25-825502d48c37 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:40.105149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97b70e67-1f26-4eb1-8c25-825502d48c37 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:40.106332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97b70e67-1f26-4eb1-8c25-825502d48c37 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:40.214513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-88722791-2ddd-47ea-b9dc-482d291070b7 req-c34e99d9-f912-4be2-9384-813e196aac72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "tag": "7044c5c8-0b1d-4f05-bb0b-77bde6537776"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:40.225709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-88722791-2ddd-47ea-b9dc-482d291070b7 req-c34e99d9-f912-4be2-9384-813e196aac72 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:40.226640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-88722791-2ddd-47ea-b9dc-482d291070b7 req-c34e99d9-f912-4be2-9384-813e196aac72 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:40.227326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-88722791-2ddd-47ea-b9dc-482d291070b7 req-c34e99d9-f912-4be2-9384-813e196aac72 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:40.240879 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-88722791-2ddd-47ea-b9dc-482d291070b7 req-c34e99d9-f912-4be2-9384-813e196aac72 service nova] Creating event network-changed:7044c5c8-0b1d-4f05-bb0b-77bde6537776 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:16:40.247697 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-88722791-2ddd-47ea-b9dc-482d291070b7 req-c34e99d9-f912-4be2-9384-813e196aac72 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037921 Aug 23 18:16:40.249124 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2600/5087] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:40.425551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dc080271-01e6-4be0-9278-19a50774a9ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:40.428202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc080271-01e6-4be0-9278-19a50774a9ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:40.434304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:40.436282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc080271-01e6-4be0-9278-19a50774a9ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:40.437208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc080271-01e6-4be0-9278-19a50774a9ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:40.437906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc080271-01e6-4be0-9278-19a50774a9ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:40.438912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc080271-01e6-4be0-9278-19a50774a9ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:40.439593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc080271-01e6-4be0-9278-19a50774a9ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:40.440285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc080271-01e6-4be0-9278-19a50774a9ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:40.518530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-97b70e67-1f26-4eb1-8c25-825502d48c37 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:40.530332 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-97b70e67-1f26-4eb1-8c25-825502d48c37 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1309 microversion: 2.1 time: 0.467265 Aug 23 18:16:40.549832 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2488/5088] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:40 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1309 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:40.580808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c75730f-3801-4b58-aa20-5f86b7249481 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:40.582348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1c75730f-3801-4b58-aa20-5f86b7249481 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:40.595636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c75730f-3801-4b58-aa20-5f86b7249481 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:40.597717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c75730f-3801-4b58-aa20-5f86b7249481 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:40.598366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c75730f-3801-4b58-aa20-5f86b7249481 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:40.599310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c75730f-3801-4b58-aa20-5f86b7249481 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:40.609137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c75730f-3801-4b58-aa20-5f86b7249481 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:40.612283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c75730f-3801-4b58-aa20-5f86b7249481 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:40.883170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dc080271-01e6-4be0-9278-19a50774a9ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:40.900536 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dc080271-01e6-4be0-9278-19a50774a9ae tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1502 microversion: 2.1 time: 0.488044 Aug 23 18:16:40.901233 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2601/5089] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:40 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1502 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:40.916103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd7f2e65-e1eb-450a-8217-c6c127f8d7c5 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:40.923731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cd7f2e65-e1eb-450a-8217-c6c127f8d7c5 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:40.949404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd7f2e65-e1eb-450a-8217-c6c127f8d7c5 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:40.952494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd7f2e65-e1eb-450a-8217-c6c127f8d7c5 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:40.956284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd7f2e65-e1eb-450a-8217-c6c127f8d7c5 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:40.959653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd7f2e65-e1eb-450a-8217-c6c127f8d7c5 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:40.960475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd7f2e65-e1eb-450a-8217-c6c127f8d7c5 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:40.972566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd7f2e65-e1eb-450a-8217-c6c127f8d7c5 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:41.189614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cd7f2e65-e1eb-450a-8217-c6c127f8d7c5 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf9aa252b34e4cbb7d7e11693a6dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d9218910784aafae3d855cd5ce33f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:41.199223 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd7f2e65-e1eb-450a-8217-c6c127f8d7c5 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 200 len: 1271 microversion: 2.1 time: 0.295561 Aug 23 18:16:41.205847 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2602/5090] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:40 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 1271 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:41.552857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1c75730f-3801-4b58-aa20-5f86b7249481 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:41.554794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-303e382d-eea9-4587-9e11-42ffe7e2ead3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:41.556011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-303e382d-eea9-4587-9e11-42ffe7e2ead3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:41.567748 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c75730f-3801-4b58-aa20-5f86b7249481 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1322 microversion: 2.1 time: 0.993135 Aug 23 18:16:41.571051 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2489/5091] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:40 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1322 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:41.588181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-303e382d-eea9-4587-9e11-42ffe7e2ead3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:41.588933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-303e382d-eea9-4587-9e11-42ffe7e2ead3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:41.589558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-303e382d-eea9-4587-9e11-42ffe7e2ead3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:41.590776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-303e382d-eea9-4587-9e11-42ffe7e2ead3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:41.591442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-303e382d-eea9-4587-9e11-42ffe7e2ead3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:41.592075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-303e382d-eea9-4587-9e11-42ffe7e2ead3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:41.924702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-751eebce-e062-4c56-b2c3-e462d47768e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:41.926249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-751eebce-e062-4c56-b2c3-e462d47768e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:41.941053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-751eebce-e062-4c56-b2c3-e462d47768e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:41.941908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-751eebce-e062-4c56-b2c3-e462d47768e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:41.944396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-751eebce-e062-4c56-b2c3-e462d47768e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:41.945360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-751eebce-e062-4c56-b2c3-e462d47768e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:41.946033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-751eebce-e062-4c56-b2c3-e462d47768e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:41.946698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-751eebce-e062-4c56-b2c3-e462d47768e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:42.050291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-303e382d-eea9-4587-9e11-42ffe7e2ead3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:42.061084 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-303e382d-eea9-4587-9e11-42ffe7e2ead3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1309 microversion: 2.1 time: 0.510276 Aug 23 18:16:42.062213 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2603/5092] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:41 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1309 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:42.230983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4646db20-fbf4-49a6-a7da-ec5e629668a1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:42.231852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4646db20-fbf4-49a6-a7da-ec5e629668a1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:42.239798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4646db20-fbf4-49a6-a7da-ec5e629668a1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:42.241454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4646db20-fbf4-49a6-a7da-ec5e629668a1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:42.242120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4646db20-fbf4-49a6-a7da-ec5e629668a1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:42.243289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4646db20-fbf4-49a6-a7da-ec5e629668a1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:42.243963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4646db20-fbf4-49a6-a7da-ec5e629668a1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:42.244757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4646db20-fbf4-49a6-a7da-ec5e629668a1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:42.317465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-751eebce-e062-4c56-b2c3-e462d47768e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:42.323130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:42.329439 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-751eebce-e062-4c56-b2c3-e462d47768e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.411431 Aug 23 18:16:42.344364 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2490/5093] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:41 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:42.382373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c92c11dc-6fad-4f66-a328-a8c824151475 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:42.383411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c92c11dc-6fad-4f66-a328-a8c824151475 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:42.395657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c92c11dc-6fad-4f66-a328-a8c824151475 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:42.397138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c92c11dc-6fad-4f66-a328-a8c824151475 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:42.397292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c92c11dc-6fad-4f66-a328-a8c824151475 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:42.398447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c92c11dc-6fad-4f66-a328-a8c824151475 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:42.399342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c92c11dc-6fad-4f66-a328-a8c824151475 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:42.399798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c92c11dc-6fad-4f66-a328-a8c824151475 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:42.671223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c92c11dc-6fad-4f66-a328-a8c824151475 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:42.680170 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c92c11dc-6fad-4f66-a328-a8c824151475 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.305511 Aug 23 18:16:42.680845 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2491/5094] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:42 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:42.690749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-92535a65-65fd-4407-bde3-e81c439ec017 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:42.691595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-92535a65-65fd-4407-bde3-e81c439ec017 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:42.698720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92535a65-65fd-4407-bde3-e81c439ec017 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:42.699473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92535a65-65fd-4407-bde3-e81c439ec017 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:42.700775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92535a65-65fd-4407-bde3-e81c439ec017 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:42.701864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92535a65-65fd-4407-bde3-e81c439ec017 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:42.702510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92535a65-65fd-4407-bde3-e81c439ec017 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:42.702971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92535a65-65fd-4407-bde3-e81c439ec017 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:42.968339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4646db20-fbf4-49a6-a7da-ec5e629668a1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf9aa252b34e4cbb7d7e11693a6dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d9218910784aafae3d855cd5ce33f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:42.977869 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4646db20-fbf4-49a6-a7da-ec5e629668a1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 200 len: 1313 microversion: 2.1 time: 0.755115 Aug 23 18:16:42.978854 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2604/5095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:42 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 1313 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:42.988870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1ccef341-2169-4b21-b322-23b8c8c5de12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:42.990879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1ccef341-2169-4b21-b322-23b8c8c5de12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 6dd36b1c-e67b-41be-8c0c-e2992650869c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:42.998094 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-1ccef341-2169-4b21-b322-23b8c8c5de12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 6dd36b1c-e67b-41be-8c0c-e2992650869c could not be found. Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1ccef341-2169-4b21-b322-23b8c8c5de12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/6dd36b1c-e67b-41be-8c0c-e2992650869c/action HTTP/1.1 Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 15 Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: {"unpause": {}} Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 6dd36b1c-e67b-41be-8c0c-e2992650869c could not be found. Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '6dd36b1c-e67b-41be-8c0c-e2992650869c', 'body': {'unpause': {}}} Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dd36b1c-e67b-41be-8c0c-e2992650869c could not be found. Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dd36b1c-e67b-41be-8c0c-e2992650869c could not be found. Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:43.000174 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:43.005150 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:43.005150 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:43.005150 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dd36b1c-e67b-41be-8c0c-e2992650869c could not be found. Aug 23 18:16:43.005150 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:43.008414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1ccef341-2169-4b21-b322-23b8c8c5de12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 6dd36b1c-e67b-41be-8c0c-e2992650869c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:43.009374 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1ccef341-2169-4b21-b322-23b8c8c5de12 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/6dd36b1c-e67b-41be-8c0c-e2992650869c/action" status: 404 len: 111 microversion: 2.1 time: 0.029334 Aug 23 18:16:43.010749 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2605/5096] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:16:42 2022] POST /compute/v2.1/servers/6dd36b1c-e67b-41be-8c0c-e2992650869c/action => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:43.019872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c62bbaa2-33e1-4636-8fdb-4c4de002ac9f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:43.021248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c62bbaa2-33e1-4636-8fdb-4c4de002ac9f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:43.030774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c62bbaa2-33e1-4636-8fdb-4c4de002ac9f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:43.031677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c62bbaa2-33e1-4636-8fdb-4c4de002ac9f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:43.032336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c62bbaa2-33e1-4636-8fdb-4c4de002ac9f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:43.033275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c62bbaa2-33e1-4636-8fdb-4c4de002ac9f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:43.034643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c62bbaa2-33e1-4636-8fdb-4c4de002ac9f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:43.035288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c62bbaa2-33e1-4636-8fdb-4c4de002ac9f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:43.043176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-92535a65-65fd-4407-bde3-e81c439ec017 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:43.055403 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-92535a65-65fd-4407-bde3-e81c439ec017 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1322 microversion: 2.1 time: 0.369755 Aug 23 18:16:43.058859 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2492/5097] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:42 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:43.085976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ee696e13-9df4-457b-83e0-00c13e7f50ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:43.087568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ee696e13-9df4-457b-83e0-00c13e7f50ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:43.103984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee696e13-9df4-457b-83e0-00c13e7f50ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:43.105228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee696e13-9df4-457b-83e0-00c13e7f50ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:43.106693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee696e13-9df4-457b-83e0-00c13e7f50ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:43.108445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee696e13-9df4-457b-83e0-00c13e7f50ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:43.110204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee696e13-9df4-457b-83e0-00c13e7f50ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:43.114822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee696e13-9df4-457b-83e0-00c13e7f50ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:43.463259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ee696e13-9df4-457b-83e0-00c13e7f50ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:43.477107 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ee696e13-9df4-457b-83e0-00c13e7f50ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1309 microversion: 2.1 time: 0.396298 Aug 23 18:16:43.477898 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2493/5098] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:43 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1309 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:43.486861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-3744fda1-c6a9-4d75-ad33-ba1b6ac1bdf4 req-d5790a85-e0c9-499c-b8b7-40a371dfa626 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6e6d612-1196-4700-b893-d355ca237e7f", "tag": "82424a3c-a6fe-433b-8e79-c404fe9e85b7"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:43.502859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3744fda1-c6a9-4d75-ad33-ba1b6ac1bdf4 req-d5790a85-e0c9-499c-b8b7-40a371dfa626 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:43.503707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3744fda1-c6a9-4d75-ad33-ba1b6ac1bdf4 req-d5790a85-e0c9-499c-b8b7-40a371dfa626 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:43.504358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3744fda1-c6a9-4d75-ad33-ba1b6ac1bdf4 req-d5790a85-e0c9-499c-b8b7-40a371dfa626 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:43.526666 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-3744fda1-c6a9-4d75-ad33-ba1b6ac1bdf4 req-d5790a85-e0c9-499c-b8b7-40a371dfa626 service nova] Creating event network-changed:82424a3c-a6fe-433b-8e79-c404fe9e85b7 for instance e6e6d612-1196-4700-b893-d355ca237e7f on n-h2-850468-16 Aug 23 18:16:43.537779 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-3744fda1-c6a9-4d75-ad33-ba1b6ac1bdf4 req-d5790a85-e0c9-499c-b8b7-40a371dfa626 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057976 Aug 23 18:16:43.539211 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2494/5099] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:43.674770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-54ef9721-1080-41a1-aa74-2dbf51134009 req-fd89705a-a0ca-43ab-b49e-afcc9df3bea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea", "tag": "64835173-71b3-4c34-8178-c06ca99dd52b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:43.722043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-54ef9721-1080-41a1-aa74-2dbf51134009 req-fd89705a-a0ca-43ab-b49e-afcc9df3bea0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:43.722572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-54ef9721-1080-41a1-aa74-2dbf51134009 req-fd89705a-a0ca-43ab-b49e-afcc9df3bea0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:43.722998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-54ef9721-1080-41a1-aa74-2dbf51134009 req-fd89705a-a0ca-43ab-b49e-afcc9df3bea0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:43.738487 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-54ef9721-1080-41a1-aa74-2dbf51134009 req-fd89705a-a0ca-43ab-b49e-afcc9df3bea0 service nova] Creating event network-changed:64835173-71b3-4c34-8178-c06ca99dd52b for instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea on n-h1-850468-16 Aug 23 18:16:43.746039 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-54ef9721-1080-41a1-aa74-2dbf51134009 req-fd89705a-a0ca-43ab-b49e-afcc9df3bea0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078970 Aug 23 18:16:43.746840 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2495/5100] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:43.780340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c62bbaa2-33e1-4636-8fdb-4c4de002ac9f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:43.791213 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c62bbaa2-33e1-4636-8fdb-4c4de002ac9f tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.775849 Aug 23 18:16:43.792827 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2606/5101] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:43 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:43.817818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1afdc050-cc12-4fba-b1b2-81acf1cea180 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:43.821313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1afdc050-cc12-4fba-b1b2-81acf1cea180 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:43.828184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1afdc050-cc12-4fba-b1b2-81acf1cea180 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:43.828919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1afdc050-cc12-4fba-b1b2-81acf1cea180 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:43.829578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1afdc050-cc12-4fba-b1b2-81acf1cea180 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:43.830821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1afdc050-cc12-4fba-b1b2-81acf1cea180 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:43.832124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1afdc050-cc12-4fba-b1b2-81acf1cea180 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:43.832844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1afdc050-cc12-4fba-b1b2-81acf1cea180 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:44.014088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f0292110-1e15-4ce8-ae5d-6a4dcbe43cc3 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:44.018427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f0292110-1e15-4ce8-ae5d-6a4dcbe43cc3 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:44.031627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0292110-1e15-4ce8-ae5d-6a4dcbe43cc3 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:44.033906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0292110-1e15-4ce8-ae5d-6a4dcbe43cc3 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:44.035263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0292110-1e15-4ce8-ae5d-6a4dcbe43cc3 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:44.036924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0292110-1e15-4ce8-ae5d-6a4dcbe43cc3 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:44.037794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0292110-1e15-4ce8-ae5d-6a4dcbe43cc3 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:44.040728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0292110-1e15-4ce8-ae5d-6a4dcbe43cc3 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:44.143792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1afdc050-cc12-4fba-b1b2-81acf1cea180 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:44.156296 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1afdc050-cc12-4fba-b1b2-81acf1cea180 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.343777 Aug 23 18:16:44.156891 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2496/5102] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:43 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:44.171615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b4973c8e-a98d-4db5-b30e-4decdd73e839 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:44.174438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b4973c8e-a98d-4db5-b30e-4decdd73e839 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:44.187487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4973c8e-a98d-4db5-b30e-4decdd73e839 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:44.187994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4973c8e-a98d-4db5-b30e-4decdd73e839 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:44.188440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4973c8e-a98d-4db5-b30e-4decdd73e839 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:44.189163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4973c8e-a98d-4db5-b30e-4decdd73e839 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:44.189705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4973c8e-a98d-4db5-b30e-4decdd73e839 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:44.190148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4973c8e-a98d-4db5-b30e-4decdd73e839 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:44.431640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b4973c8e-a98d-4db5-b30e-4decdd73e839 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:44.447231 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b4973c8e-a98d-4db5-b30e-4decdd73e839 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1322 microversion: 2.1 time: 0.285448 Aug 23 18:16:44.448186 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2497/5103] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:44 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1322 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:44.453353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-14597d31-c65b-4911-8849-96455a03b82c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:44.454518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-14597d31-c65b-4911-8849-96455a03b82c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:44.463489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14597d31-c65b-4911-8849-96455a03b82c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:44.464340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14597d31-c65b-4911-8849-96455a03b82c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:44.464963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14597d31-c65b-4911-8849-96455a03b82c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:44.466232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14597d31-c65b-4911-8849-96455a03b82c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:44.468360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14597d31-c65b-4911-8849-96455a03b82c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:44.470002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14597d31-c65b-4911-8849-96455a03b82c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:44.507617 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-14597d31-c65b-4911-8849-96455a03b82c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Cannot 'unpause' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-14597d31-c65b-4911-8849-96455a03b82c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action HTTP/1.1 Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 15 Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: {"unpause": {}} Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: exception: Cannot 'unpause' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f1cad0fb-87b4-403c-9881-64ce147502fd', 'body': {'unpause': {}}} Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1cad0fb-87b4-403c-9881-64ce147502fd in vm_state active. Cannot unpause while the instance is in this state. Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:44.509734 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:44.515302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:44.515302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:44.515302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:44.515302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:16:44.515302 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:44.515302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-14597d31-c65b-4911-8849-96455a03b82c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 409 to user: Cannot 'unpause' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:44.515302 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-14597d31-c65b-4911-8849-96455a03b82c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 409 len: 145 microversion: 2.1 time: 0.063574 Aug 23 18:16:44.515302 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2498/5104] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:16:44 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 145 bytes in 66 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:16:44.520173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b461d241-1b1f-4581-b29d-6686c9fd8b4d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:44.520819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b461d241-1b1f-4581-b29d-6686c9fd8b4d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:44.529449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b461d241-1b1f-4581-b29d-6686c9fd8b4d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:44.529957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b461d241-1b1f-4581-b29d-6686c9fd8b4d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:44.530398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b461d241-1b1f-4581-b29d-6686c9fd8b4d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:44.531553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b461d241-1b1f-4581-b29d-6686c9fd8b4d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:44.532176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b461d241-1b1f-4581-b29d-6686c9fd8b4d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:44.533186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b461d241-1b1f-4581-b29d-6686c9fd8b4d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:44.611846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f0292110-1e15-4ce8-ae5d-6a4dcbe43cc3 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf9aa252b34e4cbb7d7e11693a6dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d9218910784aafae3d855cd5ce33f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:44.627893 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f0292110-1e15-4ce8-ae5d-6a4dcbe43cc3 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 200 len: 1313 microversion: 2.1 time: 0.631001 Aug 23 18:16:44.629299 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2607/5105] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:43 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:44.636293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ca849021-b49d-4d98-a7ba-511190005aad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:44.637240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ca849021-b49d-4d98-a7ba-511190005aad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:44.644953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca849021-b49d-4d98-a7ba-511190005aad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:44.646901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca849021-b49d-4d98-a7ba-511190005aad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:44.647580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca849021-b49d-4d98-a7ba-511190005aad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:44.648518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca849021-b49d-4d98-a7ba-511190005aad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:44.651212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca849021-b49d-4d98-a7ba-511190005aad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:44.651738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca849021-b49d-4d98-a7ba-511190005aad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:44.760777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b461d241-1b1f-4581-b29d-6686c9fd8b4d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:44.776320 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b461d241-1b1f-4581-b29d-6686c9fd8b4d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1309 microversion: 2.1 time: 0.260211 Aug 23 18:16:44.776926 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2499/5106] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:44 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1309 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:45.082273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ca849021-b49d-4d98-a7ba-511190005aad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:45.095842 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ca849021-b49d-4d98-a7ba-511190005aad tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.464780 Aug 23 18:16:45.108633 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2608/5107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:44 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:45.121867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-961f9c10-0b0d-4cbb-8c1c-7a1d820d79a3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:45.122853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-961f9c10-0b0d-4cbb-8c1c-7a1d820d79a3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:45.130916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-961f9c10-0b0d-4cbb-8c1c-7a1d820d79a3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:45.131637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-961f9c10-0b0d-4cbb-8c1c-7a1d820d79a3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:45.132154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-961f9c10-0b0d-4cbb-8c1c-7a1d820d79a3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:45.133075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-961f9c10-0b0d-4cbb-8c1c-7a1d820d79a3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:45.133623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-961f9c10-0b0d-4cbb-8c1c-7a1d820d79a3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:45.134126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-961f9c10-0b0d-4cbb-8c1c-7a1d820d79a3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:45.367971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-961f9c10-0b0d-4cbb-8c1c-7a1d820d79a3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:45.377406 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-961f9c10-0b0d-4cbb-8c1c-7a1d820d79a3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.259408 Aug 23 18:16:45.378600 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2500/5108] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:45 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:45.400230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d269d0a2-b69f-4048-86c0-1c8fa3de0b87 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:45.400823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d269d0a2-b69f-4048-86c0-1c8fa3de0b87 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: fd21da3f-b9e1-41be-996a-1f5ce29ce940] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:45.406882 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-d269d0a2-b69f-4048-86c0-1c8fa3de0b87 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance fd21da3f-b9e1-41be-996a-1f5ce29ce940 could not be found. Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d269d0a2-b69f-4048-86c0-1c8fa3de0b87 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/fd21da3f-b9e1-41be-996a-1f5ce29ce940/action HTTP/1.1 Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 18 Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: {"unshelve": null} Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance fd21da3f-b9e1-41be-996a-1f5ce29ce940 could not be found. Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'fd21da3f-b9e1-41be-996a-1f5ce29ce940', 'body': {'unshelve': None}} Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd21da3f-b9e1-41be-996a-1f5ce29ce940 could not be found. Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd21da3f-b9e1-41be-996a-1f5ce29ce940 could not be found. Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:45.408506 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:45.413848 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:45.413848 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:45.413848 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:45.413848 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:45.413848 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:45.413848 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:45.413848 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd21da3f-b9e1-41be-996a-1f5ce29ce940 could not be found. Aug 23 18:16:45.413848 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:45.413848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d269d0a2-b69f-4048-86c0-1c8fa3de0b87 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance fd21da3f-b9e1-41be-996a-1f5ce29ce940 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:45.413848 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d269d0a2-b69f-4048-86c0-1c8fa3de0b87 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/fd21da3f-b9e1-41be-996a-1f5ce29ce940/action" status: 404 len: 111 microversion: 2.1 time: 0.014181 Aug 23 18:16:45.418780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-da3f5bfc-41ee-42f8-94dd-00ef62aad5bf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:45.419406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-da3f5bfc-41ee-42f8-94dd-00ef62aad5bf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:45.423170 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2609/5109] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:16:45 2022] POST /compute/v2.1/servers/fd21da3f-b9e1-41be-996a-1f5ce29ce940/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:45.431267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da3f5bfc-41ee-42f8-94dd-00ef62aad5bf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:45.431772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da3f5bfc-41ee-42f8-94dd-00ef62aad5bf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:45.432208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da3f5bfc-41ee-42f8-94dd-00ef62aad5bf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:45.432963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da3f5bfc-41ee-42f8-94dd-00ef62aad5bf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:45.433422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da3f5bfc-41ee-42f8-94dd-00ef62aad5bf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:45.433845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da3f5bfc-41ee-42f8-94dd-00ef62aad5bf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:45.477743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-25b96e05-8a1a-4e39-947d-c3a6167d5462 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:45.478114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-25b96e05-8a1a-4e39-947d-c3a6167d5462 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:45.498759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25b96e05-8a1a-4e39-947d-c3a6167d5462 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:45.499561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25b96e05-8a1a-4e39-947d-c3a6167d5462 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:45.500198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25b96e05-8a1a-4e39-947d-c3a6167d5462 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:45.501114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25b96e05-8a1a-4e39-947d-c3a6167d5462 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:45.501756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25b96e05-8a1a-4e39-947d-c3a6167d5462 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:45.502951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25b96e05-8a1a-4e39-947d-c3a6167d5462 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:45.669309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-da3f5bfc-41ee-42f8-94dd-00ef62aad5bf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:45.679004 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-da3f5bfc-41ee-42f8-94dd-00ef62aad5bf tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.263981 Aug 23 18:16:45.679592 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2501/5110] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:45 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:45.684817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b595683b-1579-4c90-bd88-0e144f784fb9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:45.685426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b595683b-1579-4c90-bd88-0e144f784fb9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:45.692038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b595683b-1579-4c90-bd88-0e144f784fb9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:45.692691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b595683b-1579-4c90-bd88-0e144f784fb9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:45.696177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b595683b-1579-4c90-bd88-0e144f784fb9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:45.697252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b595683b-1579-4c90-bd88-0e144f784fb9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:45.697727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b595683b-1579-4c90-bd88-0e144f784fb9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:45.698162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b595683b-1579-4c90-bd88-0e144f784fb9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:45.783578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-25b96e05-8a1a-4e39-947d-c3a6167d5462 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:45.793376 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-25b96e05-8a1a-4e39-947d-c3a6167d5462 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1322 microversion: 2.1 time: 0.320879 Aug 23 18:16:45.807345 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2610/5111] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:45 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:45.813500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-10d25316-fb3c-4357-b00d-c1c895fe6000 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:45.814174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-10d25316-fb3c-4357-b00d-c1c895fe6000 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:45.822581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10d25316-fb3c-4357-b00d-c1c895fe6000 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:45.823325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10d25316-fb3c-4357-b00d-c1c895fe6000 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:45.824406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10d25316-fb3c-4357-b00d-c1c895fe6000 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:45.825168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10d25316-fb3c-4357-b00d-c1c895fe6000 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:45.825631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10d25316-fb3c-4357-b00d-c1c895fe6000 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:45.826059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-10d25316-fb3c-4357-b00d-c1c895fe6000 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:45.992965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b595683b-1579-4c90-bd88-0e144f784fb9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf9aa252b34e4cbb7d7e11693a6dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d9218910784aafae3d855cd5ce33f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:46.015735 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b595683b-1579-4c90-bd88-0e144f784fb9 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 200 len: 1313 microversion: 2.1 time: 0.334516 Aug 23 18:16:46.017518 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2502/5112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:45 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 1313 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:46.022994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-88d8ef47-2189-4711-8484-b2c4771a3662 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:46.024116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-88d8ef47-2189-4711-8484-b2c4771a3662 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:46.032306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d8ef47-2189-4711-8484-b2c4771a3662 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:46.033007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d8ef47-2189-4711-8484-b2c4771a3662 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:46.033656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d8ef47-2189-4711-8484-b2c4771a3662 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:46.033820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-10d25316-fb3c-4357-b00d-c1c895fe6000 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:46.034645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d8ef47-2189-4711-8484-b2c4771a3662 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:46.035138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d8ef47-2189-4711-8484-b2c4771a3662 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:46.035568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d8ef47-2189-4711-8484-b2c4771a3662 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:46.044089 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-10d25316-fb3c-4357-b00d-c1c895fe6000 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.235478 Aug 23 18:16:46.045248 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2611/5113] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:45 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:46.072450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-035e7247-0096-4d1d-a3b3-f612ce11f3e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:46.073721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-035e7247-0096-4d1d-a3b3-f612ce11f3e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:46.080527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-035e7247-0096-4d1d-a3b3-f612ce11f3e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:46.081116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-035e7247-0096-4d1d-a3b3-f612ce11f3e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:46.081683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-035e7247-0096-4d1d-a3b3-f612ce11f3e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:46.082598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-035e7247-0096-4d1d-a3b3-f612ce11f3e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:46.083180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-035e7247-0096-4d1d-a3b3-f612ce11f3e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:46.084156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-035e7247-0096-4d1d-a3b3-f612ce11f3e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:46.089608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:46.128164 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-035e7247-0096-4d1d-a3b3-f612ce11f3e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Cannot 'unshelve' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-035e7247-0096-4d1d-a3b3-f612ce11f3e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action HTTP/1.1 Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 18 Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: {"unshelve": null} Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: exception: Cannot 'unshelve' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f1cad0fb-87b4-403c-9881-64ce147502fd', 'body': {'unshelve': None}} Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance f1cad0fb-87b4-403c-9881-64ce147502fd in vm_state active. Cannot unshelve while the instance is in this state. Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 23 18:16:46.130095 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 23 18:16:46.136069 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:16:46.136069 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:46.136069 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:46.136069 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:46.136069 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:46.136069 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:46.136069 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:46.136069 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:46.136069 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:46.136069 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active Aug 23 18:16:46.136069 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:46.138508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-035e7247-0096-4d1d-a3b3-f612ce11f3e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 409 to user: Cannot 'unshelve' instance f1cad0fb-87b4-403c-9881-64ce147502fd while it is in vm_state active {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:46.139720 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-035e7247-0096-4d1d-a3b3-f612ce11f3e7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action" status: 409 len: 146 microversion: 2.1 time: 0.076260 Aug 23 18:16:46.140579 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2612/5114] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:16:46 2022] POST /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd/action => generated 146 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 23 18:16:46.151794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2aaca3b9-5828-4523-9d92-9698cf7f7d49 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:46.152424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2aaca3b9-5828-4523-9d92-9698cf7f7d49 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:46.160217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aaca3b9-5828-4523-9d92-9698cf7f7d49 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:46.160716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aaca3b9-5828-4523-9d92-9698cf7f7d49 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:46.161267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aaca3b9-5828-4523-9d92-9698cf7f7d49 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:46.163161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aaca3b9-5828-4523-9d92-9698cf7f7d49 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:46.163743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aaca3b9-5828-4523-9d92-9698cf7f7d49 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:46.164355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aaca3b9-5828-4523-9d92-9698cf7f7d49 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:46.269135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-88d8ef47-2189-4711-8484-b2c4771a3662 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:46.287400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=24 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:46.294795 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-88d8ef47-2189-4711-8484-b2c4771a3662 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1309 microversion: 2.1 time: 0.272783 Aug 23 18:16:46.296295 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2503/5115] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:46 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1309 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:46.329326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-15c3e119-95db-4d7e-a9ba-9403a8d888a6 req-0ded71c2-8aed-4562-bd91-ef721bffaf59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5480cb09-9eb4-48d7-8bbe-88de71af3b07", "name": "network-vif-plugged", "status": "completed", "tag": "ff840925-6785-4a00-a68f-0086858b81eb"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:46.346229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-15c3e119-95db-4d7e-a9ba-9403a8d888a6 req-0ded71c2-8aed-4562-bd91-ef721bffaf59 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:46.347159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-15c3e119-95db-4d7e-a9ba-9403a8d888a6 req-0ded71c2-8aed-4562-bd91-ef721bffaf59 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:46.348005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-15c3e119-95db-4d7e-a9ba-9403a8d888a6 req-0ded71c2-8aed-4562-bd91-ef721bffaf59 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:46.364549 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-15c3e119-95db-4d7e-a9ba-9403a8d888a6 req-0ded71c2-8aed-4562-bd91-ef721bffaf59 service nova] Creating event network-vif-plugged:ff840925-6785-4a00-a68f-0086858b81eb for instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 on n-h2-850468-16 Aug 23 18:16:46.372847 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-15c3e119-95db-4d7e-a9ba-9403a8d888a6 req-0ded71c2-8aed-4562-bd91-ef721bffaf59 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047621 Aug 23 18:16:46.374207 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2504/5116] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:46.475014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2aaca3b9-5828-4523-9d92-9698cf7f7d49 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:46.484429 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2aaca3b9-5828-4523-9d92-9698cf7f7d49 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.338710 Aug 23 18:16:46.485295 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2613/5117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:46 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:46.509130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2fbcac77-1f7d-4063-85a7-05c815c33319 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:46.513316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2fbcac77-1f7d-4063-85a7-05c815c33319 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:46.523675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fbcac77-1f7d-4063-85a7-05c815c33319 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:46.524712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fbcac77-1f7d-4063-85a7-05c815c33319 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:46.537156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fbcac77-1f7d-4063-85a7-05c815c33319 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:46.538742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fbcac77-1f7d-4063-85a7-05c815c33319 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:46.539530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fbcac77-1f7d-4063-85a7-05c815c33319 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:46.540056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fbcac77-1f7d-4063-85a7-05c815c33319 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:46.815947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f20c7c7-3bef-418d-9f90-668297c17e7c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:46.816661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8f20c7c7-3bef-418d-9f90-668297c17e7c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:46.838411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f20c7c7-3bef-418d-9f90-668297c17e7c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:46.839025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f20c7c7-3bef-418d-9f90-668297c17e7c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:46.839596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f20c7c7-3bef-418d-9f90-668297c17e7c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:46.840749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f20c7c7-3bef-418d-9f90-668297c17e7c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:46.841388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f20c7c7-3bef-418d-9f90-668297c17e7c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:46.841823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f20c7c7-3bef-418d-9f90-668297c17e7c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:47.026510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2fbcac77-1f7d-4063-85a7-05c815c33319 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:47.094339 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2fbcac77-1f7d-4063-85a7-05c815c33319 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.586704 Aug 23 18:16:47.096293 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2505/5118] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:46 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:47.104475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0769670b-8e7a-472c-9b0a-c1bbd516cfd1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:47.105435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0769670b-8e7a-472c-9b0a-c1bbd516cfd1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:47.122028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0769670b-8e7a-472c-9b0a-c1bbd516cfd1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:47.122926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0769670b-8e7a-472c-9b0a-c1bbd516cfd1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:47.123686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0769670b-8e7a-472c-9b0a-c1bbd516cfd1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:47.125023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0769670b-8e7a-472c-9b0a-c1bbd516cfd1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:47.125836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0769670b-8e7a-472c-9b0a-c1bbd516cfd1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:47.126494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0769670b-8e7a-472c-9b0a-c1bbd516cfd1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:47.234029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8f20c7c7-3bef-418d-9f90-668297c17e7c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:47.243163 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f20c7c7-3bef-418d-9f90-668297c17e7c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1322 microversion: 2.1 time: 0.431849 Aug 23 18:16:47.258653 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2614/5119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:46 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1322 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:47.265381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f53b40a-0d87-42e1-abb9-1dfed099db6e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-65096999_updated"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:47.268040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5f53b40a-0d87-42e1-abb9-1dfed099db6e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 23a9f49d-c9ee-4c4e-96b5-6be46572ff29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:47.274514 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-5f53b40a-0d87-42e1-abb9-1dfed099db6e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 23a9f49d-c9ee-4c4e-96b5-6be46572ff29 could not be found. Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f53b40a-0d87-42e1-abb9-1dfed099db6e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: request: PUT /compute/v2.1/servers/23a9f49d-c9ee-4c4e-96b5-6be46572ff29 HTTP/1.1 Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 79 Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-65096999_updated"}} Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 23a9f49d-c9ee-4c4e-96b5-6be46572ff29 could not be found. Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '23a9f49d-c9ee-4c4e-96b5-6be46572ff29', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-65096999_updated'}}} Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23a9f49d-c9ee-4c4e-96b5-6be46572ff29 could not be found. Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Aug 23 18:16:47.276554 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23a9f49d-c9ee-4c4e-96b5-6be46572ff29 could not be found. Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23a9f49d-c9ee-4c4e-96b5-6be46572ff29 could not be found. Aug 23 18:16:47.281725 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:47.283621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f53b40a-0d87-42e1-abb9-1dfed099db6e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 23a9f49d-c9ee-4c4e-96b5-6be46572ff29 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:47.284511 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5f53b40a-0d87-42e1-abb9-1dfed099db6e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "PUT /compute/v2.1/servers/23a9f49d-c9ee-4c4e-96b5-6be46572ff29" status: 404 len: 111 microversion: 2.1 time: 0.024796 Aug 23 18:16:47.285591 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2615/5120] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Aug 23 18:16:47 2022] PUT /compute/v2.1/servers/23a9f49d-c9ee-4c4e-96b5-6be46572ff29 => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:47.294913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-421f2c0b-06c2-4855-883c-fd8c9ac640d4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:47.295572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-421f2c0b-06c2-4855-883c-fd8c9ac640d4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:47.303646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-421f2c0b-06c2-4855-883c-fd8c9ac640d4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:47.304135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-421f2c0b-06c2-4855-883c-fd8c9ac640d4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:47.304595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-421f2c0b-06c2-4855-883c-fd8c9ac640d4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:47.305424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-421f2c0b-06c2-4855-883c-fd8c9ac640d4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:47.305876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-421f2c0b-06c2-4855-883c-fd8c9ac640d4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:47.306303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-421f2c0b-06c2-4855-883c-fd8c9ac640d4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:47.528121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0769670b-8e7a-472c-9b0a-c1bbd516cfd1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf9aa252b34e4cbb7d7e11693a6dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d9218910784aafae3d855cd5ce33f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:47.535977 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0769670b-8e7a-472c-9b0a-c1bbd516cfd1 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 200 len: 1313 microversion: 2.1 time: 0.438428 Aug 23 18:16:47.536570 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2506/5121] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:47 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 1313 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:47.543575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e756dc85-8712-445c-919c-97389fe6f0e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:47.544437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e756dc85-8712-445c-919c-97389fe6f0e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:47.550616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e756dc85-8712-445c-919c-97389fe6f0e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:47.551349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e756dc85-8712-445c-919c-97389fe6f0e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:47.551966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e756dc85-8712-445c-919c-97389fe6f0e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:47.553382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e756dc85-8712-445c-919c-97389fe6f0e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:47.554057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e756dc85-8712-445c-919c-97389fe6f0e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:47.554699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e756dc85-8712-445c-919c-97389fe6f0e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:47.645559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-421f2c0b-06c2-4855-883c-fd8c9ac640d4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:47.658827 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-421f2c0b-06c2-4855-883c-fd8c9ac640d4 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.367797 Aug 23 18:16:47.668351 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2616/5122] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:47 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:47.690592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b14d4b09-55c0-4a15-a389-bf7bb175a25c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:47.691783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b14d4b09-55c0-4a15-a389-bf7bb175a25c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:47.699507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b14d4b09-55c0-4a15-a389-bf7bb175a25c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:47.700402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b14d4b09-55c0-4a15-a389-bf7bb175a25c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:47.701037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b14d4b09-55c0-4a15-a389-bf7bb175a25c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:47.701954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b14d4b09-55c0-4a15-a389-bf7bb175a25c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:47.702727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b14d4b09-55c0-4a15-a389-bf7bb175a25c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:47.703378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b14d4b09-55c0-4a15-a389-bf7bb175a25c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:47.900026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e756dc85-8712-445c-919c-97389fe6f0e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:47.917089 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e756dc85-8712-445c-919c-97389fe6f0e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1309 microversion: 2.1 time: 0.378146 Aug 23 18:16:47.918007 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2507/5123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:47 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1309 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:47.998933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b14d4b09-55c0-4a15-a389-bf7bb175a25c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:48.016637 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b14d4b09-55c0-4a15-a389-bf7bb175a25c tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.330953 Aug 23 18:16:48.017557 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2617/5124] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:47 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:48.041647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7192f5dd-1387-4e1a-b3aa-82dcd8fe4075 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7192f5dd-1387-4e1a-b3aa-82dcd8fe4075 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: request: PUT /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd HTTP/1.1 Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 280 Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f1cad0fb-87b4-403c-9881-64ce147502fd', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.046237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7192f5dd-1387-4e1a-b3aa-82dcd8fe4075 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:48.051001 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7192f5dd-1387-4e1a-b3aa-82dcd8fe4075 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "PUT /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 400 len: 619 microversion: 2.1 time: 0.011060 Aug 23 18:16:48.054854 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2508/5125] 10.222.0.61 () {60 vars in 1257 bytes} [Tue Aug 23 18:16:48 2022] PUT /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 619 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:16:48.060904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-06e1600e-8c8d-40e0-b908-4e09c39f5ce8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:48.061726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-06e1600e-8c8d-40e0-b908-4e09c39f5ce8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:48.064033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:48.075744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06e1600e-8c8d-40e0-b908-4e09c39f5ce8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:48.075744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06e1600e-8c8d-40e0-b908-4e09c39f5ce8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:48.075744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06e1600e-8c8d-40e0-b908-4e09c39f5ce8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:48.075744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06e1600e-8c8d-40e0-b908-4e09c39f5ce8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:48.075744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06e1600e-8c8d-40e0-b908-4e09c39f5ce8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:48.075744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06e1600e-8c8d-40e0-b908-4e09c39f5ce8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:48.267317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-137f7607-442c-49b4-aca1-5c5a36af6f7e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:48.268114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-137f7607-442c-49b4-aca1-5c5a36af6f7e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:48.279538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-137f7607-442c-49b4-aca1-5c5a36af6f7e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:48.280128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-137f7607-442c-49b4-aca1-5c5a36af6f7e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:48.280463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-137f7607-442c-49b4-aca1-5c5a36af6f7e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:48.281404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-137f7607-442c-49b4-aca1-5c5a36af6f7e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:48.282038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-137f7607-442c-49b4-aca1-5c5a36af6f7e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:48.282671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-137f7607-442c-49b4-aca1-5c5a36af6f7e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:48.331355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-06e1600e-8c8d-40e0-b908-4e09c39f5ce8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:48.346048 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-06e1600e-8c8d-40e0-b908-4e09c39f5ce8 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.289459 Aug 23 18:16:48.347240 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2618/5126] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:48 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:48.370348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-82f6c155-af02-4b2e-929f-8ca4a1606f60 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:48.371235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-82f6c155-af02-4b2e-929f-8ca4a1606f60 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:48.377783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82f6c155-af02-4b2e-929f-8ca4a1606f60 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:48.378658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82f6c155-af02-4b2e-929f-8ca4a1606f60 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:48.379359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82f6c155-af02-4b2e-929f-8ca4a1606f60 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:48.380428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82f6c155-af02-4b2e-929f-8ca4a1606f60 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:48.381522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82f6c155-af02-4b2e-929f-8ca4a1606f60 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:48.382063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82f6c155-af02-4b2e-929f-8ca4a1606f60 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:48.434390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=48 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:48.487780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-137f7607-442c-49b4-aca1-5c5a36af6f7e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:48.497843 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-137f7607-442c-49b4-aca1-5c5a36af6f7e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1322 microversion: 2.1 time: 0.237231 Aug 23 18:16:48.499108 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2509/5127] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:48 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1322 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:48.565578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c5103596-6ba0-4a9e-838e-7509dceca6c0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:48.567021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c5103596-6ba0-4a9e-838e-7509dceca6c0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:48.582348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5103596-6ba0-4a9e-838e-7509dceca6c0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:48.583123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5103596-6ba0-4a9e-838e-7509dceca6c0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:48.584576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5103596-6ba0-4a9e-838e-7509dceca6c0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:48.585762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5103596-6ba0-4a9e-838e-7509dceca6c0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:48.586848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5103596-6ba0-4a9e-838e-7509dceca6c0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:48.589141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5103596-6ba0-4a9e-838e-7509dceca6c0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:48.612392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-82f6c155-af02-4b2e-929f-8ca4a1606f60 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:48.635397 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-82f6c155-af02-4b2e-929f-8ca4a1606f60 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.269286 Aug 23 18:16:48.636393 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2619/5128] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:48 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:48.658054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6ca1bc26-80d3-4003-a580-8b16df988f21 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6ca1bc26-80d3-4003-a580-8b16df988f21 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: request: PUT /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd HTTP/1.1 Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 24 Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": ""}} Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute name. Value: . '' is too short Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f1cad0fb-87b4-403c-9881-64ce147502fd', 'body': {'server': {'name': ''}}} Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi '' Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:16:48.662429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6ca1bc26-80d3-4003-a580-8b16df988f21 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6ca1bc26-80d3-4003-a580-8b16df988f21 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "PUT /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 400 len: 108 microversion: 2.1 time: 0.012064 Aug 23 18:16:48.671570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2620/5129] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Aug 23 18:16:48 2022] PUT /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:16:48.683583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d5b9721a-82f9-47d6-8f10-869e33e67358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:48.684119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d5b9721a-82f9-47d6-8f10-869e33e67358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:48.696878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5b9721a-82f9-47d6-8f10-869e33e67358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:48.697382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5b9721a-82f9-47d6-8f10-869e33e67358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:48.697828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5b9721a-82f9-47d6-8f10-869e33e67358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:48.698566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5b9721a-82f9-47d6-8f10-869e33e67358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:48.699030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5b9721a-82f9-47d6-8f10-869e33e67358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:48.699467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5b9721a-82f9-47d6-8f10-869e33e67358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:49.025784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5b9721a-82f9-47d6-8f10-869e33e67358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:49.035419 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d5b9721a-82f9-47d6-8f10-869e33e67358 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1505 microversion: 2.1 time: 0.355631 Aug 23 18:16:49.040324 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2621/5130] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:48 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1505 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:49.045501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b0c4c56d-0ace-4fe3-b6d3-8ff849a159e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:49.046359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b0c4c56d-0ace-4fe3-b6d3-8ff849a159e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:49.068384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0c4c56d-0ace-4fe3-b6d3-8ff849a159e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:49.069294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0c4c56d-0ace-4fe3-b6d3-8ff849a159e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:49.070088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0c4c56d-0ace-4fe3-b6d3-8ff849a159e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:49.071615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0c4c56d-0ace-4fe3-b6d3-8ff849a159e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:49.073418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0c4c56d-0ace-4fe3-b6d3-8ff849a159e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:49.074034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0c4c56d-0ace-4fe3-b6d3-8ff849a159e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:49.182414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c5103596-6ba0-4a9e-838e-7509dceca6c0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf9aa252b34e4cbb7d7e11693a6dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d9218910784aafae3d855cd5ce33f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:49.191951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:49.209877 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c5103596-6ba0-4a9e-838e-7509dceca6c0 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 200 len: 1313 microversion: 2.1 time: 0.651053 Aug 23 18:16:49.210481 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2510/5131] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:48 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 1313 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:49.310577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-bc432f02-524b-4779-ba7c-0dfe0e7c489f req-8ae5a490-74e6-4dcd-9b7b-8fef6e3adf3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea", "name": "network-vif-plugged", "status": "completed", "tag": "64835173-71b3-4c34-8178-c06ca99dd52b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:49.322901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bc432f02-524b-4779-ba7c-0dfe0e7c489f req-8ae5a490-74e6-4dcd-9b7b-8fef6e3adf3e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:49.323529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bc432f02-524b-4779-ba7c-0dfe0e7c489f req-8ae5a490-74e6-4dcd-9b7b-8fef6e3adf3e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:49.323977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bc432f02-524b-4779-ba7c-0dfe0e7c489f req-8ae5a490-74e6-4dcd-9b7b-8fef6e3adf3e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:49.351508 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-bc432f02-524b-4779-ba7c-0dfe0e7c489f req-8ae5a490-74e6-4dcd-9b7b-8fef6e3adf3e service nova] Creating event network-vif-plugged:64835173-71b3-4c34-8178-c06ca99dd52b for instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea on n-h1-850468-16 Aug 23 18:16:49.357568 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-bc432f02-524b-4779-ba7c-0dfe0e7c489f req-8ae5a490-74e6-4dcd-9b7b-8fef6e3adf3e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055766 Aug 23 18:16:49.358433 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2511/5132] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:16:49.524029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e6346e38-a34b-41ab-8783-f8f8085f0473 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:49.524754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e6346e38-a34b-41ab-8783-f8f8085f0473 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:49.539639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6346e38-a34b-41ab-8783-f8f8085f0473 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:49.542246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6346e38-a34b-41ab-8783-f8f8085f0473 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:49.544008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6346e38-a34b-41ab-8783-f8f8085f0473 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:49.546070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6346e38-a34b-41ab-8783-f8f8085f0473 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:49.548700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6346e38-a34b-41ab-8783-f8f8085f0473 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:49.549156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6346e38-a34b-41ab-8783-f8f8085f0473 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:49.725474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b0c4c56d-0ace-4fe3-b6d3-8ff849a159e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:49.738943 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b0c4c56d-0ace-4fe3-b6d3-8ff849a159e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1309 microversion: 2.1 time: 0.697094 Aug 23 18:16:49.754879 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2622/5133] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:49 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1309 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:49.820702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e6346e38-a34b-41ab-8783-f8f8085f0473 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:49.832282 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e6346e38-a34b-41ab-8783-f8f8085f0473 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1516 microversion: 2.1 time: 0.315330 Aug 23 18:16:49.832870 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2512/5134] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:49 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1516 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:49.855494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-11199adc-f848-40c5-8860-84d051b2b9ed tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:49.858866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-11199adc-f848-40c5-8860-84d051b2b9ed tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:49.868185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11199adc-f848-40c5-8860-84d051b2b9ed tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:49.868762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11199adc-f848-40c5-8860-84d051b2b9ed tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:49.869244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11199adc-f848-40c5-8860-84d051b2b9ed tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:49.870090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11199adc-f848-40c5-8860-84d051b2b9ed tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:49.870590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11199adc-f848-40c5-8860-84d051b2b9ed tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:49.871037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11199adc-f848-40c5-8860-84d051b2b9ed tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:49.901476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-11199adc-f848-40c5-8860-84d051b2b9ed tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lazy-loading 'flavor' on Instance uuid 5480cb09-9eb4-48d7-8bbe-88de71af3b07 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:16:49.998512 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-11199adc-f848-40c5-8860-84d051b2b9ed tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "POST /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07/action" status: 200 len: 32 microversion: 2.1 time: 0.147850 Aug 23 18:16:49.999724 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2623/5135] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:16:49 2022] POST /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07/action => generated 32 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:16:50.009265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2f87b857-de77-4de9-b804-e0f9fe3f30ef tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:50.009898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2f87b857-de77-4de9-b804-e0f9fe3f30ef tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:50.016976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f87b857-de77-4de9-b804-e0f9fe3f30ef tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:50.018049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f87b857-de77-4de9-b804-e0f9fe3f30ef tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:50.019244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f87b857-de77-4de9-b804-e0f9fe3f30ef tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:50.020158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f87b857-de77-4de9-b804-e0f9fe3f30ef tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:50.020800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f87b857-de77-4de9-b804-e0f9fe3f30ef tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:50.022153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2f87b857-de77-4de9-b804-e0f9fe3f30ef tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:50.198210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2f87b857-de77-4de9-b804-e0f9fe3f30ef tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:50.219495 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2f87b857-de77-4de9-b804-e0f9fe3f30ef tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.213307 Aug 23 18:16:50.234570 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2513/5136] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:50 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:50.234797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3d0bcdd-16d2-4963-952c-08f96ae59104 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:50.234987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d3d0bcdd-16d2-4963-952c-08f96ae59104 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:50.248766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3d0bcdd-16d2-4963-952c-08f96ae59104 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:50.249276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3d0bcdd-16d2-4963-952c-08f96ae59104 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:50.249720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3d0bcdd-16d2-4963-952c-08f96ae59104 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:50.250699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3d0bcdd-16d2-4963-952c-08f96ae59104 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:50.251328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3d0bcdd-16d2-4963-952c-08f96ae59104 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:50.253393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3d0bcdd-16d2-4963-952c-08f96ae59104 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:50.733874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d3d0bcdd-16d2-4963-952c-08f96ae59104 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf9aa252b34e4cbb7d7e11693a6dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d9218910784aafae3d855cd5ce33f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:50.745263 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d3d0bcdd-16d2-4963-952c-08f96ae59104 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 200 len: 1313 microversion: 2.1 time: 0.516534 Aug 23 18:16:50.746531 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2624/5137] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:50 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 1313 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:50.765428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-87ee0e8d-602b-4f60-8b23-26f37ad2b698 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:50.766054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-87ee0e8d-602b-4f60-8b23-26f37ad2b698 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:50.775257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87ee0e8d-602b-4f60-8b23-26f37ad2b698 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:50.775733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87ee0e8d-602b-4f60-8b23-26f37ad2b698 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:50.776186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87ee0e8d-602b-4f60-8b23-26f37ad2b698 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:50.776905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87ee0e8d-602b-4f60-8b23-26f37ad2b698 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:50.777371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87ee0e8d-602b-4f60-8b23-26f37ad2b698 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:50.777808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87ee0e8d-602b-4f60-8b23-26f37ad2b698 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:50.973482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-87ee0e8d-602b-4f60-8b23-26f37ad2b698 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:50.983811 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-87ee0e8d-602b-4f60-8b23-26f37ad2b698 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1309 microversion: 2.1 time: 0.222330 Aug 23 18:16:50.998245 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2514/5138] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:50 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1309 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:51.245089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6f310ea8-6e9e-444a-be50-9f6bcac57cd0 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:51.246109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6f310ea8-6e9e-444a-be50-9f6bcac57cd0 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:51.253602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f310ea8-6e9e-444a-be50-9f6bcac57cd0 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:51.254277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f310ea8-6e9e-444a-be50-9f6bcac57cd0 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:51.254743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f310ea8-6e9e-444a-be50-9f6bcac57cd0 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:51.255666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f310ea8-6e9e-444a-be50-9f6bcac57cd0 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:51.256115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f310ea8-6e9e-444a-be50-9f6bcac57cd0 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:51.256714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6f310ea8-6e9e-444a-be50-9f6bcac57cd0 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:51.446680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6f310ea8-6e9e-444a-be50-9f6bcac57cd0 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:51.466484 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6f310ea8-6e9e-444a-be50-9f6bcac57cd0 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.215885 Aug 23 18:16:51.468548 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2625/5139] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:51 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:51.771853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-27e52cf1-6c81-4a50-92ff-c249d7eb7bf6 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:51.775208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-27e52cf1-6c81-4a50-92ff-c249d7eb7bf6 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:51.785939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:51.790143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27e52cf1-6c81-4a50-92ff-c249d7eb7bf6 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:51.791096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27e52cf1-6c81-4a50-92ff-c249d7eb7bf6 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:51.791691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27e52cf1-6c81-4a50-92ff-c249d7eb7bf6 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:51.792521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27e52cf1-6c81-4a50-92ff-c249d7eb7bf6 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:51.793174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27e52cf1-6c81-4a50-92ff-c249d7eb7bf6 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:51.793816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27e52cf1-6c81-4a50-92ff-c249d7eb7bf6 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:52.010907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d6c07e67-38d0-40b1-9554-0c4848aebd24 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:52.011691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d6c07e67-38d0-40b1-9554-0c4848aebd24 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:52.020287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6c07e67-38d0-40b1-9554-0c4848aebd24 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:52.021835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6c07e67-38d0-40b1-9554-0c4848aebd24 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:52.022525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6c07e67-38d0-40b1-9554-0c4848aebd24 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:52.023589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6c07e67-38d0-40b1-9554-0c4848aebd24 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:52.024280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6c07e67-38d0-40b1-9554-0c4848aebd24 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:52.024927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6c07e67-38d0-40b1-9554-0c4848aebd24 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:52.038183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-27e52cf1-6c81-4a50-92ff-c249d7eb7bf6 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf9aa252b34e4cbb7d7e11693a6dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d9218910784aafae3d855cd5ce33f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:52.078750 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-27e52cf1-6c81-4a50-92ff-c249d7eb7bf6 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 200 len: 1498 microversion: 2.1 time: 0.309108 Aug 23 18:16:52.080195 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2515/5140] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:51 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 1498 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:52.112656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cfb57617-b6e8-405d-a44d-6b9a7a6a7411 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:52.175140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.compute.server_groups [None req-cfb57617-b6e8-405d-a44d-6b9a7a6a7411 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Querying cell 410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) for 1 instances {{(pid=128807) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 23 18:16:52.178431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfb57617-b6e8-405d-a44d-6b9a7a6a7411 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:52.179304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfb57617-b6e8-405d-a44d-6b9a7a6a7411 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:52.179851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfb57617-b6e8-405d-a44d-6b9a7a6a7411 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:52.227759 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cfb57617-b6e8-405d-a44d-6b9a7a6a7411 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/fbbc029b-637d-4e38-9bed-7b259c43d5e8" status: 200 len: 222 microversion: 2.1 time: 0.126343 Aug 23 18:16:52.229342 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2516/5141] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 18:16:52 2022] GET /compute/v2.1/os-server-groups/fbbc029b-637d-4e38-9bed-7b259c43d5e8 => generated 222 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:52.247586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bb424cea-09ba-47b1-aacd-1f539f2f5a2c tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:52.250685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bb424cea-09ba-47b1-aacd-1f539f2f5a2c tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:52.267603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb424cea-09ba-47b1-aacd-1f539f2f5a2c tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:52.271420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb424cea-09ba-47b1-aacd-1f539f2f5a2c tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:52.274160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb424cea-09ba-47b1-aacd-1f539f2f5a2c tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:52.278393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb424cea-09ba-47b1-aacd-1f539f2f5a2c tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:52.279480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb424cea-09ba-47b1-aacd-1f539f2f5a2c tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:52.280519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb424cea-09ba-47b1-aacd-1f539f2f5a2c tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:52.359005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bb424cea-09ba-47b1-aacd-1f539f2f5a2c tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:16:52.393900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d6c07e67-38d0-40b1-9554-0c4848aebd24 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:52.401956 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d6c07e67-38d0-40b1-9554-0c4848aebd24 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1309 microversion: 2.1 time: 0.398527 Aug 23 18:16:52.402589 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2626/5142] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:52 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1309 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:52.489872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a58c4964-5a37-40ab-bf7d-cb560b3bd1a4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:52.492466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a58c4964-5a37-40ab-bf7d-cb560b3bd1a4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:52.512103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a58c4964-5a37-40ab-bf7d-cb560b3bd1a4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:52.512619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a58c4964-5a37-40ab-bf7d-cb560b3bd1a4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:52.513071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a58c4964-5a37-40ab-bf7d-cb560b3bd1a4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:52.513842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a58c4964-5a37-40ab-bf7d-cb560b3bd1a4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:52.514871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a58c4964-5a37-40ab-bf7d-cb560b3bd1a4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:52.515319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a58c4964-5a37-40ab-bf7d-cb560b3bd1a4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:52.531395 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bb424cea-09ba-47b1-aacd-1f539f2f5a2c tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 204 len: 0 microversion: 2.1 time: 0.294631 Aug 23 18:16:52.532462 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2517/5143] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:16:52 2022] DELETE /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:16:52.549209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-a18351cd-6fdb-4df0-a578-e5eafec8e532 req-94110faa-1daf-4a99-b821-4dc38aea6833 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e6d612-1196-4700-b893-d355ca237e7f", "name": "network-vif-plugged", "status": "completed", "tag": "82424a3c-a6fe-433b-8e79-c404fe9e85b7"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:52.564222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a18351cd-6fdb-4df0-a578-e5eafec8e532 req-94110faa-1daf-4a99-b821-4dc38aea6833 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:52.565242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a18351cd-6fdb-4df0-a578-e5eafec8e532 req-94110faa-1daf-4a99-b821-4dc38aea6833 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:52.565963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a18351cd-6fdb-4df0-a578-e5eafec8e532 req-94110faa-1daf-4a99-b821-4dc38aea6833 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:52.594313 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-a18351cd-6fdb-4df0-a578-e5eafec8e532 req-94110faa-1daf-4a99-b821-4dc38aea6833 service nova] Creating event network-vif-plugged:82424a3c-a6fe-433b-8e79-c404fe9e85b7 for instance e6e6d612-1196-4700-b893-d355ca237e7f on n-h2-850468-16 Aug 23 18:16:52.607119 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-a18351cd-6fdb-4df0-a578-e5eafec8e532 req-94110faa-1daf-4a99-b821-4dc38aea6833 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073020 Aug 23 18:16:52.610225 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2518/5144] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:52.659270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2adb4b70-8a2b-4b95-ab55-09216c8f7a61 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:52.661198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2adb4b70-8a2b-4b95-ab55-09216c8f7a61 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:52.675519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2adb4b70-8a2b-4b95-ab55-09216c8f7a61 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:52.676119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2adb4b70-8a2b-4b95-ab55-09216c8f7a61 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:52.685163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2adb4b70-8a2b-4b95-ab55-09216c8f7a61 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:52.686296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2adb4b70-8a2b-4b95-ab55-09216c8f7a61 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:52.686497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2adb4b70-8a2b-4b95-ab55-09216c8f7a61 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:52.686852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2adb4b70-8a2b-4b95-ab55-09216c8f7a61 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:52.934949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2adb4b70-8a2b-4b95-ab55-09216c8f7a61 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf9aa252b34e4cbb7d7e11693a6dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d9218910784aafae3d855cd5ce33f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:52.952730 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2adb4b70-8a2b-4b95-ab55-09216c8f7a61 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 200 len: 1504 microversion: 2.1 time: 0.340868 Aug 23 18:16:52.953444 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2519/5145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:52 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 1504 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:53.033503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a58c4964-5a37-40ab-bf7d-cb560b3bd1a4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:53.048886 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a58c4964-5a37-40ab-bf7d-cb560b3bd1a4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.563095 Aug 23 18:16:53.049979 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2627/5146] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:52 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:53.432852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83dcba3c-3f8b-4608-b597-458ec3ebe18b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:53.434051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-83dcba3c-3f8b-4608-b597-458ec3ebe18b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:53.458806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83dcba3c-3f8b-4608-b597-458ec3ebe18b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:53.460058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83dcba3c-3f8b-4608-b597-458ec3ebe18b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:53.460809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83dcba3c-3f8b-4608-b597-458ec3ebe18b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:53.462030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83dcba3c-3f8b-4608-b597-458ec3ebe18b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:53.463609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83dcba3c-3f8b-4608-b597-458ec3ebe18b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:53.464544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83dcba3c-3f8b-4608-b597-458ec3ebe18b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:53.734629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-83dcba3c-3f8b-4608-b597-458ec3ebe18b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:53.748051 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-83dcba3c-3f8b-4608-b597-458ec3ebe18b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1309 microversion: 2.1 time: 0.325443 Aug 23 18:16:53.762296 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2520/5147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:53 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1309 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:53.984473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c5405ab3-e5a0-4a24-b400-a9a01a9f3bd4 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:53.986396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c5405ab3-e5a0-4a24-b400-a9a01a9f3bd4 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:54.001023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5405ab3-e5a0-4a24-b400-a9a01a9f3bd4 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:54.001541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5405ab3-e5a0-4a24-b400-a9a01a9f3bd4 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:54.001985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5405ab3-e5a0-4a24-b400-a9a01a9f3bd4 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:54.002718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5405ab3-e5a0-4a24-b400-a9a01a9f3bd4 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:54.003182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5405ab3-e5a0-4a24-b400-a9a01a9f3bd4 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:54.003636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5405ab3-e5a0-4a24-b400-a9a01a9f3bd4 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:54.074957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8f1b58a0-9be9-4a37-a637-47f440691658 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:54.077153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8f1b58a0-9be9-4a37-a637-47f440691658 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:54.088576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f1b58a0-9be9-4a37-a637-47f440691658 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:54.089710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f1b58a0-9be9-4a37-a637-47f440691658 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:54.090756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f1b58a0-9be9-4a37-a637-47f440691658 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:54.091724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f1b58a0-9be9-4a37-a637-47f440691658 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:54.092459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f1b58a0-9be9-4a37-a637-47f440691658 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:54.093277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f1b58a0-9be9-4a37-a637-47f440691658 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:54.377024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8f1b58a0-9be9-4a37-a637-47f440691658 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:54.389153 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8f1b58a0-9be9-4a37-a637-47f440691658 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.321479 Aug 23 18:16:54.391116 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2521/5148] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:54 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:54.648292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c5405ab3-e5a0-4a24-b400-a9a01a9f3bd4 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8fcf9aa252b34e4cbb7d7e11693a6dab', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6d9218910784aafae3d855cd5ce33f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:54.664023 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c5405ab3-e5a0-4a24-b400-a9a01a9f3bd4 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 200 len: 1504 microversion: 2.1 time: 0.686411 Aug 23 18:16:54.664827 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2628/5149] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:53 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 1504 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:54.772685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-951032cb-e30c-4c4e-b442-a5e080e86802 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:54.773847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-951032cb-e30c-4c4e-b442-a5e080e86802 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:54.789465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-951032cb-e30c-4c4e-b442-a5e080e86802 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:54.791201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-951032cb-e30c-4c4e-b442-a5e080e86802 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:54.805043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-951032cb-e30c-4c4e-b442-a5e080e86802 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:54.805864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-951032cb-e30c-4c4e-b442-a5e080e86802 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:54.806317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-951032cb-e30c-4c4e-b442-a5e080e86802 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:54.806794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-951032cb-e30c-4c4e-b442-a5e080e86802 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:54.829511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:55.065492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-6da4c784-29ce-47d2-9781-0027bf2bd528 req-9465c917-b569-49e0-ab8a-5d833bcd5b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea", "name": "network-vif-deleted", "tag": "64835173-71b3-4c34-8178-c06ca99dd52b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:55.077921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6da4c784-29ce-47d2-9781-0027bf2bd528 req-9465c917-b569-49e0-ab8a-5d833bcd5b0d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.078614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6da4c784-29ce-47d2-9781-0027bf2bd528 req-9465c917-b569-49e0-ab8a-5d833bcd5b0d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.078931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6da4c784-29ce-47d2-9781-0027bf2bd528 req-9465c917-b569-49e0-ab8a-5d833bcd5b0d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.101867 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-6da4c784-29ce-47d2-9781-0027bf2bd528 req-9465c917-b569-49e0-ab8a-5d833bcd5b0d service nova] Creating event network-vif-deleted:64835173-71b3-4c34-8178-c06ca99dd52b for instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea on n-h1-850468-16 Aug 23 18:16:55.108334 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-6da4c784-29ce-47d2-9781-0027bf2bd528 req-9465c917-b569-49e0-ab8a-5d833bcd5b0d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.354353 Aug 23 18:16:55.109590 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2522/5150] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:55.207111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-951032cb-e30c-4c4e-b442-a5e080e86802 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:55.220536 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-951032cb-e30c-4c4e-b442-a5e080e86802 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1489 microversion: 2.1 time: 0.454772 Aug 23 18:16:55.222227 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2629/5151] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:54 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1489 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:55.247960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3e11118d-3345-4b70-ab16-16c8a3e8e6fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:16:55.250683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3e11118d-3345-4b70-ab16-16c8a3e8e6fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:55.260140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e11118d-3345-4b70-ab16-16c8a3e8e6fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.260284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e11118d-3345-4b70-ab16-16c8a3e8e6fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.260724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e11118d-3345-4b70-ab16-16c8a3e8e6fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.261844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e11118d-3345-4b70-ab16-16c8a3e8e6fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.262639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e11118d-3345-4b70-ab16-16c8a3e8e6fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.263225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e11118d-3345-4b70-ab16-16c8a3e8e6fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.355070 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3e11118d-3345-4b70-ab16-16c8a3e8e6fd tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "PUT /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1084 microversion: 2.1 time: 0.111330 Aug 23 18:16:55.356181 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2523/5152] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Aug 23 18:16:55 2022] PUT /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1084 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:55.374276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-542f5ffd-e695-42e6-a696-62512254bfe2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:55.374925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-542f5ffd-e695-42e6-a696-62512254bfe2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:55.383213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-542f5ffd-e695-42e6-a696-62512254bfe2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.383711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-542f5ffd-e695-42e6-a696-62512254bfe2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.384149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-542f5ffd-e695-42e6-a696-62512254bfe2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.384896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-542f5ffd-e695-42e6-a696-62512254bfe2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.385511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-542f5ffd-e695-42e6-a696-62512254bfe2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.386222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-542f5ffd-e695-42e6-a696-62512254bfe2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.414878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-53f38201-c0b6-430c-bc5e-8c2e3d77616e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:55.416964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-53f38201-c0b6-430c-bc5e-8c2e3d77616e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:55.426216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53f38201-c0b6-430c-bc5e-8c2e3d77616e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.426377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53f38201-c0b6-430c-bc5e-8c2e3d77616e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.427883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53f38201-c0b6-430c-bc5e-8c2e3d77616e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.429553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53f38201-c0b6-430c-bc5e-8c2e3d77616e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.430581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53f38201-c0b6-430c-bc5e-8c2e3d77616e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.431399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53f38201-c0b6-430c-bc5e-8c2e3d77616e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.676361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-53f38201-c0b6-430c-bc5e-8c2e3d77616e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:55.690158 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-53f38201-c0b6-430c-bc5e-8c2e3d77616e tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.280742 Aug 23 18:16:55.705871 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2524/5153] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:55 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:55.719612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07ea63ae-e96f-4b77-a852-494863485bf7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:55.720252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07ea63ae-e96f-4b77-a852-494863485bf7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:55.729314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07ea63ae-e96f-4b77-a852-494863485bf7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.729774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07ea63ae-e96f-4b77-a852-494863485bf7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.730266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07ea63ae-e96f-4b77-a852-494863485bf7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.731033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07ea63ae-e96f-4b77-a852-494863485bf7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.731497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07ea63ae-e96f-4b77-a852-494863485bf7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.731932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07ea63ae-e96f-4b77-a852-494863485bf7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.763426 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-07ea63ae-e96f-4b77-a852-494863485bf7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] HTTP exception thrown: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07ea63ae-e96f-4b77-a852-494863485bf7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Request method failure captured: Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea HTTP/1.1 Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRl93m9eO7xLaUYoN3pUFaHuzwcM726RNkhvYGEORk3UfwJ6y__0bHopwKRKErrRR9lk3nv3kCCM9W138L7vecw87QjfCXu9caf6ZeyH7bNi5wGCMg1zDAUzq53Mg7gzcTVJXS6048sDV6IliVQIHk3Pj0OB6kIv50TngMQA4uPWGIk Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}] Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 8fcf9aa252b34e4cbb7d7e11693a6dab Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea'} Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:55.767516 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:55.774287 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:55.774287 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:55.774287 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:55.774287 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:55.774287 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:55.774287 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:55.774287 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:55.774287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07ea63ae-e96f-4b77-a852-494863485bf7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Returning 404 to user: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:55.774287 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-07ea63ae-e96f-4b77-a852-494863485bf7 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 404 len: 111 microversion: 2.1 time: 0.062149 Aug 23 18:16:55.776082 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2525/5154] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:55 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:55.782834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d0eaa777-254d-48a6-9ea8-99745258c6ec tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:55.804112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.compute.server_groups [None req-d0eaa777-254d-48a6-9ea8-99745258c6ec tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Querying cell 410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) for 1 instances {{(pid=128807) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 23 18:16:55.804854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0eaa777-254d-48a6-9ea8-99745258c6ec tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.805342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0eaa777-254d-48a6-9ea8-99745258c6ec tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.805851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0eaa777-254d-48a6-9ea8-99745258c6ec tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.856085 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d0eaa777-254d-48a6-9ea8-99745258c6ec tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups" status: 200 len: 187 microversion: 2.1 time: 0.077436 Aug 23 18:16:55.863272 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2526/5155] 10.222.0.61 () {58 vars in 1152 bytes} [Tue Aug 23 18:16:55 2022] GET /compute/v2.1/os-server-groups => generated 187 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:55.876611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd7ebd19-9e74-437c-ba6c-6a0755e9c997 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:55.904083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-542f5ffd-e695-42e6-a696-62512254bfe2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:55.916242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.compute.server_groups [None req-bd7ebd19-9e74-437c-ba6c-6a0755e9c997 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Querying cell 410bab2c-50ee-4129-957b-35fe1cb70e43(cell1) for 1 instances {{(pid=128807) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Aug 23 18:16:55.917136 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-542f5ffd-e695-42e6-a696-62512254bfe2 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1510 microversion: 2.1 time: 0.547233 Aug 23 18:16:55.917568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd7ebd19-9e74-437c-ba6c-6a0755e9c997 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.918393 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2630/5156] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:55 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1510 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:16:55.928353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd7ebd19-9e74-437c-ba6c-6a0755e9c997 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.929009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd7ebd19-9e74-437c-ba6c-6a0755e9c997 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.940876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eda6998a-320a-428d-8792-a28455f976d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:55.942050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eda6998a-320a-428d-8792-a28455f976d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:55.952998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eda6998a-320a-428d-8792-a28455f976d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.958295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eda6998a-320a-428d-8792-a28455f976d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.958941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eda6998a-320a-428d-8792-a28455f976d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.959810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eda6998a-320a-428d-8792-a28455f976d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:55.960401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eda6998a-320a-428d-8792-a28455f976d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:55.960944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eda6998a-320a-428d-8792-a28455f976d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:55.964044 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd7ebd19-9e74-437c-ba6c-6a0755e9c997 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/os-server-groups/fbbc029b-637d-4e38-9bed-7b259c43d5e8" status: 200 len: 184 microversion: 2.1 time: 0.091362 Aug 23 18:16:55.973779 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2527/5157] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 18:16:55 2022] GET /compute/v2.1/os-server-groups/fbbc029b-637d-4e38-9bed-7b259c43d5e8 => generated 184 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:16:55.987445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1e852b5d-0ef7-44ad-bd0e-447359eb4356 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:55.991972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1e852b5d-0ef7-44ad-bd0e-447359eb4356 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:56.020651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e852b5d-0ef7-44ad-bd0e-447359eb4356 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.031203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e852b5d-0ef7-44ad-bd0e-447359eb4356 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.031911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e852b5d-0ef7-44ad-bd0e-447359eb4356 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.032889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e852b5d-0ef7-44ad-bd0e-447359eb4356 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.036343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e852b5d-0ef7-44ad-bd0e-447359eb4356 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.037494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e852b5d-0ef7-44ad-bd0e-447359eb4356 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.063070 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-1e852b5d-0ef7-44ad-bd0e-447359eb4356 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] HTTP exception thrown: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1e852b5d-0ef7-44ad-bd0e-447359eb4356 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Request method failure captured: Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea HTTP/1.1 Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRl93m9eO7xLaUYoN3pUFaHuzwcM726RNkhvYGEORk3UfwJ6y__0bHopwKRKErrRR9lk3nv3kCCM9W138L7vecw87QjfCXu9caf6ZeyH7bNi5wGCMg1zDAUzq53Mg7gzcTVJXS6048sDV6IliVQIHk3Pj0OB6kIv50TngMQA4uPWGIk Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}] Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 8fcf9aa252b34e4cbb7d7e11693a6dab Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea'} Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:16:56.064937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1e852b5d-0ef7-44ad-bd0e-447359eb4356 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Returning 404 to user: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1e852b5d-0ef7-44ad-bd0e-447359eb4356 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 404 len: 111 microversion: 2.1 time: 0.088904 Aug 23 18:16:56.072042 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2528/5158] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:16:55 2022] DELETE /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:56.076211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a04c228b-3f91-4734-b12c-8bd1f6c3412d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:56.076735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a04c228b-3f91-4734-b12c-8bd1f6c3412d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:56.082923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a04c228b-3f91-4734-b12c-8bd1f6c3412d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.084273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a04c228b-3f91-4734-b12c-8bd1f6c3412d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.084647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a04c228b-3f91-4734-b12c-8bd1f6c3412d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.085377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a04c228b-3f91-4734-b12c-8bd1f6c3412d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.085845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a04c228b-3f91-4734-b12c-8bd1f6c3412d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.086452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a04c228b-3f91-4734-b12c-8bd1f6c3412d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.103036 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-a04c228b-3f91-4734-b12c-8bd1f6c3412d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a04c228b-3f91-4734-b12c-8bd1f6c3412d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 HTTP/1.1 Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '0d0004ed-3c7a-48da-a704-d0a2b3c43077'} Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:16:56.104804 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a04c228b-3f91-4734-b12c-8bd1f6c3412d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a04c228b-3f91-4734-b12c-8bd1f6c3412d tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "DELETE /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 404 len: 111 microversion: 2.1 time: 0.037435 Aug 23 18:16:56.110127 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2529/5159] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:16:56 2022] DELETE /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:56.115443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d57f0ae-a162-4e12-92a1-bff893747144 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:56.116195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d57f0ae-a162-4e12-92a1-bff893747144 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] [instance: 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:56.122835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d57f0ae-a162-4e12-92a1-bff893747144 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.123520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d57f0ae-a162-4e12-92a1-bff893747144 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.124047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d57f0ae-a162-4e12-92a1-bff893747144 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.125254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d57f0ae-a162-4e12-92a1-bff893747144 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.125962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d57f0ae-a162-4e12-92a1-bff893747144 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.126664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d57f0ae-a162-4e12-92a1-bff893747144 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.170443 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-4d57f0ae-a162-4e12-92a1-bff893747144 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] HTTP exception thrown: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d57f0ae-a162-4e12-92a1-bff893747144 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Request method failure captured: Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea HTTP/1.1 Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRl93m9eO7xLaUYoN3pUFaHuzwcM726RNkhvYGEORk3UfwJ6y__0bHopwKRKErrRR9lk3nv3kCCM9W138L7vecw87QjfCXu9caf6ZeyH7bNi5wGCMg1zDAUzq53Mg7gzcTVJXS6048sDV6IliVQIHk3Pj0OB6kIv50TngMQA4uPWGIk Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}] Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 8fcf9aa252b34e4cbb7d7e11693a6dab Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea'} Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.179974 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.185401 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.185401 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.185401 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.185401 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:56.185401 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:56.185401 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. Aug 23 18:16:56.185401 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.185401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d57f0ae-a162-4e12-92a1-bff893747144 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Returning 404 to user: Instance 5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:56.186105 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d57f0ae-a162-4e12-92a1-bff893747144 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea" status: 404 len: 111 microversion: 2.1 time: 0.075017 Aug 23 18:16:56.191696 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2530/5160] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:56 2022] GET /compute/v2.1/servers/5d6a8289-b0d7-40ca-80ec-1c86cc3fa4ea => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:56.201596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0df2346e-22b2-4a16-b93c-13822023e19e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:56.201885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eda6998a-320a-428d-8792-a28455f976d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:56.206922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0df2346e-22b2-4a16-b93c-13822023e19e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: 0d0004ed-3c7a-48da-a704-d0a2b3c43077] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:56.221399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0df2346e-22b2-4a16-b93c-13822023e19e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.222044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0df2346e-22b2-4a16-b93c-13822023e19e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.222599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0df2346e-22b2-4a16-b93c-13822023e19e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.222820 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eda6998a-320a-428d-8792-a28455f976d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1510 microversion: 2.1 time: 0.284640 Aug 23 18:16:56.223496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0df2346e-22b2-4a16-b93c-13822023e19e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.225754 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2631/5161] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:55 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1510 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:56.239109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0df2346e-22b2-4a16-b93c-13822023e19e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.240433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0df2346e-22b2-4a16-b93c-13822023e19e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.243517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a811cef7-2309-46a7-b527-33ccd58c8233 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:56.266196 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-a811cef7-2309-46a7-b527-33ccd58c8233 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] HTTP exception thrown: Instance group 7ef95270-1da5-4a48-b894-7217c705584e could not be found. Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a811cef7-2309-46a7-b527-33ccd58c8233 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Request method failure captured: Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/os-server-groups/7ef95270-1da5-4a48-b894-7217c705584e HTTP/1.1 Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRl93m9eO7xLaUYoN3pUFaHuzwcM726RNkhvYGEORk3UfwJ6y__0bHopwKRKErrRR9lk3nv3kCCM9W138L7vecw87QjfCXu9caf6ZeyH7bNi5wGCMg1zDAUzq53Mg7gzcTVJXS6048sDV6IliVQIHk3Pj0OB6kIv50TngMQA4uPWGIk Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}] Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 8fcf9aa252b34e4cbb7d7e11693a6dab Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance group 7ef95270-1da5-4a48-b894-7217c705584e could not be found. Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '7ef95270-1da5-4a48-b894-7217c705584e'} Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7ef95270-1da5-4a48-b894-7217c705584e could not be found. Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7ef95270-1da5-4a48-b894-7217c705584e could not be found. Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.284791 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.290963 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.290963 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.290963 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:56.290963 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:56.290963 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7ef95270-1da5-4a48-b894-7217c705584e could not be found. Aug 23 18:16:56.290963 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.290963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a811cef7-2309-46a7-b527-33ccd58c8233 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Returning 404 to user: Instance group 7ef95270-1da5-4a48-b894-7217c705584e could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:56.290963 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a811cef7-2309-46a7-b527-33ccd58c8233 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/7ef95270-1da5-4a48-b894-7217c705584e" status: 404 len: 117 microversion: 2.1 time: 0.058453 Aug 23 18:16:56.290963 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2632/5162] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Aug 23 18:16:56 2022] DELETE /compute/v2.1/os-server-groups/7ef95270-1da5-4a48-b894-7217c705584e => generated 117 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:56.297062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-52acbe08-35eb-4195-9bc0-a950a4021469 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:56.299732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-52acbe08-35eb-4195-9bc0-a950a4021469 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:56.303941 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-0df2346e-22b2-4a16-b93c-13822023e19e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0df2346e-22b2-4a16-b93c-13822023e19e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 HTTP/1.1 Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '0d0004ed-3c7a-48da-a704-d0a2b3c43077'} Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.308236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.313443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.313443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.313443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.313443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:56.313443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:56.313443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. Aug 23 18:16:56.313443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.314048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0df2346e-22b2-4a16-b93c-13822023e19e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance 0d0004ed-3c7a-48da-a704-d0a2b3c43077 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:56.316974 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0df2346e-22b2-4a16-b93c-13822023e19e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077" status: 404 len: 111 microversion: 2.1 time: 0.122710 Aug 23 18:16:56.318211 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2531/5163] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:56 2022] GET /compute/v2.1/servers/0d0004ed-3c7a-48da-a704-d0a2b3c43077 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:56.325522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52acbe08-35eb-4195-9bc0-a950a4021469 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.326099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52acbe08-35eb-4195-9bc0-a950a4021469 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.326594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52acbe08-35eb-4195-9bc0-a950a4021469 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.327348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52acbe08-35eb-4195-9bc0-a950a4021469 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.328995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52acbe08-35eb-4195-9bc0-a950a4021469 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.329335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3aea07f3-9076-4b78-a83b-ffbd7fc3357a tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:56.329480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52acbe08-35eb-4195-9bc0-a950a4021469 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.346572 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-3aea07f3-9076-4b78-a83b-ffbd7fc3357a tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] HTTP exception thrown: Instance group d4861da2-332b-4902-83cb-cdda4b4eaab6 could not be found. Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3aea07f3-9076-4b78-a83b-ffbd7fc3357a tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Request method failure captured: Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-server-groups/d4861da2-332b-4902-83cb-cdda4b4eaab6 HTTP/1.1 Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRl93m9eO7xLaUYoN3pUFaHuzwcM726RNkhvYGEORk3UfwJ6y__0bHopwKRKErrRR9lk3nv3kCCM9W138L7vecw87QjfCXu9caf6ZeyH7bNi5wGCMg1zDAUzq53Mg7gzcTVJXS6048sDV6IliVQIHk3Pj0OB6kIv50TngMQA4uPWGIk Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}] Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 8fcf9aa252b34e4cbb7d7e11693a6dab Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance group d4861da2-332b-4902-83cb-cdda4b4eaab6 could not be found. Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'd4861da2-332b-4902-83cb-cdda4b4eaab6'} Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group d4861da2-332b-4902-83cb-cdda4b4eaab6 could not be found. Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group d4861da2-332b-4902-83cb-cdda4b4eaab6 could not be found. Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.348422 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.354758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.354758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.354758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:56.354758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:56.354758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group d4861da2-332b-4902-83cb-cdda4b4eaab6 could not be found. Aug 23 18:16:56.354758 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.357875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3aea07f3-9076-4b78-a83b-ffbd7fc3357a tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Returning 404 to user: Instance group d4861da2-332b-4902-83cb-cdda4b4eaab6 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:56.360985 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3aea07f3-9076-4b78-a83b-ffbd7fc3357a tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/d4861da2-332b-4902-83cb-cdda4b4eaab6" status: 404 len: 117 microversion: 2.1 time: 0.040368 Aug 23 18:16:56.362757 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2532/5164] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Aug 23 18:16:56 2022] DELETE /compute/v2.1/os-server-groups/d4861da2-332b-4902-83cb-cdda4b4eaab6 => generated 117 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:56.373644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c3bfd37-b835-4757-96e7-d8b676064ca7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:56.383393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0c3bfd37-b835-4757-96e7-d8b676064ca7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:56.395591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c3bfd37-b835-4757-96e7-d8b676064ca7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.404936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c3bfd37-b835-4757-96e7-d8b676064ca7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.405708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c3bfd37-b835-4757-96e7-d8b676064ca7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.406722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c3bfd37-b835-4757-96e7-d8b676064ca7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.407371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c3bfd37-b835-4757-96e7-d8b676064ca7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.407523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-52acbe08-35eb-4195-9bc0-a950a4021469 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:16:56.408129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c3bfd37-b835-4757-96e7-d8b676064ca7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.414666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:16:56.475311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0c3bfd37-b835-4757-96e7-d8b676064ca7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:16:56.589156 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-52acbe08-35eb-4195-9bc0-a950a4021469 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 204 len: 0 microversion: 2.1 time: 0.297526 Aug 23 18:16:56.589816 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2633/5165] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:16:56 2022] DELETE /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:16:56.603960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-054766dd-4737-402a-bb2a-02226698f677 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:56.635280 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-054766dd-4737-402a-bb2a-02226698f677 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] HTTP exception thrown: Instance group 2e2f7038-438d-44ce-98e0-5ec71f2c5d44 could not be found. Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-054766dd-4737-402a-bb2a-02226698f677 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Request method failure captured: Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/os-server-groups/2e2f7038-438d-44ce-98e0-5ec71f2c5d44 HTTP/1.1 Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRl93m9eO7xLaUYoN3pUFaHuzwcM726RNkhvYGEORk3UfwJ6y__0bHopwKRKErrRR9lk3nv3kCCM9W138L7vecw87QjfCXu9caf6ZeyH7bNi5wGCMg1zDAUzq53Mg7gzcTVJXS6048sDV6IliVQIHk3Pj0OB6kIv50TngMQA4uPWGIk Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}] Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 8fcf9aa252b34e4cbb7d7e11693a6dab Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance group 2e2f7038-438d-44ce-98e0-5ec71f2c5d44 could not be found. Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '2e2f7038-438d-44ce-98e0-5ec71f2c5d44'} Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 2e2f7038-438d-44ce-98e0-5ec71f2c5d44 could not be found. Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 2e2f7038-438d-44ce-98e0-5ec71f2c5d44 could not be found. Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.640055 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.646521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.646521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.646521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:56.646521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:56.646521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 2e2f7038-438d-44ce-98e0-5ec71f2c5d44 could not be found. Aug 23 18:16:56.646521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.646521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-054766dd-4737-402a-bb2a-02226698f677 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Returning 404 to user: Instance group 2e2f7038-438d-44ce-98e0-5ec71f2c5d44 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:56.646521 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-054766dd-4737-402a-bb2a-02226698f677 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/2e2f7038-438d-44ce-98e0-5ec71f2c5d44" status: 404 len: 117 microversion: 2.1 time: 0.051991 Aug 23 18:16:56.646521 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2634/5166] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Aug 23 18:16:56 2022] DELETE /compute/v2.1/os-server-groups/2e2f7038-438d-44ce-98e0-5ec71f2c5d44 => generated 117 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:56.653694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6552f17d-46c0-4aec-aca4-5977fde5000f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:56.654461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6552f17d-46c0-4aec-aca4-5977fde5000f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:56.673071 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c3bfd37-b835-4757-96e7-d8b676064ca7 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 204 len: 0 microversion: 2.1 time: 0.303705 Aug 23 18:16:56.674971 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2533/5167] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:16:56 2022] DELETE /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 0 bytes in 308 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:16:56.678049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6552f17d-46c0-4aec-aca4-5977fde5000f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.681234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6552f17d-46c0-4aec-aca4-5977fde5000f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.682173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6552f17d-46c0-4aec-aca4-5977fde5000f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.683971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6552f17d-46c0-4aec-aca4-5977fde5000f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.685655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6552f17d-46c0-4aec-aca4-5977fde5000f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.687215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6552f17d-46c0-4aec-aca4-5977fde5000f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.692083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-977ff1c3-8746-4df8-8f4f-d646273a5333 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:56.705277 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-977ff1c3-8746-4df8-8f4f-d646273a5333 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] HTTP exception thrown: Instance group 6b071450-c5d3-40e7-875d-798d88657a4d could not be found. Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-977ff1c3-8746-4df8-8f4f-d646273a5333 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Request method failure captured: Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-server-groups/6b071450-c5d3-40e7-875d-798d88657a4d HTTP/1.1 Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRl93m9eO7xLaUYoN3pUFaHuzwcM726RNkhvYGEORk3UfwJ6y__0bHopwKRKErrRR9lk3nv3kCCM9W138L7vecw87QjfCXu9caf6ZeyH7bNi5wGCMg1zDAUzq53Mg7gzcTVJXS6048sDV6IliVQIHk3Pj0OB6kIv50TngMQA4uPWGIk Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/f6d9218910784aafae3d855cd5ce33f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/f6d9218910784aafae3d855cd5ce33f7"}]}] Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: f6d9218910784aafae3d855cd5ce33f7 Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerGroupTestJSON-1276933443 Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 8fcf9aa252b34e4cbb7d7e11693a6dab Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerGroupTestJSON-1276933443-project Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance group 6b071450-c5d3-40e7-875d-798d88657a4d could not be found. Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '6b071450-c5d3-40e7-875d-798d88657a4d'} Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 6b071450-c5d3-40e7-875d-798d88657a4d could not be found. Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 6b071450-c5d3-40e7-875d-798d88657a4d could not be found. Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.709678 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:16:56.716312 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:16:56.716312 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:16:56.716312 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:16:56.716312 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:16:56.716312 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 6b071450-c5d3-40e7-875d-798d88657a4d could not be found. Aug 23 18:16:56.716312 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:16:56.716312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-977ff1c3-8746-4df8-8f4f-d646273a5333 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Returning 404 to user: Instance group 6b071450-c5d3-40e7-875d-798d88657a4d could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:16:56.716312 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-977ff1c3-8746-4df8-8f4f-d646273a5333 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/6b071450-c5d3-40e7-875d-798d88657a4d" status: 404 len: 117 microversion: 2.1 time: 0.036262 Aug 23 18:16:56.717602 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2534/5168] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Aug 23 18:16:56 2022] DELETE /compute/v2.1/os-server-groups/6b071450-c5d3-40e7-875d-798d88657a4d => generated 117 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:16:56.732133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-94913ec4-9d15-4dbe-a38d-062102fcbf1e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:56.733066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-94913ec4-9d15-4dbe-a38d-062102fcbf1e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:56.744994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-94913ec4-9d15-4dbe-a38d-062102fcbf1e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.745516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-94913ec4-9d15-4dbe-a38d-062102fcbf1e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.745983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-94913ec4-9d15-4dbe-a38d-062102fcbf1e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.746789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-94913ec4-9d15-4dbe-a38d-062102fcbf1e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:56.747282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-94913ec4-9d15-4dbe-a38d-062102fcbf1e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:56.748242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-94913ec4-9d15-4dbe-a38d-062102fcbf1e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:56.998431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6552f17d-46c0-4aec-aca4-5977fde5000f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:57.019796 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6552f17d-46c0-4aec-aca4-5977fde5000f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1516 microversion: 2.1 time: 0.372635 Aug 23 18:16:57.023025 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2635/5169] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:56 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1516 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:57.038218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-95352e2d-bbfc-478e-ba5c-6f0fe1625fbf tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:57.038870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-95352e2d-bbfc-478e-ba5c-6f0fe1625fbf tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:57.052475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95352e2d-bbfc-478e-ba5c-6f0fe1625fbf tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:57.055502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95352e2d-bbfc-478e-ba5c-6f0fe1625fbf tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:57.056461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95352e2d-bbfc-478e-ba5c-6f0fe1625fbf tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:57.057643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95352e2d-bbfc-478e-ba5c-6f0fe1625fbf tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:57.059071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95352e2d-bbfc-478e-ba5c-6f0fe1625fbf tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:57.064676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95352e2d-bbfc-478e-ba5c-6f0fe1625fbf tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:57.290624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-94913ec4-9d15-4dbe-a38d-062102fcbf1e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:57.300699 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-94913ec4-9d15-4dbe-a38d-062102fcbf1e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1511 microversion: 2.1 time: 0.579781 Aug 23 18:16:57.302972 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2535/5170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:56 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1511 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:57.319705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-92081f37-a42e-45c4-8e09-49be9ec99335 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:57.356439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-95352e2d-bbfc-478e-ba5c-6f0fe1625fbf tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:57.371708 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-95352e2d-bbfc-478e-ba5c-6f0fe1625fbf tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.347555 Aug 23 18:16:57.374058 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-92081f37-a42e-45c4-8e09-49be9ec99335 tempest-ServerGroupTestJSON-1276933443 tempest-ServerGroupTestJSON-1276933443-project] 10.222.0.61 "DELETE /compute/v2.1/os-server-groups/fbbc029b-637d-4e38-9bed-7b259c43d5e8" status: 204 len: 0 microversion: 2.1 time: 0.069033 Aug 23 18:16:57.375874 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2536/5171] 10.222.0.61 () {58 vars in 1266 bytes} [Tue Aug 23 18:16:57 2022] DELETE /compute/v2.1/os-server-groups/fbbc029b-637d-4e38-9bed-7b259c43d5e8 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:16:57.381226 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2636/5172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:57 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:58.048122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-181516fe-5e39-4ba8-9a71-6cb889651390 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:58.049705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-181516fe-5e39-4ba8-9a71-6cb889651390 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:58.065357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-181516fe-5e39-4ba8-9a71-6cb889651390 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:58.066076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-181516fe-5e39-4ba8-9a71-6cb889651390 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:58.066734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-181516fe-5e39-4ba8-9a71-6cb889651390 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:58.069000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-181516fe-5e39-4ba8-9a71-6cb889651390 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:58.072445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-181516fe-5e39-4ba8-9a71-6cb889651390 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:58.073104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-181516fe-5e39-4ba8-9a71-6cb889651390 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:58.328630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c4c1709c-5a81-4f2a-95ae-57977f17b55e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:58.330928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c4c1709c-5a81-4f2a-95ae-57977f17b55e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:58.346312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4c1709c-5a81-4f2a-95ae-57977f17b55e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:58.347640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4c1709c-5a81-4f2a-95ae-57977f17b55e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:58.348509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4c1709c-5a81-4f2a-95ae-57977f17b55e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:58.350653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4c1709c-5a81-4f2a-95ae-57977f17b55e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:58.351302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4c1709c-5a81-4f2a-95ae-57977f17b55e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:58.351924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4c1709c-5a81-4f2a-95ae-57977f17b55e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:58.447151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-181516fe-5e39-4ba8-9a71-6cb889651390 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:58.456166 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-181516fe-5e39-4ba8-9a71-6cb889651390 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1516 microversion: 2.1 time: 0.411593 Aug 23 18:16:58.457249 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2537/5173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:58 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1516 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:58.471985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86fc6287-1084-4216-9f2e-80698319127d tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:58.473010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-86fc6287-1084-4216-9f2e-80698319127d tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:58.483650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86fc6287-1084-4216-9f2e-80698319127d tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:58.484384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86fc6287-1084-4216-9f2e-80698319127d tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:58.485113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86fc6287-1084-4216-9f2e-80698319127d tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:58.487911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86fc6287-1084-4216-9f2e-80698319127d tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:58.488645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86fc6287-1084-4216-9f2e-80698319127d tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:58.489406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86fc6287-1084-4216-9f2e-80698319127d tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:58.685995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c4c1709c-5a81-4f2a-95ae-57977f17b55e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:58.697244 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c4c1709c-5a81-4f2a-95ae-57977f17b55e tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1511 microversion: 2.1 time: 0.376383 Aug 23 18:16:58.703101 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2637/5174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:58 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1511 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:59.443226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-86fc6287-1084-4216-9f2e-80698319127d tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:59.456544 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-86fc6287-1084-4216-9f2e-80698319127d tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.996475 Aug 23 18:16:59.458200 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2538/5175] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:58 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:59.482036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dc98dfc6-5f29-4432-b92d-13b9db24ed5a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:59.487629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc98dfc6-5f29-4432-b92d-13b9db24ed5a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:59.494952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc98dfc6-5f29-4432-b92d-13b9db24ed5a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:59.495455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc98dfc6-5f29-4432-b92d-13b9db24ed5a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:59.495907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc98dfc6-5f29-4432-b92d-13b9db24ed5a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:59.496655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc98dfc6-5f29-4432-b92d-13b9db24ed5a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:59.497085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc98dfc6-5f29-4432-b92d-13b9db24ed5a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:59.497513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc98dfc6-5f29-4432-b92d-13b9db24ed5a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:59.714155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dc98dfc6-5f29-4432-b92d-13b9db24ed5a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:16:59.725649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6bbc121f-8cc7-42fe-ba85-ecb18c088f02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:16:59.727371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6bbc121f-8cc7-42fe-ba85-ecb18c088f02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:16:59.729280 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dc98dfc6-5f29-4432-b92d-13b9db24ed5a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1516 microversion: 2.1 time: 0.252277 Aug 23 18:16:59.730155 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2638/5176] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:59 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1516 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:16:59.736968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bbc121f-8cc7-42fe-ba85-ecb18c088f02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:59.738006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bbc121f-8cc7-42fe-ba85-ecb18c088f02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:59.738695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bbc121f-8cc7-42fe-ba85-ecb18c088f02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:16:59.740698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bbc121f-8cc7-42fe-ba85-ecb18c088f02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:16:59.741921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bbc121f-8cc7-42fe-ba85-ecb18c088f02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:16:59.742754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bbc121f-8cc7-42fe-ba85-ecb18c088f02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:00.167102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6bbc121f-8cc7-42fe-ba85-ecb18c088f02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:00.194235 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6bbc121f-8cc7-42fe-ba85-ecb18c088f02 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1511 microversion: 2.1 time: 0.471423 Aug 23 18:17:00.214698 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2539/5177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:16:59 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1511 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:00.492781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7c5e2a79-908f-4618-85db-3fbbb022d472 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:00.494062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7c5e2a79-908f-4618-85db-3fbbb022d472 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:00.516582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c5e2a79-908f-4618-85db-3fbbb022d472 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:00.519513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c5e2a79-908f-4618-85db-3fbbb022d472 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:00.522764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c5e2a79-908f-4618-85db-3fbbb022d472 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:00.527926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c5e2a79-908f-4618-85db-3fbbb022d472 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:00.528958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c5e2a79-908f-4618-85db-3fbbb022d472 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:00.529899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c5e2a79-908f-4618-85db-3fbbb022d472 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:00.752605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ec35ed5-01cd-48d3-867b-f4e906a43380 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:00.754089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1ec35ed5-01cd-48d3-867b-f4e906a43380 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:00.764477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ec35ed5-01cd-48d3-867b-f4e906a43380 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:00.765391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ec35ed5-01cd-48d3-867b-f4e906a43380 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:00.766288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ec35ed5-01cd-48d3-867b-f4e906a43380 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:00.767458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ec35ed5-01cd-48d3-867b-f4e906a43380 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:00.768797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ec35ed5-01cd-48d3-867b-f4e906a43380 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:00.771829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ec35ed5-01cd-48d3-867b-f4e906a43380 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:01.073534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7c5e2a79-908f-4618-85db-3fbbb022d472 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:01.086657 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7c5e2a79-908f-4618-85db-3fbbb022d472 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.606069 Aug 23 18:17:01.103809 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2639/5178] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:00 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:01.221901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8844b58c-cb2e-4b09-a950-4b64618eca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:01.223185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8844b58c-cb2e-4b09-a950-4b64618eca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:01.256319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8844b58c-cb2e-4b09-a950-4b64618eca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:01.259635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8844b58c-cb2e-4b09-a950-4b64618eca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:01.261016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8844b58c-cb2e-4b09-a950-4b64618eca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:01.262733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8844b58c-cb2e-4b09-a950-4b64618eca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:01.263528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8844b58c-cb2e-4b09-a950-4b64618eca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:01.264500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8844b58c-cb2e-4b09-a950-4b64618eca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:01.291197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1ec35ed5-01cd-48d3-867b-f4e906a43380 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:01.347471 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1ec35ed5-01cd-48d3-867b-f4e906a43380 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 200 len: 1516 microversion: 2.1 time: 0.597186 Aug 23 18:17:01.349826 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2540/5179] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:00 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 1516 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:01.359512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-8e998efd-c25d-4a75-8e2f-0c04e97ba78c req-9278ac7b-808f-4783-96dc-8fc47f0328cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6e6d612-1196-4700-b893-d355ca237e7f", "name": "network-vif-deleted", "tag": "82424a3c-a6fe-433b-8e79-c404fe9e85b7"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:01.384609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8e998efd-c25d-4a75-8e2f-0c04e97ba78c req-9278ac7b-808f-4783-96dc-8fc47f0328cf service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:01.386456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8e998efd-c25d-4a75-8e2f-0c04e97ba78c req-9278ac7b-808f-4783-96dc-8fc47f0328cf service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:01.388937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8e998efd-c25d-4a75-8e2f-0c04e97ba78c req-9278ac7b-808f-4783-96dc-8fc47f0328cf service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:01.428477 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-8e998efd-c25d-4a75-8e2f-0c04e97ba78c req-9278ac7b-808f-4783-96dc-8fc47f0328cf service nova] Creating event network-vif-deleted:82424a3c-a6fe-433b-8e79-c404fe9e85b7 for instance e6e6d612-1196-4700-b893-d355ca237e7f on n-h2-850468-16 Aug 23 18:17:01.442251 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-8e998efd-c25d-4a75-8e2f-0c04e97ba78c req-9278ac7b-808f-4783-96dc-8fc47f0328cf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090981 Aug 23 18:17:01.444453 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2541/5180] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:01.689381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8844b58c-cb2e-4b09-a950-4b64618eca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f03bc0a9e89240dbbe6b7c556449b912', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2600f90b7734756a397c658ae140e6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:01.698097 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8844b58c-cb2e-4b09-a950-4b64618eca95 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 200 len: 1511 microversion: 2.1 time: 0.483716 Aug 23 18:17:01.699494 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2640/5181] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:01 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 1511 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:02.122333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-15570450-b1b5-4021-a7ad-a2b8588ccfcc tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:02.129237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-15570450-b1b5-4021-a7ad-a2b8588ccfcc tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:02.165338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15570450-b1b5-4021-a7ad-a2b8588ccfcc tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:02.166090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15570450-b1b5-4021-a7ad-a2b8588ccfcc tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:02.166757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15570450-b1b5-4021-a7ad-a2b8588ccfcc tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:02.167734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15570450-b1b5-4021-a7ad-a2b8588ccfcc tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:02.168429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15570450-b1b5-4021-a7ad-a2b8588ccfcc tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:02.169028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15570450-b1b5-4021-a7ad-a2b8588ccfcc tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:02.371697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c5f9615d-d582-47cd-a811-e932ff071467 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:02.372775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c5f9615d-d582-47cd-a811-e932ff071467 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:02.379792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:02.382742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5f9615d-d582-47cd-a811-e932ff071467 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:02.384452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5f9615d-d582-47cd-a811-e932ff071467 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:02.385184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5f9615d-d582-47cd-a811-e932ff071467 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:02.386139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5f9615d-d582-47cd-a811-e932ff071467 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:02.387048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5f9615d-d582-47cd-a811-e932ff071467 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:02.387746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5f9615d-d582-47cd-a811-e932ff071467 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:02.421034 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-c5f9615d-d582-47cd-a811-e932ff071467 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c5f9615d-d582-47cd-a811-e932ff071467 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f HTTP/1.1 Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'e6e6d612-1196-4700-b893-d355ca237e7f'} Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:17:02.425412 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:17:02.435318 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:17:02.435318 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:17:02.435318 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:17:02.435318 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:17:02.435318 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:17:02.435318 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:17:02.435318 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:17:02.441291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c5f9615d-d582-47cd-a811-e932ff071467 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:17:02.443098 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c5f9615d-d582-47cd-a811-e932ff071467 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 404 len: 111 microversion: 2.1 time: 0.076871 Aug 23 18:17:02.455033 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2641/5182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:02 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:17:02.513180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-15570450-b1b5-4021-a7ad-a2b8588ccfcc tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:02.527438 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-15570450-b1b5-4021-a7ad-a2b8588ccfcc tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.417424 Aug 23 18:17:02.530860 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2542/5183] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:02 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:02.660851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1694506226", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "bcef2581-80d0-47e5-8b8b-34343a6facf5"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:02.721738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5b196e6-b864-4cb8-9023-fe94148916e3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:02.722285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a5b196e6-b864-4cb8-9023-fe94148916e3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] [instance: f1cad0fb-87b4-403c-9881-64ce147502fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:02.730082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] validate_networks() for [('bcef2581-80d0-47e5-8b8b-34343a6facf5', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:17:02.740227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5b196e6-b864-4cb8-9023-fe94148916e3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:02.742246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5b196e6-b864-4cb8-9023-fe94148916e3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:02.743011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5b196e6-b864-4cb8-9023-fe94148916e3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:02.744006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5b196e6-b864-4cb8-9023-fe94148916e3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:02.744745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5b196e6-b864-4cb8-9023-fe94148916e3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:02.745379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5b196e6-b864-4cb8-9023-fe94148916e3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:02.763512 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-a5b196e6-b864-4cb8-9023-fe94148916e3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] HTTP exception thrown: Instance f1cad0fb-87b4-403c-9881-64ce147502fd could not be found. Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5b196e6-b864-4cb8-9023-fe94148916e3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Request method failure captured: Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd HTTP/1.1 Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRikxdHhjdUg7FHAh9tJArrab6ubysWRPXqKlko8fJ6NlhNIpM8hTyorYi8HJEZ0d3nRY0yLhtQkaMuAf2OQwy1u61b0-VdS_2Km6ExpKq3Agey28TCuOLBI5jjngWPHysRZtPqIKhO0kW36fD5LkKwGsJ38jA-dKHeBp3J4ipmx5Xc Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/a2600f90b7734756a397c658ae140e6e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/a2600f90b7734756a397c658ae140e6e"}]}] Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: a2600f90b7734756a397c658ae140e6e Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1024565656 Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f03bc0a9e89240dbbe6b7c556449b912 Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1024565656-project Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance f1cad0fb-87b4-403c-9881-64ce147502fd could not be found. Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f1cad0fb-87b4-403c-9881-64ce147502fd'} Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f1cad0fb-87b4-403c-9881-64ce147502fd could not be found. Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f1cad0fb-87b4-403c-9881-64ce147502fd could not be found. Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:17:02.765990 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:17:02.770877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:17:02.770877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:17:02.770877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:17:02.770877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:17:02.770877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:17:02.770877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f1cad0fb-87b4-403c-9881-64ce147502fd could not be found. Aug 23 18:17:02.770877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:17:02.773495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5b196e6-b864-4cb8-9023-fe94148916e3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] Returning 404 to user: Instance f1cad0fb-87b4-403c-9881-64ce147502fd could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:17:02.774688 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a5b196e6-b864-4cb8-9023-fe94148916e3 tempest-ServersNegativeTestJSON-1024565656 tempest-ServersNegativeTestJSON-1024565656-project] 10.222.0.61 "GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd" status: 404 len: 111 microversion: 2.1 time: 0.058372 Aug 23 18:17:02.775928 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2543/5184] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:02 2022] GET /compute/v2.1/servers/f1cad0fb-87b4-403c-9881-64ce147502fd => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:17:03.518774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2c631975-d9b5-48a7-b826-56c8c6158a8c req-d24404aa-0b56-4b8b-bdb7-2a4dddd29d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f1cad0fb-87b4-403c-9881-64ce147502fd", "name": "network-vif-deleted", "tag": "933227f8-f35c-4a4d-8cd9-453f1505d7a3"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:03.551285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2c631975-d9b5-48a7-b826-56c8c6158a8c req-d24404aa-0b56-4b8b-bdb7-2a4dddd29d54 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:03.555642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2c631975-d9b5-48a7-b826-56c8c6158a8c req-d24404aa-0b56-4b8b-bdb7-2a4dddd29d54 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:03.556133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2c631975-d9b5-48a7-b826-56c8c6158a8c req-d24404aa-0b56-4b8b-bdb7-2a4dddd29d54 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:03.579882 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2c631975-d9b5-48a7-b826-56c8c6158a8c req-d24404aa-0b56-4b8b-bdb7-2a4dddd29d54 service nova] Creating event network-vif-deleted:933227f8-f35c-4a4d-8cd9-453f1505d7a3 for instance f1cad0fb-87b4-403c-9881-64ce147502fd on n-h2-850468-16 Aug 23 18:17:03.591697 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2c631975-d9b5-48a7-b826-56c8c6158a8c req-d24404aa-0b56-4b8b-bdb7-2a4dddd29d54 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079897 Aug 23 18:17:03.595677 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2544/5185] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:03.619872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-969c442c-d20e-45d6-a815-ff2ddef6ff85 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:03.620944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-969c442c-d20e-45d6-a815-ff2ddef6ff85 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:03.629381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-969c442c-d20e-45d6-a815-ff2ddef6ff85 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:03.643331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-969c442c-d20e-45d6-a815-ff2ddef6ff85 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:03.643847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-969c442c-d20e-45d6-a815-ff2ddef6ff85 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:03.646357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-969c442c-d20e-45d6-a815-ff2ddef6ff85 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:03.647370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-969c442c-d20e-45d6-a815-ff2ddef6ff85 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:03.648215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-969c442c-d20e-45d6-a815-ff2ddef6ff85 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:04.132037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-969c442c-d20e-45d6-a815-ff2ddef6ff85 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:04.143535 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-969c442c-d20e-45d6-a815-ff2ddef6ff85 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.540745 Aug 23 18:17:04.143695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:17:04.144144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:17:04.146955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:17:04.147377 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2545/5186] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:03 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:04.147515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:17:04.147905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:17:04.170071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:04.171933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:04.173071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:04.174725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:04.175486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:04.176256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:04.219623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:17:04.227462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Getting quotas for user 6e80c3f1c008459faa3ac74ea5984eea and project 27a6a20a50ef474db0b83487eb029629. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:17:04.247417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:17:04.252692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:17:04.336252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8d7d691e-8251-4bed-a21f-51afb43e5c0e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Action: 'create', calling method: .version_select at 0x7f27ec8910d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-516232811", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvrSGhtKmyttTjN6jJX1Ya8bEy75NLHh10sxfX9DW2Zv78MB3ihYGz3WHdMg8sfEUCrcTCHM16loffyUYFsSefL7WVV8jxHD37v2Z1I/keCfDblvd7y8cwaXAfQIoTdSg=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:04.362750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-8d7d691e-8251-4bed-a21f-51afb43e5c0e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Getting quotas for project bc5872887aaa488fafcb94629d083630. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:17:04.369329 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7878516f-0ffe-41e9-ab49-353ad2ffc6d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.710532 Aug 23 18:17:04.372428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-8d7d691e-8251-4bed-a21f-51afb43e5c0e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Getting quotas for user ef5f5a1ba1e7414a82fff09abe84a931 and project bc5872887aaa488fafcb94629d083630. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:17:04.372621 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2642/5187] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:17:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1716 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:17:04.385019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3ca17a9c-471e-4956-880f-631bd1cbb1e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:04.388099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3ca17a9c-471e-4956-880f-631bd1cbb1e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:04.416075 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8d7d691e-8251-4bed-a21f-51afb43e5c0e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.084777 Aug 23 18:17:04.417307 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2546/5188] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:17:04 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:17:04.623468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3ca17a9c-471e-4956-880f-631bd1cbb1e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:04.642532 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3ca17a9c-471e-4956-880f-631bd1cbb1e3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1209 microversion: 2.1 time: 0.262919 Aug 23 18:17:04.644609 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2643/5189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:04 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1209 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:05.171080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a92bb7e6-449c-4ec2-83cf-0c130e67a0ae tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:05.171715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a92bb7e6-449c-4ec2-83cf-0c130e67a0ae tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:05.185751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a92bb7e6-449c-4ec2-83cf-0c130e67a0ae tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:05.186899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a92bb7e6-449c-4ec2-83cf-0c130e67a0ae tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:05.187995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a92bb7e6-449c-4ec2-83cf-0c130e67a0ae tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:05.190366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a92bb7e6-449c-4ec2-83cf-0c130e67a0ae tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:05.191095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a92bb7e6-449c-4ec2-83cf-0c130e67a0ae tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:05.192150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a92bb7e6-449c-4ec2-83cf-0c130e67a0ae tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:05.531641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a92bb7e6-449c-4ec2-83cf-0c130e67a0ae tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:05.545220 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a92bb7e6-449c-4ec2-83cf-0c130e67a0ae tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.381281 Aug 23 18:17:05.558573 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2547/5190] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:05 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:05.675205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-64c40c31-c6ef-484a-9a15-030c4578ef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:05.676596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-64c40c31-c6ef-484a-9a15-030c4578ef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:05.703342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64c40c31-c6ef-484a-9a15-030c4578ef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:05.705148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64c40c31-c6ef-484a-9a15-030c4578ef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:05.705912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64c40c31-c6ef-484a-9a15-030c4578ef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:05.709704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64c40c31-c6ef-484a-9a15-030c4578ef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:05.710302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64c40c31-c6ef-484a-9a15-030c4578ef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:05.716220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64c40c31-c6ef-484a-9a15-030c4578ef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:05.974370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-64c40c31-c6ef-484a-9a15-030c4578ef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:05.985464 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-64c40c31-c6ef-484a-9a15-030c4578ef1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1261 microversion: 2.1 time: 0.319741 Aug 23 18:17:05.990294 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2644/5191] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:05 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1261 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:06.569453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45af9e5a-28ad-4631-8216-28ce88f1bbce tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:06.570181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-45af9e5a-28ad-4631-8216-28ce88f1bbce tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:06.584593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=3,nova_api:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:06.594487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45af9e5a-28ad-4631-8216-28ce88f1bbce tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:06.595323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45af9e5a-28ad-4631-8216-28ce88f1bbce tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:06.595854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45af9e5a-28ad-4631-8216-28ce88f1bbce tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:06.597962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45af9e5a-28ad-4631-8216-28ce88f1bbce tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:06.599497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45af9e5a-28ad-4631-8216-28ce88f1bbce tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:06.622963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45af9e5a-28ad-4631-8216-28ce88f1bbce tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:07.017697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0ba1e98a-80da-4d1a-a49c-6c4515917f09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:07.019812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0ba1e98a-80da-4d1a-a49c-6c4515917f09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:07.042305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ba1e98a-80da-4d1a-a49c-6c4515917f09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:07.043576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ba1e98a-80da-4d1a-a49c-6c4515917f09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:07.044106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ba1e98a-80da-4d1a-a49c-6c4515917f09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:07.045108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ba1e98a-80da-4d1a-a49c-6c4515917f09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:07.045911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ba1e98a-80da-4d1a-a49c-6c4515917f09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:07.046419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ba1e98a-80da-4d1a-a49c-6c4515917f09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:07.103731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-45af9e5a-28ad-4631-8216-28ce88f1bbce tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:07.123894 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-45af9e5a-28ad-4631-8216-28ce88f1bbce tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.558371 Aug 23 18:17:07.146499 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2548/5192] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:06 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:07.616142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1532090644", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "8269ca0b-829c-43a1-866d-6192565d2ef7"}], "key_name": "tempest-TestNetworkBasicOps-516232811", "security_groups": [{"name": "tempest-secgroup-smoke-1066344220"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:07.621946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0ba1e98a-80da-4d1a-a49c-6c4515917f09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:07.639884 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0ba1e98a-80da-4d1a-a49c-6c4515917f09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1267 microversion: 2.1 time: 0.631996 Aug 23 18:17:07.642162 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2645/5193] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:07 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1267 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:07.774715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] validate_networks() for [('8269ca0b-829c-43a1-866d-6192565d2ef7', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:17:08.153647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-35defc8a-fae5-40ad-b52a-4d6599d2e851 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:08.154481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-35defc8a-fae5-40ad-b52a-4d6599d2e851 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:08.167864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35defc8a-fae5-40ad-b52a-4d6599d2e851 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:08.168184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35defc8a-fae5-40ad-b52a-4d6599d2e851 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:08.172578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35defc8a-fae5-40ad-b52a-4d6599d2e851 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:08.173750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35defc8a-fae5-40ad-b52a-4d6599d2e851 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:08.174818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35defc8a-fae5-40ad-b52a-4d6599d2e851 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:08.175424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35defc8a-fae5-40ad-b52a-4d6599d2e851 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:08.408172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:17:08.408903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:17:08.409363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:17:08.410057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:17:08.410579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:17:08.448791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:08.450066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:08.452840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:08.456573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:08.457424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:08.461595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:08.501185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Getting quotas for project bc5872887aaa488fafcb94629d083630. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:17:08.508882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Getting quotas for user ef5f5a1ba1e7414a82fff09abe84a931 and project bc5872887aaa488fafcb94629d083630. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:17:08.545402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:17:08.548820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:17:08.645161 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e1596b79-49b2-453e-852c-2f83bcb9ffd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.038281 Aug 23 18:17:08.647169 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2549/5194] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:17:07 2022] POST /compute/v2.1/servers => generated 406 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:17:08.668859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ccc27a91-9fb0-478a-9183-6f97ade5f091 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:08.672522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ccc27a91-9fb0-478a-9183-6f97ade5f091 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:08.684019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc27a91-9fb0-478a-9183-6f97ade5f091 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:08.685086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc27a91-9fb0-478a-9183-6f97ade5f091 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:08.685707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc27a91-9fb0-478a-9183-6f97ade5f091 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:08.686858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc27a91-9fb0-478a-9183-6f97ade5f091 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:08.688894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc27a91-9fb0-478a-9183-6f97ade5f091 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:08.689573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccc27a91-9fb0-478a-9183-6f97ade5f091 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:08.736884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-35defc8a-fae5-40ad-b52a-4d6599d2e851 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:08.752360 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-35defc8a-fae5-40ad-b52a-4d6599d2e851 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.605457 Aug 23 18:17:08.763311 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2646/5195] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:08 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:08.779021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ccd4d110-3a32-49bb-b896-acdef0a7a23e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:08.782216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ccd4d110-3a32-49bb-b896-acdef0a7a23e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:08.906692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ccc27a91-9fb0-478a-9183-6f97ade5f091 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:08.913502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ccd4d110-3a32-49bb-b896-acdef0a7a23e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:08.919675 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ccc27a91-9fb0-478a-9183-6f97ade5f091 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1267 microversion: 2.1 time: 0.261422 Aug 23 18:17:08.923637 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2550/5196] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:08 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1267 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:08.934449 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ccd4d110-3a32-49bb-b896-acdef0a7a23e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1248 microversion: 2.1 time: 0.165940 Aug 23 18:17:08.935848 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2647/5197] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:08 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1248 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:09.775578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-99839968-c63d-4ab3-aa55-bbd4e4127621 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:09.777909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-99839968-c63d-4ab3-aa55-bbd4e4127621 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:09.793410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99839968-c63d-4ab3-aa55-bbd4e4127621 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:09.793933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99839968-c63d-4ab3-aa55-bbd4e4127621 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:09.798311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99839968-c63d-4ab3-aa55-bbd4e4127621 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:09.799176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99839968-c63d-4ab3-aa55-bbd4e4127621 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:09.799703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99839968-c63d-4ab3-aa55-bbd4e4127621 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:09.800137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99839968-c63d-4ab3-aa55-bbd4e4127621 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:09.960536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-27832554-ddf0-47b0-96af-f081c82c9645 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:09.961156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-27832554-ddf0-47b0-96af-f081c82c9645 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:09.971869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27832554-ddf0-47b0-96af-f081c82c9645 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:09.972639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27832554-ddf0-47b0-96af-f081c82c9645 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:09.973250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27832554-ddf0-47b0-96af-f081c82c9645 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:09.974245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27832554-ddf0-47b0-96af-f081c82c9645 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:09.990814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27832554-ddf0-47b0-96af-f081c82c9645 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:09.991275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27832554-ddf0-47b0-96af-f081c82c9645 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:10.347370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-99839968-c63d-4ab3-aa55-bbd4e4127621 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:10.365110 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-99839968-c63d-4ab3-aa55-bbd4e4127621 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.592844 Aug 23 18:17:10.368078 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2551/5198] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:09 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:10.378215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0469bf45-32f9-4ecd-8c5d-13e5d07e37b2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:10.379474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0469bf45-32f9-4ecd-8c5d-13e5d07e37b2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:10.391875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-27832554-ddf0-47b0-96af-f081c82c9645 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:10.399528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0469bf45-32f9-4ecd-8c5d-13e5d07e37b2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:10.400312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0469bf45-32f9-4ecd-8c5d-13e5d07e37b2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:10.400952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0469bf45-32f9-4ecd-8c5d-13e5d07e37b2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:10.402134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0469bf45-32f9-4ecd-8c5d-13e5d07e37b2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:10.402950 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-27832554-ddf0-47b0-96af-f081c82c9645 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1309 microversion: 2.1 time: 0.446882 Aug 23 18:17:10.404245 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2648/5199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:09 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1309 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:10.404442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0469bf45-32f9-4ecd-8c5d-13e5d07e37b2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:10.404896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0469bf45-32f9-4ecd-8c5d-13e5d07e37b2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:10.517096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0469bf45-32f9-4ecd-8c5d-13e5d07e37b2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:10.553683 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0469bf45-32f9-4ecd-8c5d-13e5d07e37b2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1300 microversion: 2.1 time: 0.184050 Aug 23 18:17:10.559064 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2552/5200] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:10 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1300 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:11.392378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9531fecd-cf57-4160-a164-15527ac8d8d3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:11.399116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9531fecd-cf57-4160-a164-15527ac8d8d3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:11.404513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-b9352d8f-5c0a-4a04-8b99-3f316d4cd29f req-616e869f-ff46-46ca-bedb-afd00bec7393 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e78af1d-a084-470c-a742-90fbf9fd4b43", "tag": "5e1e9a32-1eaf-439c-a37f-c780e4e2d8a8"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:11.427845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9531fecd-cf57-4160-a164-15527ac8d8d3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:11.430742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9531fecd-cf57-4160-a164-15527ac8d8d3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:11.431728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9531fecd-cf57-4160-a164-15527ac8d8d3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:11.435151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9531fecd-cf57-4160-a164-15527ac8d8d3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:11.438955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9531fecd-cf57-4160-a164-15527ac8d8d3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:11.439812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9531fecd-cf57-4160-a164-15527ac8d8d3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:11.445401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b9352d8f-5c0a-4a04-8b99-3f316d4cd29f req-616e869f-ff46-46ca-bedb-afd00bec7393 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:11.446279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b9352d8f-5c0a-4a04-8b99-3f316d4cd29f req-616e869f-ff46-46ca-bedb-afd00bec7393 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:11.447155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b9352d8f-5c0a-4a04-8b99-3f316d4cd29f req-616e869f-ff46-46ca-bedb-afd00bec7393 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:11.474294 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b9352d8f-5c0a-4a04-8b99-3f316d4cd29f req-616e869f-ff46-46ca-bedb-afd00bec7393 service nova] Creating event network-changed:5e1e9a32-1eaf-439c-a37f-c780e4e2d8a8 for instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 on n-h2-850468-16 Aug 23 18:17:11.490325 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-b9352d8f-5c0a-4a04-8b99-3f316d4cd29f req-616e869f-ff46-46ca-bedb-afd00bec7393 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106335 Aug 23 18:17:11.492690 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2649/5201] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:11.516903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33ceca07-e685-435f-894b-2268c065cfba tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:11.517220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33ceca07-e685-435f-894b-2268c065cfba tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:11.539345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33ceca07-e685-435f-894b-2268c065cfba tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:11.540217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33ceca07-e685-435f-894b-2268c065cfba tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:11.540837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33ceca07-e685-435f-894b-2268c065cfba tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:11.542215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33ceca07-e685-435f-894b-2268c065cfba tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:11.543005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33ceca07-e685-435f-894b-2268c065cfba tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:11.544236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33ceca07-e685-435f-894b-2268c065cfba tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:11.553790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:11.927693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9531fecd-cf57-4160-a164-15527ac8d8d3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:11.931589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:11.937669 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9531fecd-cf57-4160-a164-15527ac8d8d3 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.549383 Aug 23 18:17:11.962571 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2553/5202] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:11 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:11.968120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0466f9e2-741f-46d1-a646-e0f508a72b5a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:11.969038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0466f9e2-741f-46d1-a646-e0f508a72b5a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:11.976893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0466f9e2-741f-46d1-a646-e0f508a72b5a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:11.977770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0466f9e2-741f-46d1-a646-e0f508a72b5a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:11.978427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0466f9e2-741f-46d1-a646-e0f508a72b5a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:11.979378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0466f9e2-741f-46d1-a646-e0f508a72b5a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:11.980166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0466f9e2-741f-46d1-a646-e0f508a72b5a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:11.980789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0466f9e2-741f-46d1-a646-e0f508a72b5a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:12.027263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-33ceca07-e685-435f-894b-2268c065cfba tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:12.039630 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-33ceca07-e685-435f-894b-2268c065cfba tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1309 microversion: 2.1 time: 0.543585 Aug 23 18:17:12.054504 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2650/5203] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:11 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1309 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:12.130517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0466f9e2-741f-46d1-a646-e0f508a72b5a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:12.145549 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0466f9e2-741f-46d1-a646-e0f508a72b5a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1306 microversion: 2.1 time: 0.179905 Aug 23 18:17:12.147277 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2554/5204] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:11 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1306 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:12.973305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-551b3169-b241-4ac8-8d4a-ca37bad67136 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:12.975048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-551b3169-b241-4ac8-8d4a-ca37bad67136 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:12.988480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-551b3169-b241-4ac8-8d4a-ca37bad67136 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:12.992900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-551b3169-b241-4ac8-8d4a-ca37bad67136 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:12.997303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-551b3169-b241-4ac8-8d4a-ca37bad67136 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:12.998946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-551b3169-b241-4ac8-8d4a-ca37bad67136 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:12.999616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-551b3169-b241-4ac8-8d4a-ca37bad67136 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:13.000909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-551b3169-b241-4ac8-8d4a-ca37bad67136 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:13.071076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dddca2bf-2fba-44f0-b69a-36ea2e551ee7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:13.071724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dddca2bf-2fba-44f0-b69a-36ea2e551ee7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:13.078847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dddca2bf-2fba-44f0-b69a-36ea2e551ee7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:13.079334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dddca2bf-2fba-44f0-b69a-36ea2e551ee7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:13.079768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dddca2bf-2fba-44f0-b69a-36ea2e551ee7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:13.082110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dddca2bf-2fba-44f0-b69a-36ea2e551ee7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:13.082601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dddca2bf-2fba-44f0-b69a-36ea2e551ee7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:13.087014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dddca2bf-2fba-44f0-b69a-36ea2e551ee7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:13.407839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-551b3169-b241-4ac8-8d4a-ca37bad67136 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:13.417778 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-551b3169-b241-4ac8-8d4a-ca37bad67136 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.452537 Aug 23 18:17:13.431688 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2651/5205] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:12 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:13.438491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dc5e808a-cc16-4ea2-b819-fe902f229c19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:13.439878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc5e808a-cc16-4ea2-b819-fe902f229c19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:13.447071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc5e808a-cc16-4ea2-b819-fe902f229c19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:13.447955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc5e808a-cc16-4ea2-b819-fe902f229c19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:13.448568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc5e808a-cc16-4ea2-b819-fe902f229c19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:13.449552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc5e808a-cc16-4ea2-b819-fe902f229c19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:13.450299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc5e808a-cc16-4ea2-b819-fe902f229c19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:13.450915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc5e808a-cc16-4ea2-b819-fe902f229c19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:13.760461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dc5e808a-cc16-4ea2-b819-fe902f229c19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:13.772034 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dc5e808a-cc16-4ea2-b819-fe902f229c19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1374 microversion: 2.1 time: 0.339097 Aug 23 18:17:13.772750 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2652/5206] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:13 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1374 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:13.785038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dddca2bf-2fba-44f0-b69a-36ea2e551ee7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:13.808233 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dddca2bf-2fba-44f0-b69a-36ea2e551ee7 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1309 microversion: 2.1 time: 0.750386 Aug 23 18:17:13.809586 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2555/5207] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:13 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1309 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:14.444110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8561f1b8-a54d-4dbf-ab43-0922c4eb6925 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:14.444849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8561f1b8-a54d-4dbf-ab43-0922c4eb6925 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:14.451690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:14.453655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8561f1b8-a54d-4dbf-ab43-0922c4eb6925 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:14.455010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8561f1b8-a54d-4dbf-ab43-0922c4eb6925 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:14.455564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8561f1b8-a54d-4dbf-ab43-0922c4eb6925 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:14.456366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8561f1b8-a54d-4dbf-ab43-0922c4eb6925 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:14.457088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8561f1b8-a54d-4dbf-ab43-0922c4eb6925 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:14.458484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8561f1b8-a54d-4dbf-ab43-0922c4eb6925 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:14.726155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8561f1b8-a54d-4dbf-ab43-0922c4eb6925 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:14.743941 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8561f1b8-a54d-4dbf-ab43-0922c4eb6925 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.305300 Aug 23 18:17:14.744591 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2653/5208] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:14 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:14.797208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-88d888dc-170f-4e25-9380-806bde019506 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:14.798433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-88d888dc-170f-4e25-9380-806bde019506 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:14.813151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d888dc-170f-4e25-9380-806bde019506 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:14.814085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d888dc-170f-4e25-9380-806bde019506 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:14.814636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d888dc-170f-4e25-9380-806bde019506 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:14.815464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d888dc-170f-4e25-9380-806bde019506 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:14.816056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d888dc-170f-4e25-9380-806bde019506 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:14.816579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d888dc-170f-4e25-9380-806bde019506 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:14.831580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-243ce678-2088-4d1f-a380-5f78c6d89d5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:14.832403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-243ce678-2088-4d1f-a380-5f78c6d89d5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:14.844154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-243ce678-2088-4d1f-a380-5f78c6d89d5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:14.851477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-243ce678-2088-4d1f-a380-5f78c6d89d5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:14.852464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-243ce678-2088-4d1f-a380-5f78c6d89d5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:14.853520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-243ce678-2088-4d1f-a380-5f78c6d89d5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:14.854245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-243ce678-2088-4d1f-a380-5f78c6d89d5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:14.855175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-243ce678-2088-4d1f-a380-5f78c6d89d5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:15.094154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-243ce678-2088-4d1f-a380-5f78c6d89d5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:15.105471 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-243ce678-2088-4d1f-a380-5f78c6d89d5f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1309 microversion: 2.1 time: 0.277762 Aug 23 18:17:15.108313 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2654/5209] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:14 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1309 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:15.387445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d279d359-1e0a-41a3-8b85-2126bd451fc9 tempest-QuotasTestJSON-352683977 tempest-QuotasTestJSON-352683977-project] Calling method '.version_select at 0x7f27f1bdf040>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:15.488095 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d279d359-1e0a-41a3-8b85-2126bd451fc9 tempest-QuotasTestJSON-352683977 tempest-QuotasTestJSON-352683977-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/fb53ef849de54013a005ec7c70889728/defaults" status: 200 len: 371 microversion: 2.1 time: 0.378400 Aug 23 18:17:15.490072 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2655/5210] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 18:17:15 2022] GET /compute/v2.1/os-quota-sets/fb53ef849de54013a005ec7c70889728/defaults => generated 371 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:15.496780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-88d888dc-170f-4e25-9380-806bde019506 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:15.507935 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-88d888dc-170f-4e25-9380-806bde019506 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1374 microversion: 2.1 time: 0.718440 Aug 23 18:17:15.510715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adfbdb50-b6c9-466a-8a3d-a4c0ef6d17f8 tempest-QuotasTestJSON-352683977 tempest-QuotasTestJSON-352683977-project] Calling method '.version_select at 0x7f27ec492670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:15.514643 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2556/5211] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:14 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1374 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:15.669703 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-adfbdb50-b6c9-466a-8a3d-a4c0ef6d17f8 tempest-QuotasTestJSON-352683977 tempest-QuotasTestJSON-352683977-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/fb53ef849de54013a005ec7c70889728" status: 200 len: 371 microversion: 2.1 time: 0.164788 Aug 23 18:17:15.672468 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2656/5212] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Aug 23 18:17:15 2022] GET /compute/v2.1/os-quota-sets/fb53ef849de54013a005ec7c70889728 => generated 371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:15.688733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-712e25b7-2f93-40d4-bbff-3e6fe93946fa tempest-QuotasTestJSON-352683977 tempest-QuotasTestJSON-352683977-project] Calling method '.version_select at 0x7f27ecb25dc0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:15.769012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-71e1a245-26a3-4bb1-853f-342cdd14dbe4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:15.769987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-71e1a245-26a3-4bb1-853f-342cdd14dbe4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:15.789856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71e1a245-26a3-4bb1-853f-342cdd14dbe4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:15.790798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71e1a245-26a3-4bb1-853f-342cdd14dbe4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:15.791578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71e1a245-26a3-4bb1-853f-342cdd14dbe4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:15.792520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71e1a245-26a3-4bb1-853f-342cdd14dbe4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:15.793154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71e1a245-26a3-4bb1-853f-342cdd14dbe4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:15.793764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-71e1a245-26a3-4bb1-853f-342cdd14dbe4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:15.855819 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-712e25b7-2f93-40d4-bbff-3e6fe93946fa tempest-QuotasTestJSON-352683977 tempest-QuotasTestJSON-352683977-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/fb53ef849de54013a005ec7c70889728/defaults" status: 200 len: 371 microversion: 2.1 time: 0.172025 Aug 23 18:17:15.858590 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2557/5213] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 18:17:15 2022] GET /compute/v2.1/os-quota-sets/fb53ef849de54013a005ec7c70889728/defaults => generated 371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:15.874799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-454258bd-a8ba-4c73-bbf7-04e334b794ae tempest-QuotasTestJSON-352683977 tempest-QuotasTestJSON-352683977-project] Calling method '.version_select at 0x7f27f1c52790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:16.048111 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-454258bd-a8ba-4c73-bbf7-04e334b794ae tempest-QuotasTestJSON-352683977 tempest-QuotasTestJSON-352683977-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/fb53ef849de54013a005ec7c70889728" status: 200 len: 371 microversion: 2.1 time: 0.171730 Aug 23 18:17:16.048111 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2558/5214] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Aug 23 18:17:15 2022] GET /compute/v2.1/os-quota-sets/fb53ef849de54013a005ec7c70889728 => generated 371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:16.052621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-df61ccf9-d07f-4cfd-a7d9-3f40f042bbbc req-fcfc556a-afba-4125-b954-5137ea58c1d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ffff4ed-e3af-4618-b5ae-23b808a9b517", "tag": "6eab7cfd-2033-410c-9b8a-7a04eedb7c58"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:16.068615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-df61ccf9-d07f-4cfd-a7d9-3f40f042bbbc req-fcfc556a-afba-4125-b954-5137ea58c1d4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:16.069448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-df61ccf9-d07f-4cfd-a7d9-3f40f042bbbc req-fcfc556a-afba-4125-b954-5137ea58c1d4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:16.070138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-df61ccf9-d07f-4cfd-a7d9-3f40f042bbbc req-fcfc556a-afba-4125-b954-5137ea58c1d4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:16.083793 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-df61ccf9-d07f-4cfd-a7d9-3f40f042bbbc req-fcfc556a-afba-4125-b954-5137ea58c1d4 service nova] Creating event network-changed:6eab7cfd-2033-410c-9b8a-7a04eedb7c58 for instance 2ffff4ed-e3af-4618-b5ae-23b808a9b517 on n-h1-850468-16 Aug 23 18:17:16.090093 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-df61ccf9-d07f-4cfd-a7d9-3f40f042bbbc req-fcfc556a-afba-4125-b954-5137ea58c1d4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047206 Aug 23 18:17:16.091366 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2559/5215] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:16.097888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f9eb5557-ea18-4b70-a402-70d1bcda9e1f tempest-QuotasTestJSON-352683977 tempest-QuotasTestJSON-352683977-project] Calling method '.version_select at 0x7f27ecb25160>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:16.210741 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f9eb5557-ea18-4b70-a402-70d1bcda9e1f tempest-QuotasTestJSON-352683977 tempest-QuotasTestJSON-352683977-project] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/fb53ef849de54013a005ec7c70889728?user_id=632d3015401c4b7c8aa27bddcbfd8877" status: 200 len: 371 microversion: 2.1 time: 0.117781 Aug 23 18:17:16.212021 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2560/5216] 10.222.0.61 () {58 vars in 1323 bytes} [Tue Aug 23 18:17:16 2022] GET /compute/v2.1/os-quota-sets/fb53ef849de54013a005ec7c70889728?user_id=632d3015401c4b7c8aa27bddcbfd8877 => generated 371 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:16.218657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dbd76eb1-cecb-4d78-a875-39f2ba61aca5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:16.220216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dbd76eb1-cecb-4d78-a875-39f2ba61aca5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:16.230726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbd76eb1-cecb-4d78-a875-39f2ba61aca5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:16.231606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbd76eb1-cecb-4d78-a875-39f2ba61aca5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:16.232251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbd76eb1-cecb-4d78-a875-39f2ba61aca5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:16.233397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbd76eb1-cecb-4d78-a875-39f2ba61aca5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:16.234069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbd76eb1-cecb-4d78-a875-39f2ba61aca5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:16.236966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbd76eb1-cecb-4d78-a875-39f2ba61aca5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:16.257845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-71e1a245-26a3-4bb1-853f-342cdd14dbe4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:16.274716 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-71e1a245-26a3-4bb1-853f-342cdd14dbe4 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.508638 Aug 23 18:17:16.279004 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2657/5217] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:15 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:16.537399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7ca21e19-272f-4e5f-a74c-70e9f795eeac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:16.538031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7ca21e19-272f-4e5f-a74c-70e9f795eeac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:16.566170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ca21e19-272f-4e5f-a74c-70e9f795eeac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:16.571579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ca21e19-272f-4e5f-a74c-70e9f795eeac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:16.574571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ca21e19-272f-4e5f-a74c-70e9f795eeac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:16.577018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ca21e19-272f-4e5f-a74c-70e9f795eeac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:16.577533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ca21e19-272f-4e5f-a74c-70e9f795eeac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:16.580593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ca21e19-272f-4e5f-a74c-70e9f795eeac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:16.713348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dbd76eb1-cecb-4d78-a875-39f2ba61aca5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:16.728026 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dbd76eb1-cecb-4d78-a875-39f2ba61aca5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1309 microversion: 2.1 time: 0.514501 Aug 23 18:17:16.731403 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2561/5218] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:16 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1309 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:17.288459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7ca21e19-272f-4e5f-a74c-70e9f795eeac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:17.300960 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7ca21e19-272f-4e5f-a74c-70e9f795eeac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1374 microversion: 2.1 time: 0.767369 Aug 23 18:17:17.302066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cac29de4-64ed-4e5a-bc46-f2c2fbba6630 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:17.303392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cac29de4-64ed-4e5a-bc46-f2c2fbba6630 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:17.315597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cac29de4-64ed-4e5a-bc46-f2c2fbba6630 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:17.316439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cac29de4-64ed-4e5a-bc46-f2c2fbba6630 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:17.317844 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2658/5219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:16 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1374 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:17.319600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cac29de4-64ed-4e5a-bc46-f2c2fbba6630 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:17.320738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cac29de4-64ed-4e5a-bc46-f2c2fbba6630 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:17.322367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cac29de4-64ed-4e5a-bc46-f2c2fbba6630 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:17.326735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cac29de4-64ed-4e5a-bc46-f2c2fbba6630 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:17.753657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cac29de4-64ed-4e5a-bc46-f2c2fbba6630 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:17.753892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e028b2d2-e52a-4e69-bc0a-311ae61bee3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:17.754601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e028b2d2-e52a-4e69-bc0a-311ae61bee3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:17.770790 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cac29de4-64ed-4e5a-bc46-f2c2fbba6630 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.470678 Aug 23 18:17:17.773280 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2562/5220] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:17 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:17.789285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e028b2d2-e52a-4e69-bc0a-311ae61bee3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:17.793492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e028b2d2-e52a-4e69-bc0a-311ae61bee3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:17.793614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e028b2d2-e52a-4e69-bc0a-311ae61bee3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:17.799525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e028b2d2-e52a-4e69-bc0a-311ae61bee3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:17.802477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e028b2d2-e52a-4e69-bc0a-311ae61bee3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:17.803989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e028b2d2-e52a-4e69-bc0a-311ae61bee3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:18.327710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e973f590-3894-4990-ac33-0969697ff74c tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:18.328300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e973f590-3894-4990-ac33-0969697ff74c tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:18.352598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e973f590-3894-4990-ac33-0969697ff74c tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:18.355547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e973f590-3894-4990-ac33-0969697ff74c tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:18.357131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e973f590-3894-4990-ac33-0969697ff74c tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:18.360132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e973f590-3894-4990-ac33-0969697ff74c tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:18.360830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e973f590-3894-4990-ac33-0969697ff74c tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:18.364420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e973f590-3894-4990-ac33-0969697ff74c tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:18.484231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:18.576464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e028b2d2-e52a-4e69-bc0a-311ae61bee3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:18.600773 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e028b2d2-e52a-4e69-bc0a-311ae61bee3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1309 microversion: 2.1 time: 0.850048 Aug 23 18:17:18.602755 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2659/5221] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:17 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1309 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:18.744751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e973f590-3894-4990-ac33-0969697ff74c tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:18.768250 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e973f590-3894-4990-ac33-0969697ff74c tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1374 microversion: 2.1 time: 0.444467 Aug 23 18:17:18.768787 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2563/5222] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:18 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1374 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:18.799861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-57ca5288-9400-4ed7-8184-030ffb80b7ca tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:18.800601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-57ca5288-9400-4ed7-8184-030ffb80b7ca tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:18.816577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57ca5288-9400-4ed7-8184-030ffb80b7ca tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:18.819298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57ca5288-9400-4ed7-8184-030ffb80b7ca tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:18.819762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57ca5288-9400-4ed7-8184-030ffb80b7ca tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:18.821019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57ca5288-9400-4ed7-8184-030ffb80b7ca tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:18.823429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57ca5288-9400-4ed7-8184-030ffb80b7ca tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:18.825153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57ca5288-9400-4ed7-8184-030ffb80b7ca tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:19.100131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-57ca5288-9400-4ed7-8184-030ffb80b7ca tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:19.111949 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-57ca5288-9400-4ed7-8184-030ffb80b7ca tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.316997 Aug 23 18:17:19.112700 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2660/5223] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:18 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:19.628675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-04896675-4dd9-4e06-9bfe-bec668e2612d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:19.628675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-04896675-4dd9-4e06-9bfe-bec668e2612d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:19.648154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04896675-4dd9-4e06-9bfe-bec668e2612d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:19.651295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04896675-4dd9-4e06-9bfe-bec668e2612d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:19.652354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04896675-4dd9-4e06-9bfe-bec668e2612d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:19.654187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04896675-4dd9-4e06-9bfe-bec668e2612d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:19.656960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04896675-4dd9-4e06-9bfe-bec668e2612d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:19.657650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04896675-4dd9-4e06-9bfe-bec668e2612d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:19.800467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3e96e3ef-f037-4193-8964-29df97c93659 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:19.802009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3e96e3ef-f037-4193-8964-29df97c93659 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:19.821523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e96e3ef-f037-4193-8964-29df97c93659 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:19.827635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e96e3ef-f037-4193-8964-29df97c93659 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:19.828631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e96e3ef-f037-4193-8964-29df97c93659 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:19.830894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e96e3ef-f037-4193-8964-29df97c93659 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:19.833894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e96e3ef-f037-4193-8964-29df97c93659 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:19.835158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e96e3ef-f037-4193-8964-29df97c93659 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:20.032860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-04896675-4dd9-4e06-9bfe-bec668e2612d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:20.049648 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-04896675-4dd9-4e06-9bfe-bec668e2612d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1309 microversion: 2.1 time: 0.429205 Aug 23 18:17:20.051229 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2564/5224] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:19 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1309 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:20.142424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-84c52282-5b18-4c0b-b768-9473ee732bb9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:20.143226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-84c52282-5b18-4c0b-b768-9473ee732bb9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:20.152990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84c52282-5b18-4c0b-b768-9473ee732bb9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:20.155698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84c52282-5b18-4c0b-b768-9473ee732bb9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:20.157819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84c52282-5b18-4c0b-b768-9473ee732bb9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:20.159526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84c52282-5b18-4c0b-b768-9473ee732bb9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:20.160115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84c52282-5b18-4c0b-b768-9473ee732bb9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:20.161723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-84c52282-5b18-4c0b-b768-9473ee732bb9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:20.617722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-84c52282-5b18-4c0b-b768-9473ee732bb9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:20.627362 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-84c52282-5b18-4c0b-b768-9473ee732bb9 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.489267 Aug 23 18:17:20.628515 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2565/5225] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:20 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:20.869716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e96e3ef-f037-4193-8964-29df97c93659 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:20.882509 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3e96e3ef-f037-4193-8964-29df97c93659 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1374 microversion: 2.1 time: 1.093710 Aug 23 18:17:20.884122 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2661/5226] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:19 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1374 bytes in 1096 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:20.898000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2380e627-da9f-4728-a358-d0d8f2b322e0 req-5058ece9-6e89-457f-8154-e30a722be252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e78af1d-a084-470c-a742-90fbf9fd4b43", "name": "network-vif-plugged", "status": "completed", "tag": "5e1e9a32-1eaf-439c-a37f-c780e4e2d8a8"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:20.912673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2380e627-da9f-4728-a358-d0d8f2b322e0 req-5058ece9-6e89-457f-8154-e30a722be252 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:20.918385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2380e627-da9f-4728-a358-d0d8f2b322e0 req-5058ece9-6e89-457f-8154-e30a722be252 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:20.919783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2380e627-da9f-4728-a358-d0d8f2b322e0 req-5058ece9-6e89-457f-8154-e30a722be252 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:20.944360 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2380e627-da9f-4728-a358-d0d8f2b322e0 req-5058ece9-6e89-457f-8154-e30a722be252 service nova] Creating event network-vif-plugged:5e1e9a32-1eaf-439c-a37f-c780e4e2d8a8 for instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 on n-h2-850468-16 Aug 23 18:17:20.953684 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2380e627-da9f-4728-a358-d0d8f2b322e0 req-5058ece9-6e89-457f-8154-e30a722be252 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.321389 Aug 23 18:17:20.953684 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2566/5227] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:21.076318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5661c1df-af32-4577-9f87-7ba745092f10 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:21.077101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5661c1df-af32-4577-9f87-7ba745092f10 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:21.091314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5661c1df-af32-4577-9f87-7ba745092f10 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:21.091951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5661c1df-af32-4577-9f87-7ba745092f10 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:21.093717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5661c1df-af32-4577-9f87-7ba745092f10 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:21.096509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5661c1df-af32-4577-9f87-7ba745092f10 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:21.097164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5661c1df-af32-4577-9f87-7ba745092f10 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:21.097778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5661c1df-af32-4577-9f87-7ba745092f10 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:21.586954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5661c1df-af32-4577-9f87-7ba745092f10 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:21.599977 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5661c1df-af32-4577-9f87-7ba745092f10 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1309 microversion: 2.1 time: 0.528069 Aug 23 18:17:21.600900 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2662/5228] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:21 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1309 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:21.658918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e19c3d61-e51a-4309-9ff8-85424bd8f234 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:21.659966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e19c3d61-e51a-4309-9ff8-85424bd8f234 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:21.668350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e19c3d61-e51a-4309-9ff8-85424bd8f234 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:21.669128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e19c3d61-e51a-4309-9ff8-85424bd8f234 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:21.669771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e19c3d61-e51a-4309-9ff8-85424bd8f234 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:21.670883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e19c3d61-e51a-4309-9ff8-85424bd8f234 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:21.671519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e19c3d61-e51a-4309-9ff8-85424bd8f234 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:21.672313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e19c3d61-e51a-4309-9ff8-85424bd8f234 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:21.912490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8adc871b-4d43-4aa9-a640-277a14192ecf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:21.913988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8adc871b-4d43-4aa9-a640-277a14192ecf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:21.927562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8adc871b-4d43-4aa9-a640-277a14192ecf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:21.928321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8adc871b-4d43-4aa9-a640-277a14192ecf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:21.931854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8adc871b-4d43-4aa9-a640-277a14192ecf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:21.933283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8adc871b-4d43-4aa9-a640-277a14192ecf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:21.933862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8adc871b-4d43-4aa9-a640-277a14192ecf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:21.934500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8adc871b-4d43-4aa9-a640-277a14192ecf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:21.951018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e19c3d61-e51a-4309-9ff8-85424bd8f234 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:21.961949 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e19c3d61-e51a-4309-9ff8-85424bd8f234 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.312163 Aug 23 18:17:21.966290 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2567/5229] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:21 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:22.348098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8adc871b-4d43-4aa9-a640-277a14192ecf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:22.365081 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8adc871b-4d43-4aa9-a640-277a14192ecf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1374 microversion: 2.1 time: 0.452125 Aug 23 18:17:22.367401 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2663/5230] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:21 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1374 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:22.621179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5a01f8b2-5915-48ec-b992-53dbc6074b09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:22.622056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5a01f8b2-5915-48ec-b992-53dbc6074b09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:22.635850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a01f8b2-5915-48ec-b992-53dbc6074b09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:22.638620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a01f8b2-5915-48ec-b992-53dbc6074b09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:22.639244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a01f8b2-5915-48ec-b992-53dbc6074b09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:22.640240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a01f8b2-5915-48ec-b992-53dbc6074b09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:22.640967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a01f8b2-5915-48ec-b992-53dbc6074b09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:22.641663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a01f8b2-5915-48ec-b992-53dbc6074b09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:22.940444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bd37cf97-ff00-41f0-b8ff-c2019df9d641 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: .version_select at 0x7f27df7b8940>, body: {"keypair": {"name": "tempest-keypair-85746087", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFLntSsIKe4Ub8l8k470nrskLvaglw90S3LxceSZJRp3sO4RhxfUKnMWuDpl1U/wikBMMJQhbRj7cLnOVS0vM36oeakzLfTQ8g159Ttaoic84FUwsnrvzXWDWR3Rd8u7lw=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:22.965781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5a01f8b2-5915-48ec-b992-53dbc6074b09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:22.981664 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5a01f8b2-5915-48ec-b992-53dbc6074b09 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1309 microversion: 2.1 time: 0.362938 Aug 23 18:17:22.983633 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2568/5231] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:22 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1309 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:22.985927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-bd37cf97-ff00-41f0-b8ff-c2019df9d641 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:17:23.001589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5ab3e4e5-94b3-4e9c-8d4a-fdbe5fa65f54 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:23.002881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5ab3e4e5-94b3-4e9c-8d4a-fdbe5fa65f54 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:23.009411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-bd37cf97-ff00-41f0-b8ff-c2019df9d641 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for user a11d6c5120f24a448c1831ff925409c3 and project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:17:23.024302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ab3e4e5-94b3-4e9c-8d4a-fdbe5fa65f54 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:23.025707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ab3e4e5-94b3-4e9c-8d4a-fdbe5fa65f54 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:23.025877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ab3e4e5-94b3-4e9c-8d4a-fdbe5fa65f54 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:23.028188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ab3e4e5-94b3-4e9c-8d4a-fdbe5fa65f54 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:23.030572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ab3e4e5-94b3-4e9c-8d4a-fdbe5fa65f54 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:23.031974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ab3e4e5-94b3-4e9c-8d4a-fdbe5fa65f54 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:23.071833 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bd37cf97-ff00-41f0-b8ff-c2019df9d641 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.309314 Aug 23 18:17:23.073323 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2664/5232] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:17:22 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:23.340042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5ab3e4e5-94b3-4e9c-8d4a-fdbe5fa65f54 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:23.349720 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5ab3e4e5-94b3-4e9c-8d4a-fdbe5fa65f54 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.362516 Aug 23 18:17:23.355346 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2569/5233] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:22 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:23.389957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8de37124-84bb-4374-8023-830d00ef6571 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:23.390974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8de37124-84bb-4374-8023-830d00ef6571 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:23.404896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8de37124-84bb-4374-8023-830d00ef6571 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:23.405568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8de37124-84bb-4374-8023-830d00ef6571 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:23.406980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8de37124-84bb-4374-8023-830d00ef6571 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:23.408255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8de37124-84bb-4374-8023-830d00ef6571 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:23.418129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8de37124-84bb-4374-8023-830d00ef6571 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:23.418932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8de37124-84bb-4374-8023-830d00ef6571 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:23.652433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8de37124-84bb-4374-8023-830d00ef6571 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:23.663975 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8de37124-84bb-4374-8023-830d00ef6571 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1374 microversion: 2.1 time: 0.278115 Aug 23 18:17:23.665410 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2665/5234] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:23 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1374 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:24.011144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d0b07382-571e-4264-b2c0-ec03d53a56d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:24.011765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d0b07382-571e-4264-b2c0-ec03d53a56d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:24.019267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0b07382-571e-4264-b2c0-ec03d53a56d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:24.020726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0b07382-571e-4264-b2c0-ec03d53a56d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:24.021429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0b07382-571e-4264-b2c0-ec03d53a56d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:24.022414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0b07382-571e-4264-b2c0-ec03d53a56d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:24.023140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0b07382-571e-4264-b2c0-ec03d53a56d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:24.023809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d0b07382-571e-4264-b2c0-ec03d53a56d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:24.380706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f6bebd81-84c0-47b7-af29-4b0714b2ee3f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:24.381647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f6bebd81-84c0-47b7-af29-4b0714b2ee3f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:24.401278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6bebd81-84c0-47b7-af29-4b0714b2ee3f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:24.404471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6bebd81-84c0-47b7-af29-4b0714b2ee3f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:24.405581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6bebd81-84c0-47b7-af29-4b0714b2ee3f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:24.407801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6bebd81-84c0-47b7-af29-4b0714b2ee3f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:24.408538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6bebd81-84c0-47b7-af29-4b0714b2ee3f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:24.411314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6bebd81-84c0-47b7-af29-4b0714b2ee3f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:24.723128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f6bebd81-84c0-47b7-af29-4b0714b2ee3f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:24.733825 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f6bebd81-84c0-47b7-af29-4b0714b2ee3f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1522 microversion: 2.1 time: 0.359207 Aug 23 18:17:24.735405 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2666/5235] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:24 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1522 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:24.742232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d0b07382-571e-4264-b2c0-ec03d53a56d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:24.760184 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d0b07382-571e-4264-b2c0-ec03d53a56d3 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1309 microversion: 2.1 time: 0.752660 Aug 23 18:17:24.762713 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2570/5236] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:24 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1309 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:24.766302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-545df167-7fb2-45c1-a2cf-92e346dcf712 req-58c84af8-8693-493d-b625-71c921fd23c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ffff4ed-e3af-4618-b5ae-23b808a9b517", "name": "network-vif-plugged", "status": "completed", "tag": "6eab7cfd-2033-410c-9b8a-7a04eedb7c58"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:24.783479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f849615a-f95d-46f5-bc36-c9bfb508a262 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:24.784421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f849615a-f95d-46f5-bc36-c9bfb508a262 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:24.792487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-545df167-7fb2-45c1-a2cf-92e346dcf712 req-58c84af8-8693-493d-b625-71c921fd23c8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:24.793416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-545df167-7fb2-45c1-a2cf-92e346dcf712 req-58c84af8-8693-493d-b625-71c921fd23c8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:24.793990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-545df167-7fb2-45c1-a2cf-92e346dcf712 req-58c84af8-8693-493d-b625-71c921fd23c8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:24.804081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f849615a-f95d-46f5-bc36-c9bfb508a262 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:24.806307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f849615a-f95d-46f5-bc36-c9bfb508a262 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:24.806965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f849615a-f95d-46f5-bc36-c9bfb508a262 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:24.807882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f849615a-f95d-46f5-bc36-c9bfb508a262 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:24.808347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f849615a-f95d-46f5-bc36-c9bfb508a262 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:24.808789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f849615a-f95d-46f5-bc36-c9bfb508a262 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:24.823036 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-545df167-7fb2-45c1-a2cf-92e346dcf712 req-58c84af8-8693-493d-b625-71c921fd23c8 service nova] Creating event network-vif-plugged:6eab7cfd-2033-410c-9b8a-7a04eedb7c58 for instance 2ffff4ed-e3af-4618-b5ae-23b808a9b517 on n-h1-850468-16 Aug 23 18:17:24.835732 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-545df167-7fb2-45c1-a2cf-92e346dcf712 req-58c84af8-8693-493d-b625-71c921fd23c8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098825 Aug 23 18:17:24.837394 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2667/5237] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:25.402395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f849615a-f95d-46f5-bc36-c9bfb508a262 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:25.415484 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f849615a-f95d-46f5-bc36-c9bfb508a262 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1374 microversion: 2.1 time: 0.650146 Aug 23 18:17:25.417205 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2571/5238] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:24 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1374 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:25.764724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f6d9123-b14d-4d66-b674-215280b7c3ab tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:25.765510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4f6d9123-b14d-4d66-b674-215280b7c3ab tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:25.774278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f6d9123-b14d-4d66-b674-215280b7c3ab tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:25.775070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f6d9123-b14d-4d66-b674-215280b7c3ab tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:25.775738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f6d9123-b14d-4d66-b674-215280b7c3ab tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:25.776644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f6d9123-b14d-4d66-b674-215280b7c3ab tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:25.777286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f6d9123-b14d-4d66-b674-215280b7c3ab tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:25.777899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f6d9123-b14d-4d66-b674-215280b7c3ab tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:25.793146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7c4acceb-ef9d-4b9f-b8cf-e08186e6cb25 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:25.793861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7c4acceb-ef9d-4b9f-b8cf-e08186e6cb25 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:25.809293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c4acceb-ef9d-4b9f-b8cf-e08186e6cb25 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:25.809807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c4acceb-ef9d-4b9f-b8cf-e08186e6cb25 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:25.810905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c4acceb-ef9d-4b9f-b8cf-e08186e6cb25 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:25.812030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c4acceb-ef9d-4b9f-b8cf-e08186e6cb25 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:25.815559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c4acceb-ef9d-4b9f-b8cf-e08186e6cb25 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:25.834121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c4acceb-ef9d-4b9f-b8cf-e08186e6cb25 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:26.079683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4f6d9123-b14d-4d66-b674-215280b7c3ab tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:26.089716 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4f6d9123-b14d-4d66-b674-215280b7c3ab tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1502 microversion: 2.1 time: 0.335084 Aug 23 18:17:26.095124 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2668/5239] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:25 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1502 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:26.121932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a080e552-6386-4a05-89aa-25c7a373361c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Action: 'create', calling method: .version_select at 0x7f27df7e3670>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-749902507", "description": "tempest-description-539603433"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:26.202148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=16 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:26.447452 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a080e552-6386-4a05-89aa-25c7a373361c tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "POST /compute/v2.1/os-security-groups" status: 200 len: 249 microversion: 2.1 time: 0.322556 Aug 23 18:17:26.458065 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2669/5240] 10.222.0.61 () {60 vars in 1180 bytes} [Tue Aug 23 18:17:26 2022] POST /compute/v2.1/os-security-groups => generated 249 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:26.463774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e7157baf-bc91-4c30-9bef-400402651d19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:26.465933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e7157baf-bc91-4c30-9bef-400402651d19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:26.482371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7157baf-bc91-4c30-9bef-400402651d19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:26.485722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7157baf-bc91-4c30-9bef-400402651d19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:26.486456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7157baf-bc91-4c30-9bef-400402651d19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:26.489768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7157baf-bc91-4c30-9bef-400402651d19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:26.490517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7157baf-bc91-4c30-9bef-400402651d19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:26.491170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7157baf-bc91-4c30-9bef-400402651d19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:26.605588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7c4acceb-ef9d-4b9f-b8cf-e08186e6cb25 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:26.615050 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7c4acceb-ef9d-4b9f-b8cf-e08186e6cb25 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1490 microversion: 2.1 time: 0.827652 Aug 23 18:17:26.615762 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2572/5241] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:25 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1490 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:26.622115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f66ea371-3cf2-4354-acb9-49e49ab0e5c2 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-749902507"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:26.627359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f66ea371-3cf2-4354-acb9-49e49ab0e5c2 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:26.635207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f66ea371-3cf2-4354-acb9-49e49ab0e5c2 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:26.636584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f66ea371-3cf2-4354-acb9-49e49ab0e5c2 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:26.637879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f66ea371-3cf2-4354-acb9-49e49ab0e5c2 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:26.651334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f66ea371-3cf2-4354-acb9-49e49ab0e5c2 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:26.659089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f66ea371-3cf2-4354-acb9-49e49ab0e5c2 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:26.659865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f66ea371-3cf2-4354-acb9-49e49ab0e5c2 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:26.784414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e7157baf-bc91-4c30-9bef-400402651d19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:26.800571 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e7157baf-bc91-4c30-9bef-400402651d19 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1374 microversion: 2.1 time: 0.340810 Aug 23 18:17:26.801555 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2670/5242] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:26 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1374 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:26.808676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-09f942c0-fed5-4ee6-a9f2-39955d02eb28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2042635408"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:26.811925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-09f942c0-fed5-4ee6-a9f2-39955d02eb28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:26.822431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09f942c0-fed5-4ee6-a9f2-39955d02eb28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:26.823584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09f942c0-fed5-4ee6-a9f2-39955d02eb28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:26.824254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09f942c0-fed5-4ee6-a9f2-39955d02eb28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:26.826686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09f942c0-fed5-4ee6-a9f2-39955d02eb28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:26.827679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09f942c0-fed5-4ee6-a9f2-39955d02eb28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:26.828345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09f942c0-fed5-4ee6-a9f2-39955d02eb28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:26.874159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:26.950802 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-09f942c0-fed5-4ee6-a9f2-39955d02eb28 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "PUT /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1075 microversion: 2.1 time: 0.145978 Aug 23 18:17:26.952469 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2671/5243] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Aug 23 18:17:26 2022] PUT /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1075 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:26.976315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-714f2b0b-e7c3-4fd4-8c57-c91fcb1579f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:26.977428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-714f2b0b-e7c3-4fd4-8c57-c91fcb1579f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:26.993154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714f2b0b-e7c3-4fd4-8c57-c91fcb1579f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:26.994781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714f2b0b-e7c3-4fd4-8c57-c91fcb1579f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:26.999078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714f2b0b-e7c3-4fd4-8c57-c91fcb1579f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:27.000188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714f2b0b-e7c3-4fd4-8c57-c91fcb1579f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:27.001019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714f2b0b-e7c3-4fd4-8c57-c91fcb1579f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:27.002290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714f2b0b-e7c3-4fd4-8c57-c91fcb1579f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:27.298177 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.network.security_group_api [None req-f66ea371-3cf2-4354-acb9-49e49ab0e5c2 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Adding security group 86dbca9f-e1c5-4c33-8264-b974ae7ed5d6 to port ff840925-6785-4a00-a68f-0086858b81eb Aug 23 18:17:27.583149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-714f2b0b-e7c3-4fd4-8c57-c91fcb1579f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:27.597792 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-714f2b0b-e7c3-4fd4-8c57-c91fcb1579f4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1501 microversion: 2.1 time: 0.626757 Aug 23 18:17:27.611529 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2672/5244] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:26 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1501 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:27.638331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fddb40c6-d476-4916-9f3f-e008ca200e1d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:27.640628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fddb40c6-d476-4916-9f3f-e008ca200e1d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:27.659465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fddb40c6-d476-4916-9f3f-e008ca200e1d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:27.660088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fddb40c6-d476-4916-9f3f-e008ca200e1d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:27.661021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fddb40c6-d476-4916-9f3f-e008ca200e1d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:27.661752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fddb40c6-d476-4916-9f3f-e008ca200e1d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:27.662426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fddb40c6-d476-4916-9f3f-e008ca200e1d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:27.662895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fddb40c6-d476-4916-9f3f-e008ca200e1d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:27.944299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fddb40c6-d476-4916-9f3f-e008ca200e1d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:27.962570 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fddb40c6-d476-4916-9f3f-e008ca200e1d tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1501 microversion: 2.1 time: 0.341373 Aug 23 18:17:27.965069 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2673/5245] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:27 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1501 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:27.990488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ebee7a9d-6d56-402d-959e-3c5f7351f9aa tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:27.991429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ebee7a9d-6d56-402d-959e-3c5f7351f9aa tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:28.012811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebee7a9d-6d56-402d-959e-3c5f7351f9aa tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:28.014577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebee7a9d-6d56-402d-959e-3c5f7351f9aa tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:28.016816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebee7a9d-6d56-402d-959e-3c5f7351f9aa tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:28.017804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebee7a9d-6d56-402d-959e-3c5f7351f9aa tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:28.018832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebee7a9d-6d56-402d-959e-3c5f7351f9aa tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:28.021212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebee7a9d-6d56-402d-959e-3c5f7351f9aa tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:28.365221 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f66ea371-3cf2-4354-acb9-49e49ab0e5c2 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "POST /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07/action" status: 202 len: 0 microversion: 2.1 time: 1.746728 Aug 23 18:17:28.365866 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2573/5246] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:17:26 2022] POST /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07/action => generated 0 bytes in 1750 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:17:28.371575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8f33abc6-11ef-4e7e-b532-5c3af5454ad0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:28.386212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f33abc6-11ef-4e7e-b532-5c3af5454ad0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:28.386754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f33abc6-11ef-4e7e-b532-5c3af5454ad0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:28.387202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f33abc6-11ef-4e7e-b532-5c3af5454ad0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:28.464098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8f33abc6-11ef-4e7e-b532-5c3af5454ad0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Going to try to stop instance {{(pid=128807) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 18:17:28.521086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:28.563509 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8f33abc6-11ef-4e7e-b532-5c3af5454ad0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "POST /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43/action" status: 202 len: 0 microversion: 2.1 time: 0.195326 Aug 23 18:17:28.573442 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2574/5247] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:17:28 2022] POST /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43/action => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:17:28.590856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1399487465", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80f627cf-1c5b-45c1-a064-49e8b550df67"}], "security_groups": [{"name": "tempest-securitygroup--1220467521"}], "key_name": "tempest-keypair-85746087", "user_data": "}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:28.714567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ebee7a9d-6d56-402d-959e-3c5f7351f9aa tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:28.726650 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ebee7a9d-6d56-402d-959e-3c5f7351f9aa tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1547 microversion: 2.1 time: 0.758459 Aug 23 18:17:28.727811 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2674/5248] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:27 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1547 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:28.733843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f10efd4-177d-4e6d-a4af-56e4745e5897 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-749902507"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:28.734697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8f10efd4-177d-4e6d-a4af-56e4745e5897 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:28.743997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f10efd4-177d-4e6d-a4af-56e4745e5897 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:28.744784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f10efd4-177d-4e6d-a4af-56e4745e5897 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:28.745393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f10efd4-177d-4e6d-a4af-56e4745e5897 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:28.746752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f10efd4-177d-4e6d-a4af-56e4745e5897 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:28.747449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f10efd4-177d-4e6d-a4af-56e4745e5897 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:28.748487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f10efd4-177d-4e6d-a4af-56e4745e5897 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:28.805386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] validate_networks() for [('80f627cf-1c5b-45c1-a064-49e8b550df67', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:17:29.100395 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.network.security_group_api [None req-8f10efd4-177d-4e6d-a4af-56e4745e5897 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Removing security group 86dbca9f-e1c5-4c33-8264-b974ae7ed5d6 from port ff840925-6785-4a00-a68f-0086858b81eb Aug 23 18:17:29.697556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:17:29.698040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:17:29.698452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:17:29.699032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:17:29.699456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:17:29.714366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:29.715339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:29.717069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:29.718212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:29.718970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:29.719797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:29.748542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:17:29.758264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for user a11d6c5120f24a448c1831ff925409c3 and project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:17:29.776772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:17:29.781129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:17:29.852645 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e57deb7-5d57-465f-8d6f-28fe5192dd6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.279118 Aug 23 18:17:29.854587 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2575/5249] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:17:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 1282 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:17:29.866735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-9025983f-b647-422a-ba47-df1a0bba5e9e req-2edebbf7-97ea-4ea5-825b-ab07765cc4d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5480cb09-9eb4-48d7-8bbe-88de71af3b07", "tag": "ff840925-6785-4a00-a68f-0086858b81eb"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:29.886273 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f10efd4-177d-4e6d-a4af-56e4745e5897 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "POST /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07/action" status: 202 len: 0 microversion: 2.1 time: 1.157078 Aug 23 18:17:29.887982 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2675/5250] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:17:28 2022] POST /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07/action => generated 0 bytes in 1159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:17:29.899024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c32d19e6-0933-47d3-85bb-774aa94c2fe9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:29.900029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c32d19e6-0933-47d3-85bb-774aa94c2fe9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:29.905297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9025983f-b647-422a-ba47-df1a0bba5e9e req-2edebbf7-97ea-4ea5-825b-ab07765cc4d3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:29.905787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9025983f-b647-422a-ba47-df1a0bba5e9e req-2edebbf7-97ea-4ea5-825b-ab07765cc4d3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:29.906233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9025983f-b647-422a-ba47-df1a0bba5e9e req-2edebbf7-97ea-4ea5-825b-ab07765cc4d3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:29.912002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c32d19e6-0933-47d3-85bb-774aa94c2fe9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:29.914018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c32d19e6-0933-47d3-85bb-774aa94c2fe9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:29.914888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c32d19e6-0933-47d3-85bb-774aa94c2fe9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:29.916102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c32d19e6-0933-47d3-85bb-774aa94c2fe9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:29.917565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c32d19e6-0933-47d3-85bb-774aa94c2fe9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:29.918226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c32d19e6-0933-47d3-85bb-774aa94c2fe9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:29.936052 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-9025983f-b647-422a-ba47-df1a0bba5e9e req-2edebbf7-97ea-4ea5-825b-ab07765cc4d3 service nova] Creating event network-changed:ff840925-6785-4a00-a68f-0086858b81eb for instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 on n-h2-850468-16 Aug 23 18:17:29.943991 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-9025983f-b647-422a-ba47-df1a0bba5e9e req-2edebbf7-97ea-4ea5-825b-ab07765cc4d3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087856 Aug 23 18:17:29.945073 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2576/5251] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:29.950246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-69116632-8c89-4c54-b09a-f7440375904a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:29.951216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-69116632-8c89-4c54-b09a-f7440375904a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:29.964108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69116632-8c89-4c54-b09a-f7440375904a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:29.966375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69116632-8c89-4c54-b09a-f7440375904a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:29.967124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69116632-8c89-4c54-b09a-f7440375904a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:29.970147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69116632-8c89-4c54-b09a-f7440375904a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:29.972651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69116632-8c89-4c54-b09a-f7440375904a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:29.976255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69116632-8c89-4c54-b09a-f7440375904a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:30.277336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-69116632-8c89-4c54-b09a-f7440375904a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:30.294249 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-69116632-8c89-4c54-b09a-f7440375904a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1547 microversion: 2.1 time: 0.346540 Aug 23 18:17:30.296180 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2577/5252] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:29 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1547 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:30.307935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2f346748-1b7a-4e1d-ba60-8ef5855aa814 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:30.312725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2f346748-1b7a-4e1d-ba60-8ef5855aa814 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:30.343264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:30.447617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2f346748-1b7a-4e1d-ba60-8ef5855aa814 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:30.463964 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2f346748-1b7a-4e1d-ba60-8ef5855aa814 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1240 microversion: 2.1 time: 0.161864 Aug 23 18:17:30.464943 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2578/5253] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:30 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1240 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:30.482070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-effbb079-0206-4a04-8609-d5178c0f8a79 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Action: 'create', calling method: .version_select at 0x7f27f1bdda60>, body: {"pool": null} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:30.969460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c32d19e6-0933-47d3-85bb-774aa94c2fe9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:30.980072 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c32d19e6-0933-47d3-85bb-774aa94c2fe9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 1.087720 Aug 23 18:17:31.001257 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2676/5254] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:29 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 1110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:31.010194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f6a5645f-b1f6-4667-a430-e3d7ff5d826f req-12175069-f34e-46c9-af68-3c76098d760c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5480cb09-9eb4-48d7-8bbe-88de71af3b07", "tag": "ff840925-6785-4a00-a68f-0086858b81eb"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:31.036507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:31.043307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f6a5645f-b1f6-4667-a430-e3d7ff5d826f req-12175069-f34e-46c9-af68-3c76098d760c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:31.044111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f6a5645f-b1f6-4667-a430-e3d7ff5d826f req-12175069-f34e-46c9-af68-3c76098d760c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:31.045713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f6a5645f-b1f6-4667-a430-e3d7ff5d826f req-12175069-f34e-46c9-af68-3c76098d760c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:31.060631 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f6a5645f-b1f6-4667-a430-e3d7ff5d826f req-12175069-f34e-46c9-af68-3c76098d760c service nova] Creating event network-changed:ff840925-6785-4a00-a68f-0086858b81eb for instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 on n-h2-850468-16 Aug 23 18:17:31.072284 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f6a5645f-b1f6-4667-a430-e3d7ff5d826f req-12175069-f34e-46c9-af68-3c76098d760c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069531 Aug 23 18:17:31.074431 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2677/5255] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:31.490655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-84e9c066-e5f0-4364-a719-6ec2715570d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:31.491769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-84e9c066-e5f0-4364-a719-6ec2715570d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:31.520999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e9c066-e5f0-4364-a719-6ec2715570d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:31.521519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e9c066-e5f0-4364-a719-6ec2715570d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:31.521970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e9c066-e5f0-4364-a719-6ec2715570d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:31.532179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e9c066-e5f0-4364-a719-6ec2715570d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:31.532754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e9c066-e5f0-4364-a719-6ec2715570d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:31.536563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84e9c066-e5f0-4364-a719-6ec2715570d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:31.763970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-84e9c066-e5f0-4364-a719-6ec2715570d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:31.779032 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-84e9c066-e5f0-4364-a719-6ec2715570d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1236 microversion: 2.1 time: 0.294529 Aug 23 18:17:31.780091 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2678/5256] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:31 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1236 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:31.802630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0218cf13-3d9c-452e-bcc5-41168067a503 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:31.803973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0218cf13-3d9c-452e-bcc5-41168067a503 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:31.811903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0218cf13-3d9c-452e-bcc5-41168067a503 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:31.812621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0218cf13-3d9c-452e-bcc5-41168067a503 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:31.813276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0218cf13-3d9c-452e-bcc5-41168067a503 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:31.814050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0218cf13-3d9c-452e-bcc5-41168067a503 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:31.814769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0218cf13-3d9c-452e-bcc5-41168067a503 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:31.815207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0218cf13-3d9c-452e-bcc5-41168067a503 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:32.242843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0218cf13-3d9c-452e-bcc5-41168067a503 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:32.257337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0218cf13-3d9c-452e-bcc5-41168067a503 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:32.258979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0218cf13-3d9c-452e-bcc5-41168067a503 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:32.260483 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0218cf13-3d9c-452e-bcc5-41168067a503 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 2955 microversion: 2.42 time: 0.478801 Aug 23 18:17:32.261395 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2679/5257] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:31 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 2955 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:32.266518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-931c9027-0bd8-4859-8a44-f936085920df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:32.267561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-931c9027-0bd8-4859-8a44-f936085920df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:32.283628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-931c9027-0bd8-4859-8a44-f936085920df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:32.284688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-931c9027-0bd8-4859-8a44-f936085920df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:32.286160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-931c9027-0bd8-4859-8a44-f936085920df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:32.287228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-931c9027-0bd8-4859-8a44-f936085920df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:32.287865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-931c9027-0bd8-4859-8a44-f936085920df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:32.288542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-931c9027-0bd8-4859-8a44-f936085920df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:32.636603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-931c9027-0bd8-4859-8a44-f936085920df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:32.646335 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-931c9027-0bd8-4859-8a44-f936085920df tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.383493 Aug 23 18:17:32.650290 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2680/5258] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:32 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:32.854586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1404a9b6-ac51-4ece-9125-8ce198499c0d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Action: 'create', calling method: .version_select at 0x7f27dfa279d0>, body: {"keypair": {"name": "tempest-keypair-1120815762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9yy/XTlqyLTWHy2zMpcD97ecQlpdfa0CVDKP01ixjp94QZrHNaUFm5iVHzuse4ax1su3mcg3/9mt2l7U9n5FCOj/w3JthbpTQlRJzuR5re88qUIa9PdEjVOhcm5B4xRA=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:32.875864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=17 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:32.882237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-1404a9b6-ac51-4ece-9125-8ce198499c0d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Getting quotas for project 261a311c2f2b480984ab2412ac78e881. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:17:32.892400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-1404a9b6-ac51-4ece-9125-8ce198499c0d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Getting quotas for user f43268df184e40b0b66655e5a6eaa07c and project 261a311c2f2b480984ab2412ac78e881. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:17:32.931991 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1404a9b6-ac51-4ece-9125-8ce198499c0d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.279426 Aug 23 18:17:32.932859 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2681/5259] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Aug 23 18:17:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 281 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 18:17:32.945794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a83b4a1a-e501-4567-b035-6bfee34417a0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:32.947988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a83b4a1a-e501-4567-b035-6bfee34417a0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:32.967446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a83b4a1a-e501-4567-b035-6bfee34417a0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:32.968018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a83b4a1a-e501-4567-b035-6bfee34417a0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:32.970167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a83b4a1a-e501-4567-b035-6bfee34417a0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:32.970962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a83b4a1a-e501-4567-b035-6bfee34417a0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:32.975914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a83b4a1a-e501-4567-b035-6bfee34417a0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:32.976915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a83b4a1a-e501-4567-b035-6bfee34417a0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:33.196546 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a83b4a1a-e501-4567-b035-6bfee34417a0 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3/os-interface" status: 200 len: 1831 microversion: 2.42 time: 0.262399 Aug 23 18:17:33.198074 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2682/5260] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Aug 23 18:17:32 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3/os-interface => generated 1831 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:33.210931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f67b2862-64e0-4695-a1bc-e96ae4309eb2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:33.211739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f67b2862-64e0-4695-a1bc-e96ae4309eb2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:33.224547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f67b2862-64e0-4695-a1bc-e96ae4309eb2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:33.225597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f67b2862-64e0-4695-a1bc-e96ae4309eb2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:33.226242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f67b2862-64e0-4695-a1bc-e96ae4309eb2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:33.227201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f67b2862-64e0-4695-a1bc-e96ae4309eb2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:33.227860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f67b2862-64e0-4695-a1bc-e96ae4309eb2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:33.228489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f67b2862-64e0-4695-a1bc-e96ae4309eb2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:33.408685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f67b2862-64e0-4695-a1bc-e96ae4309eb2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:33.420793 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f67b2862-64e0-4695-a1bc-e96ae4309eb2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1298 microversion: 2.1 time: 0.221325 Aug 23 18:17:33.424629 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2683/5261] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:33 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1298 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:33.671479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d4359fd6-f356-4730-8c78-5f57189f9d01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:33.672107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d4359fd6-f356-4730-8c78-5f57189f9d01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:33.690583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4359fd6-f356-4730-8c78-5f57189f9d01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:33.691259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4359fd6-f356-4730-8c78-5f57189f9d01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:33.691760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4359fd6-f356-4730-8c78-5f57189f9d01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:33.692611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4359fd6-f356-4730-8c78-5f57189f9d01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:33.693176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4359fd6-f356-4730-8c78-5f57189f9d01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:33.693493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4359fd6-f356-4730-8c78-5f57189f9d01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:33.965231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d4359fd6-f356-4730-8c78-5f57189f9d01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:33.976405 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d4359fd6-f356-4730-8c78-5f57189f9d01 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.309003 Aug 23 18:17:33.977428 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2684/5262] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:33 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:34.459908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-49ed5ebb-6d72-4124-8d09-dd4832994ca8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:34.461896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-49ed5ebb-6d72-4124-8d09-dd4832994ca8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:34.488751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49ed5ebb-6d72-4124-8d09-dd4832994ca8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:34.489776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49ed5ebb-6d72-4124-8d09-dd4832994ca8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:34.490397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49ed5ebb-6d72-4124-8d09-dd4832994ca8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:34.496422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49ed5ebb-6d72-4124-8d09-dd4832994ca8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:34.497106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49ed5ebb-6d72-4124-8d09-dd4832994ca8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:34.497868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49ed5ebb-6d72-4124-8d09-dd4832994ca8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:34.691194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-49ed5ebb-6d72-4124-8d09-dd4832994ca8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:34.706127 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-49ed5ebb-6d72-4124-8d09-dd4832994ca8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1298 microversion: 2.1 time: 0.259793 Aug 23 18:17:34.706993 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2685/5263] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:34 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1298 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:34.998704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e77d0ea9-4ae0-4161-877e-2a05a676644c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:34.999615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e77d0ea9-4ae0-4161-877e-2a05a676644c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:35.020360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e77d0ea9-4ae0-4161-877e-2a05a676644c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:35.021061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e77d0ea9-4ae0-4161-877e-2a05a676644c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:35.021811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e77d0ea9-4ae0-4161-877e-2a05a676644c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:35.023790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e77d0ea9-4ae0-4161-877e-2a05a676644c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:35.025490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e77d0ea9-4ae0-4161-877e-2a05a676644c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:35.027708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e77d0ea9-4ae0-4161-877e-2a05a676644c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:35.436821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e77d0ea9-4ae0-4161-877e-2a05a676644c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:35.462507 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e77d0ea9-4ae0-4161-877e-2a05a676644c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.466769 Aug 23 18:17:35.464613 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2686/5264] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:34 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:35.732125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0425d5eb-6a1d-4557-9927-3683eb441b2c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:35.732930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0425d5eb-6a1d-4557-9927-3683eb441b2c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:35.751060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0425d5eb-6a1d-4557-9927-3683eb441b2c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:35.752205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0425d5eb-6a1d-4557-9927-3683eb441b2c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:35.755666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0425d5eb-6a1d-4557-9927-3683eb441b2c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:35.757060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0425d5eb-6a1d-4557-9927-3683eb441b2c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:35.757932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0425d5eb-6a1d-4557-9927-3683eb441b2c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:35.758937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0425d5eb-6a1d-4557-9927-3683eb441b2c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:36.017794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0425d5eb-6a1d-4557-9927-3683eb441b2c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:36.028642 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0425d5eb-6a1d-4557-9927-3683eb441b2c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1366 microversion: 2.1 time: 0.302975 Aug 23 18:17:36.029555 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2687/5265] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:35 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:36.035491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-570573470", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b051757f-c56b-4439-bfab-5529d042b27d"}], "security_groups": [{"name": "tempest-securitygroup--1940233167"}], "key_name": "tempest-keypair-1120815762", "user_data": "}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:36.152927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] validate_networks() for [('b051757f-c56b-4439-bfab-5529d042b27d', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:17:36.230292 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-effbb079-0206-4a04-8609-d5178c0f8a79 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 5.763590 Aug 23 18:17:36.231820 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2579/5266] 10.222.0.61 () {60 vars in 1170 bytes} [Tue Aug 23 18:17:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 5766 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:36.248313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.9.122"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:36.254956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:36.275384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:36.276621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:36.277648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:36.278582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:36.280150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:36.280788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:36.325810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "refresh_cache-5480cb09-9eb4-48d7-8bbe-88de71af3b07" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 18:17:36.326236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquired lock "refresh_cache-5480cb09-9eb4-48d7-8bbe-88de71af3b07" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 18:17:37.094422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:17:37.095145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:17:37.097309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:17:37.097884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:17:37.099877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:17:37.142382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:37.143160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:37.144208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:37.146206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:37.147048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:37.150707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:37.185372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Getting quotas for project 261a311c2f2b480984ab2412ac78e881. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:17:37.192635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Getting quotas for user f43268df184e40b0b66655e5a6eaa07c and project 261a311c2f2b480984ab2412ac78e881. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:17:37.208805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:17:37.211672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:17:37.297325 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-15dc2fc4-dbbe-46fd-9a33-88187e3a1795 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.266486 Aug 23 18:17:37.298661 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2688/5267] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 18:17:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 1268 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 18:17:37.306246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-99e595fb-1e32-4327-9094-56f82c9a2cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:37.307633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-99e595fb-1e32-4327-9094-56f82c9a2cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:37.323985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99e595fb-1e32-4327-9094-56f82c9a2cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:37.326702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99e595fb-1e32-4327-9094-56f82c9a2cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:37.327332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99e595fb-1e32-4327-9094-56f82c9a2cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:37.328228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99e595fb-1e32-4327-9094-56f82c9a2cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:37.328965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99e595fb-1e32-4327-9094-56f82c9a2cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:37.329555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99e595fb-1e32-4327-9094-56f82c9a2cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:37.658338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-99e595fb-1e32-4327-9094-56f82c9a2cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:37.672021 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-99e595fb-1e32-4327-9094-56f82c9a2cc9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.371298 Aug 23 18:17:37.673772 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2689/5268] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:37 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:37.684440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-35629d67-538a-47d0-b997-20f9b25f6a1c req-6ce559a9-0dbd-4a92-874c-b243f4c2839d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ffff4ed-e3af-4618-b5ae-23b808a9b517", "tag": "6eab7cfd-2033-410c-9b8a-7a04eedb7c58"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:37.700890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-35629d67-538a-47d0-b997-20f9b25f6a1c req-6ce559a9-0dbd-4a92-874c-b243f4c2839d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:37.702381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-35629d67-538a-47d0-b997-20f9b25f6a1c req-6ce559a9-0dbd-4a92-874c-b243f4c2839d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:37.703905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-35629d67-538a-47d0-b997-20f9b25f6a1c req-6ce559a9-0dbd-4a92-874c-b243f4c2839d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:37.730776 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-35629d67-538a-47d0-b997-20f9b25f6a1c req-6ce559a9-0dbd-4a92-874c-b243f4c2839d service nova] Creating event network-changed:6eab7cfd-2033-410c-9b8a-7a04eedb7c58 for instance 2ffff4ed-e3af-4618-b5ae-23b808a9b517 on n-h1-850468-16 Aug 23 18:17:37.739274 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-35629d67-538a-47d0-b997-20f9b25f6a1c req-6ce559a9-0dbd-4a92-874c-b243f4c2839d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062225 Aug 23 18:17:37.740489 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2690/5269] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:37.749586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e862ba36-60f7-4025-a107-72342f1d0454 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:37.750657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e862ba36-60f7-4025-a107-72342f1d0454 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:37.758748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e862ba36-60f7-4025-a107-72342f1d0454 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:37.760015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e862ba36-60f7-4025-a107-72342f1d0454 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:37.760796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e862ba36-60f7-4025-a107-72342f1d0454 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:37.763006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e862ba36-60f7-4025-a107-72342f1d0454 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:37.763710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e862ba36-60f7-4025-a107-72342f1d0454 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:37.764367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e862ba36-60f7-4025-a107-72342f1d0454 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:37.772785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:38.165486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e862ba36-60f7-4025-a107-72342f1d0454 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:38.180529 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e862ba36-60f7-4025-a107-72342f1d0454 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1366 microversion: 2.1 time: 0.436603 Aug 23 18:17:38.182004 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2691/5270] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:37 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1366 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:38.187253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d2eea9ab-b03b-4416-a780-78200d2c2f71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:38.188085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d2eea9ab-b03b-4416-a780-78200d2c2f71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:38.258386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d2eea9ab-b03b-4416-a780-78200d2c2f71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:38.273908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d2eea9ab-b03b-4416-a780-78200d2c2f71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:38.277063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d2eea9ab-b03b-4416-a780-78200d2c2f71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:38.278747 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d2eea9ab-b03b-4416-a780-78200d2c2f71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1281 microversion: 2.20 time: 0.095131 Aug 23 18:17:38.279575 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2692/5271] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:38 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1281 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:38.706594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a2e6127-c90a-4ffa-85d5-2575e5af53b6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:38.708669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5a2e6127-c90a-4ffa-85d5-2575e5af53b6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:38.716648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a2e6127-c90a-4ffa-85d5-2575e5af53b6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:38.717597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a2e6127-c90a-4ffa-85d5-2575e5af53b6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:38.718527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a2e6127-c90a-4ffa-85d5-2575e5af53b6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:38.719491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a2e6127-c90a-4ffa-85d5-2575e5af53b6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:38.720160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a2e6127-c90a-4ffa-85d5-2575e5af53b6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:38.720798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a2e6127-c90a-4ffa-85d5-2575e5af53b6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:38.871011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5a2e6127-c90a-4ffa-85d5-2575e5af53b6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:38.880616 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a2e6127-c90a-4ffa-85d5-2575e5af53b6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.181343 Aug 23 18:17:38.881701 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2693/5272] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:38 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:39.205318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1448c065-cfa5-46dd-b567-ccb918539222 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:39.205998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1448c065-cfa5-46dd-b567-ccb918539222 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:39.214440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1448c065-cfa5-46dd-b567-ccb918539222 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:39.214977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1448c065-cfa5-46dd-b567-ccb918539222 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:39.215733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1448c065-cfa5-46dd-b567-ccb918539222 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:39.216448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1448c065-cfa5-46dd-b567-ccb918539222 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:39.216908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1448c065-cfa5-46dd-b567-ccb918539222 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:39.217338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1448c065-cfa5-46dd-b567-ccb918539222 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:39.457702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1448c065-cfa5-46dd-b567-ccb918539222 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:39.467922 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1448c065-cfa5-46dd-b567-ccb918539222 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1366 microversion: 2.1 time: 0.267581 Aug 23 18:17:39.493488 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2694/5273] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:39 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:39.499293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-272d1c06-1dbf-4abf-9501-8035aad07c41 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:39.500705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-272d1c06-1dbf-4abf-9501-8035aad07c41 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:39.508186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-272d1c06-1dbf-4abf-9501-8035aad07c41 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:39.509585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-272d1c06-1dbf-4abf-9501-8035aad07c41 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:39.510227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-272d1c06-1dbf-4abf-9501-8035aad07c41 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:39.511141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-272d1c06-1dbf-4abf-9501-8035aad07c41 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:39.511765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-272d1c06-1dbf-4abf-9501-8035aad07c41 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:39.512478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-272d1c06-1dbf-4abf-9501-8035aad07c41 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:39.601312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-272d1c06-1dbf-4abf-9501-8035aad07c41 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:39.612003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-272d1c06-1dbf-4abf-9501-8035aad07c41 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:39.616579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-272d1c06-1dbf-4abf-9501-8035aad07c41 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:39.618054 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-272d1c06-1dbf-4abf-9501-8035aad07c41 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1339 microversion: 2.20 time: 0.123008 Aug 23 18:17:39.618825 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2695/5274] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:39 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1339 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:39.729915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:39.797463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-ed0cd9f4-9955-4e4b-a5d8-fea6f73c1faa req-1dc0cba8-25b7-440b-a9e7-b8096edfedf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c1c0a9-6679-4485-a539-9e2d5b10c64b", "tag": "a6a4fdaf-b1bf-4a1e-a4d7-c4f0f5806cb9"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:39.810768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ed0cd9f4-9955-4e4b-a5d8-fea6f73c1faa req-1dc0cba8-25b7-440b-a9e7-b8096edfedf2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:39.811775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ed0cd9f4-9955-4e4b-a5d8-fea6f73c1faa req-1dc0cba8-25b7-440b-a9e7-b8096edfedf2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:39.812474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ed0cd9f4-9955-4e4b-a5d8-fea6f73c1faa req-1dc0cba8-25b7-440b-a9e7-b8096edfedf2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:39.826310 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-ed0cd9f4-9955-4e4b-a5d8-fea6f73c1faa req-1dc0cba8-25b7-440b-a9e7-b8096edfedf2 service nova] Creating event network-changed:a6a4fdaf-b1bf-4a1e-a4d7-c4f0f5806cb9 for instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b on n-h1-850468-16 Aug 23 18:17:39.833121 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-ed0cd9f4-9955-4e4b-a5d8-fea6f73c1faa req-1dc0cba8-25b7-440b-a9e7-b8096edfedf2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041102 Aug 23 18:17:39.834384 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2696/5275] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:17:39.848924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Building network info cache for instance {{(pid=128807) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 18:17:39.917331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-212c0ec2-a791-40d0-808e-0ed7d3792123 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:39.918065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-212c0ec2-a791-40d0-808e-0ed7d3792123 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:39.928573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-212c0ec2-a791-40d0-808e-0ed7d3792123 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:39.931259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-212c0ec2-a791-40d0-808e-0ed7d3792123 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:39.933130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-212c0ec2-a791-40d0-808e-0ed7d3792123 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:39.934230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-212c0ec2-a791-40d0-808e-0ed7d3792123 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:39.936991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-212c0ec2-a791-40d0-808e-0ed7d3792123 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:39.937514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-212c0ec2-a791-40d0-808e-0ed7d3792123 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:40.195805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-212c0ec2-a791-40d0-808e-0ed7d3792123 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:40.207752 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-212c0ec2-a791-40d0-808e-0ed7d3792123 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.308141 Aug 23 18:17:40.208609 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2697/5276] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:39 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:40.459396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:40.494405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48b28d95-82d2-460b-a1e1-93e6f7b7130d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:40.495207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-48b28d95-82d2-460b-a1e1-93e6f7b7130d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:40.507581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48b28d95-82d2-460b-a1e1-93e6f7b7130d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:40.508156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48b28d95-82d2-460b-a1e1-93e6f7b7130d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:40.508675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48b28d95-82d2-460b-a1e1-93e6f7b7130d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:40.510497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48b28d95-82d2-460b-a1e1-93e6f7b7130d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:40.511068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48b28d95-82d2-460b-a1e1-93e6f7b7130d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:40.512751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48b28d95-82d2-460b-a1e1-93e6f7b7130d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:40.520585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Updating instance_info_cache with network_info: [{"id": "ff840925-6785-4a00-a68f-0086858b81eb", "address": "fa:16:3e:ff:3a:c6", "network": {"id": "47e9e3fc-2241-4d42-b358-a9873aaf6e0b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-562807139-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.9.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb247a14dad45d68fc17c1f9c93818d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapff840925-67", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 18:17:40.539395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Releasing lock "refresh_cache-5480cb09-9eb4-48d7-8bbe-88de71af3b07" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 18:17:40.540557 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-16b27e07-4730-43ec-95d4-f7f4528f7817 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "POST /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07/action" status: 202 len: 0 microversion: 2.1 time: 4.300735 Aug 23 18:17:40.541726 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2580/5277] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:17:36 2022] POST /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07/action => generated 0 bytes in 4303 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 18:17:40.556195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.9.122"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:40.741016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:40.748849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:40.749806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:40.750838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:40.751571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:40.752036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:40.752467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:40.824175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-48b28d95-82d2-460b-a1e1-93e6f7b7130d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:40.836755 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48b28d95-82d2-460b-a1e1-93e6f7b7130d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1366 microversion: 2.1 time: 0.350802 Aug 23 18:17:40.837721 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2698/5278] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:40 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:40.853509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-43d00dc3-7eee-47b0-87ed-6c5325c8a669 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:40.854784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-43d00dc3-7eee-47b0-87ed-6c5325c8a669 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:40.862478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d00dc3-7eee-47b0-87ed-6c5325c8a669 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:40.863993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d00dc3-7eee-47b0-87ed-6c5325c8a669 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:40.864849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d00dc3-7eee-47b0-87ed-6c5325c8a669 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:40.865764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d00dc3-7eee-47b0-87ed-6c5325c8a669 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:40.866393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d00dc3-7eee-47b0-87ed-6c5325c8a669 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:40.867055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d00dc3-7eee-47b0-87ed-6c5325c8a669 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:41.018318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "refresh_cache-5480cb09-9eb4-48d7-8bbe-88de71af3b07" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 23 18:17:41.018775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquired lock "refresh_cache-5480cb09-9eb4-48d7-8bbe-88de71af3b07" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 23 18:17:41.162105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-43d00dc3-7eee-47b0-87ed-6c5325c8a669 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:41.197874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-43d00dc3-7eee-47b0-87ed-6c5325c8a669 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:41.203606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-43d00dc3-7eee-47b0-87ed-6c5325c8a669 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:41.205852 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-43d00dc3-7eee-47b0-87ed-6c5325c8a669 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1407 microversion: 2.20 time: 0.360420 Aug 23 18:17:41.210801 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2699/5279] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:40 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1407 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:41.231601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dcdf4c5c-938a-4ebc-9479-2beefe4cf681 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:41.232460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dcdf4c5c-938a-4ebc-9479-2beefe4cf681 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:41.239248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcdf4c5c-938a-4ebc-9479-2beefe4cf681 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:41.239942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcdf4c5c-938a-4ebc-9479-2beefe4cf681 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:41.240571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcdf4c5c-938a-4ebc-9479-2beefe4cf681 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:41.241470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcdf4c5c-938a-4ebc-9479-2beefe4cf681 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:41.245259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcdf4c5c-938a-4ebc-9479-2beefe4cf681 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:41.245946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcdf4c5c-938a-4ebc-9479-2beefe4cf681 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:41.565969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dcdf4c5c-938a-4ebc-9479-2beefe4cf681 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:41.574730 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dcdf4c5c-938a-4ebc-9479-2beefe4cf681 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.346768 Aug 23 18:17:41.575402 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2700/5280] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:41 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:41.595119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6e88c64e-7fcd-415f-9878-95e2f89e3386 req-45836530-4f55-4e59-a57d-63656097d35d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8fe0c3-ea81-46b5-9230-216cf8e932d2", "tag": "663bf035-ee8e-4ca7-aeb3-025d64e3d0e1"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:41.605817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6e88c64e-7fcd-415f-9878-95e2f89e3386 req-45836530-4f55-4e59-a57d-63656097d35d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:41.606295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6e88c64e-7fcd-415f-9878-95e2f89e3386 req-45836530-4f55-4e59-a57d-63656097d35d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:41.606754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6e88c64e-7fcd-415f-9878-95e2f89e3386 req-45836530-4f55-4e59-a57d-63656097d35d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:41.620195 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6e88c64e-7fcd-415f-9878-95e2f89e3386 req-45836530-4f55-4e59-a57d-63656097d35d service nova] Creating event network-changed:663bf035-ee8e-4ca7-aeb3-025d64e3d0e1 for instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 on n-h2-850468-16 Aug 23 18:17:41.625753 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6e88c64e-7fcd-415f-9878-95e2f89e3386 req-45836530-4f55-4e59-a57d-63656097d35d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037661 Aug 23 18:17:41.626361 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2701/5281] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:41.854495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-cdcdcf2f-39ab-4d8c-9f4a-bae604dc9b50 req-4075f297-d2be-4717-b620-5aa6cc5009a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5480cb09-9eb4-48d7-8bbe-88de71af3b07", "tag": "ff840925-6785-4a00-a68f-0086858b81eb"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:41.866006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cdcdcf2f-39ab-4d8c-9f4a-bae604dc9b50 req-4075f297-d2be-4717-b620-5aa6cc5009a1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:41.866735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cdcdcf2f-39ab-4d8c-9f4a-bae604dc9b50 req-4075f297-d2be-4717-b620-5aa6cc5009a1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:41.867245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cdcdcf2f-39ab-4d8c-9f4a-bae604dc9b50 req-4075f297-d2be-4717-b620-5aa6cc5009a1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:41.880225 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-cdcdcf2f-39ab-4d8c-9f4a-bae604dc9b50 req-4075f297-d2be-4717-b620-5aa6cc5009a1 service nova] Creating event network-changed:ff840925-6785-4a00-a68f-0086858b81eb for instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 on n-h2-850468-16 Aug 23 18:17:41.885971 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-cdcdcf2f-39ab-4d8c-9f4a-bae604dc9b50 req-4075f297-d2be-4717-b620-5aa6cc5009a1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037810 Aug 23 18:17:41.886630 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2702/5282] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:17:41.894946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-789f179a-5ecd-4ede-b20f-8614810f0e35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:41.895768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-789f179a-5ecd-4ede-b20f-8614810f0e35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:41.913599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-789f179a-5ecd-4ede-b20f-8614810f0e35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:41.914197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-789f179a-5ecd-4ede-b20f-8614810f0e35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:41.914742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-789f179a-5ecd-4ede-b20f-8614810f0e35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:41.915540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-789f179a-5ecd-4ede-b20f-8614810f0e35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:41.916061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-789f179a-5ecd-4ede-b20f-8614810f0e35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:41.916919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-789f179a-5ecd-4ede-b20f-8614810f0e35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:42.215171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-789f179a-5ecd-4ede-b20f-8614810f0e35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:42.232765 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-789f179a-5ecd-4ede-b20f-8614810f0e35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1366 microversion: 2.1 time: 0.341757 Aug 23 18:17:42.247656 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2703/5283] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:41 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1366 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:42.261081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1923a14c-544c-427c-8bb0-b5a75810796d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:42.261733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1923a14c-544c-427c-8bb0-b5a75810796d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:42.269994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1923a14c-544c-427c-8bb0-b5a75810796d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:42.270498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1923a14c-544c-427c-8bb0-b5a75810796d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:42.270967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1923a14c-544c-427c-8bb0-b5a75810796d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:42.271906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1923a14c-544c-427c-8bb0-b5a75810796d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:42.272468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1923a14c-544c-427c-8bb0-b5a75810796d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:42.272723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1923a14c-544c-427c-8bb0-b5a75810796d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:42.432343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1923a14c-544c-427c-8bb0-b5a75810796d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:42.444290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1923a14c-544c-427c-8bb0-b5a75810796d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:42.446259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1923a14c-544c-427c-8bb0-b5a75810796d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:42.447913 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1923a14c-544c-427c-8bb0-b5a75810796d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1407 microversion: 2.20 time: 0.192610 Aug 23 18:17:42.448678 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2704/5284] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:42 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1407 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:42.601779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-472a4817-7f66-4c29-a20d-404a5a88fd3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:42.602400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-472a4817-7f66-4c29-a20d-404a5a88fd3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:42.609592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-472a4817-7f66-4c29-a20d-404a5a88fd3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:42.610262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-472a4817-7f66-4c29-a20d-404a5a88fd3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:42.610851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-472a4817-7f66-4c29-a20d-404a5a88fd3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:42.611674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-472a4817-7f66-4c29-a20d-404a5a88fd3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:42.612470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-472a4817-7f66-4c29-a20d-404a5a88fd3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:42.614209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-472a4817-7f66-4c29-a20d-404a5a88fd3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:42.777310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-472a4817-7f66-4c29-a20d-404a5a88fd3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:42.786954 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-472a4817-7f66-4c29-a20d-404a5a88fd3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.189133 Aug 23 18:17:42.787644 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2705/5285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:42 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:43.198515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Building network info cache for instance {{(pid=128807) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1990}} Aug 23 18:17:43.264830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3f2aa703-6112-4f87-8f14-def83267ed27 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:43.266298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3f2aa703-6112-4f87-8f14-def83267ed27 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:43.301769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f2aa703-6112-4f87-8f14-def83267ed27 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:43.302389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f2aa703-6112-4f87-8f14-def83267ed27 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:43.302866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f2aa703-6112-4f87-8f14-def83267ed27 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:43.303681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f2aa703-6112-4f87-8f14-def83267ed27 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:43.304147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f2aa703-6112-4f87-8f14-def83267ed27 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:43.304571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f2aa703-6112-4f87-8f14-def83267ed27 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:43.515559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3f2aa703-6112-4f87-8f14-def83267ed27 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:43.532032 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3f2aa703-6112-4f87-8f14-def83267ed27 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1366 microversion: 2.1 time: 0.273319 Aug 23 18:17:43.532634 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2706/5286] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:43 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1366 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:43.551880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7197baa-0e1f-4778-9be6-eb711f3df218 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:43.560050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c7197baa-0e1f-4778-9be6-eb711f3df218 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:43.567062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7197baa-0e1f-4778-9be6-eb711f3df218 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:43.567741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7197baa-0e1f-4778-9be6-eb711f3df218 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:43.568178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7197baa-0e1f-4778-9be6-eb711f3df218 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:43.575484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7197baa-0e1f-4778-9be6-eb711f3df218 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:43.576585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7197baa-0e1f-4778-9be6-eb711f3df218 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:43.578454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7197baa-0e1f-4778-9be6-eb711f3df218 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:43.758470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c7197baa-0e1f-4778-9be6-eb711f3df218 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:43.770104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c7197baa-0e1f-4778-9be6-eb711f3df218 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:43.772608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c7197baa-0e1f-4778-9be6-eb711f3df218 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:43.774138 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c7197baa-0e1f-4778-9be6-eb711f3df218 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1407 microversion: 2.20 time: 0.240589 Aug 23 18:17:43.775307 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2707/5287] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:43 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1407 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:43.792961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Updating instance_info_cache with network_info: [{"id": "ff840925-6785-4a00-a68f-0086858b81eb", "address": "fa:16:3e:ff:3a:c6", "network": {"id": "47e9e3fc-2241-4d42-b358-a9873aaf6e0b", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-562807139-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "cdb247a14dad45d68fc17c1f9c93818d", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapff840925-67", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=128807) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:117}} Aug 23 18:17:43.807842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Releasing lock "refresh_cache-5480cb09-9eb4-48d7-8bbe-88de71af3b07" {{(pid=128807) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 23 18:17:43.808474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c0f6d6a2-4b4a-4b6f-9232-2500bd6eb913 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:43.809096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c0f6d6a2-4b4a-4b6f-9232-2500bd6eb913 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:43.809630 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9321e63b-c827-46df-b0bc-e8331ae58174 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "POST /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07/action" status: 202 len: 0 microversion: 2.1 time: 3.260424 Aug 23 18:17:43.815042 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2581/5288] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:17:40 2022] POST /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07/action => generated 0 bytes in 3268 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Aug 23 18:17:43.818981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0f6d6a2-4b4a-4b6f-9232-2500bd6eb913 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:43.819483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0f6d6a2-4b4a-4b6f-9232-2500bd6eb913 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:43.820301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0f6d6a2-4b4a-4b6f-9232-2500bd6eb913 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:43.820671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0f6d6a2-4b4a-4b6f-9232-2500bd6eb913 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:43.821496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c03a056-e746-4f63-8834-08e87e1994bf tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '.version_select at 0x7f27f1cb64c0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:43.822669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0f6d6a2-4b4a-4b6f-9232-2500bd6eb913 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:43.823671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0f6d6a2-4b4a-4b6f-9232-2500bd6eb913 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:44.032931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c0f6d6a2-4b4a-4b6f-9232-2500bd6eb913 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:44.044039 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c0f6d6a2-4b4a-4b6f-9232-2500bd6eb913 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.238896 Aug 23 18:17:44.060234 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2708/5289] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:43 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:44.085589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-05086fed-3a74-4519-a259-a3ca44589903 req-12f23cb1-1db8-4ec9-a7c4-ef1fa913fec3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5480cb09-9eb4-48d7-8bbe-88de71af3b07", "tag": "ff840925-6785-4a00-a68f-0086858b81eb"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:44.107693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-05086fed-3a74-4519-a259-a3ca44589903 req-12f23cb1-1db8-4ec9-a7c4-ef1fa913fec3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:44.108403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-05086fed-3a74-4519-a259-a3ca44589903 req-12f23cb1-1db8-4ec9-a7c4-ef1fa913fec3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:44.109411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-05086fed-3a74-4519-a259-a3ca44589903 req-12f23cb1-1db8-4ec9-a7c4-ef1fa913fec3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:44.127196 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-05086fed-3a74-4519-a259-a3ca44589903 req-12f23cb1-1db8-4ec9-a7c4-ef1fa913fec3 service nova] Creating event network-changed:ff840925-6785-4a00-a68f-0086858b81eb for instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 on n-h2-850468-16 Aug 23 18:17:44.133465 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-05086fed-3a74-4519-a259-a3ca44589903 req-12f23cb1-1db8-4ec9-a7c4-ef1fa913fec3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052039 Aug 23 18:17:44.134733 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2709/5290] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:44.562687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-56329947-da41-4eee-8d11-00746f6e4ec5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:44.564362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-56329947-da41-4eee-8d11-00746f6e4ec5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:44.603712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56329947-da41-4eee-8d11-00746f6e4ec5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:44.604212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56329947-da41-4eee-8d11-00746f6e4ec5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:44.605980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56329947-da41-4eee-8d11-00746f6e4ec5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:44.607487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56329947-da41-4eee-8d11-00746f6e4ec5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:44.611006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56329947-da41-4eee-8d11-00746f6e4ec5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:44.612383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56329947-da41-4eee-8d11-00746f6e4ec5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:45.002477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-56329947-da41-4eee-8d11-00746f6e4ec5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:45.015014 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-56329947-da41-4eee-8d11-00746f6e4ec5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1366 microversion: 2.1 time: 0.465375 Aug 23 18:17:45.015602 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2710/5291] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:44 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1366 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:45.020969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-512e60d7-d309-4a90-899d-d6878c0456bd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:45.024397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-512e60d7-d309-4a90-899d-d6878c0456bd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:45.042626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-512e60d7-d309-4a90-899d-d6878c0456bd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:45.043141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-512e60d7-d309-4a90-899d-d6878c0456bd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:45.043783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-512e60d7-d309-4a90-899d-d6878c0456bd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:45.044670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-512e60d7-d309-4a90-899d-d6878c0456bd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:45.045352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-512e60d7-d309-4a90-899d-d6878c0456bd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:45.046108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-512e60d7-d309-4a90-899d-d6878c0456bd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:45.098491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:45.216686 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c03a056-e746-4f63-8834-08e87e1994bf tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "DELETE /compute/v2.1/os-floating-ips/499e765e-1421-40a0-afb2-f108d326b21d" status: 202 len: 0 microversion: 2.1 time: 1.400222 Aug 23 18:17:45.217839 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2582/5292] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 18:17:43 2022] DELETE /compute/v2.1/os-floating-ips/499e765e-1421-40a0-afb2-f108d326b21d => generated 0 bytes in 1402 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:17:45.225797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f0efbb19-f252-438b-8b19-7a21f9436dc8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:45.226424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f0efbb19-f252-438b-8b19-7a21f9436dc8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:45.243144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0efbb19-f252-438b-8b19-7a21f9436dc8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:45.243670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0efbb19-f252-438b-8b19-7a21f9436dc8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:45.244663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0efbb19-f252-438b-8b19-7a21f9436dc8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:45.245365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0efbb19-f252-438b-8b19-7a21f9436dc8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:45.245838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0efbb19-f252-438b-8b19-7a21f9436dc8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:45.246400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0efbb19-f252-438b-8b19-7a21f9436dc8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:45.430843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f0efbb19-f252-438b-8b19-7a21f9436dc8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:45.440524 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f0efbb19-f252-438b-8b19-7a21f9436dc8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.220709 Aug 23 18:17:45.441241 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2583/5293] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:45 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:45.446284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-27fe570f-a849-41c2-88d2-66ca695dddcb tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '.version_select at 0x7f27ec303940>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:45.673687 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-27fe570f-a849-41c2-88d2-66ca695dddcb tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "DELETE /compute/v2.1/os-security-groups/86dbca9f-e1c5-4c33-8264-b974ae7ed5d6" status: 202 len: 0 microversion: 2.1 time: 0.231026 Aug 23 18:17:45.674583 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2584/5294] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 18:17:45 2022] DELETE /compute/v2.1/os-security-groups/86dbca9f-e1c5-4c33-8264-b974ae7ed5d6 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:17:45.684404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-12e745db-31e5-4204-aed1-90dff9b3ab70 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:45.685159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-12e745db-31e5-4204-aed1-90dff9b3ab70 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:45.693613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-512e60d7-d309-4a90-899d-d6878c0456bd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:45.695208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12e745db-31e5-4204-aed1-90dff9b3ab70 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:45.696091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12e745db-31e5-4204-aed1-90dff9b3ab70 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:45.696700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12e745db-31e5-4204-aed1-90dff9b3ab70 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:45.697930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12e745db-31e5-4204-aed1-90dff9b3ab70 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:45.698772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12e745db-31e5-4204-aed1-90dff9b3ab70 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:45.699369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12e745db-31e5-4204-aed1-90dff9b3ab70 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:45.708390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-512e60d7-d309-4a90-899d-d6878c0456bd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:45.709950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-512e60d7-d309-4a90-899d-d6878c0456bd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:45.711111 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-512e60d7-d309-4a90-899d-d6878c0456bd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1407 microversion: 2.20 time: 0.694387 Aug 23 18:17:45.711907 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2711/5295] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:45 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1407 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:45.746064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-12e745db-31e5-4204-aed1-90dff9b3ab70 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:17:45.837554 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-12e745db-31e5-4204-aed1-90dff9b3ab70 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 204 len: 0 microversion: 2.1 time: 0.158024 Aug 23 18:17:45.838487 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2585/5296] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:17:45 2022] DELETE /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:17:45.846933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bd8787b7-fbbf-4630-94b6-c216318b20d1 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:45.848331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bd8787b7-fbbf-4630-94b6-c216318b20d1 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:45.855141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd8787b7-fbbf-4630-94b6-c216318b20d1 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:45.855654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd8787b7-fbbf-4630-94b6-c216318b20d1 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:45.856110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd8787b7-fbbf-4630-94b6-c216318b20d1 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:45.856986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd8787b7-fbbf-4630-94b6-c216318b20d1 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:45.857459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd8787b7-fbbf-4630-94b6-c216318b20d1 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:45.857945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd8787b7-fbbf-4630-94b6-c216318b20d1 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:46.004951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bd8787b7-fbbf-4630-94b6-c216318b20d1 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:46.012983 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bd8787b7-fbbf-4630-94b6-c216318b20d1 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1508 microversion: 2.1 time: 0.170269 Aug 23 18:17:46.013560 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2712/5297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:45 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1508 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:46.040014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7446ffc2-5d81-4d5f-997a-978b4838633c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:46.040718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7446ffc2-5d81-4d5f-997a-978b4838633c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:46.046665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7446ffc2-5d81-4d5f-997a-978b4838633c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:46.047148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7446ffc2-5d81-4d5f-997a-978b4838633c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:46.047586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7446ffc2-5d81-4d5f-997a-978b4838633c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:46.048275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7446ffc2-5d81-4d5f-997a-978b4838633c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:46.048724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7446ffc2-5d81-4d5f-997a-978b4838633c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:46.049172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7446ffc2-5d81-4d5f-997a-978b4838633c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:46.203717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7446ffc2-5d81-4d5f-997a-978b4838633c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:46.212343 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7446ffc2-5d81-4d5f-997a-978b4838633c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1366 microversion: 2.1 time: 0.177325 Aug 23 18:17:46.213560 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2586/5298] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:46 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:46.298064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-96021188-43e6-4c79-a0a1-53bbac32c8cc req-ed7d6c64-11f8-4b98-99e6-c10a74c0be06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c1c0a9-6679-4485-a539-9e2d5b10c64b", "name": "network-vif-plugged", "status": "completed", "tag": "a6a4fdaf-b1bf-4a1e-a4d7-c4f0f5806cb9"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:46.305296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:46.309664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-96021188-43e6-4c79-a0a1-53bbac32c8cc req-ed7d6c64-11f8-4b98-99e6-c10a74c0be06 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:46.310437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-96021188-43e6-4c79-a0a1-53bbac32c8cc req-ed7d6c64-11f8-4b98-99e6-c10a74c0be06 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:46.311119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-96021188-43e6-4c79-a0a1-53bbac32c8cc req-ed7d6c64-11f8-4b98-99e6-c10a74c0be06 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:46.333653 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-96021188-43e6-4c79-a0a1-53bbac32c8cc req-ed7d6c64-11f8-4b98-99e6-c10a74c0be06 service nova] Creating event network-vif-plugged:a6a4fdaf-b1bf-4a1e-a4d7-c4f0f5806cb9 for instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b on n-h1-850468-16 Aug 23 18:17:46.340329 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-96021188-43e6-4c79-a0a1-53bbac32c8cc req-ed7d6c64-11f8-4b98-99e6-c10a74c0be06 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045951 Aug 23 18:17:46.342263 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2713/5299] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:46.468741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e1748b3-673a-4a3f-97a3-d6a6728b50e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:46.469892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2e1748b3-673a-4a3f-97a3-d6a6728b50e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:46.489874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e1748b3-673a-4a3f-97a3-d6a6728b50e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:46.491609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e1748b3-673a-4a3f-97a3-d6a6728b50e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:46.492295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e1748b3-673a-4a3f-97a3-d6a6728b50e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:46.494014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e1748b3-673a-4a3f-97a3-d6a6728b50e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:46.494890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e1748b3-673a-4a3f-97a3-d6a6728b50e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:46.495534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e1748b3-673a-4a3f-97a3-d6a6728b50e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:46.669995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2e1748b3-673a-4a3f-97a3-d6a6728b50e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:46.682726 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e1748b3-673a-4a3f-97a3-d6a6728b50e1 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.219943 Aug 23 18:17:46.683380 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2587/5300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:46 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:46.736274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9096587d-582e-4c69-b68e-9f93b9dc6262 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:46.737022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9096587d-582e-4c69-b68e-9f93b9dc6262 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:46.744124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9096587d-582e-4c69-b68e-9f93b9dc6262 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:46.744620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9096587d-582e-4c69-b68e-9f93b9dc6262 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:46.745066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9096587d-582e-4c69-b68e-9f93b9dc6262 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:46.745777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9096587d-582e-4c69-b68e-9f93b9dc6262 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:46.746326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9096587d-582e-4c69-b68e-9f93b9dc6262 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:46.746683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9096587d-582e-4c69-b68e-9f93b9dc6262 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:46.881955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9096587d-582e-4c69-b68e-9f93b9dc6262 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:46.890106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9096587d-582e-4c69-b68e-9f93b9dc6262 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:46.891649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9096587d-582e-4c69-b68e-9f93b9dc6262 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:46.892757 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9096587d-582e-4c69-b68e-9f93b9dc6262 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1407 microversion: 2.20 time: 0.161647 Aug 23 18:17:46.893318 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2714/5301] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:46 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:47.035771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d620356-7eb9-4ea8-853a-a6c0cef830e6 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:47.036869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d620356-7eb9-4ea8-853a-a6c0cef830e6 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:47.043421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d620356-7eb9-4ea8-853a-a6c0cef830e6 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:47.043922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d620356-7eb9-4ea8-853a-a6c0cef830e6 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:47.045250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d620356-7eb9-4ea8-853a-a6c0cef830e6 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:47.045994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d620356-7eb9-4ea8-853a-a6c0cef830e6 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:47.046465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d620356-7eb9-4ea8-853a-a6c0cef830e6 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:47.046933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d620356-7eb9-4ea8-853a-a6c0cef830e6 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:47.193808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4d620356-7eb9-4ea8-853a-a6c0cef830e6 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:47.202317 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d620356-7eb9-4ea8-853a-a6c0cef830e6 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1508 microversion: 2.1 time: 0.171390 Aug 23 18:17:47.202936 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2588/5302] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:47 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:47.234269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc0a673b-290a-4ce0-8001-e9ce2446ba1b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:47.234895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc0a673b-290a-4ce0-8001-e9ce2446ba1b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:47.236890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:47.243292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc0a673b-290a-4ce0-8001-e9ce2446ba1b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:47.243785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc0a673b-290a-4ce0-8001-e9ce2446ba1b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:47.244231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc0a673b-290a-4ce0-8001-e9ce2446ba1b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:47.244938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc0a673b-290a-4ce0-8001-e9ce2446ba1b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:47.245395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc0a673b-290a-4ce0-8001-e9ce2446ba1b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:47.245827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc0a673b-290a-4ce0-8001-e9ce2446ba1b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:47.394214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc0a673b-290a-4ce0-8001-e9ce2446ba1b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:47.403195 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc0a673b-290a-4ce0-8001-e9ce2446ba1b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1366 microversion: 2.1 time: 0.173407 Aug 23 18:17:47.403780 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2715/5303] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:47 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:47.704365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b8174bfa-2b57-481f-ab14-40932e1c3f2b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:47.704993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b8174bfa-2b57-481f-ab14-40932e1c3f2b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:47.713539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8174bfa-2b57-481f-ab14-40932e1c3f2b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:47.714428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8174bfa-2b57-481f-ab14-40932e1c3f2b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:47.715312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8174bfa-2b57-481f-ab14-40932e1c3f2b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:47.716488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8174bfa-2b57-481f-ab14-40932e1c3f2b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:47.716965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8174bfa-2b57-481f-ab14-40932e1c3f2b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:47.717524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b8174bfa-2b57-481f-ab14-40932e1c3f2b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:47.867767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b8174bfa-2b57-481f-ab14-40932e1c3f2b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:47.876813 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b8174bfa-2b57-481f-ab14-40932e1c3f2b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.176512 Aug 23 18:17:47.877931 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2589/5304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:47 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:47.916102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b63e6221-5fd1-4d4f-999b-d36d15017d17 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:47.916641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b63e6221-5fd1-4d4f-999b-d36d15017d17 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:47.923722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b63e6221-5fd1-4d4f-999b-d36d15017d17 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:47.924214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b63e6221-5fd1-4d4f-999b-d36d15017d17 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:47.924671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b63e6221-5fd1-4d4f-999b-d36d15017d17 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:47.925361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b63e6221-5fd1-4d4f-999b-d36d15017d17 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:47.926403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b63e6221-5fd1-4d4f-999b-d36d15017d17 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:47.926896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b63e6221-5fd1-4d4f-999b-d36d15017d17 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:48.068361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b63e6221-5fd1-4d4f-999b-d36d15017d17 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:48.078202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b63e6221-5fd1-4d4f-999b-d36d15017d17 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:48.081236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b63e6221-5fd1-4d4f-999b-d36d15017d17 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:48.083436 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b63e6221-5fd1-4d4f-999b-d36d15017d17 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1407 microversion: 2.20 time: 0.171334 Aug 23 18:17:48.084220 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2716/5305] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:47 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1407 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:17:48.225525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-756d3cac-a54f-42d9-8cd7-899cacc92665 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:48.226138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-756d3cac-a54f-42d9-8cd7-899cacc92665 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:48.232558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-756d3cac-a54f-42d9-8cd7-899cacc92665 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:48.233047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-756d3cac-a54f-42d9-8cd7-899cacc92665 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:48.233482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-756d3cac-a54f-42d9-8cd7-899cacc92665 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:48.234180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-756d3cac-a54f-42d9-8cd7-899cacc92665 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:48.234658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-756d3cac-a54f-42d9-8cd7-899cacc92665 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:48.235079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-756d3cac-a54f-42d9-8cd7-899cacc92665 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:48.414055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-756d3cac-a54f-42d9-8cd7-899cacc92665 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:48.425282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f06fa298-988d-49f4-bd72-ccbc60a9a7cc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:48.426035 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-756d3cac-a54f-42d9-8cd7-899cacc92665 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1508 microversion: 2.1 time: 0.200931 Aug 23 18:17:48.429887 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2590/5306] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:48 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1508 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:48.439875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f06fa298-988d-49f4-bd72-ccbc60a9a7cc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:48.443696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=11 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:48.460796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f06fa298-988d-49f4-bd72-ccbc60a9a7cc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:48.461634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f06fa298-988d-49f4-bd72-ccbc60a9a7cc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:48.462258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f06fa298-988d-49f4-bd72-ccbc60a9a7cc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:48.463046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f06fa298-988d-49f4-bd72-ccbc60a9a7cc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:48.463497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f06fa298-988d-49f4-bd72-ccbc60a9a7cc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:48.464016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f06fa298-988d-49f4-bd72-ccbc60a9a7cc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:48.526352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-92bf9785-b3bf-4575-bf4d-85e9b573db95 req-676d2aec-2527-45ac-b2a4-e0c13ccb4bed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8fe0c3-ea81-46b5-9230-216cf8e932d2", "name": "network-vif-plugged", "status": "completed", "tag": "663bf035-ee8e-4ca7-aeb3-025d64e3d0e1"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:48.541742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-92bf9785-b3bf-4575-bf4d-85e9b573db95 req-676d2aec-2527-45ac-b2a4-e0c13ccb4bed service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:48.542259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-92bf9785-b3bf-4575-bf4d-85e9b573db95 req-676d2aec-2527-45ac-b2a4-e0c13ccb4bed service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:48.542711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-92bf9785-b3bf-4575-bf4d-85e9b573db95 req-676d2aec-2527-45ac-b2a4-e0c13ccb4bed service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:48.571135 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-92bf9785-b3bf-4575-bf4d-85e9b573db95 req-676d2aec-2527-45ac-b2a4-e0c13ccb4bed service nova] Creating event network-vif-plugged:663bf035-ee8e-4ca7-aeb3-025d64e3d0e1 for instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 on n-h2-850468-16 Aug 23 18:17:48.577833 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-92bf9785-b3bf-4575-bf4d-85e9b573db95 req-676d2aec-2527-45ac-b2a4-e0c13ccb4bed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055148 Aug 23 18:17:48.579544 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2591/5307] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:17:48.675151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f06fa298-988d-49f4-bd72-ccbc60a9a7cc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:48.684502 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f06fa298-988d-49f4-bd72-ccbc60a9a7cc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1556 microversion: 2.1 time: 0.263323 Aug 23 18:17:48.685200 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2717/5308] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:48 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1556 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:48.706409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6de8011a-a824-430b-b3d8-3ea455c1ad53 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:48.707057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6de8011a-a824-430b-b3d8-3ea455c1ad53 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:48.713994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6de8011a-a824-430b-b3d8-3ea455c1ad53 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:48.715971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6de8011a-a824-430b-b3d8-3ea455c1ad53 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:48.716433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6de8011a-a824-430b-b3d8-3ea455c1ad53 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:48.717166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6de8011a-a824-430b-b3d8-3ea455c1ad53 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:48.717928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6de8011a-a824-430b-b3d8-3ea455c1ad53 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:48.718370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6de8011a-a824-430b-b3d8-3ea455c1ad53 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:48.814072 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6de8011a-a824-430b-b3d8-3ea455c1ad53 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112194 Aug 23 18:17:48.814762 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2592/5309] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:17:48 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:48.902292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8bf3544f-ee26-456e-8379-ee8cba7c1c1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:48.905469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8bf3544f-ee26-456e-8379-ee8cba7c1c1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:48.916627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bf3544f-ee26-456e-8379-ee8cba7c1c1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:48.917999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bf3544f-ee26-456e-8379-ee8cba7c1c1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:48.918983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bf3544f-ee26-456e-8379-ee8cba7c1c1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:48.919983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bf3544f-ee26-456e-8379-ee8cba7c1c1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:48.920678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bf3544f-ee26-456e-8379-ee8cba7c1c1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:48.921560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bf3544f-ee26-456e-8379-ee8cba7c1c1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:49.108913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ce4d80fd-9753-4916-b202-32b27e7159a1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:49.109841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ce4d80fd-9753-4916-b202-32b27e7159a1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:49.116703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce4d80fd-9753-4916-b202-32b27e7159a1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:49.117445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce4d80fd-9753-4916-b202-32b27e7159a1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:49.118077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce4d80fd-9753-4916-b202-32b27e7159a1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:49.119131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce4d80fd-9753-4916-b202-32b27e7159a1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:49.119767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce4d80fd-9753-4916-b202-32b27e7159a1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:49.120364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce4d80fd-9753-4916-b202-32b27e7159a1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:49.188676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8bf3544f-ee26-456e-8379-ee8cba7c1c1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:49.201622 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8bf3544f-ee26-456e-8379-ee8cba7c1c1b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.306043 Aug 23 18:17:49.202916 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2718/5310] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:48 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:49.402749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ce4d80fd-9753-4916-b202-32b27e7159a1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:49.407212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=90,nova_cell1:INSERT=2,nova_cell1:SAVEPOINT=2,nova_cell1:RELEASE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:17:49.413593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ce4d80fd-9753-4916-b202-32b27e7159a1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:49.415257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ce4d80fd-9753-4916-b202-32b27e7159a1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:49.416603 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ce4d80fd-9753-4916-b202-32b27e7159a1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1407 microversion: 2.20 time: 0.311793 Aug 23 18:17:49.416966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-38cb24c2-d64a-43a8-8508-bf33acaa9969 req-874b1f5e-6962-4206-ac22-f6bd73178e5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5480cb09-9eb4-48d7-8bbe-88de71af3b07", "name": "network-vif-deleted", "tag": "ff840925-6785-4a00-a68f-0086858b81eb"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:49.417892 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2593/5311] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:49 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1407 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:17:49.429610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-38cb24c2-d64a-43a8-8508-bf33acaa9969 req-874b1f5e-6962-4206-ac22-f6bd73178e5a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:49.430426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-38cb24c2-d64a-43a8-8508-bf33acaa9969 req-874b1f5e-6962-4206-ac22-f6bd73178e5a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:49.431118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-38cb24c2-d64a-43a8-8508-bf33acaa9969 req-874b1f5e-6962-4206-ac22-f6bd73178e5a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:49.444709 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-38cb24c2-d64a-43a8-8508-bf33acaa9969 req-874b1f5e-6962-4206-ac22-f6bd73178e5a service nova] Creating event network-vif-deleted:ff840925-6785-4a00-a68f-0086858b81eb for instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 on n-h2-850468-16 Aug 23 18:17:49.447525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9fbce77-f9bf-4e3b-ae9e-8a81c9a45e7f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:49.449273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d9fbce77-f9bf-4e3b-ae9e-8a81c9a45e7f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:49.450010 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-38cb24c2-d64a-43a8-8508-bf33acaa9969 req-874b1f5e-6962-4206-ac22-f6bd73178e5a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037629 Aug 23 18:17:49.451115 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2719/5312] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:49.458353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9fbce77-f9bf-4e3b-ae9e-8a81c9a45e7f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:49.458985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9fbce77-f9bf-4e3b-ae9e-8a81c9a45e7f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:49.459545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9fbce77-f9bf-4e3b-ae9e-8a81c9a45e7f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:49.460456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9fbce77-f9bf-4e3b-ae9e-8a81c9a45e7f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:49.461144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9fbce77-f9bf-4e3b-ae9e-8a81c9a45e7f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:49.461772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9fbce77-f9bf-4e3b-ae9e-8a81c9a45e7f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:49.593548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d9fbce77-f9bf-4e3b-ae9e-8a81c9a45e7f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:49.602080 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d9fbce77-f9bf-4e3b-ae9e-8a81c9a45e7f tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1466 microversion: 2.1 time: 0.158862 Aug 23 18:17:49.603177 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2594/5313] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:49 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1466 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:50.017521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-79e5e752-2ca5-41e4-a3ac-aae8083dab72 req-f8fd9449-8ebc-4a0b-a0da-1e4545f189cf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2c1c0a9-6679-4485-a539-9e2d5b10c64b", "tag": "a6a4fdaf-b1bf-4a1e-a4d7-c4f0f5806cb9"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:50.029737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-79e5e752-2ca5-41e4-a3ac-aae8083dab72 req-f8fd9449-8ebc-4a0b-a0da-1e4545f189cf service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:50.029959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-79e5e752-2ca5-41e4-a3ac-aae8083dab72 req-f8fd9449-8ebc-4a0b-a0da-1e4545f189cf service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:50.030411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-79e5e752-2ca5-41e4-a3ac-aae8083dab72 req-f8fd9449-8ebc-4a0b-a0da-1e4545f189cf service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:50.051890 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-79e5e752-2ca5-41e4-a3ac-aae8083dab72 req-f8fd9449-8ebc-4a0b-a0da-1e4545f189cf service nova] Creating event network-changed:a6a4fdaf-b1bf-4a1e-a4d7-c4f0f5806cb9 for instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b on n-h1-850468-16 Aug 23 18:17:50.057347 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-79e5e752-2ca5-41e4-a3ac-aae8083dab72 req-f8fd9449-8ebc-4a0b-a0da-1e4545f189cf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044694 Aug 23 18:17:50.058288 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2720/5314] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:50.223924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9260a4af-4115-4ed2-8697-7f692de40446 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:50.225352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9260a4af-4115-4ed2-8697-7f692de40446 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:50.232132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9260a4af-4115-4ed2-8697-7f692de40446 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:50.232611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9260a4af-4115-4ed2-8697-7f692de40446 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:50.233049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9260a4af-4115-4ed2-8697-7f692de40446 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:50.234011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9260a4af-4115-4ed2-8697-7f692de40446 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:50.234531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9260a4af-4115-4ed2-8697-7f692de40446 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:50.235041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9260a4af-4115-4ed2-8697-7f692de40446 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:50.442921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c83aff61-e043-44a4-869a-28317e34d7b0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:50.444072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c83aff61-e043-44a4-869a-28317e34d7b0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:50.457348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c83aff61-e043-44a4-869a-28317e34d7b0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:50.457854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c83aff61-e043-44a4-869a-28317e34d7b0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:50.458589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c83aff61-e043-44a4-869a-28317e34d7b0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:50.459185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c83aff61-e043-44a4-869a-28317e34d7b0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:50.459643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c83aff61-e043-44a4-869a-28317e34d7b0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:50.460075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c83aff61-e043-44a4-869a-28317e34d7b0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:50.494207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9260a4af-4115-4ed2-8697-7f692de40446 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:50.505727 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9260a4af-4115-4ed2-8697-7f692de40446 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.286820 Aug 23 18:17:50.519725 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2595/5315] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:50 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:50.623437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:50.624058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:50.638926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:50.639843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:50.640511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:50.641416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:50.642038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:50.642661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:50.749766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c83aff61-e043-44a4-869a-28317e34d7b0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:50.758640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:50.759135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:50.759570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:50.761992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c83aff61-e043-44a4-869a-28317e34d7b0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:50.762906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lazy-loading 'fault' on Instance uuid 5480cb09-9eb4-48d7-8bbe-88de71af3b07 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:17:50.764025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c83aff61-e043-44a4-869a-28317e34d7b0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:50.766023 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c83aff61-e043-44a4-869a-28317e34d7b0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1407 microversion: 2.20 time: 0.328118 Aug 23 18:17:50.778756 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2721/5316] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:50 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1407 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:51.151989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be0a9a69f7d4717943f603f69ca5f89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdb247a14dad45d68fc17c1f9c93818d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:51.160673 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a33a4a6-ee4c-4e6c-b7fa-052e14e12879 tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 200 len: 1312 microversion: 2.1 time: 0.540447 Aug 23 18:17:51.162468 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2596/5317] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:50 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 1312 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:51.530412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9270e76f-0964-46cf-8f7b-a9dee09aaae6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:51.531189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9270e76f-0964-46cf-8f7b-a9dee09aaae6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:51.539256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9270e76f-0964-46cf-8f7b-a9dee09aaae6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:51.539702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9270e76f-0964-46cf-8f7b-a9dee09aaae6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:51.540140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9270e76f-0964-46cf-8f7b-a9dee09aaae6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:51.540851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9270e76f-0964-46cf-8f7b-a9dee09aaae6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:51.541335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9270e76f-0964-46cf-8f7b-a9dee09aaae6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:51.541755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9270e76f-0964-46cf-8f7b-a9dee09aaae6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:51.695224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9270e76f-0964-46cf-8f7b-a9dee09aaae6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:51.703306 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9270e76f-0964-46cf-8f7b-a9dee09aaae6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.176800 Aug 23 18:17:51.703963 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2722/5318] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:51 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:51.792690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e2f414a7-2984-488e-97a8-c79d893ccea7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:51.793398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e2f414a7-2984-488e-97a8-c79d893ccea7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:51.802093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2f414a7-2984-488e-97a8-c79d893ccea7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:51.802496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2f414a7-2984-488e-97a8-c79d893ccea7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:51.802980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2f414a7-2984-488e-97a8-c79d893ccea7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:51.803709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2f414a7-2984-488e-97a8-c79d893ccea7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:51.804170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2f414a7-2984-488e-97a8-c79d893ccea7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:51.804605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2f414a7-2984-488e-97a8-c79d893ccea7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:51.942477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e2f414a7-2984-488e-97a8-c79d893ccea7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:51.950752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e2f414a7-2984-488e-97a8-c79d893ccea7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:51.952272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e2f414a7-2984-488e-97a8-c79d893ccea7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:51.953444 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e2f414a7-2984-488e-97a8-c79d893ccea7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1599 microversion: 2.20 time: 0.165238 Aug 23 18:17:51.954016 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2597/5319] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:51 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1599 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:51.976643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-745cde93-d3fb-4d71-b07f-8614a4c0572c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:51.977148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-745cde93-d3fb-4d71-b07f-8614a4c0572c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:51.983285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-745cde93-d3fb-4d71-b07f-8614a4c0572c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:51.983712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-745cde93-d3fb-4d71-b07f-8614a4c0572c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:51.984186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-745cde93-d3fb-4d71-b07f-8614a4c0572c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:51.984885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-745cde93-d3fb-4d71-b07f-8614a4c0572c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:51.985349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-745cde93-d3fb-4d71-b07f-8614a4c0572c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:51.985942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-745cde93-d3fb-4d71-b07f-8614a4c0572c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:52.072497 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-745cde93-d3fb-4d71-b07f-8614a4c0572c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100240 Aug 23 18:17:52.073285 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2723/5320] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Aug 23 18:17:51 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:17:52.181791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b2997b21-428d-4693-87fe-0c8d906d683b tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:52.182413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b2997b21-428d-4693-87fe-0c8d906d683b tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] [instance: 5480cb09-9eb4-48d7-8bbe-88de71af3b07] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:52.188527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2997b21-428d-4693-87fe-0c8d906d683b tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:52.189022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2997b21-428d-4693-87fe-0c8d906d683b tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:52.189461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2997b21-428d-4693-87fe-0c8d906d683b tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:52.190241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2997b21-428d-4693-87fe-0c8d906d683b tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:52.190732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2997b21-428d-4693-87fe-0c8d906d683b tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:52.191453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2997b21-428d-4693-87fe-0c8d906d683b tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:52.208286 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-b2997b21-428d-4693-87fe-0c8d906d683b tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] HTTP exception thrown: Instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 could not be found. Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b2997b21-428d-4693-87fe-0c8d906d683b tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Request method failure captured: Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 HTTP/1.1 Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRl7bjZJqU85p8jvbcCpJ0kKo6KxhKk0Wyyv9KU9VT891NHli15yDXiPeseWZW0GnMI6_lG77WHE3jyYVf1XxDDG1sq9gGUxG97zuN-sGl7H5yqzR87dWy0lbnX-Qg-8feSV7taNAeK0T8jZ3wXOlNzS4dgao-Oo6_uQwGnBtOQPLF0 Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: cdb247a14dad45d68fc17c1f9c93818d Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-565213580 Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_cdb247a14dad45d68fc17c1f9c93818d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cdb247a14dad45d68fc17c1f9c93818d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/cdb247a14dad45d68fc17c1f9c93818d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/cdb247a14dad45d68fc17c1f9c93818d"}]}] Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-565213580 Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: cdb247a14dad45d68fc17c1f9c93818d Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-565213580 Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerRescueTestJSONUnderV235-565213580-project Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 1be0a9a69f7d4717943f603f69ca5f89 Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-565213580-project Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 could not be found. Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '5480cb09-9eb4-48d7-8bbe-88de71af3b07'} Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 could not be found. Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 could not be found. Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:17:52.210286 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:17:52.216157 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:17:52.216157 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:17:52.216157 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:17:52.216157 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:17:52.216157 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:17:52.216157 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:17:52.216157 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 could not be found. Aug 23 18:17:52.216157 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:17:52.217548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b2997b21-428d-4693-87fe-0c8d906d683b tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] Returning 404 to user: Instance 5480cb09-9eb4-48d7-8bbe-88de71af3b07 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:17:52.218429 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b2997b21-428d-4693-87fe-0c8d906d683b tempest-ServerRescueTestJSONUnderV235-565213580 tempest-ServerRescueTestJSONUnderV235-565213580-project] 10.222.0.61 "GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07" status: 404 len: 111 microversion: 2.1 time: 0.040934 Aug 23 18:17:52.219030 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2598/5321] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:52 2022] GET /compute/v2.1/servers/5480cb09-9eb4-48d7-8bbe-88de71af3b07 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:17:52.735272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ff5b369c-6868-477b-870d-a0a7a6d47558 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:52.736738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ff5b369c-6868-477b-870d-a0a7a6d47558 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:52.749815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff5b369c-6868-477b-870d-a0a7a6d47558 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:52.750881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff5b369c-6868-477b-870d-a0a7a6d47558 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:52.751752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff5b369c-6868-477b-870d-a0a7a6d47558 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:52.752737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff5b369c-6868-477b-870d-a0a7a6d47558 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:52.754083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff5b369c-6868-477b-870d-a0a7a6d47558 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:52.754847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff5b369c-6868-477b-870d-a0a7a6d47558 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:53.031081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ff5b369c-6868-477b-870d-a0a7a6d47558 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:53.041208 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ff5b369c-6868-477b-870d-a0a7a6d47558 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.319634 Aug 23 18:17:53.042111 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2724/5322] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:52 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:53.181572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-37d2524c-45cd-4822-ac59-9ba5aa86caef req-212db3c2-041d-4ad2-a3d5-c9bf5fd6bee1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8fe0c3-ea81-46b5-9230-216cf8e932d2", "tag": "663bf035-ee8e-4ca7-aeb3-025d64e3d0e1"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:53.192843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-37d2524c-45cd-4822-ac59-9ba5aa86caef req-212db3c2-041d-4ad2-a3d5-c9bf5fd6bee1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:53.193802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-37d2524c-45cd-4822-ac59-9ba5aa86caef req-212db3c2-041d-4ad2-a3d5-c9bf5fd6bee1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:53.194421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-37d2524c-45cd-4822-ac59-9ba5aa86caef req-212db3c2-041d-4ad2-a3d5-c9bf5fd6bee1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:53.209090 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-37d2524c-45cd-4822-ac59-9ba5aa86caef req-212db3c2-041d-4ad2-a3d5-c9bf5fd6bee1 service nova] Creating event network-changed:663bf035-ee8e-4ca7-aeb3-025d64e3d0e1 for instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 on n-h2-850468-16 Aug 23 18:17:53.214515 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-37d2524c-45cd-4822-ac59-9ba5aa86caef req-212db3c2-041d-4ad2-a3d5-c9bf5fd6bee1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037573 Aug 23 18:17:53.216378 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2599/5323] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:17:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:17:54.068139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-72d67c48-0dd2-44af-bf4b-2adabf8ac519 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:54.069747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-72d67c48-0dd2-44af-bf4b-2adabf8ac519 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:54.077934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72d67c48-0dd2-44af-bf4b-2adabf8ac519 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:54.078875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72d67c48-0dd2-44af-bf4b-2adabf8ac519 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:54.079666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72d67c48-0dd2-44af-bf4b-2adabf8ac519 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:54.080661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72d67c48-0dd2-44af-bf4b-2adabf8ac519 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:54.081379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72d67c48-0dd2-44af-bf4b-2adabf8ac519 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:54.082698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72d67c48-0dd2-44af-bf4b-2adabf8ac519 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:54.519444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-72d67c48-0dd2-44af-bf4b-2adabf8ac519 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:54.533598 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-72d67c48-0dd2-44af-bf4b-2adabf8ac519 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.474130 Aug 23 18:17:54.534198 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2725/5324] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:54 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:55.557086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2830b501-3647-4ba0-b9ea-5eb184b1ce41 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:55.558216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2830b501-3647-4ba0-b9ea-5eb184b1ce41 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:55.571880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2830b501-3647-4ba0-b9ea-5eb184b1ce41 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:55.572556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2830b501-3647-4ba0-b9ea-5eb184b1ce41 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:55.573398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2830b501-3647-4ba0-b9ea-5eb184b1ce41 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:55.574513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2830b501-3647-4ba0-b9ea-5eb184b1ce41 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:55.576191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2830b501-3647-4ba0-b9ea-5eb184b1ce41 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:55.576750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2830b501-3647-4ba0-b9ea-5eb184b1ce41 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:55.745523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2830b501-3647-4ba0-b9ea-5eb184b1ce41 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:55.754154 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2830b501-3647-4ba0-b9ea-5eb184b1ce41 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.202187 Aug 23 18:17:55.758936 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2600/5325] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:55 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:56.774576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce40b6a0-7274-4d15-86fd-cae190931ee8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:56.775195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ce40b6a0-7274-4d15-86fd-cae190931ee8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:56.782657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce40b6a0-7274-4d15-86fd-cae190931ee8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:56.783365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce40b6a0-7274-4d15-86fd-cae190931ee8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:56.784058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce40b6a0-7274-4d15-86fd-cae190931ee8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:56.785054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce40b6a0-7274-4d15-86fd-cae190931ee8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:56.785976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce40b6a0-7274-4d15-86fd-cae190931ee8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:56.786608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce40b6a0-7274-4d15-86fd-cae190931ee8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:57.021604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ce40b6a0-7274-4d15-86fd-cae190931ee8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:57.029942 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce40b6a0-7274-4d15-86fd-cae190931ee8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.259198 Aug 23 18:17:57.030700 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2726/5326] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:56 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:58.055287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7c4ab2cd-f474-4da5-94ff-85162baf3781 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:58.055907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7c4ab2cd-f474-4da5-94ff-85162baf3781 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:58.062987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c4ab2cd-f474-4da5-94ff-85162baf3781 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:58.063521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c4ab2cd-f474-4da5-94ff-85162baf3781 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:58.064077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c4ab2cd-f474-4da5-94ff-85162baf3781 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:58.064781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c4ab2cd-f474-4da5-94ff-85162baf3781 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:58.065240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c4ab2cd-f474-4da5-94ff-85162baf3781 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:58.065659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c4ab2cd-f474-4da5-94ff-85162baf3781 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:58.091100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-93604969", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": "none"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:58.152685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:17:58.153420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:17:58.154099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:17:58.154518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:17:58.155146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:17:58.165227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:58.165800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:58.166242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:58.167222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:58.167682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:58.168115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:58.186185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Getting quotas for project 1cc03ad0d71240d68976106ee44fa655. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:17:58.192088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Getting quotas for user 570583085e954774ac58273fdfd2b7fd and project 1cc03ad0d71240d68976106ee44fa655. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:17:58.206095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:17:58.209525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 7787b839-c82c-415a-9aa0-1fe82027401c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:17:58.233357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7c4ab2cd-f474-4da5-94ff-85162baf3781 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:58.242913 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7c4ab2cd-f474-4da5-94ff-85162baf3781 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1511 microversion: 2.1 time: 0.191539 Aug 23 18:17:58.243779 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2727/5327] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:58 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1511 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:17:58.265978 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-827b94eb-3b29-4a4b-8301-d7f31f1f8920 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.310454 Aug 23 18:17:58.266760 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2601/5328] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 18:17:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 312 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 23 18:17:58.279544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9562f9e2-6449-4cc1-bff5-a6b3b0a9f151 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:58.280470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9562f9e2-6449-4cc1-bff5-a6b3b0a9f151 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 7787b839-c82c-415a-9aa0-1fe82027401c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:58.344379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9562f9e2-6449-4cc1-bff5-a6b3b0a9f151 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:58.352663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9562f9e2-6449-4cc1-bff5-a6b3b0a9f151 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:58.354253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9562f9e2-6449-4cc1-bff5-a6b3b0a9f151 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:58.355491 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9562f9e2-6449-4cc1-bff5-a6b3b0a9f151 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c" status: 200 len: 1276 microversion: 2.47 time: 0.080694 Aug 23 18:17:58.356177 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2728/5329] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:58 2022] GET /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c => generated 1276 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:58.423401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-547676989", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": "none"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:58.490154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:17:58.490715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:17:58.491559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:17:58.491975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:17:58.492394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:17:58.502729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:58.503778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:58.504795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:58.505548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:58.506005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:58.506666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:58.528470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Getting quotas for project 1cc03ad0d71240d68976106ee44fa655. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:17:58.534487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Getting quotas for user 570583085e954774ac58273fdfd2b7fd and project 1cc03ad0d71240d68976106ee44fa655. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:17:58.550957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:17:58.553624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:17:58.619080 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c3a92a5e-0e35-4276-b3df-0692fc002a63 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.199661 Aug 23 18:17:58.622580 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2602/5330] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 18:17:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 202 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 23 18:17:58.663911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0c77578b-c6f5-4f0f-8486-b9100551840f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:58.667369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0c77578b-c6f5-4f0f-8486-b9100551840f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:58.724531 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0c77578b-c6f5-4f0f-8486-b9100551840f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "PUT /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 991 microversion: 2.47 time: 0.097180 Aug 23 18:17:58.738620 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2729/5331] 10.222.0.61 () {62 vars in 1297 bytes} [Tue Aug 23 18:17:58 2022] PUT /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 991 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:17:58.744308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-53d4bd8b-027f-4b73-b2a5-9f1809e0fdb8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:58.745422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-53d4bd8b-027f-4b73-b2a5-9f1809e0fdb8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:58.852493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-53d4bd8b-027f-4b73-b2a5-9f1809e0fdb8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:58.874461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-53d4bd8b-027f-4b73-b2a5-9f1809e0fdb8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:58.876812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-53d4bd8b-027f-4b73-b2a5-9f1809e0fdb8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:58.879689 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-53d4bd8b-027f-4b73-b2a5-9f1809e0fdb8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1277 microversion: 2.47 time: 0.139454 Aug 23 18:17:58.894946 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2603/5332] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:58 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:17:59.267373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dd20f7d4-41cc-4b7e-a8da-d4f44b53c851 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:59.268554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dd20f7d4-41cc-4b7e-a8da-d4f44b53c851 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:59.277161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd20f7d4-41cc-4b7e-a8da-d4f44b53c851 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:59.277644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd20f7d4-41cc-4b7e-a8da-d4f44b53c851 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:59.278159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd20f7d4-41cc-4b7e-a8da-d4f44b53c851 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:59.278912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd20f7d4-41cc-4b7e-a8da-d4f44b53c851 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:59.279374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd20f7d4-41cc-4b7e-a8da-d4f44b53c851 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:59.279804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd20f7d4-41cc-4b7e-a8da-d4f44b53c851 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:59.460630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dd20f7d4-41cc-4b7e-a8da-d4f44b53c851 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:59.470064 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dd20f7d4-41cc-4b7e-a8da-d4f44b53c851 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1488 microversion: 2.1 time: 0.209015 Aug 23 18:17:59.471097 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2730/5333] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:59 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1488 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:59.492004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-812876b5-50cc-4a5f-bb95-f82a401b52e9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-655378594"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:17:59.495738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-812876b5-50cc-4a5f-bb95-f82a401b52e9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:59.504176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-812876b5-50cc-4a5f-bb95-f82a401b52e9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:59.504688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-812876b5-50cc-4a5f-bb95-f82a401b52e9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:59.505344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-812876b5-50cc-4a5f-bb95-f82a401b52e9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:59.506065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-812876b5-50cc-4a5f-bb95-f82a401b52e9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:59.506526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-812876b5-50cc-4a5f-bb95-f82a401b52e9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:59.506980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-812876b5-50cc-4a5f-bb95-f82a401b52e9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:59.577068 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-812876b5-50cc-4a5f-bb95-f82a401b52e9 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "PUT /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1060 microversion: 2.1 time: 0.089722 Aug 23 18:17:59.580919 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2604/5334] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Aug 23 18:17:59 2022] PUT /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1060 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:59.595190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d16994e6-84a5-4896-bd62-5a6c693284bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:59.595804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d16994e6-84a5-4896-bd62-5a6c693284bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:59.604056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d16994e6-84a5-4896-bd62-5a6c693284bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:59.604864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d16994e6-84a5-4896-bd62-5a6c693284bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:59.605531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d16994e6-84a5-4896-bd62-5a6c693284bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:59.606590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d16994e6-84a5-4896-bd62-5a6c693284bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:59.607198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d16994e6-84a5-4896-bd62-5a6c693284bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:59.607805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d16994e6-84a5-4896-bd62-5a6c693284bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:59.819585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d16994e6-84a5-4896-bd62-5a6c693284bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:17:59.828559 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d16994e6-84a5-4896-bd62-5a6c693284bf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1487 microversion: 2.1 time: 0.236921 Aug 23 18:17:59.829538 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2731/5335] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:59 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1487 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:17:59.850408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3017c127-bed3-4a40-9e37-af4ddaacc9ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:59.851060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3017c127-bed3-4a40-9e37-af4ddaacc9ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:59.857225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3017c127-bed3-4a40-9e37-af4ddaacc9ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:59.857706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3017c127-bed3-4a40-9e37-af4ddaacc9ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:59.858332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3017c127-bed3-4a40-9e37-af4ddaacc9ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:59.859068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3017c127-bed3-4a40-9e37-af4ddaacc9ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:59.859553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3017c127-bed3-4a40-9e37-af4ddaacc9ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:59.859974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3017c127-bed3-4a40-9e37-af4ddaacc9ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:59.924035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2d86b6e4-3f45-4b4b-a6a7-48ae08e0d51e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:17:59.924653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2d86b6e4-3f45-4b4b-a6a7-48ae08e0d51e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:17:59.931570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d86b6e4-3f45-4b4b-a6a7-48ae08e0d51e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:59.932064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d86b6e4-3f45-4b4b-a6a7-48ae08e0d51e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:59.932509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d86b6e4-3f45-4b4b-a6a7-48ae08e0d51e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:59.933219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d86b6e4-3f45-4b4b-a6a7-48ae08e0d51e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:17:59.933681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d86b6e4-3f45-4b4b-a6a7-48ae08e0d51e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:17:59.934107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d86b6e4-3f45-4b4b-a6a7-48ae08e0d51e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:17:59.956034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:00.020971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2d86b6e4-3f45-4b4b-a6a7-48ae08e0d51e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:00.030644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2d86b6e4-3f45-4b4b-a6a7-48ae08e0d51e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:00.032154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2d86b6e4-3f45-4b4b-a6a7-48ae08e0d51e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:00.033303 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2d86b6e4-3f45-4b4b-a6a7-48ae08e0d51e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1329 microversion: 2.47 time: 0.113219 Aug 23 18:18:00.033858 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2732/5336] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:17:59 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1329 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:00.052257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3017c127-bed3-4a40-9e37-af4ddaacc9ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:00.064955 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3017c127-bed3-4a40-9e37-af4ddaacc9ef tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1487 microversion: 2.1 time: 0.218996 Aug 23 18:18:00.065528 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2605/5337] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:17:59 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1487 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:00.086199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-010e7450-db34-4c24-8a40-1d6ac502a016 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:00.086821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-010e7450-db34-4c24-8a40-1d6ac502a016 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:00.093684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010e7450-db34-4c24-8a40-1d6ac502a016 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:00.094264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010e7450-db34-4c24-8a40-1d6ac502a016 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:00.094748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010e7450-db34-4c24-8a40-1d6ac502a016 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:00.095475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010e7450-db34-4c24-8a40-1d6ac502a016 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:00.095939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010e7450-db34-4c24-8a40-1d6ac502a016 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:00.096399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010e7450-db34-4c24-8a40-1d6ac502a016 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:00.123106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-010e7450-db34-4c24-8a40-1d6ac502a016 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:18:00.223826 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-010e7450-db34-4c24-8a40-1d6ac502a016 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 204 len: 0 microversion: 2.1 time: 0.141741 Aug 23 18:18:00.224726 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2733/5338] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:18:00 2022] DELETE /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:18:00.232860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b0c06b07-b14d-4ca1-b7dc-809b377b6a3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:00.233483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b0c06b07-b14d-4ca1-b7dc-809b377b6a3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:00.243079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0c06b07-b14d-4ca1-b7dc-809b377b6a3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:00.244066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0c06b07-b14d-4ca1-b7dc-809b377b6a3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:00.244578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0c06b07-b14d-4ca1-b7dc-809b377b6a3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:00.245402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0c06b07-b14d-4ca1-b7dc-809b377b6a3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:00.246130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0c06b07-b14d-4ca1-b7dc-809b377b6a3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:00.246705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0c06b07-b14d-4ca1-b7dc-809b377b6a3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:00.399640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b0c06b07-b14d-4ca1-b7dc-809b377b6a3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:00.407681 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b0c06b07-b14d-4ca1-b7dc-809b377b6a3c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1493 microversion: 2.1 time: 0.178826 Aug 23 18:18:00.408251 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2606/5339] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:00 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1493 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:01.069087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d4238b23-bc3c-4d09-b841-63bd89d7cd87 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:01.069797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d4238b23-bc3c-4d09-b841-63bd89d7cd87 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:01.076757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4238b23-bc3c-4d09-b841-63bd89d7cd87 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:01.077468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4238b23-bc3c-4d09-b841-63bd89d7cd87 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:01.077904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4238b23-bc3c-4d09-b841-63bd89d7cd87 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:01.078699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4238b23-bc3c-4d09-b841-63bd89d7cd87 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:01.079156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4238b23-bc3c-4d09-b841-63bd89d7cd87 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:01.079600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4238b23-bc3c-4d09-b841-63bd89d7cd87 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:01.149803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d4238b23-bc3c-4d09-b841-63bd89d7cd87 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:01.158481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d4238b23-bc3c-4d09-b841-63bd89d7cd87 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:01.160752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d4238b23-bc3c-4d09-b841-63bd89d7cd87 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:01.161992 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d4238b23-bc3c-4d09-b841-63bd89d7cd87 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1347 microversion: 2.47 time: 0.098659 Aug 23 18:18:01.162506 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2734/5340] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:01 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1347 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:01.429414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c526901b-b7d6-48ff-aee5-324fd8f221e5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:01.430032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c526901b-b7d6-48ff-aee5-324fd8f221e5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:01.432917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:01.438520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c526901b-b7d6-48ff-aee5-324fd8f221e5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:01.439037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c526901b-b7d6-48ff-aee5-324fd8f221e5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:01.439474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c526901b-b7d6-48ff-aee5-324fd8f221e5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:01.440168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c526901b-b7d6-48ff-aee5-324fd8f221e5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:01.441148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c526901b-b7d6-48ff-aee5-324fd8f221e5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:01.441709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c526901b-b7d6-48ff-aee5-324fd8f221e5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:01.591279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c526901b-b7d6-48ff-aee5-324fd8f221e5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:01.600673 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c526901b-b7d6-48ff-aee5-324fd8f221e5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1493 microversion: 2.1 time: 0.175092 Aug 23 18:18:01.603290 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2607/5341] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:01 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1493 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:02.185565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8c60571-0e52-4aeb-8bd0-86c946dbf335 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:02.186322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8c60571-0e52-4aeb-8bd0-86c946dbf335 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:02.193851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8c60571-0e52-4aeb-8bd0-86c946dbf335 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:02.194426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8c60571-0e52-4aeb-8bd0-86c946dbf335 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:02.195020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8c60571-0e52-4aeb-8bd0-86c946dbf335 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:02.195710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8c60571-0e52-4aeb-8bd0-86c946dbf335 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:02.196171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8c60571-0e52-4aeb-8bd0-86c946dbf335 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:02.196603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8c60571-0e52-4aeb-8bd0-86c946dbf335 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:02.262258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8c60571-0e52-4aeb-8bd0-86c946dbf335 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:02.271135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8c60571-0e52-4aeb-8bd0-86c946dbf335 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:02.272632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8c60571-0e52-4aeb-8bd0-86c946dbf335 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:02.273799 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8c60571-0e52-4aeb-8bd0-86c946dbf335 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1335 microversion: 2.47 time: 0.092375 Aug 23 18:18:02.274571 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2735/5342] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:02 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1335 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:02.624291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45155974-d29a-4ff7-a4c5-b3a6c6ebc437 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:02.624981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-45155974-d29a-4ff7-a4c5-b3a6c6ebc437 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:02.633233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45155974-d29a-4ff7-a4c5-b3a6c6ebc437 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:02.633732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45155974-d29a-4ff7-a4c5-b3a6c6ebc437 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:02.634352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45155974-d29a-4ff7-a4c5-b3a6c6ebc437 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:02.635104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45155974-d29a-4ff7-a4c5-b3a6c6ebc437 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:02.635816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45155974-d29a-4ff7-a4c5-b3a6c6ebc437 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:02.638715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45155974-d29a-4ff7-a4c5-b3a6c6ebc437 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:02.778245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-45155974-d29a-4ff7-a4c5-b3a6c6ebc437 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:02.786165 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-45155974-d29a-4ff7-a4c5-b3a6c6ebc437 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1493 microversion: 2.1 time: 0.165969 Aug 23 18:18:02.786762 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2608/5343] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:02 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1493 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:03.297439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b89f3eab-4c19-4aba-a8dc-80244b4fc622 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:03.298201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b89f3eab-4c19-4aba-a8dc-80244b4fc622 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:03.299924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2bb91063-df32-480b-95b0-e72af5bcc742 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:18:03.303304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2bb91063-df32-480b-95b0-e72af5bcc742 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:03.306664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b89f3eab-4c19-4aba-a8dc-80244b4fc622 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:03.307166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b89f3eab-4c19-4aba-a8dc-80244b4fc622 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:03.307616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b89f3eab-4c19-4aba-a8dc-80244b4fc622 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:03.308333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b89f3eab-4c19-4aba-a8dc-80244b4fc622 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:03.308825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b89f3eab-4c19-4aba-a8dc-80244b4fc622 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:03.309282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b89f3eab-4c19-4aba-a8dc-80244b4fc622 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:03.309425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bb91063-df32-480b-95b0-e72af5bcc742 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:03.310524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bb91063-df32-480b-95b0-e72af5bcc742 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:03.311021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bb91063-df32-480b-95b0-e72af5bcc742 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:03.311910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bb91063-df32-480b-95b0-e72af5bcc742 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:03.312207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bb91063-df32-480b-95b0-e72af5bcc742 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:03.312629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bb91063-df32-480b-95b0-e72af5bcc742 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:03.376606 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2bb91063-df32-480b-95b0-e72af5bcc742 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "POST /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517/action" status: 200 len: 24538 microversion: 2.1 time: 0.078316 Aug 23 18:18:03.377282 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2609/5344] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:18:03 2022] POST /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517/action => generated 24538 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:18:03.381784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b89f3eab-4c19-4aba-a8dc-80244b4fc622 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:03.390935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b89f3eab-4c19-4aba-a8dc-80244b4fc622 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:03.392452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b89f3eab-4c19-4aba-a8dc-80244b4fc622 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:03.393594 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b89f3eab-4c19-4aba-a8dc-80244b4fc622 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1335 microversion: 2.47 time: 0.100242 Aug 23 18:18:03.394380 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2736/5345] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:03 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1335 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:03.808715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86528609-b2ce-4ff5-af68-554752d809d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:03.809441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-86528609-b2ce-4ff5-af68-554752d809d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:03.817897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86528609-b2ce-4ff5-af68-554752d809d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:03.818456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86528609-b2ce-4ff5-af68-554752d809d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:03.818994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86528609-b2ce-4ff5-af68-554752d809d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:03.819701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86528609-b2ce-4ff5-af68-554752d809d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:03.820156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86528609-b2ce-4ff5-af68-554752d809d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:03.820580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86528609-b2ce-4ff5-af68-554752d809d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:03.982063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-86528609-b2ce-4ff5-af68-554752d809d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:04.001628 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-86528609-b2ce-4ff5-af68-554752d809d8 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1493 microversion: 2.1 time: 0.197458 Aug 23 18:18:04.002223 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2610/5346] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:03 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1493 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:04.333617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-622f231e-2b20-47b9-bfca-1929e629da1b req-ce5cc637-efd4-46d4-9586-91bb75cbdf7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e78af1d-a084-470c-a742-90fbf9fd4b43", "name": "network-vif-deleted", "tag": "5e1e9a32-1eaf-439c-a37f-c780e4e2d8a8"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:18:04.347970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-622f231e-2b20-47b9-bfca-1929e629da1b req-ce5cc637-efd4-46d4-9586-91bb75cbdf7e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:04.348502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-622f231e-2b20-47b9-bfca-1929e629da1b req-ce5cc637-efd4-46d4-9586-91bb75cbdf7e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:04.352438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-622f231e-2b20-47b9-bfca-1929e629da1b req-ce5cc637-efd4-46d4-9586-91bb75cbdf7e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:04.367999 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-622f231e-2b20-47b9-bfca-1929e629da1b req-ce5cc637-efd4-46d4-9586-91bb75cbdf7e service nova] Creating event network-vif-deleted:5e1e9a32-1eaf-439c-a37f-c780e4e2d8a8 for instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 on n-h2-850468-16 Aug 23 18:18:04.373224 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-622f231e-2b20-47b9-bfca-1929e629da1b req-ce5cc637-efd4-46d4-9586-91bb75cbdf7e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043391 Aug 23 18:18:04.374149 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2737/5347] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:18:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:18:04.418424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ea2c35af-8835-448c-a89d-9cb29e2d729c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:04.419624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ea2c35af-8835-448c-a89d-9cb29e2d729c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:04.428329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea2c35af-8835-448c-a89d-9cb29e2d729c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:04.429067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea2c35af-8835-448c-a89d-9cb29e2d729c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:04.429680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea2c35af-8835-448c-a89d-9cb29e2d729c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:04.430772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea2c35af-8835-448c-a89d-9cb29e2d729c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:04.431460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea2c35af-8835-448c-a89d-9cb29e2d729c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:04.432084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea2c35af-8835-448c-a89d-9cb29e2d729c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:04.510869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ea2c35af-8835-448c-a89d-9cb29e2d729c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:04.520081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ea2c35af-8835-448c-a89d-9cb29e2d729c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:04.521609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ea2c35af-8835-448c-a89d-9cb29e2d729c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:04.522768 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ea2c35af-8835-448c-a89d-9cb29e2d729c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1335 microversion: 2.47 time: 0.109719 Aug 23 18:18:04.523541 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2611/5348] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:04 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1335 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:05.024277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6fb769a6-67ff-4e26-ad99-828a0ab403d0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:05.024990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6fb769a6-67ff-4e26-ad99-828a0ab403d0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:05.031430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fb769a6-67ff-4e26-ad99-828a0ab403d0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:05.031922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fb769a6-67ff-4e26-ad99-828a0ab403d0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:05.032379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fb769a6-67ff-4e26-ad99-828a0ab403d0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:05.033062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fb769a6-67ff-4e26-ad99-828a0ab403d0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:05.033516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fb769a6-67ff-4e26-ad99-828a0ab403d0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:05.033942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fb769a6-67ff-4e26-ad99-828a0ab403d0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:05.109215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6fb769a6-67ff-4e26-ad99-828a0ab403d0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:05.117666 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6fb769a6-67ff-4e26-ad99-828a0ab403d0 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1451 microversion: 2.1 time: 0.097645 Aug 23 18:18:05.118241 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2738/5349] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:05 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1451 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:05.547093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b75cb89d-aeff-42d4-b706-24735d5d76b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:05.547736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b75cb89d-aeff-42d4-b706-24735d5d76b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:05.555560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b75cb89d-aeff-42d4-b706-24735d5d76b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:05.556043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b75cb89d-aeff-42d4-b706-24735d5d76b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:05.556475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b75cb89d-aeff-42d4-b706-24735d5d76b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:05.557181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b75cb89d-aeff-42d4-b706-24735d5d76b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:05.557626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b75cb89d-aeff-42d4-b706-24735d5d76b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:05.558051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b75cb89d-aeff-42d4-b706-24735d5d76b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:05.627974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b75cb89d-aeff-42d4-b706-24735d5d76b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:05.637613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b75cb89d-aeff-42d4-b706-24735d5d76b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:05.639232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b75cb89d-aeff-42d4-b706-24735d5d76b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:05.640377 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b75cb89d-aeff-42d4-b706-24735d5d76b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1335 microversion: 2.47 time: 0.097284 Aug 23 18:18:05.640949 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2612/5350] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:05 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1335 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:06.139715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d48bf08-ddd5-4c20-9406-121927b3e71c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:06.140336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8d48bf08-ddd5-4c20-9406-121927b3e71c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:06.147423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d48bf08-ddd5-4c20-9406-121927b3e71c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:06.147912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d48bf08-ddd5-4c20-9406-121927b3e71c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:06.148356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d48bf08-ddd5-4c20-9406-121927b3e71c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:06.149056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d48bf08-ddd5-4c20-9406-121927b3e71c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:06.149520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d48bf08-ddd5-4c20-9406-121927b3e71c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:06.149950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d48bf08-ddd5-4c20-9406-121927b3e71c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:06.212801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8d48bf08-ddd5-4c20-9406-121927b3e71c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:06.220862 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8d48bf08-ddd5-4c20-9406-121927b3e71c tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1451 microversion: 2.1 time: 0.085165 Aug 23 18:18:06.221430 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2739/5351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:06 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1451 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:18:06.664516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff52c1ad-6dd3-46fa-9c2e-f2e07a3ac723 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:06.665309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff52c1ad-6dd3-46fa-9c2e-f2e07a3ac723 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:06.672461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff52c1ad-6dd3-46fa-9c2e-f2e07a3ac723 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:06.672984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff52c1ad-6dd3-46fa-9c2e-f2e07a3ac723 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:06.673431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff52c1ad-6dd3-46fa-9c2e-f2e07a3ac723 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:06.674136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff52c1ad-6dd3-46fa-9c2e-f2e07a3ac723 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:06.674620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff52c1ad-6dd3-46fa-9c2e-f2e07a3ac723 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:06.675934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff52c1ad-6dd3-46fa-9c2e-f2e07a3ac723 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:06.700377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:06.749366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff52c1ad-6dd3-46fa-9c2e-f2e07a3ac723 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:06.758572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff52c1ad-6dd3-46fa-9c2e-f2e07a3ac723 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:06.760214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff52c1ad-6dd3-46fa-9c2e-f2e07a3ac723 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:06.761349 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff52c1ad-6dd3-46fa-9c2e-f2e07a3ac723 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1335 microversion: 2.47 time: 0.101066 Aug 23 18:18:06.762167 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2613/5352] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:06 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1335 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:18:07.243435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:07.244227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:07.251635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:07.252129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:07.252607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:07.253599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:07.254069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:07.254508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:07.287487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:07.287974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:07.288407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:07.288860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lazy-loading 'fault' on Instance uuid 9e78af1d-a084-470c-a742-90fbf9fd4b43 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:18:07.336330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:07.348171 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3f40a065-bded-41a4-b59e-4d80faa2eaf6 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1309 microversion: 2.1 time: 0.108711 Aug 23 18:18:07.348761 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2740/5353] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:07 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1309 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:07.785355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2be2be8a-8dd8-4dab-8a06-63eee3e502cd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:07.786080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2be2be8a-8dd8-4dab-8a06-63eee3e502cd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:07.792676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2be2be8a-8dd8-4dab-8a06-63eee3e502cd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:07.793168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2be2be8a-8dd8-4dab-8a06-63eee3e502cd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:07.793897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2be2be8a-8dd8-4dab-8a06-63eee3e502cd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:07.794638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2be2be8a-8dd8-4dab-8a06-63eee3e502cd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:07.795104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2be2be8a-8dd8-4dab-8a06-63eee3e502cd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:07.795541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2be2be8a-8dd8-4dab-8a06-63eee3e502cd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:07.863411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2be2be8a-8dd8-4dab-8a06-63eee3e502cd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:07.871872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2be2be8a-8dd8-4dab-8a06-63eee3e502cd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:07.873327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2be2be8a-8dd8-4dab-8a06-63eee3e502cd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:07.874483 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2be2be8a-8dd8-4dab-8a06-63eee3e502cd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1335 microversion: 2.47 time: 0.093653 Aug 23 18:18:07.875097 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2614/5354] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:07 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1335 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:08.369354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:08.369966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:08.373168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:08.379121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:08.379622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:08.380069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:08.380779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:08.381239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:08.381675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:08.419698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:08.420193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:08.420637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:08.421095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lazy-loading 'fault' on Instance uuid 9e78af1d-a084-470c-a742-90fbf9fd4b43 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:18:08.478701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:08.487212 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eb148aac-3f5e-43e1-ac91-7eadfbc37682 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 200 len: 1309 microversion: 2.1 time: 0.121499 Aug 23 18:18:08.489060 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2741/5355] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:08 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:08.899165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-68c0f065-94ef-4c29-ba0f-2605ef7c47d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:08.899772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-68c0f065-94ef-4c29-ba0f-2605ef7c47d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:08.901675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:08.903227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=14 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:08.909013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68c0f065-94ef-4c29-ba0f-2605ef7c47d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:08.910210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68c0f065-94ef-4c29-ba0f-2605ef7c47d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:08.910905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68c0f065-94ef-4c29-ba0f-2605ef7c47d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:08.911643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68c0f065-94ef-4c29-ba0f-2605ef7c47d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:08.912072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68c0f065-94ef-4c29-ba0f-2605ef7c47d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:08.912495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68c0f065-94ef-4c29-ba0f-2605ef7c47d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:08.980103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-68c0f065-94ef-4c29-ba0f-2605ef7c47d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:08.988664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-68c0f065-94ef-4c29-ba0f-2605ef7c47d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:08.990405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-68c0f065-94ef-4c29-ba0f-2605ef7c47d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:08.991665 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-68c0f065-94ef-4c29-ba0f-2605ef7c47d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1356 microversion: 2.47 time: 0.096803 Aug 23 18:18:08.992225 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2615/5356] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:08 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1356 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:09.015578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:18:09.019319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.026022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.026779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.027223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.027935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.028392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.028819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.115200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:18:09.115631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:18:09.116116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:18:09.116560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:18:09.116978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:18:09.181177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.187863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.188466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.189100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.190144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.191355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.191787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.222408 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d1df54b3-22d5-46db-84f0-b899e17e0ff4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "POST /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4/action" status: 202 len: 1078 microversion: 2.47 time: 0.210031 Aug 23 18:18:09.223479 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2742/5357] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 18:18:09 2022] POST /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4/action => generated 1078 bytes in 212 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Aug 23 18:18:09.241446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6dfe6ad2-26e5-4fb2-ba31-654ee7d6d19f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.241987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6dfe6ad2-26e5-4fb2-ba31-654ee7d6d19f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.248563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dfe6ad2-26e5-4fb2-ba31-654ee7d6d19f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.249059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dfe6ad2-26e5-4fb2-ba31-654ee7d6d19f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.249621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dfe6ad2-26e5-4fb2-ba31-654ee7d6d19f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.250327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dfe6ad2-26e5-4fb2-ba31-654ee7d6d19f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.250818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dfe6ad2-26e5-4fb2-ba31-654ee7d6d19f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.251462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6dfe6ad2-26e5-4fb2-ba31-654ee7d6d19f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.329626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6dfe6ad2-26e5-4fb2-ba31-654ee7d6d19f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:09.339226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6dfe6ad2-26e5-4fb2-ba31-654ee7d6d19f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:09.340990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6dfe6ad2-26e5-4fb2-ba31-654ee7d6d19f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:09.342378 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6dfe6ad2-26e5-4fb2-ba31-654ee7d6d19f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.105000 Aug 23 18:18:09.343291 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2616/5358] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:09 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:09.509434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-713f3f8f-e481-4f56-b645-d8865eb2fb0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.511020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-713f3f8f-e481-4f56-b645-d8865eb2fb0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.520138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-713f3f8f-e481-4f56-b645-d8865eb2fb0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.521029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-713f3f8f-e481-4f56-b645-d8865eb2fb0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.521810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-713f3f8f-e481-4f56-b645-d8865eb2fb0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.522989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-713f3f8f-e481-4f56-b645-d8865eb2fb0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.523553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-713f3f8f-e481-4f56-b645-d8865eb2fb0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.524203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-713f3f8f-e481-4f56-b645-d8865eb2fb0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.539556 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-713f3f8f-e481-4f56-b645-d8865eb2fb0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-713f3f8f-e481-4f56-b645-d8865eb2fb0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 HTTP/1.1 Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '9e78af1d-a084-470c-a742-90fbf9fd4b43'} Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.541372 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.546314 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.546314 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.546314 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.546314 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:09.546314 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:09.546314 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.546314 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.546314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-713f3f8f-e481-4f56-b645-d8865eb2fb0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:09.546314 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-713f3f8f-e481-4f56-b645-d8865eb2fb0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 404 len: 111 microversion: 2.1 time: 0.037354 Aug 23 18:18:09.546314 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2743/5359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:09 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:09.559585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91f90568-02f5-4e18-b182-39937219b294 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.560211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-91f90568-02f5-4e18-b182-39937219b294 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.566469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f90568-02f5-4e18-b182-39937219b294 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.567053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f90568-02f5-4e18-b182-39937219b294 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.567787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f90568-02f5-4e18-b182-39937219b294 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.568995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f90568-02f5-4e18-b182-39937219b294 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.569462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f90568-02f5-4e18-b182-39937219b294 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.569896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f90568-02f5-4e18-b182-39937219b294 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.584038 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-91f90568-02f5-4e18-b182-39937219b294 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91f90568-02f5-4e18-b182-39937219b294 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 HTTP/1.1 Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '9e78af1d-a084-470c-a742-90fbf9fd4b43'} Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:09.585857 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91f90568-02f5-4e18-b182-39937219b294 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-91f90568-02f5-4e18-b182-39937219b294 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 404 len: 111 microversion: 2.1 time: 0.031625 Aug 23 18:18:09.591451 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2617/5360] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:18:09 2022] DELETE /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:18:09.596509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0c1b2d6b-7997-48fd-8431-0d13d4543e4a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.597749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0c1b2d6b-7997-48fd-8431-0d13d4543e4a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 9e78af1d-a084-470c-a742-90fbf9fd4b43] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.604313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c1b2d6b-7997-48fd-8431-0d13d4543e4a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.604808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c1b2d6b-7997-48fd-8431-0d13d4543e4a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.605249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c1b2d6b-7997-48fd-8431-0d13d4543e4a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.605956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c1b2d6b-7997-48fd-8431-0d13d4543e4a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.606411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c1b2d6b-7997-48fd-8431-0d13d4543e4a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.606936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c1b2d6b-7997-48fd-8431-0d13d4543e4a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.622243 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-0c1b2d6b-7997-48fd-8431-0d13d4543e4a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0c1b2d6b-7997-48fd-8431-0d13d4543e4a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 HTTP/1.1 Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '9e78af1d-a084-470c-a742-90fbf9fd4b43'} Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.623822 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.630456 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.630456 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.630456 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.630456 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:09.630456 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:09.630456 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. Aug 23 18:18:09.630456 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.630456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0c1b2d6b-7997-48fd-8431-0d13d4543e4a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 9e78af1d-a084-470c-a742-90fbf9fd4b43 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:09.630456 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0c1b2d6b-7997-48fd-8431-0d13d4543e4a tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43" status: 404 len: 111 microversion: 2.1 time: 0.032605 Aug 23 18:18:09.630456 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2744/5361] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:09 2022] GET /compute/v2.1/servers/9e78af1d-a084-470c-a742-90fbf9fd4b43 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:09.637461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-64c0a36b-9484-4bc1-8175-3a4812d13baf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.637929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-64c0a36b-9484-4bc1-8175-3a4812d13baf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.650312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64c0a36b-9484-4bc1-8175-3a4812d13baf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.650836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64c0a36b-9484-4bc1-8175-3a4812d13baf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.651280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64c0a36b-9484-4bc1-8175-3a4812d13baf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.652041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64c0a36b-9484-4bc1-8175-3a4812d13baf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.652505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64c0a36b-9484-4bc1-8175-3a4812d13baf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.652945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64c0a36b-9484-4bc1-8175-3a4812d13baf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.669404 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-64c0a36b-9484-4bc1-8175-3a4812d13baf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-64c0a36b-9484-4bc1-8175-3a4812d13baf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f HTTP/1.1 Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'e6e6d612-1196-4700-b893-d355ca237e7f'} Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:09.671258 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-64c0a36b-9484-4bc1-8175-3a4812d13baf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-64c0a36b-9484-4bc1-8175-3a4812d13baf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 404 len: 111 microversion: 2.1 time: 0.040124 Aug 23 18:18:09.678189 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2618/5362] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:18:09 2022] DELETE /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:09.683719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9982ee80-47d8-460d-ba9b-1414fd42e61b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.684334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9982ee80-47d8-460d-ba9b-1414fd42e61b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: e6e6d612-1196-4700-b893-d355ca237e7f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.690430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9982ee80-47d8-460d-ba9b-1414fd42e61b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.691104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9982ee80-47d8-460d-ba9b-1414fd42e61b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.691544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9982ee80-47d8-460d-ba9b-1414fd42e61b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.692248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9982ee80-47d8-460d-ba9b-1414fd42e61b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.692705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9982ee80-47d8-460d-ba9b-1414fd42e61b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.693133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9982ee80-47d8-460d-ba9b-1414fd42e61b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.707170 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-9982ee80-47d8-460d-ba9b-1414fd42e61b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9982ee80-47d8-460d-ba9b-1414fd42e61b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f HTTP/1.1 Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'e6e6d612-1196-4700-b893-d355ca237e7f'} Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.708714 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.714020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.714020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.714020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.714020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:09.714020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:09.714020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. Aug 23 18:18:09.714020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.714020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9982ee80-47d8-460d-ba9b-1414fd42e61b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance e6e6d612-1196-4700-b893-d355ca237e7f could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:09.714020 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9982ee80-47d8-460d-ba9b-1414fd42e61b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f" status: 404 len: 111 microversion: 2.1 time: 0.030254 Aug 23 18:18:09.714020 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2745/5363] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:09 2022] GET /compute/v2.1/servers/e6e6d612-1196-4700-b893-d355ca237e7f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:18:09.718965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed17f372-2ba7-462d-9fbf-09e9ece4b77f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.719469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ed17f372-2ba7-462d-9fbf-09e9ece4b77f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.726186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed17f372-2ba7-462d-9fbf-09e9ece4b77f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.727240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed17f372-2ba7-462d-9fbf-09e9ece4b77f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.727240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed17f372-2ba7-462d-9fbf-09e9ece4b77f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.727841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed17f372-2ba7-462d-9fbf-09e9ece4b77f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.728299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed17f372-2ba7-462d-9fbf-09e9ece4b77f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.728730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed17f372-2ba7-462d-9fbf-09e9ece4b77f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.742643 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-ed17f372-2ba7-462d-9fbf-09e9ece4b77f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed17f372-2ba7-462d-9fbf-09e9ece4b77f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 HTTP/1.1 Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0'} Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:09.744356 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed17f372-2ba7-462d-9fbf-09e9ece4b77f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ed17f372-2ba7-462d-9fbf-09e9ece4b77f tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 404 len: 111 microversion: 2.1 time: 0.030977 Aug 23 18:18:09.748936 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2619/5364] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:18:09 2022] DELETE /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:09.754564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f9ea4008-8223-413e-829f-30b8fe35bedf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.755199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f9ea4008-8223-413e-829f-30b8fe35bedf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.761406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9ea4008-8223-413e-829f-30b8fe35bedf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.761844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9ea4008-8223-413e-829f-30b8fe35bedf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.762282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9ea4008-8223-413e-829f-30b8fe35bedf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.763020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9ea4008-8223-413e-829f-30b8fe35bedf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.763486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9ea4008-8223-413e-829f-30b8fe35bedf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.763917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9ea4008-8223-413e-829f-30b8fe35bedf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.778123 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-f9ea4008-8223-413e-829f-30b8fe35bedf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f9ea4008-8223-413e-829f-30b8fe35bedf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 HTTP/1.1 Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0'} Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.779698 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.788817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.788817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.788817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.788817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:09.788817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:09.788817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. Aug 23 18:18:09.788817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.788817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f9ea4008-8223-413e-829f-30b8fe35bedf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:09.788817 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f9ea4008-8223-413e-829f-30b8fe35bedf tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0" status: 404 len: 111 microversion: 2.1 time: 0.030733 Aug 23 18:18:09.788817 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2746/5365] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:09 2022] GET /compute/v2.1/servers/f541d0cd-ec8e-4b36-9ff9-4b5f2bdc24e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:09.790279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de929862-04ba-4ebb-8f26-d0409bb07f32 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.790814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-de929862-04ba-4ebb-8f26-d0409bb07f32 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.796926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de929862-04ba-4ebb-8f26-d0409bb07f32 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.797408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de929862-04ba-4ebb-8f26-d0409bb07f32 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.797845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de929862-04ba-4ebb-8f26-d0409bb07f32 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.798551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de929862-04ba-4ebb-8f26-d0409bb07f32 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.799016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de929862-04ba-4ebb-8f26-d0409bb07f32 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.799442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de929862-04ba-4ebb-8f26-d0409bb07f32 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.813419 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-de929862-04ba-4ebb-8f26-d0409bb07f32 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de929862-04ba-4ebb-8f26-d0409bb07f32 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc HTTP/1.1 Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '404a2173-45ea-493f-8fc8-153dfd7896fc'} Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:09.815069 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de929862-04ba-4ebb-8f26-d0409bb07f32 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-de929862-04ba-4ebb-8f26-d0409bb07f32 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 404 len: 111 microversion: 2.1 time: 0.030096 Aug 23 18:18:09.820823 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2620/5366] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:18:09 2022] DELETE /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:09.826122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b1e24e18-96be-478a-a53a-5fd869783cc5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.826920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b1e24e18-96be-478a-a53a-5fd869783cc5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 404a2173-45ea-493f-8fc8-153dfd7896fc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.834658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1e24e18-96be-478a-a53a-5fd869783cc5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.835217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1e24e18-96be-478a-a53a-5fd869783cc5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.835723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1e24e18-96be-478a-a53a-5fd869783cc5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.836483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1e24e18-96be-478a-a53a-5fd869783cc5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.837424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1e24e18-96be-478a-a53a-5fd869783cc5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.837632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1e24e18-96be-478a-a53a-5fd869783cc5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.853918 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b1e24e18-96be-478a-a53a-5fd869783cc5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b1e24e18-96be-478a-a53a-5fd869783cc5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc HTTP/1.1 Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '404a2173-45ea-493f-8fc8-153dfd7896fc'} Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.855522 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.860697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.860697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.860697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.860697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:09.860697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:09.860697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. Aug 23 18:18:09.860697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.860697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b1e24e18-96be-478a-a53a-5fd869783cc5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 404a2173-45ea-493f-8fc8-153dfd7896fc could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:09.860697 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b1e24e18-96be-478a-a53a-5fd869783cc5 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc" status: 404 len: 111 microversion: 2.1 time: 0.035094 Aug 23 18:18:09.860697 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2747/5367] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:09 2022] GET /compute/v2.1/servers/404a2173-45ea-493f-8fc8-153dfd7896fc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:09.866521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eabc5eaa-234f-4c28-b50a-52cbda9c0197 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.867138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eabc5eaa-234f-4c28-b50a-52cbda9c0197 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.873316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eabc5eaa-234f-4c28-b50a-52cbda9c0197 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.873799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eabc5eaa-234f-4c28-b50a-52cbda9c0197 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.874235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eabc5eaa-234f-4c28-b50a-52cbda9c0197 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.874953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eabc5eaa-234f-4c28-b50a-52cbda9c0197 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.875410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eabc5eaa-234f-4c28-b50a-52cbda9c0197 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.875838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eabc5eaa-234f-4c28-b50a-52cbda9c0197 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.893032 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-eabc5eaa-234f-4c28-b50a-52cbda9c0197 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eabc5eaa-234f-4c28-b50a-52cbda9c0197 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 HTTP/1.1 Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '8220873b-1b5e-457b-911a-1cd53303f7d9'} Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:09.894877 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eabc5eaa-234f-4c28-b50a-52cbda9c0197 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eabc5eaa-234f-4c28-b50a-52cbda9c0197 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 404 len: 111 microversion: 2.1 time: 0.034732 Aug 23 18:18:09.900318 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2621/5368] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:18:09 2022] DELETE /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:09.907615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fee2d3ab-81a8-49c8-b3c4-4e7c76893c7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.908239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fee2d3ab-81a8-49c8-b3c4-4e7c76893c7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 8220873b-1b5e-457b-911a-1cd53303f7d9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.914733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fee2d3ab-81a8-49c8-b3c4-4e7c76893c7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.915235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fee2d3ab-81a8-49c8-b3c4-4e7c76893c7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.915867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fee2d3ab-81a8-49c8-b3c4-4e7c76893c7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.916597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fee2d3ab-81a8-49c8-b3c4-4e7c76893c7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.917059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fee2d3ab-81a8-49c8-b3c4-4e7c76893c7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.917489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fee2d3ab-81a8-49c8-b3c4-4e7c76893c7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.934532 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-fee2d3ab-81a8-49c8-b3c4-4e7c76893c7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fee2d3ab-81a8-49c8-b3c4-4e7c76893c7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 HTTP/1.1 Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '8220873b-1b5e-457b-911a-1cd53303f7d9'} Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.938585 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.943949 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.943949 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.943949 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.943949 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:09.943949 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:09.943949 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. Aug 23 18:18:09.943949 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.943949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fee2d3ab-81a8-49c8-b3c4-4e7c76893c7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 8220873b-1b5e-457b-911a-1cd53303f7d9 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:09.943949 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fee2d3ab-81a8-49c8-b3c4-4e7c76893c7b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9" status: 404 len: 111 microversion: 2.1 time: 0.035866 Aug 23 18:18:09.943949 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2748/5369] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:09 2022] GET /compute/v2.1/servers/8220873b-1b5e-457b-911a-1cd53303f7d9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:09.949345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e83fc443-8e56-4216-af02-1bb48cc6a1a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.949851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e83fc443-8e56-4216-af02-1bb48cc6a1a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.957131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e83fc443-8e56-4216-af02-1bb48cc6a1a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.957623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e83fc443-8e56-4216-af02-1bb48cc6a1a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.958072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e83fc443-8e56-4216-af02-1bb48cc6a1a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.958873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e83fc443-8e56-4216-af02-1bb48cc6a1a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.959342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e83fc443-8e56-4216-af02-1bb48cc6a1a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.959776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e83fc443-8e56-4216-af02-1bb48cc6a1a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.974133 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-e83fc443-8e56-4216-af02-1bb48cc6a1a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e83fc443-8e56-4216-af02-1bb48cc6a1a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 HTTP/1.1 Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '839bd8e1-c38c-4cb8-ac70-9f26284fe291'} Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:09.975771 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e83fc443-8e56-4216-af02-1bb48cc6a1a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e83fc443-8e56-4216-af02-1bb48cc6a1a4 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 404 len: 111 microversion: 2.1 time: 0.031971 Aug 23 18:18:09.980814 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2622/5370] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:18:09 2022] DELETE /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:18:09.986659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-005f6855-6167-40ea-85e6-70c11fba0021 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:09.987940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-005f6855-6167-40ea-85e6-70c11fba0021 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 839bd8e1-c38c-4cb8-ac70-9f26284fe291] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:09.994309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-005f6855-6167-40ea-85e6-70c11fba0021 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.994903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-005f6855-6167-40ea-85e6-70c11fba0021 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.995416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-005f6855-6167-40ea-85e6-70c11fba0021 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:09.996198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-005f6855-6167-40ea-85e6-70c11fba0021 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:09.996726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-005f6855-6167-40ea-85e6-70c11fba0021 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:09.997221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-005f6855-6167-40ea-85e6-70c11fba0021 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:10.011664 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-005f6855-6167-40ea-85e6-70c11fba0021 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-005f6855-6167-40ea-85e6-70c11fba0021 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 HTTP/1.1 Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '839bd8e1-c38c-4cb8-ac70-9f26284fe291'} Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:10.013147 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.020181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:10.020181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:10.020181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:10.020181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:10.020181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:10.020181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. Aug 23 18:18:10.020181 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.020181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-005f6855-6167-40ea-85e6-70c11fba0021 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 839bd8e1-c38c-4cb8-ac70-9f26284fe291 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:10.020181 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-005f6855-6167-40ea-85e6-70c11fba0021 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291" status: 404 len: 111 microversion: 2.1 time: 0.031843 Aug 23 18:18:10.020181 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2749/5371] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:09 2022] GET /compute/v2.1/servers/839bd8e1-c38c-4cb8-ac70-9f26284fe291 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:10.023396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-23cfd85c-5b62-40fb-b01d-e0ff7e9b1c72 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:10.023914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-23cfd85c-5b62-40fb-b01d-e0ff7e9b1c72 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 4c05b516-7563-4e2d-8185-9d3ca7dbdadc] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:10.029410 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-23cfd85c-5b62-40fb-b01d-e0ff7e9b1c72 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-23cfd85c-5b62-40fb-b01d-e0ff7e9b1c72 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/4c05b516-7563-4e2d-8185-9d3ca7dbdadc HTTP/1.1 Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '4c05b516-7563-4e2d-8185-9d3ca7dbdadc'} Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:10.030978 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.036568 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:10.036568 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:10.036568 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:10.036568 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:10.036568 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:10.036568 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:18:10.036568 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.036568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-23cfd85c-5b62-40fb-b01d-e0ff7e9b1c72 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:10.036568 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-23cfd85c-5b62-40fb-b01d-e0ff7e9b1c72 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4c05b516-7563-4e2d-8185-9d3ca7dbdadc" status: 404 len: 111 microversion: 2.1 time: 0.012906 Aug 23 18:18:10.036568 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2623/5372] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:18:10 2022] DELETE /compute/v2.1/servers/4c05b516-7563-4e2d-8185-9d3ca7dbdadc => generated 111 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:10.041299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f9486c4-fe4b-4c2c-886e-5c6dc94766ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:10.041911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7f9486c4-fe4b-4c2c-886e-5c6dc94766ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: 4c05b516-7563-4e2d-8185-9d3ca7dbdadc] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:10.047509 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-7f9486c4-fe4b-4c2c-886e-5c6dc94766ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f9486c4-fe4b-4c2c-886e-5c6dc94766ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/4c05b516-7563-4e2d-8185-9d3ca7dbdadc HTTP/1.1 Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '4c05b516-7563-4e2d-8185-9d3ca7dbdadc'} Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:10.048971 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:10.055052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:10.055052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:10.055052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:10.055052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. Aug 23 18:18:10.055052 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:10.055052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f9486c4-fe4b-4c2c-886e-5c6dc94766ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance 4c05b516-7563-4e2d-8185-9d3ca7dbdadc could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:10.055052 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7f9486c4-fe4b-4c2c-886e-5c6dc94766ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/4c05b516-7563-4e2d-8185-9d3ca7dbdadc" status: 404 len: 111 microversion: 2.1 time: 0.013576 Aug 23 18:18:10.055052 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2750/5373] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:10 2022] GET /compute/v2.1/servers/4c05b516-7563-4e2d-8185-9d3ca7dbdadc => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:10.060756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-923b4799-d69a-48a9-a352-32476e9c3d6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:10.061263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-923b4799-d69a-48a9-a352-32476e9c3d6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:10.069059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-923b4799-d69a-48a9-a352-32476e9c3d6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:10.069589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-923b4799-d69a-48a9-a352-32476e9c3d6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:10.070036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-923b4799-d69a-48a9-a352-32476e9c3d6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:10.070861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-923b4799-d69a-48a9-a352-32476e9c3d6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:10.071261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-923b4799-d69a-48a9-a352-32476e9c3d6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:10.071659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-923b4799-d69a-48a9-a352-32476e9c3d6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:10.096453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-923b4799-d69a-48a9-a352-32476e9c3d6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:18:10.192408 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-923b4799-d69a-48a9-a352-32476e9c3d6e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "DELETE /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 204 len: 0 microversion: 2.1 time: 0.135454 Aug 23 18:18:10.196189 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2624/5374] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:18:10 2022] DELETE /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:18:10.202578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-20239064-1b06-4d5b-92bf-00c583070b0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:10.203384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-20239064-1b06-4d5b-92bf-00c583070b0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:10.217153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20239064-1b06-4d5b-92bf-00c583070b0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:10.217665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20239064-1b06-4d5b-92bf-00c583070b0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:10.218127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20239064-1b06-4d5b-92bf-00c583070b0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:10.219141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20239064-1b06-4d5b-92bf-00c583070b0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:10.219732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20239064-1b06-4d5b-92bf-00c583070b0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:10.220618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20239064-1b06-4d5b-92bf-00c583070b0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:10.225972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:10.362907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-20239064-1b06-4d5b-92bf-00c583070b0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:10.367767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e2c99c2-504a-4756-b103-acb60967f83f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:10.368473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2e2c99c2-504a-4756-b103-acb60967f83f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:10.371406 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-20239064-1b06-4d5b-92bf-00c583070b0b tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1480 microversion: 2.1 time: 0.173767 Aug 23 18:18:10.372101 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2751/5375] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:10 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1480 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:10.374701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e2c99c2-504a-4756-b103-acb60967f83f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:10.375192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e2c99c2-504a-4756-b103-acb60967f83f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:10.375636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e2c99c2-504a-4756-b103-acb60967f83f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:10.376342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e2c99c2-504a-4756-b103-acb60967f83f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:10.376800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e2c99c2-504a-4756-b103-acb60967f83f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:10.377228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e2c99c2-504a-4756-b103-acb60967f83f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:10.446491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2e2c99c2-504a-4756-b103-acb60967f83f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:10.456736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2e2c99c2-504a-4756-b103-acb60967f83f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:10.458402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2e2c99c2-504a-4756-b103-acb60967f83f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:10.459610 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e2c99c2-504a-4756-b103-acb60967f83f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.096122 Aug 23 18:18:10.460168 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2625/5376] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:10 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:18:11.393270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fdfd73e6-8d64-48f8-a3c3-ddd252ef4738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:11.394956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fdfd73e6-8d64-48f8-a3c3-ddd252ef4738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:11.398820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:11.402768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdfd73e6-8d64-48f8-a3c3-ddd252ef4738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:11.403253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdfd73e6-8d64-48f8-a3c3-ddd252ef4738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:11.403691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdfd73e6-8d64-48f8-a3c3-ddd252ef4738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:11.404378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdfd73e6-8d64-48f8-a3c3-ddd252ef4738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:11.404833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdfd73e6-8d64-48f8-a3c3-ddd252ef4738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:11.405254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdfd73e6-8d64-48f8-a3c3-ddd252ef4738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:11.482861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-714dad58-8265-4735-84ca-6ed905b9b5d9 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:11.483567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-714dad58-8265-4735-84ca-6ed905b9b5d9 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:11.500544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-714dad58-8265-4735-84ca-6ed905b9b5d9 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:11.501921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-714dad58-8265-4735-84ca-6ed905b9b5d9 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:11.501921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-714dad58-8265-4735-84ca-6ed905b9b5d9 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:11.502336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-714dad58-8265-4735-84ca-6ed905b9b5d9 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:11.502814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-714dad58-8265-4735-84ca-6ed905b9b5d9 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:11.503911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-714dad58-8265-4735-84ca-6ed905b9b5d9 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:11.573094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fdfd73e6-8d64-48f8-a3c3-ddd252ef4738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:11.575231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-714dad58-8265-4735-84ca-6ed905b9b5d9 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:11.581774 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fdfd73e6-8d64-48f8-a3c3-ddd252ef4738 tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1480 microversion: 2.1 time: 0.192332 Aug 23 18:18:11.582360 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2752/5377] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:11 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1480 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:11.583749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-714dad58-8265-4735-84ca-6ed905b9b5d9 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:11.585259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-714dad58-8265-4735-84ca-6ed905b9b5d9 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:11.586482 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-714dad58-8265-4735-84ca-6ed905b9b5d9 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.107706 Aug 23 18:18:11.588999 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2626/5378] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:11 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:18:12.282729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-2736e95e-7777-432c-ad66-72c6cb60d272 req-0cc78dec-e691-4f34-8075-7beeea2ff43d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0e35640-9377-487d-85e3-96ef4549659b", "name": "network-vif-deleted", "tag": "8bcd1bd5-1d30-437d-bc07-1b0c8f010179"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:18:12.293124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2736e95e-7777-432c-ad66-72c6cb60d272 req-0cc78dec-e691-4f34-8075-7beeea2ff43d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:12.293658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2736e95e-7777-432c-ad66-72c6cb60d272 req-0cc78dec-e691-4f34-8075-7beeea2ff43d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:12.294268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2736e95e-7777-432c-ad66-72c6cb60d272 req-0cc78dec-e691-4f34-8075-7beeea2ff43d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:12.308718 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-2736e95e-7777-432c-ad66-72c6cb60d272 req-0cc78dec-e691-4f34-8075-7beeea2ff43d service nova] Creating event network-vif-deleted:8bcd1bd5-1d30-437d-bc07-1b0c8f010179 for instance c0e35640-9377-487d-85e3-96ef4549659b on n-h1-850468-16 Aug 23 18:18:12.314235 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-2736e95e-7777-432c-ad66-72c6cb60d272 req-0cc78dec-e691-4f34-8075-7beeea2ff43d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035109 Aug 23 18:18:12.315179 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2753/5379] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:18:12.604751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:12.605479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:12.616595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a31b026b-1bc8-4921-88e4-e2afd7dd11d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:12.617392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a31b026b-1bc8-4921-88e4-e2afd7dd11d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:12.624154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:12.624885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:12.625402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:12.625741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a31b026b-1bc8-4921-88e4-e2afd7dd11d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:12.626307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a31b026b-1bc8-4921-88e4-e2afd7dd11d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:12.626475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:12.626922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a31b026b-1bc8-4921-88e4-e2afd7dd11d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:12.627104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:12.627609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:12.630620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a31b026b-1bc8-4921-88e4-e2afd7dd11d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:12.631231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a31b026b-1bc8-4921-88e4-e2afd7dd11d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:12.631672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a31b026b-1bc8-4921-88e4-e2afd7dd11d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:12.681244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:12.681956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:12.682497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:12.683121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lazy-loading 'fault' on Instance uuid c0e35640-9377-487d-85e3-96ef4549659b {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:18:12.712752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a31b026b-1bc8-4921-88e4-e2afd7dd11d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:12.724243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a31b026b-1bc8-4921-88e4-e2afd7dd11d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:12.726086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a31b026b-1bc8-4921-88e4-e2afd7dd11d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:12.727321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a31b026b-1bc8-4921-88e4-e2afd7dd11d8 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.117957 Aug 23 18:18:12.729430 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2754/5380] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:12 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:12.734530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e80c3f1c008459faa3ac74ea5984eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27a6a20a50ef474db0b83487eb029629', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:12.743615 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1a5f2649-b100-41db-83f8-bc00a2288c3e tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 200 len: 1283 microversion: 2.1 time: 0.143295 Aug 23 18:18:12.745695 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2627/5381] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:12 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 1283 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:13.753242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1961a819-541c-4189-870e-8c59cea368fb tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:13.754667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1961a819-541c-4189-870e-8c59cea368fb tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:13.761474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1961a819-541c-4189-870e-8c59cea368fb tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:13.761962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1961a819-541c-4189-870e-8c59cea368fb tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:13.762654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1961a819-541c-4189-870e-8c59cea368fb tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:13.763366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1961a819-541c-4189-870e-8c59cea368fb tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:13.763833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1961a819-541c-4189-870e-8c59cea368fb tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:13.764293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1961a819-541c-4189-870e-8c59cea368fb tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:13.767561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d025893-d2f4-4dd5-8a84-2eb0198429ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:13.768194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d025893-d2f4-4dd5-8a84-2eb0198429ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] [instance: c0e35640-9377-487d-85e3-96ef4549659b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:13.776040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d025893-d2f4-4dd5-8a84-2eb0198429ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:13.776541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d025893-d2f4-4dd5-8a84-2eb0198429ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:13.777011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d025893-d2f4-4dd5-8a84-2eb0198429ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:13.777718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d025893-d2f4-4dd5-8a84-2eb0198429ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:13.778205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d025893-d2f4-4dd5-8a84-2eb0198429ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:13.778663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d025893-d2f4-4dd5-8a84-2eb0198429ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:13.793071 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-5d025893-d2f4-4dd5-8a84-2eb0198429ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] HTTP exception thrown: Instance c0e35640-9377-487d-85e3-96ef4549659b could not be found. Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d025893-d2f4-4dd5-8a84-2eb0198429ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Request method failure captured: Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b HTTP/1.1 Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRjKFbWlSaj0ZI2bVhx-9qFMkEofclaTykU4uJfW79OjaPeG-ZfNmGwfLQ3IzOgM6ES-VH3mLH96-UYdqXq_S2r_cnR8x3KiyHj6yO5gpZhT03wk8_qGiihGEp1eaUDiHN8Aw8_eCcv6L_TOPL6hZpqURjcxuTYKjEaHwO1p_d7lSWg Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/27a6a20a50ef474db0b83487eb029629"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/27a6a20a50ef474db0b83487eb029629"}]}] Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersTestJSON-2083301625 Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 27a6a20a50ef474db0b83487eb029629 Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersTestJSON-2083301625 Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 6e80c3f1c008459faa3ac74ea5984eea Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersTestJSON-2083301625-project Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance c0e35640-9377-487d-85e3-96ef4549659b could not be found. Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'c0e35640-9377-487d-85e3-96ef4549659b'} Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0e35640-9377-487d-85e3-96ef4549659b could not be found. Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0e35640-9377-487d-85e3-96ef4549659b could not be found. Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:13.794811 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:13.803193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:13.803193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:13.803193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:13.803193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:13.803193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:13.803193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0e35640-9377-487d-85e3-96ef4549659b could not be found. Aug 23 18:18:13.803193 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:13.803193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d025893-d2f4-4dd5-8a84-2eb0198429ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] Returning 404 to user: Instance c0e35640-9377-487d-85e3-96ef4549659b could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:13.803193 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d025893-d2f4-4dd5-8a84-2eb0198429ca tempest-ServersTestJSON-2083301625 tempest-ServersTestJSON-2083301625-project] 10.222.0.61 "GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b" status: 404 len: 111 microversion: 2.1 time: 0.032722 Aug 23 18:18:13.803193 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2628/5382] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:13 2022] GET /compute/v2.1/servers/c0e35640-9377-487d-85e3-96ef4549659b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:13.837920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1961a819-541c-4189-870e-8c59cea368fb tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:13.848542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1961a819-541c-4189-870e-8c59cea368fb tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:13.850239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1961a819-541c-4189-870e-8c59cea368fb tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:13.851450 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1961a819-541c-4189-870e-8c59cea368fb tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.102175 Aug 23 18:18:13.852010 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2755/5383] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:13 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:14.876407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f1affce3-282b-4906-b698-0aeb263fd1e3 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:14.877065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f1affce3-282b-4906-b698-0aeb263fd1e3 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:14.890657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1affce3-282b-4906-b698-0aeb263fd1e3 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:14.891459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1affce3-282b-4906-b698-0aeb263fd1e3 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:14.892086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1affce3-282b-4906-b698-0aeb263fd1e3 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:14.892998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1affce3-282b-4906-b698-0aeb263fd1e3 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:14.893658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1affce3-282b-4906-b698-0aeb263fd1e3 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:14.894994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1affce3-282b-4906-b698-0aeb263fd1e3 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:14.990948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f1affce3-282b-4906-b698-0aeb263fd1e3 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:15.000752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f1affce3-282b-4906-b698-0aeb263fd1e3 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:15.002270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f1affce3-282b-4906-b698-0aeb263fd1e3 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:15.004073 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f1affce3-282b-4906-b698-0aeb263fd1e3 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.131166 Aug 23 18:18:15.004742 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2629/5384] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:14 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:16.028194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a576cf69-2d98-4eb4-b14f-8cd14a213411 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:16.029468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a576cf69-2d98-4eb4-b14f-8cd14a213411 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:16.043914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a576cf69-2d98-4eb4-b14f-8cd14a213411 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:16.044606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a576cf69-2d98-4eb4-b14f-8cd14a213411 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:16.045119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a576cf69-2d98-4eb4-b14f-8cd14a213411 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:16.046596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a576cf69-2d98-4eb4-b14f-8cd14a213411 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:16.047048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a576cf69-2d98-4eb4-b14f-8cd14a213411 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:16.051278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a576cf69-2d98-4eb4-b14f-8cd14a213411 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:16.162386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a576cf69-2d98-4eb4-b14f-8cd14a213411 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:16.180760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a576cf69-2d98-4eb4-b14f-8cd14a213411 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:16.182219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a576cf69-2d98-4eb4-b14f-8cd14a213411 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:16.183642 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a576cf69-2d98-4eb4-b14f-8cd14a213411 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.160251 Aug 23 18:18:16.185017 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2756/5385] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:16 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:17.209586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:17.210863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:17.234903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:17.235338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:17.235781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:17.236498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:17.236958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:17.237385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:17.333324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:17.348351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:17.350286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:17.352774 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.147976 Aug 23 18:18:17.354392 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2630/5386] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:17 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:18.376878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-65efdfd2-98d2-48ea-9efb-3d4b420267b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:18.377598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-65efdfd2-98d2-48ea-9efb-3d4b420267b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:18.385191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65efdfd2-98d2-48ea-9efb-3d4b420267b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:18.385689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65efdfd2-98d2-48ea-9efb-3d4b420267b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:18.386136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65efdfd2-98d2-48ea-9efb-3d4b420267b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:18.386875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65efdfd2-98d2-48ea-9efb-3d4b420267b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:18.387513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65efdfd2-98d2-48ea-9efb-3d4b420267b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:18.387950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65efdfd2-98d2-48ea-9efb-3d4b420267b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:18.459636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65efdfd2-98d2-48ea-9efb-3d4b420267b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:18.473388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65efdfd2-98d2-48ea-9efb-3d4b420267b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:18.474951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65efdfd2-98d2-48ea-9efb-3d4b420267b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:18.476131 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-65efdfd2-98d2-48ea-9efb-3d4b420267b2 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.103350 Aug 23 18:18:18.477005 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2757/5387] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:18 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:18.752494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:18.753652 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e54b65cc-ec22-42a8-a4bd-a2fab86a4687 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001404 Aug 23 18:18:18.754084 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2631/5388] 10.222.0.61 () {56 vars in 886 bytes} [Tue Aug 23 18:18:18 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Aug 23 18:18:19.501785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-771b545f-e5cb-4a7c-8339-cea16411da20 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:19.503214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-771b545f-e5cb-4a7c-8339-cea16411da20 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:19.510978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-771b545f-e5cb-4a7c-8339-cea16411da20 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:19.511472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-771b545f-e5cb-4a7c-8339-cea16411da20 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:19.511923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-771b545f-e5cb-4a7c-8339-cea16411da20 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:19.512668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-771b545f-e5cb-4a7c-8339-cea16411da20 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:19.513137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-771b545f-e5cb-4a7c-8339-cea16411da20 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:19.513750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-771b545f-e5cb-4a7c-8339-cea16411da20 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:19.588797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-771b545f-e5cb-4a7c-8339-cea16411da20 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:19.598369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-771b545f-e5cb-4a7c-8339-cea16411da20 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:19.600165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-771b545f-e5cb-4a7c-8339-cea16411da20 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:19.601357 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-771b545f-e5cb-4a7c-8339-cea16411da20 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.104641 Aug 23 18:18:19.601949 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2758/5389] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:19 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:20.212042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5b7b962c-96de-4f9b-a7f0-5fa73861713f tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Action: 'create', calling method: .version_select at 0x7f27ec910ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1581769836", "metadata": {"Type": "work"}}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5b7b962c-96de-4f9b-a7f0-5fa73861713f tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Request method failure captured: Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 122 Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRnsqFdALlvGh_yGMFwonp7UbyaYCQPPmxuL4bO0aWYgldAkf_JOLjZaQNigvLipSRT_wnUJQHeqRKri_ijI7lAKdOk3FW6Q4yiNLhlQpwHZhthkYpNSDa2pRNLuhu7NlOh5J-GuDov0Ga2JUjTm6lvhtWvsZplvi64hRXJbslXSv8I Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 7c1addcd30eb4d04afe3da47d6ecdcf0 Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}] Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 7c1addcd30eb4d04afe3da47d6ecdcf0 Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-VolumesNegativeTest-662722538-project Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 20258de639b74e02927ec1014c90221c Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-VolumesNegativeTest-662722538-project Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1581769836", "metadata": {"Type": "work"}}} Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1581769836', 'metadata': {'Type': 'work'}}}} Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi '#$%' Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:18:20.216339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5b7b962c-96de-4f9b-a7f0-5fa73861713f tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5b7b962c-96de-4f9b-a7f0-5fa73861713f tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.130094 Aug 23 18:18:20.222636 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2632/5390] 10.222.0.61 () {60 vars in 1156 bytes} [Tue Aug 23 18:18:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 132 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:18:20.229545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e29f801d-3183-463c-a8ec-54d7c7df8c44 tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Action: 'create', calling method: .version_select at 0x7f27df5dc700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1598702881", "metadata": {"Type": "work"}}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e29f801d-3183-463c-a8ec-54d7c7df8c44 tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Request method failure captured: Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 120 Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRnsqFdALlvGh_yGMFwonp7UbyaYCQPPmxuL4bO0aWYgldAkf_JOLjZaQNigvLipSRT_wnUJQHeqRKri_ijI7lAKdOk3FW6Q4yiNLhlQpwHZhthkYpNSDa2pRNLuhu7NlOh5J-GuDov0Ga2JUjTm6lvhtWvsZplvi64hRXJbslXSv8I Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 7c1addcd30eb4d04afe3da47d6ecdcf0 Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}] Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 7c1addcd30eb4d04afe3da47d6ecdcf0 Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-VolumesNegativeTest-662722538-project Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 20258de639b74e02927ec1014c90221c Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-VolumesNegativeTest-662722538-project Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1598702881", "metadata": {"Type": "work"}}} Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1598702881', 'metadata': {'Type': 'work'}}}} Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi '0' Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:18:20.233342 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e29f801d-3183-463c-a8ec-54d7c7df8c44 tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e29f801d-3183-463c-a8ec-54d7c7df8c44 tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009024 Aug 23 18:18:20.238994 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2759/5391] 10.222.0.61 () {60 vars in 1156 bytes} [Tue Aug 23 18:18:20 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:18:20.246722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d2108ebc-2ef9-417f-977b-1cfe70a300b6 tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Action: 'create', calling method: .version_select at 0x7f27f1c64700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1802506248", "metadata": {"Type": "work"}}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d2108ebc-2ef9-417f-977b-1cfe70a300b6 tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Request method failure captured: Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 119 Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRnsqFdALlvGh_yGMFwonp7UbyaYCQPPmxuL4bO0aWYgldAkf_JOLjZaQNigvLipSRT_wnUJQHeqRKri_ijI7lAKdOk3FW6Q4yiNLhlQpwHZhthkYpNSDa2pRNLuhu7NlOh5J-GuDov0Ga2JUjTm6lvhtWvsZplvi64hRXJbslXSv8I Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 7c1addcd30eb4d04afe3da47d6ecdcf0 Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}] Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 7c1addcd30eb4d04afe3da47d6ecdcf0 Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-VolumesNegativeTest-662722538-project Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 20258de639b74e02927ec1014c90221c Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-VolumesNegativeTest-662722538-project Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1802506248", "metadata": {"Type": "work"}}} Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1802506248', 'metadata': {'Type': 'work'}}}} Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi '' Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:18:20.250458 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d2108ebc-2ef9-417f-977b-1cfe70a300b6 tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d2108ebc-2ef9-417f-977b-1cfe70a300b6 tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009109 Aug 23 18:18:20.259469 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2633/5392] 10.222.0.61 () {60 vars in 1156 bytes} [Tue Aug 23 18:18:20 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:18:20.262573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c5320eef-a419-44fe-b36a-c1e5d40d369a tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Calling method '.version_select at 0x7f27ec329040>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:20.293574 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-c5320eef-a419-44fe-b36a-c1e5d40d369a tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] HTTP exception thrown: Volume tempest-invalid-1596910434 could not be found. Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c5320eef-a419-44fe-b36a-c1e5d40d369a tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Request method failure captured: Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1596910434 HTTP/1.1 Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRnsqFdALlvGh_yGMFwonp7UbyaYCQPPmxuL4bO0aWYgldAkf_JOLjZaQNigvLipSRT_wnUJQHeqRKri_ijI7lAKdOk3FW6Q4yiNLhlQpwHZhthkYpNSDa2pRNLuhu7NlOh5J-GuDov0Ga2JUjTm6lvhtWvsZplvi64hRXJbslXSv8I Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 7c1addcd30eb4d04afe3da47d6ecdcf0 Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}] Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 7c1addcd30eb4d04afe3da47d6ecdcf0 Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-VolumesNegativeTest-662722538-project Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 20258de639b74e02927ec1014c90221c Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-VolumesNegativeTest-662722538-project Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: exception: Volume tempest-invalid-1596910434 could not be found. Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'tempest-invalid-1596910434'} Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1596910434 could not be found. (HTTP 404) (Request-ID: req-d9d49729-df79-4dc1-b5c7-c406e9fedc4f) Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 18:18:20.327589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1596910434 could not be found. Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1596910434 could not be found. Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1596910434 could not be found. Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c5320eef-a419-44fe-b36a-c1e5d40d369a tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Returning 404 to user: Volume tempest-invalid-1596910434 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c5320eef-a419-44fe-b36a-c1e5d40d369a tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1596910434" status: 404 len: 99 microversion: 2.1 time: 0.071374 Aug 23 18:18:20.332261 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2760/5393] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Aug 23 18:18:20 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1596910434 => generated 99 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 23 18:18:20.340778 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-755663c6-066a-494f-af93-34ca0f95bfb6 tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005143 Aug 23 18:18:20.341389 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2634/5394] 10.222.0.61 () {58 vars in 1140 bytes} [Tue Aug 23 18:18:20 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 23 18:18:20.350656 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-946df549-c9c5-4473-ad47-8dc0a3c6cf3d tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004145 Aug 23 18:18:20.351146 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2761/5395] 10.222.0.61 () {58 vars in 1137 bytes} [Tue Aug 23 18:18:20 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 23 18:18:20.360295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9e93b876-44fe-488a-8b70-55ddc7a75b7e tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Calling method '.version_select at 0x7f27f1c64f70>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:20.390890 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-9e93b876-44fe-488a-8b70-55ddc7a75b7e tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] HTTP exception thrown: Volume 404d0370-cdbf-4f2c-a0ad-8add1c0d0643 could not be found. Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9e93b876-44fe-488a-8b70-55ddc7a75b7e tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Request method failure captured: Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/os-volumes/404d0370-cdbf-4f2c-a0ad-8add1c0d0643 HTTP/1.1 Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRnsqFdALlvGh_yGMFwonp7UbyaYCQPPmxuL4bO0aWYgldAkf_JOLjZaQNigvLipSRT_wnUJQHeqRKri_ijI7lAKdOk3FW6Q4yiNLhlQpwHZhthkYpNSDa2pRNLuhu7NlOh5J-GuDov0Ga2JUjTm6lvhtWvsZplvi64hRXJbslXSv8I Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 7c1addcd30eb4d04afe3da47d6ecdcf0 Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}] Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 7c1addcd30eb4d04afe3da47d6ecdcf0 Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-VolumesNegativeTest-662722538-project Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 20258de639b74e02927ec1014c90221c Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-VolumesNegativeTest-662722538-project Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: exception: Volume 404d0370-cdbf-4f2c-a0ad-8add1c0d0643 could not be found. Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '404d0370-cdbf-4f2c-a0ad-8add1c0d0643'} Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 404d0370-cdbf-4f2c-a0ad-8add1c0d0643 could not be found. (HTTP 404) (Request-ID: req-06ce73ff-7dd7-432f-882a-568a6b948b9b) Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 18:18:20.392911 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 404d0370-cdbf-4f2c-a0ad-8add1c0d0643 could not be found. Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 404d0370-cdbf-4f2c-a0ad-8add1c0d0643 could not be found. Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 404d0370-cdbf-4f2c-a0ad-8add1c0d0643 could not be found. Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9e93b876-44fe-488a-8b70-55ddc7a75b7e tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Returning 404 to user: Volume 404d0370-cdbf-4f2c-a0ad-8add1c0d0643 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9e93b876-44fe-488a-8b70-55ddc7a75b7e tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/404d0370-cdbf-4f2c-a0ad-8add1c0d0643" status: 404 len: 109 microversion: 2.1 time: 0.038289 Aug 23 18:18:20.397777 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2635/5396] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:18:20 2022] DELETE /compute/v2.1/os-volumes/404d0370-cdbf-4f2c-a0ad-8add1c0d0643 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:20.404282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ac5e8c0-6bac-49c9-91dc-9effc47b66fe tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Calling method '.version_select at 0x7f27df5dc280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:20.433067 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-2ac5e8c0-6bac-49c9-91dc-9effc47b66fe tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] HTTP exception thrown: Volume 50f0eefa-916e-4e32-a133-1fdf86c73835 could not be found. Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ac5e8c0-6bac-49c9-91dc-9effc47b66fe tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Request method failure captured: Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/os-volumes/50f0eefa-916e-4e32-a133-1fdf86c73835 HTTP/1.1 Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRnsqFdALlvGh_yGMFwonp7UbyaYCQPPmxuL4bO0aWYgldAkf_JOLjZaQNigvLipSRT_wnUJQHeqRKri_ijI7lAKdOk3FW6Q4yiNLhlQpwHZhthkYpNSDa2pRNLuhu7NlOh5J-GuDov0Ga2JUjTm6lvhtWvsZplvi64hRXJbslXSv8I Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 7c1addcd30eb4d04afe3da47d6ecdcf0 Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7c1addcd30eb4d04afe3da47d6ecdcf0"}]}] Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 7c1addcd30eb4d04afe3da47d6ecdcf0 Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-VolumesNegativeTest-662722538 Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-VolumesNegativeTest-662722538-project Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 20258de639b74e02927ec1014c90221c Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-VolumesNegativeTest-662722538-project Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: exception: Volume 50f0eefa-916e-4e32-a133-1fdf86c73835 could not be found. Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '50f0eefa-916e-4e32-a133-1fdf86c73835'} Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 50f0eefa-916e-4e32-a133-1fdf86c73835 could not be found. (HTTP 404) (Request-ID: req-064c4ad2-8a97-404b-b6ae-f1789b803dc6) Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 18:18:20.435217 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 50f0eefa-916e-4e32-a133-1fdf86c73835 could not be found. Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 50f0eefa-916e-4e32-a133-1fdf86c73835 could not be found. Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 50f0eefa-916e-4e32-a133-1fdf86c73835 could not be found. Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ac5e8c0-6bac-49c9-91dc-9effc47b66fe tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] Returning 404 to user: Volume 50f0eefa-916e-4e32-a133-1fdf86c73835 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2ac5e8c0-6bac-49c9-91dc-9effc47b66fe tempest-VolumesNegativeTest-662722538 tempest-VolumesNegativeTest-662722538-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/50f0eefa-916e-4e32-a133-1fdf86c73835" status: 404 len: 109 microversion: 2.1 time: 0.036294 Aug 23 18:18:20.440197 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2762/5397] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:18:20 2022] GET /compute/v2.1/os-volumes/50f0eefa-916e-4e32-a133-1fdf86c73835 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:18:20.629525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d455500-70cf-43ce-8364-a02edfc4b107 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:20.630147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d455500-70cf-43ce-8364-a02edfc4b107 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:20.637863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d455500-70cf-43ce-8364-a02edfc4b107 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:20.638236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d455500-70cf-43ce-8364-a02edfc4b107 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:20.638903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d455500-70cf-43ce-8364-a02edfc4b107 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:20.639620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d455500-70cf-43ce-8364-a02edfc4b107 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:20.640079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d455500-70cf-43ce-8364-a02edfc4b107 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:20.640507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d455500-70cf-43ce-8364-a02edfc4b107 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:20.711919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4d455500-70cf-43ce-8364-a02edfc4b107 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:20.722080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4d455500-70cf-43ce-8364-a02edfc4b107 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:20.724484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4d455500-70cf-43ce-8364-a02edfc4b107 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:20.727216 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d455500-70cf-43ce-8364-a02edfc4b107 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.103132 Aug 23 18:18:20.738951 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2636/5398] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:20 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:21.755433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f22223a5-bde7-4f22-b376-d1fc47e88ff1 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:21.756854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f22223a5-bde7-4f22-b376-d1fc47e88ff1 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:21.770774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f22223a5-bde7-4f22-b376-d1fc47e88ff1 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:21.770774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f22223a5-bde7-4f22-b376-d1fc47e88ff1 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:21.770774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f22223a5-bde7-4f22-b376-d1fc47e88ff1 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:21.770774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f22223a5-bde7-4f22-b376-d1fc47e88ff1 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:21.770774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f22223a5-bde7-4f22-b376-d1fc47e88ff1 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:21.770774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f22223a5-bde7-4f22-b376-d1fc47e88ff1 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:21.846252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f22223a5-bde7-4f22-b376-d1fc47e88ff1 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:21.858651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f22223a5-bde7-4f22-b376-d1fc47e88ff1 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:21.860498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f22223a5-bde7-4f22-b376-d1fc47e88ff1 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:21.861668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f22223a5-bde7-4f22-b376-d1fc47e88ff1 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.113914 Aug 23 18:18:21.862223 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2763/5399] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:21 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:18:22.885447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4f0e9e0a-3d8f-44a8-82b5-2eaa42db9c8f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:22.886065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4f0e9e0a-3d8f-44a8-82b5-2eaa42db9c8f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:22.893252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f0e9e0a-3d8f-44a8-82b5-2eaa42db9c8f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:22.894057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f0e9e0a-3d8f-44a8-82b5-2eaa42db9c8f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:22.894514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f0e9e0a-3d8f-44a8-82b5-2eaa42db9c8f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:22.895273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f0e9e0a-3d8f-44a8-82b5-2eaa42db9c8f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:22.895693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f0e9e0a-3d8f-44a8-82b5-2eaa42db9c8f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:22.896352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f0e9e0a-3d8f-44a8-82b5-2eaa42db9c8f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:22.970481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4f0e9e0a-3d8f-44a8-82b5-2eaa42db9c8f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:22.980855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4f0e9e0a-3d8f-44a8-82b5-2eaa42db9c8f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:22.982392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4f0e9e0a-3d8f-44a8-82b5-2eaa42db9c8f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:22.983735 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4f0e9e0a-3d8f-44a8-82b5-2eaa42db9c8f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.102299 Aug 23 18:18:22.984547 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2637/5400] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:22 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:24.009002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1d3a133b-6a8c-4bca-ba4a-30a60125db8d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:24.010295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1d3a133b-6a8c-4bca-ba4a-30a60125db8d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:24.017307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d3a133b-6a8c-4bca-ba4a-30a60125db8d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:24.018014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d3a133b-6a8c-4bca-ba4a-30a60125db8d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:24.019242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d3a133b-6a8c-4bca-ba4a-30a60125db8d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:24.021340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d3a133b-6a8c-4bca-ba4a-30a60125db8d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:24.021801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d3a133b-6a8c-4bca-ba4a-30a60125db8d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:24.022398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d3a133b-6a8c-4bca-ba4a-30a60125db8d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:24.091845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d3a133b-6a8c-4bca-ba4a-30a60125db8d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:24.100902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d3a133b-6a8c-4bca-ba4a-30a60125db8d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:24.102588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d3a133b-6a8c-4bca-ba4a-30a60125db8d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:24.104158 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1d3a133b-6a8c-4bca-ba4a-30a60125db8d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.099211 Aug 23 18:18:24.104819 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2764/5401] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:24 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:25.129899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-22b62b39-5f9e-4fae-b096-27079b741818 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:25.130908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-22b62b39-5f9e-4fae-b096-27079b741818 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:25.138416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22b62b39-5f9e-4fae-b096-27079b741818 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:25.139007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22b62b39-5f9e-4fae-b096-27079b741818 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:25.139580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22b62b39-5f9e-4fae-b096-27079b741818 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:25.140354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22b62b39-5f9e-4fae-b096-27079b741818 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:25.141519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22b62b39-5f9e-4fae-b096-27079b741818 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:25.142034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22b62b39-5f9e-4fae-b096-27079b741818 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:25.223100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22b62b39-5f9e-4fae-b096-27079b741818 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:25.227150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:25.233360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22b62b39-5f9e-4fae-b096-27079b741818 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:25.235139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22b62b39-5f9e-4fae-b096-27079b741818 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:25.236629 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-22b62b39-5f9e-4fae-b096-27079b741818 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.112339 Aug 23 18:18:25.238790 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2638/5402] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:25 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:26.261788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-56da53fa-1a33-424c-9648-0e8565916337 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:26.262949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-56da53fa-1a33-424c-9648-0e8565916337 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:26.270961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56da53fa-1a33-424c-9648-0e8565916337 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:26.271391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56da53fa-1a33-424c-9648-0e8565916337 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:26.271834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56da53fa-1a33-424c-9648-0e8565916337 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:26.272733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56da53fa-1a33-424c-9648-0e8565916337 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:26.273201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56da53fa-1a33-424c-9648-0e8565916337 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:26.273636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56da53fa-1a33-424c-9648-0e8565916337 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:26.363901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-56da53fa-1a33-424c-9648-0e8565916337 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:26.380362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-56da53fa-1a33-424c-9648-0e8565916337 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:26.383270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-56da53fa-1a33-424c-9648-0e8565916337 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:26.384739 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-56da53fa-1a33-424c-9648-0e8565916337 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.127158 Aug 23 18:18:26.385742 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2765/5403] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:26 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:18:27.411613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec9c1072-1afa-427f-92f0-74f5517f9bba tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:27.412234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ec9c1072-1afa-427f-92f0-74f5517f9bba tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:27.421491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec9c1072-1afa-427f-92f0-74f5517f9bba tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:27.422149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec9c1072-1afa-427f-92f0-74f5517f9bba tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:27.422813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec9c1072-1afa-427f-92f0-74f5517f9bba tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:27.423534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec9c1072-1afa-427f-92f0-74f5517f9bba tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:27.423961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec9c1072-1afa-427f-92f0-74f5517f9bba tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:27.424383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec9c1072-1afa-427f-92f0-74f5517f9bba tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:27.528498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec9c1072-1afa-427f-92f0-74f5517f9bba tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:27.538816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec9c1072-1afa-427f-92f0-74f5517f9bba tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:27.540571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec9c1072-1afa-427f-92f0-74f5517f9bba tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:27.541832 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec9c1072-1afa-427f-92f0-74f5517f9bba tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.136400 Aug 23 18:18:27.542477 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2639/5404] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:27 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:28.568992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7c0d0133-e9e2-4721-b870-c4025d80a962 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:28.569718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7c0d0133-e9e2-4721-b870-c4025d80a962 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:28.578116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c0d0133-e9e2-4721-b870-c4025d80a962 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:28.578668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c0d0133-e9e2-4721-b870-c4025d80a962 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:28.579084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c0d0133-e9e2-4721-b870-c4025d80a962 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:28.579795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c0d0133-e9e2-4721-b870-c4025d80a962 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:28.580404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c0d0133-e9e2-4721-b870-c4025d80a962 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:28.581168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c0d0133-e9e2-4721-b870-c4025d80a962 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:28.680090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7c0d0133-e9e2-4721-b870-c4025d80a962 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:28.693470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7c0d0133-e9e2-4721-b870-c4025d80a962 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:28.702504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7c0d0133-e9e2-4721-b870-c4025d80a962 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:28.703867 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7c0d0133-e9e2-4721-b870-c4025d80a962 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.140143 Aug 23 18:18:28.706597 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2766/5405] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:28 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:29.729080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8e132347-2ca8-417f-92b4-113dfc63ee4f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:29.729778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8e132347-2ca8-417f-92b4-113dfc63ee4f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:29.738388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e132347-2ca8-417f-92b4-113dfc63ee4f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:29.740346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e132347-2ca8-417f-92b4-113dfc63ee4f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:29.740783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e132347-2ca8-417f-92b4-113dfc63ee4f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:29.741781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e132347-2ca8-417f-92b4-113dfc63ee4f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:29.742482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e132347-2ca8-417f-92b4-113dfc63ee4f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:29.743205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e132347-2ca8-417f-92b4-113dfc63ee4f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:29.826905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8e132347-2ca8-417f-92b4-113dfc63ee4f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:29.837089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8e132347-2ca8-417f-92b4-113dfc63ee4f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:29.838683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8e132347-2ca8-417f-92b4-113dfc63ee4f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:29.840226 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8e132347-2ca8-417f-92b4-113dfc63ee4f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.115119 Aug 23 18:18:29.840954 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2640/5406] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:29 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:30.865260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33049aad-5f17-47c3-acec-fbda5204916c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:30.865896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33049aad-5f17-47c3-acec-fbda5204916c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:30.872847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33049aad-5f17-47c3-acec-fbda5204916c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:30.873338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33049aad-5f17-47c3-acec-fbda5204916c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:30.873782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33049aad-5f17-47c3-acec-fbda5204916c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:30.874481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33049aad-5f17-47c3-acec-fbda5204916c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:30.874969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33049aad-5f17-47c3-acec-fbda5204916c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:30.875398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33049aad-5f17-47c3-acec-fbda5204916c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:30.946109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-33049aad-5f17-47c3-acec-fbda5204916c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:30.954400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-33049aad-5f17-47c3-acec-fbda5204916c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:30.956010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-33049aad-5f17-47c3-acec-fbda5204916c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:30.957183 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-33049aad-5f17-47c3-acec-fbda5204916c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.096468 Aug 23 18:18:30.957748 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2767/5407] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:30 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:31.981424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7fac2bc2-6073-43eb-888e-ea62230a44bd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:31.982125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7fac2bc2-6073-43eb-888e-ea62230a44bd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:31.985416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:31.992747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7fac2bc2-6073-43eb-888e-ea62230a44bd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:31.993252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7fac2bc2-6073-43eb-888e-ea62230a44bd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:31.993700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7fac2bc2-6073-43eb-888e-ea62230a44bd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:31.994430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7fac2bc2-6073-43eb-888e-ea62230a44bd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:31.994941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7fac2bc2-6073-43eb-888e-ea62230a44bd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:31.995376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7fac2bc2-6073-43eb-888e-ea62230a44bd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:32.066867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7fac2bc2-6073-43eb-888e-ea62230a44bd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:32.075557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7fac2bc2-6073-43eb-888e-ea62230a44bd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:32.077064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7fac2bc2-6073-43eb-888e-ea62230a44bd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:32.078249 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7fac2bc2-6073-43eb-888e-ea62230a44bd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.100791 Aug 23 18:18:32.078840 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2641/5408] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:31 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:33.104181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-27bd7de0-4b90-4435-890e-9716f7023aaf tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:33.104765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-27bd7de0-4b90-4435-890e-9716f7023aaf tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:33.113909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27bd7de0-4b90-4435-890e-9716f7023aaf tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:33.114452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27bd7de0-4b90-4435-890e-9716f7023aaf tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:33.114906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27bd7de0-4b90-4435-890e-9716f7023aaf tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:33.115820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27bd7de0-4b90-4435-890e-9716f7023aaf tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:33.116320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27bd7de0-4b90-4435-890e-9716f7023aaf tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:33.116755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27bd7de0-4b90-4435-890e-9716f7023aaf tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:33.193363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-27bd7de0-4b90-4435-890e-9716f7023aaf tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:33.208938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-27bd7de0-4b90-4435-890e-9716f7023aaf tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:33.210403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-27bd7de0-4b90-4435-890e-9716f7023aaf tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:33.211577 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-27bd7de0-4b90-4435-890e-9716f7023aaf tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.111772 Aug 23 18:18:33.212164 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2768/5409] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:33 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:34.236872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-48b47827-8647-4f30-b46d-3aece827f90e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:34.238267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-48b47827-8647-4f30-b46d-3aece827f90e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:34.245498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48b47827-8647-4f30-b46d-3aece827f90e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:34.246015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48b47827-8647-4f30-b46d-3aece827f90e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:34.246420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48b47827-8647-4f30-b46d-3aece827f90e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:34.247223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48b47827-8647-4f30-b46d-3aece827f90e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:34.247675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48b47827-8647-4f30-b46d-3aece827f90e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:34.248099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48b47827-8647-4f30-b46d-3aece827f90e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:34.318078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-48b47827-8647-4f30-b46d-3aece827f90e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:34.327667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-48b47827-8647-4f30-b46d-3aece827f90e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:34.329178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-48b47827-8647-4f30-b46d-3aece827f90e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:34.330434 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-48b47827-8647-4f30-b46d-3aece827f90e tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.097575 Aug 23 18:18:34.331109 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2642/5410] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:34 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:35.356156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-da6abde0-f56e-4e87-94f5-4a3b4200adfe tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:35.356773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-da6abde0-f56e-4e87-94f5-4a3b4200adfe tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:35.364871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da6abde0-f56e-4e87-94f5-4a3b4200adfe tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:35.365432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da6abde0-f56e-4e87-94f5-4a3b4200adfe tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:35.365878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da6abde0-f56e-4e87-94f5-4a3b4200adfe tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:35.366789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da6abde0-f56e-4e87-94f5-4a3b4200adfe tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:35.367255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da6abde0-f56e-4e87-94f5-4a3b4200adfe tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:35.367683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da6abde0-f56e-4e87-94f5-4a3b4200adfe tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:35.447044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-da6abde0-f56e-4e87-94f5-4a3b4200adfe tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:35.457558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-da6abde0-f56e-4e87-94f5-4a3b4200adfe tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:35.459076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-da6abde0-f56e-4e87-94f5-4a3b4200adfe tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:35.460665 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-da6abde0-f56e-4e87-94f5-4a3b4200adfe tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.109075 Aug 23 18:18:35.461239 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2769/5411] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:35 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:36.489822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ea3e8ed0-4a7b-49c9-bd8d-8ce6d7909df6 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:36.490623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ea3e8ed0-4a7b-49c9-bd8d-8ce6d7909df6 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:36.498757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3e8ed0-4a7b-49c9-bd8d-8ce6d7909df6 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:36.499352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3e8ed0-4a7b-49c9-bd8d-8ce6d7909df6 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:36.499902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3e8ed0-4a7b-49c9-bd8d-8ce6d7909df6 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:36.500689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3e8ed0-4a7b-49c9-bd8d-8ce6d7909df6 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:36.501253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3e8ed0-4a7b-49c9-bd8d-8ce6d7909df6 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:36.501751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3e8ed0-4a7b-49c9-bd8d-8ce6d7909df6 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:36.568943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ea3e8ed0-4a7b-49c9-bd8d-8ce6d7909df6 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:36.577446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ea3e8ed0-4a7b-49c9-bd8d-8ce6d7909df6 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:36.578919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ea3e8ed0-4a7b-49c9-bd8d-8ce6d7909df6 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:36.580121 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ea3e8ed0-4a7b-49c9-bd8d-8ce6d7909df6 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.095660 Aug 23 18:18:36.580683 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2643/5412] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:36 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:37.604923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5214b0e4-77ca-4d9f-92d6-565daadd06be tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:37.605548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5214b0e4-77ca-4d9f-92d6-565daadd06be tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:37.613390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5214b0e4-77ca-4d9f-92d6-565daadd06be tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:37.614087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5214b0e4-77ca-4d9f-92d6-565daadd06be tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:37.614794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5214b0e4-77ca-4d9f-92d6-565daadd06be tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:37.615592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5214b0e4-77ca-4d9f-92d6-565daadd06be tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:37.616303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5214b0e4-77ca-4d9f-92d6-565daadd06be tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:37.616985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5214b0e4-77ca-4d9f-92d6-565daadd06be tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:37.708775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5214b0e4-77ca-4d9f-92d6-565daadd06be tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:37.718144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5214b0e4-77ca-4d9f-92d6-565daadd06be tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:37.719763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5214b0e4-77ca-4d9f-92d6-565daadd06be tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:37.721086 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5214b0e4-77ca-4d9f-92d6-565daadd06be tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.120811 Aug 23 18:18:37.721788 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2770/5413] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:37 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:38.749603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cd1fb814-f341-4fbf-a792-dd38003c68ab tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:38.750172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cd1fb814-f341-4fbf-a792-dd38003c68ab tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:38.757849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd1fb814-f341-4fbf-a792-dd38003c68ab tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:38.758354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd1fb814-f341-4fbf-a792-dd38003c68ab tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:38.759545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd1fb814-f341-4fbf-a792-dd38003c68ab tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:38.759679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd1fb814-f341-4fbf-a792-dd38003c68ab tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:38.761768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd1fb814-f341-4fbf-a792-dd38003c68ab tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:38.761768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd1fb814-f341-4fbf-a792-dd38003c68ab tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:38.828406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cd1fb814-f341-4fbf-a792-dd38003c68ab tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:38.837327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cd1fb814-f341-4fbf-a792-dd38003c68ab tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:38.838849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cd1fb814-f341-4fbf-a792-dd38003c68ab tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:38.840025 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cd1fb814-f341-4fbf-a792-dd38003c68ab tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.094620 Aug 23 18:18:38.840848 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2644/5414] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:38 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:39.867101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-478288c8-7732-4319-ba66-62254b690750 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:39.868114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-478288c8-7732-4319-ba66-62254b690750 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:39.875496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-478288c8-7732-4319-ba66-62254b690750 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:39.875998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-478288c8-7732-4319-ba66-62254b690750 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:39.876436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-478288c8-7732-4319-ba66-62254b690750 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:39.877142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-478288c8-7732-4319-ba66-62254b690750 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:39.877598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-478288c8-7732-4319-ba66-62254b690750 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:39.878871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-478288c8-7732-4319-ba66-62254b690750 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:39.945396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-478288c8-7732-4319-ba66-62254b690750 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:39.953802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-478288c8-7732-4319-ba66-62254b690750 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:39.955368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-478288c8-7732-4319-ba66-62254b690750 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:39.956593 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-478288c8-7732-4319-ba66-62254b690750 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.095286 Aug 23 18:18:39.957164 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2771/5415] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:39 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:18:40.979805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-855d4437-625e-44dc-9ea7-e7b234224455 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:40.980365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-855d4437-625e-44dc-9ea7-e7b234224455 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:40.988085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-855d4437-625e-44dc-9ea7-e7b234224455 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:40.988757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-855d4437-625e-44dc-9ea7-e7b234224455 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:40.989201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-855d4437-625e-44dc-9ea7-e7b234224455 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:40.989909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-855d4437-625e-44dc-9ea7-e7b234224455 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:40.990373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-855d4437-625e-44dc-9ea7-e7b234224455 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:40.990832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-855d4437-625e-44dc-9ea7-e7b234224455 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:41.068899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-855d4437-625e-44dc-9ea7-e7b234224455 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:41.079823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-855d4437-625e-44dc-9ea7-e7b234224455 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:41.081490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-855d4437-625e-44dc-9ea7-e7b234224455 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:41.082866 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-855d4437-625e-44dc-9ea7-e7b234224455 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1365 microversion: 2.47 time: 0.107006 Aug 23 18:18:41.089060 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2645/5416] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:40 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:42.110757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8be3b127-2867-4e21-806e-d8c9187de904 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:42.111392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8be3b127-2867-4e21-806e-d8c9187de904 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:42.115111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=31 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:42.119390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8be3b127-2867-4e21-806e-d8c9187de904 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:42.119877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8be3b127-2867-4e21-806e-d8c9187de904 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:42.120343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8be3b127-2867-4e21-806e-d8c9187de904 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:42.121024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8be3b127-2867-4e21-806e-d8c9187de904 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:42.121551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8be3b127-2867-4e21-806e-d8c9187de904 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:42.121904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8be3b127-2867-4e21-806e-d8c9187de904 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:42.129142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:42.228461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8be3b127-2867-4e21-806e-d8c9187de904 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:42.237375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8be3b127-2867-4e21-806e-d8c9187de904 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:42.238930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8be3b127-2867-4e21-806e-d8c9187de904 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:42.240117 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8be3b127-2867-4e21-806e-d8c9187de904 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1371 microversion: 2.47 time: 0.135391 Aug 23 18:18:42.240827 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2772/5417] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:42 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1371 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:43.265073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-61aec2f3-b887-4e19-aa0f-a0a888d1ac29 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:43.265618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-61aec2f3-b887-4e19-aa0f-a0a888d1ac29 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:43.272213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61aec2f3-b887-4e19-aa0f-a0a888d1ac29 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:43.272696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61aec2f3-b887-4e19-aa0f-a0a888d1ac29 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:43.273128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61aec2f3-b887-4e19-aa0f-a0a888d1ac29 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:43.273833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61aec2f3-b887-4e19-aa0f-a0a888d1ac29 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:43.274280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61aec2f3-b887-4e19-aa0f-a0a888d1ac29 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:43.274764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61aec2f3-b887-4e19-aa0f-a0a888d1ac29 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:43.338934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-61aec2f3-b887-4e19-aa0f-a0a888d1ac29 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:43.347960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-61aec2f3-b887-4e19-aa0f-a0a888d1ac29 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:43.349643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-61aec2f3-b887-4e19-aa0f-a0a888d1ac29 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:43.350832 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-61aec2f3-b887-4e19-aa0f-a0a888d1ac29 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1371 microversion: 2.47 time: 0.090909 Aug 23 18:18:43.351385 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2646/5418] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:43 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:44.375754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-50ec655b-0f68-439c-a1d1-d1c7a7a88a3a tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:44.376549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-50ec655b-0f68-439c-a1d1-d1c7a7a88a3a tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:44.384727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ec655b-0f68-439c-a1d1-d1c7a7a88a3a tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:44.385485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ec655b-0f68-439c-a1d1-d1c7a7a88a3a tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:44.386104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ec655b-0f68-439c-a1d1-d1c7a7a88a3a tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:44.387281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ec655b-0f68-439c-a1d1-d1c7a7a88a3a tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:44.387744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ec655b-0f68-439c-a1d1-d1c7a7a88a3a tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:44.388237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ec655b-0f68-439c-a1d1-d1c7a7a88a3a tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:44.470102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-50ec655b-0f68-439c-a1d1-d1c7a7a88a3a tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:44.488712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-50ec655b-0f68-439c-a1d1-d1c7a7a88a3a tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:44.490447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-50ec655b-0f68-439c-a1d1-d1c7a7a88a3a tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:44.491695 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-50ec655b-0f68-439c-a1d1-d1c7a7a88a3a tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1371 microversion: 2.47 time: 0.120558 Aug 23 18:18:44.492378 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2773/5419] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:44 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1371 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:45.516842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d712e887-92bd-4773-8e8a-75d3bf929f8c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:45.518190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d712e887-92bd-4773-8e8a-75d3bf929f8c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:45.527047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d712e887-92bd-4773-8e8a-75d3bf929f8c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:45.527739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d712e887-92bd-4773-8e8a-75d3bf929f8c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:45.528397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d712e887-92bd-4773-8e8a-75d3bf929f8c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:45.529315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d712e887-92bd-4773-8e8a-75d3bf929f8c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:45.529965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d712e887-92bd-4773-8e8a-75d3bf929f8c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:45.530603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d712e887-92bd-4773-8e8a-75d3bf929f8c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:45.644133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d712e887-92bd-4773-8e8a-75d3bf929f8c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:45.659200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d712e887-92bd-4773-8e8a-75d3bf929f8c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:45.664675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d712e887-92bd-4773-8e8a-75d3bf929f8c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:45.668014 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d712e887-92bd-4773-8e8a-75d3bf929f8c tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1371 microversion: 2.47 time: 0.155100 Aug 23 18:18:45.681588 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2647/5420] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:45 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:46.254404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3da67b82-eb2b-4bb0-bf67-cd500412610e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Action: 'create', calling method: .version_select at 0x7f27df7510d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1318640162", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLGJYWv4t7QCz3OTkbNjglslR900HtoCkuFAHmHurDgQyRCviLpVjuXDZgqOl1g+RBfcEhp5DWe5oTCdL8w6n8DgXZxwE23687Vh2PvYXCkqQ8M70gfezp3fyqLheNGCw=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:18:46.273304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-3da67b82-eb2b-4bb0-bf67-cd500412610e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Getting quotas for project bc5872887aaa488fafcb94629d083630. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:18:46.283364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-3da67b82-eb2b-4bb0-bf67-cd500412610e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Getting quotas for user ef5f5a1ba1e7414a82fff09abe84a931 and project bc5872887aaa488fafcb94629d083630. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:18:46.328584 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3da67b82-eb2b-4bb0-bf67-cd500412610e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.078357 Aug 23 18:18:46.329362 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2774/5421] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:18:46 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:18:46.701357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-17377dd6-3ce6-4734-8f2a-db4711042350 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:46.702048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-17377dd6-3ce6-4734-8f2a-db4711042350 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:46.714354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17377dd6-3ce6-4734-8f2a-db4711042350 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:46.721127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17377dd6-3ce6-4734-8f2a-db4711042350 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:46.722273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17377dd6-3ce6-4734-8f2a-db4711042350 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:46.723081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17377dd6-3ce6-4734-8f2a-db4711042350 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:46.724180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17377dd6-3ce6-4734-8f2a-db4711042350 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:46.725189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17377dd6-3ce6-4734-8f2a-db4711042350 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:46.897235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-17377dd6-3ce6-4734-8f2a-db4711042350 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:46.910951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-17377dd6-3ce6-4734-8f2a-db4711042350 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:46.913903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-17377dd6-3ce6-4734-8f2a-db4711042350 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:46.915181 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-17377dd6-3ce6-4734-8f2a-db4711042350 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1356 microversion: 2.47 time: 0.219116 Aug 23 18:18:46.947647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:46.956009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:46.958688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Searching by: {'deleted': False, 'project_id': '1cc03ad0d71240d68976106ee44fa655'} {{(pid=128808) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 18:18:46.961044 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2648/5422] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:46 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1356 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:46.971945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:46.972753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:46.975451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:46.976535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:46.978078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:46.991614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:47.161726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.multi_cell_list [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=128808) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 18:18:47.298399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:47.313204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:47.313757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:47.314241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:47.338315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:47.340023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:47.423740 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-37378f45-8f35-48c1-b2f2-1e37d7d99d55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/detail" status: 200 len: 2704 microversion: 2.47 time: 0.482522 Aug 23 18:18:47.425986 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2775/5423] 10.222.0.61 () {60 vars in 1187 bytes} [Tue Aug 23 18:18:46 2022] GET /compute/v2.1/servers/detail => generated 2704 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:18:47.460415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ac63ec4-b2f9-4be5-a4e6-b506d75924fd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:47.460944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2ac63ec4-b2f9-4be5-a4e6-b506d75924fd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:47.470513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ac63ec4-b2f9-4be5-a4e6-b506d75924fd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:47.471162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ac63ec4-b2f9-4be5-a4e6-b506d75924fd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:47.471619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ac63ec4-b2f9-4be5-a4e6-b506d75924fd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:47.476625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ac63ec4-b2f9-4be5-a4e6-b506d75924fd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:47.477131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ac63ec4-b2f9-4be5-a4e6-b506d75924fd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:47.477590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ac63ec4-b2f9-4be5-a4e6-b506d75924fd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:47.521625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2ac63ec4-b2f9-4be5-a4e6-b506d75924fd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:18:47.689276 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2ac63ec4-b2f9-4be5-a4e6-b506d75924fd tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "DELETE /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 204 len: 0 microversion: 2.47 time: 0.233533 Aug 23 18:18:47.690474 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2649/5424] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:18:47 2022] DELETE /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:18:47.701154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9cbc22f0-67e6-4246-941b-2406682723ea tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:47.702430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9cbc22f0-67e6-4246-941b-2406682723ea tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:47.720641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cbc22f0-67e6-4246-941b-2406682723ea tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:47.721141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cbc22f0-67e6-4246-941b-2406682723ea tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:47.746694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cbc22f0-67e6-4246-941b-2406682723ea tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:47.748630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cbc22f0-67e6-4246-941b-2406682723ea tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:47.748810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cbc22f0-67e6-4246-941b-2406682723ea tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:47.749188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cbc22f0-67e6-4246-941b-2406682723ea tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:47.880608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9cbc22f0-67e6-4246-941b-2406682723ea tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:47.890664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9cbc22f0-67e6-4246-941b-2406682723ea tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:47.892617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9cbc22f0-67e6-4246-941b-2406682723ea tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:47.894728 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9cbc22f0-67e6-4246-941b-2406682723ea tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1362 microversion: 2.47 time: 0.198311 Aug 23 18:18:47.895483 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2776/5425] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:47 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1362 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:48.117113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1183167264", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "d8af63c7-627e-47f1-a4d9-9aabc883f567"}], "key_name": "tempest-TestNetworkBasicOps-1318640162", "security_groups": [{"name": "tempest-secgroup-smoke-1298015431"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:18:48.248330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] validate_networks() for [('d8af63c7-627e-47f1-a4d9-9aabc883f567', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:18:48.922828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fc2105e0-6f7e-4616-b566-c8d9d3e5904d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:48.923464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fc2105e0-6f7e-4616-b566-c8d9d3e5904d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:48.937359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc2105e0-6f7e-4616-b566-c8d9d3e5904d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:48.938218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc2105e0-6f7e-4616-b566-c8d9d3e5904d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:48.938935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc2105e0-6f7e-4616-b566-c8d9d3e5904d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:48.940443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc2105e0-6f7e-4616-b566-c8d9d3e5904d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:48.942303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc2105e0-6f7e-4616-b566-c8d9d3e5904d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:48.943630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc2105e0-6f7e-4616-b566-c8d9d3e5904d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:49.054995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:18:49.055436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:18:49.055924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:18:49.056347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:18:49.056770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:18:49.070902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:49.071338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:49.072536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:49.073728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:49.075090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:49.075967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:49.108734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Getting quotas for project bc5872887aaa488fafcb94629d083630. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:18:49.120655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Getting quotas for user ef5f5a1ba1e7414a82fff09abe84a931 and project bc5872887aaa488fafcb94629d083630. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:18:49.136940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fc2105e0-6f7e-4616-b566-c8d9d3e5904d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:49.139515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:18:49.142525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:18:49.150391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fc2105e0-6f7e-4616-b566-c8d9d3e5904d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:49.170899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fc2105e0-6f7e-4616-b566-c8d9d3e5904d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:49.172423 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fc2105e0-6f7e-4616-b566-c8d9d3e5904d tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 200 len: 1362 microversion: 2.47 time: 0.254597 Aug 23 18:18:49.173796 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2777/5426] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:48 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:18:49.252905 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3509158d-2952-40ce-afa6-0853438c1fe9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.141200 Aug 23 18:18:49.254162 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2650/5427] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:18:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1144 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:18:49.266089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-55a99c2c-356d-4111-af84-9fef74fa4338 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:49.266667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-55a99c2c-356d-4111-af84-9fef74fa4338 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:49.368032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-55a99c2c-356d-4111-af84-9fef74fa4338 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:49.378170 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-55a99c2c-356d-4111-af84-9fef74fa4338 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1249 microversion: 2.1 time: 0.116411 Aug 23 18:18:49.380039 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2778/5428] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:49 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1249 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:50.204937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83b806c1-35ec-4ae5-b70e-3da267be02aa tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:50.206682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-83b806c1-35ec-4ae5-b70e-3da267be02aa tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 822982d4-3147-4d32-8892-935c84ab42e4] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:50.218208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83b806c1-35ec-4ae5-b70e-3da267be02aa tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:50.218804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83b806c1-35ec-4ae5-b70e-3da267be02aa tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:50.219324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83b806c1-35ec-4ae5-b70e-3da267be02aa tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:50.220071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83b806c1-35ec-4ae5-b70e-3da267be02aa tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:50.220535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83b806c1-35ec-4ae5-b70e-3da267be02aa tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:50.220971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83b806c1-35ec-4ae5-b70e-3da267be02aa tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:50.236536 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-83b806c1-35ec-4ae5-b70e-3da267be02aa tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] HTTP exception thrown: Instance 822982d4-3147-4d32-8892-935c84ab42e4 could not be found. Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83b806c1-35ec-4ae5-b70e-3da267be02aa tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Request method failure captured: Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 HTTP/1.1 Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRnVZ--DDcYUUmPubYGjwV9B-_KnvvXVrx6rB884kNQnm54_0dINwIztDSRBPuCD3Wf00eRNtSuTgcC-xu0F8h1CBoJko_zbugThE8XWkgoTJYXvo52AICsAqzmHGT970A_CWWmdBxS6eQRysS9bDKUYRMoxGCQq7h7HHJHrUPycUeo Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.47 Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 1cc03ad0d71240d68976106ee44fa655 Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerShowV247Test-880730893 Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1cc03ad0d71240d68976106ee44fa655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1cc03ad0d71240d68976106ee44fa655"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1cc03ad0d71240d68976106ee44fa655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1cc03ad0d71240d68976106ee44fa655"}]}] Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerShowV247Test-880730893 Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 1cc03ad0d71240d68976106ee44fa655 Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerShowV247Test-880730893 Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerShowV247Test-880730893-project Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 570583085e954774ac58273fdfd2b7fd Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerShowV247Test-880730893-project Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 822982d4-3147-4d32-8892-935c84ab42e4 could not be found. Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '822982d4-3147-4d32-8892-935c84ab42e4'} Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 822982d4-3147-4d32-8892-935c84ab42e4 could not be found. Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 822982d4-3147-4d32-8892-935c84ab42e4 could not be found. Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:50.239338 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:50.243070 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:50.243070 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:50.243070 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:50.243070 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:50.243070 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:50.243070 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 822982d4-3147-4d32-8892-935c84ab42e4 could not be found. Aug 23 18:18:50.243070 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:18:50.243070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83b806c1-35ec-4ae5-b70e-3da267be02aa tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Returning 404 to user: Instance 822982d4-3147-4d32-8892-935c84ab42e4 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:50.243070 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-83b806c1-35ec-4ae5-b70e-3da267be02aa tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4" status: 404 len: 111 microversion: 2.47 time: 0.042935 Aug 23 18:18:50.243070 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2651/5429] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:50 2022] GET /compute/v2.1/servers/822982d4-3147-4d32-8892-935c84ab42e4 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 23 18:18:50.249409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a71d59a4-ec84-4f3c-9774-7244a3d0e4d4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:50.249898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a71d59a4-ec84-4f3c-9774-7244a3d0e4d4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 7787b839-c82c-415a-9aa0-1fe82027401c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:50.258236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a71d59a4-ec84-4f3c-9774-7244a3d0e4d4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:50.258771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a71d59a4-ec84-4f3c-9774-7244a3d0e4d4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:50.259210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a71d59a4-ec84-4f3c-9774-7244a3d0e4d4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:50.260077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a71d59a4-ec84-4f3c-9774-7244a3d0e4d4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:50.260541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a71d59a4-ec84-4f3c-9774-7244a3d0e4d4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:50.260975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a71d59a4-ec84-4f3c-9774-7244a3d0e4d4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:50.287638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a71d59a4-ec84-4f3c-9774-7244a3d0e4d4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 7787b839-c82c-415a-9aa0-1fe82027401c] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:18:50.369221 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a71d59a4-ec84-4f3c-9774-7244a3d0e4d4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c" status: 204 len: 0 microversion: 2.47 time: 0.123422 Aug 23 18:18:50.370189 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2779/5430] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:18:50 2022] DELETE /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:18:50.378900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-214745c4-842f-43e4-8d48-c6cf3d3866c4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:50.379540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-214745c4-842f-43e4-8d48-c6cf3d3866c4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 7787b839-c82c-415a-9aa0-1fe82027401c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:50.385582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-214745c4-842f-43e4-8d48-c6cf3d3866c4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:50.386055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-214745c4-842f-43e4-8d48-c6cf3d3866c4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:50.386483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-214745c4-842f-43e4-8d48-c6cf3d3866c4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:50.387205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-214745c4-842f-43e4-8d48-c6cf3d3866c4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:50.387664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-214745c4-842f-43e4-8d48-c6cf3d3866c4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:50.388092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-214745c4-842f-43e4-8d48-c6cf3d3866c4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:50.404850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ea1b9c70-cf7c-4b25-ae4c-f4035839d7da tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:50.405504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ea1b9c70-cf7c-4b25-ae4c-f4035839d7da tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:50.413178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea1b9c70-cf7c-4b25-ae4c-f4035839d7da tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:50.413678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea1b9c70-cf7c-4b25-ae4c-f4035839d7da tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:50.414123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea1b9c70-cf7c-4b25-ae4c-f4035839d7da tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:50.414875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea1b9c70-cf7c-4b25-ae4c-f4035839d7da tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:50.415496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea1b9c70-cf7c-4b25-ae4c-f4035839d7da tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:50.415937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea1b9c70-cf7c-4b25-ae4c-f4035839d7da tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:50.457728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-214745c4-842f-43e4-8d48-c6cf3d3866c4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:50.466488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-214745c4-842f-43e4-8d48-c6cf3d3866c4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:50.468088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-214745c4-842f-43e4-8d48-c6cf3d3866c4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:50.469493 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-214745c4-842f-43e4-8d48-c6cf3d3866c4 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c" status: 200 len: 1361 microversion: 2.47 time: 0.094821 Aug 23 18:18:50.470116 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2652/5431] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:50 2022] GET /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c => generated 1361 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:50.501180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ea1b9c70-cf7c-4b25-ae4c-f4035839d7da tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:50.509429 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ea1b9c70-cf7c-4b25-ae4c-f4035839d7da tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1301 microversion: 2.1 time: 0.109106 Aug 23 18:18:50.510017 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2780/5432] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:50 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1301 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:51.494855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dc0e4b9d-e30b-4865-871f-42fc4197d26f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:51.496275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dc0e4b9d-e30b-4865-871f-42fc4197d26f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 7787b839-c82c-415a-9aa0-1fe82027401c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:51.513463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc0e4b9d-e30b-4865-871f-42fc4197d26f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:51.513969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc0e4b9d-e30b-4865-871f-42fc4197d26f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:51.514406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc0e4b9d-e30b-4865-871f-42fc4197d26f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:51.515180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc0e4b9d-e30b-4865-871f-42fc4197d26f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:51.515656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc0e4b9d-e30b-4865-871f-42fc4197d26f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:51.516112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc0e4b9d-e30b-4865-871f-42fc4197d26f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:51.532449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6941efd-18e1-4387-bf29-9f78c17b4a1f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:51.533719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6941efd-18e1-4387-bf29-9f78c17b4a1f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:51.543094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6941efd-18e1-4387-bf29-9f78c17b4a1f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:51.543894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6941efd-18e1-4387-bf29-9f78c17b4a1f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:51.544536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6941efd-18e1-4387-bf29-9f78c17b4a1f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:51.545476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6941efd-18e1-4387-bf29-9f78c17b4a1f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:51.546150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6941efd-18e1-4387-bf29-9f78c17b4a1f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:51.546939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6941efd-18e1-4387-bf29-9f78c17b4a1f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:51.595925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dc0e4b9d-e30b-4865-871f-42fc4197d26f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:51.608589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dc0e4b9d-e30b-4865-871f-42fc4197d26f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:51.610393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dc0e4b9d-e30b-4865-871f-42fc4197d26f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:51.612001 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dc0e4b9d-e30b-4865-871f-42fc4197d26f tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c" status: 200 len: 1361 microversion: 2.47 time: 0.122140 Aug 23 18:18:51.614112 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2653/5433] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:51 2022] GET /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c => generated 1361 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:51.625608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6941efd-18e1-4387-bf29-9f78c17b4a1f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:51.639016 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6941efd-18e1-4387-bf29-9f78c17b4a1f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1307 microversion: 2.1 time: 0.110457 Aug 23 18:18:51.639616 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2781/5434] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:51 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1307 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:52.499378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-16fd0d21-6d77-4a71-acd3-822553743456 req-a00921cc-0be3-4e08-bc03-45f870f0c209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56177b26-1f5a-4e30-9612-e12570c6db1f", "tag": "569eebda-cfd9-47e0-8869-8add9cbd39b8"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:18:52.527933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-16fd0d21-6d77-4a71-acd3-822553743456 req-a00921cc-0be3-4e08-bc03-45f870f0c209 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:52.541600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-16fd0d21-6d77-4a71-acd3-822553743456 req-a00921cc-0be3-4e08-bc03-45f870f0c209 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:52.542994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-16fd0d21-6d77-4a71-acd3-822553743456 req-a00921cc-0be3-4e08-bc03-45f870f0c209 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:52.574638 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-16fd0d21-6d77-4a71-acd3-822553743456 req-a00921cc-0be3-4e08-bc03-45f870f0c209 service nova] Creating event network-changed:569eebda-cfd9-47e0-8869-8add9cbd39b8 for instance 56177b26-1f5a-4e30-9612-e12570c6db1f on n-h1-850468-16 Aug 23 18:18:52.584702 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-16fd0d21-6d77-4a71-acd3-822553743456 req-a00921cc-0be3-4e08-bc03-45f870f0c209 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096550 Aug 23 18:18:52.585647 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2654/5435] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:18:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:18:52.637552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:52.638532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 7787b839-c82c-415a-9aa0-1fe82027401c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:52.647568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:52.648070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:52.648581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:52.649303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:52.649757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:52.651741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:52.662834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-48eb9758-c198-4004-b6db-a01d222db8b9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:52.663555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-48eb9758-c198-4004-b6db-a01d222db8b9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:52.672063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48eb9758-c198-4004-b6db-a01d222db8b9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:52.673120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48eb9758-c198-4004-b6db-a01d222db8b9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:52.673581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48eb9758-c198-4004-b6db-a01d222db8b9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:52.674300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48eb9758-c198-4004-b6db-a01d222db8b9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:52.674797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48eb9758-c198-4004-b6db-a01d222db8b9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:52.678979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-48eb9758-c198-4004-b6db-a01d222db8b9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:52.704837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:52.705629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:52.706218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:52.708564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lazy-loading 'fault' on Instance uuid 7787b839-c82c-415a-9aa0-1fe82027401c {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:18:52.768979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:52.779641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:52.781400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '570583085e954774ac58273fdfd2b7fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cc03ad0d71240d68976106ee44fa655', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:52.783054 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-40def485-a139-4b2e-b6e4-ae08b9e56b55 tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c" status: 200 len: 1366 microversion: 2.47 time: 0.149212 Aug 23 18:18:52.783835 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2782/5436] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:52 2022] GET /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:18:52.938783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-48eb9758-c198-4004-b6db-a01d222db8b9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:52.943111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:52.948278 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-48eb9758-c198-4004-b6db-a01d222db8b9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1375 microversion: 2.1 time: 0.291382 Aug 23 18:18:52.948985 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2655/5437] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:52 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1375 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:53.807525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-313d2e69-9d4a-4ae3-aa63-bb80a92a72de tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:53.808064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-313d2e69-9d4a-4ae3-aa63-bb80a92a72de tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] [instance: 7787b839-c82c-415a-9aa0-1fe82027401c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:53.814866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-313d2e69-9d4a-4ae3-aa63-bb80a92a72de tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:53.815355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-313d2e69-9d4a-4ae3-aa63-bb80a92a72de tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:53.816504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-313d2e69-9d4a-4ae3-aa63-bb80a92a72de tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:53.817052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-313d2e69-9d4a-4ae3-aa63-bb80a92a72de tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:53.817509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-313d2e69-9d4a-4ae3-aa63-bb80a92a72de tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:53.817933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-313d2e69-9d4a-4ae3-aa63-bb80a92a72de tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:53.832770 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-313d2e69-9d4a-4ae3-aa63-bb80a92a72de tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] HTTP exception thrown: Instance 7787b839-c82c-415a-9aa0-1fe82027401c could not be found. Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-313d2e69-9d4a-4ae3-aa63-bb80a92a72de tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Request method failure captured: Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c HTTP/1.1 Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRnVZ--DDcYUUmPubYGjwV9B-_KnvvXVrx6rB884kNQnm54_0dINwIztDSRBPuCD3Wf00eRNtSuTgcC-xu0F8h1CBoJko_zbugThE8XWkgoTJYXvo52AICsAqzmHGT970A_CWWmdBxS6eQRysS9bDKUYRMoxGCQq7h7HHJHrUPycUeo Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.47 Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 1cc03ad0d71240d68976106ee44fa655 Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerShowV247Test-880730893 Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1cc03ad0d71240d68976106ee44fa655"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1cc03ad0d71240d68976106ee44fa655"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1cc03ad0d71240d68976106ee44fa655"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1cc03ad0d71240d68976106ee44fa655"}]}] Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerShowV247Test-880730893 Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 1cc03ad0d71240d68976106ee44fa655 Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerShowV247Test-880730893 Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerShowV247Test-880730893-project Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 570583085e954774ac58273fdfd2b7fd Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerShowV247Test-880730893-project Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 7787b839-c82c-415a-9aa0-1fe82027401c could not be found. Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '7787b839-c82c-415a-9aa0-1fe82027401c'} Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7787b839-c82c-415a-9aa0-1fe82027401c could not be found. Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7787b839-c82c-415a-9aa0-1fe82027401c could not be found. Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:18:53.834568 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:53.838074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:18:53.838074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:18:53.838074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:18:53.838074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:18:53.838074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:18:53.838074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7787b839-c82c-415a-9aa0-1fe82027401c could not be found. Aug 23 18:18:53.838074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:18:53.838074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-313d2e69-9d4a-4ae3-aa63-bb80a92a72de tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] Returning 404 to user: Instance 7787b839-c82c-415a-9aa0-1fe82027401c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:18:53.838074 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-313d2e69-9d4a-4ae3-aa63-bb80a92a72de tempest-ServerShowV247Test-880730893 tempest-ServerShowV247Test-880730893-project] 10.222.0.61 "GET /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c" status: 404 len: 111 microversion: 2.47 time: 0.032509 Aug 23 18:18:53.838074 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2783/5438] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:18:53 2022] GET /compute/v2.1/servers/7787b839-c82c-415a-9aa0-1fe82027401c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 23 18:18:53.969442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-da642e01-fcfc-4bab-837f-005319d506a5 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:53.970179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-da642e01-fcfc-4bab-837f-005319d506a5 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:53.978464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da642e01-fcfc-4bab-837f-005319d506a5 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:53.979231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da642e01-fcfc-4bab-837f-005319d506a5 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:53.979736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da642e01-fcfc-4bab-837f-005319d506a5 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:53.980621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da642e01-fcfc-4bab-837f-005319d506a5 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:53.981069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da642e01-fcfc-4bab-837f-005319d506a5 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:53.981641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da642e01-fcfc-4bab-837f-005319d506a5 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:54.146930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-da642e01-fcfc-4bab-837f-005319d506a5 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:54.155482 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-da642e01-fcfc-4bab-837f-005319d506a5 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1375 microversion: 2.1 time: 0.190786 Aug 23 18:18:54.156526 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2656/5439] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:53 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1375 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:55.177867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9d5a79bf-a699-462a-a32d-355ab79115b4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:55.179826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9d5a79bf-a699-462a-a32d-355ab79115b4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:55.188213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d5a79bf-a699-462a-a32d-355ab79115b4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:55.189591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d5a79bf-a699-462a-a32d-355ab79115b4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:55.190277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d5a79bf-a699-462a-a32d-355ab79115b4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:55.192501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d5a79bf-a699-462a-a32d-355ab79115b4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:55.193228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d5a79bf-a699-462a-a32d-355ab79115b4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:55.193850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d5a79bf-a699-462a-a32d-355ab79115b4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:55.432212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9d5a79bf-a699-462a-a32d-355ab79115b4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:55.456282 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9d5a79bf-a699-462a-a32d-355ab79115b4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1375 microversion: 2.1 time: 0.281928 Aug 23 18:18:55.459166 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2784/5440] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:55 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1375 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:55.704445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f08ed8bf-b3aa-446d-ab6a-4c9096b6e551 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] Action: 'create', calling method: .version_select at 0x7f27f1ac4040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1563789935", "metadata": {"Type": "work"}}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:18:56.192168 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f08ed8bf-b3aa-446d-ab6a-4c9096b6e551 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.697899 Aug 23 18:18:56.194466 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2657/5441] 10.222.0.61 () {60 vars in 1156 bytes} [Tue Aug 23 18:18:55 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 700 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 23 18:18:56.206906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5cf914ef-8677-4956-8e5b-7e7f3ac658e9 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] Calling method '.version_select at 0x7f27df69e670>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:56.275265 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5cf914ef-8677-4956-8e5b-7e7f3ac658e9 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3" status: 200 len: 353 microversion: 2.1 time: 0.072120 Aug 23 18:18:56.276072 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2785/5442] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:18:56 2022] GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:18:56.484064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7355ed2b-4d4f-4798-893e-c4a4898ae435 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:56.485133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7355ed2b-4d4f-4798-893e-c4a4898ae435 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:56.493399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7355ed2b-4d4f-4798-893e-c4a4898ae435 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:56.494182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7355ed2b-4d4f-4798-893e-c4a4898ae435 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:56.494864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7355ed2b-4d4f-4798-893e-c4a4898ae435 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:56.495573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7355ed2b-4d4f-4798-893e-c4a4898ae435 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:56.496204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7355ed2b-4d4f-4798-893e-c4a4898ae435 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:56.496822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7355ed2b-4d4f-4798-893e-c4a4898ae435 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:56.687169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7355ed2b-4d4f-4798-893e-c4a4898ae435 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:56.697299 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7355ed2b-4d4f-4798-893e-c4a4898ae435 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1375 microversion: 2.1 time: 0.216775 Aug 23 18:18:56.697882 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2658/5443] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:56 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1375 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:57.290119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7145624f-fff0-4bfb-b23f-e894f86784a0 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] Calling method '.version_select at 0x7f27df67b3a0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:57.298001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:57.408969 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7145624f-fff0-4bfb-b23f-e894f86784a0 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3" status: 200 len: 354 microversion: 2.1 time: 0.122718 Aug 23 18:18:57.410089 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2786/5444] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:18:57 2022] GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:18:57.423090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-074012f6-c89f-4b3a-a0a0-a68f15ca91b2 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] Calling method '.version_select at 0x7f27f1ab81f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:57.485298 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-074012f6-c89f-4b3a-a0a0-a68f15ca91b2 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3" status: 200 len: 354 microversion: 2.1 time: 0.065802 Aug 23 18:18:57.486128 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2659/5445] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:18:57 2022] GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 => generated 354 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:18:57.500568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd74dc33-571b-4ecc-8cac-328ae880b643 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] Calling method '.version_select at 0x7f27df7484c0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:57.583037 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd74dc33-571b-4ecc-8cac-328ae880b643 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3" status: 202 len: 0 microversion: 2.1 time: 0.087143 Aug 23 18:18:57.586776 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2787/5446] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:18:57 2022] DELETE /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:18:57.592957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e79616d-fdaa-4ced-9d23-efbe9ba06f42 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] Calling method '.version_select at 0x7f27dfbb4af0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:57.680944 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e79616d-fdaa-4ced-9d23-efbe9ba06f42 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3" status: 200 len: 353 microversion: 2.1 time: 0.092818 Aug 23 18:18:57.682993 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2660/5447] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:18:57 2022] GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:18:57.721636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-44a5c8fc-7030-487f-a26c-14b5441d1196 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:57.722314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-44a5c8fc-7030-487f-a26c-14b5441d1196 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:57.730464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44a5c8fc-7030-487f-a26c-14b5441d1196 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:57.734112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44a5c8fc-7030-487f-a26c-14b5441d1196 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:57.734642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44a5c8fc-7030-487f-a26c-14b5441d1196 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:57.736354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44a5c8fc-7030-487f-a26c-14b5441d1196 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:57.736880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44a5c8fc-7030-487f-a26c-14b5441d1196 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:57.737326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44a5c8fc-7030-487f-a26c-14b5441d1196 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:57.917646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-44a5c8fc-7030-487f-a26c-14b5441d1196 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:57.926748 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-44a5c8fc-7030-487f-a26c-14b5441d1196 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1375 microversion: 2.1 time: 0.209397 Aug 23 18:18:57.928148 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2788/5448] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:57 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1375 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:58.697195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d15fe51-bfdc-48e1-9f52-b7c7bc590270 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] Calling method '.version_select at 0x7f27f1ab81f0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:58.765948 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2d15fe51-bfdc-48e1-9f52-b7c7bc590270 tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3" status: 200 len: 353 microversion: 2.1 time: 0.074587 Aug 23 18:18:58.767883 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2661/5449] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:18:58 2022] GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 => generated 353 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:18:58.948337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-409c958b-ede9-45d6-83d3-7da02f6e3ed0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:58.949878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-409c958b-ede9-45d6-83d3-7da02f6e3ed0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:18:58.959638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-409c958b-ede9-45d6-83d3-7da02f6e3ed0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:58.960147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-409c958b-ede9-45d6-83d3-7da02f6e3ed0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:58.960674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-409c958b-ede9-45d6-83d3-7da02f6e3ed0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:58.961618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-409c958b-ede9-45d6-83d3-7da02f6e3ed0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:58.962108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-409c958b-ede9-45d6-83d3-7da02f6e3ed0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:58.962579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-409c958b-ede9-45d6-83d3-7da02f6e3ed0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:59.039776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-8ae200f1-5257-4d26-bf1e-dbb2d5752848 req-289d52ad-4893-4022-b384-dc5517862252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56177b26-1f5a-4e30-9612-e12570c6db1f", "name": "network-vif-plugged", "status": "completed", "tag": "569eebda-cfd9-47e0-8869-8add9cbd39b8"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:18:59.060764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8ae200f1-5257-4d26-bf1e-dbb2d5752848 req-289d52ad-4893-4022-b384-dc5517862252 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:18:59.061465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8ae200f1-5257-4d26-bf1e-dbb2d5752848 req-289d52ad-4893-4022-b384-dc5517862252 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:18:59.062059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8ae200f1-5257-4d26-bf1e-dbb2d5752848 req-289d52ad-4893-4022-b384-dc5517862252 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:18:59.084841 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-8ae200f1-5257-4d26-bf1e-dbb2d5752848 req-289d52ad-4893-4022-b384-dc5517862252 service nova] Creating event network-vif-plugged:569eebda-cfd9-47e0-8869-8add9cbd39b8 for instance 56177b26-1f5a-4e30-9612-e12570c6db1f on n-h1-850468-16 Aug 23 18:18:59.099939 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-8ae200f1-5257-4d26-bf1e-dbb2d5752848 req-289d52ad-4893-4022-b384-dc5517862252 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063693 Aug 23 18:18:59.103857 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2662/5450] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:18:59.170480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-409c958b-ede9-45d6-83d3-7da02f6e3ed0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:18:59.179327 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-409c958b-ede9-45d6-83d3-7da02f6e3ed0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1375 microversion: 2.1 time: 0.234974 Aug 23 18:18:59.180441 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2789/5451] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:18:58 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1375 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:18:59.781375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4932294d-0d74-4054-bf88-835c25e3d1cb tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] Calling method '.version_select at 0x7f27dfa8f160>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:18:59.788991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:59.790329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:18:59.851369 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4932294d-0d74-4054-bf88-835c25e3d1cb tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3" status: 200 len: 353 microversion: 2.1 time: 0.073125 Aug 23 18:18:59.855997 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2663/5452] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:18:59 2022] GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:00.202249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5992fc66-9fe6-4249-b9fe-7438383e1a08 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:00.203063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5992fc66-9fe6-4249-b9fe-7438383e1a08 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:00.204940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:00.216396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5992fc66-9fe6-4249-b9fe-7438383e1a08 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:00.217171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5992fc66-9fe6-4249-b9fe-7438383e1a08 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:00.217721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5992fc66-9fe6-4249-b9fe-7438383e1a08 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:00.218794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5992fc66-9fe6-4249-b9fe-7438383e1a08 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:00.219484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5992fc66-9fe6-4249-b9fe-7438383e1a08 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:00.220128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5992fc66-9fe6-4249-b9fe-7438383e1a08 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:00.402150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5992fc66-9fe6-4249-b9fe-7438383e1a08 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:00.410905 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5992fc66-9fe6-4249-b9fe-7438383e1a08 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1375 microversion: 2.1 time: 0.214012 Aug 23 18:19:00.411743 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2790/5453] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:00 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1375 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:00.867533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f7938463-0cd8-4340-a881-495a3c23181e tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] Calling method '.version_select at 0x7f27dfba7160>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:00.925675 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-f7938463-0cd8-4340-a881-495a3c23181e tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] HTTP exception thrown: Volume a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 could not be found. Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f7938463-0cd8-4340-a881-495a3c23181e tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] Request method failure captured: Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 HTTP/1.1 Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRoPhe0xsR2hX60RZPGxUwjcGgCND8Ulh_74AdKoqHr_FgtJ-AOtznCbTO-szAQhKu8Na1fE750JDErPdT4vUrT-Wrp4aanIzNR9dNK82sXjtnhZ2vW4YMwrlsaRlP8CqqasRSCI9MWazhX3kpbG5UTs3tMALlxBaxLNsYDYo63SpUU Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: eec2769fc6a94fdcb9485f08c2898449 Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-VolumesGetTestJSON-2138920897 Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_eec2769fc6a94fdcb9485f08c2898449"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eec2769fc6a94fdcb9485f08c2898449"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/eec2769fc6a94fdcb9485f08c2898449"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/eec2769fc6a94fdcb9485f08c2898449"}]}] Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-VolumesGetTestJSON-2138920897 Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: eec2769fc6a94fdcb9485f08c2898449 Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-VolumesGetTestJSON-2138920897 Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-VolumesGetTestJSON-2138920897-project Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 469be60287e546438a431fa3282f6779 Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-VolumesGetTestJSON-2138920897-project Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: exception: Volume a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 could not be found. Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'a80cf0b8-a8f4-4bab-9029-79343ebf6ee3'} Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 could not be found. (HTTP 404) (Request-ID: req-8c2a1fc7-66e8-4242-a77b-d1b232744299) Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 18:19:00.932746 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 could not be found. Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 could not be found. Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 could not be found. Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f7938463-0cd8-4340-a881-495a3c23181e tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] Returning 404 to user: Volume a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f7938463-0cd8-4340-a881-495a3c23181e tempest-VolumesGetTestJSON-2138920897 tempest-VolumesGetTestJSON-2138920897-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3" status: 404 len: 109 microversion: 2.1 time: 0.071502 Aug 23 18:19:00.936664 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2664/5454] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:19:00 2022] GET /compute/v2.1/os-volumes/a80cf0b8-a8f4-4bab-9029-79343ebf6ee3 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:19:01.433234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-90bb4bd2-3f22-4a87-a41e-7a0fe4918dd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:01.433856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-90bb4bd2-3f22-4a87-a41e-7a0fe4918dd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:01.444447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90bb4bd2-3f22-4a87-a41e-7a0fe4918dd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:01.444939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90bb4bd2-3f22-4a87-a41e-7a0fe4918dd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:01.445376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90bb4bd2-3f22-4a87-a41e-7a0fe4918dd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:01.446077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90bb4bd2-3f22-4a87-a41e-7a0fe4918dd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:01.446529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90bb4bd2-3f22-4a87-a41e-7a0fe4918dd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:01.446981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90bb4bd2-3f22-4a87-a41e-7a0fe4918dd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:01.682290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-90bb4bd2-3f22-4a87-a41e-7a0fe4918dd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:01.687813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:01.699004 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-90bb4bd2-3f22-4a87-a41e-7a0fe4918dd2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1548 microversion: 2.1 time: 0.269311 Aug 23 18:19:01.700474 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2791/5455] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:01 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1548 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:01.721345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-23c60ba5-caf5-48a6-8b86-9bff82ffeb68 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:01.723613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-23c60ba5-caf5-48a6-8b86-9bff82ffeb68 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:01.730258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23c60ba5-caf5-48a6-8b86-9bff82ffeb68 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:01.731085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23c60ba5-caf5-48a6-8b86-9bff82ffeb68 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:01.733497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23c60ba5-caf5-48a6-8b86-9bff82ffeb68 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:01.734458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23c60ba5-caf5-48a6-8b86-9bff82ffeb68 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:01.735168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23c60ba5-caf5-48a6-8b86-9bff82ffeb68 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:01.735758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-23c60ba5-caf5-48a6-8b86-9bff82ffeb68 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:01.954631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-23c60ba5-caf5-48a6-8b86-9bff82ffeb68 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:01.966008 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-23c60ba5-caf5-48a6-8b86-9bff82ffeb68 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1548 microversion: 2.1 time: 0.248205 Aug 23 18:19:01.967769 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2665/5456] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:01 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1548 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:05.374279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3a5c0fb4-976c-4e51-9266-920d17b7a81e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:05.374836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3a5c0fb4-976c-4e51-9266-920d17b7a81e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:05.384383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a5c0fb4-976c-4e51-9266-920d17b7a81e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:05.384892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a5c0fb4-976c-4e51-9266-920d17b7a81e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:05.385323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a5c0fb4-976c-4e51-9266-920d17b7a81e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:05.386044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a5c0fb4-976c-4e51-9266-920d17b7a81e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:05.391907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a5c0fb4-976c-4e51-9266-920d17b7a81e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:05.395640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a5c0fb4-976c-4e51-9266-920d17b7a81e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:05.446109 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3a5c0fb4-976c-4e51-9266-920d17b7a81e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/ips" status: 200 len: 150 microversion: 2.1 time: 0.075594 Aug 23 18:19:05.472109 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2792/5457] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:19:05 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/ips => generated 150 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:08.211663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-34e3fe94-c605-4ba8-9637-309ae4253cbc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6beedc9c-9d8b-454d-b21a-b6d34f061c28"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:08.217676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-34e3fe94-c605-4ba8-9637-309ae4253cbc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:08.223066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:08.229750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34e3fe94-c605-4ba8-9637-309ae4253cbc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:08.230645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34e3fe94-c605-4ba8-9637-309ae4253cbc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:08.231012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34e3fe94-c605-4ba8-9637-309ae4253cbc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:08.231865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34e3fe94-c605-4ba8-9637-309ae4253cbc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:08.232515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34e3fe94-c605-4ba8-9637-309ae4253cbc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:08.232953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34e3fe94-c605-4ba8-9637-309ae4253cbc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:08.593211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6e4b3303-b130-4525-8dc9-d7908796fdcb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:08.594289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6e4b3303-b130-4525-8dc9-d7908796fdcb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:08.610725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e4b3303-b130-4525-8dc9-d7908796fdcb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:08.611488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e4b3303-b130-4525-8dc9-d7908796fdcb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:08.612182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e4b3303-b130-4525-8dc9-d7908796fdcb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:08.618452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e4b3303-b130-4525-8dc9-d7908796fdcb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:08.625343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e4b3303-b130-4525-8dc9-d7908796fdcb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:08.626888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e4b3303-b130-4525-8dc9-d7908796fdcb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:08.667295 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-34e3fe94-c605-4ba8-9637-309ae4253cbc tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.461057 Aug 23 18:19:08.668479 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2666/5458] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:19:08 2022] POST /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:08.767486 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6e4b3303-b130-4525-8dc9-d7908796fdcb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/ips" status: 200 len: 152 microversion: 2.20 time: 0.179596 Aug 23 18:19:08.768098 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2793/5459] 10.222.0.61 () {60 vars in 1289 bytes} [Tue Aug 23 18:19:08 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/ips => generated 152 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:19:12.088668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6bb7c765-7d13-4613-b1ba-96ee25cb69ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:12.090812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6bb7c765-7d13-4613-b1ba-96ee25cb69ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:12.101186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bb7c765-7d13-4613-b1ba-96ee25cb69ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:12.101836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bb7c765-7d13-4613-b1ba-96ee25cb69ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:12.102345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bb7c765-7d13-4613-b1ba-96ee25cb69ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:12.103113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bb7c765-7d13-4613-b1ba-96ee25cb69ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:12.103971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bb7c765-7d13-4613-b1ba-96ee25cb69ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:12.105092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6bb7c765-7d13-4613-b1ba-96ee25cb69ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:12.139329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-6bb7c765-7d13-4613-b1ba-96ee25cb69ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lazy-loading 'flavor' on Instance uuid 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:19:12.478835 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6bb7c765-7d13-4613-b1ba-96ee25cb69ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "POST /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/action" status: 202 len: 0 microversion: 2.20 time: 0.398536 Aug 23 18:19:12.479622 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2667/5460] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 18:19:12 2022] POST /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/action => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:19:12.498658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-44f00d49-854c-4970-9750-1f5f41c37cc1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:12.499287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-44f00d49-854c-4970-9750-1f5f41c37cc1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:12.513302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:12.516766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44f00d49-854c-4970-9750-1f5f41c37cc1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:12.517434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44f00d49-854c-4970-9750-1f5f41c37cc1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:12.518054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44f00d49-854c-4970-9750-1f5f41c37cc1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:12.519911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44f00d49-854c-4970-9750-1f5f41c37cc1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:12.520476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44f00d49-854c-4970-9750-1f5f41c37cc1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:12.521413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44f00d49-854c-4970-9750-1f5f41c37cc1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:12.832137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-44f00d49-854c-4970-9750-1f5f41c37cc1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:12.843597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-44f00d49-854c-4970-9750-1f5f41c37cc1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:12.854681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-44f00d49-854c-4970-9750-1f5f41c37cc1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:12.856364 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-44f00d49-854c-4970-9750-1f5f41c37cc1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1724 microversion: 2.20 time: 0.372020 Aug 23 18:19:12.872679 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2794/5461] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:12 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1724 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:13.885233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e5685634-4446-41c4-885c-3df8e81e6566 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:13.885854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e5685634-4446-41c4-885c-3df8e81e6566 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:13.916377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5685634-4446-41c4-885c-3df8e81e6566 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:13.917186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5685634-4446-41c4-885c-3df8e81e6566 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:13.917810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5685634-4446-41c4-885c-3df8e81e6566 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:13.918768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5685634-4446-41c4-885c-3df8e81e6566 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:13.919384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5685634-4446-41c4-885c-3df8e81e6566 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:13.920037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5685634-4446-41c4-885c-3df8e81e6566 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:14.215405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5685634-4446-41c4-885c-3df8e81e6566 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:14.226877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5685634-4446-41c4-885c-3df8e81e6566 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:14.228636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5685634-4446-41c4-885c-3df8e81e6566 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:14.229903 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e5685634-4446-41c4-885c-3df8e81e6566 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1724 microversion: 2.20 time: 0.349029 Aug 23 18:19:14.246750 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2668/5462] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:13 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1724 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:15.254820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-185c6541-0329-4989-a67d-7c989fad43ab tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:15.255191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-185c6541-0329-4989-a67d-7c989fad43ab tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:15.262143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-185c6541-0329-4989-a67d-7c989fad43ab tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:15.262765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-185c6541-0329-4989-a67d-7c989fad43ab tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:15.263284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-185c6541-0329-4989-a67d-7c989fad43ab tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:15.264132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-185c6541-0329-4989-a67d-7c989fad43ab tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:15.264662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-185c6541-0329-4989-a67d-7c989fad43ab tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:15.265164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-185c6541-0329-4989-a67d-7c989fad43ab tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:15.538783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-185c6541-0329-4989-a67d-7c989fad43ab tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:15.580015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-185c6541-0329-4989-a67d-7c989fad43ab tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:15.592703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-185c6541-0329-4989-a67d-7c989fad43ab tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:15.603176 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-185c6541-0329-4989-a67d-7c989fad43ab tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1724 microversion: 2.20 time: 0.344478 Aug 23 18:19:15.636397 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2795/5463] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:15 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1724 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:16.629838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8156ad33-701b-4627-bf85-fbdd7903e1ae tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:16.630441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8156ad33-701b-4627-bf85-fbdd7903e1ae tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:16.644249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8156ad33-701b-4627-bf85-fbdd7903e1ae tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:16.644764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8156ad33-701b-4627-bf85-fbdd7903e1ae tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:16.645207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8156ad33-701b-4627-bf85-fbdd7903e1ae tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:16.648016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8156ad33-701b-4627-bf85-fbdd7903e1ae tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:16.648650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8156ad33-701b-4627-bf85-fbdd7903e1ae tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:16.650524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8156ad33-701b-4627-bf85-fbdd7903e1ae tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:16.942162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8156ad33-701b-4627-bf85-fbdd7903e1ae tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:16.963986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8156ad33-701b-4627-bf85-fbdd7903e1ae tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:16.965911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8156ad33-701b-4627-bf85-fbdd7903e1ae tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:16.967428 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8156ad33-701b-4627-bf85-fbdd7903e1ae tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1724 microversion: 2.20 time: 0.341698 Aug 23 18:19:16.981017 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2669/5464] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:16 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1724 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:18.012118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-22dbbf18-e359-46ae-b159-6f4c05a99970 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:18.012781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-22dbbf18-e359-46ae-b159-6f4c05a99970 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:18.024316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22dbbf18-e359-46ae-b159-6f4c05a99970 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:18.024999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22dbbf18-e359-46ae-b159-6f4c05a99970 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:18.025640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22dbbf18-e359-46ae-b159-6f4c05a99970 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:18.026580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22dbbf18-e359-46ae-b159-6f4c05a99970 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:18.028138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22dbbf18-e359-46ae-b159-6f4c05a99970 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:18.028886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22dbbf18-e359-46ae-b159-6f4c05a99970 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:18.196827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-22dbbf18-e359-46ae-b159-6f4c05a99970 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:18.205274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-22dbbf18-e359-46ae-b159-6f4c05a99970 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:18.206959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-22dbbf18-e359-46ae-b159-6f4c05a99970 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:18.208435 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-22dbbf18-e359-46ae-b159-6f4c05a99970 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1724 microversion: 2.20 time: 0.214276 Aug 23 18:19:18.210064 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2796/5465] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:17 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:19.232920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4531dcf9-7ce4-4d13-a6a9-5c711e50fabd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:19.233593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4531dcf9-7ce4-4d13-a6a9-5c711e50fabd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:19.247596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4531dcf9-7ce4-4d13-a6a9-5c711e50fabd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:19.248334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4531dcf9-7ce4-4d13-a6a9-5c711e50fabd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:19.248951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4531dcf9-7ce4-4d13-a6a9-5c711e50fabd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:19.249853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4531dcf9-7ce4-4d13-a6a9-5c711e50fabd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:19.280104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4531dcf9-7ce4-4d13-a6a9-5c711e50fabd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:19.280943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4531dcf9-7ce4-4d13-a6a9-5c711e50fabd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:19.600012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4531dcf9-7ce4-4d13-a6a9-5c711e50fabd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:19.626902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4531dcf9-7ce4-4d13-a6a9-5c711e50fabd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:19.630332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4531dcf9-7ce4-4d13-a6a9-5c711e50fabd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:19.632907 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4531dcf9-7ce4-4d13-a6a9-5c711e50fabd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1724 microversion: 2.20 time: 0.403953 Aug 23 18:19:19.634034 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2670/5466] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:19 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1724 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:20.665868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a7336a95-dc36-4e27-8bd9-f07dc254da5c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:20.665868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a7336a95-dc36-4e27-8bd9-f07dc254da5c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:20.673385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7336a95-dc36-4e27-8bd9-f07dc254da5c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:20.673385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7336a95-dc36-4e27-8bd9-f07dc254da5c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:20.673385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7336a95-dc36-4e27-8bd9-f07dc254da5c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:20.673385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7336a95-dc36-4e27-8bd9-f07dc254da5c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:20.673385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7336a95-dc36-4e27-8bd9-f07dc254da5c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:20.680101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7336a95-dc36-4e27-8bd9-f07dc254da5c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:21.006504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a7336a95-dc36-4e27-8bd9-f07dc254da5c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:21.016012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a7336a95-dc36-4e27-8bd9-f07dc254da5c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:21.018592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a7336a95-dc36-4e27-8bd9-f07dc254da5c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:21.020426 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a7336a95-dc36-4e27-8bd9-f07dc254da5c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1724 microversion: 2.20 time: 0.366868 Aug 23 18:19:21.021323 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2797/5467] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:20 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1724 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:22.045262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c5829ed3-08a1-460b-8dcd-21c5d0fabac2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:22.049090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c5829ed3-08a1-460b-8dcd-21c5d0fabac2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:22.064341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5829ed3-08a1-460b-8dcd-21c5d0fabac2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:22.067748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5829ed3-08a1-460b-8dcd-21c5d0fabac2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:22.068591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5829ed3-08a1-460b-8dcd-21c5d0fabac2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:22.070734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5829ed3-08a1-460b-8dcd-21c5d0fabac2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:22.072420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5829ed3-08a1-460b-8dcd-21c5d0fabac2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:22.073093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5829ed3-08a1-460b-8dcd-21c5d0fabac2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:22.321502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c5829ed3-08a1-460b-8dcd-21c5d0fabac2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:22.337403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c5829ed3-08a1-460b-8dcd-21c5d0fabac2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:22.344244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c5829ed3-08a1-460b-8dcd-21c5d0fabac2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:22.345585 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c5829ed3-08a1-460b-8dcd-21c5d0fabac2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1724 microversion: 2.20 time: 0.306267 Aug 23 18:19:22.350025 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2671/5468] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:22 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1724 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:23.206753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-da7ab658-f9d8-4f21-b851-b0a16c68834d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: .version_select at 0x7f27df69e9d0>, body: {"keypair": {"name": "tempest-keypair-1925915936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKLSvm6tXtLAnqMORYLyzAzWqjiLEd/GygzDjEJjKVYkHUA0AogL5eisuo5yFSgV8bYWc5ILzQmCN9Ygo2HVzlflRHAfi3++bJSuNtmcMKFlm1ibF4YvNmNgQRgStuIIVw=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:23.226181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-da7ab658-f9d8-4f21-b851-b0a16c68834d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:19:23.232795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-da7ab658-f9d8-4f21-b851-b0a16c68834d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for user a11d6c5120f24a448c1831ff925409c3 and project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:19:23.267040 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-da7ab658-f9d8-4f21-b851-b0a16c68834d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064219 Aug 23 18:19:23.268577 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2798/5469] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:19:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:23.377382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ee647fe5-0aaa-4cc3-bd6a-dbda17ecc7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:23.379756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ee647fe5-0aaa-4cc3-bd6a-dbda17ecc7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:23.393325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee647fe5-0aaa-4cc3-bd6a-dbda17ecc7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:23.394390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee647fe5-0aaa-4cc3-bd6a-dbda17ecc7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:23.395821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee647fe5-0aaa-4cc3-bd6a-dbda17ecc7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:23.397154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee647fe5-0aaa-4cc3-bd6a-dbda17ecc7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:23.397286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee647fe5-0aaa-4cc3-bd6a-dbda17ecc7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:23.397780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee647fe5-0aaa-4cc3-bd6a-dbda17ecc7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:23.651178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ee647fe5-0aaa-4cc3-bd6a-dbda17ecc7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:23.669655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ee647fe5-0aaa-4cc3-bd6a-dbda17ecc7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:23.673694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ee647fe5-0aaa-4cc3-bd6a-dbda17ecc7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:23.677575 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ee647fe5-0aaa-4cc3-bd6a-dbda17ecc7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1724 microversion: 2.20 time: 0.306670 Aug 23 18:19:23.694746 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2672/5470] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:23 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1724 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:24.705786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-030734ca-0381-4165-b439-63db349aa99d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:24.706458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-030734ca-0381-4165-b439-63db349aa99d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:24.715177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-030734ca-0381-4165-b439-63db349aa99d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:24.715978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-030734ca-0381-4165-b439-63db349aa99d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:24.716432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-030734ca-0381-4165-b439-63db349aa99d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:24.717149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-030734ca-0381-4165-b439-63db349aa99d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:24.717616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-030734ca-0381-4165-b439-63db349aa99d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:24.718050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-030734ca-0381-4165-b439-63db349aa99d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:25.124645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-030734ca-0381-4165-b439-63db349aa99d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:25.135190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-030734ca-0381-4165-b439-63db349aa99d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:25.137108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-030734ca-0381-4165-b439-63db349aa99d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:25.138314 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-030734ca-0381-4165-b439-63db349aa99d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1745 microversion: 2.20 time: 0.437088 Aug 23 18:19:25.138924 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2799/5471] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:24 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1745 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:26.163171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b66de74b-13cd-43cc-ab4b-5a96f10d462b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:26.164717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b66de74b-13cd-43cc-ab4b-5a96f10d462b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:26.194070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b66de74b-13cd-43cc-ab4b-5a96f10d462b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:26.199071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b66de74b-13cd-43cc-ab4b-5a96f10d462b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:26.199651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b66de74b-13cd-43cc-ab4b-5a96f10d462b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:26.200911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b66de74b-13cd-43cc-ab4b-5a96f10d462b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:26.201482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b66de74b-13cd-43cc-ab4b-5a96f10d462b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:26.202031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b66de74b-13cd-43cc-ab4b-5a96f10d462b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:26.211328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:26.387166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-168285807", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80f627cf-1c5b-45c1-a064-49e8b550df67"}], "security_groups": [{"name": "tempest-securitygroup--783353218"}], "key_name": "tempest-keypair-1925915936", "user_data": "}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:26.394316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b66de74b-13cd-43cc-ab4b-5a96f10d462b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:26.405034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b66de74b-13cd-43cc-ab4b-5a96f10d462b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:26.406529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b66de74b-13cd-43cc-ab4b-5a96f10d462b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:26.407872 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b66de74b-13cd-43cc-ab4b-5a96f10d462b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1745 microversion: 2.20 time: 0.249029 Aug 23 18:19:26.409738 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2673/5472] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:26 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1745 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:26.582173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] validate_networks() for [('80f627cf-1c5b-45c1-a064-49e8b550df67', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:19:27.438232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a1468b58-b232-497d-a159-f7088f33f80d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:27.440223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a1468b58-b232-497d-a159-f7088f33f80d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:27.456431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1468b58-b232-497d-a159-f7088f33f80d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:27.463124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1468b58-b232-497d-a159-f7088f33f80d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:27.464021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1468b58-b232-497d-a159-f7088f33f80d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:27.465115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1468b58-b232-497d-a159-f7088f33f80d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:27.466051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1468b58-b232-497d-a159-f7088f33f80d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:27.467080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1468b58-b232-497d-a159-f7088f33f80d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:27.714670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a1468b58-b232-497d-a159-f7088f33f80d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:27.728634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a1468b58-b232-497d-a159-f7088f33f80d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:27.730209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a1468b58-b232-497d-a159-f7088f33f80d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:27.731655 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a1468b58-b232-497d-a159-f7088f33f80d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1745 microversion: 2.20 time: 0.298204 Aug 23 18:19:27.732620 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2674/5473] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:27 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1745 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:28.177650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:19:28.179633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:19:28.180910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:19:28.181447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:19:28.182629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:19:28.195319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:28.196150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:28.197166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:28.198236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:28.199075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:28.200164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:28.223984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:19:28.231322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for user a11d6c5120f24a448c1831ff925409c3 and project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:19:28.250869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:19:28.253882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:19:28.304820 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e7c2ab47-d49e-4e6f-b881-fc0b773b4f06 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.922280 Aug 23 18:19:28.306090 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2800/5474] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:19:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 1924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:19:28.317162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-369e50cd-f6b0-49e4-b099-a70bea24ba35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:28.318073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-369e50cd-f6b0-49e4-b099-a70bea24ba35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:28.407919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-369e50cd-f6b0-49e4-b099-a70bea24ba35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:28.417125 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-369e50cd-f6b0-49e4-b099-a70bea24ba35 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1241 microversion: 2.1 time: 0.103988 Aug 23 18:19:28.418788 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2675/5475] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:28 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:28.768671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9bf253d-a95d-4862-8829-e7b3db49a9e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:28.771875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b9bf253d-a95d-4862-8829-e7b3db49a9e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:28.789046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9bf253d-a95d-4862-8829-e7b3db49a9e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:28.790962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9bf253d-a95d-4862-8829-e7b3db49a9e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:28.793177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9bf253d-a95d-4862-8829-e7b3db49a9e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:28.794168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9bf253d-a95d-4862-8829-e7b3db49a9e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:28.794851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9bf253d-a95d-4862-8829-e7b3db49a9e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:28.796835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9bf253d-a95d-4862-8829-e7b3db49a9e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:29.097902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-89a3c59d-bba6-4b25-9b1c-bf992c0705e1 req-ae924e59-17f7-4217-bc1d-c5cc107f4de3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8fe0c3-ea81-46b5-9230-216cf8e932d2", "name": "network-vif-plugged", "status": "completed", "tag": "663bf035-ee8e-4ca7-aeb3-025d64e3d0e1"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:29.105248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b9bf253d-a95d-4862-8829-e7b3db49a9e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:29.120262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b9bf253d-a95d-4862-8829-e7b3db49a9e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:29.122604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b9bf253d-a95d-4862-8829-e7b3db49a9e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:29.124215 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b9bf253d-a95d-4862-8829-e7b3db49a9e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1745 microversion: 2.20 time: 0.363205 Aug 23 18:19:29.125205 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2801/5476] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:28 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1745 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:29.153693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-89a3c59d-bba6-4b25-9b1c-bf992c0705e1 req-ae924e59-17f7-4217-bc1d-c5cc107f4de3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:29.154201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-89a3c59d-bba6-4b25-9b1c-bf992c0705e1 req-ae924e59-17f7-4217-bc1d-c5cc107f4de3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:29.154669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-89a3c59d-bba6-4b25-9b1c-bf992c0705e1 req-ae924e59-17f7-4217-bc1d-c5cc107f4de3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:29.195972 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-89a3c59d-bba6-4b25-9b1c-bf992c0705e1 req-ae924e59-17f7-4217-bc1d-c5cc107f4de3 service nova] Creating event network-vif-plugged:663bf035-ee8e-4ca7-aeb3-025d64e3d0e1 for instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 on n-h2-850468-16 Aug 23 18:19:29.231592 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-89a3c59d-bba6-4b25-9b1c-bf992c0705e1 req-ae924e59-17f7-4217-bc1d-c5cc107f4de3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.139513 Aug 23 18:19:29.232455 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2676/5477] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:19:29.444961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bf024eb5-ef14-40e4-9d60-b515db1a58ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:29.445588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bf024eb5-ef14-40e4-9d60-b515db1a58ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:29.459126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf024eb5-ef14-40e4-9d60-b515db1a58ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:29.459866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf024eb5-ef14-40e4-9d60-b515db1a58ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:29.460476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf024eb5-ef14-40e4-9d60-b515db1a58ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:29.461430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf024eb5-ef14-40e4-9d60-b515db1a58ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:29.462054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf024eb5-ef14-40e4-9d60-b515db1a58ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:29.464269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf024eb5-ef14-40e4-9d60-b515db1a58ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:29.584166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bf024eb5-ef14-40e4-9d60-b515db1a58ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:29.592813 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bf024eb5-ef14-40e4-9d60-b515db1a58ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1237 microversion: 2.1 time: 0.155360 Aug 23 18:19:29.593367 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2802/5478] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:29 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1237 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:30.162297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-38ba07cc-f34c-4a4c-9baf-7d48a69bd99f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:30.163041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-38ba07cc-f34c-4a4c-9baf-7d48a69bd99f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:30.175798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38ba07cc-f34c-4a4c-9baf-7d48a69bd99f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:30.176319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38ba07cc-f34c-4a4c-9baf-7d48a69bd99f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:30.176751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38ba07cc-f34c-4a4c-9baf-7d48a69bd99f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:30.177461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38ba07cc-f34c-4a4c-9baf-7d48a69bd99f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:30.181686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38ba07cc-f34c-4a4c-9baf-7d48a69bd99f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:30.183115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38ba07cc-f34c-4a4c-9baf-7d48a69bd99f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:30.619331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bcebea0a-8d4e-4645-84e9-1975e0969b81 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:30.619956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bcebea0a-8d4e-4645-84e9-1975e0969b81 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:30.632138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcebea0a-8d4e-4645-84e9-1975e0969b81 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:30.632630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcebea0a-8d4e-4645-84e9-1975e0969b81 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:30.633067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcebea0a-8d4e-4645-84e9-1975e0969b81 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:30.633871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcebea0a-8d4e-4645-84e9-1975e0969b81 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:30.634325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcebea0a-8d4e-4645-84e9-1975e0969b81 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:30.634774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcebea0a-8d4e-4645-84e9-1975e0969b81 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:30.679602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-38ba07cc-f34c-4a4c-9baf-7d48a69bd99f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:30.688213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-38ba07cc-f34c-4a4c-9baf-7d48a69bd99f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:30.689885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-38ba07cc-f34c-4a4c-9baf-7d48a69bd99f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:30.714741 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-38ba07cc-f34c-4a4c-9baf-7d48a69bd99f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1745 microversion: 2.20 time: 0.561314 Aug 23 18:19:30.715349 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2677/5479] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:30 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1745 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:30.795072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bcebea0a-8d4e-4645-84e9-1975e0969b81 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:30.808856 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bcebea0a-8d4e-4645-84e9-1975e0969b81 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1299 microversion: 2.1 time: 0.190298 Aug 23 18:19:30.810176 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2803/5480] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:30 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1299 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:19:31.744976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6428cbe7-1175-4b64-931d-33811d9c7054 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:31.746225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6428cbe7-1175-4b64-931d-33811d9c7054 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:31.764538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6428cbe7-1175-4b64-931d-33811d9c7054 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:31.765286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6428cbe7-1175-4b64-931d-33811d9c7054 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:31.765884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6428cbe7-1175-4b64-931d-33811d9c7054 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:31.768244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6428cbe7-1175-4b64-931d-33811d9c7054 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:31.780920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6428cbe7-1175-4b64-931d-33811d9c7054 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:31.781388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6428cbe7-1175-4b64-931d-33811d9c7054 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:31.837340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f6134a42-e436-411b-8356-74b49854f772 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:31.838135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f6134a42-e436-411b-8356-74b49854f772 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:31.849817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6134a42-e436-411b-8356-74b49854f772 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:31.855350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6134a42-e436-411b-8356-74b49854f772 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:31.857232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6134a42-e436-411b-8356-74b49854f772 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:31.860859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6134a42-e436-411b-8356-74b49854f772 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:31.863160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6134a42-e436-411b-8356-74b49854f772 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:31.866712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6134a42-e436-411b-8356-74b49854f772 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:32.172785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6428cbe7-1175-4b64-931d-33811d9c7054 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:32.188918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6428cbe7-1175-4b64-931d-33811d9c7054 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:32.193958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6428cbe7-1175-4b64-931d-33811d9c7054 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:32.200299 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6428cbe7-1175-4b64-931d-33811d9c7054 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.465209 Aug 23 18:19:32.200888 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2678/5481] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:31 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:32.357263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f6134a42-e436-411b-8356-74b49854f772 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:32.376249 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f6134a42-e436-411b-8356-74b49854f772 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1366 microversion: 2.1 time: 0.543612 Aug 23 18:19:32.377306 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2804/5482] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:31 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1366 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:33.230919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-014fca79-a09a-49db-b2b9-f03cbfff7646 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:33.231670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-014fca79-a09a-49db-b2b9-f03cbfff7646 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:33.243358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-014fca79-a09a-49db-b2b9-f03cbfff7646 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:33.270272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-014fca79-a09a-49db-b2b9-f03cbfff7646 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:33.271039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-014fca79-a09a-49db-b2b9-f03cbfff7646 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:33.276899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-014fca79-a09a-49db-b2b9-f03cbfff7646 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:33.281041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-014fca79-a09a-49db-b2b9-f03cbfff7646 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:33.281743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-014fca79-a09a-49db-b2b9-f03cbfff7646 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:33.397579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1fe7a9f7-df06-4e5f-8380-fb9760101715 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:33.398205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1fe7a9f7-df06-4e5f-8380-fb9760101715 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:33.427569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1fe7a9f7-df06-4e5f-8380-fb9760101715 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:33.429932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1fe7a9f7-df06-4e5f-8380-fb9760101715 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:33.430385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1fe7a9f7-df06-4e5f-8380-fb9760101715 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:33.433029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1fe7a9f7-df06-4e5f-8380-fb9760101715 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:33.435051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1fe7a9f7-df06-4e5f-8380-fb9760101715 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:33.437043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1fe7a9f7-df06-4e5f-8380-fb9760101715 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:33.864709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-014fca79-a09a-49db-b2b9-f03cbfff7646 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:33.880209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-014fca79-a09a-49db-b2b9-f03cbfff7646 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:33.882695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-014fca79-a09a-49db-b2b9-f03cbfff7646 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:33.884900 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-014fca79-a09a-49db-b2b9-f03cbfff7646 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.657417 Aug 23 18:19:33.905717 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2679/5483] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:33 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:34.320679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1fe7a9f7-df06-4e5f-8380-fb9760101715 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:34.333106 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1fe7a9f7-df06-4e5f-8380-fb9760101715 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1366 microversion: 2.1 time: 0.940126 Aug 23 18:19:34.335178 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2805/5484] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:33 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1366 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:34.616914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-0da59e3a-a3dd-4520-940b-a85a06110ff6 req-8d19e429-1b2c-43ec-9050-0af26ca56e35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2666d044-c9dc-484d-939f-7bdf780731ea", "tag": "3926ef9d-fd08-4b96-852a-893474ad1ff2"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:34.652726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0da59e3a-a3dd-4520-940b-a85a06110ff6 req-8d19e429-1b2c-43ec-9050-0af26ca56e35 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:34.654112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0da59e3a-a3dd-4520-940b-a85a06110ff6 req-8d19e429-1b2c-43ec-9050-0af26ca56e35 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:34.655863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0da59e3a-a3dd-4520-940b-a85a06110ff6 req-8d19e429-1b2c-43ec-9050-0af26ca56e35 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:34.703524 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-0da59e3a-a3dd-4520-940b-a85a06110ff6 req-8d19e429-1b2c-43ec-9050-0af26ca56e35 service nova] Creating event network-changed:3926ef9d-fd08-4b96-852a-893474ad1ff2 for instance 2666d044-c9dc-484d-939f-7bdf780731ea on n-h2-850468-16 Aug 23 18:19:34.723612 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-0da59e3a-a3dd-4520-940b-a85a06110ff6 req-8d19e429-1b2c-43ec-9050-0af26ca56e35 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.602162 Aug 23 18:19:34.728532 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2680/5485] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:34.914841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5fe5100f-f249-4a1f-a36c-5f52e2bf912c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:34.916745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5fe5100f-f249-4a1f-a36c-5f52e2bf912c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:34.942232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fe5100f-f249-4a1f-a36c-5f52e2bf912c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:34.946442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fe5100f-f249-4a1f-a36c-5f52e2bf912c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:34.948903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fe5100f-f249-4a1f-a36c-5f52e2bf912c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:34.953224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fe5100f-f249-4a1f-a36c-5f52e2bf912c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:34.956615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fe5100f-f249-4a1f-a36c-5f52e2bf912c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:34.957607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fe5100f-f249-4a1f-a36c-5f52e2bf912c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:35.356410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-54b3e285-d2b6-4bbd-b5f8-49ebe0e4b746 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:35.357882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-54b3e285-d2b6-4bbd-b5f8-49ebe0e4b746 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:35.386972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54b3e285-d2b6-4bbd-b5f8-49ebe0e4b746 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:35.394521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54b3e285-d2b6-4bbd-b5f8-49ebe0e4b746 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:35.397137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54b3e285-d2b6-4bbd-b5f8-49ebe0e4b746 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:35.404600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5fe5100f-f249-4a1f-a36c-5f52e2bf912c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:35.408795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54b3e285-d2b6-4bbd-b5f8-49ebe0e4b746 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:35.408795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54b3e285-d2b6-4bbd-b5f8-49ebe0e4b746 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:35.408795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54b3e285-d2b6-4bbd-b5f8-49ebe0e4b746 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:35.412757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=76 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:35.424222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5fe5100f-f249-4a1f-a36c-5f52e2bf912c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:35.428094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5fe5100f-f249-4a1f-a36c-5f52e2bf912c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:35.433716 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5fe5100f-f249-4a1f-a36c-5f52e2bf912c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.520501 Aug 23 18:19:35.436804 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2806/5486] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:34 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:36.161458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-54b3e285-d2b6-4bbd-b5f8-49ebe0e4b746 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:36.182890 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-54b3e285-d2b6-4bbd-b5f8-49ebe0e4b746 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1366 microversion: 2.1 time: 0.830273 Aug 23 18:19:36.184130 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2681/5487] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:35 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1366 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:19:36.460408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a212a720-8b06-442f-bebe-74e0ab008c80 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:36.462080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a212a720-8b06-442f-bebe-74e0ab008c80 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:36.488121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a212a720-8b06-442f-bebe-74e0ab008c80 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:36.489611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a212a720-8b06-442f-bebe-74e0ab008c80 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:36.493008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a212a720-8b06-442f-bebe-74e0ab008c80 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:36.494046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a212a720-8b06-442f-bebe-74e0ab008c80 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:36.494858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a212a720-8b06-442f-bebe-74e0ab008c80 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:36.495472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a212a720-8b06-442f-bebe-74e0ab008c80 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:36.917619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a212a720-8b06-442f-bebe-74e0ab008c80 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:36.934662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a212a720-8b06-442f-bebe-74e0ab008c80 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:36.936589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a212a720-8b06-442f-bebe-74e0ab008c80 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:36.937833 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a212a720-8b06-442f-bebe-74e0ab008c80 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.483595 Aug 23 18:19:36.938412 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2807/5488] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:36 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:37.207175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81adb84e-274e-4906-b5cc-ef55c50f8e6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:37.209344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-81adb84e-274e-4906-b5cc-ef55c50f8e6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:37.226879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81adb84e-274e-4906-b5cc-ef55c50f8e6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:37.231912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81adb84e-274e-4906-b5cc-ef55c50f8e6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:37.232732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81adb84e-274e-4906-b5cc-ef55c50f8e6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:37.235977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81adb84e-274e-4906-b5cc-ef55c50f8e6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:37.238304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81adb84e-274e-4906-b5cc-ef55c50f8e6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:37.242256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81adb84e-274e-4906-b5cc-ef55c50f8e6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:38.213214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:38.240197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=10 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:38.355749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ad31ba55-740a-4315-9d44-ba67083b83b1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:38.356265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ad31ba55-740a-4315-9d44-ba67083b83b1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:38.379439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad31ba55-740a-4315-9d44-ba67083b83b1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:38.402858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad31ba55-740a-4315-9d44-ba67083b83b1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:38.403801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad31ba55-740a-4315-9d44-ba67083b83b1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:38.404889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad31ba55-740a-4315-9d44-ba67083b83b1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:38.405586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad31ba55-740a-4315-9d44-ba67083b83b1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:38.407054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad31ba55-740a-4315-9d44-ba67083b83b1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:38.414894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:38.431189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81adb84e-274e-4906-b5cc-ef55c50f8e6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:38.449625 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81adb84e-274e-4906-b5cc-ef55c50f8e6c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1366 microversion: 2.1 time: 1.247077 Aug 23 18:19:38.468234 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2682/5489] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:37 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1366 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:38.479867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ee75575-5fee-4178-8781-4bc922047981 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:38.495398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1ee75575-5fee-4178-8781-4bc922047981 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:38.506903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=36 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:38.532780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ee75575-5fee-4178-8781-4bc922047981 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:38.538062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ee75575-5fee-4178-8781-4bc922047981 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:38.539744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ee75575-5fee-4178-8781-4bc922047981 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:38.541885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ee75575-5fee-4178-8781-4bc922047981 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:38.544316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ee75575-5fee-4178-8781-4bc922047981 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:38.545211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ee75575-5fee-4178-8781-4bc922047981 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:38.558245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ad31ba55-740a-4315-9d44-ba67083b83b1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:19:38.849616 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ad31ba55-740a-4315-9d44-ba67083b83b1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "DELETE /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 204 len: 0 microversion: 2.42 time: 1.149091 Aug 23 18:19:38.850734 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2808/5490] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:19:37 2022] DELETE /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 0 bytes in 1151 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:19:38.860492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-989f0434-e9e1-4bfa-92a4-edf79204357f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:38.862522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-989f0434-e9e1-4bfa-92a4-edf79204357f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:38.873898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-989f0434-e9e1-4bfa-92a4-edf79204357f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:38.881497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-989f0434-e9e1-4bfa-92a4-edf79204357f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:38.882013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-989f0434-e9e1-4bfa-92a4-edf79204357f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:38.886637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-989f0434-e9e1-4bfa-92a4-edf79204357f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:38.887114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-989f0434-e9e1-4bfa-92a4-edf79204357f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:38.887608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-989f0434-e9e1-4bfa-92a4-edf79204357f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:39.276744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1ee75575-5fee-4178-8781-4bc922047981 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:39.288592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1ee75575-5fee-4178-8781-4bc922047981 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:39.290398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1ee75575-5fee-4178-8781-4bc922047981 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:39.292066 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1ee75575-5fee-4178-8781-4bc922047981 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.822613 Aug 23 18:19:39.303702 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2683/5491] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:38 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:39.433982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-989f0434-e9e1-4bfa-92a4-edf79204357f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:39.461573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-989f0434-e9e1-4bfa-92a4-edf79204357f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:39.464622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-989f0434-e9e1-4bfa-92a4-edf79204357f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:39.467032 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-989f0434-e9e1-4bfa-92a4-edf79204357f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 2961 microversion: 2.42 time: 0.611773 Aug 23 18:19:39.469007 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2809/5492] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:38 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 2961 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:39.483314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3672dc65-69d1-4471-a460-1ebf440afab4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:39.487209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3672dc65-69d1-4471-a460-1ebf440afab4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:39.494749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3672dc65-69d1-4471-a460-1ebf440afab4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:39.495622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3672dc65-69d1-4471-a460-1ebf440afab4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:39.496470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3672dc65-69d1-4471-a460-1ebf440afab4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:39.497433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3672dc65-69d1-4471-a460-1ebf440afab4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:39.498371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3672dc65-69d1-4471-a460-1ebf440afab4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:39.499027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3672dc65-69d1-4471-a460-1ebf440afab4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:40.103564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3672dc65-69d1-4471-a460-1ebf440afab4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:40.113587 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3672dc65-69d1-4471-a460-1ebf440afab4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1366 microversion: 2.1 time: 0.641306 Aug 23 18:19:40.114169 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2684/5493] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:39 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1366 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:40.321638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d91ba382-604a-4c2a-ab3c-906c90d71ea0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:40.322578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d91ba382-604a-4c2a-ab3c-906c90d71ea0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:40.330939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d91ba382-604a-4c2a-ab3c-906c90d71ea0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:40.331811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d91ba382-604a-4c2a-ab3c-906c90d71ea0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:40.333365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d91ba382-604a-4c2a-ab3c-906c90d71ea0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:40.335563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d91ba382-604a-4c2a-ab3c-906c90d71ea0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:40.336120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d91ba382-604a-4c2a-ab3c-906c90d71ea0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:40.343612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d91ba382-604a-4c2a-ab3c-906c90d71ea0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:40.513134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81dbb3fa-219a-4003-a57f-912448def903 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:40.513823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-81dbb3fa-219a-4003-a57f-912448def903 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:40.522023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbb3fa-219a-4003-a57f-912448def903 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:40.522514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbb3fa-219a-4003-a57f-912448def903 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:40.531181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbb3fa-219a-4003-a57f-912448def903 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:40.531945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbb3fa-219a-4003-a57f-912448def903 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:40.532416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbb3fa-219a-4003-a57f-912448def903 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:40.532844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81dbb3fa-219a-4003-a57f-912448def903 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:40.638651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d91ba382-604a-4c2a-ab3c-906c90d71ea0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:40.655862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d91ba382-604a-4c2a-ab3c-906c90d71ea0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:40.661269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d91ba382-604a-4c2a-ab3c-906c90d71ea0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:40.680869 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d91ba382-604a-4c2a-ab3c-906c90d71ea0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.350438 Aug 23 18:19:40.698689 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2810/5494] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:40 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:41.075772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81dbb3fa-219a-4003-a57f-912448def903 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:41.088510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81dbb3fa-219a-4003-a57f-912448def903 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:41.095146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81dbb3fa-219a-4003-a57f-912448def903 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:41.096916 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81dbb3fa-219a-4003-a57f-912448def903 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 2961 microversion: 2.42 time: 0.587846 Aug 23 18:19:41.097669 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2685/5495] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:40 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 2961 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:19:41.144244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6eed990-bdc4-4560-b18d-affb508ccb5c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:41.145470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6eed990-bdc4-4560-b18d-affb508ccb5c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:41.155196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6eed990-bdc4-4560-b18d-affb508ccb5c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:41.155708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6eed990-bdc4-4560-b18d-affb508ccb5c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:41.156157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6eed990-bdc4-4560-b18d-affb508ccb5c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:41.157433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6eed990-bdc4-4560-b18d-affb508ccb5c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:41.158260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6eed990-bdc4-4560-b18d-affb508ccb5c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:41.159154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6eed990-bdc4-4560-b18d-affb508ccb5c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:41.264275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-3d18564f-7c49-406d-9367-488167fdf7fb req-d561fc3f-e424-46a8-8bea-177f9139af1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2666d044-c9dc-484d-939f-7bdf780731ea", "name": "network-vif-plugged", "status": "completed", "tag": "3926ef9d-fd08-4b96-852a-893474ad1ff2"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:41.291468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3d18564f-7c49-406d-9367-488167fdf7fb req-d561fc3f-e424-46a8-8bea-177f9139af1b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:41.293673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3d18564f-7c49-406d-9367-488167fdf7fb req-d561fc3f-e424-46a8-8bea-177f9139af1b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:41.294366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3d18564f-7c49-406d-9367-488167fdf7fb req-d561fc3f-e424-46a8-8bea-177f9139af1b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:41.321618 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-3d18564f-7c49-406d-9367-488167fdf7fb req-d561fc3f-e424-46a8-8bea-177f9139af1b service nova] Creating event network-vif-plugged:3926ef9d-fd08-4b96-852a-893474ad1ff2 for instance 2666d044-c9dc-484d-939f-7bdf780731ea on n-h2-850468-16 Aug 23 18:19:41.344612 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-3d18564f-7c49-406d-9367-488167fdf7fb req-d561fc3f-e424-46a8-8bea-177f9139af1b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084738 Aug 23 18:19:41.346378 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2686/5496] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:41.436828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b6eed990-bdc4-4560-b18d-affb508ccb5c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:41.452516 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6eed990-bdc4-4560-b18d-affb508ccb5c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1366 microversion: 2.1 time: 0.314858 Aug 23 18:19:41.460036 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2811/5497] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:41 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1366 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:41.711414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-272872e3-ddc1-4396-b0a6-c0815f8f3a79 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:41.712138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-272872e3-ddc1-4396-b0a6-c0815f8f3a79 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:41.727358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-272872e3-ddc1-4396-b0a6-c0815f8f3a79 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:41.727886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-272872e3-ddc1-4396-b0a6-c0815f8f3a79 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:41.728340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-272872e3-ddc1-4396-b0a6-c0815f8f3a79 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:41.729085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-272872e3-ddc1-4396-b0a6-c0815f8f3a79 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:41.729552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-272872e3-ddc1-4396-b0a6-c0815f8f3a79 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:41.729987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-272872e3-ddc1-4396-b0a6-c0815f8f3a79 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:42.033236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-272872e3-ddc1-4396-b0a6-c0815f8f3a79 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:42.063913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-272872e3-ddc1-4396-b0a6-c0815f8f3a79 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:42.066584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-272872e3-ddc1-4396-b0a6-c0815f8f3a79 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:42.068088 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-272872e3-ddc1-4396-b0a6-c0815f8f3a79 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.362253 Aug 23 18:19:42.083438 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2687/5498] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:41 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:42.125795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6574fdfa-7631-4c47-8c21-0ac1ad57504e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:42.126584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6574fdfa-7631-4c47-8c21-0ac1ad57504e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:42.143325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6574fdfa-7631-4c47-8c21-0ac1ad57504e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:42.144392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6574fdfa-7631-4c47-8c21-0ac1ad57504e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:42.146080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6574fdfa-7631-4c47-8c21-0ac1ad57504e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:42.147492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6574fdfa-7631-4c47-8c21-0ac1ad57504e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:42.148593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6574fdfa-7631-4c47-8c21-0ac1ad57504e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:42.149496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6574fdfa-7631-4c47-8c21-0ac1ad57504e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:42.480033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d14ddbdd-9fa7-4f4c-9302-259769ab5c07 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:42.481040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d14ddbdd-9fa7-4f4c-9302-259769ab5c07 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:42.489719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d14ddbdd-9fa7-4f4c-9302-259769ab5c07 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:42.497280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d14ddbdd-9fa7-4f4c-9302-259769ab5c07 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:42.498195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d14ddbdd-9fa7-4f4c-9302-259769ab5c07 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:42.499183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d14ddbdd-9fa7-4f4c-9302-259769ab5c07 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:42.499867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d14ddbdd-9fa7-4f4c-9302-259769ab5c07 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:42.500503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d14ddbdd-9fa7-4f4c-9302-259769ab5c07 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:42.834310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6574fdfa-7631-4c47-8c21-0ac1ad57504e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:42.873909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6574fdfa-7631-4c47-8c21-0ac1ad57504e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:42.877881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6574fdfa-7631-4c47-8c21-0ac1ad57504e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:42.880494 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6574fdfa-7631-4c47-8c21-0ac1ad57504e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 2961 microversion: 2.42 time: 0.758982 Aug 23 18:19:42.905699 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2812/5499] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:42 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 2961 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:42.969064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d14ddbdd-9fa7-4f4c-9302-259769ab5c07 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:42.986969 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d14ddbdd-9fa7-4f4c-9302-259769ab5c07 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1366 microversion: 2.1 time: 0.511470 Aug 23 18:19:43.004063 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2688/5500] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:42 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1366 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:43.094853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-364029f5-d73f-4bd4-8dd4-03917d9d2e0e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:43.095501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-364029f5-d73f-4bd4-8dd4-03917d9d2e0e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:43.108382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:43.115423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-364029f5-d73f-4bd4-8dd4-03917d9d2e0e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:43.115514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-364029f5-d73f-4bd4-8dd4-03917d9d2e0e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:43.115910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-364029f5-d73f-4bd4-8dd4-03917d9d2e0e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:43.116648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-364029f5-d73f-4bd4-8dd4-03917d9d2e0e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:43.117116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-364029f5-d73f-4bd4-8dd4-03917d9d2e0e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:43.124498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-364029f5-d73f-4bd4-8dd4-03917d9d2e0e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:43.916384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a6be32bb-d7a1-4b32-a8ea-99e014cffca1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:43.917018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a6be32bb-d7a1-4b32-a8ea-99e014cffca1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:43.935932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6be32bb-d7a1-4b32-a8ea-99e014cffca1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:43.936696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6be32bb-d7a1-4b32-a8ea-99e014cffca1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:43.937318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6be32bb-d7a1-4b32-a8ea-99e014cffca1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:43.938196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6be32bb-d7a1-4b32-a8ea-99e014cffca1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:43.940142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6be32bb-d7a1-4b32-a8ea-99e014cffca1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:43.941911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6be32bb-d7a1-4b32-a8ea-99e014cffca1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:43.998584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-364029f5-d73f-4bd4-8dd4-03917d9d2e0e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:44.008636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-364029f5-d73f-4bd4-8dd4-03917d9d2e0e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:44.010267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-364029f5-d73f-4bd4-8dd4-03917d9d2e0e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:44.011492 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-364029f5-d73f-4bd4-8dd4-03917d9d2e0e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.922272 Aug 23 18:19:44.012058 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2813/5501] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:43 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:44.033676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-82307803-44b8-4c83-a6a9-43234cfd3ee8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:44.034880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-82307803-44b8-4c83-a6a9-43234cfd3ee8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:44.051890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82307803-44b8-4c83-a6a9-43234cfd3ee8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:44.052634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82307803-44b8-4c83-a6a9-43234cfd3ee8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:44.053829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82307803-44b8-4c83-a6a9-43234cfd3ee8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:44.054776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82307803-44b8-4c83-a6a9-43234cfd3ee8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:44.055396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82307803-44b8-4c83-a6a9-43234cfd3ee8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:44.056144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82307803-44b8-4c83-a6a9-43234cfd3ee8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:44.400486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-82307803-44b8-4c83-a6a9-43234cfd3ee8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:44.421876 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-82307803-44b8-4c83-a6a9-43234cfd3ee8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1557 microversion: 2.1 time: 0.408349 Aug 23 18:19:44.424055 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2814/5502] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:44 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1557 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:44.446190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f8136514-1e1f-486f-85a4-a9dc3d625672 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:44.447729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f8136514-1e1f-486f-85a4-a9dc3d625672 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:44.473064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8136514-1e1f-486f-85a4-a9dc3d625672 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:44.475062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8136514-1e1f-486f-85a4-a9dc3d625672 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:44.476651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8136514-1e1f-486f-85a4-a9dc3d625672 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:44.478793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8136514-1e1f-486f-85a4-a9dc3d625672 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:44.479573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8136514-1e1f-486f-85a4-a9dc3d625672 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:44.480400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8136514-1e1f-486f-85a4-a9dc3d625672 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:44.649883 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f8136514-1e1f-486f-85a4-a9dc3d625672 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.209646 Aug 23 18:19:44.660451 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2815/5503] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:19:44 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea/os-interface => generated 285 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:45.034720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a816c87c-8ce6-4b1e-99ed-b0cfde47edec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:45.036259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a816c87c-8ce6-4b1e-99ed-b0cfde47edec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:45.052625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a816c87c-8ce6-4b1e-99ed-b0cfde47edec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:45.053493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a816c87c-8ce6-4b1e-99ed-b0cfde47edec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:45.054153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a816c87c-8ce6-4b1e-99ed-b0cfde47edec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:45.055255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a816c87c-8ce6-4b1e-99ed-b0cfde47edec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:45.055927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a816c87c-8ce6-4b1e-99ed-b0cfde47edec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:45.056533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a816c87c-8ce6-4b1e-99ed-b0cfde47edec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:45.301927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a6be32bb-d7a1-4b32-a8ea-99e014cffca1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:45.321092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a6be32bb-d7a1-4b32-a8ea-99e014cffca1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:45.324557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a6be32bb-d7a1-4b32-a8ea-99e014cffca1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:45.326324 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a6be32bb-d7a1-4b32-a8ea-99e014cffca1 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 2961 microversion: 2.42 time: 1.416745 Aug 23 18:19:45.342584 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2689/5504] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:43 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 2961 bytes in 1419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:45.353117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-c1ef0453-034e-41d6-be19-43e8ee5d3d30 req-c1a7a65a-768e-41dd-9815-00f0c22113b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-unplugged", "status": "completed", "tag": "7044c5c8-0b1d-4f05-bb0b-77bde6537776"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:45.384422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c1ef0453-034e-41d6-be19-43e8ee5d3d30 req-c1a7a65a-768e-41dd-9815-00f0c22113b5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:45.384928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c1ef0453-034e-41d6-be19-43e8ee5d3d30 req-c1a7a65a-768e-41dd-9815-00f0c22113b5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:45.386561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c1ef0453-034e-41d6-be19-43e8ee5d3d30 req-c1a7a65a-768e-41dd-9815-00f0c22113b5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:45.427565 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-c1ef0453-034e-41d6-be19-43e8ee5d3d30 req-c1a7a65a-768e-41dd-9815-00f0c22113b5 service nova] Creating event network-vif-unplugged:7044c5c8-0b1d-4f05-bb0b-77bde6537776 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:19:45.445821 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-c1ef0453-034e-41d6-be19-43e8ee5d3d30 req-c1a7a65a-768e-41dd-9815-00f0c22113b5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.116966 Aug 23 18:19:45.447232 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2690/5505] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:45.692256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a74793e5-cab6-4dfa-9bdb-540d3726c4e6 tempest-PortsAdminExtendedAttrsTestJSON-1132036451 tempest-PortsAdminExtendedAttrsTestJSON-1132036451-project-admin] Calling method '.version_select at 0x7f27dfa8f940>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:45.693218 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-hypervisors:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:19:45.693218 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:19:45.694410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a74793e5-cab6-4dfa-9bdb-540d3726c4e6 tempest-PortsAdminExtendedAttrsTestJSON-1132036451 tempest-PortsAdminExtendedAttrsTestJSON-1132036451-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:45.694946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a74793e5-cab6-4dfa-9bdb-540d3726c4e6 tempest-PortsAdminExtendedAttrsTestJSON-1132036451 tempest-PortsAdminExtendedAttrsTestJSON-1132036451-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:45.707053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a74793e5-cab6-4dfa-9bdb-540d3726c4e6 tempest-PortsAdminExtendedAttrsTestJSON-1132036451 tempest-PortsAdminExtendedAttrsTestJSON-1132036451-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:45.732874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a74793e5-cab6-4dfa-9bdb-540d3726c4e6 tempest-PortsAdminExtendedAttrsTestJSON-1132036451 tempest-PortsAdminExtendedAttrsTestJSON-1132036451-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:45.733387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a74793e5-cab6-4dfa-9bdb-540d3726c4e6 tempest-PortsAdminExtendedAttrsTestJSON-1132036451 tempest-PortsAdminExtendedAttrsTestJSON-1132036451-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:45.733840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a74793e5-cab6-4dfa-9bdb-540d3726c4e6 tempest-PortsAdminExtendedAttrsTestJSON-1132036451 tempest-PortsAdminExtendedAttrsTestJSON-1132036451-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:45.765348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a74793e5-cab6-4dfa-9bdb-540d3726c4e6 tempest-PortsAdminExtendedAttrsTestJSON-1132036451 tempest-PortsAdminExtendedAttrsTestJSON-1132036451-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:45.765843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a74793e5-cab6-4dfa-9bdb-540d3726c4e6 tempest-PortsAdminExtendedAttrsTestJSON-1132036451 tempest-PortsAdminExtendedAttrsTestJSON-1132036451-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:45.766297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a74793e5-cab6-4dfa-9bdb-540d3726c4e6 tempest-PortsAdminExtendedAttrsTestJSON-1132036451 tempest-PortsAdminExtendedAttrsTestJSON-1132036451-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:45.787155 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a74793e5-cab6-4dfa-9bdb-540d3726c4e6 tempest-PortsAdminExtendedAttrsTestJSON-1132036451 tempest-PortsAdminExtendedAttrsTestJSON-1132036451-project-admin] 10.222.0.61 "GET /compute/v2.1/os-hypervisors" status: 200 len: 193 microversion: 2.1 time: 0.291554 Aug 23 18:19:45.788482 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2691/5506] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 18:19:45 2022] GET /compute/v2.1/os-hypervisors => generated 193 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:46.346659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a816c87c-8ce6-4b1e-99ed-b0cfde47edec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:46.358403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a816c87c-8ce6-4b1e-99ed-b0cfde47edec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:46.359965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a816c87c-8ce6-4b1e-99ed-b0cfde47edec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:46.361737 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a816c87c-8ce6-4b1e-99ed-b0cfde47edec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 1.330359 Aug 23 18:19:46.365040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-408e94be-f3d9-481b-af75-9265316c7e06 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:46.366240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-408e94be-f3d9-481b-af75-9265316c7e06 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:46.393122 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2816/5507] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:45 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 1352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:46.408904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-408e94be-f3d9-481b-af75-9265316c7e06 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:46.413683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-408e94be-f3d9-481b-af75-9265316c7e06 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:46.414465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-408e94be-f3d9-481b-af75-9265316c7e06 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:46.415383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-408e94be-f3d9-481b-af75-9265316c7e06 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:46.415998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-408e94be-f3d9-481b-af75-9265316c7e06 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:46.417164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-408e94be-f3d9-481b-af75-9265316c7e06 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:47.412552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5358c85b-2d08-40a9-830e-e009376d1d5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:47.413198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5358c85b-2d08-40a9-830e-e009376d1d5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:47.423353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5358c85b-2d08-40a9-830e-e009376d1d5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:47.423874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5358c85b-2d08-40a9-830e-e009376d1d5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:47.424468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5358c85b-2d08-40a9-830e-e009376d1d5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:47.425025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5358c85b-2d08-40a9-830e-e009376d1d5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:47.425485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5358c85b-2d08-40a9-830e-e009376d1d5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:47.425916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5358c85b-2d08-40a9-830e-e009376d1d5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:47.830344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5358c85b-2d08-40a9-830e-e009376d1d5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:47.841780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5358c85b-2d08-40a9-830e-e009376d1d5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:47.853340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5358c85b-2d08-40a9-830e-e009376d1d5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:47.854828 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5358c85b-2d08-40a9-830e-e009376d1d5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.451937 Aug 23 18:19:47.862647 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2817/5508] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:47 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:47.862647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-10116fe1-c7c0-4a45-a826-8deecef7ff48 req-58506b33-f57d-47ad-858b-877a535877c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-unplugged", "status": "completed", "tag": "3e0b7dcf-3e88-405c-abd5-d6403cd681d8"}, {"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-unplugged", "status": "completed", "tag": "efc446c9-5ccd-4541-9891-7415a79be535"}, {"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-unplugged", "status": "completed", "tag": "984fbe3f-942d-428e-b69a-4f736cedf9e1"}, {"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-unplugged", "status": "completed", "tag": "da6de964-c367-4565-80ba-9058c4151df9"}, {"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-unplugged", "status": "completed", "tag": "1748595a-c8aa-4422-ab33-d3f8d2ec00d2"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:47.895678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-10116fe1-c7c0-4a45-a826-8deecef7ff48 req-58506b33-f57d-47ad-858b-877a535877c5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:47.896171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-10116fe1-c7c0-4a45-a826-8deecef7ff48 req-58506b33-f57d-47ad-858b-877a535877c5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:47.896615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-10116fe1-c7c0-4a45-a826-8deecef7ff48 req-58506b33-f57d-47ad-858b-877a535877c5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:47.916951 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-10116fe1-c7c0-4a45-a826-8deecef7ff48 req-58506b33-f57d-47ad-858b-877a535877c5 service nova] Creating event network-vif-unplugged:3e0b7dcf-3e88-405c-abd5-d6403cd681d8 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:19:47.917475 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-10116fe1-c7c0-4a45-a826-8deecef7ff48 req-58506b33-f57d-47ad-858b-877a535877c5 service nova] Creating event network-vif-unplugged:efc446c9-5ccd-4541-9891-7415a79be535 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:19:47.918257 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-10116fe1-c7c0-4a45-a826-8deecef7ff48 req-58506b33-f57d-47ad-858b-877a535877c5 service nova] Creating event network-vif-unplugged:984fbe3f-942d-428e-b69a-4f736cedf9e1 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:19:47.918797 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-10116fe1-c7c0-4a45-a826-8deecef7ff48 req-58506b33-f57d-47ad-858b-877a535877c5 service nova] Creating event network-vif-unplugged:da6de964-c367-4565-80ba-9058c4151df9 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:19:47.919304 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-10116fe1-c7c0-4a45-a826-8deecef7ff48 req-58506b33-f57d-47ad-858b-877a535877c5 service nova] Creating event network-vif-unplugged:1748595a-c8aa-4422-ab33-d3f8d2ec00d2 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:19:47.936237 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-10116fe1-c7c0-4a45-a826-8deecef7ff48 req-58506b33-f57d-47ad-858b-877a535877c5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 877 microversion: 2.1 time: 0.079196 Aug 23 18:19:47.937175 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2818/5509] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 877 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:48.005877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-321a7864-0b21-48b2-9d2d-284f13cc0f2c req-47c5128b-8061-4bc7-bcb2-4ef6f1b87de4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2666d044-c9dc-484d-939f-7bdf780731ea", "tag": "3926ef9d-fd08-4b96-852a-893474ad1ff2"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:48.023941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-321a7864-0b21-48b2-9d2d-284f13cc0f2c req-47c5128b-8061-4bc7-bcb2-4ef6f1b87de4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:48.024442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-321a7864-0b21-48b2-9d2d-284f13cc0f2c req-47c5128b-8061-4bc7-bcb2-4ef6f1b87de4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:48.024892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-321a7864-0b21-48b2-9d2d-284f13cc0f2c req-47c5128b-8061-4bc7-bcb2-4ef6f1b87de4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:48.040666 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-321a7864-0b21-48b2-9d2d-284f13cc0f2c req-47c5128b-8061-4bc7-bcb2-4ef6f1b87de4 service nova] Creating event network-changed:3926ef9d-fd08-4b96-852a-893474ad1ff2 for instance 2666d044-c9dc-484d-939f-7bdf780731ea on n-h2-850468-16 Aug 23 18:19:48.052443 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-321a7864-0b21-48b2-9d2d-284f13cc0f2c req-47c5128b-8061-4bc7-bcb2-4ef6f1b87de4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051074 Aug 23 18:19:48.059489 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2819/5510] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:19:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:19:48.895341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2aee8a7c-ceb5-4af4-935f-b86f9701ee71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:48.896941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2aee8a7c-ceb5-4af4-935f-b86f9701ee71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:48.916403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aee8a7c-ceb5-4af4-935f-b86f9701ee71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:48.933492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aee8a7c-ceb5-4af4-935f-b86f9701ee71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:48.934202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aee8a7c-ceb5-4af4-935f-b86f9701ee71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:48.943953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aee8a7c-ceb5-4af4-935f-b86f9701ee71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:48.951016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aee8a7c-ceb5-4af4-935f-b86f9701ee71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:48.951660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aee8a7c-ceb5-4af4-935f-b86f9701ee71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:49.085151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-408e94be-f3d9-481b-af75-9265316c7e06 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:49.115330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-408e94be-f3d9-481b-af75-9265316c7e06 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:49.123989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-408e94be-f3d9-481b-af75-9265316c7e06 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:49.125590 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-408e94be-f3d9-481b-af75-9265316c7e06 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 2940 microversion: 2.42 time: 2.771515 Aug 23 18:19:49.146702 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2692/5511] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:46 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 2940 bytes in 2793 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:49.462434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2aee8a7c-ceb5-4af4-935f-b86f9701ee71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:49.491261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2aee8a7c-ceb5-4af4-935f-b86f9701ee71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:49.496039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2aee8a7c-ceb5-4af4-935f-b86f9701ee71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:49.501418 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2aee8a7c-ceb5-4af4-935f-b86f9701ee71 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.615591 Aug 23 18:19:49.503722 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2820/5512] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:48 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:19:50.152849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e46b8880-a0d7-4c17-b075-d02774410d6b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:50.153987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e46b8880-a0d7-4c17-b075-d02774410d6b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:50.168252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e46b8880-a0d7-4c17-b075-d02774410d6b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:50.172656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e46b8880-a0d7-4c17-b075-d02774410d6b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:50.173317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e46b8880-a0d7-4c17-b075-d02774410d6b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:50.175304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e46b8880-a0d7-4c17-b075-d02774410d6b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:50.180645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e46b8880-a0d7-4c17-b075-d02774410d6b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:50.181258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e46b8880-a0d7-4c17-b075-d02774410d6b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:50.226996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:50.532667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-336208b8-d28a-4633-86e6-15219434b6d1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:50.535104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-336208b8-d28a-4633-86e6-15219434b6d1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:50.576854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336208b8-d28a-4633-86e6-15219434b6d1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:50.577731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336208b8-d28a-4633-86e6-15219434b6d1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:50.578203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336208b8-d28a-4633-86e6-15219434b6d1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:50.578994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336208b8-d28a-4633-86e6-15219434b6d1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:50.584194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336208b8-d28a-4633-86e6-15219434b6d1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:50.584793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336208b8-d28a-4633-86e6-15219434b6d1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:50.847751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e46b8880-a0d7-4c17-b075-d02774410d6b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:50.868108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e46b8880-a0d7-4c17-b075-d02774410d6b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:50.874257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e46b8880-a0d7-4c17-b075-d02774410d6b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:50.875660 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e46b8880-a0d7-4c17-b075-d02774410d6b tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 2919 microversion: 2.42 time: 0.727176 Aug 23 18:19:50.898290 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2693/5513] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:50 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 2919 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:51.022681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-336208b8-d28a-4633-86e6-15219434b6d1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:51.039473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-336208b8-d28a-4633-86e6-15219434b6d1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:51.046242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-336208b8-d28a-4633-86e6-15219434b6d1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:51.047434 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-336208b8-d28a-4633-86e6-15219434b6d1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.523582 Aug 23 18:19:51.048055 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2821/5514] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:50 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:19:51.411747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-52899e17-2b12-492f-b590-28c5b822c3d4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:51.413481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-52899e17-2b12-492f-b590-28c5b822c3d4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:51.431243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52899e17-2b12-492f-b590-28c5b822c3d4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:51.431788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52899e17-2b12-492f-b590-28c5b822c3d4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:51.432353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52899e17-2b12-492f-b590-28c5b822c3d4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:51.433249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52899e17-2b12-492f-b590-28c5b822c3d4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:51.435329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52899e17-2b12-492f-b590-28c5b822c3d4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:51.440693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52899e17-2b12-492f-b590-28c5b822c3d4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:51.515449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-52899e17-2b12-492f-b590-28c5b822c3d4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:19:51.693758 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-52899e17-2b12-492f-b590-28c5b822c3d4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "DELETE /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 204 len: 0 microversion: 2.1 time: 0.287057 Aug 23 18:19:51.695234 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2694/5515] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:19:51 2022] DELETE /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:19:51.703751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-881de581-a5b4-4568-9181-53d7405c6208 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:51.705621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-881de581-a5b4-4568-9181-53d7405c6208 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:51.728371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-881de581-a5b4-4568-9181-53d7405c6208 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:51.729776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-881de581-a5b4-4568-9181-53d7405c6208 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:51.731936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-881de581-a5b4-4568-9181-53d7405c6208 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:51.733445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-881de581-a5b4-4568-9181-53d7405c6208 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:51.738633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-881de581-a5b4-4568-9181-53d7405c6208 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:51.739317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-881de581-a5b4-4568-9181-53d7405c6208 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:51.906957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c43d6ef7-f4e3-426a-99af-528c5e3b8e2f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:51.907751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c43d6ef7-f4e3-426a-99af-528c5e3b8e2f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:51.928612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c43d6ef7-f4e3-426a-99af-528c5e3b8e2f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:51.929212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c43d6ef7-f4e3-426a-99af-528c5e3b8e2f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:51.933098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c43d6ef7-f4e3-426a-99af-528c5e3b8e2f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:51.935020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c43d6ef7-f4e3-426a-99af-528c5e3b8e2f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:51.936966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c43d6ef7-f4e3-426a-99af-528c5e3b8e2f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:51.937874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c43d6ef7-f4e3-426a-99af-528c5e3b8e2f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:52.188023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-881de581-a5b4-4568-9181-53d7405c6208 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:52.212279 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-881de581-a5b4-4568-9181-53d7405c6208 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1554 microversion: 2.1 time: 0.512200 Aug 23 18:19:52.216733 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2822/5516] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:51 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1554 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:52.231178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f62101bf-3c4e-46f3-9264-72b0176d9603 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:52.231820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f62101bf-3c4e-46f3-9264-72b0176d9603 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:52.254413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f62101bf-3c4e-46f3-9264-72b0176d9603 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:52.255114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f62101bf-3c4e-46f3-9264-72b0176d9603 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:52.255569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f62101bf-3c4e-46f3-9264-72b0176d9603 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:52.262896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f62101bf-3c4e-46f3-9264-72b0176d9603 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:52.263399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f62101bf-3c4e-46f3-9264-72b0176d9603 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:52.263862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f62101bf-3c4e-46f3-9264-72b0176d9603 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:52.312460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:19:52.826861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f62101bf-3c4e-46f3-9264-72b0176d9603 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:52.857327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f62101bf-3c4e-46f3-9264-72b0176d9603 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:52.862202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f62101bf-3c4e-46f3-9264-72b0176d9603 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:52.870941 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f62101bf-3c4e-46f3-9264-72b0176d9603 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.651176 Aug 23 18:19:52.873495 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2823/5517] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:52 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:52.887453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c30a7de0-e498-4053-97a3-cf4547e7390f req-2d2a432b-4554-4509-8782-119cf4154d4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-deleted", "tag": "7044c5c8-0b1d-4f05-bb0b-77bde6537776"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:52.945550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c30a7de0-e498-4053-97a3-cf4547e7390f req-2d2a432b-4554-4509-8782-119cf4154d4e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:52.949254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c30a7de0-e498-4053-97a3-cf4547e7390f req-2d2a432b-4554-4509-8782-119cf4154d4e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:52.951609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c30a7de0-e498-4053-97a3-cf4547e7390f req-2d2a432b-4554-4509-8782-119cf4154d4e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:53.004383 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c30a7de0-e498-4053-97a3-cf4547e7390f req-2d2a432b-4554-4509-8782-119cf4154d4e service nova] Creating event network-vif-deleted:7044c5c8-0b1d-4f05-bb0b-77bde6537776 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:19:53.055307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c43d6ef7-f4e3-426a-99af-528c5e3b8e2f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:53.071251 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c30a7de0-e498-4053-97a3-cf4547e7390f req-2d2a432b-4554-4509-8782-119cf4154d4e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191295 Aug 23 18:19:53.076646 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2824/5518] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:19:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:53.103135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c43d6ef7-f4e3-426a-99af-528c5e3b8e2f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:53.105344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c43d6ef7-f4e3-426a-99af-528c5e3b8e2f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:53.111357 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c43d6ef7-f4e3-426a-99af-528c5e3b8e2f tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 2872 microversion: 2.42 time: 1.208970 Aug 23 18:19:53.116643 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2695/5519] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:51 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 2872 bytes in 1215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:53.238589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-39b9aafb-a5ef-4060-95e6-18ec6e032ee2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:53.239487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-39b9aafb-a5ef-4060-95e6-18ec6e032ee2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:53.255160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39b9aafb-a5ef-4060-95e6-18ec6e032ee2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:53.255898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39b9aafb-a5ef-4060-95e6-18ec6e032ee2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:53.256493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39b9aafb-a5ef-4060-95e6-18ec6e032ee2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:53.257395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39b9aafb-a5ef-4060-95e6-18ec6e032ee2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:53.258005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39b9aafb-a5ef-4060-95e6-18ec6e032ee2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:53.258677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-39b9aafb-a5ef-4060-95e6-18ec6e032ee2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:53.568642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-39b9aafb-a5ef-4060-95e6-18ec6e032ee2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:53.583032 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-39b9aafb-a5ef-4060-95e6-18ec6e032ee2 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1554 microversion: 2.1 time: 0.349211 Aug 23 18:19:53.588413 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2825/5520] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:53 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1554 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:53.897513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0637e7a3-1530-4f2f-8c3c-3eb4649ceb25 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:53.902300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0637e7a3-1530-4f2f-8c3c-3eb4649ceb25 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:53.914037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0637e7a3-1530-4f2f-8c3c-3eb4649ceb25 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:53.914528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0637e7a3-1530-4f2f-8c3c-3eb4649ceb25 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:53.914985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0637e7a3-1530-4f2f-8c3c-3eb4649ceb25 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:53.915971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0637e7a3-1530-4f2f-8c3c-3eb4649ceb25 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:53.916529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0637e7a3-1530-4f2f-8c3c-3eb4649ceb25 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:53.916938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0637e7a3-1530-4f2f-8c3c-3eb4649ceb25 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:54.142386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4e7a0e86-5e36-4732-834e-ee4cd2721db6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:54.144525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4e7a0e86-5e36-4732-834e-ee4cd2721db6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:54.164004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e7a0e86-5e36-4732-834e-ee4cd2721db6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:54.164723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e7a0e86-5e36-4732-834e-ee4cd2721db6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:54.168493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e7a0e86-5e36-4732-834e-ee4cd2721db6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:54.170758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e7a0e86-5e36-4732-834e-ee4cd2721db6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:54.171423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e7a0e86-5e36-4732-834e-ee4cd2721db6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:54.171818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e7a0e86-5e36-4732-834e-ee4cd2721db6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:54.636259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4e7a0e86-5e36-4732-834e-ee4cd2721db6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:54.644209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0637e7a3-1530-4f2f-8c3c-3eb4649ceb25 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:54.653115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0637e7a3-1530-4f2f-8c3c-3eb4649ceb25 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:54.655356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4e7a0e86-5e36-4732-834e-ee4cd2721db6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:54.659251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0637e7a3-1530-4f2f-8c3c-3eb4649ceb25 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:54.664021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4e7a0e86-5e36-4732-834e-ee4cd2721db6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:54.666482 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4e7a0e86-5e36-4732-834e-ee4cd2721db6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 2532 microversion: 2.42 time: 0.529433 Aug 23 18:19:54.666915 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0637e7a3-1530-4f2f-8c3c-3eb4649ceb25 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1740 microversion: 2.20 time: 0.774774 Aug 23 18:19:54.667815 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2826/5521] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:54 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 2532 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:19:54.668076 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2696/5522] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:53 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1740 bytes in 777 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:54.674431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-15ee4d31-d12c-439d-b687-0a44e1d061e1 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:54.675254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-15ee4d31-d12c-439d-b687-0a44e1d061e1 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:54.682201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15ee4d31-d12c-439d-b687-0a44e1d061e1 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:54.682906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15ee4d31-d12c-439d-b687-0a44e1d061e1 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:54.683517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15ee4d31-d12c-439d-b687-0a44e1d061e1 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:54.685140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15ee4d31-d12c-439d-b687-0a44e1d061e1 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:54.685816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15ee4d31-d12c-439d-b687-0a44e1d061e1 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:54.686403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-15ee4d31-d12c-439d-b687-0a44e1d061e1 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:55.137879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-47fd10fa-73b8-464c-b730-8136127186ac req-e2e4a306-a995-43bf-8b2b-b0618c75398d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-deleted", "tag": "da6de964-c367-4565-80ba-9058c4151df9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:55.160957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-47fd10fa-73b8-464c-b730-8136127186ac req-e2e4a306-a995-43bf-8b2b-b0618c75398d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:55.161949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-47fd10fa-73b8-464c-b730-8136127186ac req-e2e4a306-a995-43bf-8b2b-b0618c75398d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:55.162708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-47fd10fa-73b8-464c-b730-8136127186ac req-e2e4a306-a995-43bf-8b2b-b0618c75398d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:55.184900 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-47fd10fa-73b8-464c-b730-8136127186ac req-e2e4a306-a995-43bf-8b2b-b0618c75398d service nova] Creating event network-vif-deleted:da6de964-c367-4565-80ba-9058c4151df9 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:19:55.197783 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-47fd10fa-73b8-464c-b730-8136127186ac req-e2e4a306-a995-43bf-8b2b-b0618c75398d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066508 Aug 23 18:19:55.199335 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2697/5523] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:19:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:55.332094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-15ee4d31-d12c-439d-b687-0a44e1d061e1 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:55.354105 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-15ee4d31-d12c-439d-b687-0a44e1d061e1 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1554 microversion: 2.1 time: 0.684439 Aug 23 18:19:55.355309 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2827/5524] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:54 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1554 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:55.692367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cd678f49-4a82-4066-8164-fdde07032866 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:55.693659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cd678f49-4a82-4066-8164-fdde07032866 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:55.695227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-651d326a-f0c2-467c-b8c7-f7fd786f353a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:55.695857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-651d326a-f0c2-467c-b8c7-f7fd786f353a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:55.703935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd678f49-4a82-4066-8164-fdde07032866 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:55.708760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-651d326a-f0c2-467c-b8c7-f7fd786f353a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:55.709265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-651d326a-f0c2-467c-b8c7-f7fd786f353a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:55.709690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd678f49-4a82-4066-8164-fdde07032866 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:55.710013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-651d326a-f0c2-467c-b8c7-f7fd786f353a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:55.710383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd678f49-4a82-4066-8164-fdde07032866 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:55.711197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd678f49-4a82-4066-8164-fdde07032866 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:55.711426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-651d326a-f0c2-467c-b8c7-f7fd786f353a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:55.711657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd678f49-4a82-4066-8164-fdde07032866 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:55.711978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-651d326a-f0c2-467c-b8c7-f7fd786f353a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:55.712144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd678f49-4a82-4066-8164-fdde07032866 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:55.712419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-651d326a-f0c2-467c-b8c7-f7fd786f353a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:56.150115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cd678f49-4a82-4066-8164-fdde07032866 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:56.166091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cd678f49-4a82-4066-8164-fdde07032866 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:56.168364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cd678f49-4a82-4066-8164-fdde07032866 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:56.169616 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cd678f49-4a82-4066-8164-fdde07032866 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1722 microversion: 2.20 time: 0.483263 Aug 23 18:19:56.181102 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2698/5525] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:55 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1722 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:56.378117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:56.378935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:56.391083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:56.394504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:56.396930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:56.400404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:56.401091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:56.401695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:56.455586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:56.456767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:56.457449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:56.458224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lazy-loading 'fault' on Instance uuid 56177b26-1f5a-4e30-9612-e12570c6db1f {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:19:56.526970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-651d326a-f0c2-467c-b8c7-f7fd786f353a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:56.540424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-651d326a-f0c2-467c-b8c7-f7fd786f353a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:56.543592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-651d326a-f0c2-467c-b8c7-f7fd786f353a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:56.547363 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-651d326a-f0c2-467c-b8c7-f7fd786f353a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 2372 microversion: 2.42 time: 0.855432 Aug 23 18:19:56.550208 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2828/5526] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:55 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 2372 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:56.571150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:56.581212 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4add24e3-c857-44a3-9720-b775d1bb0c67 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 200 len: 1339 microversion: 2.1 time: 0.208663 Aug 23 18:19:56.583196 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2699/5527] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:56 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 1339 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:19:57.194230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cba5ede5-de41-43e5-89de-cabfafa36630 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:57.194990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cba5ede5-de41-43e5-89de-cabfafa36630 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:57.212529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cba5ede5-de41-43e5-89de-cabfafa36630 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:57.231377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cba5ede5-de41-43e5-89de-cabfafa36630 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:57.237940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cba5ede5-de41-43e5-89de-cabfafa36630 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:57.238881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cba5ede5-de41-43e5-89de-cabfafa36630 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:57.239478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cba5ede5-de41-43e5-89de-cabfafa36630 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:57.240025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cba5ede5-de41-43e5-89de-cabfafa36630 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:57.252870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4a4cea21-0f2b-4cd0-b647-003265897e6a req-7684cd56-d2ca-4e94-bb47-410a51c3aecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56177b26-1f5a-4e30-9612-e12570c6db1f", "name": "network-vif-deleted", "tag": "569eebda-cfd9-47e0-8869-8add9cbd39b8"}, {"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-deleted", "tag": "1748595a-c8aa-4422-ab33-d3f8d2ec00d2"}, {"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-deleted", "tag": "984fbe3f-942d-428e-b69a-4f736cedf9e1"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:57.272232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4a4cea21-0f2b-4cd0-b647-003265897e6a req-7684cd56-d2ca-4e94-bb47-410a51c3aecc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:57.272715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4a4cea21-0f2b-4cd0-b647-003265897e6a req-7684cd56-d2ca-4e94-bb47-410a51c3aecc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:57.273152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4a4cea21-0f2b-4cd0-b647-003265897e6a req-7684cd56-d2ca-4e94-bb47-410a51c3aecc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:57.296425 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4a4cea21-0f2b-4cd0-b647-003265897e6a req-7684cd56-d2ca-4e94-bb47-410a51c3aecc service nova] Creating event network-vif-deleted:569eebda-cfd9-47e0-8869-8add9cbd39b8 for instance 56177b26-1f5a-4e30-9612-e12570c6db1f on n-h1-850468-16 Aug 23 18:19:57.296931 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4a4cea21-0f2b-4cd0-b647-003265897e6a req-7684cd56-d2ca-4e94-bb47-410a51c3aecc service nova] Creating event network-vif-deleted:1748595a-c8aa-4422-ab33-d3f8d2ec00d2 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:19:57.297434 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4a4cea21-0f2b-4cd0-b647-003265897e6a req-7684cd56-d2ca-4e94-bb47-410a51c3aecc service nova] Creating event network-vif-deleted:984fbe3f-942d-428e-b69a-4f736cedf9e1 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:19:57.315111 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4a4cea21-0f2b-4cd0-b647-003265897e6a req-7684cd56-d2ca-4e94-bb47-410a51c3aecc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.066244 Aug 23 18:19:57.326707 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2700/5528] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:57.333484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b6465c5b-72ae-474a-af37-d54759d09d16 req-0e1a015e-2f1b-4c53-a81b-8609d8c8a391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8fe0c3-ea81-46b5-9230-216cf8e932d2", "name": "network-vif-unplugged", "status": "completed", "tag": "663bf035-ee8e-4ca7-aeb3-025d64e3d0e1"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:57.351886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b6465c5b-72ae-474a-af37-d54759d09d16 req-0e1a015e-2f1b-4c53-a81b-8609d8c8a391 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:57.352826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b6465c5b-72ae-474a-af37-d54759d09d16 req-0e1a015e-2f1b-4c53-a81b-8609d8c8a391 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:57.353411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b6465c5b-72ae-474a-af37-d54759d09d16 req-0e1a015e-2f1b-4c53-a81b-8609d8c8a391 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:57.371214 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b6465c5b-72ae-474a-af37-d54759d09d16 req-0e1a015e-2f1b-4c53-a81b-8609d8c8a391 service nova] Creating event network-vif-unplugged:663bf035-ee8e-4ca7-aeb3-025d64e3d0e1 for instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 on n-h2-850468-16 Aug 23 18:19:57.378415 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b6465c5b-72ae-474a-af37-d54759d09d16 req-0e1a015e-2f1b-4c53-a81b-8609d8c8a391 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049884 Aug 23 18:19:57.379293 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2701/5529] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:19:57.583425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-430bd416-b43c-4dee-9081-57ca32a5be82 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:57.583425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-430bd416-b43c-4dee-9081-57ca32a5be82 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:57.604700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-430bd416-b43c-4dee-9081-57ca32a5be82 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:57.605203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-430bd416-b43c-4dee-9081-57ca32a5be82 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:57.605643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-430bd416-b43c-4dee-9081-57ca32a5be82 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:57.606357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-430bd416-b43c-4dee-9081-57ca32a5be82 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:57.606859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-430bd416-b43c-4dee-9081-57ca32a5be82 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:57.607285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-430bd416-b43c-4dee-9081-57ca32a5be82 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:57.711917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-430bd416-b43c-4dee-9081-57ca32a5be82 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:57.743793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-430bd416-b43c-4dee-9081-57ca32a5be82 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:57.745667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-430bd416-b43c-4dee-9081-57ca32a5be82 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:57.761072 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-430bd416-b43c-4dee-9081-57ca32a5be82 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1985 microversion: 2.42 time: 0.176916 Aug 23 18:19:57.763703 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2702/5530] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:57 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1985 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:19:57.792779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ad50a1a-089e-4e8e-949d-8b6e0d05fee7 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:57.793409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8ad50a1a-089e-4e8e-949d-8b6e0d05fee7 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 56177b26-1f5a-4e30-9612-e12570c6db1f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:57.809050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ad50a1a-089e-4e8e-949d-8b6e0d05fee7 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:57.809558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ad50a1a-089e-4e8e-949d-8b6e0d05fee7 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:57.817835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cba5ede5-de41-43e5-89de-cabfafa36630 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:57.818861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ad50a1a-089e-4e8e-949d-8b6e0d05fee7 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:57.820160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ad50a1a-089e-4e8e-949d-8b6e0d05fee7 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:57.820877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ad50a1a-089e-4e8e-949d-8b6e0d05fee7 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:57.822187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ad50a1a-089e-4e8e-949d-8b6e0d05fee7 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:57.830720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cba5ede5-de41-43e5-89de-cabfafa36630 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:57.835943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cba5ede5-de41-43e5-89de-cabfafa36630 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:57.837198 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cba5ede5-de41-43e5-89de-cabfafa36630 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1722 microversion: 2.20 time: 0.647836 Aug 23 18:19:57.837776 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2829/5531] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:57 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1722 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:57.841846 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-8ad50a1a-089e-4e8e-949d-8b6e0d05fee7 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] HTTP exception thrown: Instance 56177b26-1f5a-4e30-9612-e12570c6db1f could not be found. Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ad50a1a-089e-4e8e-949d-8b6e0d05fee7 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Request method failure captured: Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f HTTP/1.1 Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRmSvpgAIznH5S1a4nybwyYK2B3Qh2Avc70Gt0_e8zHcozOFTda5V3x0KYhyk_Ne6OpOT_wUleY6NHBuHo2GLPhKP_qWdnYimRz80vPv5PC0vMv_aeqXc6tL8uzwYolCx52LizP2jg0DMmIaIs7yy_xJu8sEnBmeoTU3NBTCEscB5bs Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: bc5872887aaa488fafcb94629d083630 Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestNetworkBasicOps-1018920659 Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc5872887aaa488fafcb94629d083630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc5872887aaa488fafcb94629d083630"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc5872887aaa488fafcb94629d083630"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc5872887aaa488fafcb94629d083630"}]}] Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestNetworkBasicOps-1018920659 Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: bc5872887aaa488fafcb94629d083630 Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestNetworkBasicOps-1018920659 Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestNetworkBasicOps-1018920659-project Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: ef5f5a1ba1e7414a82fff09abe84a931 Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestNetworkBasicOps-1018920659-project Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 56177b26-1f5a-4e30-9612-e12570c6db1f could not be found. Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '56177b26-1f5a-4e30-9612-e12570c6db1f'} Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56177b26-1f5a-4e30-9612-e12570c6db1f could not be found. Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56177b26-1f5a-4e30-9612-e12570c6db1f could not be found. Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:19:57.844222 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:19:57.848795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:19:57.848795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:19:57.848795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:19:57.848795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:19:57.848795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:19:57.848795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56177b26-1f5a-4e30-9612-e12570c6db1f could not be found. Aug 23 18:19:57.848795 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:19:57.853139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ad50a1a-089e-4e8e-949d-8b6e0d05fee7 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Returning 404 to user: Instance 56177b26-1f5a-4e30-9612-e12570c6db1f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:19:57.854623 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8ad50a1a-089e-4e8e-949d-8b6e0d05fee7 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f" status: 404 len: 111 microversion: 2.1 time: 0.066819 Aug 23 18:19:57.855527 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2703/5532] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:19:57 2022] GET /compute/v2.1/servers/56177b26-1f5a-4e30-9612-e12570c6db1f => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:19:58.555552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2cf37b1f-d1e2-4cac-b22d-263595209ee0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '.version_select at 0x7f27df4e0280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:58.584659 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2cf37b1f-d1e2-4cac-b22d-263595209ee0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1318640162" status: 202 len: 0 microversion: 2.1 time: 0.032876 Aug 23 18:19:58.585305 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2830/5533] 10.222.0.61 () {58 vars in 1257 bytes} [Tue Aug 23 18:19:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1318640162 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:19:58.797566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2557e345-7245-45ac-b061-92a34d082c3a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:58.799420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2557e345-7245-45ac-b061-92a34d082c3a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:58.816607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2557e345-7245-45ac-b061-92a34d082c3a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:58.817469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2557e345-7245-45ac-b061-92a34d082c3a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:58.818154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2557e345-7245-45ac-b061-92a34d082c3a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:58.819265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2557e345-7245-45ac-b061-92a34d082c3a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:58.831508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2557e345-7245-45ac-b061-92a34d082c3a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:58.832211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2557e345-7245-45ac-b061-92a34d082c3a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:58.863431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93e4d2c3-c249-4f86-afcd-03d3abbdd51b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:19:58.864049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-93e4d2c3-c249-4f86-afcd-03d3abbdd51b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:58.880643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93e4d2c3-c249-4f86-afcd-03d3abbdd51b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:58.881180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93e4d2c3-c249-4f86-afcd-03d3abbdd51b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:58.881628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93e4d2c3-c249-4f86-afcd-03d3abbdd51b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:58.882355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93e4d2c3-c249-4f86-afcd-03d3abbdd51b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:58.882843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93e4d2c3-c249-4f86-afcd-03d3abbdd51b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:58.883276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93e4d2c3-c249-4f86-afcd-03d3abbdd51b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:59.116945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2557e345-7245-45ac-b061-92a34d082c3a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:59.131668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2557e345-7245-45ac-b061-92a34d082c3a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:59.133384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2557e345-7245-45ac-b061-92a34d082c3a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:59.134675 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2557e345-7245-45ac-b061-92a34d082c3a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.341166 Aug 23 18:19:59.139161 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2704/5534] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:58 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:19:59.345760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93e4d2c3-c249-4f86-afcd-03d3abbdd51b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:59.354655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93e4d2c3-c249-4f86-afcd-03d3abbdd51b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:59.356190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93e4d2c3-c249-4f86-afcd-03d3abbdd51b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:19:59.370642 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93e4d2c3-c249-4f86-afcd-03d3abbdd51b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1725 microversion: 2.20 time: 0.508988 Aug 23 18:19:59.374703 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2831/5535] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:19:58 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1725 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:19:59.398908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b6f4bce7-b7ce-4d55-976e-88be22447457 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "75b3527d-59b4-42ea-b276-dafd8f9fd816"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:59.401535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b6f4bce7-b7ce-4d55-976e-88be22447457 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:19:59.436500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6f4bce7-b7ce-4d55-976e-88be22447457 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:59.437250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6f4bce7-b7ce-4d55-976e-88be22447457 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:59.437875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6f4bce7-b7ce-4d55-976e-88be22447457 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:59.439460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6f4bce7-b7ce-4d55-976e-88be22447457 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:59.440436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6f4bce7-b7ce-4d55-976e-88be22447457 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:59.441046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6f4bce7-b7ce-4d55-976e-88be22447457 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:59.546186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-0e6f0ccb-2e33-4517-897e-d172b21bd2d2 req-b08d409c-5617-4b49-8f22-9b6162e02f44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "adf336a2-359d-4e7d-9d72-b47c42a924b3", "name": "network-vif-deleted", "tag": "efc446c9-5ccd-4541-9891-7415a79be535"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:19:59.561000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0e6f0ccb-2e33-4517-897e-d172b21bd2d2 req-b08d409c-5617-4b49-8f22-9b6162e02f44 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:19:59.573572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0e6f0ccb-2e33-4517-897e-d172b21bd2d2 req-b08d409c-5617-4b49-8f22-9b6162e02f44 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:19:59.575191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0e6f0ccb-2e33-4517-897e-d172b21bd2d2 req-b08d409c-5617-4b49-8f22-9b6162e02f44 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:19:59.618738 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-0e6f0ccb-2e33-4517-897e-d172b21bd2d2 req-b08d409c-5617-4b49-8f22-9b6162e02f44 service nova] Creating event network-vif-deleted:efc446c9-5ccd-4541-9891-7415a79be535 for instance adf336a2-359d-4e7d-9d72-b47c42a924b3 on n-h1-850468-16 Aug 23 18:19:59.631756 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-0e6f0ccb-2e33-4517-897e-d172b21bd2d2 req-b08d409c-5617-4b49-8f22-9b6162e02f44 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089211 Aug 23 18:19:59.632843 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2832/5536] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:20:00.004559 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b6f4bce7-b7ce-4d55-976e-88be22447457 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "POST /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.609542 Aug 23 18:20:00.006054 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2705/5537] 10.222.0.61 () {62 vars in 1364 bytes} [Tue Aug 23 18:19:59 2022] POST /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments => generated 188 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:20:00.166130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c2213e62-e8ec-4951-9e6e-95a8e332c877 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:20:00.166779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c2213e62-e8ec-4951-9e6e-95a8e332c877 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:00.171668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-027afbeb-0a23-4272-8062-c0fe1da629fc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:00.172390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-027afbeb-0a23-4272-8062-c0fe1da629fc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:00.183833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2213e62-e8ec-4951-9e6e-95a8e332c877 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:00.184340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2213e62-e8ec-4951-9e6e-95a8e332c877 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:00.184791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2213e62-e8ec-4951-9e6e-95a8e332c877 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:00.185512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2213e62-e8ec-4951-9e6e-95a8e332c877 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:00.185974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2213e62-e8ec-4951-9e6e-95a8e332c877 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:00.186410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2213e62-e8ec-4951-9e6e-95a8e332c877 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:00.187966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-027afbeb-0a23-4272-8062-c0fe1da629fc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:00.190711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-027afbeb-0a23-4272-8062-c0fe1da629fc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:00.191380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-027afbeb-0a23-4272-8062-c0fe1da629fc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:00.192324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-027afbeb-0a23-4272-8062-c0fe1da629fc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:00.195328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-027afbeb-0a23-4272-8062-c0fe1da629fc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:00.195950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-027afbeb-0a23-4272-8062-c0fe1da629fc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:00.296394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c2213e62-e8ec-4951-9e6e-95a8e332c877 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128807) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 18:20:00.445181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-027afbeb-0a23-4272-8062-c0fe1da629fc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:00.447820 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c2213e62-e8ec-4951-9e6e-95a8e332c877 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "POST /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/action" status: 202 len: 0 microversion: 2.20 time: 0.286920 Aug 23 18:20:00.449131 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2706/5538] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 18:20:00 2022] POST /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/action => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:20:00.464495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4ac52296-c3fc-43c0-b233-0347bbbf1d87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:00.466865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4ac52296-c3fc-43c0-b233-0347bbbf1d87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:00.477061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ac52296-c3fc-43c0-b233-0347bbbf1d87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:00.496842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ac52296-c3fc-43c0-b233-0347bbbf1d87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:00.497022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-027afbeb-0a23-4272-8062-c0fe1da629fc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:00.498435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ac52296-c3fc-43c0-b233-0347bbbf1d87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:00.502153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ac52296-c3fc-43c0-b233-0347bbbf1d87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:00.503995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ac52296-c3fc-43c0-b233-0347bbbf1d87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:00.504598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-027afbeb-0a23-4272-8062-c0fe1da629fc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:00.506284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ac52296-c3fc-43c0-b233-0347bbbf1d87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:00.513925 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-027afbeb-0a23-4272-8062-c0fe1da629fc tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.352736 Aug 23 18:20:00.517756 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2833/5539] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:00 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:00.621067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:20:01.241765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ac52296-c3fc-43c0-b233-0347bbbf1d87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:01.256746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ac52296-c3fc-43c0-b233-0347bbbf1d87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:01.261542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ac52296-c3fc-43c0-b233-0347bbbf1d87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:01.262830 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4ac52296-c3fc-43c0-b233-0347bbbf1d87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1751 microversion: 2.20 time: 0.806160 Aug 23 18:20:01.269534 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2707/5540] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:00 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1751 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:01.545751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e8be4bcb-daad-4c0d-90cf-a1f1512bff18 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:01.546697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e8be4bcb-daad-4c0d-90cf-a1f1512bff18 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:01.581927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8be4bcb-daad-4c0d-90cf-a1f1512bff18 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:01.584108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8be4bcb-daad-4c0d-90cf-a1f1512bff18 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:01.586262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8be4bcb-daad-4c0d-90cf-a1f1512bff18 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:01.589716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8be4bcb-daad-4c0d-90cf-a1f1512bff18 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:01.595637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8be4bcb-daad-4c0d-90cf-a1f1512bff18 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:01.597229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8be4bcb-daad-4c0d-90cf-a1f1512bff18 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:01.969099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8be4bcb-daad-4c0d-90cf-a1f1512bff18 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:01.989257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8be4bcb-daad-4c0d-90cf-a1f1512bff18 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:01.992461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8be4bcb-daad-4c0d-90cf-a1f1512bff18 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:01.999099 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e8be4bcb-daad-4c0d-90cf-a1f1512bff18 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.458735 Aug 23 18:20:02.002657 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2834/5541] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:01 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:02.297703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-68fe1295-7121-4c12-8b83-2a791a13821a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:02.299154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-68fe1295-7121-4c12-8b83-2a791a13821a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:02.321652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68fe1295-7121-4c12-8b83-2a791a13821a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:02.324198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68fe1295-7121-4c12-8b83-2a791a13821a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:02.326240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68fe1295-7121-4c12-8b83-2a791a13821a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:02.334146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68fe1295-7121-4c12-8b83-2a791a13821a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:02.340839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68fe1295-7121-4c12-8b83-2a791a13821a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:02.344703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68fe1295-7121-4c12-8b83-2a791a13821a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:02.729939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-68fe1295-7121-4c12-8b83-2a791a13821a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:02.745074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-68fe1295-7121-4c12-8b83-2a791a13821a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:02.746667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-68fe1295-7121-4c12-8b83-2a791a13821a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:02.747883 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-68fe1295-7121-4c12-8b83-2a791a13821a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1751 microversion: 2.20 time: 0.456429 Aug 23 18:20:02.759008 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2708/5542] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:02 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1751 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:03.034044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-76fefd99-7835-4dde-9970-9a99c34c750a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:03.036239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-76fefd99-7835-4dde-9970-9a99c34c750a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:03.049481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76fefd99-7835-4dde-9970-9a99c34c750a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:03.052094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76fefd99-7835-4dde-9970-9a99c34c750a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:03.052900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76fefd99-7835-4dde-9970-9a99c34c750a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:03.053642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76fefd99-7835-4dde-9970-9a99c34c750a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:03.054115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76fefd99-7835-4dde-9970-9a99c34c750a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:03.054572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76fefd99-7835-4dde-9970-9a99c34c750a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:03.375798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-76fefd99-7835-4dde-9970-9a99c34c750a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:03.387137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-76fefd99-7835-4dde-9970-9a99c34c750a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:03.389223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-76fefd99-7835-4dde-9970-9a99c34c750a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:03.391138 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-76fefd99-7835-4dde-9970-9a99c34c750a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.362582 Aug 23 18:20:03.403706 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2835/5543] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:03 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:03.773741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83c79418-8fa5-4a5f-82d3-ccbbd5e9b398 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:03.774505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-83c79418-8fa5-4a5f-82d3-ccbbd5e9b398 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:03.785863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83c79418-8fa5-4a5f-82d3-ccbbd5e9b398 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:03.786367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83c79418-8fa5-4a5f-82d3-ccbbd5e9b398 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:03.792310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83c79418-8fa5-4a5f-82d3-ccbbd5e9b398 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:03.795012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83c79418-8fa5-4a5f-82d3-ccbbd5e9b398 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:03.796304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83c79418-8fa5-4a5f-82d3-ccbbd5e9b398 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:03.797192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83c79418-8fa5-4a5f-82d3-ccbbd5e9b398 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:04.048699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-83c79418-8fa5-4a5f-82d3-ccbbd5e9b398 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:04.080162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-83c79418-8fa5-4a5f-82d3-ccbbd5e9b398 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:04.082298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-83c79418-8fa5-4a5f-82d3-ccbbd5e9b398 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:04.083970 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-83c79418-8fa5-4a5f-82d3-ccbbd5e9b398 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1753 microversion: 2.20 time: 0.314241 Aug 23 18:20:04.085321 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2709/5544] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:03 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1753 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:04.329999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-cefac7a3-34c7-49f2-9645-b10cde851dc5 req-364e7e84-1c9b-46a8-913e-3f76f27b2a6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ffff4ed-e3af-4618-b5ae-23b808a9b517", "tag": "6eab7cfd-2033-410c-9b8a-7a04eedb7c58"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:20:04.332445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-37676ecc-3c15-4b59-bf62-d62180b1841d tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:04.333573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-37676ecc-3c15-4b59-bf62-d62180b1841d tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:04.348103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37676ecc-3c15-4b59-bf62-d62180b1841d tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:04.351012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37676ecc-3c15-4b59-bf62-d62180b1841d tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:04.351872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37676ecc-3c15-4b59-bf62-d62180b1841d tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:04.352930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37676ecc-3c15-4b59-bf62-d62180b1841d tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:04.355537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37676ecc-3c15-4b59-bf62-d62180b1841d tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:04.356148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37676ecc-3c15-4b59-bf62-d62180b1841d tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:04.357551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cefac7a3-34c7-49f2-9645-b10cde851dc5 req-364e7e84-1c9b-46a8-913e-3f76f27b2a6b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:04.358246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cefac7a3-34c7-49f2-9645-b10cde851dc5 req-364e7e84-1c9b-46a8-913e-3f76f27b2a6b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:04.360330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cefac7a3-34c7-49f2-9645-b10cde851dc5 req-364e7e84-1c9b-46a8-913e-3f76f27b2a6b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:04.384123 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-cefac7a3-34c7-49f2-9645-b10cde851dc5 req-364e7e84-1c9b-46a8-913e-3f76f27b2a6b service nova] Creating event network-changed:6eab7cfd-2033-410c-9b8a-7a04eedb7c58 for instance 2ffff4ed-e3af-4618-b5ae-23b808a9b517 on n-h1-850468-16 Aug 23 18:20:04.394626 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-cefac7a3-34c7-49f2-9645-b10cde851dc5 req-364e7e84-1c9b-46a8-913e-3f76f27b2a6b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068819 Aug 23 18:20:04.395649 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2710/5545] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:20:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:20:04.405167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-37676ecc-3c15-4b59-bf62-d62180b1841d tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:20:04.421620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7f4ddd14-9805-45e6-bbf3-60f3ac3757ab tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:04.422489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7f4ddd14-9805-45e6-bbf3-60f3ac3757ab tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:04.436909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f4ddd14-9805-45e6-bbf3-60f3ac3757ab tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:04.437602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f4ddd14-9805-45e6-bbf3-60f3ac3757ab tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:04.438151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f4ddd14-9805-45e6-bbf3-60f3ac3757ab tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:04.439057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f4ddd14-9805-45e6-bbf3-60f3ac3757ab tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:04.443186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f4ddd14-9805-45e6-bbf3-60f3ac3757ab tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:04.443787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7f4ddd14-9805-45e6-bbf3-60f3ac3757ab tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:04.562610 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-37676ecc-3c15-4b59-bf62-d62180b1841d tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 204 len: 0 microversion: 2.1 time: 0.239839 Aug 23 18:20:04.564468 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2836/5546] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:20:04 2022] DELETE /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:20:04.582784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-395657fc-c5d3-43d8-b762-b5886af0d22e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:04.583549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-395657fc-c5d3-43d8-b762-b5886af0d22e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:04.611726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-395657fc-c5d3-43d8-b762-b5886af0d22e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:04.612246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-395657fc-c5d3-43d8-b762-b5886af0d22e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:04.612697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-395657fc-c5d3-43d8-b762-b5886af0d22e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:04.613432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-395657fc-c5d3-43d8-b762-b5886af0d22e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:04.613914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-395657fc-c5d3-43d8-b762-b5886af0d22e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:04.614333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-395657fc-c5d3-43d8-b762-b5886af0d22e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:04.664650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7f4ddd14-9805-45e6-bbf3-60f3ac3757ab tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:04.682643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7f4ddd14-9805-45e6-bbf3-60f3ac3757ab tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:04.686115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7f4ddd14-9805-45e6-bbf3-60f3ac3757ab tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:04.687523 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7f4ddd14-9805-45e6-bbf3-60f3ac3757ab tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.270063 Aug 23 18:20:04.718569 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2711/5547] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:04 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:04.821671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-395657fc-c5d3-43d8-b762-b5886af0d22e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:04.831615 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-395657fc-c5d3-43d8-b762-b5886af0d22e tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1672 microversion: 2.1 time: 0.259855 Aug 23 18:20:04.832844 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2837/5548] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:04 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1672 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:20:05.108522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fe9451fc-eddb-42b8-a564-9c55b362749f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:05.109788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe9451fc-eddb-42b8-a564-9c55b362749f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:05.118098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe9451fc-eddb-42b8-a564-9c55b362749f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:05.118983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe9451fc-eddb-42b8-a564-9c55b362749f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:05.119613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe9451fc-eddb-42b8-a564-9c55b362749f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:05.120522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe9451fc-eddb-42b8-a564-9c55b362749f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:05.121148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe9451fc-eddb-42b8-a564-9c55b362749f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:05.121742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe9451fc-eddb-42b8-a564-9c55b362749f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:05.484189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fe9451fc-eddb-42b8-a564-9c55b362749f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:05.496920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fe9451fc-eddb-42b8-a564-9c55b362749f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:05.498719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fe9451fc-eddb-42b8-a564-9c55b362749f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:05.499939 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fe9451fc-eddb-42b8-a564-9c55b362749f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1753 microversion: 2.20 time: 0.395546 Aug 23 18:20:05.501045 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2712/5549] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:05 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1753 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:05.729929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e7bda0c4-62d9-4272-bb4e-50da3c880805 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:05.731168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e7bda0c4-62d9-4272-bb4e-50da3c880805 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:05.742881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7bda0c4-62d9-4272-bb4e-50da3c880805 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:05.752249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7bda0c4-62d9-4272-bb4e-50da3c880805 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:05.754262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7bda0c4-62d9-4272-bb4e-50da3c880805 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:05.757119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7bda0c4-62d9-4272-bb4e-50da3c880805 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:05.757800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7bda0c4-62d9-4272-bb4e-50da3c880805 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:05.768056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7bda0c4-62d9-4272-bb4e-50da3c880805 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:05.859064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d3a70148-6b90-44b9-bc5f-10c36ee8637a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:05.860642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d3a70148-6b90-44b9-bc5f-10c36ee8637a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:05.884240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d3a70148-6b90-44b9-bc5f-10c36ee8637a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:05.884881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d3a70148-6b90-44b9-bc5f-10c36ee8637a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:05.888643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d3a70148-6b90-44b9-bc5f-10c36ee8637a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:05.891194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d3a70148-6b90-44b9-bc5f-10c36ee8637a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:05.898895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d3a70148-6b90-44b9-bc5f-10c36ee8637a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:05.901195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d3a70148-6b90-44b9-bc5f-10c36ee8637a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:05.901873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e7bda0c4-62d9-4272-bb4e-50da3c880805 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:05.920921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e7bda0c4-62d9-4272-bb4e-50da3c880805 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:05.923335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e7bda0c4-62d9-4272-bb4e-50da3c880805 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:05.924902 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e7bda0c4-62d9-4272-bb4e-50da3c880805 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.199453 Aug 23 18:20:05.925682 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2838/5550] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:05 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:20:06.312415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d3a70148-6b90-44b9-bc5f-10c36ee8637a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:06.327124 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d3a70148-6b90-44b9-bc5f-10c36ee8637a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1672 microversion: 2.1 time: 0.473432 Aug 23 18:20:06.328431 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2713/5551] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:05 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1672 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:20:06.524604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-059d53f5-af98-499e-a94b-c3f00ece6ae0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:06.525504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-059d53f5-af98-499e-a94b-c3f00ece6ae0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:06.538712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-059d53f5-af98-499e-a94b-c3f00ece6ae0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:06.540458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-059d53f5-af98-499e-a94b-c3f00ece6ae0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:06.543112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-059d53f5-af98-499e-a94b-c3f00ece6ae0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:06.545091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-059d53f5-af98-499e-a94b-c3f00ece6ae0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:06.547358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-059d53f5-af98-499e-a94b-c3f00ece6ae0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:06.548833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-059d53f5-af98-499e-a94b-c3f00ece6ae0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:06.921576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-059d53f5-af98-499e-a94b-c3f00ece6ae0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:06.953248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a4a1c3ca-c773-4466-8349-aabcb93c2d61 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:06.954986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a4a1c3ca-c773-4466-8349-aabcb93c2d61 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:06.971845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4a1c3ca-c773-4466-8349-aabcb93c2d61 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:06.972786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4a1c3ca-c773-4466-8349-aabcb93c2d61 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:06.974339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-059d53f5-af98-499e-a94b-c3f00ece6ae0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:06.976790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-059d53f5-af98-499e-a94b-c3f00ece6ae0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:06.977441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4a1c3ca-c773-4466-8349-aabcb93c2d61 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:06.979574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4a1c3ca-c773-4466-8349-aabcb93c2d61 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:06.982321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-059d53f5-af98-499e-a94b-c3f00ece6ae0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1753 microversion: 2.20 time: 0.458715 Aug 23 18:20:06.983674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4a1c3ca-c773-4466-8349-aabcb93c2d61 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:06.984781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4a1c3ca-c773-4466-8349-aabcb93c2d61 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:06.987600 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2839/5552] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:06 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1753 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:07.183941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a4a1c3ca-c773-4466-8349-aabcb93c2d61 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:07.221296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a4a1c3ca-c773-4466-8349-aabcb93c2d61 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:07.227975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a4a1c3ca-c773-4466-8349-aabcb93c2d61 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:07.234113 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a4a1c3ca-c773-4466-8349-aabcb93c2d61 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.282253 Aug 23 18:20:07.235476 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2714/5553] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:06 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:20:07.365008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-50df91de-1f70-4077-a8d2-2f41779e3e4a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:07.369179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-50df91de-1f70-4077-a8d2-2f41779e3e4a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:07.390069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50df91de-1f70-4077-a8d2-2f41779e3e4a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:07.390995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50df91de-1f70-4077-a8d2-2f41779e3e4a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:07.392312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50df91de-1f70-4077-a8d2-2f41779e3e4a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:07.407752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50df91de-1f70-4077-a8d2-2f41779e3e4a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:07.408646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50df91de-1f70-4077-a8d2-2f41779e3e4a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:07.409281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50df91de-1f70-4077-a8d2-2f41779e3e4a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:07.501760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-50df91de-1f70-4077-a8d2-2f41779e3e4a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:07.512788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:20:07.518292 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-50df91de-1f70-4077-a8d2-2f41779e3e4a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 200 len: 1485 microversion: 2.1 time: 0.160264 Aug 23 18:20:07.539449 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2840/5554] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:07 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 1485 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:20:07.658354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f4dc90d2-2340-42a4-b28a-49cb3d06a42d req-406802d9-7cc0-4fd4-aa05-fc75a2d4198c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ffff4ed-e3af-4618-b5ae-23b808a9b517", "name": "network-vif-deleted", "tag": "6eab7cfd-2033-410c-9b8a-7a04eedb7c58"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:20:07.687319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f4dc90d2-2340-42a4-b28a-49cb3d06a42d req-406802d9-7cc0-4fd4-aa05-fc75a2d4198c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:07.687835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f4dc90d2-2340-42a4-b28a-49cb3d06a42d req-406802d9-7cc0-4fd4-aa05-fc75a2d4198c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:07.688674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f4dc90d2-2340-42a4-b28a-49cb3d06a42d req-406802d9-7cc0-4fd4-aa05-fc75a2d4198c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:07.714017 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f4dc90d2-2340-42a4-b28a-49cb3d06a42d req-406802d9-7cc0-4fd4-aa05-fc75a2d4198c service nova] Creating event network-vif-deleted:6eab7cfd-2033-410c-9b8a-7a04eedb7c58 for instance 2ffff4ed-e3af-4618-b5ae-23b808a9b517 on n-h1-850468-16 Aug 23 18:20:07.726041 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f4dc90d2-2340-42a4-b28a-49cb3d06a42d req-406802d9-7cc0-4fd4-aa05-fc75a2d4198c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075292 Aug 23 18:20:07.727616 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2715/5555] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:20:08.008749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db1853c3-f22b-4a64-9fbb-d5361024b3a7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:08.010159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-db1853c3-f22b-4a64-9fbb-d5361024b3a7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:08.024828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db1853c3-f22b-4a64-9fbb-d5361024b3a7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:08.025816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db1853c3-f22b-4a64-9fbb-d5361024b3a7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:08.026524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db1853c3-f22b-4a64-9fbb-d5361024b3a7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:08.037640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db1853c3-f22b-4a64-9fbb-d5361024b3a7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:08.040375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db1853c3-f22b-4a64-9fbb-d5361024b3a7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:08.047953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db1853c3-f22b-4a64-9fbb-d5361024b3a7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:08.259867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fff445fd-7f04-4bb1-9760-0105a8c6a65e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:08.260812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fff445fd-7f04-4bb1-9760-0105a8c6a65e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:08.281289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fff445fd-7f04-4bb1-9760-0105a8c6a65e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:08.282783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fff445fd-7f04-4bb1-9760-0105a8c6a65e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:08.283681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fff445fd-7f04-4bb1-9760-0105a8c6a65e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:08.287683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fff445fd-7f04-4bb1-9760-0105a8c6a65e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:08.288373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fff445fd-7f04-4bb1-9760-0105a8c6a65e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:08.288824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fff445fd-7f04-4bb1-9760-0105a8c6a65e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:08.417149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fff445fd-7f04-4bb1-9760-0105a8c6a65e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:08.436636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fff445fd-7f04-4bb1-9760-0105a8c6a65e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:08.439115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fff445fd-7f04-4bb1-9760-0105a8c6a65e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:08.443889 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fff445fd-7f04-4bb1-9760-0105a8c6a65e tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.188711 Aug 23 18:20:08.444939 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2716/5556] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:08 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:20:08.540303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-855fd5cc-272c-4c34-9699-db9e9132e3b8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:08.541041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-855fd5cc-272c-4c34-9699-db9e9132e3b8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: 2ffff4ed-e3af-4618-b5ae-23b808a9b517] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:08.544865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:20:08.553489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-855fd5cc-272c-4c34-9699-db9e9132e3b8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:08.560345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-855fd5cc-272c-4c34-9699-db9e9132e3b8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:08.561737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-855fd5cc-272c-4c34-9699-db9e9132e3b8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:08.562998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-db1853c3-f22b-4a64-9fbb-d5361024b3a7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:08.564769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-855fd5cc-272c-4c34-9699-db9e9132e3b8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:08.565898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-855fd5cc-272c-4c34-9699-db9e9132e3b8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:08.566695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-855fd5cc-272c-4c34-9699-db9e9132e3b8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:08.597152 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-855fd5cc-272c-4c34-9699-db9e9132e3b8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] HTTP exception thrown: Instance 2ffff4ed-e3af-4618-b5ae-23b808a9b517 could not be found. Aug 23 18:20:08.599366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-db1853c3-f22b-4a64-9fbb-d5361024b3a7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-855fd5cc-272c-4c34-9699-db9e9132e3b8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Request method failure captured: Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 HTTP/1.1 Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRmSvpgAIznH5S1a4nybwyYK2B3Qh2Avc70Gt0_e8zHcozOFTda5V3x0KYhyk_Ne6OpOT_wUleY6NHBuHo2GLPhKP_qWdnYimRz80vPv5PC0vMv_aeqXc6tL8uzwYolCx52LizP2jg0DMmIaIs7yy_xJu8sEnBmeoTU3NBTCEscB5bs Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: bc5872887aaa488fafcb94629d083630 Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestNetworkBasicOps-1018920659 Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc5872887aaa488fafcb94629d083630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc5872887aaa488fafcb94629d083630"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc5872887aaa488fafcb94629d083630"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc5872887aaa488fafcb94629d083630"}]}] Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestNetworkBasicOps-1018920659 Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: bc5872887aaa488fafcb94629d083630 Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestNetworkBasicOps-1018920659 Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestNetworkBasicOps-1018920659-project Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: ef5f5a1ba1e7414a82fff09abe84a931 Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestNetworkBasicOps-1018920659-project Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 2ffff4ed-e3af-4618-b5ae-23b808a9b517 could not be found. Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2ffff4ed-e3af-4618-b5ae-23b808a9b517'} Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ffff4ed-e3af-4618-b5ae-23b808a9b517 could not be found. Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ffff4ed-e3af-4618-b5ae-23b808a9b517 could not be found. Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:20:08.600036 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:08.604393 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:20:08.604393 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:20:08.604393 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:20:08.604393 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:20:08.604393 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:20:08.604393 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ffff4ed-e3af-4618-b5ae-23b808a9b517 could not be found. Aug 23 18:20:08.604393 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:08.605038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-db1853c3-f22b-4a64-9fbb-d5361024b3a7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:08.605038 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-db1853c3-f22b-4a64-9fbb-d5361024b3a7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1753 microversion: 2.20 time: 0.599754 Aug 23 18:20:08.607199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-855fd5cc-272c-4c34-9699-db9e9132e3b8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Returning 404 to user: Instance 2ffff4ed-e3af-4618-b5ae-23b808a9b517 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:20:08.608467 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-855fd5cc-272c-4c34-9699-db9e9132e3b8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517" status: 404 len: 111 microversion: 2.1 time: 0.072513 Aug 23 18:20:08.612908 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2717/5557] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:08 2022] GET /compute/v2.1/servers/2ffff4ed-e3af-4618-b5ae-23b808a9b517 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:20:08.613081 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2841/5558] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:08 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1753 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:09.088182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96894032-4676-4114-97fb-a652f96e2061 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '.version_select at 0x7f27dfa925e0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:09.167853 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-96894032-4676-4114-97fb-a652f96e2061 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-516232811" status: 202 len: 0 microversion: 2.1 time: 0.084082 Aug 23 18:20:09.171869 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2718/5559] 10.222.0.61 () {58 vars in 1254 bytes} [Tue Aug 23 18:20:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-516232811 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:20:09.472877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-97c65707-2717-42b8-bdec-be1a58fa6a37 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:09.475046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-97c65707-2717-42b8-bdec-be1a58fa6a37 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:09.496900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c65707-2717-42b8-bdec-be1a58fa6a37 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:09.497411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c65707-2717-42b8-bdec-be1a58fa6a37 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:09.497857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c65707-2717-42b8-bdec-be1a58fa6a37 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:09.498593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c65707-2717-42b8-bdec-be1a58fa6a37 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:09.499056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c65707-2717-42b8-bdec-be1a58fa6a37 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:09.505308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97c65707-2717-42b8-bdec-be1a58fa6a37 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:09.653657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e256a3c9-1a0a-4659-b128-c29324b52506 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:09.655824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e256a3c9-1a0a-4659-b128-c29324b52506 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:09.669156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97c65707-2717-42b8-bdec-be1a58fa6a37 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:09.680264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e256a3c9-1a0a-4659-b128-c29324b52506 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:09.682083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e256a3c9-1a0a-4659-b128-c29324b52506 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:09.682811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e256a3c9-1a0a-4659-b128-c29324b52506 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:09.684334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e256a3c9-1a0a-4659-b128-c29324b52506 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:09.685022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97c65707-2717-42b8-bdec-be1a58fa6a37 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:09.685734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e256a3c9-1a0a-4659-b128-c29324b52506 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:09.686535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e256a3c9-1a0a-4659-b128-c29324b52506 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:09.687560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97c65707-2717-42b8-bdec-be1a58fa6a37 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:09.690564 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-97c65707-2717-42b8-bdec-be1a58fa6a37 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.222975 Aug 23 18:20:09.694064 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2842/5560] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:09 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:10.294453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e256a3c9-1a0a-4659-b128-c29324b52506 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:10.312651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e256a3c9-1a0a-4659-b128-c29324b52506 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:10.316245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e256a3c9-1a0a-4659-b128-c29324b52506 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:10.319903 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e256a3c9-1a0a-4659-b128-c29324b52506 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1753 microversion: 2.20 time: 0.690886 Aug 23 18:20:10.320824 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2719/5561] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:09 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1753 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:20:10.721100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cdb71fdb-b01f-4874-8257-d302a12dcc76 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:10.722320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cdb71fdb-b01f-4874-8257-d302a12dcc76 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:10.733420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cdb71fdb-b01f-4874-8257-d302a12dcc76 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:10.742711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cdb71fdb-b01f-4874-8257-d302a12dcc76 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:10.743382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cdb71fdb-b01f-4874-8257-d302a12dcc76 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:10.747977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cdb71fdb-b01f-4874-8257-d302a12dcc76 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:10.748689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cdb71fdb-b01f-4874-8257-d302a12dcc76 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:10.756457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cdb71fdb-b01f-4874-8257-d302a12dcc76 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:10.916549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cdb71fdb-b01f-4874-8257-d302a12dcc76 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:10.935541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cdb71fdb-b01f-4874-8257-d302a12dcc76 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:10.943981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cdb71fdb-b01f-4874-8257-d302a12dcc76 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:10.955565 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cdb71fdb-b01f-4874-8257-d302a12dcc76 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.238228 Aug 23 18:20:10.959845 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2843/5562] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:10 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:11.356821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45aff544-ff51-48c7-a323-0476e2a4fc62 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:11.357470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-45aff544-ff51-48c7-a323-0476e2a4fc62 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:11.372839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45aff544-ff51-48c7-a323-0476e2a4fc62 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:11.373504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45aff544-ff51-48c7-a323-0476e2a4fc62 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:11.374294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45aff544-ff51-48c7-a323-0476e2a4fc62 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:11.375147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45aff544-ff51-48c7-a323-0476e2a4fc62 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:11.375616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45aff544-ff51-48c7-a323-0476e2a4fc62 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:11.376080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45aff544-ff51-48c7-a323-0476e2a4fc62 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:11.828975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-45aff544-ff51-48c7-a323-0476e2a4fc62 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:11.850738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-45aff544-ff51-48c7-a323-0476e2a4fc62 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:11.867167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-45aff544-ff51-48c7-a323-0476e2a4fc62 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:11.869823 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-45aff544-ff51-48c7-a323-0476e2a4fc62 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1753 microversion: 2.20 time: 0.519543 Aug 23 18:20:11.871595 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2720/5563] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:11 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1753 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:11.987871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-26c64329-d0a2-42d0-b9a4-ad862674e579 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:11.988492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-26c64329-d0a2-42d0-b9a4-ad862674e579 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:12.004080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26c64329-d0a2-42d0-b9a4-ad862674e579 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:12.004924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26c64329-d0a2-42d0-b9a4-ad862674e579 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:12.005628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26c64329-d0a2-42d0-b9a4-ad862674e579 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:12.007027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26c64329-d0a2-42d0-b9a4-ad862674e579 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:12.009657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26c64329-d0a2-42d0-b9a4-ad862674e579 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:12.010792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26c64329-d0a2-42d0-b9a4-ad862674e579 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:12.168723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-26c64329-d0a2-42d0-b9a4-ad862674e579 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:12.187090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-26c64329-d0a2-42d0-b9a4-ad862674e579 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:12.194075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-26c64329-d0a2-42d0-b9a4-ad862674e579 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:12.195545 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-26c64329-d0a2-42d0-b9a4-ad862674e579 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.212195 Aug 23 18:20:12.216426 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2844/5564] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:11 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:12.900002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ae241dd3-5072-425d-ba66-9fdc4bf75152 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:12.900630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ae241dd3-5072-425d-ba66-9fdc4bf75152 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:12.911239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae241dd3-5072-425d-ba66-9fdc4bf75152 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:12.931313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae241dd3-5072-425d-ba66-9fdc4bf75152 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:12.931646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae241dd3-5072-425d-ba66-9fdc4bf75152 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:12.932867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae241dd3-5072-425d-ba66-9fdc4bf75152 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:12.933402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae241dd3-5072-425d-ba66-9fdc4bf75152 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:12.933804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae241dd3-5072-425d-ba66-9fdc4bf75152 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:13.231851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3e952fde-feb5-408e-8dff-256a95908f09 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:13.232492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3e952fde-feb5-408e-8dff-256a95908f09 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:13.252329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e952fde-feb5-408e-8dff-256a95908f09 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:13.252879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e952fde-feb5-408e-8dff-256a95908f09 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:13.253330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e952fde-feb5-408e-8dff-256a95908f09 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:13.254078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e952fde-feb5-408e-8dff-256a95908f09 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:13.254796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e952fde-feb5-408e-8dff-256a95908f09 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:13.255419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e952fde-feb5-408e-8dff-256a95908f09 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:13.415140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e952fde-feb5-408e-8dff-256a95908f09 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:13.431742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e952fde-feb5-408e-8dff-256a95908f09 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:13.433552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e952fde-feb5-408e-8dff-256a95908f09 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:13.434804 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3e952fde-feb5-408e-8dff-256a95908f09 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.208285 Aug 23 18:20:13.439726 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2845/5565] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:13 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:20:13.702303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ae241dd3-5072-425d-ba66-9fdc4bf75152 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:13.716710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ae241dd3-5072-425d-ba66-9fdc4bf75152 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:13.718446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ae241dd3-5072-425d-ba66-9fdc4bf75152 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:13.720845 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ae241dd3-5072-425d-ba66-9fdc4bf75152 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1753 microversion: 2.20 time: 0.823851 Aug 23 18:20:13.726971 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2721/5566] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:12 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1753 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:14.471426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4a47af3a-244a-4881-9de0-2ad614039565 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:14.475405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4a47af3a-244a-4881-9de0-2ad614039565 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:14.477869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=72,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:20:14.495079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a47af3a-244a-4881-9de0-2ad614039565 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:14.495705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a47af3a-244a-4881-9de0-2ad614039565 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:14.496155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a47af3a-244a-4881-9de0-2ad614039565 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:14.496901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a47af3a-244a-4881-9de0-2ad614039565 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:14.497355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a47af3a-244a-4881-9de0-2ad614039565 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:14.497779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a47af3a-244a-4881-9de0-2ad614039565 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:14.621366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4a47af3a-244a-4881-9de0-2ad614039565 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:14.645083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4a47af3a-244a-4881-9de0-2ad614039565 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:14.647146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4a47af3a-244a-4881-9de0-2ad614039565 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:14.648537 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4a47af3a-244a-4881-9de0-2ad614039565 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.188927 Aug 23 18:20:14.655121 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2846/5567] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:14 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:14.745490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-54b95b28-f715-4f39-8562-b3a1772da7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:14.746688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-54b95b28-f715-4f39-8562-b3a1772da7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:14.770907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54b95b28-f715-4f39-8562-b3a1772da7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:14.771413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54b95b28-f715-4f39-8562-b3a1772da7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:14.771854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54b95b28-f715-4f39-8562-b3a1772da7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:14.772799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54b95b28-f715-4f39-8562-b3a1772da7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:14.773422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54b95b28-f715-4f39-8562-b3a1772da7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:14.774012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54b95b28-f715-4f39-8562-b3a1772da7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:15.069627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-54b95b28-f715-4f39-8562-b3a1772da7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:15.100578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-54b95b28-f715-4f39-8562-b3a1772da7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:15.102249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-54b95b28-f715-4f39-8562-b3a1772da7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:15.103595 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-54b95b28-f715-4f39-8562-b3a1772da7c7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1753 microversion: 2.20 time: 0.362583 Aug 23 18:20:15.104447 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2722/5568] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:14 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1753 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:15.673930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f36ee081-c2f3-45a1-894c-648e4ed16e1a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:15.674715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f36ee081-c2f3-45a1-894c-648e4ed16e1a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:15.685061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f36ee081-c2f3-45a1-894c-648e4ed16e1a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:15.689865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f36ee081-c2f3-45a1-894c-648e4ed16e1a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:15.690785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f36ee081-c2f3-45a1-894c-648e4ed16e1a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:15.691753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f36ee081-c2f3-45a1-894c-648e4ed16e1a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:15.695493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f36ee081-c2f3-45a1-894c-648e4ed16e1a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:15.696214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f36ee081-c2f3-45a1-894c-648e4ed16e1a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:16.020311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f36ee081-c2f3-45a1-894c-648e4ed16e1a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:16.045772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f36ee081-c2f3-45a1-894c-648e4ed16e1a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:16.060049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f36ee081-c2f3-45a1-894c-648e4ed16e1a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:16.061360 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f36ee081-c2f3-45a1-894c-648e4ed16e1a tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.391967 Aug 23 18:20:16.063013 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2847/5569] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:15 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:16.129397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e0a66542-7944-4cd7-a8ff-c05b49534a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:16.130231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e0a66542-7944-4cd7-a8ff-c05b49534a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:16.151498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0a66542-7944-4cd7-a8ff-c05b49534a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:16.159272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0a66542-7944-4cd7-a8ff-c05b49534a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:16.160868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0a66542-7944-4cd7-a8ff-c05b49534a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:16.166579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0a66542-7944-4cd7-a8ff-c05b49534a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:16.167251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0a66542-7944-4cd7-a8ff-c05b49534a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:16.167806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e0a66542-7944-4cd7-a8ff-c05b49534a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:16.721090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e0a66542-7944-4cd7-a8ff-c05b49534a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:16.736460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e0a66542-7944-4cd7-a8ff-c05b49534a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:16.740101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e0a66542-7944-4cd7-a8ff-c05b49534a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:16.741308 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e0a66542-7944-4cd7-a8ff-c05b49534a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1753 microversion: 2.20 time: 0.616559 Aug 23 18:20:16.755314 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2723/5570] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:16 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1753 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:17.089543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ccb4a1d-b084-424e-8822-d22a96d8a440 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:17.090159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8ccb4a1d-b084-424e-8822-d22a96d8a440 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:17.108800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ccb4a1d-b084-424e-8822-d22a96d8a440 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:17.112022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ccb4a1d-b084-424e-8822-d22a96d8a440 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:17.113763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ccb4a1d-b084-424e-8822-d22a96d8a440 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:17.114859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ccb4a1d-b084-424e-8822-d22a96d8a440 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:17.117714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ccb4a1d-b084-424e-8822-d22a96d8a440 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:17.119725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ccb4a1d-b084-424e-8822-d22a96d8a440 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:17.271878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8ccb4a1d-b084-424e-8822-d22a96d8a440 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:17.291938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8ccb4a1d-b084-424e-8822-d22a96d8a440 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:17.295118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8ccb4a1d-b084-424e-8822-d22a96d8a440 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:17.296898 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8ccb4a1d-b084-424e-8822-d22a96d8a440 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.211280 Aug 23 18:20:17.299099 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2848/5571] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:17 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:17.767538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-744d3882-0238-4a6a-9c8a-c146147b98e9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:17.768293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-744d3882-0238-4a6a-9c8a-c146147b98e9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:17.776710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-744d3882-0238-4a6a-9c8a-c146147b98e9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:17.777366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-744d3882-0238-4a6a-9c8a-c146147b98e9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:17.777808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-744d3882-0238-4a6a-9c8a-c146147b98e9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:17.779154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-744d3882-0238-4a6a-9c8a-c146147b98e9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:17.779770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-744d3882-0238-4a6a-9c8a-c146147b98e9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:17.780546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-744d3882-0238-4a6a-9c8a-c146147b98e9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:18.049375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-744d3882-0238-4a6a-9c8a-c146147b98e9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:18.068144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-744d3882-0238-4a6a-9c8a-c146147b98e9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:18.069760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-744d3882-0238-4a6a-9c8a-c146147b98e9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:18.071021 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-744d3882-0238-4a6a-9c8a-c146147b98e9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1753 microversion: 2.20 time: 0.309026 Aug 23 18:20:18.079350 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2724/5572] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:17 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1753 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:18.321520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f3606be-a075-41c2-b843-9c8198bad821 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:18.322100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f3606be-a075-41c2-b843-9c8198bad821 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:18.336549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f3606be-a075-41c2-b843-9c8198bad821 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:18.337095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f3606be-a075-41c2-b843-9c8198bad821 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:18.337497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f3606be-a075-41c2-b843-9c8198bad821 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:18.338195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f3606be-a075-41c2-b843-9c8198bad821 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:18.338852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f3606be-a075-41c2-b843-9c8198bad821 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:18.339430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f3606be-a075-41c2-b843-9c8198bad821 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:18.830471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f3606be-a075-41c2-b843-9c8198bad821 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:18.847787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f3606be-a075-41c2-b843-9c8198bad821 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:18.852276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f3606be-a075-41c2-b843-9c8198bad821 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:18.859016 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f3606be-a075-41c2-b843-9c8198bad821 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.536416 Aug 23 18:20:18.860497 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2849/5573] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:18 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:20:19.096863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b43c37c-55c8-4b49-9a25-2896552a74f1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:19.098207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b43c37c-55c8-4b49-9a25-2896552a74f1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:19.120394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b43c37c-55c8-4b49-9a25-2896552a74f1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:19.121116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b43c37c-55c8-4b49-9a25-2896552a74f1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:19.121733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b43c37c-55c8-4b49-9a25-2896552a74f1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:19.122705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b43c37c-55c8-4b49-9a25-2896552a74f1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:19.123359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b43c37c-55c8-4b49-9a25-2896552a74f1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:19.123980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b43c37c-55c8-4b49-9a25-2896552a74f1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:19.793703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3b43c37c-55c8-4b49-9a25-2896552a74f1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:19.816120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3b43c37c-55c8-4b49-9a25-2896552a74f1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:19.827061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3b43c37c-55c8-4b49-9a25-2896552a74f1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:19.831574 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3b43c37c-55c8-4b49-9a25-2896552a74f1 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.739663 Aug 23 18:20:19.832183 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2725/5574] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:19 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:19.887536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3668e028-2491-439a-ad98-b2860a2ad40c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:19.888692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3668e028-2491-439a-ad98-b2860a2ad40c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:19.903952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3668e028-2491-439a-ad98-b2860a2ad40c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:19.904447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3668e028-2491-439a-ad98-b2860a2ad40c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:19.904919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3668e028-2491-439a-ad98-b2860a2ad40c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:19.905608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3668e028-2491-439a-ad98-b2860a2ad40c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:19.906060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3668e028-2491-439a-ad98-b2860a2ad40c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:19.906482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3668e028-2491-439a-ad98-b2860a2ad40c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:20.054415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3668e028-2491-439a-ad98-b2860a2ad40c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:20.076425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3668e028-2491-439a-ad98-b2860a2ad40c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:20.077964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3668e028-2491-439a-ad98-b2860a2ad40c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:20.080208 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3668e028-2491-439a-ad98-b2860a2ad40c tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.196511 Aug 23 18:20:20.080694 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2850/5575] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:19 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:20.859047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d27d5637-7b9d-43ad-8872-76b8de005969 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:20.860362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d27d5637-7b9d-43ad-8872-76b8de005969 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:20.867568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d27d5637-7b9d-43ad-8872-76b8de005969 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:20.871181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d27d5637-7b9d-43ad-8872-76b8de005969 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:20.874669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d27d5637-7b9d-43ad-8872-76b8de005969 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:20.877450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d27d5637-7b9d-43ad-8872-76b8de005969 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:20.879120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d27d5637-7b9d-43ad-8872-76b8de005969 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:20.879721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d27d5637-7b9d-43ad-8872-76b8de005969 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:21.106121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c2e21257-b06c-4a84-b3eb-c897342a07b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:21.110737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c2e21257-b06c-4a84-b3eb-c897342a07b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:21.134240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2e21257-b06c-4a84-b3eb-c897342a07b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:21.135051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2e21257-b06c-4a84-b3eb-c897342a07b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:21.135810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2e21257-b06c-4a84-b3eb-c897342a07b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:21.137157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2e21257-b06c-4a84-b3eb-c897342a07b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:21.139534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2e21257-b06c-4a84-b3eb-c897342a07b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:21.140249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2e21257-b06c-4a84-b3eb-c897342a07b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:21.349484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c2e21257-b06c-4a84-b3eb-c897342a07b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:21.360593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c2e21257-b06c-4a84-b3eb-c897342a07b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:21.364667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c2e21257-b06c-4a84-b3eb-c897342a07b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:21.367753 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c2e21257-b06c-4a84-b3eb-c897342a07b5 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.267278 Aug 23 18:20:21.373283 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2851/5576] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:21 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:22.010447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d27d5637-7b9d-43ad-8872-76b8de005969 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:22.012868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:20:22.029420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d27d5637-7b9d-43ad-8872-76b8de005969 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:22.032293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d27d5637-7b9d-43ad-8872-76b8de005969 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:22.034084 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d27d5637-7b9d-43ad-8872-76b8de005969 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 1.179788 Aug 23 18:20:22.041816 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2726/5577] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:20 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:22.306524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-360e7105-3a7e-450a-a25f-be88c8802fe2 req-fa75eb77-1fce-499f-9dfc-1c70d10572bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d8fe0c3-ea81-46b5-9230-216cf8e932d2", "tag": "663bf035-ee8e-4ca7-aeb3-025d64e3d0e1"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:20:22.332831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-360e7105-3a7e-450a-a25f-be88c8802fe2 req-fa75eb77-1fce-499f-9dfc-1c70d10572bd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:22.334380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-360e7105-3a7e-450a-a25f-be88c8802fe2 req-fa75eb77-1fce-499f-9dfc-1c70d10572bd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:22.335415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-360e7105-3a7e-450a-a25f-be88c8802fe2 req-fa75eb77-1fce-499f-9dfc-1c70d10572bd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:22.376010 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-360e7105-3a7e-450a-a25f-be88c8802fe2 req-fa75eb77-1fce-499f-9dfc-1c70d10572bd service nova] Creating event network-changed:663bf035-ee8e-4ca7-aeb3-025d64e3d0e1 for instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 on n-h1-850468-16 Aug 23 18:20:22.397897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3064627f-cc6d-4d0c-950a-68be0fa369a6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:22.398515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3064627f-cc6d-4d0c-950a-68be0fa369a6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:22.405432 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-360e7105-3a7e-450a-a25f-be88c8802fe2 req-fa75eb77-1fce-499f-9dfc-1c70d10572bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102710 Aug 23 18:20:22.413738 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2852/5578] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:20:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:20:22.414409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3064627f-cc6d-4d0c-950a-68be0fa369a6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:22.418043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3064627f-cc6d-4d0c-950a-68be0fa369a6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:22.420636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3064627f-cc6d-4d0c-950a-68be0fa369a6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:22.423139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3064627f-cc6d-4d0c-950a-68be0fa369a6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:22.428051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3064627f-cc6d-4d0c-950a-68be0fa369a6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:22.429898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3064627f-cc6d-4d0c-950a-68be0fa369a6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:22.898924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3064627f-cc6d-4d0c-950a-68be0fa369a6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:22.924867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3064627f-cc6d-4d0c-950a-68be0fa369a6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:22.934374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3064627f-cc6d-4d0c-950a-68be0fa369a6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:22.935660 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3064627f-cc6d-4d0c-950a-68be0fa369a6 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.541662 Aug 23 18:20:22.943784 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2727/5579] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:22 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:20:23.072937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2cf19727-94c3-470d-aa4f-315aff3210fa tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:23.074971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2cf19727-94c3-470d-aa4f-315aff3210fa tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:23.105916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2cf19727-94c3-470d-aa4f-315aff3210fa tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:23.107272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2cf19727-94c3-470d-aa4f-315aff3210fa tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:23.107718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2cf19727-94c3-470d-aa4f-315aff3210fa tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:23.108491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2cf19727-94c3-470d-aa4f-315aff3210fa tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:23.108947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2cf19727-94c3-470d-aa4f-315aff3210fa tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:23.109373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2cf19727-94c3-470d-aa4f-315aff3210fa tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:23.970218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5a87ca77-c428-4da3-a8c1-ae70ad36c96d tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:23.971767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5a87ca77-c428-4da3-a8c1-ae70ad36c96d tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:23.991287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a87ca77-c428-4da3-a8c1-ae70ad36c96d tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:23.992042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a87ca77-c428-4da3-a8c1-ae70ad36c96d tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:23.992639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a87ca77-c428-4da3-a8c1-ae70ad36c96d tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:23.993564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a87ca77-c428-4da3-a8c1-ae70ad36c96d tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:23.994278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a87ca77-c428-4da3-a8c1-ae70ad36c96d tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:23.994890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a87ca77-c428-4da3-a8c1-ae70ad36c96d tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:24.238846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5a87ca77-c428-4da3-a8c1-ae70ad36c96d tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:24.257729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5a87ca77-c428-4da3-a8c1-ae70ad36c96d tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:24.271114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5a87ca77-c428-4da3-a8c1-ae70ad36c96d tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:24.273092 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5a87ca77-c428-4da3-a8c1-ae70ad36c96d tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.308136 Aug 23 18:20:24.273970 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2728/5580] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:23 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:24.563769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2cf19727-94c3-470d-aa4f-315aff3210fa tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:24.608236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2cf19727-94c3-470d-aa4f-315aff3210fa tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:24.643067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2cf19727-94c3-470d-aa4f-315aff3210fa tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:24.644356 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2cf19727-94c3-470d-aa4f-315aff3210fa tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 1.577703 Aug 23 18:20:24.644953 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2853/5581] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:23 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:25.303000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1228da15-e793-43c1-a159-3e20cbef0874 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:25.303623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1228da15-e793-43c1-a159-3e20cbef0874 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:25.322467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1228da15-e793-43c1-a159-3e20cbef0874 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:25.323777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1228da15-e793-43c1-a159-3e20cbef0874 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:25.324844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1228da15-e793-43c1-a159-3e20cbef0874 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:25.328018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1228da15-e793-43c1-a159-3e20cbef0874 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:25.329090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1228da15-e793-43c1-a159-3e20cbef0874 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:25.331120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1228da15-e793-43c1-a159-3e20cbef0874 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:25.636791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1228da15-e793-43c1-a159-3e20cbef0874 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:25.672492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1228da15-e793-43c1-a159-3e20cbef0874 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:25.674270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7f688d3-dd08-4e82-b87d-e67f3fe15a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:25.674788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1228da15-e793-43c1-a159-3e20cbef0874 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:25.675752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f7f688d3-dd08-4e82-b87d-e67f3fe15a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:25.675910 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1228da15-e793-43c1-a159-3e20cbef0874 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1603 microversion: 2.42 time: 0.376957 Aug 23 18:20:25.694241 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2729/5582] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:25 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1603 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:25.703356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7f688d3-dd08-4e82-b87d-e67f3fe15a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:25.704532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7f688d3-dd08-4e82-b87d-e67f3fe15a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:25.705036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7f688d3-dd08-4e82-b87d-e67f3fe15a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:25.710047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7f688d3-dd08-4e82-b87d-e67f3fe15a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:25.711718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7f688d3-dd08-4e82-b87d-e67f3fe15a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:25.712296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7f688d3-dd08-4e82-b87d-e67f3fe15a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:26.721882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:26.724307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:26.760298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:26.764279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:26.770041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:26.771432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:26.778929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:26.780087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:26.919213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:26.921750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:26.930991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:26.930991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lazy-loading 'fault' on Instance uuid adf336a2-359d-4e7d-9d72-b47c42a924b3 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:20:27.020414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:27.031287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:27.045090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b65c0b1d85b64207a9fe0d69b6635844', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '95a8ab289dd4486993a639a3fa206ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:27.046996 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5247003b-287e-41fd-8d69-4555750a41ae tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 200 len: 1608 microversion: 2.42 time: 0.330469 Aug 23 18:20:27.047804 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2730/5583] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:26 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 1608 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:28.082688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c76bbcb-fa60-4ce6-b4cc-11f414b254ef tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:28.086706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0c76bbcb-fa60-4ce6-b4cc-11f414b254ef tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:28.101126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c76bbcb-fa60-4ce6-b4cc-11f414b254ef tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:28.114366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c76bbcb-fa60-4ce6-b4cc-11f414b254ef tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:28.117175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c76bbcb-fa60-4ce6-b4cc-11f414b254ef tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:28.119593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c76bbcb-fa60-4ce6-b4cc-11f414b254ef tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:28.120277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c76bbcb-fa60-4ce6-b4cc-11f414b254ef tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:28.127655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c76bbcb-fa60-4ce6-b4cc-11f414b254ef tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:28.165604 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-0c76bbcb-fa60-4ce6-b4cc-11f414b254ef tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] HTTP exception thrown: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c76bbcb-fa60-4ce6-b4cc-11f414b254ef tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Request method failure captured: Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 HTTP/1.1 Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRi2b-MwrNsMO9TTkR5BDl5GesI5oaWihimcOEHqheBHTD7j0HA5CkU9fw8tDYi7OQVH2M_KMT4Mk5nwJn_wZ3WcFsTg4SMCKjwZO6icLf8sR4kNSJ7S1YG9iQ9iOxSVwRewtViVUDgDeFOG6LRen_i0tRgBdYR8DcSLDoWdFJQPclM Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.42 Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 95a8ab289dd4486993a639a3fa206ca4 Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2051509167 Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_95a8ab289dd4486993a639a3fa206ca4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/95a8ab289dd4486993a639a3fa206ca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/95a8ab289dd4486993a639a3fa206ca4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/95a8ab289dd4486993a639a3fa206ca4"}]}] Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2051509167 Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 95a8ab289dd4486993a639a3fa206ca4 Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2051509167 Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TaggedBootDevicesTest_v242-2051509167-project Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: b65c0b1d85b64207a9fe0d69b6635844 Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2051509167-project Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'adf336a2-359d-4e7d-9d72-b47c42a924b3'} Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:28.176366 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:20:28.180246 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:28.180246 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:20:28.180246 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:20:28.180246 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:20:28.180246 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:20:28.180246 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:20:28.180246 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:28.180246 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:28.184081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c76bbcb-fa60-4ce6-b4cc-11f414b254ef tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Returning 404 to user: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:20:28.189201 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c76bbcb-fa60-4ce6-b4cc-11f414b254ef tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 404 len: 111 microversion: 2.42 time: 0.117835 Aug 23 18:20:28.190202 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2731/5584] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:28 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 23 18:20:28.200875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f0dd65b0-7296-4f85-9414-471e0fa924be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '.version_select at 0x7f27dfaf6ee0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:28.250226 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f0dd65b0-7296-4f85-9414-471e0fa924be tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-750123781" status: 204 len: 0 microversion: 2.42 time: 0.054034 Aug 23 18:20:28.255804 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2732/5585] 10.222.0.61 () {60 vars in 1259 bytes} [Tue Aug 23 18:20:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-750123781 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:20:28.355430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f7f688d3-dd08-4e82-b87d-e67f3fe15a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:28.369883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f7f688d3-dd08-4e82-b87d-e67f3fe15a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:28.371429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f7f688d3-dd08-4e82-b87d-e67f3fe15a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:28.397381 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f7f688d3-dd08-4e82-b87d-e67f3fe15a2a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 2.703119 Aug 23 18:20:28.398056 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2854/5586] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:25 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 2729 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:20:29.429909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf19ea11-0245-4027-8cf6-1ac44120d47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:29.430732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf19ea11-0245-4027-8cf6-1ac44120d47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:29.460556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf19ea11-0245-4027-8cf6-1ac44120d47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:29.462523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf19ea11-0245-4027-8cf6-1ac44120d47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:29.475887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf19ea11-0245-4027-8cf6-1ac44120d47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:29.484146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf19ea11-0245-4027-8cf6-1ac44120d47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:29.488556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf19ea11-0245-4027-8cf6-1ac44120d47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:29.491571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf19ea11-0245-4027-8cf6-1ac44120d47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:30.942350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf19ea11-0245-4027-8cf6-1ac44120d47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:30.967650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf19ea11-0245-4027-8cf6-1ac44120d47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:30.970094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf19ea11-0245-4027-8cf6-1ac44120d47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:31.002438 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf19ea11-0245-4027-8cf6-1ac44120d47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 1.569539 Aug 23 18:20:31.014568 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2733/5587] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:29 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 1581 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:32.029911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d5c2abfb-7513-46ef-bf00-89fc4c729654 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:32.032315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d5c2abfb-7513-46ef-bf00-89fc4c729654 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:32.046784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5c2abfb-7513-46ef-bf00-89fc4c729654 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:32.049384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5c2abfb-7513-46ef-bf00-89fc4c729654 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:32.050615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5c2abfb-7513-46ef-bf00-89fc4c729654 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:32.052231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5c2abfb-7513-46ef-bf00-89fc4c729654 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:32.053907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5c2abfb-7513-46ef-bf00-89fc4c729654 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:32.055372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5c2abfb-7513-46ef-bf00-89fc4c729654 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:32.504652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3d406a07-385d-4d9e-83b9-a549b6c3efae tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Action: 'create', calling method: .version_select at 0x7f27df9c31f0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-971607671", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJw0m/+kRocNAMJk4WnltoudyaVfsxR03Fptj1B/M4FMEHICLDPa24Q4jntysgQ0NMuru+uMyHXIN2y/Xb9353Lick1KIQ7RpaZYmLGRCsWAnKOBm4NlSTjVeEOzfRQibg=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:20:32.548776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3d406a07-385d-4d9e-83b9-a549b6c3efae tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Getting quotas for project bc5872887aaa488fafcb94629d083630. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:20:32.550925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5c2abfb-7513-46ef-bf00-89fc4c729654 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:32.573466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3d406a07-385d-4d9e-83b9-a549b6c3efae tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Getting quotas for user ef5f5a1ba1e7414a82fff09abe84a931 and project bc5872887aaa488fafcb94629d083630. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:20:32.584886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5c2abfb-7513-46ef-bf00-89fc4c729654 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:32.592636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5c2abfb-7513-46ef-bf00-89fc4c729654 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:32.602690 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d5c2abfb-7513-46ef-bf00-89fc4c729654 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.573674 Aug 23 18:20:32.605107 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2855/5588] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:32 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:32.649511 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3d406a07-385d-4d9e-83b9-a549b6c3efae tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.150080 Aug 23 18:20:32.650816 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2734/5589] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:20:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:20:33.633906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-631c54c2-6733-4a42-9faa-c8fe4ef0dcc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:33.635424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-631c54c2-6733-4a42-9faa-c8fe4ef0dcc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:33.650991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-631c54c2-6733-4a42-9faa-c8fe4ef0dcc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:33.652699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-631c54c2-6733-4a42-9faa-c8fe4ef0dcc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:33.653322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-631c54c2-6733-4a42-9faa-c8fe4ef0dcc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:33.654316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-631c54c2-6733-4a42-9faa-c8fe4ef0dcc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:33.655231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-631c54c2-6733-4a42-9faa-c8fe4ef0dcc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:33.655880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-631c54c2-6733-4a42-9faa-c8fe4ef0dcc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:34.096957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-631c54c2-6733-4a42-9faa-c8fe4ef0dcc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:34.112379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-631c54c2-6733-4a42-9faa-c8fe4ef0dcc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:34.114198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-631c54c2-6733-4a42-9faa-c8fe4ef0dcc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:34.118281 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-631c54c2-6733-4a42-9faa-c8fe4ef0dcc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.489442 Aug 23 18:20:34.120937 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2856/5590] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:33 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:35.166684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-161f40b9-1d5f-4b6d-a4b9-db24a360ef13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:35.168554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-161f40b9-1d5f-4b6d-a4b9-db24a360ef13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:35.196246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-161f40b9-1d5f-4b6d-a4b9-db24a360ef13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:35.197915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-161f40b9-1d5f-4b6d-a4b9-db24a360ef13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:35.199211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-161f40b9-1d5f-4b6d-a4b9-db24a360ef13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:35.202739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-161f40b9-1d5f-4b6d-a4b9-db24a360ef13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:35.212214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-161f40b9-1d5f-4b6d-a4b9-db24a360ef13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:35.214257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-161f40b9-1d5f-4b6d-a4b9-db24a360ef13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:35.910945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-161f40b9-1d5f-4b6d-a4b9-db24a360ef13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:35.926058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-161f40b9-1d5f-4b6d-a4b9-db24a360ef13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:35.930503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-161f40b9-1d5f-4b6d-a4b9-db24a360ef13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:35.934108 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-161f40b9-1d5f-4b6d-a4b9-db24a360ef13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.773785 Aug 23 18:20:35.955162 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2735/5591] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:35 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:36.965262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-05ea307d-ffbf-4d98-b4fc-b9e0ec368d42 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:36.966388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-05ea307d-ffbf-4d98-b4fc-b9e0ec368d42 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:36.999220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05ea307d-ffbf-4d98-b4fc-b9e0ec368d42 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:37.002690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05ea307d-ffbf-4d98-b4fc-b9e0ec368d42 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:37.003631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05ea307d-ffbf-4d98-b4fc-b9e0ec368d42 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:37.004811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05ea307d-ffbf-4d98-b4fc-b9e0ec368d42 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:37.007363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05ea307d-ffbf-4d98-b4fc-b9e0ec368d42 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:37.008129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05ea307d-ffbf-4d98-b4fc-b9e0ec368d42 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:38.273800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-05ea307d-ffbf-4d98-b4fc-b9e0ec368d42 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:38.276814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:20:38.292665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-05ea307d-ffbf-4d98-b4fc-b9e0ec368d42 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:38.295281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-05ea307d-ffbf-4d98-b4fc-b9e0ec368d42 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:38.296914 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-05ea307d-ffbf-4d98-b4fc-b9e0ec368d42 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 1.338182 Aug 23 18:20:38.298565 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2857/5592] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:36 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:39.183617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1870828207", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "68be4829-59e6-4b5d-a098-297e6dafe409"}], "key_name": "tempest-TestNetworkBasicOps-971607671", "security_groups": [{"name": "tempest-secgroup-smoke-875016555"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:20:39.197559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:20:39.329039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ad7256a1-9721-49c4-8ba4-230022907bc0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:39.330177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ad7256a1-9721-49c4-8ba4-230022907bc0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:39.343206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad7256a1-9721-49c4-8ba4-230022907bc0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:39.348264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad7256a1-9721-49c4-8ba4-230022907bc0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:39.348987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad7256a1-9721-49c4-8ba4-230022907bc0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:39.350140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad7256a1-9721-49c4-8ba4-230022907bc0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:39.357357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad7256a1-9721-49c4-8ba4-230022907bc0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:39.361800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad7256a1-9721-49c4-8ba4-230022907bc0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:39.859352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] validate_networks() for [('68be4829-59e6-4b5d-a098-297e6dafe409', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:20:40.293389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ad7256a1-9721-49c4-8ba4-230022907bc0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:40.311957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ad7256a1-9721-49c4-8ba4-230022907bc0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:40.314869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ad7256a1-9721-49c4-8ba4-230022907bc0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:40.319019 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ad7256a1-9721-49c4-8ba4-230022907bc0 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.994844 Aug 23 18:20:40.320216 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2858/5593] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:39 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 997 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:41.344795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-73525b79-88ae-405f-84c1-7bc326d0531b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:41.345503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-73525b79-88ae-405f-84c1-7bc326d0531b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:41.363156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73525b79-88ae-405f-84c1-7bc326d0531b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:41.364734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73525b79-88ae-405f-84c1-7bc326d0531b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:41.367753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73525b79-88ae-405f-84c1-7bc326d0531b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:41.370093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73525b79-88ae-405f-84c1-7bc326d0531b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:41.372057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73525b79-88ae-405f-84c1-7bc326d0531b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:41.373578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73525b79-88ae-405f-84c1-7bc326d0531b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:41.565098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:20:41.565594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:20:41.565984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:20:41.566576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:20:41.567388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:20:41.604224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:41.611763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:41.623189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:41.624038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:41.624519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:41.625004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:41.747327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Getting quotas for project bc5872887aaa488fafcb94629d083630. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:20:41.763464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Getting quotas for user ef5f5a1ba1e7414a82fff09abe84a931 and project bc5872887aaa488fafcb94629d083630. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:20:41.806898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:20:41.811645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:20:41.942231 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3e6e7ce8-2463-4469-8acc-398d01b7ceb9 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.766272 Aug 23 18:20:41.946870 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2736/5594] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:20:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 2772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:20:41.971373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d73be2e4-036b-4d29-a089-3188fbdda6e4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:41.972101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d73be2e4-036b-4d29-a089-3188fbdda6e4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:41.996135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d73be2e4-036b-4d29-a089-3188fbdda6e4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:41.998636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d73be2e4-036b-4d29-a089-3188fbdda6e4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:41.999467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d73be2e4-036b-4d29-a089-3188fbdda6e4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:42.004173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d73be2e4-036b-4d29-a089-3188fbdda6e4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:42.004896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d73be2e4-036b-4d29-a089-3188fbdda6e4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:42.005520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d73be2e4-036b-4d29-a089-3188fbdda6e4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:42.022431 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-d73be2e4-036b-4d29-a089-3188fbdda6e4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] HTTP exception thrown: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d73be2e4-036b-4d29-a089-3188fbdda6e4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Request method failure captured: Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 HTTP/1.1 Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRi2b-MwrNsMO9TTkR5BDl5GesI5oaWihimcOEHqheBHTD7j0HA5CkU9fw8tDYi7OQVH2M_KMT4Mk5nwJn_wZ3WcFsTg4SMCKjwZO6icLf8sR4kNSJ7S1YG9iQ9iOxSVwRewtViVUDgDeFOG6LRen_i0tRgBdYR8DcSLDoWdFJQPclM Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.42 Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 95a8ab289dd4486993a639a3fa206ca4 Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2051509167 Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_95a8ab289dd4486993a639a3fa206ca4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/95a8ab289dd4486993a639a3fa206ca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/95a8ab289dd4486993a639a3fa206ca4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/95a8ab289dd4486993a639a3fa206ca4"}]}] Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2051509167 Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 95a8ab289dd4486993a639a3fa206ca4 Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2051509167 Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TaggedBootDevicesTest_v242-2051509167-project Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: b65c0b1d85b64207a9fe0d69b6635844 Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2051509167-project Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'adf336a2-359d-4e7d-9d72-b47c42a924b3'} Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:20:42.024407 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:20:42.028827 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:42.028827 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:42.028827 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:20:42.028827 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:42.028827 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:20:42.028827 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:20:42.028827 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:20:42.028827 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:20:42.028827 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:20:42.028827 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:42.028827 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:20:42.034571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73525b79-88ae-405f-84c1-7bc326d0531b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:42.045152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d73be2e4-036b-4d29-a089-3188fbdda6e4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Returning 404 to user: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:20:42.046522 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d73be2e4-036b-4d29-a089-3188fbdda6e4 tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "DELETE /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 404 len: 111 microversion: 2.42 time: 0.097916 Aug 23 18:20:42.049344 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2737/5595] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:20:41 2022] DELETE /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:20:42.051862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73525b79-88ae-405f-84c1-7bc326d0531b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:42.058815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73525b79-88ae-405f-84c1-7bc326d0531b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:42.062200 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-73525b79-88ae-405f-84c1-7bc326d0531b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.721511 Aug 23 18:20:42.064814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3ead3bef-d3fc-4a94-8783-428c57822e65 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:42.065178 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2859/5596] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:41 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:42.066326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3ead3bef-d3fc-4a94-8783-428c57822e65 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:42.079691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-401a16d7-772d-4168-9c17-01d2467bd6dd tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:42.080622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-401a16d7-772d-4168-9c17-01d2467bd6dd tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] [instance: adf336a2-359d-4e7d-9d72-b47c42a924b3] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:42.111180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-401a16d7-772d-4168-9c17-01d2467bd6dd tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:42.117212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-401a16d7-772d-4168-9c17-01d2467bd6dd tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:42.117745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-401a16d7-772d-4168-9c17-01d2467bd6dd tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:42.118451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-401a16d7-772d-4168-9c17-01d2467bd6dd tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:42.120024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-401a16d7-772d-4168-9c17-01d2467bd6dd tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:42.120475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-401a16d7-772d-4168-9c17-01d2467bd6dd tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:42.159508 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-401a16d7-772d-4168-9c17-01d2467bd6dd tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] HTTP exception thrown: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-401a16d7-772d-4168-9c17-01d2467bd6dd tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Request method failure captured: Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 HTTP/1.1 Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRi2b-MwrNsMO9TTkR5BDl5GesI5oaWihimcOEHqheBHTD7j0HA5CkU9fw8tDYi7OQVH2M_KMT4Mk5nwJn_wZ3WcFsTg4SMCKjwZO6icLf8sR4kNSJ7S1YG9iQ9iOxSVwRewtViVUDgDeFOG6LRen_i0tRgBdYR8DcSLDoWdFJQPclM Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.42 Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 95a8ab289dd4486993a639a3fa206ca4 Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-2051509167 Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_95a8ab289dd4486993a639a3fa206ca4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/95a8ab289dd4486993a639a3fa206ca4"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/95a8ab289dd4486993a639a3fa206ca4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/95a8ab289dd4486993a639a3fa206ca4"}]}] Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TaggedBootDevicesTest_v242-2051509167 Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 95a8ab289dd4486993a639a3fa206ca4 Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-2051509167 Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TaggedBootDevicesTest_v242-2051509167-project Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b65c0b1d85b64207a9fe0d69b6635844 Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TaggedBootDevicesTest_v242-2051509167-project Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'adf336a2-359d-4e7d-9d72-b47c42a924b3'} Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:20:42.165665 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:20:42.173956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:20:42.173956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:20:42.173956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:20:42.173956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:20:42.173956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:20:42.173956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:20:42.173956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. Aug 23 18:20:42.173956 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:20:42.173956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-401a16d7-772d-4168-9c17-01d2467bd6dd tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] Returning 404 to user: Instance adf336a2-359d-4e7d-9d72-b47c42a924b3 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:20:42.176157 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-401a16d7-772d-4168-9c17-01d2467bd6dd tempest-TaggedBootDevicesTest_v242-2051509167 tempest-TaggedBootDevicesTest_v242-2051509167-project] 10.222.0.61 "GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3" status: 404 len: 111 microversion: 2.42 time: 0.104526 Aug 23 18:20:42.176157 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2860/5597] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:42 2022] GET /compute/v2.1/servers/adf336a2-359d-4e7d-9d72-b47c42a924b3 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:20:42.379532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3ead3bef-d3fc-4a94-8783-428c57822e65 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:42.395159 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3ead3bef-d3fc-4a94-8783-428c57822e65 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1248 microversion: 2.1 time: 0.343108 Aug 23 18:20:42.396990 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2738/5598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:42 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1248 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:20:43.096059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4b80462a-12cd-4900-b057-d35307c461f4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:43.098243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4b80462a-12cd-4900-b057-d35307c461f4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:43.117288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b80462a-12cd-4900-b057-d35307c461f4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:43.117806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b80462a-12cd-4900-b057-d35307c461f4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:43.118256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b80462a-12cd-4900-b057-d35307c461f4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:43.121919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b80462a-12cd-4900-b057-d35307c461f4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:43.123298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b80462a-12cd-4900-b057-d35307c461f4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:43.123765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b80462a-12cd-4900-b057-d35307c461f4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:43.427686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-08396b2a-0d65-4cc4-94a1-d33c67bb5ad8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:43.434162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-08396b2a-0d65-4cc4-94a1-d33c67bb5ad8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:43.464941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08396b2a-0d65-4cc4-94a1-d33c67bb5ad8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:43.467970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08396b2a-0d65-4cc4-94a1-d33c67bb5ad8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:43.471069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08396b2a-0d65-4cc4-94a1-d33c67bb5ad8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:43.473378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08396b2a-0d65-4cc4-94a1-d33c67bb5ad8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:43.476444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08396b2a-0d65-4cc4-94a1-d33c67bb5ad8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:43.477566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08396b2a-0d65-4cc4-94a1-d33c67bb5ad8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:43.526758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b80462a-12cd-4900-b057-d35307c461f4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:43.561111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b80462a-12cd-4900-b057-d35307c461f4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:43.563696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b80462a-12cd-4900-b057-d35307c461f4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:43.575623 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4b80462a-12cd-4900-b057-d35307c461f4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.487059 Aug 23 18:20:43.576668 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2861/5599] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:43 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:43.814889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-08396b2a-0d65-4cc4-94a1-d33c67bb5ad8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:43.844157 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-08396b2a-0d65-4cc4-94a1-d33c67bb5ad8 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1252 microversion: 2.1 time: 0.427623 Aug 23 18:20:43.860470 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2739/5600] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:43 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1252 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:20:44.603356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c36f56d-55a7-4f43-97f4-425c4a9c75b2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:44.603985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1c36f56d-55a7-4f43-97f4-425c4a9c75b2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:44.617054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=32 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:20:44.635635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c36f56d-55a7-4f43-97f4-425c4a9c75b2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:44.636143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c36f56d-55a7-4f43-97f4-425c4a9c75b2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:44.636832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c36f56d-55a7-4f43-97f4-425c4a9c75b2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:44.637589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c36f56d-55a7-4f43-97f4-425c4a9c75b2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:44.638065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c36f56d-55a7-4f43-97f4-425c4a9c75b2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:44.638739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c36f56d-55a7-4f43-97f4-425c4a9c75b2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:44.867903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-587c2887-de6a-47b8-8120-569424ca5871 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:44.868517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-587c2887-de6a-47b8-8120-569424ca5871 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:44.878511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-587c2887-de6a-47b8-8120-569424ca5871 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:44.881780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-587c2887-de6a-47b8-8120-569424ca5871 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:44.882991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-587c2887-de6a-47b8-8120-569424ca5871 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:44.885014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-587c2887-de6a-47b8-8120-569424ca5871 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:44.889779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-587c2887-de6a-47b8-8120-569424ca5871 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:44.890484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-587c2887-de6a-47b8-8120-569424ca5871 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:45.053938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c36f56d-55a7-4f43-97f4-425c4a9c75b2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:45.075093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c36f56d-55a7-4f43-97f4-425c4a9c75b2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:45.077484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c36f56d-55a7-4f43-97f4-425c4a9c75b2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:45.079377 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c36f56d-55a7-4f43-97f4-425c4a9c75b2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.479993 Aug 23 18:20:45.080520 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2862/5601] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:44 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:45.177174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-587c2887-de6a-47b8-8120-569424ca5871 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:45.190575 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-587c2887-de6a-47b8-8120-569424ca5871 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1306 microversion: 2.1 time: 0.326669 Aug 23 18:20:45.214836 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2740/5602] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:44 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1306 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:20:45.572824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7b3af7f-6c4c-41af-821c-96386b189479 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Action: 'create', calling method: .version_select at 0x7f27df6605e0>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-2089254089", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdiHIuYcTlOWHbixN8F9inLFmYoQUZrcw8LbZLAOWfltnVBW62J9CjEzDLbcqWWtTrhOhQ53kME2J4d3C3SkQQ++Id85DeUA+0MB/cMgA3b3pLLhjWlSu/TUfbONfHKHg=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:20:45.600430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7b3af7f-6c4c-41af-821c-96386b189479 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Getting quotas for project 453bc930d231491f81b4843fa86613cc. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:20:45.608857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f7b3af7f-6c4c-41af-821c-96386b189479 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Getting quotas for user a28cba675eca43b881dfdfa00fd348f4 and project 453bc930d231491f81b4843fa86613cc. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:20:45.650173 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f7b3af7f-6c4c-41af-821c-96386b189479 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.500490 Aug 23 18:20:45.650847 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2863/5603] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:20:45 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:20:46.108595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-471b0090-547b-48cb-b87e-02db607351d3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:46.109847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-471b0090-547b-48cb-b87e-02db607351d3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:46.125708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-471b0090-547b-48cb-b87e-02db607351d3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:46.126810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-471b0090-547b-48cb-b87e-02db607351d3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:46.127274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-471b0090-547b-48cb-b87e-02db607351d3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:46.128022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-471b0090-547b-48cb-b87e-02db607351d3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:46.128488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-471b0090-547b-48cb-b87e-02db607351d3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:46.128922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-471b0090-547b-48cb-b87e-02db607351d3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:46.238513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-72060aeb-2226-4267-9f08-bdaf63abefc4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:46.239464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-72060aeb-2226-4267-9f08-bdaf63abefc4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:46.253737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72060aeb-2226-4267-9f08-bdaf63abefc4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:46.254271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72060aeb-2226-4267-9f08-bdaf63abefc4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:46.256775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72060aeb-2226-4267-9f08-bdaf63abefc4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:46.257765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72060aeb-2226-4267-9f08-bdaf63abefc4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:46.259181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72060aeb-2226-4267-9f08-bdaf63abefc4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:46.261674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72060aeb-2226-4267-9f08-bdaf63abefc4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:46.535438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-72060aeb-2226-4267-9f08-bdaf63abefc4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:46.550025 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-72060aeb-2226-4267-9f08-bdaf63abefc4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1306 microversion: 2.1 time: 0.315539 Aug 23 18:20:46.550703 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2864/5604] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:46 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1306 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:20:47.340746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-471b0090-547b-48cb-b87e-02db607351d3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:47.350143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-471b0090-547b-48cb-b87e-02db607351d3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:47.366062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-471b0090-547b-48cb-b87e-02db607351d3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:47.367383 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-471b0090-547b-48cb-b87e-02db607351d3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 1.262810 Aug 23 18:20:47.367960 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2741/5605] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:46 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:47.577210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b0f02486-5214-4ea7-8705-53bb2515be8b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:47.580366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b0f02486-5214-4ea7-8705-53bb2515be8b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:47.600970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0f02486-5214-4ea7-8705-53bb2515be8b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:47.601780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0f02486-5214-4ea7-8705-53bb2515be8b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:47.603636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0f02486-5214-4ea7-8705-53bb2515be8b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:47.606095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0f02486-5214-4ea7-8705-53bb2515be8b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:47.607811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0f02486-5214-4ea7-8705-53bb2515be8b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:47.608417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0f02486-5214-4ea7-8705-53bb2515be8b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:48.395227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1f0f9d0b-7e5c-4437-a748-e9219d8f0739 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:48.396983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1f0f9d0b-7e5c-4437-a748-e9219d8f0739 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:48.411857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f0f9d0b-7e5c-4437-a748-e9219d8f0739 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:48.412609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f0f9d0b-7e5c-4437-a748-e9219d8f0739 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:48.413301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f0f9d0b-7e5c-4437-a748-e9219d8f0739 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:48.414276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f0f9d0b-7e5c-4437-a748-e9219d8f0739 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:48.415054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f0f9d0b-7e5c-4437-a748-e9219d8f0739 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:48.415714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f0f9d0b-7e5c-4437-a748-e9219d8f0739 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:48.544462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b0f02486-5214-4ea7-8705-53bb2515be8b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:48.561888 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b0f02486-5214-4ea7-8705-53bb2515be8b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1373 microversion: 2.1 time: 0.992514 Aug 23 18:20:48.567099 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2865/5606] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:47 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1373 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:20:48.803750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1f0f9d0b-7e5c-4437-a748-e9219d8f0739 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:48.813437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1f0f9d0b-7e5c-4437-a748-e9219d8f0739 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:48.823515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1f0f9d0b-7e5c-4437-a748-e9219d8f0739 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:48.825120 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1f0f9d0b-7e5c-4437-a748-e9219d8f0739 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.434967 Aug 23 18:20:48.826306 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2742/5607] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:48 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:49.588522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b0f76b2d-0308-4be3-bf9c-256dd9fff1dd tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:49.589145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b0f76b2d-0308-4be3-bf9c-256dd9fff1dd tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:49.604015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0f76b2d-0308-4be3-bf9c-256dd9fff1dd tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:49.604877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0f76b2d-0308-4be3-bf9c-256dd9fff1dd tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:49.605504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0f76b2d-0308-4be3-bf9c-256dd9fff1dd tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:49.606512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0f76b2d-0308-4be3-bf9c-256dd9fff1dd tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:49.607234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0f76b2d-0308-4be3-bf9c-256dd9fff1dd tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:49.611930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0f76b2d-0308-4be3-bf9c-256dd9fff1dd tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:49.779320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-fad4f52f-cf61-43ac-b0a5-a7d34c32d54d req-cf0283df-bcb5-4071-94f2-1c3d09569a17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a439a32a-1387-4654-bd15-4de0a4d1e58d", "tag": "7fb999cd-0b0f-416d-b067-84c25d59f6ce"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:20:49.803597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fad4f52f-cf61-43ac-b0a5-a7d34c32d54d req-cf0283df-bcb5-4071-94f2-1c3d09569a17 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:49.806149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fad4f52f-cf61-43ac-b0a5-a7d34c32d54d req-cf0283df-bcb5-4071-94f2-1c3d09569a17 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:49.807941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fad4f52f-cf61-43ac-b0a5-a7d34c32d54d req-cf0283df-bcb5-4071-94f2-1c3d09569a17 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:49.841273 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-fad4f52f-cf61-43ac-b0a5-a7d34c32d54d req-cf0283df-bcb5-4071-94f2-1c3d09569a17 service nova] Creating event network-changed:7fb999cd-0b0f-416d-b067-84c25d59f6ce for instance a439a32a-1387-4654-bd15-4de0a4d1e58d on n-h1-850468-16 Aug 23 18:20:49.861110 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-fad4f52f-cf61-43ac-b0a5-a7d34c32d54d req-cf0283df-bcb5-4071-94f2-1c3d09569a17 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082500 Aug 23 18:20:49.863103 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2743/5608] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:20:49.885891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5df39921-d07a-4bbb-b386-8df47a583763 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:49.887079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5df39921-d07a-4bbb-b386-8df47a583763 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:49.904554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5df39921-d07a-4bbb-b386-8df47a583763 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:49.904940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5df39921-d07a-4bbb-b386-8df47a583763 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:49.912778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5df39921-d07a-4bbb-b386-8df47a583763 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:49.914078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5df39921-d07a-4bbb-b386-8df47a583763 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:49.914792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5df39921-d07a-4bbb-b386-8df47a583763 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:49.915236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5df39921-d07a-4bbb-b386-8df47a583763 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:50.139280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b0f76b2d-0308-4be3-bf9c-256dd9fff1dd tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:50.158439 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b0f76b2d-0308-4be3-bf9c-256dd9fff1dd tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1373 microversion: 2.1 time: 0.573503 Aug 23 18:20:50.160365 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2866/5609] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:49 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1373 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:20:50.396590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5df39921-d07a-4bbb-b386-8df47a583763 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:50.415555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5df39921-d07a-4bbb-b386-8df47a583763 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:50.417517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5df39921-d07a-4bbb-b386-8df47a583763 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:50.419519 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5df39921-d07a-4bbb-b386-8df47a583763 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.553635 Aug 23 18:20:50.420250 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2744/5610] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:49 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:51.182659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-117ee727-d1e7-4f4a-a221-6dd0f0b196f6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:51.183215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-117ee727-d1e7-4f4a-a221-6dd0f0b196f6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:51.197722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-117ee727-d1e7-4f4a-a221-6dd0f0b196f6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:51.198473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-117ee727-d1e7-4f4a-a221-6dd0f0b196f6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:51.198988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-117ee727-d1e7-4f4a-a221-6dd0f0b196f6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:51.199791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-117ee727-d1e7-4f4a-a221-6dd0f0b196f6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:51.200327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-117ee727-d1e7-4f4a-a221-6dd0f0b196f6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:51.200770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-117ee727-d1e7-4f4a-a221-6dd0f0b196f6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:51.445702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-26e94f35-4eae-4a36-85c0-be831a1aebe3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:51.446244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-26e94f35-4eae-4a36-85c0-be831a1aebe3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:51.460101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26e94f35-4eae-4a36-85c0-be831a1aebe3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:51.460602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26e94f35-4eae-4a36-85c0-be831a1aebe3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:51.461036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26e94f35-4eae-4a36-85c0-be831a1aebe3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:51.461752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26e94f35-4eae-4a36-85c0-be831a1aebe3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:51.462202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26e94f35-4eae-4a36-85c0-be831a1aebe3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:51.462667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26e94f35-4eae-4a36-85c0-be831a1aebe3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:51.524559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-117ee727-d1e7-4f4a-a221-6dd0f0b196f6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:51.536182 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-117ee727-d1e7-4f4a-a221-6dd0f0b196f6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1373 microversion: 2.1 time: 0.358579 Aug 23 18:20:51.537060 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2867/5611] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:51 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1373 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:20:51.683004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:20:52.200218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-26e94f35-4eae-4a36-85c0-be831a1aebe3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:52.223992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-26e94f35-4eae-4a36-85c0-be831a1aebe3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:52.229544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-26e94f35-4eae-4a36-85c0-be831a1aebe3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:52.234587 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-26e94f35-4eae-4a36-85c0-be831a1aebe3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.792903 Aug 23 18:20:52.244980 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2745/5612] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:51 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:20:52.569674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6063843c-e171-4a7b-91da-644a5030fd87 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:52.573160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6063843c-e171-4a7b-91da-644a5030fd87 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:52.581214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6063843c-e171-4a7b-91da-644a5030fd87 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:52.582086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6063843c-e171-4a7b-91da-644a5030fd87 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:52.583382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6063843c-e171-4a7b-91da-644a5030fd87 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:52.584290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6063843c-e171-4a7b-91da-644a5030fd87 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:52.584934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6063843c-e171-4a7b-91da-644a5030fd87 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:52.585551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6063843c-e171-4a7b-91da-644a5030fd87 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:52.889589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6063843c-e171-4a7b-91da-644a5030fd87 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:52.903401 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6063843c-e171-4a7b-91da-644a5030fd87 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1373 microversion: 2.1 time: 0.343487 Aug 23 18:20:52.920344 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2868/5613] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:52 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1373 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:20:53.262037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-00e68b5b-177b-45bf-b8e8-0ed0cf812f2d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:53.262734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-00e68b5b-177b-45bf-b8e8-0ed0cf812f2d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:53.276566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=12 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:20:53.284995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00e68b5b-177b-45bf-b8e8-0ed0cf812f2d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:53.284995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00e68b5b-177b-45bf-b8e8-0ed0cf812f2d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:53.286600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00e68b5b-177b-45bf-b8e8-0ed0cf812f2d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:53.287465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00e68b5b-177b-45bf-b8e8-0ed0cf812f2d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:53.288122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00e68b5b-177b-45bf-b8e8-0ed0cf812f2d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:53.291720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00e68b5b-177b-45bf-b8e8-0ed0cf812f2d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:53.311014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=84 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:20:53.530445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5ae2d1f8-fba7-4b8d-9ba0-646baa0b7086 req-6f58be61-302f-4514-8c65-f9596f1b9e3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8fe0c3-ea81-46b5-9230-216cf8e932d2", "name": "network-vif-plugged", "status": "completed", "tag": "663bf035-ee8e-4ca7-aeb3-025d64e3d0e1"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:20:53.551093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5ae2d1f8-fba7-4b8d-9ba0-646baa0b7086 req-6f58be61-302f-4514-8c65-f9596f1b9e3e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:53.552759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5ae2d1f8-fba7-4b8d-9ba0-646baa0b7086 req-6f58be61-302f-4514-8c65-f9596f1b9e3e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:53.553230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5ae2d1f8-fba7-4b8d-9ba0-646baa0b7086 req-6f58be61-302f-4514-8c65-f9596f1b9e3e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:53.587041 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5ae2d1f8-fba7-4b8d-9ba0-646baa0b7086 req-6f58be61-302f-4514-8c65-f9596f1b9e3e service nova] Creating event network-vif-plugged:663bf035-ee8e-4ca7-aeb3-025d64e3d0e1 for instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 on n-h1-850468-16 Aug 23 18:20:53.602788 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5ae2d1f8-fba7-4b8d-9ba0-646baa0b7086 req-6f58be61-302f-4514-8c65-f9596f1b9e3e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076029 Aug 23 18:20:53.604523 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2869/5614] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:20:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:20:53.932300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-35144498-67b3-4ce8-8823-0c48eb12116a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:53.933030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-35144498-67b3-4ce8-8823-0c48eb12116a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:53.954390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35144498-67b3-4ce8-8823-0c48eb12116a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:53.955911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35144498-67b3-4ce8-8823-0c48eb12116a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:53.955911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35144498-67b3-4ce8-8823-0c48eb12116a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:53.974049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35144498-67b3-4ce8-8823-0c48eb12116a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:53.975084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35144498-67b3-4ce8-8823-0c48eb12116a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:53.975565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35144498-67b3-4ce8-8823-0c48eb12116a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:54.189056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-00e68b5b-177b-45bf-b8e8-0ed0cf812f2d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:54.209607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-00e68b5b-177b-45bf-b8e8-0ed0cf812f2d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:54.222319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-00e68b5b-177b-45bf-b8e8-0ed0cf812f2d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:54.224227 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-00e68b5b-177b-45bf-b8e8-0ed0cf812f2d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.965876 Aug 23 18:20:54.226468 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2746/5615] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:53 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:54.491503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-35144498-67b3-4ce8-8823-0c48eb12116a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:54.508760 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-35144498-67b3-4ce8-8823-0c48eb12116a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1373 microversion: 2.1 time: 0.580738 Aug 23 18:20:54.523282 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2870/5616] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:53 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1373 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:20:55.255553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6c232d43-f49d-4818-aaf2-85edb77bea91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:55.256734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6c232d43-f49d-4818-aaf2-85edb77bea91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:55.267138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c232d43-f49d-4818-aaf2-85edb77bea91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:55.271176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c232d43-f49d-4818-aaf2-85edb77bea91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:55.271842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c232d43-f49d-4818-aaf2-85edb77bea91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:55.275434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c232d43-f49d-4818-aaf2-85edb77bea91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:55.276114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c232d43-f49d-4818-aaf2-85edb77bea91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:55.276718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c232d43-f49d-4818-aaf2-85edb77bea91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:55.540210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a1e5e7dc-f4e3-4fc1-b2da-d303217c4183 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:55.541536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a1e5e7dc-f4e3-4fc1-b2da-d303217c4183 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:55.558320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1e5e7dc-f4e3-4fc1-b2da-d303217c4183 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:55.561633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1e5e7dc-f4e3-4fc1-b2da-d303217c4183 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:55.563061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1e5e7dc-f4e3-4fc1-b2da-d303217c4183 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:55.564367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1e5e7dc-f4e3-4fc1-b2da-d303217c4183 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:55.565238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1e5e7dc-f4e3-4fc1-b2da-d303217c4183 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:55.565911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1e5e7dc-f4e3-4fc1-b2da-d303217c4183 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:55.611853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c232d43-f49d-4818-aaf2-85edb77bea91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:55.621950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:20:55.630404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c232d43-f49d-4818-aaf2-85edb77bea91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:55.642387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c232d43-f49d-4818-aaf2-85edb77bea91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:55.646124 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6c232d43-f49d-4818-aaf2-85edb77bea91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.400507 Aug 23 18:20:55.669144 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2747/5617] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:55 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:56.517403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a1e5e7dc-f4e3-4fc1-b2da-d303217c4183 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:56.532014 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a1e5e7dc-f4e3-4fc1-b2da-d303217c4183 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1373 microversion: 2.1 time: 0.992552 Aug 23 18:20:56.533274 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2871/5618] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:55 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1373 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:20:56.672835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8df72480-137d-4dd6-a1ae-34debda41b06 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:56.673955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8df72480-137d-4dd6-a1ae-34debda41b06 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:56.692411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8df72480-137d-4dd6-a1ae-34debda41b06 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:56.699508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8df72480-137d-4dd6-a1ae-34debda41b06 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:56.700366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8df72480-137d-4dd6-a1ae-34debda41b06 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:56.701283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8df72480-137d-4dd6-a1ae-34debda41b06 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:56.701919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8df72480-137d-4dd6-a1ae-34debda41b06 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:56.703890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8df72480-137d-4dd6-a1ae-34debda41b06 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:56.932239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8df72480-137d-4dd6-a1ae-34debda41b06 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:56.947101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8df72480-137d-4dd6-a1ae-34debda41b06 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:56.948922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8df72480-137d-4dd6-a1ae-34debda41b06 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:56.950157 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8df72480-137d-4dd6-a1ae-34debda41b06 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.282836 Aug 23 18:20:56.973902 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2748/5619] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:56 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:57.553928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e3d9be01-014a-41b7-b2b0-3c5dc06e287b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:57.555157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e3d9be01-014a-41b7-b2b0-3c5dc06e287b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:57.571584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3d9be01-014a-41b7-b2b0-3c5dc06e287b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:57.572360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3d9be01-014a-41b7-b2b0-3c5dc06e287b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:57.573001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3d9be01-014a-41b7-b2b0-3c5dc06e287b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:57.573898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3d9be01-014a-41b7-b2b0-3c5dc06e287b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:57.574524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3d9be01-014a-41b7-b2b0-3c5dc06e287b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:57.575368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3d9be01-014a-41b7-b2b0-3c5dc06e287b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:57.980639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7343cf91-acae-4851-872a-042900684f3b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:57.981283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7343cf91-acae-4851-872a-042900684f3b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:58.002573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7343cf91-acae-4851-872a-042900684f3b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:58.003094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7343cf91-acae-4851-872a-042900684f3b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:58.003548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7343cf91-acae-4851-872a-042900684f3b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:58.004297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7343cf91-acae-4851-872a-042900684f3b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:58.004772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7343cf91-acae-4851-872a-042900684f3b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:58.005207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7343cf91-acae-4851-872a-042900684f3b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:58.192719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e3d9be01-014a-41b7-b2b0-3c5dc06e287b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:58.201172 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e3d9be01-014a-41b7-b2b0-3c5dc06e287b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1373 microversion: 2.1 time: 0.651095 Aug 23 18:20:58.201779 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2872/5620] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:57 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1373 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:20:58.717801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7343cf91-acae-4851-872a-042900684f3b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:58.731062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7343cf91-acae-4851-872a-042900684f3b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:58.732663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7343cf91-acae-4851-872a-042900684f3b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:58.734439 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7343cf91-acae-4851-872a-042900684f3b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1809 microversion: 2.20 time: 0.757597 Aug 23 18:20:58.737612 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2749/5621] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:57 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1809 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:20:59.228841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-56959291-4313-45dc-9914-1a5d66484cbf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:59.230019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-56959291-4313-45dc-9914-1a5d66484cbf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:59.243559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56959291-4313-45dc-9914-1a5d66484cbf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:59.244322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56959291-4313-45dc-9914-1a5d66484cbf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:59.244938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56959291-4313-45dc-9914-1a5d66484cbf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:59.246094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56959291-4313-45dc-9914-1a5d66484cbf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:59.250300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56959291-4313-45dc-9914-1a5d66484cbf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:59.251210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56959291-4313-45dc-9914-1a5d66484cbf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:59.711058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-56959291-4313-45dc-9914-1a5d66484cbf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:20:59.730668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-56959291-4313-45dc-9914-1a5d66484cbf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1373 microversion: 2.1 time: 0.505481 Aug 23 18:20:59.731196 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2873/5622] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:20:59 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1373 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:20:59.770988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-75aa0d34-47fe-40db-baca-7c553fd66b91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:20:59.773632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-75aa0d34-47fe-40db-baca-7c553fd66b91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:20:59.802043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75aa0d34-47fe-40db-baca-7c553fd66b91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:59.805503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75aa0d34-47fe-40db-baca-7c553fd66b91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:59.806217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75aa0d34-47fe-40db-baca-7c553fd66b91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:59.807226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75aa0d34-47fe-40db-baca-7c553fd66b91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:59.807994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75aa0d34-47fe-40db-baca-7c553fd66b91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:20:59.808960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75aa0d34-47fe-40db-baca-7c553fd66b91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:20:59.962739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6aa533d2-aa14-45ac-b893-23a1300786ea req-7ef699a3-b09f-4bf9-8808-fb394a38ac14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a439a32a-1387-4654-bd15-4de0a4d1e58d", "name": "network-vif-plugged", "status": "completed", "tag": "7fb999cd-0b0f-416d-b067-84c25d59f6ce"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:20:59.996933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6aa533d2-aa14-45ac-b893-23a1300786ea req-7ef699a3-b09f-4bf9-8808-fb394a38ac14 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:20:59.999065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6aa533d2-aa14-45ac-b893-23a1300786ea req-7ef699a3-b09f-4bf9-8808-fb394a38ac14 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:00.001777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6aa533d2-aa14-45ac-b893-23a1300786ea req-7ef699a3-b09f-4bf9-8808-fb394a38ac14 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:00.077011 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6aa533d2-aa14-45ac-b893-23a1300786ea req-7ef699a3-b09f-4bf9-8808-fb394a38ac14 service nova] Creating event network-vif-plugged:7fb999cd-0b0f-416d-b067-84c25d59f6ce for instance a439a32a-1387-4654-bd15-4de0a4d1e58d on n-h1-850468-16 Aug 23 18:21:00.108189 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6aa533d2-aa14-45ac-b893-23a1300786ea req-7ef699a3-b09f-4bf9-8808-fb394a38ac14 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151265 Aug 23 18:21:00.116660 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2874/5623] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:21:00.767816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f4d20b48-c9aa-4e36-b703-fe5711f9a1a4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:00.769237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f4d20b48-c9aa-4e36-b703-fe5711f9a1a4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:00.787871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d20b48-c9aa-4e36-b703-fe5711f9a1a4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:00.788389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d20b48-c9aa-4e36-b703-fe5711f9a1a4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:00.788843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d20b48-c9aa-4e36-b703-fe5711f9a1a4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:00.789583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d20b48-c9aa-4e36-b703-fe5711f9a1a4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:00.790808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d20b48-c9aa-4e36-b703-fe5711f9a1a4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:00.790808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d20b48-c9aa-4e36-b703-fe5711f9a1a4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:01.354870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-75aa0d34-47fe-40db-baca-7c553fd66b91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:01.370584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-75aa0d34-47fe-40db-baca-7c553fd66b91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:01.384491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-75aa0d34-47fe-40db-baca-7c553fd66b91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:01.386201 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-75aa0d34-47fe-40db-baca-7c553fd66b91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1796 microversion: 2.20 time: 1.632606 Aug 23 18:21:01.401159 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2750/5624] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:20:59 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1796 bytes in 1648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:21:01.815260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1832abde-b37e-4771-bbd2-2f8469e1cf38 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:01.816515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1832abde-b37e-4771-bbd2-2f8469e1cf38 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:01.831282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1832abde-b37e-4771-bbd2-2f8469e1cf38 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:01.831789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1832abde-b37e-4771-bbd2-2f8469e1cf38 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:01.832266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1832abde-b37e-4771-bbd2-2f8469e1cf38 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:01.837450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1832abde-b37e-4771-bbd2-2f8469e1cf38 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:01.837944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1832abde-b37e-4771-bbd2-2f8469e1cf38 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:01.841348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1832abde-b37e-4771-bbd2-2f8469e1cf38 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:01.900461 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1832abde-b37e-4771-bbd2-2f8469e1cf38 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea/ips" status: 200 len: 150 microversion: 2.1 time: 0.090699 Aug 23 18:21:01.910107 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2751/5625] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:21:01 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea/ips => generated 150 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:21:01.924140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81a48504-5e87-49d8-8557-635da5d701db tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6beedc9c-9d8b-454d-b21a-b6d34f061c28"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:01.929560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-81a48504-5e87-49d8-8557-635da5d701db tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:01.946154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81a48504-5e87-49d8-8557-635da5d701db tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:01.947089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81a48504-5e87-49d8-8557-635da5d701db tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:01.947718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81a48504-5e87-49d8-8557-635da5d701db tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:01.950959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81a48504-5e87-49d8-8557-635da5d701db tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:01.951908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81a48504-5e87-49d8-8557-635da5d701db tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:01.953987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81a48504-5e87-49d8-8557-635da5d701db tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:02.116939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f4d20b48-c9aa-4e36-b703-fe5711f9a1a4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:02.129084 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-81a48504-5e87-49d8-8557-635da5d701db tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Invalid volume: volume 6beedc9c-9d8b-454d-b21a-b6d34f061c28 is already attached to instances: e2c1c0a9-6679-4485-a539-9e2d5b10c64b Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81a48504-5e87-49d8-8557-635da5d701db tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea/os-volume_attachments HTTP/1.1 Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 74 Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: {"volumeAttachment": {"volumeId": "6beedc9c-9d8b-454d-b21a-b6d34f061c28"}} Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid volume: volume 6beedc9c-9d8b-454d-b21a-b6d34f061c28 is already attached to instances: e2c1c0a9-6679-4485-a539-9e2d5b10c64b Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': '2666d044-c9dc-484d-939f-7bdf780731ea', 'body': {'volumeAttachment': {'volumeId': '6beedc9c-9d8b-454d-b21a-b6d34f061c28'}}} Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6beedc9c-9d8b-454d-b21a-b6d34f061c28 is already attached to instances: e2c1c0a9-6679-4485-a539-9e2d5b10c64b Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:21:02.135048 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6beedc9c-9d8b-454d-b21a-b6d34f061c28 is already attached to instances: e2c1c0a9-6679-4485-a539-9e2d5b10c64b Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6beedc9c-9d8b-454d-b21a-b6d34f061c28 is already attached to instances: e2c1c0a9-6679-4485-a539-9e2d5b10c64b Aug 23 18:21:02.138769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:02.143449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81a48504-5e87-49d8-8557-635da5d701db tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 400 to user: Invalid volume: volume 6beedc9c-9d8b-454d-b21a-b6d34f061c28 is already attached to instances: e2c1c0a9-6679-4485-a539-9e2d5b10c64b {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:21:02.144560 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f4d20b48-c9aa-4e36-b703-fe5711f9a1a4 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1373 microversion: 2.1 time: 1.391054 Aug 23 18:21:02.160072 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81a48504-5e87-49d8-8557-635da5d701db tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.236086 Aug 23 18:21:02.164305 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2875/5626] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:00 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1373 bytes in 1409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:02.165543 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2752/5627] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:21:01 2022] POST /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea/os-volume_attachments => generated 174 bytes in 255 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:21:02.173194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1784b065-0b47-44df-8666-7c7b7d383ff1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:02.173991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1784b065-0b47-44df-8666-7c7b7d383ff1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:02.180823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1784b065-0b47-44df-8666-7c7b7d383ff1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:02.181653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1784b065-0b47-44df-8666-7c7b7d383ff1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:02.182407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1784b065-0b47-44df-8666-7c7b7d383ff1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:02.183660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1784b065-0b47-44df-8666-7c7b7d383ff1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:02.184406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1784b065-0b47-44df-8666-7c7b7d383ff1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:02.185203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1784b065-0b47-44df-8666-7c7b7d383ff1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:02.230241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1784b065-0b47-44df-8666-7c7b7d383ff1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:21:02.292385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:02.359553 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1784b065-0b47-44df-8666-7c7b7d383ff1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 204 len: 0 microversion: 2.1 time: 0.192169 Aug 23 18:21:02.361396 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2876/5628] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:21:02 2022] DELETE /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:21:02.370664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4bc0eb55-902e-43ef-a93b-6419247d7e0d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:02.371877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4bc0eb55-902e-43ef-a93b-6419247d7e0d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:02.381508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bc0eb55-902e-43ef-a93b-6419247d7e0d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:02.382001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bc0eb55-902e-43ef-a93b-6419247d7e0d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:02.383153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bc0eb55-902e-43ef-a93b-6419247d7e0d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:02.384014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bc0eb55-902e-43ef-a93b-6419247d7e0d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:02.384591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bc0eb55-902e-43ef-a93b-6419247d7e0d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:02.386629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bc0eb55-902e-43ef-a93b-6419247d7e0d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:02.988722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4bc0eb55-902e-43ef-a93b-6419247d7e0d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:03.001959 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4bc0eb55-902e-43ef-a93b-6419247d7e0d tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1681 microversion: 2.1 time: 0.635525 Aug 23 18:21:03.004927 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2753/5629] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:02 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1681 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:03.184772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-97e0baa2-133f-413e-86c0-0082d031a52f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:03.187829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-97e0baa2-133f-413e-86c0-0082d031a52f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:03.216478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97e0baa2-133f-413e-86c0-0082d031a52f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:03.216992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97e0baa2-133f-413e-86c0-0082d031a52f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:03.219486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97e0baa2-133f-413e-86c0-0082d031a52f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:03.220720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97e0baa2-133f-413e-86c0-0082d031a52f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:03.221532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97e0baa2-133f-413e-86c0-0082d031a52f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:03.222230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97e0baa2-133f-413e-86c0-0082d031a52f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:03.832286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-681698998-access_point-646802023", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "f22a266e-d76a-460a-b7a3-155a945f4420"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2089254089", "security_groups": [{"name": "tempest-secgroup_access--48319726"}, {"name": "tempest-secgroup_general--1641313600"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:03.880047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97e0baa2-133f-413e-86c0-0082d031a52f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:03.895092 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-97e0baa2-133f-413e-86c0-0082d031a52f tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1545 microversion: 2.1 time: 0.725431 Aug 23 18:21:03.896306 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2877/5630] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:03 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1545 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:03.933261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4e81b214-0ca0-4679-b3a3-60d9ea42465b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:03.936266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4e81b214-0ca0-4679-b3a3-60d9ea42465b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:03.950271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e81b214-0ca0-4679-b3a3-60d9ea42465b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:03.950965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e81b214-0ca0-4679-b3a3-60d9ea42465b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:03.952815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e81b214-0ca0-4679-b3a3-60d9ea42465b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:03.955428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e81b214-0ca0-4679-b3a3-60d9ea42465b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:03.956146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e81b214-0ca0-4679-b3a3-60d9ea42465b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:03.956609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e81b214-0ca0-4679-b3a3-60d9ea42465b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:04.399027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4e81b214-0ca0-4679-b3a3-60d9ea42465b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:04.416417 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4e81b214-0ca0-4679-b3a3-60d9ea42465b tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1545 microversion: 2.1 time: 0.496219 Aug 23 18:21:04.417294 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2878/5631] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:03 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1545 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:04.436022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-500b6af3-bc53-4138-af03-5181be5afbcf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:04.437727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-500b6af3-bc53-4138-af03-5181be5afbcf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:04.445688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-500b6af3-bc53-4138-af03-5181be5afbcf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:04.446450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-500b6af3-bc53-4138-af03-5181be5afbcf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:04.447073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-500b6af3-bc53-4138-af03-5181be5afbcf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:04.447957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-500b6af3-bc53-4138-af03-5181be5afbcf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:04.448576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-500b6af3-bc53-4138-af03-5181be5afbcf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:04.449162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-500b6af3-bc53-4138-af03-5181be5afbcf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:04.540538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] validate_networks() for [('f22a266e-d76a-460a-b7a3-155a945f4420', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:21:04.958838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-500b6af3-bc53-4138-af03-5181be5afbcf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:04.980008 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-500b6af3-bc53-4138-af03-5181be5afbcf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1681 microversion: 2.1 time: 0.548165 Aug 23 18:21:04.980727 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2879/5632] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:04 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1681 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:05.708378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:21:05.710009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:21:05.710653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:21:05.711207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:21:05.711740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:21:05.739259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:05.744396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:05.746900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:05.753077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:05.754821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:05.755522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:05.793875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Getting quotas for project 453bc930d231491f81b4843fa86613cc. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:21:05.808905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Getting quotas for user a28cba675eca43b881dfdfa00fd348f4 and project 453bc930d231491f81b4843fa86613cc. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:21:05.838606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:21:05.841388 n-d-850468-16 devstack@n-api.service[128807]: WARNING nova.utils [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-681698998-access_point-646802023 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-681698998-acc Aug 23 18:21:05.842419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:21:05.931646 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-88dac54a-0913-4d76-94da-eae4f4e2bb63 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 456 microversion: 2.1 time: 2.103829 Aug 23 18:21:05.934719 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2754/5633] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:21:03 2022] POST /compute/v2.1/servers => generated 456 bytes in 2109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:21:05.945101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9277ec01-d88d-48e6-a483-0d1ebb2c35ab tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:05.945614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9277ec01-d88d-48e6-a483-0d1ebb2c35ab tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:06.004207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-60624dcf-d1c1-426d-8230-8810a4fc447a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:06.005091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-60624dcf-d1c1-426d-8230-8810a4fc447a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:06.018417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60624dcf-d1c1-426d-8230-8810a4fc447a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:06.022838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60624dcf-d1c1-426d-8230-8810a4fc447a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:06.023218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60624dcf-d1c1-426d-8230-8810a4fc447a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:06.025912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60624dcf-d1c1-426d-8230-8810a4fc447a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:06.029129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60624dcf-d1c1-426d-8230-8810a4fc447a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:06.032013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60624dcf-d1c1-426d-8230-8810a4fc447a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:06.199150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9277ec01-d88d-48e6-a483-0d1ebb2c35ab tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:06.207219 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9277ec01-d88d-48e6-a483-0d1ebb2c35ab tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1293 microversion: 2.1 time: 0.266851 Aug 23 18:21:06.222744 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2880/5634] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:05 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1293 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:06.622646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-60624dcf-d1c1-426d-8230-8810a4fc447a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:06.643065 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-60624dcf-d1c1-426d-8230-8810a4fc447a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1681 microversion: 2.1 time: 0.633267 Aug 23 18:21:06.643770 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2755/5635] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:05 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1681 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:07.245679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb2c8f83-ac8e-4987-8032-d7e95665a572 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:07.246930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eb2c8f83-ac8e-4987-8032-d7e95665a572 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:07.271681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb2c8f83-ac8e-4987-8032-d7e95665a572 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:07.272186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb2c8f83-ac8e-4987-8032-d7e95665a572 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:07.276607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb2c8f83-ac8e-4987-8032-d7e95665a572 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:07.278825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb2c8f83-ac8e-4987-8032-d7e95665a572 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:07.282403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb2c8f83-ac8e-4987-8032-d7e95665a572 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:07.285984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb2c8f83-ac8e-4987-8032-d7e95665a572 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:07.533108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eb2c8f83-ac8e-4987-8032-d7e95665a572 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:07.542941 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eb2c8f83-ac8e-4987-8032-d7e95665a572 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1289 microversion: 2.1 time: 0.316097 Aug 23 18:21:07.562981 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2881/5636] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:07 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1289 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:07.666913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c5af978e-d699-4096-b615-d14336b31a8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:07.667724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c5af978e-d699-4096-b615-d14336b31a8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:07.682142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5af978e-d699-4096-b615-d14336b31a8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:07.684430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5af978e-d699-4096-b615-d14336b31a8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:07.684880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5af978e-d699-4096-b615-d14336b31a8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:07.688865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5af978e-d699-4096-b615-d14336b31a8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:07.689358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5af978e-d699-4096-b615-d14336b31a8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:07.691479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5af978e-d699-4096-b615-d14336b31a8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:07.843578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c5af978e-d699-4096-b615-d14336b31a8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:07.853632 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c5af978e-d699-4096-b615-d14336b31a8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1614 microversion: 2.1 time: 0.190836 Aug 23 18:21:07.859768 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2756/5637] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:07 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1614 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:08.571486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e75e5a60-22d3-4321-9313-501afe817eb5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:08.572101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e75e5a60-22d3-4321-9313-501afe817eb5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:08.580463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e75e5a60-22d3-4321-9313-501afe817eb5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:08.581196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e75e5a60-22d3-4321-9313-501afe817eb5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:08.581864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e75e5a60-22d3-4321-9313-501afe817eb5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:08.582691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e75e5a60-22d3-4321-9313-501afe817eb5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:08.583352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e75e5a60-22d3-4321-9313-501afe817eb5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:08.583975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e75e5a60-22d3-4321-9313-501afe817eb5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:08.754328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e75e5a60-22d3-4321-9313-501afe817eb5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:08.767750 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e75e5a60-22d3-4321-9313-501afe817eb5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1351 microversion: 2.1 time: 0.200068 Aug 23 18:21:08.771449 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2882/5638] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:08 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1351 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:08.880518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41ec73fb-a251-4e5e-98e4-1c7df2b1ccec tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:08.881239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-41ec73fb-a251-4e5e-98e4-1c7df2b1ccec tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:08.889660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ec73fb-a251-4e5e-98e4-1c7df2b1ccec tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:08.891390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ec73fb-a251-4e5e-98e4-1c7df2b1ccec tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:08.892039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ec73fb-a251-4e5e-98e4-1c7df2b1ccec tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:08.893631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ec73fb-a251-4e5e-98e4-1c7df2b1ccec tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:08.894314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ec73fb-a251-4e5e-98e4-1c7df2b1ccec tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:08.895215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ec73fb-a251-4e5e-98e4-1c7df2b1ccec tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:08.979751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-421298e3-1354-4585-b3a4-f770c5019b53 req-2968a98a-4564-46be-b7a1-4786996b915d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2666d044-c9dc-484d-939f-7bdf780731ea", "name": "network-vif-deleted", "tag": "3926ef9d-fd08-4b96-852a-893474ad1ff2"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:08.995051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-421298e3-1354-4585-b3a4-f770c5019b53 req-2968a98a-4564-46be-b7a1-4786996b915d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:08.995936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-421298e3-1354-4585-b3a4-f770c5019b53 req-2968a98a-4564-46be-b7a1-4786996b915d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:08.999710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-421298e3-1354-4585-b3a4-f770c5019b53 req-2968a98a-4564-46be-b7a1-4786996b915d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:09.019177 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-421298e3-1354-4585-b3a4-f770c5019b53 req-2968a98a-4564-46be-b7a1-4786996b915d service nova] Creating event network-vif-deleted:3926ef9d-fd08-4b96-852a-893474ad1ff2 for instance 2666d044-c9dc-484d-939f-7bdf780731ea on n-h2-850468-16 Aug 23 18:21:09.058066 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-421298e3-1354-4585-b3a4-f770c5019b53 req-2968a98a-4564-46be-b7a1-4786996b915d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080247 Aug 23 18:21:09.066466 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2883/5639] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:21:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:21:09.234940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41ec73fb-a251-4e5e-98e4-1c7df2b1ccec tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:09.252431 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-41ec73fb-a251-4e5e-98e4-1c7df2b1ccec tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 200 len: 1614 microversion: 2.1 time: 0.375757 Aug 23 18:21:09.253139 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2757/5640] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:08 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 1614 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:09.802107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4489887f-2c16-4f22-8b76-c7356233dcce tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:09.802935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4489887f-2c16-4f22-8b76-c7356233dcce tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:09.820448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4489887f-2c16-4f22-8b76-c7356233dcce tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:09.829973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4489887f-2c16-4f22-8b76-c7356233dcce tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:09.829973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4489887f-2c16-4f22-8b76-c7356233dcce tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:09.829973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4489887f-2c16-4f22-8b76-c7356233dcce tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:09.829973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4489887f-2c16-4f22-8b76-c7356233dcce tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:09.829973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4489887f-2c16-4f22-8b76-c7356233dcce tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:09.952980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4489887f-2c16-4f22-8b76-c7356233dcce tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:09.971658 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4489887f-2c16-4f22-8b76-c7356233dcce tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1351 microversion: 2.1 time: 0.173658 Aug 23 18:21:09.972879 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2884/5641] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:09 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1351 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:10.277007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5701bbb-1d14-4203-8c0b-a22e5fd81cb6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:10.277609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a5701bbb-1d14-4203-8c0b-a22e5fd81cb6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:10.296571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:10.298233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5701bbb-1d14-4203-8c0b-a22e5fd81cb6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:10.298836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5701bbb-1d14-4203-8c0b-a22e5fd81cb6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:10.299293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5701bbb-1d14-4203-8c0b-a22e5fd81cb6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:10.300114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5701bbb-1d14-4203-8c0b-a22e5fd81cb6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:10.300581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5701bbb-1d14-4203-8c0b-a22e5fd81cb6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:10.301022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5701bbb-1d14-4203-8c0b-a22e5fd81cb6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:10.318424 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-a5701bbb-1d14-4203-8c0b-a22e5fd81cb6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5701bbb-1d14-4203-8c0b-a22e5fd81cb6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea HTTP/1.1 Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2666d044-c9dc-484d-939f-7bdf780731ea'} Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:21:10.320079 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:10.324428 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:21:10.324428 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:21:10.324428 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:21:10.324428 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:21:10.324428 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:21:10.324428 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:21:10.324428 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:10.324428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5701bbb-1d14-4203-8c0b-a22e5fd81cb6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 404 to user: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:21:10.324428 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a5701bbb-1d14-4203-8c0b-a22e5fd81cb6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 404 len: 111 microversion: 2.1 time: 0.048728 Aug 23 18:21:10.324428 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2758/5642] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:10 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:21:10.332161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6155d0c3-a67f-447c-a86d-7eadc0eb9cf4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '.version_select at 0x7f27df563940>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:10.369445 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6155d0c3-a67f-447c-a86d-7eadc0eb9cf4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925915936" status: 202 len: 0 microversion: 2.1 time: 0.042120 Aug 23 18:21:10.371548 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2885/5643] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 18:21:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1925915936 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:21:10.993385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49da94d7-8117-40b0-bb31-f9e8a6d302e0 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:10.994005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49da94d7-8117-40b0-bb31-f9e8a6d302e0 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:11.001946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49da94d7-8117-40b0-bb31-f9e8a6d302e0 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:11.002443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49da94d7-8117-40b0-bb31-f9e8a6d302e0 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:11.002916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49da94d7-8117-40b0-bb31-f9e8a6d302e0 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:11.003676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49da94d7-8117-40b0-bb31-f9e8a6d302e0 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:11.004133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49da94d7-8117-40b0-bb31-f9e8a6d302e0 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:11.004563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49da94d7-8117-40b0-bb31-f9e8a6d302e0 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:11.592229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-49da94d7-8117-40b0-bb31-f9e8a6d302e0 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:11.604924 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49da94d7-8117-40b0-bb31-f9e8a6d302e0 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1469 microversion: 2.1 time: 0.615265 Aug 23 18:21:11.608626 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2759/5644] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:10 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1469 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:12.609678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3d854915-3d70-4193-9dc6-4e7c22859c2d req-aff2771d-80ef-4a0f-a893-8cebe1a43738 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a439a32a-1387-4654-bd15-4de0a4d1e58d", "tag": "7fb999cd-0b0f-416d-b067-84c25d59f6ce"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:12.636797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-72e374a8-0288-4194-a63a-41c9ba49b1b2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:12.638013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-72e374a8-0288-4194-a63a-41c9ba49b1b2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:12.653355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72e374a8-0288-4194-a63a-41c9ba49b1b2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:12.654204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72e374a8-0288-4194-a63a-41c9ba49b1b2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:12.655227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72e374a8-0288-4194-a63a-41c9ba49b1b2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:12.656250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72e374a8-0288-4194-a63a-41c9ba49b1b2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:12.658448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3d854915-3d70-4193-9dc6-4e7c22859c2d req-aff2771d-80ef-4a0f-a893-8cebe1a43738 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:12.659444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72e374a8-0288-4194-a63a-41c9ba49b1b2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:12.660128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72e374a8-0288-4194-a63a-41c9ba49b1b2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:12.663277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3d854915-3d70-4193-9dc6-4e7c22859c2d req-aff2771d-80ef-4a0f-a893-8cebe1a43738 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:12.664006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3d854915-3d70-4193-9dc6-4e7c22859c2d req-aff2771d-80ef-4a0f-a893-8cebe1a43738 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:12.699761 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3d854915-3d70-4193-9dc6-4e7c22859c2d req-aff2771d-80ef-4a0f-a893-8cebe1a43738 service nova] Creating event network-changed:7fb999cd-0b0f-416d-b067-84c25d59f6ce for instance a439a32a-1387-4654-bd15-4de0a4d1e58d on n-h1-850468-16 Aug 23 18:21:12.716886 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3d854915-3d70-4193-9dc6-4e7c22859c2d req-aff2771d-80ef-4a0f-a893-8cebe1a43738 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106297 Aug 23 18:21:12.718783 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2886/5645] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:13.087377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bcb34365-35fb-41d2-83c5-85f3e1dbd537 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:13.088263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bcb34365-35fb-41d2-83c5-85f3e1dbd537 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:13.096442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcb34365-35fb-41d2-83c5-85f3e1dbd537 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:13.097393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcb34365-35fb-41d2-83c5-85f3e1dbd537 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:13.098100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcb34365-35fb-41d2-83c5-85f3e1dbd537 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:13.099022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcb34365-35fb-41d2-83c5-85f3e1dbd537 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:13.099639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcb34365-35fb-41d2-83c5-85f3e1dbd537 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:13.100234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcb34365-35fb-41d2-83c5-85f3e1dbd537 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:13.214454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-bcb34365-35fb-41d2-83c5-85f3e1dbd537 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lazy-loading 'services' on Instance uuid e2c1c0a9-6679-4485-a539-9e2d5b10c64b {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:21:13.396357 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bcb34365-35fb-41d2-83c5-85f3e1dbd537 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments/6beedc9c-9d8b-454d-b21a-b6d34f061c28" status: 202 len: 0 microversion: 2.1 time: 0.299929 Aug 23 18:21:13.405294 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2887/5646] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 18:21:13 2022] DELETE /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments/6beedc9c-9d8b-454d-b21a-b6d34f061c28 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:21:13.436229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9d8f0be-8290-47d0-ae79-4a5f2d65866e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:13.446729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b9d8f0be-8290-47d0-ae79-4a5f2d65866e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:13.456702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9d8f0be-8290-47d0-ae79-4a5f2d65866e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:13.457209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9d8f0be-8290-47d0-ae79-4a5f2d65866e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:13.457655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9d8f0be-8290-47d0-ae79-4a5f2d65866e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:13.461279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9d8f0be-8290-47d0-ae79-4a5f2d65866e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:13.461780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9d8f0be-8290-47d0-ae79-4a5f2d65866e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:13.475237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9d8f0be-8290-47d0-ae79-4a5f2d65866e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:13.536387 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b9d8f0be-8290-47d0-ae79-4a5f2d65866e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.126662 Aug 23 18:21:13.536827 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2888/5647] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:21:13 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments => generated 197 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:13.815502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-72e374a8-0288-4194-a63a-41c9ba49b1b2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:13.836083 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-72e374a8-0288-4194-a63a-41c9ba49b1b2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1469 microversion: 2.1 time: 1.209391 Aug 23 18:21:13.839246 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2760/5648] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:12 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1469 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:14.549408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33bd2e91-6aeb-4c1a-bafb-ea90d310f954 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:14.551792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33bd2e91-6aeb-4c1a-bafb-ea90d310f954 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:14.571101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33bd2e91-6aeb-4c1a-bafb-ea90d310f954 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:14.571616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33bd2e91-6aeb-4c1a-bafb-ea90d310f954 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:14.572068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33bd2e91-6aeb-4c1a-bafb-ea90d310f954 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:14.572800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33bd2e91-6aeb-4c1a-bafb-ea90d310f954 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:14.573260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33bd2e91-6aeb-4c1a-bafb-ea90d310f954 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:14.579226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33bd2e91-6aeb-4c1a-bafb-ea90d310f954 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:14.647642 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-33bd2e91-6aeb-4c1a-bafb-ea90d310f954 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.102810 Aug 23 18:21:14.656750 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2889/5649] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:21:14 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:14.748508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-108f07cf-31c4-4ce6-81de-e0418204e7fb req-330ddfdc-cd95-44a6-86e7-664787186227 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4220478c-eb77-460e-acbd-e1a4d739af9c", "tag": "3b405d96-6035-4d19-babd-6cca1c43298a"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:14.761146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-108f07cf-31c4-4ce6-81de-e0418204e7fb req-330ddfdc-cd95-44a6-86e7-664787186227 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:14.769382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-108f07cf-31c4-4ce6-81de-e0418204e7fb req-330ddfdc-cd95-44a6-86e7-664787186227 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:14.770204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-108f07cf-31c4-4ce6-81de-e0418204e7fb req-330ddfdc-cd95-44a6-86e7-664787186227 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:14.793826 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-108f07cf-31c4-4ce6-81de-e0418204e7fb req-330ddfdc-cd95-44a6-86e7-664787186227 service nova] Creating event network-changed:3b405d96-6035-4d19-babd-6cca1c43298a for instance 4220478c-eb77-460e-acbd-e1a4d739af9c on n-h2-850468-16 Aug 23 18:21:14.807035 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-108f07cf-31c4-4ce6-81de-e0418204e7fb req-330ddfdc-cd95-44a6-86e7-664787186227 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063116 Aug 23 18:21:14.812823 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2761/5650] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:14.864497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-abebbbaf-0a16-4f40-8652-984d19534596 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:14.865817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-abebbbaf-0a16-4f40-8652-984d19534596 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:14.868209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:14.879572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abebbbaf-0a16-4f40-8652-984d19534596 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:14.880389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abebbbaf-0a16-4f40-8652-984d19534596 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:14.881035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abebbbaf-0a16-4f40-8652-984d19534596 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:14.881964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abebbbaf-0a16-4f40-8652-984d19534596 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:14.882646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abebbbaf-0a16-4f40-8652-984d19534596 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:14.883285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abebbbaf-0a16-4f40-8652-984d19534596 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:15.284227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-abebbbaf-0a16-4f40-8652-984d19534596 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:15.303395 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-abebbbaf-0a16-4f40-8652-984d19534596 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1469 microversion: 2.1 time: 0.441419 Aug 23 18:21:15.305115 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2890/5651] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:14 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1469 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:15.662818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49ef0aaf-442c-4b5b-a118-bc9bdb28e5de tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:15.665607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49ef0aaf-442c-4b5b-a118-bc9bdb28e5de tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:15.692695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49ef0aaf-442c-4b5b-a118-bc9bdb28e5de tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:15.693310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49ef0aaf-442c-4b5b-a118-bc9bdb28e5de tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:15.693963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49ef0aaf-442c-4b5b-a118-bc9bdb28e5de tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:15.694905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49ef0aaf-442c-4b5b-a118-bc9bdb28e5de tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:15.699916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49ef0aaf-442c-4b5b-a118-bc9bdb28e5de tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:15.703094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49ef0aaf-442c-4b5b-a118-bc9bdb28e5de tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:15.784300 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49ef0aaf-442c-4b5b-a118-bc9bdb28e5de tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.122791 Aug 23 18:21:15.790387 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2762/5652] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:21:15 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments => generated 197 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:16.338521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00126691-9bb6-4ec3-9598-202b1b989610 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:16.339787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-00126691-9bb6-4ec3-9598-202b1b989610 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:16.363297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:16.377566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00126691-9bb6-4ec3-9598-202b1b989610 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:16.378083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00126691-9bb6-4ec3-9598-202b1b989610 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:16.378531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00126691-9bb6-4ec3-9598-202b1b989610 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:16.379367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00126691-9bb6-4ec3-9598-202b1b989610 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:16.379841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00126691-9bb6-4ec3-9598-202b1b989610 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:16.380443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00126691-9bb6-4ec3-9598-202b1b989610 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:16.796646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9652e8d2-78de-4338-8b25-65aa3a5fbda1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:16.799659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9652e8d2-78de-4338-8b25-65aa3a5fbda1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:16.813677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:16.815240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:16.817677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9652e8d2-78de-4338-8b25-65aa3a5fbda1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:16.821619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9652e8d2-78de-4338-8b25-65aa3a5fbda1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:16.824568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9652e8d2-78de-4338-8b25-65aa3a5fbda1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:16.828044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9652e8d2-78de-4338-8b25-65aa3a5fbda1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:16.829145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9652e8d2-78de-4338-8b25-65aa3a5fbda1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:16.831298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9652e8d2-78de-4338-8b25-65aa3a5fbda1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:16.870513 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9652e8d2-78de-4338-8b25-65aa3a5fbda1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077909 Aug 23 18:21:16.871492 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2763/5653] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:21:16 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:21:16.966291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-00126691-9bb6-4ec3-9598-202b1b989610 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:16.990412 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-00126691-9bb6-4ec3-9598-202b1b989610 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1469 microversion: 2.1 time: 0.662324 Aug 23 18:21:16.992745 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2891/5654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:16 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1469 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:17.883597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d15b4f9-4af2-4a49-b2dc-b5bd39dc4fa9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:17.885996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d15b4f9-4af2-4a49-b2dc-b5bd39dc4fa9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:17.900269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d15b4f9-4af2-4a49-b2dc-b5bd39dc4fa9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:17.911369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d15b4f9-4af2-4a49-b2dc-b5bd39dc4fa9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:17.912498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d15b4f9-4af2-4a49-b2dc-b5bd39dc4fa9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:17.913456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d15b4f9-4af2-4a49-b2dc-b5bd39dc4fa9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:17.914084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d15b4f9-4af2-4a49-b2dc-b5bd39dc4fa9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:17.914740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d15b4f9-4af2-4a49-b2dc-b5bd39dc4fa9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:17.966329 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d15b4f9-4af2-4a49-b2dc-b5bd39dc4fa9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086717 Aug 23 18:21:17.966959 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2764/5655] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:21:17 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:18.020116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fad8ab1b-48be-4c1d-b67e-68081367123a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:18.022112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fad8ab1b-48be-4c1d-b67e-68081367123a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:18.031320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fad8ab1b-48be-4c1d-b67e-68081367123a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:18.032177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fad8ab1b-48be-4c1d-b67e-68081367123a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:18.032929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fad8ab1b-48be-4c1d-b67e-68081367123a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:18.034004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fad8ab1b-48be-4c1d-b67e-68081367123a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:18.034791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fad8ab1b-48be-4c1d-b67e-68081367123a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:18.035518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fad8ab1b-48be-4c1d-b67e-68081367123a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:18.427844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fad8ab1b-48be-4c1d-b67e-68081367123a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:18.443924 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fad8ab1b-48be-4c1d-b67e-68081367123a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1469 microversion: 2.1 time: 0.429969 Aug 23 18:21:18.447584 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2892/5656] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:18 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1469 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:18.978827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ae38e354-7b51-442f-89f0-9bb46a33fca2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:18.981016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ae38e354-7b51-442f-89f0-9bb46a33fca2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:18.989002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae38e354-7b51-442f-89f0-9bb46a33fca2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:19.000391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae38e354-7b51-442f-89f0-9bb46a33fca2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:19.001088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae38e354-7b51-442f-89f0-9bb46a33fca2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:19.004452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae38e354-7b51-442f-89f0-9bb46a33fca2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:19.005127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae38e354-7b51-442f-89f0-9bb46a33fca2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:19.005718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae38e354-7b51-442f-89f0-9bb46a33fca2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:19.023236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:19.107419 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ae38e354-7b51-442f-89f0-9bb46a33fca2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.132454 Aug 23 18:21:19.112137 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2765/5657] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:21:18 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments => generated 197 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:19.472392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-78b43623-9d0a-480f-a6e3-c63e752d9b54 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:19.473916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-78b43623-9d0a-480f-a6e3-c63e752d9b54 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:19.486726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78b43623-9d0a-480f-a6e3-c63e752d9b54 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:19.494175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78b43623-9d0a-480f-a6e3-c63e752d9b54 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:19.494940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78b43623-9d0a-480f-a6e3-c63e752d9b54 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:19.496049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78b43623-9d0a-480f-a6e3-c63e752d9b54 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:19.496723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78b43623-9d0a-480f-a6e3-c63e752d9b54 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:19.497360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78b43623-9d0a-480f-a6e3-c63e752d9b54 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:20.132610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b78a30d-d210-4857-90f9-079f76362ad1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:20.135818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7b78a30d-d210-4857-90f9-079f76362ad1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:20.159098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b78a30d-d210-4857-90f9-079f76362ad1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:20.160108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b78a30d-d210-4857-90f9-079f76362ad1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:20.161346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b78a30d-d210-4857-90f9-079f76362ad1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:20.164544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b78a30d-d210-4857-90f9-079f76362ad1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:20.166152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b78a30d-d210-4857-90f9-079f76362ad1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:20.167233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b78a30d-d210-4857-90f9-079f76362ad1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:20.178557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-78b43623-9d0a-480f-a6e3-c63e752d9b54 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:20.187025 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-78b43623-9d0a-480f-a6e3-c63e752d9b54 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1469 microversion: 2.1 time: 0.719341 Aug 23 18:21:20.189521 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2893/5658] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:19 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1469 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:20.236570 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7b78a30d-d210-4857-90f9-079f76362ad1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.115627 Aug 23 18:21:20.237970 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2766/5659] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:21:20 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments => generated 197 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:21:20.433208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-62f6fceb-8d8e-43e7-bf74-bbf13ffd84e2 req-9bddbf9a-5d4e-4f9b-be60-375fe98cd8ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4220478c-eb77-460e-acbd-e1a4d739af9c", "name": "network-vif-plugged", "status": "completed", "tag": "3b405d96-6035-4d19-babd-6cca1c43298a"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:20.451191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-62f6fceb-8d8e-43e7-bf74-bbf13ffd84e2 req-9bddbf9a-5d4e-4f9b-be60-375fe98cd8ad service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:20.454361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-62f6fceb-8d8e-43e7-bf74-bbf13ffd84e2 req-9bddbf9a-5d4e-4f9b-be60-375fe98cd8ad service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:20.460022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-62f6fceb-8d8e-43e7-bf74-bbf13ffd84e2 req-9bddbf9a-5d4e-4f9b-be60-375fe98cd8ad service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:20.488905 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-62f6fceb-8d8e-43e7-bf74-bbf13ffd84e2 req-9bddbf9a-5d4e-4f9b-be60-375fe98cd8ad service nova] Creating event network-vif-plugged:3b405d96-6035-4d19-babd-6cca1c43298a for instance 4220478c-eb77-460e-acbd-e1a4d739af9c on n-h2-850468-16 Aug 23 18:21:20.500474 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-62f6fceb-8d8e-43e7-bf74-bbf13ffd84e2 req-9bddbf9a-5d4e-4f9b-be60-375fe98cd8ad service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072039 Aug 23 18:21:20.503183 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2894/5660] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:21.210373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-82d9dede-d3a0-43a0-8c26-fcddaeb6dc1d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:21.211024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-82d9dede-d3a0-43a0-8c26-fcddaeb6dc1d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:21.226117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82d9dede-d3a0-43a0-8c26-fcddaeb6dc1d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:21.226936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82d9dede-d3a0-43a0-8c26-fcddaeb6dc1d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:21.227550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82d9dede-d3a0-43a0-8c26-fcddaeb6dc1d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:21.228466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82d9dede-d3a0-43a0-8c26-fcddaeb6dc1d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:21.239381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82d9dede-d3a0-43a0-8c26-fcddaeb6dc1d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:21.239838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82d9dede-d3a0-43a0-8c26-fcddaeb6dc1d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:21.250566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-54bfdc94-205a-4704-8482-97b7a8ad2eb4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:21.255090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-54bfdc94-205a-4704-8482-97b7a8ad2eb4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:21.265184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54bfdc94-205a-4704-8482-97b7a8ad2eb4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:21.267264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54bfdc94-205a-4704-8482-97b7a8ad2eb4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:21.267932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54bfdc94-205a-4704-8482-97b7a8ad2eb4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:21.272110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54bfdc94-205a-4704-8482-97b7a8ad2eb4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:21.272681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54bfdc94-205a-4704-8482-97b7a8ad2eb4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:21.273342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54bfdc94-205a-4704-8482-97b7a8ad2eb4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:21.328576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:21.334154 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-54bfdc94-205a-4704-8482-97b7a8ad2eb4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.088338 Aug 23 18:21:21.335455 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2895/5661] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:21:21 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b/os-volume_attachments => generated 25 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:21:21.409486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7596c9e2-6708-4968-b051-8d405104f1cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:21.410313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7596c9e2-6708-4968-b051-8d405104f1cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:21.418414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7596c9e2-6708-4968-b051-8d405104f1cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:21.419138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7596c9e2-6708-4968-b051-8d405104f1cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:21.419934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7596c9e2-6708-4968-b051-8d405104f1cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:21.421339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7596c9e2-6708-4968-b051-8d405104f1cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:21.422012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7596c9e2-6708-4968-b051-8d405104f1cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:21.422750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7596c9e2-6708-4968-b051-8d405104f1cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:21.463516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7596c9e2-6708-4968-b051-8d405104f1cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:21:21.639735 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7596c9e2-6708-4968-b051-8d405104f1cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 204 len: 0 microversion: 2.1 time: 0.224346 Aug 23 18:21:21.645021 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2896/5662] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:21:21 2022] DELETE /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:21:21.651750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-54573b06-5ed1-4b80-8f7f-d84291a7d4a8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:21.652842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-54573b06-5ed1-4b80-8f7f-d84291a7d4a8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:21.662401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54573b06-5ed1-4b80-8f7f-d84291a7d4a8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:21.663279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54573b06-5ed1-4b80-8f7f-d84291a7d4a8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:21.663887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54573b06-5ed1-4b80-8f7f-d84291a7d4a8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:21.664869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54573b06-5ed1-4b80-8f7f-d84291a7d4a8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:21.665503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54573b06-5ed1-4b80-8f7f-d84291a7d4a8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:21.666102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54573b06-5ed1-4b80-8f7f-d84291a7d4a8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:21.821426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-82d9dede-d3a0-43a0-8c26-fcddaeb6dc1d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:21.839974 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-82d9dede-d3a0-43a0-8c26-fcddaeb6dc1d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1469 microversion: 2.1 time: 0.632103 Aug 23 18:21:21.841783 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2767/5663] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:21 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1469 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:21.994583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-54573b06-5ed1-4b80-8f7f-d84291a7d4a8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:22.007275 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-54573b06-5ed1-4b80-8f7f-d84291a7d4a8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1681 microversion: 2.1 time: 0.360519 Aug 23 18:21:22.008150 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2897/5664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:21 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1681 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:22.864037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47185441-3e5a-4ae3-9f10-9f43e8821867 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:22.865699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-47185441-3e5a-4ae3-9f10-9f43e8821867 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:22.873062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47185441-3e5a-4ae3-9f10-9f43e8821867 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:22.874153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47185441-3e5a-4ae3-9f10-9f43e8821867 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:22.874616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47185441-3e5a-4ae3-9f10-9f43e8821867 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:22.875497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47185441-3e5a-4ae3-9f10-9f43e8821867 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:22.876039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47185441-3e5a-4ae3-9f10-9f43e8821867 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:22.876679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47185441-3e5a-4ae3-9f10-9f43e8821867 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:23.031464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-88315b67-3a35-42a2-8946-d238ede6c0eb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:23.031930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-88315b67-3a35-42a2-8946-d238ede6c0eb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:23.045385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88315b67-3a35-42a2-8946-d238ede6c0eb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:23.045892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88315b67-3a35-42a2-8946-d238ede6c0eb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:23.046768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88315b67-3a35-42a2-8946-d238ede6c0eb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:23.048183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88315b67-3a35-42a2-8946-d238ede6c0eb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:23.051200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88315b67-3a35-42a2-8946-d238ede6c0eb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:23.052378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88315b67-3a35-42a2-8946-d238ede6c0eb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:23.075276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-47185441-3e5a-4ae3-9f10-9f43e8821867 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:23.117312 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-47185441-3e5a-4ae3-9f10-9f43e8821867 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1642 microversion: 2.1 time: 0.259060 Aug 23 18:21:23.122688 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2768/5665] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:22 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1642 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:23.143399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2fe64e2b-6c36-4378-969a-8d3c368afe16 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:23.144068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2fe64e2b-6c36-4378-969a-8d3c368afe16 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:23.166360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fe64e2b-6c36-4378-969a-8d3c368afe16 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:23.167969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fe64e2b-6c36-4378-969a-8d3c368afe16 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:23.173376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fe64e2b-6c36-4378-969a-8d3c368afe16 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:23.175501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fe64e2b-6c36-4378-969a-8d3c368afe16 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:23.176137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fe64e2b-6c36-4378-969a-8d3c368afe16 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:23.177327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fe64e2b-6c36-4378-969a-8d3c368afe16 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:23.412937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-88315b67-3a35-42a2-8946-d238ede6c0eb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:23.422932 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-88315b67-3a35-42a2-8946-d238ede6c0eb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1681 microversion: 2.1 time: 0.396218 Aug 23 18:21:23.423987 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2898/5666] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:23 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1681 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:23.484874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2fe64e2b-6c36-4378-969a-8d3c368afe16 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:23.495055 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2fe64e2b-6c36-4378-969a-8d3c368afe16 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1642 microversion: 2.1 time: 0.359787 Aug 23 18:21:23.496530 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2769/5667] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:23 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1642 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:23.517737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8184fdf4-4ae8-4c68-a71a-11da2fdfe187 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:23.518597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8184fdf4-4ae8-4c68-a71a-11da2fdfe187 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:23.526914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8184fdf4-4ae8-4c68-a71a-11da2fdfe187 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:23.533223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8184fdf4-4ae8-4c68-a71a-11da2fdfe187 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:23.535431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8184fdf4-4ae8-4c68-a71a-11da2fdfe187 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:23.535431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8184fdf4-4ae8-4c68-a71a-11da2fdfe187 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:23.535431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8184fdf4-4ae8-4c68-a71a-11da2fdfe187 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:23.535845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8184fdf4-4ae8-4c68-a71a-11da2fdfe187 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:24.022446 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8184fdf4-4ae8-4c68-a71a-11da2fdfe187 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1795 microversion: 2.1 time: 0.510070 Aug 23 18:21:24.038131 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2899/5668] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:23 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1795 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:24.449134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5e77971-a530-410f-bb95-377912e65a21 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:24.449991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a5e77971-a530-410f-bb95-377912e65a21 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:24.467940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5e77971-a530-410f-bb95-377912e65a21 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:24.469115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5e77971-a530-410f-bb95-377912e65a21 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:24.469934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5e77971-a530-410f-bb95-377912e65a21 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:24.470860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5e77971-a530-410f-bb95-377912e65a21 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:24.472016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5e77971-a530-410f-bb95-377912e65a21 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:24.472608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5e77971-a530-410f-bb95-377912e65a21 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:25.078123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a5e77971-a530-410f-bb95-377912e65a21 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:25.124827 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a5e77971-a530-410f-bb95-377912e65a21 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1681 microversion: 2.1 time: 0.682337 Aug 23 18:21:25.129374 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2770/5669] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:24 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1681 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:26.157917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-59c47195-4796-41e8-a2f5-ee71abb3ee01 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:26.159295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-59c47195-4796-41e8-a2f5-ee71abb3ee01 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:26.182386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59c47195-4796-41e8-a2f5-ee71abb3ee01 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:26.183172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59c47195-4796-41e8-a2f5-ee71abb3ee01 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:26.183929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59c47195-4796-41e8-a2f5-ee71abb3ee01 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:26.184865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59c47195-4796-41e8-a2f5-ee71abb3ee01 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:26.185485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59c47195-4796-41e8-a2f5-ee71abb3ee01 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:26.186530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59c47195-4796-41e8-a2f5-ee71abb3ee01 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:26.337529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-59c47195-4796-41e8-a2f5-ee71abb3ee01 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:26.348435 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-59c47195-4796-41e8-a2f5-ee71abb3ee01 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1613 microversion: 2.1 time: 0.201319 Aug 23 18:21:26.350354 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2900/5670] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:26 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1613 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:27.233323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-5a9fe9cd-408f-43c8-8535-1c139446e48e req-68bd352e-c93c-40fb-8999-5bf2edc93131 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2c1c0a9-6679-4485-a539-9e2d5b10c64b", "name": "network-vif-deleted", "tag": "a6a4fdaf-b1bf-4a1e-a4d7-c4f0f5806cb9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:27.252194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5a9fe9cd-408f-43c8-8535-1c139446e48e req-68bd352e-c93c-40fb-8999-5bf2edc93131 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:27.253330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5a9fe9cd-408f-43c8-8535-1c139446e48e req-68bd352e-c93c-40fb-8999-5bf2edc93131 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:27.254047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5a9fe9cd-408f-43c8-8535-1c139446e48e req-68bd352e-c93c-40fb-8999-5bf2edc93131 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:27.293092 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5a9fe9cd-408f-43c8-8535-1c139446e48e req-68bd352e-c93c-40fb-8999-5bf2edc93131 service nova] Creating event network-vif-deleted:a6a4fdaf-b1bf-4a1e-a4d7-c4f0f5806cb9 for instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b on n-h1-850468-16 Aug 23 18:21:27.306628 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-5a9fe9cd-408f-43c8-8535-1c139446e48e req-68bd352e-c93c-40fb-8999-5bf2edc93131 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079222 Aug 23 18:21:27.309891 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2771/5671] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:27.375137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:27.375764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:27.393899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:27.394779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:27.395409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:27.396450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:27.398821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:27.399523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:27.490555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:27.494352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:27.495158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:27.495774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lazy-loading 'fault' on Instance uuid e2c1c0a9-6679-4485-a539-9e2d5b10c64b {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:21:27.589145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:27.604382 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5559bb88-64b8-422b-ab05-4ef4ef527232 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 200 len: 1330 microversion: 2.1 time: 0.238671 Aug 23 18:21:27.604989 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2901/5672] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:27 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 1330 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:28.649425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-441e4c05-6ac4-4a98-b250-a181b88fba44 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:28.650244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-441e4c05-6ac4-4a98-b250-a181b88fba44 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:28.658956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-441e4c05-6ac4-4a98-b250-a181b88fba44 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:28.659484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-441e4c05-6ac4-4a98-b250-a181b88fba44 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:28.660064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-441e4c05-6ac4-4a98-b250-a181b88fba44 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:28.662316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-441e4c05-6ac4-4a98-b250-a181b88fba44 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:28.662895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-441e4c05-6ac4-4a98-b250-a181b88fba44 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:28.663693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-441e4c05-6ac4-4a98-b250-a181b88fba44 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:28.686087 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-441e4c05-6ac4-4a98-b250-a181b88fba44 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-441e4c05-6ac4-4a98-b250-a181b88fba44 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b HTTP/1.1 Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'e2c1c0a9-6679-4485-a539-9e2d5b10c64b'} Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:21:28.688934 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:28.693676 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:21:28.693676 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:21:28.693676 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:21:28.693676 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:21:28.693676 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:21:28.693676 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:21:28.693676 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:21:28.695352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-441e4c05-6ac4-4a98-b250-a181b88fba44 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 404 to user: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:21:28.696632 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-441e4c05-6ac4-4a98-b250-a181b88fba44 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 404 len: 111 microversion: 2.1 time: 0.061579 Aug 23 18:21:28.697704 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2772/5673] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:28 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:21:28.706456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9fe65a01-cbee-4561-a996-4e2b4b7acba4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '.version_select at 0x7f27df57ae50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:28.753429 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9fe65a01-cbee-4561-a996-4e2b4b7acba4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-85746087" status: 202 len: 0 microversion: 2.1 time: 0.050764 Aug 23 18:21:28.754634 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2902/5674] 10.222.0.61 () {58 vars in 1215 bytes} [Tue Aug 23 18:21:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-85746087 => generated 0 bytes in 53 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:21:30.379121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8c9705b7-3412-4ef5-9a31-61638e1ed953 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: .version_select at 0x7f27dfa8fdc0>, body: {"keypair": {"name": "tempest-keypair-564117457", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKs8wqyA1H0r35WanVTiARIuiRtCm4dV1gd1zd3nfkG7G2iMWXNEykQpbIlG0L7+t21PYmlYsoPUGfMw/acQb+C+xlfg4cjp6JsYYW/7Gy/eBJu8Wp6I5IAaiGOp26KTMw=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:30.419708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-8c9705b7-3412-4ef5-9a31-61638e1ed953 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:21:30.425877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-8c9705b7-3412-4ef5-9a31-61638e1ed953 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for user a11d6c5120f24a448c1831ff925409c3 and project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:21:30.466710 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8c9705b7-3412-4ef5-9a31-61638e1ed953 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.091264 Aug 23 18:21:30.468852 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2773/5675] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:21:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:31.476189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f9e604b2-5b4e-47fe-907a-86a3a5cbac8a req-7cec299f-cfed-4d54-b5f5-1da15bdcdf7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4220478c-eb77-460e-acbd-e1a4d739af9c", "tag": "3b405d96-6035-4d19-babd-6cca1c43298a"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:31.540929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f9e604b2-5b4e-47fe-907a-86a3a5cbac8a req-7cec299f-cfed-4d54-b5f5-1da15bdcdf7c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:31.541562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f9e604b2-5b4e-47fe-907a-86a3a5cbac8a req-7cec299f-cfed-4d54-b5f5-1da15bdcdf7c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:31.542280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f9e604b2-5b4e-47fe-907a-86a3a5cbac8a req-7cec299f-cfed-4d54-b5f5-1da15bdcdf7c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:31.587854 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f9e604b2-5b4e-47fe-907a-86a3a5cbac8a req-7cec299f-cfed-4d54-b5f5-1da15bdcdf7c service nova] Creating event network-changed:3b405d96-6035-4d19-babd-6cca1c43298a for instance 4220478c-eb77-460e-acbd-e1a4d739af9c on n-h2-850468-16 Aug 23 18:21:31.599687 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f9e604b2-5b4e-47fe-907a-86a3a5cbac8a req-7cec299f-cfed-4d54-b5f5-1da15bdcdf7c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128539 Aug 23 18:21:31.600903 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2903/5676] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:21:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:21:36.188349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1710780952", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80f627cf-1c5b-45c1-a064-49e8b550df67"}], "security_groups": [{"name": "tempest-securitygroup--484276125"}], "key_name": "tempest-keypair-564117457", "user_data": "}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:36.465011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] validate_networks() for [('80f627cf-1c5b-45c1-a064-49e8b550df67', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:21:37.831985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:21:37.832547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:21:37.832886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:21:37.833312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:21:37.833726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:21:37.865417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:37.866310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:37.867096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:37.868343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:37.868926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:37.869261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:37.925336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:21:37.935047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for user a11d6c5120f24a448c1831ff925409c3 and project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:21:37.962971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:21:37.965414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:21:38.098577 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d54555e-26f2-4739-837a-b9fb0e8c5455 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.916482 Aug 23 18:21:38.108423 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2774/5677] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:21:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:21:38.120167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ef9410d8-c1f9-4f32-ab52-d9d47cfb9682 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:38.121582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ef9410d8-c1f9-4f32-ab52-d9d47cfb9682 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:38.272728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ef9410d8-c1f9-4f32-ab52-d9d47cfb9682 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:38.284396 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ef9410d8-c1f9-4f32-ab52-d9d47cfb9682 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1241 microversion: 2.1 time: 0.170167 Aug 23 18:21:38.287808 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2904/5678] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:38 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1241 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:39.106090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1535258922", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "68ce5121-678b-4517-ba2c-957ca7c12ee0"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:39.249308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] validate_networks() for [('68ce5121-678b-4517-ba2c-957ca7c12ee0', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:21:39.313944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c8c3942-35b7-4389-b804-c572b8d4b921 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:39.315051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1c8c3942-35b7-4389-b804-c572b8d4b921 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:39.347421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c8c3942-35b7-4389-b804-c572b8d4b921 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:39.348166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c8c3942-35b7-4389-b804-c572b8d4b921 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:39.348833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c8c3942-35b7-4389-b804-c572b8d4b921 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:39.349629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c8c3942-35b7-4389-b804-c572b8d4b921 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:39.351628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c8c3942-35b7-4389-b804-c572b8d4b921 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:39.352578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c8c3942-35b7-4389-b804-c572b8d4b921 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:39.440234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c8c3942-35b7-4389-b804-c572b8d4b921 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:39.463974 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c8c3942-35b7-4389-b804-c572b8d4b921 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1293 microversion: 2.1 time: 0.154330 Aug 23 18:21:39.473443 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2905/5679] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:39 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1293 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:40.496897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c92aac8d-cc88-412c-a7c2-4ad6b5e603f7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:40.504688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c92aac8d-cc88-412c-a7c2-4ad6b5e603f7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:40.514448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c92aac8d-cc88-412c-a7c2-4ad6b5e603f7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:40.520127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c92aac8d-cc88-412c-a7c2-4ad6b5e603f7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:40.521169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c92aac8d-cc88-412c-a7c2-4ad6b5e603f7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:40.523701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c92aac8d-cc88-412c-a7c2-4ad6b5e603f7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:40.526411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c92aac8d-cc88-412c-a7c2-4ad6b5e603f7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:40.528637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c92aac8d-cc88-412c-a7c2-4ad6b5e603f7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:40.662735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c92aac8d-cc88-412c-a7c2-4ad6b5e603f7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:40.674053 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c92aac8d-cc88-412c-a7c2-4ad6b5e603f7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1299 microversion: 2.1 time: 0.182043 Aug 23 18:21:40.682654 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2906/5680] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:40 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1299 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:40.897707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:21:40.898362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:21:40.899256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:21:40.899731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:21:40.900207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:21:40.902876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:40.917903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:40.918698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:40.919513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:40.921500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:40.922759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:40.923451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:40.948332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Getting quotas for project 41f4e8e13960468dbdaf601e0141db0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:21:40.954815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Getting quotas for user d175596a3d804183b2388a25ab9a1018 and project 41f4e8e13960468dbdaf601e0141db0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:21:40.971471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:21:40.974239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:21:41.039895 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-33162da2-2dcd-40d2-9cbc-ffb0cee82531 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.156957 Aug 23 18:21:41.041518 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2775/5681] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:21:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 2160 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:21:41.053246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04da5cbe-d835-449a-b5bc-50ef0e4ad53c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:41.053637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-04da5cbe-d835-449a-b5bc-50ef0e4ad53c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:41.262714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-04da5cbe-d835-449a-b5bc-50ef0e4ad53c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:41.297536 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-04da5cbe-d835-449a-b5bc-50ef0e4ad53c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1218 microversion: 2.1 time: 0.248262 Aug 23 18:21:41.310183 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2907/5682] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:41 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1218 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:41.697712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b25f4f37-26dd-4835-843f-1a320bd0338b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:41.698809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b25f4f37-26dd-4835-843f-1a320bd0338b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:41.709668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b25f4f37-26dd-4835-843f-1a320bd0338b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:41.713332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b25f4f37-26dd-4835-843f-1a320bd0338b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:41.715673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b25f4f37-26dd-4835-843f-1a320bd0338b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:41.718629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b25f4f37-26dd-4835-843f-1a320bd0338b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:41.719379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b25f4f37-26dd-4835-843f-1a320bd0338b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:41.721878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b25f4f37-26dd-4835-843f-1a320bd0338b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:41.918068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b25f4f37-26dd-4835-843f-1a320bd0338b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:41.931267 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b25f4f37-26dd-4835-843f-1a320bd0338b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1299 microversion: 2.1 time: 0.237669 Aug 23 18:21:41.931854 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2776/5683] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:41 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1299 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:42.333880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-687f7403-a4ff-440f-bbc2-a1300b76b166 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:42.334514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-687f7403-a4ff-440f-bbc2-a1300b76b166 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:42.351875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-687f7403-a4ff-440f-bbc2-a1300b76b166 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:42.352001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-687f7403-a4ff-440f-bbc2-a1300b76b166 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:42.352393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-687f7403-a4ff-440f-bbc2-a1300b76b166 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:42.353114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-687f7403-a4ff-440f-bbc2-a1300b76b166 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:42.353571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-687f7403-a4ff-440f-bbc2-a1300b76b166 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:42.364921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-687f7403-a4ff-440f-bbc2-a1300b76b166 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:42.627620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-687f7403-a4ff-440f-bbc2-a1300b76b166 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:42.636489 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-687f7403-a4ff-440f-bbc2-a1300b76b166 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1270 microversion: 2.1 time: 0.306891 Aug 23 18:21:42.640801 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2908/5684] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:42 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1270 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:42.953435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ac834309-adc0-4059-8bd6-18a94a3a3166 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:42.954080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ac834309-adc0-4059-8bd6-18a94a3a3166 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:42.966982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac834309-adc0-4059-8bd6-18a94a3a3166 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:42.967870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac834309-adc0-4059-8bd6-18a94a3a3166 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:42.972611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac834309-adc0-4059-8bd6-18a94a3a3166 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:42.973634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac834309-adc0-4059-8bd6-18a94a3a3166 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:42.974270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac834309-adc0-4059-8bd6-18a94a3a3166 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:42.975048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac834309-adc0-4059-8bd6-18a94a3a3166 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:43.265087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7b87843-e309-432e-b5bd-129b0fb445ba tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:43.267613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c7b87843-e309-432e-b5bd-129b0fb445ba tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:43.286208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7b87843-e309-432e-b5bd-129b0fb445ba tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:43.286821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7b87843-e309-432e-b5bd-129b0fb445ba tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:43.287285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7b87843-e309-432e-b5bd-129b0fb445ba tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:43.288042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7b87843-e309-432e-b5bd-129b0fb445ba tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:43.288579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7b87843-e309-432e-b5bd-129b0fb445ba tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:43.289020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7b87843-e309-432e-b5bd-129b0fb445ba tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:43.375879 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c7b87843-e309-432e-b5bd-129b0fb445ba tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "POST /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d/action" status: 200 len: 24570 microversion: 2.1 time: 0.116076 Aug 23 18:21:43.383134 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2909/5685] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:21:43 2022] POST /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d/action => generated 24570 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:21:43.644147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ac834309-adc0-4059-8bd6-18a94a3a3166 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:43.652784 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ac834309-adc0-4059-8bd6-18a94a3a3166 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1366 microversion: 2.1 time: 0.703664 Aug 23 18:21:43.666569 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2777/5686] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:42 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1366 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:43.667066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c32cbc22-ebca-4c53-bd3c-5f4260e3c1a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:43.667066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c32cbc22-ebca-4c53-bd3c-5f4260e3c1a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:43.683898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c32cbc22-ebca-4c53-bd3c-5f4260e3c1a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:43.684420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c32cbc22-ebca-4c53-bd3c-5f4260e3c1a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:43.684879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c32cbc22-ebca-4c53-bd3c-5f4260e3c1a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:43.686179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c32cbc22-ebca-4c53-bd3c-5f4260e3c1a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:43.686677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c32cbc22-ebca-4c53-bd3c-5f4260e3c1a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:43.687119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c32cbc22-ebca-4c53-bd3c-5f4260e3c1a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:43.932153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c32cbc22-ebca-4c53-bd3c-5f4260e3c1a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:43.963865 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c32cbc22-ebca-4c53-bd3c-5f4260e3c1a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1276 microversion: 2.1 time: 0.302899 Aug 23 18:21:43.965144 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2910/5687] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:43 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1276 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:44.678416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dcfbe3b1-e3dc-4339-b71e-ba5814a213ee tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:44.679083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dcfbe3b1-e3dc-4339-b71e-ba5814a213ee tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:44.690263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcfbe3b1-e3dc-4339-b71e-ba5814a213ee tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:44.693948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcfbe3b1-e3dc-4339-b71e-ba5814a213ee tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:44.694691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcfbe3b1-e3dc-4339-b71e-ba5814a213ee tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:44.695606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcfbe3b1-e3dc-4339-b71e-ba5814a213ee tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:44.703327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcfbe3b1-e3dc-4339-b71e-ba5814a213ee tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:44.704060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcfbe3b1-e3dc-4339-b71e-ba5814a213ee tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:44.987371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ad906e91-3329-4987-b26f-93e587288a4a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:44.989620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ad906e91-3329-4987-b26f-93e587288a4a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:44.995917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:45.019711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad906e91-3329-4987-b26f-93e587288a4a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:45.020422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad906e91-3329-4987-b26f-93e587288a4a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:45.021527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad906e91-3329-4987-b26f-93e587288a4a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:45.022292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad906e91-3329-4987-b26f-93e587288a4a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:45.022798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad906e91-3329-4987-b26f-93e587288a4a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:45.023394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ad906e91-3329-4987-b26f-93e587288a4a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:45.090728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dcfbe3b1-e3dc-4339-b71e-ba5814a213ee tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:45.119179 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dcfbe3b1-e3dc-4339-b71e-ba5814a213ee tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1366 microversion: 2.1 time: 0.443837 Aug 23 18:21:45.119785 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2778/5688] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:44 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:45.943440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ad906e91-3329-4987-b26f-93e587288a4a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:45.959574 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ad906e91-3329-4987-b26f-93e587288a4a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1318 microversion: 2.1 time: 0.974401 Aug 23 18:21:45.976746 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2911/5689] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:44 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1318 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:21:46.030652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-a6ca89f9-783a-43ee-9019-f9a21714d070 req-e5de35aa-29c7-49c7-a7e9-25f81a1fdf9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454f6367-fca5-4f24-b48e-4c1ea5603c29", "tag": "1c075ec6-d5ef-40f7-adc0-9c451365ccf9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:46.046916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a6ca89f9-783a-43ee-9019-f9a21714d070 req-e5de35aa-29c7-49c7-a7e9-25f81a1fdf9d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:46.047302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a6ca89f9-783a-43ee-9019-f9a21714d070 req-e5de35aa-29c7-49c7-a7e9-25f81a1fdf9d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:46.047987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a6ca89f9-783a-43ee-9019-f9a21714d070 req-e5de35aa-29c7-49c7-a7e9-25f81a1fdf9d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:46.082275 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-a6ca89f9-783a-43ee-9019-f9a21714d070 req-e5de35aa-29c7-49c7-a7e9-25f81a1fdf9d service nova] Creating event network-changed:1c075ec6-d5ef-40f7-adc0-9c451365ccf9 for instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 on n-h2-850468-16 Aug 23 18:21:46.090243 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-a6ca89f9-783a-43ee-9019-f9a21714d070 req-e5de35aa-29c7-49c7-a7e9-25f81a1fdf9d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065051 Aug 23 18:21:46.095537 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2779/5690] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:46.142237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-da28ccb7-e0b1-4d2a-b954-ae90c6c46a45 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:46.143535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-da28ccb7-e0b1-4d2a-b954-ae90c6c46a45 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:46.163131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da28ccb7-e0b1-4d2a-b954-ae90c6c46a45 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:46.163868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da28ccb7-e0b1-4d2a-b954-ae90c6c46a45 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:46.164580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da28ccb7-e0b1-4d2a-b954-ae90c6c46a45 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:46.166151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da28ccb7-e0b1-4d2a-b954-ae90c6c46a45 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:46.167791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da28ccb7-e0b1-4d2a-b954-ae90c6c46a45 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:46.168583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da28ccb7-e0b1-4d2a-b954-ae90c6c46a45 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:46.228023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ee31263e-6fd5-4a36-826e-bbffa8702eae req-9db3d2bd-aad2-4f12-97a3-a8ff1faa5eaa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f9d20f3-bb14-4021-9ee1-d921cdc4fe05", "tag": "dab328d0-fc26-4012-91a4-3e9081bc9057"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:46.242514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ee31263e-6fd5-4a36-826e-bbffa8702eae req-9db3d2bd-aad2-4f12-97a3-a8ff1faa5eaa service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:46.243301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ee31263e-6fd5-4a36-826e-bbffa8702eae req-9db3d2bd-aad2-4f12-97a3-a8ff1faa5eaa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:46.243900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ee31263e-6fd5-4a36-826e-bbffa8702eae req-9db3d2bd-aad2-4f12-97a3-a8ff1faa5eaa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:46.258212 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ee31263e-6fd5-4a36-826e-bbffa8702eae req-9db3d2bd-aad2-4f12-97a3-a8ff1faa5eaa service nova] Creating event network-changed:dab328d0-fc26-4012-91a4-3e9081bc9057 for instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 on n-h1-850468-16 Aug 23 18:21:46.264440 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ee31263e-6fd5-4a36-826e-bbffa8702eae req-9db3d2bd-aad2-4f12-97a3-a8ff1faa5eaa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040390 Aug 23 18:21:46.265817 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2780/5691] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:46.903915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-da28ccb7-e0b1-4d2a-b954-ae90c6c46a45 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:46.913666 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-da28ccb7-e0b1-4d2a-b954-ae90c6c46a45 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1366 microversion: 2.1 time: 0.776103 Aug 23 18:21:46.914260 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2912/5692] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:46 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1366 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:46.984227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-04f45f6d-e8d5-4e80-97a2-a9f5ece67c1d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:46.985216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-04f45f6d-e8d5-4e80-97a2-a9f5ece67c1d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:46.992423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04f45f6d-e8d5-4e80-97a2-a9f5ece67c1d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:46.993248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04f45f6d-e8d5-4e80-97a2-a9f5ece67c1d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:46.993891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04f45f6d-e8d5-4e80-97a2-a9f5ece67c1d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:46.994810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04f45f6d-e8d5-4e80-97a2-a9f5ece67c1d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:46.995435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04f45f6d-e8d5-4e80-97a2-a9f5ece67c1d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:46.996030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04f45f6d-e8d5-4e80-97a2-a9f5ece67c1d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:47.147616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-04f45f6d-e8d5-4e80-97a2-a9f5ece67c1d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:47.157697 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-04f45f6d-e8d5-4e80-97a2-a9f5ece67c1d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1318 microversion: 2.1 time: 0.177878 Aug 23 18:21:47.158460 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2781/5693] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:46 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:47.934327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1a3f8aea-20dc-42db-8605-333a42b924f1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:47.934980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1a3f8aea-20dc-42db-8605-333a42b924f1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:47.943774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a3f8aea-20dc-42db-8605-333a42b924f1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:47.944280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a3f8aea-20dc-42db-8605-333a42b924f1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:47.944819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a3f8aea-20dc-42db-8605-333a42b924f1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:47.945539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a3f8aea-20dc-42db-8605-333a42b924f1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:47.946153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a3f8aea-20dc-42db-8605-333a42b924f1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:47.946619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a3f8aea-20dc-42db-8605-333a42b924f1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:48.183044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1a3f8aea-20dc-42db-8605-333a42b924f1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:48.187421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e9625dce-73dc-4a33-927b-0bd75599fc50 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:48.193958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e9625dce-73dc-4a33-927b-0bd75599fc50 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:48.204470 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1a3f8aea-20dc-42db-8605-333a42b924f1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1366 microversion: 2.1 time: 0.274032 Aug 23 18:21:48.210275 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2913/5694] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:47 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1366 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:48.211026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9625dce-73dc-4a33-927b-0bd75599fc50 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:48.211746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9625dce-73dc-4a33-927b-0bd75599fc50 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:48.212385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9625dce-73dc-4a33-927b-0bd75599fc50 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:48.213290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9625dce-73dc-4a33-927b-0bd75599fc50 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:48.213928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9625dce-73dc-4a33-927b-0bd75599fc50 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:48.214578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9625dce-73dc-4a33-927b-0bd75599fc50 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:48.489011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e9625dce-73dc-4a33-927b-0bd75599fc50 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:48.499104 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e9625dce-73dc-4a33-927b-0bd75599fc50 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1318 microversion: 2.1 time: 0.321091 Aug 23 18:21:48.500975 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2782/5695] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:48 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1318 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:49.230435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fc5f494e-5627-4c23-b7e6-1294d7970127 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:49.231088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fc5f494e-5627-4c23-b7e6-1294d7970127 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:49.238613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc5f494e-5627-4c23-b7e6-1294d7970127 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:49.240068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc5f494e-5627-4c23-b7e6-1294d7970127 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:49.240068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc5f494e-5627-4c23-b7e6-1294d7970127 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:49.240801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc5f494e-5627-4c23-b7e6-1294d7970127 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:49.241434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc5f494e-5627-4c23-b7e6-1294d7970127 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:49.242025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc5f494e-5627-4c23-b7e6-1294d7970127 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:49.268441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:49.497134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fc5f494e-5627-4c23-b7e6-1294d7970127 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:49.510897 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fc5f494e-5627-4c23-b7e6-1294d7970127 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1366 microversion: 2.1 time: 0.284221 Aug 23 18:21:49.521538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ebdf50a-eab5-49aa-b870-61534c680c5b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:49.523026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8ebdf50a-eab5-49aa-b870-61534c680c5b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:49.526099 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2914/5696] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:49 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:21:49.539563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ebdf50a-eab5-49aa-b870-61534c680c5b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:49.540273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ebdf50a-eab5-49aa-b870-61534c680c5b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:49.543247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ebdf50a-eab5-49aa-b870-61534c680c5b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:49.545286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ebdf50a-eab5-49aa-b870-61534c680c5b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:49.545893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ebdf50a-eab5-49aa-b870-61534c680c5b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:49.546880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ebdf50a-eab5-49aa-b870-61534c680c5b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:49.579648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=78 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:50.333590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8ebdf50a-eab5-49aa-b870-61534c680c5b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:50.350752 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8ebdf50a-eab5-49aa-b870-61534c680c5b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1318 microversion: 2.1 time: 0.833338 Aug 23 18:21:50.356314 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2783/5697] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:49 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1318 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:50.536968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aaf5301f-ace0-44b3-a8ec-c0c23f72938e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:50.537587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aaf5301f-ace0-44b3-a8ec-c0c23f72938e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:50.556396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaf5301f-ace0-44b3-a8ec-c0c23f72938e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:50.557287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaf5301f-ace0-44b3-a8ec-c0c23f72938e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:50.558119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaf5301f-ace0-44b3-a8ec-c0c23f72938e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:50.559244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaf5301f-ace0-44b3-a8ec-c0c23f72938e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:50.559889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaf5301f-ace0-44b3-a8ec-c0c23f72938e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:50.560574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aaf5301f-ace0-44b3-a8ec-c0c23f72938e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:50.907497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aaf5301f-ace0-44b3-a8ec-c0c23f72938e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:50.917221 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aaf5301f-ace0-44b3-a8ec-c0c23f72938e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1366 microversion: 2.1 time: 0.383797 Aug 23 18:21:50.919324 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2915/5698] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:50 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1366 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:51.376299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2fe7e9f1-59ba-4667-9e74-6777fcb62034 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:51.376921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2fe7e9f1-59ba-4667-9e74-6777fcb62034 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:51.379824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:51.380493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=16 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:51.387179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fe7e9f1-59ba-4667-9e74-6777fcb62034 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:51.387677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fe7e9f1-59ba-4667-9e74-6777fcb62034 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:51.388146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fe7e9f1-59ba-4667-9e74-6777fcb62034 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:51.389447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fe7e9f1-59ba-4667-9e74-6777fcb62034 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:51.389906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fe7e9f1-59ba-4667-9e74-6777fcb62034 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:51.390332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fe7e9f1-59ba-4667-9e74-6777fcb62034 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:51.585557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2fe7e9f1-59ba-4667-9e74-6777fcb62034 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:51.605554 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2fe7e9f1-59ba-4667-9e74-6777fcb62034 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1318 microversion: 2.1 time: 0.231117 Aug 23 18:21:51.608755 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2784/5699] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:51 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1318 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:51.943341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-068c6390-79a4-43b4-b245-3cd467bd1b6b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:51.945552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-068c6390-79a4-43b4-b245-3cd467bd1b6b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:51.958285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:21:51.963332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-068c6390-79a4-43b4-b245-3cd467bd1b6b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:51.964127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-068c6390-79a4-43b4-b245-3cd467bd1b6b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:51.964803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-068c6390-79a4-43b4-b245-3cd467bd1b6b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:51.967029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-068c6390-79a4-43b4-b245-3cd467bd1b6b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:51.967758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-068c6390-79a4-43b4-b245-3cd467bd1b6b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:51.968456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-068c6390-79a4-43b4-b245-3cd467bd1b6b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:52.224075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-068c6390-79a4-43b4-b245-3cd467bd1b6b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:52.232686 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-068c6390-79a4-43b4-b245-3cd467bd1b6b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1366 microversion: 2.1 time: 0.297734 Aug 23 18:21:52.245847 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2916/5700] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:51 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:52.540052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4f38eaf1-6423-4ea1-a2da-f2bc864a082d req-91b0ef72-e79e-4b0a-aa7c-841125eba4a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9d20f3-bb14-4021-9ee1-d921cdc4fe05", "name": "network-vif-plugged", "status": "completed", "tag": "dab328d0-fc26-4012-91a4-3e9081bc9057"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:52.554559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4f38eaf1-6423-4ea1-a2da-f2bc864a082d req-91b0ef72-e79e-4b0a-aa7c-841125eba4a7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:52.555120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4f38eaf1-6423-4ea1-a2da-f2bc864a082d req-91b0ef72-e79e-4b0a-aa7c-841125eba4a7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:52.555738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4f38eaf1-6423-4ea1-a2da-f2bc864a082d req-91b0ef72-e79e-4b0a-aa7c-841125eba4a7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:52.569739 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4f38eaf1-6423-4ea1-a2da-f2bc864a082d req-91b0ef72-e79e-4b0a-aa7c-841125eba4a7 service nova] Creating event network-vif-plugged:dab328d0-fc26-4012-91a4-3e9081bc9057 for instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 on n-h1-850468-16 Aug 23 18:21:52.575740 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4f38eaf1-6423-4ea1-a2da-f2bc864a082d req-91b0ef72-e79e-4b0a-aa7c-841125eba4a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039605 Aug 23 18:21:52.577086 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2785/5701] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:52.637187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-283d44bc-aab5-49db-8b4b-af961a38be72 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:52.637683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-283d44bc-aab5-49db-8b4b-af961a38be72 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:52.647192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-283d44bc-aab5-49db-8b4b-af961a38be72 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:52.647777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-283d44bc-aab5-49db-8b4b-af961a38be72 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:52.648584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-283d44bc-aab5-49db-8b4b-af961a38be72 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:52.649526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-283d44bc-aab5-49db-8b4b-af961a38be72 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:52.650187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-283d44bc-aab5-49db-8b4b-af961a38be72 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:52.650929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-283d44bc-aab5-49db-8b4b-af961a38be72 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:52.813158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-283d44bc-aab5-49db-8b4b-af961a38be72 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:52.825309 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-283d44bc-aab5-49db-8b4b-af961a38be72 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1318 microversion: 2.1 time: 0.199663 Aug 23 18:21:52.827828 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2917/5702] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:52 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:53.254464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-782df1c1-3599-4187-a637-38b83bf334fb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:53.255137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-782df1c1-3599-4187-a637-38b83bf334fb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:53.261755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-782df1c1-3599-4187-a637-38b83bf334fb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:53.262255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-782df1c1-3599-4187-a637-38b83bf334fb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:53.262935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-782df1c1-3599-4187-a637-38b83bf334fb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:53.264276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-782df1c1-3599-4187-a637-38b83bf334fb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:53.264909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-782df1c1-3599-4187-a637-38b83bf334fb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:53.265499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-782df1c1-3599-4187-a637-38b83bf334fb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:53.422278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-782df1c1-3599-4187-a637-38b83bf334fb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:53.433144 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-782df1c1-3599-4187-a637-38b83bf334fb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1366 microversion: 2.1 time: 0.183016 Aug 23 18:21:53.436047 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2786/5703] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:53 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:53.847829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-df9324ad-a0c3-4d88-bc1e-1ce30df43055 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:53.849344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-df9324ad-a0c3-4d88-bc1e-1ce30df43055 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:53.862631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df9324ad-a0c3-4d88-bc1e-1ce30df43055 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:53.872176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df9324ad-a0c3-4d88-bc1e-1ce30df43055 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:53.874017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df9324ad-a0c3-4d88-bc1e-1ce30df43055 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:53.875352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df9324ad-a0c3-4d88-bc1e-1ce30df43055 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:53.876151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df9324ad-a0c3-4d88-bc1e-1ce30df43055 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:53.876885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df9324ad-a0c3-4d88-bc1e-1ce30df43055 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:54.144657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-df9324ad-a0c3-4d88-bc1e-1ce30df43055 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:54.159688 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-df9324ad-a0c3-4d88-bc1e-1ce30df43055 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1318 microversion: 2.1 time: 0.315846 Aug 23 18:21:54.160537 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2918/5704] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:53 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:54.457249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-27791ee0-6b81-412d-a6f2-99dea662c7ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:54.458691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-27791ee0-6b81-412d-a6f2-99dea662c7ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:54.467390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27791ee0-6b81-412d-a6f2-99dea662c7ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:54.468622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27791ee0-6b81-412d-a6f2-99dea662c7ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:54.469171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27791ee0-6b81-412d-a6f2-99dea662c7ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:54.469997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27791ee0-6b81-412d-a6f2-99dea662c7ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:54.470686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27791ee0-6b81-412d-a6f2-99dea662c7ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:54.471477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27791ee0-6b81-412d-a6f2-99dea662c7ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:54.647354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-27791ee0-6b81-412d-a6f2-99dea662c7ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:54.656580 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-27791ee0-6b81-412d-a6f2-99dea662c7ca tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1366 microversion: 2.1 time: 0.203624 Aug 23 18:21:54.657394 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2787/5705] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:54 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:21:54.958429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-1c50f420-9a78-42c7-bb00-8852ff607c8a req-4b2f5a67-3569-4e79-9602-86350e2fab3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454f6367-fca5-4f24-b48e-4c1ea5603c29", "name": "network-vif-plugged", "status": "completed", "tag": "1c075ec6-d5ef-40f7-adc0-9c451365ccf9"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:54.978630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1c50f420-9a78-42c7-bb00-8852ff607c8a req-4b2f5a67-3569-4e79-9602-86350e2fab3a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:54.979345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1c50f420-9a78-42c7-bb00-8852ff607c8a req-4b2f5a67-3569-4e79-9602-86350e2fab3a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:54.979944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1c50f420-9a78-42c7-bb00-8852ff607c8a req-4b2f5a67-3569-4e79-9602-86350e2fab3a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:54.993656 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-1c50f420-9a78-42c7-bb00-8852ff607c8a req-4b2f5a67-3569-4e79-9602-86350e2fab3a service nova] Creating event network-vif-plugged:1c075ec6-d5ef-40f7-adc0-9c451365ccf9 for instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 on n-h2-850468-16 Aug 23 18:21:54.999298 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-1c50f420-9a78-42c7-bb00-8852ff607c8a req-4b2f5a67-3569-4e79-9602-86350e2fab3a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045833 Aug 23 18:21:54.999920 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2919/5706] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:21:55.185625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c224f3b1-9988-416f-a00c-605b64c8673b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:55.186884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c224f3b1-9988-416f-a00c-605b64c8673b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:55.194311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c224f3b1-9988-416f-a00c-605b64c8673b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:55.195130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c224f3b1-9988-416f-a00c-605b64c8673b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:55.195678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c224f3b1-9988-416f-a00c-605b64c8673b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:55.196525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c224f3b1-9988-416f-a00c-605b64c8673b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:55.197216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c224f3b1-9988-416f-a00c-605b64c8673b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:55.197871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c224f3b1-9988-416f-a00c-605b64c8673b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:55.341677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c224f3b1-9988-416f-a00c-605b64c8673b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:55.350011 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c224f3b1-9988-416f-a00c-605b64c8673b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1509 microversion: 2.1 time: 0.170409 Aug 23 18:21:55.350715 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2788/5707] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:55 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:55.371362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-87d49150-e2f2-4534-b3e6-c3454189514d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:55.372123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-87d49150-e2f2-4534-b3e6-c3454189514d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:55.380470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87d49150-e2f2-4534-b3e6-c3454189514d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:55.380966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87d49150-e2f2-4534-b3e6-c3454189514d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:55.381405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87d49150-e2f2-4534-b3e6-c3454189514d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:55.382109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87d49150-e2f2-4534-b3e6-c3454189514d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:55.382587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87d49150-e2f2-4534-b3e6-c3454189514d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:55.383021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-87d49150-e2f2-4534-b3e6-c3454189514d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:55.647948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-87d49150-e2f2-4534-b3e6-c3454189514d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:55.656997 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-87d49150-e2f2-4534-b3e6-c3454189514d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1509 microversion: 2.1 time: 0.290407 Aug 23 18:21:55.657940 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2920/5708] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:55 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:55.681614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd82d34f-2fc5-4e73-804e-c75d84a37e71 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:55.682286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd82d34f-2fc5-4e73-804e-c75d84a37e71 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:55.682528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:21:55.685574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:55.691079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd82d34f-2fc5-4e73-804e-c75d84a37e71 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:55.691830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd82d34f-2fc5-4e73-804e-c75d84a37e71 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:55.691980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:55.692482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:55.692616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd82d34f-2fc5-4e73-804e-c75d84a37e71 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:55.692933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:55.693449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd82d34f-2fc5-4e73-804e-c75d84a37e71 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:55.693641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:55.694035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd82d34f-2fc5-4e73-804e-c75d84a37e71 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:55.694531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd82d34f-2fc5-4e73-804e-c75d84a37e71 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:55.694879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:55.695534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:55.782284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:21:55.782819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:21:55.783312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:21:55.783732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:21:55.784221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:21:55.851157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:55.858652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:55.859239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:55.859904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:55.860716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:55.861256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:55.861774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:55.893657 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cbe18d46-3070-4bda-8918-c058554a3b85 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "POST /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05/action" status: 202 len: 1111 microversion: 2.1 time: 0.215656 Aug 23 18:21:55.894441 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2921/5709] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:21:55 2022] POST /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05/action => generated 1111 bytes in 217 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 23 18:21:55.913428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3aff4fce-d9fe-4c69-9a8a-17945192942f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:55.921150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3aff4fce-d9fe-4c69-9a8a-17945192942f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:55.929830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3aff4fce-d9fe-4c69-9a8a-17945192942f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:55.930411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3aff4fce-d9fe-4c69-9a8a-17945192942f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:55.931079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3aff4fce-d9fe-4c69-9a8a-17945192942f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:55.931930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3aff4fce-d9fe-4c69-9a8a-17945192942f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:55.932383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3aff4fce-d9fe-4c69-9a8a-17945192942f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:55.933541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3aff4fce-d9fe-4c69-9a8a-17945192942f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:56.032147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bd82d34f-2fc5-4e73-804e-c75d84a37e71 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:56.043441 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd82d34f-2fc5-4e73-804e-c75d84a37e71 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1366 microversion: 2.1 time: 0.365500 Aug 23 18:21:56.044661 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2789/5710] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:55 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1366 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:56.145178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3aff4fce-d9fe-4c69-9a8a-17945192942f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:56.155108 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3aff4fce-d9fe-4c69-9a8a-17945192942f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.245958 Aug 23 18:21:56.156099 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2922/5711] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:55 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:21:57.067176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0bfd4c86-0289-4d1a-8f50-959e6eae0149 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:57.068510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0bfd4c86-0289-4d1a-8f50-959e6eae0149 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:57.077818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bfd4c86-0289-4d1a-8f50-959e6eae0149 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:57.078734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bfd4c86-0289-4d1a-8f50-959e6eae0149 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:57.079548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bfd4c86-0289-4d1a-8f50-959e6eae0149 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:57.081884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bfd4c86-0289-4d1a-8f50-959e6eae0149 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:57.082601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bfd4c86-0289-4d1a-8f50-959e6eae0149 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:57.083895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bfd4c86-0289-4d1a-8f50-959e6eae0149 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:57.179752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a281ba6-ac88-47c0-a739-40821c5db760 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:57.182044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5a281ba6-ac88-47c0-a739-40821c5db760 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:57.195195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a281ba6-ac88-47c0-a739-40821c5db760 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:57.198522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a281ba6-ac88-47c0-a739-40821c5db760 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:57.199246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a281ba6-ac88-47c0-a739-40821c5db760 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:57.200280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a281ba6-ac88-47c0-a739-40821c5db760 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:57.201119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a281ba6-ac88-47c0-a739-40821c5db760 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:57.203039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a281ba6-ac88-47c0-a739-40821c5db760 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:57.326039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0bfd4c86-0289-4d1a-8f50-959e6eae0149 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:57.342341 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0bfd4c86-0289-4d1a-8f50-959e6eae0149 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1556 microversion: 2.1 time: 0.277819 Aug 23 18:21:57.343015 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2790/5712] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:57 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1556 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:57.364163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-497ffb91-8880-4ead-852a-30483625152b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:57.364850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-497ffb91-8880-4ead-852a-30483625152b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:57.371832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-497ffb91-8880-4ead-852a-30483625152b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:57.375247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-497ffb91-8880-4ead-852a-30483625152b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:57.377406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-497ffb91-8880-4ead-852a-30483625152b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:57.380932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-497ffb91-8880-4ead-852a-30483625152b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:57.381706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-497ffb91-8880-4ead-852a-30483625152b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:57.382966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-497ffb91-8880-4ead-852a-30483625152b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:57.431692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5a281ba6-ac88-47c0-a739-40821c5db760 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:57.441350 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a281ba6-ac88-47c0-a739-40821c5db760 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.268094 Aug 23 18:21:57.442988 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2923/5713] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:57 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:21:57.561868 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-497ffb91-8880-4ead-852a-30483625152b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.201818 Aug 23 18:21:57.562731 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2791/5714] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:21:57 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-interface => generated 284 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:21:58.462324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6d2beb22-c3b4-49fb-bacf-fd0b59b1eb26 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:58.462892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6d2beb22-c3b4-49fb-bacf-fd0b59b1eb26 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:58.471268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d2beb22-c3b4-49fb-bacf-fd0b59b1eb26 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:58.471783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d2beb22-c3b4-49fb-bacf-fd0b59b1eb26 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:58.472423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d2beb22-c3b4-49fb-bacf-fd0b59b1eb26 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:58.473314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d2beb22-c3b4-49fb-bacf-fd0b59b1eb26 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:58.473920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d2beb22-c3b4-49fb-bacf-fd0b59b1eb26 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:58.474833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d2beb22-c3b4-49fb-bacf-fd0b59b1eb26 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:58.724645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6d2beb22-c3b4-49fb-bacf-fd0b59b1eb26 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:21:58.739865 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6d2beb22-c3b4-49fb-bacf-fd0b59b1eb26 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.281407 Aug 23 18:21:58.741063 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2924/5715] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:58 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:21:59.764120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-af44dd87-5d9c-43cf-ab47-7180784ae367 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:21:59.766273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-af44dd87-5d9c-43cf-ab47-7180784ae367 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:21:59.774713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af44dd87-5d9c-43cf-ab47-7180784ae367 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:59.776029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af44dd87-5d9c-43cf-ab47-7180784ae367 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:59.776873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af44dd87-5d9c-43cf-ab47-7180784ae367 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:21:59.777781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af44dd87-5d9c-43cf-ab47-7180784ae367 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:21:59.778580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af44dd87-5d9c-43cf-ab47-7180784ae367 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:21:59.779993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af44dd87-5d9c-43cf-ab47-7180784ae367 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:00.026958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-42e76a27-b270-464b-a71e-dcfab172d5e2 req-bce4861e-3c0d-4848-ba49-3842192e11bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "454f6367-fca5-4f24-b48e-4c1ea5603c29", "tag": "1c075ec6-d5ef-40f7-adc0-9c451365ccf9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:00.048072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-42e76a27-b270-464b-a71e-dcfab172d5e2 req-bce4861e-3c0d-4848-ba49-3842192e11bf service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:00.053188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-42e76a27-b270-464b-a71e-dcfab172d5e2 req-bce4861e-3c0d-4848-ba49-3842192e11bf service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:00.053924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-42e76a27-b270-464b-a71e-dcfab172d5e2 req-bce4861e-3c0d-4848-ba49-3842192e11bf service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:00.080534 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-42e76a27-b270-464b-a71e-dcfab172d5e2 req-bce4861e-3c0d-4848-ba49-3842192e11bf service nova] Creating event network-changed:1c075ec6-d5ef-40f7-adc0-9c451365ccf9 for instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 on n-h2-850468-16 Aug 23 18:22:00.095299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-af44dd87-5d9c-43cf-ab47-7180784ae367 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:00.097168 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-42e76a27-b270-464b-a71e-dcfab172d5e2 req-bce4861e-3c0d-4848-ba49-3842192e11bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.409301 Aug 23 18:22:00.099744 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2792/5716] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:22:00.110139 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-af44dd87-5d9c-43cf-ab47-7180784ae367 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.351580 Aug 23 18:22:00.111638 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2925/5717] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:21:59 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:22:01.134353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b45653a3-9a98-4f6a-a49e-7b55ac655a95 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:01.135954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b45653a3-9a98-4f6a-a49e-7b55ac655a95 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:01.147480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b45653a3-9a98-4f6a-a49e-7b55ac655a95 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:01.149654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b45653a3-9a98-4f6a-a49e-7b55ac655a95 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:01.152323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b45653a3-9a98-4f6a-a49e-7b55ac655a95 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:01.154924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b45653a3-9a98-4f6a-a49e-7b55ac655a95 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:01.155874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b45653a3-9a98-4f6a-a49e-7b55ac655a95 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:01.158311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b45653a3-9a98-4f6a-a49e-7b55ac655a95 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:01.423316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b45653a3-9a98-4f6a-a49e-7b55ac655a95 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:01.436256 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b45653a3-9a98-4f6a-a49e-7b55ac655a95 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.307475 Aug 23 18:22:01.453194 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2793/5718] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:01 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:02.461132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2af3ea25-aede-44e1-8928-2bc91d155f4d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:02.462293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2af3ea25-aede-44e1-8928-2bc91d155f4d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:02.470473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2af3ea25-aede-44e1-8928-2bc91d155f4d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:02.471115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2af3ea25-aede-44e1-8928-2bc91d155f4d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:02.471545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2af3ea25-aede-44e1-8928-2bc91d155f4d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:02.473121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2af3ea25-aede-44e1-8928-2bc91d155f4d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:02.473575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2af3ea25-aede-44e1-8928-2bc91d155f4d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:02.474717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2af3ea25-aede-44e1-8928-2bc91d155f4d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:02.752576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2af3ea25-aede-44e1-8928-2bc91d155f4d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:02.761842 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2af3ea25-aede-44e1-8928-2bc91d155f4d tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.304520 Aug 23 18:22:02.767742 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2926/5719] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:02 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:03.786220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a89a1273-3224-458d-92e8-00487c0439f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:03.787681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a89a1273-3224-458d-92e8-00487c0439f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:03.802902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a89a1273-3224-458d-92e8-00487c0439f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:03.803449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a89a1273-3224-458d-92e8-00487c0439f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:03.803914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a89a1273-3224-458d-92e8-00487c0439f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:03.804648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a89a1273-3224-458d-92e8-00487c0439f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:03.807115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a89a1273-3224-458d-92e8-00487c0439f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:03.807901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a89a1273-3224-458d-92e8-00487c0439f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:04.079972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a89a1273-3224-458d-92e8-00487c0439f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:04.090185 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a89a1273-3224-458d-92e8-00487c0439f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.309828 Aug 23 18:22:04.092257 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2794/5720] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:03 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:05.113369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a404a118-c297-4e8a-862a-fb6a10b9473c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:05.114193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a404a118-c297-4e8a-862a-fb6a10b9473c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:05.125527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a404a118-c297-4e8a-862a-fb6a10b9473c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:05.126199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a404a118-c297-4e8a-862a-fb6a10b9473c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:05.126783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a404a118-c297-4e8a-862a-fb6a10b9473c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:05.127609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a404a118-c297-4e8a-862a-fb6a10b9473c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:05.128170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a404a118-c297-4e8a-862a-fb6a10b9473c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:05.128716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a404a118-c297-4e8a-862a-fb6a10b9473c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:05.368107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a404a118-c297-4e8a-862a-fb6a10b9473c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:05.378781 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a404a118-c297-4e8a-862a-fb6a10b9473c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.270065 Aug 23 18:22:05.392296 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2927/5721] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:05 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:06.403422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aac4c9e3-a91d-4320-9b22-761f675c8a6c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:06.405236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aac4c9e3-a91d-4320-9b22-761f675c8a6c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:06.412479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aac4c9e3-a91d-4320-9b22-761f675c8a6c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:06.412974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aac4c9e3-a91d-4320-9b22-761f675c8a6c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:06.413412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aac4c9e3-a91d-4320-9b22-761f675c8a6c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:06.414128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aac4c9e3-a91d-4320-9b22-761f675c8a6c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:06.414790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aac4c9e3-a91d-4320-9b22-761f675c8a6c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:06.415220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aac4c9e3-a91d-4320-9b22-761f675c8a6c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:06.611578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aac4c9e3-a91d-4320-9b22-761f675c8a6c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:06.623841 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aac4c9e3-a91d-4320-9b22-761f675c8a6c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.224081 Aug 23 18:22:06.624846 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2795/5722] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:06 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:07.646159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d5063796-4a25-4448-ad43-2e30aeb6194c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:07.648092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d5063796-4a25-4448-ad43-2e30aeb6194c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:07.678363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5063796-4a25-4448-ad43-2e30aeb6194c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:07.683463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5063796-4a25-4448-ad43-2e30aeb6194c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:07.683946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5063796-4a25-4448-ad43-2e30aeb6194c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:07.685388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5063796-4a25-4448-ad43-2e30aeb6194c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:07.685952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5063796-4a25-4448-ad43-2e30aeb6194c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:07.687789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5063796-4a25-4448-ad43-2e30aeb6194c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:07.910747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5063796-4a25-4448-ad43-2e30aeb6194c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:07.923013 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d5063796-4a25-4448-ad43-2e30aeb6194c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.280626 Aug 23 18:22:07.939371 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2928/5723] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:07 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:08.948292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97bf8459-26a6-49a1-aa48-d2aae8eee6f9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:08.952102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-97bf8459-26a6-49a1-aa48-d2aae8eee6f9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:08.961958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97bf8459-26a6-49a1-aa48-d2aae8eee6f9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:08.963026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97bf8459-26a6-49a1-aa48-d2aae8eee6f9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:08.964484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97bf8459-26a6-49a1-aa48-d2aae8eee6f9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:08.968359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97bf8459-26a6-49a1-aa48-d2aae8eee6f9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:08.969019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97bf8459-26a6-49a1-aa48-d2aae8eee6f9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:08.969605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97bf8459-26a6-49a1-aa48-d2aae8eee6f9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:09.502321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-97bf8459-26a6-49a1-aa48-d2aae8eee6f9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:09.510352 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-97bf8459-26a6-49a1-aa48-d2aae8eee6f9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.569557 Aug 23 18:22:09.510969 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2796/5724] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:08 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:10.533655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f5756f1c-7b59-40ee-b1ad-a0183fe5a2fa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:10.534361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f5756f1c-7b59-40ee-b1ad-a0183fe5a2fa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:10.547158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5756f1c-7b59-40ee-b1ad-a0183fe5a2fa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:10.547976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5756f1c-7b59-40ee-b1ad-a0183fe5a2fa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:10.548746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5756f1c-7b59-40ee-b1ad-a0183fe5a2fa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:10.549734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5756f1c-7b59-40ee-b1ad-a0183fe5a2fa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:10.550517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5756f1c-7b59-40ee-b1ad-a0183fe5a2fa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:10.551272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5756f1c-7b59-40ee-b1ad-a0183fe5a2fa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:10.783091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f5756f1c-7b59-40ee-b1ad-a0183fe5a2fa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:10.792436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:10.797692 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f5756f1c-7b59-40ee-b1ad-a0183fe5a2fa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.268408 Aug 23 18:22:10.811030 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2929/5725] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:10 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:11.820277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-da5e9b2b-fb8e-4883-8c9c-110d6cc0f18a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:11.820880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-da5e9b2b-fb8e-4883-8c9c-110d6cc0f18a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:11.823812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:11.832287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5e9b2b-fb8e-4883-8c9c-110d6cc0f18a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:11.833398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5e9b2b-fb8e-4883-8c9c-110d6cc0f18a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:11.834317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5e9b2b-fb8e-4883-8c9c-110d6cc0f18a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:11.835255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5e9b2b-fb8e-4883-8c9c-110d6cc0f18a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:11.836065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5e9b2b-fb8e-4883-8c9c-110d6cc0f18a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:11.836693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da5e9b2b-fb8e-4883-8c9c-110d6cc0f18a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:12.073717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-da5e9b2b-fb8e-4883-8c9c-110d6cc0f18a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:12.083319 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-da5e9b2b-fb8e-4883-8c9c-110d6cc0f18a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.266963 Aug 23 18:22:12.083896 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2797/5726] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:11 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:12.633915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c3df2afc-e509-40c3-a404-f3f989507acc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:12.635173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c3df2afc-e509-40c3-a404-f3f989507acc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:12.644811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3df2afc-e509-40c3-a404-f3f989507acc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:12.645464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3df2afc-e509-40c3-a404-f3f989507acc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:12.646115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3df2afc-e509-40c3-a404-f3f989507acc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:12.647110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3df2afc-e509-40c3-a404-f3f989507acc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:12.648972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3df2afc-e509-40c3-a404-f3f989507acc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:12.649613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3df2afc-e509-40c3-a404-f3f989507acc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:12.688333 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c3df2afc-e509-40c3-a404-f3f989507acc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments/75b3527d-59b4-42ea-b276-dafd8f9fd816" status: 200 len: 194 microversion: 2.20 time: 0.058502 Aug 23 18:22:12.689286 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2930/5727] 10.222.0.61 () {60 vars in 1454 bytes} [Tue Aug 23 18:22:12 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments/75b3527d-59b4-42ea-b276-dafd8f9fd816 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:22:12.767692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3478e2b3-e085-47be-ac02-e32d5bbbcac8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:12.768195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3478e2b3-e085-47be-ac02-e32d5bbbcac8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:12.775065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3478e2b3-e085-47be-ac02-e32d5bbbcac8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:12.775473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3478e2b3-e085-47be-ac02-e32d5bbbcac8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:12.775906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3478e2b3-e085-47be-ac02-e32d5bbbcac8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:12.776944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3478e2b3-e085-47be-ac02-e32d5bbbcac8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:12.777404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3478e2b3-e085-47be-ac02-e32d5bbbcac8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:12.777831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3478e2b3-e085-47be-ac02-e32d5bbbcac8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:12.873140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-3478e2b3-e085-47be-ac02-e32d5bbbcac8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lazy-loading 'services' on Instance uuid 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:22:12.985742 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3478e2b3-e085-47be-ac02-e32d5bbbcac8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments/75b3527d-59b4-42ea-b276-dafd8f9fd816" status: 202 len: 0 microversion: 2.20 time: 0.223959 Aug 23 18:22:12.990681 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2798/5728] 10.222.0.61 () {60 vars in 1457 bytes} [Tue Aug 23 18:22:12 2022] DELETE /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments/75b3527d-59b4-42ea-b276-dafd8f9fd816 => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:22:13.000141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3fbfd8ab-955f-4d1b-accf-639ef83aea00 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:13.003145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3fbfd8ab-955f-4d1b-accf-639ef83aea00 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:13.017191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbfd8ab-955f-4d1b-accf-639ef83aea00 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:13.018471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbfd8ab-955f-4d1b-accf-639ef83aea00 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:13.019289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbfd8ab-955f-4d1b-accf-639ef83aea00 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:13.020283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbfd8ab-955f-4d1b-accf-639ef83aea00 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:13.020904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbfd8ab-955f-4d1b-accf-639ef83aea00 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:13.021516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbfd8ab-955f-4d1b-accf-639ef83aea00 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:13.062340 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3fbfd8ab-955f-4d1b-accf-639ef83aea00 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070203 Aug 23 18:22:13.062956 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2931/5729] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 18:22:12 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:22:13.109359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9dfd7bd1-0f48-43e6-8392-f05690107444 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:13.111029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9dfd7bd1-0f48-43e6-8392-f05690107444 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:13.118977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dfd7bd1-0f48-43e6-8392-f05690107444 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:13.119551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dfd7bd1-0f48-43e6-8392-f05690107444 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:13.120057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dfd7bd1-0f48-43e6-8392-f05690107444 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:13.121026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dfd7bd1-0f48-43e6-8392-f05690107444 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:13.121541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dfd7bd1-0f48-43e6-8392-f05690107444 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:13.122724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dfd7bd1-0f48-43e6-8392-f05690107444 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:13.289216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9dfd7bd1-0f48-43e6-8392-f05690107444 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:13.299901 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9dfd7bd1-0f48-43e6-8392-f05690107444 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.199612 Aug 23 18:22:13.300499 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2799/5730] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:13 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:14.076166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-42d55575-5363-4116-8812-a4e7771199ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:14.078942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-42d55575-5363-4116-8812-a4e7771199ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:14.097939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42d55575-5363-4116-8812-a4e7771199ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:14.098697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42d55575-5363-4116-8812-a4e7771199ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:14.099356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42d55575-5363-4116-8812-a4e7771199ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:14.101543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42d55575-5363-4116-8812-a4e7771199ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:14.102235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42d55575-5363-4116-8812-a4e7771199ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:14.104274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42d55575-5363-4116-8812-a4e7771199ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:14.173434 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-42d55575-5363-4116-8812-a4e7771199ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.103316 Aug 23 18:22:14.179280 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2932/5731] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 18:22:14 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments => generated 197 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:22:14.326603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-64ffa3a1-68dc-485f-9adf-8ae746034129 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:14.328043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-64ffa3a1-68dc-485f-9adf-8ae746034129 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:14.349749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64ffa3a1-68dc-485f-9adf-8ae746034129 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:14.350332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64ffa3a1-68dc-485f-9adf-8ae746034129 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:14.350997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64ffa3a1-68dc-485f-9adf-8ae746034129 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:14.351727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64ffa3a1-68dc-485f-9adf-8ae746034129 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:14.352260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64ffa3a1-68dc-485f-9adf-8ae746034129 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:14.352743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64ffa3a1-68dc-485f-9adf-8ae746034129 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:14.655763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-64ffa3a1-68dc-485f-9adf-8ae746034129 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:14.664010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:14.669050 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-64ffa3a1-68dc-485f-9adf-8ae746034129 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.348690 Aug 23 18:22:14.683342 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2800/5732] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:14 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:15.196080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-089e50fb-40bf-470d-98ce-9c069beecc65 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:15.198522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-089e50fb-40bf-470d-98ce-9c069beecc65 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:15.205299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=48 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:15.218569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-089e50fb-40bf-470d-98ce-9c069beecc65 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:15.220634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-089e50fb-40bf-470d-98ce-9c069beecc65 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:15.221378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-089e50fb-40bf-470d-98ce-9c069beecc65 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:15.227023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-089e50fb-40bf-470d-98ce-9c069beecc65 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:15.227692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-089e50fb-40bf-470d-98ce-9c069beecc65 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:15.228319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-089e50fb-40bf-470d-98ce-9c069beecc65 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:15.270044 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-089e50fb-40bf-470d-98ce-9c069beecc65 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.078635 Aug 23 18:22:15.271126 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2933/5733] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 18:22:15 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:22:15.691711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-14ded7ea-b4c8-4fcc-977b-a6db41aa5a46 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:15.693034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-14ded7ea-b4c8-4fcc-977b-a6db41aa5a46 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:15.712581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14ded7ea-b4c8-4fcc-977b-a6db41aa5a46 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:15.719268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14ded7ea-b4c8-4fcc-977b-a6db41aa5a46 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:15.720345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14ded7ea-b4c8-4fcc-977b-a6db41aa5a46 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:15.733929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14ded7ea-b4c8-4fcc-977b-a6db41aa5a46 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:15.734709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14ded7ea-b4c8-4fcc-977b-a6db41aa5a46 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:15.735446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14ded7ea-b4c8-4fcc-977b-a6db41aa5a46 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:15.922184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-14ded7ea-b4c8-4fcc-977b-a6db41aa5a46 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:15.931300 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-14ded7ea-b4c8-4fcc-977b-a6db41aa5a46 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.245761 Aug 23 18:22:15.943564 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2801/5734] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:15 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:16.285924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7249feca-b20c-4085-8323-ac06c66ab101 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:16.293202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7249feca-b20c-4085-8323-ac06c66ab101 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:16.325069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7249feca-b20c-4085-8323-ac06c66ab101 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:16.326959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7249feca-b20c-4085-8323-ac06c66ab101 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:16.332238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7249feca-b20c-4085-8323-ac06c66ab101 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:16.333194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7249feca-b20c-4085-8323-ac06c66ab101 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:16.333696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7249feca-b20c-4085-8323-ac06c66ab101 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:16.334150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7249feca-b20c-4085-8323-ac06c66ab101 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:16.420292 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7249feca-b20c-4085-8323-ac06c66ab101 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.140722 Aug 23 18:22:16.425553 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2934/5735] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 18:22:16 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:22:16.960375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4a56dbe9-c732-4cef-942f-a74d9f43bbdf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:16.964661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4a56dbe9-c732-4cef-942f-a74d9f43bbdf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:16.986598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a56dbe9-c732-4cef-942f-a74d9f43bbdf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:16.987475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a56dbe9-c732-4cef-942f-a74d9f43bbdf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:16.988139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a56dbe9-c732-4cef-942f-a74d9f43bbdf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:16.991017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a56dbe9-c732-4cef-942f-a74d9f43bbdf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:16.992968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a56dbe9-c732-4cef-942f-a74d9f43bbdf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:16.993660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a56dbe9-c732-4cef-942f-a74d9f43bbdf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:17.243264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4a56dbe9-c732-4cef-942f-a74d9f43bbdf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:17.252263 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4a56dbe9-c732-4cef-942f-a74d9f43bbdf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.302758 Aug 23 18:22:17.269720 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2802/5736] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:16 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:17.439251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e97a7e1d-e3f6-405f-ae9c-98478171edcd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:17.442756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e97a7e1d-e3f6-405f-ae9c-98478171edcd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:17.454780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e97a7e1d-e3f6-405f-ae9c-98478171edcd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:17.455538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e97a7e1d-e3f6-405f-ae9c-98478171edcd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:17.456315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e97a7e1d-e3f6-405f-ae9c-98478171edcd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:17.457257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e97a7e1d-e3f6-405f-ae9c-98478171edcd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:17.458523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e97a7e1d-e3f6-405f-ae9c-98478171edcd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:17.459207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e97a7e1d-e3f6-405f-ae9c-98478171edcd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:17.514215 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e97a7e1d-e3f6-405f-ae9c-98478171edcd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.083662 Aug 23 18:22:17.535095 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2935/5737] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 18:22:17 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:22:18.276796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d2fcd56e-db03-4832-bfdc-c7ff0ffbdbd0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:18.277420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d2fcd56e-db03-4832-bfdc-c7ff0ffbdbd0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:18.284718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2fcd56e-db03-4832-bfdc-c7ff0ffbdbd0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:18.285208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2fcd56e-db03-4832-bfdc-c7ff0ffbdbd0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:18.285653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2fcd56e-db03-4832-bfdc-c7ff0ffbdbd0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:18.286368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2fcd56e-db03-4832-bfdc-c7ff0ffbdbd0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:18.286855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2fcd56e-db03-4832-bfdc-c7ff0ffbdbd0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:18.287283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2fcd56e-db03-4832-bfdc-c7ff0ffbdbd0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:18.508600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d2fcd56e-db03-4832-bfdc-c7ff0ffbdbd0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:18.518565 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d2fcd56e-db03-4832-bfdc-c7ff0ffbdbd0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.245358 Aug 23 18:22:18.519354 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2803/5738] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:18 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:18.531223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-25133870-c960-4464-b08e-7b7849c3f496 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:18.534608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-25133870-c960-4464-b08e-7b7849c3f496 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:18.547816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25133870-c960-4464-b08e-7b7849c3f496 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:18.548691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25133870-c960-4464-b08e-7b7849c3f496 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:18.550101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25133870-c960-4464-b08e-7b7849c3f496 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:18.551897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25133870-c960-4464-b08e-7b7849c3f496 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:18.554181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25133870-c960-4464-b08e-7b7849c3f496 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:18.556753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25133870-c960-4464-b08e-7b7849c3f496 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:18.606603 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-25133870-c960-4464-b08e-7b7849c3f496 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.079305 Aug 23 18:22:18.607865 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2936/5739] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 18:22:18 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:22:19.548191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b70a8ea2-9b39-45e4-b43d-98666ec6b9a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:19.548745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b70a8ea2-9b39-45e4-b43d-98666ec6b9a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:19.573819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b70a8ea2-9b39-45e4-b43d-98666ec6b9a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:19.574337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b70a8ea2-9b39-45e4-b43d-98666ec6b9a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:19.574815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b70a8ea2-9b39-45e4-b43d-98666ec6b9a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:19.575631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b70a8ea2-9b39-45e4-b43d-98666ec6b9a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:19.576312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b70a8ea2-9b39-45e4-b43d-98666ec6b9a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:19.576749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b70a8ea2-9b39-45e4-b43d-98666ec6b9a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:19.619406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2852bc85-ac04-44fa-a537-becc4130c302 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:19.623529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2852bc85-ac04-44fa-a537-becc4130c302 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:19.645270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2852bc85-ac04-44fa-a537-becc4130c302 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:19.645779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2852bc85-ac04-44fa-a537-becc4130c302 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:19.646234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2852bc85-ac04-44fa-a537-becc4130c302 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:19.646995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2852bc85-ac04-44fa-a537-becc4130c302 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:19.647460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2852bc85-ac04-44fa-a537-becc4130c302 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:19.647896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2852bc85-ac04-44fa-a537-becc4130c302 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:19.731045 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2852bc85-ac04-44fa-a537-becc4130c302 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.115721 Aug 23 18:22:19.735554 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2937/5740] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 18:22:19 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:19.848279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d2c9f70f-e525-435b-9656-d5f593c740ef tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:19.849149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d2c9f70f-e525-435b-9656-d5f593c740ef tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:19.857802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2c9f70f-e525-435b-9656-d5f593c740ef tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:19.859513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2c9f70f-e525-435b-9656-d5f593c740ef tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:19.860163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2c9f70f-e525-435b-9656-d5f593c740ef tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:19.861211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2c9f70f-e525-435b-9656-d5f593c740ef tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:19.861872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2c9f70f-e525-435b-9656-d5f593c740ef tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:19.862504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d2c9f70f-e525-435b-9656-d5f593c740ef tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:19.891440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b70a8ea2-9b39-45e4-b43d-98666ec6b9a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:19.902454 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b70a8ea2-9b39-45e4-b43d-98666ec6b9a6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.363784 Aug 23 18:22:19.906859 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2804/5741] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:19 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:19.914308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d2c9f70f-e525-435b-9656-d5f593c740ef tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:22:20.067910 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d2c9f70f-e525-435b-9656-d5f593c740ef tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 204 len: 0 microversion: 2.20 time: 0.227312 Aug 23 18:22:20.069097 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2938/5742] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:22:19 2022] DELETE /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 23 18:22:20.078704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-514aa8ee-7b8a-4fea-8aca-30bc7ae6dbdd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:20.079416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-514aa8ee-7b8a-4fea-8aca-30bc7ae6dbdd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:20.092089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-514aa8ee-7b8a-4fea-8aca-30bc7ae6dbdd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:20.092653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-514aa8ee-7b8a-4fea-8aca-30bc7ae6dbdd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:20.093170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-514aa8ee-7b8a-4fea-8aca-30bc7ae6dbdd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:20.095764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-514aa8ee-7b8a-4fea-8aca-30bc7ae6dbdd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:20.096476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-514aa8ee-7b8a-4fea-8aca-30bc7ae6dbdd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:20.100301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-514aa8ee-7b8a-4fea-8aca-30bc7ae6dbdd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:20.333423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-514aa8ee-7b8a-4fea-8aca-30bc7ae6dbdd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:20.342853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-514aa8ee-7b8a-4fea-8aca-30bc7ae6dbdd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:20.360363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-514aa8ee-7b8a-4fea-8aca-30bc7ae6dbdd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:20.362367 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-514aa8ee-7b8a-4fea-8aca-30bc7ae6dbdd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1724 microversion: 2.20 time: 0.288717 Aug 23 18:22:20.364062 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2805/5743] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:20 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1724 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:20.928240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f9efb2e1-9ee5-4a58-bb90-4d79bdb029b7 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:20.929690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f9efb2e1-9ee5-4a58-bb90-4d79bdb029b7 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:20.948604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9efb2e1-9ee5-4a58-bb90-4d79bdb029b7 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:20.950946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9efb2e1-9ee5-4a58-bb90-4d79bdb029b7 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:20.951761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9efb2e1-9ee5-4a58-bb90-4d79bdb029b7 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:20.952830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9efb2e1-9ee5-4a58-bb90-4d79bdb029b7 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:20.955276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9efb2e1-9ee5-4a58-bb90-4d79bdb029b7 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:20.956005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9efb2e1-9ee5-4a58-bb90-4d79bdb029b7 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:21.155149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f9efb2e1-9ee5-4a58-bb90-4d79bdb029b7 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:21.171425 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f9efb2e1-9ee5-4a58-bb90-4d79bdb029b7 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 0.249482 Aug 23 18:22:21.172755 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2939/5744] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:20 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:21.391551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a616a7f-e535-4681-bb7b-d763f88c240b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:21.392179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6a616a7f-e535-4681-bb7b-d763f88c240b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:21.424358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a616a7f-e535-4681-bb7b-d763f88c240b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:21.424860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a616a7f-e535-4681-bb7b-d763f88c240b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:21.425309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a616a7f-e535-4681-bb7b-d763f88c240b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:21.426037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a616a7f-e535-4681-bb7b-d763f88c240b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:21.426500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a616a7f-e535-4681-bb7b-d763f88c240b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:21.426956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a616a7f-e535-4681-bb7b-d763f88c240b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:22.116695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a616a7f-e535-4681-bb7b-d763f88c240b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:22.126311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a616a7f-e535-4681-bb7b-d763f88c240b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:22.128207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a616a7f-e535-4681-bb7b-d763f88c240b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:22.132175 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a616a7f-e535-4681-bb7b-d763f88c240b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1724 microversion: 2.20 time: 0.744648 Aug 23 18:22:22.133257 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2806/5745] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:21 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1724 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:22.192992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0ea2325e-0b28-4419-b932-bb57c8ebe605 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:22.194159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0ea2325e-0b28-4419-b932-bb57c8ebe605 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:22.205092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ea2325e-0b28-4419-b932-bb57c8ebe605 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:22.208736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ea2325e-0b28-4419-b932-bb57c8ebe605 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:22.209416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ea2325e-0b28-4419-b932-bb57c8ebe605 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:22.212569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ea2325e-0b28-4419-b932-bb57c8ebe605 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:22.213325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ea2325e-0b28-4419-b932-bb57c8ebe605 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:22.213958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ea2325e-0b28-4419-b932-bb57c8ebe605 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:23.159782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2da7c09d-7564-4a70-a731-5dad5bd23401 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:23.163255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2da7c09d-7564-4a70-a731-5dad5bd23401 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:23.174870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da7c09d-7564-4a70-a731-5dad5bd23401 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:23.180093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da7c09d-7564-4a70-a731-5dad5bd23401 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:23.180710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da7c09d-7564-4a70-a731-5dad5bd23401 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:23.181552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da7c09d-7564-4a70-a731-5dad5bd23401 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:23.183304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da7c09d-7564-4a70-a731-5dad5bd23401 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:23.183770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da7c09d-7564-4a70-a731-5dad5bd23401 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:23.287743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0ea2325e-0b28-4419-b932-bb57c8ebe605 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:23.304493 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0ea2325e-0b28-4419-b932-bb57c8ebe605 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1516 microversion: 2.1 time: 1.108198 Aug 23 18:22:23.305175 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2940/5746] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:22 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1516 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:23.401449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f667262d-c122-497b-9476-824cdce22dac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:23.407593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f667262d-c122-497b-9476-824cdce22dac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:23.418276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f667262d-c122-497b-9476-824cdce22dac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:23.419384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f667262d-c122-497b-9476-824cdce22dac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:23.427370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f667262d-c122-497b-9476-824cdce22dac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:23.428911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f667262d-c122-497b-9476-824cdce22dac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:23.435791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f667262d-c122-497b-9476-824cdce22dac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:23.436744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f667262d-c122-497b-9476-824cdce22dac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:23.520458 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f667262d-c122-497b-9476-824cdce22dac tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "POST /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d/action" status: 200 len: 32644 microversion: 2.1 time: 0.122761 Aug 23 18:22:23.526639 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2941/5747] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:22:23 2022] POST /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d/action => generated 32644 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:22:23.789947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2da7c09d-7564-4a70-a731-5dad5bd23401 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:23.814816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2da7c09d-7564-4a70-a731-5dad5bd23401 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:23.817672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2da7c09d-7564-4a70-a731-5dad5bd23401 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:23.824142 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2da7c09d-7564-4a70-a731-5dad5bd23401 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1724 microversion: 2.20 time: 0.669876 Aug 23 18:22:23.831376 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2807/5748] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:23 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1724 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:24.328121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-35e21483-912e-4833-a1d5-0467c0053cf6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:24.329642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-35e21483-912e-4833-a1d5-0467c0053cf6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:24.345874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35e21483-912e-4833-a1d5-0467c0053cf6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:24.347314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35e21483-912e-4833-a1d5-0467c0053cf6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:24.348327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35e21483-912e-4833-a1d5-0467c0053cf6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:24.349750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35e21483-912e-4833-a1d5-0467c0053cf6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:24.350963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35e21483-912e-4833-a1d5-0467c0053cf6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:24.352013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35e21483-912e-4833-a1d5-0467c0053cf6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:24.694955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-35e21483-912e-4833-a1d5-0467c0053cf6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:24.708320 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-35e21483-912e-4833-a1d5-0467c0053cf6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1522 microversion: 2.1 time: 0.386374 Aug 23 18:22:24.708929 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2942/5749] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:24 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:24.853524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81314682-fca3-4d8b-bced-c33040f232f9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:24.854136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-81314682-fca3-4d8b-bced-c33040f232f9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:24.866880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81314682-fca3-4d8b-bced-c33040f232f9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:24.874404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81314682-fca3-4d8b-bced-c33040f232f9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:24.874902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81314682-fca3-4d8b-bced-c33040f232f9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:24.875658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81314682-fca3-4d8b-bced-c33040f232f9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:24.876122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81314682-fca3-4d8b-bced-c33040f232f9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:24.876552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81314682-fca3-4d8b-bced-c33040f232f9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:25.229030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81314682-fca3-4d8b-bced-c33040f232f9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:25.245263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81314682-fca3-4d8b-bced-c33040f232f9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:25.247846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81314682-fca3-4d8b-bced-c33040f232f9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:25.249245 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81314682-fca3-4d8b-bced-c33040f232f9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1656 microversion: 2.20 time: 0.399928 Aug 23 18:22:25.255092 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2808/5750] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:24 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1656 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:25.361330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-665785b7-8754-4c2f-9894-301d220e27fc req-9f9805d5-3c8f-431f-a82a-d451e256974a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d8fe0c3-ea81-46b5-9230-216cf8e932d2", "name": "network-vif-deleted", "tag": "663bf035-ee8e-4ca7-aeb3-025d64e3d0e1"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:25.375086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-665785b7-8754-4c2f-9894-301d220e27fc req-9f9805d5-3c8f-431f-a82a-d451e256974a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:25.375574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-665785b7-8754-4c2f-9894-301d220e27fc req-9f9805d5-3c8f-431f-a82a-d451e256974a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:25.376004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-665785b7-8754-4c2f-9894-301d220e27fc req-9f9805d5-3c8f-431f-a82a-d451e256974a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:25.388651 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-665785b7-8754-4c2f-9894-301d220e27fc req-9f9805d5-3c8f-431f-a82a-d451e256974a service nova] Creating event network-vif-deleted:663bf035-ee8e-4ca7-aeb3-025d64e3d0e1 for instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 on n-h1-850468-16 Aug 23 18:22:25.394274 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-665785b7-8754-4c2f-9894-301d220e27fc req-9f9805d5-3c8f-431f-a82a-d451e256974a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036675 Aug 23 18:22:25.395415 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2943/5751] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:22:25.735912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-515b9e55-b335-4739-8fa3-21ff350c3628 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:25.736557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-515b9e55-b335-4739-8fa3-21ff350c3628 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:25.768729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-515b9e55-b335-4739-8fa3-21ff350c3628 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:25.770074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-515b9e55-b335-4739-8fa3-21ff350c3628 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:25.770560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-515b9e55-b335-4739-8fa3-21ff350c3628 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:25.771456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-515b9e55-b335-4739-8fa3-21ff350c3628 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:25.771940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-515b9e55-b335-4739-8fa3-21ff350c3628 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:25.772361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-515b9e55-b335-4739-8fa3-21ff350c3628 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:26.284785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:26.286521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:26.301971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:26.303420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:26.304067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:26.304991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:26.305691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:26.310858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:26.399102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:26.400229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:26.400836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:26.401467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lazy-loading 'fault' on Instance uuid 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:22:26.471262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-515b9e55-b335-4739-8fa3-21ff350c3628 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:26.486047 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-515b9e55-b335-4739-8fa3-21ff350c3628 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1522 microversion: 2.1 time: 0.754825 Aug 23 18:22:26.488985 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2809/5752] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:25 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1522 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:26.553231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:26.572274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:26.573782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:26.584631 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4f3a3a7e-f723-438e-ad0b-cf4edf3d326a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 200 len: 1371 microversion: 2.20 time: 0.295466 Aug 23 18:22:26.585662 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2944/5753] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:26 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 1371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:27.027089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b6400434-460e-404b-a8af-4a737b7813cf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:27.044496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b6400434-460e-404b-a8af-4a737b7813cf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:27.071996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6400434-460e-404b-a8af-4a737b7813cf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:27.072684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6400434-460e-404b-a8af-4a737b7813cf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:27.073317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6400434-460e-404b-a8af-4a737b7813cf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:27.075849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6400434-460e-404b-a8af-4a737b7813cf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:27.077542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6400434-460e-404b-a8af-4a737b7813cf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:27.078151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b6400434-460e-404b-a8af-4a737b7813cf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:27.120595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b6400434-460e-404b-a8af-4a737b7813cf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:22:27.267197 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b6400434-460e-404b-a8af-4a737b7813cf tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 204 len: 0 microversion: 2.1 time: 0.244328 Aug 23 18:22:27.271284 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2810/5754] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:22:27 2022] DELETE /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:22:27.277370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-741319e6-5c4e-484d-adb2-853be14e3f3a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:27.279836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-741319e6-5c4e-484d-adb2-853be14e3f3a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:27.292107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-741319e6-5c4e-484d-adb2-853be14e3f3a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:27.292874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-741319e6-5c4e-484d-adb2-853be14e3f3a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:27.294774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-741319e6-5c4e-484d-adb2-853be14e3f3a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:27.296595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-741319e6-5c4e-484d-adb2-853be14e3f3a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:27.304486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-741319e6-5c4e-484d-adb2-853be14e3f3a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:27.305521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-741319e6-5c4e-484d-adb2-853be14e3f3a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:27.348951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:27.422180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b66fdd97-02d3-4185-a0b0-95d5c99e1037 req-863fcf71-6462-41fb-b208-caa0e6520e8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a439a32a-1387-4654-bd15-4de0a4d1e58d", "tag": "7fb999cd-0b0f-416d-b067-84c25d59f6ce"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:27.464373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b66fdd97-02d3-4185-a0b0-95d5c99e1037 req-863fcf71-6462-41fb-b208-caa0e6520e8a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:27.464886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b66fdd97-02d3-4185-a0b0-95d5c99e1037 req-863fcf71-6462-41fb-b208-caa0e6520e8a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:27.465963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b66fdd97-02d3-4185-a0b0-95d5c99e1037 req-863fcf71-6462-41fb-b208-caa0e6520e8a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:27.500508 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b66fdd97-02d3-4185-a0b0-95d5c99e1037 req-863fcf71-6462-41fb-b208-caa0e6520e8a service nova] Creating event network-changed:7fb999cd-0b0f-416d-b067-84c25d59f6ce for instance a439a32a-1387-4654-bd15-4de0a4d1e58d on n-h1-850468-16 Aug 23 18:22:27.507319 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b66fdd97-02d3-4185-a0b0-95d5c99e1037 req-863fcf71-6462-41fb-b208-caa0e6520e8a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092794 Aug 23 18:22:27.508657 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2811/5755] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:22:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:22:27.542524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f4cf0574-ad01-45ef-b2cd-5e544fb00eab tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:27.543288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f4cf0574-ad01-45ef-b2cd-5e544fb00eab tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:27.571300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4cf0574-ad01-45ef-b2cd-5e544fb00eab tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:27.572155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4cf0574-ad01-45ef-b2cd-5e544fb00eab tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:27.572888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4cf0574-ad01-45ef-b2cd-5e544fb00eab tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:27.573945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4cf0574-ad01-45ef-b2cd-5e544fb00eab tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:27.575469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4cf0574-ad01-45ef-b2cd-5e544fb00eab tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:27.576414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4cf0574-ad01-45ef-b2cd-5e544fb00eab tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:27.781062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f4cf0574-ad01-45ef-b2cd-5e544fb00eab tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:27.791415 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f4cf0574-ad01-45ef-b2cd-5e544fb00eab tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1522 microversion: 2.1 time: 0.266562 Aug 23 18:22:27.791975 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2812/5756] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:27 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:27.798256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc4219e0-86d1-4310-ac7e-39999cc495ea tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:27.798908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fc4219e0-86d1-4310-ac7e-39999cc495ea tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:27.805390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc4219e0-86d1-4310-ac7e-39999cc495ea tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:27.805886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc4219e0-86d1-4310-ac7e-39999cc495ea tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:27.806955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc4219e0-86d1-4310-ac7e-39999cc495ea tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:27.807668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc4219e0-86d1-4310-ac7e-39999cc495ea tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:27.808118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc4219e0-86d1-4310-ac7e-39999cc495ea tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:27.808544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc4219e0-86d1-4310-ac7e-39999cc495ea tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:27.835067 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-fc4219e0-86d1-4310-ac7e-39999cc495ea tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] HTTP exception thrown: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc4219e0-86d1-4310-ac7e-39999cc495ea tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Request method failure captured: Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 HTTP/1.1 Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRm7_Zm6d92jA7uaQU4LV4mwndE7TqwKQLeeEndCknMqcFiJM5-hEq9M0Xzh5NdSON-r1JbFLYhxGVZuaztDk52og-ONxOPh34qAIYJJrep9H-C-M6VfN062VFt4wX7ZG2BlIN03uqv7OILZFyj-4ska2N8E27bGnNLJhsidSpgKrFY Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 261a311c2f2b480984ab2412ac78e881 Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_261a311c2f2b480984ab2412ac78e881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/261a311c2f2b480984ab2412ac78e881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/261a311c2f2b480984ab2412ac78e881"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/261a311c2f2b480984ab2412ac78e881"}]}] Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 261a311c2f2b480984ab2412ac78e881 Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeShelveTestJSON-75466456-project Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f43268df184e40b0b66655e5a6eaa07c Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeShelveTestJSON-75466456-project Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2d8fe0c3-ea81-46b5-9230-216cf8e932d2'} Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:22:27.844601 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:22:27.849375 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:22:27.849375 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:22:27.849375 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:22:27.849375 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:22:27.849375 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:22:27.849375 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:22:27.849375 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:22:27.849375 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:22:27.849375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc4219e0-86d1-4310-ac7e-39999cc495ea tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Returning 404 to user: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:22:27.862562 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fc4219e0-86d1-4310-ac7e-39999cc495ea tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 404 len: 111 microversion: 2.20 time: 0.053305 Aug 23 18:22:27.867683 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2813/5757] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:27 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:22:27.873591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-873ff042-0bcd-4db7-9069-0b144d16d6dc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '.version_select at 0x7f27dfa8f670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:27.897198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-741319e6-5c4e-484d-adb2-853be14e3f3a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:27.911628 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-741319e6-5c4e-484d-adb2-853be14e3f3a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1670 microversion: 2.1 time: 0.638502 Aug 23 18:22:27.914092 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2945/5758] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:27 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1670 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:22:27.936555 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-873ff042-0bcd-4db7-9069-0b144d16d6dc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120815762" status: 204 len: 0 microversion: 2.20 time: 0.067405 Aug 23 18:22:27.937083 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2814/5759] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 18:22:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1120815762 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:22:28.823476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-22cd44bc-c6bb-482f-8d09-42805ad99696 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:28.824548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-22cd44bc-c6bb-482f-8d09-42805ad99696 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:28.855590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22cd44bc-c6bb-482f-8d09-42805ad99696 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:28.863934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22cd44bc-c6bb-482f-8d09-42805ad99696 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:28.864780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22cd44bc-c6bb-482f-8d09-42805ad99696 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:28.867172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22cd44bc-c6bb-482f-8d09-42805ad99696 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:28.869203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22cd44bc-c6bb-482f-8d09-42805ad99696 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:28.870971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22cd44bc-c6bb-482f-8d09-42805ad99696 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:28.936650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec1295dd-0109-45ff-b2ad-a4856680eca0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:28.937869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ec1295dd-0109-45ff-b2ad-a4856680eca0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:28.952626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec1295dd-0109-45ff-b2ad-a4856680eca0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:28.958931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec1295dd-0109-45ff-b2ad-a4856680eca0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:28.959630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec1295dd-0109-45ff-b2ad-a4856680eca0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:28.962178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec1295dd-0109-45ff-b2ad-a4856680eca0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:28.962869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec1295dd-0109-45ff-b2ad-a4856680eca0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:28.964680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec1295dd-0109-45ff-b2ad-a4856680eca0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:29.411588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-22cd44bc-c6bb-482f-8d09-42805ad99696 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:29.421562 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-22cd44bc-c6bb-482f-8d09-42805ad99696 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1522 microversion: 2.1 time: 0.608698 Aug 23 18:22:29.422172 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2946/5760] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:28 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1522 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:29.709169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c8acb014-61b8-466e-a3e1-afc79cdfebc6 req-a9cee6a0-1bc2-4fa2-831e-16dac2b2f4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9d20f3-bb14-4021-9ee1-d921cdc4fe05", "name": "network-vif-unplugged", "status": "completed", "tag": "dab328d0-fc26-4012-91a4-3e9081bc9057"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:29.723283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c8acb014-61b8-466e-a3e1-afc79cdfebc6 req-a9cee6a0-1bc2-4fa2-831e-16dac2b2f4e0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:29.723811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c8acb014-61b8-466e-a3e1-afc79cdfebc6 req-a9cee6a0-1bc2-4fa2-831e-16dac2b2f4e0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:29.724268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c8acb014-61b8-466e-a3e1-afc79cdfebc6 req-a9cee6a0-1bc2-4fa2-831e-16dac2b2f4e0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:29.751406 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c8acb014-61b8-466e-a3e1-afc79cdfebc6 req-a9cee6a0-1bc2-4fa2-831e-16dac2b2f4e0 service nova] Creating event network-vif-unplugged:dab328d0-fc26-4012-91a4-3e9081bc9057 for instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 on n-h1-850468-16 Aug 23 18:22:29.771710 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c8acb014-61b8-466e-a3e1-afc79cdfebc6 req-a9cee6a0-1bc2-4fa2-831e-16dac2b2f4e0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.325995 Aug 23 18:22:29.774649 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2947/5761] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:22:29.780765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-488c0eec-b2f1-4458-8b3e-0acb1bc004e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Action: 'create', calling method: .version_select at 0x7f27df7821f0>, body: {"keypair": {"name": "tempest-keypair-1660895580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcfpoSDkkznWwUEHxBHc22CEy7b/yEFZTaO9SqVyXwZYmQ2hDpblUK/7pu9rbE4NTGXOgi5lyyVXMPE1gBuy2sa347ooNHT8UJcpOJ3yOT9Ldbdu8FBXg/l7yBUKCP/dw=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:29.844630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-488c0eec-b2f1-4458-8b3e-0acb1bc004e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Getting quotas for project 261a311c2f2b480984ab2412ac78e881. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:22:29.853631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-488c0eec-b2f1-4458-8b3e-0acb1bc004e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Getting quotas for user f43268df184e40b0b66655e5a6eaa07c and project 261a311c2f2b480984ab2412ac78e881. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:22:29.916930 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-488c0eec-b2f1-4458-8b3e-0acb1bc004e4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.140856 Aug 23 18:22:29.917770 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2948/5762] 10.222.0.61 () {62 vars in 1200 bytes} [Tue Aug 23 18:22:29 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 23 18:22:29.946845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec1295dd-0109-45ff-b2ad-a4856680eca0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:29.959726 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec1295dd-0109-45ff-b2ad-a4856680eca0 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1670 microversion: 2.1 time: 1.027327 Aug 23 18:22:29.961895 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2815/5763] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:28 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1670 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:30.443991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cfe88942-f51e-4a2f-99c9-80b50cf21403 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:30.444738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cfe88942-f51e-4a2f-99c9-80b50cf21403 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:30.459675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfe88942-f51e-4a2f-99c9-80b50cf21403 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:30.460183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfe88942-f51e-4a2f-99c9-80b50cf21403 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:30.460652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfe88942-f51e-4a2f-99c9-80b50cf21403 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:30.461374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfe88942-f51e-4a2f-99c9-80b50cf21403 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:30.461845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfe88942-f51e-4a2f-99c9-80b50cf21403 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:30.462282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfe88942-f51e-4a2f-99c9-80b50cf21403 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:30.790149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ef031763-c5e9-407d-ad16-eb2b805f8593 req-b3edc905-17f0-4e00-a97f-c1c201b94656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a439a32a-1387-4654-bd15-4de0a4d1e58d", "name": "network-vif-deleted", "tag": "7fb999cd-0b0f-416d-b067-84c25d59f6ce"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:30.835923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ef031763-c5e9-407d-ad16-eb2b805f8593 req-b3edc905-17f0-4e00-a97f-c1c201b94656 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:30.837641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ef031763-c5e9-407d-ad16-eb2b805f8593 req-b3edc905-17f0-4e00-a97f-c1c201b94656 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:30.839617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ef031763-c5e9-407d-ad16-eb2b805f8593 req-b3edc905-17f0-4e00-a97f-c1c201b94656 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:30.878945 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ef031763-c5e9-407d-ad16-eb2b805f8593 req-b3edc905-17f0-4e00-a97f-c1c201b94656 service nova] Creating event network-vif-deleted:7fb999cd-0b0f-416d-b067-84c25d59f6ce for instance a439a32a-1387-4654-bd15-4de0a4d1e58d on n-h1-850468-16 Aug 23 18:22:30.890915 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ef031763-c5e9-407d-ad16-eb2b805f8593 req-b3edc905-17f0-4e00-a97f-c1c201b94656 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106443 Aug 23 18:22:30.894991 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2816/5764] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:22:30.983480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:30.984138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:31.006204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:31.006770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:31.007243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:31.010946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:31.011492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:31.011589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:31.017443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cfe88942-f51e-4a2f-99c9-80b50cf21403 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:31.065224 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cfe88942-f51e-4a2f-99c9-80b50cf21403 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1522 microversion: 2.1 time: 0.624233 Aug 23 18:22:31.067415 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2949/5765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:30 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1522 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:31.096433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:31.097362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:31.097978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:31.098644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lazy-loading 'fault' on Instance uuid a439a32a-1387-4654-bd15-4de0a4d1e58d {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:22:31.188754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef5f5a1ba1e7414a82fff09abe84a931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bc5872887aaa488fafcb94629d083630', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:31.212047 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-acf09930-97b4-4a39-ad41-f020e8b992bb tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 200 len: 1338 microversion: 2.1 time: 0.229571 Aug 23 18:22:31.213343 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2817/5766] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:30 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 1338 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:22:32.110357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b3aa30e-6b2d-423d-8694-903c434e5f42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:32.111901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3b3aa30e-6b2d-423d-8694-903c434e5f42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:32.136070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b3aa30e-6b2d-423d-8694-903c434e5f42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:32.136566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b3aa30e-6b2d-423d-8694-903c434e5f42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:32.138304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b3aa30e-6b2d-423d-8694-903c434e5f42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:32.139379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b3aa30e-6b2d-423d-8694-903c434e5f42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:32.143186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b3aa30e-6b2d-423d-8694-903c434e5f42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:32.143625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b3aa30e-6b2d-423d-8694-903c434e5f42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:32.236199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b5424660-c7b9-4e7f-9d4d-cb6866ab19a6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:32.237977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b5424660-c7b9-4e7f-9d4d-cb6866ab19a6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] [instance: a439a32a-1387-4654-bd15-4de0a4d1e58d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:32.256766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5424660-c7b9-4e7f-9d4d-cb6866ab19a6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:32.257519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5424660-c7b9-4e7f-9d4d-cb6866ab19a6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:32.257969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5424660-c7b9-4e7f-9d4d-cb6866ab19a6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:32.258714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5424660-c7b9-4e7f-9d4d-cb6866ab19a6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:32.259327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5424660-c7b9-4e7f-9d4d-cb6866ab19a6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:32.259913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5424660-c7b9-4e7f-9d4d-cb6866ab19a6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:32.279031 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-b5424660-c7b9-4e7f-9d4d-cb6866ab19a6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] HTTP exception thrown: Instance a439a32a-1387-4654-bd15-4de0a4d1e58d could not be found. Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b5424660-c7b9-4e7f-9d4d-cb6866ab19a6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Request method failure captured: Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d HTTP/1.1 Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRmSvpgAIznH5S1a4nybwyYK2B3Qh2Avc70Gt0_e8zHcozOFTda5V3x0KYhyk_Ne6OpOT_wUleY6NHBuHo2GLPhKP_qWdnYimRz80vPv5PC0vMv_aeqXc6tL8uzwYolCx52LizP2jg0DMmIaIs7yy_xJu8sEnBmeoTU3NBTCEscB5bs Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: bc5872887aaa488fafcb94629d083630 Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestNetworkBasicOps-1018920659 Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_bc5872887aaa488fafcb94629d083630"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc5872887aaa488fafcb94629d083630"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/bc5872887aaa488fafcb94629d083630"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/bc5872887aaa488fafcb94629d083630"}]}] Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestNetworkBasicOps-1018920659 Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: bc5872887aaa488fafcb94629d083630 Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestNetworkBasicOps-1018920659 Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestNetworkBasicOps-1018920659-project Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: ef5f5a1ba1e7414a82fff09abe84a931 Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestNetworkBasicOps-1018920659-project Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance a439a32a-1387-4654-bd15-4de0a4d1e58d could not be found. Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'a439a32a-1387-4654-bd15-4de0a4d1e58d'} Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a439a32a-1387-4654-bd15-4de0a4d1e58d could not be found. Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a439a32a-1387-4654-bd15-4de0a4d1e58d could not be found. Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:22:32.285932 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:22:32.290499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:22:32.290499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:22:32.290499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:22:32.290499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:22:32.290499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:22:32.290499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a439a32a-1387-4654-bd15-4de0a4d1e58d could not be found. Aug 23 18:22:32.290499 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:22:32.292656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b5424660-c7b9-4e7f-9d4d-cb6866ab19a6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Returning 404 to user: Instance a439a32a-1387-4654-bd15-4de0a4d1e58d could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:22:32.294322 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b5424660-c7b9-4e7f-9d4d-cb6866ab19a6 tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d" status: 404 len: 111 microversion: 2.1 time: 0.064666 Aug 23 18:22:32.295507 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2818/5767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:32 2022] GET /compute/v2.1/servers/a439a32a-1387-4654-bd15-4de0a4d1e58d => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:22:32.537380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3b3aa30e-6b2d-423d-8694-903c434e5f42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:32.573500 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3b3aa30e-6b2d-423d-8694-903c434e5f42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1522 microversion: 2.1 time: 0.484011 Aug 23 18:22:32.574781 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2950/5768] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:32 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1522 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:32.763952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-52480e51-2768-4ba9-97a0-b0fbaa629a4a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] Calling method '.version_select at 0x7f27df8855e0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:32.800079 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-52480e51-2768-4ba9-97a0-b0fbaa629a4a tempest-TestNetworkBasicOps-1018920659 tempest-TestNetworkBasicOps-1018920659-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-971607671" status: 202 len: 0 microversion: 2.1 time: 0.040868 Aug 23 18:22:32.800636 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2819/5769] 10.222.0.61 () {58 vars in 1254 bytes} [Tue Aug 23 18:22:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-971607671 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:22:32.970969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c28277d5-7ab5-4af3-83db-182c477807dd req-ded7d377-6c22-4417-a314-7dfebf9d044e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9d20f3-bb14-4021-9ee1-d921cdc4fe05", "name": "network-vif-plugged", "status": "completed", "tag": "dab328d0-fc26-4012-91a4-3e9081bc9057"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:32.989367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c28277d5-7ab5-4af3-83db-182c477807dd req-ded7d377-6c22-4417-a314-7dfebf9d044e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:32.990009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c28277d5-7ab5-4af3-83db-182c477807dd req-ded7d377-6c22-4417-a314-7dfebf9d044e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:32.990569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c28277d5-7ab5-4af3-83db-182c477807dd req-ded7d377-6c22-4417-a314-7dfebf9d044e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:33.015668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c28277d5-7ab5-4af3-83db-182c477807dd req-ded7d377-6c22-4417-a314-7dfebf9d044e service nova] Creating event network-vif-plugged:dab328d0-fc26-4012-91a4-3e9081bc9057 for instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 on n-h1-850468-16 Aug 23 18:22:33.032649 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c28277d5-7ab5-4af3-83db-182c477807dd req-ded7d377-6c22-4417-a314-7dfebf9d044e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065286 Aug 23 18:22:33.033826 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2951/5770] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:22:33.599811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47763901-c8f0-4f7c-8aa1-ea9338e35f33 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:33.600661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-47763901-c8f0-4f7c-8aa1-ea9338e35f33 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:33.617210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47763901-c8f0-4f7c-8aa1-ea9338e35f33 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:33.619549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47763901-c8f0-4f7c-8aa1-ea9338e35f33 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:33.620032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47763901-c8f0-4f7c-8aa1-ea9338e35f33 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:33.622155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47763901-c8f0-4f7c-8aa1-ea9338e35f33 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:33.623849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47763901-c8f0-4f7c-8aa1-ea9338e35f33 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:33.624305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47763901-c8f0-4f7c-8aa1-ea9338e35f33 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:33.634515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:34.291304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-47763901-c8f0-4f7c-8aa1-ea9338e35f33 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:34.305357 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-47763901-c8f0-4f7c-8aa1-ea9338e35f33 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1522 microversion: 2.1 time: 0.711906 Aug 23 18:22:34.306036 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2820/5771] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:33 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1522 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:34.306480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1032614640", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b051757f-c56b-4439-bfab-5529d042b27d"}], "security_groups": [{"name": "tempest-securitygroup--954983648"}], "key_name": "tempest-keypair-1660895580", "user_data": "}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:34.569176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] validate_networks() for [('b051757f-c56b-4439-bfab-5529d042b27d', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:22:35.328676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ca55a53-b5c3-40cc-bbd9-239b4e784c48 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:35.329290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1ca55a53-b5c3-40cc-bbd9-239b4e784c48 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:35.343849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ca55a53-b5c3-40cc-bbd9-239b4e784c48 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:35.346233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ca55a53-b5c3-40cc-bbd9-239b4e784c48 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:35.347751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ca55a53-b5c3-40cc-bbd9-239b4e784c48 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:35.351660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ca55a53-b5c3-40cc-bbd9-239b4e784c48 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:35.353661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ca55a53-b5c3-40cc-bbd9-239b4e784c48 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:35.356246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ca55a53-b5c3-40cc-bbd9-239b4e784c48 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:35.779840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:22:35.780303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:22:35.782119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:22:35.782652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:22:35.783265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:22:35.801422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:35.804502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:35.806831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:35.807761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:35.809616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:35.810385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:35.834787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1ca55a53-b5c3-40cc-bbd9-239b4e784c48 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:35.855627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Getting quotas for project 261a311c2f2b480984ab2412ac78e881. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:22:35.862412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Getting quotas for user f43268df184e40b0b66655e5a6eaa07c and project 261a311c2f2b480984ab2412ac78e881. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:22:35.864735 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1ca55a53-b5c3-40cc-bbd9-239b4e784c48 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1507 microversion: 2.1 time: 0.541301 Aug 23 18:22:35.879410 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2821/5772] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:35 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1507 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:35.886722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:22:35.889635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9bdbe8da-3459-478f-898d-f80df20ef57a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:35.890478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9bdbe8da-3459-478f-898d-f80df20ef57a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:35.900736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bdbe8da-3459-478f-898d-f80df20ef57a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:35.901488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bdbe8da-3459-478f-898d-f80df20ef57a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:35.901628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:22:35.902282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bdbe8da-3459-478f-898d-f80df20ef57a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:35.904105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bdbe8da-3459-478f-898d-f80df20ef57a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:35.904922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bdbe8da-3459-478f-898d-f80df20ef57a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:35.905649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9bdbe8da-3459-478f-898d-f80df20ef57a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:35.972358 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8beecd14-f83f-4f73-b527-48b1267f274e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.038220 Aug 23 18:22:35.973362 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2952/5773] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 18:22:33 2022] POST /compute/v2.1/servers => generated 401 bytes in 2040 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 23 18:22:35.984950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8975bf08-6934-47b3-96c1-9b80771fb9a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:35.990366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8975bf08-6934-47b3-96c1-9b80771fb9a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:36.080825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8975bf08-6934-47b3-96c1-9b80771fb9a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:36.089576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8975bf08-6934-47b3-96c1-9b80771fb9a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:36.091535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8975bf08-6934-47b3-96c1-9b80771fb9a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:36.100869 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8975bf08-6934-47b3-96c1-9b80771fb9a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1282 microversion: 2.20 time: 0.119981 Aug 23 18:22:36.106928 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2953/5774] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:35 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1282 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:22:36.308420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9bdbe8da-3459-478f-898d-f80df20ef57a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:36.325013 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9bdbe8da-3459-478f-898d-f80df20ef57a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 200 len: 1507 microversion: 2.1 time: 0.439476 Aug 23 18:22:36.342431 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2822/5775] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:35 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 1507 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:36.346319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e1bc392-8bfc-4d2c-aa63-631abc51cb29 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:36.347387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e1bc392-8bfc-4d2c-aa63-631abc51cb29 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:36.361823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e1bc392-8bfc-4d2c-aa63-631abc51cb29 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:36.364269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e1bc392-8bfc-4d2c-aa63-631abc51cb29 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:36.364849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e1bc392-8bfc-4d2c-aa63-631abc51cb29 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:36.367573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e1bc392-8bfc-4d2c-aa63-631abc51cb29 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:36.368679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e1bc392-8bfc-4d2c-aa63-631abc51cb29 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:36.371584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e1bc392-8bfc-4d2c-aa63-631abc51cb29 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:36.460516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e1bc392-8bfc-4d2c-aa63-631abc51cb29 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:22:36.734287 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e1bc392-8bfc-4d2c-aa63-631abc51cb29 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 204 len: 0 microversion: 2.1 time: 0.391309 Aug 23 18:22:36.735113 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2954/5776] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:22:36 2022] DELETE /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:22:37.090351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-408558733", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "68ce5121-678b-4517-ba2c-957ca7c12ee0"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:37.130823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2189f56a-1381-4ee2-9c20-ab3402e67426 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:37.131652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2189f56a-1381-4ee2-9c20-ab3402e67426 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:37.218666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] validate_networks() for [('68ce5121-678b-4517-ba2c-957ca7c12ee0', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:22:37.302531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2189f56a-1381-4ee2-9c20-ab3402e67426 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:37.323430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2189f56a-1381-4ee2-9c20-ab3402e67426 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:37.332469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2189f56a-1381-4ee2-9c20-ab3402e67426 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:37.339152 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2189f56a-1381-4ee2-9c20-ab3402e67426 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1282 microversion: 2.20 time: 0.213050 Aug 23 18:22:37.341463 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2955/5777] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:37 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1282 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:38.366437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c374b773-8acf-4180-87e4-41f8a7af0ecd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:38.367189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c374b773-8acf-4180-87e4-41f8a7af0ecd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:38.383097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c374b773-8acf-4180-87e4-41f8a7af0ecd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:38.383950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c374b773-8acf-4180-87e4-41f8a7af0ecd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:38.393867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c374b773-8acf-4180-87e4-41f8a7af0ecd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:38.394691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c374b773-8acf-4180-87e4-41f8a7af0ecd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:38.395218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c374b773-8acf-4180-87e4-41f8a7af0ecd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:38.395654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c374b773-8acf-4180-87e4-41f8a7af0ecd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:38.464996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:22:38.465889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:22:38.466345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:22:38.468015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:22:38.468749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:22:38.481615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:38.482444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:38.483150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:38.484150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:38.484830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:38.485462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:38.527047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c374b773-8acf-4180-87e4-41f8a7af0ecd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:38.536357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Getting quotas for project 41f4e8e13960468dbdaf601e0141db0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:22:38.540541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c374b773-8acf-4180-87e4-41f8a7af0ecd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:38.544550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Getting quotas for user d175596a3d804183b2388a25ab9a1018 and project 41f4e8e13960468dbdaf601e0141db0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:22:38.548790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c374b773-8acf-4180-87e4-41f8a7af0ecd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:38.550958 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c374b773-8acf-4180-87e4-41f8a7af0ecd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1334 microversion: 2.20 time: 0.188597 Aug 23 18:22:38.552534 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2956/5778] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:38 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1334 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:38.588540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:22:38.597659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:22:38.714010 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-616ab751-104f-438f-a068-67dc752cccc3 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.628418 Aug 23 18:22:38.715921 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2823/5779] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:22:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:22:38.726472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-67fe04f7-e808-4c45-a5ca-a94be9fa5c78 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:38.727383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-67fe04f7-e808-4c45-a5ca-a94be9fa5c78 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:38.943802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-67fe04f7-e808-4c45-a5ca-a94be9fa5c78 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:38.964613 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-67fe04f7-e808-4c45-a5ca-a94be9fa5c78 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1217 microversion: 2.1 time: 0.238913 Aug 23 18:22:38.969942 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2957/5780] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:38 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1217 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:22:39.579187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf1b2c13-244a-456f-84db-2aac62d90c20 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:39.580413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf1b2c13-244a-456f-84db-2aac62d90c20 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:39.594634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf1b2c13-244a-456f-84db-2aac62d90c20 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:39.595404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf1b2c13-244a-456f-84db-2aac62d90c20 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:39.599756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf1b2c13-244a-456f-84db-2aac62d90c20 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:39.600733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf1b2c13-244a-456f-84db-2aac62d90c20 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:39.601376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf1b2c13-244a-456f-84db-2aac62d90c20 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:39.601964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf1b2c13-244a-456f-84db-2aac62d90c20 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:39.770084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf1b2c13-244a-456f-84db-2aac62d90c20 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:39.782306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf1b2c13-244a-456f-84db-2aac62d90c20 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:39.783863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf1b2c13-244a-456f-84db-2aac62d90c20 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:39.784986 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf1b2c13-244a-456f-84db-2aac62d90c20 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1340 microversion: 2.20 time: 0.211139 Aug 23 18:22:39.786149 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2824/5781] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:39 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1340 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:39.994884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c28ed787-2225-4927-b838-db556f89deb0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:39.995419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c28ed787-2225-4927-b838-db556f89deb0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:40.014180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c28ed787-2225-4927-b838-db556f89deb0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:40.014727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c28ed787-2225-4927-b838-db556f89deb0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:40.015185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c28ed787-2225-4927-b838-db556f89deb0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:40.015921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c28ed787-2225-4927-b838-db556f89deb0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:40.016391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c28ed787-2225-4927-b838-db556f89deb0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:40.016840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c28ed787-2225-4927-b838-db556f89deb0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:40.272657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c28ed787-2225-4927-b838-db556f89deb0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:40.318956 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c28ed787-2225-4927-b838-db556f89deb0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1269 microversion: 2.1 time: 0.327736 Aug 23 18:22:40.319752 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2958/5782] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:39 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1269 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:40.569199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-6f5cd017-61fe-4079-b4f8-391e2d0676be req-606b720a-2079-49db-ab83-da37b902cd31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f9d20f3-bb14-4021-9ee1-d921cdc4fe05", "name": "network-vif-deleted", "tag": "dab328d0-fc26-4012-91a4-3e9081bc9057"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:40.628928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6f5cd017-61fe-4079-b4f8-391e2d0676be req-606b720a-2079-49db-ab83-da37b902cd31 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:40.629550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6f5cd017-61fe-4079-b4f8-391e2d0676be req-606b720a-2079-49db-ab83-da37b902cd31 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:40.632493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6f5cd017-61fe-4079-b4f8-391e2d0676be req-606b720a-2079-49db-ab83-da37b902cd31 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:40.678652 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-6f5cd017-61fe-4079-b4f8-391e2d0676be req-606b720a-2079-49db-ab83-da37b902cd31 service nova] Creating event network-vif-deleted:dab328d0-fc26-4012-91a4-3e9081bc9057 for instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 on n-h1-850468-16 Aug 23 18:22:40.692827 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-6f5cd017-61fe-4079-b4f8-391e2d0676be req-606b720a-2079-49db-ab83-da37b902cd31 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.127831 Aug 23 18:22:40.694670 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2825/5783] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:22:40.813105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9c2884e1-ebcb-435a-82a6-4c90e26aec99 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:40.814238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9c2884e1-ebcb-435a-82a6-4c90e26aec99 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:40.829690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c2884e1-ebcb-435a-82a6-4c90e26aec99 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:40.830642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c2884e1-ebcb-435a-82a6-4c90e26aec99 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:40.831327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c2884e1-ebcb-435a-82a6-4c90e26aec99 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:40.832429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c2884e1-ebcb-435a-82a6-4c90e26aec99 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:40.833145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c2884e1-ebcb-435a-82a6-4c90e26aec99 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:40.833868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c2884e1-ebcb-435a-82a6-4c90e26aec99 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:41.189028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9c2884e1-ebcb-435a-82a6-4c90e26aec99 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:41.205929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9c2884e1-ebcb-435a-82a6-4c90e26aec99 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:41.208555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9c2884e1-ebcb-435a-82a6-4c90e26aec99 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:41.216955 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9c2884e1-ebcb-435a-82a6-4c90e26aec99 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1340 microversion: 2.20 time: 0.408946 Aug 23 18:22:41.217763 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2959/5784] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:40 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1340 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:41.342113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5633336-35f1-4293-99c7-89cd1d149423 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:41.343583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a5633336-35f1-4293-99c7-89cd1d149423 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:41.354620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5633336-35f1-4293-99c7-89cd1d149423 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:41.358803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5633336-35f1-4293-99c7-89cd1d149423 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:41.359518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5633336-35f1-4293-99c7-89cd1d149423 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:41.360420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5633336-35f1-4293-99c7-89cd1d149423 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:41.364494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5633336-35f1-4293-99c7-89cd1d149423 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:41.365070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5633336-35f1-4293-99c7-89cd1d149423 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:41.671339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a5633336-35f1-4293-99c7-89cd1d149423 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:41.687875 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a5633336-35f1-4293-99c7-89cd1d149423 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1275 microversion: 2.1 time: 0.351389 Aug 23 18:22:41.689991 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2826/5785] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:41 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1275 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:42.270878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-17d84d69-10d4-4397-8db0-6237d57eca92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:42.270878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-17d84d69-10d4-4397-8db0-6237d57eca92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:42.274959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:42.290491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d84d69-10d4-4397-8db0-6237d57eca92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:42.292115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d84d69-10d4-4397-8db0-6237d57eca92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:42.292600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d84d69-10d4-4397-8db0-6237d57eca92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:42.293546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d84d69-10d4-4397-8db0-6237d57eca92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:42.294033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d84d69-10d4-4397-8db0-6237d57eca92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:42.294483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17d84d69-10d4-4397-8db0-6237d57eca92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:42.712455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6474a7fd-9393-439b-b665-eb0e08a8b8f2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:42.716407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6474a7fd-9393-439b-b665-eb0e08a8b8f2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:42.739118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:42.740945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6474a7fd-9393-439b-b665-eb0e08a8b8f2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:42.741064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6474a7fd-9393-439b-b665-eb0e08a8b8f2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:42.741466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6474a7fd-9393-439b-b665-eb0e08a8b8f2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:42.742329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6474a7fd-9393-439b-b665-eb0e08a8b8f2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:42.768160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6474a7fd-9393-439b-b665-eb0e08a8b8f2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:42.776323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6474a7fd-9393-439b-b665-eb0e08a8b8f2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:43.004895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6474a7fd-9393-439b-b665-eb0e08a8b8f2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:43.015704 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6474a7fd-9393-439b-b665-eb0e08a8b8f2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1275 microversion: 2.1 time: 0.309521 Aug 23 18:22:43.016279 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2827/5786] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:42 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1275 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:43.163951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-895ea244-cdea-4b58-b87e-17086bfeafe0 req-4db91e20-0e6d-4783-b6df-474df7f7f476 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9825ea0c-c842-4818-af65-f737a8c71689", "tag": "9cdade09-ac01-4d30-a9d4-cb5277d88470"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:43.187408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-895ea244-cdea-4b58-b87e-17086bfeafe0 req-4db91e20-0e6d-4783-b6df-474df7f7f476 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:43.188274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-895ea244-cdea-4b58-b87e-17086bfeafe0 req-4db91e20-0e6d-4783-b6df-474df7f7f476 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:43.188984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-895ea244-cdea-4b58-b87e-17086bfeafe0 req-4db91e20-0e6d-4783-b6df-474df7f7f476 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:43.213644 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-895ea244-cdea-4b58-b87e-17086bfeafe0 req-4db91e20-0e6d-4783-b6df-474df7f7f476 service nova] Creating event network-changed:9cdade09-ac01-4d30-a9d4-cb5277d88470 for instance 9825ea0c-c842-4818-af65-f737a8c71689 on n-h1-850468-16 Aug 23 18:22:43.220574 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-895ea244-cdea-4b58-b87e-17086bfeafe0 req-4db91e20-0e6d-4783-b6df-474df7f7f476 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060240 Aug 23 18:22:43.221983 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2828/5787] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:22:43.253891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-17d84d69-10d4-4397-8db0-6237d57eca92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:43.263377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-17d84d69-10d4-4397-8db0-6237d57eca92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:43.265229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-17d84d69-10d4-4397-8db0-6237d57eca92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:43.266754 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-17d84d69-10d4-4397-8db0-6237d57eca92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1407 microversion: 2.20 time: 1.001717 Aug 23 18:22:43.267570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2960/5788] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:42 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1407 bytes in 1003 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:44.038643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eed1f0ef-e8e1-4d44-b26b-02bf1c611fed tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:44.039547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eed1f0ef-e8e1-4d44-b26b-02bf1c611fed tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:44.049622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eed1f0ef-e8e1-4d44-b26b-02bf1c611fed tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:44.049622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eed1f0ef-e8e1-4d44-b26b-02bf1c611fed tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:44.049622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eed1f0ef-e8e1-4d44-b26b-02bf1c611fed tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:44.052339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eed1f0ef-e8e1-4d44-b26b-02bf1c611fed tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:44.052924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eed1f0ef-e8e1-4d44-b26b-02bf1c611fed tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:44.055436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eed1f0ef-e8e1-4d44-b26b-02bf1c611fed tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:44.296016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac7f22ae-f939-4bef-858d-b23667dd582e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:44.297094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac7f22ae-f939-4bef-858d-b23667dd582e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:44.311176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7f22ae-f939-4bef-858d-b23667dd582e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:44.312196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7f22ae-f939-4bef-858d-b23667dd582e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:44.312820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7f22ae-f939-4bef-858d-b23667dd582e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:44.313379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7f22ae-f939-4bef-858d-b23667dd582e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:44.313848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7f22ae-f939-4bef-858d-b23667dd582e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:44.314283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac7f22ae-f939-4bef-858d-b23667dd582e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:44.370389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eed1f0ef-e8e1-4d44-b26b-02bf1c611fed tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:44.396784 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eed1f0ef-e8e1-4d44-b26b-02bf1c611fed tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1317 microversion: 2.1 time: 0.363701 Aug 23 18:22:44.397581 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2829/5789] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:44 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1317 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:44.721972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac7f22ae-f939-4bef-858d-b23667dd582e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:44.735644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac7f22ae-f939-4bef-858d-b23667dd582e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:44.737280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac7f22ae-f939-4bef-858d-b23667dd582e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:44.739034 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac7f22ae-f939-4bef-858d-b23667dd582e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1407 microversion: 2.20 time: 0.450998 Aug 23 18:22:44.739806 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2961/5790] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:44 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1407 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:22:45.420995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc04fe9f-ced9-4dc1-8554-46b71c7444d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:45.422219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fc04fe9f-ced9-4dc1-8554-46b71c7444d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:45.429642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc04fe9f-ced9-4dc1-8554-46b71c7444d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:45.435246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc04fe9f-ced9-4dc1-8554-46b71c7444d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:45.435928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc04fe9f-ced9-4dc1-8554-46b71c7444d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:45.436858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc04fe9f-ced9-4dc1-8554-46b71c7444d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:45.443231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc04fe9f-ced9-4dc1-8554-46b71c7444d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:45.443889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc04fe9f-ced9-4dc1-8554-46b71c7444d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:45.766031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-31527e95-5d9c-4006-b4c3-b94f6db384cf tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:45.766929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-31527e95-5d9c-4006-b4c3-b94f6db384cf tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:45.780045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31527e95-5d9c-4006-b4c3-b94f6db384cf tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:45.780911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31527e95-5d9c-4006-b4c3-b94f6db384cf tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:45.781691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31527e95-5d9c-4006-b4c3-b94f6db384cf tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:45.782728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31527e95-5d9c-4006-b4c3-b94f6db384cf tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:45.783425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31527e95-5d9c-4006-b4c3-b94f6db384cf tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:45.784575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31527e95-5d9c-4006-b4c3-b94f6db384cf tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:45.834151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:45.906214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fc04fe9f-ced9-4dc1-8554-46b71c7444d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:45.919857 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fc04fe9f-ced9-4dc1-8554-46b71c7444d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1317 microversion: 2.1 time: 0.503748 Aug 23 18:22:45.921003 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2830/5791] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:45 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1317 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:46.025282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-953be7c9-ccbb-41c4-9a28-312e8d2aa93c req-06c274f1-bcb3-404e-9b4a-1f792cfcf503 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e967f401-d352-4b31-8c5a-0f03fa0a9d3f", "tag": "99f1f073-60a1-4593-8a55-07aea05f954b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:46.047176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-953be7c9-ccbb-41c4-9a28-312e8d2aa93c req-06c274f1-bcb3-404e-9b4a-1f792cfcf503 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:46.047931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-953be7c9-ccbb-41c4-9a28-312e8d2aa93c req-06c274f1-bcb3-404e-9b4a-1f792cfcf503 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:46.048521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-953be7c9-ccbb-41c4-9a28-312e8d2aa93c req-06c274f1-bcb3-404e-9b4a-1f792cfcf503 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:46.074457 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-953be7c9-ccbb-41c4-9a28-312e8d2aa93c req-06c274f1-bcb3-404e-9b4a-1f792cfcf503 service nova] Creating event network-changed:99f1f073-60a1-4593-8a55-07aea05f954b for instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f on n-h2-850468-16 Aug 23 18:22:46.081526 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-953be7c9-ccbb-41c4-9a28-312e8d2aa93c req-06c274f1-bcb3-404e-9b4a-1f792cfcf503 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059920 Aug 23 18:22:46.082495 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2831/5792] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:22:46.143943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-31527e95-5d9c-4006-b4c3-b94f6db384cf tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:46.168086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-31527e95-5d9c-4006-b4c3-b94f6db384cf tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:46.170706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-31527e95-5d9c-4006-b4c3-b94f6db384cf tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:46.171455 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-31527e95-5d9c-4006-b4c3-b94f6db384cf tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1407 microversion: 2.20 time: 0.409971 Aug 23 18:22:46.182892 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2962/5793] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:45 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1407 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:46.942219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5a9028ad-b549-497a-9616-79ecb48591ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:46.943008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5a9028ad-b549-497a-9616-79ecb48591ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:46.950640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a9028ad-b549-497a-9616-79ecb48591ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:46.951573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a9028ad-b549-497a-9616-79ecb48591ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:46.952276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a9028ad-b549-497a-9616-79ecb48591ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:46.953233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a9028ad-b549-497a-9616-79ecb48591ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:46.953907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a9028ad-b549-497a-9616-79ecb48591ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:46.954569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a9028ad-b549-497a-9616-79ecb48591ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:47.198397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6f9395f-07e6-4d19-ba3e-7bfbd8f3bc5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:47.199951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6f9395f-07e6-4d19-ba3e-7bfbd8f3bc5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:47.216250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6f9395f-07e6-4d19-ba3e-7bfbd8f3bc5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:47.216781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6f9395f-07e6-4d19-ba3e-7bfbd8f3bc5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:47.217235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6f9395f-07e6-4d19-ba3e-7bfbd8f3bc5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:47.217979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6f9395f-07e6-4d19-ba3e-7bfbd8f3bc5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:47.218441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6f9395f-07e6-4d19-ba3e-7bfbd8f3bc5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:47.218904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6f9395f-07e6-4d19-ba3e-7bfbd8f3bc5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:47.555630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6f9395f-07e6-4d19-ba3e-7bfbd8f3bc5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:47.579839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6f9395f-07e6-4d19-ba3e-7bfbd8f3bc5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:47.586918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6f9395f-07e6-4d19-ba3e-7bfbd8f3bc5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:47.588446 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6f9395f-07e6-4d19-ba3e-7bfbd8f3bc5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1407 microversion: 2.20 time: 0.395314 Aug 23 18:22:47.595866 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2963/5794] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:47 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:47.648589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5a9028ad-b549-497a-9616-79ecb48591ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:47.666131 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5a9028ad-b549-497a-9616-79ecb48591ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1317 microversion: 2.1 time: 0.728749 Aug 23 18:22:47.667225 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2832/5795] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:46 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1317 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:48.637460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4b187fa7-416b-427b-8159-5debc95e3520 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:48.639290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4b187fa7-416b-427b-8159-5debc95e3520 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:48.647558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b187fa7-416b-427b-8159-5debc95e3520 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:48.648333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b187fa7-416b-427b-8159-5debc95e3520 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:48.648953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b187fa7-416b-427b-8159-5debc95e3520 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:48.650067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b187fa7-416b-427b-8159-5debc95e3520 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:48.650744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b187fa7-416b-427b-8159-5debc95e3520 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:48.651339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b187fa7-416b-427b-8159-5debc95e3520 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:48.693238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1d9c88e9-c176-4213-aa37-f0f48168e31b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:48.694514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1d9c88e9-c176-4213-aa37-f0f48168e31b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:48.700507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:48.706643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:48.713881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d9c88e9-c176-4213-aa37-f0f48168e31b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:48.714380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d9c88e9-c176-4213-aa37-f0f48168e31b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:48.717471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d9c88e9-c176-4213-aa37-f0f48168e31b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:48.719729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d9c88e9-c176-4213-aa37-f0f48168e31b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:48.721887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d9c88e9-c176-4213-aa37-f0f48168e31b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:48.723558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d9c88e9-c176-4213-aa37-f0f48168e31b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:48.961252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=16 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:49.040897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b187fa7-416b-427b-8159-5debc95e3520 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:49.053843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b187fa7-416b-427b-8159-5debc95e3520 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:49.056062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b187fa7-416b-427b-8159-5debc95e3520 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:49.059589 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4b187fa7-416b-427b-8159-5debc95e3520 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1407 microversion: 2.20 time: 0.433746 Aug 23 18:22:49.077903 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2964/5796] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:48 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1407 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:49.133915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1d9c88e9-c176-4213-aa37-f0f48168e31b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:49.150921 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1d9c88e9-c176-4213-aa37-f0f48168e31b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1317 microversion: 2.1 time: 0.458680 Aug 23 18:22:49.154739 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2833/5797] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:48 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1317 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:50.085120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a673de86-eef3-41a3-8155-04ff35a9eba4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:50.087307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a673de86-eef3-41a3-8155-04ff35a9eba4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:50.103763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a673de86-eef3-41a3-8155-04ff35a9eba4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:50.104532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a673de86-eef3-41a3-8155-04ff35a9eba4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:50.107549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a673de86-eef3-41a3-8155-04ff35a9eba4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:50.109105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a673de86-eef3-41a3-8155-04ff35a9eba4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:50.109764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a673de86-eef3-41a3-8155-04ff35a9eba4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:50.111797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a673de86-eef3-41a3-8155-04ff35a9eba4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:50.176100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a99b1f1a-1fe7-4588-944a-55bba02ba7f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:50.176717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a99b1f1a-1fe7-4588-944a-55bba02ba7f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:50.188758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99b1f1a-1fe7-4588-944a-55bba02ba7f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:50.191716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99b1f1a-1fe7-4588-944a-55bba02ba7f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:50.192368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99b1f1a-1fe7-4588-944a-55bba02ba7f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:50.193275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99b1f1a-1fe7-4588-944a-55bba02ba7f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:50.194238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99b1f1a-1fe7-4588-944a-55bba02ba7f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:50.195327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a99b1f1a-1fe7-4588-944a-55bba02ba7f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:50.463247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a673de86-eef3-41a3-8155-04ff35a9eba4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:50.476523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a673de86-eef3-41a3-8155-04ff35a9eba4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:50.478061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a673de86-eef3-41a3-8155-04ff35a9eba4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:50.482812 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a673de86-eef3-41a3-8155-04ff35a9eba4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1407 microversion: 2.20 time: 0.401657 Aug 23 18:22:50.501714 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2965/5798] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:50 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1407 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:50.525986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-a690f34f-7c69-4d5a-9b09-49287cb13d27 req-61516c4e-89fb-44b7-afb3-1aaea9d3ebca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9825ea0c-c842-4818-af65-f737a8c71689", "name": "network-vif-plugged", "status": "completed", "tag": "9cdade09-ac01-4d30-a9d4-cb5277d88470"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:50.569142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a690f34f-7c69-4d5a-9b09-49287cb13d27 req-61516c4e-89fb-44b7-afb3-1aaea9d3ebca service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:50.571665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a690f34f-7c69-4d5a-9b09-49287cb13d27 req-61516c4e-89fb-44b7-afb3-1aaea9d3ebca service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:50.588081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a690f34f-7c69-4d5a-9b09-49287cb13d27 req-61516c4e-89fb-44b7-afb3-1aaea9d3ebca service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:50.639080 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-a690f34f-7c69-4d5a-9b09-49287cb13d27 req-61516c4e-89fb-44b7-afb3-1aaea9d3ebca service nova] Creating event network-vif-plugged:9cdade09-ac01-4d30-a9d4-cb5277d88470 for instance 9825ea0c-c842-4818-af65-f737a8c71689 on n-h1-850468-16 Aug 23 18:22:50.655249 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-a690f34f-7c69-4d5a-9b09-49287cb13d27 req-61516c4e-89fb-44b7-afb3-1aaea9d3ebca service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147819 Aug 23 18:22:50.657223 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2966/5799] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:22:50.667162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a99b1f1a-1fe7-4588-944a-55bba02ba7f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:50.676176 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a99b1f1a-1fe7-4588-944a-55bba02ba7f4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1317 microversion: 2.1 time: 0.504156 Aug 23 18:22:50.682749 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2834/5800] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:50 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1317 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:51.509127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1cb36b22-0917-4105-9442-96316f73e1cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:51.510655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1cb36b22-0917-4105-9442-96316f73e1cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:51.541944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cb36b22-0917-4105-9442-96316f73e1cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:51.546769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cb36b22-0917-4105-9442-96316f73e1cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:51.549347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cb36b22-0917-4105-9442-96316f73e1cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:51.553029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cb36b22-0917-4105-9442-96316f73e1cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:51.554802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cb36b22-0917-4105-9442-96316f73e1cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:51.557305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1cb36b22-0917-4105-9442-96316f73e1cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:51.594314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:22:51.702794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d90c1a1c-0501-475f-843e-be122af2555a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:51.704032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d90c1a1c-0501-475f-843e-be122af2555a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:51.723780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d90c1a1c-0501-475f-843e-be122af2555a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:51.728467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d90c1a1c-0501-475f-843e-be122af2555a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:51.729732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d90c1a1c-0501-475f-843e-be122af2555a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:51.732778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d90c1a1c-0501-475f-843e-be122af2555a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:51.734610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d90c1a1c-0501-475f-843e-be122af2555a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:51.735373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d90c1a1c-0501-475f-843e-be122af2555a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:51.980211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1cb36b22-0917-4105-9442-96316f73e1cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:51.989988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1cb36b22-0917-4105-9442-96316f73e1cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:51.995373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1cb36b22-0917-4105-9442-96316f73e1cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:52.000847 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1cb36b22-0917-4105-9442-96316f73e1cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1407 microversion: 2.20 time: 0.496023 Aug 23 18:22:52.003257 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2967/5801] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:51 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1407 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:52.299261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d90c1a1c-0501-475f-843e-be122af2555a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:52.313295 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d90c1a1c-0501-475f-843e-be122af2555a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1317 microversion: 2.1 time: 0.616621 Aug 23 18:22:52.315981 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2835/5802] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:51 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1317 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:53.025488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bb9e0c9f-0e70-4054-8f5b-fd8e935a4219 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:53.026373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bb9e0c9f-0e70-4054-8f5b-fd8e935a4219 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:53.040430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb9e0c9f-0e70-4054-8f5b-fd8e935a4219 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:53.044928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb9e0c9f-0e70-4054-8f5b-fd8e935a4219 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:53.045523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb9e0c9f-0e70-4054-8f5b-fd8e935a4219 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:53.046853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb9e0c9f-0e70-4054-8f5b-fd8e935a4219 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:53.051443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb9e0c9f-0e70-4054-8f5b-fd8e935a4219 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:53.052215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb9e0c9f-0e70-4054-8f5b-fd8e935a4219 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:53.334423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-badb1d75-780c-40b6-b563-2c98d8ae9bd8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:53.335434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-badb1d75-780c-40b6-b563-2c98d8ae9bd8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:53.350949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-badb1d75-780c-40b6-b563-2c98d8ae9bd8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:53.353515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-badb1d75-780c-40b6-b563-2c98d8ae9bd8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:53.355873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-badb1d75-780c-40b6-b563-2c98d8ae9bd8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:53.358531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-badb1d75-780c-40b6-b563-2c98d8ae9bd8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:53.361276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-badb1d75-780c-40b6-b563-2c98d8ae9bd8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:53.362236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-badb1d75-780c-40b6-b563-2c98d8ae9bd8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:53.509018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bb9e0c9f-0e70-4054-8f5b-fd8e935a4219 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:53.520732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bb9e0c9f-0e70-4054-8f5b-fd8e935a4219 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:53.522369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bb9e0c9f-0e70-4054-8f5b-fd8e935a4219 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:53.527148 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bb9e0c9f-0e70-4054-8f5b-fd8e935a4219 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1598 microversion: 2.20 time: 0.505379 Aug 23 18:22:53.540307 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2968/5803] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:22:53 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1598 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:22:53.567596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9c3255bf-4b8e-4283-9b6f-fc46be720470 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:53.567972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9c3255bf-4b8e-4283-9b6f-fc46be720470 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:53.579213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c3255bf-4b8e-4283-9b6f-fc46be720470 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:53.582067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c3255bf-4b8e-4283-9b6f-fc46be720470 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:53.588912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c3255bf-4b8e-4283-9b6f-fc46be720470 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:53.591801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c3255bf-4b8e-4283-9b6f-fc46be720470 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:53.592706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c3255bf-4b8e-4283-9b6f-fc46be720470 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:53.593491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9c3255bf-4b8e-4283-9b6f-fc46be720470 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:53.882232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-badb1d75-780c-40b6-b563-2c98d8ae9bd8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:53.905910 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-badb1d75-780c-40b6-b563-2c98d8ae9bd8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1317 microversion: 2.1 time: 0.570843 Aug 23 18:22:53.911859 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2836/5804] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:53 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1317 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:53.980734 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9c3255bf-4b8e-4283-9b6f-fc46be720470 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.428045 Aug 23 18:22:53.981635 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2969/5805] 10.222.0.61 () {60 vars in 1316 bytes} [Tue Aug 23 18:22:53 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/os-interface => generated 284 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:22:54.941288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f7851a33-0cac-47d6-94a5-673861ff0772 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:54.941962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f7851a33-0cac-47d6-94a5-673861ff0772 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:54.963180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7851a33-0cac-47d6-94a5-673861ff0772 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:54.980630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7851a33-0cac-47d6-94a5-673861ff0772 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:54.981069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7851a33-0cac-47d6-94a5-673861ff0772 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:54.981924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7851a33-0cac-47d6-94a5-673861ff0772 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:54.982388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7851a33-0cac-47d6-94a5-673861ff0772 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:54.990247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7851a33-0cac-47d6-94a5-673861ff0772 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:56.300374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-831fc79a-d8c2-4e1c-baaa-6be5958e3f75 req-d6f8bea9-a33c-4693-9885-c650ec63dae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e967f401-d352-4b31-8c5a-0f03fa0a9d3f", "name": "network-vif-plugged", "status": "completed", "tag": "99f1f073-60a1-4593-8a55-07aea05f954b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:56.333024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-831fc79a-d8c2-4e1c-baaa-6be5958e3f75 req-d6f8bea9-a33c-4693-9885-c650ec63dae4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:56.334619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-831fc79a-d8c2-4e1c-baaa-6be5958e3f75 req-d6f8bea9-a33c-4693-9885-c650ec63dae4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:56.335916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-831fc79a-d8c2-4e1c-baaa-6be5958e3f75 req-d6f8bea9-a33c-4693-9885-c650ec63dae4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:56.369586 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-831fc79a-d8c2-4e1c-baaa-6be5958e3f75 req-d6f8bea9-a33c-4693-9885-c650ec63dae4 service nova] Creating event network-vif-plugged:99f1f073-60a1-4593-8a55-07aea05f954b for instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f on n-h2-850468-16 Aug 23 18:22:56.383726 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-831fc79a-d8c2-4e1c-baaa-6be5958e3f75 req-d6f8bea9-a33c-4693-9885-c650ec63dae4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096730 Aug 23 18:22:56.384912 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2970/5806] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:22:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:22:56.849796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f7851a33-0cac-47d6-94a5-673861ff0772 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:56.861085 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f7851a33-0cac-47d6-94a5-673861ff0772 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1317 microversion: 2.1 time: 1.936944 Aug 23 18:22:56.863267 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2837/5807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:54 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1317 bytes in 1940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:57.570672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-319468090", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "95ab5fb9-a475-4a15-9e97-4e1bf3d7b1d7"}], "key_name": "tempest-TestSecurityGroupsBasicOps-2089254089", "security_groups": []}, "os:scheduler_hints": {"different_host": ["4220478c-eb77-460e-acbd-e1a4d739af9c"]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:57.784298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] validate_networks() for [('95ab5fb9-a475-4a15-9e97-4e1bf3d7b1d7', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:22:57.899284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-466adf50-964e-4b2c-be57-6baa169527b9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:57.901714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-466adf50-964e-4b2c-be57-6baa169527b9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:57.924762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-466adf50-964e-4b2c-be57-6baa169527b9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:57.925268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-466adf50-964e-4b2c-be57-6baa169527b9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:57.925714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-466adf50-964e-4b2c-be57-6baa169527b9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:57.926449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-466adf50-964e-4b2c-be57-6baa169527b9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:57.926926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-466adf50-964e-4b2c-be57-6baa169527b9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:57.927361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-466adf50-964e-4b2c-be57-6baa169527b9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:58.793629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-466adf50-964e-4b2c-be57-6baa169527b9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:58.807200 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-466adf50-964e-4b2c-be57-6baa169527b9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1317 microversion: 2.1 time: 0.923376 Aug 23 18:22:58.807856 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2838/5808] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:57 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1317 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:58.986970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-141679c9-a03a-41b5-a908-2e0867ceca41 req-80e7b037-62fc-4b3f-9123-5a5749a123dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9825ea0c-c842-4818-af65-f737a8c71689", "tag": "9cdade09-ac01-4d30-a9d4-cb5277d88470"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:22:59.016357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-141679c9-a03a-41b5-a908-2e0867ceca41 req-80e7b037-62fc-4b3f-9123-5a5749a123dc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:59.016848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-141679c9-a03a-41b5-a908-2e0867ceca41 req-80e7b037-62fc-4b3f-9123-5a5749a123dc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:59.017297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-141679c9-a03a-41b5-a908-2e0867ceca41 req-80e7b037-62fc-4b3f-9123-5a5749a123dc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:59.048739 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-141679c9-a03a-41b5-a908-2e0867ceca41 req-80e7b037-62fc-4b3f-9123-5a5749a123dc service nova] Creating event network-changed:9cdade09-ac01-4d30-a9d4-cb5277d88470 for instance 9825ea0c-c842-4818-af65-f737a8c71689 on n-h1-850468-16 Aug 23 18:22:59.080475 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-141679c9-a03a-41b5-a908-2e0867ceca41 req-80e7b037-62fc-4b3f-9123-5a5749a123dc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083817 Aug 23 18:22:59.081459 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2839/5809] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:22:59.284689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:22:59.285558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:22:59.286163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:22:59.286721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:22:59.287293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:22:59.304678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:59.305333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:59.305886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:59.306770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:59.310699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:59.311625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:59.345607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Getting quotas for project 453bc930d231491f81b4843fa86613cc. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:22:59.366397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Getting quotas for user a28cba675eca43b881dfdfa00fd348f4 and project 453bc930d231491f81b4843fa86613cc. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:22:59.394419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:22:59.396996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:22:59.512016 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2162d916-09aa-4f0f-8aab-1f6ae9230ba8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.945476 Aug 23 18:22:59.513024 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2971/5810] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:22:57 2022] POST /compute/v2.1/servers => generated 361 bytes in 1948 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:22:59.526768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-010747c2-2ae6-48a2-841d-8ee30d11b9e8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:59.527502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-010747c2-2ae6-48a2-841d-8ee30d11b9e8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:59.675035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-010747c2-2ae6-48a2-841d-8ee30d11b9e8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:22:59.683641 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-010747c2-2ae6-48a2-841d-8ee30d11b9e8 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1241 microversion: 2.1 time: 0.163051 Aug 23 18:22:59.689096 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2840/5811] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:59 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1241 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:22:59.828989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-63e33d1e-23a8-4976-856f-de22e71e072b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:22:59.829768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-63e33d1e-23a8-4976-856f-de22e71e072b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:22:59.849811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63e33d1e-23a8-4976-856f-de22e71e072b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:59.849811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63e33d1e-23a8-4976-856f-de22e71e072b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:59.849811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63e33d1e-23a8-4976-856f-de22e71e072b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:22:59.850445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63e33d1e-23a8-4976-856f-de22e71e072b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:22:59.875209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63e33d1e-23a8-4976-856f-de22e71e072b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:22:59.875704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63e33d1e-23a8-4976-856f-de22e71e072b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:00.303861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-63e33d1e-23a8-4976-856f-de22e71e072b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:00.318446 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-63e33d1e-23a8-4976-856f-de22e71e072b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1507 microversion: 2.1 time: 0.494029 Aug 23 18:23:00.320683 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2972/5812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:22:59 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1507 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:00.348999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c735d2b-8012-4d20-a6c6-dacd6987c383 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:00.349731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c735d2b-8012-4d20-a6c6-dacd6987c383 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:00.363984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c735d2b-8012-4d20-a6c6-dacd6987c383 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:00.365687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c735d2b-8012-4d20-a6c6-dacd6987c383 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:00.368594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c735d2b-8012-4d20-a6c6-dacd6987c383 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:00.372651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c735d2b-8012-4d20-a6c6-dacd6987c383 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:00.375572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c735d2b-8012-4d20-a6c6-dacd6987c383 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:00.376265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c735d2b-8012-4d20-a6c6-dacd6987c383 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:00.439537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:00.713543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-298c820b-0547-4dbe-8382-955307979065 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:00.715299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-298c820b-0547-4dbe-8382-955307979065 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:00.735676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-298c820b-0547-4dbe-8382-955307979065 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:00.739375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-298c820b-0547-4dbe-8382-955307979065 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:00.739843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-298c820b-0547-4dbe-8382-955307979065 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:00.740594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-298c820b-0547-4dbe-8382-955307979065 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:00.741058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-298c820b-0547-4dbe-8382-955307979065 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:00.741493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-298c820b-0547-4dbe-8382-955307979065 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:01.067745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c735d2b-8012-4d20-a6c6-dacd6987c383 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:01.088421 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c735d2b-8012-4d20-a6c6-dacd6987c383 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1507 microversion: 2.1 time: 0.750895 Aug 23 18:23:01.089942 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2841/5813] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:00 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1507 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:01.109486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-298c820b-0547-4dbe-8382-955307979065 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:01.116488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8f29985a-3286-43e3-a73e-82667293d196 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:01.120585 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-298c820b-0547-4dbe-8382-955307979065 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1237 microversion: 2.1 time: 0.413460 Aug 23 18:23:01.124527 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2973/5814] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:00 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1237 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:01.138290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8f29985a-3286-43e3-a73e-82667293d196 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:01.141423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f29985a-3286-43e3-a73e-82667293d196 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:01.147267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f29985a-3286-43e3-a73e-82667293d196 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:01.147842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f29985a-3286-43e3-a73e-82667293d196 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:01.149159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f29985a-3286-43e3-a73e-82667293d196 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:01.149744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f29985a-3286-43e3-a73e-82667293d196 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:01.150316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f29985a-3286-43e3-a73e-82667293d196 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:01.484752 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8f29985a-3286-43e3-a73e-82667293d196 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "PUT /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1079 microversion: 2.1 time: 0.374875 Aug 23 18:23:01.502808 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2842/5815] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Aug 23 18:23:01 2022] PUT /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1079 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:01.525445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-884aefb4-8b45-4fcc-9917-225682ada733 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:01.535215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-884aefb4-8b45-4fcc-9917-225682ada733 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:01.549274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884aefb4-8b45-4fcc-9917-225682ada733 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:01.550072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884aefb4-8b45-4fcc-9917-225682ada733 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:01.550704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884aefb4-8b45-4fcc-9917-225682ada733 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:01.551610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884aefb4-8b45-4fcc-9917-225682ada733 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:01.552233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884aefb4-8b45-4fcc-9917-225682ada733 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:01.552849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884aefb4-8b45-4fcc-9917-225682ada733 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:02.145794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2a2962bc-0e16-494e-9181-da9b8b626965 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:02.146783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2a2962bc-0e16-494e-9181-da9b8b626965 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:02.162395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a2962bc-0e16-494e-9181-da9b8b626965 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:02.169913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a2962bc-0e16-494e-9181-da9b8b626965 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:02.177707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a2962bc-0e16-494e-9181-da9b8b626965 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:02.180111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a2962bc-0e16-494e-9181-da9b8b626965 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:02.181349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a2962bc-0e16-494e-9181-da9b8b626965 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:02.184396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a2962bc-0e16-494e-9181-da9b8b626965 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:02.349542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-884aefb4-8b45-4fcc-9917-225682ada733 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:02.377601 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-884aefb4-8b45-4fcc-9917-225682ada733 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1505 microversion: 2.1 time: 0.852160 Aug 23 18:23:02.379195 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2974/5816] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:01 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1505 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:02.431658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51ea8f0d-177d-4334-a776-69ef32f08c44 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:02.434527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51ea8f0d-177d-4334-a776-69ef32f08c44 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:02.462033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51ea8f0d-177d-4334-a776-69ef32f08c44 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:02.462761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51ea8f0d-177d-4334-a776-69ef32f08c44 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:02.463376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51ea8f0d-177d-4334-a776-69ef32f08c44 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:02.464331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51ea8f0d-177d-4334-a776-69ef32f08c44 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:02.465714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51ea8f0d-177d-4334-a776-69ef32f08c44 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:02.466324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51ea8f0d-177d-4334-a776-69ef32f08c44 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:03.223604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2a2962bc-0e16-494e-9181-da9b8b626965 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:03.243279 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2a2962bc-0e16-494e-9181-da9b8b626965 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1299 microversion: 2.1 time: 1.101734 Aug 23 18:23:03.259236 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2843/5817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:02 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1299 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:03.280450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-51ea8f0d-177d-4334-a776-69ef32f08c44 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:03.293120 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51ea8f0d-177d-4334-a776-69ef32f08c44 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1505 microversion: 2.1 time: 0.891088 Aug 23 18:23:03.302494 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2975/5818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:02 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1505 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:03.322685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:03.326898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:03.334630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:03.335617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:03.336284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:03.337253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:03.338082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:03.339041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:03.497435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:23:03.497889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:23:03.498382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:23:03.498822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:23:03.499241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:23:03.781677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:03.798054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:03.798570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:03.813517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:03.814289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:03.823288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:03.827443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:03.995244 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cb3cf4a8-6bcf-400d-8e89-07e9aa6a1d84 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "POST /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f/action" status: 202 len: 1111 microversion: 2.1 time: 0.681032 Aug 23 18:23:03.998440 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2844/5819] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:23:03 2022] POST /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f/action => generated 1111 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 23 18:23:04.018938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-910efe3a-0a30-452c-b1f7-84c37c19bba6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:04.021384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-910efe3a-0a30-452c-b1f7-84c37c19bba6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:04.044950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-910efe3a-0a30-452c-b1f7-84c37c19bba6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:04.045461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-910efe3a-0a30-452c-b1f7-84c37c19bba6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:04.045912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-910efe3a-0a30-452c-b1f7-84c37c19bba6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:04.067282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-910efe3a-0a30-452c-b1f7-84c37c19bba6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:04.069399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-910efe3a-0a30-452c-b1f7-84c37c19bba6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:04.071194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-910efe3a-0a30-452c-b1f7-84c37c19bba6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:04.267852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4f040014-8d8f-47fd-b339-c51340ff4a40 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:04.269141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4f040014-8d8f-47fd-b339-c51340ff4a40 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:04.289372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f040014-8d8f-47fd-b339-c51340ff4a40 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:04.295469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f040014-8d8f-47fd-b339-c51340ff4a40 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:04.299194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f040014-8d8f-47fd-b339-c51340ff4a40 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:04.301098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f040014-8d8f-47fd-b339-c51340ff4a40 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:04.304480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f040014-8d8f-47fd-b339-c51340ff4a40 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:04.305990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f040014-8d8f-47fd-b339-c51340ff4a40 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:04.572027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-910efe3a-0a30-452c-b1f7-84c37c19bba6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:04.584302 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-910efe3a-0a30-452c-b1f7-84c37c19bba6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.571743 Aug 23 18:23:04.593798 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2976/5820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:04 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:04.885853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4f040014-8d8f-47fd-b339-c51340ff4a40 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:04.912500 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4f040014-8d8f-47fd-b339-c51340ff4a40 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1299 microversion: 2.1 time: 0.648722 Aug 23 18:23:04.918795 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2845/5821] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:04 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1299 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:05.616985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-019a0778-e321-4328-afee-1807bf63cadf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:05.618293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-019a0778-e321-4328-afee-1807bf63cadf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:05.633131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-019a0778-e321-4328-afee-1807bf63cadf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:05.637031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-019a0778-e321-4328-afee-1807bf63cadf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:05.639095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-019a0778-e321-4328-afee-1807bf63cadf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:05.640101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-019a0778-e321-4328-afee-1807bf63cadf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:05.643352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-019a0778-e321-4328-afee-1807bf63cadf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:05.644036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-019a0778-e321-4328-afee-1807bf63cadf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:05.943362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d589106-8551-48e7-b6a9-11698e25b352 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:05.944606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2d589106-8551-48e7-b6a9-11698e25b352 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:05.989596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d589106-8551-48e7-b6a9-11698e25b352 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:05.990120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d589106-8551-48e7-b6a9-11698e25b352 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:05.991269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d589106-8551-48e7-b6a9-11698e25b352 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:05.992030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d589106-8551-48e7-b6a9-11698e25b352 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:05.992502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d589106-8551-48e7-b6a9-11698e25b352 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:05.992944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d589106-8551-48e7-b6a9-11698e25b352 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:06.345842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2d589106-8551-48e7-b6a9-11698e25b352 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:06.357173 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2d589106-8551-48e7-b6a9-11698e25b352 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1299 microversion: 2.1 time: 0.419888 Aug 23 18:23:06.361298 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2846/5822] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:05 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1299 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:06.367138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-de090dc9-128c-44f5-ac80-bd9077dbd167 req-751c0004-8adb-472a-8d1a-201212ddb0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67fa321c-8a3e-4cb9-ab7e-2c48aed19427", "tag": "962600af-0c62-4ec9-b7f4-d092ec307c5e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:06.382407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-de090dc9-128c-44f5-ac80-bd9077dbd167 req-751c0004-8adb-472a-8d1a-201212ddb0d8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:06.383237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-de090dc9-128c-44f5-ac80-bd9077dbd167 req-751c0004-8adb-472a-8d1a-201212ddb0d8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:06.383994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-de090dc9-128c-44f5-ac80-bd9077dbd167 req-751c0004-8adb-472a-8d1a-201212ddb0d8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:06.389030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-019a0778-e321-4328-afee-1807bf63cadf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:06.404153 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-019a0778-e321-4328-afee-1807bf63cadf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.791787 Aug 23 18:23:06.406429 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2977/5823] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:05 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:06.425299 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-de090dc9-128c-44f5-ac80-bd9077dbd167 req-751c0004-8adb-472a-8d1a-201212ddb0d8 service nova] Creating event network-changed:962600af-0c62-4ec9-b7f4-d092ec307c5e for instance 67fa321c-8a3e-4cb9-ab7e-2c48aed19427 on n-h1-850468-16 Aug 23 18:23:06.431152 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-de090dc9-128c-44f5-ac80-bd9077dbd167 req-751c0004-8adb-472a-8d1a-201212ddb0d8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068343 Aug 23 18:23:06.434188 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2847/5824] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:07.389515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1226cc37-05dc-4854-9ab8-5b6c35f469bc tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:07.390819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1226cc37-05dc-4854-9ab8-5b6c35f469bc tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:07.421708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1226cc37-05dc-4854-9ab8-5b6c35f469bc tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:07.422484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1226cc37-05dc-4854-9ab8-5b6c35f469bc tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:07.423143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1226cc37-05dc-4854-9ab8-5b6c35f469bc tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:07.424102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1226cc37-05dc-4854-9ab8-5b6c35f469bc tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:07.424732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1226cc37-05dc-4854-9ab8-5b6c35f469bc tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:07.425338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1226cc37-05dc-4854-9ab8-5b6c35f469bc tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:07.428766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2947e614-8e50-4aeb-b8d8-89e121420d09 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:07.434483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2947e614-8e50-4aeb-b8d8-89e121420d09 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:07.449227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2947e614-8e50-4aeb-b8d8-89e121420d09 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:07.449981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2947e614-8e50-4aeb-b8d8-89e121420d09 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:07.450720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2947e614-8e50-4aeb-b8d8-89e121420d09 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:07.451604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2947e614-8e50-4aeb-b8d8-89e121420d09 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:07.455155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2947e614-8e50-4aeb-b8d8-89e121420d09 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:07.455793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2947e614-8e50-4aeb-b8d8-89e121420d09 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:07.781590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1226cc37-05dc-4854-9ab8-5b6c35f469bc tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:07.796280 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1226cc37-05dc-4854-9ab8-5b6c35f469bc tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1299 microversion: 2.1 time: 0.417567 Aug 23 18:23:07.797046 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2978/5825] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:07 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1299 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:07.835857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2947e614-8e50-4aeb-b8d8-89e121420d09 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:07.846295 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2947e614-8e50-4aeb-b8d8-89e121420d09 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.422483 Aug 23 18:23:07.864312 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2848/5826] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:07 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:08.823048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03254084-ccd2-4f69-b142-38fa0d87374d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:08.824828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-03254084-ccd2-4f69-b142-38fa0d87374d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:08.837527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03254084-ccd2-4f69-b142-38fa0d87374d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:08.845042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03254084-ccd2-4f69-b142-38fa0d87374d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:08.846935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03254084-ccd2-4f69-b142-38fa0d87374d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:08.847820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03254084-ccd2-4f69-b142-38fa0d87374d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:08.849253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03254084-ccd2-4f69-b142-38fa0d87374d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:08.849970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03254084-ccd2-4f69-b142-38fa0d87374d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:08.874965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-19df4cfe-4bae-40ec-8ccb-a49125bc01f8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:08.887802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-19df4cfe-4bae-40ec-8ccb-a49125bc01f8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:08.907785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-19df4cfe-4bae-40ec-8ccb-a49125bc01f8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:08.908293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-19df4cfe-4bae-40ec-8ccb-a49125bc01f8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:08.908744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-19df4cfe-4bae-40ec-8ccb-a49125bc01f8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:08.909472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-19df4cfe-4bae-40ec-8ccb-a49125bc01f8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:08.910106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-19df4cfe-4bae-40ec-8ccb-a49125bc01f8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:08.910778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-19df4cfe-4bae-40ec-8ccb-a49125bc01f8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:09.075714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-03254084-ccd2-4f69-b142-38fa0d87374d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:09.089479 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-03254084-ccd2-4f69-b142-38fa0d87374d tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1299 microversion: 2.1 time: 0.270542 Aug 23 18:23:09.091103 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2979/5827] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:08 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1299 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:09.680282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:09.964730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-19df4cfe-4bae-40ec-8ccb-a49125bc01f8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:09.984102 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-19df4cfe-4bae-40ec-8ccb-a49125bc01f8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 1.115644 Aug 23 18:23:10.001375 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2849/5828] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:08 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:10.112541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-90b63dc9-06ee-4dd3-a4fa-ceaf61b82370 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:10.113765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-90b63dc9-06ee-4dd3-a4fa-ceaf61b82370 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:10.116865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:10.117711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:10.129995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90b63dc9-06ee-4dd3-a4fa-ceaf61b82370 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:10.133664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90b63dc9-06ee-4dd3-a4fa-ceaf61b82370 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:10.137233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90b63dc9-06ee-4dd3-a4fa-ceaf61b82370 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:10.138214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90b63dc9-06ee-4dd3-a4fa-ceaf61b82370 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:10.138715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90b63dc9-06ee-4dd3-a4fa-ceaf61b82370 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:10.139347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90b63dc9-06ee-4dd3-a4fa-ceaf61b82370 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:10.270359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-90b63dc9-06ee-4dd3-a4fa-ceaf61b82370 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:10.279217 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-90b63dc9-06ee-4dd3-a4fa-ceaf61b82370 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1299 microversion: 2.1 time: 0.170769 Aug 23 18:23:10.279824 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2980/5829] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:10 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1299 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:11.004888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-20907574-46b9-4934-ae09-17bf08a81de9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:11.005509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-20907574-46b9-4934-ae09-17bf08a81de9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:11.015999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20907574-46b9-4934-ae09-17bf08a81de9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:11.016558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20907574-46b9-4934-ae09-17bf08a81de9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:11.016996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20907574-46b9-4934-ae09-17bf08a81de9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:11.017711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20907574-46b9-4934-ae09-17bf08a81de9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:11.018168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20907574-46b9-4934-ae09-17bf08a81de9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:11.020344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20907574-46b9-4934-ae09-17bf08a81de9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:11.301300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ac8871f-49b9-4f5b-9a54-0048fe428822 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:11.302042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8ac8871f-49b9-4f5b-9a54-0048fe428822 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:11.339867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac8871f-49b9-4f5b-9a54-0048fe428822 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:11.340907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac8871f-49b9-4f5b-9a54-0048fe428822 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:11.341789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac8871f-49b9-4f5b-9a54-0048fe428822 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:11.343683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac8871f-49b9-4f5b-9a54-0048fe428822 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:11.348650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac8871f-49b9-4f5b-9a54-0048fe428822 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:11.351319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ac8871f-49b9-4f5b-9a54-0048fe428822 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:11.526696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20907574-46b9-4934-ae09-17bf08a81de9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:11.540857 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-20907574-46b9-4934-ae09-17bf08a81de9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.539664 Aug 23 18:23:11.544622 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2850/5830] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:10 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:11.579914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8ac8871f-49b9-4f5b-9a54-0048fe428822 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:11.588505 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8ac8871f-49b9-4f5b-9a54-0048fe428822 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1299 microversion: 2.1 time: 0.291496 Aug 23 18:23:11.591194 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2981/5831] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:11 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1299 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:12.562209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e7709407-9b86-4412-baf1-ff5a00ce672a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:12.563408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e7709407-9b86-4412-baf1-ff5a00ce672a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:12.576155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7709407-9b86-4412-baf1-ff5a00ce672a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:12.585167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7709407-9b86-4412-baf1-ff5a00ce672a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:12.585874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7709407-9b86-4412-baf1-ff5a00ce672a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:12.586817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7709407-9b86-4412-baf1-ff5a00ce672a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:12.587443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7709407-9b86-4412-baf1-ff5a00ce672a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:12.588135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7709407-9b86-4412-baf1-ff5a00ce672a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:12.613639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a42e0099-bd33-41ab-b74f-e838c45e62df tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:12.613639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a42e0099-bd33-41ab-b74f-e838c45e62df tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:12.624633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:12.639173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a42e0099-bd33-41ab-b74f-e838c45e62df tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:12.639920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a42e0099-bd33-41ab-b74f-e838c45e62df tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:12.641261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a42e0099-bd33-41ab-b74f-e838c45e62df tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:12.642230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a42e0099-bd33-41ab-b74f-e838c45e62df tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:12.642940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a42e0099-bd33-41ab-b74f-e838c45e62df tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:12.645421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a42e0099-bd33-41ab-b74f-e838c45e62df tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:12.796771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a42e0099-bd33-41ab-b74f-e838c45e62df tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:12.806186 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a42e0099-bd33-41ab-b74f-e838c45e62df tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1299 microversion: 2.1 time: 0.197863 Aug 23 18:23:12.806823 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2982/5832] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:12 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1299 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:13.011900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e7709407-9b86-4412-baf1-ff5a00ce672a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:13.021513 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e7709407-9b86-4412-baf1-ff5a00ce672a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.463989 Aug 23 18:23:13.022803 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2851/5833] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:12 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:13.828860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a6e4b935-531a-4887-82cc-0c6863416030 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:13.830225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a6e4b935-531a-4887-82cc-0c6863416030 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:13.845751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6e4b935-531a-4887-82cc-0c6863416030 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:13.846682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6e4b935-531a-4887-82cc-0c6863416030 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:13.847356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6e4b935-531a-4887-82cc-0c6863416030 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:13.848318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6e4b935-531a-4887-82cc-0c6863416030 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:13.849027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6e4b935-531a-4887-82cc-0c6863416030 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:13.849694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a6e4b935-531a-4887-82cc-0c6863416030 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:14.040897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a6e4b935-531a-4887-82cc-0c6863416030 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:14.043938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7bf47547-1282-4567-a8cd-529696ac4425 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:14.044554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7bf47547-1282-4567-a8cd-529696ac4425 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:14.058374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=56 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:14.060074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bf47547-1282-4567-a8cd-529696ac4425 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:14.062203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bf47547-1282-4567-a8cd-529696ac4425 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:14.062714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bf47547-1282-4567-a8cd-529696ac4425 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:14.063433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bf47547-1282-4567-a8cd-529696ac4425 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:14.063897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bf47547-1282-4567-a8cd-529696ac4425 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:14.064323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bf47547-1282-4567-a8cd-529696ac4425 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:14.065000 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a6e4b935-531a-4887-82cc-0c6863416030 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1299 microversion: 2.1 time: 0.240097 Aug 23 18:23:14.074573 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2983/5834] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:13 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1299 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:14.320601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7bf47547-1282-4567-a8cd-529696ac4425 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:14.341211 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7bf47547-1282-4567-a8cd-529696ac4425 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.301093 Aug 23 18:23:14.346365 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2852/5835] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:14 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:14.464589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cdc85536-8b2b-44fd-9d82-2ce534df6a99 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Action: 'create', calling method: .version_select at 0x7f27df894160>, body: {"keypair": {"name": "tempest-TestServerBasicOps-1858637466", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKK3IXh7MeBmaIhl2i3J7qBtxsZXHdpyFlPbs9Jx6Hb71rQac8dt29V7/D7okyks2/e6feOcoc/DLd8sDHwdUKH3b+h35hWXbeFK+fKieWyzPRsjimW4L/ibQYV1C57Kpg=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:14.486046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-cdc85536-8b2b-44fd-9d82-2ce534df6a99 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Getting quotas for project 3e43a78b2cc5437c9eb2f1bb02b6465c. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:23:14.496528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-cdc85536-8b2b-44fd-9d82-2ce534df6a99 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Getting quotas for user 32d1459e5c8a414f940b09614fab6dd7 and project 3e43a78b2cc5437c9eb2f1bb02b6465c. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:23:14.551858 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cdc85536-8b2b-44fd-9d82-2ce534df6a99 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.376818 Aug 23 18:23:14.552482 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2984/5836] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:23:14 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:23:15.034200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-d5ced7aa-b33c-4c5b-a7a2-4079b01c010c req-6e7db553-80e7-43ec-a545-a2298a6f570c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67fa321c-8a3e-4cb9-ab7e-2c48aed19427", "name": "network-vif-plugged", "status": "completed", "tag": "962600af-0c62-4ec9-b7f4-d092ec307c5e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:15.053658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d5ced7aa-b33c-4c5b-a7a2-4079b01c010c req-6e7db553-80e7-43ec-a545-a2298a6f570c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:15.058917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d5ced7aa-b33c-4c5b-a7a2-4079b01c010c req-6e7db553-80e7-43ec-a545-a2298a6f570c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:15.059395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d5ced7aa-b33c-4c5b-a7a2-4079b01c010c req-6e7db553-80e7-43ec-a545-a2298a6f570c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:15.088413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-02c8d5bb-c600-4749-b139-f6990dbba7d3 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:15.089657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-02c8d5bb-c600-4749-b139-f6990dbba7d3 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:15.093695 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-d5ced7aa-b33c-4c5b-a7a2-4079b01c010c req-6e7db553-80e7-43ec-a545-a2298a6f570c service nova] Creating event network-vif-plugged:962600af-0c62-4ec9-b7f4-d092ec307c5e for instance 67fa321c-8a3e-4cb9-ab7e-2c48aed19427 on n-h1-850468-16 Aug 23 18:23:15.111148 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-d5ced7aa-b33c-4c5b-a7a2-4079b01c010c req-6e7db553-80e7-43ec-a545-a2298a6f570c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081137 Aug 23 18:23:15.112137 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2853/5837] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:15.112810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02c8d5bb-c600-4749-b139-f6990dbba7d3 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:15.114378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02c8d5bb-c600-4749-b139-f6990dbba7d3 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:15.114875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02c8d5bb-c600-4749-b139-f6990dbba7d3 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:15.115635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02c8d5bb-c600-4749-b139-f6990dbba7d3 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:15.122736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02c8d5bb-c600-4749-b139-f6990dbba7d3 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:15.123431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02c8d5bb-c600-4749-b139-f6990dbba7d3 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:15.382443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cfb20b1a-1e55-4087-9968-a31a33d8b799 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:15.383291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cfb20b1a-1e55-4087-9968-a31a33d8b799 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:15.392227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfb20b1a-1e55-4087-9968-a31a33d8b799 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:15.393979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfb20b1a-1e55-4087-9968-a31a33d8b799 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:15.395093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfb20b1a-1e55-4087-9968-a31a33d8b799 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:15.396924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfb20b1a-1e55-4087-9968-a31a33d8b799 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:15.402621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfb20b1a-1e55-4087-9968-a31a33d8b799 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:15.403831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cfb20b1a-1e55-4087-9968-a31a33d8b799 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:15.421156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-02c8d5bb-c600-4749-b139-f6990dbba7d3 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:15.429217 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-02c8d5bb-c600-4749-b139-f6990dbba7d3 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1299 microversion: 2.1 time: 0.345708 Aug 23 18:23:15.432563 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2985/5838] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:15 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1299 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:15.795961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cfb20b1a-1e55-4087-9968-a31a33d8b799 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:15.811287 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cfb20b1a-1e55-4087-9968-a31a33d8b799 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.444304 Aug 23 18:23:15.821499 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2854/5839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:15 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:16.453796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-32135d5f-66af-4963-a821-9f8a1bea13ff tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:16.454442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-32135d5f-66af-4963-a821-9f8a1bea13ff tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:16.465043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32135d5f-66af-4963-a821-9f8a1bea13ff tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:16.465819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32135d5f-66af-4963-a821-9f8a1bea13ff tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:16.466571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32135d5f-66af-4963-a821-9f8a1bea13ff tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:16.467305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32135d5f-66af-4963-a821-9f8a1bea13ff tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:16.467769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32135d5f-66af-4963-a821-9f8a1bea13ff tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:16.468436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32135d5f-66af-4963-a821-9f8a1bea13ff tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:16.505902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:16.621510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-400804977", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-1858637466", "security_groups": [{"name": "tempest-secgroup-smoke-2021322189"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "d4239a4c-378d-437e-bdba-2790d68f0b53"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:16.670761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-32135d5f-66af-4963-a821-9f8a1bea13ff tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:16.695640 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-32135d5f-66af-4963-a821-9f8a1bea13ff tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1299 microversion: 2.1 time: 0.236750 Aug 23 18:23:16.707240 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2986/5840] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:16 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1299 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:16.798674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] validate_networks() for [('d4239a4c-378d-437e-bdba-2790d68f0b53', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:23:16.835672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b2857d6-60e0-44b5-b084-e9c4ab2277c8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:16.836463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3b2857d6-60e0-44b5-b084-e9c4ab2277c8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:16.846095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b2857d6-60e0-44b5-b084-e9c4ab2277c8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:16.846846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b2857d6-60e0-44b5-b084-e9c4ab2277c8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:16.847436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b2857d6-60e0-44b5-b084-e9c4ab2277c8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:16.848809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b2857d6-60e0-44b5-b084-e9c4ab2277c8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:16.849494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b2857d6-60e0-44b5-b084-e9c4ab2277c8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:16.850141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b2857d6-60e0-44b5-b084-e9c4ab2277c8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:17.064825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3b2857d6-60e0-44b5-b084-e9c4ab2277c8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:17.077053 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3b2857d6-60e0-44b5-b084-e9c4ab2277c8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.246059 Aug 23 18:23:17.092246 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2987/5841] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:16 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:17.362936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Getting quotas for project 3e43a78b2cc5437c9eb2f1bb02b6465c. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:23:17.369023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Getting quotas for user 32d1459e5c8a414f940b09614fab6dd7 and project 3e43a78b2cc5437c9eb2f1bb02b6465c. Resources: dict_keys(['metadata_items']) {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:23:17.384259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:23:17.384783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:23:17.385520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:23:17.386693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:23:17.387530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:23:17.396663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:17.397148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:17.397890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:17.398861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:17.399555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:17.400163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:17.424473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Getting quotas for project 3e43a78b2cc5437c9eb2f1bb02b6465c. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:23:17.430139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Getting quotas for user 32d1459e5c8a414f940b09614fab6dd7 and project 3e43a78b2cc5437c9eb2f1bb02b6465c. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:23:17.444441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:23:17.447145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:23:17.508620 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d4f08da8-84c3-4f71-9c5a-81eb29166388 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.891968 Aug 23 18:23:17.509794 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2855/5842] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:23:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:23:17.525447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a9d1a9e4-94d6-4f97-8edd-ac90465fdd74 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:17.526384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a9d1a9e4-94d6-4f97-8edd-ac90465fdd74 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:17.625081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a9d1a9e4-94d6-4f97-8edd-ac90465fdd74 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:17.637044 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a9d1a9e4-94d6-4f97-8edd-ac90465fdd74 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1302 microversion: 2.1 time: 0.114872 Aug 23 18:23:17.637918 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2988/5843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:17 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1302 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:17.720993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b0670ba-5ca7-4151-bd28-626dcb63b966 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:17.722382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b0670ba-5ca7-4151-bd28-626dcb63b966 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:17.736632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b0670ba-5ca7-4151-bd28-626dcb63b966 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:17.737138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b0670ba-5ca7-4151-bd28-626dcb63b966 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:17.737958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b0670ba-5ca7-4151-bd28-626dcb63b966 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:17.739673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b0670ba-5ca7-4151-bd28-626dcb63b966 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:17.740300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b0670ba-5ca7-4151-bd28-626dcb63b966 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:17.740895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b0670ba-5ca7-4151-bd28-626dcb63b966 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:17.845413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3b0670ba-5ca7-4151-bd28-626dcb63b966 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:17.853990 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3b0670ba-5ca7-4151-bd28-626dcb63b966 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1471 microversion: 2.1 time: 0.137627 Aug 23 18:23:17.855115 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2856/5844] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:17 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1471 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:17.881768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9cfc2970-4b96-463a-9b30-3e5d3fd8ba5a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:17.882790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9cfc2970-4b96-463a-9b30-3e5d3fd8ba5a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:17.897410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cfc2970-4b96-463a-9b30-3e5d3fd8ba5a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:17.898171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cfc2970-4b96-463a-9b30-3e5d3fd8ba5a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:17.898997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cfc2970-4b96-463a-9b30-3e5d3fd8ba5a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:17.900702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cfc2970-4b96-463a-9b30-3e5d3fd8ba5a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:17.901878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cfc2970-4b96-463a-9b30-3e5d3fd8ba5a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:17.902501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cfc2970-4b96-463a-9b30-3e5d3fd8ba5a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:18.054889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9cfc2970-4b96-463a-9b30-3e5d3fd8ba5a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:18.069225 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9cfc2970-4b96-463a-9b30-3e5d3fd8ba5a tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1471 microversion: 2.1 time: 0.193146 Aug 23 18:23:18.069846 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2989/5845] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:17 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1471 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:18.092331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f60c2f0d-b02a-42e3-ada4-d4711e686b27 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:18.108070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f60c2f0d-b02a-42e3-ada4-d4711e686b27 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:18.121482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1aefd520-ba72-4962-b812-0c52dfe32f63 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:18.124336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1aefd520-ba72-4962-b812-0c52dfe32f63 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:18.131923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f60c2f0d-b02a-42e3-ada4-d4711e686b27 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:18.132326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f60c2f0d-b02a-42e3-ada4-d4711e686b27 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:18.137553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f60c2f0d-b02a-42e3-ada4-d4711e686b27 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:18.139110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f60c2f0d-b02a-42e3-ada4-d4711e686b27 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:18.140235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f60c2f0d-b02a-42e3-ada4-d4711e686b27 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:18.141911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f60c2f0d-b02a-42e3-ada4-d4711e686b27 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:18.145181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1aefd520-ba72-4962-b812-0c52dfe32f63 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:18.146404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1aefd520-ba72-4962-b812-0c52dfe32f63 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:18.149133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1aefd520-ba72-4962-b812-0c52dfe32f63 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:18.150460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1aefd520-ba72-4962-b812-0c52dfe32f63 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:18.152069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1aefd520-ba72-4962-b812-0c52dfe32f63 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:18.152916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1aefd520-ba72-4962-b812-0c52dfe32f63 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:18.153735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:18.375609 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f60c2f0d-b02a-42e3-ada4-d4711e686b27 tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1624 microversion: 2.1 time: 0.280852 Aug 23 18:23:18.392621 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2857/5846] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:18 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1624 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:18.397353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6293a49a-fd6c-4bc8-a865-a05b83b559ba tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:18.397912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6293a49a-fd6c-4bc8-a865-a05b83b559ba tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:18.419898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6293a49a-fd6c-4bc8-a865-a05b83b559ba tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:18.420413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6293a49a-fd6c-4bc8-a865-a05b83b559ba tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:18.420857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6293a49a-fd6c-4bc8-a865-a05b83b559ba tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:18.421789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6293a49a-fd6c-4bc8-a865-a05b83b559ba tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:18.422406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6293a49a-fd6c-4bc8-a865-a05b83b559ba tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:18.423058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6293a49a-fd6c-4bc8-a865-a05b83b559ba tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:18.523794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1aefd520-ba72-4962-b812-0c52dfe32f63 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:18.536674 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1aefd520-ba72-4962-b812-0c52dfe32f63 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.427086 Aug 23 18:23:18.537646 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2990/5847] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:18 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:18.661144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-47341950-56bb-4ab4-aacd-3f9435966004 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:18.662021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-47341950-56bb-4ab4-aacd-3f9435966004 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:18.676339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47341950-56bb-4ab4-aacd-3f9435966004 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:18.676932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47341950-56bb-4ab4-aacd-3f9435966004 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:18.679284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47341950-56bb-4ab4-aacd-3f9435966004 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:18.680147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47341950-56bb-4ab4-aacd-3f9435966004 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:18.685635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47341950-56bb-4ab4-aacd-3f9435966004 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:18.687321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47341950-56bb-4ab4-aacd-3f9435966004 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:18.784594 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6293a49a-fd6c-4bc8-a865-a05b83b559ba tempest-TestSecurityGroupsBasicOps-48772941 tempest-TestSecurityGroupsBasicOps-48772941-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1913 microversion: 2.1 time: 0.390857 Aug 23 18:23:18.785188 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2858/5848] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:18 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1913 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:18.879673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-47341950-56bb-4ab4-aacd-3f9435966004 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:18.888993 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-47341950-56bb-4ab4-aacd-3f9435966004 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1354 microversion: 2.1 time: 0.233258 Aug 23 18:23:18.890646 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2991/5849] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:18 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1354 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:18.932216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-46af585d-c133-4ddb-8b40-7217bceef8f2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:18.934044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-46af585d-c133-4ddb-8b40-7217bceef8f2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:18.941589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-46af585d-c133-4ddb-8b40-7217bceef8f2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:18.946195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-46af585d-c133-4ddb-8b40-7217bceef8f2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:18.946807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-46af585d-c133-4ddb-8b40-7217bceef8f2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:18.947585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-46af585d-c133-4ddb-8b40-7217bceef8f2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:18.948093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-46af585d-c133-4ddb-8b40-7217bceef8f2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:18.950948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-46af585d-c133-4ddb-8b40-7217bceef8f2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:19.038942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-46af585d-c133-4ddb-8b40-7217bceef8f2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:23:19.185158 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-46af585d-c133-4ddb-8b40-7217bceef8f2 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "DELETE /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 204 len: 0 microversion: 2.1 time: 0.256069 Aug 23 18:23:19.186109 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2859/5850] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:23:18 2022] DELETE /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:23:19.194246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1f9b6e08-a392-405e-b5e6-e1ce0d74b397 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:19.194897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1f9b6e08-a392-405e-b5e6-e1ce0d74b397 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:19.203679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f9b6e08-a392-405e-b5e6-e1ce0d74b397 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:19.204599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f9b6e08-a392-405e-b5e6-e1ce0d74b397 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:19.205346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f9b6e08-a392-405e-b5e6-e1ce0d74b397 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:19.206362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f9b6e08-a392-405e-b5e6-e1ce0d74b397 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:19.207869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f9b6e08-a392-405e-b5e6-e1ce0d74b397 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:19.208874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f9b6e08-a392-405e-b5e6-e1ce0d74b397 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:19.381397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1f9b6e08-a392-405e-b5e6-e1ce0d74b397 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:19.393080 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1f9b6e08-a392-405e-b5e6-e1ce0d74b397 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1477 microversion: 2.1 time: 0.202639 Aug 23 18:23:19.394406 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2992/5851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:19 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1477 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:19.561113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-30578fa6-f658-4469-b3a3-0d9c8b6e0b64 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:19.561825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-30578fa6-f658-4469-b3a3-0d9c8b6e0b64 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:19.569398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30578fa6-f658-4469-b3a3-0d9c8b6e0b64 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:19.570159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30578fa6-f658-4469-b3a3-0d9c8b6e0b64 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:19.570951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30578fa6-f658-4469-b3a3-0d9c8b6e0b64 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:19.571939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30578fa6-f658-4469-b3a3-0d9c8b6e0b64 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:19.572630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30578fa6-f658-4469-b3a3-0d9c8b6e0b64 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:19.573974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-30578fa6-f658-4469-b3a3-0d9c8b6e0b64 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:19.803357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-30578fa6-f658-4469-b3a3-0d9c8b6e0b64 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:19.824770 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-30578fa6-f658-4469-b3a3-0d9c8b6e0b64 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.263501 Aug 23 18:23:19.825836 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2860/5852] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:19 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:19.915799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-13fca733-e3e0-40e6-8c68-9b6252e6f76b tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:19.917397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-13fca733-e3e0-40e6-8c68-9b6252e6f76b tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:19.943408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13fca733-e3e0-40e6-8c68-9b6252e6f76b tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:19.944290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13fca733-e3e0-40e6-8c68-9b6252e6f76b tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:19.944954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13fca733-e3e0-40e6-8c68-9b6252e6f76b tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:19.945978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13fca733-e3e0-40e6-8c68-9b6252e6f76b tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:19.946681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13fca733-e3e0-40e6-8c68-9b6252e6f76b tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:19.947835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13fca733-e3e0-40e6-8c68-9b6252e6f76b tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:20.109080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-13fca733-e3e0-40e6-8c68-9b6252e6f76b tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:20.123084 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-13fca733-e3e0-40e6-8c68-9b6252e6f76b tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1360 microversion: 2.1 time: 0.212413 Aug 23 18:23:20.146278 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2993/5853] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:19 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1360 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:20.418298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3f3b5d06-c3ad-495b-8248-2332fabe0f3e tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:20.419293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3f3b5d06-c3ad-495b-8248-2332fabe0f3e tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:20.431861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f3b5d06-c3ad-495b-8248-2332fabe0f3e tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:20.433703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f3b5d06-c3ad-495b-8248-2332fabe0f3e tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:20.435831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f3b5d06-c3ad-495b-8248-2332fabe0f3e tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:20.436858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f3b5d06-c3ad-495b-8248-2332fabe0f3e tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:20.438811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f3b5d06-c3ad-495b-8248-2332fabe0f3e tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:20.439468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f3b5d06-c3ad-495b-8248-2332fabe0f3e tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:20.611293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3f3b5d06-c3ad-495b-8248-2332fabe0f3e tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:20.627734 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3f3b5d06-c3ad-495b-8248-2332fabe0f3e tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1477 microversion: 2.1 time: 0.213701 Aug 23 18:23:20.628990 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2861/5854] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:20 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1477 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:20.849039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51ecfa9f-c22e-4f3c-93c7-765f3cad5200 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:20.849844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51ecfa9f-c22e-4f3c-93c7-765f3cad5200 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:20.869257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51ecfa9f-c22e-4f3c-93c7-765f3cad5200 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:20.870430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51ecfa9f-c22e-4f3c-93c7-765f3cad5200 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:20.877972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51ecfa9f-c22e-4f3c-93c7-765f3cad5200 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:20.879179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51ecfa9f-c22e-4f3c-93c7-765f3cad5200 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:20.879890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51ecfa9f-c22e-4f3c-93c7-765f3cad5200 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:20.880575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51ecfa9f-c22e-4f3c-93c7-765f3cad5200 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:21.153379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-262c2491-c58c-42c8-baaf-41674bdbc5ca tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:21.160280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-262c2491-c58c-42c8-baaf-41674bdbc5ca tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:21.206571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-262c2491-c58c-42c8-baaf-41674bdbc5ca tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:21.211114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-262c2491-c58c-42c8-baaf-41674bdbc5ca tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:21.211114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-262c2491-c58c-42c8-baaf-41674bdbc5ca tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:21.211114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-262c2491-c58c-42c8-baaf-41674bdbc5ca tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:21.211114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-262c2491-c58c-42c8-baaf-41674bdbc5ca tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:21.211114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-262c2491-c58c-42c8-baaf-41674bdbc5ca tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:21.968539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-51ecfa9f-c22e-4f3c-93c7-765f3cad5200 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:21.983159 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51ecfa9f-c22e-4f3c-93c7-765f3cad5200 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 1.138141 Aug 23 18:23:21.984762 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2994/5855] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:20 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:21.998518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ca7a0119-c45c-4e41-865b-3fa237f4c898 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:22.000155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ca7a0119-c45c-4e41-865b-3fa237f4c898 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:22.010158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca7a0119-c45c-4e41-865b-3fa237f4c898 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:22.011027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca7a0119-c45c-4e41-865b-3fa237f4c898 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:22.011657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca7a0119-c45c-4e41-865b-3fa237f4c898 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:22.012633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca7a0119-c45c-4e41-865b-3fa237f4c898 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:22.013255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca7a0119-c45c-4e41-865b-3fa237f4c898 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:22.013854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca7a0119-c45c-4e41-865b-3fa237f4c898 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:22.141530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ca7a0119-c45c-4e41-865b-3fa237f4c898 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:22.153956 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ca7a0119-c45c-4e41-865b-3fa237f4c898 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1477 microversion: 2.1 time: 0.164471 Aug 23 18:23:22.155972 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2995/5856] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:21 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1477 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:22.665657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-63838bcc-dd0f-48d7-bb6f-52265f4dad98 req-cf90316d-3ee0-443f-b151-7fd146381dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67fa321c-8a3e-4cb9-ab7e-2c48aed19427", "name": "network-vif-deleted", "tag": "962600af-0c62-4ec9-b7f4-d092ec307c5e"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:22.679747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-262c2491-c58c-42c8-baaf-41674bdbc5ca tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:22.692152 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-262c2491-c58c-42c8-baaf-41674bdbc5ca tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1428 microversion: 2.1 time: 1.551166 Aug 23 18:23:22.702015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-63838bcc-dd0f-48d7-bb6f-52265f4dad98 req-cf90316d-3ee0-443f-b151-7fd146381dc5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:22.706786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-63838bcc-dd0f-48d7-bb6f-52265f4dad98 req-cf90316d-3ee0-443f-b151-7fd146381dc5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:22.710885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-63838bcc-dd0f-48d7-bb6f-52265f4dad98 req-cf90316d-3ee0-443f-b151-7fd146381dc5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:22.711870 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2862/5857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:21 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1428 bytes in 1571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:22.754223 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-63838bcc-dd0f-48d7-bb6f-52265f4dad98 req-cf90316d-3ee0-443f-b151-7fd146381dc5 service nova] Creating event network-vif-deleted:962600af-0c62-4ec9-b7f4-d092ec307c5e for instance 67fa321c-8a3e-4cb9-ab7e-2c48aed19427 on n-h1-850468-16 Aug 23 18:23:22.766158 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-63838bcc-dd0f-48d7-bb6f-52265f4dad98 req-cf90316d-3ee0-443f-b151-7fd146381dc5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101767 Aug 23 18:23:22.768269 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2996/5858] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:23.005963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-511c2974-7d19-4677-a882-3ad945b01525 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:23.008196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-511c2974-7d19-4677-a882-3ad945b01525 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:23.016613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-511c2974-7d19-4677-a882-3ad945b01525 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:23.017459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-511c2974-7d19-4677-a882-3ad945b01525 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:23.017965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-511c2974-7d19-4677-a882-3ad945b01525 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:23.018775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-511c2974-7d19-4677-a882-3ad945b01525 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:23.019426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-511c2974-7d19-4677-a882-3ad945b01525 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:23.020077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-511c2974-7d19-4677-a882-3ad945b01525 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:23.182978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:23.185455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:23.221624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:23.222781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:23.223487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:23.224667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:23.225424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:23.226895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:23.329409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:23.331076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:23.331972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:23.332671 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lazy-loading 'fault' on Instance uuid 67fa321c-8a3e-4cb9-ab7e-2c48aed19427 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:23:23.420968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-511c2974-7d19-4677-a882-3ad945b01525 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:23.439177 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-511c2974-7d19-4677-a882-3ad945b01525 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.436688 Aug 23 18:23:23.441713 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2863/5859] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:23 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:23.471190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-291bf94d-24a6-42a9-9c8e-c02f731bfd93 req-167a835e-ffe3-4e18-a2d3-163a8d7b4f48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "182272d5-4238-47d7-917f-f604b24bd05f", "tag": "096e329a-9de7-409c-8a71-48b0df191e5b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:23.499165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-291bf94d-24a6-42a9-9c8e-c02f731bfd93 req-167a835e-ffe3-4e18-a2d3-163a8d7b4f48 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:23.499852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-291bf94d-24a6-42a9-9c8e-c02f731bfd93 req-167a835e-ffe3-4e18-a2d3-163a8d7b4f48 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:23.500698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-291bf94d-24a6-42a9-9c8e-c02f731bfd93 req-167a835e-ffe3-4e18-a2d3-163a8d7b4f48 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:23.500825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:23.515110 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f9f27211-dfa3-483e-9723-ba7c79a70843 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 200 len: 1331 microversion: 2.1 time: 0.340608 Aug 23 18:23:23.515729 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2997/5860] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:23 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 1331 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:23.515917 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-291bf94d-24a6-42a9-9c8e-c02f731bfd93 req-167a835e-ffe3-4e18-a2d3-163a8d7b4f48 service nova] Creating event network-changed:096e329a-9de7-409c-8a71-48b0df191e5b for instance 182272d5-4238-47d7-917f-f604b24bd05f on n-h2-850468-16 Aug 23 18:23:23.522350 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-291bf94d-24a6-42a9-9c8e-c02f731bfd93 req-167a835e-ffe3-4e18-a2d3-163a8d7b4f48 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078172 Aug 23 18:23:23.523405 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2864/5861] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:23.719972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fedbdc3a-df35-4e5a-90b7-3eea669cf6b4 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:23.720867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fedbdc3a-df35-4e5a-90b7-3eea669cf6b4 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:23.734879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fedbdc3a-df35-4e5a-90b7-3eea669cf6b4 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:23.735401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fedbdc3a-df35-4e5a-90b7-3eea669cf6b4 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:23.735852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fedbdc3a-df35-4e5a-90b7-3eea669cf6b4 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:23.736610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fedbdc3a-df35-4e5a-90b7-3eea669cf6b4 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:23.737079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fedbdc3a-df35-4e5a-90b7-3eea669cf6b4 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:23.737519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fedbdc3a-df35-4e5a-90b7-3eea669cf6b4 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:24.048568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fedbdc3a-df35-4e5a-90b7-3eea669cf6b4 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:24.059733 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fedbdc3a-df35-4e5a-90b7-3eea669cf6b4 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1428 microversion: 2.1 time: 0.341508 Aug 23 18:23:24.060536 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2998/5862] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:23 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1428 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:24.462813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-51228363-634b-4256-af5b-22b4070ddff2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:24.464871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-51228363-634b-4256-af5b-22b4070ddff2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:24.474215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51228363-634b-4256-af5b-22b4070ddff2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:24.475070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51228363-634b-4256-af5b-22b4070ddff2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:24.475978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51228363-634b-4256-af5b-22b4070ddff2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:24.476864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51228363-634b-4256-af5b-22b4070ddff2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:24.478936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51228363-634b-4256-af5b-22b4070ddff2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:24.479730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51228363-634b-4256-af5b-22b4070ddff2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:24.538907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f886f56-11e9-4ce9-a27a-c4acad8c5bf4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:24.541412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7f886f56-11e9-4ce9-a27a-c4acad8c5bf4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 67fa321c-8a3e-4cb9-ab7e-2c48aed19427] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:24.562377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f886f56-11e9-4ce9-a27a-c4acad8c5bf4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:24.562967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f886f56-11e9-4ce9-a27a-c4acad8c5bf4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:24.563414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f886f56-11e9-4ce9-a27a-c4acad8c5bf4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:24.564141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f886f56-11e9-4ce9-a27a-c4acad8c5bf4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:24.564596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f886f56-11e9-4ce9-a27a-c4acad8c5bf4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:24.565900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f886f56-11e9-4ce9-a27a-c4acad8c5bf4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:24.590066 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-7f886f56-11e9-4ce9-a27a-c4acad8c5bf4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] HTTP exception thrown: Instance 67fa321c-8a3e-4cb9-ab7e-2c48aed19427 could not be found. Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f886f56-11e9-4ce9-a27a-c4acad8c5bf4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Request method failure captured: Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 HTTP/1.1 Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRp6hqhUahV88yDGYOABGeAp6BHsxJn615Gtb2bfwUvThnAdzQX4u54zdLLK0blcdwf8BESTqGZuhP_87yJAgBEX9h7t8wt8G0kJFAPeAejtr6li1IOP-UGn6H4OcUQMi5XAKQ1dpCaa76b5CTTRC7WgQiknEQxc5YOeVdHMluqGeW0 Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 453bc930d231491f81b4843fa86613cc Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-681698998 Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_453bc930d231491f81b4843fa86613cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/453bc930d231491f81b4843fa86613cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/453bc930d231491f81b4843fa86613cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/453bc930d231491f81b4843fa86613cc"}]}] Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestSecurityGroupsBasicOps-681698998 Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 453bc930d231491f81b4843fa86613cc Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-681698998 Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestSecurityGroupsBasicOps-681698998-project Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a28cba675eca43b881dfdfa00fd348f4 Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestSecurityGroupsBasicOps-681698998-project Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 67fa321c-8a3e-4cb9-ab7e-2c48aed19427 could not be found. Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '67fa321c-8a3e-4cb9-ab7e-2c48aed19427'} Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67fa321c-8a3e-4cb9-ab7e-2c48aed19427 could not be found. Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67fa321c-8a3e-4cb9-ab7e-2c48aed19427 could not be found. Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:23:24.592853 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:24.598035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:23:24.598035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:23:24.598035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:23:24.598035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:23:24.598035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:23:24.598035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67fa321c-8a3e-4cb9-ab7e-2c48aed19427 could not be found. Aug 23 18:23:24.598035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:24.601283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f886f56-11e9-4ce9-a27a-c4acad8c5bf4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Returning 404 to user: Instance 67fa321c-8a3e-4cb9-ab7e-2c48aed19427 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:23:24.602172 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7f886f56-11e9-4ce9-a27a-c4acad8c5bf4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427" status: 404 len: 111 microversion: 2.1 time: 0.068731 Aug 23 18:23:24.603316 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 2999/5863] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:24 2022] GET /compute/v2.1/servers/67fa321c-8a3e-4cb9-ab7e-2c48aed19427 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:23:24.815402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-51228363-634b-4256-af5b-22b4070ddff2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:24.855382 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-51228363-634b-4256-af5b-22b4070ddff2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.397008 Aug 23 18:23:24.858726 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2865/5864] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:24 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:25.083863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e1ceb92-ae2b-43db-8a63-bc36e28e978a tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:25.084944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e1ceb92-ae2b-43db-8a63-bc36e28e978a tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:25.107620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e1ceb92-ae2b-43db-8a63-bc36e28e978a tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:25.108149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e1ceb92-ae2b-43db-8a63-bc36e28e978a tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:25.108620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e1ceb92-ae2b-43db-8a63-bc36e28e978a tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:25.109351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e1ceb92-ae2b-43db-8a63-bc36e28e978a tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:25.109813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e1ceb92-ae2b-43db-8a63-bc36e28e978a tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:25.110428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e1ceb92-ae2b-43db-8a63-bc36e28e978a tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:25.416469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8e1ceb92-ae2b-43db-8a63-bc36e28e978a tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:25.426703 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e1ceb92-ae2b-43db-8a63-bc36e28e978a tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1428 microversion: 2.1 time: 0.349033 Aug 23 18:23:25.427804 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3000/5865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:25 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1428 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:25.878278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-320a09ce-9f85-408e-9ae0-d06c8c326b5f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:25.878929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-320a09ce-9f85-408e-9ae0-d06c8c326b5f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:25.890209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-320a09ce-9f85-408e-9ae0-d06c8c326b5f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:25.890870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-320a09ce-9f85-408e-9ae0-d06c8c326b5f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:25.891287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-320a09ce-9f85-408e-9ae0-d06c8c326b5f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:25.892450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-320a09ce-9f85-408e-9ae0-d06c8c326b5f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:25.892557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-320a09ce-9f85-408e-9ae0-d06c8c326b5f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:25.903250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-320a09ce-9f85-408e-9ae0-d06c8c326b5f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:26.216787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-320a09ce-9f85-408e-9ae0-d06c8c326b5f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:26.234159 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-320a09ce-9f85-408e-9ae0-d06c8c326b5f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.359995 Aug 23 18:23:26.237937 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2866/5866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:25 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:26.449885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7269ccdc-da21-40de-980d-2007c3aff9f7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:26.450576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7269ccdc-da21-40de-980d-2007c3aff9f7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:26.458723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7269ccdc-da21-40de-980d-2007c3aff9f7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:26.459162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7269ccdc-da21-40de-980d-2007c3aff9f7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:26.459605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7269ccdc-da21-40de-980d-2007c3aff9f7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:26.460560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7269ccdc-da21-40de-980d-2007c3aff9f7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:26.461212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7269ccdc-da21-40de-980d-2007c3aff9f7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:26.461649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7269ccdc-da21-40de-980d-2007c3aff9f7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:27.059118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7269ccdc-da21-40de-980d-2007c3aff9f7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:27.068946 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7269ccdc-da21-40de-980d-2007c3aff9f7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1428 microversion: 2.1 time: 0.623714 Aug 23 18:23:27.071149 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3001/5867] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:26 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1428 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:27.238053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-01eef704-55b1-457a-b8a7-d7901a18bd65 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'create', calling method: .version_select at 0x7f27df73c940>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-340573885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA73cNKOaBT59d6m8HMP7+SjPdZ/Rf967PTTtZyI9LJ/yfmx2EOd5a2peW9qnBGKX9tFjAGw0FjB0uka5aFtK87jI72fJrCDBNZXDxWZCIJfjzI5fXfG/dM3qoICbhRjFg=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:27.269812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-01eef704-55b1-457a-b8a7-d7901a18bd65 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:23:27.279616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6a283b9-04b8-4718-9ae2-7e0ed1c06ed9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:27.280206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6a283b9-04b8-4718-9ae2-7e0ed1c06ed9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:27.282036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-01eef704-55b1-457a-b8a7-d7901a18bd65 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for user 399d321c5f564e8ba9d3e1ed7ae05184 and project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:23:27.287120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6a283b9-04b8-4718-9ae2-7e0ed1c06ed9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:27.287805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6a283b9-04b8-4718-9ae2-7e0ed1c06ed9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:27.288452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6a283b9-04b8-4718-9ae2-7e0ed1c06ed9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:27.289763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6a283b9-04b8-4718-9ae2-7e0ed1c06ed9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:27.290398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6a283b9-04b8-4718-9ae2-7e0ed1c06ed9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:27.292118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6a283b9-04b8-4718-9ae2-7e0ed1c06ed9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:27.321670 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6a283b9-04b8-4718-9ae2-7e0ed1c06ed9 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/ips" status: 200 len: 150 microversion: 2.1 time: 0.247989 Aug 23 18:23:27.323309 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3002/5868] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:23:27 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/ips => generated 150 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:27.328232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-83228fa9-92cb-48d1-91e0-3649454d25bf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:27.329227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-83228fa9-92cb-48d1-91e0-3649454d25bf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:27.337374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83228fa9-92cb-48d1-91e0-3649454d25bf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:27.338168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83228fa9-92cb-48d1-91e0-3649454d25bf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:27.340252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83228fa9-92cb-48d1-91e0-3649454d25bf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:27.341735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83228fa9-92cb-48d1-91e0-3649454d25bf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:27.342226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83228fa9-92cb-48d1-91e0-3649454d25bf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:27.343420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-83228fa9-92cb-48d1-91e0-3649454d25bf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:27.362119 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-01eef704-55b1-457a-b8a7-d7901a18bd65 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.548293 Aug 23 18:23:27.363808 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2867/5869] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:23:26 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:23:27.636977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:27.719753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-83228fa9-92cb-48d1-91e0-3649454d25bf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:27.745043 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-83228fa9-92cb-48d1-91e0-3649454d25bf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.418930 Aug 23 18:23:27.750640 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3003/5870] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:27 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:28.098145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ae142f84-9329-4f0f-8a4f-fb493948dd97 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:28.098313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ae142f84-9329-4f0f-8a4f-fb493948dd97 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:28.109523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:28.121958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae142f84-9329-4f0f-8a4f-fb493948dd97 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:28.122669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae142f84-9329-4f0f-8a4f-fb493948dd97 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:28.123774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae142f84-9329-4f0f-8a4f-fb493948dd97 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:28.126210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae142f84-9329-4f0f-8a4f-fb493948dd97 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:28.127174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae142f84-9329-4f0f-8a4f-fb493948dd97 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:28.127972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae142f84-9329-4f0f-8a4f-fb493948dd97 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:28.659080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ae142f84-9329-4f0f-8a4f-fb493948dd97 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:28.689858 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ae142f84-9329-4f0f-8a4f-fb493948dd97 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1428 microversion: 2.1 time: 0.596075 Aug 23 18:23:28.695337 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2868/5871] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:28 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1428 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:28.772261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bcd3649a-109e-4b72-8b4c-35b0358f2560 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:28.773739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bcd3649a-109e-4b72-8b4c-35b0358f2560 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:28.783468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcd3649a-109e-4b72-8b4c-35b0358f2560 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:28.784352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcd3649a-109e-4b72-8b4c-35b0358f2560 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:28.785046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcd3649a-109e-4b72-8b4c-35b0358f2560 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:28.787075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcd3649a-109e-4b72-8b4c-35b0358f2560 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:28.788630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcd3649a-109e-4b72-8b4c-35b0358f2560 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:28.789303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bcd3649a-109e-4b72-8b4c-35b0358f2560 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:29.308452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bcd3649a-109e-4b72-8b4c-35b0358f2560 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:29.317311 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bcd3649a-109e-4b72-8b4c-35b0358f2560 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.551821 Aug 23 18:23:29.322757 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3004/5872] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:28 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:29.718398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47e05cf9-b650-4660-a159-27c3f48c1824 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:29.719215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-47e05cf9-b650-4660-a159-27c3f48c1824 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:29.732568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47e05cf9-b650-4660-a159-27c3f48c1824 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:29.733463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47e05cf9-b650-4660-a159-27c3f48c1824 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:29.735220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47e05cf9-b650-4660-a159-27c3f48c1824 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:29.737585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47e05cf9-b650-4660-a159-27c3f48c1824 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:29.739891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47e05cf9-b650-4660-a159-27c3f48c1824 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:29.740406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47e05cf9-b650-4660-a159-27c3f48c1824 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:30.117104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2aaa5b6c-24cf-4466-a63e-ed90e139dd02 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca524fa1-93e9-429f-b7b2-53305f9dca39"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:30.121115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2aaa5b6c-24cf-4466-a63e-ed90e139dd02 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:30.133534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aaa5b6c-24cf-4466-a63e-ed90e139dd02 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:30.135898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aaa5b6c-24cf-4466-a63e-ed90e139dd02 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:30.136698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aaa5b6c-24cf-4466-a63e-ed90e139dd02 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:30.137494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aaa5b6c-24cf-4466-a63e-ed90e139dd02 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:30.140659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aaa5b6c-24cf-4466-a63e-ed90e139dd02 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:30.141162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2aaa5b6c-24cf-4466-a63e-ed90e139dd02 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:30.161398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:30.297829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-47e05cf9-b650-4660-a159-27c3f48c1824 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:30.309637 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-47e05cf9-b650-4660-a159-27c3f48c1824 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1428 microversion: 2.1 time: 0.596478 Aug 23 18:23:30.310806 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2869/5873] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:29 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1428 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:30.349436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5e91fe0c-5b5b-41b5-af2c-800cf2e21af9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:30.351138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5e91fe0c-5b5b-41b5-af2c-800cf2e21af9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:30.366259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e91fe0c-5b5b-41b5-af2c-800cf2e21af9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:30.366925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e91fe0c-5b5b-41b5-af2c-800cf2e21af9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:30.367764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e91fe0c-5b5b-41b5-af2c-800cf2e21af9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:30.368865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e91fe0c-5b5b-41b5-af2c-800cf2e21af9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:30.372608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e91fe0c-5b5b-41b5-af2c-800cf2e21af9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:30.373277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e91fe0c-5b5b-41b5-af2c-800cf2e21af9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:30.566418 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2aaa5b6c-24cf-4466-a63e-ed90e139dd02 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.455427 Aug 23 18:23:30.567674 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3005/5874] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:23:30 2022] POST /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:23:30.857883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5e91fe0c-5b5b-41b5-af2c-800cf2e21af9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:30.866283 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5e91fe0c-5b5b-41b5-af2c-800cf2e21af9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.526741 Aug 23 18:23:30.881703 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2870/5875] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:30 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:31.342407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8728fcf3-43a8-4c4a-b493-ec1e180e2c82 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:31.343806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8728fcf3-43a8-4c4a-b493-ec1e180e2c82 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:31.353300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8728fcf3-43a8-4c4a-b493-ec1e180e2c82 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:31.355026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8728fcf3-43a8-4c4a-b493-ec1e180e2c82 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:31.355668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8728fcf3-43a8-4c4a-b493-ec1e180e2c82 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:31.357341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8728fcf3-43a8-4c4a-b493-ec1e180e2c82 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:31.357977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8728fcf3-43a8-4c4a-b493-ec1e180e2c82 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:31.358715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8728fcf3-43a8-4c4a-b493-ec1e180e2c82 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:31.890330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-034ec106-bfdc-4891-bcbc-581deb752bbb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:31.891583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-034ec106-bfdc-4891-bcbc-581deb752bbb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:31.904097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-034ec106-bfdc-4891-bcbc-581deb752bbb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:31.908478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-034ec106-bfdc-4891-bcbc-581deb752bbb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:31.909865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-034ec106-bfdc-4891-bcbc-581deb752bbb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:31.918635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-034ec106-bfdc-4891-bcbc-581deb752bbb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:31.920149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-034ec106-bfdc-4891-bcbc-581deb752bbb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:31.921516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-034ec106-bfdc-4891-bcbc-581deb752bbb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:32.039647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8728fcf3-43a8-4c4a-b493-ec1e180e2c82 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:32.058803 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8728fcf3-43a8-4c4a-b493-ec1e180e2c82 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1428 microversion: 2.1 time: 0.723084 Aug 23 18:23:32.069101 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3006/5876] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:31 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1428 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:32.083011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-74da0b7f-0ab1-4012-97e2-9a831ab1d3c4 req-79fef10a-67fa-4955-a81a-53ee96c8960a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "182272d5-4238-47d7-917f-f604b24bd05f", "name": "network-vif-plugged", "status": "completed", "tag": "096e329a-9de7-409c-8a71-48b0df191e5b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:32.108767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-74da0b7f-0ab1-4012-97e2-9a831ab1d3c4 req-79fef10a-67fa-4955-a81a-53ee96c8960a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:32.112030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-74da0b7f-0ab1-4012-97e2-9a831ab1d3c4 req-79fef10a-67fa-4955-a81a-53ee96c8960a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:32.112492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-74da0b7f-0ab1-4012-97e2-9a831ab1d3c4 req-79fef10a-67fa-4955-a81a-53ee96c8960a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:32.147570 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-74da0b7f-0ab1-4012-97e2-9a831ab1d3c4 req-79fef10a-67fa-4955-a81a-53ee96c8960a service nova] Creating event network-vif-plugged:096e329a-9de7-409c-8a71-48b0df191e5b for instance 182272d5-4238-47d7-917f-f604b24bd05f on n-h2-850468-16 Aug 23 18:23:32.157373 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-74da0b7f-0ab1-4012-97e2-9a831ab1d3c4 req-79fef10a-67fa-4955-a81a-53ee96c8960a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086161 Aug 23 18:23:32.158238 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3007/5877] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:32.497619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-034ec106-bfdc-4891-bcbc-581deb752bbb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:32.511502 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-034ec106-bfdc-4891-bcbc-581deb752bbb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1516 microversion: 2.1 time: 0.625609 Aug 23 18:23:32.513662 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2871/5878] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:31 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1516 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:33.082366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ca6d6261-5fc7-4f8c-99e6-915de3fb1ca3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:33.083403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ca6d6261-5fc7-4f8c-99e6-915de3fb1ca3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:33.097287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca6d6261-5fc7-4f8c-99e6-915de3fb1ca3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:33.099893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca6d6261-5fc7-4f8c-99e6-915de3fb1ca3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:33.100349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca6d6261-5fc7-4f8c-99e6-915de3fb1ca3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:33.101079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca6d6261-5fc7-4f8c-99e6-915de3fb1ca3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:33.105498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca6d6261-5fc7-4f8c-99e6-915de3fb1ca3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:33.106383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ca6d6261-5fc7-4f8c-99e6-915de3fb1ca3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:33.112934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aeeae264-5068-4193-9f18-df025fe10a88 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:33.114220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aeeae264-5068-4193-9f18-df025fe10a88 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:33.129227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aeeae264-5068-4193-9f18-df025fe10a88 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:33.131644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aeeae264-5068-4193-9f18-df025fe10a88 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:33.134321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aeeae264-5068-4193-9f18-df025fe10a88 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:33.139464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aeeae264-5068-4193-9f18-df025fe10a88 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:33.140130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aeeae264-5068-4193-9f18-df025fe10a88 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:33.153160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aeeae264-5068-4193-9f18-df025fe10a88 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:33.207641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aeeae264-5068-4193-9f18-df025fe10a88 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:23:33.262501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:33.379648 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aeeae264-5068-4193-9f18-df025fe10a88 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 204 len: 0 microversion: 2.1 time: 0.270410 Aug 23 18:23:33.380734 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2872/5879] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:23:33 2022] DELETE /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:23:33.396374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ca6d6261-5fc7-4f8c-99e6-915de3fb1ca3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:33.401648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-0856b800-9d93-4cfd-b453-0051d33d4e64 req-941e0993-47e9-49ee-811a-35254ffd7084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4220478c-eb77-460e-acbd-e1a4d739af9c", "tag": "3b405d96-6035-4d19-babd-6cca1c43298a"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:33.406560 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ca6d6261-5fc7-4f8c-99e6-915de3fb1ca3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1428 microversion: 2.1 time: 0.328796 Aug 23 18:23:33.410713 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3008/5880] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:33 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1428 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:33.426655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ea700b6c-6ad0-470b-8a59-e4c037192163 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:33.427854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ea700b6c-6ad0-470b-8a59-e4c037192163 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:33.434528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0856b800-9d93-4cfd-b453-0051d33d4e64 req-941e0993-47e9-49ee-811a-35254ffd7084 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:33.435332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0856b800-9d93-4cfd-b453-0051d33d4e64 req-941e0993-47e9-49ee-811a-35254ffd7084 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:33.435974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0856b800-9d93-4cfd-b453-0051d33d4e64 req-941e0993-47e9-49ee-811a-35254ffd7084 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:33.438502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea700b6c-6ad0-470b-8a59-e4c037192163 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:33.439505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea700b6c-6ad0-470b-8a59-e4c037192163 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:33.439961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea700b6c-6ad0-470b-8a59-e4c037192163 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:33.440683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea700b6c-6ad0-470b-8a59-e4c037192163 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:33.441148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea700b6c-6ad0-470b-8a59-e4c037192163 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:33.441578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ea700b6c-6ad0-470b-8a59-e4c037192163 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:33.458143 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-0856b800-9d93-4cfd-b453-0051d33d4e64 req-941e0993-47e9-49ee-811a-35254ffd7084 service nova] Creating event network-changed:3b405d96-6035-4d19-babd-6cca1c43298a for instance 4220478c-eb77-460e-acbd-e1a4d739af9c on n-h2-850468-16 Aug 23 18:23:33.470581 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-0856b800-9d93-4cfd-b453-0051d33d4e64 req-941e0993-47e9-49ee-811a-35254ffd7084 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087810 Aug 23 18:23:33.472934 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2873/5881] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:33.536450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6ac3853a-58e7-4157-9977-9babf43203b1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:33.537220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6ac3853a-58e7-4157-9977-9babf43203b1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:33.546330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ac3853a-58e7-4157-9977-9babf43203b1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:33.546717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ac3853a-58e7-4157-9977-9babf43203b1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:33.547170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ac3853a-58e7-4157-9977-9babf43203b1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:33.548294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ac3853a-58e7-4157-9977-9babf43203b1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:33.549276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ac3853a-58e7-4157-9977-9babf43203b1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:33.549276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ac3853a-58e7-4157-9977-9babf43203b1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:33.737594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ea700b6c-6ad0-470b-8a59-e4c037192163 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:33.754146 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ea700b6c-6ad0-470b-8a59-e4c037192163 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1766 microversion: 2.1 time: 0.341789 Aug 23 18:23:33.755024 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3009/5882] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:33 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1766 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:33.811761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6ac3853a-58e7-4157-9977-9babf43203b1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:33.824173 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6ac3853a-58e7-4157-9977-9babf43203b1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1522 microversion: 2.1 time: 0.292501 Aug 23 18:23:33.827711 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2874/5883] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:33 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:34.435055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-523aa394-d57f-4b20-b927-c8a6071daf6e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:34.436492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-523aa394-d57f-4b20-b927-c8a6071daf6e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:34.449421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-523aa394-d57f-4b20-b927-c8a6071daf6e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:34.450268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-523aa394-d57f-4b20-b927-c8a6071daf6e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:34.450933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-523aa394-d57f-4b20-b927-c8a6071daf6e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:34.453422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-523aa394-d57f-4b20-b927-c8a6071daf6e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:34.456693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-523aa394-d57f-4b20-b927-c8a6071daf6e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:34.457365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-523aa394-d57f-4b20-b927-c8a6071daf6e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:34.782135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4054ce41-f9be-4069-bdf3-3151eadbdceb tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:34.783524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4054ce41-f9be-4069-bdf3-3151eadbdceb tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:34.794587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4054ce41-f9be-4069-bdf3-3151eadbdceb tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:34.812678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4054ce41-f9be-4069-bdf3-3151eadbdceb tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:34.813617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4054ce41-f9be-4069-bdf3-3151eadbdceb tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:34.816997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4054ce41-f9be-4069-bdf3-3151eadbdceb tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:34.817554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4054ce41-f9be-4069-bdf3-3151eadbdceb tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:34.818097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4054ce41-f9be-4069-bdf3-3151eadbdceb tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:34.987819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-523aa394-d57f-4b20-b927-c8a6071daf6e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:35.006637 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-523aa394-d57f-4b20-b927-c8a6071daf6e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1428 microversion: 2.1 time: 0.576800 Aug 23 18:23:35.007466 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3010/5884] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:34 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1428 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:35.018794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-acc4fff6-4c8a-4f6a-8af6-30f3a9a0177a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:35.019430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-acc4fff6-4c8a-4f6a-8af6-30f3a9a0177a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:35.033651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc4fff6-4c8a-4f6a-8af6-30f3a9a0177a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:35.034219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc4fff6-4c8a-4f6a-8af6-30f3a9a0177a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:35.034738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc4fff6-4c8a-4f6a-8af6-30f3a9a0177a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:35.035501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc4fff6-4c8a-4f6a-8af6-30f3a9a0177a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:35.045406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc4fff6-4c8a-4f6a-8af6-30f3a9a0177a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:35.046420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc4fff6-4c8a-4f6a-8af6-30f3a9a0177a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:35.437278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-acc4fff6-4c8a-4f6a-8af6-30f3a9a0177a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:35.446006 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-acc4fff6-4c8a-4f6a-8af6-30f3a9a0177a tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1522 microversion: 2.1 time: 0.436679 Aug 23 18:23:35.448965 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3011/5885] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:35 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1522 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:35.465401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4054ce41-f9be-4069-bdf3-3151eadbdceb tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:35.476346 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4054ce41-f9be-4069-bdf3-3151eadbdceb tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1766 microversion: 2.1 time: 0.698363 Aug 23 18:23:35.477216 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2875/5886] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:34 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1766 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:36.028866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1feb82c5-5d1b-4847-91b9-ebcd0943624d tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:36.030151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1feb82c5-5d1b-4847-91b9-ebcd0943624d tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:36.048446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1feb82c5-5d1b-4847-91b9-ebcd0943624d tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:36.049136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1feb82c5-5d1b-4847-91b9-ebcd0943624d tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:36.049698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1feb82c5-5d1b-4847-91b9-ebcd0943624d tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:36.050878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1feb82c5-5d1b-4847-91b9-ebcd0943624d tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:36.051339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1feb82c5-5d1b-4847-91b9-ebcd0943624d tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:36.051794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1feb82c5-5d1b-4847-91b9-ebcd0943624d tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:36.404883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1feb82c5-5d1b-4847-91b9-ebcd0943624d tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:36.415422 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1feb82c5-5d1b-4847-91b9-ebcd0943624d tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1428 microversion: 2.1 time: 0.391629 Aug 23 18:23:36.420182 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3012/5887] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:36 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1428 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:36.469177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-36137164-6edc-4718-bd72-5a700851de73 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:36.470373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-36137164-6edc-4718-bd72-5a700851de73 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:36.487406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36137164-6edc-4718-bd72-5a700851de73 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:36.488169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36137164-6edc-4718-bd72-5a700851de73 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:36.488802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36137164-6edc-4718-bd72-5a700851de73 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:36.489701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36137164-6edc-4718-bd72-5a700851de73 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:36.490323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36137164-6edc-4718-bd72-5a700851de73 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:36.490951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36137164-6edc-4718-bd72-5a700851de73 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:36.502016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5265eab3-d478-4b32-8d1f-d94d4dc575db tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:36.503395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5265eab3-d478-4b32-8d1f-d94d4dc575db tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:36.515037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5265eab3-d478-4b32-8d1f-d94d4dc575db tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:36.516507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5265eab3-d478-4b32-8d1f-d94d4dc575db tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:36.518236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5265eab3-d478-4b32-8d1f-d94d4dc575db tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:36.526410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5265eab3-d478-4b32-8d1f-d94d4dc575db tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:36.527240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5265eab3-d478-4b32-8d1f-d94d4dc575db tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:36.531801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5265eab3-d478-4b32-8d1f-d94d4dc575db tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:36.968813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5265eab3-d478-4b32-8d1f-d94d4dc575db tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:36.987645 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5265eab3-d478-4b32-8d1f-d94d4dc575db tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1766 microversion: 2.1 time: 0.490205 Aug 23 18:23:36.991593 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3013/5888] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:36 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1766 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:37.005181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-25b78fd3-d133-494e-a25a-9a1dee0d00db req-cf4cbbc0-9edf-4cdc-b110-0921c0dac843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4220478c-eb77-460e-acbd-e1a4d739af9c", "name": "network-vif-unplugged", "status": "completed", "tag": "3b405d96-6035-4d19-babd-6cca1c43298a"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:37.024348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-25b78fd3-d133-494e-a25a-9a1dee0d00db req-cf4cbbc0-9edf-4cdc-b110-0921c0dac843 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:37.025087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-25b78fd3-d133-494e-a25a-9a1dee0d00db req-cf4cbbc0-9edf-4cdc-b110-0921c0dac843 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:37.026495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-25b78fd3-d133-494e-a25a-9a1dee0d00db req-cf4cbbc0-9edf-4cdc-b110-0921c0dac843 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:37.048080 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-25b78fd3-d133-494e-a25a-9a1dee0d00db req-cf4cbbc0-9edf-4cdc-b110-0921c0dac843 service nova] Creating event network-vif-unplugged:3b405d96-6035-4d19-babd-6cca1c43298a for instance 4220478c-eb77-460e-acbd-e1a4d739af9c on n-h2-850468-16 Aug 23 18:23:37.065158 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-25b78fd3-d133-494e-a25a-9a1dee0d00db req-cf4cbbc0-9edf-4cdc-b110-0921c0dac843 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070246 Aug 23 18:23:37.066247 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3014/5889] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:37.242954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-36137164-6edc-4718-bd72-5a700851de73 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:37.269751 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-36137164-6edc-4718-bd72-5a700851de73 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1522 microversion: 2.1 time: 0.804551 Aug 23 18:23:37.271501 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2876/5890] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:36 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1522 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:37.441881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-23c5e482-dac9-4061-b6d8-422c7029cf13 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:37.448157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-23c5e482-dac9-4061-b6d8-422c7029cf13 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:37.465405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23c5e482-dac9-4061-b6d8-422c7029cf13 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:37.471196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23c5e482-dac9-4061-b6d8-422c7029cf13 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:37.471901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23c5e482-dac9-4061-b6d8-422c7029cf13 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:37.472839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23c5e482-dac9-4061-b6d8-422c7029cf13 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:37.473474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23c5e482-dac9-4061-b6d8-422c7029cf13 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:37.474230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23c5e482-dac9-4061-b6d8-422c7029cf13 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:38.012798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-52b0d38f-92c8-4a1d-9241-12089fdac99b tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:38.013424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-52b0d38f-92c8-4a1d-9241-12089fdac99b tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:38.023764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=14 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:38.033748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52b0d38f-92c8-4a1d-9241-12089fdac99b tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:38.034742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52b0d38f-92c8-4a1d-9241-12089fdac99b tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:38.036969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52b0d38f-92c8-4a1d-9241-12089fdac99b tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:38.036969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52b0d38f-92c8-4a1d-9241-12089fdac99b tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:38.036969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52b0d38f-92c8-4a1d-9241-12089fdac99b tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:38.037518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52b0d38f-92c8-4a1d-9241-12089fdac99b tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:38.644408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-52b0d38f-92c8-4a1d-9241-12089fdac99b tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:38.663960 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-52b0d38f-92c8-4a1d-9241-12089fdac99b tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1766 microversion: 2.1 time: 0.655743 Aug 23 18:23:38.664294 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2877/5891] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:38 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1766 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:38.680910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-23c5e482-dac9-4061-b6d8-422c7029cf13 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:38.681454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8fef3642-9016-4f15-ba7e-8a7b4ec7ada1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:38.684333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8fef3642-9016-4f15-ba7e-8a7b4ec7ada1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:38.691237 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-23c5e482-dac9-4061-b6d8-422c7029cf13 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1428 microversion: 2.1 time: 1.253579 Aug 23 18:23:38.691993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8fef3642-9016-4f15-ba7e-8a7b4ec7ada1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:38.699604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8fef3642-9016-4f15-ba7e-8a7b4ec7ada1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:38.702534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8fef3642-9016-4f15-ba7e-8a7b4ec7ada1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:38.703514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8fef3642-9016-4f15-ba7e-8a7b4ec7ada1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:38.704517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8fef3642-9016-4f15-ba7e-8a7b4ec7ada1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:38.705123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8fef3642-9016-4f15-ba7e-8a7b4ec7ada1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:38.707513 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3015/5892] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:37 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1428 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:38.977404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8fef3642-9016-4f15-ba7e-8a7b4ec7ada1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:38.987826 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8fef3642-9016-4f15-ba7e-8a7b4ec7ada1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1522 microversion: 2.1 time: 0.322262 Aug 23 18:23:38.990688 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2878/5893] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:38 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:39.128020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-e1bf2edf-e21d-477c-beb1-757b3d499037 req-15b03e9f-d14d-428a-861f-ccbd681dd169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e967f401-d352-4b31-8c5a-0f03fa0a9d3f", "name": "network-vif-unplugged", "status": "completed", "tag": "99f1f073-60a1-4593-8a55-07aea05f954b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:39.145564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e1bf2edf-e21d-477c-beb1-757b3d499037 req-15b03e9f-d14d-428a-861f-ccbd681dd169 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:39.145980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e1bf2edf-e21d-477c-beb1-757b3d499037 req-15b03e9f-d14d-428a-861f-ccbd681dd169 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:39.152189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e1bf2edf-e21d-477c-beb1-757b3d499037 req-15b03e9f-d14d-428a-861f-ccbd681dd169 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:39.185175 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-e1bf2edf-e21d-477c-beb1-757b3d499037 req-15b03e9f-d14d-428a-861f-ccbd681dd169 service nova] Creating event network-vif-unplugged:99f1f073-60a1-4593-8a55-07aea05f954b for instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f on n-h2-850468-16 Aug 23 18:23:39.202360 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-e1bf2edf-e21d-477c-beb1-757b3d499037 req-15b03e9f-d14d-428a-861f-ccbd681dd169 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.074749 Aug 23 18:23:39.203540 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3016/5894] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:39.280397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1929092313", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "1f0f67a4-2d09-4d3f-9ef2-fc848079510c"}], "key_name": "tempest-TestNetworkAdvancedServerOps-340573885", "security_groups": [{"name": "tempest-secgroup-smoke-400503367"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:39.315067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:39.507903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] validate_networks() for [('1f0f67a4-2d09-4d3f-9ef2-fc848079510c', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:23:39.688321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-16055134-203e-4d5b-851b-164d221e7ad5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:39.690503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-16055134-203e-4d5b-851b-164d221e7ad5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:39.719885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16055134-203e-4d5b-851b-164d221e7ad5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:39.723905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16055134-203e-4d5b-851b-164d221e7ad5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:39.728403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16055134-203e-4d5b-851b-164d221e7ad5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:39.733268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16055134-203e-4d5b-851b-164d221e7ad5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:39.733969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16055134-203e-4d5b-851b-164d221e7ad5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:39.734439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16055134-203e-4d5b-851b-164d221e7ad5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:39.923911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-16055134-203e-4d5b-851b-164d221e7ad5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a28cba675eca43b881dfdfa00fd348f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '453bc930d231491f81b4843fa86613cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:39.938604 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-16055134-203e-4d5b-851b-164d221e7ad5 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 200 len: 1530 microversion: 2.1 time: 0.256722 Aug 23 18:23:39.962410 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3017/5895] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:39 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 1530 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:39.996971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6eb133e2-d494-4c66-84a8-504b0f3a091e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:39.998286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6eb133e2-d494-4c66-84a8-504b0f3a091e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:40.028401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6eb133e2-d494-4c66-84a8-504b0f3a091e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:40.034995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6eb133e2-d494-4c66-84a8-504b0f3a091e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:40.035487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6eb133e2-d494-4c66-84a8-504b0f3a091e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:40.037263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6eb133e2-d494-4c66-84a8-504b0f3a091e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:40.039991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6eb133e2-d494-4c66-84a8-504b0f3a091e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:40.042695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6eb133e2-d494-4c66-84a8-504b0f3a091e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:40.279499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:23:40.282346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:23:40.285256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:23:40.285690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:23:40.286116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:23:40.297337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:40.298142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:40.298862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:40.299768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:40.300484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:40.301097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:40.333935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:23:40.341467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for user 399d321c5f564e8ba9d3e1ed7ae05184 and project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:23:40.359786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:23:40.362396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:23:40.397178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6eb133e2-d494-4c66-84a8-504b0f3a091e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:40.407362 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6eb133e2-d494-4c66-84a8-504b0f3a091e tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1607 microversion: 2.1 time: 0.438240 Aug 23 18:23:40.420734 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3018/5896] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:39 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1607 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:40.426273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f9914372-a80e-486c-9865-4e307db2b2ec req-7c86fe33-132a-409c-a00a-e6b7231d9831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4220478c-eb77-460e-acbd-e1a4d739af9c", "name": "network-vif-deleted", "tag": "3b405d96-6035-4d19-babd-6cca1c43298a"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:40.441598 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4626d42d-f2e4-43b1-9191-41ed31883e06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.167055 Aug 23 18:23:40.442255 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2879/5897] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:23:39 2022] POST /compute/v2.1/servers => generated 405 bytes in 1168 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:23:40.449708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4f79bc06-eb62-4ac3-97f4-48d5f32d5a6f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:40.450623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4f79bc06-eb62-4ac3-97f4-48d5f32d5a6f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:40.462337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f9914372-a80e-486c-9865-4e307db2b2ec req-7c86fe33-132a-409c-a00a-e6b7231d9831 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:40.463858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f9914372-a80e-486c-9865-4e307db2b2ec req-7c86fe33-132a-409c-a00a-e6b7231d9831 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:40.464037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f79bc06-eb62-4ac3-97f4-48d5f32d5a6f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:40.464637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f9914372-a80e-486c-9865-4e307db2b2ec req-7c86fe33-132a-409c-a00a-e6b7231d9831 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:40.475846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f79bc06-eb62-4ac3-97f4-48d5f32d5a6f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:40.476679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f79bc06-eb62-4ac3-97f4-48d5f32d5a6f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:40.477440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f79bc06-eb62-4ac3-97f4-48d5f32d5a6f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:40.479492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f79bc06-eb62-4ac3-97f4-48d5f32d5a6f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:40.480001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f79bc06-eb62-4ac3-97f4-48d5f32d5a6f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:40.483193 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f9914372-a80e-486c-9865-4e307db2b2ec req-7c86fe33-132a-409c-a00a-e6b7231d9831 service nova] Creating event network-vif-deleted:3b405d96-6035-4d19-babd-6cca1c43298a for instance 4220478c-eb77-460e-acbd-e1a4d739af9c on n-h2-850468-16 Aug 23 18:23:40.488740 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f9914372-a80e-486c-9865-4e307db2b2ec req-7c86fe33-132a-409c-a00a-e6b7231d9831 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066727 Aug 23 18:23:40.489712 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3019/5898] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:40.495142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0c92a83e-6c28-44c2-aac8-2dcc50a244aa tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:40.495912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0c92a83e-6c28-44c2-aac8-2dcc50a244aa tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:40.504064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c92a83e-6c28-44c2-aac8-2dcc50a244aa tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:40.504936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c92a83e-6c28-44c2-aac8-2dcc50a244aa tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:40.505717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c92a83e-6c28-44c2-aac8-2dcc50a244aa tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:40.506782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c92a83e-6c28-44c2-aac8-2dcc50a244aa tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:40.507395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c92a83e-6c28-44c2-aac8-2dcc50a244aa tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:40.507979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c92a83e-6c28-44c2-aac8-2dcc50a244aa tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:40.711439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4f79bc06-eb62-4ac3-97f4-48d5f32d5a6f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:40.725405 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4f79bc06-eb62-4ac3-97f4-48d5f32d5a6f tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1522 microversion: 2.1 time: 0.281589 Aug 23 18:23:40.725906 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2880/5899] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:40 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:40.738560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e1e01b2-9dcb-48ba-adba-1b8aada4176f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:40.738560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e1e01b2-9dcb-48ba-adba-1b8aada4176f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:40.842642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7e1e01b2-9dcb-48ba-adba-1b8aada4176f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:40.856249 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e1e01b2-9dcb-48ba-adba-1b8aada4176f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1266 microversion: 2.1 time: 0.128062 Aug 23 18:23:40.857415 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2881/5900] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:40 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1266 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:40.868921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0c92a83e-6c28-44c2-aac8-2dcc50a244aa tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:40.884866 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0c92a83e-6c28-44c2-aac8-2dcc50a244aa tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1607 microversion: 2.1 time: 0.393899 Aug 23 18:23:40.886479 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3020/5901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:40 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1607 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:40.908136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cc882ca-cd7c-4959-a424-40189b05c8d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:40.908953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0cc882ca-cd7c-4959-a424-40189b05c8d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:40.923919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cc882ca-cd7c-4959-a424-40189b05c8d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:40.925218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cc882ca-cd7c-4959-a424-40189b05c8d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:40.925767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cc882ca-cd7c-4959-a424-40189b05c8d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:40.926852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cc882ca-cd7c-4959-a424-40189b05c8d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:40.927473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cc882ca-cd7c-4959-a424-40189b05c8d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:40.928112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cc882ca-cd7c-4959-a424-40189b05c8d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:40.985438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d316cefb-c271-40f9-87e9-da415bd3fae4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:40.989805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d316cefb-c271-40f9-87e9-da415bd3fae4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] [instance: 4220478c-eb77-460e-acbd-e1a4d739af9c] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:41.002845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d316cefb-c271-40f9-87e9-da415bd3fae4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:41.003649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d316cefb-c271-40f9-87e9-da415bd3fae4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:41.004257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d316cefb-c271-40f9-87e9-da415bd3fae4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:41.005191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d316cefb-c271-40f9-87e9-da415bd3fae4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:41.005900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d316cefb-c271-40f9-87e9-da415bd3fae4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:41.006585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d316cefb-c271-40f9-87e9-da415bd3fae4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:41.029915 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-d316cefb-c271-40f9-87e9-da415bd3fae4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] HTTP exception thrown: Instance 4220478c-eb77-460e-acbd-e1a4d739af9c could not be found. Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d316cefb-c271-40f9-87e9-da415bd3fae4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Request method failure captured: Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c HTTP/1.1 Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRp6hqhUahV88yDGYOABGeAp6BHsxJn615Gtb2bfwUvThnAdzQX4u54zdLLK0blcdwf8BESTqGZuhP_87yJAgBEX9h7t8wt8G0kJFAPeAejtr6li1IOP-UGn6H4OcUQMi5XAKQ1dpCaa76b5CTTRC7WgQiknEQxc5YOeVdHMluqGeW0 Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 453bc930d231491f81b4843fa86613cc Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-681698998 Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_453bc930d231491f81b4843fa86613cc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/453bc930d231491f81b4843fa86613cc"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/453bc930d231491f81b4843fa86613cc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/453bc930d231491f81b4843fa86613cc"}]}] Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestSecurityGroupsBasicOps-681698998 Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 453bc930d231491f81b4843fa86613cc Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-681698998 Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestSecurityGroupsBasicOps-681698998-project Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a28cba675eca43b881dfdfa00fd348f4 Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestSecurityGroupsBasicOps-681698998-project Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 4220478c-eb77-460e-acbd-e1a4d739af9c could not be found. Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '4220478c-eb77-460e-acbd-e1a4d739af9c'} Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4220478c-eb77-460e-acbd-e1a4d739af9c could not be found. Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4220478c-eb77-460e-acbd-e1a4d739af9c could not be found. Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:23:41.033249 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:41.042663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:23:41.042663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:23:41.042663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:23:41.042663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:23:41.042663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:23:41.042663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4220478c-eb77-460e-acbd-e1a4d739af9c could not be found. Aug 23 18:23:41.042663 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:41.042663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d316cefb-c271-40f9-87e9-da415bd3fae4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Returning 404 to user: Instance 4220478c-eb77-460e-acbd-e1a4d739af9c could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:23:41.042663 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d316cefb-c271-40f9-87e9-da415bd3fae4 tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c" status: 404 len: 111 microversion: 2.1 time: 0.057147 Aug 23 18:23:41.042663 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3021/5902] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:40 2022] GET /compute/v2.1/servers/4220478c-eb77-460e-acbd-e1a4d739af9c => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:23:41.163463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0cc882ca-cd7c-4959-a424-40189b05c8d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:41.176977 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0cc882ca-cd7c-4959-a424-40189b05c8d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1607 microversion: 2.1 time: 0.272666 Aug 23 18:23:41.178966 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2882/5903] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:40 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1607 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:41.330140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-545e7c5c-f50f-482c-9bfd-7f4e8166a780 req-ebff6b37-5d7b-4c3f-822f-89e38796d8dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e967f401-d352-4b31-8c5a-0f03fa0a9d3f", "name": "network-vif-plugged", "status": "completed", "tag": "99f1f073-60a1-4593-8a55-07aea05f954b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:41.343255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-545e7c5c-f50f-482c-9bfd-7f4e8166a780 req-ebff6b37-5d7b-4c3f-822f-89e38796d8dd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:41.343744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-545e7c5c-f50f-482c-9bfd-7f4e8166a780 req-ebff6b37-5d7b-4c3f-822f-89e38796d8dd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:41.344720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-545e7c5c-f50f-482c-9bfd-7f4e8166a780 req-ebff6b37-5d7b-4c3f-822f-89e38796d8dd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:41.373335 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-545e7c5c-f50f-482c-9bfd-7f4e8166a780 req-ebff6b37-5d7b-4c3f-822f-89e38796d8dd service nova] Creating event network-vif-plugged:99f1f073-60a1-4593-8a55-07aea05f954b for instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f on n-h2-850468-16 Aug 23 18:23:41.387784 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-545e7c5c-f50f-482c-9bfd-7f4e8166a780 req-ebff6b37-5d7b-4c3f-822f-89e38796d8dd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062308 Aug 23 18:23:41.388704 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3022/5904] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:41.753108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0f4d4e9f-17ae-4c4e-80d8-32a6e7e452d5 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:41.754071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0f4d4e9f-17ae-4c4e-80d8-32a6e7e452d5 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:41.764430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f4d4e9f-17ae-4c4e-80d8-32a6e7e452d5 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:41.765213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f4d4e9f-17ae-4c4e-80d8-32a6e7e452d5 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:41.766058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f4d4e9f-17ae-4c4e-80d8-32a6e7e452d5 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:41.766988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f4d4e9f-17ae-4c4e-80d8-32a6e7e452d5 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:41.767603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f4d4e9f-17ae-4c4e-80d8-32a6e7e452d5 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:41.768220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f4d4e9f-17ae-4c4e-80d8-32a6e7e452d5 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:41.882919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7085153-e6e9-4e8e-a894-a8e4f01dc65d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:41.884155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b7085153-e6e9-4e8e-a894-a8e4f01dc65d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:41.896174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7085153-e6e9-4e8e-a894-a8e4f01dc65d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:41.896761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7085153-e6e9-4e8e-a894-a8e4f01dc65d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:41.897949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7085153-e6e9-4e8e-a894-a8e4f01dc65d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:41.898886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7085153-e6e9-4e8e-a894-a8e4f01dc65d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:41.899511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7085153-e6e9-4e8e-a894-a8e4f01dc65d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:41.900051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7085153-e6e9-4e8e-a894-a8e4f01dc65d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:42.020667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b7085153-e6e9-4e8e-a894-a8e4f01dc65d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:42.042951 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b7085153-e6e9-4e8e-a894-a8e4f01dc65d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1318 microversion: 2.1 time: 0.165568 Aug 23 18:23:42.044222 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3023/5905] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:41 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:42.348671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0f4d4e9f-17ae-4c4e-80d8-32a6e7e452d5 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:42.375981 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0f4d4e9f-17ae-4c4e-80d8-32a6e7e452d5 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1522 microversion: 2.1 time: 0.633463 Aug 23 18:23:42.402022 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2883/5906] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:41 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1522 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:43.068937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c5ce3762-d16f-4708-8525-3dedfbb1b129 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:43.071770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c5ce3762-d16f-4708-8525-3dedfbb1b129 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:43.076403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:43.083837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5ce3762-d16f-4708-8525-3dedfbb1b129 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:43.084510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5ce3762-d16f-4708-8525-3dedfbb1b129 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:43.085228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5ce3762-d16f-4708-8525-3dedfbb1b129 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:43.086153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5ce3762-d16f-4708-8525-3dedfbb1b129 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:43.086846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5ce3762-d16f-4708-8525-3dedfbb1b129 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:43.087609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c5ce3762-d16f-4708-8525-3dedfbb1b129 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:43.270423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c5ce3762-d16f-4708-8525-3dedfbb1b129 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:43.282080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:43.285967 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c5ce3762-d16f-4708-8525-3dedfbb1b129 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1324 microversion: 2.1 time: 0.221502 Aug 23 18:23:43.303128 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3024/5907] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:43 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1324 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:43.411844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ed7b1a3-e53e-47d2-a428-ebc2def53036 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:43.413741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9ed7b1a3-e53e-47d2-a428-ebc2def53036 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:43.435649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ed7b1a3-e53e-47d2-a428-ebc2def53036 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:43.436278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ed7b1a3-e53e-47d2-a428-ebc2def53036 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:43.440917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ed7b1a3-e53e-47d2-a428-ebc2def53036 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:43.441858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ed7b1a3-e53e-47d2-a428-ebc2def53036 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:43.442359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ed7b1a3-e53e-47d2-a428-ebc2def53036 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:43.442891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ed7b1a3-e53e-47d2-a428-ebc2def53036 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:44.121240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dfcd6222-ed83-49ce-acea-ee4fc5f1d2e0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ca524fa1-93e9-429f-b7b2-53305f9dca39"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:44.140373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dfcd6222-ed83-49ce-acea-ee4fc5f1d2e0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:44.192963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfcd6222-ed83-49ce-acea-ee4fc5f1d2e0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:44.193492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfcd6222-ed83-49ce-acea-ee4fc5f1d2e0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:44.195217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfcd6222-ed83-49ce-acea-ee4fc5f1d2e0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:44.196811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfcd6222-ed83-49ce-acea-ee4fc5f1d2e0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:44.197624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfcd6222-ed83-49ce-acea-ee4fc5f1d2e0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:44.198303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfcd6222-ed83-49ce-acea-ee4fc5f1d2e0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:44.345391 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-dfcd6222-ed83-49ce-acea-ee4fc5f1d2e0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Invalid volume: volume ca524fa1-93e9-429f-b7b2-53305f9dca39 is already attached to instances: 454f6367-fca5-4f24-b48e-4c1ea5603c29 Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dfcd6222-ed83-49ce-acea-ee4fc5f1d2e0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments HTTP/1.1 Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 74 Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: {"volumeAttachment": {"volumeId": "ca524fa1-93e9-429f-b7b2-53305f9dca39"}} Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid volume: volume ca524fa1-93e9-429f-b7b2-53305f9dca39 is already attached to instances: 454f6367-fca5-4f24-b48e-4c1ea5603c29 Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'server_id': '454f6367-fca5-4f24-b48e-4c1ea5603c29', 'body': {'volumeAttachment': {'volumeId': 'ca524fa1-93e9-429f-b7b2-53305f9dca39'}}} Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5113, in attach_volume Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4953, in _check_volume_already_attached Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ca524fa1-93e9-429f-b7b2-53305f9dca39 is already attached to instances: 454f6367-fca5-4f24-b48e-4c1ea5603c29 Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:23:44.348583 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ca524fa1-93e9-429f-b7b2-53305f9dca39 is already attached to instances: 454f6367-fca5-4f24-b48e-4c1ea5603c29 Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ca524fa1-93e9-429f-b7b2-53305f9dca39 is already attached to instances: 454f6367-fca5-4f24-b48e-4c1ea5603c29 Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dfcd6222-ed83-49ce-acea-ee4fc5f1d2e0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 400 to user: Invalid volume: volume ca524fa1-93e9-429f-b7b2-53305f9dca39 is already attached to instances: 454f6367-fca5-4f24-b48e-4c1ea5603c29 {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:23:44.353817 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dfcd6222-ed83-49ce-acea-ee4fc5f1d2e0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.236063 Aug 23 18:23:44.367801 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3025/5908] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:23:44 2022] POST /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments => generated 174 bytes in 254 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:23:44.404107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7a26c8a-39b1-4a04-87ab-cf3c045d9696 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:44.405009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b7a26c8a-39b1-4a04-87ab-cf3c045d9696 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:44.422878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7a26c8a-39b1-4a04-87ab-cf3c045d9696 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:44.423790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7a26c8a-39b1-4a04-87ab-cf3c045d9696 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:44.425473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7a26c8a-39b1-4a04-87ab-cf3c045d9696 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:44.426334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7a26c8a-39b1-4a04-87ab-cf3c045d9696 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:44.428143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7a26c8a-39b1-4a04-87ab-cf3c045d9696 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:44.431152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7a26c8a-39b1-4a04-87ab-cf3c045d9696 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:44.646809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b7a26c8a-39b1-4a04-87ab-cf3c045d9696 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:44.660597 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b7a26c8a-39b1-4a04-87ab-cf3c045d9696 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1324 microversion: 2.1 time: 0.288906 Aug 23 18:23:44.670487 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3026/5909] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:44 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1324 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:44.672243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9ed7b1a3-e53e-47d2-a428-ebc2def53036 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:44.684486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1bf6de88-2f69-47ae-8879-815d497661cb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:44.685154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1bf6de88-2f69-47ae-8879-815d497661cb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:44.685920 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9ed7b1a3-e53e-47d2-a428-ebc2def53036 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1522 microversion: 2.1 time: 1.280276 Aug 23 18:23:44.687180 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2884/5910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:43 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1522 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:44.715985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bf6de88-2f69-47ae-8879-815d497661cb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:44.716651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bf6de88-2f69-47ae-8879-815d497661cb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:44.717360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bf6de88-2f69-47ae-8879-815d497661cb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:44.718333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bf6de88-2f69-47ae-8879-815d497661cb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:44.719051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bf6de88-2f69-47ae-8879-815d497661cb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:44.719703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bf6de88-2f69-47ae-8879-815d497661cb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:44.926559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-1bf6de88-2f69-47ae-8879-815d497661cb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lazy-loading 'services' on Instance uuid 454f6367-fca5-4f24-b48e-4c1ea5603c29 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:23:45.150184 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1bf6de88-2f69-47ae-8879-815d497661cb tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments/ca524fa1-93e9-429f-b7b2-53305f9dca39" status: 202 len: 0 microversion: 2.1 time: 0.478158 Aug 23 18:23:45.152433 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3027/5911] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 18:23:44 2022] DELETE /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments/ca524fa1-93e9-429f-b7b2-53305f9dca39 => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:23:45.160995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d120923-27f6-474d-98c2-33e1b8f14909 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:45.163480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d120923-27f6-474d-98c2-33e1b8f14909 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:45.176440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d120923-27f6-474d-98c2-33e1b8f14909 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:45.176943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d120923-27f6-474d-98c2-33e1b8f14909 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:45.177389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d120923-27f6-474d-98c2-33e1b8f14909 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:45.190939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d120923-27f6-474d-98c2-33e1b8f14909 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:45.191569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d120923-27f6-474d-98c2-33e1b8f14909 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:45.192031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d120923-27f6-474d-98c2-33e1b8f14909 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:45.270295 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d120923-27f6-474d-98c2-33e1b8f14909 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113148 Aug 23 18:23:45.271311 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2885/5912] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:23:45 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:45.695123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-52e14f71-1192-41d4-813b-9befc9a22461 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:45.696535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-52e14f71-1192-41d4-813b-9befc9a22461 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:45.712282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a4d88fd7-2ab9-47fa-a4c7-871c7a4d45cd tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:45.714336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a4d88fd7-2ab9-47fa-a4c7-871c7a4d45cd tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:45.725547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4d88fd7-2ab9-47fa-a4c7-871c7a4d45cd tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:45.726878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52e14f71-1192-41d4-813b-9befc9a22461 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:45.726878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52e14f71-1192-41d4-813b-9befc9a22461 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:45.727808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52e14f71-1192-41d4-813b-9befc9a22461 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:45.727989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4d88fd7-2ab9-47fa-a4c7-871c7a4d45cd tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:45.729150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52e14f71-1192-41d4-813b-9befc9a22461 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:45.730672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4d88fd7-2ab9-47fa-a4c7-871c7a4d45cd tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:45.731642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4d88fd7-2ab9-47fa-a4c7-871c7a4d45cd tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:45.732281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4d88fd7-2ab9-47fa-a4c7-871c7a4d45cd tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:45.732880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4d88fd7-2ab9-47fa-a4c7-871c7a4d45cd tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:45.734790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52e14f71-1192-41d4-813b-9befc9a22461 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:45.736171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52e14f71-1192-41d4-813b-9befc9a22461 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:46.114472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-52e14f71-1192-41d4-813b-9befc9a22461 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:46.126521 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-52e14f71-1192-41d4-813b-9befc9a22461 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1391 microversion: 2.1 time: 0.438036 Aug 23 18:23:46.127149 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3028/5913] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:45 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1391 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:46.283271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e409ac87-224b-48c2-8f29-84d8b2f96296 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:46.285682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e409ac87-224b-48c2-8f29-84d8b2f96296 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:46.295932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e409ac87-224b-48c2-8f29-84d8b2f96296 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:46.296596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e409ac87-224b-48c2-8f29-84d8b2f96296 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:46.298127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e409ac87-224b-48c2-8f29-84d8b2f96296 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:46.299064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e409ac87-224b-48c2-8f29-84d8b2f96296 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:46.299686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e409ac87-224b-48c2-8f29-84d8b2f96296 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:46.300279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e409ac87-224b-48c2-8f29-84d8b2f96296 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:46.371628 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e409ac87-224b-48c2-8f29-84d8b2f96296 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092377 Aug 23 18:23:46.384453 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3029/5914] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:23:46 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:23:47.033054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a4d88fd7-2ab9-47fa-a4c7-871c7a4d45cd tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:47.043311 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a4d88fd7-2ab9-47fa-a4c7-871c7a4d45cd tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1507 microversion: 2.1 time: 1.334749 Aug 23 18:23:47.046559 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2886/5915] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:45 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1507 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:47.070004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-05377ee1-b8a8-44ee-bb53-b08f47a4be42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:47.070659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-05377ee1-b8a8-44ee-bb53-b08f47a4be42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:47.084114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05377ee1-b8a8-44ee-bb53-b08f47a4be42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:47.084609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05377ee1-b8a8-44ee-bb53-b08f47a4be42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:47.085048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05377ee1-b8a8-44ee-bb53-b08f47a4be42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:47.087658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05377ee1-b8a8-44ee-bb53-b08f47a4be42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:47.091293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05377ee1-b8a8-44ee-bb53-b08f47a4be42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:47.092687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05377ee1-b8a8-44ee-bb53-b08f47a4be42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:47.151159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77070e9f-9c10-4268-ba3b-ca4d5d755c40 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:47.151695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-77070e9f-9c10-4268-ba3b-ca4d5d755c40 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:47.169136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77070e9f-9c10-4268-ba3b-ca4d5d755c40 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:47.169638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77070e9f-9c10-4268-ba3b-ca4d5d755c40 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:47.172292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77070e9f-9c10-4268-ba3b-ca4d5d755c40 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:47.176995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77070e9f-9c10-4268-ba3b-ca4d5d755c40 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:47.178186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77070e9f-9c10-4268-ba3b-ca4d5d755c40 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:47.186610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77070e9f-9c10-4268-ba3b-ca4d5d755c40 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:47.508523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-05377ee1-b8a8-44ee-bb53-b08f47a4be42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:47.521734 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-05377ee1-b8a8-44ee-bb53-b08f47a4be42 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 200 len: 1507 microversion: 2.1 time: 0.456115 Aug 23 18:23:47.523318 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3030/5916] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:47 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 1507 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:47.531516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-06f75cea-3d9c-41ca-a81b-5b7b3644cff6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:47.534940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-06f75cea-3d9c-41ca-a81b-5b7b3644cff6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:47.550139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06f75cea-3d9c-41ca-a81b-5b7b3644cff6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:47.550690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06f75cea-3d9c-41ca-a81b-5b7b3644cff6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:47.551151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06f75cea-3d9c-41ca-a81b-5b7b3644cff6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:47.553131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06f75cea-3d9c-41ca-a81b-5b7b3644cff6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:47.553964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06f75cea-3d9c-41ca-a81b-5b7b3644cff6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:47.554610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06f75cea-3d9c-41ca-a81b-5b7b3644cff6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:47.605475 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-06f75cea-3d9c-41ca-a81b-5b7b3644cff6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080489 Aug 23 18:23:47.606840 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3031/5917] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:23:47 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:47.612383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-86d941c3-36b6-40ad-a1ca-4478ec4dd893 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:47.613143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-86d941c3-36b6-40ad-a1ca-4478ec4dd893 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:47.625420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86d941c3-36b6-40ad-a1ca-4478ec4dd893 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:47.626410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86d941c3-36b6-40ad-a1ca-4478ec4dd893 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:47.627402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86d941c3-36b6-40ad-a1ca-4478ec4dd893 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:47.629166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86d941c3-36b6-40ad-a1ca-4478ec4dd893 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:47.629990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86d941c3-36b6-40ad-a1ca-4478ec4dd893 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:47.630804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-86d941c3-36b6-40ad-a1ca-4478ec4dd893 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:47.679378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-86d941c3-36b6-40ad-a1ca-4478ec4dd893 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:23:47.786862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-77070e9f-9c10-4268-ba3b-ca4d5d755c40 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:47.796870 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-86d941c3-36b6-40ad-a1ca-4478ec4dd893 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 204 len: 0 microversion: 2.1 time: 0.188181 Aug 23 18:23:47.799909 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-77070e9f-9c10-4268-ba3b-ca4d5d755c40 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1391 microversion: 2.1 time: 0.653577 Aug 23 18:23:47.800903 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2887/5919] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:47 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1391 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:47.801766 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3032/5919] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:23:47 2022] DELETE /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:23:47.826219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5cf94a69-1d80-433b-872f-4f030a8bddde tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] Calling method '.version_select at 0x7f27df675040>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:47.872020 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5cf94a69-1d80-433b-872f-4f030a8bddde tempest-TestSecurityGroupsBasicOps-681698998 tempest-TestSecurityGroupsBasicOps-681698998-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2089254089" status: 202 len: 0 microversion: 2.1 time: 0.050107 Aug 23 18:23:47.873185 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2888/5920] 10.222.0.61 () {58 vars in 1278 bytes} [Tue Aug 23 18:23:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-2089254089 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:23:47.980394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1612941257", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "68ce5121-678b-4517-ba2c-957ca7c12ee0"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:48.062075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] validate_networks() for [('68ce5121-678b-4517-ba2c-957ca7c12ee0', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:23:48.617787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-54f482c9-a4e1-4934-88d1-496dd884cc8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:48.620949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-54f482c9-a4e1-4934-88d1-496dd884cc8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:48.639557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54f482c9-a4e1-4934-88d1-496dd884cc8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:48.641953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54f482c9-a4e1-4934-88d1-496dd884cc8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:48.644759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54f482c9-a4e1-4934-88d1-496dd884cc8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:48.645735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54f482c9-a4e1-4934-88d1-496dd884cc8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:48.647733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54f482c9-a4e1-4934-88d1-496dd884cc8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:48.648383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54f482c9-a4e1-4934-88d1-496dd884cc8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:48.719430 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-54f482c9-a4e1-4934-88d1-496dd884cc8e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.103021 Aug 23 18:23:48.720634 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2889/5921] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:23:48 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments => generated 197 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:23:48.826298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-9a66fe51-05d0-442f-8fe7-5c334321a34f req-05dabf93-2000-4be8-9f00-7a25dbf399e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "182272d5-4238-47d7-917f-f604b24bd05f", "tag": "096e329a-9de7-409c-8a71-48b0df191e5b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:48.845613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9a66fe51-05d0-442f-8fe7-5c334321a34f req-05dabf93-2000-4be8-9f00-7a25dbf399e3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:48.846405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9a66fe51-05d0-442f-8fe7-5c334321a34f req-05dabf93-2000-4be8-9f00-7a25dbf399e3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:48.847256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9a66fe51-05d0-442f-8fe7-5c334321a34f req-05dabf93-2000-4be8-9f00-7a25dbf399e3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:48.864721 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-9a66fe51-05d0-442f-8fe7-5c334321a34f req-05dabf93-2000-4be8-9f00-7a25dbf399e3 service nova] Creating event network-changed:096e329a-9de7-409c-8a71-48b0df191e5b for instance 182272d5-4238-47d7-917f-f604b24bd05f on n-h2-850468-16 Aug 23 18:23:48.872910 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-9a66fe51-05d0-442f-8fe7-5c334321a34f req-05dabf93-2000-4be8-9f00-7a25dbf399e3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051786 Aug 23 18:23:48.874240 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2890/5922] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:48.881140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6899b9f9-ddf1-4c13-8f2a-a379615fe5a7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:48.882213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6899b9f9-ddf1-4c13-8f2a-a379615fe5a7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:48.904056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6899b9f9-ddf1-4c13-8f2a-a379615fe5a7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:48.904380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:23:48.904936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:23:48.905363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:23:48.905672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6899b9f9-ddf1-4c13-8f2a-a379615fe5a7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:48.906298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6899b9f9-ddf1-4c13-8f2a-a379615fe5a7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:48.906426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:23:48.906900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:23:48.907625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6899b9f9-ddf1-4c13-8f2a-a379615fe5a7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:48.908264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6899b9f9-ddf1-4c13-8f2a-a379615fe5a7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:48.908890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6899b9f9-ddf1-4c13-8f2a-a379615fe5a7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:48.927498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:48.928152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:48.929857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:48.932748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:48.936960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:48.937841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:48.982084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Getting quotas for project 41f4e8e13960468dbdaf601e0141db0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:23:48.991894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Getting quotas for user d175596a3d804183b2388a25ab9a1018 and project 41f4e8e13960468dbdaf601e0141db0c. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:23:49.026733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:23:49.035975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:23:49.161044 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e6fbf131-b9c6-4e52-b762-8626d85759fb tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.185118 Aug 23 18:23:49.164416 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3033/5923] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:23:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1189 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:23:49.179970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-590f886e-19be-4143-a1f4-0221f921ddaa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:49.182643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-590f886e-19be-4143-a1f4-0221f921ddaa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:49.487177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-590f886e-19be-4143-a1f4-0221f921ddaa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:49.488825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6899b9f9-ddf1-4c13-8f2a-a379615fe5a7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:49.498812 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-590f886e-19be-4143-a1f4-0221f921ddaa tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1218 microversion: 2.1 time: 0.325664 Aug 23 18:23:49.503168 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6899b9f9-ddf1-4c13-8f2a-a379615fe5a7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1391 microversion: 2.1 time: 0.627417 Aug 23 18:23:49.504283 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3034/5924] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:49 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1218 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:49.505677 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2891/5925] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:48 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1391 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:49.736403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-21259b12-273b-4a70-8bef-6c0860da42ce tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:49.739749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-21259b12-273b-4a70-8bef-6c0860da42ce tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:49.757615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21259b12-273b-4a70-8bef-6c0860da42ce tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:49.758358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21259b12-273b-4a70-8bef-6c0860da42ce tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:49.760863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21259b12-273b-4a70-8bef-6c0860da42ce tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:49.761974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21259b12-273b-4a70-8bef-6c0860da42ce tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:49.764077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21259b12-273b-4a70-8bef-6c0860da42ce tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:49.765016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21259b12-273b-4a70-8bef-6c0860da42ce tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:49.849690 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-21259b12-273b-4a70-8bef-6c0860da42ce tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120959 Aug 23 18:23:49.853917 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3035/5926] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:23:49 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments => generated 197 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:50.519736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6c98ad30-0f16-46ac-a056-f2043198ebc4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:50.520998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6c98ad30-0f16-46ac-a056-f2043198ebc4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:50.523851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:50.529922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-253eb9af-3e89-4366-9b5e-0602eabb04d7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:50.530575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-253eb9af-3e89-4366-9b5e-0602eabb04d7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:50.539396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c98ad30-0f16-46ac-a056-f2043198ebc4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:50.539884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c98ad30-0f16-46ac-a056-f2043198ebc4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:50.540502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c98ad30-0f16-46ac-a056-f2043198ebc4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:50.541406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c98ad30-0f16-46ac-a056-f2043198ebc4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:50.542145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c98ad30-0f16-46ac-a056-f2043198ebc4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:50.542760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c98ad30-0f16-46ac-a056-f2043198ebc4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:50.543916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-253eb9af-3e89-4366-9b5e-0602eabb04d7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:50.544420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-253eb9af-3e89-4366-9b5e-0602eabb04d7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:50.544870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-253eb9af-3e89-4366-9b5e-0602eabb04d7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:50.548953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-253eb9af-3e89-4366-9b5e-0602eabb04d7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:50.551019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-253eb9af-3e89-4366-9b5e-0602eabb04d7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:50.552853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-253eb9af-3e89-4366-9b5e-0602eabb04d7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:50.646405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6c98ad30-0f16-46ac-a056-f2043198ebc4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:50.651118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:50.664990 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6c98ad30-0f16-46ac-a056-f2043198ebc4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1270 microversion: 2.1 time: 0.148951 Aug 23 18:23:50.666673 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2892/5927] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:50 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:50.865677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-85fd9102-de01-4b92-8236-56c023c33ab1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:50.868129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-85fd9102-de01-4b92-8236-56c023c33ab1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:50.877894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:50.886941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-85fd9102-de01-4b92-8236-56c023c33ab1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:50.887302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-85fd9102-de01-4b92-8236-56c023c33ab1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:50.887741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-85fd9102-de01-4b92-8236-56c023c33ab1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:50.889042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-85fd9102-de01-4b92-8236-56c023c33ab1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:50.889042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-85fd9102-de01-4b92-8236-56c023c33ab1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:50.889343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-85fd9102-de01-4b92-8236-56c023c33ab1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:50.944198 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-85fd9102-de01-4b92-8236-56c023c33ab1 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082601 Aug 23 18:23:50.945392 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2893/5928] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:23:50 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:23:50.953462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1d7a6121-4f1c-4c26-b9ba-77daee8fa9ec req-ff22ff7a-62d0-4dbb-a5d3-c5b175b7fb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134e2d84-3f0f-4f9f-b4d7-536f87817862", "tag": "d1239621-cfc1-4ef0-b26e-40a6e6e24d16"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:50.966598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1d7a6121-4f1c-4c26-b9ba-77daee8fa9ec req-ff22ff7a-62d0-4dbb-a5d3-c5b175b7fb79 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:50.967710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1d7a6121-4f1c-4c26-b9ba-77daee8fa9ec req-ff22ff7a-62d0-4dbb-a5d3-c5b175b7fb79 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:50.968596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1d7a6121-4f1c-4c26-b9ba-77daee8fa9ec req-ff22ff7a-62d0-4dbb-a5d3-c5b175b7fb79 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:50.985497 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1d7a6121-4f1c-4c26-b9ba-77daee8fa9ec req-ff22ff7a-62d0-4dbb-a5d3-c5b175b7fb79 service nova] Creating event network-changed:d1239621-cfc1-4ef0-b26e-40a6e6e24d16 for instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 on n-h1-850468-16 Aug 23 18:23:50.991311 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1d7a6121-4f1c-4c26-b9ba-77daee8fa9ec req-ff22ff7a-62d0-4dbb-a5d3-c5b175b7fb79 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044608 Aug 23 18:23:50.991944 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2894/5929] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:51.041058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-253eb9af-3e89-4366-9b5e-0602eabb04d7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:51.049243 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-253eb9af-3e89-4366-9b5e-0602eabb04d7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1391 microversion: 2.1 time: 0.525003 Aug 23 18:23:51.050474 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3036/5930] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:50 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1391 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:51.379517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4f9a9a61-5788-4a83-b100-224f29264297 req-2aa2acf7-9489-4bf8-bf54-88289bbc31cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e967f401-d352-4b31-8c5a-0f03fa0a9d3f", "name": "network-vif-deleted", "tag": "99f1f073-60a1-4593-8a55-07aea05f954b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:51.391860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4f9a9a61-5788-4a83-b100-224f29264297 req-2aa2acf7-9489-4bf8-bf54-88289bbc31cd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:51.392610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4f9a9a61-5788-4a83-b100-224f29264297 req-2aa2acf7-9489-4bf8-bf54-88289bbc31cd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:51.393079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4f9a9a61-5788-4a83-b100-224f29264297 req-2aa2acf7-9489-4bf8-bf54-88289bbc31cd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:51.445431 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4f9a9a61-5788-4a83-b100-224f29264297 req-2aa2acf7-9489-4bf8-bf54-88289bbc31cd service nova] Creating event network-vif-deleted:99f1f073-60a1-4593-8a55-07aea05f954b for instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f on n-h2-850468-16 Aug 23 18:23:51.461326 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4f9a9a61-5788-4a83-b100-224f29264297 req-2aa2acf7-9489-4bf8-bf54-88289bbc31cd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086308 Aug 23 18:23:51.464483 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2895/5931] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:51.693605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4b019622-1cfd-49a3-8ccf-e856a264febf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:51.694238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4b019622-1cfd-49a3-8ccf-e856a264febf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:51.705025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b019622-1cfd-49a3-8ccf-e856a264febf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:51.706988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b019622-1cfd-49a3-8ccf-e856a264febf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:51.707691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b019622-1cfd-49a3-8ccf-e856a264febf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:51.709424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b019622-1cfd-49a3-8ccf-e856a264febf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:51.710682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b019622-1cfd-49a3-8ccf-e856a264febf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:51.711623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b019622-1cfd-49a3-8ccf-e856a264febf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:51.826440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b019622-1cfd-49a3-8ccf-e856a264febf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:51.838959 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4b019622-1cfd-49a3-8ccf-e856a264febf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1270 microversion: 2.1 time: 0.154091 Aug 23 18:23:51.838959 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3037/5932] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:51 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:51.957677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-75df7a36-7ecf-4ba6-8a62-f8646258aa88 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:51.960119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-75df7a36-7ecf-4ba6-8a62-f8646258aa88 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:51.976455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75df7a36-7ecf-4ba6-8a62-f8646258aa88 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:51.977027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75df7a36-7ecf-4ba6-8a62-f8646258aa88 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:51.977531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75df7a36-7ecf-4ba6-8a62-f8646258aa88 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:51.978387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75df7a36-7ecf-4ba6-8a62-f8646258aa88 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:51.983280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75df7a36-7ecf-4ba6-8a62-f8646258aa88 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:51.984053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-75df7a36-7ecf-4ba6-8a62-f8646258aa88 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:52.044520 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-75df7a36-7ecf-4ba6-8a62-f8646258aa88 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091932 Aug 23 18:23:52.055113 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2896/5933] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:23:51 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:52.078075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-389d0d1d-7c4e-4edf-97d5-1bc467616167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:52.079274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-389d0d1d-7c4e-4edf-97d5-1bc467616167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:52.097886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-389d0d1d-7c4e-4edf-97d5-1bc467616167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:52.098828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-389d0d1d-7c4e-4edf-97d5-1bc467616167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:52.099635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-389d0d1d-7c4e-4edf-97d5-1bc467616167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:52.102928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-389d0d1d-7c4e-4edf-97d5-1bc467616167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:52.104615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-389d0d1d-7c4e-4edf-97d5-1bc467616167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:52.106732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-389d0d1d-7c4e-4edf-97d5-1bc467616167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:52.286139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-389d0d1d-7c4e-4edf-97d5-1bc467616167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:52.296160 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-389d0d1d-7c4e-4edf-97d5-1bc467616167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1391 microversion: 2.1 time: 0.220805 Aug 23 18:23:52.297252 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3038/5934] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:52 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:52.861995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a1750fd8-3e55-4da7-9735-cd88e75d7da6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:52.862579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a1750fd8-3e55-4da7-9735-cd88e75d7da6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:52.870029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1750fd8-3e55-4da7-9735-cd88e75d7da6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:52.870628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1750fd8-3e55-4da7-9735-cd88e75d7da6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:52.871194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1750fd8-3e55-4da7-9735-cd88e75d7da6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:52.871930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1750fd8-3e55-4da7-9735-cd88e75d7da6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:52.872395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1750fd8-3e55-4da7-9735-cd88e75d7da6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:52.872825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1750fd8-3e55-4da7-9735-cd88e75d7da6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:52.999686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a1750fd8-3e55-4da7-9735-cd88e75d7da6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:53.013065 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a1750fd8-3e55-4da7-9735-cd88e75d7da6 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1270 microversion: 2.1 time: 0.155333 Aug 23 18:23:53.014252 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2897/5935] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:52 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1270 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:53.060449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-becc0db4-79c8-44f4-b357-14408bbb4707 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:53.063640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-becc0db4-79c8-44f4-b357-14408bbb4707 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:53.075553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-becc0db4-79c8-44f4-b357-14408bbb4707 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:53.076466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-becc0db4-79c8-44f4-b357-14408bbb4707 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:53.077114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-becc0db4-79c8-44f4-b357-14408bbb4707 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:53.078149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-becc0db4-79c8-44f4-b357-14408bbb4707 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:53.078857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-becc0db4-79c8-44f4-b357-14408bbb4707 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:53.079462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-becc0db4-79c8-44f4-b357-14408bbb4707 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:53.122627 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-becc0db4-79c8-44f4-b357-14408bbb4707 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069647 Aug 23 18:23:53.130470 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3039/5936] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:23:53 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:23:53.209819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d45161be-da4e-4e75-aec0-ee2667eba937 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:53.210489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d45161be-da4e-4e75-aec0-ee2667eba937 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:53.218326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d45161be-da4e-4e75-aec0-ee2667eba937 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:53.218864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d45161be-da4e-4e75-aec0-ee2667eba937 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:53.219299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d45161be-da4e-4e75-aec0-ee2667eba937 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:53.220207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d45161be-da4e-4e75-aec0-ee2667eba937 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:53.221561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d45161be-da4e-4e75-aec0-ee2667eba937 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:53.223057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d45161be-da4e-4e75-aec0-ee2667eba937 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:53.252837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d45161be-da4e-4e75-aec0-ee2667eba937 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:23:53.317235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-884d199a-9b4b-4bb7-a6c0-873ddf0c1016 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:53.318263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-884d199a-9b4b-4bb7-a6c0-873ddf0c1016 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:53.325878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884d199a-9b4b-4bb7-a6c0-873ddf0c1016 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:53.327076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884d199a-9b4b-4bb7-a6c0-873ddf0c1016 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:53.327543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884d199a-9b4b-4bb7-a6c0-873ddf0c1016 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:53.328269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884d199a-9b4b-4bb7-a6c0-873ddf0c1016 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:53.328919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884d199a-9b4b-4bb7-a6c0-873ddf0c1016 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:53.329385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884d199a-9b4b-4bb7-a6c0-873ddf0c1016 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:53.348001 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d45161be-da4e-4e75-aec0-ee2667eba937 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 204 len: 0 microversion: 2.1 time: 0.142066 Aug 23 18:23:53.349067 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2898/5937] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:23:53 2022] DELETE /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:23:53.361413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9f6d870c-3c50-4086-944f-3396d3580f9e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:53.362252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9f6d870c-3c50-4086-944f-3396d3580f9e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:53.371673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f6d870c-3c50-4086-944f-3396d3580f9e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:53.372167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f6d870c-3c50-4086-944f-3396d3580f9e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:53.372628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f6d870c-3c50-4086-944f-3396d3580f9e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:53.373618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f6d870c-3c50-4086-944f-3396d3580f9e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:53.374076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f6d870c-3c50-4086-944f-3396d3580f9e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:53.374516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f6d870c-3c50-4086-944f-3396d3580f9e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:53.492868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-884d199a-9b4b-4bb7-a6c0-873ddf0c1016 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:53.496090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:53.504557 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-884d199a-9b4b-4bb7-a6c0-873ddf0c1016 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1391 microversion: 2.1 time: 0.191247 Aug 23 18:23:53.505310 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3040/5938] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:53 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1391 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:23:53.818376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9f6d870c-3c50-4086-944f-3396d3580f9e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:53.833642 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9f6d870c-3c50-4086-944f-3396d3580f9e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1681 microversion: 2.1 time: 0.477689 Aug 23 18:23:53.835194 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2899/5939] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:53 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1681 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:54.035637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b3c57dfb-cd84-42c5-ab2f-cf834b2ae934 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:54.037496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b3c57dfb-cd84-42c5-ab2f-cf834b2ae934 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:54.045935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3c57dfb-cd84-42c5-ab2f-cf834b2ae934 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:54.046663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3c57dfb-cd84-42c5-ab2f-cf834b2ae934 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:54.047220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3c57dfb-cd84-42c5-ab2f-cf834b2ae934 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:54.048017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3c57dfb-cd84-42c5-ab2f-cf834b2ae934 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:54.048710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3c57dfb-cd84-42c5-ab2f-cf834b2ae934 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:54.049369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3c57dfb-cd84-42c5-ab2f-cf834b2ae934 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:54.131999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b3c57dfb-cd84-42c5-ab2f-cf834b2ae934 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:54.145074 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b3c57dfb-cd84-42c5-ab2f-cf834b2ae934 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1276 microversion: 2.1 time: 0.113366 Aug 23 18:23:54.146756 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3041/5940] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:54 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1276 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:54.529493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f840ecc8-e48d-4f4e-8864-e4393d6e383b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:54.530228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f840ecc8-e48d-4f4e-8864-e4393d6e383b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:54.550186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f840ecc8-e48d-4f4e-8864-e4393d6e383b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:54.550730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f840ecc8-e48d-4f4e-8864-e4393d6e383b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:54.551185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f840ecc8-e48d-4f4e-8864-e4393d6e383b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:54.551918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f840ecc8-e48d-4f4e-8864-e4393d6e383b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:54.552401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f840ecc8-e48d-4f4e-8864-e4393d6e383b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:54.552819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f840ecc8-e48d-4f4e-8864-e4393d6e383b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:54.826276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f840ecc8-e48d-4f4e-8864-e4393d6e383b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:54.841390 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f840ecc8-e48d-4f4e-8864-e4393d6e383b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1391 microversion: 2.1 time: 0.318703 Aug 23 18:23:54.842343 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2900/5941] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:54 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1391 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:54.862358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adb27917-d72f-4816-a049-9762e5d25800 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:54.863450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-adb27917-d72f-4816-a049-9762e5d25800 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:54.871239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adb27917-d72f-4816-a049-9762e5d25800 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:54.872044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adb27917-d72f-4816-a049-9762e5d25800 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:54.872753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adb27917-d72f-4816-a049-9762e5d25800 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:54.874236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adb27917-d72f-4816-a049-9762e5d25800 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:54.874971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adb27917-d72f-4816-a049-9762e5d25800 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:54.877871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adb27917-d72f-4816-a049-9762e5d25800 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:55.093292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-adb27917-d72f-4816-a049-9762e5d25800 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:55.104322 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-adb27917-d72f-4816-a049-9762e5d25800 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1681 microversion: 2.1 time: 0.245453 Aug 23 18:23:55.107112 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3042/5942] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:54 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1681 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:55.168401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e9b58305-0187-4266-81e4-3fe7bc4acd4e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:55.169258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e9b58305-0187-4266-81e4-3fe7bc4acd4e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:55.176544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9b58305-0187-4266-81e4-3fe7bc4acd4e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:55.177437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9b58305-0187-4266-81e4-3fe7bc4acd4e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:55.178223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9b58305-0187-4266-81e4-3fe7bc4acd4e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:55.179129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9b58305-0187-4266-81e4-3fe7bc4acd4e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:55.179737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9b58305-0187-4266-81e4-3fe7bc4acd4e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:55.180339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9b58305-0187-4266-81e4-3fe7bc4acd4e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:55.433963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e9b58305-0187-4266-81e4-3fe7bc4acd4e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:55.449230 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e9b58305-0187-4266-81e4-3fe7bc4acd4e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1318 microversion: 2.1 time: 0.285182 Aug 23 18:23:55.450220 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2901/5943] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:55 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:55.525626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-10f7a774-e9bc-42bf-a298-7ebea278d3e2 req-19817227-8a86-44af-ba98-61aa8e19d6d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134e2d84-3f0f-4f9f-b4d7-536f87817862", "name": "network-vif-plugged", "status": "completed", "tag": "d1239621-cfc1-4ef0-b26e-40a6e6e24d16"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:55.534365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ed464d40-6de4-425a-a370-94a0f00307bb req-621d08d8-e040-40fc-a9c0-00117d0a19fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "835aa76d-65de-4f7e-9a2b-bac88860c1eb", "tag": "85ac0ffe-4e1c-4d56-826b-f91a096ab14e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:55.554207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-10f7a774-e9bc-42bf-a298-7ebea278d3e2 req-19817227-8a86-44af-ba98-61aa8e19d6d8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:55.554939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed464d40-6de4-425a-a370-94a0f00307bb req-621d08d8-e040-40fc-a9c0-00117d0a19fc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:55.555223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-10f7a774-e9bc-42bf-a298-7ebea278d3e2 req-19817227-8a86-44af-ba98-61aa8e19d6d8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:55.556058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-10f7a774-e9bc-42bf-a298-7ebea278d3e2 req-19817227-8a86-44af-ba98-61aa8e19d6d8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:55.557505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed464d40-6de4-425a-a370-94a0f00307bb req-621d08d8-e040-40fc-a9c0-00117d0a19fc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:55.558980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed464d40-6de4-425a-a370-94a0f00307bb req-621d08d8-e040-40fc-a9c0-00117d0a19fc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:55.585572 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ed464d40-6de4-425a-a370-94a0f00307bb req-621d08d8-e040-40fc-a9c0-00117d0a19fc service nova] Creating event network-changed:85ac0ffe-4e1c-4d56-826b-f91a096ab14e for instance 835aa76d-65de-4f7e-9a2b-bac88860c1eb on n-h1-850468-16 Aug 23 18:23:55.588387 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-10f7a774-e9bc-42bf-a298-7ebea278d3e2 req-19817227-8a86-44af-ba98-61aa8e19d6d8 service nova] Creating event network-vif-plugged:d1239621-cfc1-4ef0-b26e-40a6e6e24d16 for instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 on n-h1-850468-16 Aug 23 18:23:55.600732 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ed464d40-6de4-425a-a370-94a0f00307bb req-621d08d8-e040-40fc-a9c0-00117d0a19fc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070760 Aug 23 18:23:55.601303 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-10f7a774-e9bc-42bf-a298-7ebea278d3e2 req-19817227-8a86-44af-ba98-61aa8e19d6d8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077905 Aug 23 18:23:55.601447 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2902/5944] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:23:55.613025 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3043/5945] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:55.871447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e5d4857a-d007-4a64-a69a-399fe0b91209 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:55.873750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e5d4857a-d007-4a64-a69a-399fe0b91209 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:55.886513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5d4857a-d007-4a64-a69a-399fe0b91209 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:55.887035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5d4857a-d007-4a64-a69a-399fe0b91209 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:55.887475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5d4857a-d007-4a64-a69a-399fe0b91209 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:55.888194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5d4857a-d007-4a64-a69a-399fe0b91209 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:55.901276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5d4857a-d007-4a64-a69a-399fe0b91209 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:55.901996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5d4857a-d007-4a64-a69a-399fe0b91209 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:56.131027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9cd74dfb-d71a-4e8b-b66f-136b69934f93 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:56.131742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9cd74dfb-d71a-4e8b-b66f-136b69934f93 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:56.143491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cd74dfb-d71a-4e8b-b66f-136b69934f93 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:56.143988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cd74dfb-d71a-4e8b-b66f-136b69934f93 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:56.144444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cd74dfb-d71a-4e8b-b66f-136b69934f93 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:56.145142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cd74dfb-d71a-4e8b-b66f-136b69934f93 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:56.145598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cd74dfb-d71a-4e8b-b66f-136b69934f93 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:56.146021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cd74dfb-d71a-4e8b-b66f-136b69934f93 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:56.232960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5d4857a-d007-4a64-a69a-399fe0b91209 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:56.243448 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e5d4857a-d007-4a64-a69a-399fe0b91209 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1391 microversion: 2.1 time: 0.382179 Aug 23 18:23:56.245597 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2903/5946] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:55 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1391 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:56.470499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66b78e0b-741b-42ba-9cc0-dae85d3835ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:56.471411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66b78e0b-741b-42ba-9cc0-dae85d3835ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:56.484291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66b78e0b-741b-42ba-9cc0-dae85d3835ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:56.484795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66b78e0b-741b-42ba-9cc0-dae85d3835ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:56.485294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66b78e0b-741b-42ba-9cc0-dae85d3835ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:56.485940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66b78e0b-741b-42ba-9cc0-dae85d3835ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:56.486393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66b78e0b-741b-42ba-9cc0-dae85d3835ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:56.486851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66b78e0b-741b-42ba-9cc0-dae85d3835ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:56.754850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9cd74dfb-d71a-4e8b-b66f-136b69934f93 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:56.771622 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9cd74dfb-d71a-4e8b-b66f-136b69934f93 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1681 microversion: 2.1 time: 0.645910 Aug 23 18:23:56.772625 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3044/5947] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:56 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1681 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:56.809358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66b78e0b-741b-42ba-9cc0-dae85d3835ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:56.824196 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66b78e0b-741b-42ba-9cc0-dae85d3835ef tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1318 microversion: 2.1 time: 0.357496 Aug 23 18:23:56.828194 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2904/5948] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:56 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1318 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:57.267245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a2d714dc-91ea-41b9-8158-4a8afb3ea163 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:57.268094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a2d714dc-91ea-41b9-8158-4a8afb3ea163 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:57.274529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2d714dc-91ea-41b9-8158-4a8afb3ea163 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:57.275675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2d714dc-91ea-41b9-8158-4a8afb3ea163 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:57.276316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2d714dc-91ea-41b9-8158-4a8afb3ea163 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:57.277451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2d714dc-91ea-41b9-8158-4a8afb3ea163 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:57.280222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2d714dc-91ea-41b9-8158-4a8afb3ea163 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:57.280872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2d714dc-91ea-41b9-8158-4a8afb3ea163 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:57.676799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a2d714dc-91ea-41b9-8158-4a8afb3ea163 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:57.689848 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a2d714dc-91ea-41b9-8158-4a8afb3ea163 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1391 microversion: 2.1 time: 0.426724 Aug 23 18:23:57.690979 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3045/5949] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:57 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1391 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:57.785442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-172dc40b-7e74-42ee-b2c2-d4956919e652 req-ac2ada18-3f22-40de-93d4-0838fea1cdd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "454f6367-fca5-4f24-b48e-4c1ea5603c29", "name": "network-vif-deleted", "tag": "1c075ec6-d5ef-40f7-adc0-9c451365ccf9"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:23:57.796531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a45ec021-bfcd-4272-b12b-358a0d3515cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:57.797586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a45ec021-bfcd-4272-b12b-358a0d3515cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:57.808135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a45ec021-bfcd-4272-b12b-358a0d3515cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:57.809140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-172dc40b-7e74-42ee-b2c2-d4956919e652 req-ac2ada18-3f22-40de-93d4-0838fea1cdd6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:57.809433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a45ec021-bfcd-4272-b12b-358a0d3515cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:57.809623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-172dc40b-7e74-42ee-b2c2-d4956919e652 req-ac2ada18-3f22-40de-93d4-0838fea1cdd6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:57.810102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a45ec021-bfcd-4272-b12b-358a0d3515cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:57.811024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a45ec021-bfcd-4272-b12b-358a0d3515cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:57.811688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a45ec021-bfcd-4272-b12b-358a0d3515cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:57.812346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a45ec021-bfcd-4272-b12b-358a0d3515cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:57.812747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-172dc40b-7e74-42ee-b2c2-d4956919e652 req-ac2ada18-3f22-40de-93d4-0838fea1cdd6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:57.839987 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-172dc40b-7e74-42ee-b2c2-d4956919e652 req-ac2ada18-3f22-40de-93d4-0838fea1cdd6 service nova] Creating event network-vif-deleted:1c075ec6-d5ef-40f7-adc0-9c451365ccf9 for instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 on n-h2-850468-16 Aug 23 18:23:57.848274 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-172dc40b-7e74-42ee-b2c2-d4956919e652 req-ac2ada18-3f22-40de-93d4-0838fea1cdd6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066927 Aug 23 18:23:57.849631 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2905/5950] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:23:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:23:57.858249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa363ed0-adf0-409a-abea-7a6ccbb0cb1e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:57.859417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fa363ed0-adf0-409a-abea-7a6ccbb0cb1e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:57.866569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa363ed0-adf0-409a-abea-7a6ccbb0cb1e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:57.867233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa363ed0-adf0-409a-abea-7a6ccbb0cb1e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:57.867855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa363ed0-adf0-409a-abea-7a6ccbb0cb1e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:57.868821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa363ed0-adf0-409a-abea-7a6ccbb0cb1e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:57.870018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa363ed0-adf0-409a-abea-7a6ccbb0cb1e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:57.870775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa363ed0-adf0-409a-abea-7a6ccbb0cb1e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:58.007169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a45ec021-bfcd-4272-b12b-358a0d3515cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:58.015995 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a45ec021-bfcd-4272-b12b-358a0d3515cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 200 len: 1614 microversion: 2.1 time: 0.225861 Aug 23 18:23:58.029122 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3046/5951] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:57 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 1614 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:58.057917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fa363ed0-adf0-409a-abea-7a6ccbb0cb1e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:58.069353 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fa363ed0-adf0-409a-abea-7a6ccbb0cb1e tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1318 microversion: 2.1 time: 0.218060 Aug 23 18:23:58.080200 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2906/5952] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:57 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:58.715010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fc39d98b-797e-4e15-9915-bde7fde48f72 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:58.715909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fc39d98b-797e-4e15-9915-bde7fde48f72 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:58.747240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc39d98b-797e-4e15-9915-bde7fde48f72 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:58.747746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc39d98b-797e-4e15-9915-bde7fde48f72 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:58.748193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc39d98b-797e-4e15-9915-bde7fde48f72 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:58.748924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc39d98b-797e-4e15-9915-bde7fde48f72 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:58.749388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc39d98b-797e-4e15-9915-bde7fde48f72 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:58.749825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc39d98b-797e-4e15-9915-bde7fde48f72 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:58.962626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:23:59.041127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5ff560dc-0c80-47ab-87fc-78c1bcd7b889 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:59.042175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5ff560dc-0c80-47ab-87fc-78c1bcd7b889 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:59.049686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ff560dc-0c80-47ab-87fc-78c1bcd7b889 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:59.050514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ff560dc-0c80-47ab-87fc-78c1bcd7b889 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:59.050975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ff560dc-0c80-47ab-87fc-78c1bcd7b889 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:59.051906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ff560dc-0c80-47ab-87fc-78c1bcd7b889 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:59.052364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ff560dc-0c80-47ab-87fc-78c1bcd7b889 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:59.052951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ff560dc-0c80-47ab-87fc-78c1bcd7b889 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:59.068796 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-5ff560dc-0c80-47ab-87fc-78c1bcd7b889 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:23:59.071195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fc39d98b-797e-4e15-9915-bde7fde48f72 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5ff560dc-0c80-47ab-87fc-78c1bcd7b889 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 HTTP/1.1 Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '454f6367-fca5-4f24-b48e-4c1ea5603c29'} Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:23:59.071484 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:23:59.076840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:23:59.076840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:23:59.076840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:23:59.076840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:23:59.076840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:23:59.076840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:23:59.076840 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:23:59.078329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5ff560dc-0c80-47ab-87fc-78c1bcd7b889 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 404 to user: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:23:59.079414 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5ff560dc-0c80-47ab-87fc-78c1bcd7b889 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 404 len: 111 microversion: 2.1 time: 0.042879 Aug 23 18:23:59.080302 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2907/5953] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:59 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:23:59.088746 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fc39d98b-797e-4e15-9915-bde7fde48f72 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1391 microversion: 2.1 time: 0.378439 Aug 23 18:23:59.098574 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3047/5954] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:58 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1391 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:23:59.098789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1a588fe9-f247-458a-9194-cacd38cb85b3 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '.version_select at 0x7f27df67fca0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:59.105031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7382013a-25a7-474f-b9b9-7ac4c3944281 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:23:59.105677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7382013a-25a7-474f-b9b9-7ac4c3944281 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:23:59.112599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7382013a-25a7-474f-b9b9-7ac4c3944281 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:59.113591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7382013a-25a7-474f-b9b9-7ac4c3944281 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:59.114046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7382013a-25a7-474f-b9b9-7ac4c3944281 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:59.115022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7382013a-25a7-474f-b9b9-7ac4c3944281 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:23:59.115799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7382013a-25a7-474f-b9b9-7ac4c3944281 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:23:59.116396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7382013a-25a7-474f-b9b9-7ac4c3944281 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:23:59.125890 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1a588fe9-f247-458a-9194-cacd38cb85b3 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-564117457" status: 202 len: 0 microversion: 2.1 time: 0.040141 Aug 23 18:23:59.127302 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2908/5955] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Aug 23 18:23:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-564117457 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:23:59.360107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7382013a-25a7-474f-b9b9-7ac4c3944281 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:23:59.375073 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7382013a-25a7-474f-b9b9-7ac4c3944281 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1318 microversion: 2.1 time: 0.284059 Aug 23 18:23:59.376351 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3048/5956] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:23:59 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1318 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:00.111329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c71ab41a-5d8b-4c40-8697-657ab439e201 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:00.112724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c71ab41a-5d8b-4c40-8697-657ab439e201 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:00.124174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c71ab41a-5d8b-4c40-8697-657ab439e201 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:00.125472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c71ab41a-5d8b-4c40-8697-657ab439e201 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:00.127238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c71ab41a-5d8b-4c40-8697-657ab439e201 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:00.128226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c71ab41a-5d8b-4c40-8697-657ab439e201 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:00.129016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c71ab41a-5d8b-4c40-8697-657ab439e201 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:00.130489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c71ab41a-5d8b-4c40-8697-657ab439e201 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:00.401173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-699de306-2b84-4941-bc68-bcfd4be87bca tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:00.404070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-699de306-2b84-4941-bc68-bcfd4be87bca tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:00.408019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:00.414119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-699de306-2b84-4941-bc68-bcfd4be87bca tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:00.415356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-699de306-2b84-4941-bc68-bcfd4be87bca tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:00.416404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-699de306-2b84-4941-bc68-bcfd4be87bca tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:00.417547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-699de306-2b84-4941-bc68-bcfd4be87bca tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:00.418270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-699de306-2b84-4941-bc68-bcfd4be87bca tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:00.419032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-699de306-2b84-4941-bc68-bcfd4be87bca tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:00.512101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c71ab41a-5d8b-4c40-8697-657ab439e201 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:00.521351 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c71ab41a-5d8b-4c40-8697-657ab439e201 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1562 microversion: 2.1 time: 0.413777 Aug 23 18:24:00.537703 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2909/5957] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:00 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1562 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:00.548253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9e10166a-99ca-4a17-85d1-09bd93c04068 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:00.548994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9e10166a-99ca-4a17-85d1-09bd93c04068 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:00.555537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e10166a-99ca-4a17-85d1-09bd93c04068 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:00.556706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e10166a-99ca-4a17-85d1-09bd93c04068 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:00.557336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e10166a-99ca-4a17-85d1-09bd93c04068 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:00.558250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e10166a-99ca-4a17-85d1-09bd93c04068 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:00.558775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e10166a-99ca-4a17-85d1-09bd93c04068 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:00.559204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9e10166a-99ca-4a17-85d1-09bd93c04068 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:00.668930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-699de306-2b84-4941-bc68-bcfd4be87bca tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:00.680193 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-699de306-2b84-4941-bc68-bcfd4be87bca tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1318 microversion: 2.1 time: 0.284601 Aug 23 18:24:00.686279 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3049/5958] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:00 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:00.878242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9e10166a-99ca-4a17-85d1-09bd93c04068 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:00.895913 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9e10166a-99ca-4a17-85d1-09bd93c04068 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1562 microversion: 2.1 time: 0.351907 Aug 23 18:24:00.896871 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2910/5959] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:00 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1562 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:00.914882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5e100104-6682-4c7c-920c-3ff78517ec32 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: .version_select at 0x7f27ec454670>, body: {"keypair": {"name": "tempest-keypair-1173824241", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPl2UWdIclV3dWNWz68AK9hwEVGDqou48lmng2FItiV8mUjLTuv/htI1sHVnMLj0w6kRpa+eExIZNF9KClpUk4R6ojsXSdzzrRp9YAnuM1dtlkob00EAvJ5/8aiGcgNY2Q=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:00.940528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5e100104-6682-4c7c-920c-3ff78517ec32 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:24:00.957332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-5e100104-6682-4c7c-920c-3ff78517ec32 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for user a11d6c5120f24a448c1831ff925409c3 and project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:24:01.008488 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5e100104-6682-4c7c-920c-3ff78517ec32 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.097853 Aug 23 18:24:01.016818 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3050/5960] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:24:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:01.708176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7caf8909-409a-453c-bb1e-da670f6bd181 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:01.708836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7caf8909-409a-453c-bb1e-da670f6bd181 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:01.720733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7caf8909-409a-453c-bb1e-da670f6bd181 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:01.721619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7caf8909-409a-453c-bb1e-da670f6bd181 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:01.722902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7caf8909-409a-453c-bb1e-da670f6bd181 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:01.724601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7caf8909-409a-453c-bb1e-da670f6bd181 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:01.725599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7caf8909-409a-453c-bb1e-da670f6bd181 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:01.726829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7caf8909-409a-453c-bb1e-da670f6bd181 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:02.005157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7caf8909-409a-453c-bb1e-da670f6bd181 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:02.014443 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7caf8909-409a-453c-bb1e-da670f6bd181 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1318 microversion: 2.1 time: 0.310935 Aug 23 18:24:02.015084 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2911/5961] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:01 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1318 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:03.036750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-27819f1d-8566-44e8-aa60-f17fa963f0bc tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:03.037819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-27819f1d-8566-44e8-aa60-f17fa963f0bc tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:03.047462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27819f1d-8566-44e8-aa60-f17fa963f0bc tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:03.048269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27819f1d-8566-44e8-aa60-f17fa963f0bc tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:03.048722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27819f1d-8566-44e8-aa60-f17fa963f0bc tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:03.049458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27819f1d-8566-44e8-aa60-f17fa963f0bc tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:03.050091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27819f1d-8566-44e8-aa60-f17fa963f0bc tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:03.050728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27819f1d-8566-44e8-aa60-f17fa963f0bc tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:03.109116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5f94ff80-ab27-49b9-ac73-acc3cfcc2643 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:03.109748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5f94ff80-ab27-49b9-ac73-acc3cfcc2643 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:03.116738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f94ff80-ab27-49b9-ac73-acc3cfcc2643 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:03.117232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f94ff80-ab27-49b9-ac73-acc3cfcc2643 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:03.117909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f94ff80-ab27-49b9-ac73-acc3cfcc2643 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:03.119217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f94ff80-ab27-49b9-ac73-acc3cfcc2643 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:03.119889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f94ff80-ab27-49b9-ac73-acc3cfcc2643 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:03.120483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f94ff80-ab27-49b9-ac73-acc3cfcc2643 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:03.123714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:03.291803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5f94ff80-ab27-49b9-ac73-acc3cfcc2643 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:03.301554 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5f94ff80-ab27-49b9-ac73-acc3cfcc2643 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1562 microversion: 2.1 time: 0.196277 Aug 23 18:24:03.302426 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2912/5962] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:03 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1562 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:03.308888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f654ba6a-c03c-4786-a7c9-eac4fcab1583 req-76354224-2f7f-41d4-a4d7-cef72f7b3804 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134e2d84-3f0f-4f9f-b4d7-536f87817862", "tag": "d1239621-cfc1-4ef0-b26e-40a6e6e24d16"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:03.319628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f654ba6a-c03c-4786-a7c9-eac4fcab1583 req-76354224-2f7f-41d4-a4d7-cef72f7b3804 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:03.320280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f654ba6a-c03c-4786-a7c9-eac4fcab1583 req-76354224-2f7f-41d4-a4d7-cef72f7b3804 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:03.320887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f654ba6a-c03c-4786-a7c9-eac4fcab1583 req-76354224-2f7f-41d4-a4d7-cef72f7b3804 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:03.338140 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f654ba6a-c03c-4786-a7c9-eac4fcab1583 req-76354224-2f7f-41d4-a4d7-cef72f7b3804 service nova] Creating event network-changed:d1239621-cfc1-4ef0-b26e-40a6e6e24d16 for instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 on n-h1-850468-16 Aug 23 18:24:03.347705 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f654ba6a-c03c-4786-a7c9-eac4fcab1583 req-76354224-2f7f-41d4-a4d7-cef72f7b3804 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043308 Aug 23 18:24:03.348602 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2913/5963] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:03.360996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-e0fd7f9c-a705-4ff7-86a6-40a05aac8100 req-0b4bbdc7-4663-4839-a2d6-0e8e855d3581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835aa76d-65de-4f7e-9a2b-bac88860c1eb", "name": "network-vif-plugged", "status": "completed", "tag": "85ac0ffe-4e1c-4d56-826b-f91a096ab14e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:03.375086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e0fd7f9c-a705-4ff7-86a6-40a05aac8100 req-0b4bbdc7-4663-4839-a2d6-0e8e855d3581 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:03.376717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e0fd7f9c-a705-4ff7-86a6-40a05aac8100 req-0b4bbdc7-4663-4839-a2d6-0e8e855d3581 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:03.377315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-e0fd7f9c-a705-4ff7-86a6-40a05aac8100 req-0b4bbdc7-4663-4839-a2d6-0e8e855d3581 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:03.406711 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-e0fd7f9c-a705-4ff7-86a6-40a05aac8100 req-0b4bbdc7-4663-4839-a2d6-0e8e855d3581 service nova] Creating event network-vif-plugged:85ac0ffe-4e1c-4d56-826b-f91a096ab14e for instance 835aa76d-65de-4f7e-9a2b-bac88860c1eb on n-h1-850468-16 Aug 23 18:24:03.423147 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-e0fd7f9c-a705-4ff7-86a6-40a05aac8100 req-0b4bbdc7-4663-4839-a2d6-0e8e855d3581 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069789 Aug 23 18:24:03.427000 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2914/5964] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:03.427150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-27819f1d-8566-44e8-aa60-f17fa963f0bc tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:03.435760 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-27819f1d-8566-44e8-aa60-f17fa963f0bc tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1318 microversion: 2.1 time: 0.405060 Aug 23 18:24:03.450070 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3051/5965] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:03 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1318 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:04.271609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-282030507", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80f627cf-1c5b-45c1-a064-49e8b550df67"}], "security_groups": [{"name": "tempest-securitygroup--1368899922"}], "key_name": "tempest-keypair-1173824241", "user_data": "}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:04.287892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:04.402650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] validate_networks() for [('80f627cf-1c5b-45c1-a064-49e8b550df67', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:24:04.456898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ded12b86-9b49-4212-b6a7-3d5c46846eb4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:04.457526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ded12b86-9b49-4212-b6a7-3d5c46846eb4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:04.464783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ded12b86-9b49-4212-b6a7-3d5c46846eb4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:04.465278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ded12b86-9b49-4212-b6a7-3d5c46846eb4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:04.465989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ded12b86-9b49-4212-b6a7-3d5c46846eb4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:04.466747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ded12b86-9b49-4212-b6a7-3d5c46846eb4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:04.467208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ded12b86-9b49-4212-b6a7-3d5c46846eb4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:04.467809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ded12b86-9b49-4212-b6a7-3d5c46846eb4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:04.707884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ded12b86-9b49-4212-b6a7-3d5c46846eb4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:04.717544 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ded12b86-9b49-4212-b6a7-3d5c46846eb4 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1318 microversion: 2.1 time: 0.264527 Aug 23 18:24:04.718498 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3052/5966] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:04 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1318 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:24:05.567157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:24:05.567157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:24:05.567766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:24:05.567972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:24:05.568387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:24:05.577656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:05.578146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:05.578612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:05.579376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:05.579833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:05.580261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:05.598637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:24:05.604468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Getting quotas for user a11d6c5120f24a448c1831ff925409c3 and project 4187000f2f8947aaab6603191fe0cb9a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:24:05.617129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:24:05.620132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:24:05.692164 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0421a0c3-54ea-4d9a-bf5f-77bc4fd3439b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.425170 Aug 23 18:24:05.698727 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2915/5967] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:24:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:24:05.703920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7bf17e8f-457b-4038-a603-c02fba4dd4a4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:05.704632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7bf17e8f-457b-4038-a603-c02fba4dd4a4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:05.740443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-564d3d96-9597-49b4-8b09-8c9ed205a6e1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:05.741175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-564d3d96-9597-49b4-8b09-8c9ed205a6e1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:05.749881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-564d3d96-9597-49b4-8b09-8c9ed205a6e1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:05.750505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-564d3d96-9597-49b4-8b09-8c9ed205a6e1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:05.751536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-564d3d96-9597-49b4-8b09-8c9ed205a6e1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:05.752357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-564d3d96-9597-49b4-8b09-8c9ed205a6e1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:05.752912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-564d3d96-9597-49b4-8b09-8c9ed205a6e1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:05.753431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-564d3d96-9597-49b4-8b09-8c9ed205a6e1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:05.797603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7bf17e8f-457b-4038-a603-c02fba4dd4a4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:05.804638 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7bf17e8f-457b-4038-a603-c02fba4dd4a4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1241 microversion: 2.1 time: 0.104563 Aug 23 18:24:05.806690 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3053/5968] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:05 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1241 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:24:06.005879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-564d3d96-9597-49b4-8b09-8c9ed205a6e1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:06.015417 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-564d3d96-9597-49b4-8b09-8c9ed205a6e1 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1509 microversion: 2.1 time: 0.279267 Aug 23 18:24:06.016203 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2916/5969] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:05 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1509 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:06.036636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-97bebb3f-5977-4345-8283-8b18a5285e3c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:06.037295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-97bebb3f-5977-4345-8283-8b18a5285e3c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:06.045012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97bebb3f-5977-4345-8283-8b18a5285e3c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:06.045510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97bebb3f-5977-4345-8283-8b18a5285e3c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:06.046281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97bebb3f-5977-4345-8283-8b18a5285e3c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:06.047745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97bebb3f-5977-4345-8283-8b18a5285e3c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:06.048426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97bebb3f-5977-4345-8283-8b18a5285e3c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:06.049106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97bebb3f-5977-4345-8283-8b18a5285e3c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:06.208281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97bebb3f-5977-4345-8283-8b18a5285e3c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:06.218145 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-97bebb3f-5977-4345-8283-8b18a5285e3c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1509 microversion: 2.1 time: 0.185964 Aug 23 18:24:06.219178 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3054/5970] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:06 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:06.239631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7bb2709f-d3f8-44a2-9bb6-d6613ee25667 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:06.242928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7bb2709f-d3f8-44a2-9bb6-d6613ee25667 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:06.251920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bb2709f-d3f8-44a2-9bb6-d6613ee25667 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:06.252719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bb2709f-d3f8-44a2-9bb6-d6613ee25667 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:06.253341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bb2709f-d3f8-44a2-9bb6-d6613ee25667 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:06.254764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bb2709f-d3f8-44a2-9bb6-d6613ee25667 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:06.255816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bb2709f-d3f8-44a2-9bb6-d6613ee25667 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:06.256437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7bb2709f-d3f8-44a2-9bb6-d6613ee25667 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:06.356336 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7bb2709f-d3f8-44a2-9bb6-d6613ee25667 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "PUT /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1081 microversion: 2.1 time: 0.121239 Aug 23 18:24:06.368672 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2917/5971] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Aug 23 18:24:06 2022] PUT /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1081 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:06.379519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-80e583d9-2192-478e-89a3-7ebdbd9e8bc0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:06.380162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-80e583d9-2192-478e-89a3-7ebdbd9e8bc0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:06.389618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80e583d9-2192-478e-89a3-7ebdbd9e8bc0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:06.390719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80e583d9-2192-478e-89a3-7ebdbd9e8bc0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:06.391369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80e583d9-2192-478e-89a3-7ebdbd9e8bc0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:06.392649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80e583d9-2192-478e-89a3-7ebdbd9e8bc0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:06.393670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80e583d9-2192-478e-89a3-7ebdbd9e8bc0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:06.402416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80e583d9-2192-478e-89a3-7ebdbd9e8bc0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:06.612727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-80e583d9-2192-478e-89a3-7ebdbd9e8bc0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:06.629029 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-80e583d9-2192-478e-89a3-7ebdbd9e8bc0 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1507 microversion: 2.1 time: 0.257280 Aug 23 18:24:06.644318 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3055/5972] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:06 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1507 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:06.651234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7a1ad6cf-a9db-43a8-943e-479ead4a065c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:06.652994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7a1ad6cf-a9db-43a8-943e-479ead4a065c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:06.659766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a1ad6cf-a9db-43a8-943e-479ead4a065c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:06.660346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a1ad6cf-a9db-43a8-943e-479ead4a065c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:06.661002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a1ad6cf-a9db-43a8-943e-479ead4a065c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:06.661943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a1ad6cf-a9db-43a8-943e-479ead4a065c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:06.662481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a1ad6cf-a9db-43a8-943e-479ead4a065c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:06.663077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a1ad6cf-a9db-43a8-943e-479ead4a065c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:06.826820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-82ec8d41-624e-4094-9d85-d7de2e418516 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:06.827607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-82ec8d41-624e-4094-9d85-d7de2e418516 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:06.835831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82ec8d41-624e-4094-9d85-d7de2e418516 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:06.836423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82ec8d41-624e-4094-9d85-d7de2e418516 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:06.836973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82ec8d41-624e-4094-9d85-d7de2e418516 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:06.838294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82ec8d41-624e-4094-9d85-d7de2e418516 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:06.838972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82ec8d41-624e-4094-9d85-d7de2e418516 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:06.839481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82ec8d41-624e-4094-9d85-d7de2e418516 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:06.909043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-82ec8d41-624e-4094-9d85-d7de2e418516 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:06.918292 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-82ec8d41-624e-4094-9d85-d7de2e418516 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1293 microversion: 2.1 time: 0.096841 Aug 23 18:24:06.932835 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3056/5973] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:06 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1293 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:24:06.933594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7a1ad6cf-a9db-43a8-943e-479ead4a065c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:06.942167 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7a1ad6cf-a9db-43a8-943e-479ead4a065c tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1507 microversion: 2.1 time: 0.297010 Aug 23 18:24:06.943089 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2918/5974] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:06 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1507 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:24:06.963028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e12285d1-f39c-4e38-833b-d87739443e91 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:06.976482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e12285d1-f39c-4e38-833b-d87739443e91 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:06.980230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:06.985830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e12285d1-f39c-4e38-833b-d87739443e91 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:06.986645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e12285d1-f39c-4e38-833b-d87739443e91 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:06.987338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e12285d1-f39c-4e38-833b-d87739443e91 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:06.988311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e12285d1-f39c-4e38-833b-d87739443e91 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:06.988835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e12285d1-f39c-4e38-833b-d87739443e91 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:06.989517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e12285d1-f39c-4e38-833b-d87739443e91 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:07.093718 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e12285d1-f39c-4e38-833b-d87739443e91 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "PUT /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1083 microversion: 2.1 time: 0.135110 Aug 23 18:24:07.094947 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3057/5975] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Aug 23 18:24:06 2022] PUT /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1083 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:07.113722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b290787-a5ef-494e-aea7-b970721a77d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:07.114337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7b290787-a5ef-494e-aea7-b970721a77d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:07.122079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b290787-a5ef-494e-aea7-b970721a77d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:07.122587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b290787-a5ef-494e-aea7-b970721a77d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:07.123029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b290787-a5ef-494e-aea7-b970721a77d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:07.123731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b290787-a5ef-494e-aea7-b970721a77d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:07.124184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b290787-a5ef-494e-aea7-b970721a77d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:07.124603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b290787-a5ef-494e-aea7-b970721a77d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:07.392113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7b290787-a5ef-494e-aea7-b970721a77d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:07.400446 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7b290787-a5ef-494e-aea7-b970721a77d9 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1509 microversion: 2.1 time: 0.290275 Aug 23 18:24:07.400816 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2919/5976] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:07 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1509 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:07.419996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7cb2f55e-ccc6-43e9-82d8-59a57aef87d2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:07.420531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7cb2f55e-ccc6-43e9-82d8-59a57aef87d2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:07.427762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7cb2f55e-ccc6-43e9-82d8-59a57aef87d2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:07.428262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7cb2f55e-ccc6-43e9-82d8-59a57aef87d2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:07.428708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7cb2f55e-ccc6-43e9-82d8-59a57aef87d2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:07.429424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7cb2f55e-ccc6-43e9-82d8-59a57aef87d2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:07.429887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7cb2f55e-ccc6-43e9-82d8-59a57aef87d2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:07.430319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7cb2f55e-ccc6-43e9-82d8-59a57aef87d2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:07.773699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7cb2f55e-ccc6-43e9-82d8-59a57aef87d2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:07.782975 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7cb2f55e-ccc6-43e9-82d8-59a57aef87d2 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1509 microversion: 2.1 time: 0.366982 Aug 23 18:24:07.783563 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3058/5977] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:07 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1509 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:07.804033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c76bdf7-5f86-49d5-b467-dd65417c7473 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:07.805052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c76bdf7-5f86-49d5-b467-dd65417c7473 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:07.812813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c76bdf7-5f86-49d5-b467-dd65417c7473 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:07.813307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c76bdf7-5f86-49d5-b467-dd65417c7473 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:07.813753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c76bdf7-5f86-49d5-b467-dd65417c7473 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:07.814458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c76bdf7-5f86-49d5-b467-dd65417c7473 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:07.815092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c76bdf7-5f86-49d5-b467-dd65417c7473 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:07.815523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c76bdf7-5f86-49d5-b467-dd65417c7473 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:07.844024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c76bdf7-5f86-49d5-b467-dd65417c7473 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:24:07.936157 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c76bdf7-5f86-49d5-b467-dd65417c7473 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "DELETE /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 204 len: 0 microversion: 2.1 time: 0.135111 Aug 23 18:24:07.937071 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2920/5978] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:24:07 2022] DELETE /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:24:07.944758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3fbad56f-46b1-4ebd-8844-4f1708db18b7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:07.946439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3fbad56f-46b1-4ebd-8844-4f1708db18b7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:07.952015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b656213-d447-4b65-bb12-5a98ad1b5890 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:07.952700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7b656213-d447-4b65-bb12-5a98ad1b5890 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:07.955173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbad56f-46b1-4ebd-8844-4f1708db18b7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:07.956185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbad56f-46b1-4ebd-8844-4f1708db18b7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:07.956832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbad56f-46b1-4ebd-8844-4f1708db18b7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:07.957751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbad56f-46b1-4ebd-8844-4f1708db18b7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:07.958458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbad56f-46b1-4ebd-8844-4f1708db18b7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:07.958917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbad56f-46b1-4ebd-8844-4f1708db18b7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:07.959326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b656213-d447-4b65-bb12-5a98ad1b5890 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:07.959908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b656213-d447-4b65-bb12-5a98ad1b5890 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:07.960573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b656213-d447-4b65-bb12-5a98ad1b5890 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:07.961526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b656213-d447-4b65-bb12-5a98ad1b5890 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:07.962351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b656213-d447-4b65-bb12-5a98ad1b5890 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:07.963047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b656213-d447-4b65-bb12-5a98ad1b5890 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:07.982807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:07.991169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7b656213-d447-4b65-bb12-5a98ad1b5890 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:24:08.042827 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.compute.api [None req-7b656213-d447-4b65-bb12-5a98ad1b5890 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Instance is already in deleting state, ignoring this request Aug 23 18:24:08.043514 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7b656213-d447-4b65-bb12-5a98ad1b5890 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "DELETE /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 204 len: 0 microversion: 2.1 time: 0.096671 Aug 23 18:24:08.044402 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2921/5979] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:24:07 2022] DELETE /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:24:08.052371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d2522083-3f94-4e30-9c69-77dedfe27770 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:08.053054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d2522083-3f94-4e30-9c69-77dedfe27770 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:08.059713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2522083-3f94-4e30-9c69-77dedfe27770 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:08.060204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2522083-3f94-4e30-9c69-77dedfe27770 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:08.060779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2522083-3f94-4e30-9c69-77dedfe27770 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:08.061784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2522083-3f94-4e30-9c69-77dedfe27770 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:08.062398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2522083-3f94-4e30-9c69-77dedfe27770 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:08.063095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d2522083-3f94-4e30-9c69-77dedfe27770 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:08.078813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3fbad56f-46b1-4ebd-8844-4f1708db18b7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:08.091934 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3fbad56f-46b1-4ebd-8844-4f1708db18b7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1299 microversion: 2.1 time: 0.153598 Aug 23 18:24:08.092689 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3059/5980] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:07 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:08.294770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d2522083-3f94-4e30-9c69-77dedfe27770 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:08.303325 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d2522083-3f94-4e30-9c69-77dedfe27770 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1515 microversion: 2.1 time: 0.254866 Aug 23 18:24:08.317695 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2922/5981] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:08 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1515 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:24:09.014872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5c617776-88a8-4203-98f0-b178007ab20c req-1a3c17ef-0327-4808-93b9-54e40705ca3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b33aebb-e0c2-43d1-9182-7818c49e0d6d", "tag": "a8d50a38-1a3f-4f55-a8e3-170e93de2b8f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:09.034036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5c617776-88a8-4203-98f0-b178007ab20c req-1a3c17ef-0327-4808-93b9-54e40705ca3b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:09.035524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5c617776-88a8-4203-98f0-b178007ab20c req-1a3c17ef-0327-4808-93b9-54e40705ca3b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:09.036264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5c617776-88a8-4203-98f0-b178007ab20c req-1a3c17ef-0327-4808-93b9-54e40705ca3b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:09.068350 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5c617776-88a8-4203-98f0-b178007ab20c req-1a3c17ef-0327-4808-93b9-54e40705ca3b service nova] Creating event network-changed:a8d50a38-1a3f-4f55-a8e3-170e93de2b8f for instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d on n-h2-850468-16 Aug 23 18:24:09.074705 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5c617776-88a8-4203-98f0-b178007ab20c req-1a3c17ef-0327-4808-93b9-54e40705ca3b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068740 Aug 23 18:24:09.077561 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3060/5982] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:09.114247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ddd49e08-d8f0-462a-b4ea-1bcf5f1e8841 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:09.115945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ddd49e08-d8f0-462a-b4ea-1bcf5f1e8841 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:09.123541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddd49e08-d8f0-462a-b4ea-1bcf5f1e8841 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:09.124431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddd49e08-d8f0-462a-b4ea-1bcf5f1e8841 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:09.125095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddd49e08-d8f0-462a-b4ea-1bcf5f1e8841 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:09.126035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddd49e08-d8f0-462a-b4ea-1bcf5f1e8841 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:09.126995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddd49e08-d8f0-462a-b4ea-1bcf5f1e8841 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:09.127695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddd49e08-d8f0-462a-b4ea-1bcf5f1e8841 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:09.320413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ddd49e08-d8f0-462a-b4ea-1bcf5f1e8841 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:09.326301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c68a1c3d-31e0-4d0d-9d40-7f2aa9453218 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:09.327101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c68a1c3d-31e0-4d0d-9d40-7f2aa9453218 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:09.336728 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ddd49e08-d8f0-462a-b4ea-1bcf5f1e8841 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1367 microversion: 2.1 time: 0.227662 Aug 23 18:24:09.338244 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2923/5983] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:09 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:09.340962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c68a1c3d-31e0-4d0d-9d40-7f2aa9453218 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:09.341545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c68a1c3d-31e0-4d0d-9d40-7f2aa9453218 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:09.342067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c68a1c3d-31e0-4d0d-9d40-7f2aa9453218 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:09.342904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c68a1c3d-31e0-4d0d-9d40-7f2aa9453218 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:09.343443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c68a1c3d-31e0-4d0d-9d40-7f2aa9453218 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:09.344676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c68a1c3d-31e0-4d0d-9d40-7f2aa9453218 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:09.590140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c68a1c3d-31e0-4d0d-9d40-7f2aa9453218 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:09.600909 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c68a1c3d-31e0-4d0d-9d40-7f2aa9453218 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1515 microversion: 2.1 time: 0.279560 Aug 23 18:24:09.616175 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3061/5984] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:09 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1515 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:24:10.310416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-65d27291-932d-480f-be10-4ecd30c2ab1a req-4b7b5860-67bd-4628-a6e9-653e9960b4e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "835aa76d-65de-4f7e-9a2b-bac88860c1eb", "name": "network-vif-deleted", "tag": "85ac0ffe-4e1c-4d56-826b-f91a096ab14e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:10.342845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-65d27291-932d-480f-be10-4ecd30c2ab1a req-4b7b5860-67bd-4628-a6e9-653e9960b4e9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:10.343676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-65d27291-932d-480f-be10-4ecd30c2ab1a req-4b7b5860-67bd-4628-a6e9-653e9960b4e9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:10.344411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-65d27291-932d-480f-be10-4ecd30c2ab1a req-4b7b5860-67bd-4628-a6e9-653e9960b4e9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:10.361122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-78fd74ac-0ccb-4996-a315-7878b2fa18b8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:10.363140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-78fd74ac-0ccb-4996-a315-7878b2fa18b8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:10.382660 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-65d27291-932d-480f-be10-4ecd30c2ab1a req-4b7b5860-67bd-4628-a6e9-653e9960b4e9 service nova] Creating event network-vif-deleted:85ac0ffe-4e1c-4d56-826b-f91a096ab14e for instance 835aa76d-65de-4f7e-9a2b-bac88860c1eb on n-h1-850468-16 Aug 23 18:24:10.389308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78fd74ac-0ccb-4996-a315-7878b2fa18b8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:10.390107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78fd74ac-0ccb-4996-a315-7878b2fa18b8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:10.391454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78fd74ac-0ccb-4996-a315-7878b2fa18b8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:10.394718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78fd74ac-0ccb-4996-a315-7878b2fa18b8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:10.395325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78fd74ac-0ccb-4996-a315-7878b2fa18b8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:10.395766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78fd74ac-0ccb-4996-a315-7878b2fa18b8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:10.396461 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-65d27291-932d-480f-be10-4ecd30c2ab1a req-4b7b5860-67bd-4628-a6e9-653e9960b4e9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092099 Aug 23 18:24:10.402795 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2924/5985] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:10.624492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:10.625737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:10.637369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:10.640599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:10.643124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:10.645129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:10.645772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:10.646353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:10.690509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:10.691039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:10.691628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:10.692094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lazy-loading 'fault' on Instance uuid 835aa76d-65de-4f7e-9a2b-bac88860c1eb {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:24:10.748032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd175596a3d804183b2388a25ab9a1018', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41f4e8e13960468dbdaf601e0141db0c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:10.758797 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9cace42e-5cd6-4b8b-a5df-8658795cfe8b tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 200 len: 1308 microversion: 2.1 time: 0.141108 Aug 23 18:24:10.760073 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2925/5986] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:10 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 1308 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:24:10.822682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-78fd74ac-0ccb-4996-a315-7878b2fa18b8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:10.831731 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-78fd74ac-0ccb-4996-a315-7878b2fa18b8 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1367 microversion: 2.1 time: 0.477206 Aug 23 18:24:10.832338 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3062/5987] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:10 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1367 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:11.142251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cc82cc45-260c-4afc-8f9f-5373e4a5ef4f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:11.144886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cc82cc45-260c-4afc-8f9f-5373e4a5ef4f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:11.151925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc82cc45-260c-4afc-8f9f-5373e4a5ef4f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.152553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc82cc45-260c-4afc-8f9f-5373e4a5ef4f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.153206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc82cc45-260c-4afc-8f9f-5373e4a5ef4f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.154140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc82cc45-260c-4afc-8f9f-5373e4a5ef4f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.155581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc82cc45-260c-4afc-8f9f-5373e4a5ef4f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.156015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc82cc45-260c-4afc-8f9f-5373e4a5ef4f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.182986 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cc82cc45-260c-4afc-8f9f-5373e4a5ef4f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/ips" status: 200 len: 150 microversion: 2.20 time: 0.044713 Aug 23 18:24:11.189864 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2926/5988] 10.222.0.61 () {60 vars in 1289 bytes} [Tue Aug 23 18:24:11 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:24:11.781636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a4e79af5-9bc6-4ec2-8d91-416f458c5ddf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:11.782799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a4e79af5-9bc6-4ec2-8d91-416f458c5ddf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 835aa76d-65de-4f7e-9a2b-bac88860c1eb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:11.804560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4e79af5-9bc6-4ec2-8d91-416f458c5ddf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.805439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4e79af5-9bc6-4ec2-8d91-416f458c5ddf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.806722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4e79af5-9bc6-4ec2-8d91-416f458c5ddf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.807981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4e79af5-9bc6-4ec2-8d91-416f458c5ddf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.809081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4e79af5-9bc6-4ec2-8d91-416f458c5ddf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.809875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4e79af5-9bc6-4ec2-8d91-416f458c5ddf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.833215 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-a4e79af5-9bc6-4ec2-8d91-416f458c5ddf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] HTTP exception thrown: Instance 835aa76d-65de-4f7e-9a2b-bac88860c1eb could not be found. Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a4e79af5-9bc6-4ec2-8d91-416f458c5ddf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Request method failure captured: Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb HTTP/1.1 Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRqyEZzgxN_vI2F_1_qd5uN4ouJCi_AXjpoSPZ_yB4RFSjkGhSMBeU0OSnB-ljh1W4PZ5aKhZouaXBhuErWHqXYSNaWjCGVwpKY7JyDaYqfe7u7XzPFoflmbqtT0oC5WtCzwYWD_xpKc5A1IVhoGQ2UyUzF7-EznEB8JUJdmKos8c0I Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 41f4e8e13960468dbdaf601e0141db0c Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/41f4e8e13960468dbdaf601e0141db0c"}]}] Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 41f4e8e13960468dbdaf601e0141db0c Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerDiskConfigTestJSON-1241896882-project Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: d175596a3d804183b2388a25ab9a1018 Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerDiskConfigTestJSON-1241896882-project Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 835aa76d-65de-4f7e-9a2b-bac88860c1eb could not be found. Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '835aa76d-65de-4f7e-9a2b-bac88860c1eb'} Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 835aa76d-65de-4f7e-9a2b-bac88860c1eb could not be found. Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 835aa76d-65de-4f7e-9a2b-bac88860c1eb could not be found. Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:24:11.834940 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.841461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:11.841461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:24:11.841461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:24:11.841461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:24:11.841461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:24:11.841461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 835aa76d-65de-4f7e-9a2b-bac88860c1eb could not be found. Aug 23 18:24:11.841461 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.841461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a4e79af5-9bc6-4ec2-8d91-416f458c5ddf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Returning 404 to user: Instance 835aa76d-65de-4f7e-9a2b-bac88860c1eb could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:24:11.841461 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a4e79af5-9bc6-4ec2-8d91-416f458c5ddf tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb" status: 404 len: 111 microversion: 2.1 time: 0.060063 Aug 23 18:24:11.843465 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3063/5989] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:11 2022] GET /compute/v2.1/servers/835aa76d-65de-4f7e-9a2b-bac88860c1eb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:24:11.847798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56446cda-80b3-4b27-bfe4-6e3cad8d7073 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:11.848579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-56446cda-80b3-4b27-bfe4-6e3cad8d7073 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:11.855063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-05bf55f7-9af3-40bd-ad51-09942cea9b9c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:11.855613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-05bf55f7-9af3-40bd-ad51-09942cea9b9c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:11.857622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56446cda-80b3-4b27-bfe4-6e3cad8d7073 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.858379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56446cda-80b3-4b27-bfe4-6e3cad8d7073 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.859062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56446cda-80b3-4b27-bfe4-6e3cad8d7073 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.860089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56446cda-80b3-4b27-bfe4-6e3cad8d7073 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.860762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56446cda-80b3-4b27-bfe4-6e3cad8d7073 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.861404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56446cda-80b3-4b27-bfe4-6e3cad8d7073 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.862700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05bf55f7-9af3-40bd-ad51-09942cea9b9c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.863271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05bf55f7-9af3-40bd-ad51-09942cea9b9c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.864109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05bf55f7-9af3-40bd-ad51-09942cea9b9c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.864885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05bf55f7-9af3-40bd-ad51-09942cea9b9c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.865380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05bf55f7-9af3-40bd-ad51-09942cea9b9c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.865775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05bf55f7-9af3-40bd-ad51-09942cea9b9c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.878492 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-56446cda-80b3-4b27-bfe4-6e3cad8d7073 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] HTTP exception thrown: Instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f could not be found. Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56446cda-80b3-4b27-bfe4-6e3cad8d7073 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Request method failure captured: Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f HTTP/1.1 Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRqyEZzgxN_vI2F_1_qd5uN4ouJCi_AXjpoSPZ_yB4RFSjkGhSMBeU0OSnB-ljh1W4PZ5aKhZouaXBhuErWHqXYSNaWjCGVwpKY7JyDaYqfe7u7XzPFoflmbqtT0oC5WtCzwYWD_xpKc5A1IVhoGQ2UyUzF7-EznEB8JUJdmKos8c0I Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 41f4e8e13960468dbdaf601e0141db0c Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/41f4e8e13960468dbdaf601e0141db0c"}]}] Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 41f4e8e13960468dbdaf601e0141db0c Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerDiskConfigTestJSON-1241896882-project Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: d175596a3d804183b2388a25ab9a1018 Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerDiskConfigTestJSON-1241896882-project Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f could not be found. Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'e967f401-d352-4b31-8c5a-0f03fa0a9d3f'} Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f could not be found. Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:24:11.880602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:24:11.884387 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f could not be found. Aug 23 18:24:11.884387 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.884387 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:24:11.884387 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.884387 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:11.884387 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:24:11.884387 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:24:11.884387 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:24:11.884387 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:24:11.884387 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f could not be found. Aug 23 18:24:11.884387 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.886936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56446cda-80b3-4b27-bfe4-6e3cad8d7073 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Returning 404 to user: Instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:24:11.888052 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-56446cda-80b3-4b27-bfe4-6e3cad8d7073 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 404 len: 111 microversion: 2.1 time: 0.044562 Aug 23 18:24:11.889154 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2927/5990] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:24:11 2022] DELETE /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:24:11.901113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3d917a03-1f7e-4ad6-9526-67272296c4e8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:11.902137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3d917a03-1f7e-4ad6-9526-67272296c4e8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: e967f401-d352-4b31-8c5a-0f03fa0a9d3f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:11.908882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d917a03-1f7e-4ad6-9526-67272296c4e8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.909419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d917a03-1f7e-4ad6-9526-67272296c4e8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.909992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d917a03-1f7e-4ad6-9526-67272296c4e8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.910823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d917a03-1f7e-4ad6-9526-67272296c4e8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.911592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d917a03-1f7e-4ad6-9526-67272296c4e8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.912147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d917a03-1f7e-4ad6-9526-67272296c4e8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.930313 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-3d917a03-1f7e-4ad6-9526-67272296c4e8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] HTTP exception thrown: Instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f could not be found. Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3d917a03-1f7e-4ad6-9526-67272296c4e8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Request method failure captured: Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f HTTP/1.1 Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRqyEZzgxN_vI2F_1_qd5uN4ouJCi_AXjpoSPZ_yB4RFSjkGhSMBeU0OSnB-ljh1W4PZ5aKhZouaXBhuErWHqXYSNaWjCGVwpKY7JyDaYqfe7u7XzPFoflmbqtT0oC5WtCzwYWD_xpKc5A1IVhoGQ2UyUzF7-EznEB8JUJdmKos8c0I Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 41f4e8e13960468dbdaf601e0141db0c Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/41f4e8e13960468dbdaf601e0141db0c"}]}] Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 41f4e8e13960468dbdaf601e0141db0c Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerDiskConfigTestJSON-1241896882-project Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: d175596a3d804183b2388a25ab9a1018 Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerDiskConfigTestJSON-1241896882-project Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f could not be found. Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'e967f401-d352-4b31-8c5a-0f03fa0a9d3f'} Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f could not be found. Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f could not be found. Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:24:11.932602 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.937903 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:11.937903 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:24:11.937903 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:24:11.937903 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:24:11.937903 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:24:11.937903 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f could not be found. Aug 23 18:24:11.937903 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.937903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3d917a03-1f7e-4ad6-9526-67272296c4e8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Returning 404 to user: Instance e967f401-d352-4b31-8c5a-0f03fa0a9d3f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:24:11.937903 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3d917a03-1f7e-4ad6-9526-67272296c4e8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f" status: 404 len: 111 microversion: 2.1 time: 0.038645 Aug 23 18:24:11.937903 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2928/5991] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:11 2022] GET /compute/v2.1/servers/e967f401-d352-4b31-8c5a-0f03fa0a9d3f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:24:11.942150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5918b59c-7d92-4a23-9091-1920357e13d8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:11.942741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5918b59c-7d92-4a23-9091-1920357e13d8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:11.950521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5918b59c-7d92-4a23-9091-1920357e13d8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.951058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5918b59c-7d92-4a23-9091-1920357e13d8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.951500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5918b59c-7d92-4a23-9091-1920357e13d8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.952538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5918b59c-7d92-4a23-9091-1920357e13d8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.952980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5918b59c-7d92-4a23-9091-1920357e13d8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.953459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5918b59c-7d92-4a23-9091-1920357e13d8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.956613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:11.970836 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-5918b59c-7d92-4a23-9091-1920357e13d8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] HTTP exception thrown: Instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 could not be found. Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5918b59c-7d92-4a23-9091-1920357e13d8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Request method failure captured: Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 HTTP/1.1 Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRqyEZzgxN_vI2F_1_qd5uN4ouJCi_AXjpoSPZ_yB4RFSjkGhSMBeU0OSnB-ljh1W4PZ5aKhZouaXBhuErWHqXYSNaWjCGVwpKY7JyDaYqfe7u7XzPFoflmbqtT0oC5WtCzwYWD_xpKc5A1IVhoGQ2UyUzF7-EznEB8JUJdmKos8c0I Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 41f4e8e13960468dbdaf601e0141db0c Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/41f4e8e13960468dbdaf601e0141db0c"}]}] Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 41f4e8e13960468dbdaf601e0141db0c Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerDiskConfigTestJSON-1241896882-project Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: d175596a3d804183b2388a25ab9a1018 Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerDiskConfigTestJSON-1241896882-project Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 could not be found. Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '6f9d20f3-bb14-4021-9ee1-d921cdc4fe05'} Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 could not be found. Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:24:11.972551 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 could not be found. Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 could not be found. Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5918b59c-7d92-4a23-9091-1920357e13d8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Returning 404 to user: Instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5918b59c-7d92-4a23-9091-1920357e13d8 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 404 len: 111 microversion: 2.1 time: 0.035380 Aug 23 18:24:11.977784 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2929/5992] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:24:11 2022] DELETE /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:24:11.982597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ed41dbd-0184-47eb-96a2-679036a59550 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:11.983217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9ed41dbd-0184-47eb-96a2-679036a59550 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] [instance: 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:11.989944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ed41dbd-0184-47eb-96a2-679036a59550 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.990664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ed41dbd-0184-47eb-96a2-679036a59550 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.991110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ed41dbd-0184-47eb-96a2-679036a59550 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:11.991822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ed41dbd-0184-47eb-96a2-679036a59550 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:11.992275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ed41dbd-0184-47eb-96a2-679036a59550 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:11.992866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ed41dbd-0184-47eb-96a2-679036a59550 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:12.010042 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-9ed41dbd-0184-47eb-96a2-679036a59550 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] HTTP exception thrown: Instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 could not be found. Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ed41dbd-0184-47eb-96a2-679036a59550 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Request method failure captured: Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 HTTP/1.1 Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRqyEZzgxN_vI2F_1_qd5uN4ouJCi_AXjpoSPZ_yB4RFSjkGhSMBeU0OSnB-ljh1W4PZ5aKhZouaXBhuErWHqXYSNaWjCGVwpKY7JyDaYqfe7u7XzPFoflmbqtT0oC5WtCzwYWD_xpKc5A1IVhoGQ2UyUzF7-EznEB8JUJdmKos8c0I Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 41f4e8e13960468dbdaf601e0141db0c Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/41f4e8e13960468dbdaf601e0141db0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/41f4e8e13960468dbdaf601e0141db0c"}]}] Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 41f4e8e13960468dbdaf601e0141db0c Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1241896882 Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerDiskConfigTestJSON-1241896882-project Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: d175596a3d804183b2388a25ab9a1018 Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerDiskConfigTestJSON-1241896882-project Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 could not be found. Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '6f9d20f3-bb14-4021-9ee1-d921cdc4fe05'} Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 could not be found. Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 could not be found. Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:24:12.011658 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:12.018709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:12.018709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:24:12.018709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:24:12.018709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:24:12.018709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:24:12.018709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 could not be found. Aug 23 18:24:12.018709 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:12.018709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ed41dbd-0184-47eb-96a2-679036a59550 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] Returning 404 to user: Instance 6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:24:12.018709 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9ed41dbd-0184-47eb-96a2-679036a59550 tempest-ServerDiskConfigTestJSON-1241896882 tempest-ServerDiskConfigTestJSON-1241896882-project] 10.222.0.61 "GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05" status: 404 len: 111 microversion: 2.1 time: 0.034200 Aug 23 18:24:12.018709 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2930/5993] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:11 2022] GET /compute/v2.1/servers/6f9d20f3-bb14-4021-9ee1-d921cdc4fe05 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:24:12.249142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-05bf55f7-9af3-40bd-ad51-09942cea9b9c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:12.264905 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-05bf55f7-9af3-40bd-ad51-09942cea9b9c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1367 microversion: 2.1 time: 0.414984 Aug 23 18:24:12.275309 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3064/5994] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:11 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1367 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:13.286782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-339ea6e3-c27d-42fc-8a83-b6e3be811b0b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:13.287859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-339ea6e3-c27d-42fc-8a83-b6e3be811b0b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:13.295905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-339ea6e3-c27d-42fc-8a83-b6e3be811b0b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:13.296546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-339ea6e3-c27d-42fc-8a83-b6e3be811b0b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:13.296992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-339ea6e3-c27d-42fc-8a83-b6e3be811b0b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:13.297714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-339ea6e3-c27d-42fc-8a83-b6e3be811b0b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:13.298168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-339ea6e3-c27d-42fc-8a83-b6e3be811b0b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:13.298787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-339ea6e3-c27d-42fc-8a83-b6e3be811b0b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:13.553176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-339ea6e3-c27d-42fc-8a83-b6e3be811b0b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:13.566036 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-339ea6e3-c27d-42fc-8a83-b6e3be811b0b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1367 microversion: 2.1 time: 0.283907 Aug 23 18:24:13.567473 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2931/5995] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:13 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1367 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:14.215171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dc192f68-25a5-410e-a77e-311d6342365a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:14.216017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc192f68-25a5-410e-a77e-311d6342365a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:14.227245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc192f68-25a5-410e-a77e-311d6342365a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:14.228996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc192f68-25a5-410e-a77e-311d6342365a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:14.241154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc192f68-25a5-410e-a77e-311d6342365a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:14.243210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc192f68-25a5-410e-a77e-311d6342365a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:14.244688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc192f68-25a5-410e-a77e-311d6342365a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:14.245701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc192f68-25a5-410e-a77e-311d6342365a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:14.287791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-dc192f68-25a5-410e-a77e-311d6342365a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lazy-loading 'flavor' on Instance uuid 9825ea0c-c842-4818-af65-f737a8c71689 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:24:14.523876 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dc192f68-25a5-410e-a77e-311d6342365a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "POST /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/action" status: 202 len: 0 microversion: 2.20 time: 0.315869 Aug 23 18:24:14.525297 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3065/5996] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 18:24:14 2022] POST /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/action => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:24:14.539883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c2b445b4-61b9-4249-b51b-f0c9cc3b9db7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:14.543349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c2b445b4-61b9-4249-b51b-f0c9cc3b9db7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:14.560513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b445b4-61b9-4249-b51b-f0c9cc3b9db7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:14.561362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b445b4-61b9-4249-b51b-f0c9cc3b9db7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:14.562908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b445b4-61b9-4249-b51b-f0c9cc3b9db7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:14.564166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b445b4-61b9-4249-b51b-f0c9cc3b9db7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:14.567642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b445b4-61b9-4249-b51b-f0c9cc3b9db7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:14.568724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2b445b4-61b9-4249-b51b-f0c9cc3b9db7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:14.588865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a7961b52-a295-4ef7-b88a-5c6a54b1321b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:14.589663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a7961b52-a295-4ef7-b88a-5c6a54b1321b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:14.603331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7961b52-a295-4ef7-b88a-5c6a54b1321b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:14.608762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7961b52-a295-4ef7-b88a-5c6a54b1321b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:14.610051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7961b52-a295-4ef7-b88a-5c6a54b1321b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:14.612845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7961b52-a295-4ef7-b88a-5c6a54b1321b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:14.613553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7961b52-a295-4ef7-b88a-5c6a54b1321b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:14.617181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a7961b52-a295-4ef7-b88a-5c6a54b1321b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:14.845818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c2b445b4-61b9-4249-b51b-f0c9cc3b9db7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:14.855729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c2b445b4-61b9-4249-b51b-f0c9cc3b9db7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:14.857222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c2b445b4-61b9-4249-b51b-f0c9cc3b9db7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:14.858390 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c2b445b4-61b9-4249-b51b-f0c9cc3b9db7 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.329142 Aug 23 18:24:14.870433 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2932/5997] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:14 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:15.075311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a7961b52-a295-4ef7-b88a-5c6a54b1321b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:15.084415 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a7961b52-a295-4ef7-b88a-5c6a54b1321b tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1367 microversion: 2.1 time: 0.499732 Aug 23 18:24:15.084415 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3066/5998] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:14 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1367 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:24:15.900361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-272b2710-f6d7-4fcc-bbd8-e2430458edd6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:15.901781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-272b2710-f6d7-4fcc-bbd8-e2430458edd6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:15.905120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:15.906180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:15.913096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-272b2710-f6d7-4fcc-bbd8-e2430458edd6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:15.916701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-272b2710-f6d7-4fcc-bbd8-e2430458edd6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:15.919252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-272b2710-f6d7-4fcc-bbd8-e2430458edd6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:15.921134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-272b2710-f6d7-4fcc-bbd8-e2430458edd6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:15.923807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-272b2710-f6d7-4fcc-bbd8-e2430458edd6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:15.924513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-272b2710-f6d7-4fcc-bbd8-e2430458edd6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:16.105420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-45c22b47-f98c-4342-a9ee-0d08e4b7f4c4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:16.106559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-45c22b47-f98c-4342-a9ee-0d08e4b7f4c4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:16.110706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:16.129630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-272b2710-f6d7-4fcc-bbd8-e2430458edd6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:16.130413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45c22b47-f98c-4342-a9ee-0d08e4b7f4c4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:16.131096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45c22b47-f98c-4342-a9ee-0d08e4b7f4c4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:16.131764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45c22b47-f98c-4342-a9ee-0d08e4b7f4c4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:16.132641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45c22b47-f98c-4342-a9ee-0d08e4b7f4c4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:16.133342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45c22b47-f98c-4342-a9ee-0d08e4b7f4c4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:16.134330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45c22b47-f98c-4342-a9ee-0d08e4b7f4c4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:16.141749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-272b2710-f6d7-4fcc-bbd8-e2430458edd6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:16.143811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-272b2710-f6d7-4fcc-bbd8-e2430458edd6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:16.145263 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-272b2710-f6d7-4fcc-bbd8-e2430458edd6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.253419 Aug 23 18:24:16.147170 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2933/5999] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:15 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:16.528492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45c22b47-f98c-4342-a9ee-0d08e4b7f4c4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:16.537053 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-45c22b47-f98c-4342-a9ee-0d08e4b7f4c4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1367 microversion: 2.1 time: 0.436177 Aug 23 18:24:16.544296 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3067/6000] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:16 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1367 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:24:16.809476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-dfd9f7cc-b057-4f59-b62b-1b8a4584d74c req-a6e3b24a-2f1a-4c3d-a3ea-ad6abda319ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b33aebb-e0c2-43d1-9182-7818c49e0d6d", "name": "network-vif-plugged", "status": "completed", "tag": "a8d50a38-1a3f-4f55-a8e3-170e93de2b8f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:16.826633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dfd9f7cc-b057-4f59-b62b-1b8a4584d74c req-a6e3b24a-2f1a-4c3d-a3ea-ad6abda319ef service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:16.827120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dfd9f7cc-b057-4f59-b62b-1b8a4584d74c req-a6e3b24a-2f1a-4c3d-a3ea-ad6abda319ef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:16.827814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dfd9f7cc-b057-4f59-b62b-1b8a4584d74c req-a6e3b24a-2f1a-4c3d-a3ea-ad6abda319ef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:16.846578 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-dfd9f7cc-b057-4f59-b62b-1b8a4584d74c req-a6e3b24a-2f1a-4c3d-a3ea-ad6abda319ef service nova] Creating event network-vif-plugged:a8d50a38-1a3f-4f55-a8e3-170e93de2b8f for instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d on n-h2-850468-16 Aug 23 18:24:16.853496 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-dfd9f7cc-b057-4f59-b62b-1b8a4584d74c req-a6e3b24a-2f1a-4c3d-a3ea-ad6abda319ef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047807 Aug 23 18:24:16.854449 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2934/6001] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:17.170907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2a0a241f-8067-40e2-8921-96d489b93191 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:17.171534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2a0a241f-8067-40e2-8921-96d489b93191 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:17.178641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a0a241f-8067-40e2-8921-96d489b93191 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:17.179138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a0a241f-8067-40e2-8921-96d489b93191 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:17.179659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a0a241f-8067-40e2-8921-96d489b93191 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:17.180379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a0a241f-8067-40e2-8921-96d489b93191 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:17.180851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a0a241f-8067-40e2-8921-96d489b93191 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:17.181369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a0a241f-8067-40e2-8921-96d489b93191 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:17.400367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2a0a241f-8067-40e2-8921-96d489b93191 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:17.409687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2a0a241f-8067-40e2-8921-96d489b93191 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:17.411353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2a0a241f-8067-40e2-8921-96d489b93191 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:17.412642 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2a0a241f-8067-40e2-8921-96d489b93191 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.247314 Aug 23 18:24:17.427138 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3068/6002] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:17 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:17.564348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0ed843dc-2bf6-41c3-b519-4926d0c5381e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:17.565066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0ed843dc-2bf6-41c3-b519-4926d0c5381e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:17.573218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ed843dc-2bf6-41c3-b519-4926d0c5381e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:17.579375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ed843dc-2bf6-41c3-b519-4926d0c5381e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:17.580062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ed843dc-2bf6-41c3-b519-4926d0c5381e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:17.580905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ed843dc-2bf6-41c3-b519-4926d0c5381e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:17.581475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ed843dc-2bf6-41c3-b519-4926d0c5381e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:17.582028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ed843dc-2bf6-41c3-b519-4926d0c5381e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:17.813232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0ed843dc-2bf6-41c3-b519-4926d0c5381e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:17.824553 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0ed843dc-2bf6-41c3-b519-4926d0c5381e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1367 microversion: 2.1 time: 0.265159 Aug 23 18:24:17.825333 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2935/6003] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:17 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1367 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:18.439051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3e57000b-c829-4fe2-b8eb-197ea40b8473 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:18.439674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3e57000b-c829-4fe2-b8eb-197ea40b8473 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:18.453749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e57000b-c829-4fe2-b8eb-197ea40b8473 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:18.454426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e57000b-c829-4fe2-b8eb-197ea40b8473 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:18.457110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e57000b-c829-4fe2-b8eb-197ea40b8473 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:18.458074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e57000b-c829-4fe2-b8eb-197ea40b8473 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:18.458681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e57000b-c829-4fe2-b8eb-197ea40b8473 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:18.459097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e57000b-c829-4fe2-b8eb-197ea40b8473 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:18.846439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d8d7d34f-2cc9-474d-b9df-ad9f02a5a35c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:18.847727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d8d7d34f-2cc9-474d-b9df-ad9f02a5a35c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:18.857560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8d7d34f-2cc9-474d-b9df-ad9f02a5a35c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:18.858340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8d7d34f-2cc9-474d-b9df-ad9f02a5a35c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:18.859108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8d7d34f-2cc9-474d-b9df-ad9f02a5a35c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:18.860021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8d7d34f-2cc9-474d-b9df-ad9f02a5a35c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:18.860955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8d7d34f-2cc9-474d-b9df-ad9f02a5a35c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:18.861549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8d7d34f-2cc9-474d-b9df-ad9f02a5a35c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:18.871580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e57000b-c829-4fe2-b8eb-197ea40b8473 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:18.889126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e57000b-c829-4fe2-b8eb-197ea40b8473 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:18.890859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e57000b-c829-4fe2-b8eb-197ea40b8473 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:18.892278 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3e57000b-c829-4fe2-b8eb-197ea40b8473 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.458077 Aug 23 18:24:18.893506 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3069/6004] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:18 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:19.077733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d8d7d34f-2cc9-474d-b9df-ad9f02a5a35c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:19.088771 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d8d7d34f-2cc9-474d-b9df-ad9f02a5a35c tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1557 microversion: 2.1 time: 0.246579 Aug 23 18:24:19.094586 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2936/6005] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:18 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1557 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:19.111223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-84928e2d-ca8e-40a4-a23b-2d5be42ab157 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:19.111734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-84928e2d-ca8e-40a4-a23b-2d5be42ab157 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:19.124108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84928e2d-ca8e-40a4-a23b-2d5be42ab157 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:19.124849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84928e2d-ca8e-40a4-a23b-2d5be42ab157 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:19.125487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84928e2d-ca8e-40a4-a23b-2d5be42ab157 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:19.126391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84928e2d-ca8e-40a4-a23b-2d5be42ab157 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:19.127037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84928e2d-ca8e-40a4-a23b-2d5be42ab157 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:19.127634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84928e2d-ca8e-40a4-a23b-2d5be42ab157 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:19.274899 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-84928e2d-ca8e-40a4-a23b-2d5be42ab157 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.167097 Aug 23 18:24:19.283703 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3070/6006] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:24:19 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:19.917620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49a65281-1067-4143-9e91-bf31591f5365 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:19.919090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49a65281-1067-4143-9e91-bf31591f5365 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:19.928700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a65281-1067-4143-9e91-bf31591f5365 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:19.929648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a65281-1067-4143-9e91-bf31591f5365 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:19.930258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a65281-1067-4143-9e91-bf31591f5365 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:19.932459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a65281-1067-4143-9e91-bf31591f5365 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:19.933435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a65281-1067-4143-9e91-bf31591f5365 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:19.934078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49a65281-1067-4143-9e91-bf31591f5365 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:20.295749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-49a65281-1067-4143-9e91-bf31591f5365 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:20.308672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-49a65281-1067-4143-9e91-bf31591f5365 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:20.318871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-49a65281-1067-4143-9e91-bf31591f5365 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:20.318871 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49a65281-1067-4143-9e91-bf31591f5365 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.405446 Aug 23 18:24:20.326629 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2937/6007] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:19 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:21.344076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-77faebab-94ad-4513-bcb4-88475751fe0f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:21.345361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-77faebab-94ad-4513-bcb4-88475751fe0f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:21.353158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77faebab-94ad-4513-bcb4-88475751fe0f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:21.354314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77faebab-94ad-4513-bcb4-88475751fe0f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:21.355152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77faebab-94ad-4513-bcb4-88475751fe0f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:21.356210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77faebab-94ad-4513-bcb4-88475751fe0f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:21.356851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77faebab-94ad-4513-bcb4-88475751fe0f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:21.357560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77faebab-94ad-4513-bcb4-88475751fe0f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:21.609477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-77faebab-94ad-4513-bcb4-88475751fe0f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:21.630139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-77faebab-94ad-4513-bcb4-88475751fe0f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:21.631710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-77faebab-94ad-4513-bcb4-88475751fe0f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:21.632936 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-77faebab-94ad-4513-bcb4-88475751fe0f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.294276 Aug 23 18:24:21.643872 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3071/6008] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:21 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:21.896270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-3fcb3590-7b18-43b3-9cbc-0fbd34d5b191 req-907e21e4-c904-4f41-9700-9d653ca7d04e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b33aebb-e0c2-43d1-9182-7818c49e0d6d", "tag": "a8d50a38-1a3f-4f55-a8e3-170e93de2b8f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:21.917479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3fcb3590-7b18-43b3-9cbc-0fbd34d5b191 req-907e21e4-c904-4f41-9700-9d653ca7d04e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:21.918650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3fcb3590-7b18-43b3-9cbc-0fbd34d5b191 req-907e21e4-c904-4f41-9700-9d653ca7d04e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:21.919382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3fcb3590-7b18-43b3-9cbc-0fbd34d5b191 req-907e21e4-c904-4f41-9700-9d653ca7d04e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:21.946950 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-3fcb3590-7b18-43b3-9cbc-0fbd34d5b191 req-907e21e4-c904-4f41-9700-9d653ca7d04e service nova] Creating event network-changed:a8d50a38-1a3f-4f55-a8e3-170e93de2b8f for instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d on n-h2-850468-16 Aug 23 18:24:21.953033 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-3fcb3590-7b18-43b3-9cbc-0fbd34d5b191 req-907e21e4-c904-4f41-9700-9d653ca7d04e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060376 Aug 23 18:24:21.954377 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2938/6009] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:22.673261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7ac36001-b647-45f8-9f49-70c831795cba tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:22.674669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7ac36001-b647-45f8-9f49-70c831795cba tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:22.685462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ac36001-b647-45f8-9f49-70c831795cba tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:22.686290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ac36001-b647-45f8-9f49-70c831795cba tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:22.686985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ac36001-b647-45f8-9f49-70c831795cba tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:22.687812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ac36001-b647-45f8-9f49-70c831795cba tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:22.688357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ac36001-b647-45f8-9f49-70c831795cba tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:22.688857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ac36001-b647-45f8-9f49-70c831795cba tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:23.317696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7ac36001-b647-45f8-9f49-70c831795cba tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:23.327139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7ac36001-b647-45f8-9f49-70c831795cba tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:23.328972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7ac36001-b647-45f8-9f49-70c831795cba tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:23.330176 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7ac36001-b647-45f8-9f49-70c831795cba tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.661157 Aug 23 18:24:23.347002 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3072/6010] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:22 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:24.356662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-16823e45-3447-47c3-9728-65e96b767dc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:24.357482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-16823e45-3447-47c3-9728-65e96b767dc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:24.366088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16823e45-3447-47c3-9728-65e96b767dc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:24.366970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16823e45-3447-47c3-9728-65e96b767dc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:24.368402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16823e45-3447-47c3-9728-65e96b767dc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:24.369554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16823e45-3447-47c3-9728-65e96b767dc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:24.370095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16823e45-3447-47c3-9728-65e96b767dc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:24.370732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16823e45-3447-47c3-9728-65e96b767dc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:24.517334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-16823e45-3447-47c3-9728-65e96b767dc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:24.528070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-16823e45-3447-47c3-9728-65e96b767dc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:24.529746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-16823e45-3447-47c3-9728-65e96b767dc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:24.531075 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-16823e45-3447-47c3-9728-65e96b767dc5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.179005 Aug 23 18:24:24.543288 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2939/6011] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:24 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:25.556806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-621b153c-3c1b-445a-ba60-4ea01a1a0a19 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:25.557437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-621b153c-3c1b-445a-ba60-4ea01a1a0a19 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:25.565025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-621b153c-3c1b-445a-ba60-4ea01a1a0a19 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:25.565982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-621b153c-3c1b-445a-ba60-4ea01a1a0a19 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:25.566655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-621b153c-3c1b-445a-ba60-4ea01a1a0a19 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:25.567517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-621b153c-3c1b-445a-ba60-4ea01a1a0a19 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:25.567980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-621b153c-3c1b-445a-ba60-4ea01a1a0a19 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:25.568763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-621b153c-3c1b-445a-ba60-4ea01a1a0a19 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:25.897755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-621b153c-3c1b-445a-ba60-4ea01a1a0a19 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:25.907925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-621b153c-3c1b-445a-ba60-4ea01a1a0a19 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:25.909559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-621b153c-3c1b-445a-ba60-4ea01a1a0a19 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:25.911077 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-621b153c-3c1b-445a-ba60-4ea01a1a0a19 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.358974 Aug 23 18:24:25.911831 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3073/6012] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:25 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:26.936591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c9cbbeda-3706-4a23-8579-40e352f6fc9a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:26.937212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c9cbbeda-3706-4a23-8579-40e352f6fc9a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:26.945834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9cbbeda-3706-4a23-8579-40e352f6fc9a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:26.946996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9cbbeda-3706-4a23-8579-40e352f6fc9a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:26.947432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9cbbeda-3706-4a23-8579-40e352f6fc9a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:26.948475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9cbbeda-3706-4a23-8579-40e352f6fc9a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:26.948931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9cbbeda-3706-4a23-8579-40e352f6fc9a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:26.949431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9cbbeda-3706-4a23-8579-40e352f6fc9a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:27.600025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1968469457", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "a4db0939-e209-4027-a688-d612c965e392"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:27.661451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] validate_networks() for [('a4db0939-e209-4027-a688-d612c965e392', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:24:27.909373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c9cbbeda-3706-4a23-8579-40e352f6fc9a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:27.920115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c9cbbeda-3706-4a23-8579-40e352f6fc9a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:27.922936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c9cbbeda-3706-4a23-8579-40e352f6fc9a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:27.924277 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c9cbbeda-3706-4a23-8579-40e352f6fc9a tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.991910 Aug 23 18:24:27.925553 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2940/6013] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:26 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:28.401234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:24:28.401744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:24:28.402155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:24:28.402594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:24:28.403542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:24:28.412952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:28.413635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:28.414429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:28.416508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:28.417428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:28.418039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:28.437042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Getting quotas for project e330ecd772bd472cbd221e1f90764c9a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:24:28.442842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Getting quotas for user 3be4b66dd9b947a78292e766cc2c0869 and project e330ecd772bd472cbd221e1f90764c9a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:24:28.457044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:24:28.459422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:24:28.507824 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ddb47f47-ab51-4255-bf64-ca1fcb521722 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.065690 Aug 23 18:24:28.509879 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3074/6014] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:24:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:24:28.520819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5458760a-e1da-49b2-91b9-c82e3012af68 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:28.521450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5458760a-e1da-49b2-91b9-c82e3012af68 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:28.607732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5458760a-e1da-49b2-91b9-c82e3012af68 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:28.624747 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5458760a-e1da-49b2-91b9-c82e3012af68 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1217 microversion: 2.1 time: 0.107902 Aug 23 18:24:28.625848 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2941/6015] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:28 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1217 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:28.950334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d74ac637-241d-400a-b9c1-8d1843cca9cc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:28.950994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d74ac637-241d-400a-b9c1-8d1843cca9cc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:28.959514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d74ac637-241d-400a-b9c1-8d1843cca9cc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:28.960486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d74ac637-241d-400a-b9c1-8d1843cca9cc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:28.961226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d74ac637-241d-400a-b9c1-8d1843cca9cc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:28.961986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d74ac637-241d-400a-b9c1-8d1843cca9cc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:28.962447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d74ac637-241d-400a-b9c1-8d1843cca9cc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:28.963089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d74ac637-241d-400a-b9c1-8d1843cca9cc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:29.120171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d74ac637-241d-400a-b9c1-8d1843cca9cc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:29.129463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d74ac637-241d-400a-b9c1-8d1843cca9cc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:29.131012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d74ac637-241d-400a-b9c1-8d1843cca9cc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:29.132509 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d74ac637-241d-400a-b9c1-8d1843cca9cc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.187042 Aug 23 18:24:29.133457 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3075/6016] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:28 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:24:29.645310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0716fc8a-6867-4dca-bc86-9d28c0ae25fa tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:29.646303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0716fc8a-6867-4dca-bc86-9d28c0ae25fa tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:29.654786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0716fc8a-6867-4dca-bc86-9d28c0ae25fa tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:29.655382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0716fc8a-6867-4dca-bc86-9d28c0ae25fa tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:29.655900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0716fc8a-6867-4dca-bc86-9d28c0ae25fa tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:29.656691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0716fc8a-6867-4dca-bc86-9d28c0ae25fa tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:29.657233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0716fc8a-6867-4dca-bc86-9d28c0ae25fa tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:29.657732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0716fc8a-6867-4dca-bc86-9d28c0ae25fa tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:29.745678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0716fc8a-6867-4dca-bc86-9d28c0ae25fa tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:29.755191 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0716fc8a-6867-4dca-bc86-9d28c0ae25fa tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1269 microversion: 2.1 time: 0.113772 Aug 23 18:24:29.756063 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2942/6017] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:29 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1269 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:30.164626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-504ae277-2293-47cf-89b5-4a4fdfa1b4f2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:30.165907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-504ae277-2293-47cf-89b5-4a4fdfa1b4f2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:30.200397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-504ae277-2293-47cf-89b5-4a4fdfa1b4f2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:30.201771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-504ae277-2293-47cf-89b5-4a4fdfa1b4f2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:30.203066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-504ae277-2293-47cf-89b5-4a4fdfa1b4f2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:30.204021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-504ae277-2293-47cf-89b5-4a4fdfa1b4f2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:30.206939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-504ae277-2293-47cf-89b5-4a4fdfa1b4f2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:30.209048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-504ae277-2293-47cf-89b5-4a4fdfa1b4f2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:30.262107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:30.546481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-504ae277-2293-47cf-89b5-4a4fdfa1b4f2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:30.560371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-504ae277-2293-47cf-89b5-4a4fdfa1b4f2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:30.562167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-504ae277-2293-47cf-89b5-4a4fdfa1b4f2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:30.563599 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-504ae277-2293-47cf-89b5-4a4fdfa1b4f2 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.408925 Aug 23 18:24:30.579551 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3076/6018] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:30 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:30.777741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0137eff0-ecc4-4631-a20f-9d6a525b936e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:30.778367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0137eff0-ecc4-4631-a20f-9d6a525b936e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:30.786286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0137eff0-ecc4-4631-a20f-9d6a525b936e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:30.786975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0137eff0-ecc4-4631-a20f-9d6a525b936e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:30.788143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0137eff0-ecc4-4631-a20f-9d6a525b936e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:30.788869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0137eff0-ecc4-4631-a20f-9d6a525b936e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:30.789321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0137eff0-ecc4-4631-a20f-9d6a525b936e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:30.790677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0137eff0-ecc4-4631-a20f-9d6a525b936e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:31.061895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0137eff0-ecc4-4631-a20f-9d6a525b936e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:31.078362 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0137eff0-ecc4-4631-a20f-9d6a525b936e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1317 microversion: 2.1 time: 0.303993 Aug 23 18:24:31.095091 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2943/6019] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:30 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1317 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:31.588816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-01c291d6-091b-4be8-9846-4fa8d5c541ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:31.589416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-01c291d6-091b-4be8-9846-4fa8d5c541ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:31.599284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01c291d6-091b-4be8-9846-4fa8d5c541ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:31.601927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01c291d6-091b-4be8-9846-4fa8d5c541ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:31.603153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01c291d6-091b-4be8-9846-4fa8d5c541ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:31.606437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01c291d6-091b-4be8-9846-4fa8d5c541ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:31.606942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01c291d6-091b-4be8-9846-4fa8d5c541ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:31.609142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01c291d6-091b-4be8-9846-4fa8d5c541ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:31.826969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-0b358f4e-ee0b-4de6-8359-de6eba248b7a req-a0ef733f-3f0a-424f-91c8-399d9fcf3e01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d294cdf-5e34-4f9b-b6b6-7028d1e23c84", "tag": "be805729-362c-482a-8460-80c562f33dcc"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:31.850019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0b358f4e-ee0b-4de6-8359-de6eba248b7a req-a0ef733f-3f0a-424f-91c8-399d9fcf3e01 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:31.853018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0b358f4e-ee0b-4de6-8359-de6eba248b7a req-a0ef733f-3f0a-424f-91c8-399d9fcf3e01 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:31.853969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0b358f4e-ee0b-4de6-8359-de6eba248b7a req-a0ef733f-3f0a-424f-91c8-399d9fcf3e01 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:31.868378 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-0b358f4e-ee0b-4de6-8359-de6eba248b7a req-a0ef733f-3f0a-424f-91c8-399d9fcf3e01 service nova] Creating event network-changed:be805729-362c-482a-8460-80c562f33dcc for instance 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 on n-h1-850468-16 Aug 23 18:24:31.876450 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-0b358f4e-ee0b-4de6-8359-de6eba248b7a req-a0ef733f-3f0a-424f-91c8-399d9fcf3e01 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055059 Aug 23 18:24:31.877587 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2944/6020] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:24:31.916745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-01c291d6-091b-4be8-9846-4fa8d5c541ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:31.926428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-01c291d6-091b-4be8-9846-4fa8d5c541ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:31.928960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-01c291d6-091b-4be8-9846-4fa8d5c541ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:31.931730 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-01c291d6-091b-4be8-9846-4fa8d5c541ff tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1743 microversion: 2.20 time: 0.345968 Aug 23 18:24:31.933670 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3077/6021] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:31 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1743 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:32.102667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-151f668d-81ca-422d-8c67-04dcaf7099f0 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:32.103731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-151f668d-81ca-422d-8c67-04dcaf7099f0 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:32.110396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-151f668d-81ca-422d-8c67-04dcaf7099f0 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:32.111205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-151f668d-81ca-422d-8c67-04dcaf7099f0 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:32.111876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-151f668d-81ca-422d-8c67-04dcaf7099f0 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:32.112788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-151f668d-81ca-422d-8c67-04dcaf7099f0 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:32.113370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-151f668d-81ca-422d-8c67-04dcaf7099f0 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:32.114014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-151f668d-81ca-422d-8c67-04dcaf7099f0 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:32.378349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-151f668d-81ca-422d-8c67-04dcaf7099f0 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:32.393094 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-151f668d-81ca-422d-8c67-04dcaf7099f0 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1317 microversion: 2.1 time: 0.295307 Aug 23 18:24:32.400216 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2945/6022] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:32 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:32.959505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-16453a00-b897-4d65-8d06-13a476c2f0cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:32.960420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-16453a00-b897-4d65-8d06-13a476c2f0cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:32.968855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16453a00-b897-4d65-8d06-13a476c2f0cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:32.969646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16453a00-b897-4d65-8d06-13a476c2f0cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:32.970464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16453a00-b897-4d65-8d06-13a476c2f0cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:32.971473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16453a00-b897-4d65-8d06-13a476c2f0cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:32.971882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16453a00-b897-4d65-8d06-13a476c2f0cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:32.972317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16453a00-b897-4d65-8d06-13a476c2f0cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:33.182528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-16453a00-b897-4d65-8d06-13a476c2f0cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:33.191971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-16453a00-b897-4d65-8d06-13a476c2f0cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:33.193531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-16453a00-b897-4d65-8d06-13a476c2f0cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:33.195008 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-16453a00-b897-4d65-8d06-13a476c2f0cb tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1743 microversion: 2.20 time: 0.240954 Aug 23 18:24:33.204898 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3078/6023] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:32 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1743 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:33.423586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8d76dfb8-416e-460d-8f47-3134dac91638 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:33.425068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8d76dfb8-416e-460d-8f47-3134dac91638 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:33.434713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d76dfb8-416e-460d-8f47-3134dac91638 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:33.435190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d76dfb8-416e-460d-8f47-3134dac91638 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:33.435839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d76dfb8-416e-460d-8f47-3134dac91638 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:33.436551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d76dfb8-416e-460d-8f47-3134dac91638 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:33.437005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d76dfb8-416e-460d-8f47-3134dac91638 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:33.437425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d76dfb8-416e-460d-8f47-3134dac91638 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:33.777115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8d76dfb8-416e-460d-8f47-3134dac91638 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:33.788884 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8d76dfb8-416e-460d-8f47-3134dac91638 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1317 microversion: 2.1 time: 0.369505 Aug 23 18:24:33.789419 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2946/6024] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:33 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1317 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:34.218273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0cb4e363-0592-4523-9168-fab299035eca tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:34.219082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0cb4e363-0592-4523-9168-fab299035eca tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:34.227071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cb4e363-0592-4523-9168-fab299035eca tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:34.227775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cb4e363-0592-4523-9168-fab299035eca tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:34.228497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cb4e363-0592-4523-9168-fab299035eca tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:34.229535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cb4e363-0592-4523-9168-fab299035eca tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:34.230340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cb4e363-0592-4523-9168-fab299035eca tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:34.230969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0cb4e363-0592-4523-9168-fab299035eca tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:34.458375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0cb4e363-0592-4523-9168-fab299035eca tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:34.467505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0cb4e363-0592-4523-9168-fab299035eca tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:34.469030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0cb4e363-0592-4523-9168-fab299035eca tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:34.470257 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0cb4e363-0592-4523-9168-fab299035eca tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1743 microversion: 2.20 time: 0.256755 Aug 23 18:24:34.470853 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3079/6025] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:34 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1743 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:34.810703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cfc707e-59d3-4f45-a51f-1de267255700 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:34.811346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0cfc707e-59d3-4f45-a51f-1de267255700 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:34.814143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:34.819401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cfc707e-59d3-4f45-a51f-1de267255700 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:34.819883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cfc707e-59d3-4f45-a51f-1de267255700 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:34.820324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cfc707e-59d3-4f45-a51f-1de267255700 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:34.821832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cfc707e-59d3-4f45-a51f-1de267255700 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:34.822524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cfc707e-59d3-4f45-a51f-1de267255700 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:34.822977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cfc707e-59d3-4f45-a51f-1de267255700 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:34.967066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0cfc707e-59d3-4f45-a51f-1de267255700 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:34.974722 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0cfc707e-59d3-4f45-a51f-1de267255700 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1317 microversion: 2.1 time: 0.167975 Aug 23 18:24:34.975298 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2947/6026] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:34 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1317 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:35.439730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-ab614cec-d49c-43bb-b240-08407d18fc28 req-1465b072-0f22-4d69-a0b4-a8f40689d756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9825ea0c-c842-4818-af65-f737a8c71689", "name": "network-vif-plugged", "status": "completed", "tag": "9cdade09-ac01-4d30-a9d4-cb5277d88470"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:35.453663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ab614cec-d49c-43bb-b240-08407d18fc28 req-1465b072-0f22-4d69-a0b4-a8f40689d756 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:35.454277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ab614cec-d49c-43bb-b240-08407d18fc28 req-1465b072-0f22-4d69-a0b4-a8f40689d756 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:35.454860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ab614cec-d49c-43bb-b240-08407d18fc28 req-1465b072-0f22-4d69-a0b4-a8f40689d756 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:35.471855 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-ab614cec-d49c-43bb-b240-08407d18fc28 req-1465b072-0f22-4d69-a0b4-a8f40689d756 service nova] Creating event network-vif-plugged:9cdade09-ac01-4d30-a9d4-cb5277d88470 for instance 9825ea0c-c842-4818-af65-f737a8c71689 on n-h1-850468-16 Aug 23 18:24:35.477714 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-ab614cec-d49c-43bb-b240-08407d18fc28 req-1465b072-0f22-4d69-a0b4-a8f40689d756 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041491 Aug 23 18:24:35.479313 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3080/6027] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:35.493907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a1a71c1f-f866-42d8-ba6a-b150d02afb4b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:35.494528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a1a71c1f-f866-42d8-ba6a-b150d02afb4b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:35.500672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1a71c1f-f866-42d8-ba6a-b150d02afb4b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:35.501363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1a71c1f-f866-42d8-ba6a-b150d02afb4b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:35.502032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1a71c1f-f866-42d8-ba6a-b150d02afb4b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:35.503058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1a71c1f-f866-42d8-ba6a-b150d02afb4b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:35.503873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1a71c1f-f866-42d8-ba6a-b150d02afb4b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:35.504314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1a71c1f-f866-42d8-ba6a-b150d02afb4b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:35.667381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a1a71c1f-f866-42d8-ba6a-b150d02afb4b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:35.675687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a1a71c1f-f866-42d8-ba6a-b150d02afb4b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:35.677338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a1a71c1f-f866-42d8-ba6a-b150d02afb4b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:35.678766 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a1a71c1f-f866-42d8-ba6a-b150d02afb4b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1743 microversion: 2.20 time: 0.189440 Aug 23 18:24:35.679489 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2948/6028] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:35 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1743 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:24:35.997964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9843162f-77fa-4b60-99cb-fa5095e480d8 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:35.999232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9843162f-77fa-4b60-99cb-fa5095e480d8 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:36.010053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9843162f-77fa-4b60-99cb-fa5095e480d8 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:36.010989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9843162f-77fa-4b60-99cb-fa5095e480d8 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:36.012643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9843162f-77fa-4b60-99cb-fa5095e480d8 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:36.014480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9843162f-77fa-4b60-99cb-fa5095e480d8 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:36.015487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9843162f-77fa-4b60-99cb-fa5095e480d8 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:36.016632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9843162f-77fa-4b60-99cb-fa5095e480d8 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:36.294533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9843162f-77fa-4b60-99cb-fa5095e480d8 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:36.309700 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9843162f-77fa-4b60-99cb-fa5095e480d8 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1317 microversion: 2.1 time: 0.318186 Aug 23 18:24:36.311248 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3081/6029] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:35 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1317 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:36.703148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a8018252-4b0e-4d7a-9f73-817fe95ef87b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:36.703752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a8018252-4b0e-4d7a-9f73-817fe95ef87b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:36.711213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8018252-4b0e-4d7a-9f73-817fe95ef87b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:36.711865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8018252-4b0e-4d7a-9f73-817fe95ef87b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:36.712495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8018252-4b0e-4d7a-9f73-817fe95ef87b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:36.713395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8018252-4b0e-4d7a-9f73-817fe95ef87b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:36.713851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8018252-4b0e-4d7a-9f73-817fe95ef87b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:36.714274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8018252-4b0e-4d7a-9f73-817fe95ef87b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:37.091589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a8018252-4b0e-4d7a-9f73-817fe95ef87b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:37.099848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a8018252-4b0e-4d7a-9f73-817fe95ef87b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:37.101366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a8018252-4b0e-4d7a-9f73-817fe95ef87b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:37.103072 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a8018252-4b0e-4d7a-9f73-817fe95ef87b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1743 microversion: 2.20 time: 0.403827 Aug 23 18:24:37.103814 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2949/6030] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:36 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1743 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:37.331286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0e5e0a14-8b36-44ac-85d1-02d6578bd223 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:37.332093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0e5e0a14-8b36-44ac-85d1-02d6578bd223 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:37.334956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:37.341534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e5e0a14-8b36-44ac-85d1-02d6578bd223 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:37.342258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e5e0a14-8b36-44ac-85d1-02d6578bd223 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:37.342682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e5e0a14-8b36-44ac-85d1-02d6578bd223 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:37.343404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e5e0a14-8b36-44ac-85d1-02d6578bd223 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:37.343868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e5e0a14-8b36-44ac-85d1-02d6578bd223 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:37.344301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e5e0a14-8b36-44ac-85d1-02d6578bd223 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:37.861051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0e5e0a14-8b36-44ac-85d1-02d6578bd223 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:37.871138 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0e5e0a14-8b36-44ac-85d1-02d6578bd223 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1317 microversion: 2.1 time: 0.543510 Aug 23 18:24:37.871743 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3082/6031] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:37 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1317 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:37.944115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4659d9b7-e94d-4831-922a-dc4c2433a60b req-7b96b759-d402-4739-803e-c344fd030bd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d294cdf-5e34-4f9b-b6b6-7028d1e23c84", "name": "network-vif-plugged", "status": "completed", "tag": "be805729-362c-482a-8460-80c562f33dcc"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:37.955548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4659d9b7-e94d-4831-922a-dc4c2433a60b req-7b96b759-d402-4739-803e-c344fd030bd2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:37.956033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4659d9b7-e94d-4831-922a-dc4c2433a60b req-7b96b759-d402-4739-803e-c344fd030bd2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:37.956490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4659d9b7-e94d-4831-922a-dc4c2433a60b req-7b96b759-d402-4739-803e-c344fd030bd2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:37.960323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:37.968753 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4659d9b7-e94d-4831-922a-dc4c2433a60b req-7b96b759-d402-4739-803e-c344fd030bd2 service nova] Creating event network-vif-plugged:be805729-362c-482a-8460-80c562f33dcc for instance 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 on n-h1-850468-16 Aug 23 18:24:37.973923 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4659d9b7-e94d-4831-922a-dc4c2433a60b req-7b96b759-d402-4739-803e-c344fd030bd2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034806 Aug 23 18:24:37.974935 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2950/6032] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:38.129866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d8c2f39c-dcef-4530-a841-d8ebfcec9df8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:38.130835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d8c2f39c-dcef-4530-a841-d8ebfcec9df8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:38.137906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8c2f39c-dcef-4530-a841-d8ebfcec9df8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:38.138718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8c2f39c-dcef-4530-a841-d8ebfcec9df8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:38.139359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8c2f39c-dcef-4530-a841-d8ebfcec9df8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:38.140330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8c2f39c-dcef-4530-a841-d8ebfcec9df8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:38.140959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8c2f39c-dcef-4530-a841-d8ebfcec9df8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:38.141635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8c2f39c-dcef-4530-a841-d8ebfcec9df8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:38.298941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d8c2f39c-dcef-4530-a841-d8ebfcec9df8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:38.308732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d8c2f39c-dcef-4530-a841-d8ebfcec9df8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:38.310400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d8c2f39c-dcef-4530-a841-d8ebfcec9df8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:38.311726 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d8c2f39c-dcef-4530-a841-d8ebfcec9df8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1743 microversion: 2.20 time: 0.187413 Aug 23 18:24:38.312402 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3083/6033] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:38 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1743 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:24:38.889391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:38.894026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-29bd5781-8b18-4145-8297-42eb80fbfa87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:38.894843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-29bd5781-8b18-4145-8297-42eb80fbfa87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:38.901402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29bd5781-8b18-4145-8297-42eb80fbfa87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:38.901888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29bd5781-8b18-4145-8297-42eb80fbfa87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:38.902321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29bd5781-8b18-4145-8297-42eb80fbfa87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:38.907910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29bd5781-8b18-4145-8297-42eb80fbfa87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:38.908419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29bd5781-8b18-4145-8297-42eb80fbfa87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:38.908845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-29bd5781-8b18-4145-8297-42eb80fbfa87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:39.182991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-29bd5781-8b18-4145-8297-42eb80fbfa87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:39.191300 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-29bd5781-8b18-4145-8297-42eb80fbfa87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1317 microversion: 2.1 time: 0.302769 Aug 23 18:24:39.192047 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2951/6034] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:38 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1317 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:39.335291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e8499660-61f5-4e40-8bde-45dfe04c1ef9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:39.335916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e8499660-61f5-4e40-8bde-45dfe04c1ef9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:39.342209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:39.343031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:39.345250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8499660-61f5-4e40-8bde-45dfe04c1ef9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:39.345748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8499660-61f5-4e40-8bde-45dfe04c1ef9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:39.346185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8499660-61f5-4e40-8bde-45dfe04c1ef9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:39.347140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8499660-61f5-4e40-8bde-45dfe04c1ef9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:39.347971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8499660-61f5-4e40-8bde-45dfe04c1ef9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:39.348416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8499660-61f5-4e40-8bde-45dfe04c1ef9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:39.501030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8499660-61f5-4e40-8bde-45dfe04c1ef9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:39.511837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8499660-61f5-4e40-8bde-45dfe04c1ef9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:39.513803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8499660-61f5-4e40-8bde-45dfe04c1ef9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:39.515105 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e8499660-61f5-4e40-8bde-45dfe04c1ef9 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1743 microversion: 2.20 time: 0.183733 Aug 23 18:24:39.515661 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3084/6035] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:39 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1743 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:40.214437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-714853c1-9d79-4e6f-81e2-3baa8cde3e61 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:40.216135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-714853c1-9d79-4e6f-81e2-3baa8cde3e61 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:40.232703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-714853c1-9d79-4e6f-81e2-3baa8cde3e61 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:40.233198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-714853c1-9d79-4e6f-81e2-3baa8cde3e61 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:40.233637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-714853c1-9d79-4e6f-81e2-3baa8cde3e61 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:40.244867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-714853c1-9d79-4e6f-81e2-3baa8cde3e61 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:40.245507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-714853c1-9d79-4e6f-81e2-3baa8cde3e61 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:40.245954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-714853c1-9d79-4e6f-81e2-3baa8cde3e61 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:40.540894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-06665f7e-283c-4d7c-b317-1bc53e116dac tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:40.541667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-06665f7e-283c-4d7c-b317-1bc53e116dac tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:40.552303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06665f7e-283c-4d7c-b317-1bc53e116dac tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:40.553270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06665f7e-283c-4d7c-b317-1bc53e116dac tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:40.554336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06665f7e-283c-4d7c-b317-1bc53e116dac tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:40.556031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06665f7e-283c-4d7c-b317-1bc53e116dac tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:40.558838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06665f7e-283c-4d7c-b317-1bc53e116dac tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:40.559558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-06665f7e-283c-4d7c-b317-1bc53e116dac tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:40.570189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-714853c1-9d79-4e6f-81e2-3baa8cde3e61 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:40.581647 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-714853c1-9d79-4e6f-81e2-3baa8cde3e61 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1506 microversion: 2.1 time: 0.372870 Aug 23 18:24:40.582244 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2952/6036] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:40 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1506 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:40.610578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f8d96d1c-611a-4648-b695-fe9a0b0d9c5c tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:40.610578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f8d96d1c-611a-4648-b695-fe9a0b0d9c5c tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:40.625926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8d96d1c-611a-4648-b695-fe9a0b0d9c5c tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:40.630014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8d96d1c-611a-4648-b695-fe9a0b0d9c5c tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:40.637852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8d96d1c-611a-4648-b695-fe9a0b0d9c5c tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:40.638895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8d96d1c-611a-4648-b695-fe9a0b0d9c5c tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:40.639545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8d96d1c-611a-4648-b695-fe9a0b0d9c5c tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:40.640143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8d96d1c-611a-4648-b695-fe9a0b0d9c5c tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:40.717565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f8d96d1c-611a-4648-b695-fe9a0b0d9c5c tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:40.719987 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f8d96d1c-611a-4648-b695-fe9a0b0d9c5c tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84/os-instance-actions/req-ddb47f47-ab51-4255-bf64-ca1fcb521722" status: 200 len: 313 microversion: 2.1 time: 0.118678 Aug 23 18:24:40.723051 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2953/6037] 10.222.0.61 () {58 vars in 1419 bytes} [Tue Aug 23 18:24:40 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84/os-instance-actions/req-ddb47f47-ab51-4255-bf64-ca1fcb521722 => generated 313 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:40.747095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b8bde63-7671-495e-a33a-c446ba72b7f9 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:40.756881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b8bde63-7671-495e-a33a-c446ba72b7f9 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:40.780524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b8bde63-7671-495e-a33a-c446ba72b7f9 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:40.781788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b8bde63-7671-495e-a33a-c446ba72b7f9 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:40.784141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b8bde63-7671-495e-a33a-c446ba72b7f9 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:40.807061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b8bde63-7671-495e-a33a-c446ba72b7f9 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:40.807893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b8bde63-7671-495e-a33a-c446ba72b7f9 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:40.808514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b8bde63-7671-495e-a33a-c446ba72b7f9 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:40.819055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-06665f7e-283c-4d7c-b317-1bc53e116dac tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:40.830301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-06665f7e-283c-4d7c-b317-1bc53e116dac tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:40.833856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-06665f7e-283c-4d7c-b317-1bc53e116dac tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:40.836036 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-06665f7e-283c-4d7c-b317-1bc53e116dac tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 0.299961 Aug 23 18:24:40.837715 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3085/6038] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:40 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:24:40.997858 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3b8bde63-7671-495e-a33a-c446ba72b7f9 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "POST /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84/action" status: 202 len: 0 microversion: 2.1 time: 0.264933 Aug 23 18:24:40.999176 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2954/6039] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:24:40 2022] POST /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:24:41.015420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e211dca9-e0bf-469b-8b42-14bed49b2551 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:41.016335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e211dca9-e0bf-469b-8b42-14bed49b2551 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:41.027670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e211dca9-e0bf-469b-8b42-14bed49b2551 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:41.030416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e211dca9-e0bf-469b-8b42-14bed49b2551 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:41.032688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e211dca9-e0bf-469b-8b42-14bed49b2551 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:41.033658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e211dca9-e0bf-469b-8b42-14bed49b2551 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:41.035254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e211dca9-e0bf-469b-8b42-14bed49b2551 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:41.036156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e211dca9-e0bf-469b-8b42-14bed49b2551 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:41.301255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e211dca9-e0bf-469b-8b42-14bed49b2551 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:41.310177 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e211dca9-e0bf-469b-8b42-14bed49b2551 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1508 microversion: 2.1 time: 0.307433 Aug 23 18:24:41.317722 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3086/6040] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:41 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1508 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:41.864291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9b50d4b3-8714-4fe1-a584-59921951a47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:41.865703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9b50d4b3-8714-4fe1-a584-59921951a47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:41.881660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b50d4b3-8714-4fe1-a584-59921951a47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:41.889473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b50d4b3-8714-4fe1-a584-59921951a47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:41.892863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b50d4b3-8714-4fe1-a584-59921951a47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:41.902332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b50d4b3-8714-4fe1-a584-59921951a47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:41.905047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b50d4b3-8714-4fe1-a584-59921951a47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:41.907003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b50d4b3-8714-4fe1-a584-59921951a47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:41.940234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d59453da-86cf-409c-97b0-a192b757cddd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:41.943397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d59453da-86cf-409c-97b0-a192b757cddd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:41.961424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59453da-86cf-409c-97b0-a192b757cddd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:41.962355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59453da-86cf-409c-97b0-a192b757cddd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:41.962996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59453da-86cf-409c-97b0-a192b757cddd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:41.963955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59453da-86cf-409c-97b0-a192b757cddd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:41.964634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59453da-86cf-409c-97b0-a192b757cddd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:41.965979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59453da-86cf-409c-97b0-a192b757cddd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:42.074665 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d59453da-86cf-409c-97b0-a192b757cddd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862/action" status: 200 len: 24572 microversion: 2.1 time: 0.138524 Aug 23 18:24:42.076401 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3087/6041] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:24:41 2022] POST /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862/action => generated 24572 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:24:42.333261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-58f64685-b233-40a8-b9b1-5e25663762cd tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:42.334068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-58f64685-b233-40a8-b9b1-5e25663762cd tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:42.345754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f64685-b233-40a8-b9b1-5e25663762cd tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:42.346257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f64685-b233-40a8-b9b1-5e25663762cd tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:42.346927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f64685-b233-40a8-b9b1-5e25663762cd tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:42.347644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f64685-b233-40a8-b9b1-5e25663762cd tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:42.348292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f64685-b233-40a8-b9b1-5e25663762cd tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:42.348890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f64685-b233-40a8-b9b1-5e25663762cd tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:42.667511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-58f64685-b233-40a8-b9b1-5e25663762cd tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:42.677283 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-58f64685-b233-40a8-b9b1-5e25663762cd tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1508 microversion: 2.1 time: 0.349295 Aug 23 18:24:42.694877 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3088/6042] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:42 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1508 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:42.825833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9b50d4b3-8714-4fe1-a584-59921951a47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:42.847889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9b50d4b3-8714-4fe1-a584-59921951a47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:42.849719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9b50d4b3-8714-4fe1-a584-59921951a47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:42.851002 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9b50d4b3-8714-4fe1-a584-59921951a47e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 0.992535 Aug 23 18:24:42.851966 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2955/6043] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:41 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:43.702996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1170d60c-905f-4bfd-9f1c-5666cb74721b tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:43.703634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1170d60c-905f-4bfd-9f1c-5666cb74721b tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:43.722792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1170d60c-905f-4bfd-9f1c-5666cb74721b tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:43.723313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1170d60c-905f-4bfd-9f1c-5666cb74721b tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:43.723779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1170d60c-905f-4bfd-9f1c-5666cb74721b tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:43.725111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1170d60c-905f-4bfd-9f1c-5666cb74721b tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:43.725607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1170d60c-905f-4bfd-9f1c-5666cb74721b tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:43.726070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1170d60c-905f-4bfd-9f1c-5666cb74721b tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:43.875423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ba9b3923-c8ea-4512-83c7-68ed9706d701 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:43.875914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ba9b3923-c8ea-4512-83c7-68ed9706d701 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:43.887111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba9b3923-c8ea-4512-83c7-68ed9706d701 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:43.892887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba9b3923-c8ea-4512-83c7-68ed9706d701 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:43.893815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba9b3923-c8ea-4512-83c7-68ed9706d701 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:43.894846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba9b3923-c8ea-4512-83c7-68ed9706d701 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:43.897086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba9b3923-c8ea-4512-83c7-68ed9706d701 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:43.898083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba9b3923-c8ea-4512-83c7-68ed9706d701 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:44.107825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1170d60c-905f-4bfd-9f1c-5666cb74721b tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:44.122670 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1170d60c-905f-4bfd-9f1c-5666cb74721b tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1513 microversion: 2.1 time: 0.423849 Aug 23 18:24:44.135249 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3089/6044] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:43 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1513 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:44.322967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ba9b3923-c8ea-4512-83c7-68ed9706d701 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:44.337032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ba9b3923-c8ea-4512-83c7-68ed9706d701 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:44.339074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ba9b3923-c8ea-4512-83c7-68ed9706d701 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:44.342670 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ba9b3923-c8ea-4512-83c7-68ed9706d701 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 0.471897 Aug 23 18:24:44.345946 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2956/6045] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:43 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:24:45.145667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d6537cf-1ffb-43c7-bd19-d12168e3d852 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:45.146306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7d6537cf-1ffb-43c7-bd19-d12168e3d852 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:45.165484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d6537cf-1ffb-43c7-bd19-d12168e3d852 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:45.166069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d6537cf-1ffb-43c7-bd19-d12168e3d852 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:45.166649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d6537cf-1ffb-43c7-bd19-d12168e3d852 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:45.167492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d6537cf-1ffb-43c7-bd19-d12168e3d852 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:45.168169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d6537cf-1ffb-43c7-bd19-d12168e3d852 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:45.169055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d6537cf-1ffb-43c7-bd19-d12168e3d852 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:45.376196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-52a13810-8fcf-4893-b3d1-60963bdefc92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:45.376815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-52a13810-8fcf-4893-b3d1-60963bdefc92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:45.387837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52a13810-8fcf-4893-b3d1-60963bdefc92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:45.389936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52a13810-8fcf-4893-b3d1-60963bdefc92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:45.399882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52a13810-8fcf-4893-b3d1-60963bdefc92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:45.401003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52a13810-8fcf-4893-b3d1-60963bdefc92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:45.401648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52a13810-8fcf-4893-b3d1-60963bdefc92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:45.402246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52a13810-8fcf-4893-b3d1-60963bdefc92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:45.545861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7d6537cf-1ffb-43c7-bd19-d12168e3d852 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:45.557165 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7d6537cf-1ffb-43c7-bd19-d12168e3d852 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1506 microversion: 2.1 time: 0.415484 Aug 23 18:24:45.558479 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3090/6046] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:45 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1506 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:45.584390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2c77d7b2-6185-4aa2-aec2-3aa592735770 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '.version_select at 0x7f27ec3b49d0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:45.585421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2c77d7b2-6185-4aa2-aec2-3aa592735770 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:45.594339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c77d7b2-6185-4aa2-aec2-3aa592735770 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:45.595239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c77d7b2-6185-4aa2-aec2-3aa592735770 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:45.595911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c77d7b2-6185-4aa2-aec2-3aa592735770 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:45.596880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c77d7b2-6185-4aa2-aec2-3aa592735770 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:45.597550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c77d7b2-6185-4aa2-aec2-3aa592735770 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:45.598205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c77d7b2-6185-4aa2-aec2-3aa592735770 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:45.657414 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2c77d7b2-6185-4aa2-aec2-3aa592735770 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.082510 Aug 23 18:24:45.659484 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3091/6047] 10.222.0.61 () {58 vars in 1296 bytes} [Tue Aug 23 18:24:45 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84/os-instance-actions => generated 611 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:45.676027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a04b6d5-3f82-463d-948b-bacfb9ab5c87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:45.676757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6a04b6d5-3f82-463d-948b-bacfb9ab5c87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:45.687027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a04b6d5-3f82-463d-948b-bacfb9ab5c87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:45.687728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a04b6d5-3f82-463d-948b-bacfb9ab5c87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:45.688333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a04b6d5-3f82-463d-948b-bacfb9ab5c87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:45.689260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a04b6d5-3f82-463d-948b-bacfb9ab5c87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:45.690208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a04b6d5-3f82-463d-948b-bacfb9ab5c87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:45.690980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a04b6d5-3f82-463d-948b-bacfb9ab5c87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:45.733385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6a04b6d5-3f82-463d-948b-bacfb9ab5c87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:24:45.745497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-52a13810-8fcf-4893-b3d1-60963bdefc92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:45.756797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-52a13810-8fcf-4893-b3d1-60963bdefc92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:45.761240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-52a13810-8fcf-4893-b3d1-60963bdefc92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:45.762851 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-52a13810-8fcf-4893-b3d1-60963bdefc92 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 0.396945 Aug 23 18:24:45.780779 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2957/6048] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:45 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:45.845979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:24:45.917032 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6a04b6d5-3f82-463d-948b-bacfb9ab5c87 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 204 len: 0 microversion: 2.1 time: 0.244564 Aug 23 18:24:45.927467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6acfd872-2798-4cde-9108-d6cd1265eeee tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:45.928621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6acfd872-2798-4cde-9108-d6cd1265eeee tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:45.932188 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3092/6049] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:24:45 2022] DELETE /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:24:45.938125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6acfd872-2798-4cde-9108-d6cd1265eeee tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:45.939000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6acfd872-2798-4cde-9108-d6cd1265eeee tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:45.939747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6acfd872-2798-4cde-9108-d6cd1265eeee tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:45.941728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6acfd872-2798-4cde-9108-d6cd1265eeee tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:45.942497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6acfd872-2798-4cde-9108-d6cd1265eeee tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:45.943354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6acfd872-2798-4cde-9108-d6cd1265eeee tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:46.220233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6acfd872-2798-4cde-9108-d6cd1265eeee tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:46.238221 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6acfd872-2798-4cde-9108-d6cd1265eeee tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1512 microversion: 2.1 time: 0.314100 Aug 23 18:24:46.239994 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2958/6050] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:45 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1512 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:46.787851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-740dee81-c93a-4421-9306-e3786d78436d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:46.788752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-740dee81-c93a-4421-9306-e3786d78436d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:46.799980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-740dee81-c93a-4421-9306-e3786d78436d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:46.800850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-740dee81-c93a-4421-9306-e3786d78436d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:46.801576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-740dee81-c93a-4421-9306-e3786d78436d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:46.802568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-740dee81-c93a-4421-9306-e3786d78436d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:46.803018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-740dee81-c93a-4421-9306-e3786d78436d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:46.803674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-740dee81-c93a-4421-9306-e3786d78436d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:47.089463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-740dee81-c93a-4421-9306-e3786d78436d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:47.098860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-740dee81-c93a-4421-9306-e3786d78436d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:47.101352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-740dee81-c93a-4421-9306-e3786d78436d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:47.104029 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-740dee81-c93a-4421-9306-e3786d78436d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 0.320993 Aug 23 18:24:47.119150 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3093/6051] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:46 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:47.263894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2da5585e-86f3-435f-a764-377b3860c53e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:47.265937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2da5585e-86f3-435f-a764-377b3860c53e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:47.278759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da5585e-86f3-435f-a764-377b3860c53e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:47.279668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da5585e-86f3-435f-a764-377b3860c53e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:47.280118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da5585e-86f3-435f-a764-377b3860c53e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:47.280882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da5585e-86f3-435f-a764-377b3860c53e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:47.281559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da5585e-86f3-435f-a764-377b3860c53e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:47.281987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2da5585e-86f3-435f-a764-377b3860c53e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:47.550940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2da5585e-86f3-435f-a764-377b3860c53e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:47.561182 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2da5585e-86f3-435f-a764-377b3860c53e tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1512 microversion: 2.1 time: 0.301654 Aug 23 18:24:47.577856 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2959/6052] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:47 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1512 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:48.130369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc7d83d5-3330-4960-a9e1-44676772f786 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:48.136832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc7d83d5-3330-4960-a9e1-44676772f786 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:48.145517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7d83d5-3330-4960-a9e1-44676772f786 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:48.146018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7d83d5-3330-4960-a9e1-44676772f786 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:48.151581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7d83d5-3330-4960-a9e1-44676772f786 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:48.152829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7d83d5-3330-4960-a9e1-44676772f786 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:48.152983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7d83d5-3330-4960-a9e1-44676772f786 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:48.157142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc7d83d5-3330-4960-a9e1-44676772f786 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:48.575581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-96103c69-324a-4f41-a456-695806e25104 req-240b46c0-eb52-4c88-ab5e-4b36cd307891 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d294cdf-5e34-4f9b-b6b6-7028d1e23c84", "name": "network-vif-deleted", "tag": "be805729-362c-482a-8460-80c562f33dcc"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:24:48.641370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-96103c69-324a-4f41-a456-695806e25104 req-240b46c0-eb52-4c88-ab5e-4b36cd307891 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:48.650699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-96103c69-324a-4f41-a456-695806e25104 req-240b46c0-eb52-4c88-ab5e-4b36cd307891 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:48.651051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-96103c69-324a-4f41-a456-695806e25104 req-240b46c0-eb52-4c88-ab5e-4b36cd307891 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:48.699989 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-96103c69-324a-4f41-a456-695806e25104 req-240b46c0-eb52-4c88-ab5e-4b36cd307891 service nova] Creating event network-vif-deleted:be805729-362c-482a-8460-80c562f33dcc for instance 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 on n-h1-850468-16 Aug 23 18:24:48.715158 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-96103c69-324a-4f41-a456-695806e25104 req-240b46c0-eb52-4c88-ab5e-4b36cd307891 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140642 Aug 23 18:24:48.716771 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2960/6053] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:24:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:48.736296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:48.737827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:48.752263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc7d83d5-3330-4960-a9e1-44676772f786 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:48.760290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:48.761129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:48.762274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:48.763382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:48.764590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:48.765197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:48.770162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc7d83d5-3330-4960-a9e1-44676772f786 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:48.773315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc7d83d5-3330-4960-a9e1-44676772f786 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:48.785307 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc7d83d5-3330-4960-a9e1-44676772f786 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 0.653448 Aug 23 18:24:48.803043 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3094/6054] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:48 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:48.879289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:48.879818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:48.880258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:48.881181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lazy-loading 'fault' on Instance uuid 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:24:48.989526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3be4b66dd9b947a78292e766cc2c0869', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e330ecd772bd472cbd221e1f90764c9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:49.012756 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a77287e-500e-4fe7-ba8c-deea6146e416 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 200 len: 1307 microversion: 2.1 time: 0.287444 Aug 23 18:24:49.029670 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2961/6055] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:48 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 1307 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:24:49.813458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b462290a-2491-4a4b-b7dc-f33c77d7afec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:49.814905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b462290a-2491-4a4b-b7dc-f33c77d7afec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:49.827316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b462290a-2491-4a4b-b7dc-f33c77d7afec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:49.829444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b462290a-2491-4a4b-b7dc-f33c77d7afec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:49.831625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b462290a-2491-4a4b-b7dc-f33c77d7afec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:49.832585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b462290a-2491-4a4b-b7dc-f33c77d7afec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:49.835378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b462290a-2491-4a4b-b7dc-f33c77d7afec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:49.837209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b462290a-2491-4a4b-b7dc-f33c77d7afec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:50.040585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b92a3807-d0ac-4965-8c63-69ef120e03c6 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:50.042106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b92a3807-d0ac-4965-8c63-69ef120e03c6 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] [instance: 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:50.051155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b92a3807-d0ac-4965-8c63-69ef120e03c6 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:50.052061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b92a3807-d0ac-4965-8c63-69ef120e03c6 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:50.052751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b92a3807-d0ac-4965-8c63-69ef120e03c6 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:50.053693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b92a3807-d0ac-4965-8c63-69ef120e03c6 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:50.054157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b92a3807-d0ac-4965-8c63-69ef120e03c6 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:50.054692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b92a3807-d0ac-4965-8c63-69ef120e03c6 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:50.078330 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-b92a3807-d0ac-4965-8c63-69ef120e03c6 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] HTTP exception thrown: Instance 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 could not be found. Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b92a3807-d0ac-4965-8c63-69ef120e03c6 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Request method failure captured: Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 HTTP/1.1 Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRtbFENDU7S3A0yDUWobReTgMD_kovVz6GfC7qPjz3-GRTpuGiBHrGzKd0VRgX5HiU1s-wAOhMYUD57r5l-Eai2ZtlNQC1t0USk2_9DyD14X31nSfD3r47O7cyBZX7SHafNpDdxvZKCT3jPXzLhX5u-1_e4wpZliB6v8moDYFtX8HzI Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: e330ecd772bd472cbd221e1f90764c9a Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-InstanceActionsTestJSON-1104424824 Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_e330ecd772bd472cbd221e1f90764c9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e330ecd772bd472cbd221e1f90764c9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/e330ecd772bd472cbd221e1f90764c9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/e330ecd772bd472cbd221e1f90764c9a"}]}] Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-InstanceActionsTestJSON-1104424824 Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: e330ecd772bd472cbd221e1f90764c9a Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1104424824 Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-InstanceActionsTestJSON-1104424824-project Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 3be4b66dd9b947a78292e766cc2c0869 Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-InstanceActionsTestJSON-1104424824-project Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 could not be found. Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '7d294cdf-5e34-4f9b-b6b6-7028d1e23c84'} Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 could not be found. Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 could not be found. Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:24:50.082514 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:50.088443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:24:50.088443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:24:50.088443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:24:50.088443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:24:50.088443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:24:50.088443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 could not be found. Aug 23 18:24:50.088443 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:24:50.088443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b92a3807-d0ac-4965-8c63-69ef120e03c6 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] Returning 404 to user: Instance 7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:24:50.088443 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b92a3807-d0ac-4965-8c63-69ef120e03c6 tempest-InstanceActionsTestJSON-1104424824 tempest-InstanceActionsTestJSON-1104424824-project] 10.222.0.61 "GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84" status: 404 len: 111 microversion: 2.1 time: 0.051536 Aug 23 18:24:50.089580 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2962/6056] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:24:50 2022] GET /compute/v2.1/servers/7d294cdf-5e34-4f9b-b6b6-7028d1e23c84 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:24:50.346856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b462290a-2491-4a4b-b7dc-f33c77d7afec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:50.369904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b462290a-2491-4a4b-b7dc-f33c77d7afec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:50.376113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b462290a-2491-4a4b-b7dc-f33c77d7afec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:50.377523 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b462290a-2491-4a4b-b7dc-f33c77d7afec tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 0.569107 Aug 23 18:24:50.386169 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3095/6057] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:49 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:51.409846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8893a395-a771-4c24-978a-7e82ea5c6cfc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:51.411202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8893a395-a771-4c24-978a-7e82ea5c6cfc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:51.427248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8893a395-a771-4c24-978a-7e82ea5c6cfc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:51.428049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8893a395-a771-4c24-978a-7e82ea5c6cfc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:51.428650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8893a395-a771-4c24-978a-7e82ea5c6cfc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:51.429567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8893a395-a771-4c24-978a-7e82ea5c6cfc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:51.436529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8893a395-a771-4c24-978a-7e82ea5c6cfc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:51.440510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8893a395-a771-4c24-978a-7e82ea5c6cfc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:52.568493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8893a395-a771-4c24-978a-7e82ea5c6cfc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:52.579094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8893a395-a771-4c24-978a-7e82ea5c6cfc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:52.581005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8893a395-a771-4c24-978a-7e82ea5c6cfc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:52.582461 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8893a395-a771-4c24-978a-7e82ea5c6cfc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 1.178558 Aug 23 18:24:52.588302 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2963/6058] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:51 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 1185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:53.281823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0d3b0287-1169-487f-8dab-9d410fff07c0 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:53.282661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0d3b0287-1169-487f-8dab-9d410fff07c0 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:53.293387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d3b0287-1169-487f-8dab-9d410fff07c0 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:53.294026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d3b0287-1169-487f-8dab-9d410fff07c0 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:53.294688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d3b0287-1169-487f-8dab-9d410fff07c0 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:53.295644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d3b0287-1169-487f-8dab-9d410fff07c0 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:53.296331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d3b0287-1169-487f-8dab-9d410fff07c0 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:53.296920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d3b0287-1169-487f-8dab-9d410fff07c0 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:53.331021 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0d3b0287-1169-487f-8dab-9d410fff07c0 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.053200 Aug 23 18:24:53.331843 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3096/6059] 10.222.0.61 () {58 vars in 1293 bytes} [Tue Aug 23 18:24:53 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f/os-server-password => generated 116 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:24:53.640543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-68c72cdb-26c1-48db-bbc4-9214f23f7287 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:53.640942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-68c72cdb-26c1-48db-bbc4-9214f23f7287 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:53.655491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68c72cdb-26c1-48db-bbc4-9214f23f7287 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:53.659515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68c72cdb-26c1-48db-bbc4-9214f23f7287 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:53.660563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68c72cdb-26c1-48db-bbc4-9214f23f7287 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:53.661714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68c72cdb-26c1-48db-bbc4-9214f23f7287 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:53.662397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68c72cdb-26c1-48db-bbc4-9214f23f7287 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:53.669315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68c72cdb-26c1-48db-bbc4-9214f23f7287 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:53.994505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-68c72cdb-26c1-48db-bbc4-9214f23f7287 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:54.009733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-68c72cdb-26c1-48db-bbc4-9214f23f7287 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:54.015055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-68c72cdb-26c1-48db-bbc4-9214f23f7287 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:54.016547 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-68c72cdb-26c1-48db-bbc4-9214f23f7287 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 0.405971 Aug 23 18:24:54.017757 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2964/6060] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:53 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:55.044633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ad62787-bd00-4619-a6bc-4bf2451a7020 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:55.045899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2ad62787-bd00-4619-a6bc-4bf2451a7020 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:55.059631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ad62787-bd00-4619-a6bc-4bf2451a7020 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:55.061750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ad62787-bd00-4619-a6bc-4bf2451a7020 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:55.062388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ad62787-bd00-4619-a6bc-4bf2451a7020 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:55.065554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ad62787-bd00-4619-a6bc-4bf2451a7020 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:55.066297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ad62787-bd00-4619-a6bc-4bf2451a7020 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:55.067198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ad62787-bd00-4619-a6bc-4bf2451a7020 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:55.620920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2ad62787-bd00-4619-a6bc-4bf2451a7020 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:55.634920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2ad62787-bd00-4619-a6bc-4bf2451a7020 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:55.642644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2ad62787-bd00-4619-a6bc-4bf2451a7020 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:55.645182 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2ad62787-bd00-4619-a6bc-4bf2451a7020 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 0.604627 Aug 23 18:24:55.648920 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3097/6061] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:55 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:56.674359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e073270-c35c-4b12-b1fa-b7fc442cccbd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:56.675921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e073270-c35c-4b12-b1fa-b7fc442cccbd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:56.692206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e073270-c35c-4b12-b1fa-b7fc442cccbd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:56.699294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e073270-c35c-4b12-b1fa-b7fc442cccbd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:56.701615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e073270-c35c-4b12-b1fa-b7fc442cccbd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:56.703919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e073270-c35c-4b12-b1fa-b7fc442cccbd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:56.706597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e073270-c35c-4b12-b1fa-b7fc442cccbd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:56.707952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e073270-c35c-4b12-b1fa-b7fc442cccbd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:57.453281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7e073270-c35c-4b12-b1fa-b7fc442cccbd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:57.471315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7e073270-c35c-4b12-b1fa-b7fc442cccbd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:57.473019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7e073270-c35c-4b12-b1fa-b7fc442cccbd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:57.474401 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e073270-c35c-4b12-b1fa-b7fc442cccbd tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 0.805431 Aug 23 18:24:57.475950 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2965/6062] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:56 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:24:58.501164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5df5abaa-b245-44c9-8abf-560ec51d1046 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:58.502436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5df5abaa-b245-44c9-8abf-560ec51d1046 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:58.517953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5df5abaa-b245-44c9-8abf-560ec51d1046 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:58.519823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5df5abaa-b245-44c9-8abf-560ec51d1046 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:58.520578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5df5abaa-b245-44c9-8abf-560ec51d1046 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:58.525001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5df5abaa-b245-44c9-8abf-560ec51d1046 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:58.525674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5df5abaa-b245-44c9-8abf-560ec51d1046 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:58.526286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5df5abaa-b245-44c9-8abf-560ec51d1046 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:58.885126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5df5abaa-b245-44c9-8abf-560ec51d1046 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:58.894236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5df5abaa-b245-44c9-8abf-560ec51d1046 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:58.896017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5df5abaa-b245-44c9-8abf-560ec51d1046 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:24:58.897239 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5df5abaa-b245-44c9-8abf-560ec51d1046 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 0.401401 Aug 23 18:24:58.902056 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3098/6063] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:58 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:24:59.927487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-18d130fe-80fd-46b3-8202-10ff8151a315 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:24:59.928783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-18d130fe-80fd-46b3-8202-10ff8151a315 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:24:59.938926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18d130fe-80fd-46b3-8202-10ff8151a315 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:59.939645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18d130fe-80fd-46b3-8202-10ff8151a315 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:59.940525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18d130fe-80fd-46b3-8202-10ff8151a315 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:24:59.941573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18d130fe-80fd-46b3-8202-10ff8151a315 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:24:59.942262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18d130fe-80fd-46b3-8202-10ff8151a315 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:24:59.943155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-18d130fe-80fd-46b3-8202-10ff8151a315 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:00.127701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-18d130fe-80fd-46b3-8202-10ff8151a315 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:00.136942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-18d130fe-80fd-46b3-8202-10ff8151a315 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:00.138670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-18d130fe-80fd-46b3-8202-10ff8151a315 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:00.140011 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-18d130fe-80fd-46b3-8202-10ff8151a315 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1738 microversion: 2.20 time: 0.217135 Aug 23 18:25:00.151077 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2966/6064] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:24:59 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:01.170713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-467e700c-2744-4023-a1b2-de403ab325df tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:01.171940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-467e700c-2744-4023-a1b2-de403ab325df tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:01.190321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-467e700c-2744-4023-a1b2-de403ab325df tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:01.190894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-467e700c-2744-4023-a1b2-de403ab325df tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:01.191249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-467e700c-2744-4023-a1b2-de403ab325df tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:01.191966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-467e700c-2744-4023-a1b2-de403ab325df tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:01.192425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-467e700c-2744-4023-a1b2-de403ab325df tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:01.192856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-467e700c-2744-4023-a1b2-de403ab325df tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:01.572823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-467e700c-2744-4023-a1b2-de403ab325df tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:01.583310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-467e700c-2744-4023-a1b2-de403ab325df tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:01.585858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-467e700c-2744-4023-a1b2-de403ab325df tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:01.587708 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-467e700c-2744-4023-a1b2-de403ab325df tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1720 microversion: 2.20 time: 0.421951 Aug 23 18:25:01.588508 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3099/6065] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:01 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1720 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:02.616064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-64d76a8f-5587-4daf-b96f-237df2bf0563 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:02.619547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-64d76a8f-5587-4daf-b96f-237df2bf0563 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:02.633689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64d76a8f-5587-4daf-b96f-237df2bf0563 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:02.634494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64d76a8f-5587-4daf-b96f-237df2bf0563 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:02.635134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64d76a8f-5587-4daf-b96f-237df2bf0563 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:02.638668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64d76a8f-5587-4daf-b96f-237df2bf0563 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:02.640665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64d76a8f-5587-4daf-b96f-237df2bf0563 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:02.641346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-64d76a8f-5587-4daf-b96f-237df2bf0563 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:02.670170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:02.811649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-64d76a8f-5587-4daf-b96f-237df2bf0563 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:02.821361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-64d76a8f-5587-4daf-b96f-237df2bf0563 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:02.824527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-64d76a8f-5587-4daf-b96f-237df2bf0563 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:02.827680 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-64d76a8f-5587-4daf-b96f-237df2bf0563 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1720 microversion: 2.20 time: 0.216569 Aug 23 18:25:02.829784 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2967/6066] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:02 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:03.855084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9dfd1ff9-6675-4761-bd66-252c15368f13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:03.855746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9dfd1ff9-6675-4761-bd66-252c15368f13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:03.868573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dfd1ff9-6675-4761-bd66-252c15368f13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:03.869073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dfd1ff9-6675-4761-bd66-252c15368f13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:03.869523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dfd1ff9-6675-4761-bd66-252c15368f13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:03.870242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dfd1ff9-6675-4761-bd66-252c15368f13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:03.870739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dfd1ff9-6675-4761-bd66-252c15368f13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:03.878056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dfd1ff9-6675-4761-bd66-252c15368f13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:03.963839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-a6d53365-14ba-49e7-92ad-2cb7a79ca2ef req-d9a257fe-304b-46a5-8be2-7700e946a829 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9825ea0c-c842-4818-af65-f737a8c71689", "name": "network-vif-unplugged", "status": "completed", "tag": "9cdade09-ac01-4d30-a9d4-cb5277d88470"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:03.984586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a6d53365-14ba-49e7-92ad-2cb7a79ca2ef req-d9a257fe-304b-46a5-8be2-7700e946a829 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:03.985091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a6d53365-14ba-49e7-92ad-2cb7a79ca2ef req-d9a257fe-304b-46a5-8be2-7700e946a829 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:03.985528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a6d53365-14ba-49e7-92ad-2cb7a79ca2ef req-d9a257fe-304b-46a5-8be2-7700e946a829 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:04.018293 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-a6d53365-14ba-49e7-92ad-2cb7a79ca2ef req-d9a257fe-304b-46a5-8be2-7700e946a829 service nova] Creating event network-vif-unplugged:9cdade09-ac01-4d30-a9d4-cb5277d88470 for instance 9825ea0c-c842-4818-af65-f737a8c71689 on n-h1-850468-16 Aug 23 18:25:04.028453 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-a6d53365-14ba-49e7-92ad-2cb7a79ca2ef req-d9a257fe-304b-46a5-8be2-7700e946a829 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068320 Aug 23 18:25:04.039417 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2968/6067] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:25:04.250969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9dfd1ff9-6675-4761-bd66-252c15368f13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:04.266297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9dfd1ff9-6675-4761-bd66-252c15368f13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:04.270732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9dfd1ff9-6675-4761-bd66-252c15368f13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:04.285415 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9dfd1ff9-6675-4761-bd66-252c15368f13 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1723 microversion: 2.20 time: 0.435804 Aug 23 18:25:04.288088 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3100/6068] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:03 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1723 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:04.311174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f15b7917-12d1-47b8-b2cb-6a436f15fc35 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "662cb169-51ca-496a-b791-820764c579b1"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:04.314955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f15b7917-12d1-47b8-b2cb-6a436f15fc35 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:04.322207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f15b7917-12d1-47b8-b2cb-6a436f15fc35 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:04.323246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f15b7917-12d1-47b8-b2cb-6a436f15fc35 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:04.323921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f15b7917-12d1-47b8-b2cb-6a436f15fc35 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:04.325048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f15b7917-12d1-47b8-b2cb-6a436f15fc35 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:04.325729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f15b7917-12d1-47b8-b2cb-6a436f15fc35 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:04.326379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f15b7917-12d1-47b8-b2cb-6a436f15fc35 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:04.774495 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f15b7917-12d1-47b8-b2cb-6a436f15fc35 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "POST /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.467822 Aug 23 18:25:04.776004 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2969/6069] 10.222.0.61 () {62 vars in 1364 bytes} [Tue Aug 23 18:25:04 2022] POST /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/os-volume_attachments => generated 188 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:25:04.943275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-26761e60-9dac-4280-95ac-67cb52c9396e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:04.945040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-26761e60-9dac-4280-95ac-67cb52c9396e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:04.952738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26761e60-9dac-4280-95ac-67cb52c9396e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:04.953537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26761e60-9dac-4280-95ac-67cb52c9396e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:04.954206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26761e60-9dac-4280-95ac-67cb52c9396e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:04.955175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26761e60-9dac-4280-95ac-67cb52c9396e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:04.955827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26761e60-9dac-4280-95ac-67cb52c9396e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:04.956475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26761e60-9dac-4280-95ac-67cb52c9396e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:05.385027 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-26761e60-9dac-4280-95ac-67cb52c9396e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/os-volume_attachments/662cb169-51ca-496a-b791-820764c579b1" status: 202 len: 0 microversion: 2.20 time: 0.445721 Aug 23 18:25:05.386093 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3101/6070] 10.222.0.61 () {60 vars in 1457 bytes} [Tue Aug 23 18:25:04 2022] DELETE /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/os-volume_attachments/662cb169-51ca-496a-b791-820764c579b1 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:25:05.503610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ad263f6b-03c3-454f-bb4e-8f54697b7732 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:05.504238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ad263f6b-03c3-454f-bb4e-8f54697b7732 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:05.527662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=48 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:05.529339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad263f6b-03c3-454f-bb4e-8f54697b7732 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:05.529873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad263f6b-03c3-454f-bb4e-8f54697b7732 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:05.534302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad263f6b-03c3-454f-bb4e-8f54697b7732 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:05.535114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad263f6b-03c3-454f-bb4e-8f54697b7732 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:05.535586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad263f6b-03c3-454f-bb4e-8f54697b7732 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:05.536183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad263f6b-03c3-454f-bb4e-8f54697b7732 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:05.594055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ad263f6b-03c3-454f-bb4e-8f54697b7732 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128807) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 18:25:05.733471 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ad263f6b-03c3-454f-bb4e-8f54697b7732 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "POST /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/action" status: 202 len: 0 microversion: 2.20 time: 0.236113 Aug 23 18:25:05.736434 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2970/6071] 10.222.0.61 () {62 vars in 1319 bytes} [Tue Aug 23 18:25:05 2022] POST /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:25:05.745132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1d11240f-6caa-4782-b727-20dacbf59b07 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:05.746098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1d11240f-6caa-4782-b727-20dacbf59b07 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:05.753295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d11240f-6caa-4782-b727-20dacbf59b07 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:05.754086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d11240f-6caa-4782-b727-20dacbf59b07 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:05.755547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d11240f-6caa-4782-b727-20dacbf59b07 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:05.756514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d11240f-6caa-4782-b727-20dacbf59b07 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:05.757390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d11240f-6caa-4782-b727-20dacbf59b07 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:05.758099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d11240f-6caa-4782-b727-20dacbf59b07 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:06.011665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d11240f-6caa-4782-b727-20dacbf59b07 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:06.048635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d11240f-6caa-4782-b727-20dacbf59b07 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:06.054395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d11240f-6caa-4782-b727-20dacbf59b07 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:06.057819 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1d11240f-6caa-4782-b727-20dacbf59b07 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1671 microversion: 2.20 time: 0.318344 Aug 23 18:25:06.060783 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3102/6072] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:05 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1671 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:07.092134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2ccbfb6e-a9c8-41af-8b63-94da2c5e4f8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:07.093305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2ccbfb6e-a9c8-41af-8b63-94da2c5e4f8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:07.132202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ccbfb6e-a9c8-41af-8b63-94da2c5e4f8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:07.136673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ccbfb6e-a9c8-41af-8b63-94da2c5e4f8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:07.139145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ccbfb6e-a9c8-41af-8b63-94da2c5e4f8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:07.143060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ccbfb6e-a9c8-41af-8b63-94da2c5e4f8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:07.143765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ccbfb6e-a9c8-41af-8b63-94da2c5e4f8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:07.144068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2ccbfb6e-a9c8-41af-8b63-94da2c5e4f8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:07.470612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2ccbfb6e-a9c8-41af-8b63-94da2c5e4f8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:07.492507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2ccbfb6e-a9c8-41af-8b63-94da2c5e4f8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:07.495544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2ccbfb6e-a9c8-41af-8b63-94da2c5e4f8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:07.500418 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2ccbfb6e-a9c8-41af-8b63-94da2c5e4f8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1671 microversion: 2.20 time: 0.418859 Aug 23 18:25:07.501032 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2971/6073] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:07 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1671 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:25:08.297318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1667158641", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "671023e8-2b2f-4337-b937-c92731b39a14"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:08.306664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:08.388293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] validate_networks() for [('671023e8-2b2f-4337-b937-c92731b39a14', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:25:08.524378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9f3f7538-feab-4615-a593-3a374179c2a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:08.525672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9f3f7538-feab-4615-a593-3a374179c2a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:08.533398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f3f7538-feab-4615-a593-3a374179c2a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:08.534150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f3f7538-feab-4615-a593-3a374179c2a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:08.534617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f3f7538-feab-4615-a593-3a374179c2a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:08.535356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f3f7538-feab-4615-a593-3a374179c2a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:08.535807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f3f7538-feab-4615-a593-3a374179c2a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:08.536242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f3f7538-feab-4615-a593-3a374179c2a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:08.778308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9f3f7538-feab-4615-a593-3a374179c2a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:08.787815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9f3f7538-feab-4615-a593-3a374179c2a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:08.791245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9f3f7538-feab-4615-a593-3a374179c2a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:08.792511 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9f3f7538-feab-4615-a593-3a374179c2a8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.272903 Aug 23 18:25:08.793238 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2972/6074] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:08 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:25:09.504991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:25:09.505436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:25:09.505900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:25:09.506319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:25:09.506766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:25:09.518257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:09.519134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:09.519897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:09.520824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:09.521499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:09.522271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:09.542893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Getting quotas for project 77f50f42ab4541f99d185c9770dfae57. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:25:09.549106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Getting quotas for user a277751bf4df4ed0820b2b0fd543c78d and project 77f50f42ab4541f99d185c9770dfae57. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:25:09.563244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:25:09.566004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:25:09.633080 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-891eaf81-164e-4dbf-8315-2a7317ea7379 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.473414 Aug 23 18:25:09.641328 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3103/6075] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:25:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:25:09.650047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f01b2d8b-7c8b-493e-95a3-125e9773ac19 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:09.653602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f01b2d8b-7c8b-493e-95a3-125e9773ac19 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:09.767057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f01b2d8b-7c8b-493e-95a3-125e9773ac19 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:09.777890 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f01b2d8b-7c8b-493e-95a3-125e9773ac19 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1224 microversion: 2.1 time: 0.132440 Aug 23 18:25:09.779672 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2973/6076] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:09 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1224 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:09.817713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-99cb7bd0-e9a8-41fe-afac-b4d81c8885a5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:09.818357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-99cb7bd0-e9a8-41fe-afac-b4d81c8885a5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:09.830524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99cb7bd0-e9a8-41fe-afac-b4d81c8885a5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:09.831065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99cb7bd0-e9a8-41fe-afac-b4d81c8885a5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:09.831518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99cb7bd0-e9a8-41fe-afac-b4d81c8885a5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:09.832253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99cb7bd0-e9a8-41fe-afac-b4d81c8885a5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:09.832748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99cb7bd0-e9a8-41fe-afac-b4d81c8885a5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:09.833143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99cb7bd0-e9a8-41fe-afac-b4d81c8885a5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:10.048044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-99cb7bd0-e9a8-41fe-afac-b4d81c8885a5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:10.058412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-99cb7bd0-e9a8-41fe-afac-b4d81c8885a5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:10.063582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-99cb7bd0-e9a8-41fe-afac-b4d81c8885a5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:10.065177 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-99cb7bd0-e9a8-41fe-afac-b4d81c8885a5 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.251872 Aug 23 18:25:10.071199 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3104/6077] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:09 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:10.802325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f0292757-4a37-4efc-b0f8-abf702105ce2 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:10.804796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f0292757-4a37-4efc-b0f8-abf702105ce2 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:10.824508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0292757-4a37-4efc-b0f8-abf702105ce2 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:10.827111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0292757-4a37-4efc-b0f8-abf702105ce2 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:10.831632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0292757-4a37-4efc-b0f8-abf702105ce2 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:10.834276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0292757-4a37-4efc-b0f8-abf702105ce2 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:10.837825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0292757-4a37-4efc-b0f8-abf702105ce2 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:10.839288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0292757-4a37-4efc-b0f8-abf702105ce2 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:10.994247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f0292757-4a37-4efc-b0f8-abf702105ce2 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:11.010958 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f0292757-4a37-4efc-b0f8-abf702105ce2 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1220 microversion: 2.1 time: 0.213470 Aug 23 18:25:11.014878 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2974/6078] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:10 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1220 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:11.104754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-52f673ca-d58a-486e-a0e6-c32151b8a462 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:11.106023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-52f673ca-d58a-486e-a0e6-c32151b8a462 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:11.125387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f673ca-d58a-486e-a0e6-c32151b8a462 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:11.128309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f673ca-d58a-486e-a0e6-c32151b8a462 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:11.131113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f673ca-d58a-486e-a0e6-c32151b8a462 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:11.134709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f673ca-d58a-486e-a0e6-c32151b8a462 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:11.137775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f673ca-d58a-486e-a0e6-c32151b8a462 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:11.139870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52f673ca-d58a-486e-a0e6-c32151b8a462 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:11.516582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-52f673ca-d58a-486e-a0e6-c32151b8a462 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:11.534313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-52f673ca-d58a-486e-a0e6-c32151b8a462 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:11.542476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-52f673ca-d58a-486e-a0e6-c32151b8a462 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:11.551687 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-52f673ca-d58a-486e-a0e6-c32151b8a462 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.453469 Aug 23 18:25:11.552895 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3105/6079] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:11 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:12.035712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-863acb8b-fb1b-49b4-83c5-f447da20916e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:12.043211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-863acb8b-fb1b-49b4-83c5-f447da20916e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:12.061377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-863acb8b-fb1b-49b4-83c5-f447da20916e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:12.062207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-863acb8b-fb1b-49b4-83c5-f447da20916e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:12.063009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-863acb8b-fb1b-49b4-83c5-f447da20916e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:12.063740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-863acb8b-fb1b-49b4-83c5-f447da20916e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:12.064371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-863acb8b-fb1b-49b4-83c5-f447da20916e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:12.077418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-863acb8b-fb1b-49b4-83c5-f447da20916e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:12.239748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-863acb8b-fb1b-49b4-83c5-f447da20916e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:12.254990 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-863acb8b-fb1b-49b4-83c5-f447da20916e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1276 microversion: 2.1 time: 0.223495 Aug 23 18:25:12.272521 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2975/6080] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:12 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1276 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:12.583198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-24685e18-6510-4644-b55e-8cc0d67f33f3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:12.584590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-24685e18-6510-4644-b55e-8cc0d67f33f3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:12.622935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24685e18-6510-4644-b55e-8cc0d67f33f3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:12.623852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24685e18-6510-4644-b55e-8cc0d67f33f3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:12.624737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24685e18-6510-4644-b55e-8cc0d67f33f3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:12.625900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24685e18-6510-4644-b55e-8cc0d67f33f3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:12.626933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24685e18-6510-4644-b55e-8cc0d67f33f3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:12.632948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24685e18-6510-4644-b55e-8cc0d67f33f3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:13.279901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d95c7bae-b6a4-43a3-8eff-107e435b5a5b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:13.280578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d95c7bae-b6a4-43a3-8eff-107e435b5a5b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:13.301662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d95c7bae-b6a4-43a3-8eff-107e435b5a5b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:13.303260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d95c7bae-b6a4-43a3-8eff-107e435b5a5b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:13.305993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d95c7bae-b6a4-43a3-8eff-107e435b5a5b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:13.311619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d95c7bae-b6a4-43a3-8eff-107e435b5a5b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:13.312503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d95c7bae-b6a4-43a3-8eff-107e435b5a5b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:13.313185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d95c7bae-b6a4-43a3-8eff-107e435b5a5b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:13.485088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d95c7bae-b6a4-43a3-8eff-107e435b5a5b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:13.498617 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d95c7bae-b6a4-43a3-8eff-107e435b5a5b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1282 microversion: 2.1 time: 0.224894 Aug 23 18:25:13.499297 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2976/6081] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:13 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1282 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:25:13.869581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-24685e18-6510-4644-b55e-8cc0d67f33f3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:13.889938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-24685e18-6510-4644-b55e-8cc0d67f33f3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:13.901059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-24685e18-6510-4644-b55e-8cc0d67f33f3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:13.903107 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-24685e18-6510-4644-b55e-8cc0d67f33f3 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 1.327774 Aug 23 18:25:13.911243 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3106/6082] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:12 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 1337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:14.527695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6da62ad8-5c0e-4f9d-9b99-7cf0ee3bf311 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:14.528396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6da62ad8-5c0e-4f9d-9b99-7cf0ee3bf311 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:14.543919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6da62ad8-5c0e-4f9d-9b99-7cf0ee3bf311 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:14.544442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6da62ad8-5c0e-4f9d-9b99-7cf0ee3bf311 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:14.548201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6da62ad8-5c0e-4f9d-9b99-7cf0ee3bf311 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:14.549053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6da62ad8-5c0e-4f9d-9b99-7cf0ee3bf311 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:14.553358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6da62ad8-5c0e-4f9d-9b99-7cf0ee3bf311 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:14.554356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6da62ad8-5c0e-4f9d-9b99-7cf0ee3bf311 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:14.778232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6da62ad8-5c0e-4f9d-9b99-7cf0ee3bf311 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:14.787705 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6da62ad8-5c0e-4f9d-9b99-7cf0ee3bf311 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.266263 Aug 23 18:25:14.802120 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2977/6083] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:14 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:14.940411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-97361320-4cca-4dff-b2eb-28468ad9a42e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:14.942727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-97361320-4cca-4dff-b2eb-28468ad9a42e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:14.966123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97361320-4cca-4dff-b2eb-28468ad9a42e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:14.971704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97361320-4cca-4dff-b2eb-28468ad9a42e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:14.972455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97361320-4cca-4dff-b2eb-28468ad9a42e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:14.977918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97361320-4cca-4dff-b2eb-28468ad9a42e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:14.978770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97361320-4cca-4dff-b2eb-28468ad9a42e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:14.981265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97361320-4cca-4dff-b2eb-28468ad9a42e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:15.055598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:15.743276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97361320-4cca-4dff-b2eb-28468ad9a42e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:15.777473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97361320-4cca-4dff-b2eb-28468ad9a42e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:15.779418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97361320-4cca-4dff-b2eb-28468ad9a42e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:15.796239 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-97361320-4cca-4dff-b2eb-28468ad9a42e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.856431 Aug 23 18:25:15.797914 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3107/6084] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:14 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:15.813535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7c1b4caa-896c-4eb7-aa21-37432beef119 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:15.815008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7c1b4caa-896c-4eb7-aa21-37432beef119 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:15.831509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c1b4caa-896c-4eb7-aa21-37432beef119 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:15.832240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c1b4caa-896c-4eb7-aa21-37432beef119 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:15.832876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c1b4caa-896c-4eb7-aa21-37432beef119 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:15.833770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c1b4caa-896c-4eb7-aa21-37432beef119 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:15.834383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c1b4caa-896c-4eb7-aa21-37432beef119 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:15.835017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c1b4caa-896c-4eb7-aa21-37432beef119 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:16.121044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-eb6de12c-9fb7-4d90-a7c1-2d66c240cfd6 req-78d4d5ea-2c76-4a0a-ae61-acf4b2851e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18b07854-1390-4dbe-8fa0-865c68fc1f20", "tag": "11136f24-0db0-4b8a-b9c3-a427bbd50bd0"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:16.162141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eb6de12c-9fb7-4d90-a7c1-2d66c240cfd6 req-78d4d5ea-2c76-4a0a-ae61-acf4b2851e53 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:16.163209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eb6de12c-9fb7-4d90-a7c1-2d66c240cfd6 req-78d4d5ea-2c76-4a0a-ae61-acf4b2851e53 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:16.165098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eb6de12c-9fb7-4d90-a7c1-2d66c240cfd6 req-78d4d5ea-2c76-4a0a-ae61-acf4b2851e53 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:16.196841 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-eb6de12c-9fb7-4d90-a7c1-2d66c240cfd6 req-78d4d5ea-2c76-4a0a-ae61-acf4b2851e53 service nova] Creating event network-changed:11136f24-0db0-4b8a-b9c3-a427bbd50bd0 for instance 18b07854-1390-4dbe-8fa0-865c68fc1f20 on n-h1-850468-16 Aug 23 18:25:16.212579 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-eb6de12c-9fb7-4d90-a7c1-2d66c240cfd6 req-78d4d5ea-2c76-4a0a-ae61-acf4b2851e53 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099471 Aug 23 18:25:16.218023 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3108/6085] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:25:16.338690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7c1b4caa-896c-4eb7-aa21-37432beef119 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:16.353565 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7c1b4caa-896c-4eb7-aa21-37432beef119 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.543929 Aug 23 18:25:16.361119 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2978/6086] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:15 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:16.821780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b693213e-a5c9-4493-bba4-a894400500b4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:16.822783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b693213e-a5c9-4493-bba4-a894400500b4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:16.834087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b693213e-a5c9-4493-bba4-a894400500b4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:16.834827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b693213e-a5c9-4493-bba4-a894400500b4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:16.838203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b693213e-a5c9-4493-bba4-a894400500b4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:16.839232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b693213e-a5c9-4493-bba4-a894400500b4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:16.847618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b693213e-a5c9-4493-bba4-a894400500b4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:16.848312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b693213e-a5c9-4493-bba4-a894400500b4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:17.180421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b693213e-a5c9-4493-bba4-a894400500b4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:17.192959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b693213e-a5c9-4493-bba4-a894400500b4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:17.196034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b693213e-a5c9-4493-bba4-a894400500b4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:17.201496 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b693213e-a5c9-4493-bba4-a894400500b4 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.384273 Aug 23 18:25:17.202089 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3109/6087] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:16 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:17.385034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a6556412-3c61-48cc-b2d3-5fde4e404e22 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:17.386672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a6556412-3c61-48cc-b2d3-5fde4e404e22 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:17.406771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6556412-3c61-48cc-b2d3-5fde4e404e22 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:17.407800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6556412-3c61-48cc-b2d3-5fde4e404e22 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:17.408508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6556412-3c61-48cc-b2d3-5fde4e404e22 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:17.412696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6556412-3c61-48cc-b2d3-5fde4e404e22 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:17.414712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6556412-3c61-48cc-b2d3-5fde4e404e22 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:17.415449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6556412-3c61-48cc-b2d3-5fde4e404e22 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:17.811623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a6556412-3c61-48cc-b2d3-5fde4e404e22 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:17.834380 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a6556412-3c61-48cc-b2d3-5fde4e404e22 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.456147 Aug 23 18:25:17.836115 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2979/6088] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:17 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:18.234314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7d2dd36-1937-4cb0-b5b4-cb696186ba87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:18.235981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d7d2dd36-1937-4cb0-b5b4-cb696186ba87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:18.255352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7d2dd36-1937-4cb0-b5b4-cb696186ba87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:18.258973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7d2dd36-1937-4cb0-b5b4-cb696186ba87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:18.260975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7d2dd36-1937-4cb0-b5b4-cb696186ba87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:18.265178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7d2dd36-1937-4cb0-b5b4-cb696186ba87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:18.268204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7d2dd36-1937-4cb0-b5b4-cb696186ba87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:18.268659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7d2dd36-1937-4cb0-b5b4-cb696186ba87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:18.634060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7d2dd36-1937-4cb0-b5b4-cb696186ba87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:18.649654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7d2dd36-1937-4cb0-b5b4-cb696186ba87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:18.651213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7d2dd36-1937-4cb0-b5b4-cb696186ba87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:18.652810 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7d2dd36-1937-4cb0-b5b4-cb696186ba87 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.424255 Aug 23 18:25:18.654076 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3110/6089] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:18 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:18.859341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c8c8f12-e3bd-4d6f-9117-b677f9b7577b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:18.859953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c8c8f12-e3bd-4d6f-9117-b677f9b7577b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:18.867436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c8c8f12-e3bd-4d6f-9117-b677f9b7577b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:18.868156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c8c8f12-e3bd-4d6f-9117-b677f9b7577b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:18.868596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c8c8f12-e3bd-4d6f-9117-b677f9b7577b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:18.869299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c8c8f12-e3bd-4d6f-9117-b677f9b7577b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:18.869760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c8c8f12-e3bd-4d6f-9117-b677f9b7577b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:18.870187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c8c8f12-e3bd-4d6f-9117-b677f9b7577b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:19.550585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c8c8f12-e3bd-4d6f-9117-b677f9b7577b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:19.559962 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c8c8f12-e3bd-4d6f-9117-b677f9b7577b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.704418 Aug 23 18:25:19.560544 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2980/6090] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:18 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:19.678002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5fec164a-e545-4079-aee3-2a7b29535b8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:19.678635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5fec164a-e545-4079-aee3-2a7b29535b8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:19.683404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:19.684084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:19.689803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fec164a-e545-4079-aee3-2a7b29535b8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:19.690440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fec164a-e545-4079-aee3-2a7b29535b8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:19.691127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fec164a-e545-4079-aee3-2a7b29535b8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:19.691841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fec164a-e545-4079-aee3-2a7b29535b8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:19.692473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fec164a-e545-4079-aee3-2a7b29535b8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:19.692919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fec164a-e545-4079-aee3-2a7b29535b8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:19.835615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5fec164a-e545-4079-aee3-2a7b29535b8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:19.844692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5fec164a-e545-4079-aee3-2a7b29535b8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:19.846190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5fec164a-e545-4079-aee3-2a7b29535b8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:19.847393 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5fec164a-e545-4079-aee3-2a7b29535b8d tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.174243 Aug 23 18:25:19.847959 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3111/6091] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:19 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:20.582940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb85dc8a-fc13-4215-80c7-0c5afc71562e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:20.584203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eb85dc8a-fc13-4215-80c7-0c5afc71562e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:20.587807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:20.593615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb85dc8a-fc13-4215-80c7-0c5afc71562e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:20.594216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb85dc8a-fc13-4215-80c7-0c5afc71562e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:20.594930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb85dc8a-fc13-4215-80c7-0c5afc71562e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:20.595656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb85dc8a-fc13-4215-80c7-0c5afc71562e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:20.596122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb85dc8a-fc13-4215-80c7-0c5afc71562e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:20.596555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb85dc8a-fc13-4215-80c7-0c5afc71562e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:20.751393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eb85dc8a-fc13-4215-80c7-0c5afc71562e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:20.760543 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eb85dc8a-fc13-4215-80c7-0c5afc71562e tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.182394 Aug 23 18:25:20.761511 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2981/6092] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:20 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:20.870227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-036640e9-4dce-4095-8e37-df196827f58e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:20.870873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-036640e9-4dce-4095-8e37-df196827f58e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:20.877839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-036640e9-4dce-4095-8e37-df196827f58e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:20.878416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-036640e9-4dce-4095-8e37-df196827f58e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:20.878961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-036640e9-4dce-4095-8e37-df196827f58e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:20.879739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-036640e9-4dce-4095-8e37-df196827f58e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:20.880268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-036640e9-4dce-4095-8e37-df196827f58e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:20.880785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-036640e9-4dce-4095-8e37-df196827f58e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:21.010633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-206d0dc0-2453-4f00-baa1-676fec04dd28 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:21.014942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-206d0dc0-2453-4f00-baa1-676fec04dd28 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:21.022239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-206d0dc0-2453-4f00-baa1-676fec04dd28 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:21.023585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-206d0dc0-2453-4f00-baa1-676fec04dd28 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:21.024092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-206d0dc0-2453-4f00-baa1-676fec04dd28 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:21.024829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-206d0dc0-2453-4f00-baa1-676fec04dd28 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:21.025302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-206d0dc0-2453-4f00-baa1-676fec04dd28 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:21.025907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-206d0dc0-2453-4f00-baa1-676fec04dd28 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:21.031093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:21.071285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-036640e9-4dce-4095-8e37-df196827f58e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:21.082098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-036640e9-4dce-4095-8e37-df196827f58e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:21.083741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-036640e9-4dce-4095-8e37-df196827f58e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:21.085552 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-036640e9-4dce-4095-8e37-df196827f58e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.218833 Aug 23 18:25:21.086239 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3112/6093] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:20 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:21.318147 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-206d0dc0-2453-4f00-baa1-676fec04dd28 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1834 microversion: 2.1 time: 0.316494 Aug 23 18:25:21.326652 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2982/6094] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:21 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1834 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:21.339421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-af2990d3-fe80-4e36-8584-bbdc888fc1d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:21.340049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-af2990d3-fe80-4e36-8584-bbdc888fc1d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:21.346428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af2990d3-fe80-4e36-8584-bbdc888fc1d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:21.346973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af2990d3-fe80-4e36-8584-bbdc888fc1d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:21.347419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af2990d3-fe80-4e36-8584-bbdc888fc1d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:21.348383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af2990d3-fe80-4e36-8584-bbdc888fc1d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:21.348853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af2990d3-fe80-4e36-8584-bbdc888fc1d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:21.349301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af2990d3-fe80-4e36-8584-bbdc888fc1d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:21.516805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-af2990d3-fe80-4e36-8584-bbdc888fc1d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:21.524794 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-af2990d3-fe80-4e36-8584-bbdc888fc1d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1681 microversion: 2.1 time: 0.189523 Aug 23 18:25:21.525397 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3113/6095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:21 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1681 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:21.681642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a2fbed60-6c57-403c-aefa-d4a36e3d0aea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:21.685779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a2fbed60-6c57-403c-aefa-d4a36e3d0aea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:21.693408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2fbed60-6c57-403c-aefa-d4a36e3d0aea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:21.694042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2fbed60-6c57-403c-aefa-d4a36e3d0aea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:21.695155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2fbed60-6c57-403c-aefa-d4a36e3d0aea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:21.695969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2fbed60-6c57-403c-aefa-d4a36e3d0aea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:21.696533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2fbed60-6c57-403c-aefa-d4a36e3d0aea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:21.697070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a2fbed60-6c57-403c-aefa-d4a36e3d0aea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:21.784849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6150d74-de4b-44b8-a09d-82af2a8d80bb tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:21.786142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6150d74-de4b-44b8-a09d-82af2a8d80bb tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:21.792178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6150d74-de4b-44b8-a09d-82af2a8d80bb tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:21.794475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6150d74-de4b-44b8-a09d-82af2a8d80bb tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:21.795139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6150d74-de4b-44b8-a09d-82af2a8d80bb tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:21.796049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6150d74-de4b-44b8-a09d-82af2a8d80bb tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:21.796686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6150d74-de4b-44b8-a09d-82af2a8d80bb tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:21.797311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6150d74-de4b-44b8-a09d-82af2a8d80bb tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:22.099624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6150d74-de4b-44b8-a09d-82af2a8d80bb tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:22.110767 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6150d74-de4b-44b8-a09d-82af2a8d80bb tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.329880 Aug 23 18:25:22.111624 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3114/6096] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:21 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:22.125076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-daca8f5d-b0b1-4daf-b455-2c3db197539e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:22.125937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-daca8f5d-b0b1-4daf-b455-2c3db197539e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:22.133386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daca8f5d-b0b1-4daf-b455-2c3db197539e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:22.133890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daca8f5d-b0b1-4daf-b455-2c3db197539e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:22.134340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daca8f5d-b0b1-4daf-b455-2c3db197539e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:22.135085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daca8f5d-b0b1-4daf-b455-2c3db197539e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:22.135552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daca8f5d-b0b1-4daf-b455-2c3db197539e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:22.135987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-daca8f5d-b0b1-4daf-b455-2c3db197539e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:22.365829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-daca8f5d-b0b1-4daf-b455-2c3db197539e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:22.375348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-daca8f5d-b0b1-4daf-b455-2c3db197539e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:22.376967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-daca8f5d-b0b1-4daf-b455-2c3db197539e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:22.378265 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-daca8f5d-b0b1-4daf-b455-2c3db197539e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.265496 Aug 23 18:25:22.379137 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3115/6097] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:22 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:23.132275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3a07ae4f-e85c-4911-8b3d-7b91a7e421e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:23.133715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3a07ae4f-e85c-4911-8b3d-7b91a7e421e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:23.140761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a07ae4f-e85c-4911-8b3d-7b91a7e421e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:23.141253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a07ae4f-e85c-4911-8b3d-7b91a7e421e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:23.141700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a07ae4f-e85c-4911-8b3d-7b91a7e421e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:23.142436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a07ae4f-e85c-4911-8b3d-7b91a7e421e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:23.142925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a07ae4f-e85c-4911-8b3d-7b91a7e421e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:23.143357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a07ae4f-e85c-4911-8b3d-7b91a7e421e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:23.282535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3a07ae4f-e85c-4911-8b3d-7b91a7e421e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:23.291250 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3a07ae4f-e85c-4911-8b3d-7b91a7e421e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.162827 Aug 23 18:25:23.291839 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3116/6098] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:23 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:25:23.403118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2503adc1-02d3-4c6e-aff5-578f2c233c5f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:23.403735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2503adc1-02d3-4c6e-aff5-578f2c233c5f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:23.409753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2503adc1-02d3-4c6e-aff5-578f2c233c5f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:23.410239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2503adc1-02d3-4c6e-aff5-578f2c233c5f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:23.410709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2503adc1-02d3-4c6e-aff5-578f2c233c5f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:23.411414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2503adc1-02d3-4c6e-aff5-578f2c233c5f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:23.411864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2503adc1-02d3-4c6e-aff5-578f2c233c5f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:23.412292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2503adc1-02d3-4c6e-aff5-578f2c233c5f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:23.555798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2503adc1-02d3-4c6e-aff5-578f2c233c5f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:23.566324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2503adc1-02d3-4c6e-aff5-578f2c233c5f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:23.567898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2503adc1-02d3-4c6e-aff5-578f2c233c5f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:23.569146 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2503adc1-02d3-4c6e-aff5-578f2c233c5f tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.169930 Aug 23 18:25:23.570586 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3117/6099] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:23 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:25:24.314211 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a2fbed60-6c57-403c-aefa-d4a36e3d0aea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862/action" status: 200 len: 32641 microversion: 2.1 time: 2.637701 Aug 23 18:25:24.314833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7b826b32-8350-4d1d-af7a-95379af19a79 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:24.315195 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2983/6100] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:25:21 2022] POST /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862/action => generated 32641 bytes in 2639 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:25:24.321600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7b826b32-8350-4d1d-af7a-95379af19a79 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:24.331661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b826b32-8350-4d1d-af7a-95379af19a79 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:24.332421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b826b32-8350-4d1d-af7a-95379af19a79 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:24.333105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b826b32-8350-4d1d-af7a-95379af19a79 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:24.334315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b826b32-8350-4d1d-af7a-95379af19a79 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:24.336045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b826b32-8350-4d1d-af7a-95379af19a79 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:24.336864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b826b32-8350-4d1d-af7a-95379af19a79 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:24.480844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-619ee320-4365-41a2-bd3a-47c2d93b4b16 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:24.481542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-619ee320-4365-41a2-bd3a-47c2d93b4b16 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:24.497491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-619ee320-4365-41a2-bd3a-47c2d93b4b16 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:24.498028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-619ee320-4365-41a2-bd3a-47c2d93b4b16 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:24.498487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-619ee320-4365-41a2-bd3a-47c2d93b4b16 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:24.502213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-619ee320-4365-41a2-bd3a-47c2d93b4b16 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:24.502876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-619ee320-4365-41a2-bd3a-47c2d93b4b16 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:24.508059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-619ee320-4365-41a2-bd3a-47c2d93b4b16 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:24.638160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-619ee320-4365-41a2-bd3a-47c2d93b4b16 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'db500e0bbe1c4b75a1ad33de0ace5e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95d4a02c3dc4ced91922808ed378ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:24.640151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-619ee320-4365-41a2-bd3a-47c2d93b4b16 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] flavor_id is None. Assuming migration. {{(pid=128807) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 23 18:25:24.640804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-619ee320-4365-41a2-bd3a-47c2d93b4b16 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128807) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 18:25:24.793617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7b826b32-8350-4d1d-af7a-95379af19a79 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:24.802173 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7b826b32-8350-4d1d-af7a-95379af19a79 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.492310 Aug 23 18:25:24.803123 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3118/6101] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:24 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:24.817974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f828ffd7-167d-42b6-9c36-c6ec9c6ea435 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:24.819314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f828ffd7-167d-42b6-9c36-c6ec9c6ea435 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:24.827405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f828ffd7-167d-42b6-9c36-c6ec9c6ea435 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:24.827907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f828ffd7-167d-42b6-9c36-c6ec9c6ea435 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:24.828360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f828ffd7-167d-42b6-9c36-c6ec9c6ea435 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:24.829172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f828ffd7-167d-42b6-9c36-c6ec9c6ea435 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:24.829631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f828ffd7-167d-42b6-9c36-c6ec9c6ea435 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:24.830506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f828ffd7-167d-42b6-9c36-c6ec9c6ea435 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:25.031565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f828ffd7-167d-42b6-9c36-c6ec9c6ea435 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:25.037703 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-619ee320-4365-41a2-bd3a-47c2d93b4b16 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862/action" status: 202 len: 0 microversion: 2.1 time: 0.562884 Aug 23 18:25:25.039201 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2984/6102] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:25:24 2022] POST /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:25:25.044316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f828ffd7-167d-42b6-9c36-c6ec9c6ea435 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:25.046271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f828ffd7-167d-42b6-9c36-c6ec9c6ea435 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:25.047373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b33ae31f-3adb-4bbf-ba5a-5f104760aac0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:25.048212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b33ae31f-3adb-4bbf-ba5a-5f104760aac0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:25.048912 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f828ffd7-167d-42b6-9c36-c6ec9c6ea435 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.243369 Aug 23 18:25:25.057239 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3119/6103] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:24 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:25.057564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b33ae31f-3adb-4bbf-ba5a-5f104760aac0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:25.058229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b33ae31f-3adb-4bbf-ba5a-5f104760aac0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:25.058867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b33ae31f-3adb-4bbf-ba5a-5f104760aac0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:25.059771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b33ae31f-3adb-4bbf-ba5a-5f104760aac0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:25.060382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b33ae31f-3adb-4bbf-ba5a-5f104760aac0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:25.060963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b33ae31f-3adb-4bbf-ba5a-5f104760aac0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:25.362397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b33ae31f-3adb-4bbf-ba5a-5f104760aac0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:25.373664 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b33ae31f-3adb-4bbf-ba5a-5f104760aac0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1690 microversion: 2.1 time: 0.330158 Aug 23 18:25:25.378243 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2985/6104] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:25 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1690 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:25.833326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-18451e28-5d58-447d-9f01-a16eb5b8d389 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:25.836156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-18451e28-5d58-447d-9f01-a16eb5b8d389 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:25.845307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18451e28-5d58-447d-9f01-a16eb5b8d389 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:25.845879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18451e28-5d58-447d-9f01-a16eb5b8d389 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:25.846479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18451e28-5d58-447d-9f01-a16eb5b8d389 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:25.847604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18451e28-5d58-447d-9f01-a16eb5b8d389 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:25.848795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18451e28-5d58-447d-9f01-a16eb5b8d389 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:25.849764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-18451e28-5d58-447d-9f01-a16eb5b8d389 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:26.076753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d86beb6-f408-46c0-853d-8036159a7de6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:26.077323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2d86beb6-f408-46c0-853d-8036159a7de6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:26.095352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d86beb6-f408-46c0-853d-8036159a7de6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:26.099586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d86beb6-f408-46c0-853d-8036159a7de6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:26.101062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d86beb6-f408-46c0-853d-8036159a7de6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:26.111257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d86beb6-f408-46c0-853d-8036159a7de6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:26.112640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d86beb6-f408-46c0-853d-8036159a7de6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:26.113385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d86beb6-f408-46c0-853d-8036159a7de6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:26.427606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-18451e28-5d58-447d-9f01-a16eb5b8d389 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:26.440866 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-18451e28-5d58-447d-9f01-a16eb5b8d389 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.616657 Aug 23 18:25:26.441700 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3120/6105] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:25 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:26.454721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2d86beb6-f408-46c0-853d-8036159a7de6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:26.463730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-154d3e4d-c8d3-44ed-8cf4-2169f4c590d5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:26.464548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-154d3e4d-c8d3-44ed-8cf4-2169f4c590d5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:26.472368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-154d3e4d-c8d3-44ed-8cf4-2169f4c590d5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:26.473054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-154d3e4d-c8d3-44ed-8cf4-2169f4c590d5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:26.473691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-154d3e4d-c8d3-44ed-8cf4-2169f4c590d5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:26.474633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-154d3e4d-c8d3-44ed-8cf4-2169f4c590d5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:26.475258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-154d3e4d-c8d3-44ed-8cf4-2169f4c590d5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:26.477361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-154d3e4d-c8d3-44ed-8cf4-2169f4c590d5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:26.483092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2d86beb6-f408-46c0-853d-8036159a7de6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:26.486022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2d86beb6-f408-46c0-853d-8036159a7de6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:26.488572 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2d86beb6-f408-46c0-853d-8036159a7de6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.416878 Aug 23 18:25:26.489375 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2986/6106] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:26 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:25:26.805515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-154d3e4d-c8d3-44ed-8cf4-2169f4c590d5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:26.820336 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-154d3e4d-c8d3-44ed-8cf4-2169f4c590d5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1690 microversion: 2.1 time: 0.361899 Aug 23 18:25:26.834758 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3121/6107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:26 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1690 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:27.467752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5366564d-ddf2-40f2-978c-8abdadce8486 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:27.468987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5366564d-ddf2-40f2-978c-8abdadce8486 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:27.478338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5366564d-ddf2-40f2-978c-8abdadce8486 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:27.478867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5366564d-ddf2-40f2-978c-8abdadce8486 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:27.479692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5366564d-ddf2-40f2-978c-8abdadce8486 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:27.480581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5366564d-ddf2-40f2-978c-8abdadce8486 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:27.481086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5366564d-ddf2-40f2-978c-8abdadce8486 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:27.481736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5366564d-ddf2-40f2-978c-8abdadce8486 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:27.519672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b95c173e-02c8-4b21-a947-e62aecc99542 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:27.521997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b95c173e-02c8-4b21-a947-e62aecc99542 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:27.540573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b95c173e-02c8-4b21-a947-e62aecc99542 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:27.541354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b95c173e-02c8-4b21-a947-e62aecc99542 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:27.542000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b95c173e-02c8-4b21-a947-e62aecc99542 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:27.543473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b95c173e-02c8-4b21-a947-e62aecc99542 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:27.544117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b95c173e-02c8-4b21-a947-e62aecc99542 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:27.545019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b95c173e-02c8-4b21-a947-e62aecc99542 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:27.720410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b95c173e-02c8-4b21-a947-e62aecc99542 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:27.731694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b95c173e-02c8-4b21-a947-e62aecc99542 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:27.733642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b95c173e-02c8-4b21-a947-e62aecc99542 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:27.735169 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b95c173e-02c8-4b21-a947-e62aecc99542 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.222868 Aug 23 18:25:27.736353 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3122/6108] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:27 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:27.843856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8946c80-1454-4e3d-888e-ab6bd0366c39 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:27.844519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8946c80-1454-4e3d-888e-ab6bd0366c39 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:27.850858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8946c80-1454-4e3d-888e-ab6bd0366c39 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:27.851680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8946c80-1454-4e3d-888e-ab6bd0366c39 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:27.852287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8946c80-1454-4e3d-888e-ab6bd0366c39 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:27.854110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8946c80-1454-4e3d-888e-ab6bd0366c39 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:27.854819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8946c80-1454-4e3d-888e-ab6bd0366c39 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:27.855416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8946c80-1454-4e3d-888e-ab6bd0366c39 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:28.027979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8946c80-1454-4e3d-888e-ab6bd0366c39 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:28.052695 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8946c80-1454-4e3d-888e-ab6bd0366c39 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1690 microversion: 2.1 time: 0.213238 Aug 23 18:25:28.055397 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3123/6109] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:27 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1690 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:25:28.425639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5366564d-ddf2-40f2-978c-8abdadce8486 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:28.444082 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5366564d-ddf2-40f2-978c-8abdadce8486 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.981090 Aug 23 18:25:28.450021 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2987/6110] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:27 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:28.762125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a8ac7eba-038a-4eb9-a41f-71f458cbaa5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:28.764349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a8ac7eba-038a-4eb9-a41f-71f458cbaa5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:28.779042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8ac7eba-038a-4eb9-a41f-71f458cbaa5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:28.780644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8ac7eba-038a-4eb9-a41f-71f458cbaa5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:28.781326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8ac7eba-038a-4eb9-a41f-71f458cbaa5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:28.782311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8ac7eba-038a-4eb9-a41f-71f458cbaa5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:28.783033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8ac7eba-038a-4eb9-a41f-71f458cbaa5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:28.784202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8ac7eba-038a-4eb9-a41f-71f458cbaa5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:29.011562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a8ac7eba-038a-4eb9-a41f-71f458cbaa5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:29.018914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:29.027310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a8ac7eba-038a-4eb9-a41f-71f458cbaa5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:29.029041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a8ac7eba-038a-4eb9-a41f-71f458cbaa5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:29.030462 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a8ac7eba-038a-4eb9-a41f-71f458cbaa5e tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.272498 Aug 23 18:25:29.031227 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3124/6111] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:28 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:29.077363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8a68601a-303a-41c9-89a9-cac2f6012483 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:29.078704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8a68601a-303a-41c9-89a9-cac2f6012483 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:29.089515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a68601a-303a-41c9-89a9-cac2f6012483 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:29.092831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a68601a-303a-41c9-89a9-cac2f6012483 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:29.093487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a68601a-303a-41c9-89a9-cac2f6012483 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:29.094864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a68601a-303a-41c9-89a9-cac2f6012483 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:29.095437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a68601a-303a-41c9-89a9-cac2f6012483 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:29.096078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a68601a-303a-41c9-89a9-cac2f6012483 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:29.338678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8a68601a-303a-41c9-89a9-cac2f6012483 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:29.356452 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8a68601a-303a-41c9-89a9-cac2f6012483 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1690 microversion: 2.1 time: 0.284040 Aug 23 18:25:29.372997 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2988/6112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:29 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1690 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:29.479266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b70c5322-32ad-4b34-95d1-4591437e9869 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:29.480177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b70c5322-32ad-4b34-95d1-4591437e9869 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:29.502696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b70c5322-32ad-4b34-95d1-4591437e9869 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:29.502988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b70c5322-32ad-4b34-95d1-4591437e9869 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:29.503648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b70c5322-32ad-4b34-95d1-4591437e9869 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:29.504581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b70c5322-32ad-4b34-95d1-4591437e9869 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:29.505217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b70c5322-32ad-4b34-95d1-4591437e9869 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:29.506105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b70c5322-32ad-4b34-95d1-4591437e9869 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:29.692338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b70c5322-32ad-4b34-95d1-4591437e9869 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:29.702369 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b70c5322-32ad-4b34-95d1-4591437e9869 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.236048 Aug 23 18:25:29.703430 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3125/6113] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:29 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:30.053969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-43c057bb-846e-496a-8c1d-1ed8c8ac8b82 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:30.055123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-43c057bb-846e-496a-8c1d-1ed8c8ac8b82 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:30.061261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43c057bb-846e-496a-8c1d-1ed8c8ac8b82 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:30.061973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43c057bb-846e-496a-8c1d-1ed8c8ac8b82 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:30.062407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43c057bb-846e-496a-8c1d-1ed8c8ac8b82 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:30.063296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43c057bb-846e-496a-8c1d-1ed8c8ac8b82 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:30.063741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43c057bb-846e-496a-8c1d-1ed8c8ac8b82 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:30.064374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43c057bb-846e-496a-8c1d-1ed8c8ac8b82 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:30.214757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-43c057bb-846e-496a-8c1d-1ed8c8ac8b82 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:30.225899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-43c057bb-846e-496a-8c1d-1ed8c8ac8b82 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:30.227590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-43c057bb-846e-496a-8c1d-1ed8c8ac8b82 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:30.228768 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-43c057bb-846e-496a-8c1d-1ed8c8ac8b82 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.179329 Aug 23 18:25:30.229461 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2989/6114] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:30 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:30.379223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0382a54c-c1b4-47fd-abd8-a0bd4531d4af tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:30.381042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0382a54c-c1b4-47fd-abd8-a0bd4531d4af tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:30.392308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0382a54c-c1b4-47fd-abd8-a0bd4531d4af tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:30.392881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0382a54c-c1b4-47fd-abd8-a0bd4531d4af tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:30.393335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0382a54c-c1b4-47fd-abd8-a0bd4531d4af tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:30.394144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0382a54c-c1b4-47fd-abd8-a0bd4531d4af tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:30.394823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0382a54c-c1b4-47fd-abd8-a0bd4531d4af tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:30.395454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0382a54c-c1b4-47fd-abd8-a0bd4531d4af tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:30.596563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-fcd38065-9263-46f5-86da-999ac473260a req-33563f65-3070-4c41-b8ff-3be03d1dcd91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9825ea0c-c842-4818-af65-f737a8c71689", "name": "network-vif-plugged", "status": "completed", "tag": "9cdade09-ac01-4d30-a9d4-cb5277d88470"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:30.608402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fcd38065-9263-46f5-86da-999ac473260a req-33563f65-3070-4c41-b8ff-3be03d1dcd91 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:30.609080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fcd38065-9263-46f5-86da-999ac473260a req-33563f65-3070-4c41-b8ff-3be03d1dcd91 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:30.609762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-fcd38065-9263-46f5-86da-999ac473260a req-33563f65-3070-4c41-b8ff-3be03d1dcd91 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:30.631962 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-fcd38065-9263-46f5-86da-999ac473260a req-33563f65-3070-4c41-b8ff-3be03d1dcd91 service nova] Creating event network-vif-plugged:9cdade09-ac01-4d30-a9d4-cb5277d88470 for instance 9825ea0c-c842-4818-af65-f737a8c71689 on n-h1-850468-16 Aug 23 18:25:30.649730 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-fcd38065-9263-46f5-86da-999ac473260a req-33563f65-3070-4c41-b8ff-3be03d1dcd91 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056510 Aug 23 18:25:30.651120 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2990/6115] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:25:30.688683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0382a54c-c1b4-47fd-abd8-a0bd4531d4af tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:30.697297 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0382a54c-c1b4-47fd-abd8-a0bd4531d4af tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1690 microversion: 2.1 time: 0.322031 Aug 23 18:25:30.698741 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3126/6116] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:30 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1690 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:30.729955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e2b37ed-6bbe-4507-9184-f5ab5f07d1a8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:30.731835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e2b37ed-6bbe-4507-9184-f5ab5f07d1a8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:30.743209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e2b37ed-6bbe-4507-9184-f5ab5f07d1a8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:30.744898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e2b37ed-6bbe-4507-9184-f5ab5f07d1a8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:30.745524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e2b37ed-6bbe-4507-9184-f5ab5f07d1a8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:30.747314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e2b37ed-6bbe-4507-9184-f5ab5f07d1a8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:30.748503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e2b37ed-6bbe-4507-9184-f5ab5f07d1a8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:30.749158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e2b37ed-6bbe-4507-9184-f5ab5f07d1a8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:30.903523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e2b37ed-6bbe-4507-9184-f5ab5f07d1a8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:30.911578 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e2b37ed-6bbe-4507-9184-f5ab5f07d1a8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.190523 Aug 23 18:25:30.912748 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2991/6117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:30 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:31.253139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5599b1ac-4f6a-4ed0-80be-7c53dafc1839 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:31.254767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5599b1ac-4f6a-4ed0-80be-7c53dafc1839 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:31.264564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5599b1ac-4f6a-4ed0-80be-7c53dafc1839 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:31.265367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5599b1ac-4f6a-4ed0-80be-7c53dafc1839 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:31.266056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5599b1ac-4f6a-4ed0-80be-7c53dafc1839 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:31.267017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5599b1ac-4f6a-4ed0-80be-7c53dafc1839 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:31.267924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5599b1ac-4f6a-4ed0-80be-7c53dafc1839 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:31.268568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5599b1ac-4f6a-4ed0-80be-7c53dafc1839 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:31.576153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5599b1ac-4f6a-4ed0-80be-7c53dafc1839 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:31.585613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5599b1ac-4f6a-4ed0-80be-7c53dafc1839 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:31.587171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5599b1ac-4f6a-4ed0-80be-7c53dafc1839 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:31.588349 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5599b1ac-4f6a-4ed0-80be-7c53dafc1839 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.339941 Aug 23 18:25:31.589314 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3127/6118] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:31 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:31.719039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9830450-c8a3-473d-a1be-0e720f5c82cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:31.720218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d9830450-c8a3-473d-a1be-0e720f5c82cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:31.729431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9830450-c8a3-473d-a1be-0e720f5c82cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:31.729949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9830450-c8a3-473d-a1be-0e720f5c82cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:31.730715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9830450-c8a3-473d-a1be-0e720f5c82cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:31.731437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9830450-c8a3-473d-a1be-0e720f5c82cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:31.731906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9830450-c8a3-473d-a1be-0e720f5c82cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:31.732470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9830450-c8a3-473d-a1be-0e720f5c82cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:31.934125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f7f88fe-d102-4fe5-8d17-eb01cb328570 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:31.934683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f7f88fe-d102-4fe5-8d17-eb01cb328570 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:31.940607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f7f88fe-d102-4fe5-8d17-eb01cb328570 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:31.941088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f7f88fe-d102-4fe5-8d17-eb01cb328570 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:31.941697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f7f88fe-d102-4fe5-8d17-eb01cb328570 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:31.942473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f7f88fe-d102-4fe5-8d17-eb01cb328570 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:31.942956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f7f88fe-d102-4fe5-8d17-eb01cb328570 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:31.943382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f7f88fe-d102-4fe5-8d17-eb01cb328570 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:32.033256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d9830450-c8a3-473d-a1be-0e720f5c82cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:32.042962 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d9830450-c8a3-473d-a1be-0e720f5c82cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1690 microversion: 2.1 time: 0.328089 Aug 23 18:25:32.043605 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2992/6119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:31 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1690 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:32.089901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f7f88fe-d102-4fe5-8d17-eb01cb328570 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:32.098227 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f7f88fe-d102-4fe5-8d17-eb01cb328570 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.168214 Aug 23 18:25:32.099053 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3128/6120] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:31 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:25:32.612534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f2e71b8e-d23a-4afb-9e25-48f59659ec91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:32.613314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f2e71b8e-d23a-4afb-9e25-48f59659ec91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:32.619999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2e71b8e-d23a-4afb-9e25-48f59659ec91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:32.620546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2e71b8e-d23a-4afb-9e25-48f59659ec91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:32.620987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2e71b8e-d23a-4afb-9e25-48f59659ec91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:32.621701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2e71b8e-d23a-4afb-9e25-48f59659ec91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:32.622154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2e71b8e-d23a-4afb-9e25-48f59659ec91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:32.622612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2e71b8e-d23a-4afb-9e25-48f59659ec91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:32.806811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f2e71b8e-d23a-4afb-9e25-48f59659ec91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:32.815827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f2e71b8e-d23a-4afb-9e25-48f59659ec91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:32.817505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f2e71b8e-d23a-4afb-9e25-48f59659ec91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:32.818721 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f2e71b8e-d23a-4afb-9e25-48f59659ec91 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.210384 Aug 23 18:25:32.820131 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2993/6121] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:32 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:33.064572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c889e826-27f8-4aeb-bd8c-0198fd81b0f2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:33.065262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c889e826-27f8-4aeb-bd8c-0198fd81b0f2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:33.073332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c889e826-27f8-4aeb-bd8c-0198fd81b0f2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:33.074051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c889e826-27f8-4aeb-bd8c-0198fd81b0f2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:33.074713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c889e826-27f8-4aeb-bd8c-0198fd81b0f2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:33.075614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c889e826-27f8-4aeb-bd8c-0198fd81b0f2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:33.076238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c889e826-27f8-4aeb-bd8c-0198fd81b0f2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:33.076660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c889e826-27f8-4aeb-bd8c-0198fd81b0f2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:33.123090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-58b8ebb8-92fd-44a6-9ea4-d56cd49b2fc0 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:33.126711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-58b8ebb8-92fd-44a6-9ea4-d56cd49b2fc0 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:33.147663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58b8ebb8-92fd-44a6-9ea4-d56cd49b2fc0 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:33.148758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58b8ebb8-92fd-44a6-9ea4-d56cd49b2fc0 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:33.150462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58b8ebb8-92fd-44a6-9ea4-d56cd49b2fc0 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:33.151327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58b8ebb8-92fd-44a6-9ea4-d56cd49b2fc0 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:33.153528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58b8ebb8-92fd-44a6-9ea4-d56cd49b2fc0 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:33.154152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58b8ebb8-92fd-44a6-9ea4-d56cd49b2fc0 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:33.290594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c889e826-27f8-4aeb-bd8c-0198fd81b0f2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:33.302135 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c889e826-27f8-4aeb-bd8c-0198fd81b0f2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.241319 Aug 23 18:25:33.305714 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3129/6122] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:33 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:33.780324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-58b8ebb8-92fd-44a6-9ea4-d56cd49b2fc0 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:33.797894 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-58b8ebb8-92fd-44a6-9ea4-d56cd49b2fc0 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.680166 Aug 23 18:25:33.800787 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2994/6123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:33 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:33.844047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93b0f3ae-30b9-4b3d-8659-4de52284d509 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:33.844676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-93b0f3ae-30b9-4b3d-8659-4de52284d509 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:33.853162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93b0f3ae-30b9-4b3d-8659-4de52284d509 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:33.853664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93b0f3ae-30b9-4b3d-8659-4de52284d509 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:33.854103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93b0f3ae-30b9-4b3d-8659-4de52284d509 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:33.855047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93b0f3ae-30b9-4b3d-8659-4de52284d509 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:33.855504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93b0f3ae-30b9-4b3d-8659-4de52284d509 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:33.855930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93b0f3ae-30b9-4b3d-8659-4de52284d509 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:34.064866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93b0f3ae-30b9-4b3d-8659-4de52284d509 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:34.080651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93b0f3ae-30b9-4b3d-8659-4de52284d509 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:34.082213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93b0f3ae-30b9-4b3d-8659-4de52284d509 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:34.083461 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93b0f3ae-30b9-4b3d-8659-4de52284d509 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1729 microversion: 2.20 time: 0.243987 Aug 23 18:25:34.084024 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3130/6124] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:33 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1729 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:34.328447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-765da98e-a218-4232-a7cd-790a440628d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:34.329290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-765da98e-a218-4232-a7cd-790a440628d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:34.338038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-765da98e-a218-4232-a7cd-790a440628d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:34.340351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-765da98e-a218-4232-a7cd-790a440628d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:34.341140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-765da98e-a218-4232-a7cd-790a440628d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:34.342708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-765da98e-a218-4232-a7cd-790a440628d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:34.343891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-765da98e-a218-4232-a7cd-790a440628d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:34.344656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-765da98e-a218-4232-a7cd-790a440628d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:34.669542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-765da98e-a218-4232-a7cd-790a440628d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:34.680943 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-765da98e-a218-4232-a7cd-790a440628d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.356464 Aug 23 18:25:34.682176 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2995/6125] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:34 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:34.734041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-a434a0fb-5525-4b48-808d-857425b64a88 req-5c86c0e0-ca74-4ffe-8cbe-9ebf273f0ac6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18b07854-1390-4dbe-8fa0-865c68fc1f20", "name": "network-vif-plugged", "status": "completed", "tag": "11136f24-0db0-4b8a-b9c3-a427bbd50bd0"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:34.745903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a434a0fb-5525-4b48-808d-857425b64a88 req-5c86c0e0-ca74-4ffe-8cbe-9ebf273f0ac6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:34.746390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a434a0fb-5525-4b48-808d-857425b64a88 req-5c86c0e0-ca74-4ffe-8cbe-9ebf273f0ac6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:34.747759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a434a0fb-5525-4b48-808d-857425b64a88 req-5c86c0e0-ca74-4ffe-8cbe-9ebf273f0ac6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:34.766205 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-a434a0fb-5525-4b48-808d-857425b64a88 req-5c86c0e0-ca74-4ffe-8cbe-9ebf273f0ac6 service nova] Creating event network-vif-plugged:11136f24-0db0-4b8a-b9c3-a427bbd50bd0 for instance 18b07854-1390-4dbe-8fa0-865c68fc1f20 on n-h1-850468-16 Aug 23 18:25:34.772705 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-a434a0fb-5525-4b48-808d-857425b64a88 req-5c86c0e0-ca74-4ffe-8cbe-9ebf273f0ac6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041753 Aug 23 18:25:34.773768 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3131/6126] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:25:34.822507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5f654e6b-8d46-4426-861a-1cf2812b77e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:34.823608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5f654e6b-8d46-4426-861a-1cf2812b77e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:34.835991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f654e6b-8d46-4426-861a-1cf2812b77e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:34.836762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f654e6b-8d46-4426-861a-1cf2812b77e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:34.837931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f654e6b-8d46-4426-861a-1cf2812b77e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:34.838987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f654e6b-8d46-4426-861a-1cf2812b77e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:34.840180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f654e6b-8d46-4426-861a-1cf2812b77e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:34.841146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f654e6b-8d46-4426-861a-1cf2812b77e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:35.108533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-292462eb-8275-4940-9ef6-4ff0f8f57589 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:35.110194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-292462eb-8275-4940-9ef6-4ff0f8f57589 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:35.118345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-292462eb-8275-4940-9ef6-4ff0f8f57589 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:35.118950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-292462eb-8275-4940-9ef6-4ff0f8f57589 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:35.119459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-292462eb-8275-4940-9ef6-4ff0f8f57589 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:35.120392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-292462eb-8275-4940-9ef6-4ff0f8f57589 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:35.120921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-292462eb-8275-4940-9ef6-4ff0f8f57589 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:35.121426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-292462eb-8275-4940-9ef6-4ff0f8f57589 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:35.150409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5f654e6b-8d46-4426-861a-1cf2812b77e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:35.175702 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5f654e6b-8d46-4426-861a-1cf2812b77e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.357855 Aug 23 18:25:35.177587 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2996/6127] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:34 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:35.302915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-292462eb-8275-4940-9ef6-4ff0f8f57589 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:35.313778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-292462eb-8275-4940-9ef6-4ff0f8f57589 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:35.315317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-292462eb-8275-4940-9ef6-4ff0f8f57589 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:35.317230 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-292462eb-8275-4940-9ef6-4ff0f8f57589 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1716 microversion: 2.20 time: 0.212848 Aug 23 18:25:35.332452 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3132/6128] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:35 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1716 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:25:35.703115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fcfbc945-7587-43ce-9a37-140e0a7b2896 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:35.703805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fcfbc945-7587-43ce-9a37-140e0a7b2896 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:35.707360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:35.712120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcfbc945-7587-43ce-9a37-140e0a7b2896 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:35.712603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcfbc945-7587-43ce-9a37-140e0a7b2896 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:35.713066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcfbc945-7587-43ce-9a37-140e0a7b2896 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:35.713985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcfbc945-7587-43ce-9a37-140e0a7b2896 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:35.714532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcfbc945-7587-43ce-9a37-140e0a7b2896 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:35.715072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcfbc945-7587-43ce-9a37-140e0a7b2896 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:35.856196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fcfbc945-7587-43ce-9a37-140e0a7b2896 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:35.864104 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fcfbc945-7587-43ce-9a37-140e0a7b2896 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.164906 Aug 23 18:25:35.864683 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2997/6129] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:35 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:35.940664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-40015c36-d2de-4b0d-a7d8-32a7840a03b2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:35.941160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-40015c36-d2de-4b0d-a7d8-32a7840a03b2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:35.947329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40015c36-d2de-4b0d-a7d8-32a7840a03b2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:35.947825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40015c36-d2de-4b0d-a7d8-32a7840a03b2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:35.948334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40015c36-d2de-4b0d-a7d8-32a7840a03b2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:35.949740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40015c36-d2de-4b0d-a7d8-32a7840a03b2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:35.949740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40015c36-d2de-4b0d-a7d8-32a7840a03b2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:35.950110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40015c36-d2de-4b0d-a7d8-32a7840a03b2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:35.974229 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-40015c36-d2de-4b0d-a7d8-32a7840a03b2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/ips" status: 200 len: 149 microversion: 2.1 time: 0.037582 Aug 23 18:25:35.974924 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3133/6130] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:25:35 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:25:36.197542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1f51c291-1f0c-43b9-9456-9a86701754b7 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:36.198170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1f51c291-1f0c-43b9-9456-9a86701754b7 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:36.225332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f51c291-1f0c-43b9-9456-9a86701754b7 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:36.225727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f51c291-1f0c-43b9-9456-9a86701754b7 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:36.226167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f51c291-1f0c-43b9-9456-9a86701754b7 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:36.238586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f51c291-1f0c-43b9-9456-9a86701754b7 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:36.248108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f51c291-1f0c-43b9-9456-9a86701754b7 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:36.248930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f51c291-1f0c-43b9-9456-9a86701754b7 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:36.253639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:36.466152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1f51c291-1f0c-43b9-9456-9a86701754b7 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:36.474438 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1f51c291-1f0c-43b9-9456-9a86701754b7 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1324 microversion: 2.1 time: 0.281517 Aug 23 18:25:36.475585 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2998/6131] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:36 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1324 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:36.886126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-807bc2c6-5b9d-4c97-af46-f295d129ba06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:36.889172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-807bc2c6-5b9d-4c97-af46-f295d129ba06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:36.901337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-807bc2c6-5b9d-4c97-af46-f295d129ba06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:36.905042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-807bc2c6-5b9d-4c97-af46-f295d129ba06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:36.922741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-807bc2c6-5b9d-4c97-af46-f295d129ba06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:36.934495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-807bc2c6-5b9d-4c97-af46-f295d129ba06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:36.935374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-807bc2c6-5b9d-4c97-af46-f295d129ba06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:36.936355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-807bc2c6-5b9d-4c97-af46-f295d129ba06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:37.381150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e6752260-e6a2-4b51-a2c6-a0bc8b03f046 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f50ea0e0-8761-4e10-abf4-3afb35392ecd"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:37.384674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e6752260-e6a2-4b51-a2c6-a0bc8b03f046 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:37.391104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6752260-e6a2-4b51-a2c6-a0bc8b03f046 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:37.391602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6752260-e6a2-4b51-a2c6-a0bc8b03f046 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:37.392047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6752260-e6a2-4b51-a2c6-a0bc8b03f046 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:37.392782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6752260-e6a2-4b51-a2c6-a0bc8b03f046 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:37.393272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6752260-e6a2-4b51-a2c6-a0bc8b03f046 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:37.393715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6752260-e6a2-4b51-a2c6-a0bc8b03f046 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:37.536486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-807bc2c6-5b9d-4c97-af46-f295d129ba06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:37.552804 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-807bc2c6-5b9d-4c97-af46-f295d129ba06 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.670569 Aug 23 18:25:37.554461 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3134/6132] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:36 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:37.561277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce492a88-5dba-4899-bc05-0bf69b42065b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:37.562134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ce492a88-5dba-4899-bc05-0bf69b42065b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:37.569675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce492a88-5dba-4899-bc05-0bf69b42065b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:37.570200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce492a88-5dba-4899-bc05-0bf69b42065b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:37.570975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce492a88-5dba-4899-bc05-0bf69b42065b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:37.571997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce492a88-5dba-4899-bc05-0bf69b42065b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:37.572602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce492a88-5dba-4899-bc05-0bf69b42065b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:37.573031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce492a88-5dba-4899-bc05-0bf69b42065b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:37.710261 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e6752260-e6a2-4b51-a2c6-a0bc8b03f046 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "POST /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332681 Aug 23 18:25:37.716720 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 2999/6133] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:25:37 2022] POST /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:25:37.750792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ce492a88-5dba-4899-bc05-0bf69b42065b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:37.760895 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce492a88-5dba-4899-bc05-0bf69b42065b tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1520 microversion: 2.1 time: 0.204528 Aug 23 18:25:37.761478 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3135/6134] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:37 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:37.891583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b48ab87-33eb-4d9b-a1eb-bf06fe91b7ab tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1208384349", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "671023e8-2b2f-4337-b937-c92731b39a14"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b48ab87-33eb-4d9b-a1eb-bf06fe91b7ab tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Request method failure captured: Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 243 Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRuEVqSK2sbDhcrGQl5sCz-GVqSYuFPiUex7JcnQVR0Ywk2riCWN5Jma_3vDFS9omjigD_Mmn0vlBbcxi2Yrh5sVcOLqfiBwIc9vY2rgcYOygiclwAkWHlw6C5u3dlZw_JckwbZGd-N0QNh1tU_rOa9RweqxYPzzJevE2SdsxjhX1Ug Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}] Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a277751bf4df4ed0820b2b0fd543c78d Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1208384349", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "671023e8-2b2f-4337-b937-c92731b39a14"}]}} Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1208384349', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': '671023e8-2b2f-4337-b937-c92731b39a14'}]}}} Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'': 'data1'} Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:25:37.896368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:37.901169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:37.903407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b48ab87-33eb-4d9b-a1eb-bf06fe91b7ab tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:25:37.904414 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b48ab87-33eb-4d9b-a1eb-bf06fe91b7ab tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.017344 Aug 23 18:25:37.905280 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3000/6135] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:25:37 2022] POST /compute/v2.1/servers => generated 175 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:25:37.916797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c8b73d3-bb0c-4d25-94fe-22b9a8ed1bdd tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:37.917313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1c8b73d3-bb0c-4d25-94fe-22b9a8ed1bdd tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: c70bac52-43dd-4dd9-b4c8-4ab49e3a86c6] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:37.923846 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-1c8b73d3-bb0c-4d25-94fe-22b9a8ed1bdd tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] HTTP exception thrown: Instance c70bac52-43dd-4dd9-b4c8-4ab49e3a86c6 could not be found. Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c8b73d3-bb0c-4d25-94fe-22b9a8ed1bdd tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Request method failure captured: Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/c70bac52-43dd-4dd9-b4c8-4ab49e3a86c6/metadata HTTP/1.1 Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRuEVqSK2sbDhcrGQl5sCz-GVqSYuFPiUex7JcnQVR0Ywk2riCWN5Jma_3vDFS9omjigD_Mmn0vlBbcxi2Yrh5sVcOLqfiBwIc9vY2rgcYOygiclwAkWHlw6C5u3dlZw_JckwbZGd-N0QNh1tU_rOa9RweqxYPzzJevE2SdsxjhX1Ug Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}] Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a277751bf4df4ed0820b2b0fd543c78d Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance c70bac52-43dd-4dd9-b4c8-4ab49e3a86c6 could not be found. Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'server_id': 'c70bac52-43dd-4dd9-b4c8-4ab49e3a86c6'} Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c70bac52-43dd-4dd9-b4c8-4ab49e3a86c6 could not be found. Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c70bac52-43dd-4dd9-b4c8-4ab49e3a86c6 could not be found. Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:37.937602 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:37.945074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:25:37.945074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:25:37.945074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c70bac52-43dd-4dd9-b4c8-4ab49e3a86c6 could not be found. Aug 23 18:25:37.945074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:37.945074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c8b73d3-bb0c-4d25-94fe-22b9a8ed1bdd tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Returning 404 to user: Instance c70bac52-43dd-4dd9-b4c8-4ab49e3a86c6 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:25:37.945074 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c8b73d3-bb0c-4d25-94fe-22b9a8ed1bdd tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/c70bac52-43dd-4dd9-b4c8-4ab49e3a86c6/metadata" status: 404 len: 111 microversion: 2.1 time: 0.026993 Aug 23 18:25:37.947894 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3136/6136] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 18:25:37 2022] GET /compute/v2.1/servers/c70bac52-43dd-4dd9-b4c8-4ab49e3a86c6/metadata => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:25:37.995722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-867a42d6-33ae-4278-9ba1-671b01fbd86c tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1109783055", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "671023e8-2b2f-4337-b937-c92731b39a14"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-867a42d6-33ae-4278-9ba1-671b01fbd86c tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Request method failure captured: Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 499 Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRuEVqSK2sbDhcrGQl5sCz-GVqSYuFPiUex7JcnQVR0Ywk2riCWN5Jma_3vDFS9omjigD_Mmn0vlBbcxi2Yrh5sVcOLqfiBwIc9vY2rgcYOygiclwAkWHlw6C5u3dlZw_JckwbZGd-N0QNh1tU_rOa9RweqxYPzzJevE2SdsxjhX1Ug Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}] Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a277751bf4df4ed0820b2b0fd543c78d Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1109783055", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "671023e8-2b2f-4337-b937-c92731b39a14"}]}} Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1109783055', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '671023e8-2b2f-4337-b937-c92731b39a14'}]}}} Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 18:25:38.000480 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-867a42d6-33ae-4278-9ba1-671b01fbd86c tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:25:38.004394 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-867a42d6-33ae-4278-9ba1-671b01fbd86c tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.011146 Aug 23 18:25:38.011753 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3001/6137] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:25:37 2022] POST /compute/v2.1/servers => generated 687 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:25:38.061615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-251795d1-c43f-4757-8e39-6d3eda9163e8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1512402216", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "671023e8-2b2f-4337-b937-c92731b39a14"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-251795d1-c43f-4757-8e39-6d3eda9163e8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Request method failure captured: Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 500 Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRuEVqSK2sbDhcrGQl5sCz-GVqSYuFPiUex7JcnQVR0Ywk2riCWN5Jma_3vDFS9omjigD_Mmn0vlBbcxi2Yrh5sVcOLqfiBwIc9vY2rgcYOygiclwAkWHlw6C5u3dlZw_JckwbZGd-N0QNh1tU_rOa9RweqxYPzzJevE2SdsxjhX1Ug Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}] Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a277751bf4df4ed0820b2b0fd543c78d Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1512402216", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "671023e8-2b2f-4337-b937-c92731b39a14"}]}} Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1512402216', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '671023e8-2b2f-4337-b937-c92731b39a14'}]}}} Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 18:25:38.066403 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-251795d1-c43f-4757-8e39-6d3eda9163e8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-251795d1-c43f-4757-8e39-6d3eda9163e8 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.010316 Aug 23 18:25:38.076429 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3137/6138] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:25:38 2022] POST /compute/v2.1/servers => generated 689 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:25:38.126259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-27d8a637-8ffa-4765-8b00-8c13228a5134 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1827169142", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "671023e8-2b2f-4337-b937-c92731b39a14"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-27d8a637-8ffa-4765-8b00-8c13228a5134 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Request method failure captured: Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 754 Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRuEVqSK2sbDhcrGQl5sCz-GVqSYuFPiUex7JcnQVR0Ywk2riCWN5Jma_3vDFS9omjigD_Mmn0vlBbcxi2Yrh5sVcOLqfiBwIc9vY2rgcYOygiclwAkWHlw6C5u3dlZw_JckwbZGd-N0QNh1tU_rOa9RweqxYPzzJevE2SdsxjhX1Ug Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}] Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a277751bf4df4ed0820b2b0fd543c78d Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1827169142", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "671023e8-2b2f-4337-b937-c92731b39a14"}]}} Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1827169142', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '671023e8-2b2f-4337-b937-c92731b39a14'}]}}} Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:25:38.134813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:25:38.137808 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:25:38.140569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.140569 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.141475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-27d8a637-8ffa-4765-8b00-8c13228a5134 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:25:38.142646 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-27d8a637-8ffa-4765-8b00-8c13228a5134 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.021240 Aug 23 18:25:38.153888 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3002/6139] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:25:38 2022] POST /compute/v2.1/servers => generated 1197 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 23 18:25:38.208569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4576574e-b1ab-4b19-a4d3-09ef2f9bd0e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1110672252", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "671023e8-2b2f-4337-b937-c92731b39a14"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4576574e-b1ab-4b19-a4d3-09ef2f9bd0e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Request method failure captured: Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers HTTP/1.1 Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 1266 Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRuEVqSK2sbDhcrGQl5sCz-GVqSYuFPiUex7JcnQVR0Ywk2riCWN5Jma_3vDFS9omjigD_Mmn0vlBbcxi2Yrh5sVcOLqfiBwIc9vY2rgcYOygiclwAkWHlw6C5u3dlZw_JckwbZGd-N0QNh1tU_rOa9RweqxYPzzJevE2SdsxjhX1Ug Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}] Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a277751bf4df4ed0820b2b0fd543c78d Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1110672252", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "671023e8-2b2f-4337-b937-c92731b39a14"}]}} Aug 23 18:25:38.216218 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1110672252', 'imageRef': '126e0038-c91e-4894-b027-98e76f88a186', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': '671023e8-2b2f-4337-b937-c92731b39a14'}]}}} Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi 'type': 'object'} Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.218961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi On instance['server']: Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:25:38.220293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:25:38.228056 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Aug 23 18:25:38.228056 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.228056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4576574e-b1ab-4b19-a4d3-09ef2f9bd0e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:25:38.228056 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4576574e-b1ab-4b19-a4d3-09ef2f9bd0e1 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.017090 Aug 23 18:25:38.228056 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3138/6140] 10.222.0.61 () {60 vars in 1148 bytes} [Tue Aug 23 18:25:38 2022] POST /compute/v2.1/servers => generated 2221 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Aug 23 18:25:38.231974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-852ea9c9-4410-457d-b0f7-6f4f56ef7776 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:38.232700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-852ea9c9-4410-457d-b0f7-6f4f56ef7776 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 6ab00910-fb25-4ad9-b0a4-f00bc487ca8a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:38.238445 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-852ea9c9-4410-457d-b0f7-6f4f56ef7776 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] HTTP exception thrown: Instance 6ab00910-fb25-4ad9-b0a4-f00bc487ca8a could not be found. Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-852ea9c9-4410-457d-b0f7-6f4f56ef7776 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Request method failure captured: Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/6ab00910-fb25-4ad9-b0a4-f00bc487ca8a/metadata/test2 HTTP/1.1 Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRuEVqSK2sbDhcrGQl5sCz-GVqSYuFPiUex7JcnQVR0Ywk2riCWN5Jma_3vDFS9omjigD_Mmn0vlBbcxi2Yrh5sVcOLqfiBwIc9vY2rgcYOygiclwAkWHlw6C5u3dlZw_JckwbZGd-N0QNh1tU_rOa9RweqxYPzzJevE2SdsxjhX1Ug Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}] Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a277751bf4df4ed0820b2b0fd543c78d Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 6ab00910-fb25-4ad9-b0a4-f00bc487ca8a could not be found. Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': '6ab00910-fb25-4ad9-b0a4-f00bc487ca8a', 'id': 'test2'} Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6ab00910-fb25-4ad9-b0a4-f00bc487ca8a could not be found. Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6ab00910-fb25-4ad9-b0a4-f00bc487ca8a could not be found. Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:38.240266 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:38.244472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:25:38.244472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:25:38.244472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6ab00910-fb25-4ad9-b0a4-f00bc487ca8a could not be found. Aug 23 18:25:38.244472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:25:38.244472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-852ea9c9-4410-457d-b0f7-6f4f56ef7776 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Returning 404 to user: Instance 6ab00910-fb25-4ad9-b0a4-f00bc487ca8a could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:25:38.244472 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-852ea9c9-4410-457d-b0f7-6f4f56ef7776 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/6ab00910-fb25-4ad9-b0a4-f00bc487ca8a/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.014988 Aug 23 18:25:38.244472 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3003/6141] 10.222.0.61 () {58 vars in 1281 bytes} [Tue Aug 23 18:25:38 2022] GET /compute/v2.1/servers/6ab00910-fb25-4ad9-b0a4-f00bc487ca8a/metadata/test2 => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:25:38.261197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b902f632-a72b-4fd6-bb9c-ca48c4b1ed45 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:38.261977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b902f632-a72b-4fd6-bb9c-ca48c4b1ed45 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:38.269251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b902f632-a72b-4fd6-bb9c-ca48c4b1ed45 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:38.269959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b902f632-a72b-4fd6-bb9c-ca48c4b1ed45 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:38.270594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b902f632-a72b-4fd6-bb9c-ca48c4b1ed45 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:38.271489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b902f632-a72b-4fd6-bb9c-ca48c4b1ed45 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:38.272351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b902f632-a72b-4fd6-bb9c-ca48c4b1ed45 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:38.272962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b902f632-a72b-4fd6-bb9c-ca48c4b1ed45 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:38.300994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b902f632-a72b-4fd6-bb9c-ca48c4b1ed45 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:25:38.377042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:38.404764 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b902f632-a72b-4fd6-bb9c-ca48c4b1ed45 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "DELETE /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 204 len: 0 microversion: 2.1 time: 0.147880 Aug 23 18:25:38.405860 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3139/6142] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:25:38 2022] DELETE /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:25:38.415114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b89adda-953f-451a-92a2-9c4d59e684cc tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:38.416687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4b89adda-953f-451a-92a2-9c4d59e684cc tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:38.424146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b89adda-953f-451a-92a2-9c4d59e684cc tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:38.424937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b89adda-953f-451a-92a2-9c4d59e684cc tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:38.425745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b89adda-953f-451a-92a2-9c4d59e684cc tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:38.426732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b89adda-953f-451a-92a2-9c4d59e684cc tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:38.427370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b89adda-953f-451a-92a2-9c4d59e684cc tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:38.428023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b89adda-953f-451a-92a2-9c4d59e684cc tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:38.585358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-abe0d210-278b-4b16-8345-314cdbd33097 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:38.586105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-abe0d210-278b-4b16-8345-314cdbd33097 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:38.602790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abe0d210-278b-4b16-8345-314cdbd33097 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:38.603478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abe0d210-278b-4b16-8345-314cdbd33097 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:38.604197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abe0d210-278b-4b16-8345-314cdbd33097 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:38.605619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abe0d210-278b-4b16-8345-314cdbd33097 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:38.606250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abe0d210-278b-4b16-8345-314cdbd33097 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:38.606862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abe0d210-278b-4b16-8345-314cdbd33097 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:38.778527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-abe0d210-278b-4b16-8345-314cdbd33097 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:38.787405 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-abe0d210-278b-4b16-8345-314cdbd33097 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.212576 Aug 23 18:25:38.788848 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3140/6143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:38 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:25:38.955608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4b89adda-953f-451a-92a2-9c4d59e684cc tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:38.963995 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b89adda-953f-451a-92a2-9c4d59e684cc tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1526 microversion: 2.1 time: 0.553911 Aug 23 18:25:38.964846 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3004/6144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:38 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1526 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:39.810966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e8718729-c2c3-47ec-8e4d-1b6cada5f034 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:39.812244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e8718729-c2c3-47ec-8e4d-1b6cada5f034 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:39.821215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8718729-c2c3-47ec-8e4d-1b6cada5f034 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:39.821970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8718729-c2c3-47ec-8e4d-1b6cada5f034 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:39.822715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8718729-c2c3-47ec-8e4d-1b6cada5f034 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:39.823950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8718729-c2c3-47ec-8e4d-1b6cada5f034 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:39.824625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8718729-c2c3-47ec-8e4d-1b6cada5f034 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:39.825226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8718729-c2c3-47ec-8e4d-1b6cada5f034 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:39.987591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e8bb13b-6f94-42f5-bb3a-f3d95a19f5ef tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:39.990265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4e8bb13b-6f94-42f5-bb3a-f3d95a19f5ef tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:39.999559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e8bb13b-6f94-42f5-bb3a-f3d95a19f5ef tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:40.000299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e8bb13b-6f94-42f5-bb3a-f3d95a19f5ef tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:40.001021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e8bb13b-6f94-42f5-bb3a-f3d95a19f5ef tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:40.002162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e8bb13b-6f94-42f5-bb3a-f3d95a19f5ef tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:40.002809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e8bb13b-6f94-42f5-bb3a-f3d95a19f5ef tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:40.003403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e8bb13b-6f94-42f5-bb3a-f3d95a19f5ef tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:40.108261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8718729-c2c3-47ec-8e4d-1b6cada5f034 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:40.121655 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e8718729-c2c3-47ec-8e4d-1b6cada5f034 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.314392 Aug 23 18:25:40.122737 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3141/6145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:39 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:40.257640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e8bb13b-6f94-42f5-bb3a-f3d95a19f5ef tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:40.265650 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e8bb13b-6f94-42f5-bb3a-f3d95a19f5ef tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1526 microversion: 2.1 time: 0.283418 Aug 23 18:25:40.275398 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3005/6146] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:39 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1526 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:40.833742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-16d46597-16d0-4d3a-a94d-8173002edaed req-acf46729-49aa-4276-87e6-6cb3ffc371fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18b07854-1390-4dbe-8fa0-865c68fc1f20", "name": "network-vif-deleted", "tag": "11136f24-0db0-4b8a-b9c3-a427bbd50bd0"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:40.852150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-16d46597-16d0-4d3a-a94d-8173002edaed req-acf46729-49aa-4276-87e6-6cb3ffc371fa service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:40.853080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-16d46597-16d0-4d3a-a94d-8173002edaed req-acf46729-49aa-4276-87e6-6cb3ffc371fa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:40.853680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-16d46597-16d0-4d3a-a94d-8173002edaed req-acf46729-49aa-4276-87e6-6cb3ffc371fa service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:40.885018 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-16d46597-16d0-4d3a-a94d-8173002edaed req-acf46729-49aa-4276-87e6-6cb3ffc371fa service nova] Creating event network-vif-deleted:11136f24-0db0-4b8a-b9c3-a427bbd50bd0 for instance 18b07854-1390-4dbe-8fa0-865c68fc1f20 on n-h1-850468-16 Aug 23 18:25:40.904911 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-16d46597-16d0-4d3a-a94d-8173002edaed req-acf46729-49aa-4276-87e6-6cb3ffc371fa service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076796 Aug 23 18:25:40.905555 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3142/6147] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:25:41.148624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8b0b7d2-2960-457c-aab8-3fcd9d734cd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:41.151078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c8b0b7d2-2960-457c-aab8-3fcd9d734cd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:41.159001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8b0b7d2-2960-457c-aab8-3fcd9d734cd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:41.159850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8b0b7d2-2960-457c-aab8-3fcd9d734cd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:41.160630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8b0b7d2-2960-457c-aab8-3fcd9d734cd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:41.161502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8b0b7d2-2960-457c-aab8-3fcd9d734cd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:41.162150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8b0b7d2-2960-457c-aab8-3fcd9d734cd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:41.163771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8b0b7d2-2960-457c-aab8-3fcd9d734cd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:41.297541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:41.299200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:41.307547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:41.308360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:41.309243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:41.310259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:41.311087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:41.311898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:41.351023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:41.351852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:41.352500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:41.353136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lazy-loading 'fault' on Instance uuid 18b07854-1390-4dbe-8fa0-865c68fc1f20 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:25:41.432442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a277751bf4df4ed0820b2b0fd543c78d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '77f50f42ab4541f99d185c9770dfae57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:41.451164 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f7bdabae-8796-4767-85a9-fe8dffaccc73 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 200 len: 1314 microversion: 2.1 time: 0.158492 Aug 23 18:25:41.451984 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3143/6148] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:41 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:41.456281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c8b0b7d2-2960-457c-aab8-3fcd9d734cd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:41.465778 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c8b0b7d2-2960-457c-aab8-3fcd9d734cd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.320965 Aug 23 18:25:41.466630 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3006/6149] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:41 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:42.473420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e803258-38bd-4383-acb4-f139149e2f38 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:42.474167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e803258-38bd-4383-acb4-f139149e2f38 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] [instance: 18b07854-1390-4dbe-8fa0-865c68fc1f20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:42.483134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e803258-38bd-4383-acb4-f139149e2f38 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:42.483969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e803258-38bd-4383-acb4-f139149e2f38 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:42.484742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e803258-38bd-4383-acb4-f139149e2f38 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:42.485661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e803258-38bd-4383-acb4-f139149e2f38 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:42.486317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e803258-38bd-4383-acb4-f139149e2f38 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:42.487481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e803258-38bd-4383-acb4-f139149e2f38 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:42.488724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e15eb600-3c2f-47a0-a016-eeef50a011c8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:42.489906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e15eb600-3c2f-47a0-a016-eeef50a011c8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:42.500177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15eb600-3c2f-47a0-a016-eeef50a011c8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:42.501117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15eb600-3c2f-47a0-a016-eeef50a011c8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:42.502210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15eb600-3c2f-47a0-a016-eeef50a011c8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:42.503334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15eb600-3c2f-47a0-a016-eeef50a011c8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:42.504231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15eb600-3c2f-47a0-a016-eeef50a011c8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:42.505195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15eb600-3c2f-47a0-a016-eeef50a011c8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:42.505950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:42.508522 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8e803258-38bd-4383-acb4-f139149e2f38 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] HTTP exception thrown: Instance 18b07854-1390-4dbe-8fa0-865c68fc1f20 could not be found. Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e803258-38bd-4383-acb4-f139149e2f38 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Request method failure captured: Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 HTTP/1.1 Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRuEVqSK2sbDhcrGQl5sCz-GVqSYuFPiUex7JcnQVR0Ywk2riCWN5Jma_3vDFS9omjigD_Mmn0vlBbcxi2Yrh5sVcOLqfiBwIc9vY2rgcYOygiclwAkWHlw6C5u3dlZw_JckwbZGd-N0QNh1tU_rOa9RweqxYPzzJevE2SdsxjhX1Ug Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/77f50f42ab4541f99d185c9770dfae57"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/77f50f42ab4541f99d185c9770dfae57"}]}] Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 77f50f42ab4541f99d185c9770dfae57 Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1061395290 Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a277751bf4df4ed0820b2b0fd543c78d Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1061395290-project Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 18b07854-1390-4dbe-8fa0-865c68fc1f20 could not be found. Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '18b07854-1390-4dbe-8fa0-865c68fc1f20'} Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18b07854-1390-4dbe-8fa0-865c68fc1f20 could not be found. Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18b07854-1390-4dbe-8fa0-865c68fc1f20 could not be found. Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:42.510604 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:25:42.514687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:42.514687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:25:42.514687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:25:42.514687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:25:42.514687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:25:42.514687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:25:42.514687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18b07854-1390-4dbe-8fa0-865c68fc1f20 could not be found. Aug 23 18:25:42.514687 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:25:42.516224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e803258-38bd-4383-acb4-f139149e2f38 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] Returning 404 to user: Instance 18b07854-1390-4dbe-8fa0-865c68fc1f20 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:25:42.516371 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e803258-38bd-4383-acb4-f139149e2f38 tempest-ServerMetadataNegativeTestJSON-1061395290 tempest-ServerMetadataNegativeTestJSON-1061395290-project] 10.222.0.61 "GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20" status: 404 len: 111 microversion: 2.1 time: 0.047982 Aug 23 18:25:42.516972 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3144/6150] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:42 2022] GET /compute/v2.1/servers/18b07854-1390-4dbe-8fa0-865c68fc1f20 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:25:42.797312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e15eb600-3c2f-47a0-a016-eeef50a011c8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:42.806772 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e15eb600-3c2f-47a0-a016-eeef50a011c8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.322470 Aug 23 18:25:42.807667 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3007/6151] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:42 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:43.831018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-27c41b49-c0aa-4972-98dc-ecf2f8918639 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:43.831743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-27c41b49-c0aa-4972-98dc-ecf2f8918639 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:43.840311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27c41b49-c0aa-4972-98dc-ecf2f8918639 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:43.841137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27c41b49-c0aa-4972-98dc-ecf2f8918639 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:43.841785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27c41b49-c0aa-4972-98dc-ecf2f8918639 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:43.842499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27c41b49-c0aa-4972-98dc-ecf2f8918639 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:43.843153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27c41b49-c0aa-4972-98dc-ecf2f8918639 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:43.843780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27c41b49-c0aa-4972-98dc-ecf2f8918639 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:43.996240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-27c41b49-c0aa-4972-98dc-ecf2f8918639 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:44.004895 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-27c41b49-c0aa-4972-98dc-ecf2f8918639 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.177966 Aug 23 18:25:44.019433 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3145/6152] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:43 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:45.029154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ebc9697f-4d2c-456c-849b-6ff3f5b60f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:45.046511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ebc9697f-4d2c-456c-849b-6ff3f5b60f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:45.056335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebc9697f-4d2c-456c-849b-6ff3f5b60f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:45.056927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebc9697f-4d2c-456c-849b-6ff3f5b60f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:45.057517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebc9697f-4d2c-456c-849b-6ff3f5b60f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:45.058296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebc9697f-4d2c-456c-849b-6ff3f5b60f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:45.059571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebc9697f-4d2c-456c-849b-6ff3f5b60f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:45.061904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ebc9697f-4d2c-456c-849b-6ff3f5b60f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:45.397396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ebc9697f-4d2c-456c-849b-6ff3f5b60f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:45.411245 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ebc9697f-4d2c-456c-849b-6ff3f5b60f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.389160 Aug 23 18:25:45.412470 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3008/6153] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:45 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:46.435930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-769b70d0-d0e2-44ba-b8dd-87e70bd0bf78 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:46.436548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-769b70d0-d0e2-44ba-b8dd-87e70bd0bf78 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:46.448443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-769b70d0-d0e2-44ba-b8dd-87e70bd0bf78 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:46.449400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-769b70d0-d0e2-44ba-b8dd-87e70bd0bf78 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:46.450051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-769b70d0-d0e2-44ba-b8dd-87e70bd0bf78 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:46.450982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-769b70d0-d0e2-44ba-b8dd-87e70bd0bf78 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:46.451936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-769b70d0-d0e2-44ba-b8dd-87e70bd0bf78 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:46.453103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-769b70d0-d0e2-44ba-b8dd-87e70bd0bf78 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:46.640740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-769b70d0-d0e2-44ba-b8dd-87e70bd0bf78 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:46.651293 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-769b70d0-d0e2-44ba-b8dd-87e70bd0bf78 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.219165 Aug 23 18:25:46.652766 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3146/6154] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:46 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:47.674250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c4b377d0-43ee-4779-9fef-b21c56d50dae tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:47.674902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c4b377d0-43ee-4779-9fef-b21c56d50dae tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:47.683182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4b377d0-43ee-4779-9fef-b21c56d50dae tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:47.683669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4b377d0-43ee-4779-9fef-b21c56d50dae tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:47.684123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4b377d0-43ee-4779-9fef-b21c56d50dae tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:47.685027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4b377d0-43ee-4779-9fef-b21c56d50dae tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:47.685490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4b377d0-43ee-4779-9fef-b21c56d50dae tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:47.686562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4b377d0-43ee-4779-9fef-b21c56d50dae tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:47.705971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1734030319", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": "none"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:47.785585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:25:47.789976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:25:47.798753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:25:47.815834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:25:47.816316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:25:47.840864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:47.841485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:47.841988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:47.842834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:47.844355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:47.845024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:47.866906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Getting quotas for project 56d2fcfcf8d242838d547eb3243d56b8. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:25:47.873298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Getting quotas for user 596ab5ede6e04032bab75e007094297b and project 56d2fcfcf8d242838d547eb3243d56b8. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:25:47.885549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c4b377d0-43ee-4779-9fef-b21c56d50dae tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:47.888658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:25:47.891142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:25:47.904136 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c4b377d0-43ee-4779-9fef-b21c56d50dae tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.233532 Aug 23 18:25:47.905865 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3147/6155] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:47 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:25:47.945288 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-06623d80-7506-4c88-a36d-22ef3549cc9f tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.368934 Aug 23 18:25:47.946250 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3009/6156] 10.222.0.61 () {62 vars in 1188 bytes} [Tue Aug 23 18:25:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 371 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 23 18:25:47.958352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6de12a4b-9cc7-45e0-a1be-4a5416b4c880 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:47.959222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6de12a4b-9cc7-45e0-a1be-4a5416b4c880 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:48.018431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6de12a4b-9cc7-45e0-a1be-4a5416b4c880 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:48.028363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6de12a4b-9cc7-45e0-a1be-4a5416b4c880 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:48.030205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6de12a4b-9cc7-45e0-a1be-4a5416b4c880 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:48.031428 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6de12a4b-9cc7-45e0-a1be-4a5416b4c880 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1278 microversion: 2.57 time: 0.078196 Aug 23 18:25:48.032209 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3148/6157] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:47 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1278 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:48.930020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e04346f6-05f7-4a64-8c85-e63fb74e5109 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:48.930902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e04346f6-05f7-4a64-8c85-e63fb74e5109 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:48.937439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e04346f6-05f7-4a64-8c85-e63fb74e5109 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:48.938066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e04346f6-05f7-4a64-8c85-e63fb74e5109 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:48.939285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e04346f6-05f7-4a64-8c85-e63fb74e5109 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:48.940239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e04346f6-05f7-4a64-8c85-e63fb74e5109 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:48.940795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e04346f6-05f7-4a64-8c85-e63fb74e5109 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:48.941337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e04346f6-05f7-4a64-8c85-e63fb74e5109 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:49.061046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-658b917a-33f5-4482-8ceb-385910dfee39 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:49.062709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-658b917a-33f5-4482-8ceb-385910dfee39 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:49.071856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-658b917a-33f5-4482-8ceb-385910dfee39 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:49.072737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-658b917a-33f5-4482-8ceb-385910dfee39 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:49.073351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-658b917a-33f5-4482-8ceb-385910dfee39 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:49.074079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-658b917a-33f5-4482-8ceb-385910dfee39 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:49.074575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-658b917a-33f5-4482-8ceb-385910dfee39 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:49.075003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-658b917a-33f5-4482-8ceb-385910dfee39 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:49.103775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e04346f6-05f7-4a64-8c85-e63fb74e5109 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:49.112131 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e04346f6-05f7-4a64-8c85-e63fb74e5109 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1695 microversion: 2.1 time: 0.188721 Aug 23 18:25:49.112702 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3010/6158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:48 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1695 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:49.151433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-658b917a-33f5-4482-8ceb-385910dfee39 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:49.159845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-658b917a-33f5-4482-8ceb-385910dfee39 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:49.161370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-658b917a-33f5-4482-8ceb-385910dfee39 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:49.163273 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-658b917a-33f5-4482-8ceb-385910dfee39 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1330 microversion: 2.57 time: 0.106541 Aug 23 18:25:49.164181 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3149/6159] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:49 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1330 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:49.876708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8b0e4a3-87cd-4867-bbc0-ffe2049bcbd3 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:49.877215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c8b0e4a3-87cd-4867-bbc0-ffe2049bcbd3 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:49.884434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8b0e4a3-87cd-4867-bbc0-ffe2049bcbd3 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:49.884434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8b0e4a3-87cd-4867-bbc0-ffe2049bcbd3 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:49.884832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8b0e4a3-87cd-4867-bbc0-ffe2049bcbd3 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:49.885533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8b0e4a3-87cd-4867-bbc0-ffe2049bcbd3 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:49.886090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8b0e4a3-87cd-4867-bbc0-ffe2049bcbd3 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:49.886427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8b0e4a3-87cd-4867-bbc0-ffe2049bcbd3 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:49.974225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-c8b0e4a3-87cd-4867-bbc0-ffe2049bcbd3 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lazy-loading 'services' on Instance uuid 7b33aebb-e0c2-43d1-9182-7818c49e0d6d {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:25:50.104366 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c8b0e4a3-87cd-4867-bbc0-ffe2049bcbd3 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments/f50ea0e0-8761-4e10-abf4-3afb35392ecd" status: 202 len: 0 microversion: 2.1 time: 0.231391 Aug 23 18:25:50.104984 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3011/6160] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 18:25:49 2022] DELETE /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments/f50ea0e0-8761-4e10-abf4-3afb35392ecd => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:25:50.114654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3c644f36-eef1-4d17-981b-e2fdb2727103 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:50.118060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3c644f36-eef1-4d17-981b-e2fdb2727103 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:50.127816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c644f36-eef1-4d17-981b-e2fdb2727103 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:50.129542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c644f36-eef1-4d17-981b-e2fdb2727103 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:50.130310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c644f36-eef1-4d17-981b-e2fdb2727103 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:50.132130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c644f36-eef1-4d17-981b-e2fdb2727103 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:50.132599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c644f36-eef1-4d17-981b-e2fdb2727103 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:50.133231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c644f36-eef1-4d17-981b-e2fdb2727103 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:50.139960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc260bd1-b62a-44f1-b8ef-0ea03fe5461e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:50.141196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fc260bd1-b62a-44f1-b8ef-0ea03fe5461e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:50.151619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc260bd1-b62a-44f1-b8ef-0ea03fe5461e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:50.152179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc260bd1-b62a-44f1-b8ef-0ea03fe5461e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:50.153411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc260bd1-b62a-44f1-b8ef-0ea03fe5461e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:50.154463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc260bd1-b62a-44f1-b8ef-0ea03fe5461e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:50.154970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc260bd1-b62a-44f1-b8ef-0ea03fe5461e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:50.155604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc260bd1-b62a-44f1-b8ef-0ea03fe5461e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:50.186359 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3c644f36-eef1-4d17-981b-e2fdb2727103 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.075985 Aug 23 18:25:50.187550 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3150/6161] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:25:50 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:25:50.196305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5eee732b-ddb5-47c7-9fa9-537f4f099345 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:50.197602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5eee732b-ddb5-47c7-9fa9-537f4f099345 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:50.204904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5eee732b-ddb5-47c7-9fa9-537f4f099345 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:50.205573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5eee732b-ddb5-47c7-9fa9-537f4f099345 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:50.206208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5eee732b-ddb5-47c7-9fa9-537f4f099345 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:50.207132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5eee732b-ddb5-47c7-9fa9-537f4f099345 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:50.217417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5eee732b-ddb5-47c7-9fa9-537f4f099345 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:50.218111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5eee732b-ddb5-47c7-9fa9-537f4f099345 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:50.333786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fc260bd1-b62a-44f1-b8ef-0ea03fe5461e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:50.342404 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fc260bd1-b62a-44f1-b8ef-0ea03fe5461e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1694 microversion: 2.1 time: 0.212622 Aug 23 18:25:50.343237 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3012/6162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:50 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1694 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:50.400585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5eee732b-ddb5-47c7-9fa9-537f4f099345 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:50.410078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5eee732b-ddb5-47c7-9fa9-537f4f099345 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:50.411629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5eee732b-ddb5-47c7-9fa9-537f4f099345 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:50.413771 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5eee732b-ddb5-47c7-9fa9-537f4f099345 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1336 microversion: 2.57 time: 0.224906 Aug 23 18:25:50.414621 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3151/6163] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:50 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1336 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:51.199767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ca0f420b-4283-451e-88c6-962663bfda31 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:51.202287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ca0f420b-4283-451e-88c6-962663bfda31 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:51.210248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0f420b-4283-451e-88c6-962663bfda31 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:51.210514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0f420b-4283-451e-88c6-962663bfda31 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:51.210990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0f420b-4283-451e-88c6-962663bfda31 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:51.211696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0f420b-4283-451e-88c6-962663bfda31 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:51.212501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0f420b-4283-451e-88c6-962663bfda31 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:51.213070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca0f420b-4283-451e-88c6-962663bfda31 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:51.244145 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ca0f420b-4283-451e-88c6-962663bfda31 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048702 Aug 23 18:25:51.244716 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3013/6164] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:25:51 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:25:51.366476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f70f3b89-fb0b-4b53-ba0c-effd7af96529 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:51.367111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f70f3b89-fb0b-4b53-ba0c-effd7af96529 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:51.373917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f70f3b89-fb0b-4b53-ba0c-effd7af96529 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:51.374424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f70f3b89-fb0b-4b53-ba0c-effd7af96529 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:51.374905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f70f3b89-fb0b-4b53-ba0c-effd7af96529 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:51.375592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f70f3b89-fb0b-4b53-ba0c-effd7af96529 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:51.376362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f70f3b89-fb0b-4b53-ba0c-effd7af96529 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:51.376799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f70f3b89-fb0b-4b53-ba0c-effd7af96529 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:51.437509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aec2ed6a-2401-4aec-9734-2bebfb34da9d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:51.438241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aec2ed6a-2401-4aec-9734-2bebfb34da9d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:51.445313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aec2ed6a-2401-4aec-9734-2bebfb34da9d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:51.445921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aec2ed6a-2401-4aec-9734-2bebfb34da9d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:51.446616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aec2ed6a-2401-4aec-9734-2bebfb34da9d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:51.447349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aec2ed6a-2401-4aec-9734-2bebfb34da9d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:51.447804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aec2ed6a-2401-4aec-9734-2bebfb34da9d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:51.448228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aec2ed6a-2401-4aec-9734-2bebfb34da9d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:51.519010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aec2ed6a-2401-4aec-9734-2bebfb34da9d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:51.527185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f70f3b89-fb0b-4b53-ba0c-effd7af96529 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:51.529883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aec2ed6a-2401-4aec-9734-2bebfb34da9d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:51.532109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aec2ed6a-2401-4aec-9734-2bebfb34da9d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:51.533591 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aec2ed6a-2401-4aec-9734-2bebfb34da9d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1336 microversion: 2.57 time: 0.100143 Aug 23 18:25:51.547156 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f70f3b89-fb0b-4b53-ba0c-effd7af96529 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1694 microversion: 2.1 time: 0.174695 Aug 23 18:25:51.547156 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3152/6166] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:51 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:51.573264 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3014/6166] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:51 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1336 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:25:52.257655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-30dbdae1-6fb6-4168-b07e-8cc5fb0252d5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:52.259980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-30dbdae1-6fb6-4168-b07e-8cc5fb0252d5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:52.266115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30dbdae1-6fb6-4168-b07e-8cc5fb0252d5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:52.266644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30dbdae1-6fb6-4168-b07e-8cc5fb0252d5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:52.267088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30dbdae1-6fb6-4168-b07e-8cc5fb0252d5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:52.267786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30dbdae1-6fb6-4168-b07e-8cc5fb0252d5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:52.268243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30dbdae1-6fb6-4168-b07e-8cc5fb0252d5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:52.268670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30dbdae1-6fb6-4168-b07e-8cc5fb0252d5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:52.299726 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-30dbdae1-6fb6-4168-b07e-8cc5fb0252d5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047088 Aug 23 18:25:52.300509 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3153/6167] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:25:52 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:25:52.558835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a753760-9ca3-4ec1-877d-678a84c9c57b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:52.560283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a753760-9ca3-4ec1-877d-678a84c9c57b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:52.562028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7cd9e261-3bd4-41be-aafd-23fb5923a5cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:52.562868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7cd9e261-3bd4-41be-aafd-23fb5923a5cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:52.568515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a753760-9ca3-4ec1-877d-678a84c9c57b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:52.569239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a753760-9ca3-4ec1-877d-678a84c9c57b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:52.570117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a753760-9ca3-4ec1-877d-678a84c9c57b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:52.571279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a753760-9ca3-4ec1-877d-678a84c9c57b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:52.571898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a753760-9ca3-4ec1-877d-678a84c9c57b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:52.572356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7cd9e261-3bd4-41be-aafd-23fb5923a5cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:52.572766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a753760-9ca3-4ec1-877d-678a84c9c57b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:52.573712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7cd9e261-3bd4-41be-aafd-23fb5923a5cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:52.574277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7cd9e261-3bd4-41be-aafd-23fb5923a5cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:52.575210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7cd9e261-3bd4-41be-aafd-23fb5923a5cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:52.575984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7cd9e261-3bd4-41be-aafd-23fb5923a5cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:52.577042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7cd9e261-3bd4-41be-aafd-23fb5923a5cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:52.668528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a753760-9ca3-4ec1-877d-678a84c9c57b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:52.688191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a753760-9ca3-4ec1-877d-678a84c9c57b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:52.689947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a753760-9ca3-4ec1-877d-678a84c9c57b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:52.691259 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a753760-9ca3-4ec1-877d-678a84c9c57b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1336 microversion: 2.57 time: 0.136594 Aug 23 18:25:52.691814 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3015/6168] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:52 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1336 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:52.697619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-0b474dc2-0485-4794-851c-fdcf170eba03 req-01ffa498-b584-40d5-b44a-1009143c8f6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134e2d84-3f0f-4f9f-b4d7-536f87817862", "name": "network-vif-unplugged", "status": "completed", "tag": "d1239621-cfc1-4ef0-b26e-40a6e6e24d16"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:52.708527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0b474dc2-0485-4794-851c-fdcf170eba03 req-01ffa498-b584-40d5-b44a-1009143c8f6b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:52.709807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0b474dc2-0485-4794-851c-fdcf170eba03 req-01ffa498-b584-40d5-b44a-1009143c8f6b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:52.710372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0b474dc2-0485-4794-851c-fdcf170eba03 req-01ffa498-b584-40d5-b44a-1009143c8f6b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:52.722675 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-0b474dc2-0485-4794-851c-fdcf170eba03 req-01ffa498-b584-40d5-b44a-1009143c8f6b service nova] Creating event network-vif-unplugged:d1239621-cfc1-4ef0-b26e-40a6e6e24d16 for instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 on n-h2-850468-16 Aug 23 18:25:52.729538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-0b474dc2-0485-4794-851c-fdcf170eba03 req-01ffa498-b584-40d5-b44a-1009143c8f6b service nova] Instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:25:52.743164 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-0b474dc2-0485-4794-851c-fdcf170eba03 req-01ffa498-b584-40d5-b44a-1009143c8f6b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049390 Aug 23 18:25:52.743802 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3016/6169] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:25:52.808514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7cd9e261-3bd4-41be-aafd-23fb5923a5cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:52.816241 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7cd9e261-3bd4-41be-aafd-23fb5923a5cb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1694 microversion: 2.1 time: 0.259992 Aug 23 18:25:52.816821 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3154/6170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:52 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1694 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:53.313860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ff88b44-95d9-40e5-8aa8-64241986161a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:53.317674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8ff88b44-95d9-40e5-8aa8-64241986161a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:53.326788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ff88b44-95d9-40e5-8aa8-64241986161a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:53.327635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ff88b44-95d9-40e5-8aa8-64241986161a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:53.329217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ff88b44-95d9-40e5-8aa8-64241986161a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:53.330253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ff88b44-95d9-40e5-8aa8-64241986161a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:53.331755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ff88b44-95d9-40e5-8aa8-64241986161a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:53.332424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ff88b44-95d9-40e5-8aa8-64241986161a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:53.363218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:53.371327 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8ff88b44-95d9-40e5-8aa8-64241986161a tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062716 Aug 23 18:25:53.378059 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3017/6171] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:25:53 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:25:53.716799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-44932275-5d26-4b68-a987-1f2344652279 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:53.718023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-44932275-5d26-4b68-a987-1f2344652279 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:53.726374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44932275-5d26-4b68-a987-1f2344652279 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:53.727180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44932275-5d26-4b68-a987-1f2344652279 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:53.727780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44932275-5d26-4b68-a987-1f2344652279 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:53.728692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44932275-5d26-4b68-a987-1f2344652279 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:53.729311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44932275-5d26-4b68-a987-1f2344652279 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:53.729894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44932275-5d26-4b68-a987-1f2344652279 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:53.816029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-44932275-5d26-4b68-a987-1f2344652279 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:53.829610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-44932275-5d26-4b68-a987-1f2344652279 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:53.831490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-44932275-5d26-4b68-a987-1f2344652279 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:53.833128 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-44932275-5d26-4b68-a987-1f2344652279 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1336 microversion: 2.57 time: 0.120299 Aug 23 18:25:53.833263 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3155/6172] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:53 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1336 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:53.852351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91f9a0a7-52a3-4fe2-8788-927e3c20e833 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:53.854315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-91f9a0a7-52a3-4fe2-8788-927e3c20e833 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:53.866988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f9a0a7-52a3-4fe2-8788-927e3c20e833 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:53.867163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f9a0a7-52a3-4fe2-8788-927e3c20e833 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:53.868736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f9a0a7-52a3-4fe2-8788-927e3c20e833 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:53.871113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f9a0a7-52a3-4fe2-8788-927e3c20e833 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:53.871782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f9a0a7-52a3-4fe2-8788-927e3c20e833 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:53.872386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91f9a0a7-52a3-4fe2-8788-927e3c20e833 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:54.027506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-91f9a0a7-52a3-4fe2-8788-927e3c20e833 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:54.038570 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-91f9a0a7-52a3-4fe2-8788-927e3c20e833 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1694 microversion: 2.1 time: 0.192994 Aug 23 18:25:54.040007 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3018/6173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:53 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1694 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:54.091917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-be01a4cb-e2e9-4167-b920-242b93837f04 req-9bfe0617-3f8b-4518-b335-0752ea279319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134e2d84-3f0f-4f9f-b4d7-536f87817862", "tag": "d1239621-cfc1-4ef0-b26e-40a6e6e24d16"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:54.102268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-be01a4cb-e2e9-4167-b920-242b93837f04 req-9bfe0617-3f8b-4518-b335-0752ea279319 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:54.103084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-be01a4cb-e2e9-4167-b920-242b93837f04 req-9bfe0617-3f8b-4518-b335-0752ea279319 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:54.103719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-be01a4cb-e2e9-4167-b920-242b93837f04 req-9bfe0617-3f8b-4518-b335-0752ea279319 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:54.116791 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-be01a4cb-e2e9-4167-b920-242b93837f04 req-9bfe0617-3f8b-4518-b335-0752ea279319 service nova] Creating event network-changed:d1239621-cfc1-4ef0-b26e-40a6e6e24d16 for instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 on n-h2-850468-16 Aug 23 18:25:54.122917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-be01a4cb-e2e9-4167-b920-242b93837f04 req-9bfe0617-3f8b-4518-b335-0752ea279319 service nova] Instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:25:54.135089 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-be01a4cb-e2e9-4167-b920-242b93837f04 req-9bfe0617-3f8b-4518-b335-0752ea279319 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136348 Aug 23 18:25:54.136067 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3156/6174] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:25:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:25:54.384003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf8ff514-bf6b-4bb1-a2fc-14c2bd366ac6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:54.387360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bf8ff514-bf6b-4bb1-a2fc-14c2bd366ac6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:54.402661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8ff514-bf6b-4bb1-a2fc-14c2bd366ac6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:54.403653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8ff514-bf6b-4bb1-a2fc-14c2bd366ac6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:54.405444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8ff514-bf6b-4bb1-a2fc-14c2bd366ac6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:54.406320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8ff514-bf6b-4bb1-a2fc-14c2bd366ac6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:54.407970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8ff514-bf6b-4bb1-a2fc-14c2bd366ac6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:54.410205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8ff514-bf6b-4bb1-a2fc-14c2bd366ac6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:54.492946 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bf8ff514-bf6b-4bb1-a2fc-14c2bd366ac6 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113021 Aug 23 18:25:54.496160 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3019/6175] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:25:54 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments => generated 197 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:25:54.859622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0a58d19c-e409-41cc-9a92-1f7945057fb2 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:54.861006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0a58d19c-e409-41cc-9a92-1f7945057fb2 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:54.879346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a58d19c-e409-41cc-9a92-1f7945057fb2 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:54.880151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a58d19c-e409-41cc-9a92-1f7945057fb2 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:54.883057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a58d19c-e409-41cc-9a92-1f7945057fb2 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:54.884041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a58d19c-e409-41cc-9a92-1f7945057fb2 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:54.886696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a58d19c-e409-41cc-9a92-1f7945057fb2 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:54.887487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0a58d19c-e409-41cc-9a92-1f7945057fb2 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:55.016020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0a58d19c-e409-41cc-9a92-1f7945057fb2 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:55.027741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0a58d19c-e409-41cc-9a92-1f7945057fb2 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:55.029260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0a58d19c-e409-41cc-9a92-1f7945057fb2 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:55.030476 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0a58d19c-e409-41cc-9a92-1f7945057fb2 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1357 microversion: 2.57 time: 0.177076 Aug 23 18:25:55.047302 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3157/6176] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:54 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1357 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:55.071170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-01b9f7c1-ed2f-4df8-a446-c0ba4c6d31df tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:55.073494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-01b9f7c1-ed2f-4df8-a446-c0ba4c6d31df tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:55.073722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:55.085761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:55.102099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01b9f7c1-ed2f-4df8-a446-c0ba4c6d31df tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:55.103842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01b9f7c1-ed2f-4df8-a446-c0ba4c6d31df tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:55.105954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01b9f7c1-ed2f-4df8-a446-c0ba4c6d31df tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:55.106934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01b9f7c1-ed2f-4df8-a446-c0ba4c6d31df tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:55.108167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01b9f7c1-ed2f-4df8-a446-c0ba4c6d31df tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:55.109189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:55.109699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:55.110017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01b9f7c1-ed2f-4df8-a446-c0ba4c6d31df tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:55.110160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:55.114466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:55.115014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:55.116008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:55.245536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:25:55.245912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:25:55.246404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:25:55.246854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:25:55.247282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:25:55.329535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:55.335479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-01b9f7c1-ed2f-4df8-a446-c0ba4c6d31df tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:55.338893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:55.340237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:55.341718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:55.342674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:55.343310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:55.343946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:55.355104 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-01b9f7c1-ed2f-4df8-a446-c0ba4c6d31df tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1692 microversion: 2.1 time: 0.290946 Aug 23 18:25:55.360425 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3020/6177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:55 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1692 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:55.382390 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f385b0a5-de8c-460a-8520-f152442abeed tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "POST /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d/action" status: 202 len: 1138 microversion: 2.57 time: 0.314914 Aug 23 18:25:55.383460 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3158/6178] 10.222.0.61 () {62 vars in 1320 bytes} [Tue Aug 23 18:25:55 2022] POST /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d/action => generated 1138 bytes in 317 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Aug 23 18:25:55.405829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7faf0492-7574-432e-8b22-f872a40f1e46 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:55.406927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7faf0492-7574-432e-8b22-f872a40f1e46 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:55.415548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7faf0492-7574-432e-8b22-f872a40f1e46 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:55.417439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7faf0492-7574-432e-8b22-f872a40f1e46 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:55.418065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7faf0492-7574-432e-8b22-f872a40f1e46 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:55.419291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7faf0492-7574-432e-8b22-f872a40f1e46 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:55.419936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7faf0492-7574-432e-8b22-f872a40f1e46 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:55.420531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7faf0492-7574-432e-8b22-f872a40f1e46 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:55.499042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7faf0492-7574-432e-8b22-f872a40f1e46 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:55.507781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8102d59d-a3bb-49bb-8b4b-582d72709371 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:55.510249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8102d59d-a3bb-49bb-8b4b-582d72709371 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:55.513481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7faf0492-7574-432e-8b22-f872a40f1e46 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:55.515300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7faf0492-7574-432e-8b22-f872a40f1e46 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:55.516772 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7faf0492-7574-432e-8b22-f872a40f1e46 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.115701 Aug 23 18:25:55.517176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8102d59d-a3bb-49bb-8b4b-582d72709371 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:55.517755 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3021/6179] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:55 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:55.518050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8102d59d-a3bb-49bb-8b4b-582d72709371 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:55.518506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8102d59d-a3bb-49bb-8b4b-582d72709371 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:55.519245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8102d59d-a3bb-49bb-8b4b-582d72709371 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:55.519712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8102d59d-a3bb-49bb-8b4b-582d72709371 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:55.520331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8102d59d-a3bb-49bb-8b4b-582d72709371 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:55.552028 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8102d59d-a3bb-49bb-8b4b-582d72709371 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048188 Aug 23 18:25:55.553748 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3159/6180] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:25:55 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:25:56.383870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0465c516-4571-4598-9b7b-ff2863e9b231 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:56.384579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0465c516-4571-4598-9b7b-ff2863e9b231 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:56.392048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0465c516-4571-4598-9b7b-ff2863e9b231 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:56.392543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0465c516-4571-4598-9b7b-ff2863e9b231 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:56.392987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0465c516-4571-4598-9b7b-ff2863e9b231 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:56.393794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0465c516-4571-4598-9b7b-ff2863e9b231 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:56.394252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0465c516-4571-4598-9b7b-ff2863e9b231 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:56.394709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0465c516-4571-4598-9b7b-ff2863e9b231 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:56.541747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0465c516-4571-4598-9b7b-ff2863e9b231 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:56.542509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eda5164f-65d6-41ea-a9e0-8c5e5b9fb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:56.543697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eda5164f-65d6-41ea-a9e0-8c5e5b9fb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:56.549816 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0465c516-4571-4598-9b7b-ff2863e9b231 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1692 microversion: 2.1 time: 0.170492 Aug 23 18:25:56.551676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eda5164f-65d6-41ea-a9e0-8c5e5b9fb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:56.553288 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3022/6181] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:56 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1692 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:56.565375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-90a1ad45-0fe0-49f9-82b1-d15f846b47c0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:56.566686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eda5164f-65d6-41ea-a9e0-8c5e5b9fb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:56.567762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-90a1ad45-0fe0-49f9-82b1-d15f846b47c0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:56.568277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eda5164f-65d6-41ea-a9e0-8c5e5b9fb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:56.570424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eda5164f-65d6-41ea-a9e0-8c5e5b9fb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:56.571613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eda5164f-65d6-41ea-a9e0-8c5e5b9fb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:56.572289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eda5164f-65d6-41ea-a9e0-8c5e5b9fb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:56.590085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90a1ad45-0fe0-49f9-82b1-d15f846b47c0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:56.591593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90a1ad45-0fe0-49f9-82b1-d15f846b47c0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:56.596192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90a1ad45-0fe0-49f9-82b1-d15f846b47c0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:56.597293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90a1ad45-0fe0-49f9-82b1-d15f846b47c0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:56.597767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90a1ad45-0fe0-49f9-82b1-d15f846b47c0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:56.598373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90a1ad45-0fe0-49f9-82b1-d15f846b47c0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:56.641456 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-90a1ad45-0fe0-49f9-82b1-d15f846b47c0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.080021 Aug 23 18:25:56.646219 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3023/6182] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:25:56 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:25:56.670616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eda5164f-65d6-41ea-a9e0-8c5e5b9fb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:56.674521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:56.691868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eda5164f-65d6-41ea-a9e0-8c5e5b9fb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:56.694440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eda5164f-65d6-41ea-a9e0-8c5e5b9fb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:56.695999 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eda5164f-65d6-41ea-a9e0-8c5e5b9fb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.159151 Aug 23 18:25:56.706621 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3160/6183] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:56 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:25:57.574763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8c7d2bdc-f761-408c-84b0-814a65439729 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:57.575379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8c7d2bdc-f761-408c-84b0-814a65439729 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:57.583014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c7d2bdc-f761-408c-84b0-814a65439729 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:57.583514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c7d2bdc-f761-408c-84b0-814a65439729 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:57.584535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c7d2bdc-f761-408c-84b0-814a65439729 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:57.585355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c7d2bdc-f761-408c-84b0-814a65439729 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:57.585826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c7d2bdc-f761-408c-84b0-814a65439729 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:57.586270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c7d2bdc-f761-408c-84b0-814a65439729 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:57.653998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d0d35925-70b3-4e64-95ec-2b61d2119d7e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:57.657314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d0d35925-70b3-4e64-95ec-2b61d2119d7e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:57.664781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0d35925-70b3-4e64-95ec-2b61d2119d7e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:57.665360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0d35925-70b3-4e64-95ec-2b61d2119d7e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:57.666129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0d35925-70b3-4e64-95ec-2b61d2119d7e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:57.666956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0d35925-70b3-4e64-95ec-2b61d2119d7e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:57.667534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0d35925-70b3-4e64-95ec-2b61d2119d7e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:57.667987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0d35925-70b3-4e64-95ec-2b61d2119d7e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:57.713225 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d0d35925-70b3-4e64-95ec-2b61d2119d7e tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062988 Aug 23 18:25:57.714692 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3161/6184] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:25:57 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:25:57.728585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e45b5f96-b90c-42db-b79d-9c16cd05ad49 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:57.730297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e45b5f96-b90c-42db-b79d-9c16cd05ad49 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:57.739368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e45b5f96-b90c-42db-b79d-9c16cd05ad49 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:57.745060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e45b5f96-b90c-42db-b79d-9c16cd05ad49 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:57.746254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e45b5f96-b90c-42db-b79d-9c16cd05ad49 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:57.747154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e45b5f96-b90c-42db-b79d-9c16cd05ad49 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:57.747636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e45b5f96-b90c-42db-b79d-9c16cd05ad49 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:57.748232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e45b5f96-b90c-42db-b79d-9c16cd05ad49 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:57.776095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8c7d2bdc-f761-408c-84b0-814a65439729 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:57.786665 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8c7d2bdc-f761-408c-84b0-814a65439729 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1692 microversion: 2.1 time: 0.215793 Aug 23 18:25:57.789593 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3024/6185] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:57 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1692 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:57.870051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e45b5f96-b90c-42db-b79d-9c16cd05ad49 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:57.880544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e45b5f96-b90c-42db-b79d-9c16cd05ad49 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:57.882119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e45b5f96-b90c-42db-b79d-9c16cd05ad49 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:57.883342 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e45b5f96-b90c-42db-b79d-9c16cd05ad49 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.162120 Aug 23 18:25:57.884081 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3162/6186] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:57 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 23 18:25:58.727363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c51e7363-6381-431c-8299-218182a28762 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:58.729593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c51e7363-6381-431c-8299-218182a28762 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:58.733105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:58.734041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:58.742073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c51e7363-6381-431c-8299-218182a28762 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:58.742840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c51e7363-6381-431c-8299-218182a28762 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:58.743280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c51e7363-6381-431c-8299-218182a28762 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:58.743990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c51e7363-6381-431c-8299-218182a28762 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:58.744451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c51e7363-6381-431c-8299-218182a28762 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:58.744872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c51e7363-6381-431c-8299-218182a28762 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:58.780555 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c51e7363-6381-431c-8299-218182a28762 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058072 Aug 23 18:25:58.781468 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3025/6187] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:25:58 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:25:58.814255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-43eaf0fb-13e8-4c67-80a7-11a9d4f5e48d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:58.815197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-43eaf0fb-13e8-4c67-80a7-11a9d4f5e48d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:58.818057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:25:58.824405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43eaf0fb-13e8-4c67-80a7-11a9d4f5e48d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:58.824837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43eaf0fb-13e8-4c67-80a7-11a9d4f5e48d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:58.825278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43eaf0fb-13e8-4c67-80a7-11a9d4f5e48d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:58.826225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43eaf0fb-13e8-4c67-80a7-11a9d4f5e48d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:58.826903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43eaf0fb-13e8-4c67-80a7-11a9d4f5e48d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:58.827376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43eaf0fb-13e8-4c67-80a7-11a9d4f5e48d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:58.857949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa188fc8-52b1-44d3-a005-b6116988c907 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:58.858525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fa188fc8-52b1-44d3-a005-b6116988c907 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:58.864701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa188fc8-52b1-44d3-a005-b6116988c907 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:58.865602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa188fc8-52b1-44d3-a005-b6116988c907 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:58.866285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa188fc8-52b1-44d3-a005-b6116988c907 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:58.867290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa188fc8-52b1-44d3-a005-b6116988c907 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:58.867968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa188fc8-52b1-44d3-a005-b6116988c907 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:58.868641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa188fc8-52b1-44d3-a005-b6116988c907 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:58.897621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fa188fc8-52b1-44d3-a005-b6116988c907 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:25:59.001550 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fa188fc8-52b1-44d3-a005-b6116988c907 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 204 len: 0 microversion: 2.1 time: 0.147330 Aug 23 18:25:59.002598 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3026/6188] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:25:58 2022] DELETE /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:25:59.009868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-065b0c8a-06d2-4b01-a795-42b2b535f211 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:59.010824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-065b0c8a-06d2-4b01-a795-42b2b535f211 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:59.011087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-43eaf0fb-13e8-4c67-80a7-11a9d4f5e48d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:59.017257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-065b0c8a-06d2-4b01-a795-42b2b535f211 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:59.017751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-065b0c8a-06d2-4b01-a795-42b2b535f211 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:59.018364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-065b0c8a-06d2-4b01-a795-42b2b535f211 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:59.019123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-065b0c8a-06d2-4b01-a795-42b2b535f211 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:59.019587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-065b0c8a-06d2-4b01-a795-42b2b535f211 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:59.020018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-065b0c8a-06d2-4b01-a795-42b2b535f211 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:59.022221 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-43eaf0fb-13e8-4c67-80a7-11a9d4f5e48d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1689 microversion: 2.1 time: 0.212248 Aug 23 18:25:59.023041 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3163/6189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:58 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1689 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:59.027895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e2e1d1c3-7e1e-4956-bcb8-d3bef1d01651 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:59.028579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e2e1d1c3-7e1e-4956-bcb8-d3bef1d01651 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:59.034915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2e1d1c3-7e1e-4956-bcb8-d3bef1d01651 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:59.035472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2e1d1c3-7e1e-4956-bcb8-d3bef1d01651 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:59.036155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2e1d1c3-7e1e-4956-bcb8-d3bef1d01651 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:59.037496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2e1d1c3-7e1e-4956-bcb8-d3bef1d01651 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:59.038240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2e1d1c3-7e1e-4956-bcb8-d3bef1d01651 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:59.039247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2e1d1c3-7e1e-4956-bcb8-d3bef1d01651 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:59.112995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-065b0c8a-06d2-4b01-a795-42b2b535f211 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:59.122000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-065b0c8a-06d2-4b01-a795-42b2b535f211 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:59.123579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-065b0c8a-06d2-4b01-a795-42b2b535f211 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:59.124752 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-065b0c8a-06d2-4b01-a795-42b2b535f211 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.120948 Aug 23 18:25:59.125321 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3027/6190] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:25:59 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:25:59.132909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1e017178-3e8a-4e77-86b4-f8bfd6dab640 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:25:59.133997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1e017178-3e8a-4e77-86b4-f8bfd6dab640 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:59.143138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e017178-3e8a-4e77-86b4-f8bfd6dab640 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:59.143704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e017178-3e8a-4e77-86b4-f8bfd6dab640 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:59.144212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e017178-3e8a-4e77-86b4-f8bfd6dab640 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:59.145588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e017178-3e8a-4e77-86b4-f8bfd6dab640 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:59.147389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e017178-3e8a-4e77-86b4-f8bfd6dab640 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:59.147916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1e017178-3e8a-4e77-86b4-f8bfd6dab640 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:59.232056 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1e017178-3e8a-4e77-86b4-f8bfd6dab640 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862/action" status: 204 len: 0 microversion: 2.1 time: 0.103311 Aug 23 18:25:59.232818 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3028/6191] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:25:59 2022] POST /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862/action => generated 0 bytes in 107 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:25:59.245220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e66346a5-bc52-4007-8dee-f0c4e8ac0c88 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:25:59.246030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e66346a5-bc52-4007-8dee-f0c4e8ac0c88 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:25:59.256200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e2e1d1c3-7e1e-4956-bcb8-d3bef1d01651 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:59.265082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e66346a5-bc52-4007-8dee-f0c4e8ac0c88 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:59.265537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e66346a5-bc52-4007-8dee-f0c4e8ac0c88 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:59.266056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e66346a5-bc52-4007-8dee-f0c4e8ac0c88 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:59.266850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e66346a5-bc52-4007-8dee-f0c4e8ac0c88 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:25:59.269501 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e2e1d1c3-7e1e-4956-bcb8-d3bef1d01651 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1681 microversion: 2.1 time: 0.245106 Aug 23 18:25:59.270701 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3164/6192] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:59 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1681 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:25:59.288958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e66346a5-bc52-4007-8dee-f0c4e8ac0c88 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:25:59.289760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e66346a5-bc52-4007-8dee-f0c4e8ac0c88 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:25:59.600598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e66346a5-bc52-4007-8dee-f0c4e8ac0c88 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:25:59.620905 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e66346a5-bc52-4007-8dee-f0c4e8ac0c88 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1689 microversion: 2.1 time: 0.380526 Aug 23 18:25:59.634603 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3029/6193] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:25:59 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1689 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:00.151157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d498ecd3-ae4d-4c17-aee2-e96a6a98e5cc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:00.152908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d498ecd3-ae4d-4c17-aee2-e96a6a98e5cc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:00.160293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d498ecd3-ae4d-4c17-aee2-e96a6a98e5cc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:00.160788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d498ecd3-ae4d-4c17-aee2-e96a6a98e5cc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:00.161235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d498ecd3-ae4d-4c17-aee2-e96a6a98e5cc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:00.163486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d498ecd3-ae4d-4c17-aee2-e96a6a98e5cc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:00.163969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d498ecd3-ae4d-4c17-aee2-e96a6a98e5cc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:00.164441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d498ecd3-ae4d-4c17-aee2-e96a6a98e5cc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:00.232849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d498ecd3-ae4d-4c17-aee2-e96a6a98e5cc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:00.243013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d498ecd3-ae4d-4c17-aee2-e96a6a98e5cc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:00.244553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d498ecd3-ae4d-4c17-aee2-e96a6a98e5cc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:00.245829 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d498ecd3-ae4d-4c17-aee2-e96a6a98e5cc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.101039 Aug 23 18:26:00.246401 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3165/6194] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:00 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:00.294355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de85ba69-be14-48cf-8d7d-56753a2556bd tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:00.295347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-de85ba69-be14-48cf-8d7d-56753a2556bd tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:00.304162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de85ba69-be14-48cf-8d7d-56753a2556bd tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:00.304162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de85ba69-be14-48cf-8d7d-56753a2556bd tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:00.304420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de85ba69-be14-48cf-8d7d-56753a2556bd tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:00.305394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de85ba69-be14-48cf-8d7d-56753a2556bd tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:00.305933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de85ba69-be14-48cf-8d7d-56753a2556bd tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:00.306452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de85ba69-be14-48cf-8d7d-56753a2556bd tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:00.444034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-de85ba69-be14-48cf-8d7d-56753a2556bd tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:00.452569 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-de85ba69-be14-48cf-8d7d-56753a2556bd tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1681 microversion: 2.1 time: 0.162695 Aug 23 18:26:00.453140 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3030/6195] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:00 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:00.644429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-780a3184-8fff-4491-82fd-bb740bc783c4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:00.645394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-780a3184-8fff-4491-82fd-bb740bc783c4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:00.658784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-780a3184-8fff-4491-82fd-bb740bc783c4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:00.660610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-780a3184-8fff-4491-82fd-bb740bc783c4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:00.663353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-780a3184-8fff-4491-82fd-bb740bc783c4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:00.665631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-780a3184-8fff-4491-82fd-bb740bc783c4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:00.666300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-780a3184-8fff-4491-82fd-bb740bc783c4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:00.668276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-780a3184-8fff-4491-82fd-bb740bc783c4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:00.728983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-09092d75-84b8-4c64-ab3c-88a0ec14da28 req-89e31b9f-41d7-4d19-9952-3eec2a51690f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134e2d84-3f0f-4f9f-b4d7-536f87817862", "name": "network-vif-plugged", "status": "completed", "tag": "d1239621-cfc1-4ef0-b26e-40a6e6e24d16"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:26:00.743159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-09092d75-84b8-4c64-ab3c-88a0ec14da28 req-89e31b9f-41d7-4d19-9952-3eec2a51690f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:00.743655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-09092d75-84b8-4c64-ab3c-88a0ec14da28 req-89e31b9f-41d7-4d19-9952-3eec2a51690f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:00.744109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-09092d75-84b8-4c64-ab3c-88a0ec14da28 req-89e31b9f-41d7-4d19-9952-3eec2a51690f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:00.758784 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-09092d75-84b8-4c64-ab3c-88a0ec14da28 req-89e31b9f-41d7-4d19-9952-3eec2a51690f service nova] Creating event network-vif-plugged:d1239621-cfc1-4ef0-b26e-40a6e6e24d16 for instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 on n-h2-850468-16 Aug 23 18:26:00.764672 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-09092d75-84b8-4c64-ab3c-88a0ec14da28 req-89e31b9f-41d7-4d19-9952-3eec2a51690f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039342 Aug 23 18:26:00.765413 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3031/6196] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:26:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:26:00.884074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-780a3184-8fff-4491-82fd-bb740bc783c4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:00.892774 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-780a3184-8fff-4491-82fd-bb740bc783c4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1689 microversion: 2.1 time: 0.252871 Aug 23 18:26:00.893367 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3166/6197] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:00 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1689 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:01.275722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c41b45c-9c3c-4cd2-8840-d43ed664471b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:01.276468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c41b45c-9c3c-4cd2-8840-d43ed664471b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:01.283651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c41b45c-9c3c-4cd2-8840-d43ed664471b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:01.284150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c41b45c-9c3c-4cd2-8840-d43ed664471b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:01.284590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c41b45c-9c3c-4cd2-8840-d43ed664471b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:01.289804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c41b45c-9c3c-4cd2-8840-d43ed664471b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:01.290298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c41b45c-9c3c-4cd2-8840-d43ed664471b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:01.291000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c41b45c-9c3c-4cd2-8840-d43ed664471b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:01.297153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:01.374578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c41b45c-9c3c-4cd2-8840-d43ed664471b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:01.383179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c41b45c-9c3c-4cd2-8840-d43ed664471b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:01.384839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c41b45c-9c3c-4cd2-8840-d43ed664471b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:01.386027 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c41b45c-9c3c-4cd2-8840-d43ed664471b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.119996 Aug 23 18:26:01.386625 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3032/6198] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:01 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:01.476219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-78a9299b-7f5c-4286-ad1f-11703bef45d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:01.476898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-78a9299b-7f5c-4286-ad1f-11703bef45d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:01.486098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78a9299b-7f5c-4286-ad1f-11703bef45d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:01.486645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78a9299b-7f5c-4286-ad1f-11703bef45d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:01.487100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78a9299b-7f5c-4286-ad1f-11703bef45d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:01.487821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78a9299b-7f5c-4286-ad1f-11703bef45d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:01.488280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78a9299b-7f5c-4286-ad1f-11703bef45d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:01.488732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78a9299b-7f5c-4286-ad1f-11703bef45d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:01.620787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-78a9299b-7f5c-4286-ad1f-11703bef45d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a11d6c5120f24a448c1831ff925409c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4187000f2f8947aaab6603191fe0cb9a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:01.636561 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-78a9299b-7f5c-4286-ad1f-11703bef45d0 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 200 len: 1613 microversion: 2.1 time: 0.164597 Aug 23 18:26:01.637151 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3167/6199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:01 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 1613 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:01.838665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-cd3927d5-d039-40db-9213-08d0f73e23e7 req-1677b988-130e-4323-a4db-fb32a608e7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b33aebb-e0c2-43d1-9182-7818c49e0d6d", "name": "network-vif-deleted", "tag": "a8d50a38-1a3f-4f55-a8e3-170e93de2b8f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:26:01.850249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cd3927d5-d039-40db-9213-08d0f73e23e7 req-1677b988-130e-4323-a4db-fb32a608e7b2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:01.851123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cd3927d5-d039-40db-9213-08d0f73e23e7 req-1677b988-130e-4323-a4db-fb32a608e7b2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:01.851786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cd3927d5-d039-40db-9213-08d0f73e23e7 req-1677b988-130e-4323-a4db-fb32a608e7b2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:01.881816 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-cd3927d5-d039-40db-9213-08d0f73e23e7 req-1677b988-130e-4323-a4db-fb32a608e7b2 service nova] Creating event network-vif-deleted:a8d50a38-1a3f-4f55-a8e3-170e93de2b8f for instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d on n-h2-850468-16 Aug 23 18:26:01.889944 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-cd3927d5-d039-40db-9213-08d0f73e23e7 req-1677b988-130e-4323-a4db-fb32a608e7b2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055792 Aug 23 18:26:01.891382 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3033/6200] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:26:01.916524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d8cf18ab-c1ac-4d83-ba86-82d1a5c3608d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:01.917152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d8cf18ab-c1ac-4d83-ba86-82d1a5c3608d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:01.928077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cf18ab-c1ac-4d83-ba86-82d1a5c3608d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:01.932424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cf18ab-c1ac-4d83-ba86-82d1a5c3608d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:01.936518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cf18ab-c1ac-4d83-ba86-82d1a5c3608d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:01.937309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cf18ab-c1ac-4d83-ba86-82d1a5c3608d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:01.937793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cf18ab-c1ac-4d83-ba86-82d1a5c3608d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:01.938232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cf18ab-c1ac-4d83-ba86-82d1a5c3608d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:02.206102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d8cf18ab-c1ac-4d83-ba86-82d1a5c3608d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:02.215343 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d8cf18ab-c1ac-4d83-ba86-82d1a5c3608d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1681 microversion: 2.1 time: 0.303745 Aug 23 18:26:02.216160 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3168/6201] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:01 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1681 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:02.410599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-12267d36-96ba-4214-a1b9-b44cdf6df93d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:02.411308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-12267d36-96ba-4214-a1b9-b44cdf6df93d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:02.418315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12267d36-96ba-4214-a1b9-b44cdf6df93d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:02.418837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12267d36-96ba-4214-a1b9-b44cdf6df93d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:02.419274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12267d36-96ba-4214-a1b9-b44cdf6df93d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:02.420158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12267d36-96ba-4214-a1b9-b44cdf6df93d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:02.420621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12267d36-96ba-4214-a1b9-b44cdf6df93d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:02.421050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12267d36-96ba-4214-a1b9-b44cdf6df93d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:02.494871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-12267d36-96ba-4214-a1b9-b44cdf6df93d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:02.503540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-12267d36-96ba-4214-a1b9-b44cdf6df93d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:02.507597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-12267d36-96ba-4214-a1b9-b44cdf6df93d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:02.510484 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-12267d36-96ba-4214-a1b9-b44cdf6df93d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.105009 Aug 23 18:26:02.514818 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3034/6202] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:02 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:02.659676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-098db2a7-2bb2-4343-a6a8-8bacf47a5dc4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:02.662316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-098db2a7-2bb2-4343-a6a8-8bacf47a5dc4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:02.672666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-098db2a7-2bb2-4343-a6a8-8bacf47a5dc4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:02.673506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-098db2a7-2bb2-4343-a6a8-8bacf47a5dc4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:02.674573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-098db2a7-2bb2-4343-a6a8-8bacf47a5dc4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:02.675520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-098db2a7-2bb2-4343-a6a8-8bacf47a5dc4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:02.676235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-098db2a7-2bb2-4343-a6a8-8bacf47a5dc4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:02.676945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-098db2a7-2bb2-4343-a6a8-8bacf47a5dc4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:02.695467 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-098db2a7-2bb2-4343-a6a8-8bacf47a5dc4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-098db2a7-2bb2-4343-a6a8-8bacf47a5dc4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d HTTP/1.1 Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '7b33aebb-e0c2-43d1-9182-7818c49e0d6d'} Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:02.697815 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:02.703938 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:02.703938 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:02.703938 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:02.703938 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:26:02.703938 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:26:02.703938 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:02.703938 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:02.703938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-098db2a7-2bb2-4343-a6a8-8bacf47a5dc4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 404 to user: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:26:02.705539 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-098db2a7-2bb2-4343-a6a8-8bacf47a5dc4 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 404 len: 111 microversion: 2.1 time: 0.050795 Aug 23 18:26:02.706278 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3169/6203] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:02 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:26:02.715865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c4f8b5f0-e86d-4255-a254-5b5bb94174cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '.version_select at 0x7f27df628430>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:02.736868 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c4f8b5f0-e86d-4255-a254-5b5bb94174cf tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173824241" status: 202 len: 0 microversion: 2.1 time: 0.024940 Aug 23 18:26:02.741369 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3035/6204] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 18:26:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1173824241 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:26:03.535681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-88fbf7b8-0c23-4a0b-a035-a460754d3262 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:03.536316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-88fbf7b8-0c23-4a0b-a035-a460754d3262 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:03.546915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88fbf7b8-0c23-4a0b-a035-a460754d3262 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:03.546915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88fbf7b8-0c23-4a0b-a035-a460754d3262 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:03.546915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88fbf7b8-0c23-4a0b-a035-a460754d3262 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:03.546915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88fbf7b8-0c23-4a0b-a035-a460754d3262 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:03.546915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88fbf7b8-0c23-4a0b-a035-a460754d3262 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:03.547395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88fbf7b8-0c23-4a0b-a035-a460754d3262 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:03.838228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-88fbf7b8-0c23-4a0b-a035-a460754d3262 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:03.847498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-88fbf7b8-0c23-4a0b-a035-a460754d3262 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:03.849006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-88fbf7b8-0c23-4a0b-a035-a460754d3262 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:03.850603 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-88fbf7b8-0c23-4a0b-a035-a460754d3262 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.318802 Aug 23 18:26:03.851161 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3170/6205] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:03 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:04.876344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81076152-95b4-4006-b748-65b96ca07925 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:04.877235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-81076152-95b4-4006-b748-65b96ca07925 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:04.898501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81076152-95b4-4006-b748-65b96ca07925 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:04.899075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81076152-95b4-4006-b748-65b96ca07925 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:04.899537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81076152-95b4-4006-b748-65b96ca07925 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:04.904362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81076152-95b4-4006-b748-65b96ca07925 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:04.905382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81076152-95b4-4006-b748-65b96ca07925 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:04.905832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81076152-95b4-4006-b748-65b96ca07925 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:04.982330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81076152-95b4-4006-b748-65b96ca07925 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:04.992999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81076152-95b4-4006-b748-65b96ca07925 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:04.994820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-81076152-95b4-4006-b748-65b96ca07925 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:04.996544 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81076152-95b4-4006-b748-65b96ca07925 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.125655 Aug 23 18:26:04.997179 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3036/6206] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:04 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:06.025018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e9a26cd3-1776-453f-9018-a55daf3d1173 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:06.025654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e9a26cd3-1776-453f-9018-a55daf3d1173 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:06.035365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9a26cd3-1776-453f-9018-a55daf3d1173 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:06.035365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9a26cd3-1776-453f-9018-a55daf3d1173 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:06.035365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9a26cd3-1776-453f-9018-a55daf3d1173 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:06.035365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9a26cd3-1776-453f-9018-a55daf3d1173 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:06.035365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9a26cd3-1776-453f-9018-a55daf3d1173 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:06.035365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9a26cd3-1776-453f-9018-a55daf3d1173 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:06.104958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e9a26cd3-1776-453f-9018-a55daf3d1173 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:06.113511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e9a26cd3-1776-453f-9018-a55daf3d1173 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:06.115905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e9a26cd3-1776-453f-9018-a55daf3d1173 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:06.117219 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e9a26cd3-1776-453f-9018-a55daf3d1173 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.098159 Aug 23 18:26:06.117818 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3171/6207] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:06 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:06.171967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-725938447", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "42dfc1cf-246a-45ae-92c6-caca26114153"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:26:06.182263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:06.237092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] validate_networks() for [('42dfc1cf-246a-45ae-92c6-caca26114153', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:26:06.627403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:26:06.627836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:26:06.628618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:26:06.629336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:26:06.629869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:26:06.639312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:06.639819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:06.642003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:06.642818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:06.643291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:06.643761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:06.661020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Getting quotas for project 1977275b274d49689336fd831ea86b62. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:26:06.667428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Getting quotas for user 1be3bad4bb254b558086561daa864c0b and project 1977275b274d49689336fd831ea86b62. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:26:06.681403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:26:06.683882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:26:06.718002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1b6186d0-35b7-40c9-a8d0-ef9153fed3e7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:06.718510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1b6186d0-35b7-40c9-a8d0-ef9153fed3e7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:06.725514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b6186d0-35b7-40c9-a8d0-ef9153fed3e7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:06.726039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b6186d0-35b7-40c9-a8d0-ef9153fed3e7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:06.726486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b6186d0-35b7-40c9-a8d0-ef9153fed3e7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:06.727266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b6186d0-35b7-40c9-a8d0-ef9153fed3e7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:06.727733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b6186d0-35b7-40c9-a8d0-ef9153fed3e7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:06.728164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b6186d0-35b7-40c9-a8d0-ef9153fed3e7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:06.739158 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fc312fb7-f80d-4709-bd06-dc0f20e9ea11 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702100 Aug 23 18:26:06.746368 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3037/6208] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:26:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:26:06.748259 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-1b6186d0-35b7-40c9-a8d0-ef9153fed3e7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1b6186d0-35b7-40c9-a8d0-ef9153fed3e7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d HTTP/1.1 Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '7b33aebb-e0c2-43d1-9182-7818c49e0d6d'} Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:26:06.749861 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:26:06.753834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:06.753834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:06.753834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:06.753834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:06.753834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:06.753834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:06.753834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:06.753834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:26:06.753834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:26:06.753834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:06.753834 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:06.753834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1b6186d0-35b7-40c9-a8d0-ef9153fed3e7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 404 to user: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:26:06.754627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b4bcda40-71ab-4fa7-835b-83bcdaef33c1 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:06.754727 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1b6186d0-35b7-40c9-a8d0-ef9153fed3e7 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 404 len: 111 microversion: 2.1 time: 0.037655 Aug 23 18:26:06.754811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b4bcda40-71ab-4fa7-835b-83bcdaef33c1 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:06.756413 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3172/6209] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:26:06 2022] DELETE /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:26:06.762448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f7a37f9-efd5-4d5d-be73-8c89861a0a60 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:06.763247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8f7a37f9-efd5-4d5d-be73-8c89861a0a60 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 7b33aebb-e0c2-43d1-9182-7818c49e0d6d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:06.770531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f7a37f9-efd5-4d5d-be73-8c89861a0a60 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:06.771135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f7a37f9-efd5-4d5d-be73-8c89861a0a60 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:06.772350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f7a37f9-efd5-4d5d-be73-8c89861a0a60 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:06.772993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f7a37f9-efd5-4d5d-be73-8c89861a0a60 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:06.773462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f7a37f9-efd5-4d5d-be73-8c89861a0a60 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:06.773899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f7a37f9-efd5-4d5d-be73-8c89861a0a60 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:06.790642 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8f7a37f9-efd5-4d5d-be73-8c89861a0a60 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f7a37f9-efd5-4d5d-be73-8c89861a0a60 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d HTTP/1.1 Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '7b33aebb-e0c2-43d1-9182-7818c49e0d6d'} Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:06.792573 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:06.797545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:06.797545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:06.797545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:06.797545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:26:06.797545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:26:06.797545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. Aug 23 18:26:06.797545 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:06.799091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f7a37f9-efd5-4d5d-be73-8c89861a0a60 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 404 to user: Instance 7b33aebb-e0c2-43d1-9182-7818c49e0d6d could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:26:06.800458 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f7a37f9-efd5-4d5d-be73-8c89861a0a60 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d" status: 404 len: 111 microversion: 2.1 time: 0.043043 Aug 23 18:26:06.801234 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3173/6210] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:06 2022] GET /compute/v2.1/servers/7b33aebb-e0c2-43d1-9182-7818c49e0d6d => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:26:06.830550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b4bcda40-71ab-4fa7-835b-83bcdaef33c1 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be3bad4bb254b558086561daa864c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977275b274d49689336fd831ea86b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:06.837795 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b4bcda40-71ab-4fa7-835b-83bcdaef33c1 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 200 len: 1213 microversion: 2.1 time: 0.090336 Aug 23 18:26:06.838652 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3038/6211] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:06 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:26:07.142271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6992603d-ad60-43e6-85ca-23e80e345427 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:07.143755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6992603d-ad60-43e6-85ca-23e80e345427 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:07.152992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6992603d-ad60-43e6-85ca-23e80e345427 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:07.153897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6992603d-ad60-43e6-85ca-23e80e345427 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:07.154588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6992603d-ad60-43e6-85ca-23e80e345427 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:07.155530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6992603d-ad60-43e6-85ca-23e80e345427 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:07.156227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6992603d-ad60-43e6-85ca-23e80e345427 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:07.156855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6992603d-ad60-43e6-85ca-23e80e345427 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:07.239191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6992603d-ad60-43e6-85ca-23e80e345427 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:07.249258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6992603d-ad60-43e6-85ca-23e80e345427 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:07.251095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6992603d-ad60-43e6-85ca-23e80e345427 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:07.252847 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6992603d-ad60-43e6-85ca-23e80e345427 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.115419 Aug 23 18:26:07.268385 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3174/6212] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:07 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:07.860535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b3ac386f-ae9e-465a-b961-171463a7a22c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:07.861138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b3ac386f-ae9e-465a-b961-171463a7a22c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:07.869663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ac386f-ae9e-465a-b961-171463a7a22c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:07.870164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ac386f-ae9e-465a-b961-171463a7a22c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:07.870636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ac386f-ae9e-465a-b961-171463a7a22c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:07.871343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ac386f-ae9e-465a-b961-171463a7a22c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:07.871799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ac386f-ae9e-465a-b961-171463a7a22c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:07.872227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3ac386f-ae9e-465a-b961-171463a7a22c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:07.992918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b3ac386f-ae9e-465a-b961-171463a7a22c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be3bad4bb254b558086561daa864c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977275b274d49689336fd831ea86b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:08.002318 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b3ac386f-ae9e-465a-b961-171463a7a22c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 200 len: 1265 microversion: 2.1 time: 0.145828 Aug 23 18:26:08.002984 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3039/6213] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:07 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 1265 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:08.279425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dca00571-10bb-4258-907e-896d93964c50 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:08.280070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dca00571-10bb-4258-907e-896d93964c50 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:08.287700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dca00571-10bb-4258-907e-896d93964c50 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:08.288222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dca00571-10bb-4258-907e-896d93964c50 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:08.288649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dca00571-10bb-4258-907e-896d93964c50 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:08.289356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dca00571-10bb-4258-907e-896d93964c50 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:08.289824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dca00571-10bb-4258-907e-896d93964c50 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:08.290253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dca00571-10bb-4258-907e-896d93964c50 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:08.359832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dca00571-10bb-4258-907e-896d93964c50 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:08.373195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dca00571-10bb-4258-907e-896d93964c50 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:08.377109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dca00571-10bb-4258-907e-896d93964c50 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:08.378436 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dca00571-10bb-4258-907e-896d93964c50 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.103032 Aug 23 18:26:08.382681 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3175/6214] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:08 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:09.026039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-041df65f-348e-4c3d-8933-2586d14371a5 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:09.026525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-041df65f-348e-4c3d-8933-2586d14371a5 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:09.034612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-041df65f-348e-4c3d-8933-2586d14371a5 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:09.035474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-041df65f-348e-4c3d-8933-2586d14371a5 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:09.036207 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-041df65f-348e-4c3d-8933-2586d14371a5 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:09.037346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-041df65f-348e-4c3d-8933-2586d14371a5 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:09.038134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-041df65f-348e-4c3d-8933-2586d14371a5 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:09.038878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-041df65f-348e-4c3d-8933-2586d14371a5 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:09.409596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-34c5cc8d-b949-4725-b088-cf23fc0653eb tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:09.412208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-34c5cc8d-b949-4725-b088-cf23fc0653eb tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:09.418164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:09.424460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34c5cc8d-b949-4725-b088-cf23fc0653eb tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:09.425173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34c5cc8d-b949-4725-b088-cf23fc0653eb tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:09.425623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34c5cc8d-b949-4725-b088-cf23fc0653eb tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:09.426468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34c5cc8d-b949-4725-b088-cf23fc0653eb tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:09.427155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34c5cc8d-b949-4725-b088-cf23fc0653eb tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:09.427589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34c5cc8d-b949-4725-b088-cf23fc0653eb tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:09.504569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-34c5cc8d-b949-4725-b088-cf23fc0653eb tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:09.517701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-34c5cc8d-b949-4725-b088-cf23fc0653eb tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:09.519484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-34c5cc8d-b949-4725-b088-cf23fc0653eb tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:09.520750 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-34c5cc8d-b949-4725-b088-cf23fc0653eb tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.121107 Aug 23 18:26:09.521892 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3176/6215] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:09 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:09.603915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-041df65f-348e-4c3d-8933-2586d14371a5 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be3bad4bb254b558086561daa864c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977275b274d49689336fd831ea86b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:09.613178 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-041df65f-348e-4c3d-8933-2586d14371a5 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 200 len: 1313 microversion: 2.1 time: 0.592890 Aug 23 18:26:09.615333 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3040/6216] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:09 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 1313 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:09.666818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4647cc8c-2dd7-416d-b886-b3dc3206553e req-ee4b19de-2616-475a-bde4-aa8a2557dc79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f00585b2-dc1b-4f16-b33f-b8d9433ff9b9", "tag": "255a44c3-8b21-4af9-804f-e94c489e4d2b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:26:09.679598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4647cc8c-2dd7-416d-b886-b3dc3206553e req-ee4b19de-2616-475a-bde4-aa8a2557dc79 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:09.680553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4647cc8c-2dd7-416d-b886-b3dc3206553e req-ee4b19de-2616-475a-bde4-aa8a2557dc79 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:09.681231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4647cc8c-2dd7-416d-b886-b3dc3206553e req-ee4b19de-2616-475a-bde4-aa8a2557dc79 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:09.697384 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4647cc8c-2dd7-416d-b886-b3dc3206553e req-ee4b19de-2616-475a-bde4-aa8a2557dc79 service nova] Creating event network-changed:255a44c3-8b21-4af9-804f-e94c489e4d2b for instance f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 on n-h1-850468-16 Aug 23 18:26:09.706335 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4647cc8c-2dd7-416d-b886-b3dc3206553e req-ee4b19de-2616-475a-bde4-aa8a2557dc79 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045280 Aug 23 18:26:09.707595 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3177/6217] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:26:10.101292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c8de34e-cab1-4820-8476-e610f83fb650 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:10.101791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1c8de34e-cab1-4820-8476-e610f83fb650 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:10.109644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c8de34e-cab1-4820-8476-e610f83fb650 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:10.110389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c8de34e-cab1-4820-8476-e610f83fb650 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:10.110880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c8de34e-cab1-4820-8476-e610f83fb650 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:10.111595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c8de34e-cab1-4820-8476-e610f83fb650 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:10.112058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c8de34e-cab1-4820-8476-e610f83fb650 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:10.112556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c8de34e-cab1-4820-8476-e610f83fb650 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:10.129294 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-1c8de34e-cab1-4820-8476-e610f83fb650 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c8de34e-cab1-4820-8476-e610f83fb650 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 HTTP/1.1 Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '454f6367-fca5-4f24-b48e-4c1ea5603c29'} Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:26:10.133341 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c8de34e-cab1-4820-8476-e610f83fb650 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 404 to user: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c8de34e-cab1-4820-8476-e610f83fb650 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 404 len: 111 microversion: 2.1 time: 0.038031 Aug 23 18:26:10.138917 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3041/6218] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:26:10 2022] DELETE /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:26:10.145731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3de09891-4acc-4eab-8342-60478beb7700 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:10.147242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3de09891-4acc-4eab-8342-60478beb7700 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 454f6367-fca5-4f24-b48e-4c1ea5603c29] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:10.153862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3de09891-4acc-4eab-8342-60478beb7700 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:10.154358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3de09891-4acc-4eab-8342-60478beb7700 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:10.154855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3de09891-4acc-4eab-8342-60478beb7700 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:10.155563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3de09891-4acc-4eab-8342-60478beb7700 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:10.156025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3de09891-4acc-4eab-8342-60478beb7700 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:10.156460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3de09891-4acc-4eab-8342-60478beb7700 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:10.170939 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-3de09891-4acc-4eab-8342-60478beb7700 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3de09891-4acc-4eab-8342-60478beb7700 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 HTTP/1.1 Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '454f6367-fca5-4f24-b48e-4c1ea5603c29'} Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:10.172589 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.176870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:10.176870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:10.176870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:10.176870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:26:10.176870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:26:10.176870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. Aug 23 18:26:10.176870 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.176870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3de09891-4acc-4eab-8342-60478beb7700 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 404 to user: Instance 454f6367-fca5-4f24-b48e-4c1ea5603c29 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:26:10.176870 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3de09891-4acc-4eab-8342-60478beb7700 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29" status: 404 len: 111 microversion: 2.1 time: 0.032498 Aug 23 18:26:10.176870 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3178/6219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:10 2022] GET /compute/v2.1/servers/454f6367-fca5-4f24-b48e-4c1ea5603c29 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:26:10.182735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45d33f06-9942-4a73-8e2d-b8019b54fea5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:10.183243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-45d33f06-9942-4a73-8e2d-b8019b54fea5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:10.189785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45d33f06-9942-4a73-8e2d-b8019b54fea5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:10.190274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45d33f06-9942-4a73-8e2d-b8019b54fea5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:10.191023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45d33f06-9942-4a73-8e2d-b8019b54fea5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:10.191706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45d33f06-9942-4a73-8e2d-b8019b54fea5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:10.192164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45d33f06-9942-4a73-8e2d-b8019b54fea5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:10.192596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45d33f06-9942-4a73-8e2d-b8019b54fea5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:10.207032 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-45d33f06-9942-4a73-8e2d-b8019b54fea5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45d33f06-9942-4a73-8e2d-b8019b54fea5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea HTTP/1.1 Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2666d044-c9dc-484d-939f-7bdf780731ea'} Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:26:10.209188 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45d33f06-9942-4a73-8e2d-b8019b54fea5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 404 to user: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-45d33f06-9942-4a73-8e2d-b8019b54fea5 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 404 len: 111 microversion: 2.1 time: 0.031837 Aug 23 18:26:10.214339 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3042/6220] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:26:10 2022] DELETE /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:26:10.219678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-13a13434-0637-4d58-b270-bb837d1f9962 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:10.220491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-13a13434-0637-4d58-b270-bb837d1f9962 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: 2666d044-c9dc-484d-939f-7bdf780731ea] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:10.226857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13a13434-0637-4d58-b270-bb837d1f9962 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:10.227347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13a13434-0637-4d58-b270-bb837d1f9962 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:10.227785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13a13434-0637-4d58-b270-bb837d1f9962 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:10.228597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13a13434-0637-4d58-b270-bb837d1f9962 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:10.228944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13a13434-0637-4d58-b270-bb837d1f9962 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:10.229348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-13a13434-0637-4d58-b270-bb837d1f9962 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:10.244079 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-13a13434-0637-4d58-b270-bb837d1f9962 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-13a13434-0637-4d58-b270-bb837d1f9962 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea HTTP/1.1 Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '2666d044-c9dc-484d-939f-7bdf780731ea'} Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:10.245556 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.250035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:10.250035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:10.250035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:10.250035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:26:10.250035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:26:10.250035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. Aug 23 18:26:10.250035 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:10.250035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-13a13434-0637-4d58-b270-bb837d1f9962 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 404 to user: Instance 2666d044-c9dc-484d-939f-7bdf780731ea could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:26:10.250035 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-13a13434-0637-4d58-b270-bb837d1f9962 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea" status: 404 len: 111 microversion: 2.1 time: 0.031393 Aug 23 18:26:10.250035 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3179/6221] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:10 2022] GET /compute/v2.1/servers/2666d044-c9dc-484d-939f-7bdf780731ea => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:26:10.548292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-993926bd-1f79-4726-a856-89240c9f78a9 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:10.549243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-993926bd-1f79-4726-a856-89240c9f78a9 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:10.556072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-993926bd-1f79-4726-a856-89240c9f78a9 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:10.556696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-993926bd-1f79-4726-a856-89240c9f78a9 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:10.557442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-993926bd-1f79-4726-a856-89240c9f78a9 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:10.558480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-993926bd-1f79-4726-a856-89240c9f78a9 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:10.558899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-993926bd-1f79-4726-a856-89240c9f78a9 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:10.559362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-993926bd-1f79-4726-a856-89240c9f78a9 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:10.630778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-993926bd-1f79-4726-a856-89240c9f78a9 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:10.635670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b5afe5e-b7b8-4581-93e0-2b605a30a1ec tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:10.636295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3b5afe5e-b7b8-4581-93e0-2b605a30a1ec tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:10.641980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-993926bd-1f79-4726-a856-89240c9f78a9 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:10.642920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b5afe5e-b7b8-4581-93e0-2b605a30a1ec tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:10.643416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b5afe5e-b7b8-4581-93e0-2b605a30a1ec tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:10.643578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-993926bd-1f79-4726-a856-89240c9f78a9 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:10.643858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b5afe5e-b7b8-4581-93e0-2b605a30a1ec tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:10.644568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b5afe5e-b7b8-4581-93e0-2b605a30a1ec tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:10.645026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b5afe5e-b7b8-4581-93e0-2b605a30a1ec tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:10.645147 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-993926bd-1f79-4726-a856-89240c9f78a9 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.100750 Aug 23 18:26:10.645459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b5afe5e-b7b8-4581-93e0-2b605a30a1ec tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:10.645618 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3043/6222] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:10 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:10.790934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3b5afe5e-b7b8-4581-93e0-2b605a30a1ec tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be3bad4bb254b558086561daa864c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977275b274d49689336fd831ea86b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:10.799613 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3b5afe5e-b7b8-4581-93e0-2b605a30a1ec tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 200 len: 1313 microversion: 2.1 time: 0.167758 Aug 23 18:26:10.800785 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3180/6223] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:10 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:11.671815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07d7932f-753f-4b51-9c24-a866ac14d2b3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:11.672671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07d7932f-753f-4b51-9c24-a866ac14d2b3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:11.681103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07d7932f-753f-4b51-9c24-a866ac14d2b3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:11.681583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07d7932f-753f-4b51-9c24-a866ac14d2b3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:11.682021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07d7932f-753f-4b51-9c24-a866ac14d2b3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:11.682766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07d7932f-753f-4b51-9c24-a866ac14d2b3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:11.683219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07d7932f-753f-4b51-9c24-a866ac14d2b3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:11.683644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07d7932f-753f-4b51-9c24-a866ac14d2b3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:11.754719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-07d7932f-753f-4b51-9c24-a866ac14d2b3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:11.763871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-07d7932f-753f-4b51-9c24-a866ac14d2b3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:11.765384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-07d7932f-753f-4b51-9c24-a866ac14d2b3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:11.766619 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-07d7932f-753f-4b51-9c24-a866ac14d2b3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.098907 Aug 23 18:26:11.767212 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3044/6224] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:11 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:11.821156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a9b57a9b-8c5e-4b73-b991-0afe686bd6a9 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:11.821909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a9b57a9b-8c5e-4b73-b991-0afe686bd6a9 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:11.828658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9b57a9b-8c5e-4b73-b991-0afe686bd6a9 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:11.829264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9b57a9b-8c5e-4b73-b991-0afe686bd6a9 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:11.829781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9b57a9b-8c5e-4b73-b991-0afe686bd6a9 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:11.830584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9b57a9b-8c5e-4b73-b991-0afe686bd6a9 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:11.831125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9b57a9b-8c5e-4b73-b991-0afe686bd6a9 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:11.831634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9b57a9b-8c5e-4b73-b991-0afe686bd6a9 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:11.851446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:11.969386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a9b57a9b-8c5e-4b73-b991-0afe686bd6a9 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be3bad4bb254b558086561daa864c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977275b274d49689336fd831ea86b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:11.977362 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a9b57a9b-8c5e-4b73-b991-0afe686bd6a9 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 200 len: 1313 microversion: 2.1 time: 0.160217 Aug 23 18:26:11.977936 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3181/6225] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:11 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:12.790448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3c1185b3-08e2-4506-ab99-3d2e3d758a12 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:12.791146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3c1185b3-08e2-4506-ab99-3d2e3d758a12 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:12.802182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c1185b3-08e2-4506-ab99-3d2e3d758a12 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:12.802768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c1185b3-08e2-4506-ab99-3d2e3d758a12 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:12.803283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c1185b3-08e2-4506-ab99-3d2e3d758a12 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:12.804005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c1185b3-08e2-4506-ab99-3d2e3d758a12 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:12.804469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c1185b3-08e2-4506-ab99-3d2e3d758a12 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:12.804899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c1185b3-08e2-4506-ab99-3d2e3d758a12 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:12.888944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3c1185b3-08e2-4506-ab99-3d2e3d758a12 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:12.899300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3c1185b3-08e2-4506-ab99-3d2e3d758a12 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:12.901027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3c1185b3-08e2-4506-ab99-3d2e3d758a12 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:12.902327 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3c1185b3-08e2-4506-ab99-3d2e3d758a12 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.116947 Aug 23 18:26:12.907696 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3045/6226] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:12 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:12.998166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f0562baf-1c2c-44bc-9825-d4e681df929c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:12.999029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f0562baf-1c2c-44bc-9825-d4e681df929c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:13.007341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0562baf-1c2c-44bc-9825-d4e681df929c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:13.008012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0562baf-1c2c-44bc-9825-d4e681df929c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:13.008459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0562baf-1c2c-44bc-9825-d4e681df929c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:13.009221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0562baf-1c2c-44bc-9825-d4e681df929c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:13.009683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0562baf-1c2c-44bc-9825-d4e681df929c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:13.010105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0562baf-1c2c-44bc-9825-d4e681df929c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:13.181963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f0562baf-1c2c-44bc-9825-d4e681df929c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be3bad4bb254b558086561daa864c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977275b274d49689336fd831ea86b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:13.190752 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f0562baf-1c2c-44bc-9825-d4e681df929c tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 200 len: 1313 microversion: 2.1 time: 0.196609 Aug 23 18:26:13.205937 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3182/6227] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:12 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:13.505246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-82f9fb58-6435-42f8-a11e-d1dd729a4639 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:13.506120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-82f9fb58-6435-42f8-a11e-d1dd729a4639 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:13.512267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f9fb58-6435-42f8-a11e-d1dd729a4639 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:13.512758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f9fb58-6435-42f8-a11e-d1dd729a4639 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:13.513196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f9fb58-6435-42f8-a11e-d1dd729a4639 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:13.513885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f9fb58-6435-42f8-a11e-d1dd729a4639 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:13.514343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f9fb58-6435-42f8-a11e-d1dd729a4639 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:13.515155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f9fb58-6435-42f8-a11e-d1dd729a4639 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:13.529643 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-82f9fb58-6435-42f8-a11e-d1dd729a4639 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-82f9fb58-6435-42f8-a11e-d1dd729a4639 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b HTTP/1.1 Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'e2c1c0a9-6679-4485-a539-9e2d5b10c64b'} Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:26:13.531260 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-82f9fb58-6435-42f8-a11e-d1dd729a4639 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 404 to user: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-82f9fb58-6435-42f8-a11e-d1dd729a4639 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 404 len: 111 microversion: 2.1 time: 0.031369 Aug 23 18:26:13.535876 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3046/6228] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:26:13 2022] DELETE /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:26:13.542926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4dcb3207-84ea-45f7-af88-002ec68aabc2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:13.543551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4dcb3207-84ea-45f7-af88-002ec68aabc2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] [instance: e2c1c0a9-6679-4485-a539-9e2d5b10c64b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:13.549673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4dcb3207-84ea-45f7-af88-002ec68aabc2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:13.550164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4dcb3207-84ea-45f7-af88-002ec68aabc2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:13.550630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4dcb3207-84ea-45f7-af88-002ec68aabc2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:13.551339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4dcb3207-84ea-45f7-af88-002ec68aabc2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:13.551800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4dcb3207-84ea-45f7-af88-002ec68aabc2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:13.552270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4dcb3207-84ea-45f7-af88-002ec68aabc2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:13.566380 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-4dcb3207-84ea-45f7-af88-002ec68aabc2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] HTTP exception thrown: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4dcb3207-84ea-45f7-af88-002ec68aabc2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Request method failure captured: Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b HTTP/1.1 Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRmyWwA0jASXR4ctFFVSzFr7l2UhLgBVnjvghcyihMaqjURHUXkK54_2shUwZI_n_9e-7I9pmhQQOjHVvEXuLdhbkYQ0ryKsTcFfVs9EjtgbeiHjzRNY6ojwHhxmvrq0jXQFyf4uFOE7-4TeLIR6zR2PQj9fhhGGB5Y1Yw4zQGkk43M Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/4187000f2f8947aaab6603191fe0cb9a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/4187000f2f8947aaab6603191fe0cb9a"}]}] Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 4187000f2f8947aaab6603191fe0cb9a Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055189230 Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: a11d6c5120f24a448c1831ff925409c3 Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AttachVolumeNegativeTest-2055189230-project Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'e2c1c0a9-6679-4485-a539-9e2d5b10c64b'} Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:13.568021 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:13.572916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:13.572916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:13.572916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:13.572916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:26:13.572916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:26:13.572916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. Aug 23 18:26:13.572916 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:13.572916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4dcb3207-84ea-45f7-af88-002ec68aabc2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] Returning 404 to user: Instance e2c1c0a9-6679-4485-a539-9e2d5b10c64b could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:26:13.572916 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4dcb3207-84ea-45f7-af88-002ec68aabc2 tempest-AttachVolumeNegativeTest-2055189230 tempest-AttachVolumeNegativeTest-2055189230-project] 10.222.0.61 "GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b" status: 404 len: 111 microversion: 2.1 time: 0.030920 Aug 23 18:26:13.572916 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3183/6229] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:13 2022] GET /compute/v2.1/servers/e2c1c0a9-6679-4485-a539-9e2d5b10c64b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:26:13.926845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c7bc8b2f-9408-4603-934a-81abbc876136 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:13.928305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7bc8b2f-9408-4603-934a-81abbc876136 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:13.935581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7bc8b2f-9408-4603-934a-81abbc876136 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:13.936070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7bc8b2f-9408-4603-934a-81abbc876136 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:13.936511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7bc8b2f-9408-4603-934a-81abbc876136 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:13.937303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7bc8b2f-9408-4603-934a-81abbc876136 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:13.937712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7bc8b2f-9408-4603-934a-81abbc876136 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:13.938143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7bc8b2f-9408-4603-934a-81abbc876136 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:14.006929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c7bc8b2f-9408-4603-934a-81abbc876136 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:14.015672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c7bc8b2f-9408-4603-934a-81abbc876136 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:14.017352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c7bc8b2f-9408-4603-934a-81abbc876136 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:14.018527 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c7bc8b2f-9408-4603-934a-81abbc876136 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.096105 Aug 23 18:26:14.019658 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3047/6230] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:13 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:14.213650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2ea0afa-b28c-498d-92c5-4740e923f335 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:14.214191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f2ea0afa-b28c-498d-92c5-4740e923f335 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:14.221139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2ea0afa-b28c-498d-92c5-4740e923f335 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:14.221635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2ea0afa-b28c-498d-92c5-4740e923f335 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:14.222064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2ea0afa-b28c-498d-92c5-4740e923f335 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:14.223085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2ea0afa-b28c-498d-92c5-4740e923f335 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:14.223720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2ea0afa-b28c-498d-92c5-4740e923f335 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:14.224662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2ea0afa-b28c-498d-92c5-4740e923f335 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:14.430222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f2ea0afa-b28c-498d-92c5-4740e923f335 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be3bad4bb254b558086561daa864c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977275b274d49689336fd831ea86b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:14.437969 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f2ea0afa-b28c-498d-92c5-4740e923f335 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 200 len: 1313 microversion: 2.1 time: 0.228304 Aug 23 18:26:14.438554 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3184/6231] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:14 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 1313 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:14.725011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-344efff6-c6df-43ae-85be-a099fd7cad4d req-9aca567c-ba84-4636-ba6a-6fa85a090320 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f00585b2-dc1b-4f16-b33f-b8d9433ff9b9", "name": "network-vif-plugged", "status": "completed", "tag": "255a44c3-8b21-4af9-804f-e94c489e4d2b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:26:14.741672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-344efff6-c6df-43ae-85be-a099fd7cad4d req-9aca567c-ba84-4636-ba6a-6fa85a090320 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:14.742163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-344efff6-c6df-43ae-85be-a099fd7cad4d req-9aca567c-ba84-4636-ba6a-6fa85a090320 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:14.742630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-344efff6-c6df-43ae-85be-a099fd7cad4d req-9aca567c-ba84-4636-ba6a-6fa85a090320 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:14.756520 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-344efff6-c6df-43ae-85be-a099fd7cad4d req-9aca567c-ba84-4636-ba6a-6fa85a090320 service nova] Creating event network-vif-plugged:255a44c3-8b21-4af9-804f-e94c489e4d2b for instance f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 on n-h1-850468-16 Aug 23 18:26:14.763754 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-344efff6-c6df-43ae-85be-a099fd7cad4d req-9aca567c-ba84-4636-ba6a-6fa85a090320 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042994 Aug 23 18:26:14.764402 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3048/6232] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:26:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:26:15.044742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-25063e6b-5fc0-4080-848f-a4de825cb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:15.045421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-25063e6b-5fc0-4080-848f-a4de825cb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:15.052588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25063e6b-5fc0-4080-848f-a4de825cb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:15.053015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25063e6b-5fc0-4080-848f-a4de825cb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:15.053460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25063e6b-5fc0-4080-848f-a4de825cb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:15.054168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25063e6b-5fc0-4080-848f-a4de825cb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:15.054653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25063e6b-5fc0-4080-848f-a4de825cb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:15.055085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25063e6b-5fc0-4080-848f-a4de825cb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:15.423091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-25063e6b-5fc0-4080-848f-a4de825cb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:15.432962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-25063e6b-5fc0-4080-848f-a4de825cb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:15.434676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-25063e6b-5fc0-4080-848f-a4de825cb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:15.435972 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-25063e6b-5fc0-4080-848f-a4de825cb421 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.395221 Aug 23 18:26:15.436643 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3185/6233] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:15 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:15.461228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e6d1b09f-dcf3-4810-960f-8fb2e6c4aa23 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:15.461945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e6d1b09f-dcf3-4810-960f-8fb2e6c4aa23 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:15.469621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6d1b09f-dcf3-4810-960f-8fb2e6c4aa23 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:15.470111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6d1b09f-dcf3-4810-960f-8fb2e6c4aa23 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:15.470575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6d1b09f-dcf3-4810-960f-8fb2e6c4aa23 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:15.471449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6d1b09f-dcf3-4810-960f-8fb2e6c4aa23 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:15.472093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6d1b09f-dcf3-4810-960f-8fb2e6c4aa23 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:15.472521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e6d1b09f-dcf3-4810-960f-8fb2e6c4aa23 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:15.647059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e6d1b09f-dcf3-4810-960f-8fb2e6c4aa23 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be3bad4bb254b558086561daa864c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977275b274d49689336fd831ea86b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:15.657487 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e6d1b09f-dcf3-4810-960f-8fb2e6c4aa23 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 200 len: 1313 microversion: 2.1 time: 0.201953 Aug 23 18:26:15.659007 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3049/6234] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:15 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:16.463252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bf869afc-0b7f-4d89-ad26-8092d23a639c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:16.466001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bf869afc-0b7f-4d89-ad26-8092d23a639c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:16.477411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf869afc-0b7f-4d89-ad26-8092d23a639c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:16.477978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf869afc-0b7f-4d89-ad26-8092d23a639c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:16.479434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf869afc-0b7f-4d89-ad26-8092d23a639c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:16.480416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf869afc-0b7f-4d89-ad26-8092d23a639c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:16.480890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf869afc-0b7f-4d89-ad26-8092d23a639c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:16.481323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf869afc-0b7f-4d89-ad26-8092d23a639c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:16.574581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bf869afc-0b7f-4d89-ad26-8092d23a639c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:16.585001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bf869afc-0b7f-4d89-ad26-8092d23a639c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:16.586639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bf869afc-0b7f-4d89-ad26-8092d23a639c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:16.588250 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bf869afc-0b7f-4d89-ad26-8092d23a639c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.131968 Aug 23 18:26:16.589049 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3186/6235] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:16 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:16.679062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf1eb134-7944-4ca7-a916-153069739570 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:16.679672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf1eb134-7944-4ca7-a916-153069739570 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:16.682534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:16.692038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf1eb134-7944-4ca7-a916-153069739570 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:16.692585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf1eb134-7944-4ca7-a916-153069739570 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:16.693004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf1eb134-7944-4ca7-a916-153069739570 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:16.693802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf1eb134-7944-4ca7-a916-153069739570 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:16.694259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf1eb134-7944-4ca7-a916-153069739570 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:16.694711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf1eb134-7944-4ca7-a916-153069739570 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:16.836952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:16.846972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf1eb134-7944-4ca7-a916-153069739570 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be3bad4bb254b558086561daa864c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977275b274d49689336fd831ea86b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:16.856384 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf1eb134-7944-4ca7-a916-153069739570 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 200 len: 1497 microversion: 2.1 time: 0.181364 Aug 23 18:26:16.856973 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3050/6236] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:16 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:17.612365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b07dbd19-9f66-45d5-b247-1183e2bf138c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:17.620103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b07dbd19-9f66-45d5-b247-1183e2bf138c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:17.626974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b07dbd19-9f66-45d5-b247-1183e2bf138c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:17.627467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b07dbd19-9f66-45d5-b247-1183e2bf138c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:17.628678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b07dbd19-9f66-45d5-b247-1183e2bf138c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:17.629557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b07dbd19-9f66-45d5-b247-1183e2bf138c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:17.631119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b07dbd19-9f66-45d5-b247-1183e2bf138c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:17.631719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b07dbd19-9f66-45d5-b247-1183e2bf138c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:17.715367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b07dbd19-9f66-45d5-b247-1183e2bf138c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:17.724877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b07dbd19-9f66-45d5-b247-1183e2bf138c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:17.726271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b07dbd19-9f66-45d5-b247-1183e2bf138c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:17.727496 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b07dbd19-9f66-45d5-b247-1183e2bf138c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.119282 Aug 23 18:26:17.728057 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3187/6237] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:17 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:18.750842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6538d16d-c627-4bb3-be31-00427ed15b43 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:18.751657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6538d16d-c627-4bb3-be31-00427ed15b43 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:18.760002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6538d16d-c627-4bb3-be31-00427ed15b43 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:18.760709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6538d16d-c627-4bb3-be31-00427ed15b43 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:18.761508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6538d16d-c627-4bb3-be31-00427ed15b43 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:18.762571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6538d16d-c627-4bb3-be31-00427ed15b43 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:18.763230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6538d16d-c627-4bb3-be31-00427ed15b43 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:18.763889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6538d16d-c627-4bb3-be31-00427ed15b43 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:18.835709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6538d16d-c627-4bb3-be31-00427ed15b43 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:18.845150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6538d16d-c627-4bb3-be31-00427ed15b43 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:18.847050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6538d16d-c627-4bb3-be31-00427ed15b43 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:18.848213 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6538d16d-c627-4bb3-be31-00427ed15b43 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.101404 Aug 23 18:26:18.849865 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3051/6238] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:18 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:19.414669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d9fbc9ab-38a0-4599-a71c-b70341a59dbf tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:19.415348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d9fbc9ab-38a0-4599-a71c-b70341a59dbf tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:19.422264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9fbc9ab-38a0-4599-a71c-b70341a59dbf tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:19.422808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9fbc9ab-38a0-4599-a71c-b70341a59dbf tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:19.423252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9fbc9ab-38a0-4599-a71c-b70341a59dbf tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:19.423955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9fbc9ab-38a0-4599-a71c-b70341a59dbf tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:19.424416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9fbc9ab-38a0-4599-a71c-b70341a59dbf tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:19.424847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9fbc9ab-38a0-4599-a71c-b70341a59dbf tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:19.455191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d9fbc9ab-38a0-4599-a71c-b70341a59dbf tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:26:19.543637 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d9fbc9ab-38a0-4599-a71c-b70341a59dbf tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 204 len: 0 microversion: 2.1 time: 0.132431 Aug 23 18:26:19.544168 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3188/6239] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:26:19 2022] DELETE /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:26:19.553794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-70ee1066-4bc7-47c9-be0a-256b70eac6d8 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:19.554423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-70ee1066-4bc7-47c9-be0a-256b70eac6d8 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:19.561190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70ee1066-4bc7-47c9-be0a-256b70eac6d8 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:19.561647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70ee1066-4bc7-47c9-be0a-256b70eac6d8 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:19.562094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70ee1066-4bc7-47c9-be0a-256b70eac6d8 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:19.562989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70ee1066-4bc7-47c9-be0a-256b70eac6d8 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:19.563459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70ee1066-4bc7-47c9-be0a-256b70eac6d8 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:19.563894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-70ee1066-4bc7-47c9-be0a-256b70eac6d8 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:19.715267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-70ee1066-4bc7-47c9-be0a-256b70eac6d8 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be3bad4bb254b558086561daa864c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977275b274d49689336fd831ea86b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:19.724821 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-70ee1066-4bc7-47c9-be0a-256b70eac6d8 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 200 len: 1503 microversion: 2.1 time: 0.175329 Aug 23 18:26:19.725381 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3052/6240] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:19 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 1503 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:19.872420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9bac4eef-f166-4083-b92f-014ccff8e4bc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:19.873132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9bac4eef-f166-4083-b92f-014ccff8e4bc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:19.879540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bac4eef-f166-4083-b92f-014ccff8e4bc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:19.880109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bac4eef-f166-4083-b92f-014ccff8e4bc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:19.880616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bac4eef-f166-4083-b92f-014ccff8e4bc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:19.881326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bac4eef-f166-4083-b92f-014ccff8e4bc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:19.881784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bac4eef-f166-4083-b92f-014ccff8e4bc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:19.882215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bac4eef-f166-4083-b92f-014ccff8e4bc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:19.952535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9bac4eef-f166-4083-b92f-014ccff8e4bc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:19.961538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9bac4eef-f166-4083-b92f-014ccff8e4bc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:19.963222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9bac4eef-f166-4083-b92f-014ccff8e4bc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:19.964485 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9bac4eef-f166-4083-b92f-014ccff8e4bc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.096444 Aug 23 18:26:19.965048 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3189/6241] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:19 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:20.745789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9eaa97c5-c102-476e-9e95-0bf5c3f12769 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:20.746595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9eaa97c5-c102-476e-9e95-0bf5c3f12769 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:20.753804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9eaa97c5-c102-476e-9e95-0bf5c3f12769 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:20.755469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9eaa97c5-c102-476e-9e95-0bf5c3f12769 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:20.756323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9eaa97c5-c102-476e-9e95-0bf5c3f12769 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:20.757123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9eaa97c5-c102-476e-9e95-0bf5c3f12769 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:20.757597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9eaa97c5-c102-476e-9e95-0bf5c3f12769 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:20.758037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9eaa97c5-c102-476e-9e95-0bf5c3f12769 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:20.894354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9eaa97c5-c102-476e-9e95-0bf5c3f12769 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be3bad4bb254b558086561daa864c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977275b274d49689336fd831ea86b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:20.903583 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9eaa97c5-c102-476e-9e95-0bf5c3f12769 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 200 len: 1503 microversion: 2.1 time: 0.161879 Aug 23 18:26:20.904187 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3053/6242] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:20 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:20.992741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-63cdda6c-cd0e-4b98-8e39-ae31674ab49b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:20.993370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-63cdda6c-cd0e-4b98-8e39-ae31674ab49b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:21.001068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63cdda6c-cd0e-4b98-8e39-ae31674ab49b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:21.001899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63cdda6c-cd0e-4b98-8e39-ae31674ab49b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:21.003051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63cdda6c-cd0e-4b98-8e39-ae31674ab49b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:21.003776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63cdda6c-cd0e-4b98-8e39-ae31674ab49b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:21.004614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63cdda6c-cd0e-4b98-8e39-ae31674ab49b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:21.005150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63cdda6c-cd0e-4b98-8e39-ae31674ab49b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:21.107305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-63cdda6c-cd0e-4b98-8e39-ae31674ab49b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:21.116256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-63cdda6c-cd0e-4b98-8e39-ae31674ab49b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:21.117785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-63cdda6c-cd0e-4b98-8e39-ae31674ab49b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:21.118999 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-63cdda6c-cd0e-4b98-8e39-ae31674ab49b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.132538 Aug 23 18:26:21.119681 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3190/6243] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:20 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:21.659007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-89ff3830-ad4f-4d9b-b772-ade2206da3e9 req-5d750185-2eb3-4550-8412-91e5a5306953 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f00585b2-dc1b-4f16-b33f-b8d9433ff9b9", "name": "network-vif-deleted", "tag": "255a44c3-8b21-4af9-804f-e94c489e4d2b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:26:21.669083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-89ff3830-ad4f-4d9b-b772-ade2206da3e9 req-5d750185-2eb3-4550-8412-91e5a5306953 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:21.669571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-89ff3830-ad4f-4d9b-b772-ade2206da3e9 req-5d750185-2eb3-4550-8412-91e5a5306953 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:21.670012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-89ff3830-ad4f-4d9b-b772-ade2206da3e9 req-5d750185-2eb3-4550-8412-91e5a5306953 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:21.681939 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-89ff3830-ad4f-4d9b-b772-ade2206da3e9 req-5d750185-2eb3-4550-8412-91e5a5306953 service nova] Creating event network-vif-deleted:255a44c3-8b21-4af9-804f-e94c489e4d2b for instance f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 on n-h1-850468-16 Aug 23 18:26:21.687598 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-89ff3830-ad4f-4d9b-b772-ade2206da3e9 req-5d750185-2eb3-4550-8412-91e5a5306953 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032337 Aug 23 18:26:21.688378 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3054/6244] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:26:21.927563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:21.927563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:21.932712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:21.933200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:21.933637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:21.934332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:21.934809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:21.935232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:21.968058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:21.968579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:21.969018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:21.969474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lazy-loading 'fault' on Instance uuid f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:26:22.015543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1be3bad4bb254b558086561daa864c0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1977275b274d49689336fd831ea86b62', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:22.024644 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f4d5e8cf-1266-49f7-a0eb-e46846719e14 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 200 len: 1303 microversion: 2.1 time: 0.103317 Aug 23 18:26:22.025210 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3191/6245] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:21 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 1303 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:22.146439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e1d9924-b3f5-43d0-b48e-27ac63c2318a tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:22.147211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4e1d9924-b3f5-43d0-b48e-27ac63c2318a tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:22.153623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e1d9924-b3f5-43d0-b48e-27ac63c2318a tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:22.154907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e1d9924-b3f5-43d0-b48e-27ac63c2318a tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:22.155350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e1d9924-b3f5-43d0-b48e-27ac63c2318a tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:22.156059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e1d9924-b3f5-43d0-b48e-27ac63c2318a tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:22.156516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e1d9924-b3f5-43d0-b48e-27ac63c2318a tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:22.156938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e1d9924-b3f5-43d0-b48e-27ac63c2318a tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:22.177487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:22.227703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e1d9924-b3f5-43d0-b48e-27ac63c2318a tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:22.241817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e1d9924-b3f5-43d0-b48e-27ac63c2318a tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:22.243513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4e1d9924-b3f5-43d0-b48e-27ac63c2318a tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:22.244855 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e1d9924-b3f5-43d0-b48e-27ac63c2318a tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.104300 Aug 23 18:26:22.245643 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3055/6246] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:22 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:23.046256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db9279cb-3a35-4bb3-9375-7adc9e88e735 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:23.046916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-db9279cb-3a35-4bb3-9375-7adc9e88e735 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] [instance: f00585b2-dc1b-4f16-b33f-b8d9433ff9b9] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:23.055749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db9279cb-3a35-4bb3-9375-7adc9e88e735 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:23.055749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db9279cb-3a35-4bb3-9375-7adc9e88e735 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:23.055990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db9279cb-3a35-4bb3-9375-7adc9e88e735 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:23.056766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db9279cb-3a35-4bb3-9375-7adc9e88e735 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:23.057288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db9279cb-3a35-4bb3-9375-7adc9e88e735 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:23.058013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db9279cb-3a35-4bb3-9375-7adc9e88e735 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:23.073050 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-db9279cb-3a35-4bb3-9375-7adc9e88e735 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] HTTP exception thrown: Instance f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 could not be found. Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db9279cb-3a35-4bb3-9375-7adc9e88e735 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Request method failure captured: Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 HTTP/1.1 Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRu8XkBHn5CocLvCIeLrKQ3MOUFH-aqzPg11UIp8J5HEuJ6mnjtyRGtQjkcoJZQszCIHL61GNhnGBkkHFp0bmfEShV41xS85g23R0epKV4mvfBTo3FyuS7QfOorJEdoh4Q9oM_YEgN9ndDhS34EuIb-lY67IUQ3adEVVr9RI2C7sVDk Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 1977275b274d49689336fd831ea86b62 Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-VolumesActionsTest-612921809 Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_1977275b274d49689336fd831ea86b62"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1977275b274d49689336fd831ea86b62"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/1977275b274d49689336fd831ea86b62"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/1977275b274d49689336fd831ea86b62"}]}] Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-VolumesActionsTest-612921809 Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 1977275b274d49689336fd831ea86b62 Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-VolumesActionsTest-612921809 Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-VolumesActionsTest-612921809-project Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 1be3bad4bb254b558086561daa864c0b Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-VolumesActionsTest-612921809-project Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 could not be found. Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f00585b2-dc1b-4f16-b33f-b8d9433ff9b9'} Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 could not be found. Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 could not be found. Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:23.074769 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:23.080632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:23.080632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:23.080632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:23.080632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:26:23.080632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:26:23.080632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 could not be found. Aug 23 18:26:23.080632 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:23.080632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db9279cb-3a35-4bb3-9375-7adc9e88e735 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] Returning 404 to user: Instance f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:26:23.080632 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-db9279cb-3a35-4bb3-9375-7adc9e88e735 tempest-VolumesActionsTest-612921809 tempest-VolumesActionsTest-612921809-project] 10.222.0.61 "GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9" status: 404 len: 111 microversion: 2.1 time: 0.033774 Aug 23 18:26:23.080632 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3192/6247] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:23 2022] GET /compute/v2.1/servers/f00585b2-dc1b-4f16-b33f-b8d9433ff9b9 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:26:23.269775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8c800c32-a276-4757-9844-85e310c79e4e tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:23.271290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8c800c32-a276-4757-9844-85e310c79e4e tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:23.279913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c800c32-a276-4757-9844-85e310c79e4e tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:23.280490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c800c32-a276-4757-9844-85e310c79e4e tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:23.280951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c800c32-a276-4757-9844-85e310c79e4e tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:23.282091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c800c32-a276-4757-9844-85e310c79e4e tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:23.282975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c800c32-a276-4757-9844-85e310c79e4e tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:23.283417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c800c32-a276-4757-9844-85e310c79e4e tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:23.378106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8c800c32-a276-4757-9844-85e310c79e4e tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:23.388921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8c800c32-a276-4757-9844-85e310c79e4e tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:23.390440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8c800c32-a276-4757-9844-85e310c79e4e tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:23.391707 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8c800c32-a276-4757-9844-85e310c79e4e tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.127561 Aug 23 18:26:23.392810 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3056/6248] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:23 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:24.416431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5d5d0e46-f1ca-4187-b863-ad1302e471bf tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:24.417360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5d5d0e46-f1ca-4187-b863-ad1302e471bf tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:24.431543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d5d0e46-f1ca-4187-b863-ad1302e471bf tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:24.432152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d5d0e46-f1ca-4187-b863-ad1302e471bf tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:24.432597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d5d0e46-f1ca-4187-b863-ad1302e471bf tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:24.433336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d5d0e46-f1ca-4187-b863-ad1302e471bf tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:24.433984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d5d0e46-f1ca-4187-b863-ad1302e471bf tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:24.434413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5d5d0e46-f1ca-4187-b863-ad1302e471bf tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:24.509989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5d5d0e46-f1ca-4187-b863-ad1302e471bf tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:24.519515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5d5d0e46-f1ca-4187-b863-ad1302e471bf tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:24.522043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5d5d0e46-f1ca-4187-b863-ad1302e471bf tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:24.523626 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5d5d0e46-f1ca-4187-b863-ad1302e471bf tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.111610 Aug 23 18:26:24.524534 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3193/6249] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:24 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:25.549247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-21dcdd18-a94f-4a82-a056-dc470096c3cd tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:25.549933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-21dcdd18-a94f-4a82-a056-dc470096c3cd tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:25.558120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21dcdd18-a94f-4a82-a056-dc470096c3cd tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:25.559024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21dcdd18-a94f-4a82-a056-dc470096c3cd tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:25.559825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21dcdd18-a94f-4a82-a056-dc470096c3cd tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:25.560692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21dcdd18-a94f-4a82-a056-dc470096c3cd tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:25.561694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21dcdd18-a94f-4a82-a056-dc470096c3cd tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:25.562617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21dcdd18-a94f-4a82-a056-dc470096c3cd tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:25.643041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-21dcdd18-a94f-4a82-a056-dc470096c3cd tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:25.653014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-21dcdd18-a94f-4a82-a056-dc470096c3cd tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:25.654515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-21dcdd18-a94f-4a82-a056-dc470096c3cd tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:25.655739 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-21dcdd18-a94f-4a82-a056-dc470096c3cd tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.110575 Aug 23 18:26:25.656294 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3057/6250] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:25 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:26.682782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-98951947-143d-4765-9ac4-29e31ec78771 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:26.683539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-98951947-143d-4765-9ac4-29e31ec78771 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:26.691032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98951947-143d-4765-9ac4-29e31ec78771 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:26.691524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98951947-143d-4765-9ac4-29e31ec78771 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:26.691958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98951947-143d-4765-9ac4-29e31ec78771 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:26.692806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98951947-143d-4765-9ac4-29e31ec78771 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:26.693384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98951947-143d-4765-9ac4-29e31ec78771 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:26.694255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98951947-143d-4765-9ac4-29e31ec78771 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:26.769865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-98951947-143d-4765-9ac4-29e31ec78771 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:26.779110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-98951947-143d-4765-9ac4-29e31ec78771 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:26.780749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-98951947-143d-4765-9ac4-29e31ec78771 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:26.782226 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-98951947-143d-4765-9ac4-29e31ec78771 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.105904 Aug 23 18:26:26.782930 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3194/6251] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:26 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:27.807202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-705914cf-4021-4012-b440-140f3dce7af3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:27.807819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-705914cf-4021-4012-b440-140f3dce7af3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:27.815808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-705914cf-4021-4012-b440-140f3dce7af3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:27.816538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-705914cf-4021-4012-b440-140f3dce7af3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:27.817346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-705914cf-4021-4012-b440-140f3dce7af3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:27.819085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-705914cf-4021-4012-b440-140f3dce7af3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:27.819777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-705914cf-4021-4012-b440-140f3dce7af3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:27.820455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-705914cf-4021-4012-b440-140f3dce7af3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:27.898581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-705914cf-4021-4012-b440-140f3dce7af3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:27.910146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-705914cf-4021-4012-b440-140f3dce7af3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:27.912727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-705914cf-4021-4012-b440-140f3dce7af3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:27.914187 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-705914cf-4021-4012-b440-140f3dce7af3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.111615 Aug 23 18:26:27.914985 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3058/6252] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:27 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:28.938867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-acaa966c-8a04-44f5-9aaa-6d945dc0b10c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:28.939494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-acaa966c-8a04-44f5-9aaa-6d945dc0b10c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:28.947758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acaa966c-8a04-44f5-9aaa-6d945dc0b10c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:28.948253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acaa966c-8a04-44f5-9aaa-6d945dc0b10c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:28.948701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acaa966c-8a04-44f5-9aaa-6d945dc0b10c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:28.949410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acaa966c-8a04-44f5-9aaa-6d945dc0b10c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:28.949870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acaa966c-8a04-44f5-9aaa-6d945dc0b10c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:28.950301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acaa966c-8a04-44f5-9aaa-6d945dc0b10c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:29.022923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-acaa966c-8a04-44f5-9aaa-6d945dc0b10c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:29.031714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-acaa966c-8a04-44f5-9aaa-6d945dc0b10c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:29.033356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-acaa966c-8a04-44f5-9aaa-6d945dc0b10c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:29.034558 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-acaa966c-8a04-44f5-9aaa-6d945dc0b10c tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1366 microversion: 2.57 time: 0.100893 Aug 23 18:26:29.035140 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3195/6253] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:28 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1366 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:30.057732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-40c3ceaa-407e-45cc-9b68-6b1d89acab5d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:30.058357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-40c3ceaa-407e-45cc-9b68-6b1d89acab5d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:30.065300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-40c3ceaa-407e-45cc-9b68-6b1d89acab5d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:30.066043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-40c3ceaa-407e-45cc-9b68-6b1d89acab5d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:30.066708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-40c3ceaa-407e-45cc-9b68-6b1d89acab5d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:30.067721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-40c3ceaa-407e-45cc-9b68-6b1d89acab5d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:30.068444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-40c3ceaa-407e-45cc-9b68-6b1d89acab5d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:30.069046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-40c3ceaa-407e-45cc-9b68-6b1d89acab5d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:30.147244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-40c3ceaa-407e-45cc-9b68-6b1d89acab5d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:30.163646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-40c3ceaa-407e-45cc-9b68-6b1d89acab5d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:30.166156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-40c3ceaa-407e-45cc-9b68-6b1d89acab5d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:30.168679 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-40c3ceaa-407e-45cc-9b68-6b1d89acab5d tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1372 microversion: 2.57 time: 0.114300 Aug 23 18:26:30.169749 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3059/6254] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:30 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1372 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:31.193571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eea91b15-13b2-477f-a091-d18b4fe1620b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:31.194446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eea91b15-13b2-477f-a091-d18b4fe1620b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:31.203224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eea91b15-13b2-477f-a091-d18b4fe1620b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:31.204001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eea91b15-13b2-477f-a091-d18b4fe1620b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:31.204707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eea91b15-13b2-477f-a091-d18b4fe1620b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:31.205915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eea91b15-13b2-477f-a091-d18b4fe1620b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:31.206848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eea91b15-13b2-477f-a091-d18b4fe1620b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:31.207675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eea91b15-13b2-477f-a091-d18b4fe1620b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:31.292327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eea91b15-13b2-477f-a091-d18b4fe1620b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:31.305638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eea91b15-13b2-477f-a091-d18b4fe1620b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:31.307538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eea91b15-13b2-477f-a091-d18b4fe1620b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:31.308760 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eea91b15-13b2-477f-a091-d18b4fe1620b tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1372 microversion: 2.57 time: 0.120007 Aug 23 18:26:31.309338 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3196/6255] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:31 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:32.335061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4f9ca880-fc77-45e4-8ec3-b61e31c44749 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:32.335676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4f9ca880-fc77-45e4-8ec3-b61e31c44749 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:32.343893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f9ca880-fc77-45e4-8ec3-b61e31c44749 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:32.344597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f9ca880-fc77-45e4-8ec3-b61e31c44749 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:32.345169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f9ca880-fc77-45e4-8ec3-b61e31c44749 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:32.345879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f9ca880-fc77-45e4-8ec3-b61e31c44749 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:32.346332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f9ca880-fc77-45e4-8ec3-b61e31c44749 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:32.346780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f9ca880-fc77-45e4-8ec3-b61e31c44749 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:32.416529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4f9ca880-fc77-45e4-8ec3-b61e31c44749 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:32.427390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4f9ca880-fc77-45e4-8ec3-b61e31c44749 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:32.429384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4f9ca880-fc77-45e4-8ec3-b61e31c44749 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:32.430706 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4f9ca880-fc77-45e4-8ec3-b61e31c44749 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1372 microversion: 2.57 time: 0.099898 Aug 23 18:26:32.431646 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3060/6256] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:32 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:33.455214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7a6a7199-02ec-47b8-9a88-96a428708478 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:33.456608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7a6a7199-02ec-47b8-9a88-96a428708478 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:33.464649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a6a7199-02ec-47b8-9a88-96a428708478 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:33.465377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a6a7199-02ec-47b8-9a88-96a428708478 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:33.466090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a6a7199-02ec-47b8-9a88-96a428708478 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:33.466836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a6a7199-02ec-47b8-9a88-96a428708478 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:33.468188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a6a7199-02ec-47b8-9a88-96a428708478 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:33.468638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a6a7199-02ec-47b8-9a88-96a428708478 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:33.494215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:33.547521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a6a7199-02ec-47b8-9a88-96a428708478 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:33.557360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a6a7199-02ec-47b8-9a88-96a428708478 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:33.559566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a6a7199-02ec-47b8-9a88-96a428708478 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:33.561125 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7a6a7199-02ec-47b8-9a88-96a428708478 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1372 microversion: 2.57 time: 0.110202 Aug 23 18:26:33.561981 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3197/6257] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:33 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1372 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:34.591857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-61886d5e-27de-455e-aaf6-4f1ee4a9c526 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:34.593040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-61886d5e-27de-455e-aaf6-4f1ee4a9c526 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:34.607971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61886d5e-27de-455e-aaf6-4f1ee4a9c526 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:34.611595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61886d5e-27de-455e-aaf6-4f1ee4a9c526 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:34.613087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61886d5e-27de-455e-aaf6-4f1ee4a9c526 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:34.614046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61886d5e-27de-455e-aaf6-4f1ee4a9c526 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:34.614733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61886d5e-27de-455e-aaf6-4f1ee4a9c526 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:34.615354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61886d5e-27de-455e-aaf6-4f1ee4a9c526 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:34.712505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-61886d5e-27de-455e-aaf6-4f1ee4a9c526 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:34.723951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-61886d5e-27de-455e-aaf6-4f1ee4a9c526 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:34.725658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-61886d5e-27de-455e-aaf6-4f1ee4a9c526 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:34.731818 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-61886d5e-27de-455e-aaf6-4f1ee4a9c526 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1357 microversion: 2.57 time: 0.146079 Aug 23 18:26:34.734570 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3061/6258] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:34 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:34.762575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ab2a97b6-5b42-491f-913b-9f89c7b6f0a3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:34.763216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab2a97b6-5b42-491f-913b-9f89c7b6f0a3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:34.772960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab2a97b6-5b42-491f-913b-9f89c7b6f0a3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:34.773451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab2a97b6-5b42-491f-913b-9f89c7b6f0a3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:34.773891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab2a97b6-5b42-491f-913b-9f89c7b6f0a3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:34.774634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab2a97b6-5b42-491f-913b-9f89c7b6f0a3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:34.775095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab2a97b6-5b42-491f-913b-9f89c7b6f0a3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:34.775972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab2a97b6-5b42-491f-913b-9f89c7b6f0a3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:34.807195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab2a97b6-5b42-491f-913b-9f89c7b6f0a3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:26:34.925299 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ab2a97b6-5b42-491f-913b-9f89c7b6f0a3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 204 len: 0 microversion: 2.57 time: 0.166591 Aug 23 18:26:34.926120 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3198/6259] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:26:34 2022] DELETE /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:26:34.937830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-088766af-9e2f-407d-900f-edbe14e8a0d3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:34.938535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-088766af-9e2f-407d-900f-edbe14e8a0d3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:34.947267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088766af-9e2f-407d-900f-edbe14e8a0d3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:34.947982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088766af-9e2f-407d-900f-edbe14e8a0d3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:34.948426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088766af-9e2f-407d-900f-edbe14e8a0d3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:34.949141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088766af-9e2f-407d-900f-edbe14e8a0d3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:34.949722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088766af-9e2f-407d-900f-edbe14e8a0d3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:34.950008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088766af-9e2f-407d-900f-edbe14e8a0d3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:35.070695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-088766af-9e2f-407d-900f-edbe14e8a0d3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:35.084047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-088766af-9e2f-407d-900f-edbe14e8a0d3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:35.085573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-088766af-9e2f-407d-900f-edbe14e8a0d3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:35.086868 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-088766af-9e2f-407d-900f-edbe14e8a0d3 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1363 microversion: 2.57 time: 0.155101 Aug 23 18:26:35.099156 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3062/6260] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:34 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:36.114845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-31cecfd7-5731-4d54-92ba-6d7c5cf04c98 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:36.116016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-31cecfd7-5731-4d54-92ba-6d7c5cf04c98 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:36.123158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31cecfd7-5731-4d54-92ba-6d7c5cf04c98 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:36.123902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31cecfd7-5731-4d54-92ba-6d7c5cf04c98 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:36.124447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31cecfd7-5731-4d54-92ba-6d7c5cf04c98 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:36.125166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31cecfd7-5731-4d54-92ba-6d7c5cf04c98 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:36.125630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31cecfd7-5731-4d54-92ba-6d7c5cf04c98 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:36.126062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31cecfd7-5731-4d54-92ba-6d7c5cf04c98 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:36.193566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-31cecfd7-5731-4d54-92ba-6d7c5cf04c98 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:36.202179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-31cecfd7-5731-4d54-92ba-6d7c5cf04c98 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:36.203722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-31cecfd7-5731-4d54-92ba-6d7c5cf04c98 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:36.204897 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-31cecfd7-5731-4d54-92ba-6d7c5cf04c98 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1363 microversion: 2.57 time: 0.095490 Aug 23 18:26:36.205478 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3199/6261] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:36 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1363 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:36.490067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4e1f3c7d-41a0-41ca-a1d0-55baf8edcd4a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:26:36.492989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4e1f3c7d-41a0-41ca-a1d0-55baf8edcd4a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:36.495809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:36.501336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e1f3c7d-41a0-41ca-a1d0-55baf8edcd4a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:36.501832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e1f3c7d-41a0-41ca-a1d0-55baf8edcd4a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:36.502307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e1f3c7d-41a0-41ca-a1d0-55baf8edcd4a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:36.503276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e1f3c7d-41a0-41ca-a1d0-55baf8edcd4a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:36.503738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e1f3c7d-41a0-41ca-a1d0-55baf8edcd4a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:36.504167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4e1f3c7d-41a0-41ca-a1d0-55baf8edcd4a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:36.608565 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4e1f3c7d-41a0-41ca-a1d0-55baf8edcd4a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862/action" status: 200 len: 24567 microversion: 2.1 time: 0.122795 Aug 23 18:26:36.609508 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3063/6262] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:26:36 2022] POST /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862/action => generated 24567 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:26:37.229597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:37.231009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:37.238060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:37.239404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:37.239838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:37.240761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:37.241226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:37.241651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:37.297143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:37.297858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:37.298470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:37.299118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lazy-loading 'fault' on Instance uuid ef1bfc4f-2448-4df1-b75a-9cb997155a5d {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:26:37.361462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:37.374727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:37.385625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '596ab5ede6e04032bab75e007094297b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56d2fcfcf8d242838d547eb3243d56b8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:37.391090 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ab1c8fc7-e210-47f8-a554-889c805723b7 tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 200 len: 1368 microversion: 2.57 time: 0.164053 Aug 23 18:26:37.392679 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3200/6263] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:37 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:38.419440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-38cc8c25-0bc1-4b76-af99-92cd9a4222fc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:38.420148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-38cc8c25-0bc1-4b76-af99-92cd9a4222fc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] [instance: ef1bfc4f-2448-4df1-b75a-9cb997155a5d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:38.428809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38cc8c25-0bc1-4b76-af99-92cd9a4222fc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:38.429302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38cc8c25-0bc1-4b76-af99-92cd9a4222fc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:38.429789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38cc8c25-0bc1-4b76-af99-92cd9a4222fc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:38.430615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38cc8c25-0bc1-4b76-af99-92cd9a4222fc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:38.431192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38cc8c25-0bc1-4b76-af99-92cd9a4222fc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:38.431480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38cc8c25-0bc1-4b76-af99-92cd9a4222fc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:38.448666 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-38cc8c25-0bc1-4b76-af99-92cd9a4222fc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] HTTP exception thrown: Instance ef1bfc4f-2448-4df1-b75a-9cb997155a5d could not be found. Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-38cc8c25-0bc1-4b76-af99-92cd9a4222fc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Request method failure captured: Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d HTTP/1.1 Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRurN4b2kleCh8bl-9w0BZMX59zJdg7PcJNodRCZK15mKvilVWV70GgRq2brpzmVHkYeqxJbFKhdjAkyoANFeJ30LU_5kTHhiw2ntE_EYRRXxemmtWOD3Xam2Mcb-RNQUsMXXotaO5WnUv7SGltpzRuBtyH-ElkRV8c4mjRXEVaV5Nc Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.57 Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 56d2fcfcf8d242838d547eb3243d56b8 Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerShowV257Test-391068828 Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_56d2fcfcf8d242838d547eb3243d56b8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/56d2fcfcf8d242838d547eb3243d56b8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/56d2fcfcf8d242838d547eb3243d56b8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/56d2fcfcf8d242838d547eb3243d56b8"}]}] Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerShowV257Test-391068828 Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 56d2fcfcf8d242838d547eb3243d56b8 Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerShowV257Test-391068828 Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerShowV257Test-391068828-project Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 596ab5ede6e04032bab75e007094297b Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerShowV257Test-391068828-project Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance ef1bfc4f-2448-4df1-b75a-9cb997155a5d could not be found. Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'ef1bfc4f-2448-4df1-b75a-9cb997155a5d'} Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef1bfc4f-2448-4df1-b75a-9cb997155a5d could not be found. Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef1bfc4f-2448-4df1-b75a-9cb997155a5d could not be found. Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:38.451610 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:38.457843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:38.457843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:38.457843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:38.457843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:26:38.457843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:26:38.457843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef1bfc4f-2448-4df1-b75a-9cb997155a5d could not be found. Aug 23 18:26:38.457843 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:26:38.457843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-38cc8c25-0bc1-4b76-af99-92cd9a4222fc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] Returning 404 to user: Instance ef1bfc4f-2448-4df1-b75a-9cb997155a5d could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:26:38.457843 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-38cc8c25-0bc1-4b76-af99-92cd9a4222fc tempest-ServerShowV257Test-391068828 tempest-ServerShowV257Test-391068828-project] 10.222.0.61 "GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d" status: 404 len: 111 microversion: 2.57 time: 0.039459 Aug 23 18:26:38.457843 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3064/6264] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:38 2022] GET /compute/v2.1/servers/ef1bfc4f-2448-4df1-b75a-9cb997155a5d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:26:46.989453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8af9778c-20d3-4c98-af0b-9d1f179d9f43 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Action: 'create', calling method: .version_select at 0x7f27df4ffc10>, body: {"keypair": {"name": "tempest-keypair-1728832838", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNwC94X6C9Vc2BcbxO3ASPw0DBrubpAdGrYnJMgk76j+uKUb8zP0GTHALeNlfjjZV4p9SOEjL1/newwrlxYF2PNN+BJjHT2otvdKdXlDP4zi/JeNia+VRd5NyrFtTNFQA=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:26:47.003083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:47.021660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8af9778c-20d3-4c98-af0b-9d1f179d9f43 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Getting quotas for project 73c64d353c72438ab1c77f5d6c042cbe. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:26:47.036270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-8af9778c-20d3-4c98-af0b-9d1f179d9f43 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Getting quotas for user f84923104c9a4be5801ac8721b3e3e6c and project 73c64d353c72438ab1c77f5d6c042cbe. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:26:47.069042 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8af9778c-20d3-4c98-af0b-9d1f179d9f43 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.540451 Aug 23 18:26:47.071430 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3201/6265] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:26:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:26:49.164766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1619672267", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c0e2812-9207-4baf-9771-b7859018d73c"}], "security_groups": [{"name": "tempest-securitygroup--2046935339"}], "key_name": "tempest-keypair-1728832838", "user_data": "}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:26:49.199119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:49.201099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=50 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:49.378468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] validate_networks() for [('9c0e2812-9207-4baf-9771-b7859018d73c', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:26:50.320738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:26:50.321263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:26:50.321864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:26:50.322233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:26:50.323476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:26:50.339657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:50.340963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:50.341804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:50.342808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:50.343457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:50.344189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:50.370265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Getting quotas for project 73c64d353c72438ab1c77f5d6c042cbe. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:26:50.378703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Getting quotas for user f84923104c9a4be5801ac8721b3e3e6c and project 73c64d353c72438ab1c77f5d6c042cbe. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:26:50.398950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:26:50.401863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:26:50.468192 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-34516557-9780-4e64-8fb7-6c8debf46535 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.308892 Aug 23 18:26:50.471257 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3065/6266] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:26:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 1314 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:26:50.482175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-37a969d1-8d6b-468a-97b8-3edb68f65c15 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:50.483329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-37a969d1-8d6b-468a-97b8-3edb68f65c15 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:50.495861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:26:50.637911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-37a969d1-8d6b-468a-97b8-3edb68f65c15 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:50.653715 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-37a969d1-8d6b-468a-97b8-3edb68f65c15 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1238 microversion: 2.1 time: 0.175400 Aug 23 18:26:50.659125 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3202/6267] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:50 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1238 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:51.679298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9b6c3c99-3211-463c-b423-b17979b8b9b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:51.679930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9b6c3c99-3211-463c-b423-b17979b8b9b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:51.688202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b6c3c99-3211-463c-b423-b17979b8b9b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:51.688918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b6c3c99-3211-463c-b423-b17979b8b9b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:51.689531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b6c3c99-3211-463c-b423-b17979b8b9b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:51.690678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b6c3c99-3211-463c-b423-b17979b8b9b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:51.692274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b6c3c99-3211-463c-b423-b17979b8b9b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:51.693187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b6c3c99-3211-463c-b423-b17979b8b9b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:51.801739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9b6c3c99-3211-463c-b423-b17979b8b9b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:51.812395 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9b6c3c99-3211-463c-b423-b17979b8b9b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1290 microversion: 2.1 time: 0.138628 Aug 23 18:26:51.821967 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3066/6268] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:51 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1290 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:52.016591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-77a13697-9ae1-4402-bad3-9ba970445a22 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:52.019978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-77a13697-9ae1-4402-bad3-9ba970445a22 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:52.028611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77a13697-9ae1-4402-bad3-9ba970445a22 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:52.029117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77a13697-9ae1-4402-bad3-9ba970445a22 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:52.029569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77a13697-9ae1-4402-bad3-9ba970445a22 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:52.030291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77a13697-9ae1-4402-bad3-9ba970445a22 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:52.030811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77a13697-9ae1-4402-bad3-9ba970445a22 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:52.031448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77a13697-9ae1-4402-bad3-9ba970445a22 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:52.069992 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-77a13697-9ae1-4402-bad3-9ba970445a22 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057443 Aug 23 18:26:52.076991 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3203/6269] 10.222.0.61 () {60 vars in 1343 bytes} [Tue Aug 23 18:26:52 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:52.177835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f42155ed-4a98-47ac-bb1b-5a5e7e221fd8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:52.178926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f42155ed-4a98-47ac-bb1b-5a5e7e221fd8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:52.194748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f42155ed-4a98-47ac-bb1b-5a5e7e221fd8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:52.195609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f42155ed-4a98-47ac-bb1b-5a5e7e221fd8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:52.196684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f42155ed-4a98-47ac-bb1b-5a5e7e221fd8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:52.199758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f42155ed-4a98-47ac-bb1b-5a5e7e221fd8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:52.201359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f42155ed-4a98-47ac-bb1b-5a5e7e221fd8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:52.203605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f42155ed-4a98-47ac-bb1b-5a5e7e221fd8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:52.248907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f42155ed-4a98-47ac-bb1b-5a5e7e221fd8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:26:52.406123 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f42155ed-4a98-47ac-bb1b-5a5e7e221fd8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 204 len: 0 microversion: 2.20 time: 0.232164 Aug 23 18:26:52.407550 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3067/6270] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:26:52 2022] DELETE /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:26:52.416759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2d1c9b41-00e3-44f4-b584-bc828507e21c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:52.417497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2d1c9b41-00e3-44f4-b584-bc828507e21c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:52.428242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d1c9b41-00e3-44f4-b584-bc828507e21c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:52.430851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d1c9b41-00e3-44f4-b584-bc828507e21c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:52.433261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d1c9b41-00e3-44f4-b584-bc828507e21c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:52.437211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d1c9b41-00e3-44f4-b584-bc828507e21c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:52.438920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d1c9b41-00e3-44f4-b584-bc828507e21c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:52.439394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d1c9b41-00e3-44f4-b584-bc828507e21c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:52.651047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2d1c9b41-00e3-44f4-b584-bc828507e21c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:52.663495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2d1c9b41-00e3-44f4-b584-bc828507e21c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:52.665018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2d1c9b41-00e3-44f4-b584-bc828507e21c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:52.666422 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2d1c9b41-00e3-44f4-b584-bc828507e21c tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.254111 Aug 23 18:26:52.667378 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3204/6271] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:52 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:52.841633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-be859bca-0117-4d79-85cb-2cd37b57400e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:52.846883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-be859bca-0117-4d79-85cb-2cd37b57400e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:52.861787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be859bca-0117-4d79-85cb-2cd37b57400e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:52.863290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be859bca-0117-4d79-85cb-2cd37b57400e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:52.864699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be859bca-0117-4d79-85cb-2cd37b57400e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:52.865433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be859bca-0117-4d79-85cb-2cd37b57400e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:52.868374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be859bca-0117-4d79-85cb-2cd37b57400e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:52.868829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be859bca-0117-4d79-85cb-2cd37b57400e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:52.956581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-be859bca-0117-4d79-85cb-2cd37b57400e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:52.966143 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-be859bca-0117-4d79-85cb-2cd37b57400e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1296 microversion: 2.1 time: 0.130044 Aug 23 18:26:52.977110 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3068/6272] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:52 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1296 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:53.697869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f817b0c7-f7c8-4a6a-9063-7db44ea64801 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:53.699433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f817b0c7-f7c8-4a6a-9063-7db44ea64801 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:53.709921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f817b0c7-f7c8-4a6a-9063-7db44ea64801 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:53.710430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f817b0c7-f7c8-4a6a-9063-7db44ea64801 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:53.710894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f817b0c7-f7c8-4a6a-9063-7db44ea64801 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:53.712715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f817b0c7-f7c8-4a6a-9063-7db44ea64801 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:53.713776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f817b0c7-f7c8-4a6a-9063-7db44ea64801 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:53.714753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f817b0c7-f7c8-4a6a-9063-7db44ea64801 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:53.880163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f817b0c7-f7c8-4a6a-9063-7db44ea64801 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:53.891802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f817b0c7-f7c8-4a6a-9063-7db44ea64801 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:53.895110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f817b0c7-f7c8-4a6a-9063-7db44ea64801 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:53.896830 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f817b0c7-f7c8-4a6a-9063-7db44ea64801 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.205007 Aug 23 18:26:53.897405 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3205/6273] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:53 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:53.987926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3e670c50-f810-4b94-b2da-ef3ee827a326 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:53.990351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3e670c50-f810-4b94-b2da-ef3ee827a326 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:53.997378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e670c50-f810-4b94-b2da-ef3ee827a326 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:53.998857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e670c50-f810-4b94-b2da-ef3ee827a326 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:53.999590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e670c50-f810-4b94-b2da-ef3ee827a326 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:54.000671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e670c50-f810-4b94-b2da-ef3ee827a326 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:54.001466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e670c50-f810-4b94-b2da-ef3ee827a326 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:54.002806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e670c50-f810-4b94-b2da-ef3ee827a326 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:54.085909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3e670c50-f810-4b94-b2da-ef3ee827a326 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:54.095363 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3e670c50-f810-4b94-b2da-ef3ee827a326 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1296 microversion: 2.1 time: 0.112278 Aug 23 18:26:54.106857 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3069/6274] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:53 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1296 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:54.921898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-91a69d7e-37dd-48b4-ba06-52334c002528 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:54.923811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-91a69d7e-37dd-48b4-ba06-52334c002528 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:54.935068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91a69d7e-37dd-48b4-ba06-52334c002528 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:54.935565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91a69d7e-37dd-48b4-ba06-52334c002528 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:54.936041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91a69d7e-37dd-48b4-ba06-52334c002528 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:54.936788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91a69d7e-37dd-48b4-ba06-52334c002528 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:54.937249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91a69d7e-37dd-48b4-ba06-52334c002528 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:54.937682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91a69d7e-37dd-48b4-ba06-52334c002528 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:55.117230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e15d9230-88ef-4679-867f-17e31c68b70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:55.118874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e15d9230-88ef-4679-867f-17e31c68b70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:55.138289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15d9230-88ef-4679-867f-17e31c68b70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:55.139014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15d9230-88ef-4679-867f-17e31c68b70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:55.139657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15d9230-88ef-4679-867f-17e31c68b70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:55.140555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15d9230-88ef-4679-867f-17e31c68b70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:55.141189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15d9230-88ef-4679-867f-17e31c68b70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:55.141785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e15d9230-88ef-4679-867f-17e31c68b70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:55.164076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-91a69d7e-37dd-48b4-ba06-52334c002528 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:55.173592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-91a69d7e-37dd-48b4-ba06-52334c002528 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:55.176140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-91a69d7e-37dd-48b4-ba06-52334c002528 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:55.177833 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-91a69d7e-37dd-48b4-ba06-52334c002528 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1722 microversion: 2.20 time: 0.259525 Aug 23 18:26:55.179386 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3206/6275] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:54 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:55.485770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e15d9230-88ef-4679-867f-17e31c68b70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:55.501911 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e15d9230-88ef-4679-867f-17e31c68b70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1364 microversion: 2.1 time: 0.389719 Aug 23 18:26:55.516442 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3070/6276] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:55 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1364 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:55.654821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-555284153", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:26:55.714457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] validate_networks() for None {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:26:56.146179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-d5ee0b21-3e14-43bc-b3bd-ca228929c47e req-77922d28-42fb-43c7-b182-3748b32954b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "181bbeec-159b-4f25-91cd-4c1d93687b11", "tag": "6a63c23d-c13b-4d43-88a3-57f67e68eea7"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:26:56.181197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d5ee0b21-3e14-43bc-b3bd-ca228929c47e req-77922d28-42fb-43c7-b182-3748b32954b3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:56.182095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d5ee0b21-3e14-43bc-b3bd-ca228929c47e req-77922d28-42fb-43c7-b182-3748b32954b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:56.183403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d5ee0b21-3e14-43bc-b3bd-ca228929c47e req-77922d28-42fb-43c7-b182-3748b32954b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:56.230124 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-d5ee0b21-3e14-43bc-b3bd-ca228929c47e req-77922d28-42fb-43c7-b182-3748b32954b3 service nova] Creating event network-changed:6a63c23d-c13b-4d43-88a3-57f67e68eea7 for instance 181bbeec-159b-4f25-91cd-4c1d93687b11 on n-h1-850468-16 Aug 23 18:26:56.243382 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-d5ee0b21-3e14-43bc-b3bd-ca228929c47e req-77922d28-42fb-43c7-b182-3748b32954b3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103726 Aug 23 18:26:56.247811 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3071/6277] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:26:56.255026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-247abbf0-69c2-4b7d-9a97-4a40ee09812b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:56.256192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-247abbf0-69c2-4b7d-9a97-4a40ee09812b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:56.267469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-247abbf0-69c2-4b7d-9a97-4a40ee09812b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:56.272458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-247abbf0-69c2-4b7d-9a97-4a40ee09812b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:56.273099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-247abbf0-69c2-4b7d-9a97-4a40ee09812b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:56.274067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-247abbf0-69c2-4b7d-9a97-4a40ee09812b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:56.274775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-247abbf0-69c2-4b7d-9a97-4a40ee09812b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:56.275552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-247abbf0-69c2-4b7d-9a97-4a40ee09812b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:56.437558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-247abbf0-69c2-4b7d-9a97-4a40ee09812b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:56.451605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-247abbf0-69c2-4b7d-9a97-4a40ee09812b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:56.454657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-247abbf0-69c2-4b7d-9a97-4a40ee09812b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'f43268df184e40b0b66655e5a6eaa07c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '261a311c2f2b480984ab2412ac78e881', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:56.455881 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-247abbf0-69c2-4b7d-9a97-4a40ee09812b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 200 len: 1367 microversion: 2.20 time: 0.206468 Aug 23 18:26:56.456779 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3072/6278] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:56 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 23 18:26:56.517145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:26:56.517145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:26:56.517911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:26:56.518506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:26:56.519214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:26:56.524945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec598439-5e15-4ef1-8816-7be623682f00 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:56.526534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ec598439-5e15-4ef1-8816-7be623682f00 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:56.533839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:56.534329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:56.534804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:56.536715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:56.537183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:56.537618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:56.558933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Getting quotas for project 5156de194d694b16b77ae539f8d79fd3. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:26:56.561059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec598439-5e15-4ef1-8816-7be623682f00 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:56.566064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Getting quotas for user 5b260843fd704dc28e03f49d3947c70d and project 5156de194d694b16b77ae539f8d79fd3. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:26:56.568266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec598439-5e15-4ef1-8816-7be623682f00 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:56.571510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec598439-5e15-4ef1-8816-7be623682f00 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:56.572420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec598439-5e15-4ef1-8816-7be623682f00 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:56.575952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec598439-5e15-4ef1-8816-7be623682f00 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:56.578037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec598439-5e15-4ef1-8816-7be623682f00 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:56.584367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:26:56.588291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:26:56.646558 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9e2a4a7d-e101-441b-8cf9-a63755eba425 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.996840 Aug 23 18:26:56.647654 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3207/6279] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:26:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:26:56.658982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a07ea685-714b-49c2-a550-7446440c5015 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:56.660247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a07ea685-714b-49c2-a550-7446440c5015 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:56.733899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a07ea685-714b-49c2-a550-7446440c5015 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:56.745422 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a07ea685-714b-49c2-a550-7446440c5015 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1213 microversion: 2.1 time: 0.090533 Aug 23 18:26:56.747110 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3208/6280] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:56 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:26:56.823299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec598439-5e15-4ef1-8816-7be623682f00 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:56.835447 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec598439-5e15-4ef1-8816-7be623682f00 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1364 microversion: 2.1 time: 0.314520 Aug 23 18:26:56.854758 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3073/6281] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:56 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1364 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:57.485915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-858cc682-afed-462d-9a3e-20115b2c4a72 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:57.486794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-858cc682-afed-462d-9a3e-20115b2c4a72 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:57.497606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-858cc682-afed-462d-9a3e-20115b2c4a72 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:57.498429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-858cc682-afed-462d-9a3e-20115b2c4a72 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:57.499219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-858cc682-afed-462d-9a3e-20115b2c4a72 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:57.500253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-858cc682-afed-462d-9a3e-20115b2c4a72 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:57.501042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-858cc682-afed-462d-9a3e-20115b2c4a72 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:57.501803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-858cc682-afed-462d-9a3e-20115b2c4a72 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:57.522846 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-858cc682-afed-462d-9a3e-20115b2c4a72 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] HTTP exception thrown: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-858cc682-afed-462d-9a3e-20115b2c4a72 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Request method failure captured: Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 HTTP/1.1 Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRm7_Zm6d92jA7uaQU4LV4mwndE7TqwKQLeeEndCknMqcFiJM5-hEq9M0Xzh5NdSON-r1JbFLYhxGVZuaztDk52og-ONxOPh34qAIYJJrep9H-C-M6VfN062VFt4wX7ZG2BlIN03uqv7OILZFyj-4ska2N8E27bGnNLJhsidSpgKrFY Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 261a311c2f2b480984ab2412ac78e881 Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_261a311c2f2b480984ab2412ac78e881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/261a311c2f2b480984ab2412ac78e881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/261a311c2f2b480984ab2412ac78e881"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/261a311c2f2b480984ab2412ac78e881"}]}] Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 261a311c2f2b480984ab2412ac78e881 Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AttachVolumeShelveTestJSON-75466456-project Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f43268df184e40b0b66655e5a6eaa07c Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AttachVolumeShelveTestJSON-75466456-project Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '9825ea0c-c842-4818-af65-f737a8c71689'} Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:57.524557 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:26:57.529507 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:57.529507 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:26:57.529507 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:26:57.529507 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:26:57.529507 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:26:57.529507 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:26:57.529507 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:26:57.529507 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:26:57.529507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-858cc682-afed-462d-9a3e-20115b2c4a72 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Returning 404 to user: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:26:57.529507 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-858cc682-afed-462d-9a3e-20115b2c4a72 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 404 len: 111 microversion: 2.20 time: 0.045967 Aug 23 18:26:57.530285 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3209/6282] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:26:57 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:26:57.535967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66ece996-0106-4ec4-b9fc-29b107eeb3dc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '.version_select at 0x7f27eca11790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:57.571785 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66ece996-0106-4ec4-b9fc-29b107eeb3dc tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660895580" status: 204 len: 0 microversion: 2.20 time: 0.040400 Aug 23 18:26:57.573182 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3074/6283] 10.222.0.61 () {60 vars in 1262 bytes} [Tue Aug 23 18:26:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1660895580 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 23 18:26:57.768055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-008c3711-1550-4b51-b601-287e7c40504d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:57.768780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-008c3711-1550-4b51-b601-287e7c40504d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:57.778778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-008c3711-1550-4b51-b601-287e7c40504d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:57.779726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-008c3711-1550-4b51-b601-287e7c40504d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:57.780683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-008c3711-1550-4b51-b601-287e7c40504d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:57.788758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-008c3711-1550-4b51-b601-287e7c40504d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:57.789735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-008c3711-1550-4b51-b601-287e7c40504d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:57.790470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-008c3711-1550-4b51-b601-287e7c40504d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:57.861546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-21066efe-e2a1-46e1-a0bc-7c8929b66bc4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:57.862328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-21066efe-e2a1-46e1-a0bc-7c8929b66bc4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:57.877109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21066efe-e2a1-46e1-a0bc-7c8929b66bc4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:57.878052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21066efe-e2a1-46e1-a0bc-7c8929b66bc4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:57.879721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21066efe-e2a1-46e1-a0bc-7c8929b66bc4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:57.880803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21066efe-e2a1-46e1-a0bc-7c8929b66bc4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:57.881644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21066efe-e2a1-46e1-a0bc-7c8929b66bc4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:57.882295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21066efe-e2a1-46e1-a0bc-7c8929b66bc4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:57.931106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-008c3711-1550-4b51-b601-287e7c40504d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:57.947776 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-008c3711-1550-4b51-b601-287e7c40504d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1265 microversion: 2.1 time: 0.185188 Aug 23 18:26:57.948782 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3210/6284] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:57 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:58.026935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-21066efe-e2a1-46e1-a0bc-7c8929b66bc4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:58.034766 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-21066efe-e2a1-46e1-a0bc-7c8929b66bc4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1364 microversion: 2.1 time: 0.177307 Aug 23 18:26:58.035463 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3075/6285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:57 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:58.329945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7fb75ecf-a640-46cd-9ebf-77cb4f441bca req-a00b9c06-8f1e-4af2-a323-9203331218b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9825ea0c-c842-4818-af65-f737a8c71689", "name": "network-vif-deleted", "tag": "9cdade09-ac01-4d30-a9d4-cb5277d88470"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:26:58.344113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7fb75ecf-a640-46cd-9ebf-77cb4f441bca req-a00b9c06-8f1e-4af2-a323-9203331218b0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:58.344998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7fb75ecf-a640-46cd-9ebf-77cb4f441bca req-a00b9c06-8f1e-4af2-a323-9203331218b0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:58.345479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7fb75ecf-a640-46cd-9ebf-77cb4f441bca req-a00b9c06-8f1e-4af2-a323-9203331218b0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:58.358552 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7fb75ecf-a640-46cd-9ebf-77cb4f441bca req-a00b9c06-8f1e-4af2-a323-9203331218b0 service nova] Creating event network-vif-deleted:9cdade09-ac01-4d30-a9d4-cb5277d88470 for instance 9825ea0c-c842-4818-af65-f737a8c71689 on n-h1-850468-16 Aug 23 18:26:58.364208 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7fb75ecf-a640-46cd-9ebf-77cb4f441bca req-a00b9c06-8f1e-4af2-a323-9203331218b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037501 Aug 23 18:26:58.364932 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3211/6286] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:26:58.970257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b32213c9-3db5-4b0e-aaeb-e504c9ea0f9f tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:58.971576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b32213c9-3db5-4b0e-aaeb-e504c9ea0f9f tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:58.980794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b32213c9-3db5-4b0e-aaeb-e504c9ea0f9f tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:58.981644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b32213c9-3db5-4b0e-aaeb-e504c9ea0f9f tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:58.982495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b32213c9-3db5-4b0e-aaeb-e504c9ea0f9f tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:58.983737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b32213c9-3db5-4b0e-aaeb-e504c9ea0f9f tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:58.984430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b32213c9-3db5-4b0e-aaeb-e504c9ea0f9f tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:58.985112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b32213c9-3db5-4b0e-aaeb-e504c9ea0f9f tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:59.059163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6394a932-c54e-43f0-aa05-27c69ea77ecd tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:59.060568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6394a932-c54e-43f0-aa05-27c69ea77ecd tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:59.075070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a932-c54e-43f0-aa05-27c69ea77ecd tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:59.076584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a932-c54e-43f0-aa05-27c69ea77ecd tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:59.078666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a932-c54e-43f0-aa05-27c69ea77ecd tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:59.081481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a932-c54e-43f0-aa05-27c69ea77ecd tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:59.082620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a932-c54e-43f0-aa05-27c69ea77ecd tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:59.084560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b32213c9-3db5-4b0e-aaeb-e504c9ea0f9f tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:59.084726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6394a932-c54e-43f0-aa05-27c69ea77ecd tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:59.095219 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b32213c9-3db5-4b0e-aaeb-e504c9ea0f9f tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1271 microversion: 2.1 time: 0.129330 Aug 23 18:26:59.107665 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3076/6287] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:58 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1271 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:59.298054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6394a932-c54e-43f0-aa05-27c69ea77ecd tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:26:59.310091 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6394a932-c54e-43f0-aa05-27c69ea77ecd tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1364 microversion: 2.1 time: 0.257778 Aug 23 18:26:59.311483 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3212/6288] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:59 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1364 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:26:59.351760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-da85436c-41c0-4d6b-a47c-e54b52180420 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:26:59.352378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-da85436c-41c0-4d6b-a47c-e54b52180420 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:26:59.358877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da85436c-41c0-4d6b-a47c-e54b52180420 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:59.359624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da85436c-41c0-4d6b-a47c-e54b52180420 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:59.360295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da85436c-41c0-4d6b-a47c-e54b52180420 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:59.361182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da85436c-41c0-4d6b-a47c-e54b52180420 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:26:59.361979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da85436c-41c0-4d6b-a47c-e54b52180420 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:26:59.362590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da85436c-41c0-4d6b-a47c-e54b52180420 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:26:59.599108 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-da85436c-41c0-4d6b-a47c-e54b52180420 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1834 microversion: 2.1 time: 0.251198 Aug 23 18:26:59.600392 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3077/6289] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:26:59 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1834 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:00.118796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1c81ea4-96a9-43ef-8922-5047a1c7b4a4 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:00.119449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d1c81ea4-96a9-43ef-8922-5047a1c7b4a4 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:00.136144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1c81ea4-96a9-43ef-8922-5047a1c7b4a4 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:00.138341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1c81ea4-96a9-43ef-8922-5047a1c7b4a4 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:00.138994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1c81ea4-96a9-43ef-8922-5047a1c7b4a4 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:00.142135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1c81ea4-96a9-43ef-8922-5047a1c7b4a4 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:00.142849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1c81ea4-96a9-43ef-8922-5047a1c7b4a4 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:00.143456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1c81ea4-96a9-43ef-8922-5047a1c7b4a4 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:00.332551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d8e699c3-ea3c-4112-b059-f6ae437a8d32 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:00.337458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d8e699c3-ea3c-4112-b059-f6ae437a8d32 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:00.345366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8e699c3-ea3c-4112-b059-f6ae437a8d32 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:00.346143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8e699c3-ea3c-4112-b059-f6ae437a8d32 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:00.351113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8e699c3-ea3c-4112-b059-f6ae437a8d32 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:00.352206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8e699c3-ea3c-4112-b059-f6ae437a8d32 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:00.352863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8e699c3-ea3c-4112-b059-f6ae437a8d32 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:00.353473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8e699c3-ea3c-4112-b059-f6ae437a8d32 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:00.360778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:00.390330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:00.442125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d1c81ea4-96a9-43ef-8922-5047a1c7b4a4 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:00.455373 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d1c81ea4-96a9-43ef-8922-5047a1c7b4a4 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1313 microversion: 2.1 time: 0.341973 Aug 23 18:27:00.466715 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3213/6290] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:00 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:00.549647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-2f4bca2c-032e-49b4-88b4-3c0ea863078a req-ba36f7b7-494d-4065-aedf-629fb76c89f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63d93d45-8056-49a9-8a4f-046259107b20", "tag": "e28c4dff-9b53-4d86-a5b1-a16ec1a2ffaa"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:00.569261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2f4bca2c-032e-49b4-88b4-3c0ea863078a req-ba36f7b7-494d-4065-aedf-629fb76c89f1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:00.570212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2f4bca2c-032e-49b4-88b4-3c0ea863078a req-ba36f7b7-494d-4065-aedf-629fb76c89f1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:00.572454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2f4bca2c-032e-49b4-88b4-3c0ea863078a req-ba36f7b7-494d-4065-aedf-629fb76c89f1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:00.589965 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-2f4bca2c-032e-49b4-88b4-3c0ea863078a req-ba36f7b7-494d-4065-aedf-629fb76c89f1 service nova] Creating event network-changed:e28c4dff-9b53-4d86-a5b1-a16ec1a2ffaa for instance 63d93d45-8056-49a9-8a4f-046259107b20 on n-h2-850468-16 Aug 23 18:27:00.598904 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-2f4bca2c-032e-49b4-88b4-3c0ea863078a req-ba36f7b7-494d-4065-aedf-629fb76c89f1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054105 Aug 23 18:27:00.600588 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3214/6291] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:00.796063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d8e699c3-ea3c-4112-b059-f6ae437a8d32 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:00.823458 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d8e699c3-ea3c-4112-b059-f6ae437a8d32 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1364 microversion: 2.1 time: 0.481219 Aug 23 18:27:00.823458 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3078/6292] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:00 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1364 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:01.481047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dc4e7d83-5e37-4db7-af94-a431d99574a7 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:01.481825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc4e7d83-5e37-4db7-af94-a431d99574a7 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:01.502668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc4e7d83-5e37-4db7-af94-a431d99574a7 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:01.503472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc4e7d83-5e37-4db7-af94-a431d99574a7 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:01.504498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc4e7d83-5e37-4db7-af94-a431d99574a7 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:01.506870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc4e7d83-5e37-4db7-af94-a431d99574a7 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:01.507636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc4e7d83-5e37-4db7-af94-a431d99574a7 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:01.508325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc4e7d83-5e37-4db7-af94-a431d99574a7 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:01.772227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dc4e7d83-5e37-4db7-af94-a431d99574a7 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:01.785680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4f46af71-da62-4888-85b7-da3b88a28a6b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:01.786789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4f46af71-da62-4888-85b7-da3b88a28a6b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:01.789230 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dc4e7d83-5e37-4db7-af94-a431d99574a7 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1313 microversion: 2.1 time: 0.314840 Aug 23 18:27:01.789836 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3215/6293] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:01 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1313 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:01.805524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f46af71-da62-4888-85b7-da3b88a28a6b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:01.806144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f46af71-da62-4888-85b7-da3b88a28a6b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:01.806457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f46af71-da62-4888-85b7-da3b88a28a6b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:01.807209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f46af71-da62-4888-85b7-da3b88a28a6b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:01.807667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f46af71-da62-4888-85b7-da3b88a28a6b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:01.808452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f46af71-da62-4888-85b7-da3b88a28a6b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:01.857173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4f46af71-da62-4888-85b7-da3b88a28a6b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:27:02.010558 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4f46af71-da62-4888-85b7-da3b88a28a6b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "DELETE /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 204 len: 0 microversion: 2.1 time: 0.227273 Aug 23 18:27:02.011203 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3079/6294] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:27:01 2022] DELETE /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:27:02.021384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b89025b5-b4ec-4301-b198-85c554a6ed3c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:02.022090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b89025b5-b4ec-4301-b198-85c554a6ed3c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:02.030144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89025b5-b4ec-4301-b198-85c554a6ed3c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:02.030845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89025b5-b4ec-4301-b198-85c554a6ed3c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:02.031466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89025b5-b4ec-4301-b198-85c554a6ed3c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:02.032343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89025b5-b4ec-4301-b198-85c554a6ed3c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:02.032948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89025b5-b4ec-4301-b198-85c554a6ed3c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:02.033536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b89025b5-b4ec-4301-b198-85c554a6ed3c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:02.053064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-df53d738-35e1-4887-a825-53f9933e3397 req-26e0fa55-6662-4081-871e-c9675d41a9ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "134e2d84-3f0f-4f9f-b4d7-536f87817862", "tag": "d1239621-cfc1-4ef0-b26e-40a6e6e24d16"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:02.067672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-df53d738-35e1-4887-a825-53f9933e3397 req-26e0fa55-6662-4081-871e-c9675d41a9ba service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:02.068934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-df53d738-35e1-4887-a825-53f9933e3397 req-26e0fa55-6662-4081-871e-c9675d41a9ba service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:02.070036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-df53d738-35e1-4887-a825-53f9933e3397 req-26e0fa55-6662-4081-871e-c9675d41a9ba service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:02.090332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:02.093230 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-df53d738-35e1-4887-a825-53f9933e3397 req-26e0fa55-6662-4081-871e-c9675d41a9ba service nova] Creating event network-changed:d1239621-cfc1-4ef0-b26e-40a6e6e24d16 for instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 on n-h2-850468-16 Aug 23 18:27:02.101099 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-df53d738-35e1-4887-a825-53f9933e3397 req-26e0fa55-6662-4081-871e-c9675d41a9ba service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.301049 Aug 23 18:27:02.103842 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3216/6295] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:02.111308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9dc138e9-783a-482b-89e6-fa0f2c7bf167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:02.112823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9dc138e9-783a-482b-89e6-fa0f2c7bf167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:02.122948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dc138e9-783a-482b-89e6-fa0f2c7bf167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:02.123733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dc138e9-783a-482b-89e6-fa0f2c7bf167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:02.124451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dc138e9-783a-482b-89e6-fa0f2c7bf167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:02.125374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dc138e9-783a-482b-89e6-fa0f2c7bf167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:02.126000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dc138e9-783a-482b-89e6-fa0f2c7bf167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:02.126625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9dc138e9-783a-482b-89e6-fa0f2c7bf167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:02.329331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b89025b5-b4ec-4301-b198-85c554a6ed3c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:02.342302 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b89025b5-b4ec-4301-b198-85c554a6ed3c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1364 microversion: 2.1 time: 0.329006 Aug 23 18:27:02.343020 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3080/6296] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:02 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1364 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:02.356273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97e65fcd-3439-48a8-923d-91ba2b8cd432 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:02.356849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-97e65fcd-3439-48a8-923d-91ba2b8cd432 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:02.362021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9dc138e9-783a-482b-89e6-fa0f2c7bf167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:02.371127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97e65fcd-3439-48a8-923d-91ba2b8cd432 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:02.371273 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9dc138e9-783a-482b-89e6-fa0f2c7bf167 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1687 microversion: 2.1 time: 0.265103 Aug 23 18:27:02.373014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97e65fcd-3439-48a8-923d-91ba2b8cd432 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:02.373528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97e65fcd-3439-48a8-923d-91ba2b8cd432 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:02.374323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97e65fcd-3439-48a8-923d-91ba2b8cd432 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:02.375581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97e65fcd-3439-48a8-923d-91ba2b8cd432 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:02.375762 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3217/6297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:02 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1687 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:02.376707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97e65fcd-3439-48a8-923d-91ba2b8cd432 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:02.396161 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-97e65fcd-3439-48a8-923d-91ba2b8cd432 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] HTTP exception thrown: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97e65fcd-3439-48a8-923d-91ba2b8cd432 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Request method failure captured: Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 HTTP/1.1 Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRm7_Zm6d92jA7uaQU4LV4mwndE7TqwKQLeeEndCknMqcFiJM5-hEq9M0Xzh5NdSON-r1JbFLYhxGVZuaztDk52og-ONxOPh34qAIYJJrep9H-C-M6VfN062VFt4wX7ZG2BlIN03uqv7OILZFyj-4ska2N8E27bGnNLJhsidSpgKrFY Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 261a311c2f2b480984ab2412ac78e881 Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_261a311c2f2b480984ab2412ac78e881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/261a311c2f2b480984ab2412ac78e881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/261a311c2f2b480984ab2412ac78e881"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/261a311c2f2b480984ab2412ac78e881"}]}] Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 261a311c2f2b480984ab2412ac78e881 Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeShelveTestJSON-75466456-project Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f43268df184e40b0b66655e5a6eaa07c Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeShelveTestJSON-75466456-project Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '9825ea0c-c842-4818-af65-f737a8c71689'} Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:27:02.398753 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:27:02.403472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:27:02.403472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:02.403472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:02.403472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:02.403472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:02.403472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:02.403472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:02.403472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:27:02.403472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:27:02.403472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:27:02.403472 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:02.404340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97e65fcd-3439-48a8-923d-91ba2b8cd432 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Returning 404 to user: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:27:02.404803 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-97e65fcd-3439-48a8-923d-91ba2b8cd432 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 404 len: 111 microversion: 2.20 time: 0.059673 Aug 23 18:27:02.405388 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3081/6298] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:27:02 2022] DELETE /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:27:02.415413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7110642b-85e5-471f-addb-42d37b9e854b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:02.416054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7110642b-85e5-471f-addb-42d37b9e854b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 9825ea0c-c842-4818-af65-f737a8c71689] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:02.423823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7110642b-85e5-471f-addb-42d37b9e854b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:02.424258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7110642b-85e5-471f-addb-42d37b9e854b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:02.425367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7110642b-85e5-471f-addb-42d37b9e854b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:02.427033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7110642b-85e5-471f-addb-42d37b9e854b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:02.427679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7110642b-85e5-471f-addb-42d37b9e854b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:02.428126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7110642b-85e5-471f-addb-42d37b9e854b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:02.448298 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-7110642b-85e5-471f-addb-42d37b9e854b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] HTTP exception thrown: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7110642b-85e5-471f-addb-42d37b9e854b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Request method failure captured: Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 HTTP/1.1 Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRm7_Zm6d92jA7uaQU4LV4mwndE7TqwKQLeeEndCknMqcFiJM5-hEq9M0Xzh5NdSON-r1JbFLYhxGVZuaztDk52og-ONxOPh34qAIYJJrep9H-C-M6VfN062VFt4wX7ZG2BlIN03uqv7OILZFyj-4ska2N8E27bGnNLJhsidSpgKrFY Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 261a311c2f2b480984ab2412ac78e881 Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_261a311c2f2b480984ab2412ac78e881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/261a311c2f2b480984ab2412ac78e881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/261a311c2f2b480984ab2412ac78e881"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/261a311c2f2b480984ab2412ac78e881"}]}] Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 261a311c2f2b480984ab2412ac78e881 Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AttachVolumeShelveTestJSON-75466456-project Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f43268df184e40b0b66655e5a6eaa07c Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AttachVolumeShelveTestJSON-75466456-project Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '9825ea0c-c842-4818-af65-f737a8c71689'} Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:02.451814 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:02.457850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:02.457850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:02.457850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:02.457850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:02.457850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:27:02.457850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:27:02.457850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. Aug 23 18:27:02.457850 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:02.457850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7110642b-85e5-471f-addb-42d37b9e854b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Returning 404 to user: Instance 9825ea0c-c842-4818-af65-f737a8c71689 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:27:02.457850 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7110642b-85e5-471f-addb-42d37b9e854b tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689" status: 404 len: 111 microversion: 2.20 time: 0.044507 Aug 23 18:27:02.457850 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3218/6299] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:27:02 2022] GET /compute/v2.1/servers/9825ea0c-c842-4818-af65-f737a8c71689 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:27:02.819555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d002573-0ae2-4d01-95c7-0bd5a1272113 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:02.821058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d002573-0ae2-4d01-95c7-0bd5a1272113 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:02.830965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d002573-0ae2-4d01-95c7-0bd5a1272113 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:02.835625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d002573-0ae2-4d01-95c7-0bd5a1272113 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:02.836394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d002573-0ae2-4d01-95c7-0bd5a1272113 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:02.837577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d002573-0ae2-4d01-95c7-0bd5a1272113 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:02.838580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d002573-0ae2-4d01-95c7-0bd5a1272113 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:02.839227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d002573-0ae2-4d01-95c7-0bd5a1272113 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:03.071060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8914b2a3-9a27-4bae-8099-9e7c3d65ab06 req-7f5284ff-642e-4cd3-99eb-3f50ac3faabc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "181bbeec-159b-4f25-91cd-4c1d93687b11", "name": "network-vif-plugged", "status": "completed", "tag": "6a63c23d-c13b-4d43-88a3-57f67e68eea7"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:03.084882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7d002573-0ae2-4d01-95c7-0bd5a1272113 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:03.096868 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d002573-0ae2-4d01-95c7-0bd5a1272113 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1313 microversion: 2.1 time: 0.288238 Aug 23 18:27:03.099344 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3082/6300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:02 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1313 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:03.109049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8914b2a3-9a27-4bae-8099-9e7c3d65ab06 req-7f5284ff-642e-4cd3-99eb-3f50ac3faabc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:03.109623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8914b2a3-9a27-4bae-8099-9e7c3d65ab06 req-7f5284ff-642e-4cd3-99eb-3f50ac3faabc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:03.112211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8914b2a3-9a27-4bae-8099-9e7c3d65ab06 req-7f5284ff-642e-4cd3-99eb-3f50ac3faabc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:03.133416 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8914b2a3-9a27-4bae-8099-9e7c3d65ab06 req-7f5284ff-642e-4cd3-99eb-3f50ac3faabc service nova] Creating event network-vif-plugged:6a63c23d-c13b-4d43-88a3-57f67e68eea7 for instance 181bbeec-159b-4f25-91cd-4c1d93687b11 on n-h1-850468-16 Aug 23 18:27:03.138720 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8914b2a3-9a27-4bae-8099-9e7c3d65ab06 req-7f5284ff-642e-4cd3-99eb-3f50ac3faabc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072769 Aug 23 18:27:03.139988 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3219/6301] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:03.364692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a89ffe2-88cc-46c7-9543-ff928e108564 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:03.365319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6a89ffe2-88cc-46c7-9543-ff928e108564 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:03.375732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a89ffe2-88cc-46c7-9543-ff928e108564 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:03.376457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a89ffe2-88cc-46c7-9543-ff928e108564 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:03.377060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a89ffe2-88cc-46c7-9543-ff928e108564 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:03.378218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a89ffe2-88cc-46c7-9543-ff928e108564 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:03.379106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a89ffe2-88cc-46c7-9543-ff928e108564 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:03.380098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a89ffe2-88cc-46c7-9543-ff928e108564 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:03.408249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-531490e5-d06e-4033-b7f8-4d2da9dedcd0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:03.409653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-531490e5-d06e-4033-b7f8-4d2da9dedcd0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:03.418980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-531490e5-d06e-4033-b7f8-4d2da9dedcd0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:03.419703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-531490e5-d06e-4033-b7f8-4d2da9dedcd0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:03.420325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-531490e5-d06e-4033-b7f8-4d2da9dedcd0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:03.421237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-531490e5-d06e-4033-b7f8-4d2da9dedcd0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:03.421856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-531490e5-d06e-4033-b7f8-4d2da9dedcd0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:03.422504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-531490e5-d06e-4033-b7f8-4d2da9dedcd0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:03.577109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a89ffe2-88cc-46c7-9543-ff928e108564 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:03.588136 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a89ffe2-88cc-46c7-9543-ff928e108564 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1364 microversion: 2.1 time: 0.228054 Aug 23 18:27:03.589183 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3083/6302] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:03 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:03.601310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-531490e5-d06e-4033-b7f8-4d2da9dedcd0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:03.611506 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-531490e5-d06e-4033-b7f8-4d2da9dedcd0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1687 microversion: 2.1 time: 0.221976 Aug 23 18:27:03.620215 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3220/6303] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:03 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1687 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:04.120093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c1d1698e-fe4f-4502-a971-1b06df51bc0c tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:04.120854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c1d1698e-fe4f-4502-a971-1b06df51bc0c tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:04.127701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1d1698e-fe4f-4502-a971-1b06df51bc0c tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:04.128187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1d1698e-fe4f-4502-a971-1b06df51bc0c tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:04.129069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1d1698e-fe4f-4502-a971-1b06df51bc0c tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:04.129889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1d1698e-fe4f-4502-a971-1b06df51bc0c tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:04.130342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1d1698e-fe4f-4502-a971-1b06df51bc0c tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:04.130902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1d1698e-fe4f-4502-a971-1b06df51bc0c tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:04.283013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c1d1698e-fe4f-4502-a971-1b06df51bc0c tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:04.292504 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c1d1698e-fe4f-4502-a971-1b06df51bc0c tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1313 microversion: 2.1 time: 0.177290 Aug 23 18:27:04.293455 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3084/6304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:04 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:04.611297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3976ea8d-7ace-4c6c-9f8e-18c16c4fb6d0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:04.613727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3976ea8d-7ace-4c6c-9f8e-18c16c4fb6d0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:04.620912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3976ea8d-7ace-4c6c-9f8e-18c16c4fb6d0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:04.621655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3976ea8d-7ace-4c6c-9f8e-18c16c4fb6d0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:04.622270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3976ea8d-7ace-4c6c-9f8e-18c16c4fb6d0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:04.623045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3976ea8d-7ace-4c6c-9f8e-18c16c4fb6d0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:04.623506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3976ea8d-7ace-4c6c-9f8e-18c16c4fb6d0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:04.624129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3976ea8d-7ace-4c6c-9f8e-18c16c4fb6d0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:04.638748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7dee0779-685b-4dfe-ad8c-c1828d883500 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:04.639729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7dee0779-685b-4dfe-ad8c-c1828d883500 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:04.650365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dee0779-685b-4dfe-ad8c-c1828d883500 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:04.651415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dee0779-685b-4dfe-ad8c-c1828d883500 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:04.652415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dee0779-685b-4dfe-ad8c-c1828d883500 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:04.653335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dee0779-685b-4dfe-ad8c-c1828d883500 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:04.653953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dee0779-685b-4dfe-ad8c-c1828d883500 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:04.654622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7dee0779-685b-4dfe-ad8c-c1828d883500 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:04.868387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7dee0779-685b-4dfe-ad8c-c1828d883500 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:04.878356 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7dee0779-685b-4dfe-ad8c-c1828d883500 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1687 microversion: 2.1 time: 0.245977 Aug 23 18:27:04.893917 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3085/6305] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:04 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1687 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:04.944768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3976ea8d-7ace-4c6c-9f8e-18c16c4fb6d0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:04.959667 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3976ea8d-7ace-4c6c-9f8e-18c16c4fb6d0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1364 microversion: 2.1 time: 0.353768 Aug 23 18:27:04.960558 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3221/6306] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:04 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1364 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:05.314512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fe7ce79c-e2a7-42e4-b015-9f2d0d6e6bc6 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:05.316077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe7ce79c-e2a7-42e4-b015-9f2d0d6e6bc6 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:05.325295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe7ce79c-e2a7-42e4-b015-9f2d0d6e6bc6 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:05.327481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe7ce79c-e2a7-42e4-b015-9f2d0d6e6bc6 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:05.328149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe7ce79c-e2a7-42e4-b015-9f2d0d6e6bc6 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:05.329130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe7ce79c-e2a7-42e4-b015-9f2d0d6e6bc6 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:05.329819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe7ce79c-e2a7-42e4-b015-9f2d0d6e6bc6 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:05.331191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe7ce79c-e2a7-42e4-b015-9f2d0d6e6bc6 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:05.718378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fe7ce79c-e2a7-42e4-b015-9f2d0d6e6bc6 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:05.728614 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fe7ce79c-e2a7-42e4-b015-9f2d0d6e6bc6 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1313 microversion: 2.1 time: 0.416846 Aug 23 18:27:05.729896 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3086/6307] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:05 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1313 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:05.820912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d0400c66-c6a8-4b32-8843-4dec8fa5b7a6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:05.821502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d0400c66-c6a8-4b32-8843-4dec8fa5b7a6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:05.834057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0400c66-c6a8-4b32-8843-4dec8fa5b7a6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:05.834925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0400c66-c6a8-4b32-8843-4dec8fa5b7a6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:05.838748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0400c66-c6a8-4b32-8843-4dec8fa5b7a6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:05.839885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0400c66-c6a8-4b32-8843-4dec8fa5b7a6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:05.843927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0400c66-c6a8-4b32-8843-4dec8fa5b7a6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:05.845323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d0400c66-c6a8-4b32-8843-4dec8fa5b7a6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:05.867833 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-d0400c66-c6a8-4b32-8843-4dec8fa5b7a6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] HTTP exception thrown: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d0400c66-c6a8-4b32-8843-4dec8fa5b7a6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Request method failure captured: Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 HTTP/1.1 Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRm7_Zm6d92jA7uaQU4LV4mwndE7TqwKQLeeEndCknMqcFiJM5-hEq9M0Xzh5NdSON-r1JbFLYhxGVZuaztDk52og-ONxOPh34qAIYJJrep9H-C-M6VfN062VFt4wX7ZG2BlIN03uqv7OILZFyj-4ska2N8E27bGnNLJhsidSpgKrFY Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 261a311c2f2b480984ab2412ac78e881 Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_261a311c2f2b480984ab2412ac78e881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/261a311c2f2b480984ab2412ac78e881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/261a311c2f2b480984ab2412ac78e881"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/261a311c2f2b480984ab2412ac78e881"}]}] Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 261a311c2f2b480984ab2412ac78e881 Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AttachVolumeShelveTestJSON-75466456-project Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f43268df184e40b0b66655e5a6eaa07c Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AttachVolumeShelveTestJSON-75466456-project Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '2d8fe0c3-ea81-46b5-9230-216cf8e932d2'} Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:27:05.869970 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d0400c66-c6a8-4b32-8843-4dec8fa5b7a6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Returning 404 to user: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:27:05.875137 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d0400c66-c6a8-4b32-8843-4dec8fa5b7a6 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 404 len: 111 microversion: 2.20 time: 0.055722 Aug 23 18:27:05.886812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07cbc14c-7515-441b-82ce-1386ee3a62e8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:05.889132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07cbc14c-7515-441b-82ce-1386ee3a62e8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] [instance: 2d8fe0c3-ea81-46b5-9230-216cf8e932d2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:05.897001 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3222/6308] 10.222.0.61 () {60 vars in 1280 bytes} [Tue Aug 23 18:27:05 2022] DELETE /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:27:05.901124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07cbc14c-7515-441b-82ce-1386ee3a62e8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:05.901837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07cbc14c-7515-441b-82ce-1386ee3a62e8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:05.902449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07cbc14c-7515-441b-82ce-1386ee3a62e8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:05.903373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07cbc14c-7515-441b-82ce-1386ee3a62e8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:05.904197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07cbc14c-7515-441b-82ce-1386ee3a62e8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:05.904800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07cbc14c-7515-441b-82ce-1386ee3a62e8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:05.926492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2b6f67c6-a612-4c06-b4f0-b109d91104e3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:05.927172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2b6f67c6-a612-4c06-b4f0-b109d91104e3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:05.937268 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-07cbc14c-7515-441b-82ce-1386ee3a62e8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] HTTP exception thrown: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:27:05.940624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b6f67c6-a612-4c06-b4f0-b109d91104e3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:05.942633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b6f67c6-a612-4c06-b4f0-b109d91104e3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:05.943101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b6f67c6-a612-4c06-b4f0-b109d91104e3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07cbc14c-7515-441b-82ce-1386ee3a62e8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Request method failure captured: Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 HTTP/1.1 Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRm7_Zm6d92jA7uaQU4LV4mwndE7TqwKQLeeEndCknMqcFiJM5-hEq9M0Xzh5NdSON-r1JbFLYhxGVZuaztDk52og-ONxOPh34qAIYJJrep9H-C-M6VfN062VFt4wX7ZG2BlIN03uqv7OILZFyj-4ska2N8E27bGnNLJhsidSpgKrFY Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Openstack-Nova-Api-Version: 2.20 Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 261a311c2f2b480984ab2412ac78e881 Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_261a311c2f2b480984ab2412ac78e881"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/261a311c2f2b480984ab2412ac78e881"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/261a311c2f2b480984ab2412ac78e881"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/261a311c2f2b480984ab2412ac78e881"}]}] Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 261a311c2f2b480984ab2412ac78e881 Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-75466456 Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeShelveTestJSON-75466456-project Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f43268df184e40b0b66655e5a6eaa07c Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeShelveTestJSON-75466456-project Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2d8fe0c3-ea81-46b5-9230-216cf8e932d2'} Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:05.943462 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:05.948665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:05.948665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:05.948665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:05.948665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:05.948665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:27:05.948665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:27:05.948665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. Aug 23 18:27:05.948665 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:05.949321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b6f67c6-a612-4c06-b4f0-b109d91104e3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:05.949321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b6f67c6-a612-4c06-b4f0-b109d91104e3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:05.949321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b6f67c6-a612-4c06-b4f0-b109d91104e3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:05.950359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07cbc14c-7515-441b-82ce-1386ee3a62e8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] Returning 404 to user: Instance 2d8fe0c3-ea81-46b5-9230-216cf8e932d2 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:27:05.958256 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-07cbc14c-7515-441b-82ce-1386ee3a62e8 tempest-AttachVolumeShelveTestJSON-75466456 tempest-AttachVolumeShelveTestJSON-75466456-project] 10.222.0.61 "GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2" status: 404 len: 111 microversion: 2.20 time: 0.080843 Aug 23 18:27:05.962733 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3087/6309] 10.222.0.61 () {60 vars in 1277 bytes} [Tue Aug 23 18:27:05 2022] GET /compute/v2.1/servers/2d8fe0c3-ea81-46b5-9230-216cf8e932d2 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:27:05.984771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2c2e4f4e-ba66-4b22-a4d1-d7e06464d166 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:05.985907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2c2e4f4e-ba66-4b22-a4d1-d7e06464d166 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:05.999721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c2e4f4e-ba66-4b22-a4d1-d7e06464d166 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:06.002729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c2e4f4e-ba66-4b22-a4d1-d7e06464d166 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:06.003938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c2e4f4e-ba66-4b22-a4d1-d7e06464d166 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:06.004871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c2e4f4e-ba66-4b22-a4d1-d7e06464d166 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:06.006271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c2e4f4e-ba66-4b22-a4d1-d7e06464d166 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:06.008517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c2e4f4e-ba66-4b22-a4d1-d7e06464d166 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:06.157482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2b6f67c6-a612-4c06-b4f0-b109d91104e3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:06.167568 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2b6f67c6-a612-4c06-b4f0-b109d91104e3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1687 microversion: 2.1 time: 0.269206 Aug 23 18:27:06.168149 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3223/6310] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:05 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1687 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:06.393605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-eb3b7912-ec5d-458f-b34b-3aaff3c765b8 req-7b6e0508-c1be-4cb2-b83a-d00f73995565 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "134e2d84-3f0f-4f9f-b4d7-536f87817862", "name": "network-vif-deleted", "tag": "d1239621-cfc1-4ef0-b26e-40a6e6e24d16"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:06.418714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eb3b7912-ec5d-458f-b34b-3aaff3c765b8 req-7b6e0508-c1be-4cb2-b83a-d00f73995565 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:06.419936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eb3b7912-ec5d-458f-b34b-3aaff3c765b8 req-7b6e0508-c1be-4cb2-b83a-d00f73995565 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:06.420498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eb3b7912-ec5d-458f-b34b-3aaff3c765b8 req-7b6e0508-c1be-4cb2-b83a-d00f73995565 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:06.440079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2c2e4f4e-ba66-4b22-a4d1-d7e06464d166 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:06.454045 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2c2e4f4e-ba66-4b22-a4d1-d7e06464d166 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1550 microversion: 2.1 time: 0.473481 Aug 23 18:27:06.457560 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3088/6311] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:05 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1550 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:06.460659 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-eb3b7912-ec5d-458f-b34b-3aaff3c765b8 req-7b6e0508-c1be-4cb2-b83a-d00f73995565 service nova] Creating event network-vif-deleted:d1239621-cfc1-4ef0-b26e-40a6e6e24d16 for instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 on n-h2-850468-16 Aug 23 18:27:06.478757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0d22d26d-f4e1-4cd7-bd95-7c31f5937b70 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:06.479954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0d22d26d-f4e1-4cd7-bd95-7c31f5937b70 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:06.483390 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-eb3b7912-ec5d-458f-b34b-3aaff3c765b8 req-7b6e0508-c1be-4cb2-b83a-d00f73995565 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079348 Aug 23 18:27:06.492851 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3224/6312] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:27:06.493109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d22d26d-f4e1-4cd7-bd95-7c31f5937b70 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:06.494005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d22d26d-f4e1-4cd7-bd95-7c31f5937b70 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:06.495562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d22d26d-f4e1-4cd7-bd95-7c31f5937b70 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:06.496934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d22d26d-f4e1-4cd7-bd95-7c31f5937b70 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:06.497787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d22d26d-f4e1-4cd7-bd95-7c31f5937b70 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:06.499288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d22d26d-f4e1-4cd7-bd95-7c31f5937b70 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:06.668555 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0d22d26d-f4e1-4cd7-bd95-7c31f5937b70 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.194382 Aug 23 18:27:06.670402 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3089/6313] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:27:06 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/os-interface => generated 285 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:27:06.750649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d93cc94a-3dd6-4532-935c-bbaa4b6a39be tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:06.752586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d93cc94a-3dd6-4532-935c-bbaa4b6a39be tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:06.760472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:06.764277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=14 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:06.772744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d93cc94a-3dd6-4532-935c-bbaa4b6a39be tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:06.773446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d93cc94a-3dd6-4532-935c-bbaa4b6a39be tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:06.774152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d93cc94a-3dd6-4532-935c-bbaa4b6a39be tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:06.775922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d93cc94a-3dd6-4532-935c-bbaa4b6a39be tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:06.776614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d93cc94a-3dd6-4532-935c-bbaa4b6a39be tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:06.782029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d93cc94a-3dd6-4532-935c-bbaa4b6a39be tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:07.194532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:07.195570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:07.212252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:07.213423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:07.215834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:07.218770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:07.220651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:07.221457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:07.330989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:07.331863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:07.332531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:07.333903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lazy-loading 'fault' on Instance uuid 134e2d84-3f0f-4f9f-b4d7-536f87817862 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:27:07.684340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:07.699606 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1ce7c809-a1fc-46ed-b717-6c3d49871d9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 200 len: 1356 microversion: 2.1 time: 0.511609 Aug 23 18:27:07.714204 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3090/6314] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:07 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 1356 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:07.722075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-986369aa-00d8-4981-bc9f-032fba337bc1 req-ba24fc6c-42ae-4cd0-b597-6ae3571ac7ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d93d45-8056-49a9-8a4f-046259107b20", "name": "network-vif-plugged", "status": "completed", "tag": "e28c4dff-9b53-4d86-a5b1-a16ec1a2ffaa"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:07.735772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-986369aa-00d8-4981-bc9f-032fba337bc1 req-ba24fc6c-42ae-4cd0-b597-6ae3571ac7ef service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:07.736258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-986369aa-00d8-4981-bc9f-032fba337bc1 req-ba24fc6c-42ae-4cd0-b597-6ae3571ac7ef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:07.736694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-986369aa-00d8-4981-bc9f-032fba337bc1 req-ba24fc6c-42ae-4cd0-b597-6ae3571ac7ef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:07.752699 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-986369aa-00d8-4981-bc9f-032fba337bc1 req-ba24fc6c-42ae-4cd0-b597-6ae3571ac7ef service nova] Creating event network-vif-plugged:e28c4dff-9b53-4d86-a5b1-a16ec1a2ffaa for instance 63d93d45-8056-49a9-8a4f-046259107b20 on n-h2-850468-16 Aug 23 18:27:07.757126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d93cc94a-3dd6-4532-935c-bbaa4b6a39be tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:07.760295 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-986369aa-00d8-4981-bc9f-032fba337bc1 req-ba24fc6c-42ae-4cd0-b597-6ae3571ac7ef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047286 Aug 23 18:27:07.772125 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3091/6315] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:07.785938 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d93cc94a-3dd6-4532-935c-bbaa4b6a39be tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1313 microversion: 2.1 time: 1.039732 Aug 23 18:27:07.803338 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3225/6316] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:06 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1313 bytes in 1058 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:08.573323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-68d06b8c-e676-4e0c-87cc-81f73066a3e2 req-c3773014-2e33-4a28-baab-829252b68d93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "181bbeec-159b-4f25-91cd-4c1d93687b11", "tag": "6a63c23d-c13b-4d43-88a3-57f67e68eea7"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:08.587227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-68d06b8c-e676-4e0c-87cc-81f73066a3e2 req-c3773014-2e33-4a28-baab-829252b68d93 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:08.588339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-68d06b8c-e676-4e0c-87cc-81f73066a3e2 req-c3773014-2e33-4a28-baab-829252b68d93 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:08.589015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-68d06b8c-e676-4e0c-87cc-81f73066a3e2 req-c3773014-2e33-4a28-baab-829252b68d93 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:08.606872 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-68d06b8c-e676-4e0c-87cc-81f73066a3e2 req-c3773014-2e33-4a28-baab-829252b68d93 service nova] Creating event network-changed:6a63c23d-c13b-4d43-88a3-57f67e68eea7 for instance 181bbeec-159b-4f25-91cd-4c1d93687b11 on n-h1-850468-16 Aug 23 18:27:08.614494 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-68d06b8c-e676-4e0c-87cc-81f73066a3e2 req-c3773014-2e33-4a28-baab-829252b68d93 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050817 Aug 23 18:27:08.615804 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3092/6317] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:08.726129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1f9da55-f14a-4182-979e-7889342e1279 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:08.726777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d1f9da55-f14a-4182-979e-7889342e1279 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 134e2d84-3f0f-4f9f-b4d7-536f87817862] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:08.734064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1f9da55-f14a-4182-979e-7889342e1279 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:08.734609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1f9da55-f14a-4182-979e-7889342e1279 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:08.735422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1f9da55-f14a-4182-979e-7889342e1279 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:08.736310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1f9da55-f14a-4182-979e-7889342e1279 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:08.736777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1f9da55-f14a-4182-979e-7889342e1279 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:08.737213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1f9da55-f14a-4182-979e-7889342e1279 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:08.753094 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-d1f9da55-f14a-4182-979e-7889342e1279 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] HTTP exception thrown: Instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 could not be found. Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1f9da55-f14a-4182-979e-7889342e1279 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Request method failure captured: Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 HTTP/1.1 Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRsdVVhpR5RMU_geeBK-NR3GIvIqLdesK6DUhp09zpynAbw0X6UfFtmOOX54Hda9Mc0jqJQ7C8EEh5MjgiSeR67w9GmLZU6f4UNZ39ll_bkclo_Oe7CkkS9H6snKI3zqjko4iBZoZ7CUVY6hBlmSeyIEToW2Imz7W3zNDzyrYaOVrRo Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: c3be0a88f743407f9f59a08be6b73a5e Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-301903974 Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c3be0a88f743407f9f59a08be6b73a5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c3be0a88f743407f9f59a08be6b73a5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c3be0a88f743407f9f59a08be6b73a5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c3be0a88f743407f9f59a08be6b73a5e"}]}] Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestNetworkAdvancedServerOps-301903974 Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: c3be0a88f743407f9f59a08be6b73a5e Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-301903974 Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestNetworkAdvancedServerOps-301903974-project Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 399d321c5f564e8ba9d3e1ed7ae05184 Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestNetworkAdvancedServerOps-301903974-project Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 could not be found. Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '134e2d84-3f0f-4f9f-b4d7-536f87817862'} Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 could not be found. Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 could not be found. Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:08.755263 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:08.760821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:08.760821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:08.760821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:08.760821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:08.760821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:27:08.760821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:27:08.760821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 could not be found. Aug 23 18:27:08.760821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:08.762505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1f9da55-f14a-4182-979e-7889342e1279 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Returning 404 to user: Instance 134e2d84-3f0f-4f9f-b4d7-536f87817862 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:27:08.763605 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d1f9da55-f14a-4182-979e-7889342e1279 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862" status: 404 len: 111 microversion: 2.1 time: 0.042531 Aug 23 18:27:08.767749 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3226/6318] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:08 2022] GET /compute/v2.1/servers/134e2d84-3f0f-4f9f-b4d7-536f87817862 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:27:08.812804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2c0678da-edce-4529-9a73-52edafd8cba1 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:08.814157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2c0678da-edce-4529-9a73-52edafd8cba1 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:08.822019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c0678da-edce-4529-9a73-52edafd8cba1 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:08.822783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c0678da-edce-4529-9a73-52edafd8cba1 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:08.823420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c0678da-edce-4529-9a73-52edafd8cba1 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:08.824292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c0678da-edce-4529-9a73-52edafd8cba1 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:08.825303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c0678da-edce-4529-9a73-52edafd8cba1 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:08.826203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c0678da-edce-4529-9a73-52edafd8cba1 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:09.293790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2c0678da-edce-4529-9a73-52edafd8cba1 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:09.311327 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2c0678da-edce-4529-9a73-52edafd8cba1 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1313 microversion: 2.1 time: 0.503076 Aug 23 18:27:09.311923 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3093/6319] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:08 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1313 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:10.337109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fb2fab8e-faad-486b-ba95-a5e6409d1d4d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:10.338367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fb2fab8e-faad-486b-ba95-a5e6409d1d4d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:10.361150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb2fab8e-faad-486b-ba95-a5e6409d1d4d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:10.362159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb2fab8e-faad-486b-ba95-a5e6409d1d4d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:10.363517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb2fab8e-faad-486b-ba95-a5e6409d1d4d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:10.364421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb2fab8e-faad-486b-ba95-a5e6409d1d4d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:10.365089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb2fab8e-faad-486b-ba95-a5e6409d1d4d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:10.365695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb2fab8e-faad-486b-ba95-a5e6409d1d4d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:10.371329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:10.626531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb2fab8e-faad-486b-ba95-a5e6409d1d4d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:10.642035 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fb2fab8e-faad-486b-ba95-a5e6409d1d4d tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1463 microversion: 2.1 time: 0.312438 Aug 23 18:27:10.642955 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3227/6320] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:10 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1463 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:10.665139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8edcbff6-f11b-4464-9d36-cd057792b012 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0a6d40a0-796d-4570-bd5f-e84803373a3e", "device": "/dev/sdb"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:10.667706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8edcbff6-f11b-4464-9d36-cd057792b012 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:10.676071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8edcbff6-f11b-4464-9d36-cd057792b012 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:10.676366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8edcbff6-f11b-4464-9d36-cd057792b012 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:10.676766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8edcbff6-f11b-4464-9d36-cd057792b012 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:10.677561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8edcbff6-f11b-4464-9d36-cd057792b012 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:10.678099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8edcbff6-f11b-4464-9d36-cd057792b012 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:10.678628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8edcbff6-f11b-4464-9d36-cd057792b012 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:11.106153 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8edcbff6-f11b-4464-9d36-cd057792b012 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "POST /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.442918 Aug 23 18:27:11.106853 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3094/6321] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:27:10 2022] POST /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20/os-volume_attachments => generated 194 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:13.691131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d252a65b-f2d5-40e7-8ed4-0661ab599c12 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '.version_select at 0x7f27ec3b48b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:13.767436 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d252a65b-f2d5-40e7-8ed4-0661ab599c12 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-340573885" status: 202 len: 0 microversion: 2.1 time: 0.079067 Aug 23 18:27:13.773741 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3228/6322] 10.222.0.61 () {58 vars in 1281 bytes} [Tue Aug 23 18:27:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-340573885 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:27:13.805772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9034b273-f429-4e97-a8d0-2b666f4de4d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'create', calling method: .version_select at 0x7f27dfa0c4c0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1628359249", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJcAi5hgYgseN5zEWdySAROwNAMI3t/ay6kLol+ij1qCtstI7wAaw7U0ZBkEIhXQOpL1RjTAi44VQMskmGRgiUZQpU7BieANqAX4bbG9xfqegM2tiHy4cdvlUwWd11dXWQ=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:13.824322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-9034b273-f429-4e97-a8d0-2b666f4de4d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:27:13.830318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-9034b273-f429-4e97-a8d0-2b666f4de4d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for user 399d321c5f564e8ba9d3e1ed7ae05184 and project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:27:13.833389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:13.868037 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9034b273-f429-4e97-a8d0-2b666f4de4d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.067687 Aug 23 18:27:13.868835 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3095/6323] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:27:13 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:27:15.744311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8af5a4c2-0332-4313-a3cf-ec984ee015ff tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Action: 'create', calling method: .version_select at 0x7f27df617700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1255418670"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:16.301145 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8af5a4c2-0332-4313-a3cf-ec984ee015ff tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.883463 Aug 23 18:27:16.302000 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3229/6324] 10.222.0.61 () {60 vars in 1155 bytes} [Tue Aug 23 18:27:15 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 886 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 23 18:27:16.314499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a1c2bcae-8f0c-44c8-a60c-c016def0c55a tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27ec264a60>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:16.422193 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a1c2bcae-8f0c-44c8-a60c-c016def0c55a tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4" status: 200 len: 345 microversion: 2.1 time: 0.111474 Aug 23 18:27:16.430022 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3096/6325] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:27:16 2022] GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 => generated 345 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:17.439986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-557158f4-45e1-46b0-8c40-60a30f104ad0 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27ec075280>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:17.514889 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-557158f4-45e1-46b0-8c40-60a30f104ad0 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4" status: 200 len: 345 microversion: 2.1 time: 0.079935 Aug 23 18:27:17.520590 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3230/6326] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:27:17 2022] GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 => generated 345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:18.531393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5243e962-18c4-4d5e-bdae-2f7c3d7f469a tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27f1c51700>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:18.599432 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5243e962-18c4-4d5e-bdae-2f7c3d7f469a tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4" status: 200 len: 346 microversion: 2.1 time: 0.072678 Aug 23 18:27:18.600695 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3097/6327] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:27:18 2022] GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 => generated 346 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:18.614313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2befc34-7f0b-412d-ad0b-63aaca15c6d9 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Action: 'create', calling method: .version_select at 0x7f27df6a8af0>, body: {"snapshot": {"volume_id": "10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1172833125"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:18.812922 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f2befc34-7f0b-412d-ad0b-63aaca15c6d9 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.203328 Aug 23 18:27:18.813574 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3231/6328] 10.222.0.61 () {60 vars in 1162 bytes} [Tue Aug 23 18:27:18 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:18.827102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1206647c-c2a4-420e-a7e7-efdf15792b78 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27f1b800d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:18.889973 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1206647c-c2a4-420e-a7e7-efdf15792b78 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053" status: 200 len: 287 microversion: 2.1 time: 0.068177 Aug 23 18:27:18.891214 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3098/6329] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Aug 23 18:27:18 2022] GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:18.902971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2bdfd75-65df-4b67-9787-7e17c34dd375 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27ec3b41f0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:18.963435 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f2bdfd75-65df-4b67-9787-7e17c34dd375 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.064715 Aug 23 18:27:18.964753 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3232/6330] 10.222.0.61 () {58 vars in 1140 bytes} [Tue Aug 23 18:27:18 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:18.976233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a99745fe-fb3a-48ae-a91b-15b7bd295dd1 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27f1beac10>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:19.024228 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a99745fe-fb3a-48ae-a91b-15b7bd295dd1 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053" status: 200 len: 287 microversion: 2.1 time: 0.052457 Aug 23 18:27:19.025010 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3099/6331] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Aug 23 18:27:18 2022] GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:20.039983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-02549b84-dc14-4ff6-9459-4852bfc5752b tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27ec404310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:20.100854 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-02549b84-dc14-4ff6-9459-4852bfc5752b tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053" status: 200 len: 287 microversion: 2.1 time: 0.066989 Aug 23 18:27:20.106412 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3233/6332] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Aug 23 18:27:20 2022] GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:21.132856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5e6c0c09-12aa-4f3a-a735-395e8829095f tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27ec910790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:21.148795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:21.185880 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5e6c0c09-12aa-4f3a-a735-395e8829095f tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053" status: 200 len: 288 microversion: 2.1 time: 0.063683 Aug 23 18:27:21.187452 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3100/6333] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Aug 23 18:27:21 2022] GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053 => generated 288 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:21.199961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93186e89-a9cb-45bb-a4c9-834c3086f5c2 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27ec404d30>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:21.208071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:21.293734 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93186e89-a9cb-45bb-a4c9-834c3086f5c2 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "DELETE /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053" status: 202 len: 0 microversion: 2.1 time: 0.097226 Aug 23 18:27:21.301670 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3234/6334] 10.222.0.61 () {58 vars in 1254 bytes} [Tue Aug 23 18:27:21 2022] DELETE /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:27:21.310338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b24318fd-dcc2-48c8-9497-546b0bd842d3 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27f1ab8550>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:21.352525 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b24318fd-dcc2-48c8-9497-546b0bd842d3 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053" status: 200 len: 287 microversion: 2.1 time: 0.047989 Aug 23 18:27:21.357211 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3101/6335] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Aug 23 18:27:21 2022] GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053 => generated 287 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:22.367521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-261f71fa-2a5a-414c-b3be-463a791db061 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27df67cdc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:22.448066 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-261f71fa-2a5a-414c-b3be-463a791db061 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053" status: 200 len: 287 microversion: 2.1 time: 0.087224 Aug 23 18:27:22.449472 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3235/6336] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Aug 23 18:27:22 2022] GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053 => generated 287 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:23.465988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8216f934-57ae-4496-8b7d-589307c99e14 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27f1ab84c0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:23.521645 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8216f934-57ae-4496-8b7d-589307c99e14 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053" status: 200 len: 287 microversion: 2.1 time: 0.061291 Aug 23 18:27:23.523593 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3102/6337] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Aug 23 18:27:23 2022] GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:23.945064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:23.949900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1793043966", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "b4811591-cf63-484d-a8e1-e49aa628a1c1"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1628359249", "security_groups": [{"name": "tempest-secgroup-smoke-388147207"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:24.073485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] validate_networks() for [('b4811591-cf63-484d-a8e1-e49aa628a1c1', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:27:24.536687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-39ae343d-d526-484c-99f0-5247ff5fbdcc tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27ec264310>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:24.546317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:24.583114 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-39ae343d-d526-484c-99f0-5247ff5fbdcc tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] HTTP exception thrown: Snapshot f74c39df-c48e-49c8-b13b-b7d8c01ad053 could not be found. Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-39ae343d-d526-484c-99f0-5247ff5fbdcc tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Request method failure captured: Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053 HTTP/1.1 Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRwDa-qOrfS-lf_b5jl1Eoy_aFQYn3qEHGBgAaZbmNxUybG01KB1NloAdZvHHiSyJW5sjwpeF5UuPtemaYEB6Yoxg_PNmhL3ADE2YvX8E3eNUiOnUQ05kKUPhKOB6hcFTecvEZ5KyZb_KfIZR1AO6dE83cj7RCr6oMjQoKHPb6-1bEk Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 8a074dc2e5694182af337cf0f230fa5b Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812093828 Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8a074dc2e5694182af337cf0f230fa5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8a074dc2e5694182af337cf0f230fa5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8a074dc2e5694182af337cf0f230fa5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8a074dc2e5694182af337cf0f230fa5b"}]}] Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812093828 Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 8a074dc2e5694182af337cf0f230fa5b Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812093828 Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-VolumesSnapshotsTestJSON-812093828-project Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 7742fe93486a425fb900ee87591ad59d Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812093828-project Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: exception: Snapshot f74c39df-c48e-49c8-b13b-b7d8c01ad053 could not be found. Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f74c39df-c48e-49c8-b13b-b7d8c01ad053'} Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot f74c39df-c48e-49c8-b13b-b7d8c01ad053 could not be found. (HTTP 404) (Request-ID: req-fc1a7cbb-6272-4290-92e3-a536f21aba47) Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 18:27:24.589002 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot f74c39df-c48e-49c8-b13b-b7d8c01ad053 could not be found. Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot f74c39df-c48e-49c8-b13b-b7d8c01ad053 could not be found. Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot f74c39df-c48e-49c8-b13b-b7d8c01ad053 could not be found. Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-39ae343d-d526-484c-99f0-5247ff5fbdcc tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Returning 404 to user: Snapshot f74c39df-c48e-49c8-b13b-b7d8c01ad053 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-39ae343d-d526-484c-99f0-5247ff5fbdcc tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053" status: 404 len: 111 microversion: 2.1 time: 0.060431 Aug 23 18:27:24.596478 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3103/6338] 10.222.0.61 () {58 vars in 1251 bytes} [Tue Aug 23 18:27:24 2022] GET /compute/v2.1/os-snapshots/f74c39df-c48e-49c8-b13b-b7d8c01ad053 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:27:24.604393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ca32e1ee-3916-43f1-bf61-f5874bb9800f tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27df628160>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:24.694228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:27:24.694674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:27:24.695819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:27:24.696431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:27:24.697221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:27:24.712453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:24.712942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:24.713413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:24.714176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:24.714664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:24.715101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:24.749942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:27:24.764855 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ca32e1ee-3916-43f1-bf61-f5874bb9800f tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4" status: 202 len: 0 microversion: 2.1 time: 0.165910 Aug 23 18:27:24.769287 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3104/6339] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:27:24 2022] DELETE /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:27:24.769618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for user 399d321c5f564e8ba9d3e1ed7ae05184 and project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:27:24.775162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc2028b4-9954-42b0-86fa-056d03e3423b tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27ec2643a0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:24.801898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:27:24.803842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:27:24.886615 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d11101e5-c4df-4119-a861-34a705c0b208 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.942937 Aug 23 18:27:24.887868 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3236/6340] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:27:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:27:24.896162 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc2028b4-9954-42b0-86fa-056d03e3423b tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4" status: 200 len: 345 microversion: 2.1 time: 0.125267 Aug 23 18:27:24.897220 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3105/6341] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:27:24 2022] GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:24.910770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-844d9689-3c28-4518-8fcb-874bac24881a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:24.911935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-844d9689-3c28-4518-8fcb-874bac24881a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:24.975849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-844d9689-3c28-4518-8fcb-874bac24881a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:24.983471 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-844d9689-3c28-4518-8fcb-874bac24881a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1267 microversion: 2.1 time: 0.084773 Aug 23 18:27:24.998502 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3237/6342] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:24 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1267 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:25.913329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-52eb2bda-d613-4128-9b49-0d32dad58ce4 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27df628e50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:26.008470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a4db2be-4787-474c-9707-aec702adf39b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:26.009316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8a4db2be-4787-474c-9707-aec702adf39b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:26.027404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a4db2be-4787-474c-9707-aec702adf39b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:26.029558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a4db2be-4787-474c-9707-aec702adf39b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:26.030377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a4db2be-4787-474c-9707-aec702adf39b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:26.031464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a4db2be-4787-474c-9707-aec702adf39b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:26.033617 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-52eb2bda-d613-4128-9b49-0d32dad58ce4 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4" status: 200 len: 345 microversion: 2.1 time: 0.126245 Aug 23 18:27:26.034819 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3106/6343] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:27:25 2022] GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 => generated 345 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:26.035900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a4db2be-4787-474c-9707-aec702adf39b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:26.036459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a4db2be-4787-474c-9707-aec702adf39b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:26.134647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8a4db2be-4787-474c-9707-aec702adf39b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:26.143441 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8a4db2be-4787-474c-9707-aec702adf39b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1319 microversion: 2.1 time: 0.139045 Aug 23 18:27:26.146802 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3238/6344] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:26 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1319 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:27:27.050912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-17a75b40-c883-4c5e-8d20-65f2c9c9d5ac tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27df9c4d30>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:27.063576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=3,nova_api:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:27.164080 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-17a75b40-c883-4c5e-8d20-65f2c9c9d5ac tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4" status: 200 len: 345 microversion: 2.1 time: 0.119034 Aug 23 18:27:27.165603 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3107/6345] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:27:27 2022] GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 => generated 345 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:27.180970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-468fde29-cc4a-451b-b5d2-55a8c09fb600 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:27.183816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-468fde29-cc4a-451b-b5d2-55a8c09fb600 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:27.192899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-468fde29-cc4a-451b-b5d2-55a8c09fb600 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:27.193820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-468fde29-cc4a-451b-b5d2-55a8c09fb600 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:27.194521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-468fde29-cc4a-451b-b5d2-55a8c09fb600 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:27.195600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-468fde29-cc4a-451b-b5d2-55a8c09fb600 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:27.196325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-468fde29-cc4a-451b-b5d2-55a8c09fb600 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:27.197016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-468fde29-cc4a-451b-b5d2-55a8c09fb600 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:27.385059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-468fde29-cc4a-451b-b5d2-55a8c09fb600 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:27.399090 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-468fde29-cc4a-451b-b5d2-55a8c09fb600 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1325 microversion: 2.1 time: 0.231043 Aug 23 18:27:27.414354 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3239/6346] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:27 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1325 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:28.180290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b79143cf-0c21-48bd-97c6-1f13489842ca tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27dfa0c940>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:28.246910 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-b79143cf-0c21-48bd-97c6-1f13489842ca tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] HTTP exception thrown: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b79143cf-0c21-48bd-97c6-1f13489842ca tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Request method failure captured: Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 HTTP/1.1 Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRwDa-qOrfS-lf_b5jl1Eoy_aFQYn3qEHGBgAaZbmNxUybG01KB1NloAdZvHHiSyJW5sjwpeF5UuPtemaYEB6Yoxg_PNmhL3ADE2YvX8E3eNUiOnUQ05kKUPhKOB6hcFTecvEZ5KyZb_KfIZR1AO6dE83cj7RCr6oMjQoKHPb6-1bEk Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 8a074dc2e5694182af337cf0f230fa5b Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812093828 Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8a074dc2e5694182af337cf0f230fa5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8a074dc2e5694182af337cf0f230fa5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8a074dc2e5694182af337cf0f230fa5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8a074dc2e5694182af337cf0f230fa5b"}]}] Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812093828 Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 8a074dc2e5694182af337cf0f230fa5b Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812093828 Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-VolumesSnapshotsTestJSON-812093828-project Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 7742fe93486a425fb900ee87591ad59d Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812093828-project Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: exception: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4'} Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. (HTTP 404) (Request-ID: req-ba280043-50a7-4c64-9e3d-1e489c9528e2) Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 18:27:28.248912 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b79143cf-0c21-48bd-97c6-1f13489842ca tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Returning 404 to user: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:27:28.254582 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b79143cf-0c21-48bd-97c6-1f13489842ca tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4" status: 404 len: 109 microversion: 2.1 time: 0.078004 Aug 23 18:27:28.257600 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3108/6347] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:27:28 2022] GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:27:28.266315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b4b072d7-4984-450e-84cc-0af71d1f2492 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27df67c310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:28.324438 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b4b072d7-4984-450e-84cc-0af71d1f2492 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] HTTP exception thrown: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b4b072d7-4984-450e-84cc-0af71d1f2492 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Request method failure captured: Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 HTTP/1.1 Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRwDa-qOrfS-lf_b5jl1Eoy_aFQYn3qEHGBgAaZbmNxUybG01KB1NloAdZvHHiSyJW5sjwpeF5UuPtemaYEB6Yoxg_PNmhL3ADE2YvX8E3eNUiOnUQ05kKUPhKOB6hcFTecvEZ5KyZb_KfIZR1AO6dE83cj7RCr6oMjQoKHPb6-1bEk Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 8a074dc2e5694182af337cf0f230fa5b Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812093828 Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8a074dc2e5694182af337cf0f230fa5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8a074dc2e5694182af337cf0f230fa5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8a074dc2e5694182af337cf0f230fa5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8a074dc2e5694182af337cf0f230fa5b"}]}] Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812093828 Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 8a074dc2e5694182af337cf0f230fa5b Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812093828 Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-VolumesSnapshotsTestJSON-812093828-project Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 7742fe93486a425fb900ee87591ad59d Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812093828-project Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: method: Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: exception: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4'} Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. (HTTP 404) (Request-ID: req-cedc9f76-7407-4336-9058-efbeca5c9f29) Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 18:27:28.329012 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b4b072d7-4984-450e-84cc-0af71d1f2492 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Returning 404 to user: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b4b072d7-4984-450e-84cc-0af71d1f2492 tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "DELETE /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4" status: 404 len: 109 microversion: 2.1 time: 0.069337 Aug 23 18:27:28.336771 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3240/6348] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:27:28 2022] DELETE /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 => generated 109 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:27:28.352088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a386a8db-8d34-489d-a359-fe2357087ece tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Calling method '.version_select at 0x7f27f1b38e50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:28.427334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-31ba8e80-e500-4ed3-af3a-8b6b7c888162 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:28.431107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-31ba8e80-e500-4ed3-af3a-8b6b7c888162 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:28.450042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31ba8e80-e500-4ed3-af3a-8b6b7c888162 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:28.463089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31ba8e80-e500-4ed3-af3a-8b6b7c888162 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:28.463694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31ba8e80-e500-4ed3-af3a-8b6b7c888162 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:28.464962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31ba8e80-e500-4ed3-af3a-8b6b7c888162 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:28.465776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31ba8e80-e500-4ed3-af3a-8b6b7c888162 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:28.466272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31ba8e80-e500-4ed3-af3a-8b6b7c888162 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:28.472594 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-a386a8db-8d34-489d-a359-fe2357087ece tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] HTTP exception thrown: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a386a8db-8d34-489d-a359-fe2357087ece tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Request method failure captured: Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 HTTP/1.1 Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRwDa-qOrfS-lf_b5jl1Eoy_aFQYn3qEHGBgAaZbmNxUybG01KB1NloAdZvHHiSyJW5sjwpeF5UuPtemaYEB6Yoxg_PNmhL3ADE2YvX8E3eNUiOnUQ05kKUPhKOB6hcFTecvEZ5KyZb_KfIZR1AO6dE83cj7RCr6oMjQoKHPb6-1bEk Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 8a074dc2e5694182af337cf0f230fa5b Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812093828 Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8a074dc2e5694182af337cf0f230fa5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8a074dc2e5694182af337cf0f230fa5b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8a074dc2e5694182af337cf0f230fa5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8a074dc2e5694182af337cf0f230fa5b"}]}] Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812093828 Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 8a074dc2e5694182af337cf0f230fa5b Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812093828 Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-VolumesSnapshotsTestJSON-812093828-project Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 7742fe93486a425fb900ee87591ad59d Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812093828-project Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: method: Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: exception: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4'} Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. (HTTP 404) (Request-ID: req-c250d82d-dad0-4a31-9a0f-6fd1057f7336) Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 23 18:27:28.476468 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. Aug 23 18:27:28.483214 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:27:28.509749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a386a8db-8d34-489d-a359-fe2357087ece tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] Returning 404 to user: Volume 10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:27:28.511105 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a386a8db-8d34-489d-a359-fe2357087ece tempest-VolumesSnapshotsTestJSON-812093828 tempest-VolumesSnapshotsTestJSON-812093828-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4" status: 404 len: 109 microversion: 2.1 time: 0.169182 Aug 23 18:27:28.511941 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3109/6349] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:27:28 2022] GET /compute/v2.1/os-volumes/10d1fce7-43ec-4fdf-84d3-fdfc9393f3b4 => generated 109 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:27:29.020861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-31ba8e80-e500-4ed3-af3a-8b6b7c888162 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:29.029572 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-31ba8e80-e500-4ed3-af3a-8b6b7c888162 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1392 microversion: 2.1 time: 0.611971 Aug 23 18:27:29.037408 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3241/6350] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:28 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1392 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:27:30.059323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-549a598d-8d45-4ba3-ba88-50307cacf2b2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:30.060075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-549a598d-8d45-4ba3-ba88-50307cacf2b2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:30.076297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-549a598d-8d45-4ba3-ba88-50307cacf2b2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:30.079981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-549a598d-8d45-4ba3-ba88-50307cacf2b2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:30.080669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-549a598d-8d45-4ba3-ba88-50307cacf2b2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:30.082836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-549a598d-8d45-4ba3-ba88-50307cacf2b2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:30.086815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-549a598d-8d45-4ba3-ba88-50307cacf2b2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:30.087945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-549a598d-8d45-4ba3-ba88-50307cacf2b2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:30.146315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5a68876d-5409-45e0-ad3f-cd9b41bd0975 req-96d1063e-1c7b-451a-98bc-4e9836245d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d51053-cb2c-4787-b36d-8e1c7801712e", "tag": "7b042a88-e07a-4fdc-9a3c-220fb49a38b4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:30.215321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5a68876d-5409-45e0-ad3f-cd9b41bd0975 req-96d1063e-1c7b-451a-98bc-4e9836245d87 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:30.217190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5a68876d-5409-45e0-ad3f-cd9b41bd0975 req-96d1063e-1c7b-451a-98bc-4e9836245d87 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:30.229366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5a68876d-5409-45e0-ad3f-cd9b41bd0975 req-96d1063e-1c7b-451a-98bc-4e9836245d87 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:30.263004 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5a68876d-5409-45e0-ad3f-cd9b41bd0975 req-96d1063e-1c7b-451a-98bc-4e9836245d87 service nova] Creating event network-changed:7b042a88-e07a-4fdc-9a3c-220fb49a38b4 for instance 61d51053-cb2c-4787-b36d-8e1c7801712e on n-h1-850468-16 Aug 23 18:27:30.282715 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5a68876d-5409-45e0-ad3f-cd9b41bd0975 req-96d1063e-1c7b-451a-98bc-4e9836245d87 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138870 Aug 23 18:27:30.290124 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3242/6351] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:27:30.653567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-549a598d-8d45-4ba3-ba88-50307cacf2b2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:30.670598 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-549a598d-8d45-4ba3-ba88-50307cacf2b2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1392 microversion: 2.1 time: 0.616702 Aug 23 18:27:30.689377 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3110/6352] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:30 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1392 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:31.698957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-90e1d573-13f9-428a-a824-068b79af1853 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:31.700423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-90e1d573-13f9-428a-a824-068b79af1853 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:31.717943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90e1d573-13f9-428a-a824-068b79af1853 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:31.719249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90e1d573-13f9-428a-a824-068b79af1853 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:31.720872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90e1d573-13f9-428a-a824-068b79af1853 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:31.722097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90e1d573-13f9-428a-a824-068b79af1853 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:31.722987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90e1d573-13f9-428a-a824-068b79af1853 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:31.725158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90e1d573-13f9-428a-a824-068b79af1853 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:32.038663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-90e1d573-13f9-428a-a824-068b79af1853 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:32.055034 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-90e1d573-13f9-428a-a824-068b79af1853 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1392 microversion: 2.1 time: 0.362307 Aug 23 18:27:32.057856 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3243/6353] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:31 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1392 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:33.079289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d98e40f6-aed8-4be6-9731-3dc4ab26394f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:33.080444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d98e40f6-aed8-4be6-9731-3dc4ab26394f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:33.093401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d98e40f6-aed8-4be6-9731-3dc4ab26394f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:33.094167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d98e40f6-aed8-4be6-9731-3dc4ab26394f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:33.094885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d98e40f6-aed8-4be6-9731-3dc4ab26394f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:33.095817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d98e40f6-aed8-4be6-9731-3dc4ab26394f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:33.102875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d98e40f6-aed8-4be6-9731-3dc4ab26394f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:33.104251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d98e40f6-aed8-4be6-9731-3dc4ab26394f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:33.572892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d98e40f6-aed8-4be6-9731-3dc4ab26394f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:33.591267 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d98e40f6-aed8-4be6-9731-3dc4ab26394f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1392 microversion: 2.1 time: 0.515368 Aug 23 18:27:33.591937 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3111/6354] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:33 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1392 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:34.541915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-232196ed-f89c-4dc6-b422-ee4c21082242 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] Calling method '.version_select at 0x7f27ec69e8b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:34.617750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-727998ff-2350-4ff9-b89b-3d791fe4c023 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:34.619312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-727998ff-2350-4ff9-b89b-3d791fe4c023 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:34.627090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-727998ff-2350-4ff9-b89b-3d791fe4c023 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:34.628552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-727998ff-2350-4ff9-b89b-3d791fe4c023 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:34.629715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-727998ff-2350-4ff9-b89b-3d791fe4c023 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:34.630652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-727998ff-2350-4ff9-b89b-3d791fe4c023 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:34.631620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-727998ff-2350-4ff9-b89b-3d791fe4c023 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:34.632195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-727998ff-2350-4ff9-b89b-3d791fe4c023 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:34.637782 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-232196ed-f89c-4dc6-b422-ee4c21082242 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/09160b98-ab23-4efe-ad2a-0ec7a25dde88" status: 200 len: 350 microversion: 2.1 time: 0.099624 Aug 23 18:27:34.638589 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3244/6355] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:27:34 2022] GET /compute/v2.1/os-volumes/09160b98-ab23-4efe-ad2a-0ec7a25dde88 => generated 350 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:34.822398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-727998ff-2350-4ff9-b89b-3d791fe4c023 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:34.835553 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-727998ff-2350-4ff9-b89b-3d791fe4c023 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1392 microversion: 2.1 time: 0.224905 Aug 23 18:27:34.836920 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3112/6356] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:34 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1392 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:27:35.861313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-91806fcf-3fff-4a2d-a850-14481f7d4e4f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:35.863787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-91806fcf-3fff-4a2d-a850-14481f7d4e4f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:35.866588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:35.867564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:27:35.878764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91806fcf-3fff-4a2d-a850-14481f7d4e4f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:35.879689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91806fcf-3fff-4a2d-a850-14481f7d4e4f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:35.880488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91806fcf-3fff-4a2d-a850-14481f7d4e4f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:35.881538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91806fcf-3fff-4a2d-a850-14481f7d4e4f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:35.882221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91806fcf-3fff-4a2d-a850-14481f7d4e4f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:35.882931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91806fcf-3fff-4a2d-a850-14481f7d4e4f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:36.226993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-91806fcf-3fff-4a2d-a850-14481f7d4e4f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:36.235364 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-91806fcf-3fff-4a2d-a850-14481f7d4e4f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1392 microversion: 2.1 time: 0.378824 Aug 23 18:27:36.235940 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3245/6357] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:35 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1392 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:37.285450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-51828ac3-44f4-4899-9df7-ddd52ddb23a3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:37.290323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-51828ac3-44f4-4899-9df7-ddd52ddb23a3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:37.303338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51828ac3-44f4-4899-9df7-ddd52ddb23a3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:37.304245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51828ac3-44f4-4899-9df7-ddd52ddb23a3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:37.305087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51828ac3-44f4-4899-9df7-ddd52ddb23a3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:37.316229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51828ac3-44f4-4899-9df7-ddd52ddb23a3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:37.317427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51828ac3-44f4-4899-9df7-ddd52ddb23a3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:37.319033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51828ac3-44f4-4899-9df7-ddd52ddb23a3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:37.577282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-bba5b0e2-4838-4dbd-a1dd-9e2948d38a23 req-d9292771-52fb-4d78-88c1-fc7b1fb70b5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d51053-cb2c-4787-b36d-8e1c7801712e", "name": "network-vif-plugged", "status": "completed", "tag": "7b042a88-e07a-4fdc-9a3c-220fb49a38b4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:37.590346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bba5b0e2-4838-4dbd-a1dd-9e2948d38a23 req-d9292771-52fb-4d78-88c1-fc7b1fb70b5d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:37.591477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bba5b0e2-4838-4dbd-a1dd-9e2948d38a23 req-d9292771-52fb-4d78-88c1-fc7b1fb70b5d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:37.592097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bba5b0e2-4838-4dbd-a1dd-9e2948d38a23 req-d9292771-52fb-4d78-88c1-fc7b1fb70b5d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:37.605767 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-bba5b0e2-4838-4dbd-a1dd-9e2948d38a23 req-d9292771-52fb-4d78-88c1-fc7b1fb70b5d service nova] Creating event network-vif-plugged:7b042a88-e07a-4fdc-9a3c-220fb49a38b4 for instance 61d51053-cb2c-4787-b36d-8e1c7801712e on n-h1-850468-16 Aug 23 18:27:37.612363 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-bba5b0e2-4838-4dbd-a1dd-9e2948d38a23 req-d9292771-52fb-4d78-88c1-fc7b1fb70b5d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.340781 Aug 23 18:27:37.615322 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3246/6358] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:37.635568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-10d38337-da4c-4012-82ba-7b09b35f0f52 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] Calling method '.version_select at 0x7f27ec05faf0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:37.716949 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-10d38337-da4c-4012-82ba-7b09b35f0f52 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/4f7c0f37-3cc8-4440-ba21-97f05f250cb3" status: 200 len: 351 microversion: 2.1 time: 0.100132 Aug 23 18:27:37.717835 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3247/6359] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:27:37 2022] GET /compute/v2.1/os-volumes/4f7c0f37-3cc8-4440-ba21-97f05f250cb3 => generated 351 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:37.773874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-51828ac3-44f4-4899-9df7-ddd52ddb23a3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:37.783763 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-51828ac3-44f4-4899-9df7-ddd52ddb23a3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1392 microversion: 2.1 time: 0.513804 Aug 23 18:27:37.798789 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3113/6360] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:37 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1392 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:38.807621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-abdf1fa7-34c8-486e-b88d-25f056970f54 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:38.808509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-abdf1fa7-34c8-486e-b88d-25f056970f54 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:38.823411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abdf1fa7-34c8-486e-b88d-25f056970f54 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:38.824340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abdf1fa7-34c8-486e-b88d-25f056970f54 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:38.825015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abdf1fa7-34c8-486e-b88d-25f056970f54 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:38.826182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abdf1fa7-34c8-486e-b88d-25f056970f54 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:38.827124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abdf1fa7-34c8-486e-b88d-25f056970f54 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:38.827763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-abdf1fa7-34c8-486e-b88d-25f056970f54 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:39.030921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-abdf1fa7-34c8-486e-b88d-25f056970f54 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:39.043730 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-abdf1fa7-34c8-486e-b88d-25f056970f54 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1392 microversion: 2.1 time: 0.240746 Aug 23 18:27:39.062576 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3248/6361] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:38 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1392 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:40.072682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8c3abd7b-2f2a-45bf-a2ce-9a2581ef2e93 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:40.073654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8c3abd7b-2f2a-45bf-a2ce-9a2581ef2e93 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:40.080702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c3abd7b-2f2a-45bf-a2ce-9a2581ef2e93 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:40.081540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c3abd7b-2f2a-45bf-a2ce-9a2581ef2e93 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:40.082187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c3abd7b-2f2a-45bf-a2ce-9a2581ef2e93 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:40.082989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c3abd7b-2f2a-45bf-a2ce-9a2581ef2e93 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:40.083668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c3abd7b-2f2a-45bf-a2ce-9a2581ef2e93 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:40.084164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c3abd7b-2f2a-45bf-a2ce-9a2581ef2e93 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:40.240534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-21899d70-6bc0-40df-836a-a1c97765c08d tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] Calling method '.version_select at 0x7f27ec3b4310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:40.247875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8c3abd7b-2f2a-45bf-a2ce-9a2581ef2e93 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:40.262156 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8c3abd7b-2f2a-45bf-a2ce-9a2581ef2e93 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1565 microversion: 2.1 time: 0.193384 Aug 23 18:27:40.277464 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3114/6362] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:40 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1565 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:40.289506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a7f99d25-a1ea-48c8-9e0b-05542d742400 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:40.290418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a7f99d25-a1ea-48c8-9e0b-05542d742400 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:40.307049 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-21899d70-6bc0-40df-836a-a1c97765c08d tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/386a5a14-b662-4cf0-91b7-96b4aa71720a" status: 200 len: 351 microversion: 2.1 time: 0.071028 Aug 23 18:27:40.315790 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3249/6363] 10.222.0.61 () {58 vars in 1245 bytes} [Tue Aug 23 18:27:40 2022] GET /compute/v2.1/os-volumes/386a5a14-b662-4cf0-91b7-96b4aa71720a => generated 351 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:40.319386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7f99d25-a1ea-48c8-9e0b-05542d742400 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:40.320010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7f99d25-a1ea-48c8-9e0b-05542d742400 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:40.320523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7f99d25-a1ea-48c8-9e0b-05542d742400 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:40.321475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7f99d25-a1ea-48c8-9e0b-05542d742400 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:40.321845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7f99d25-a1ea-48c8-9e0b-05542d742400 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:40.322028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3afb6333-6971-4769-857f-5886684c8793 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] Calling method '.version_select at 0x7f27df64a310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:40.322390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7f99d25-a1ea-48c8-9e0b-05542d742400 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:40.429929 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3afb6333-6971-4769-857f-5886684c8793 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.111682 Aug 23 18:27:40.431230 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3250/6364] 10.222.0.61 () {58 vars in 1134 bytes} [Tue Aug 23 18:27:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:27:40.446340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b45d4cfa-8059-4ce6-bca7-40fc5ceecfbb tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] Calling method '.version_select at 0x7f27ec69e8b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:40.488019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a7f99d25-a1ea-48c8-9e0b-05542d742400 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:40.498812 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a7f99d25-a1ea-48c8-9e0b-05542d742400 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1565 microversion: 2.1 time: 0.214929 Aug 23 18:27:40.513336 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3115/6365] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:40 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1565 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:40.550430 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b45d4cfa-8059-4ce6-bca7-40fc5ceecfbb tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.108086 Aug 23 18:27:40.560584 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3251/6366] 10.222.0.61 () {58 vars in 1149 bytes} [Tue Aug 23 18:27:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:40.572719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-880fac7d-3792-4e9f-82f7-2ddb05d10043 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] Calling method '.version_select at 0x7f27dfba7550>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:40.668394 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-880fac7d-3792-4e9f-82f7-2ddb05d10043 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.103001 Aug 23 18:27:40.669206 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3116/6367] 10.222.0.61 () {58 vars in 1134 bytes} [Tue Aug 23 18:27:40 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:40.682404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a804759f-0ea4-4a30-be4b-374e7a6897e3 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] Calling method '.version_select at 0x7f27df7b84c0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:40.796126 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a804759f-0ea4-4a30-be4b-374e7a6897e3 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.117847 Aug 23 18:27:40.798821 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3252/6368] 10.222.0.61 () {58 vars in 1167 bytes} [Tue Aug 23 18:27:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:40.813604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-299a823c-0a87-481b-8a1e-b6d3b10e5b5c tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] Calling method '.version_select at 0x7f27ec0e5430>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:40.923988 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-299a823c-0a87-481b-8a1e-b6d3b10e5b5c tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.114925 Aug 23 18:27:40.939507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-42eba608-9a5c-40a9-9981-d8d6a6ae57af tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] Calling method '.version_select at 0x7f27df6a81f0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:40.942926 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3117/6369] 10.222.0.61 () {58 vars in 1170 bytes} [Tue Aug 23 18:27:40 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:41.035519 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-42eba608-9a5c-40a9-9981-d8d6a6ae57af tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.099841 Aug 23 18:27:41.036104 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3253/6370] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 18:27:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:41.050958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf60f193-944b-4a19-a3f3-aa3800d2a568 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] Calling method '.version_select at 0x7f27dfaf6790>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:41.172757 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bf60f193-944b-4a19-a3f3-aa3800d2a568 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.126507 Aug 23 18:27:41.174014 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3118/6371] 10.222.0.61 () {58 vars in 1188 bytes} [Tue Aug 23 18:27:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:41.187504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f1cb2528-48ee-4477-8cb1-9086b4032687 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] Calling method '.version_select at 0x7f27df4ff1f0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:41.288012 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f1cb2528-48ee-4477-8cb1-9086b4032687 tempest-VolumesTestJSON-590589202 tempest-VolumesTestJSON-590589202-project] 10.222.0.61 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.104585 Aug 23 18:27:41.302524 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3254/6372] 10.222.0.61 () {58 vars in 1155 bytes} [Tue Aug 23 18:27:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:27:42.853291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d19911d-ecbd-4114-9edd-3e1c889c9aef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:27:42.854077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d19911d-ecbd-4114-9edd-3e1c889c9aef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:27:42.870449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3c837e10-a14e-4365-b935-937975198b8a req-6f9a9444-b1a4-420e-a7bd-0e7f69b0d0f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d51053-cb2c-4787-b36d-8e1c7801712e", "tag": "7b042a88-e07a-4fdc-9a3c-220fb49a38b4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:27:42.884804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d19911d-ecbd-4114-9edd-3e1c889c9aef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:42.885616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d19911d-ecbd-4114-9edd-3e1c889c9aef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:42.887141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d19911d-ecbd-4114-9edd-3e1c889c9aef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:42.890308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d19911d-ecbd-4114-9edd-3e1c889c9aef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:42.891360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d19911d-ecbd-4114-9edd-3e1c889c9aef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:42.894268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d19911d-ecbd-4114-9edd-3e1c889c9aef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:42.900972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3c837e10-a14e-4365-b935-937975198b8a req-6f9a9444-b1a4-420e-a7bd-0e7f69b0d0f1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:27:42.902073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3c837e10-a14e-4365-b935-937975198b8a req-6f9a9444-b1a4-420e-a7bd-0e7f69b0d0f1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:27:42.903932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3c837e10-a14e-4365-b935-937975198b8a req-6f9a9444-b1a4-420e-a7bd-0e7f69b0d0f1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:27:42.932981 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3c837e10-a14e-4365-b935-937975198b8a req-6f9a9444-b1a4-420e-a7bd-0e7f69b0d0f1 service nova] Creating event network-changed:7b042a88-e07a-4fdc-9a3c-220fb49a38b4 for instance 61d51053-cb2c-4787-b36d-8e1c7801712e on n-h1-850468-16 Aug 23 18:27:42.948649 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3c837e10-a14e-4365-b935-937975198b8a req-6f9a9444-b1a4-420e-a7bd-0e7f69b0d0f1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078425 Aug 23 18:27:42.967479 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3255/6373] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:27:43.163753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7d19911d-ecbd-4114-9edd-3e1c889c9aef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:27:43.176125 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d19911d-ecbd-4114-9edd-3e1c889c9aef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1565 microversion: 2.1 time: 0.327409 Aug 23 18:27:43.183323 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3119/6374] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:27:42 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1565 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:28:21.796156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b1f3a3c-1e5d-49ef-8cb1-3393c10ee6ea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:28:21.807544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3b1f3a3c-1e5d-49ef-8cb1-3393c10ee6ea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:21.829632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:28:21.830969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=44 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:28:21.846232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b1f3a3c-1e5d-49ef-8cb1-3393c10ee6ea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:21.847099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b1f3a3c-1e5d-49ef-8cb1-3393c10ee6ea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:21.847773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b1f3a3c-1e5d-49ef-8cb1-3393c10ee6ea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:21.849057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b1f3a3c-1e5d-49ef-8cb1-3393c10ee6ea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:21.849706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b1f3a3c-1e5d-49ef-8cb1-3393c10ee6ea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:21.850325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b1f3a3c-1e5d-49ef-8cb1-3393c10ee6ea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:21.954369 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3b1f3a3c-1e5d-49ef-8cb1-3393c10ee6ea tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e/action" status: 200 len: 24564 microversion: 2.1 time: 0.163269 Aug 23 18:28:21.958039 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3256/6375] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:28:21 2022] POST /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e/action => generated 24564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:28:30.728801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b6f08f5-5064-4c0f-b5d1-cad61c3ba339 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:28:30.729334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4b6f08f5-5064-4c0f-b5d1-cad61c3ba339 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:30.732061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=14 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:28:30.733312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=42 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:28:30.739714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b6f08f5-5064-4c0f-b5d1-cad61c3ba339 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:30.740600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b6f08f5-5064-4c0f-b5d1-cad61c3ba339 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:30.740864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b6f08f5-5064-4c0f-b5d1-cad61c3ba339 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:30.741737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b6f08f5-5064-4c0f-b5d1-cad61c3ba339 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:30.742360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b6f08f5-5064-4c0f-b5d1-cad61c3ba339 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:30.742960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b6f08f5-5064-4c0f-b5d1-cad61c3ba339 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:30.885749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-4b6f08f5-5064-4c0f-b5d1-cad61c3ba339 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lazy-loading 'services' on Instance uuid 63d93d45-8056-49a9-8a4f-046259107b20 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:28:30.987331 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b6f08f5-5064-4c0f-b5d1-cad61c3ba339 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "DELETE /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20/os-volume_attachments/0a6d40a0-796d-4570-bd5f-e84803373a3e" status: 202 len: 0 microversion: 2.1 time: 0.260683 Aug 23 18:28:30.990599 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3120/6376] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 18:28:30 2022] DELETE /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20/os-volume_attachments/0a6d40a0-796d-4570-bd5f-e84803373a3e => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:28:37.657619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-40fffc9d-b23b-4f5e-b701-4111f5d65876 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:28:37.658405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-40fffc9d-b23b-4f5e-b701-4111f5d65876 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:37.665017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:28:37.665910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:28:37.668039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40fffc9d-b23b-4f5e-b701-4111f5d65876 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:37.668695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40fffc9d-b23b-4f5e-b701-4111f5d65876 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:37.669305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40fffc9d-b23b-4f5e-b701-4111f5d65876 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:37.670276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40fffc9d-b23b-4f5e-b701-4111f5d65876 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:37.670907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40fffc9d-b23b-4f5e-b701-4111f5d65876 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:37.671480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40fffc9d-b23b-4f5e-b701-4111f5d65876 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:37.701381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-40fffc9d-b23b-4f5e-b701-4111f5d65876 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:28:37.808811 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-40fffc9d-b23b-4f5e-b701-4111f5d65876 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "DELETE /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 204 len: 0 microversion: 2.1 time: 0.154876 Aug 23 18:28:37.813999 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3257/6377] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:28:37 2022] DELETE /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:28:37.821444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-042d4c2d-88a0-4ea7-b925-672edae74730 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:28:37.822073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-042d4c2d-88a0-4ea7-b925-672edae74730 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:37.837261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-042d4c2d-88a0-4ea7-b925-672edae74730 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:37.837759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-042d4c2d-88a0-4ea7-b925-672edae74730 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:37.838366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-042d4c2d-88a0-4ea7-b925-672edae74730 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:37.851487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-042d4c2d-88a0-4ea7-b925-672edae74730 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:37.855586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-042d4c2d-88a0-4ea7-b925-672edae74730 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:37.856282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-042d4c2d-88a0-4ea7-b925-672edae74730 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:38.131160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-042d4c2d-88a0-4ea7-b925-672edae74730 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:28:38.144635 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-042d4c2d-88a0-4ea7-b925-672edae74730 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1469 microversion: 2.1 time: 0.329535 Aug 23 18:28:38.146159 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3121/6378] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:28:37 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1469 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:28:38.434812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c9443ce4-4935-455a-9c46-3b12604bd9e8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:28:38.435424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c9443ce4-4935-455a-9c46-3b12604bd9e8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:38.444453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9443ce4-4935-455a-9c46-3b12604bd9e8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:38.445209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9443ce4-4935-455a-9c46-3b12604bd9e8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:38.446035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9443ce4-4935-455a-9c46-3b12604bd9e8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:38.447095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9443ce4-4935-455a-9c46-3b12604bd9e8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:38.447702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9443ce4-4935-455a-9c46-3b12604bd9e8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:38.448277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9443ce4-4935-455a-9c46-3b12604bd9e8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:38.490065 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c9443ce4-4935-455a-9c46-3b12604bd9e8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/ips" status: 200 len: 146 microversion: 2.1 time: 0.060344 Aug 23 18:28:38.491195 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3258/6379] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:28:38 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/ips => generated 146 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:28:39.168614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d43f382-e511-463c-9b01-6c7fc9be0257 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:28:39.170398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d43f382-e511-463c-9b01-6c7fc9be0257 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:39.181349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d43f382-e511-463c-9b01-6c7fc9be0257 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:39.182259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d43f382-e511-463c-9b01-6c7fc9be0257 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:39.183167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d43f382-e511-463c-9b01-6c7fc9be0257 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:39.185658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d43f382-e511-463c-9b01-6c7fc9be0257 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:39.186850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d43f382-e511-463c-9b01-6c7fc9be0257 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:39.187518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d43f382-e511-463c-9b01-6c7fc9be0257 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:39.636872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7d43f382-e511-463c-9b01-6c7fc9be0257 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:28:39.650008 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d43f382-e511-463c-9b01-6c7fc9be0257 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1469 microversion: 2.1 time: 0.486733 Aug 23 18:28:39.669843 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3122/6380] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:28:39 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1469 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:28:40.677062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c3ae82d-3868-49be-9032-08f696fac122 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:28:40.677829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1c3ae82d-3868-49be-9032-08f696fac122 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:40.694255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c3ae82d-3868-49be-9032-08f696fac122 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:40.694797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c3ae82d-3868-49be-9032-08f696fac122 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:40.695237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c3ae82d-3868-49be-9032-08f696fac122 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:40.695964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c3ae82d-3868-49be-9032-08f696fac122 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:40.696422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c3ae82d-3868-49be-9032-08f696fac122 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:40.699293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c3ae82d-3868-49be-9032-08f696fac122 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:41.388284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c3ae82d-3868-49be-9032-08f696fac122 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5b260843fd704dc28e03f49d3947c70d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5156de194d694b16b77ae539f8d79fd3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:28:41.402588 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c3ae82d-3868-49be-9032-08f696fac122 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 200 len: 1469 microversion: 2.1 time: 0.732389 Aug 23 18:28:41.403407 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3259/6381] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:28:40 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 1469 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:28:41.490445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1cc3a690-2253-408a-8dc0-d3793bca5e10 req-df1b8dbf-ad65-4988-a732-4000e3cd7ce6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63d93d45-8056-49a9-8a4f-046259107b20", "name": "network-vif-deleted", "tag": "e28c4dff-9b53-4d86-a5b1-a16ec1a2ffaa"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:28:41.520260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1cc3a690-2253-408a-8dc0-d3793bca5e10 req-df1b8dbf-ad65-4988-a732-4000e3cd7ce6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:41.521159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1cc3a690-2253-408a-8dc0-d3793bca5e10 req-df1b8dbf-ad65-4988-a732-4000e3cd7ce6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:41.522000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1cc3a690-2253-408a-8dc0-d3793bca5e10 req-df1b8dbf-ad65-4988-a732-4000e3cd7ce6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:41.543549 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1cc3a690-2253-408a-8dc0-d3793bca5e10 req-df1b8dbf-ad65-4988-a732-4000e3cd7ce6 service nova] Creating event network-vif-deleted:e28c4dff-9b53-4d86-a5b1-a16ec1a2ffaa for instance 63d93d45-8056-49a9-8a4f-046259107b20 on n-h2-850468-16 Aug 23 18:28:41.551595 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1cc3a690-2253-408a-8dc0-d3793bca5e10 req-df1b8dbf-ad65-4988-a732-4000e3cd7ce6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066549 Aug 23 18:28:41.557080 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3123/6382] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:28:42.212403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-967c5835-e0c2-47ce-9102-a5d8a1c829ed tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "456ef606-0532-49c3-81c4-23d6acf66c22"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:28:42.224576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-967c5835-e0c2-47ce-9102-a5d8a1c829ed tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:42.237333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-967c5835-e0c2-47ce-9102-a5d8a1c829ed tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:42.244121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-967c5835-e0c2-47ce-9102-a5d8a1c829ed tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:42.244849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-967c5835-e0c2-47ce-9102-a5d8a1c829ed tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:42.245762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-967c5835-e0c2-47ce-9102-a5d8a1c829ed tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:42.246385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-967c5835-e0c2-47ce-9102-a5d8a1c829ed tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:42.247243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-967c5835-e0c2-47ce-9102-a5d8a1c829ed tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:42.428618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f2c9fb63-74fe-47a1-9e97-6ccdd0184861 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:28:42.434186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f2c9fb63-74fe-47a1-9e97-6ccdd0184861 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] [instance: 63d93d45-8056-49a9-8a4f-046259107b20] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:42.449861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c9fb63-74fe-47a1-9e97-6ccdd0184861 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:42.450440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c9fb63-74fe-47a1-9e97-6ccdd0184861 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:42.454895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c9fb63-74fe-47a1-9e97-6ccdd0184861 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:42.456871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c9fb63-74fe-47a1-9e97-6ccdd0184861 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:42.459533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c9fb63-74fe-47a1-9e97-6ccdd0184861 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:42.461955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c9fb63-74fe-47a1-9e97-6ccdd0184861 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:42.519284 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-f2c9fb63-74fe-47a1-9e97-6ccdd0184861 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] HTTP exception thrown: Instance 63d93d45-8056-49a9-8a4f-046259107b20 could not be found. Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f2c9fb63-74fe-47a1-9e97-6ccdd0184861 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Request method failure captured: Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 HTTP/1.1 Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRvsuSRwJ9uqbWBXox057QFj1LCIPUVazSFEsNKwZbh6elj_H5dUMHtccE2t1Q1viL53YTBfwrBR8qwTzBCrgRas06JCUWf4qYGmnkbC2356AyxKJ_fIlYODDMHOcWq3zXXROIaoo4MUlCrE7qeh2e1mExdhxAsvMPUqdymm1xPFrW0 Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 5156de194d694b16b77ae539f8d79fd3 Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-VolumesBackupsTest-603524899 Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_5156de194d694b16b77ae539f8d79fd3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5156de194d694b16b77ae539f8d79fd3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/5156de194d694b16b77ae539f8d79fd3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/5156de194d694b16b77ae539f8d79fd3"}]}] Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-VolumesBackupsTest-603524899 Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 5156de194d694b16b77ae539f8d79fd3 Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-VolumesBackupsTest-603524899 Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-VolumesBackupsTest-603524899-project Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 5b260843fd704dc28e03f49d3947c70d Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-VolumesBackupsTest-603524899-project Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 63d93d45-8056-49a9-8a4f-046259107b20 could not be found. Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '63d93d45-8056-49a9-8a4f-046259107b20'} Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63d93d45-8056-49a9-8a4f-046259107b20 could not be found. Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63d93d45-8056-49a9-8a4f-046259107b20 could not be found. Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:28:42.528116 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:28:42.531826 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:28:42.531826 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:28:42.531826 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:28:42.531826 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:28:42.531826 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:28:42.531826 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63d93d45-8056-49a9-8a4f-046259107b20 could not be found. Aug 23 18:28:42.531826 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:28:42.534314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f2c9fb63-74fe-47a1-9e97-6ccdd0184861 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] Returning 404 to user: Instance 63d93d45-8056-49a9-8a4f-046259107b20 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:28:42.535522 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f2c9fb63-74fe-47a1-9e97-6ccdd0184861 tempest-VolumesBackupsTest-603524899 tempest-VolumesBackupsTest-603524899-project] 10.222.0.61 "GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20" status: 404 len: 111 microversion: 2.1 time: 0.113599 Aug 23 18:28:42.537106 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3124/6383] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:28:42 2022] GET /compute/v2.1/servers/63d93d45-8056-49a9-8a4f-046259107b20 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:28:42.821660 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-967c5835-e0c2-47ce-9102-a5d8a1c829ed tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "POST /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.616351 Aug 23 18:28:42.822292 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3260/6384] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:28:42 2022] POST /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:28:56.977887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=10 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:28:56.979018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=25,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:28:57.409414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-54669343-0a73-4743-b3df-b2a21d936350 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:28:57.410819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-54669343-0a73-4743-b3df-b2a21d936350 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:57.418579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54669343-0a73-4743-b3df-b2a21d936350 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:57.419327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54669343-0a73-4743-b3df-b2a21d936350 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:57.419982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54669343-0a73-4743-b3df-b2a21d936350 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:57.420971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54669343-0a73-4743-b3df-b2a21d936350 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:57.421842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54669343-0a73-4743-b3df-b2a21d936350 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:57.423411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54669343-0a73-4743-b3df-b2a21d936350 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:57.471883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-54669343-0a73-4743-b3df-b2a21d936350 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:28:57.620449 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-54669343-0a73-4743-b3df-b2a21d936350 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "DELETE /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 204 len: 0 microversion: 2.1 time: 0.651943 Aug 23 18:28:57.620970 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3125/6385] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:28:56 2022] DELETE /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:28:57.631396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:28:57.632895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:28:57.643706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e1a6844d-6d76-4d56-a5ec-57b6020faa41 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:28:57.645778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e1a6844d-6d76-4d56-a5ec-57b6020faa41 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:57.661344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1a6844d-6d76-4d56-a5ec-57b6020faa41 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:57.664525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1a6844d-6d76-4d56-a5ec-57b6020faa41 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:57.667580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1a6844d-6d76-4d56-a5ec-57b6020faa41 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:57.668514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1a6844d-6d76-4d56-a5ec-57b6020faa41 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:57.668967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1a6844d-6d76-4d56-a5ec-57b6020faa41 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:57.670919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1a6844d-6d76-4d56-a5ec-57b6020faa41 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:57.882598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e1a6844d-6d76-4d56-a5ec-57b6020faa41 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:28:57.891685 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e1a6844d-6d76-4d56-a5ec-57b6020faa41 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1732 microversion: 2.1 time: 0.264576 Aug 23 18:28:57.904207 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3261/6386] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:28:57 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1732 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:28:58.325530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e44d57d-8f99-47ff-b881-453bfab2790f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:28:58.336621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e44d57d-8f99-47ff-b881-453bfab2790f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:58.338788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e44d57d-8f99-47ff-b881-453bfab2790f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:58.340729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e44d57d-8f99-47ff-b881-453bfab2790f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:58.414526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2e44d57d-8f99-47ff-b881-453bfab2790f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Going to try to stop instance {{(pid=128807) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 18:28:58.540059 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e44d57d-8f99-47ff-b881-453bfab2790f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "POST /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/action" status: 202 len: 0 microversion: 2.1 time: 0.223638 Aug 23 18:28:58.545651 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3126/6387] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:28:58 2022] POST /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/action => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:28:58.551952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0fb68b63-9099-41a8-8cb3-6ce79fe90904 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:28:58.552584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0fb68b63-9099-41a8-8cb3-6ce79fe90904 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:58.569415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fb68b63-9099-41a8-8cb3-6ce79fe90904 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:58.569934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fb68b63-9099-41a8-8cb3-6ce79fe90904 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:58.570958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fb68b63-9099-41a8-8cb3-6ce79fe90904 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:58.594916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fb68b63-9099-41a8-8cb3-6ce79fe90904 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:58.600343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fb68b63-9099-41a8-8cb3-6ce79fe90904 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:58.603284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fb68b63-9099-41a8-8cb3-6ce79fe90904 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:58.914494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d5aa946b-2d2e-4ba9-8aff-c65c75b8f02f tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:28:58.915272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d5aa946b-2d2e-4ba9-8aff-c65c75b8f02f tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:28:58.926045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa946b-2d2e-4ba9-8aff-c65c75b8f02f tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:58.926571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa946b-2d2e-4ba9-8aff-c65c75b8f02f tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:58.931911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa946b-2d2e-4ba9-8aff-c65c75b8f02f tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:58.934189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa946b-2d2e-4ba9-8aff-c65c75b8f02f tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:28:58.936951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa946b-2d2e-4ba9-8aff-c65c75b8f02f tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:28:58.938153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d5aa946b-2d2e-4ba9-8aff-c65c75b8f02f tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:28:59.009078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0fb68b63-9099-41a8-8cb3-6ce79fe90904 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:28:59.023813 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0fb68b63-9099-41a8-8cb3-6ce79fe90904 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1725 microversion: 2.1 time: 0.476914 Aug 23 18:28:59.024597 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3262/6388] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:28:58 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1725 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:28:59.683986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d5aa946b-2d2e-4ba9-8aff-c65c75b8f02f tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:28:59.698601 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d5aa946b-2d2e-4ba9-8aff-c65c75b8f02f tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1732 microversion: 2.1 time: 0.788486 Aug 23 18:28:59.699817 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3127/6389] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:28:58 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1732 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:00.049127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d6c4c342-6be8-47d4-b4c2-b9d22e7a21a5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:00.049866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d6c4c342-6be8-47d4-b4c2-b9d22e7a21a5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:00.061923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6c4c342-6be8-47d4-b4c2-b9d22e7a21a5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:00.062446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6c4c342-6be8-47d4-b4c2-b9d22e7a21a5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:00.063594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6c4c342-6be8-47d4-b4c2-b9d22e7a21a5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:00.066773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6c4c342-6be8-47d4-b4c2-b9d22e7a21a5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:00.067264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6c4c342-6be8-47d4-b4c2-b9d22e7a21a5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:00.067718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6c4c342-6be8-47d4-b4c2-b9d22e7a21a5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:00.365437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d6c4c342-6be8-47d4-b4c2-b9d22e7a21a5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:00.376942 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d6c4c342-6be8-47d4-b4c2-b9d22e7a21a5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1725 microversion: 2.1 time: 0.332822 Aug 23 18:29:00.377553 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3263/6390] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:00 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1725 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:00.738235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c6858f6f-ab32-4077-8dd1-770720fdc201 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:00.740040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c6858f6f-ab32-4077-8dd1-770720fdc201 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:00.755466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6858f6f-ab32-4077-8dd1-770720fdc201 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:00.756285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6858f6f-ab32-4077-8dd1-770720fdc201 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:00.758075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6858f6f-ab32-4077-8dd1-770720fdc201 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:00.759105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6858f6f-ab32-4077-8dd1-770720fdc201 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:00.761880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6858f6f-ab32-4077-8dd1-770720fdc201 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:00.762591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6858f6f-ab32-4077-8dd1-770720fdc201 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:00.972209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c6858f6f-ab32-4077-8dd1-770720fdc201 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:00.986264 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c6858f6f-ab32-4077-8dd1-770720fdc201 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1664 microversion: 2.1 time: 0.252753 Aug 23 18:29:00.988458 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3128/6391] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:00 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1664 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:01.399330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fb1dbfec-0c8e-4bd9-a17f-e9561fd5bcde tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:01.400675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fb1dbfec-0c8e-4bd9-a17f-e9561fd5bcde tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:01.462473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb1dbfec-0c8e-4bd9-a17f-e9561fd5bcde tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:01.467151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb1dbfec-0c8e-4bd9-a17f-e9561fd5bcde tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:01.469515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb1dbfec-0c8e-4bd9-a17f-e9561fd5bcde tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:01.478369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb1dbfec-0c8e-4bd9-a17f-e9561fd5bcde tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:01.481484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb1dbfec-0c8e-4bd9-a17f-e9561fd5bcde tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:01.484216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb1dbfec-0c8e-4bd9-a17f-e9561fd5bcde tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:01.585761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ed4bebb5-0cc8-413e-8088-5a7eb7b8b182 req-b98c6d74-e364-4dfb-99b2-f0b9a250b4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "182272d5-4238-47d7-917f-f604b24bd05f", "name": "network-vif-deleted", "tag": "096e329a-9de7-409c-8a71-48b0df191e5b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:29:01.628875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed4bebb5-0cc8-413e-8088-5a7eb7b8b182 req-b98c6d74-e364-4dfb-99b2-f0b9a250b4bf service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:01.631450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed4bebb5-0cc8-413e-8088-5a7eb7b8b182 req-b98c6d74-e364-4dfb-99b2-f0b9a250b4bf service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:01.633454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed4bebb5-0cc8-413e-8088-5a7eb7b8b182 req-b98c6d74-e364-4dfb-99b2-f0b9a250b4bf service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:01.682685 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ed4bebb5-0cc8-413e-8088-5a7eb7b8b182 req-b98c6d74-e364-4dfb-99b2-f0b9a250b4bf service nova] Creating event network-vif-deleted:096e329a-9de7-409c-8a71-48b0df191e5b for instance 182272d5-4238-47d7-917f-f604b24bd05f on n-h2-850468-16 Aug 23 18:29:01.701840 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ed4bebb5-0cc8-413e-8088-5a7eb7b8b182 req-b98c6d74-e364-4dfb-99b2-f0b9a250b4bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115722 Aug 23 18:29:01.704579 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3129/6392] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:29:01.921265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb1dbfec-0c8e-4bd9-a17f-e9561fd5bcde tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:01.933204 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fb1dbfec-0c8e-4bd9-a17f-e9561fd5bcde tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1725 microversion: 2.1 time: 0.538499 Aug 23 18:29:01.934391 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3264/6393] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:01 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1725 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:02.014116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:02.016217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:02.025780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:02.026564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:02.027192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:02.028092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:02.028742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:02.029360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:02.069743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:02.070480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:02.071106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:02.071720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lazy-loading 'fault' on Instance uuid 182272d5-4238-47d7-917f-f604b24bd05f {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:29:02.386566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32d1459e5c8a414f940b09614fab6dd7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e43a78b2cc5437c9eb2f1bb02b6465c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:02.397960 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dc40df44-7366-4d47-b1c3-322cb92b71e5 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 200 len: 1388 microversion: 2.1 time: 0.388143 Aug 23 18:29:02.399376 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3130/6394] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:02 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 1388 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:02.958364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-02c96db8-701e-4ebe-a00c-7d18944fc852 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:02.959009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-02c96db8-701e-4ebe-a00c-7d18944fc852 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:02.966833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02c96db8-701e-4ebe-a00c-7d18944fc852 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:02.967851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02c96db8-701e-4ebe-a00c-7d18944fc852 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:02.968512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02c96db8-701e-4ebe-a00c-7d18944fc852 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:02.969892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02c96db8-701e-4ebe-a00c-7d18944fc852 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:02.970529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02c96db8-701e-4ebe-a00c-7d18944fc852 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:02.971269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02c96db8-701e-4ebe-a00c-7d18944fc852 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:03.136279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-02c96db8-701e-4ebe-a00c-7d18944fc852 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:03.146762 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-02c96db8-701e-4ebe-a00c-7d18944fc852 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1725 microversion: 2.1 time: 0.193296 Aug 23 18:29:03.147683 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3265/6395] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:02 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:03.425129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ad741e06-a4aa-455a-8213-70a4e4cdb4d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:03.425913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ad741e06-a4aa-455a-8213-70a4e4cdb4d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:03.434756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad741e06-a4aa-455a-8213-70a4e4cdb4d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:03.435569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad741e06-a4aa-455a-8213-70a4e4cdb4d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:03.436233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad741e06-a4aa-455a-8213-70a4e4cdb4d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:03.438558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad741e06-a4aa-455a-8213-70a4e4cdb4d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:03.440378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad741e06-a4aa-455a-8213-70a4e4cdb4d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:03.441042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad741e06-a4aa-455a-8213-70a4e4cdb4d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:03.461062 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-ad741e06-a4aa-455a-8213-70a4e4cdb4d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] HTTP exception thrown: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ad741e06-a4aa-455a-8213-70a4e4cdb4d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Request method failure captured: Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f HTTP/1.1 Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRsHqesdk-OCgsintjBvBNwr3IcJmfAnLPPGUY69iYyAT3RQYP3b2fa3F9CA6kjR48U88ksTehq_k0B0EmaxdP9bfryDC8ZmGblgtBzrE9szWy0s8YwCKTZ1R4SF6dD8y37xrcm5tvm46qipqpFSRrO8IkPi_KZ6y4Xilj84BKGBqro Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 3e43a78b2cc5437c9eb2f1bb02b6465c Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestServerBasicOps-1683757821 Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3e43a78b2cc5437c9eb2f1bb02b6465c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3e43a78b2cc5437c9eb2f1bb02b6465c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3e43a78b2cc5437c9eb2f1bb02b6465c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3e43a78b2cc5437c9eb2f1bb02b6465c"}]}] Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestServerBasicOps-1683757821 Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 3e43a78b2cc5437c9eb2f1bb02b6465c Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestServerBasicOps-1683757821 Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestServerBasicOps-1683757821-project Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 32d1459e5c8a414f940b09614fab6dd7 Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestServerBasicOps-1683757821-project Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '182272d5-4238-47d7-917f-f604b24bd05f'} Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:29:03.463027 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:03.467406 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:29:03.467406 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:29:03.467406 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:29:03.467406 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:29:03.467406 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:29:03.467406 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:03.467406 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:03.468523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ad741e06-a4aa-455a-8213-70a4e4cdb4d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Returning 404 to user: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:29:03.470092 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ad741e06-a4aa-455a-8213-70a4e4cdb4d7 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 404 len: 111 microversion: 2.1 time: 0.052699 Aug 23 18:29:03.471018 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3131/6396] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:03 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:29:04.169116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-07a9f7ec-f707-41a2-8e97-af535d816f0a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:04.172038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-07a9f7ec-f707-41a2-8e97-af535d816f0a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:04.183471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07a9f7ec-f707-41a2-8e97-af535d816f0a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:04.188111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07a9f7ec-f707-41a2-8e97-af535d816f0a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:04.190028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07a9f7ec-f707-41a2-8e97-af535d816f0a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:04.191168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07a9f7ec-f707-41a2-8e97-af535d816f0a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:04.192072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07a9f7ec-f707-41a2-8e97-af535d816f0a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:04.192900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07a9f7ec-f707-41a2-8e97-af535d816f0a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:04.308121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ce37284-7231-4aaf-a48c-cf37c29b5cee tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:04.308627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1ce37284-7231-4aaf-a48c-cf37c29b5cee tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:04.315485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce37284-7231-4aaf-a48c-cf37c29b5cee tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:04.315985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce37284-7231-4aaf-a48c-cf37c29b5cee tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:04.316428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce37284-7231-4aaf-a48c-cf37c29b5cee tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:04.317140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce37284-7231-4aaf-a48c-cf37c29b5cee tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:04.317601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce37284-7231-4aaf-a48c-cf37c29b5cee tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:04.318030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ce37284-7231-4aaf-a48c-cf37c29b5cee tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:04.333080 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-1ce37284-7231-4aaf-a48c-cf37c29b5cee tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] HTTP exception thrown: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ce37284-7231-4aaf-a48c-cf37c29b5cee tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Request method failure captured: Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f HTTP/1.1 Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRsHqesdk-OCgsintjBvBNwr3IcJmfAnLPPGUY69iYyAT3RQYP3b2fa3F9CA6kjR48U88ksTehq_k0B0EmaxdP9bfryDC8ZmGblgtBzrE9szWy0s8YwCKTZ1R4SF6dD8y37xrcm5tvm46qipqpFSRrO8IkPi_KZ6y4Xilj84BKGBqro Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 3e43a78b2cc5437c9eb2f1bb02b6465c Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestServerBasicOps-1683757821 Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3e43a78b2cc5437c9eb2f1bb02b6465c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3e43a78b2cc5437c9eb2f1bb02b6465c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3e43a78b2cc5437c9eb2f1bb02b6465c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3e43a78b2cc5437c9eb2f1bb02b6465c"}]}] Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestServerBasicOps-1683757821 Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 3e43a78b2cc5437c9eb2f1bb02b6465c Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestServerBasicOps-1683757821 Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestServerBasicOps-1683757821-project Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 32d1459e5c8a414f940b09614fab6dd7 Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestServerBasicOps-1683757821-project Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '182272d5-4238-47d7-917f-f604b24bd05f'} Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:29:04.336504 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:29:04.340653 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:04.340653 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:04.340653 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:29:04.340653 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:04.340653 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:29:04.340653 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:29:04.340653 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:29:04.340653 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:29:04.340653 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:29:04.340653 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:04.340653 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:04.342086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ce37284-7231-4aaf-a48c-cf37c29b5cee tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Returning 404 to user: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:29:04.343307 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1ce37284-7231-4aaf-a48c-cf37c29b5cee tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "DELETE /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 404 len: 111 microversion: 2.1 time: 0.039200 Aug 23 18:29:04.345402 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3132/6397] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:29:04 2022] DELETE /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:29:04.354023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9f066064-e88b-4177-b0a5-7d713b348ee3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:04.355202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9f066064-e88b-4177-b0a5-7d713b348ee3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] [instance: 182272d5-4238-47d7-917f-f604b24bd05f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:04.364883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f066064-e88b-4177-b0a5-7d713b348ee3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:04.365761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f066064-e88b-4177-b0a5-7d713b348ee3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:04.366379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f066064-e88b-4177-b0a5-7d713b348ee3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:04.367481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f066064-e88b-4177-b0a5-7d713b348ee3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:04.368091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f066064-e88b-4177-b0a5-7d713b348ee3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:04.368669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f066064-e88b-4177-b0a5-7d713b348ee3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:04.376193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-07a9f7ec-f707-41a2-8e97-af535d816f0a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:04.386606 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-07a9f7ec-f707-41a2-8e97-af535d816f0a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1725 microversion: 2.1 time: 0.221294 Aug 23 18:29:04.392563 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-9f066064-e88b-4177-b0a5-7d713b348ee3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] HTTP exception thrown: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9f066064-e88b-4177-b0a5-7d713b348ee3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Request method failure captured: Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f HTTP/1.1 Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRsHqesdk-OCgsintjBvBNwr3IcJmfAnLPPGUY69iYyAT3RQYP3b2fa3F9CA6kjR48U88ksTehq_k0B0EmaxdP9bfryDC8ZmGblgtBzrE9szWy0s8YwCKTZ1R4SF6dD8y37xrcm5tvm46qipqpFSRrO8IkPi_KZ6y4Xilj84BKGBqro Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 3e43a78b2cc5437c9eb2f1bb02b6465c Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestServerBasicOps-1683757821 Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_3e43a78b2cc5437c9eb2f1bb02b6465c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3e43a78b2cc5437c9eb2f1bb02b6465c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/3e43a78b2cc5437c9eb2f1bb02b6465c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/3e43a78b2cc5437c9eb2f1bb02b6465c"}]}] Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestServerBasicOps-1683757821 Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 3e43a78b2cc5437c9eb2f1bb02b6465c Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestServerBasicOps-1683757821 Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestServerBasicOps-1683757821-project Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 32d1459e5c8a414f940b09614fab6dd7 Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestServerBasicOps-1683757821-project Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '182272d5-4238-47d7-917f-f604b24bd05f'} Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:29:04.394589 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:04.398420 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:29:04.398420 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:29:04.398420 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:29:04.398420 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:29:04.398420 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:29:04.398420 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. Aug 23 18:29:04.398420 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:29:04.399425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9f066064-e88b-4177-b0a5-7d713b348ee3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Returning 404 to user: Instance 182272d5-4238-47d7-917f-f604b24bd05f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:29:04.400436 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9f066064-e88b-4177-b0a5-7d713b348ee3 tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f" status: 404 len: 111 microversion: 2.1 time: 0.051008 Aug 23 18:29:04.400667 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3266/6398] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:04 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1725 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:04.401301 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3133/6399] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:04 2022] GET /compute/v2.1/servers/182272d5-4238-47d7-917f-f604b24bd05f => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:29:04.586408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-689090af-1339-4df6-a494-928ea12dafda tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] Calling method '.version_select at 0x7f27ec0758b0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:04.618138 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-689090af-1339-4df6-a494-928ea12dafda tempest-TestServerBasicOps-1683757821 tempest-TestServerBasicOps-1683757821-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1858637466" status: 202 len: 0 microversion: 2.1 time: 0.034650 Aug 23 18:29:04.621790 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3267/6400] 10.222.0.61 () {58 vars in 1254 bytes} [Tue Aug 23 18:29:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-1858637466 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:29:05.408686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf73f31d-a922-49b1-ac33-0d4d1063d59d tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:05.409986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf73f31d-a922-49b1-ac33-0d4d1063d59d tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:05.417249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf73f31d-a922-49b1-ac33-0d4d1063d59d tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:05.417993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf73f31d-a922-49b1-ac33-0d4d1063d59d tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:05.418647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf73f31d-a922-49b1-ac33-0d4d1063d59d tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:05.419549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf73f31d-a922-49b1-ac33-0d4d1063d59d tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:05.420009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf73f31d-a922-49b1-ac33-0d4d1063d59d tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:05.420603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf73f31d-a922-49b1-ac33-0d4d1063d59d tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:05.681049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf73f31d-a922-49b1-ac33-0d4d1063d59d tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:05.692585 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf73f31d-a922-49b1-ac33-0d4d1063d59d tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1725 microversion: 2.1 time: 0.288329 Aug 23 18:29:05.693681 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3134/6401] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:05 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1725 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:06.715148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3c4a5294-8272-4361-8836-de28c4aab53a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:06.716042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3c4a5294-8272-4361-8836-de28c4aab53a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:06.724857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c4a5294-8272-4361-8836-de28c4aab53a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:06.725572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c4a5294-8272-4361-8836-de28c4aab53a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:06.726182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c4a5294-8272-4361-8836-de28c4aab53a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:06.727096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c4a5294-8272-4361-8836-de28c4aab53a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:06.727730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c4a5294-8272-4361-8836-de28c4aab53a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:06.728317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c4a5294-8272-4361-8836-de28c4aab53a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:06.990703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3c4a5294-8272-4361-8836-de28c4aab53a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:07.004050 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3c4a5294-8272-4361-8836-de28c4aab53a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1725 microversion: 2.1 time: 0.292140 Aug 23 18:29:07.007173 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3268/6402] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:06 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1725 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:08.035667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a29f4cf4-e4a0-4dfa-9402-ae30236de22c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:08.036881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a29f4cf4-e4a0-4dfa-9402-ae30236de22c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:08.049891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a29f4cf4-e4a0-4dfa-9402-ae30236de22c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:08.051944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a29f4cf4-e4a0-4dfa-9402-ae30236de22c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:08.052640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a29f4cf4-e4a0-4dfa-9402-ae30236de22c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:08.054736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a29f4cf4-e4a0-4dfa-9402-ae30236de22c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:08.056086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a29f4cf4-e4a0-4dfa-9402-ae30236de22c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:08.057006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a29f4cf4-e4a0-4dfa-9402-ae30236de22c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:08.337042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a29f4cf4-e4a0-4dfa-9402-ae30236de22c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:08.350303 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a29f4cf4-e4a0-4dfa-9402-ae30236de22c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1725 microversion: 2.1 time: 0.319954 Aug 23 18:29:08.357969 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3135/6403] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:08 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1725 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:09.388514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-47847aa7-8318-477f-abfb-f7f69be55e65 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:09.390142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-47847aa7-8318-477f-abfb-f7f69be55e65 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:09.426144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47847aa7-8318-477f-abfb-f7f69be55e65 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:09.428472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47847aa7-8318-477f-abfb-f7f69be55e65 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:09.429159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47847aa7-8318-477f-abfb-f7f69be55e65 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:09.430575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47847aa7-8318-477f-abfb-f7f69be55e65 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:09.431247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47847aa7-8318-477f-abfb-f7f69be55e65 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:09.431883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-47847aa7-8318-477f-abfb-f7f69be55e65 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:09.783437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-47847aa7-8318-477f-abfb-f7f69be55e65 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:09.815761 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-47847aa7-8318-477f-abfb-f7f69be55e65 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1725 microversion: 2.1 time: 0.434257 Aug 23 18:29:09.817997 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3269/6404] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:09 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1725 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:10.841720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-19a9a84a-bacf-4cd2-b844-bbc19b6474f6 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:10.846142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-19a9a84a-bacf-4cd2-b844-bbc19b6474f6 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:10.856969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19a9a84a-bacf-4cd2-b844-bbc19b6474f6 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:10.862940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19a9a84a-bacf-4cd2-b844-bbc19b6474f6 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:10.864229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19a9a84a-bacf-4cd2-b844-bbc19b6474f6 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:10.865104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-237e241a-6217-40ac-9c29-a8a0242679d0 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:10.865777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-237e241a-6217-40ac-9c29-a8a0242679d0 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:10.866845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19a9a84a-bacf-4cd2-b844-bbc19b6474f6 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:10.868429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19a9a84a-bacf-4cd2-b844-bbc19b6474f6 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:10.869215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-19a9a84a-bacf-4cd2-b844-bbc19b6474f6 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:10.880419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-237e241a-6217-40ac-9c29-a8a0242679d0 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:10.881217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-237e241a-6217-40ac-9c29-a8a0242679d0 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:10.881978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-237e241a-6217-40ac-9c29-a8a0242679d0 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:10.882952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-237e241a-6217-40ac-9c29-a8a0242679d0 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:10.883571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-237e241a-6217-40ac-9c29-a8a0242679d0 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:10.884272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-237e241a-6217-40ac-9c29-a8a0242679d0 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:11.230714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-19a9a84a-bacf-4cd2-b844-bbc19b6474f6 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:11.241493 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-19a9a84a-bacf-4cd2-b844-bbc19b6474f6 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1725 microversion: 2.1 time: 0.407903 Aug 23 18:29:11.242087 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3270/6405] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:10 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1725 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:11.361793 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-237e241a-6217-40ac-9c29-a8a0242679d0 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1837 microversion: 2.1 time: 0.771502 Aug 23 18:29:11.362473 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3136/6406] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:10 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1837 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:11.739315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1af93415-0b23-4afc-911f-d3b7a25cc627 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:11.739953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1af93415-0b23-4afc-911f-d3b7a25cc627 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:11.746737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1af93415-0b23-4afc-911f-d3b7a25cc627 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:11.747441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1af93415-0b23-4afc-911f-d3b7a25cc627 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:11.747886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1af93415-0b23-4afc-911f-d3b7a25cc627 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:11.748592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1af93415-0b23-4afc-911f-d3b7a25cc627 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:11.749451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1af93415-0b23-4afc-911f-d3b7a25cc627 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:11.750716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1af93415-0b23-4afc-911f-d3b7a25cc627 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:12.065235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1af93415-0b23-4afc-911f-d3b7a25cc627 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:12.081344 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1af93415-0b23-4afc-911f-d3b7a25cc627 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1684 microversion: 2.1 time: 0.697807 Aug 23 18:29:12.113138 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3271/6407] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:11 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1684 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:12.267396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c895cf7-5ca4-4434-94ab-98cbed8c0bc8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:12.268108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0c895cf7-5ca4-4434-94ab-98cbed8c0bc8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:12.299753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c895cf7-5ca4-4434-94ab-98cbed8c0bc8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:12.301574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c895cf7-5ca4-4434-94ab-98cbed8c0bc8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:12.302398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c895cf7-5ca4-4434-94ab-98cbed8c0bc8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:12.304098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c895cf7-5ca4-4434-94ab-98cbed8c0bc8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:12.305743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c895cf7-5ca4-4434-94ab-98cbed8c0bc8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:12.308712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c895cf7-5ca4-4434-94ab-98cbed8c0bc8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:12.370614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-81217d3a-4db3-4cc2-8d27-d0c7c95212bb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:29:12.379820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-81217d3a-4db3-4cc2-8d27-d0c7c95212bb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:12.408173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81217d3a-4db3-4cc2-8d27-d0c7c95212bb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:12.408683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81217d3a-4db3-4cc2-8d27-d0c7c95212bb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:12.419454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81217d3a-4db3-4cc2-8d27-d0c7c95212bb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:12.420288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81217d3a-4db3-4cc2-8d27-d0c7c95212bb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:12.420782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81217d3a-4db3-4cc2-8d27-d0c7c95212bb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:12.428511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81217d3a-4db3-4cc2-8d27-d0c7c95212bb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:12.537706 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-81217d3a-4db3-4cc2-8d27-d0c7c95212bb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e/action" status: 200 len: 32640 microversion: 2.1 time: 0.179266 Aug 23 18:29:12.542764 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3272/6408] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:29:12 2022] POST /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e/action => generated 32640 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:29:12.698052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b772ba5c-aeca-4723-8e18-df250e993cf5 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:29:12.699401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b772ba5c-aeca-4723-8e18-df250e993cf5 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:12.708958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b772ba5c-aeca-4723-8e18-df250e993cf5 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:12.709808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b772ba5c-aeca-4723-8e18-df250e993cf5 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:12.711043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b772ba5c-aeca-4723-8e18-df250e993cf5 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:12.714245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b772ba5c-aeca-4723-8e18-df250e993cf5 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:12.714954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b772ba5c-aeca-4723-8e18-df250e993cf5 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:12.715772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b772ba5c-aeca-4723-8e18-df250e993cf5 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:12.852683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b772ba5c-aeca-4723-8e18-df250e993cf5 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'db500e0bbe1c4b75a1ad33de0ace5e51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95d4a02c3dc4ced91922808ed378ba0', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:12.853312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b772ba5c-aeca-4723-8e18-df250e993cf5 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] flavor_id is None. Assuming migration. {{(pid=128808) resize /opt/stack/nova/nova/compute/api.py:4181}} Aug 23 18:29:12.853763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b772ba5c-aeca-4723-8e18-df250e993cf5 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=128808) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 18:29:13.028299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0c895cf7-5ca4-4434-94ab-98cbed8c0bc8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:13.044916 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c895cf7-5ca4-4434-94ab-98cbed8c0bc8 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1725 microversion: 2.1 time: 0.784643 Aug 23 18:29:13.045807 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3137/6409] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:12 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1725 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:13.235074 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b772ba5c-aeca-4723-8e18-df250e993cf5 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e/action" status: 202 len: 0 microversion: 2.1 time: 0.546794 Aug 23 18:29:13.244894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41ca1211-a130-4abb-97a7-ad6f8a71855e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:13.245535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-41ca1211-a130-4abb-97a7-ad6f8a71855e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:13.249273 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3273/6410] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:29:12 2022] POST /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:29:13.258923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ca1211-a130-4abb-97a7-ad6f8a71855e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:13.261106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ca1211-a130-4abb-97a7-ad6f8a71855e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:13.263814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ca1211-a130-4abb-97a7-ad6f8a71855e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:13.264794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ca1211-a130-4abb-97a7-ad6f8a71855e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:13.267757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ca1211-a130-4abb-97a7-ad6f8a71855e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:13.268828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41ca1211-a130-4abb-97a7-ad6f8a71855e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:13.793134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41ca1211-a130-4abb-97a7-ad6f8a71855e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:13.817601 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-41ca1211-a130-4abb-97a7-ad6f8a71855e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1693 microversion: 2.1 time: 0.576310 Aug 23 18:29:13.819014 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3138/6411] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:13 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1693 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:14.069326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fa4d70ee-9917-4f36-9609-6be17b38bc7b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:14.070191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fa4d70ee-9917-4f36-9609-6be17b38bc7b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:14.093056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa4d70ee-9917-4f36-9609-6be17b38bc7b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:14.097816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa4d70ee-9917-4f36-9609-6be17b38bc7b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:14.100679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa4d70ee-9917-4f36-9609-6be17b38bc7b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:14.101622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa4d70ee-9917-4f36-9609-6be17b38bc7b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:14.102273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa4d70ee-9917-4f36-9609-6be17b38bc7b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:14.105552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa4d70ee-9917-4f36-9609-6be17b38bc7b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:14.512422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fa4d70ee-9917-4f36-9609-6be17b38bc7b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:14.522078 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fa4d70ee-9917-4f36-9609-6be17b38bc7b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1702 microversion: 2.1 time: 0.457154 Aug 23 18:29:14.527635 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3274/6412] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:14 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1702 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:14.555339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6aeeebf-2fc0-4225-ac97-008d9d82a94f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:29:14.574945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6aeeebf-2fc0-4225-ac97-008d9d82a94f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:14.575672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6aeeebf-2fc0-4225-ac97-008d9d82a94f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:14.576725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6aeeebf-2fc0-4225-ac97-008d9d82a94f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:14.611861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6aeeebf-2fc0-4225-ac97-008d9d82a94f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Going to try to start instance {{(pid=128807) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 18:29:14.695777 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6aeeebf-2fc0-4225-ac97-008d9d82a94f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "POST /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/action" status: 202 len: 0 microversion: 2.1 time: 0.145471 Aug 23 18:29:14.706815 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3139/6413] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:29:14 2022] POST /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/action => generated 0 bytes in 159 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:29:14.714821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5aef150d-c887-4745-a8f4-03b69388e099 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:14.715706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5aef150d-c887-4745-a8f4-03b69388e099 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:14.723245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aef150d-c887-4745-a8f4-03b69388e099 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:14.724358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aef150d-c887-4745-a8f4-03b69388e099 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:14.724358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aef150d-c887-4745-a8f4-03b69388e099 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:14.724876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aef150d-c887-4745-a8f4-03b69388e099 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:14.725455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aef150d-c887-4745-a8f4-03b69388e099 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:14.726058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aef150d-c887-4745-a8f4-03b69388e099 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:14.845280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c94e8e43-e493-4add-b3c1-0b3aeebedaed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:14.846028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c94e8e43-e493-4add-b3c1-0b3aeebedaed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:14.861147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c94e8e43-e493-4add-b3c1-0b3aeebedaed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:14.861997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c94e8e43-e493-4add-b3c1-0b3aeebedaed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:14.862885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c94e8e43-e493-4add-b3c1-0b3aeebedaed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:14.864794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c94e8e43-e493-4add-b3c1-0b3aeebedaed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:14.868203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c94e8e43-e493-4add-b3c1-0b3aeebedaed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:14.868857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c94e8e43-e493-4add-b3c1-0b3aeebedaed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:14.890754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:29:15.182644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5aef150d-c887-4745-a8f4-03b69388e099 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:15.199980 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5aef150d-c887-4745-a8f4-03b69388e099 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1711 microversion: 2.1 time: 0.489043 Aug 23 18:29:15.201699 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3275/6414] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:14 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1711 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:15.679858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c94e8e43-e493-4add-b3c1-0b3aeebedaed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:15.698791 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c94e8e43-e493-4add-b3c1-0b3aeebedaed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1693 microversion: 2.1 time: 0.858516 Aug 23 18:29:15.700490 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3140/6415] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:14 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1693 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:16.222915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-32ab7438-93c0-4c9c-b43a-12c430ae9ce2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:16.223551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-32ab7438-93c0-4c9c-b43a-12c430ae9ce2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:16.244076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32ab7438-93c0-4c9c-b43a-12c430ae9ce2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:16.244618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32ab7438-93c0-4c9c-b43a-12c430ae9ce2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:16.247307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32ab7438-93c0-4c9c-b43a-12c430ae9ce2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:16.252607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32ab7438-93c0-4c9c-b43a-12c430ae9ce2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:16.253153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32ab7438-93c0-4c9c-b43a-12c430ae9ce2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:16.254817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32ab7438-93c0-4c9c-b43a-12c430ae9ce2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:16.525361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-32ab7438-93c0-4c9c-b43a-12c430ae9ce2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:16.541458 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-32ab7438-93c0-4c9c-b43a-12c430ae9ce2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1711 microversion: 2.1 time: 0.323393 Aug 23 18:29:16.542942 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3276/6416] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:16 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1711 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:16.735336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d44499c-73f8-4ea9-ae19-18b8fc45b102 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:16.737021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d44499c-73f8-4ea9-ae19-18b8fc45b102 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:16.799258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d44499c-73f8-4ea9-ae19-18b8fc45b102 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:16.799775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d44499c-73f8-4ea9-ae19-18b8fc45b102 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:16.800225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d44499c-73f8-4ea9-ae19-18b8fc45b102 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:16.804153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d44499c-73f8-4ea9-ae19-18b8fc45b102 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:16.804640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d44499c-73f8-4ea9-ae19-18b8fc45b102 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:16.808848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d44499c-73f8-4ea9-ae19-18b8fc45b102 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:17.568487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c9ebad7c-d6db-4288-9f19-0ef33961c63a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:17.569905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c9ebad7c-d6db-4288-9f19-0ef33961c63a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:17.584878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9ebad7c-d6db-4288-9f19-0ef33961c63a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:17.585870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9ebad7c-d6db-4288-9f19-0ef33961c63a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:17.605080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9ebad7c-d6db-4288-9f19-0ef33961c63a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:17.610930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9ebad7c-d6db-4288-9f19-0ef33961c63a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:17.611396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9ebad7c-d6db-4288-9f19-0ef33961c63a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:17.611857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c9ebad7c-d6db-4288-9f19-0ef33961c63a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:17.616877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:29:17.680130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5d44499c-73f8-4ea9-ae19-18b8fc45b102 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:17.691131 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d44499c-73f8-4ea9-ae19-18b8fc45b102 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1693 microversion: 2.1 time: 0.968936 Aug 23 18:29:17.691738 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3141/6417] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:16 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1693 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:18.014071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c9ebad7c-d6db-4288-9f19-0ef33961c63a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:18.025611 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c9ebad7c-d6db-4288-9f19-0ef33961c63a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1711 microversion: 2.1 time: 0.463259 Aug 23 18:29:18.039523 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3277/6418] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:17 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1711 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:18.721153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3a7d8e46-304c-4501-8e0e-3214385ecb68 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:18.722034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3a7d8e46-304c-4501-8e0e-3214385ecb68 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:18.733216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a7d8e46-304c-4501-8e0e-3214385ecb68 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:18.733747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a7d8e46-304c-4501-8e0e-3214385ecb68 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:18.742807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a7d8e46-304c-4501-8e0e-3214385ecb68 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:18.743697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a7d8e46-304c-4501-8e0e-3214385ecb68 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:18.744184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a7d8e46-304c-4501-8e0e-3214385ecb68 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:18.744630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a7d8e46-304c-4501-8e0e-3214385ecb68 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:19.050351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-279fe63e-69fe-4601-9f98-1fdd44a71240 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:19.050994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-279fe63e-69fe-4601-9f98-1fdd44a71240 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:19.067873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-279fe63e-69fe-4601-9f98-1fdd44a71240 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:19.068698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-279fe63e-69fe-4601-9f98-1fdd44a71240 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:19.069496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-279fe63e-69fe-4601-9f98-1fdd44a71240 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:19.076581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-279fe63e-69fe-4601-9f98-1fdd44a71240 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:19.078311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-279fe63e-69fe-4601-9f98-1fdd44a71240 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:19.079392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-279fe63e-69fe-4601-9f98-1fdd44a71240 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:19.650880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3a7d8e46-304c-4501-8e0e-3214385ecb68 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:19.661589 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3a7d8e46-304c-4501-8e0e-3214385ecb68 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1693 microversion: 2.1 time: 0.945877 Aug 23 18:29:19.662906 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3142/6419] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:18 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1693 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:20.120309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-279fe63e-69fe-4601-9f98-1fdd44a71240 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:20.130719 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-279fe63e-69fe-4601-9f98-1fdd44a71240 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1715 microversion: 2.1 time: 1.085130 Aug 23 18:29:20.132378 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3278/6420] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:19 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1715 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:20.689781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ac0e0bd3-5439-481c-a183-5ef918772131 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:20.691267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ac0e0bd3-5439-481c-a183-5ef918772131 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:20.708139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac0e0bd3-5439-481c-a183-5ef918772131 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:20.708650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac0e0bd3-5439-481c-a183-5ef918772131 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:20.709103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac0e0bd3-5439-481c-a183-5ef918772131 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:20.714248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac0e0bd3-5439-481c-a183-5ef918772131 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:20.714768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac0e0bd3-5439-481c-a183-5ef918772131 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:20.718896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac0e0bd3-5439-481c-a183-5ef918772131 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:21.258107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ac0e0bd3-5439-481c-a183-5ef918772131 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:21.272990 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ac0e0bd3-5439-481c-a183-5ef918772131 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1693 microversion: 2.1 time: 0.592192 Aug 23 18:29:21.273794 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3143/6421] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:20 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1693 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:21.829454 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:29:21.831111 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 18:29:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:29:22.295503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d02f0bb9-7c68-4c43-ab62-c5f5730bcc60 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:22.296152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d02f0bb9-7c68-4c43-ab62-c5f5730bcc60 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:22.315452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d02f0bb9-7c68-4c43-ab62-c5f5730bcc60 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:22.316189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d02f0bb9-7c68-4c43-ab62-c5f5730bcc60 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:22.316794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d02f0bb9-7c68-4c43-ab62-c5f5730bcc60 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:22.317672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d02f0bb9-7c68-4c43-ab62-c5f5730bcc60 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:22.318280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d02f0bb9-7c68-4c43-ab62-c5f5730bcc60 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:22.318923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d02f0bb9-7c68-4c43-ab62-c5f5730bcc60 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:22.769386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d02f0bb9-7c68-4c43-ab62-c5f5730bcc60 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:22.780073 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d02f0bb9-7c68-4c43-ab62-c5f5730bcc60 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1698 microversion: 2.1 time: 0.487918 Aug 23 18:29:22.782224 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3279/6422] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:22 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1698 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:23.804224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f08e185c-6ff2-43d9-a43e-44745277a082 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:23.804857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f08e185c-6ff2-43d9-a43e-44745277a082 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:23.812328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f08e185c-6ff2-43d9-a43e-44745277a082 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:23.814413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f08e185c-6ff2-43d9-a43e-44745277a082 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:23.815072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f08e185c-6ff2-43d9-a43e-44745277a082 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:23.815964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f08e185c-6ff2-43d9-a43e-44745277a082 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:23.816577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f08e185c-6ff2-43d9-a43e-44745277a082 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:23.817166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f08e185c-6ff2-43d9-a43e-44745277a082 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:24.261324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f08e185c-6ff2-43d9-a43e-44745277a082 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:24.277878 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f08e185c-6ff2-43d9-a43e-44745277a082 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1698 microversion: 2.1 time: 0.477917 Aug 23 18:29:24.279165 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3144/6423] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:23 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1698 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:25.301932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-21733d69-e2fc-44ce-9a8a-3acb094a7785 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:25.303140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-21733d69-e2fc-44ce-9a8a-3acb094a7785 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:25.319754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21733d69-e2fc-44ce-9a8a-3acb094a7785 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:25.322679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21733d69-e2fc-44ce-9a8a-3acb094a7785 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:25.331368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21733d69-e2fc-44ce-9a8a-3acb094a7785 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:25.332437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21733d69-e2fc-44ce-9a8a-3acb094a7785 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:25.333275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21733d69-e2fc-44ce-9a8a-3acb094a7785 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:25.333890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21733d69-e2fc-44ce-9a8a-3acb094a7785 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:25.623228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-21733d69-e2fc-44ce-9a8a-3acb094a7785 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:25.644204 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-21733d69-e2fc-44ce-9a8a-3acb094a7785 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1698 microversion: 2.1 time: 0.347522 Aug 23 18:29:25.646774 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3280/6424] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:25 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1698 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:29:26.672480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff12844f-fe57-46ad-95d3-c87b1269b191 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:26.673699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff12844f-fe57-46ad-95d3-c87b1269b191 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:26.693343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff12844f-fe57-46ad-95d3-c87b1269b191 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:26.693847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff12844f-fe57-46ad-95d3-c87b1269b191 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:26.694293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff12844f-fe57-46ad-95d3-c87b1269b191 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:26.695036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff12844f-fe57-46ad-95d3-c87b1269b191 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:26.695615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff12844f-fe57-46ad-95d3-c87b1269b191 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:26.696224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff12844f-fe57-46ad-95d3-c87b1269b191 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:26.937480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff12844f-fe57-46ad-95d3-c87b1269b191 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:26.955840 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff12844f-fe57-46ad-95d3-c87b1269b191 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1698 microversion: 2.1 time: 0.287941 Aug 23 18:29:26.958022 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3145/6425] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:26 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1698 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:27.988715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-45c994c4-66e6-4421-82fd-d86390716a51 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:27.989439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-45c994c4-66e6-4421-82fd-d86390716a51 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:27.993798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:29:27.997366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45c994c4-66e6-4421-82fd-d86390716a51 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:28.005601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45c994c4-66e6-4421-82fd-d86390716a51 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:28.006453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45c994c4-66e6-4421-82fd-d86390716a51 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:28.007409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45c994c4-66e6-4421-82fd-d86390716a51 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:28.008024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45c994c4-66e6-4421-82fd-d86390716a51 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:28.008613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45c994c4-66e6-4421-82fd-d86390716a51 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:28.481154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45c994c4-66e6-4421-82fd-d86390716a51 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:28.521333 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-45c994c4-66e6-4421-82fd-d86390716a51 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1698 microversion: 2.1 time: 0.540965 Aug 23 18:29:28.525119 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3281/6426] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:27 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1698 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:29.563215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f67812fb-91b2-4f1f-87fb-b4e7756d0df9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:29.564488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f67812fb-91b2-4f1f-87fb-b4e7756d0df9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:29.573582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:29:29.603636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f67812fb-91b2-4f1f-87fb-b4e7756d0df9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:29.604981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f67812fb-91b2-4f1f-87fb-b4e7756d0df9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:29.607900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f67812fb-91b2-4f1f-87fb-b4e7756d0df9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:29.611427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f67812fb-91b2-4f1f-87fb-b4e7756d0df9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:29.613854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f67812fb-91b2-4f1f-87fb-b4e7756d0df9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:29.614561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f67812fb-91b2-4f1f-87fb-b4e7756d0df9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:30.145066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f67812fb-91b2-4f1f-87fb-b4e7756d0df9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:30.156953 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f67812fb-91b2-4f1f-87fb-b4e7756d0df9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1698 microversion: 2.1 time: 0.608178 Aug 23 18:29:30.173027 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3146/6427] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:29 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1698 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:31.183032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a9c5aabc-64f0-4370-b890-dcc0adc665e9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:31.184903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a9c5aabc-64f0-4370-b890-dcc0adc665e9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:31.198241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9c5aabc-64f0-4370-b890-dcc0adc665e9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:31.201029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9c5aabc-64f0-4370-b890-dcc0adc665e9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:31.204680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9c5aabc-64f0-4370-b890-dcc0adc665e9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:31.205752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9c5aabc-64f0-4370-b890-dcc0adc665e9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:31.207140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9c5aabc-64f0-4370-b890-dcc0adc665e9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:31.208399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a9c5aabc-64f0-4370-b890-dcc0adc665e9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:32.067633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a9c5aabc-64f0-4370-b890-dcc0adc665e9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:32.078271 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a9c5aabc-64f0-4370-b890-dcc0adc665e9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1698 microversion: 2.1 time: 0.900617 Aug 23 18:29:32.081150 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3282/6428] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:31 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1698 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:33.106878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c9f13861-8063-465d-ada5-3b6ed7c447f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:33.108047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c9f13861-8063-465d-ada5-3b6ed7c447f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:33.120517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9f13861-8063-465d-ada5-3b6ed7c447f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:33.121249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9f13861-8063-465d-ada5-3b6ed7c447f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:33.121880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9f13861-8063-465d-ada5-3b6ed7c447f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:33.122979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9f13861-8063-465d-ada5-3b6ed7c447f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:33.123579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9f13861-8063-465d-ada5-3b6ed7c447f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:33.124963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c9f13861-8063-465d-ada5-3b6ed7c447f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:33.681887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c9f13861-8063-465d-ada5-3b6ed7c447f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:33.720053 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c9f13861-8063-465d-ada5-3b6ed7c447f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1698 microversion: 2.1 time: 0.617537 Aug 23 18:29:33.720693 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3147/6429] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:33 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1698 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:34.742401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-254e1f39-555e-4d0a-b83e-9018cbaa21b6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:34.743515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-254e1f39-555e-4d0a-b83e-9018cbaa21b6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:34.761630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-254e1f39-555e-4d0a-b83e-9018cbaa21b6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:34.762260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-254e1f39-555e-4d0a-b83e-9018cbaa21b6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:34.762748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-254e1f39-555e-4d0a-b83e-9018cbaa21b6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:34.767339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-254e1f39-555e-4d0a-b83e-9018cbaa21b6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:34.767850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-254e1f39-555e-4d0a-b83e-9018cbaa21b6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:34.768306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-254e1f39-555e-4d0a-b83e-9018cbaa21b6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:35.401327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-254e1f39-555e-4d0a-b83e-9018cbaa21b6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:35.429206 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-254e1f39-555e-4d0a-b83e-9018cbaa21b6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1698 microversion: 2.1 time: 0.690584 Aug 23 18:29:35.429819 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3283/6430] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:34 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1698 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:36.459180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0de75414-1edb-4919-ad1c-815b2e27cf01 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:36.460488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0de75414-1edb-4919-ad1c-815b2e27cf01 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:36.476275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0de75414-1edb-4919-ad1c-815b2e27cf01 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:36.519446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0de75414-1edb-4919-ad1c-815b2e27cf01 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.043s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:36.519921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0de75414-1edb-4919-ad1c-815b2e27cf01 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:36.520698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0de75414-1edb-4919-ad1c-815b2e27cf01 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:36.521240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0de75414-1edb-4919-ad1c-815b2e27cf01 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:36.527806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0de75414-1edb-4919-ad1c-815b2e27cf01 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:36.865608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0de75414-1edb-4919-ad1c-815b2e27cf01 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:36.877970 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0de75414-1edb-4919-ad1c-815b2e27cf01 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1698 microversion: 2.1 time: 0.428432 Aug 23 18:29:36.878597 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3148/6431] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:36 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1698 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:37.901621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2b9405b9-3724-477b-abd2-c0be8f60ddec tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:37.902242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2b9405b9-3724-477b-abd2-c0be8f60ddec tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:37.912720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b9405b9-3724-477b-abd2-c0be8f60ddec tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:37.913639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b9405b9-3724-477b-abd2-c0be8f60ddec tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:37.914263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b9405b9-3724-477b-abd2-c0be8f60ddec tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:37.915479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b9405b9-3724-477b-abd2-c0be8f60ddec tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:37.916235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b9405b9-3724-477b-abd2-c0be8f60ddec tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:37.917688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b9405b9-3724-477b-abd2-c0be8f60ddec tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:38.259522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2b9405b9-3724-477b-abd2-c0be8f60ddec tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:38.280723 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2b9405b9-3724-477b-abd2-c0be8f60ddec tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1698 microversion: 2.1 time: 0.384041 Aug 23 18:29:38.285836 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3284/6432] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:37 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1698 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:39.310619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4f568ebf-fd16-49ed-9379-05d32bae55a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:39.312217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4f568ebf-fd16-49ed-9379-05d32bae55a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:39.333178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f568ebf-fd16-49ed-9379-05d32bae55a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:39.333712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f568ebf-fd16-49ed-9379-05d32bae55a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:39.334152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f568ebf-fd16-49ed-9379-05d32bae55a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:39.335082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f568ebf-fd16-49ed-9379-05d32bae55a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:39.335695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f568ebf-fd16-49ed-9379-05d32bae55a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:39.336276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4f568ebf-fd16-49ed-9379-05d32bae55a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:40.160326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4f568ebf-fd16-49ed-9379-05d32bae55a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:40.169124 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4f568ebf-fd16-49ed-9379-05d32bae55a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1697 microversion: 2.1 time: 0.862466 Aug 23 18:29:40.178042 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3149/6433] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:39 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1697 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:41.200448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7c6018b1-1450-4cce-87ca-ae1ffbf12fbd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:41.201644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7c6018b1-1450-4cce-87ca-ae1ffbf12fbd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:41.231459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c6018b1-1450-4cce-87ca-ae1ffbf12fbd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:41.231967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c6018b1-1450-4cce-87ca-ae1ffbf12fbd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:41.237486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c6018b1-1450-4cce-87ca-ae1ffbf12fbd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:41.238304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c6018b1-1450-4cce-87ca-ae1ffbf12fbd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:41.240497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c6018b1-1450-4cce-87ca-ae1ffbf12fbd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:41.241187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c6018b1-1450-4cce-87ca-ae1ffbf12fbd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:41.694448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-38614ab9-ecba-4f4c-9ea5-6fa042045381 req-ab97b025-9b01-4e45-a74e-4a191f811d06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d51053-cb2c-4787-b36d-8e1c7801712e", "name": "network-vif-unplugged", "status": "completed", "tag": "7b042a88-e07a-4fdc-9a3c-220fb49a38b4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:29:41.719491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-38614ab9-ecba-4f4c-9ea5-6fa042045381 req-ab97b025-9b01-4e45-a74e-4a191f811d06 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:41.721158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-38614ab9-ecba-4f4c-9ea5-6fa042045381 req-ab97b025-9b01-4e45-a74e-4a191f811d06 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:41.721918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-38614ab9-ecba-4f4c-9ea5-6fa042045381 req-ab97b025-9b01-4e45-a74e-4a191f811d06 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:41.753323 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-38614ab9-ecba-4f4c-9ea5-6fa042045381 req-ab97b025-9b01-4e45-a74e-4a191f811d06 service nova] Creating event network-vif-unplugged:7b042a88-e07a-4fdc-9a3c-220fb49a38b4 for instance 61d51053-cb2c-4787-b36d-8e1c7801712e on n-h2-850468-16 Aug 23 18:29:41.768036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-38614ab9-ecba-4f4c-9ea5-6fa042045381 req-ab97b025-9b01-4e45-a74e-4a191f811d06 service nova] Instance 61d51053-cb2c-4787-b36d-8e1c7801712e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:29:41.792492 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-38614ab9-ecba-4f4c-9ea5-6fa042045381 req-ab97b025-9b01-4e45-a74e-4a191f811d06 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.103360 Aug 23 18:29:41.797931 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3150/6434] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:29:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:29:41.837609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7c6018b1-1450-4cce-87ca-ae1ffbf12fbd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:41.853844 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7c6018b1-1450-4cce-87ca-ae1ffbf12fbd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1697 microversion: 2.1 time: 0.656745 Aug 23 18:29:41.857647 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3285/6435] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:41 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1697 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:42.881436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fe7309dc-d3c8-4f2a-a7ee-a40fb20f0812 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:42.881436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe7309dc-d3c8-4f2a-a7ee-a40fb20f0812 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:42.895272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe7309dc-d3c8-4f2a-a7ee-a40fb20f0812 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:42.899450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe7309dc-d3c8-4f2a-a7ee-a40fb20f0812 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:42.899905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe7309dc-d3c8-4f2a-a7ee-a40fb20f0812 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:42.900874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe7309dc-d3c8-4f2a-a7ee-a40fb20f0812 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:42.902165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe7309dc-d3c8-4f2a-a7ee-a40fb20f0812 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:42.902799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe7309dc-d3c8-4f2a-a7ee-a40fb20f0812 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:43.372942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fe7309dc-d3c8-4f2a-a7ee-a40fb20f0812 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:43.408025 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fe7309dc-d3c8-4f2a-a7ee-a40fb20f0812 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1697 microversion: 2.1 time: 0.534404 Aug 23 18:29:43.412460 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3151/6436] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:42 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1697 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:43.819328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-df418fe5-6337-4628-97c0-1bbc898348ca req-5b5ed7fa-de3a-476b-ab9e-ef8a45624e58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d51053-cb2c-4787-b36d-8e1c7801712e", "tag": "7b042a88-e07a-4fdc-9a3c-220fb49a38b4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:29:43.833987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-df418fe5-6337-4628-97c0-1bbc898348ca req-5b5ed7fa-de3a-476b-ab9e-ef8a45624e58 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:43.836108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-df418fe5-6337-4628-97c0-1bbc898348ca req-5b5ed7fa-de3a-476b-ab9e-ef8a45624e58 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:43.836615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-df418fe5-6337-4628-97c0-1bbc898348ca req-5b5ed7fa-de3a-476b-ab9e-ef8a45624e58 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:43.850394 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-df418fe5-6337-4628-97c0-1bbc898348ca req-5b5ed7fa-de3a-476b-ab9e-ef8a45624e58 service nova] Creating event network-changed:7b042a88-e07a-4fdc-9a3c-220fb49a38b4 for instance 61d51053-cb2c-4787-b36d-8e1c7801712e on n-h2-850468-16 Aug 23 18:29:43.856011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-df418fe5-6337-4628-97c0-1bbc898348ca req-5b5ed7fa-de3a-476b-ab9e-ef8a45624e58 service nova] Instance 61d51053-cb2c-4787-b36d-8e1c7801712e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:29:43.869822 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-df418fe5-6337-4628-97c0-1bbc898348ca req-5b5ed7fa-de3a-476b-ab9e-ef8a45624e58 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054842 Aug 23 18:29:43.871668 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3286/6437] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:29:44.434439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-525706ef-a4fe-4eb5-a5e3-9081b9be5678 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:44.435386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-525706ef-a4fe-4eb5-a5e3-9081b9be5678 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:44.450935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-525706ef-a4fe-4eb5-a5e3-9081b9be5678 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:44.451580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-525706ef-a4fe-4eb5-a5e3-9081b9be5678 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:44.452719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-525706ef-a4fe-4eb5-a5e3-9081b9be5678 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:44.455066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-525706ef-a4fe-4eb5-a5e3-9081b9be5678 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:44.459009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-525706ef-a4fe-4eb5-a5e3-9081b9be5678 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:44.459606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-525706ef-a4fe-4eb5-a5e3-9081b9be5678 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:44.918048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-525706ef-a4fe-4eb5-a5e3-9081b9be5678 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:44.934855 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-525706ef-a4fe-4eb5-a5e3-9081b9be5678 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1697 microversion: 2.1 time: 0.497531 Aug 23 18:29:44.935535 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3152/6438] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:44 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1697 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:45.959605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c120cc94-c318-4db7-bba5-309d9027971d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:45.960452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c120cc94-c318-4db7-bba5-309d9027971d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:45.978595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c120cc94-c318-4db7-bba5-309d9027971d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:45.980973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c120cc94-c318-4db7-bba5-309d9027971d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:45.982166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c120cc94-c318-4db7-bba5-309d9027971d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:45.987834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c120cc94-c318-4db7-bba5-309d9027971d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:45.988560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c120cc94-c318-4db7-bba5-309d9027971d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:45.989228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c120cc94-c318-4db7-bba5-309d9027971d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:47.164642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c120cc94-c318-4db7-bba5-309d9027971d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:47.180107 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c120cc94-c318-4db7-bba5-309d9027971d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1695 microversion: 2.1 time: 1.225865 Aug 23 18:29:47.181306 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3287/6439] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:45 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1695 bytes in 1228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:48.209418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-199cacf3-df8d-400b-b487-82fa186321c6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:48.210314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-199cacf3-df8d-400b-b487-82fa186321c6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:48.241166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-199cacf3-df8d-400b-b487-82fa186321c6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:48.243142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-199cacf3-df8d-400b-b487-82fa186321c6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:48.245222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-199cacf3-df8d-400b-b487-82fa186321c6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:48.246360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-199cacf3-df8d-400b-b487-82fa186321c6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:48.247584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-199cacf3-df8d-400b-b487-82fa186321c6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:48.250228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-199cacf3-df8d-400b-b487-82fa186321c6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:48.260066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=75 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:29:48.726608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-199cacf3-df8d-400b-b487-82fa186321c6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:48.738513 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-199cacf3-df8d-400b-b487-82fa186321c6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1692 microversion: 2.1 time: 0.537002 Aug 23 18:29:48.744247 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3153/6440] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:48 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1692 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:48.771561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-98c9c78b-692e-438e-bf7e-efdfcbfd8689 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:29:48.773026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-98c9c78b-692e-438e-bf7e-efdfcbfd8689 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:48.794450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98c9c78b-692e-438e-bf7e-efdfcbfd8689 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:48.795264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98c9c78b-692e-438e-bf7e-efdfcbfd8689 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:48.797232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98c9c78b-692e-438e-bf7e-efdfcbfd8689 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:48.799974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98c9c78b-692e-438e-bf7e-efdfcbfd8689 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:48.802290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98c9c78b-692e-438e-bf7e-efdfcbfd8689 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:48.808248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-98c9c78b-692e-438e-bf7e-efdfcbfd8689 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:48.828722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=63 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:29:49.122942 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-98c9c78b-692e-438e-bf7e-efdfcbfd8689 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e/action" status: 202 len: 0 microversion: 2.1 time: 0.355354 Aug 23 18:29:49.126214 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3288/6441] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:29:48 2022] POST /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:29:49.136962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-88d7f94e-62fe-4eea-a1dc-4451d57ca487 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:49.140063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-88d7f94e-62fe-4eea-a1dc-4451d57ca487 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:49.160321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d7f94e-62fe-4eea-a1dc-4451d57ca487 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:49.160827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d7f94e-62fe-4eea-a1dc-4451d57ca487 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:49.161282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d7f94e-62fe-4eea-a1dc-4451d57ca487 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:49.161999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d7f94e-62fe-4eea-a1dc-4451d57ca487 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:49.162457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d7f94e-62fe-4eea-a1dc-4451d57ca487 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:49.162919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-88d7f94e-62fe-4eea-a1dc-4451d57ca487 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:49.658424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-88d7f94e-62fe-4eea-a1dc-4451d57ca487 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:49.676454 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-88d7f94e-62fe-4eea-a1dc-4451d57ca487 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1691 microversion: 2.1 time: 0.540234 Aug 23 18:29:49.679377 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3154/6442] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:49 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1691 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:50.700781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93038765-e1e7-46e7-8ba7-5ea5626d621d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:50.701529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-93038765-e1e7-46e7-8ba7-5ea5626d621d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:50.716158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93038765-e1e7-46e7-8ba7-5ea5626d621d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:50.716663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93038765-e1e7-46e7-8ba7-5ea5626d621d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:50.720361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93038765-e1e7-46e7-8ba7-5ea5626d621d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:50.726905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93038765-e1e7-46e7-8ba7-5ea5626d621d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:50.727757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93038765-e1e7-46e7-8ba7-5ea5626d621d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:50.729079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93038765-e1e7-46e7-8ba7-5ea5626d621d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:51.077966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93038765-e1e7-46e7-8ba7-5ea5626d621d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:51.091040 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93038765-e1e7-46e7-8ba7-5ea5626d621d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1691 microversion: 2.1 time: 0.392005 Aug 23 18:29:51.093218 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3289/6443] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:50 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1691 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:52.120614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b90022aa-b0be-4b8a-9926-de9ff5617fe4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:52.121256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b90022aa-b0be-4b8a-9926-de9ff5617fe4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:52.154261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b90022aa-b0be-4b8a-9926-de9ff5617fe4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:52.166766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b90022aa-b0be-4b8a-9926-de9ff5617fe4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:52.166766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b90022aa-b0be-4b8a-9926-de9ff5617fe4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:52.166766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b90022aa-b0be-4b8a-9926-de9ff5617fe4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:52.166766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b90022aa-b0be-4b8a-9926-de9ff5617fe4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:52.166766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b90022aa-b0be-4b8a-9926-de9ff5617fe4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:52.659393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b90022aa-b0be-4b8a-9926-de9ff5617fe4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:52.676806 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b90022aa-b0be-4b8a-9926-de9ff5617fe4 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1691 microversion: 2.1 time: 0.566362 Aug 23 18:29:52.683046 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3155/6444] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:52 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1691 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:53.711918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-35f10cb8-5f67-4969-9ce8-56c618d26f35 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:53.713408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-35f10cb8-5f67-4969-9ce8-56c618d26f35 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:53.742495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35f10cb8-5f67-4969-9ce8-56c618d26f35 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:53.743052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35f10cb8-5f67-4969-9ce8-56c618d26f35 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:53.745060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35f10cb8-5f67-4969-9ce8-56c618d26f35 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:53.746599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35f10cb8-5f67-4969-9ce8-56c618d26f35 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:53.760113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35f10cb8-5f67-4969-9ce8-56c618d26f35 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:53.760481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35f10cb8-5f67-4969-9ce8-56c618d26f35 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:54.199889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-35f10cb8-5f67-4969-9ce8-56c618d26f35 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:54.227031 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-35f10cb8-5f67-4969-9ce8-56c618d26f35 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1691 microversion: 2.1 time: 0.525852 Aug 23 18:29:54.230854 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3290/6445] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:53 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1691 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:55.249401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e1a56a50-810e-45c9-8849-e10e086bc8ff tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:55.250029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e1a56a50-810e-45c9-8849-e10e086bc8ff tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:55.266084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1a56a50-810e-45c9-8849-e10e086bc8ff tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:55.269582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1a56a50-810e-45c9-8849-e10e086bc8ff tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:55.270066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1a56a50-810e-45c9-8849-e10e086bc8ff tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:55.276079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1a56a50-810e-45c9-8849-e10e086bc8ff tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:55.276587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1a56a50-810e-45c9-8849-e10e086bc8ff tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:55.277045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1a56a50-810e-45c9-8849-e10e086bc8ff tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:56.360870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e1a56a50-810e-45c9-8849-e10e086bc8ff tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:56.374614 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e1a56a50-810e-45c9-8849-e10e086bc8ff tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1691 microversion: 2.1 time: 1.128947 Aug 23 18:29:56.397347 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3156/6446] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:55 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1691 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:56.868621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-0b26f56b-d306-4912-b65f-332c7791e7b9 req-61fa70de-c562-42b7-b71e-a038b2556be8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d51053-cb2c-4787-b36d-8e1c7801712e", "tag": "7b042a88-e07a-4fdc-9a3c-220fb49a38b4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:29:56.903027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0b26f56b-d306-4912-b65f-332c7791e7b9 req-61fa70de-c562-42b7-b71e-a038b2556be8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:56.903844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0b26f56b-d306-4912-b65f-332c7791e7b9 req-61fa70de-c562-42b7-b71e-a038b2556be8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:56.905073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0b26f56b-d306-4912-b65f-332c7791e7b9 req-61fa70de-c562-42b7-b71e-a038b2556be8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:56.928305 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-0b26f56b-d306-4912-b65f-332c7791e7b9 req-61fa70de-c562-42b7-b71e-a038b2556be8 service nova] Creating event network-changed:7b042a88-e07a-4fdc-9a3c-220fb49a38b4 for instance 61d51053-cb2c-4787-b36d-8e1c7801712e on n-h1-850468-16 Aug 23 18:29:56.935363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-0b26f56b-d306-4912-b65f-332c7791e7b9 req-61fa70de-c562-42b7-b71e-a038b2556be8 service nova] Instance 61d51053-cb2c-4787-b36d-8e1c7801712e is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:29:56.974148 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-0b26f56b-d306-4912-b65f-332c7791e7b9 req-61fa70de-c562-42b7-b71e-a038b2556be8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108220 Aug 23 18:29:56.976833 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3291/6447] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:29:57.398833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-df0deef1-d99f-47db-b46c-d6503bd3a7bd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:57.399456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-df0deef1-d99f-47db-b46c-d6503bd3a7bd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:57.410427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df0deef1-d99f-47db-b46c-d6503bd3a7bd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:57.415239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df0deef1-d99f-47db-b46c-d6503bd3a7bd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:57.417505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df0deef1-d99f-47db-b46c-d6503bd3a7bd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:57.422915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df0deef1-d99f-47db-b46c-d6503bd3a7bd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:57.424318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df0deef1-d99f-47db-b46c-d6503bd3a7bd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:57.424920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df0deef1-d99f-47db-b46c-d6503bd3a7bd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:58.452290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-df0deef1-d99f-47db-b46c-d6503bd3a7bd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:58.469159 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-df0deef1-d99f-47db-b46c-d6503bd3a7bd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1691 microversion: 2.1 time: 1.075409 Aug 23 18:29:58.475053 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3157/6448] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:57 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1691 bytes in 1082 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:29:59.507231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-512774cc-1cbe-4a34-aa33-ddb407cb4e3d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:29:59.508713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-512774cc-1cbe-4a34-aa33-ddb407cb4e3d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:29:59.526068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=26 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:29:59.532222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-512774cc-1cbe-4a34-aa33-ddb407cb4e3d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:59.532832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-512774cc-1cbe-4a34-aa33-ddb407cb4e3d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:59.533362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-512774cc-1cbe-4a34-aa33-ddb407cb4e3d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:59.534110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-512774cc-1cbe-4a34-aa33-ddb407cb4e3d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:29:59.541883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-512774cc-1cbe-4a34-aa33-ddb407cb4e3d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:29:59.542753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-512774cc-1cbe-4a34-aa33-ddb407cb4e3d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:29:59.819285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-512774cc-1cbe-4a34-aa33-ddb407cb4e3d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:29:59.833084 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-512774cc-1cbe-4a34-aa33-ddb407cb4e3d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1691 microversion: 2.1 time: 0.332246 Aug 23 18:29:59.833691 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3292/6449] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:29:59 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1691 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:00.856110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cb3dfdd5-2e86-4ed3-83fb-23017ffe76dd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:00.856731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cb3dfdd5-2e86-4ed3-83fb-23017ffe76dd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:00.862374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=24 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:30:00.892047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3dfdd5-2e86-4ed3-83fb-23017ffe76dd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:00.892553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3dfdd5-2e86-4ed3-83fb-23017ffe76dd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:00.892997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3dfdd5-2e86-4ed3-83fb-23017ffe76dd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:00.893717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3dfdd5-2e86-4ed3-83fb-23017ffe76dd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:00.894181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3dfdd5-2e86-4ed3-83fb-23017ffe76dd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:00.894675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3dfdd5-2e86-4ed3-83fb-23017ffe76dd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:01.884954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cb3dfdd5-2e86-4ed3-83fb-23017ffe76dd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:01.903336 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cb3dfdd5-2e86-4ed3-83fb-23017ffe76dd tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1691 microversion: 2.1 time: 1.050510 Aug 23 18:30:01.905149 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3158/6450] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:00 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1691 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:02.926474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-914d9b22-5f64-43b5-88c6-a640b641a0f3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:02.929055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-914d9b22-5f64-43b5-88c6-a640b641a0f3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:02.944376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-914d9b22-5f64-43b5-88c6-a640b641a0f3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:02.951332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-914d9b22-5f64-43b5-88c6-a640b641a0f3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:02.956523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-914d9b22-5f64-43b5-88c6-a640b641a0f3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:02.957536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-914d9b22-5f64-43b5-88c6-a640b641a0f3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:02.964092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-914d9b22-5f64-43b5-88c6-a640b641a0f3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:02.969544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-914d9b22-5f64-43b5-88c6-a640b641a0f3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:03.504678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-914d9b22-5f64-43b5-88c6-a640b641a0f3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:03.518408 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-914d9b22-5f64-43b5-88c6-a640b641a0f3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1684 microversion: 2.1 time: 0.592592 Aug 23 18:30:03.535471 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3293/6451] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:02 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1684 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:06.531806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ee048691-e33f-4198-a8aa-d8ec84bd7943 req-ceec7c0f-f57d-49a4-a1c0-8f7344b446bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d51053-cb2c-4787-b36d-8e1c7801712e", "name": "network-vif-plugged", "status": "completed", "tag": "7b042a88-e07a-4fdc-9a3c-220fb49a38b4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:30:06.559951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ee048691-e33f-4198-a8aa-d8ec84bd7943 req-ceec7c0f-f57d-49a4-a1c0-8f7344b446bf service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:06.560667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ee048691-e33f-4198-a8aa-d8ec84bd7943 req-ceec7c0f-f57d-49a4-a1c0-8f7344b446bf service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:06.561853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ee048691-e33f-4198-a8aa-d8ec84bd7943 req-ceec7c0f-f57d-49a4-a1c0-8f7344b446bf service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:06.586035 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ee048691-e33f-4198-a8aa-d8ec84bd7943 req-ceec7c0f-f57d-49a4-a1c0-8f7344b446bf service nova] Creating event network-vif-plugged:7b042a88-e07a-4fdc-9a3c-220fb49a38b4 for instance 61d51053-cb2c-4787-b36d-8e1c7801712e on n-h1-850468-16 Aug 23 18:30:06.593663 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ee048691-e33f-4198-a8aa-d8ec84bd7943 req-ceec7c0f-f57d-49a4-a1c0-8f7344b446bf service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067074 Aug 23 18:30:06.597110 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3159/6452] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:30:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:30:16.452060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a1a2fc8c-f974-4b06-8d9d-276b9d7093df tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:16.453265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a1a2fc8c-f974-4b06-8d9d-276b9d7093df tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:16.455932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:30:16.470413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:30:16.500341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1a2fc8c-f974-4b06-8d9d-276b9d7093df tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:16.506340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1a2fc8c-f974-4b06-8d9d-276b9d7093df tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:16.511147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1a2fc8c-f974-4b06-8d9d-276b9d7093df tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:16.512046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1a2fc8c-f974-4b06-8d9d-276b9d7093df tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:16.512542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1a2fc8c-f974-4b06-8d9d-276b9d7093df tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:16.512994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a1a2fc8c-f974-4b06-8d9d-276b9d7093df tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:16.785460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-a1a2fc8c-f974-4b06-8d9d-276b9d7093df tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lazy-loading 'services' on Instance uuid 181bbeec-159b-4f25-91cd-4c1d93687b11 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:30:16.923505 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a1a2fc8c-f974-4b06-8d9d-276b9d7093df tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "DELETE /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/os-volume_attachments/456ef606-0532-49c3-81c4-23d6acf66c22" status: 202 len: 0 microversion: 2.1 time: 0.477086 Aug 23 18:30:16.924776 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3294/6453] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 18:30:16 2022] DELETE /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/os-volume_attachments/456ef606-0532-49c3-81c4-23d6acf66c22 => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:30:26.040543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-61d81d84-4f02-44bd-8a64-32ed189d5401 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:30:26.058718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:30:26.061200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=37 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:30:26.066484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61d81d84-4f02-44bd-8a64-32ed189d5401 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:26.067278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61d81d84-4f02-44bd-8a64-32ed189d5401 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:26.067972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-61d81d84-4f02-44bd-8a64-32ed189d5401 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:26.124213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-61d81d84-4f02-44bd-8a64-32ed189d5401 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Going to try to stop instance {{(pid=128807) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 18:30:26.255136 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-61d81d84-4f02-44bd-8a64-32ed189d5401 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "POST /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/action" status: 202 len: 0 microversion: 2.1 time: 0.225090 Aug 23 18:30:26.256772 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3160/6454] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:30:26 2022] POST /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/action => generated 0 bytes in 228 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:30:26.266951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e6d61f11-083e-4a23-a9db-1304f4728f2e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:26.268422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e6d61f11-083e-4a23-a9db-1304f4728f2e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:26.299584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6d61f11-083e-4a23-a9db-1304f4728f2e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:26.300285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6d61f11-083e-4a23-a9db-1304f4728f2e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:26.300894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6d61f11-083e-4a23-a9db-1304f4728f2e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:26.301766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6d61f11-083e-4a23-a9db-1304f4728f2e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:26.302687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6d61f11-083e-4a23-a9db-1304f4728f2e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:26.303264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e6d61f11-083e-4a23-a9db-1304f4728f2e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:26.741819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e6d61f11-083e-4a23-a9db-1304f4728f2e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:26.758769 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e6d61f11-083e-4a23-a9db-1304f4728f2e tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1679 microversion: 2.1 time: 0.489748 Aug 23 18:30:26.759503 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3295/6455] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:26 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1679 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:27.785383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ee25c3bd-df87-4eaf-81cc-8a641dad6df0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:27.786019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ee25c3bd-df87-4eaf-81cc-8a641dad6df0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:27.804455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee25c3bd-df87-4eaf-81cc-8a641dad6df0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:27.804968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee25c3bd-df87-4eaf-81cc-8a641dad6df0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:27.805418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee25c3bd-df87-4eaf-81cc-8a641dad6df0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:27.806148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee25c3bd-df87-4eaf-81cc-8a641dad6df0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:27.806636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee25c3bd-df87-4eaf-81cc-8a641dad6df0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:27.807077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ee25c3bd-df87-4eaf-81cc-8a641dad6df0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:28.217669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ee25c3bd-df87-4eaf-81cc-8a641dad6df0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:28.227798 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ee25c3bd-df87-4eaf-81cc-8a641dad6df0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1679 microversion: 2.1 time: 0.447143 Aug 23 18:30:28.229466 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3161/6456] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:27 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1679 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:29.255207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5f4baad0-6285-4728-9fdc-e700bd41cd57 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:29.255826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5f4baad0-6285-4728-9fdc-e700bd41cd57 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:29.272958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f4baad0-6285-4728-9fdc-e700bd41cd57 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:29.273458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f4baad0-6285-4728-9fdc-e700bd41cd57 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:29.274077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f4baad0-6285-4728-9fdc-e700bd41cd57 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:29.275037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f4baad0-6285-4728-9fdc-e700bd41cd57 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:29.275713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f4baad0-6285-4728-9fdc-e700bd41cd57 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:29.276174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5f4baad0-6285-4728-9fdc-e700bd41cd57 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:29.597460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5f4baad0-6285-4728-9fdc-e700bd41cd57 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:29.605818 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5f4baad0-6285-4728-9fdc-e700bd41cd57 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1679 microversion: 2.1 time: 0.354990 Aug 23 18:30:29.619931 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3296/6457] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:29 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1679 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:30.635503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a82ab021-3e9c-4249-a00a-33c506cb83ee tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:30.636211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a82ab021-3e9c-4249-a00a-33c506cb83ee tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:30.666587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a82ab021-3e9c-4249-a00a-33c506cb83ee tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:30.667334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a82ab021-3e9c-4249-a00a-33c506cb83ee tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:30.667929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a82ab021-3e9c-4249-a00a-33c506cb83ee tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:30.668815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a82ab021-3e9c-4249-a00a-33c506cb83ee tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:30.671844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a82ab021-3e9c-4249-a00a-33c506cb83ee tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:30.672439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a82ab021-3e9c-4249-a00a-33c506cb83ee tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:30.948731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a82ab021-3e9c-4249-a00a-33c506cb83ee tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:30.974223 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a82ab021-3e9c-4249-a00a-33c506cb83ee tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1679 microversion: 2.1 time: 0.349309 Aug 23 18:30:30.993029 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3162/6458] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:30 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1679 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:32.003915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb062e2e-49c9-4acb-b882-9a593226366a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:32.005113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eb062e2e-49c9-4acb-b882-9a593226366a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:32.022792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb062e2e-49c9-4acb-b882-9a593226366a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:32.023900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb062e2e-49c9-4acb-b882-9a593226366a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:32.024493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb062e2e-49c9-4acb-b882-9a593226366a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:32.026082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb062e2e-49c9-4acb-b882-9a593226366a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:32.027517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb062e2e-49c9-4acb-b882-9a593226366a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:32.029346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb062e2e-49c9-4acb-b882-9a593226366a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:32.285155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eb062e2e-49c9-4acb-b882-9a593226366a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:32.303443 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eb062e2e-49c9-4acb-b882-9a593226366a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1679 microversion: 2.1 time: 0.309275 Aug 23 18:30:32.304651 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3297/6459] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:31 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1679 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:33.331245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6debf194-de75-45bd-b3da-a9dc102e55a9 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:33.331853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6debf194-de75-45bd-b3da-a9dc102e55a9 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:33.345218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6debf194-de75-45bd-b3da-a9dc102e55a9 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:33.345956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6debf194-de75-45bd-b3da-a9dc102e55a9 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:33.346568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6debf194-de75-45bd-b3da-a9dc102e55a9 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:33.347423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6debf194-de75-45bd-b3da-a9dc102e55a9 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:33.351170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6debf194-de75-45bd-b3da-a9dc102e55a9 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:33.351798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6debf194-de75-45bd-b3da-a9dc102e55a9 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:33.705890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6debf194-de75-45bd-b3da-a9dc102e55a9 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:33.720770 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6debf194-de75-45bd-b3da-a9dc102e55a9 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1679 microversion: 2.1 time: 0.392627 Aug 23 18:30:33.721690 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3163/6460] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:33 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1679 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:34.745733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4d2ed9ad-dd3d-4f7b-94fa-ff822e147e48 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:34.746369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4d2ed9ad-dd3d-4f7b-94fa-ff822e147e48 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:34.762061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d2ed9ad-dd3d-4f7b-94fa-ff822e147e48 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:34.763980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d2ed9ad-dd3d-4f7b-94fa-ff822e147e48 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:34.763980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d2ed9ad-dd3d-4f7b-94fa-ff822e147e48 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:34.764360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d2ed9ad-dd3d-4f7b-94fa-ff822e147e48 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:34.764830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d2ed9ad-dd3d-4f7b-94fa-ff822e147e48 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:34.765413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4d2ed9ad-dd3d-4f7b-94fa-ff822e147e48 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:35.084302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4d2ed9ad-dd3d-4f7b-94fa-ff822e147e48 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:35.100414 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4d2ed9ad-dd3d-4f7b-94fa-ff822e147e48 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1679 microversion: 2.1 time: 0.358768 Aug 23 18:30:35.101481 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3298/6461] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:34 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1679 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:36.124863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1aa07fac-ec8f-41f6-9a7e-5b6b0991497f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:36.125493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1aa07fac-ec8f-41f6-9a7e-5b6b0991497f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:36.142240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1aa07fac-ec8f-41f6-9a7e-5b6b0991497f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:36.142957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1aa07fac-ec8f-41f6-9a7e-5b6b0991497f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:36.143561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1aa07fac-ec8f-41f6-9a7e-5b6b0991497f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:36.144445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1aa07fac-ec8f-41f6-9a7e-5b6b0991497f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:36.145087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1aa07fac-ec8f-41f6-9a7e-5b6b0991497f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:36.145852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1aa07fac-ec8f-41f6-9a7e-5b6b0991497f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:36.358195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1aa07fac-ec8f-41f6-9a7e-5b6b0991497f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:36.369598 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1aa07fac-ec8f-41f6-9a7e-5b6b0991497f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1679 microversion: 2.1 time: 0.249072 Aug 23 18:30:36.375487 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3164/6462] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:36 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1679 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:37.392444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a76ae1c-273b-45c9-99d3-0afa2b8cc3ae tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:37.393065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5a76ae1c-273b-45c9-99d3-0afa2b8cc3ae tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:37.400101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a76ae1c-273b-45c9-99d3-0afa2b8cc3ae tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:37.400594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a76ae1c-273b-45c9-99d3-0afa2b8cc3ae tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:37.401038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a76ae1c-273b-45c9-99d3-0afa2b8cc3ae tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:37.401742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a76ae1c-273b-45c9-99d3-0afa2b8cc3ae tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:37.402198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a76ae1c-273b-45c9-99d3-0afa2b8cc3ae tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:37.406110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a76ae1c-273b-45c9-99d3-0afa2b8cc3ae tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:37.772464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5a76ae1c-273b-45c9-99d3-0afa2b8cc3ae tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:37.803970 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a76ae1c-273b-45c9-99d3-0afa2b8cc3ae tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1656 microversion: 2.1 time: 0.417033 Aug 23 18:30:37.804551 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3299/6463] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:37 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1656 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:37.834342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5f3c63c1-4b28-482a-b9bf-34f2184d5460 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:30:37.845084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f3c63c1-4b28-482a-b9bf-34f2184d5460 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:37.851110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f3c63c1-4b28-482a-b9bf-34f2184d5460 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:37.852082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5f3c63c1-4b28-482a-b9bf-34f2184d5460 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:37.882895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5f3c63c1-4b28-482a-b9bf-34f2184d5460 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Going to try to start instance {{(pid=128807) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 18:30:37.910013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a126cf80-8f65-4593-8db8-8c2fffe0593a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:30:37.913283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a126cf80-8f65-4593-8db8-8c2fffe0593a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:37.926789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a126cf80-8f65-4593-8db8-8c2fffe0593a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:37.926789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a126cf80-8f65-4593-8db8-8c2fffe0593a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:37.926789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a126cf80-8f65-4593-8db8-8c2fffe0593a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:37.933546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a126cf80-8f65-4593-8db8-8c2fffe0593a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:37.935320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a126cf80-8f65-4593-8db8-8c2fffe0593a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:37.938261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a126cf80-8f65-4593-8db8-8c2fffe0593a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:37.966195 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5f3c63c1-4b28-482a-b9bf-34f2184d5460 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "POST /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/action" status: 202 len: 0 microversion: 2.1 time: 0.134466 Aug 23 18:30:37.971604 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3165/6464] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:30:37 2022] POST /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:30:37.978794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f7d4660f-ed52-4c81-8564-bacb4e1a260b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:37.979969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f7d4660f-ed52-4c81-8564-bacb4e1a260b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:37.990757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7d4660f-ed52-4c81-8564-bacb4e1a260b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:37.991578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7d4660f-ed52-4c81-8564-bacb4e1a260b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:37.992250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7d4660f-ed52-4c81-8564-bacb4e1a260b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:37.993297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7d4660f-ed52-4c81-8564-bacb4e1a260b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:37.994195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7d4660f-ed52-4c81-8564-bacb4e1a260b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:37.994815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7d4660f-ed52-4c81-8564-bacb4e1a260b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:38.036321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a126cf80-8f65-4593-8db8-8c2fffe0593a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e/action" status: 200 len: 62901 microversion: 2.1 time: 0.129542 Aug 23 18:30:38.046915 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3300/6465] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:30:37 2022] POST /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e/action => generated 62901 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:30:38.306139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f7d4660f-ed52-4c81-8564-bacb4e1a260b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:38.329599 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f7d4660f-ed52-4c81-8564-bacb4e1a260b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1665 microversion: 2.1 time: 0.356472 Aug 23 18:30:38.332510 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3166/6466] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:37 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1665 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:39.354598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-72977b10-1490-4990-9058-8966610c5473 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:39.355310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-72977b10-1490-4990-9058-8966610c5473 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:39.377684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72977b10-1490-4990-9058-8966610c5473 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:39.378160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72977b10-1490-4990-9058-8966610c5473 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:39.378619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72977b10-1490-4990-9058-8966610c5473 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:39.379334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72977b10-1490-4990-9058-8966610c5473 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:39.379810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72977b10-1490-4990-9058-8966610c5473 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:39.380212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-72977b10-1490-4990-9058-8966610c5473 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:39.828359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-72977b10-1490-4990-9058-8966610c5473 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:39.848630 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-72977b10-1490-4990-9058-8966610c5473 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1665 microversion: 2.1 time: 0.498882 Aug 23 18:30:39.849654 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3301/6467] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:39 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1665 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:30:40.875144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ce28ffce-e745-4f73-bb3b-b73c952ab5ec tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:30:40.875674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ce28ffce-e745-4f73-bb3b-b73c952ab5ec tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:30:40.895853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce28ffce-e745-4f73-bb3b-b73c952ab5ec tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:40.896846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce28ffce-e745-4f73-bb3b-b73c952ab5ec tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:40.897495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce28ffce-e745-4f73-bb3b-b73c952ab5ec tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:40.898523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce28ffce-e745-4f73-bb3b-b73c952ab5ec tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:30:40.899338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce28ffce-e745-4f73-bb3b-b73c952ab5ec tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:30:40.900305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce28ffce-e745-4f73-bb3b-b73c952ab5ec tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:30:41.112224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ce28ffce-e745-4f73-bb3b-b73c952ab5ec tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:30:41.126709 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ce28ffce-e745-4f73-bb3b-b73c952ab5ec tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1669 microversion: 2.1 time: 0.254798 Aug 23 18:30:41.128446 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3167/6468] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:30:40 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1669 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:00.799377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-978a234f-075b-4d63-9865-6f39041694a7 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:00.800063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-978a234f-075b-4d63-9865-6f39041694a7 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:00.810851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=16 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:00.812375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=49,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:00.814424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-978a234f-075b-4d63-9865-6f39041694a7 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:00.815065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-978a234f-075b-4d63-9865-6f39041694a7 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:00.815731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-978a234f-075b-4d63-9865-6f39041694a7 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:00.816860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-978a234f-075b-4d63-9865-6f39041694a7 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:00.817448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-978a234f-075b-4d63-9865-6f39041694a7 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:00.817931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-978a234f-075b-4d63-9865-6f39041694a7 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:01.089940 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-978a234f-075b-4d63-9865-6f39041694a7 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1837 microversion: 2.1 time: 0.297001 Aug 23 18:31:01.101759 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3302/6469] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:00 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1837 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:03.639404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c552ffa0-772c-46a9-b6b8-1e118e02dafb req-341843df-351a-4af5-a77e-23f33e8bf661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61d51053-cb2c-4787-b36d-8e1c7801712e", "tag": "7b042a88-e07a-4fdc-9a3c-220fb49a38b4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:31:03.642716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-384dd287-4cd8-435a-a142-e1aeb229ebf3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:03.643238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-384dd287-4cd8-435a-a142-e1aeb229ebf3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:03.665218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=16 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:03.670161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:03.674669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-384dd287-4cd8-435a-a142-e1aeb229ebf3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:03.677771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c552ffa0-772c-46a9-b6b8-1e118e02dafb req-341843df-351a-4af5-a77e-23f33e8bf661 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:03.680175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-384dd287-4cd8-435a-a142-e1aeb229ebf3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:03.681030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-384dd287-4cd8-435a-a142-e1aeb229ebf3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:03.682652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c552ffa0-772c-46a9-b6b8-1e118e02dafb req-341843df-351a-4af5-a77e-23f33e8bf661 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:03.685147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c552ffa0-772c-46a9-b6b8-1e118e02dafb req-341843df-351a-4af5-a77e-23f33e8bf661 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:03.688148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-384dd287-4cd8-435a-a142-e1aeb229ebf3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:03.690293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-384dd287-4cd8-435a-a142-e1aeb229ebf3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:03.691703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-384dd287-4cd8-435a-a142-e1aeb229ebf3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:03.721893 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c552ffa0-772c-46a9-b6b8-1e118e02dafb req-341843df-351a-4af5-a77e-23f33e8bf661 service nova] Creating event network-changed:7b042a88-e07a-4fdc-9a3c-220fb49a38b4 for instance 61d51053-cb2c-4787-b36d-8e1c7801712e on n-h1-850468-16 Aug 23 18:31:03.742278 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c552ffa0-772c-46a9-b6b8-1e118e02dafb req-341843df-351a-4af5-a77e-23f33e8bf661 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109800 Aug 23 18:31:03.743384 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3303/6470] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:31:03.865947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-384dd287-4cd8-435a-a142-e1aeb229ebf3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:31:04.053373 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-384dd287-4cd8-435a-a142-e1aeb229ebf3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "DELETE /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 204 len: 0 microversion: 2.1 time: 0.430285 Aug 23 18:31:04.058123 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3168/6471] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:31:03 2022] DELETE /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 0 bytes in 437 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:31:04.078264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-df94d5f1-3100-41fc-b691-51d51879e947 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:04.079027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-df94d5f1-3100-41fc-b691-51d51879e947 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:04.089867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df94d5f1-3100-41fc-b691-51d51879e947 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:04.095225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df94d5f1-3100-41fc-b691-51d51879e947 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:04.096772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df94d5f1-3100-41fc-b691-51d51879e947 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:04.098045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df94d5f1-3100-41fc-b691-51d51879e947 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:04.098759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df94d5f1-3100-41fc-b691-51d51879e947 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:04.111899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-df94d5f1-3100-41fc-b691-51d51879e947 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:05.009476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-df94d5f1-3100-41fc-b691-51d51879e947 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:05.022325 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-df94d5f1-3100-41fc-b691-51d51879e947 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1690 microversion: 2.1 time: 0.950448 Aug 23 18:31:05.023480 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3304/6472] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:04 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1690 bytes in 953 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:06.051901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-556211b0-105f-45b6-b9d2-a7a6a6535840 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:06.053828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-556211b0-105f-45b6-b9d2-a7a6a6535840 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:06.072346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-556211b0-105f-45b6-b9d2-a7a6a6535840 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:06.074859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-556211b0-105f-45b6-b9d2-a7a6a6535840 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:06.076509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-556211b0-105f-45b6-b9d2-a7a6a6535840 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:06.078410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-556211b0-105f-45b6-b9d2-a7a6a6535840 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:06.087474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-556211b0-105f-45b6-b9d2-a7a6a6535840 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:06.088205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-556211b0-105f-45b6-b9d2-a7a6a6535840 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:06.752475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-556211b0-105f-45b6-b9d2-a7a6a6535840 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:06.762364 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-556211b0-105f-45b6-b9d2-a7a6a6535840 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1690 microversion: 2.1 time: 0.715218 Aug 23 18:31:06.765181 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3169/6473] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:06 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1690 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:07.284210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-9dd15596-2497-4c76-ab71-c1d2ef79cc12 req-ed1442ab-e06f-42b9-bf3e-807de8463739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61d51053-cb2c-4787-b36d-8e1c7801712e", "name": "network-vif-deleted", "tag": "7b042a88-e07a-4fdc-9a3c-220fb49a38b4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:31:07.307753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9dd15596-2497-4c76-ab71-c1d2ef79cc12 req-ed1442ab-e06f-42b9-bf3e-807de8463739 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:07.310441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9dd15596-2497-4c76-ab71-c1d2ef79cc12 req-ed1442ab-e06f-42b9-bf3e-807de8463739 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:07.310922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9dd15596-2497-4c76-ab71-c1d2ef79cc12 req-ed1442ab-e06f-42b9-bf3e-807de8463739 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:07.351334 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-9dd15596-2497-4c76-ab71-c1d2ef79cc12 req-ed1442ab-e06f-42b9-bf3e-807de8463739 service nova] Creating event network-vif-deleted:7b042a88-e07a-4fdc-9a3c-220fb49a38b4 for instance 61d51053-cb2c-4787-b36d-8e1c7801712e on n-h1-850468-16 Aug 23 18:31:07.368371 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-9dd15596-2497-4c76-ab71-c1d2ef79cc12 req-ed1442ab-e06f-42b9-bf3e-807de8463739 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089696 Aug 23 18:31:07.369843 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3305/6474] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:31:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:31:07.807470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:07.810056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:07.823169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:07.825505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:07.827641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:07.831064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:07.832524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:07.833756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:07.930588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:07.931106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:07.936587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:07.937104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lazy-loading 'fault' on Instance uuid 61d51053-cb2c-4787-b36d-8e1c7801712e {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:31:08.053289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:08.069557 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3aae7264-264c-450d-bf52-e0282bf1b3f8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 200 len: 1357 microversion: 2.1 time: 0.270504 Aug 23 18:31:08.075136 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3170/6475] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:07 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 1357 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:09.093603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3fbaff6f-4756-43da-85c9-687f562392d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:09.095063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3fbaff6f-4756-43da-85c9-687f562392d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 61d51053-cb2c-4787-b36d-8e1c7801712e] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:09.103475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbaff6f-4756-43da-85c9-687f562392d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:09.104223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbaff6f-4756-43da-85c9-687f562392d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:09.104899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbaff6f-4756-43da-85c9-687f562392d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:09.106581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbaff6f-4756-43da-85c9-687f562392d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:09.107296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbaff6f-4756-43da-85c9-687f562392d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:09.107980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbaff6f-4756-43da-85c9-687f562392d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:09.125465 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-3fbaff6f-4756-43da-85c9-687f562392d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] HTTP exception thrown: Instance 61d51053-cb2c-4787-b36d-8e1c7801712e could not be found. Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3fbaff6f-4756-43da-85c9-687f562392d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Request method failure captured: Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e HTTP/1.1 Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRsdVVhpR5RMU_geeBK-NR3GIvIqLdesK6DUhp09zpynAbw0X6UfFtmOOX54Hda9Mc0jqJQ7C8EEh5MjgiSeR67w9GmLZU6f4UNZ39ll_bkclo_Oe7CkkS9H6snKI3zqjko4iBZoZ7CUVY6hBlmSeyIEToW2Imz7W3zNDzyrYaOVrRo Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: c3be0a88f743407f9f59a08be6b73a5e Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-301903974 Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c3be0a88f743407f9f59a08be6b73a5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c3be0a88f743407f9f59a08be6b73a5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c3be0a88f743407f9f59a08be6b73a5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c3be0a88f743407f9f59a08be6b73a5e"}]}] Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestNetworkAdvancedServerOps-301903974 Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: c3be0a88f743407f9f59a08be6b73a5e Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-301903974 Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestNetworkAdvancedServerOps-301903974-project Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 399d321c5f564e8ba9d3e1ed7ae05184 Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestNetworkAdvancedServerOps-301903974-project Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 61d51053-cb2c-4787-b36d-8e1c7801712e could not be found. Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '61d51053-cb2c-4787-b36d-8e1c7801712e'} Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61d51053-cb2c-4787-b36d-8e1c7801712e could not be found. Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61d51053-cb2c-4787-b36d-8e1c7801712e could not be found. Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:31:09.128293 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:31:09.131961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:31:09.131961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:31:09.131961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:31:09.131961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:31:09.131961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:31:09.131961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:31:09.131961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61d51053-cb2c-4787-b36d-8e1c7801712e could not be found. Aug 23 18:31:09.131961 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:31:09.131961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3fbaff6f-4756-43da-85c9-687f562392d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Returning 404 to user: Instance 61d51053-cb2c-4787-b36d-8e1c7801712e could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:31:09.131961 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3fbaff6f-4756-43da-85c9-687f562392d2 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e" status: 404 len: 111 microversion: 2.1 time: 0.040748 Aug 23 18:31:09.133778 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3306/6476] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:09 2022] GET /compute/v2.1/servers/61d51053-cb2c-4787-b36d-8e1c7801712e => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:31:14.370948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0815b72b-cdd6-454b-b844-fff3ee94ced9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '.version_select at 0x7f27dfaf69d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:14.422844 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0815b72b-cdd6-454b-b844-fff3ee94ced9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1628359249" status: 202 len: 0 microversion: 2.1 time: 0.052026 Aug 23 18:31:14.442095 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3171/6477] 10.222.0.61 () {58 vars in 1284 bytes} [Tue Aug 23 18:31:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1628359249 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:31:14.478216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f85dde91-1c46-475f-8f7b-071278063716 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'create', calling method: .version_select at 0x7f27ec891790>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1560871564", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJTh7YNVSCPQ8ET4u2c/LyLNvhaaHnTonagP3vMZVdu2bLOHpTGcOToPBezakfl8btyZltumo/tAXKPDide2GcJlx7yHrCq7fegp0Jysb9CGCkEQbHqxBHT2GSAO0lQNg=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:31:14.511273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f85dde91-1c46-475f-8f7b-071278063716 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:31:14.525252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-f85dde91-1c46-475f-8f7b-071278063716 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for user 399d321c5f564e8ba9d3e1ed7ae05184 and project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:31:14.565184 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f85dde91-1c46-475f-8f7b-071278063716 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.090783 Aug 23 18:31:14.566082 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3307/6478] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:31:14 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:31:27.679510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1245128322", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "aacad9d3-5d7b-4b19-a21f-6c74586687cf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1560871564", "security_groups": [{"name": "tempest-secgroup-smoke-1428081924"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:31:27.710942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:27.713066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:28.480559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] validate_networks() for [('aacad9d3-5d7b-4b19-a21f-6c74586687cf', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:31:30.654282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:31:30.655626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:31:30.657335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:31:30.657762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:31:30.658193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:31:30.673332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:30.673802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:30.674707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:30.677376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:30.678238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:30.684418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:30.733328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:31:30.741974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for user 399d321c5f564e8ba9d3e1ed7ae05184 and project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:31:30.775745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:31:30.779019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:31:30.895742 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ddb8f6de-e66f-418f-8551-f50612620444 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 3.232963 Aug 23 18:31:30.903909 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3172/6479] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:31:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 3241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:31:30.906166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=18 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:30.907175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:30.908046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:30.913527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-58c36ec3-ff61-4c5c-806b-5aee1ab130e0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:30.914299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-58c36ec3-ff61-4c5c-806b-5aee1ab130e0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:31.056754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-58c36ec3-ff61-4c5c-806b-5aee1ab130e0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:31.072584 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-58c36ec3-ff61-4c5c-806b-5aee1ab130e0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1267 microversion: 2.1 time: 0.168231 Aug 23 18:31:31.075313 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3308/6480] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:30 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:31:32.110374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cc86e25-44fc-4c66-aea0-155438126d5f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:32.111177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0cc86e25-44fc-4c66-aea0-155438126d5f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:32.141478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cc86e25-44fc-4c66-aea0-155438126d5f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:32.152343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cc86e25-44fc-4c66-aea0-155438126d5f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:32.154201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cc86e25-44fc-4c66-aea0-155438126d5f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:32.157451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cc86e25-44fc-4c66-aea0-155438126d5f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:32.169255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cc86e25-44fc-4c66-aea0-155438126d5f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:32.177296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cc86e25-44fc-4c66-aea0-155438126d5f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:32.380025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0cc86e25-44fc-4c66-aea0-155438126d5f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:32.399635 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0cc86e25-44fc-4c66-aea0-155438126d5f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1263 microversion: 2.1 time: 0.300681 Aug 23 18:31:32.400444 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3173/6481] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:32 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1263 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:33.426508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5cad0fc4-3151-4916-b835-87e2b9a760b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:33.427142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5cad0fc4-3151-4916-b835-87e2b9a760b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:33.439704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cad0fc4-3151-4916-b835-87e2b9a760b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:33.440204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cad0fc4-3151-4916-b835-87e2b9a760b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:33.440645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cad0fc4-3151-4916-b835-87e2b9a760b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:33.441352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cad0fc4-3151-4916-b835-87e2b9a760b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:33.441808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cad0fc4-3151-4916-b835-87e2b9a760b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:33.442229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cad0fc4-3151-4916-b835-87e2b9a760b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:33.677359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5cad0fc4-3151-4916-b835-87e2b9a760b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:33.717516 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5cad0fc4-3151-4916-b835-87e2b9a760b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1325 microversion: 2.1 time: 0.295883 Aug 23 18:31:33.731908 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3309/6482] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:33 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1325 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:34.740183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-17514bf7-3a14-4bb6-a73a-5d62031ae893 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:34.740803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-17514bf7-3a14-4bb6-a73a-5d62031ae893 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:34.759380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17514bf7-3a14-4bb6-a73a-5d62031ae893 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:34.759943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17514bf7-3a14-4bb6-a73a-5d62031ae893 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:34.760403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17514bf7-3a14-4bb6-a73a-5d62031ae893 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:34.768160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17514bf7-3a14-4bb6-a73a-5d62031ae893 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:34.769248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17514bf7-3a14-4bb6-a73a-5d62031ae893 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:34.771082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17514bf7-3a14-4bb6-a73a-5d62031ae893 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:35.052928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-17514bf7-3a14-4bb6-a73a-5d62031ae893 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:35.065265 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-17514bf7-3a14-4bb6-a73a-5d62031ae893 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1325 microversion: 2.1 time: 0.329279 Aug 23 18:31:35.065891 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3174/6483] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:34 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1325 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:31:36.094596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e0fc6b31-7fc3-4caf-8d4c-eb7956806efe tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:36.096045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e0fc6b31-7fc3-4caf-8d4c-eb7956806efe tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:36.123961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0fc6b31-7fc3-4caf-8d4c-eb7956806efe tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:36.127497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0fc6b31-7fc3-4caf-8d4c-eb7956806efe tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:36.132616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0fc6b31-7fc3-4caf-8d4c-eb7956806efe tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:36.135136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0fc6b31-7fc3-4caf-8d4c-eb7956806efe tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:36.137583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0fc6b31-7fc3-4caf-8d4c-eb7956806efe tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:36.138415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0fc6b31-7fc3-4caf-8d4c-eb7956806efe tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:36.364469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-40208dbf-df92-42ae-a393-56b91ee50cb5 req-cc2ec9cf-c984-45ab-8aa1-a3fc7f40013d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec047e74-f554-4c31-b2e4-7ee0ebc4a044", "tag": "80a31b9b-188e-47c3-8a35-ebf3e78b7b36"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:31:36.380276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e0fc6b31-7fc3-4caf-8d4c-eb7956806efe tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:36.392156 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e0fc6b31-7fc3-4caf-8d4c-eb7956806efe tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1393 microversion: 2.1 time: 0.306579 Aug 23 18:31:36.406439 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3310/6484] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:36 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1393 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:36.407823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-40208dbf-df92-42ae-a393-56b91ee50cb5 req-cc2ec9cf-c984-45ab-8aa1-a3fc7f40013d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:36.408431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-40208dbf-df92-42ae-a393-56b91ee50cb5 req-cc2ec9cf-c984-45ab-8aa1-a3fc7f40013d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:36.408975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-40208dbf-df92-42ae-a393-56b91ee50cb5 req-cc2ec9cf-c984-45ab-8aa1-a3fc7f40013d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:36.443286 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-40208dbf-df92-42ae-a393-56b91ee50cb5 req-cc2ec9cf-c984-45ab-8aa1-a3fc7f40013d service nova] Creating event network-changed:80a31b9b-188e-47c3-8a35-ebf3e78b7b36 for instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 on n-h2-850468-16 Aug 23 18:31:36.456401 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-40208dbf-df92-42ae-a393-56b91ee50cb5 req-cc2ec9cf-c984-45ab-8aa1-a3fc7f40013d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098166 Aug 23 18:31:36.457665 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3175/6485] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:31:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:31:37.413549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce6fc813-0244-4973-b024-a4df4b38a503 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:37.414869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ce6fc813-0244-4973-b024-a4df4b38a503 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:37.424435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce6fc813-0244-4973-b024-a4df4b38a503 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:37.425150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce6fc813-0244-4973-b024-a4df4b38a503 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:37.425819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce6fc813-0244-4973-b024-a4df4b38a503 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:37.426777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce6fc813-0244-4973-b024-a4df4b38a503 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:37.427442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce6fc813-0244-4973-b024-a4df4b38a503 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:37.428074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce6fc813-0244-4973-b024-a4df4b38a503 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:37.661456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ce6fc813-0244-4973-b024-a4df4b38a503 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:37.670565 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce6fc813-0244-4973-b024-a4df4b38a503 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1393 microversion: 2.1 time: 0.261165 Aug 23 18:31:37.671850 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3311/6486] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:37 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1393 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:38.695679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c91a206-557f-4cad-abb6-6b8c321293b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:38.696389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5c91a206-557f-4cad-abb6-6b8c321293b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:38.704767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c91a206-557f-4cad-abb6-6b8c321293b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:38.705529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c91a206-557f-4cad-abb6-6b8c321293b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:38.706483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c91a206-557f-4cad-abb6-6b8c321293b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:38.707526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c91a206-557f-4cad-abb6-6b8c321293b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:38.708167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c91a206-557f-4cad-abb6-6b8c321293b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:38.709259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5c91a206-557f-4cad-abb6-6b8c321293b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:38.892493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5c91a206-557f-4cad-abb6-6b8c321293b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:38.909998 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5c91a206-557f-4cad-abb6-6b8c321293b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1393 microversion: 2.1 time: 0.219576 Aug 23 18:31:38.910666 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3176/6487] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:38 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1393 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:39.936756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ab6d9554-92e1-42d2-b944-9491832459be tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:39.937588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab6d9554-92e1-42d2-b944-9491832459be tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:39.946064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab6d9554-92e1-42d2-b944-9491832459be tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:39.947029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab6d9554-92e1-42d2-b944-9491832459be tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:39.947912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab6d9554-92e1-42d2-b944-9491832459be tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:39.949757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab6d9554-92e1-42d2-b944-9491832459be tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:39.950593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab6d9554-92e1-42d2-b944-9491832459be tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:39.951419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab6d9554-92e1-42d2-b944-9491832459be tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:40.156818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ab6d9554-92e1-42d2-b944-9491832459be tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:40.167093 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ab6d9554-92e1-42d2-b944-9491832459be tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1393 microversion: 2.1 time: 0.235009 Aug 23 18:31:40.168186 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3312/6488] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:39 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1393 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:41.195719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cb3a53c6-c4cc-4122-a3b6-90d2dd4c8b75 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:41.197095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cb3a53c6-c4cc-4122-a3b6-90d2dd4c8b75 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:41.205393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:41.206156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:41.209181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3a53c6-c4cc-4122-a3b6-90d2dd4c8b75 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:41.209181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3a53c6-c4cc-4122-a3b6-90d2dd4c8b75 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:41.209181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3a53c6-c4cc-4122-a3b6-90d2dd4c8b75 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:41.210220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3a53c6-c4cc-4122-a3b6-90d2dd4c8b75 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:41.211097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3a53c6-c4cc-4122-a3b6-90d2dd4c8b75 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:41.211258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb3a53c6-c4cc-4122-a3b6-90d2dd4c8b75 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:41.424101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cb3a53c6-c4cc-4122-a3b6-90d2dd4c8b75 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:41.442999 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cb3a53c6-c4cc-4122-a3b6-90d2dd4c8b75 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1393 microversion: 2.1 time: 0.252903 Aug 23 18:31:41.443749 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3177/6489] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:41 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1393 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:42.465740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eddd48f9-4625-4361-9b6f-9a3d49c55e25 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:42.466531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eddd48f9-4625-4361-9b6f-9a3d49c55e25 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:42.481445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:42.481445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eddd48f9-4625-4361-9b6f-9a3d49c55e25 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:42.483868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eddd48f9-4625-4361-9b6f-9a3d49c55e25 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:42.484409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eddd48f9-4625-4361-9b6f-9a3d49c55e25 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:42.485164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eddd48f9-4625-4361-9b6f-9a3d49c55e25 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:42.485645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eddd48f9-4625-4361-9b6f-9a3d49c55e25 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:42.486088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eddd48f9-4625-4361-9b6f-9a3d49c55e25 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:42.509437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1e73e3e8-2a3f-46f0-9e7a-787e72a2faec req-a367c78a-8f56-44c6-a88e-d0b96ddad3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec047e74-f554-4c31-b2e4-7ee0ebc4a044", "name": "network-vif-plugged", "status": "completed", "tag": "80a31b9b-188e-47c3-8a35-ebf3e78b7b36"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:31:42.536236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1e73e3e8-2a3f-46f0-9e7a-787e72a2faec req-a367c78a-8f56-44c6-a88e-d0b96ddad3e8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:42.536946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1e73e3e8-2a3f-46f0-9e7a-787e72a2faec req-a367c78a-8f56-44c6-a88e-d0b96ddad3e8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:42.537593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1e73e3e8-2a3f-46f0-9e7a-787e72a2faec req-a367c78a-8f56-44c6-a88e-d0b96ddad3e8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:42.596985 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1e73e3e8-2a3f-46f0-9e7a-787e72a2faec req-a367c78a-8f56-44c6-a88e-d0b96ddad3e8 service nova] Creating event network-vif-plugged:80a31b9b-188e-47c3-8a35-ebf3e78b7b36 for instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 on n-h2-850468-16 Aug 23 18:31:42.610467 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1e73e3e8-2a3f-46f0-9e7a-787e72a2faec req-a367c78a-8f56-44c6-a88e-d0b96ddad3e8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105055 Aug 23 18:31:42.611532 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3178/6490] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:31:42.779049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eddd48f9-4625-4361-9b6f-9a3d49c55e25 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:42.788506 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eddd48f9-4625-4361-9b6f-9a3d49c55e25 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1393 microversion: 2.1 time: 0.327626 Aug 23 18:31:42.806030 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3313/6491] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:42 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1393 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:43.816344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed54638a-d8f4-4bf6-a294-cbba88b42909 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:43.817166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ed54638a-d8f4-4bf6-a294-cbba88b42909 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:43.825248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed54638a-d8f4-4bf6-a294-cbba88b42909 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:43.825974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed54638a-d8f4-4bf6-a294-cbba88b42909 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:43.826514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed54638a-d8f4-4bf6-a294-cbba88b42909 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:43.827330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed54638a-d8f4-4bf6-a294-cbba88b42909 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:43.828033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed54638a-d8f4-4bf6-a294-cbba88b42909 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:43.828548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed54638a-d8f4-4bf6-a294-cbba88b42909 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:43.998473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ed54638a-d8f4-4bf6-a294-cbba88b42909 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:44.007478 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ed54638a-d8f4-4bf6-a294-cbba88b42909 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1393 microversion: 2.1 time: 0.197719 Aug 23 18:31:44.008367 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3179/6492] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:43 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1393 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:44.595333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9244b861-1216-4834-9dfa-e79f40ec6500 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:44.598359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9244b861-1216-4834-9dfa-e79f40ec6500 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:44.606099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9244b861-1216-4834-9dfa-e79f40ec6500 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:44.606608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9244b861-1216-4834-9dfa-e79f40ec6500 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:44.607252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9244b861-1216-4834-9dfa-e79f40ec6500 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:44.608161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9244b861-1216-4834-9dfa-e79f40ec6500 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:44.608807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9244b861-1216-4834-9dfa-e79f40ec6500 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:44.609438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9244b861-1216-4834-9dfa-e79f40ec6500 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:44.645821 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9244b861-1216-4834-9dfa-e79f40ec6500 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054961 Aug 23 18:31:44.646734 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3314/6493] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:31:44 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:31:44.733071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5732bbc-c22a-45c8-95e6-af1a86e2dd28 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:44.733561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a5732bbc-c22a-45c8-95e6-af1a86e2dd28 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:44.742905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5732bbc-c22a-45c8-95e6-af1a86e2dd28 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:44.743593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5732bbc-c22a-45c8-95e6-af1a86e2dd28 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:44.744253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5732bbc-c22a-45c8-95e6-af1a86e2dd28 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:44.746721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5732bbc-c22a-45c8-95e6-af1a86e2dd28 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:44.748403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5732bbc-c22a-45c8-95e6-af1a86e2dd28 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:44.749787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5732bbc-c22a-45c8-95e6-af1a86e2dd28 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:44.784584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a5732bbc-c22a-45c8-95e6-af1a86e2dd28 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:31:44.919477 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a5732bbc-c22a-45c8-95e6-af1a86e2dd28 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "DELETE /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 204 len: 0 microversion: 2.1 time: 0.191056 Aug 23 18:31:44.924968 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3180/6494] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:31:44 2022] DELETE /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:31:44.930388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a40d80d-b4e5-4485-947d-b77fe5493cb1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:44.931096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6a40d80d-b4e5-4485-947d-b77fe5493cb1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:44.943962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a40d80d-b4e5-4485-947d-b77fe5493cb1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:44.944454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a40d80d-b4e5-4485-947d-b77fe5493cb1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:44.945238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a40d80d-b4e5-4485-947d-b77fe5493cb1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:44.946283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a40d80d-b4e5-4485-947d-b77fe5493cb1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:44.946772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a40d80d-b4e5-4485-947d-b77fe5493cb1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:44.947197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a40d80d-b4e5-4485-947d-b77fe5493cb1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:45.032115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cda47324-ff0b-4482-a0bb-42e2292002da tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:45.033142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cda47324-ff0b-4482-a0bb-42e2292002da tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:45.040919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cda47324-ff0b-4482-a0bb-42e2292002da tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:45.041676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cda47324-ff0b-4482-a0bb-42e2292002da tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:45.046979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cda47324-ff0b-4482-a0bb-42e2292002da tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:45.046979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cda47324-ff0b-4482-a0bb-42e2292002da tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:45.046979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cda47324-ff0b-4482-a0bb-42e2292002da tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:45.056727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cda47324-ff0b-4482-a0bb-42e2292002da tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:45.157709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6a40d80d-b4e5-4485-947d-b77fe5493cb1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:45.170789 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6a40d80d-b4e5-4485-947d-b77fe5493cb1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1675 microversion: 2.1 time: 0.244092 Aug 23 18:31:45.171522 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3315/6495] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:44 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1675 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:45.269008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cda47324-ff0b-4482-a0bb-42e2292002da tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:45.279677 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cda47324-ff0b-4482-a0bb-42e2292002da tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1564 microversion: 2.1 time: 0.252417 Aug 23 18:31:45.279677 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3181/6496] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:45 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1564 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:31:45.299522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f75b7661-77e9-4d11-bbe1-3cc6fcc33b63 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:45.300134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f75b7661-77e9-4d11-bbe1-3cc6fcc33b63 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:45.306313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f75b7661-77e9-4d11-bbe1-3cc6fcc33b63 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:45.307016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f75b7661-77e9-4d11-bbe1-3cc6fcc33b63 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:45.307986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f75b7661-77e9-4d11-bbe1-3cc6fcc33b63 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:45.309137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f75b7661-77e9-4d11-bbe1-3cc6fcc33b63 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:45.310249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f75b7661-77e9-4d11-bbe1-3cc6fcc33b63 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:45.310905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f75b7661-77e9-4d11-bbe1-3cc6fcc33b63 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:45.491952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f75b7661-77e9-4d11-bbe1-3cc6fcc33b63 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:45.502466 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f75b7661-77e9-4d11-bbe1-3cc6fcc33b63 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1564 microversion: 2.1 time: 0.206584 Aug 23 18:31:45.503384 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3316/6497] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:45 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1564 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:46.588158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6adfaf95-102d-4a73-9788-d1cc1711974a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:46.588742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6adfaf95-102d-4a73-9788-d1cc1711974a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:46.596501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6adfaf95-102d-4a73-9788-d1cc1711974a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:46.597130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6adfaf95-102d-4a73-9788-d1cc1711974a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:46.597570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6adfaf95-102d-4a73-9788-d1cc1711974a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:46.598281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6adfaf95-102d-4a73-9788-d1cc1711974a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:46.598850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6adfaf95-102d-4a73-9788-d1cc1711974a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:46.599277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6adfaf95-102d-4a73-9788-d1cc1711974a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:46.889267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6adfaf95-102d-4a73-9788-d1cc1711974a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:46.929126 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6adfaf95-102d-4a73-9788-d1cc1711974a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1675 microversion: 2.1 time: 0.739812 Aug 23 18:31:46.931113 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3182/6498] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:46 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1675 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:47.964191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8640743a-1456-4530-b541-2b08c3ca7c56 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:47.967275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8640743a-1456-4530-b541-2b08c3ca7c56 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:47.992899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8640743a-1456-4530-b541-2b08c3ca7c56 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:47.995756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8640743a-1456-4530-b541-2b08c3ca7c56 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:48.001692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8640743a-1456-4530-b541-2b08c3ca7c56 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:48.007719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8640743a-1456-4530-b541-2b08c3ca7c56 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:48.008364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8640743a-1456-4530-b541-2b08c3ca7c56 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:48.008933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8640743a-1456-4530-b541-2b08c3ca7c56 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:48.053145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-351ad847-a321-4af0-8e2f-7094077ece48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:48.053753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-351ad847-a321-4af0-8e2f-7094077ece48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:48.081277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-351ad847-a321-4af0-8e2f-7094077ece48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:48.081781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-351ad847-a321-4af0-8e2f-7094077ece48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:48.082230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-351ad847-a321-4af0-8e2f-7094077ece48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:48.082988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-351ad847-a321-4af0-8e2f-7094077ece48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:48.083453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-351ad847-a321-4af0-8e2f-7094077ece48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:48.085351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-351ad847-a321-4af0-8e2f-7094077ece48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:48.361555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8640743a-1456-4530-b541-2b08c3ca7c56 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:48.371258 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8640743a-1456-4530-b541-2b08c3ca7c56 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1675 microversion: 2.1 time: 0.420616 Aug 23 18:31:48.373513 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3317/6499] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:47 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1675 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:48.380449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3df0a5de-4d82-4124-871d-e042c856e266 req-b8307d5a-c1f7-47ff-810a-3d3f643e6907 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec047e74-f554-4c31-b2e4-7ee0ebc4a044", "tag": "80a31b9b-188e-47c3-8a35-ebf3e78b7b36"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:31:48.398744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3df0a5de-4d82-4124-871d-e042c856e266 req-b8307d5a-c1f7-47ff-810a-3d3f643e6907 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:48.399903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3df0a5de-4d82-4124-871d-e042c856e266 req-b8307d5a-c1f7-47ff-810a-3d3f643e6907 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:48.401672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3df0a5de-4d82-4124-871d-e042c856e266 req-b8307d5a-c1f7-47ff-810a-3d3f643e6907 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:48.420868 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3df0a5de-4d82-4124-871d-e042c856e266 req-b8307d5a-c1f7-47ff-810a-3d3f643e6907 service nova] Creating event network-changed:80a31b9b-188e-47c3-8a35-ebf3e78b7b36 for instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 on n-h2-850468-16 Aug 23 18:31:48.428704 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3df0a5de-4d82-4124-871d-e042c856e266 req-b8307d5a-c1f7-47ff-810a-3d3f643e6907 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053691 Aug 23 18:31:48.430231 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3318/6500] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:31:48.432185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-351ad847-a321-4af0-8e2f-7094077ece48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:48.443188 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-351ad847-a321-4af0-8e2f-7094077ece48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1564 microversion: 2.1 time: 0.394100 Aug 23 18:31:48.443699 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3183/6501] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:48 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1564 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:49.406513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ddb3a75d-1e41-4202-b151-c191b3b86e22 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:49.411280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ddb3a75d-1e41-4202-b151-c191b3b86e22 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:49.433133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb3a75d-1e41-4202-b151-c191b3b86e22 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:49.434111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb3a75d-1e41-4202-b151-c191b3b86e22 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:49.434789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb3a75d-1e41-4202-b151-c191b3b86e22 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:49.436242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb3a75d-1e41-4202-b151-c191b3b86e22 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:49.436877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb3a75d-1e41-4202-b151-c191b3b86e22 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:49.439709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ddb3a75d-1e41-4202-b151-c191b3b86e22 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:49.553190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ddb3a75d-1e41-4202-b151-c191b3b86e22 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:49.564234 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ddb3a75d-1e41-4202-b151-c191b3b86e22 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1607 microversion: 2.1 time: 0.165425 Aug 23 18:31:49.566083 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3319/6502] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:49 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1607 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:50.502378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-65cf7213-8487-4956-8396-543d1ed5f863 req-458bcecd-5290-482e-831e-b8bed93b483b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "181bbeec-159b-4f25-91cd-4c1d93687b11", "name": "network-vif-deleted", "tag": "6a63c23d-c13b-4d43-88a3-57f67e68eea7"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:31:50.513867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-65cf7213-8487-4956-8396-543d1ed5f863 req-458bcecd-5290-482e-831e-b8bed93b483b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:50.514613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-65cf7213-8487-4956-8396-543d1ed5f863 req-458bcecd-5290-482e-831e-b8bed93b483b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:50.515194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-65cf7213-8487-4956-8396-543d1ed5f863 req-458bcecd-5290-482e-831e-b8bed93b483b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:50.527232 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-65cf7213-8487-4956-8396-543d1ed5f863 req-458bcecd-5290-482e-831e-b8bed93b483b service nova] Creating event network-vif-deleted:6a63c23d-c13b-4d43-88a3-57f67e68eea7 for instance 181bbeec-159b-4f25-91cd-4c1d93687b11 on n-h1-850468-16 Aug 23 18:31:50.541386 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-65cf7213-8487-4956-8396-543d1ed5f863 req-458bcecd-5290-482e-831e-b8bed93b483b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042984 Aug 23 18:31:50.543063 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3184/6503] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:31:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:31:50.588304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:50.589080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:50.604861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:50.606576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:50.607093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:50.609423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:50.610020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:50.612023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:50.670902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:50.671443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:50.671971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:50.672594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lazy-loading 'fault' on Instance uuid 181bbeec-159b-4f25-91cd-4c1d93687b11 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:31:50.777602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:50.788675 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0aa6f254-47d9-4ad1-bb7f-b6a4e8ef0b6b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 200 len: 1328 microversion: 2.1 time: 0.203998 Aug 23 18:31:50.789812 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3320/6504] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:50 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 1328 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:51.811473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-32723b5d-5133-47c0-8cfe-c6fe31a2e01a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:51.812632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-32723b5d-5133-47c0-8cfe-c6fe31a2e01a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:51.818905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32723b5d-5133-47c0-8cfe-c6fe31a2e01a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:51.819397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32723b5d-5133-47c0-8cfe-c6fe31a2e01a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:51.819842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32723b5d-5133-47c0-8cfe-c6fe31a2e01a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:51.820544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32723b5d-5133-47c0-8cfe-c6fe31a2e01a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:51.821008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32723b5d-5133-47c0-8cfe-c6fe31a2e01a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:51.821439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32723b5d-5133-47c0-8cfe-c6fe31a2e01a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:51.835105 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-32723b5d-5133-47c0-8cfe-c6fe31a2e01a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] HTTP exception thrown: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-32723b5d-5133-47c0-8cfe-c6fe31a2e01a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Request method failure captured: Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 HTTP/1.1 Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRvmCILQzYC7xcMrgx_Z5xSoeSGmidufQQqFkZX71eWkY9zWJvVqZv-AbHJuyltXL09lgxC6zekoiYAWR54NkG9Nqs5dHSK12_fKfUQULzL8xHtxfvQNzvqXJnH0C508CJuTGkuX9cVQfl_kpx6xvnyGflUE5m9UCCLUqLixEDSrHic Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 73c64d353c72438ab1c77f5d6c042cbe Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/73c64d353c72438ab1c77f5d6c042cbe"}]}] Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 73c64d353c72438ab1c77f5d6c042cbe Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeTestJSON-551385409-project Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f84923104c9a4be5801ac8721b3e3e6c Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeTestJSON-551385409-project Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '181bbeec-159b-4f25-91cd-4c1d93687b11'} Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:31:51.836791 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:31:51.845490 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:31:51.845490 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:31:51.845490 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:31:51.845490 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:31:51.845490 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:31:51.845490 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:31:51.845490 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:31:51.845490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-32723b5d-5133-47c0-8cfe-c6fe31a2e01a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Returning 404 to user: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:31:51.845490 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-32723b5d-5133-47c0-8cfe-c6fe31a2e01a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 404 len: 111 microversion: 2.1 time: 0.032610 Aug 23 18:31:51.845490 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3185/6505] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:51 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:31:51.851585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-720b5343-fe2f-443a-9475-9719adb76c2b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '.version_select at 0x7f27ec075dc0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:51.873377 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-720b5343-fe2f-443a-9475-9719adb76c2b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728832838" status: 202 len: 0 microversion: 2.1 time: 0.025880 Aug 23 18:31:51.873974 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3321/6506] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 18:31:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1728832838 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:31:52.589768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e04c157-14ad-4435-9fa0-6ad7ecc2ce4a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Action: 'create', calling method: .version_select at 0x7f27df628430>, body: {"keypair": {"name": "tempest-keypair-2048959482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhR9aoYcWPCoTlnA2xzGOgBS+GaFLuGdAkLUXOPZ0TCUPph+hfkB1NWX6H6mbJvKLuVmzTTy1RdwWnj1wDr5Gt3+9cAHKgo8NewGJMruV5Tiyj4CpTprGzp97lMlpYeOQ=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:31:52.619161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7e04c157-14ad-4435-9fa0-6ad7ecc2ce4a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Getting quotas for project 73c64d353c72438ab1c77f5d6c042cbe. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:31:52.625887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7e04c157-14ad-4435-9fa0-6ad7ecc2ce4a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Getting quotas for user f84923104c9a4be5801ac8721b3e3e6c and project 73c64d353c72438ab1c77f5d6c042cbe. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:31:52.660649 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e04c157-14ad-4435-9fa0-6ad7ecc2ce4a tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.074299 Aug 23 18:31:52.661488 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3186/6507] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:31:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:31:54.462659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1760450830", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c0e2812-9207-4baf-9771-b7859018d73c"}], "security_groups": [{"name": "tempest-securitygroup--1031290531"}], "key_name": "tempest-keypair-2048959482", "user_data": "}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:31:54.582559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] validate_networks() for [('9c0e2812-9207-4baf-9771-b7859018d73c', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:31:55.161014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:31:55.161441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:31:55.161919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:31:55.162332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:31:55.162757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:31:55.172993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:55.173775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:55.174421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:55.175510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:55.176212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:55.176973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:55.197754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Getting quotas for project 73c64d353c72438ab1c77f5d6c042cbe. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:31:55.204869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Getting quotas for user f84923104c9a4be5801ac8721b3e3e6c and project 73c64d353c72438ab1c77f5d6c042cbe. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:31:55.220575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:31:55.223420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:31:55.297311 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-562de4fb-3fb7-4f93-a181-8e9603dc4657 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.839620 Aug 23 18:31:55.298756 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3322/6508] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:31:54 2022] POST /compute/v2.1/servers => generated 402 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:31:55.309707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e4c4c52b-fb61-4ea8-9374-794f5e50fe5b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:55.310460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e4c4c52b-fb61-4ea8-9374-794f5e50fe5b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:55.391560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e4c4c52b-fb61-4ea8-9374-794f5e50fe5b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:55.398557 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e4c4c52b-fb61-4ea8-9374-794f5e50fe5b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1238 microversion: 2.1 time: 0.093213 Aug 23 18:31:55.403140 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3187/6509] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:55 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1238 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:56.421631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-460fc732-8a55-47d5-9eaa-db511c0f9054 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:56.422250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-460fc732-8a55-47d5-9eaa-db511c0f9054 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:56.430041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-460fc732-8a55-47d5-9eaa-db511c0f9054 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:56.430566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-460fc732-8a55-47d5-9eaa-db511c0f9054 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:56.431019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-460fc732-8a55-47d5-9eaa-db511c0f9054 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:56.431741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-460fc732-8a55-47d5-9eaa-db511c0f9054 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:56.432846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-460fc732-8a55-47d5-9eaa-db511c0f9054 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:56.433271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-460fc732-8a55-47d5-9eaa-db511c0f9054 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:56.528064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-460fc732-8a55-47d5-9eaa-db511c0f9054 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:56.537472 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-460fc732-8a55-47d5-9eaa-db511c0f9054 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1290 microversion: 2.1 time: 0.121347 Aug 23 18:31:56.538063 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3323/6510] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:56 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1290 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:57.559543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6c2799c-8ddd-4186-a136-df2090c3d903 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:57.560189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6c2799c-8ddd-4186-a136-df2090c3d903 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:57.567682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6c2799c-8ddd-4186-a136-df2090c3d903 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:57.568260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6c2799c-8ddd-4186-a136-df2090c3d903 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:57.568756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6c2799c-8ddd-4186-a136-df2090c3d903 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:57.569322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6c2799c-8ddd-4186-a136-df2090c3d903 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:57.569831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6c2799c-8ddd-4186-a136-df2090c3d903 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:57.570309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6c2799c-8ddd-4186-a136-df2090c3d903 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:57.687162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f6c2799c-8ddd-4186-a136-df2090c3d903 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:57.725486 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6c2799c-8ddd-4186-a136-df2090c3d903 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1296 microversion: 2.1 time: 0.155306 Aug 23 18:31:57.727908 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3188/6511] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:57 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:31:58.670204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6bec0980-cae3-4fba-b78a-11811fb76174 req-0aeffc7e-752a-40d0-a40b-af68aa94f262 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e3996c-f814-4ec8-8eec-3acd658b2d80", "tag": "ec8a0555-a1c4-4e33-83c6-9a899fe1bddc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:31:58.689767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6bec0980-cae3-4fba-b78a-11811fb76174 req-0aeffc7e-752a-40d0-a40b-af68aa94f262 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:58.692475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6bec0980-cae3-4fba-b78a-11811fb76174 req-0aeffc7e-752a-40d0-a40b-af68aa94f262 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:58.693410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6bec0980-cae3-4fba-b78a-11811fb76174 req-0aeffc7e-752a-40d0-a40b-af68aa94f262 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:58.708745 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6bec0980-cae3-4fba-b78a-11811fb76174 req-0aeffc7e-752a-40d0-a40b-af68aa94f262 service nova] Creating event network-changed:ec8a0555-a1c4-4e33-83c6-9a899fe1bddc for instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 on n-h1-850468-16 Aug 23 18:31:58.719114 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6bec0980-cae3-4fba-b78a-11811fb76174 req-0aeffc7e-752a-40d0-a40b-af68aa94f262 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052968 Aug 23 18:31:58.720265 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3324/6512] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:31:58.757704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cb917b9d-0a79-4979-92cf-c2ccc3074dd4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:31:58.758332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cb917b9d-0a79-4979-92cf-c2ccc3074dd4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:31:58.773558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:58.777812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb917b9d-0a79-4979-92cf-c2ccc3074dd4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:58.778320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb917b9d-0a79-4979-92cf-c2ccc3074dd4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:58.778804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb917b9d-0a79-4979-92cf-c2ccc3074dd4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:58.783712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb917b9d-0a79-4979-92cf-c2ccc3074dd4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:31:58.784215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb917b9d-0a79-4979-92cf-c2ccc3074dd4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:31:58.784663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cb917b9d-0a79-4979-92cf-c2ccc3074dd4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:31:58.814899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:31:59.123725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cb917b9d-0a79-4979-92cf-c2ccc3074dd4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:31:59.168935 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cb917b9d-0a79-4979-92cf-c2ccc3074dd4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1364 microversion: 2.1 time: 0.413660 Aug 23 18:31:59.171633 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3189/6513] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:31:58 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1364 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:00.194944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-620840a2-9c62-4607-a161-5ae51e05b05b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:00.205407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-620840a2-9c62-4607-a161-5ae51e05b05b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:00.224245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-620840a2-9c62-4607-a161-5ae51e05b05b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:00.225103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-620840a2-9c62-4607-a161-5ae51e05b05b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:00.225875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-620840a2-9c62-4607-a161-5ae51e05b05b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:00.226751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-620840a2-9c62-4607-a161-5ae51e05b05b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:00.227675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-620840a2-9c62-4607-a161-5ae51e05b05b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:00.228230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-620840a2-9c62-4607-a161-5ae51e05b05b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:00.435372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-620840a2-9c62-4607-a161-5ae51e05b05b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:00.451550 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-620840a2-9c62-4607-a161-5ae51e05b05b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1364 microversion: 2.1 time: 0.262138 Aug 23 18:32:00.452836 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3325/6514] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:00 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:01.474722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-49429e0f-1782-4a65-970e-b5bc44859e64 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:01.474722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-49429e0f-1782-4a65-970e-b5bc44859e64 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:01.483347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49429e0f-1782-4a65-970e-b5bc44859e64 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:01.483843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49429e0f-1782-4a65-970e-b5bc44859e64 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:01.484286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49429e0f-1782-4a65-970e-b5bc44859e64 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:01.485170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49429e0f-1782-4a65-970e-b5bc44859e64 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:01.485799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49429e0f-1782-4a65-970e-b5bc44859e64 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:01.486237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-49429e0f-1782-4a65-970e-b5bc44859e64 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:01.646169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-49429e0f-1782-4a65-970e-b5bc44859e64 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:01.655941 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-49429e0f-1782-4a65-970e-b5bc44859e64 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1364 microversion: 2.1 time: 0.186444 Aug 23 18:32:01.656788 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3190/6515] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:01 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:02.677603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e9be7f7e-1a1b-4c3e-ab70-d09924c8bcf2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:02.678058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e9be7f7e-1a1b-4c3e-ab70-d09924c8bcf2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:02.680951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=55,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:02.690471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9be7f7e-1a1b-4c3e-ab70-d09924c8bcf2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:02.691080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9be7f7e-1a1b-4c3e-ab70-d09924c8bcf2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:02.691735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9be7f7e-1a1b-4c3e-ab70-d09924c8bcf2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:02.692613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9be7f7e-1a1b-4c3e-ab70-d09924c8bcf2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:02.693249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9be7f7e-1a1b-4c3e-ab70-d09924c8bcf2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:02.693843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9be7f7e-1a1b-4c3e-ab70-d09924c8bcf2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:02.699347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=87 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:02.858379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e9be7f7e-1a1b-4c3e-ab70-d09924c8bcf2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:02.869439 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e9be7f7e-1a1b-4c3e-ab70-d09924c8bcf2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1364 microversion: 2.1 time: 0.195725 Aug 23 18:32:02.879457 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3326/6516] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:02 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1364 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:03.892608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-444a303c-ea3f-4abb-a7b6-079a72fdb521 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:03.893228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-444a303c-ea3f-4abb-a7b6-079a72fdb521 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:03.900615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-444a303c-ea3f-4abb-a7b6-079a72fdb521 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:03.902091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-444a303c-ea3f-4abb-a7b6-079a72fdb521 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:03.902564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-444a303c-ea3f-4abb-a7b6-079a72fdb521 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:03.903284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-444a303c-ea3f-4abb-a7b6-079a72fdb521 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:03.903755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-444a303c-ea3f-4abb-a7b6-079a72fdb521 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:03.904188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-444a303c-ea3f-4abb-a7b6-079a72fdb521 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:04.063941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-444a303c-ea3f-4abb-a7b6-079a72fdb521 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:04.072965 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-444a303c-ea3f-4abb-a7b6-079a72fdb521 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1364 microversion: 2.1 time: 0.184491 Aug 23 18:32:04.074239 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3191/6517] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:03 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:05.095379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-21a2aab1-d04e-4c81-b79f-3d684949bde2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:05.096609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-21a2aab1-d04e-4c81-b79f-3d684949bde2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:05.105787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21a2aab1-d04e-4c81-b79f-3d684949bde2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:05.106534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21a2aab1-d04e-4c81-b79f-3d684949bde2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:05.107180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21a2aab1-d04e-4c81-b79f-3d684949bde2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:05.108111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21a2aab1-d04e-4c81-b79f-3d684949bde2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:05.108736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21a2aab1-d04e-4c81-b79f-3d684949bde2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:05.109329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-21a2aab1-d04e-4c81-b79f-3d684949bde2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:05.189532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:05.213596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:05.306502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-21a2aab1-d04e-4c81-b79f-3d684949bde2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:05.319194 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-21a2aab1-d04e-4c81-b79f-3d684949bde2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1364 microversion: 2.1 time: 0.228709 Aug 23 18:32:05.333663 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3327/6518] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:05 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1364 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:06.341439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-590093f9-33be-43fe-8397-878768fe203f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:06.342488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-590093f9-33be-43fe-8397-878768fe203f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:06.345536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:06.352039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-590093f9-33be-43fe-8397-878768fe203f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:06.352693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-590093f9-33be-43fe-8397-878768fe203f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:06.353279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-590093f9-33be-43fe-8397-878768fe203f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:06.354652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-590093f9-33be-43fe-8397-878768fe203f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:06.355288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-590093f9-33be-43fe-8397-878768fe203f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:06.355891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-590093f9-33be-43fe-8397-878768fe203f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:06.498494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-590093f9-33be-43fe-8397-878768fe203f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:06.508015 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-590093f9-33be-43fe-8397-878768fe203f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1364 microversion: 2.1 time: 0.171507 Aug 23 18:32:06.520721 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3192/6519] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:06 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:06.700046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c63f3a56-bf1c-47ca-a7c6-11ae1958d780 req-aebee283-6e0f-417d-b7a8-42a4664f4f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e3996c-f814-4ec8-8eec-3acd658b2d80", "name": "network-vif-plugged", "status": "completed", "tag": "ec8a0555-a1c4-4e33-83c6-9a899fe1bddc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:32:06.714315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c63f3a56-bf1c-47ca-a7c6-11ae1958d780 req-aebee283-6e0f-417d-b7a8-42a4664f4f4d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:06.715152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c63f3a56-bf1c-47ca-a7c6-11ae1958d780 req-aebee283-6e0f-417d-b7a8-42a4664f4f4d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:06.716083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c63f3a56-bf1c-47ca-a7c6-11ae1958d780 req-aebee283-6e0f-417d-b7a8-42a4664f4f4d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:06.729551 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c63f3a56-bf1c-47ca-a7c6-11ae1958d780 req-aebee283-6e0f-417d-b7a8-42a4664f4f4d service nova] Creating event network-vif-plugged:ec8a0555-a1c4-4e33-83c6-9a899fe1bddc for instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 on n-h1-850468-16 Aug 23 18:32:06.735553 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c63f3a56-bf1c-47ca-a7c6-11ae1958d780 req-aebee283-6e0f-417d-b7a8-42a4664f4f4d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041964 Aug 23 18:32:06.736765 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3328/6520] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:32:07.529773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1b79ea4d-afc6-4bd1-ae63-b17c37fd29f1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:07.530553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1b79ea4d-afc6-4bd1-ae63-b17c37fd29f1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:07.540258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b79ea4d-afc6-4bd1-ae63-b17c37fd29f1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:07.540907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b79ea4d-afc6-4bd1-ae63-b17c37fd29f1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:07.542279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b79ea4d-afc6-4bd1-ae63-b17c37fd29f1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:07.543052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b79ea4d-afc6-4bd1-ae63-b17c37fd29f1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:07.543513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b79ea4d-afc6-4bd1-ae63-b17c37fd29f1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:07.543933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b79ea4d-afc6-4bd1-ae63-b17c37fd29f1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:07.702598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1b79ea4d-afc6-4bd1-ae63-b17c37fd29f1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:07.713291 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1b79ea4d-afc6-4bd1-ae63-b17c37fd29f1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1364 microversion: 2.1 time: 0.188519 Aug 23 18:32:07.714657 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3193/6521] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:07 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1364 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:08.736501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7423f59-d6ad-47e3-be1b-451ddb95247c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:08.737553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d7423f59-d6ad-47e3-be1b-451ddb95247c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:08.744896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7423f59-d6ad-47e3-be1b-451ddb95247c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:08.745506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7423f59-d6ad-47e3-be1b-451ddb95247c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:08.746304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7423f59-d6ad-47e3-be1b-451ddb95247c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:08.747083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7423f59-d6ad-47e3-be1b-451ddb95247c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:08.747553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7423f59-d6ad-47e3-be1b-451ddb95247c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:08.748156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7423f59-d6ad-47e3-be1b-451ddb95247c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:08.887765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7423f59-d6ad-47e3-be1b-451ddb95247c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:08.896542 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7423f59-d6ad-47e3-be1b-451ddb95247c tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1550 microversion: 2.1 time: 0.165343 Aug 23 18:32:08.902097 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3329/6522] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:08 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1550 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:08.918372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e5a09af-809e-4062-abf1-68c585f322da tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:08.918949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e5a09af-809e-4062-abf1-68c585f322da tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:08.927203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e5a09af-809e-4062-abf1-68c585f322da tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:08.927820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e5a09af-809e-4062-abf1-68c585f322da tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:08.928269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e5a09af-809e-4062-abf1-68c585f322da tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:08.928982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e5a09af-809e-4062-abf1-68c585f322da tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:08.929452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e5a09af-809e-4062-abf1-68c585f322da tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:08.929885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e5a09af-809e-4062-abf1-68c585f322da tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:09.016951 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e5a09af-809e-4062-abf1-68c585f322da tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.103168 Aug 23 18:32:09.017593 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3194/6523] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:32:08 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-interface => generated 285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:32:10.132487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-eb825652-79c0-4a0d-842d-fafd9377630f req-9a121e75-926a-4b60-9f37-8e51edf585ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9e3996c-f814-4ec8-8eec-3acd658b2d80", "tag": "ec8a0555-a1c4-4e33-83c6-9a899fe1bddc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:32:10.144071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eb825652-79c0-4a0d-842d-fafd9377630f req-9a121e75-926a-4b60-9f37-8e51edf585ec service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:10.144914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eb825652-79c0-4a0d-842d-fafd9377630f req-9a121e75-926a-4b60-9f37-8e51edf585ec service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:10.145552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eb825652-79c0-4a0d-842d-fafd9377630f req-9a121e75-926a-4b60-9f37-8e51edf585ec service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:10.165950 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-eb825652-79c0-4a0d-842d-fafd9377630f req-9a121e75-926a-4b60-9f37-8e51edf585ec service nova] Creating event network-changed:ec8a0555-a1c4-4e33-83c6-9a899fe1bddc for instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 on n-h1-850468-16 Aug 23 18:32:10.171276 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-eb825652-79c0-4a0d-842d-fafd9377630f req-9a121e75-926a-4b60-9f37-8e51edf585ec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117325 Aug 23 18:32:10.172156 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3330/6524] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:32:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:32:22.975211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=11 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:22.976528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=33 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:22.982002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dbf3d63b-b11f-400c-92d1-8377d47f600a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:32:22.984802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dbf3d63b-b11f-400c-92d1-8377d47f600a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:22.991982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbf3d63b-b11f-400c-92d1-8377d47f600a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:22.992679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbf3d63b-b11f-400c-92d1-8377d47f600a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:22.993127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbf3d63b-b11f-400c-92d1-8377d47f600a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:22.994350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbf3d63b-b11f-400c-92d1-8377d47f600a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:22.995035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbf3d63b-b11f-400c-92d1-8377d47f600a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:22.995670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbf3d63b-b11f-400c-92d1-8377d47f600a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:23.058095 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dbf3d63b-b11f-400c-92d1-8377d47f600a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044/action" status: 200 len: 24573 microversion: 2.1 time: 0.084502 Aug 23 18:32:23.059142 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3195/6525] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:32:22 2022] POST /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044/action => generated 24573 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:32:41.866616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=9 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:41.867270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=21 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:41.872521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae1a3912-9307-48ba-87d3-1767dc8bb794 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Action: 'create', calling method: .version_select at 0x7f27df4a24c0>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1886837130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOLZu1t1zk8NQnoAt1kS/HC1iTyIF9ZdO/Qf6+YahWurTs9vyDLhMfZY9wf0rXjFfRo7tTcLL/n1M9V7Y3PoNXJ4JhV/d/cw7doLClHLlknUrXt12rb4dOyXW5uDojiq0g=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:32:41.891740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ae1a3912-9307-48ba-87d3-1767dc8bb794 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Getting quotas for project ebc15347cda0455cb0024c8f3efbe31b. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:32:41.898703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ae1a3912-9307-48ba-87d3-1767dc8bb794 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Getting quotas for user b5bef17272e24e40a1c51daccb4dd6d6 and project ebc15347cda0455cb0024c8f3efbe31b. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:32:41.933196 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae1a3912-9307-48ba-87d3-1767dc8bb794 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.068604 Aug 23 18:32:41.933813 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3331/6526] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:32:41 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:32:43.106038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-615954239", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "0f718e00-0a32-4720-912a-5f24c1989229", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1886837130", "security_groups": [{"name": "tempest-secgroup-smoke-1521378184"}], "networks": [{"uuid": "f19cd57b-148e-4c36-ba13-29328d3dfc4d"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:32:43.116433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:43.117175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:43.240176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] validate_networks() for [('f19cd57b-148e-4c36-ba13-29328d3dfc4d', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:32:43.697442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:32:43.697861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:32:43.698340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:32:43.698821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:32:43.699238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:32:43.730880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:43.731666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:43.732274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:43.733222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:43.733857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:43.734508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:43.755286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Getting quotas for project ebc15347cda0455cb0024c8f3efbe31b. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:32:43.763011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Getting quotas for user b5bef17272e24e40a1c51daccb4dd6d6 and project ebc15347cda0455cb0024c8f3efbe31b. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:32:43.848052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:32:43.851780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0f718e00-0a32-4720-912a-5f24c1989229',volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:32:44.024191 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d464bed2-3204-4020-89c6-3ce26bd2ba71 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.923017 Aug 23 18:32:44.026019 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3196/6527] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:32:43 2022] POST /compute/v2.1/servers => generated 406 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:32:44.038275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-17b413ef-5b3f-4b4a-9bf9-63ef17486c0a tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:44.039239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-17b413ef-5b3f-4b4a-9bf9-63ef17486c0a tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:44.133296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-17b413ef-5b3f-4b4a-9bf9-63ef17486c0a tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:44.145352 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-17b413ef-5b3f-4b4a-9bf9-63ef17486c0a tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1098 microversion: 2.1 time: 0.112175 Aug 23 18:32:44.158570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3332/6528] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:44 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1098 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:45.170421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc59ad53-2332-4cbd-a6b9-e78d39c1afa8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:45.171067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc59ad53-2332-4cbd-a6b9-e78d39c1afa8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:45.177927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc59ad53-2332-4cbd-a6b9-e78d39c1afa8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:45.178416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc59ad53-2332-4cbd-a6b9-e78d39c1afa8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:45.178886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc59ad53-2332-4cbd-a6b9-e78d39c1afa8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:45.179585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc59ad53-2332-4cbd-a6b9-e78d39c1afa8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:45.180042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc59ad53-2332-4cbd-a6b9-e78d39c1afa8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:45.180495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc59ad53-2332-4cbd-a6b9-e78d39c1afa8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:45.266473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bc59ad53-2332-4cbd-a6b9-e78d39c1afa8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:45.279106 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc59ad53-2332-4cbd-a6b9-e78d39c1afa8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1196 microversion: 2.1 time: 0.112368 Aug 23 18:32:45.280700 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3197/6529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:45 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1196 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:46.303853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-186c5ecd-55eb-4eb2-b3ec-eb687a7a5ca5 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:46.305255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-186c5ecd-55eb-4eb2-b3ec-eb687a7a5ca5 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:46.317344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-186c5ecd-55eb-4eb2-b3ec-eb687a7a5ca5 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:46.318120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-186c5ecd-55eb-4eb2-b3ec-eb687a7a5ca5 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:46.318767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-186c5ecd-55eb-4eb2-b3ec-eb687a7a5ca5 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:46.319822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-186c5ecd-55eb-4eb2-b3ec-eb687a7a5ca5 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:46.321125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-186c5ecd-55eb-4eb2-b3ec-eb687a7a5ca5 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:46.321125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-186c5ecd-55eb-4eb2-b3ec-eb687a7a5ca5 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:46.583235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-186c5ecd-55eb-4eb2-b3ec-eb687a7a5ca5 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:46.592417 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-186c5ecd-55eb-4eb2-b3ec-eb687a7a5ca5 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1282 microversion: 2.1 time: 0.292966 Aug 23 18:32:46.593218 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3333/6530] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:46 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1282 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:47.613354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dae8468e-ad25-43cd-ac78-069f510ea66c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:47.613981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dae8468e-ad25-43cd-ac78-069f510ea66c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:47.633307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dae8468e-ad25-43cd-ac78-069f510ea66c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:47.634781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dae8468e-ad25-43cd-ac78-069f510ea66c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:47.634781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dae8468e-ad25-43cd-ac78-069f510ea66c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:47.635460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dae8468e-ad25-43cd-ac78-069f510ea66c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:47.636130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dae8468e-ad25-43cd-ac78-069f510ea66c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:47.636731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dae8468e-ad25-43cd-ac78-069f510ea66c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:47.815880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-79a906ba-f9ed-4758-a088-61388d75b3dc req-1a60cfce-7bd9-4c66-951f-7dd4d833ca3d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ac4913-d262-468e-9fbe-ae2cdababfff", "tag": "9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:32:47.834786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-79a906ba-f9ed-4758-a088-61388d75b3dc req-1a60cfce-7bd9-4c66-951f-7dd4d833ca3d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:47.835725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-79a906ba-f9ed-4758-a088-61388d75b3dc req-1a60cfce-7bd9-4c66-951f-7dd4d833ca3d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:47.837917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-79a906ba-f9ed-4758-a088-61388d75b3dc req-1a60cfce-7bd9-4c66-951f-7dd4d833ca3d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:47.857524 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-79a906ba-f9ed-4758-a088-61388d75b3dc req-1a60cfce-7bd9-4c66-951f-7dd4d833ca3d service nova] Creating event network-changed:9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0 for instance e7ac4913-d262-468e-9fbe-ae2cdababfff on n-h2-850468-16 Aug 23 18:32:47.879385 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-79a906ba-f9ed-4758-a088-61388d75b3dc req-1a60cfce-7bd9-4c66-951f-7dd4d833ca3d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.355564 Aug 23 18:32:47.880043 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3198/6531] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:32:47.924199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dae8468e-ad25-43cd-ac78-069f510ea66c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:47.934312 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dae8468e-ad25-43cd-ac78-069f510ea66c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1282 microversion: 2.1 time: 0.324952 Aug 23 18:32:47.940516 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3334/6532] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:47 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1282 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:32:48.957762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f2c2e321-5122-4f49-944c-d226e4445f44 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:48.958509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f2c2e321-5122-4f49-944c-d226e4445f44 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:48.967327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c2e321-5122-4f49-944c-d226e4445f44 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:48.967964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c2e321-5122-4f49-944c-d226e4445f44 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:48.968600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c2e321-5122-4f49-944c-d226e4445f44 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:48.969322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c2e321-5122-4f49-944c-d226e4445f44 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:48.969774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c2e321-5122-4f49-944c-d226e4445f44 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:48.970201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2c2e321-5122-4f49-944c-d226e4445f44 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:49.153484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f2c2e321-5122-4f49-944c-d226e4445f44 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:49.162337 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f2c2e321-5122-4f49-944c-d226e4445f44 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1282 microversion: 2.1 time: 0.210537 Aug 23 18:32:49.163441 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3199/6533] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:48 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1282 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:50.187662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1eaf2f95-2522-4ee7-94f4-3e8201d6d503 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:50.188284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1eaf2f95-2522-4ee7-94f4-3e8201d6d503 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:50.195735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1eaf2f95-2522-4ee7-94f4-3e8201d6d503 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:50.197081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1eaf2f95-2522-4ee7-94f4-3e8201d6d503 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:50.197793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1eaf2f95-2522-4ee7-94f4-3e8201d6d503 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:50.198655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1eaf2f95-2522-4ee7-94f4-3e8201d6d503 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:50.199318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1eaf2f95-2522-4ee7-94f4-3e8201d6d503 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:50.199846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1eaf2f95-2522-4ee7-94f4-3e8201d6d503 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:50.364727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1eaf2f95-2522-4ee7-94f4-3e8201d6d503 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:50.373204 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1eaf2f95-2522-4ee7-94f4-3e8201d6d503 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1282 microversion: 2.1 time: 0.189452 Aug 23 18:32:50.373799 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3335/6534] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:50 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1282 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:51.395393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-69284f53-37d8-4611-92fa-30d0f7ef6dab tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:51.396013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-69284f53-37d8-4611-92fa-30d0f7ef6dab tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:51.404005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69284f53-37d8-4611-92fa-30d0f7ef6dab tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:51.404505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69284f53-37d8-4611-92fa-30d0f7ef6dab tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:51.404943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69284f53-37d8-4611-92fa-30d0f7ef6dab tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:51.405649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69284f53-37d8-4611-92fa-30d0f7ef6dab tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:51.406107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69284f53-37d8-4611-92fa-30d0f7ef6dab tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:51.406557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69284f53-37d8-4611-92fa-30d0f7ef6dab tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:51.574298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-69284f53-37d8-4611-92fa-30d0f7ef6dab tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:51.586340 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-69284f53-37d8-4611-92fa-30d0f7ef6dab tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1282 microversion: 2.1 time: 0.195089 Aug 23 18:32:51.595686 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3200/6535] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:51 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1282 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:52.616185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-55ad337e-b61b-42c4-b672-1ace387da23c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:52.617092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-55ad337e-b61b-42c4-b672-1ace387da23c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:52.626056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55ad337e-b61b-42c4-b672-1ace387da23c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:52.627348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55ad337e-b61b-42c4-b672-1ace387da23c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:52.627917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55ad337e-b61b-42c4-b672-1ace387da23c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:52.629129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55ad337e-b61b-42c4-b672-1ace387da23c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:52.629657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55ad337e-b61b-42c4-b672-1ace387da23c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:52.630153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-55ad337e-b61b-42c4-b672-1ace387da23c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:52.775444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-55ad337e-b61b-42c4-b672-1ace387da23c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:52.783400 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-55ad337e-b61b-42c4-b672-1ace387da23c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1282 microversion: 2.1 time: 0.171350 Aug 23 18:32:52.783978 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3336/6536] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:52 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:53.813616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c2417941-4439-4fc5-a7b2-51555d356afe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:53.814322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c2417941-4439-4fc5-a7b2-51555d356afe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:53.818770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:53.819679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:53.825086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2417941-4439-4fc5-a7b2-51555d356afe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:53.825610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2417941-4439-4fc5-a7b2-51555d356afe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:53.826052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2417941-4439-4fc5-a7b2-51555d356afe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:53.826856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2417941-4439-4fc5-a7b2-51555d356afe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:53.827316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2417941-4439-4fc5-a7b2-51555d356afe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:53.827746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c2417941-4439-4fc5-a7b2-51555d356afe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:53.981797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c2417941-4439-4fc5-a7b2-51555d356afe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:53.990080 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c2417941-4439-4fc5-a7b2-51555d356afe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1270 microversion: 2.1 time: 0.180601 Aug 23 18:32:53.991012 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3201/6537] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:53 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1270 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:55.012763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a11a1a7b-aa30-42db-a0f2-8188b1a04118 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:55.013387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a11a1a7b-aa30-42db-a0f2-8188b1a04118 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:55.016094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:32:55.028579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a11a1a7b-aa30-42db-a0f2-8188b1a04118 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:55.029449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a11a1a7b-aa30-42db-a0f2-8188b1a04118 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:55.030461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a11a1a7b-aa30-42db-a0f2-8188b1a04118 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:55.031456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a11a1a7b-aa30-42db-a0f2-8188b1a04118 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:55.032206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a11a1a7b-aa30-42db-a0f2-8188b1a04118 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:55.032800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a11a1a7b-aa30-42db-a0f2-8188b1a04118 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:55.199449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a11a1a7b-aa30-42db-a0f2-8188b1a04118 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:55.210177 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a11a1a7b-aa30-42db-a0f2-8188b1a04118 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1270 microversion: 2.1 time: 0.201369 Aug 23 18:32:55.218606 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3337/6538] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:55 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1270 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:56.231338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ac87b9ff-a6b1-4799-b936-8bc0e0cbdc72 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:56.231969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ac87b9ff-a6b1-4799-b936-8bc0e0cbdc72 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:56.238970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac87b9ff-a6b1-4799-b936-8bc0e0cbdc72 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:56.239523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac87b9ff-a6b1-4799-b936-8bc0e0cbdc72 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:56.239965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac87b9ff-a6b1-4799-b936-8bc0e0cbdc72 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:56.240673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac87b9ff-a6b1-4799-b936-8bc0e0cbdc72 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:56.241136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac87b9ff-a6b1-4799-b936-8bc0e0cbdc72 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:56.241599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac87b9ff-a6b1-4799-b936-8bc0e0cbdc72 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:56.387463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ac87b9ff-a6b1-4799-b936-8bc0e0cbdc72 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:56.395325 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ac87b9ff-a6b1-4799-b936-8bc0e0cbdc72 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1270 microversion: 2.1 time: 0.167845 Aug 23 18:32:56.395896 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3202/6539] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:56 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:57.417099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1966f857-10a0-41ca-9087-f29c5ed4be3e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:57.417965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1966f857-10a0-41ca-9087-f29c5ed4be3e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:57.425548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1966f857-10a0-41ca-9087-f29c5ed4be3e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:57.426428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1966f857-10a0-41ca-9087-f29c5ed4be3e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:57.426930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1966f857-10a0-41ca-9087-f29c5ed4be3e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:57.427915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1966f857-10a0-41ca-9087-f29c5ed4be3e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:57.428576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1966f857-10a0-41ca-9087-f29c5ed4be3e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:57.429019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1966f857-10a0-41ca-9087-f29c5ed4be3e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:57.583107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1966f857-10a0-41ca-9087-f29c5ed4be3e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:57.592242 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1966f857-10a0-41ca-9087-f29c5ed4be3e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1270 microversion: 2.1 time: 0.179220 Aug 23 18:32:57.592962 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3338/6540] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:57 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1270 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:58.618855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c260fca2-0977-498e-8121-ffa6ce1c219c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:58.620104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c260fca2-0977-498e-8121-ffa6ce1c219c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:58.628970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c260fca2-0977-498e-8121-ffa6ce1c219c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:58.629846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c260fca2-0977-498e-8121-ffa6ce1c219c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:58.630593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c260fca2-0977-498e-8121-ffa6ce1c219c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:58.631466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c260fca2-0977-498e-8121-ffa6ce1c219c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:58.632162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c260fca2-0977-498e-8121-ffa6ce1c219c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:58.632590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c260fca2-0977-498e-8121-ffa6ce1c219c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:58.808039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c260fca2-0977-498e-8121-ffa6ce1c219c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:32:58.818730 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c260fca2-0977-498e-8121-ffa6ce1c219c tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1270 microversion: 2.1 time: 0.206898 Aug 23 18:32:58.819535 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3203/6541] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:58 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1270 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:32:59.841832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e62a671-f34d-4d65-8090-54eb733292a8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:32:59.842453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e62a671-f34d-4d65-8090-54eb733292a8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:32:59.856519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e62a671-f34d-4d65-8090-54eb733292a8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:59.857014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e62a671-f34d-4d65-8090-54eb733292a8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:59.857444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e62a671-f34d-4d65-8090-54eb733292a8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:32:59.858153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e62a671-f34d-4d65-8090-54eb733292a8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:32:59.858656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e62a671-f34d-4d65-8090-54eb733292a8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:32:59.859095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e62a671-f34d-4d65-8090-54eb733292a8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:00.016315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8e62a671-f34d-4d65-8090-54eb733292a8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:00.026330 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e62a671-f34d-4d65-8090-54eb733292a8 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1270 microversion: 2.1 time: 0.188614 Aug 23 18:33:00.027280 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3339/6542] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:32:59 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1270 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:01.047834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-068af142-d5c8-401b-b122-58b334edb532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:01.048452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-068af142-d5c8-401b-b122-58b334edb532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:01.056676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-068af142-d5c8-401b-b122-58b334edb532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:01.057163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-068af142-d5c8-401b-b122-58b334edb532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:01.057603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-068af142-d5c8-401b-b122-58b334edb532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:01.058311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-068af142-d5c8-401b-b122-58b334edb532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:01.058790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-068af142-d5c8-401b-b122-58b334edb532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:01.059226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-068af142-d5c8-401b-b122-58b334edb532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:01.209168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-068af142-d5c8-401b-b122-58b334edb532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:01.218402 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-068af142-d5c8-401b-b122-58b334edb532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1270 microversion: 2.1 time: 0.174522 Aug 23 18:33:01.219319 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3204/6543] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:01 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1270 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:33:01.830908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-07403331-f730-4ed9-add4-dc9974d1b836 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:01.831477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-07403331-f730-4ed9-add4-dc9974d1b836 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:01.838692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07403331-f730-4ed9-add4-dc9974d1b836 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:01.839189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07403331-f730-4ed9-add4-dc9974d1b836 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:01.839636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07403331-f730-4ed9-add4-dc9974d1b836 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:01.840347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07403331-f730-4ed9-add4-dc9974d1b836 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:01.841073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07403331-f730-4ed9-add4-dc9974d1b836 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:01.841507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07403331-f730-4ed9-add4-dc9974d1b836 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:01.978070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-07403331-f730-4ed9-add4-dc9974d1b836 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:01.986482 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-07403331-f730-4ed9-add4-dc9974d1b836 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1683 microversion: 2.1 time: 0.159684 Aug 23 18:33:01.987091 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3340/6544] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:01 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:02.094571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-27bbd8b9-8b46-4cfc-8284-71b4b30f038b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:02.096820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-27bbd8b9-8b46-4cfc-8284-71b4b30f038b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:02.104679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27bbd8b9-8b46-4cfc-8284-71b4b30f038b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:02.105177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27bbd8b9-8b46-4cfc-8284-71b4b30f038b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:02.105626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27bbd8b9-8b46-4cfc-8284-71b4b30f038b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:02.106344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27bbd8b9-8b46-4cfc-8284-71b4b30f038b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:02.106863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27bbd8b9-8b46-4cfc-8284-71b4b30f038b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:02.107303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27bbd8b9-8b46-4cfc-8284-71b4b30f038b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:02.168391 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-27bbd8b9-8b46-4cfc-8284-71b4b30f038b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044/action" status: 200 len: 32642 microversion: 2.1 time: 0.077868 Aug 23 18:33:02.169050 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3205/6545] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:33:02 2022] POST /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044/action => generated 32642 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:33:02.239933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9cdb210b-4021-449b-be83-93c4f26f4532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:02.240825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9cdb210b-4021-449b-be83-93c4f26f4532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:02.248898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cdb210b-4021-449b-be83-93c4f26f4532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:02.249889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cdb210b-4021-449b-be83-93c4f26f4532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:02.250056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cdb210b-4021-449b-be83-93c4f26f4532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:02.250897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cdb210b-4021-449b-be83-93c4f26f4532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:02.251436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cdb210b-4021-449b-be83-93c4f26f4532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:02.252088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9cdb210b-4021-449b-be83-93c4f26f4532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:02.319191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a8e65382-6a1d-4285-87f1-de29a890b763 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:02.320341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a8e65382-6a1d-4285-87f1-de29a890b763 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:02.339295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8e65382-6a1d-4285-87f1-de29a890b763 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:02.340007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8e65382-6a1d-4285-87f1-de29a890b763 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:02.340906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8e65382-6a1d-4285-87f1-de29a890b763 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:02.342127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8e65382-6a1d-4285-87f1-de29a890b763 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:02.343129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8e65382-6a1d-4285-87f1-de29a890b763 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:02.343711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8e65382-6a1d-4285-87f1-de29a890b763 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:02.453469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9cdb210b-4021-449b-be83-93c4f26f4532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:02.462375 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9cdb210b-4021-449b-be83-93c4f26f4532 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1270 microversion: 2.1 time: 0.226615 Aug 23 18:33:02.463644 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3341/6546] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:02 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1270 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:02.510417 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a8e65382-6a1d-4285-87f1-de29a890b763 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1836 microversion: 2.1 time: 0.195451 Aug 23 18:33:02.511633 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3206/6547] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:02 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1836 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:02.538689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-056a9c8a-176c-4e67-8f07-c85b250817f1 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:02.541809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-056a9c8a-176c-4e67-8f07-c85b250817f1 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:02.547915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-056a9c8a-176c-4e67-8f07-c85b250817f1 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:02.548544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-056a9c8a-176c-4e67-8f07-c85b250817f1 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:02.548990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-056a9c8a-176c-4e67-8f07-c85b250817f1 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:02.549706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-056a9c8a-176c-4e67-8f07-c85b250817f1 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:02.550173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-056a9c8a-176c-4e67-8f07-c85b250817f1 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:02.550638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-056a9c8a-176c-4e67-8f07-c85b250817f1 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:02.577587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-056a9c8a-176c-4e67-8f07-c85b250817f1 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lazy-loading 'flavor' on Instance uuid ec047e74-f554-4c31-b2e4-7ee0ebc4a044 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:33:02.590724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-056a9c8a-176c-4e67-8f07-c85b250817f1 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Going to try to live migrate instance to another host {{(pid=128808) live_migrate /opt/stack/nova/nova/compute/api.py:5477}} Aug 23 18:33:03.489444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ecd845cb-fe2b-482a-bbcd-0eb4efceabf7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:03.490177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ecd845cb-fe2b-482a-bbcd-0eb4efceabf7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:03.505936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecd845cb-fe2b-482a-bbcd-0eb4efceabf7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:03.506870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecd845cb-fe2b-482a-bbcd-0eb4efceabf7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:03.507803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecd845cb-fe2b-482a-bbcd-0eb4efceabf7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:03.508909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecd845cb-fe2b-482a-bbcd-0eb4efceabf7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:03.510071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecd845cb-fe2b-482a-bbcd-0eb4efceabf7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:03.510756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ecd845cb-fe2b-482a-bbcd-0eb4efceabf7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:03.787787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ecd845cb-fe2b-482a-bbcd-0eb4efceabf7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:03.799180 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ecd845cb-fe2b-482a-bbcd-0eb4efceabf7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1270 microversion: 2.1 time: 0.316940 Aug 23 18:33:03.799775 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3207/6548] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:03 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1270 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:04.422577 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-056a9c8a-176c-4e67-8f07-c85b250817f1 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044/action" status: 202 len: 0 microversion: 2.1 time: 1.886014 Aug 23 18:33:04.424312 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3342/6549] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:33:02 2022] POST /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044/action => generated 0 bytes in 1889 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:33:04.433748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-547e46e4-c84a-40b2-a69b-3e7e821a75ce tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:04.434822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-547e46e4-c84a-40b2-a69b-3e7e821a75ce tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:04.442736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-547e46e4-c84a-40b2-a69b-3e7e821a75ce tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:04.443510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-547e46e4-c84a-40b2-a69b-3e7e821a75ce tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:04.443978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-547e46e4-c84a-40b2-a69b-3e7e821a75ce tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:04.444678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-547e46e4-c84a-40b2-a69b-3e7e821a75ce tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:04.445136 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-547e46e4-c84a-40b2-a69b-3e7e821a75ce tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:04.446382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-547e46e4-c84a-40b2-a69b-3e7e821a75ce tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:04.681811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-547e46e4-c84a-40b2-a69b-3e7e821a75ce tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:04.693972 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-547e46e4-c84a-40b2-a69b-3e7e821a75ce tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1693 microversion: 2.1 time: 0.265347 Aug 23 18:33:04.694647 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3208/6550] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:04 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1693 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:04.821385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b1236e96-b73c-4979-a293-46552966bc98 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:04.822235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b1236e96-b73c-4979-a293-46552966bc98 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:04.843284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1236e96-b73c-4979-a293-46552966bc98 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:04.843812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1236e96-b73c-4979-a293-46552966bc98 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:04.844258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1236e96-b73c-4979-a293-46552966bc98 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:04.845028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1236e96-b73c-4979-a293-46552966bc98 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:04.845434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1236e96-b73c-4979-a293-46552966bc98 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:04.845866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1236e96-b73c-4979-a293-46552966bc98 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:05.054051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2259a204-976f-4a44-acb9-645dabb54f6a req-644f548e-64f8-4798-a1e5-3fa244dd6a11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ac4913-d262-468e-9fbe-ae2cdababfff", "name": "network-vif-plugged", "status": "completed", "tag": "9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:05.068791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2259a204-976f-4a44-acb9-645dabb54f6a req-644f548e-64f8-4798-a1e5-3fa244dd6a11 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:05.069632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2259a204-976f-4a44-acb9-645dabb54f6a req-644f548e-64f8-4798-a1e5-3fa244dd6a11 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:05.070502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2259a204-976f-4a44-acb9-645dabb54f6a req-644f548e-64f8-4798-a1e5-3fa244dd6a11 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:05.088315 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2259a204-976f-4a44-acb9-645dabb54f6a req-644f548e-64f8-4798-a1e5-3fa244dd6a11 service nova] Creating event network-vif-plugged:9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0 for instance e7ac4913-d262-468e-9fbe-ae2cdababfff on n-h2-850468-16 Aug 23 18:33:05.096924 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2259a204-976f-4a44-acb9-645dabb54f6a req-644f548e-64f8-4798-a1e5-3fa244dd6a11 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.140137 Aug 23 18:33:05.098476 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3209/6551] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:05.110811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b1236e96-b73c-4979-a293-46552966bc98 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:05.120441 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b1236e96-b73c-4979-a293-46552966bc98 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1270 microversion: 2.1 time: 0.303564 Aug 23 18:33:05.121603 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3343/6552] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:04 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1270 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:05.718906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41b17995-2b77-4e5a-9b97-c1a09435221f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:05.723539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-41b17995-2b77-4e5a-9b97-c1a09435221f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:05.736293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41b17995-2b77-4e5a-9b97-c1a09435221f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:05.737052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41b17995-2b77-4e5a-9b97-c1a09435221f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:05.737712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41b17995-2b77-4e5a-9b97-c1a09435221f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:05.738709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41b17995-2b77-4e5a-9b97-c1a09435221f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:05.739382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41b17995-2b77-4e5a-9b97-c1a09435221f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:05.740464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41b17995-2b77-4e5a-9b97-c1a09435221f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:05.989968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41b17995-2b77-4e5a-9b97-c1a09435221f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:06.019061 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-41b17995-2b77-4e5a-9b97-c1a09435221f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1693 microversion: 2.1 time: 0.304579 Aug 23 18:33:06.019643 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3210/6553] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:05 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1693 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:06.041887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-b9fce207-21ff-4eb5-bd6a-68c5a3519baf req-0a14208d-dc6f-4a85-b5ab-6809a4b896ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec047e74-f554-4c31-b2e4-7ee0ebc4a044", "name": "network-vif-unplugged", "status": "completed", "tag": "80a31b9b-188e-47c3-8a35-ebf3e78b7b36"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:06.053242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b9fce207-21ff-4eb5-bd6a-68c5a3519baf req-0a14208d-dc6f-4a85-b5ab-6809a4b896ab service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:06.054026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b9fce207-21ff-4eb5-bd6a-68c5a3519baf req-0a14208d-dc6f-4a85-b5ab-6809a4b896ab service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:06.054470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b9fce207-21ff-4eb5-bd6a-68c5a3519baf req-0a14208d-dc6f-4a85-b5ab-6809a4b896ab service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:06.067350 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b9fce207-21ff-4eb5-bd6a-68c5a3519baf req-0a14208d-dc6f-4a85-b5ab-6809a4b896ab service nova] Creating event network-vif-unplugged:80a31b9b-188e-47c3-8a35-ebf3e78b7b36 for instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 on n-h2-850468-16 Aug 23 18:33:06.073885 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-b9fce207-21ff-4eb5-bd6a-68c5a3519baf req-0a14208d-dc6f-4a85-b5ab-6809a4b896ab service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036884 Aug 23 18:33:06.075210 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3344/6554] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:06.145231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93e49c7d-3483-4bde-b424-be00118c4a0e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:06.146254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-93e49c7d-3483-4bde-b424-be00118c4a0e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:06.169997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93e49c7d-3483-4bde-b424-be00118c4a0e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:06.170823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93e49c7d-3483-4bde-b424-be00118c4a0e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:06.173723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93e49c7d-3483-4bde-b424-be00118c4a0e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:06.174869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93e49c7d-3483-4bde-b424-be00118c4a0e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:06.176642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93e49c7d-3483-4bde-b424-be00118c4a0e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:06.177297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93e49c7d-3483-4bde-b424-be00118c4a0e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:06.425734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-93e49c7d-3483-4bde-b424-be00118c4a0e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:06.440018 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93e49c7d-3483-4bde-b424-be00118c4a0e tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1270 microversion: 2.1 time: 0.301753 Aug 23 18:33:06.448300 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3211/6555] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:06 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1270 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:07.042938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-353b9caa-f1fe-4eba-8f07-0becf47cb41c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:07.046085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-353b9caa-f1fe-4eba-8f07-0becf47cb41c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:07.055515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-353b9caa-f1fe-4eba-8f07-0becf47cb41c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:07.056129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-353b9caa-f1fe-4eba-8f07-0becf47cb41c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:07.056807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-353b9caa-f1fe-4eba-8f07-0becf47cb41c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:07.057620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-353b9caa-f1fe-4eba-8f07-0becf47cb41c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:07.058156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-353b9caa-f1fe-4eba-8f07-0becf47cb41c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:07.058683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-353b9caa-f1fe-4eba-8f07-0becf47cb41c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:07.214439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-353b9caa-f1fe-4eba-8f07-0becf47cb41c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:07.224435 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-353b9caa-f1fe-4eba-8f07-0becf47cb41c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1693 microversion: 2.1 time: 0.186504 Aug 23 18:33:07.226804 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3345/6556] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:07 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1693 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:07.468635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-31494e18-b7f7-41d9-a6f1-d703dacb48e7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:07.469892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-31494e18-b7f7-41d9-a6f1-d703dacb48e7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:07.477975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31494e18-b7f7-41d9-a6f1-d703dacb48e7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:07.478473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31494e18-b7f7-41d9-a6f1-d703dacb48e7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:07.478957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31494e18-b7f7-41d9-a6f1-d703dacb48e7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:07.479830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31494e18-b7f7-41d9-a6f1-d703dacb48e7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:07.480291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31494e18-b7f7-41d9-a6f1-d703dacb48e7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:07.480717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31494e18-b7f7-41d9-a6f1-d703dacb48e7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:07.655505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-31494e18-b7f7-41d9-a6f1-d703dacb48e7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:07.663825 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-31494e18-b7f7-41d9-a6f1-d703dacb48e7 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1459 microversion: 2.1 time: 0.199391 Aug 23 18:33:07.664994 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3212/6557] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:07 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1459 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:07.685012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0795e87a-3980-4d6d-ad50-ca44666fe1f3 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:07.686034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0795e87a-3980-4d6d-ad50-ca44666fe1f3 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:07.693288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0795e87a-3980-4d6d-ad50-ca44666fe1f3 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:07.694260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0795e87a-3980-4d6d-ad50-ca44666fe1f3 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:07.694971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0795e87a-3980-4d6d-ad50-ca44666fe1f3 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:07.695961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0795e87a-3980-4d6d-ad50-ca44666fe1f3 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:07.696670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0795e87a-3980-4d6d-ad50-ca44666fe1f3 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:07.697262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0795e87a-3980-4d6d-ad50-ca44666fe1f3 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:07.894673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0795e87a-3980-4d6d-ad50-ca44666fe1f3 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:07.914219 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0795e87a-3980-4d6d-ad50-ca44666fe1f3 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1459 microversion: 2.1 time: 0.232889 Aug 23 18:33:07.916936 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3346/6558] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:07 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1459 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:08.096969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-38152d26-b0c8-4d3b-9856-eb0a47bfd7c6 req-b7aac3c8-a5ba-4f92-a95a-8bfd55253825 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec047e74-f554-4c31-b2e4-7ee0ebc4a044", "tag": "80a31b9b-188e-47c3-8a35-ebf3e78b7b36"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:08.110568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-38152d26-b0c8-4d3b-9856-eb0a47bfd7c6 req-b7aac3c8-a5ba-4f92-a95a-8bfd55253825 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:08.111111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-38152d26-b0c8-4d3b-9856-eb0a47bfd7c6 req-b7aac3c8-a5ba-4f92-a95a-8bfd55253825 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:08.111554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-38152d26-b0c8-4d3b-9856-eb0a47bfd7c6 req-b7aac3c8-a5ba-4f92-a95a-8bfd55253825 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:08.124839 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-38152d26-b0c8-4d3b-9856-eb0a47bfd7c6 req-b7aac3c8-a5ba-4f92-a95a-8bfd55253825 service nova] Creating event network-changed:80a31b9b-188e-47c3-8a35-ebf3e78b7b36 for instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 on n-h2-850468-16 Aug 23 18:33:08.138638 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-38152d26-b0c8-4d3b-9856-eb0a47bfd7c6 req-b7aac3c8-a5ba-4f92-a95a-8bfd55253825 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045328 Aug 23 18:33:08.139853 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3213/6559] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:08.255889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0092e5f6-b842-4a21-807b-d782444ecd27 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:08.257194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0092e5f6-b842-4a21-807b-d782444ecd27 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:08.265676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0092e5f6-b842-4a21-807b-d782444ecd27 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:08.266618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0092e5f6-b842-4a21-807b-d782444ecd27 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:08.267304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0092e5f6-b842-4a21-807b-d782444ecd27 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:08.268253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0092e5f6-b842-4a21-807b-d782444ecd27 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:08.268924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0092e5f6-b842-4a21-807b-d782444ecd27 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:08.269571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0092e5f6-b842-4a21-807b-d782444ecd27 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:08.723061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0092e5f6-b842-4a21-807b-d782444ecd27 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:08.735320 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0092e5f6-b842-4a21-807b-d782444ecd27 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1693 microversion: 2.1 time: 0.482588 Aug 23 18:33:08.736544 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3347/6560] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:08 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1693 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:09.761080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0ff77a76-c2dd-4a70-a588-6643e7823712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:09.765273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0ff77a76-c2dd-4a70-a588-6643e7823712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:09.777296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ff77a76-c2dd-4a70-a588-6643e7823712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:09.777973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ff77a76-c2dd-4a70-a588-6643e7823712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:09.778698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ff77a76-c2dd-4a70-a588-6643e7823712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:09.779872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ff77a76-c2dd-4a70-a588-6643e7823712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:09.780524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ff77a76-c2dd-4a70-a588-6643e7823712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:09.781206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ff77a76-c2dd-4a70-a588-6643e7823712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:09.965777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0ff77a76-c2dd-4a70-a588-6643e7823712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:09.974922 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0ff77a76-c2dd-4a70-a588-6643e7823712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1693 microversion: 2.1 time: 0.220997 Aug 23 18:33:09.975827 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3214/6561] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:09 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1693 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:10.781348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-da43f74b-fe8a-4c4c-bb1e-b9fe37ddffe4 req-e70908eb-89e8-4bcd-9e5d-c3f2c840f5bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ac4913-d262-468e-9fbe-ae2cdababfff", "tag": "9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:10.804544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-da43f74b-fe8a-4c4c-bb1e-b9fe37ddffe4 req-e70908eb-89e8-4bcd-9e5d-c3f2c840f5bd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:10.808120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-da43f74b-fe8a-4c4c-bb1e-b9fe37ddffe4 req-e70908eb-89e8-4bcd-9e5d-c3f2c840f5bd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:10.808831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-da43f74b-fe8a-4c4c-bb1e-b9fe37ddffe4 req-e70908eb-89e8-4bcd-9e5d-c3f2c840f5bd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:10.835210 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-da43f74b-fe8a-4c4c-bb1e-b9fe37ddffe4 req-e70908eb-89e8-4bcd-9e5d-c3f2c840f5bd service nova] Creating event network-changed:9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0 for instance e7ac4913-d262-468e-9fbe-ae2cdababfff on n-h2-850468-16 Aug 23 18:33:10.844960 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-da43f74b-fe8a-4c4c-bb1e-b9fe37ddffe4 req-e70908eb-89e8-4bcd-9e5d-c3f2c840f5bd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067836 Aug 23 18:33:10.846338 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3348/6562] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:10.999437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ea10a4a-3923-4f3e-aea3-ae16ceaab95d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:11.001351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8ea10a4a-3923-4f3e-aea3-ae16ceaab95d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:11.022625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ea10a4a-3923-4f3e-aea3-ae16ceaab95d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:11.035387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ea10a4a-3923-4f3e-aea3-ae16ceaab95d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:11.036126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ea10a4a-3923-4f3e-aea3-ae16ceaab95d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:11.037060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ea10a4a-3923-4f3e-aea3-ae16ceaab95d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:11.037698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ea10a4a-3923-4f3e-aea3-ae16ceaab95d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:11.038293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ea10a4a-3923-4f3e-aea3-ae16ceaab95d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:11.077221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:12.020971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8ea10a4a-3923-4f3e-aea3-ae16ceaab95d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:12.030772 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8ea10a4a-3923-4f3e-aea3-ae16ceaab95d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1693 microversion: 2.1 time: 1.035847 Aug 23 18:33:12.048386 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3215/6563] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:10 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1693 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:12.864377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-42991357-5000-447d-8c18-18a3de3ed342 req-749c15c6-0a1d-434b-b942-c110137752ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ac4913-d262-468e-9fbe-ae2cdababfff", "tag": "9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0"}, {"name": "network-changed", "server_uuid": "e7ac4913-d262-468e-9fbe-ae2cdababfff", "tag": "9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:12.877526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:12.879954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-42991357-5000-447d-8c18-18a3de3ed342 req-749c15c6-0a1d-434b-b942-c110137752ee service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:12.880673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-42991357-5000-447d-8c18-18a3de3ed342 req-749c15c6-0a1d-434b-b942-c110137752ee service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:12.881104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-42991357-5000-447d-8c18-18a3de3ed342 req-749c15c6-0a1d-434b-b942-c110137752ee service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:12.887092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:12.897988 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-42991357-5000-447d-8c18-18a3de3ed342 req-749c15c6-0a1d-434b-b942-c110137752ee service nova] Creating event network-changed:9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0 for instance e7ac4913-d262-468e-9fbe-ae2cdababfff on n-h2-850468-16 Aug 23 18:33:12.899840 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-42991357-5000-447d-8c18-18a3de3ed342 req-749c15c6-0a1d-434b-b942-c110137752ee service nova] Creating event network-changed:9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0 for instance e7ac4913-d262-468e-9fbe-ae2cdababfff on n-h2-850468-16 Aug 23 18:33:12.908367 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-42991357-5000-447d-8c18-18a3de3ed342 req-749c15c6-0a1d-434b-b942-c110137752ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.048671 Aug 23 18:33:12.909913 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3349/6564] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:13.054075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c14f40f-563e-43e0-9fef-f9eb2cc7b7cf tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:13.055311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c14f40f-563e-43e0-9fef-f9eb2cc7b7cf tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:13.066091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c14f40f-563e-43e0-9fef-f9eb2cc7b7cf tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:13.066630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c14f40f-563e-43e0-9fef-f9eb2cc7b7cf tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:13.067078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c14f40f-563e-43e0-9fef-f9eb2cc7b7cf tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:13.067945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c14f40f-563e-43e0-9fef-f9eb2cc7b7cf tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:13.068254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c14f40f-563e-43e0-9fef-f9eb2cc7b7cf tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:13.068743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c14f40f-563e-43e0-9fef-f9eb2cc7b7cf tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:13.344725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c14f40f-563e-43e0-9fef-f9eb2cc7b7cf tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:13.354003 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c14f40f-563e-43e0-9fef-f9eb2cc7b7cf tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1693 microversion: 2.1 time: 0.304502 Aug 23 18:33:13.354716 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3216/6565] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:13 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1693 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:14.381283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a463269-a448-48bc-9af8-1a8e4223c287 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:14.383356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5a463269-a448-48bc-9af8-1a8e4223c287 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:14.401948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a463269-a448-48bc-9af8-1a8e4223c287 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:14.402733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a463269-a448-48bc-9af8-1a8e4223c287 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:14.403380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a463269-a448-48bc-9af8-1a8e4223c287 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:14.404286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a463269-a448-48bc-9af8-1a8e4223c287 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:14.405763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a463269-a448-48bc-9af8-1a8e4223c287 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:14.406512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a463269-a448-48bc-9af8-1a8e4223c287 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:14.580134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5a463269-a448-48bc-9af8-1a8e4223c287 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:14.589255 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a463269-a448-48bc-9af8-1a8e4223c287 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1693 microversion: 2.1 time: 0.214477 Aug 23 18:33:14.603051 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3350/6566] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:14 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1693 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:15.612232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6a3c43b2-935d-4eb0-8266-bde55a228f48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:15.613583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6a3c43b2-935d-4eb0-8266-bde55a228f48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:15.622216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:15.628298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a3c43b2-935d-4eb0-8266-bde55a228f48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:15.630067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a3c43b2-935d-4eb0-8266-bde55a228f48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:15.633041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a3c43b2-935d-4eb0-8266-bde55a228f48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:15.636204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a3c43b2-935d-4eb0-8266-bde55a228f48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:15.637301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a3c43b2-935d-4eb0-8266-bde55a228f48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:15.639421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6a3c43b2-935d-4eb0-8266-bde55a228f48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:16.035446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6a3c43b2-935d-4eb0-8266-bde55a228f48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:16.045931 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6a3c43b2-935d-4eb0-8266-bde55a228f48 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1693 microversion: 2.1 time: 0.437979 Aug 23 18:33:16.047011 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3217/6567] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:15 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1693 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:17.077964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9196074-5bf0-433d-b8b4-27a34e8e6c5a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:17.082523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b9196074-5bf0-433d-b8b4-27a34e8e6c5a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:17.094268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9196074-5bf0-433d-b8b4-27a34e8e6c5a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:17.095202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9196074-5bf0-433d-b8b4-27a34e8e6c5a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:17.095930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9196074-5bf0-433d-b8b4-27a34e8e6c5a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:17.096649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9196074-5bf0-433d-b8b4-27a34e8e6c5a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:17.097274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9196074-5bf0-433d-b8b4-27a34e8e6c5a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:17.098013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9196074-5bf0-433d-b8b4-27a34e8e6c5a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:17.285652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b9196074-5bf0-433d-b8b4-27a34e8e6c5a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:17.298592 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b9196074-5bf0-433d-b8b4-27a34e8e6c5a tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1693 microversion: 2.1 time: 0.234420 Aug 23 18:33:17.299528 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3351/6568] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:17 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1693 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:18.322980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d95452db-37f9-4d68-b7d7-36d7bd226e9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:18.323882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d95452db-37f9-4d68-b7d7-36d7bd226e9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:18.331470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d95452db-37f9-4d68-b7d7-36d7bd226e9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:18.332222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d95452db-37f9-4d68-b7d7-36d7bd226e9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:18.332737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d95452db-37f9-4d68-b7d7-36d7bd226e9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:18.333687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d95452db-37f9-4d68-b7d7-36d7bd226e9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:18.334261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d95452db-37f9-4d68-b7d7-36d7bd226e9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:18.334794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d95452db-37f9-4d68-b7d7-36d7bd226e9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:18.496637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d95452db-37f9-4d68-b7d7-36d7bd226e9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:18.511496 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d95452db-37f9-4d68-b7d7-36d7bd226e9c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1683 microversion: 2.1 time: 0.194163 Aug 23 18:33:18.512301 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3218/6569] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:18 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1683 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:18.533153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ba18108b-cc58-4e3e-a3d5-4644bac9a943 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:18.533747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ba18108b-cc58-4e3e-a3d5-4644bac9a943 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:18.543454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba18108b-cc58-4e3e-a3d5-4644bac9a943 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:18.543947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba18108b-cc58-4e3e-a3d5-4644bac9a943 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:18.544571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba18108b-cc58-4e3e-a3d5-4644bac9a943 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:18.545478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba18108b-cc58-4e3e-a3d5-4644bac9a943 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:18.545929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba18108b-cc58-4e3e-a3d5-4644bac9a943 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:18.546356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba18108b-cc58-4e3e-a3d5-4644bac9a943 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:18.736989 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ba18108b-cc58-4e3e-a3d5-4644bac9a943 tempest-TestNetworkAdvancedServerOps-1775054557 tempest-TestNetworkAdvancedServerOps-1775054557-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1836 microversion: 2.1 time: 0.207375 Aug 23 18:33:18.737773 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3352/6570] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:18 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1836 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:18.761724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-33774a5d-052f-4558-927e-831cbbeb08db tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:18.762506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-33774a5d-052f-4558-927e-831cbbeb08db tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:18.769708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33774a5d-052f-4558-927e-831cbbeb08db tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:18.770234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33774a5d-052f-4558-927e-831cbbeb08db tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:18.771006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33774a5d-052f-4558-927e-831cbbeb08db tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:18.772598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33774a5d-052f-4558-927e-831cbbeb08db tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:18.773315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33774a5d-052f-4558-927e-831cbbeb08db tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:18.774029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33774a5d-052f-4558-927e-831cbbeb08db tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:18.923133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-33774a5d-052f-4558-927e-831cbbeb08db tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:18.932525 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-33774a5d-052f-4558-927e-831cbbeb08db tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1683 microversion: 2.1 time: 0.175964 Aug 23 18:33:18.933677 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3219/6571] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:18 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1683 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:21.044508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3b97d3d8-64ff-428c-9f52-9f22e2f2106f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:21.047449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3b97d3d8-64ff-428c-9f52-9f22e2f2106f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:21.055288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b97d3d8-64ff-428c-9f52-9f22e2f2106f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:21.056023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b97d3d8-64ff-428c-9f52-9f22e2f2106f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:21.056645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b97d3d8-64ff-428c-9f52-9f22e2f2106f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:21.057696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b97d3d8-64ff-428c-9f52-9f22e2f2106f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:21.058112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b97d3d8-64ff-428c-9f52-9f22e2f2106f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:21.058749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3b97d3d8-64ff-428c-9f52-9f22e2f2106f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:21.116150 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3b97d3d8-64ff-428c-9f52-9f22e2f2106f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044/action" status: 200 len: 38423 microversion: 2.1 time: 0.075790 Aug 23 18:33:21.118241 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3353/6572] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:33:21 2022] POST /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044/action => generated 38423 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:33:22.384316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-820c3e5f-5e2b-40cc-8aa1-012acbe93da0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:22.384822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-820c3e5f-5e2b-40cc-8aa1-012acbe93da0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:22.397428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-820c3e5f-5e2b-40cc-8aa1-012acbe93da0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:22.397933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-820c3e5f-5e2b-40cc-8aa1-012acbe93da0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:22.398709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-820c3e5f-5e2b-40cc-8aa1-012acbe93da0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:22.403441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-820c3e5f-5e2b-40cc-8aa1-012acbe93da0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:22.404166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-820c3e5f-5e2b-40cc-8aa1-012acbe93da0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:22.404900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-820c3e5f-5e2b-40cc-8aa1-012acbe93da0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:22.410861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5ea98815-50fa-4009-876c-ba101528cced req-f589ef32-f68c-4863-82da-c05b67859ae7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec047e74-f554-4c31-b2e4-7ee0ebc4a044", "tag": "80a31b9b-188e-47c3-8a35-ebf3e78b7b36"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:22.428710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5ea98815-50fa-4009-876c-ba101528cced req-f589ef32-f68c-4863-82da-c05b67859ae7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:22.433883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5ea98815-50fa-4009-876c-ba101528cced req-f589ef32-f68c-4863-82da-c05b67859ae7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:22.436534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-820c3e5f-5e2b-40cc-8aa1-012acbe93da0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:33:22.438438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5ea98815-50fa-4009-876c-ba101528cced req-f589ef32-f68c-4863-82da-c05b67859ae7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:22.483826 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5ea98815-50fa-4009-876c-ba101528cced req-f589ef32-f68c-4863-82da-c05b67859ae7 service nova] Creating event network-changed:80a31b9b-188e-47c3-8a35-ebf3e78b7b36 for instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 on n-h1-850468-16 Aug 23 18:33:22.501327 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5ea98815-50fa-4009-876c-ba101528cced req-f589ef32-f68c-4863-82da-c05b67859ae7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094220 Aug 23 18:33:22.506139 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3354/6573] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:33:22.597134 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-820c3e5f-5e2b-40cc-8aa1-012acbe93da0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "DELETE /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 204 len: 0 microversion: 2.1 time: 0.212742 Aug 23 18:33:22.598497 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3220/6574] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:33:22 2022] DELETE /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:33:22.609325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6251d67f-5b54-4fe8-8c66-ed7fcb0d617e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:22.610211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6251d67f-5b54-4fe8-8c66-ed7fcb0d617e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:22.625563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6251d67f-5b54-4fe8-8c66-ed7fcb0d617e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:22.626306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6251d67f-5b54-4fe8-8c66-ed7fcb0d617e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:22.626941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6251d67f-5b54-4fe8-8c66-ed7fcb0d617e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:22.627868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6251d67f-5b54-4fe8-8c66-ed7fcb0d617e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:22.629049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6251d67f-5b54-4fe8-8c66-ed7fcb0d617e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:22.629635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6251d67f-5b54-4fe8-8c66-ed7fcb0d617e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:22.806951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6251d67f-5b54-4fe8-8c66-ed7fcb0d617e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:22.815181 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6251d67f-5b54-4fe8-8c66-ed7fcb0d617e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1689 microversion: 2.1 time: 0.211524 Aug 23 18:33:22.817267 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3355/6575] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:22 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1689 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:23.840130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5795840a-c40f-4099-a136-9fff6d301f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:23.841854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5795840a-c40f-4099-a136-9fff6d301f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:23.855788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5795840a-c40f-4099-a136-9fff6d301f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:23.859245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5795840a-c40f-4099-a136-9fff6d301f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:23.859956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5795840a-c40f-4099-a136-9fff6d301f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:23.860949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5795840a-c40f-4099-a136-9fff6d301f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:23.869999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5795840a-c40f-4099-a136-9fff6d301f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:23.870665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5795840a-c40f-4099-a136-9fff6d301f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:24.128748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5795840a-c40f-4099-a136-9fff6d301f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:24.138498 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5795840a-c40f-4099-a136-9fff6d301f2c tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 200 len: 1570 microversion: 2.1 time: 0.303508 Aug 23 18:33:24.153344 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3221/6576] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:23 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 1570 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:24.519508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-03c69723-125e-4a76-bc3a-5e5a7b5f031b req-11fbc636-467f-4d85-a00d-716b8ad8d4f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec047e74-f554-4c31-b2e4-7ee0ebc4a044", "name": "network-vif-deleted", "tag": "80a31b9b-188e-47c3-8a35-ebf3e78b7b36"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:24.544398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-03c69723-125e-4a76-bc3a-5e5a7b5f031b req-11fbc636-467f-4d85-a00d-716b8ad8d4f5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:24.544931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-03c69723-125e-4a76-bc3a-5e5a7b5f031b req-11fbc636-467f-4d85-a00d-716b8ad8d4f5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:24.545843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-03c69723-125e-4a76-bc3a-5e5a7b5f031b req-11fbc636-467f-4d85-a00d-716b8ad8d4f5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:24.567261 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-03c69723-125e-4a76-bc3a-5e5a7b5f031b req-11fbc636-467f-4d85-a00d-716b8ad8d4f5 service nova] Creating event network-vif-deleted:80a31b9b-188e-47c3-8a35-ebf3e78b7b36 for instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 on n-h1-850468-16 Aug 23 18:33:24.593876 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-03c69723-125e-4a76-bc3a-5e5a7b5f031b req-11fbc636-467f-4d85-a00d-716b8ad8d4f5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078095 Aug 23 18:33:24.595327 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3356/6577] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:33:25.165635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95d376d8-84c4-4920-a932-1b34cd233ddb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:25.168015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-95d376d8-84c4-4920-a932-1b34cd233ddb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: ec047e74-f554-4c31-b2e4-7ee0ebc4a044] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:25.181462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95d376d8-84c4-4920-a932-1b34cd233ddb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:25.182611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95d376d8-84c4-4920-a932-1b34cd233ddb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:25.183825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95d376d8-84c4-4920-a932-1b34cd233ddb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:25.184866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95d376d8-84c4-4920-a932-1b34cd233ddb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:25.185811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95d376d8-84c4-4920-a932-1b34cd233ddb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:25.186792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95d376d8-84c4-4920-a932-1b34cd233ddb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:25.204800 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-95d376d8-84c4-4920-a932-1b34cd233ddb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] HTTP exception thrown: Instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 could not be found. Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95d376d8-84c4-4920-a932-1b34cd233ddb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Request method failure captured: Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 HTTP/1.1 Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRsdVVhpR5RMU_geeBK-NR3GIvIqLdesK6DUhp09zpynAbw0X6UfFtmOOX54Hda9Mc0jqJQ7C8EEh5MjgiSeR67w9GmLZU6f4UNZ39ll_bkclo_Oe7CkkS9H6snKI3zqjko4iBZoZ7CUVY6hBlmSeyIEToW2Imz7W3zNDzyrYaOVrRo Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: c3be0a88f743407f9f59a08be6b73a5e Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-301903974 Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c3be0a88f743407f9f59a08be6b73a5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c3be0a88f743407f9f59a08be6b73a5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c3be0a88f743407f9f59a08be6b73a5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c3be0a88f743407f9f59a08be6b73a5e"}]}] Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestNetworkAdvancedServerOps-301903974 Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: c3be0a88f743407f9f59a08be6b73a5e Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-301903974 Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestNetworkAdvancedServerOps-301903974-project Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 399d321c5f564e8ba9d3e1ed7ae05184 Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestNetworkAdvancedServerOps-301903974-project Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 could not be found. Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'ec047e74-f554-4c31-b2e4-7ee0ebc4a044'} Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 could not be found. Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 could not be found. Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:33:25.207168 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:33:25.231723 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:33:25.231723 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:33:25.231723 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:33:25.231723 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:33:25.231723 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:33:25.231723 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:33:25.231723 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 could not be found. Aug 23 18:33:25.231723 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:33:25.231723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95d376d8-84c4-4920-a932-1b34cd233ddb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Returning 404 to user: Instance ec047e74-f554-4c31-b2e4-7ee0ebc4a044 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:33:25.231723 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-95d376d8-84c4-4920-a932-1b34cd233ddb tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044" status: 404 len: 111 microversion: 2.1 time: 0.050215 Aug 23 18:33:25.231723 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3222/6578] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:25 2022] GET /compute/v2.1/servers/ec047e74-f554-4c31-b2e4-7ee0ebc4a044 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:33:30.427664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c99965cc-735f-4578-adde-c5ab26f096fe tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '.version_select at 0x7f27df48e310>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:30.459401 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c99965cc-735f-4578-adde-c5ab26f096fe tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1560871564" status: 202 len: 0 microversion: 2.1 time: 0.037524 Aug 23 18:33:30.461448 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3357/6579] 10.222.0.61 () {58 vars in 1284 bytes} [Tue Aug 23 18:33:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1560871564 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:33:30.500163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-592f4460-7792-42a3-a8fb-154a0ee6bcf7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'create', calling method: .version_select at 0x7f27dfc41700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1728252424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ17zI7W55mlr9gqtH9lX+6NbY854OmmO0C7vHAnVOkpBm+auUgwCpNB8U5OxMe3gPZmY47Q/csP5KvqXn3KAhxxkt1+R2RRD4n/1Tslw8AzSpDOrFS1SEO2RLMzICfO2A=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:30.520264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-592f4460-7792-42a3-a8fb-154a0ee6bcf7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:33:30.526516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-592f4460-7792-42a3-a8fb-154a0ee6bcf7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for user 399d321c5f564e8ba9d3e1ed7ae05184 and project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:33:30.561186 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-592f4460-7792-42a3-a8fb-154a0ee6bcf7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.066762 Aug 23 18:33:30.566661 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3223/6580] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:33:30 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:39.332972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=33 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:39.338928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1466624902", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "f07ecbbd-3c2b-4677-b6c1-f11888953c7b"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1728252424", "security_groups": [{"name": "tempest-secgroup-smoke-1554819931"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:39.582489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] validate_networks() for [('f07ecbbd-3c2b-4677-b6c1-f11888953c7b', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:33:40.148580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c7cb7a63-bec8-464d-9913-c988ca669cba tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:40.149282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7cb7a63-bec8-464d-9913-c988ca669cba tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:40.164533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:40.183795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7cb7a63-bec8-464d-9913-c988ca669cba tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:40.184195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7cb7a63-bec8-464d-9913-c988ca669cba tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:40.184770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7cb7a63-bec8-464d-9913-c988ca669cba tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:40.190832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7cb7a63-bec8-464d-9913-c988ca669cba tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:40.191323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7cb7a63-bec8-464d-9913-c988ca669cba tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:40.191841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7cb7a63-bec8-464d-9913-c988ca669cba tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:40.267712 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c7cb7a63-bec8-464d-9913-c988ca669cba tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/ips" status: 200 len: 146 microversion: 2.1 time: 0.124889 Aug 23 18:33:40.269046 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3224/6581] 10.222.0.61 () {58 vars in 1248 bytes} [Tue Aug 23 18:33:40 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/ips => generated 146 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:40.450691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:33:40.451182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:33:40.454906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:33:40.457682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:33:40.465910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:33:40.516118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:40.516636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:40.521085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:40.526484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:40.527083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:40.531386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:40.582137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:33:40.591869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Getting quotas for user 399d321c5f564e8ba9d3e1ed7ae05184 and project c3be0a88f743407f9f59a08be6b73a5e. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:33:40.611192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:40.646210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:33:40.653182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:33:40.771328 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a2c99f8c-da8a-4162-bfef-02aea6f498b8 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.440560 Aug 23 18:33:40.778602 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3358/6582] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:33:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1448 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:33:40.782817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-1166148086", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "cca54ae0-a798-4267-823e-c2b51ae68ee2"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:40.783400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8389105b-0cd7-4aec-9be9-99515989bd04 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:40.784038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8389105b-0cd7-4aec-9be9-99515989bd04 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:40.875982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] validate_networks() for [('cca54ae0-a798-4267-823e-c2b51ae68ee2', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:33:40.934744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8389105b-0cd7-4aec-9be9-99515989bd04 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:40.942699 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8389105b-0cd7-4aec-9be9-99515989bd04 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1267 microversion: 2.1 time: 0.162896 Aug 23 18:33:40.946533 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3359/6583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:40 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:41.479933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:33:41.481314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:33:41.481979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:33:41.482595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:33:41.483837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:33:41.505370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:41.508761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:41.509537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:41.511351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:41.513169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:41.516605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:41.570668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Getting quotas for project 54327484f00f4b228d6eb3b751457409. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:33:41.577130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Getting quotas for user 9672666fb9dc402d9f6f011f7955f3b6 and project 54327484f00f4b228d6eb3b751457409. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:33:41.593871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:33:41.596822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:33:41.687577 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0ac32fb5-5e74-4f33-95b1-c251ec4e3597 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.082393 Aug 23 18:33:41.690557 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3225/6584] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:33:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:33:41.716189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3e4c85e-b296-4ba7-8864-8c656e6e9dd1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:41.722347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f3e4c85e-b296-4ba7-8864-8c656e6e9dd1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:41.857150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f3e4c85e-b296-4ba7-8864-8c656e6e9dd1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:41.874415 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f3e4c85e-b296-4ba7-8864-8c656e6e9dd1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1215 microversion: 2.1 time: 0.171828 Aug 23 18:33:41.877017 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3360/6585] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:41 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1215 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:41.968346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3320f9f0-db3d-43a1-8f0f-2ba39934fbed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:41.969979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3320f9f0-db3d-43a1-8f0f-2ba39934fbed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:41.982685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3320f9f0-db3d-43a1-8f0f-2ba39934fbed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:41.986431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3320f9f0-db3d-43a1-8f0f-2ba39934fbed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:41.987188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3320f9f0-db3d-43a1-8f0f-2ba39934fbed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:41.992100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3320f9f0-db3d-43a1-8f0f-2ba39934fbed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:41.992820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3320f9f0-db3d-43a1-8f0f-2ba39934fbed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:41.993481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3320f9f0-db3d-43a1-8f0f-2ba39934fbed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:42.089302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3320f9f0-db3d-43a1-8f0f-2ba39934fbed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:42.103086 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3320f9f0-db3d-43a1-8f0f-2ba39934fbed tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1263 microversion: 2.1 time: 0.139570 Aug 23 18:33:42.104406 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3226/6586] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:41 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1263 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:42.900057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d8cda641-eb92-4eee-927d-75102947dc72 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:42.900820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d8cda641-eb92-4eee-927d-75102947dc72 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:42.917231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cda641-eb92-4eee-927d-75102947dc72 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:42.917990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cda641-eb92-4eee-927d-75102947dc72 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:42.919383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cda641-eb92-4eee-927d-75102947dc72 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:42.920903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cda641-eb92-4eee-927d-75102947dc72 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:42.921766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cda641-eb92-4eee-927d-75102947dc72 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:42.922418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d8cda641-eb92-4eee-927d-75102947dc72 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:43.032424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d8cda641-eb92-4eee-927d-75102947dc72 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:43.043136 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d8cda641-eb92-4eee-927d-75102947dc72 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1267 microversion: 2.1 time: 0.147215 Aug 23 18:33:43.056628 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3361/6587] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:42 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:43.115579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0e8b13b2-68e9-4a60-9efa-852944826f53 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "112d46b5-a07a-4aec-8f86-17cae4a3a3df"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:43.119797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0e8b13b2-68e9-4a60-9efa-852944826f53 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:43.124220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51d78822-31b0-4d7a-9a62-e5834d592294 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:43.124834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51d78822-31b0-4d7a-9a62-e5834d592294 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:43.127828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e8b13b2-68e9-4a60-9efa-852944826f53 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:43.128557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e8b13b2-68e9-4a60-9efa-852944826f53 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:43.129250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e8b13b2-68e9-4a60-9efa-852944826f53 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:43.130173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e8b13b2-68e9-4a60-9efa-852944826f53 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:43.130911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e8b13b2-68e9-4a60-9efa-852944826f53 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:43.131558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e8b13b2-68e9-4a60-9efa-852944826f53 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:43.134403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51d78822-31b0-4d7a-9a62-e5834d592294 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:43.134933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51d78822-31b0-4d7a-9a62-e5834d592294 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:43.135381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51d78822-31b0-4d7a-9a62-e5834d592294 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:43.138861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51d78822-31b0-4d7a-9a62-e5834d592294 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:43.154065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51d78822-31b0-4d7a-9a62-e5834d592294 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:43.156220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51d78822-31b0-4d7a-9a62-e5834d592294 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:43.267886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-51d78822-31b0-4d7a-9a62-e5834d592294 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:43.278655 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51d78822-31b0-4d7a-9a62-e5834d592294 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1325 microversion: 2.1 time: 0.158161 Aug 23 18:33:43.279587 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3362/6588] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:43 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1325 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:43.555172 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0e8b13b2-68e9-4a60-9efa-852944826f53 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "POST /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.440551 Aug 23 18:33:43.557021 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3227/6589] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:33:43 2022] POST /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:44.069134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-166babe4-0a8b-4b78-8b6d-67978ef141d0 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:44.069745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-166babe4-0a8b-4b78-8b6d-67978ef141d0 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:44.086045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-166babe4-0a8b-4b78-8b6d-67978ef141d0 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:44.089231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-166babe4-0a8b-4b78-8b6d-67978ef141d0 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:44.090039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-166babe4-0a8b-4b78-8b6d-67978ef141d0 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:44.091300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-166babe4-0a8b-4b78-8b6d-67978ef141d0 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:44.092427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-166babe4-0a8b-4b78-8b6d-67978ef141d0 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:44.093222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-166babe4-0a8b-4b78-8b6d-67978ef141d0 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:44.306138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-166babe4-0a8b-4b78-8b6d-67978ef141d0 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:44.312663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e9285995-ba97-4956-9c78-7c4e2a5cbeb1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:44.317043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e9285995-ba97-4956-9c78-7c4e2a5cbeb1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:44.326456 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-166babe4-0a8b-4b78-8b6d-67978ef141d0 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1273 microversion: 2.1 time: 0.261241 Aug 23 18:33:44.333365 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3363/6590] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:44 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1273 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:44.336178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9285995-ba97-4956-9c78-7c4e2a5cbeb1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:44.337901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9285995-ba97-4956-9c78-7c4e2a5cbeb1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:44.339594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9285995-ba97-4956-9c78-7c4e2a5cbeb1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:44.343740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9285995-ba97-4956-9c78-7c4e2a5cbeb1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:44.344734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9285995-ba97-4956-9c78-7c4e2a5cbeb1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:44.346667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9285995-ba97-4956-9c78-7c4e2a5cbeb1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:44.771775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e9285995-ba97-4956-9c78-7c4e2a5cbeb1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:44.781342 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e9285995-ba97-4956-9c78-7c4e2a5cbeb1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1393 microversion: 2.1 time: 0.484499 Aug 23 18:33:44.794077 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3228/6591] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:44 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1393 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:33:45.360964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-345a3993-ad0f-4803-ba9f-80170f1d64ba tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:45.361674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-345a3993-ad0f-4803-ba9f-80170f1d64ba tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:45.370300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:45.371980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-345a3993-ad0f-4803-ba9f-80170f1d64ba tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:45.372554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-345a3993-ad0f-4803-ba9f-80170f1d64ba tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:45.373065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-345a3993-ad0f-4803-ba9f-80170f1d64ba tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:45.373798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-345a3993-ad0f-4803-ba9f-80170f1d64ba tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:45.374263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-345a3993-ad0f-4803-ba9f-80170f1d64ba tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:45.374825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-345a3993-ad0f-4803-ba9f-80170f1d64ba tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:45.587344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-345a3993-ad0f-4803-ba9f-80170f1d64ba tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:45.598562 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-345a3993-ad0f-4803-ba9f-80170f1d64ba tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1315 microversion: 2.1 time: 0.241810 Aug 23 18:33:45.613432 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3364/6592] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:45 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:45.809415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7cc10aad-76be-468b-a6ea-62d063e2323f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:45.810653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7cc10aad-76be-468b-a6ea-62d063e2323f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:45.812928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:45.830309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7cc10aad-76be-468b-a6ea-62d063e2323f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:45.831250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7cc10aad-76be-468b-a6ea-62d063e2323f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:45.831938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7cc10aad-76be-468b-a6ea-62d063e2323f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:45.833280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7cc10aad-76be-468b-a6ea-62d063e2323f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:45.838746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7cc10aad-76be-468b-a6ea-62d063e2323f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:45.839681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7cc10aad-76be-468b-a6ea-62d063e2323f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:46.148201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6e314bca-727a-4078-a4ce-d2155134339f req-3622ac84-4fbb-4a92-b62f-a40c18599ff4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f036fec-6fc7-4d25-8262-91c63d4004ad", "tag": "913d6a7f-e98e-4663-bf84-b15992836ee5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:46.169756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6e314bca-727a-4078-a4ce-d2155134339f req-3622ac84-4fbb-4a92-b62f-a40c18599ff4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:46.172637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6e314bca-727a-4078-a4ce-d2155134339f req-3622ac84-4fbb-4a92-b62f-a40c18599ff4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:46.174859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6e314bca-727a-4078-a4ce-d2155134339f req-3622ac84-4fbb-4a92-b62f-a40c18599ff4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:46.210753 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6e314bca-727a-4078-a4ce-d2155134339f req-3622ac84-4fbb-4a92-b62f-a40c18599ff4 service nova] Creating event network-changed:913d6a7f-e98e-4663-bf84-b15992836ee5 for instance 5f036fec-6fc7-4d25-8262-91c63d4004ad on n-h2-850468-16 Aug 23 18:33:46.227298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7cc10aad-76be-468b-a6ea-62d063e2323f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:46.229772 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6e314bca-727a-4078-a4ce-d2155134339f req-3622ac84-4fbb-4a92-b62f-a40c18599ff4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085758 Aug 23 18:33:46.230723 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3365/6593] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:46.240939 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7cc10aad-76be-468b-a6ea-62d063e2323f tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1393 microversion: 2.1 time: 0.437725 Aug 23 18:33:46.245920 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3229/6594] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:45 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1393 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:46.562377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-757c0825-5b41-4e85-b65e-b617623f7481 req-20b5a357-e95b-4498-8552-39ed137bc72d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "346948dd-399d-482d-8ac9-bd7316770254", "tag": "2d8a6c51-68f8-416f-82e7-10b1762cd82a"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:46.594101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-757c0825-5b41-4e85-b65e-b617623f7481 req-20b5a357-e95b-4498-8552-39ed137bc72d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:46.594948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-757c0825-5b41-4e85-b65e-b617623f7481 req-20b5a357-e95b-4498-8552-39ed137bc72d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:46.595603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-757c0825-5b41-4e85-b65e-b617623f7481 req-20b5a357-e95b-4498-8552-39ed137bc72d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:46.620552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-52f122f0-21a5-45eb-a30a-daa73a75ee04 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:46.621342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-52f122f0-21a5-45eb-a30a-daa73a75ee04 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:46.634634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52f122f0-21a5-45eb-a30a-daa73a75ee04 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:46.635822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52f122f0-21a5-45eb-a30a-daa73a75ee04 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:46.647340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52f122f0-21a5-45eb-a30a-daa73a75ee04 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:46.649294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52f122f0-21a5-45eb-a30a-daa73a75ee04 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:46.655377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52f122f0-21a5-45eb-a30a-daa73a75ee04 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:46.656043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52f122f0-21a5-45eb-a30a-daa73a75ee04 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:47.252557 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-757c0825-5b41-4e85-b65e-b617623f7481 req-20b5a357-e95b-4498-8552-39ed137bc72d service nova] Creating event network-changed:2d8a6c51-68f8-416f-82e7-10b1762cd82a for instance 346948dd-399d-482d-8ac9-bd7316770254 on n-h2-850468-16 Aug 23 18:33:47.261439 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-757c0825-5b41-4e85-b65e-b617623f7481 req-20b5a357-e95b-4498-8552-39ed137bc72d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.702916 Aug 23 18:33:47.262303 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3366/6595] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:47.274430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d59e855b-590d-4c25-9b92-bfd2b3e89736 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:47.275209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d59e855b-590d-4c25-9b92-bfd2b3e89736 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:47.282433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59e855b-590d-4c25-9b92-bfd2b3e89736 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:47.285494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59e855b-590d-4c25-9b92-bfd2b3e89736 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:47.286190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59e855b-590d-4c25-9b92-bfd2b3e89736 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:47.287196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59e855b-590d-4c25-9b92-bfd2b3e89736 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:47.287833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59e855b-590d-4c25-9b92-bfd2b3e89736 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:47.288486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d59e855b-590d-4c25-9b92-bfd2b3e89736 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:47.323222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-52f122f0-21a5-45eb-a30a-daa73a75ee04 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:47.338598 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-52f122f0-21a5-45eb-a30a-daa73a75ee04 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1315 microversion: 2.1 time: 0.722237 Aug 23 18:33:47.339517 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3230/6596] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:46 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1315 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:33:47.570412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d59e855b-590d-4c25-9b92-bfd2b3e89736 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:47.580348 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d59e855b-590d-4c25-9b92-bfd2b3e89736 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1393 microversion: 2.1 time: 0.317047 Aug 23 18:33:47.581176 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3367/6597] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:47 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1393 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:48.367865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f0046b34-b637-473b-aee1-b9cfc70f642f tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:48.368709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f0046b34-b637-473b-aee1-b9cfc70f642f tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:48.376502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0046b34-b637-473b-aee1-b9cfc70f642f tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:48.377260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0046b34-b637-473b-aee1-b9cfc70f642f tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:48.377712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0046b34-b637-473b-aee1-b9cfc70f642f tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:48.378456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0046b34-b637-473b-aee1-b9cfc70f642f tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:48.378946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0046b34-b637-473b-aee1-b9cfc70f642f tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:48.379382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0046b34-b637-473b-aee1-b9cfc70f642f tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:48.607854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ebb02f3d-e2e5-47be-bc04-f6a6b9fce828 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:48.609229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ebb02f3d-e2e5-47be-bc04-f6a6b9fce828 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:48.616681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebb02f3d-e2e5-47be-bc04-f6a6b9fce828 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:48.617387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebb02f3d-e2e5-47be-bc04-f6a6b9fce828 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:48.617832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebb02f3d-e2e5-47be-bc04-f6a6b9fce828 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:48.618573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebb02f3d-e2e5-47be-bc04-f6a6b9fce828 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:48.619303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebb02f3d-e2e5-47be-bc04-f6a6b9fce828 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:48.619738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebb02f3d-e2e5-47be-bc04-f6a6b9fce828 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:48.631525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f0046b34-b637-473b-aee1-b9cfc70f642f tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:48.644280 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f0046b34-b637-473b-aee1-b9cfc70f642f tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1315 microversion: 2.1 time: 0.280411 Aug 23 18:33:48.645461 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3231/6598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:48 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:48.792131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ebb02f3d-e2e5-47be-bc04-f6a6b9fce828 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:48.804405 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ebb02f3d-e2e5-47be-bc04-f6a6b9fce828 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1393 microversion: 2.1 time: 0.203376 Aug 23 18:33:48.806060 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3368/6599] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:48 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1393 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:48.839741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1777cae-19d1-46be-a231-53e7dc5d07fd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:48.841192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d1777cae-19d1-46be-a231-53e7dc5d07fd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:48.848743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c9bb599c-0008-4882-9363-e81646fd57c3 req-c5cca0ed-4481-4d7a-a6c4-b3ab64a4ce0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7ac4913-d262-468e-9fbe-ae2cdababfff", "tag": "9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:48.860285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1777cae-19d1-46be-a231-53e7dc5d07fd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:48.860779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1777cae-19d1-46be-a231-53e7dc5d07fd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:48.861220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1777cae-19d1-46be-a231-53e7dc5d07fd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:48.861938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1777cae-19d1-46be-a231-53e7dc5d07fd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:48.867496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1777cae-19d1-46be-a231-53e7dc5d07fd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:48.868273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1777cae-19d1-46be-a231-53e7dc5d07fd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:48.868656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c9bb599c-0008-4882-9363-e81646fd57c3 req-c5cca0ed-4481-4d7a-a6c4-b3ab64a4ce0a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:48.873853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c9bb599c-0008-4882-9363-e81646fd57c3 req-c5cca0ed-4481-4d7a-a6c4-b3ab64a4ce0a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:48.874674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c9bb599c-0008-4882-9363-e81646fd57c3 req-c5cca0ed-4481-4d7a-a6c4-b3ab64a4ce0a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:48.896440 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c9bb599c-0008-4882-9363-e81646fd57c3 req-c5cca0ed-4481-4d7a-a6c4-b3ab64a4ce0a service nova] Creating event network-changed:9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0 for instance e7ac4913-d262-468e-9fbe-ae2cdababfff on n-h2-850468-16 Aug 23 18:33:48.902325 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c9bb599c-0008-4882-9363-e81646fd57c3 req-c5cca0ed-4481-4d7a-a6c4-b3ab64a4ce0a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057226 Aug 23 18:33:48.903766 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3369/6600] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:48.920514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d1777cae-19d1-46be-a231-53e7dc5d07fd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:33:49.021848 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d1777cae-19d1-46be-a231-53e7dc5d07fd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "DELETE /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 204 len: 0 microversion: 2.1 time: 0.185416 Aug 23 18:33:49.026589 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3232/6601] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:33:48 2022] DELETE /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:33:49.032299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d0a523d-517c-4e82-83c1-2b2e599564fe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:49.033096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7d0a523d-517c-4e82-83c1-2b2e599564fe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:49.045731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d0a523d-517c-4e82-83c1-2b2e599564fe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:49.055046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d0a523d-517c-4e82-83c1-2b2e599564fe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:49.055543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d0a523d-517c-4e82-83c1-2b2e599564fe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:49.056308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d0a523d-517c-4e82-83c1-2b2e599564fe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:49.056805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d0a523d-517c-4e82-83c1-2b2e599564fe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:49.057203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d0a523d-517c-4e82-83c1-2b2e599564fe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:49.253047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7d0a523d-517c-4e82-83c1-2b2e599564fe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:49.266377 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7d0a523d-517c-4e82-83c1-2b2e599564fe tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1584 microversion: 2.1 time: 0.238300 Aug 23 18:33:49.280462 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3370/6602] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:49 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1584 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:33:49.682662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ef1a2f6d-a921-464b-85d4-c38d589829fc tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:49.684480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ef1a2f6d-a921-464b-85d4-c38d589829fc tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:49.699726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef1a2f6d-a921-464b-85d4-c38d589829fc tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:49.700531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef1a2f6d-a921-464b-85d4-c38d589829fc tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:49.701573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef1a2f6d-a921-464b-85d4-c38d589829fc tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:49.702460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef1a2f6d-a921-464b-85d4-c38d589829fc tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:49.703060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef1a2f6d-a921-464b-85d4-c38d589829fc tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:49.703609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef1a2f6d-a921-464b-85d4-c38d589829fc tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:49.828920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-45cc4280-b8ad-4fed-ada8-d9c88bf8dec7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:49.829592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-45cc4280-b8ad-4fed-ada8-d9c88bf8dec7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:49.838057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45cc4280-b8ad-4fed-ada8-d9c88bf8dec7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:49.838695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45cc4280-b8ad-4fed-ada8-d9c88bf8dec7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:49.839029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45cc4280-b8ad-4fed-ada8-d9c88bf8dec7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:49.839753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45cc4280-b8ad-4fed-ada8-d9c88bf8dec7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:49.840217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45cc4280-b8ad-4fed-ada8-d9c88bf8dec7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:49.841063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45cc4280-b8ad-4fed-ada8-d9c88bf8dec7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:49.907350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ef1a2f6d-a921-464b-85d4-c38d589829fc tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:49.918772 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ef1a2f6d-a921-464b-85d4-c38d589829fc tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1315 microversion: 2.1 time: 0.242673 Aug 23 18:33:49.919751 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3233/6603] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:49 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:50.084975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45cc4280-b8ad-4fed-ada8-d9c88bf8dec7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:50.096613 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-45cc4280-b8ad-4fed-ada8-d9c88bf8dec7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1393 microversion: 2.1 time: 0.273589 Aug 23 18:33:50.098588 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3371/6604] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:49 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1393 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:50.301667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6f92775-2fc6-4af6-8d22-c1574d6486b6 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:50.302914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6f92775-2fc6-4af6-8d22-c1574d6486b6 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:50.315175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6f92775-2fc6-4af6-8d22-c1574d6486b6 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:50.316478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6f92775-2fc6-4af6-8d22-c1574d6486b6 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:50.317556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6f92775-2fc6-4af6-8d22-c1574d6486b6 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:50.318904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6f92775-2fc6-4af6-8d22-c1574d6486b6 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:50.319784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6f92775-2fc6-4af6-8d22-c1574d6486b6 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:50.320637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6f92775-2fc6-4af6-8d22-c1574d6486b6 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:50.474900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f6f92775-2fc6-4af6-8d22-c1574d6486b6 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:50.486824 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6f92775-2fc6-4af6-8d22-c1574d6486b6 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1584 microversion: 2.1 time: 0.191383 Aug 23 18:33:50.487627 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3234/6605] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:50 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1584 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:50.948155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6e9d7c55-1a88-41d1-ab82-2f3066044a44 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:50.948814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6e9d7c55-1a88-41d1-ab82-2f3066044a44 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:50.950833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:50.957020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e9d7c55-1a88-41d1-ab82-2f3066044a44 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:50.957519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e9d7c55-1a88-41d1-ab82-2f3066044a44 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:50.957961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e9d7c55-1a88-41d1-ab82-2f3066044a44 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:50.958713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e9d7c55-1a88-41d1-ab82-2f3066044a44 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:50.959184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e9d7c55-1a88-41d1-ab82-2f3066044a44 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:50.959608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e9d7c55-1a88-41d1-ab82-2f3066044a44 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:51.098989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6e9d7c55-1a88-41d1-ab82-2f3066044a44 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:51.107463 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6e9d7c55-1a88-41d1-ab82-2f3066044a44 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1315 microversion: 2.1 time: 0.164458 Aug 23 18:33:51.108235 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3372/6606] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:50 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:51.118565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ccd21504-1b21-4f20-98b2-2ce2cd4c2766 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:51.119315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ccd21504-1b21-4f20-98b2-2ce2cd4c2766 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:51.126907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccd21504-1b21-4f20-98b2-2ce2cd4c2766 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:51.127394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccd21504-1b21-4f20-98b2-2ce2cd4c2766 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:51.127828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccd21504-1b21-4f20-98b2-2ce2cd4c2766 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:51.128527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccd21504-1b21-4f20-98b2-2ce2cd4c2766 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:51.129004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccd21504-1b21-4f20-98b2-2ce2cd4c2766 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:51.129427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ccd21504-1b21-4f20-98b2-2ce2cd4c2766 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:51.271033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ccd21504-1b21-4f20-98b2-2ce2cd4c2766 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:51.279718 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ccd21504-1b21-4f20-98b2-2ce2cd4c2766 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1393 microversion: 2.1 time: 0.166313 Aug 23 18:33:51.280295 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3235/6607] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:51 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1393 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:51.509764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c3c89c74-7308-4112-b2cf-63a96b6e6f48 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:51.510397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c3c89c74-7308-4112-b2cf-63a96b6e6f48 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:51.516537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3c89c74-7308-4112-b2cf-63a96b6e6f48 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:51.517036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3c89c74-7308-4112-b2cf-63a96b6e6f48 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:51.517489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3c89c74-7308-4112-b2cf-63a96b6e6f48 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:51.518200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3c89c74-7308-4112-b2cf-63a96b6e6f48 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:51.518693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3c89c74-7308-4112-b2cf-63a96b6e6f48 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:51.519131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3c89c74-7308-4112-b2cf-63a96b6e6f48 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:51.666770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c3c89c74-7308-4112-b2cf-63a96b6e6f48 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:51.675152 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c3c89c74-7308-4112-b2cf-63a96b6e6f48 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1584 microversion: 2.1 time: 0.169939 Aug 23 18:33:51.675929 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3373/6608] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:51 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1584 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:52.129778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6f9f0ec8-4e60-4b22-a00b-0190bd36d791 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:52.130661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6f9f0ec8-4e60-4b22-a00b-0190bd36d791 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:52.133491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:52.134600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:52.143805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f9f0ec8-4e60-4b22-a00b-0190bd36d791 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:52.144362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f9f0ec8-4e60-4b22-a00b-0190bd36d791 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:52.144809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f9f0ec8-4e60-4b22-a00b-0190bd36d791 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:52.145519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f9f0ec8-4e60-4b22-a00b-0190bd36d791 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:52.145977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f9f0ec8-4e60-4b22-a00b-0190bd36d791 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:52.146407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f9f0ec8-4e60-4b22-a00b-0190bd36d791 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:52.284619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6f9f0ec8-4e60-4b22-a00b-0190bd36d791 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:52.296149 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6f9f0ec8-4e60-4b22-a00b-0190bd36d791 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1315 microversion: 2.1 time: 0.171320 Aug 23 18:33:52.301247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d5fff0db-2753-49d5-b928-7cdaa5a159f6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:52.301869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d5fff0db-2753-49d5-b928-7cdaa5a159f6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:52.304348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=10 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:52.307148 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3236/6609] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:52 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:52.311642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5fff0db-2753-49d5-b928-7cdaa5a159f6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:52.312144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5fff0db-2753-49d5-b928-7cdaa5a159f6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:52.312593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5fff0db-2753-49d5-b928-7cdaa5a159f6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:52.313312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5fff0db-2753-49d5-b928-7cdaa5a159f6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:52.313773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5fff0db-2753-49d5-b928-7cdaa5a159f6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:52.314210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5fff0db-2753-49d5-b928-7cdaa5a159f6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:52.451736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d5fff0db-2753-49d5-b928-7cdaa5a159f6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:52.459569 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d5fff0db-2753-49d5-b928-7cdaa5a159f6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1393 microversion: 2.1 time: 0.162137 Aug 23 18:33:52.460858 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3374/6610] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:52 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1393 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:33:52.696524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f9badd6f-394c-4004-832c-ad55c8993246 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:52.697140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f9badd6f-394c-4004-832c-ad55c8993246 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:52.703258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9badd6f-394c-4004-832c-ad55c8993246 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:52.703743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9badd6f-394c-4004-832c-ad55c8993246 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:52.704176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9badd6f-394c-4004-832c-ad55c8993246 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:52.704870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9badd6f-394c-4004-832c-ad55c8993246 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:52.705321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9badd6f-394c-4004-832c-ad55c8993246 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:52.705745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f9badd6f-394c-4004-832c-ad55c8993246 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:52.854304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f9badd6f-394c-4004-832c-ad55c8993246 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:52.862530 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f9badd6f-394c-4004-832c-ad55c8993246 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1584 microversion: 2.1 time: 0.170527 Aug 23 18:33:52.863247 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3237/6611] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:52 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1584 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:53.150934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-642a4806-2ae9-41c8-8422-463615be088f req-7c00aca7-c5ba-4682-8bae-66b3469a9929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f036fec-6fc7-4d25-8262-91c63d4004ad", "name": "network-vif-plugged", "status": "completed", "tag": "913d6a7f-e98e-4663-bf84-b15992836ee5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:53.160816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-642a4806-2ae9-41c8-8422-463615be088f req-7c00aca7-c5ba-4682-8bae-66b3469a9929 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:53.161533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-642a4806-2ae9-41c8-8422-463615be088f req-7c00aca7-c5ba-4682-8bae-66b3469a9929 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:53.162145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-642a4806-2ae9-41c8-8422-463615be088f req-7c00aca7-c5ba-4682-8bae-66b3469a9929 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:53.184395 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-642a4806-2ae9-41c8-8422-463615be088f req-7c00aca7-c5ba-4682-8bae-66b3469a9929 service nova] Creating event network-vif-plugged:913d6a7f-e98e-4663-bf84-b15992836ee5 for instance 5f036fec-6fc7-4d25-8262-91c63d4004ad on n-h2-850468-16 Aug 23 18:33:53.195911 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-642a4806-2ae9-41c8-8422-463615be088f req-7c00aca7-c5ba-4682-8bae-66b3469a9929 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045534 Aug 23 18:33:53.197008 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3375/6612] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:53.331434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-733ab983-8019-46df-950e-e2718aedbe0b tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:53.332768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-733ab983-8019-46df-950e-e2718aedbe0b tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:53.341247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-733ab983-8019-46df-950e-e2718aedbe0b tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:53.342090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-733ab983-8019-46df-950e-e2718aedbe0b tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:53.342749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-733ab983-8019-46df-950e-e2718aedbe0b tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:53.343626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-733ab983-8019-46df-950e-e2718aedbe0b tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:53.344245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-733ab983-8019-46df-950e-e2718aedbe0b tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:53.344835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-733ab983-8019-46df-950e-e2718aedbe0b tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:53.373307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:53.485891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d04261ed-24af-479f-a907-d683f7ecf303 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:53.487260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d04261ed-24af-479f-a907-d683f7ecf303 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:53.497980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d04261ed-24af-479f-a907-d683f7ecf303 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:53.500112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d04261ed-24af-479f-a907-d683f7ecf303 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:53.500833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d04261ed-24af-479f-a907-d683f7ecf303 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:53.503503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d04261ed-24af-479f-a907-d683f7ecf303 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:53.503994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d04261ed-24af-479f-a907-d683f7ecf303 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:53.504444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d04261ed-24af-479f-a907-d683f7ecf303 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:53.745496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-733ab983-8019-46df-950e-e2718aedbe0b tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:53.759796 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-733ab983-8019-46df-950e-e2718aedbe0b tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1315 microversion: 2.1 time: 0.434865 Aug 23 18:33:53.773866 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3238/6613] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:53 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1315 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:53.774857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d04261ed-24af-479f-a907-d683f7ecf303 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:53.782640 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d04261ed-24af-479f-a907-d683f7ecf303 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1393 microversion: 2.1 time: 0.304120 Aug 23 18:33:53.783493 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3376/6614] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:53 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1393 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:53.903640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c5636d61-5e4d-480e-8342-57f994dbbdca tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:53.905565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c5636d61-5e4d-480e-8342-57f994dbbdca tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:53.916535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5636d61-5e4d-480e-8342-57f994dbbdca tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:53.917316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5636d61-5e4d-480e-8342-57f994dbbdca tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:53.917989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5636d61-5e4d-480e-8342-57f994dbbdca tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:53.918990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5636d61-5e4d-480e-8342-57f994dbbdca tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:53.919681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5636d61-5e4d-480e-8342-57f994dbbdca tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:53.920335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c5636d61-5e4d-480e-8342-57f994dbbdca tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:54.204116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3f3cb2a0-574c-48ad-bade-3387bb116848 req-26594338-dc56-41fc-85f5-e349f5e0e2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7ac4913-d262-468e-9fbe-ae2cdababfff", "name": "network-vif-deleted", "tag": "9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:54.216634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3f3cb2a0-574c-48ad-bade-3387bb116848 req-26594338-dc56-41fc-85f5-e349f5e0e2dc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:54.216634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3f3cb2a0-574c-48ad-bade-3387bb116848 req-26594338-dc56-41fc-85f5-e349f5e0e2dc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:54.216634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3f3cb2a0-574c-48ad-bade-3387bb116848 req-26594338-dc56-41fc-85f5-e349f5e0e2dc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:54.228911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c5636d61-5e4d-480e-8342-57f994dbbdca tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:54.229066 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3f3cb2a0-574c-48ad-bade-3387bb116848 req-26594338-dc56-41fc-85f5-e349f5e0e2dc service nova] Creating event network-vif-deleted:9b7a75b7-a0f6-40f1-9d9c-036755f8bdb0 for instance e7ac4913-d262-468e-9fbe-ae2cdababfff on n-h2-850468-16 Aug 23 18:33:54.234041 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3f3cb2a0-574c-48ad-bade-3387bb116848 req-26594338-dc56-41fc-85f5-e349f5e0e2dc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035232 Aug 23 18:33:54.234658 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3377/6615] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:33:54.237838 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c5636d61-5e4d-480e-8342-57f994dbbdca tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1584 microversion: 2.1 time: 0.352664 Aug 23 18:33:54.238020 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3239/6616] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:53 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1584 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:54.782249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33b5ac4e-b67d-48b7-b01f-5f6cb57017c9 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:54.783202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33b5ac4e-b67d-48b7-b01f-5f6cb57017c9 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:54.790811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33b5ac4e-b67d-48b7-b01f-5f6cb57017c9 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:54.791697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33b5ac4e-b67d-48b7-b01f-5f6cb57017c9 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:54.792366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33b5ac4e-b67d-48b7-b01f-5f6cb57017c9 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:54.793267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33b5ac4e-b67d-48b7-b01f-5f6cb57017c9 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:54.793932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33b5ac4e-b67d-48b7-b01f-5f6cb57017c9 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:54.794464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33b5ac4e-b67d-48b7-b01f-5f6cb57017c9 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:54.805386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f0a82503-c9b7-47ec-b2be-e21259bd1a0b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:54.806009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f0a82503-c9b7-47ec-b2be-e21259bd1a0b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:54.821811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0a82503-c9b7-47ec-b2be-e21259bd1a0b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:54.822798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0a82503-c9b7-47ec-b2be-e21259bd1a0b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:54.823438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0a82503-c9b7-47ec-b2be-e21259bd1a0b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:54.824346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0a82503-c9b7-47ec-b2be-e21259bd1a0b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:54.824960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0a82503-c9b7-47ec-b2be-e21259bd1a0b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:54.825571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0a82503-c9b7-47ec-b2be-e21259bd1a0b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:55.017852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-33b5ac4e-b67d-48b7-b01f-5f6cb57017c9 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:55.029105 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-33b5ac4e-b67d-48b7-b01f-5f6cb57017c9 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1315 microversion: 2.1 time: 0.252048 Aug 23 18:33:55.042576 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3378/6617] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:54 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:55.087711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f0a82503-c9b7-47ec-b2be-e21259bd1a0b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:55.098871 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f0a82503-c9b7-47ec-b2be-e21259bd1a0b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1393 microversion: 2.1 time: 0.297970 Aug 23 18:33:55.099980 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3240/6618] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:54 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1393 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:55.277490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-44678362-56fd-43be-af4f-fd9815e4f56b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:55.278370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-44678362-56fd-43be-af4f-fd9815e4f56b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:55.287141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44678362-56fd-43be-af4f-fd9815e4f56b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:55.289364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44678362-56fd-43be-af4f-fd9815e4f56b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:55.290630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44678362-56fd-43be-af4f-fd9815e4f56b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:55.291972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44678362-56fd-43be-af4f-fd9815e4f56b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:55.292670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44678362-56fd-43be-af4f-fd9815e4f56b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:55.293317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-44678362-56fd-43be-af4f-fd9815e4f56b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:55.373705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-44678362-56fd-43be-af4f-fd9815e4f56b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:55.383830 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-44678362-56fd-43be-af4f-fd9815e4f56b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1229 microversion: 2.1 time: 0.127779 Aug 23 18:33:55.385442 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3379/6619] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:55 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1229 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:56.051800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8b06a6c8-c7c6-4971-a657-c8f6988d0297 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:56.052381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8b06a6c8-c7c6-4971-a657-c8f6988d0297 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:56.059865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b06a6c8-c7c6-4971-a657-c8f6988d0297 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:56.060241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b06a6c8-c7c6-4971-a657-c8f6988d0297 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:56.060674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b06a6c8-c7c6-4971-a657-c8f6988d0297 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:56.061521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b06a6c8-c7c6-4971-a657-c8f6988d0297 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:56.061835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b06a6c8-c7c6-4971-a657-c8f6988d0297 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:56.062269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b06a6c8-c7c6-4971-a657-c8f6988d0297 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:56.122210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b8f1a9e3-75a8-4a98-b17b-33261ee27151 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:56.123510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b8f1a9e3-75a8-4a98-b17b-33261ee27151 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:56.135035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8f1a9e3-75a8-4a98-b17b-33261ee27151 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:56.135877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8f1a9e3-75a8-4a98-b17b-33261ee27151 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:56.138370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8f1a9e3-75a8-4a98-b17b-33261ee27151 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:56.139346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8f1a9e3-75a8-4a98-b17b-33261ee27151 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:56.140637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8f1a9e3-75a8-4a98-b17b-33261ee27151 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:56.141250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b8f1a9e3-75a8-4a98-b17b-33261ee27151 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:56.173910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=100 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:33:56.232614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8b06a6c8-c7c6-4971-a657-c8f6988d0297 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:56.246741 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8b06a6c8-c7c6-4971-a657-c8f6988d0297 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1315 microversion: 2.1 time: 0.197524 Aug 23 18:33:56.248055 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3241/6620] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:56 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:33:56.385535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b8f1a9e3-75a8-4a98-b17b-33261ee27151 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:56.393826 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b8f1a9e3-75a8-4a98-b17b-33261ee27151 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1565 microversion: 2.1 time: 0.276533 Aug 23 18:33:56.394905 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3380/6621] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:56 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1565 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:33:56.406312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aeeaa024-78a0-4a88-b95f-241ca15497f1 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:56.407433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aeeaa024-78a0-4a88-b95f-241ca15497f1 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:56.415593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aeeaa024-78a0-4a88-b95f-241ca15497f1 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:56.416335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aeeaa024-78a0-4a88-b95f-241ca15497f1 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:56.416779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aeeaa024-78a0-4a88-b95f-241ca15497f1 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:56.417522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aeeaa024-78a0-4a88-b95f-241ca15497f1 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:56.418144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aeeaa024-78a0-4a88-b95f-241ca15497f1 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:56.418638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8cd989b0-d094-454e-b990-0551046577f9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:56.419055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aeeaa024-78a0-4a88-b95f-241ca15497f1 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:56.419773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8cd989b0-d094-454e-b990-0551046577f9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:56.432862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd989b0-d094-454e-b990-0551046577f9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:56.433459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd989b0-d094-454e-b990-0551046577f9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:56.434170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd989b0-d094-454e-b990-0551046577f9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:56.435148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd989b0-d094-454e-b990-0551046577f9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:56.436132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd989b0-d094-454e-b990-0551046577f9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:56.436998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cd989b0-d094-454e-b990-0551046577f9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:56.511210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aeeaa024-78a0-4a88-b95f-241ca15497f1 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:56.521858 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aeeaa024-78a0-4a88-b95f-241ca15497f1 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1229 microversion: 2.1 time: 0.118815 Aug 23 18:33:56.536851 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3242/6622] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:56 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1229 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:56.625495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8cd989b0-d094-454e-b990-0551046577f9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:56.639681 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8cd989b0-d094-454e-b990-0551046577f9 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1565 microversion: 2.1 time: 0.227169 Aug 23 18:33:56.640316 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3381/6623] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:56 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1565 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:33:57.279168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3322123f-87f9-4bcf-923e-d5784edf801e req-0344c343-5cf4-4a19-96f6-02a7f1c9dc1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "346948dd-399d-482d-8ac9-bd7316770254", "name": "network-vif-plugged", "status": "completed", "tag": "2d8a6c51-68f8-416f-82e7-10b1762cd82a"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:57.279953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-51d763a1-876e-4b75-a6f5-9f06b8a28b4a tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:57.281038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-51d763a1-876e-4b75-a6f5-9f06b8a28b4a tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:57.297020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51d763a1-876e-4b75-a6f5-9f06b8a28b4a tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:57.299027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51d763a1-876e-4b75-a6f5-9f06b8a28b4a tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:57.300141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51d763a1-876e-4b75-a6f5-9f06b8a28b4a tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:57.303056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51d763a1-876e-4b75-a6f5-9f06b8a28b4a tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:57.306603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3322123f-87f9-4bcf-923e-d5784edf801e req-0344c343-5cf4-4a19-96f6-02a7f1c9dc1d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:57.308134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51d763a1-876e-4b75-a6f5-9f06b8a28b4a tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:57.308728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51d763a1-876e-4b75-a6f5-9f06b8a28b4a tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:57.311442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3322123f-87f9-4bcf-923e-d5784edf801e req-0344c343-5cf4-4a19-96f6-02a7f1c9dc1d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:57.313718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3322123f-87f9-4bcf-923e-d5784edf801e req-0344c343-5cf4-4a19-96f6-02a7f1c9dc1d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:57.359985 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3322123f-87f9-4bcf-923e-d5784edf801e req-0344c343-5cf4-4a19-96f6-02a7f1c9dc1d service nova] Creating event network-vif-plugged:2d8a6c51-68f8-416f-82e7-10b1762cd82a for instance 346948dd-399d-482d-8ac9-bd7316770254 on n-h2-850468-16 Aug 23 18:33:57.369379 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3322123f-87f9-4bcf-923e-d5784edf801e req-0344c343-5cf4-4a19-96f6-02a7f1c9dc1d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101202 Aug 23 18:33:57.372623 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3382/6624] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:57.527275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-51d763a1-876e-4b75-a6f5-9f06b8a28b4a tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:57.536409 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-51d763a1-876e-4b75-a6f5-9f06b8a28b4a tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1315 microversion: 2.1 time: 0.268652 Aug 23 18:33:57.538873 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3243/6625] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:57 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:57.561742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a3be35d2-38ab-4b69-a477-9b079012960b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:57.563123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a3be35d2-38ab-4b69-a477-9b079012960b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:57.576031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3be35d2-38ab-4b69-a477-9b079012960b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:57.576776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3be35d2-38ab-4b69-a477-9b079012960b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:57.578285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3be35d2-38ab-4b69-a477-9b079012960b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:57.580618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3be35d2-38ab-4b69-a477-9b079012960b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:57.581278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3be35d2-38ab-4b69-a477-9b079012960b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:57.582462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3be35d2-38ab-4b69-a477-9b079012960b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:57.623444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c64b7fea-8091-4c3e-a688-5420728aee55 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:57.625992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c64b7fea-8091-4c3e-a688-5420728aee55 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:57.633189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c64b7fea-8091-4c3e-a688-5420728aee55 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:57.633931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c64b7fea-8091-4c3e-a688-5420728aee55 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:57.634528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c64b7fea-8091-4c3e-a688-5420728aee55 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:57.635432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c64b7fea-8091-4c3e-a688-5420728aee55 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:57.636145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c64b7fea-8091-4c3e-a688-5420728aee55 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:57.636740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c64b7fea-8091-4c3e-a688-5420728aee55 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:57.674992 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c64b7fea-8091-4c3e-a688-5420728aee55 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055981 Aug 23 18:33:57.675826 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3244/6626] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:33:57 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:33:57.686980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ce4d4dd6-4f73-4e07-8212-448db9278123 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:57.688164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ce4d4dd6-4f73-4e07-8212-448db9278123 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:57.691561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a3be35d2-38ab-4b69-a477-9b079012960b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:57.695479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce4d4dd6-4f73-4e07-8212-448db9278123 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:57.696160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce4d4dd6-4f73-4e07-8212-448db9278123 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:57.696776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce4d4dd6-4f73-4e07-8212-448db9278123 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:57.697646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce4d4dd6-4f73-4e07-8212-448db9278123 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:57.698257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce4d4dd6-4f73-4e07-8212-448db9278123 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:57.698873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce4d4dd6-4f73-4e07-8212-448db9278123 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:57.711872 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a3be35d2-38ab-4b69-a477-9b079012960b tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1229 microversion: 2.1 time: 0.156179 Aug 23 18:33:57.712482 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3383/6627] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:57 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1229 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:57.735524 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ce4d4dd6-4f73-4e07-8212-448db9278123 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments/112d46b5-a07a-4aec-8f86-17cae4a3a3df" status: 200 len: 194 microversion: 2.1 time: 0.052207 Aug 23 18:33:57.736057 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3245/6628] 10.222.0.61 () {58 vars in 1413 bytes} [Tue Aug 23 18:33:57 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments/112d46b5-a07a-4aec-8f86-17cae4a3a3df => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:58.562956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d6b8f746-9e36-4bf4-bdd0-ac89928bcaed tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:58.564100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d6b8f746-9e36-4bf4-bdd0-ac89928bcaed tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:58.584304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6b8f746-9e36-4bf4-bdd0-ac89928bcaed tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:58.585711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6b8f746-9e36-4bf4-bdd0-ac89928bcaed tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:58.586420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6b8f746-9e36-4bf4-bdd0-ac89928bcaed tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:58.587517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6b8f746-9e36-4bf4-bdd0-ac89928bcaed tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:58.589637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6b8f746-9e36-4bf4-bdd0-ac89928bcaed tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:58.590296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6b8f746-9e36-4bf4-bdd0-ac89928bcaed tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:58.735882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9c715b4b-0fb6-45f8-9f51-9172576612dd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:58.737219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9c715b4b-0fb6-45f8-9f51-9172576612dd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:58.749735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c715b4b-0fb6-45f8-9f51-9172576612dd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:58.750477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c715b4b-0fb6-45f8-9f51-9172576612dd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:58.752269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c715b4b-0fb6-45f8-9f51-9172576612dd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:58.753148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c715b4b-0fb6-45f8-9f51-9172576612dd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:58.754818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c715b4b-0fb6-45f8-9f51-9172576612dd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:58.755773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c715b4b-0fb6-45f8-9f51-9172576612dd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:58.857732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9c715b4b-0fb6-45f8-9f51-9172576612dd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:58.871404 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9c715b4b-0fb6-45f8-9f51-9172576612dd tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1229 microversion: 2.1 time: 0.136306 Aug 23 18:33:58.875812 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3246/6629] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:58 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1229 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:59.462129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d6b8f746-9e36-4bf4-bdd0-ac89928bcaed tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:59.473785 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d6b8f746-9e36-4bf4-bdd0-ac89928bcaed tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1315 microversion: 2.1 time: 0.915871 Aug 23 18:33:59.475565 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3384/6630] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:58 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1315 bytes in 918 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:59.532404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0aa77314-2447-417e-9339-622dbacaacd1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:59.534022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0aa77314-2447-417e-9339-622dbacaacd1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:59.545623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0aa77314-2447-417e-9339-622dbacaacd1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:59.548224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0aa77314-2447-417e-9339-622dbacaacd1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:59.549727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-80ee1075-996f-4274-9d6a-13b51c35c90f req-3ecb7ee7-a870-4d9a-b794-d8afa2cb45f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f036fec-6fc7-4d25-8262-91c63d4004ad", "tag": "913d6a7f-e98e-4663-bf84-b15992836ee5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:33:59.550465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0aa77314-2447-417e-9339-622dbacaacd1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:59.551409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0aa77314-2447-417e-9339-622dbacaacd1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:59.557466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0aa77314-2447-417e-9339-622dbacaacd1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:59.558347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0aa77314-2447-417e-9339-622dbacaacd1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:59.575672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-80ee1075-996f-4274-9d6a-13b51c35c90f req-3ecb7ee7-a870-4d9a-b794-d8afa2cb45f1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:59.576858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-80ee1075-996f-4274-9d6a-13b51c35c90f req-3ecb7ee7-a870-4d9a-b794-d8afa2cb45f1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:59.578758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-80ee1075-996f-4274-9d6a-13b51c35c90f req-3ecb7ee7-a870-4d9a-b794-d8afa2cb45f1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:59.600374 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-80ee1075-996f-4274-9d6a-13b51c35c90f req-3ecb7ee7-a870-4d9a-b794-d8afa2cb45f1 service nova] Creating event network-changed:913d6a7f-e98e-4663-bf84-b15992836ee5 for instance 5f036fec-6fc7-4d25-8262-91c63d4004ad on n-h2-850468-16 Aug 23 18:33:59.608487 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-80ee1075-996f-4274-9d6a-13b51c35c90f req-3ecb7ee7-a870-4d9a-b794-d8afa2cb45f1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068228 Aug 23 18:33:59.609369 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3385/6631] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:33:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:33:59.781606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0aa77314-2447-417e-9339-622dbacaacd1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:33:59.793362 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0aa77314-2447-417e-9339-622dbacaacd1 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1565 microversion: 2.1 time: 0.265903 Aug 23 18:33:59.812520 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3247/6632] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:59 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1565 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:33:59.894482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:33:59.895540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:33:59.904660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:59.905262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:59.905703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:59.906813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:59.907362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:59.907802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:59.945918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:33:59.946526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:33:59.947023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:33:59.947472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lazy-loading 'fault' on Instance uuid e7ac4913-d262-468e-9fbe-ae2cdababfff {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:34:00.001591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5bef17272e24e40a1c51daccb4dd6d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebc15347cda0455cb0024c8f3efbe31b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:00.011471 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6c2c1c03-bfea-49b6-8064-515cd4ef1238 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 200 len: 1234 microversion: 2.1 time: 0.121700 Aug 23 18:34:00.015943 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3386/6633] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:33:59 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 1234 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:00.241510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a28971f3-7302-41f9-92aa-f99c6b0df2b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1408a0ec-d984-483a-9dfc-ae14c8fc6688"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:00.244587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a28971f3-7302-41f9-92aa-f99c6b0df2b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:00.255898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a28971f3-7302-41f9-92aa-f99c6b0df2b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:00.259146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a28971f3-7302-41f9-92aa-f99c6b0df2b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:00.259876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a28971f3-7302-41f9-92aa-f99c6b0df2b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:00.260851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a28971f3-7302-41f9-92aa-f99c6b0df2b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:00.263147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a28971f3-7302-41f9-92aa-f99c6b0df2b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:00.265031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a28971f3-7302-41f9-92aa-f99c6b0df2b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:00.495173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ec9fa843-b77f-40e1-ac4b-4b36e3fdc004 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:00.495803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ec9fa843-b77f-40e1-ac4b-4b36e3fdc004 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:00.504985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9fa843-b77f-40e1-ac4b-4b36e3fdc004 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:00.505493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9fa843-b77f-40e1-ac4b-4b36e3fdc004 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:00.509879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9fa843-b77f-40e1-ac4b-4b36e3fdc004 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:00.512266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9fa843-b77f-40e1-ac4b-4b36e3fdc004 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:00.517162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9fa843-b77f-40e1-ac4b-4b36e3fdc004 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:00.518240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ec9fa843-b77f-40e1-ac4b-4b36e3fdc004 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:00.700124 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a28971f3-7302-41f9-92aa-f99c6b0df2b5 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "POST /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.458866 Aug 23 18:34:00.701262 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3248/6634] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:34:00 2022] POST /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments => generated 194 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:34:00.750479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ec9fa843-b77f-40e1-ac4b-4b36e3fdc004 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:00.761084 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ec9fa843-b77f-40e1-ac4b-4b36e3fdc004 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1502 microversion: 2.1 time: 0.270052 Aug 23 18:34:00.775921 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3387/6635] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:00 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1502 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:00.786875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8f3b6622-cfb9-4e76-a907-de14edf9fcf6 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:00.786875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8f3b6622-cfb9-4e76-a907-de14edf9fcf6 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:00.803252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f3b6622-cfb9-4e76-a907-de14edf9fcf6 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:00.804824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f3b6622-cfb9-4e76-a907-de14edf9fcf6 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:00.805487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f3b6622-cfb9-4e76-a907-de14edf9fcf6 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:00.806752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f3b6622-cfb9-4e76-a907-de14edf9fcf6 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:00.807330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f3b6622-cfb9-4e76-a907-de14edf9fcf6 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:00.808056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8f3b6622-cfb9-4e76-a907-de14edf9fcf6 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:01.036298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8f3b6622-cfb9-4e76-a907-de14edf9fcf6 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:01.038245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a0e6bf6-d1d4-4f3a-a0f4-879ca003f671 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:01.039307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8a0e6bf6-d1d4-4f3a-a0f4-879ca003f671 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] [instance: e7ac4913-d262-468e-9fbe-ae2cdababfff] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:01.046693 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8f3b6622-cfb9-4e76-a907-de14edf9fcf6 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1502 microversion: 2.1 time: 0.263837 Aug 23 18:34:01.047625 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3249/6636] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:00 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1502 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:01.051287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a0e6bf6-d1d4-4f3a-a0f4-879ca003f671 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:01.051793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a0e6bf6-d1d4-4f3a-a0f4-879ca003f671 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:01.052245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a0e6bf6-d1d4-4f3a-a0f4-879ca003f671 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:01.052971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a0e6bf6-d1d4-4f3a-a0f4-879ca003f671 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:01.054012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a0e6bf6-d1d4-4f3a-a0f4-879ca003f671 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:01.054450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a0e6bf6-d1d4-4f3a-a0f4-879ca003f671 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:01.072624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0d3f31aa-f102-4ad6-91c7-45123d49b2c4 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:01.073167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0d3f31aa-f102-4ad6-91c7-45123d49b2c4 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:01.079983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d3f31aa-f102-4ad6-91c7-45123d49b2c4 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:01.080691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d3f31aa-f102-4ad6-91c7-45123d49b2c4 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:01.081140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d3f31aa-f102-4ad6-91c7-45123d49b2c4 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:01.081842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d3f31aa-f102-4ad6-91c7-45123d49b2c4 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:01.082297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d3f31aa-f102-4ad6-91c7-45123d49b2c4 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:01.082752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d3f31aa-f102-4ad6-91c7-45123d49b2c4 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:01.093731 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8a0e6bf6-d1d4-4f3a-a0f4-879ca003f671 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] HTTP exception thrown: Instance e7ac4913-d262-468e-9fbe-ae2cdababfff could not be found. Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a0e6bf6-d1d4-4f3a-a0f4-879ca003f671 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Request method failure captured: Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff HTTP/1.1 Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRyQFQchYfkaWnZjYc_L5g3qNkr5rryPYa0OkBR3YNfPaz-Hn3c_UrDQg7ELrJZ3CxCLvJq1f3y8CM3cxGc-uymb2IRtwRL0hzWq8INSFzu2c1DKPcpvbsjkbZY9fwLHCqidHyjOMZtX_VxNZdjzhhgodPQMRxtcQJyKXiu5uA-E4j8 Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ebc15347cda0455cb0024c8f3efbe31b Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestVolumeBackupRestore-483645317 Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ebc15347cda0455cb0024c8f3efbe31b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ebc15347cda0455cb0024c8f3efbe31b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ebc15347cda0455cb0024c8f3efbe31b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ebc15347cda0455cb0024c8f3efbe31b"}]}] Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestVolumeBackupRestore-483645317 Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ebc15347cda0455cb0024c8f3efbe31b Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestVolumeBackupRestore-483645317 Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestVolumeBackupRestore-483645317-project Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b5bef17272e24e40a1c51daccb4dd6d6 Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestVolumeBackupRestore-483645317-project Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance e7ac4913-d262-468e-9fbe-ae2cdababfff could not be found. Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'e7ac4913-d262-468e-9fbe-ae2cdababfff'} Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7ac4913-d262-468e-9fbe-ae2cdababfff could not be found. Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7ac4913-d262-468e-9fbe-ae2cdababfff could not be found. Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:01.098965 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:01.104712 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:01.104712 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:01.104712 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:01.104712 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:34:01.104712 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:34:01.104712 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7ac4913-d262-468e-9fbe-ae2cdababfff could not be found. Aug 23 18:34:01.104712 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:01.104712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a0e6bf6-d1d4-4f3a-a0f4-879ca003f671 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Returning 404 to user: Instance e7ac4913-d262-468e-9fbe-ae2cdababfff could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:34:01.104712 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8a0e6bf6-d1d4-4f3a-a0f4-879ca003f671 tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff" status: 404 len: 111 microversion: 2.1 time: 0.068410 Aug 23 18:34:01.104712 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3388/6637] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:01 2022] GET /compute/v2.1/servers/e7ac4913-d262-468e-9fbe-ae2cdababfff => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:34:01.115080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-0d3f31aa-f102-4ad6-91c7-45123d49b2c4 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lazy-loading 'flavor' on Instance uuid 346948dd-399d-482d-8ac9-bd7316770254 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:34:01.256065 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0d3f31aa-f102-4ad6-91c7-45123d49b2c4 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "POST /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254/action" status: 202 len: 0 microversion: 2.1 time: 0.189014 Aug 23 18:34:01.262075 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3250/6638] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:34:01 2022] POST /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:34:01.270303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c637a4d2-5474-487a-bff1-ee0df8f7ce24 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:01.270965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c637a4d2-5474-487a-bff1-ee0df8f7ce24 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:01.286288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c637a4d2-5474-487a-bff1-ee0df8f7ce24 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:01.292245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c637a4d2-5474-487a-bff1-ee0df8f7ce24 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:01.295116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c637a4d2-5474-487a-bff1-ee0df8f7ce24 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:01.296221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c637a4d2-5474-487a-bff1-ee0df8f7ce24 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:01.296796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c637a4d2-5474-487a-bff1-ee0df8f7ce24 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:01.297273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c637a4d2-5474-487a-bff1-ee0df8f7ce24 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:01.346041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5713889-8aa2-42d3-bc91-d41a9e6bf27d tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] Calling method '.version_select at 0x7f27ec8c1550>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:01.374516 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a5713889-8aa2-42d3-bc91-d41a9e6bf27d tempest-TestVolumeBackupRestore-483645317 tempest-TestVolumeBackupRestore-483645317-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1886837130" status: 202 len: 0 microversion: 2.1 time: 0.033111 Aug 23 18:34:01.375728 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3251/6639] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 18:34:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1886837130 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:34:01.514064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c637a4d2-5474-487a-bff1-ee0df8f7ce24 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:01.524200 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c637a4d2-5474-487a-bff1-ee0df8f7ce24 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1510 microversion: 2.1 time: 0.261982 Aug 23 18:34:01.525553 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3389/6640] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:01 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1510 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:02.551365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb31aa57-b024-4c23-b991-ff49e584b987 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:02.554651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eb31aa57-b024-4c23-b991-ff49e584b987 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:02.565094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb31aa57-b024-4c23-b991-ff49e584b987 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:02.565642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb31aa57-b024-4c23-b991-ff49e584b987 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:02.566327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb31aa57-b024-4c23-b991-ff49e584b987 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:02.567241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb31aa57-b024-4c23-b991-ff49e584b987 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:02.567636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb31aa57-b024-4c23-b991-ff49e584b987 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:02.568068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb31aa57-b024-4c23-b991-ff49e584b987 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:02.744108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eb31aa57-b024-4c23-b991-ff49e584b987 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:02.752804 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eb31aa57-b024-4c23-b991-ff49e584b987 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1493 microversion: 2.1 time: 0.207210 Aug 23 18:34:02.754666 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3252/6641] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:02 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1493 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:02.779300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2232dbbe-1a14-49b0-97d9-f8c8746a5236 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:02.779848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2232dbbe-1a14-49b0-97d9-f8c8746a5236 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:02.793481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2232dbbe-1a14-49b0-97d9-f8c8746a5236 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:02.793997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2232dbbe-1a14-49b0-97d9-f8c8746a5236 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:02.794458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2232dbbe-1a14-49b0-97d9-f8c8746a5236 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:02.795221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2232dbbe-1a14-49b0-97d9-f8c8746a5236 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:02.795684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2232dbbe-1a14-49b0-97d9-f8c8746a5236 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:02.796305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2232dbbe-1a14-49b0-97d9-f8c8746a5236 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:02.930590 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2232dbbe-1a14-49b0-97d9-f8c8746a5236 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "POST /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254/action" status: 202 len: 0 microversion: 2.1 time: 0.154263 Aug 23 18:34:02.936137 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3390/6642] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:34:02 2022] POST /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:34:02.946872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47f580a4-46f6-4c33-84b3-72aaffb94b08 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:02.947610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-47f580a4-46f6-4c33-84b3-72aaffb94b08 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:02.958654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47f580a4-46f6-4c33-84b3-72aaffb94b08 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:02.959588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47f580a4-46f6-4c33-84b3-72aaffb94b08 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:02.960423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47f580a4-46f6-4c33-84b3-72aaffb94b08 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:02.961388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47f580a4-46f6-4c33-84b3-72aaffb94b08 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:02.962184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47f580a4-46f6-4c33-84b3-72aaffb94b08 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:02.962832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47f580a4-46f6-4c33-84b3-72aaffb94b08 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:02.968174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:03.342698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-47f580a4-46f6-4c33-84b3-72aaffb94b08 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:03.373097 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-47f580a4-46f6-4c33-84b3-72aaffb94b08 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1499 microversion: 2.1 time: 0.432496 Aug 23 18:34:03.390133 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3253/6643] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:02 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1499 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:04.404847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5331faee-659e-4d22-b9c2-4a23ef2985b8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:04.405552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5331faee-659e-4d22-b9c2-4a23ef2985b8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:04.431868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5331faee-659e-4d22-b9c2-4a23ef2985b8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:04.447508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5331faee-659e-4d22-b9c2-4a23ef2985b8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:04.449753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5331faee-659e-4d22-b9c2-4a23ef2985b8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:04.452031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5331faee-659e-4d22-b9c2-4a23ef2985b8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:04.454199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5331faee-659e-4d22-b9c2-4a23ef2985b8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:04.455969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5331faee-659e-4d22-b9c2-4a23ef2985b8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:04.831820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5331faee-659e-4d22-b9c2-4a23ef2985b8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:04.844511 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5331faee-659e-4d22-b9c2-4a23ef2985b8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1499 microversion: 2.1 time: 0.447295 Aug 23 18:34:04.846957 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3391/6644] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:04 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1499 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:05.870567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c86e9af1-9e0a-4d68-b612-0fdbaab51fd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:05.871250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c86e9af1-9e0a-4d68-b612-0fdbaab51fd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:05.883662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c86e9af1-9e0a-4d68-b612-0fdbaab51fd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:05.884141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c86e9af1-9e0a-4d68-b612-0fdbaab51fd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:05.884585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c86e9af1-9e0a-4d68-b612-0fdbaab51fd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:05.885296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c86e9af1-9e0a-4d68-b612-0fdbaab51fd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:05.894598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c86e9af1-9e0a-4d68-b612-0fdbaab51fd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:05.895298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c86e9af1-9e0a-4d68-b612-0fdbaab51fd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:06.163686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c86e9af1-9e0a-4d68-b612-0fdbaab51fd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:06.182107 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c86e9af1-9e0a-4d68-b612-0fdbaab51fd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1502 microversion: 2.1 time: 0.315470 Aug 23 18:34:06.183836 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3254/6645] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:05 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1502 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:06.218791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6d7a764a-646e-4769-8032-8b4214199c52 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:06.220930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6d7a764a-646e-4769-8032-8b4214199c52 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:06.249790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d7a764a-646e-4769-8032-8b4214199c52 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:06.250842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d7a764a-646e-4769-8032-8b4214199c52 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:06.252149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d7a764a-646e-4769-8032-8b4214199c52 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:06.253763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d7a764a-646e-4769-8032-8b4214199c52 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:06.254495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d7a764a-646e-4769-8032-8b4214199c52 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:06.255162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d7a764a-646e-4769-8032-8b4214199c52 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:06.306064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-6d7a764a-646e-4769-8032-8b4214199c52 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lazy-loading 'flavor' on Instance uuid 346948dd-399d-482d-8ac9-bd7316770254 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:34:06.512909 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6d7a764a-646e-4769-8032-8b4214199c52 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "POST /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254/action" status: 202 len: 0 microversion: 2.1 time: 0.301749 Aug 23 18:34:06.515338 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3392/6646] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:34:06 2022] POST /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:34:06.529225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b087b89-93ef-47d4-9333-2a545976efd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:06.529880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7b087b89-93ef-47d4-9333-2a545976efd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:06.551789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b087b89-93ef-47d4-9333-2a545976efd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:06.553590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b087b89-93ef-47d4-9333-2a545976efd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:06.556540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b087b89-93ef-47d4-9333-2a545976efd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:06.557465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b087b89-93ef-47d4-9333-2a545976efd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:06.587477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b087b89-93ef-47d4-9333-2a545976efd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:06.588449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b087b89-93ef-47d4-9333-2a545976efd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:06.846959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7b087b89-93ef-47d4-9333-2a545976efd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:06.859663 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7b087b89-93ef-47d4-9333-2a545976efd8 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1510 microversion: 2.1 time: 0.339761 Aug 23 18:34:06.872165 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3255/6647] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:06 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1510 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:07.883137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-397fcab6-7802-4b06-9bab-47f0cb3f26a1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:07.884754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-397fcab6-7802-4b06-9bab-47f0cb3f26a1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:07.893266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-397fcab6-7802-4b06-9bab-47f0cb3f26a1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:07.894304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-397fcab6-7802-4b06-9bab-47f0cb3f26a1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:07.895007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-397fcab6-7802-4b06-9bab-47f0cb3f26a1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:07.896044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-397fcab6-7802-4b06-9bab-47f0cb3f26a1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:07.897375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-397fcab6-7802-4b06-9bab-47f0cb3f26a1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:07.898808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-397fcab6-7802-4b06-9bab-47f0cb3f26a1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:08.107487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-397fcab6-7802-4b06-9bab-47f0cb3f26a1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:08.116417 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-397fcab6-7802-4b06-9bab-47f0cb3f26a1 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1493 microversion: 2.1 time: 0.238118 Aug 23 18:34:08.117016 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3393/6648] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:07 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1493 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:08.147021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4786ace8-0b3f-4431-9201-f82d912e5bff tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:08.147582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4786ace8-0b3f-4431-9201-f82d912e5bff tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:08.159696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4786ace8-0b3f-4431-9201-f82d912e5bff tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:08.162352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4786ace8-0b3f-4431-9201-f82d912e5bff tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:08.163813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4786ace8-0b3f-4431-9201-f82d912e5bff tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:08.170025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4786ace8-0b3f-4431-9201-f82d912e5bff tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:08.170637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4786ace8-0b3f-4431-9201-f82d912e5bff tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:08.171199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4786ace8-0b3f-4431-9201-f82d912e5bff tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:08.277638 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4786ace8-0b3f-4431-9201-f82d912e5bff tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "POST /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254/action" status: 202 len: 0 microversion: 2.1 time: 0.134978 Aug 23 18:34:08.279064 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3256/6649] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:34:08 2022] POST /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254/action => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:34:08.288978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aacb77f0-606f-4519-b5d1-18f2d14d7e87 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:08.289610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aacb77f0-606f-4519-b5d1-18f2d14d7e87 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:08.309445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aacb77f0-606f-4519-b5d1-18f2d14d7e87 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:08.309970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aacb77f0-606f-4519-b5d1-18f2d14d7e87 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:08.316054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aacb77f0-606f-4519-b5d1-18f2d14d7e87 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:08.316921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aacb77f0-606f-4519-b5d1-18f2d14d7e87 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:08.324782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aacb77f0-606f-4519-b5d1-18f2d14d7e87 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:08.325450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aacb77f0-606f-4519-b5d1-18f2d14d7e87 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:08.789496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aacb77f0-606f-4519-b5d1-18f2d14d7e87 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:08.799042 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aacb77f0-606f-4519-b5d1-18f2d14d7e87 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1499 microversion: 2.1 time: 0.514161 Aug 23 18:34:08.803768 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3394/6650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:08 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1499 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:09.826573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-794222df-720f-4edd-b84c-c23e80a50c91 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:09.827777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-794222df-720f-4edd-b84c-c23e80a50c91 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:09.836141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-794222df-720f-4edd-b84c-c23e80a50c91 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:09.838349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-794222df-720f-4edd-b84c-c23e80a50c91 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:09.839197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-794222df-720f-4edd-b84c-c23e80a50c91 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:09.840205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-794222df-720f-4edd-b84c-c23e80a50c91 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:09.841655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-794222df-720f-4edd-b84c-c23e80a50c91 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:09.842351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-794222df-720f-4edd-b84c-c23e80a50c91 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:10.165267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-794222df-720f-4edd-b84c-c23e80a50c91 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:10.192643 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-794222df-720f-4edd-b84c-c23e80a50c91 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1499 microversion: 2.1 time: 0.356392 Aug 23 18:34:10.196115 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3257/6651] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:09 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1499 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:11.216412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-32e6e5a7-b782-4587-bd4c-a5fdd3c171a5 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:11.217029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-32e6e5a7-b782-4587-bd4c-a5fdd3c171a5 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:11.224441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32e6e5a7-b782-4587-bd4c-a5fdd3c171a5 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:11.225305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32e6e5a7-b782-4587-bd4c-a5fdd3c171a5 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:11.225979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32e6e5a7-b782-4587-bd4c-a5fdd3c171a5 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:11.227016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32e6e5a7-b782-4587-bd4c-a5fdd3c171a5 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:11.227703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32e6e5a7-b782-4587-bd4c-a5fdd3c171a5 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:11.228457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32e6e5a7-b782-4587-bd4c-a5fdd3c171a5 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:11.521629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-32e6e5a7-b782-4587-bd4c-a5fdd3c171a5 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:11.531417 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-32e6e5a7-b782-4587-bd4c-a5fdd3c171a5 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1502 microversion: 2.1 time: 0.318998 Aug 23 18:34:11.532011 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3395/6652] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:11 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1502 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:11.552210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f0ee0b5f-1b74-4cc0-8e68-7776499683fe tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:11.552842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f0ee0b5f-1b74-4cc0-8e68-7776499683fe tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:11.560473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0ee0b5f-1b74-4cc0-8e68-7776499683fe tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:11.560900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0ee0b5f-1b74-4cc0-8e68-7776499683fe tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:11.561342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0ee0b5f-1b74-4cc0-8e68-7776499683fe tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:11.562265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0ee0b5f-1b74-4cc0-8e68-7776499683fe tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:11.562769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0ee0b5f-1b74-4cc0-8e68-7776499683fe tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:11.563202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f0ee0b5f-1b74-4cc0-8e68-7776499683fe tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:11.600214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f0ee0b5f-1b74-4cc0-8e68-7776499683fe tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:34:11.779300 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f0ee0b5f-1b74-4cc0-8e68-7776499683fe tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "DELETE /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 204 len: 0 microversion: 2.1 time: 0.230725 Aug 23 18:34:11.790143 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3258/6653] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:34:11 2022] DELETE /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:34:11.791238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c54d2148-ead0-48ec-914e-e4e855920906 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:11.792069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c54d2148-ead0-48ec-914e-e4e855920906 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:11.805753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c54d2148-ead0-48ec-914e-e4e855920906 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:11.806359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c54d2148-ead0-48ec-914e-e4e855920906 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:11.806847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c54d2148-ead0-48ec-914e-e4e855920906 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:11.807615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c54d2148-ead0-48ec-914e-e4e855920906 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:11.808083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c54d2148-ead0-48ec-914e-e4e855920906 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:11.808521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c54d2148-ead0-48ec-914e-e4e855920906 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:11.813339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:11.955633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1263341115", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:12.011178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:34:12.065178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c54d2148-ead0-48ec-914e-e4e855920906 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:12.075877 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c54d2148-ead0-48ec-914e-e4e855920906 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1508 microversion: 2.1 time: 0.289864 Aug 23 18:34:12.077443 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3396/6654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:11 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1508 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:12.350951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:34:12.351718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:34:12.352425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:34:12.353015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:34:12.353445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:34:12.366330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:12.367166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:12.367600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:12.368558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:12.369211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:12.369639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:12.389376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Getting quotas for project fea6d4d66a0c4c5f8362e16fbbb41166. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:34:12.394798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Getting quotas for user b6b19c6888274acbb3e9b59d98f4f631 and project fea6d4d66a0c4c5f8362e16fbbb41166. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:34:12.410946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:34:12.413966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:34:12.469876 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-445ea816-9479-49c2-b9eb-c67b64772329 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518327 Aug 23 18:34:12.470871 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3259/6655] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:34:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:34:12.481994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eef2c7ec-0023-4fcc-bdad-b9102756edb2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:12.483511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eef2c7ec-0023-4fcc-bdad-b9102756edb2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:12.595000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eef2c7ec-0023-4fcc-bdad-b9102756edb2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:12.603799 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eef2c7ec-0023-4fcc-bdad-b9102756edb2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1215 microversion: 2.1 time: 0.125634 Aug 23 18:34:12.604959 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3397/6656] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:12 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1215 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:13.101673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c3ea6f9c-c404-4f69-9246-06b2e7dda2bb tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:13.102392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c3ea6f9c-c404-4f69-9246-06b2e7dda2bb tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:13.112339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3ea6f9c-c404-4f69-9246-06b2e7dda2bb tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:13.112903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3ea6f9c-c404-4f69-9246-06b2e7dda2bb tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:13.113407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3ea6f9c-c404-4f69-9246-06b2e7dda2bb tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:13.114356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3ea6f9c-c404-4f69-9246-06b2e7dda2bb tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:13.114865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3ea6f9c-c404-4f69-9246-06b2e7dda2bb tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:13.116285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3ea6f9c-c404-4f69-9246-06b2e7dda2bb tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:13.364657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c3ea6f9c-c404-4f69-9246-06b2e7dda2bb tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:13.373667 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c3ea6f9c-c404-4f69-9246-06b2e7dda2bb tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1508 microversion: 2.1 time: 0.278363 Aug 23 18:34:13.374334 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3260/6657] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:13 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1508 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:13.626462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-22c668f7-2408-4526-82a2-e74a6429b8dd tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:13.627149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-22c668f7-2408-4526-82a2-e74a6429b8dd tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:13.640373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22c668f7-2408-4526-82a2-e74a6429b8dd tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:13.641015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22c668f7-2408-4526-82a2-e74a6429b8dd tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:13.641500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22c668f7-2408-4526-82a2-e74a6429b8dd tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:13.645417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22c668f7-2408-4526-82a2-e74a6429b8dd tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:13.645845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22c668f7-2408-4526-82a2-e74a6429b8dd tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:13.653992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-22c668f7-2408-4526-82a2-e74a6429b8dd tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:13.726605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-22c668f7-2408-4526-82a2-e74a6429b8dd tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:13.734690 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-22c668f7-2408-4526-82a2-e74a6429b8dd tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1275 microversion: 2.1 time: 0.113351 Aug 23 18:34:13.735554 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3398/6658] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:13 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1275 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:14.399308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e5c0f5e4-cdad-4c5a-a62a-82c317c44612 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:14.399895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e5c0f5e4-cdad-4c5a-a62a-82c317c44612 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:14.406138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5c0f5e4-cdad-4c5a-a62a-82c317c44612 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:14.406675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5c0f5e4-cdad-4c5a-a62a-82c317c44612 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:14.407320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5c0f5e4-cdad-4c5a-a62a-82c317c44612 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:14.408044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5c0f5e4-cdad-4c5a-a62a-82c317c44612 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:14.409155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5c0f5e4-cdad-4c5a-a62a-82c317c44612 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:14.409607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5c0f5e4-cdad-4c5a-a62a-82c317c44612 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:14.549900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c612eae5-fe11-4db3-9ac3-0af5b91891f2 req-71c2d978-077d-4a93-b9fb-c0a29ca4f82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "346948dd-399d-482d-8ac9-bd7316770254", "name": "network-vif-deleted", "tag": "2d8a6c51-68f8-416f-82e7-10b1762cd82a"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:14.561119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c612eae5-fe11-4db3-9ac3-0af5b91891f2 req-71c2d978-077d-4a93-b9fb-c0a29ca4f82e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:14.561602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c612eae5-fe11-4db3-9ac3-0af5b91891f2 req-71c2d978-077d-4a93-b9fb-c0a29ca4f82e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:14.562039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c612eae5-fe11-4db3-9ac3-0af5b91891f2 req-71c2d978-077d-4a93-b9fb-c0a29ca4f82e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:14.574849 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c612eae5-fe11-4db3-9ac3-0af5b91891f2 req-71c2d978-077d-4a93-b9fb-c0a29ca4f82e service nova] Creating event network-vif-deleted:2d8a6c51-68f8-416f-82e7-10b1762cd82a for instance 346948dd-399d-482d-8ac9-bd7316770254 on n-h2-850468-16 Aug 23 18:34:14.579928 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c612eae5-fe11-4db3-9ac3-0af5b91891f2 req-71c2d978-077d-4a93-b9fb-c0a29ca4f82e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035138 Aug 23 18:34:14.580547 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3399/6659] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:34:14.759326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aba1baf2-ed20-414b-a0d2-db958c476ae1 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:14.760179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aba1baf2-ed20-414b-a0d2-db958c476ae1 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:14.767222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aba1baf2-ed20-414b-a0d2-db958c476ae1 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:14.767717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aba1baf2-ed20-414b-a0d2-db958c476ae1 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:14.768157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aba1baf2-ed20-414b-a0d2-db958c476ae1 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:14.768868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aba1baf2-ed20-414b-a0d2-db958c476ae1 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:14.769322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aba1baf2-ed20-414b-a0d2-db958c476ae1 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:14.769752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aba1baf2-ed20-414b-a0d2-db958c476ae1 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:14.838717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aba1baf2-ed20-414b-a0d2-db958c476ae1 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:14.847119 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aba1baf2-ed20-414b-a0d2-db958c476ae1 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1273 microversion: 2.1 time: 0.093819 Aug 23 18:34:14.847700 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3400/6660] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:14 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:34:14.876839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e5c0f5e4-cdad-4c5a-a62a-82c317c44612 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9672666fb9dc402d9f6f011f7955f3b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54327484f00f4b228d6eb3b751457409', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:14.885254 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e5c0f5e4-cdad-4c5a-a62a-82c317c44612 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 200 len: 1466 microversion: 2.1 time: 0.493106 Aug 23 18:34:14.885837 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3261/6661] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:14 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 1466 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:15.870012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5e473787-3269-4397-b12a-eabac5531a89 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:15.872835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5e473787-3269-4397-b12a-eabac5531a89 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:15.876034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=78 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:15.882341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e473787-3269-4397-b12a-eabac5531a89 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:15.883150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e473787-3269-4397-b12a-eabac5531a89 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:15.883765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e473787-3269-4397-b12a-eabac5531a89 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:15.884997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e473787-3269-4397-b12a-eabac5531a89 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:15.885690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e473787-3269-4397-b12a-eabac5531a89 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:15.886311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5e473787-3269-4397-b12a-eabac5531a89 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:15.909435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a94cfab3-38fe-421f-b713-a90995839838 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:15.910740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a94cfab3-38fe-421f-b713-a90995839838 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] [instance: 346948dd-399d-482d-8ac9-bd7316770254] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:15.916544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:15.929470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a94cfab3-38fe-421f-b713-a90995839838 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:15.930314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a94cfab3-38fe-421f-b713-a90995839838 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:15.932800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a94cfab3-38fe-421f-b713-a90995839838 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:15.936268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a94cfab3-38fe-421f-b713-a90995839838 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:15.937157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a94cfab3-38fe-421f-b713-a90995839838 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:15.938155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a94cfab3-38fe-421f-b713-a90995839838 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:15.970219 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-a94cfab3-38fe-421f-b713-a90995839838 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] HTTP exception thrown: Instance 346948dd-399d-482d-8ac9-bd7316770254 could not be found. Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a94cfab3-38fe-421f-b713-a90995839838 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Request method failure captured: Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 HTTP/1.1 Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBR2BFSvO1qYA2sfoECZFINzBqXQXX_fxkZAJDBaOQfgFqdkf8JeSA7AoSHwGUbsh7z28HH3HCQXk00O_JY3Bf_oe-ByRo8V6_SLGUhfIvF-UsMQcRq9LYK-WJZaBrMXgxLJs9pWaTxGX6qrCPg3albExAXVy5cJ8WUN0vQ2zNHwQErQ Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 54327484f00f4b228d6eb3b751457409 Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestServerAdvancedOps-1577647955 Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_54327484f00f4b228d6eb3b751457409"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54327484f00f4b228d6eb3b751457409"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/54327484f00f4b228d6eb3b751457409"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/54327484f00f4b228d6eb3b751457409"}]}] Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestServerAdvancedOps-1577647955 Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 54327484f00f4b228d6eb3b751457409 Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestServerAdvancedOps-1577647955 Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestServerAdvancedOps-1577647955-project Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 9672666fb9dc402d9f6f011f7955f3b6 Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestServerAdvancedOps-1577647955-project Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 346948dd-399d-482d-8ac9-bd7316770254 could not be found. Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '346948dd-399d-482d-8ac9-bd7316770254'} Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 346948dd-399d-482d-8ac9-bd7316770254 could not be found. Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 346948dd-399d-482d-8ac9-bd7316770254 could not be found. Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:15.972402 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:15.977039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:15.977039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:15.977039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:15.977039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:34:15.977039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:34:15.977039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 346948dd-399d-482d-8ac9-bd7316770254 could not be found. Aug 23 18:34:15.977039 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:15.987501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a94cfab3-38fe-421f-b713-a90995839838 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] Returning 404 to user: Instance 346948dd-399d-482d-8ac9-bd7316770254 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:34:15.989480 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a94cfab3-38fe-421f-b713-a90995839838 tempest-TestServerAdvancedOps-1577647955 tempest-TestServerAdvancedOps-1577647955-project] 10.222.0.61 "GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254" status: 404 len: 111 microversion: 2.1 time: 0.085139 Aug 23 18:34:15.991121 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3262/6662] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:15 2022] GET /compute/v2.1/servers/346948dd-399d-482d-8ac9-bd7316770254 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:34:16.144478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5e473787-3269-4397-b12a-eabac5531a89 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:16.156110 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5e473787-3269-4397-b12a-eabac5531a89 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1315 microversion: 2.1 time: 0.291026 Aug 23 18:34:16.170273 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3401/6663] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:15 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:16.174232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cba32e36-e137-4905-bb8f-3a48fe3a3400 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:16.176870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cba32e36-e137-4905-bb8f-3a48fe3a3400 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:16.185023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cba32e36-e137-4905-bb8f-3a48fe3a3400 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:16.185498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cba32e36-e137-4905-bb8f-3a48fe3a3400 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:16.186109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cba32e36-e137-4905-bb8f-3a48fe3a3400 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:16.187381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cba32e36-e137-4905-bb8f-3a48fe3a3400 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:16.187520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cba32e36-e137-4905-bb8f-3a48fe3a3400 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:16.187901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cba32e36-e137-4905-bb8f-3a48fe3a3400 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:16.221755 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cba32e36-e137-4905-bb8f-3a48fe3a3400 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.056710 Aug 23 18:34:16.222655 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3263/6664] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:34:16 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments => generated 371 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:34:16.447131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f37cf08c-10a9-42b7-9bcc-917b356977c1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:16.447817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f37cf08c-10a9-42b7-9bcc-917b356977c1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:16.455173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f37cf08c-10a9-42b7-9bcc-917b356977c1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:16.456258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f37cf08c-10a9-42b7-9bcc-917b356977c1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:16.457064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f37cf08c-10a9-42b7-9bcc-917b356977c1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:16.458271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f37cf08c-10a9-42b7-9bcc-917b356977c1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:16.459051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f37cf08c-10a9-42b7-9bcc-917b356977c1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:16.459699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f37cf08c-10a9-42b7-9bcc-917b356977c1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:16.499603 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f37cf08c-10a9-42b7-9bcc-917b356977c1 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments/112d46b5-a07a-4aec-8f86-17cae4a3a3df" status: 200 len: 194 microversion: 2.1 time: 0.059568 Aug 23 18:34:16.500596 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3402/6665] 10.222.0.61 () {58 vars in 1413 bytes} [Tue Aug 23 18:34:16 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments/112d46b5-a07a-4aec-8f86-17cae4a3a3df => generated 194 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:34:16.512009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4a113109-1be9-4e3a-8008-74aacdb14d76 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:16.512617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4a113109-1be9-4e3a-8008-74aacdb14d76 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:16.519247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a113109-1be9-4e3a-8008-74aacdb14d76 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:16.520351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a113109-1be9-4e3a-8008-74aacdb14d76 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:16.520811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a113109-1be9-4e3a-8008-74aacdb14d76 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:16.521743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a113109-1be9-4e3a-8008-74aacdb14d76 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:16.522211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a113109-1be9-4e3a-8008-74aacdb14d76 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:16.522798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a113109-1be9-4e3a-8008-74aacdb14d76 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:16.635321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-4a113109-1be9-4e3a-8008-74aacdb14d76 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lazy-loading 'services' on Instance uuid f9e3996c-f814-4ec8-8eec-3acd658b2d80 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:34:16.735177 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4a113109-1be9-4e3a-8008-74aacdb14d76 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments/112d46b5-a07a-4aec-8f86-17cae4a3a3df" status: 202 len: 0 microversion: 2.1 time: 0.227534 Aug 23 18:34:16.736008 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3264/6666] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 18:34:16 2022] DELETE /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments/112d46b5-a07a-4aec-8f86-17cae4a3a3df => generated 0 bytes in 230 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:34:17.177473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fb03d50a-827d-4efc-adf0-02aa922350ea tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:17.178699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fb03d50a-827d-4efc-adf0-02aa922350ea tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:17.185705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb03d50a-827d-4efc-adf0-02aa922350ea tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:17.186500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb03d50a-827d-4efc-adf0-02aa922350ea tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:17.187137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb03d50a-827d-4efc-adf0-02aa922350ea tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:17.188034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb03d50a-827d-4efc-adf0-02aa922350ea tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:17.188880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb03d50a-827d-4efc-adf0-02aa922350ea tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:17.189497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb03d50a-827d-4efc-adf0-02aa922350ea tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:17.632625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb03d50a-827d-4efc-adf0-02aa922350ea tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:17.644323 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fb03d50a-827d-4efc-adf0-02aa922350ea tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1315 microversion: 2.1 time: 0.470734 Aug 23 18:34:17.664046 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3403/6667] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:17 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1315 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:17.775082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-5edb21ac-b068-4a4d-be90-0ce3df7b8bbb req-b6ea2cd6-fd70-4a8f-8181-49f3538365da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775", "tag": "f6177b8e-777e-42be-bcb4-fc0896dd58f8"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:17.806870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5edb21ac-b068-4a4d-be90-0ce3df7b8bbb req-b6ea2cd6-fd70-4a8f-8181-49f3538365da service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:17.807357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5edb21ac-b068-4a4d-be90-0ce3df7b8bbb req-b6ea2cd6-fd70-4a8f-8181-49f3538365da service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:17.807793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5edb21ac-b068-4a4d-be90-0ce3df7b8bbb req-b6ea2cd6-fd70-4a8f-8181-49f3538365da service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:17.831246 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5edb21ac-b068-4a4d-be90-0ce3df7b8bbb req-b6ea2cd6-fd70-4a8f-8181-49f3538365da service nova] Creating event network-changed:f6177b8e-777e-42be-bcb4-fc0896dd58f8 for instance 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 on n-h1-850468-16 Aug 23 18:34:17.848551 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-5edb21ac-b068-4a4d-be90-0ce3df7b8bbb req-b6ea2cd6-fd70-4a8f-8181-49f3538365da service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079647 Aug 23 18:34:17.849460 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3265/6668] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:34:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:34:18.673382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5be83714-33c4-48fc-a16f-1e9d645867e0 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:18.674633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5be83714-33c4-48fc-a16f-1e9d645867e0 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:18.683957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5be83714-33c4-48fc-a16f-1e9d645867e0 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:18.684670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5be83714-33c4-48fc-a16f-1e9d645867e0 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:18.685344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5be83714-33c4-48fc-a16f-1e9d645867e0 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:18.686384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5be83714-33c4-48fc-a16f-1e9d645867e0 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:18.687244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5be83714-33c4-48fc-a16f-1e9d645867e0 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:18.688371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5be83714-33c4-48fc-a16f-1e9d645867e0 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:18.886185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5be83714-33c4-48fc-a16f-1e9d645867e0 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:18.894961 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5be83714-33c4-48fc-a16f-1e9d645867e0 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1315 microversion: 2.1 time: 0.229825 Aug 23 18:34:18.910869 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3404/6669] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:18 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:19.918946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-120d0ddc-10ba-48bf-927c-2ce2509be653 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:19.920417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-120d0ddc-10ba-48bf-927c-2ce2509be653 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:19.928168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-120d0ddc-10ba-48bf-927c-2ce2509be653 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:19.928941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-120d0ddc-10ba-48bf-927c-2ce2509be653 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:19.929580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-120d0ddc-10ba-48bf-927c-2ce2509be653 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:19.930573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-120d0ddc-10ba-48bf-927c-2ce2509be653 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:19.931243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-120d0ddc-10ba-48bf-927c-2ce2509be653 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:19.932378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-120d0ddc-10ba-48bf-927c-2ce2509be653 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:20.164436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-120d0ddc-10ba-48bf-927c-2ce2509be653 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:20.177178 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-120d0ddc-10ba-48bf-927c-2ce2509be653 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1315 microversion: 2.1 time: 0.263418 Aug 23 18:34:20.190082 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3266/6670] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:19 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:21.201691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0487e5d8-0f46-47ad-92cd-60457186fb48 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:21.202303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0487e5d8-0f46-47ad-92cd-60457186fb48 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:21.210275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0487e5d8-0f46-47ad-92cd-60457186fb48 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:21.210928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0487e5d8-0f46-47ad-92cd-60457186fb48 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:21.211467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0487e5d8-0f46-47ad-92cd-60457186fb48 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:21.212379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0487e5d8-0f46-47ad-92cd-60457186fb48 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:21.212888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0487e5d8-0f46-47ad-92cd-60457186fb48 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:21.213798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0487e5d8-0f46-47ad-92cd-60457186fb48 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:21.405124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0487e5d8-0f46-47ad-92cd-60457186fb48 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:21.415979 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0487e5d8-0f46-47ad-92cd-60457186fb48 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1315 microversion: 2.1 time: 0.218059 Aug 23 18:34:21.416854 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3405/6671] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:21 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:34:22.242138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-02dc0f7a-3996-4124-ba80-d2572f876a1b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:22.243327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-02dc0f7a-3996-4124-ba80-d2572f876a1b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:22.250118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02dc0f7a-3996-4124-ba80-d2572f876a1b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:22.250656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02dc0f7a-3996-4124-ba80-d2572f876a1b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:22.251100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02dc0f7a-3996-4124-ba80-d2572f876a1b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:22.252052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02dc0f7a-3996-4124-ba80-d2572f876a1b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:22.252513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02dc0f7a-3996-4124-ba80-d2572f876a1b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:22.252975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02dc0f7a-3996-4124-ba80-d2572f876a1b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:22.291178 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-02dc0f7a-3996-4124-ba80-d2572f876a1b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments/1408a0ec-d984-483a-9dfc-ae14c8fc6688" status: 200 len: 194 microversion: 2.1 time: 0.054075 Aug 23 18:34:22.291796 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3267/6672] 10.222.0.61 () {58 vars in 1413 bytes} [Tue Aug 23 18:34:22 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments/1408a0ec-d984-483a-9dfc-ae14c8fc6688 => generated 194 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:34:22.304797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-704d86e0-4718-452c-8c42-b35748d833b4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:22.310081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-704d86e0-4718-452c-8c42-b35748d833b4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:22.317632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-704d86e0-4718-452c-8c42-b35748d833b4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:22.318491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-704d86e0-4718-452c-8c42-b35748d833b4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:22.319813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-704d86e0-4718-452c-8c42-b35748d833b4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:22.320815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-704d86e0-4718-452c-8c42-b35748d833b4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:22.321521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-704d86e0-4718-452c-8c42-b35748d833b4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:22.322178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-704d86e0-4718-452c-8c42-b35748d833b4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:22.419242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-704d86e0-4718-452c-8c42-b35748d833b4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lazy-loading 'services' on Instance uuid f9e3996c-f814-4ec8-8eec-3acd658b2d80 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:34:22.441541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-027aaa04-9b67-4a8a-9843-bc52f4d9f352 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:22.442517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-027aaa04-9b67-4a8a-9843-bc52f4d9f352 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:22.450119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:22.451767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:22.454115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-027aaa04-9b67-4a8a-9843-bc52f4d9f352 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:22.454907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-027aaa04-9b67-4a8a-9843-bc52f4d9f352 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:22.457450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-027aaa04-9b67-4a8a-9843-bc52f4d9f352 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:22.459817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-027aaa04-9b67-4a8a-9843-bc52f4d9f352 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:22.466298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-027aaa04-9b67-4a8a-9843-bc52f4d9f352 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:22.467205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-027aaa04-9b67-4a8a-9843-bc52f4d9f352 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:22.499695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:22.528865 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-704d86e0-4718-452c-8c42-b35748d833b4 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments/1408a0ec-d984-483a-9dfc-ae14c8fc6688" status: 202 len: 0 microversion: 2.1 time: 0.230259 Aug 23 18:34:22.533115 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3406/6673] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 18:34:22 2022] DELETE /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments/1408a0ec-d984-483a-9dfc-ae14c8fc6688 => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:34:22.729075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-027aaa04-9b67-4a8a-9843-bc52f4d9f352 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:22.739410 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-027aaa04-9b67-4a8a-9843-bc52f4d9f352 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1315 microversion: 2.1 time: 0.303360 Aug 23 18:34:22.740767 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3268/6674] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:22 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1315 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:34:23.759061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:23.765916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2742abfc-5c77-4c5c-8af3-d2bbf9e744f8 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:23.766954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2742abfc-5c77-4c5c-8af3-d2bbf9e744f8 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:23.777272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2742abfc-5c77-4c5c-8af3-d2bbf9e744f8 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:23.778108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2742abfc-5c77-4c5c-8af3-d2bbf9e744f8 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:23.779334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2742abfc-5c77-4c5c-8af3-d2bbf9e744f8 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:23.780370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2742abfc-5c77-4c5c-8af3-d2bbf9e744f8 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:23.781336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2742abfc-5c77-4c5c-8af3-d2bbf9e744f8 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:23.782226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2742abfc-5c77-4c5c-8af3-d2bbf9e744f8 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:23.957940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2742abfc-5c77-4c5c-8af3-d2bbf9e744f8 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:23.975538 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2742abfc-5c77-4c5c-8af3-d2bbf9e744f8 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1315 microversion: 2.1 time: 0.216845 Aug 23 18:34:23.979049 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3407/6675] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:23 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:25.003393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-093793f1-571d-4e8a-b4bc-bf944fc818fa tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:25.005307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-093793f1-571d-4e8a-b4bc-bf944fc818fa tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:25.013674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-093793f1-571d-4e8a-b4bc-bf944fc818fa tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:25.014616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-093793f1-571d-4e8a-b4bc-bf944fc818fa tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:25.015236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-093793f1-571d-4e8a-b4bc-bf944fc818fa tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:25.015955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-093793f1-571d-4e8a-b4bc-bf944fc818fa tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:25.016852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-093793f1-571d-4e8a-b4bc-bf944fc818fa tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:25.017295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-093793f1-571d-4e8a-b4bc-bf944fc818fa tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:25.398685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-093793f1-571d-4e8a-b4bc-bf944fc818fa tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:25.408849 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-093793f1-571d-4e8a-b4bc-bf944fc818fa tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1315 microversion: 2.1 time: 0.409538 Aug 23 18:34:25.427153 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3269/6676] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:24 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1315 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:25.736057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4b9b9b57-ac54-462f-b2e0-cc0464e70336 req-5f85e0c5-96d1-42af-89d3-71951324882d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775", "name": "network-vif-plugged", "status": "completed", "tag": "f6177b8e-777e-42be-bcb4-fc0896dd58f8"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:25.751839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4b9b9b57-ac54-462f-b2e0-cc0464e70336 req-5f85e0c5-96d1-42af-89d3-71951324882d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:25.752481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4b9b9b57-ac54-462f-b2e0-cc0464e70336 req-5f85e0c5-96d1-42af-89d3-71951324882d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:25.753027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4b9b9b57-ac54-462f-b2e0-cc0464e70336 req-5f85e0c5-96d1-42af-89d3-71951324882d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:25.770853 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4b9b9b57-ac54-462f-b2e0-cc0464e70336 req-5f85e0c5-96d1-42af-89d3-71951324882d service nova] Creating event network-vif-plugged:f6177b8e-777e-42be-bcb4-fc0896dd58f8 for instance 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 on n-h1-850468-16 Aug 23 18:34:25.784124 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4b9b9b57-ac54-462f-b2e0-cc0464e70336 req-5f85e0c5-96d1-42af-89d3-71951324882d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053416 Aug 23 18:34:25.789619 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3408/6677] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:34:26.436937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-09b4f691-84b3-407b-969d-b668fa26afed tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:26.438096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-09b4f691-84b3-407b-969d-b668fa26afed tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:26.447910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09b4f691-84b3-407b-969d-b668fa26afed tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:26.449410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09b4f691-84b3-407b-969d-b668fa26afed tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:26.449844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09b4f691-84b3-407b-969d-b668fa26afed tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:26.450580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09b4f691-84b3-407b-969d-b668fa26afed tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:26.451032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09b4f691-84b3-407b-969d-b668fa26afed tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:26.451456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09b4f691-84b3-407b-969d-b668fa26afed tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:26.606919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-09b4f691-84b3-407b-969d-b668fa26afed tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:26.618883 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-09b4f691-84b3-407b-969d-b668fa26afed tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1315 microversion: 2.1 time: 0.185626 Aug 23 18:34:26.619809 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3270/6678] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:26 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:27.647130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4cee16bc-df16-47df-b1c8-bc91563c9ef7 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:27.648642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4cee16bc-df16-47df-b1c8-bc91563c9ef7 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:27.655716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cee16bc-df16-47df-b1c8-bc91563c9ef7 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:27.656452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cee16bc-df16-47df-b1c8-bc91563c9ef7 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:27.657332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cee16bc-df16-47df-b1c8-bc91563c9ef7 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:27.658233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cee16bc-df16-47df-b1c8-bc91563c9ef7 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:27.658894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cee16bc-df16-47df-b1c8-bc91563c9ef7 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:27.660266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cee16bc-df16-47df-b1c8-bc91563c9ef7 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:27.875471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4cee16bc-df16-47df-b1c8-bc91563c9ef7 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:27.887192 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4cee16bc-df16-47df-b1c8-bc91563c9ef7 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1465 microversion: 2.1 time: 0.249859 Aug 23 18:34:27.888544 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3409/6679] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:27 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1465 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:27.945147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-293b85e1-e55c-46b8-b3cc-30e4de0e8aa2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:27.946356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-293b85e1-e55c-46b8-b3cc-30e4de0e8aa2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:27.954580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-293b85e1-e55c-46b8-b3cc-30e4de0e8aa2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:27.955393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-293b85e1-e55c-46b8-b3cc-30e4de0e8aa2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:27.956209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-293b85e1-e55c-46b8-b3cc-30e4de0e8aa2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:27.957145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-293b85e1-e55c-46b8-b3cc-30e4de0e8aa2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:27.957818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-293b85e1-e55c-46b8-b3cc-30e4de0e8aa2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:27.958459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-293b85e1-e55c-46b8-b3cc-30e4de0e8aa2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:27.990643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-293b85e1-e55c-46b8-b3cc-30e4de0e8aa2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:34:28.135121 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-293b85e1-e55c-46b8-b3cc-30e4de0e8aa2 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 204 len: 0 microversion: 2.1 time: 0.193441 Aug 23 18:34:28.139118 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3271/6680] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:34:27 2022] DELETE /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:34:28.144586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7ea1b084-b616-402f-b694-bf957f1290d6 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:28.145210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7ea1b084-b616-402f-b694-bf957f1290d6 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:28.152968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ea1b084-b616-402f-b694-bf957f1290d6 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:28.153818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ea1b084-b616-402f-b694-bf957f1290d6 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:28.154467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ea1b084-b616-402f-b694-bf957f1290d6 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:28.155539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ea1b084-b616-402f-b694-bf957f1290d6 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:28.156210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ea1b084-b616-402f-b694-bf957f1290d6 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:28.156838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ea1b084-b616-402f-b694-bf957f1290d6 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:28.322057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7ea1b084-b616-402f-b694-bf957f1290d6 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:28.331748 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7ea1b084-b616-402f-b694-bf957f1290d6 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1471 microversion: 2.1 time: 0.190692 Aug 23 18:34:28.332252 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3410/6681] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:28 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1471 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:34:29.237488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-03339d17-c4bc-403b-8d3d-303439772ce0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:29.240008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-03339d17-c4bc-403b-8d3d-303439772ce0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:29.247245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03339d17-c4bc-403b-8d3d-303439772ce0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:29.247990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03339d17-c4bc-403b-8d3d-303439772ce0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:29.248429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03339d17-c4bc-403b-8d3d-303439772ce0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:29.249137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03339d17-c4bc-403b-8d3d-303439772ce0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:29.249823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03339d17-c4bc-403b-8d3d-303439772ce0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:29.250874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03339d17-c4bc-403b-8d3d-303439772ce0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:29.302469 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-03339d17-c4bc-403b-8d3d-303439772ce0 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069361 Aug 23 18:34:29.303771 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3272/6682] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:34:29 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:34:29.356707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-899fb05d-1999-4694-8f99-f25823da6e7c tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:29.358038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-899fb05d-1999-4694-8f99-f25823da6e7c tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:29.366491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-899fb05d-1999-4694-8f99-f25823da6e7c tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:29.367192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-899fb05d-1999-4694-8f99-f25823da6e7c tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:29.367842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-899fb05d-1999-4694-8f99-f25823da6e7c tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:29.368605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-899fb05d-1999-4694-8f99-f25823da6e7c tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:29.369072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-899fb05d-1999-4694-8f99-f25823da6e7c tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:29.369801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-899fb05d-1999-4694-8f99-f25823da6e7c tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:29.548907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-899fb05d-1999-4694-8f99-f25823da6e7c tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:29.560220 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-899fb05d-1999-4694-8f99-f25823da6e7c tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1471 microversion: 2.1 time: 0.210640 Aug 23 18:34:29.574776 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3411/6683] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:29 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1471 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:30.323081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1643983f-505f-4c6c-9742-8d8541d7d230 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:30.327666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1643983f-505f-4c6c-9742-8d8541d7d230 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:30.337120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1643983f-505f-4c6c-9742-8d8541d7d230 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:30.338004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1643983f-505f-4c6c-9742-8d8541d7d230 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:30.338767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1643983f-505f-4c6c-9742-8d8541d7d230 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:30.339803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1643983f-505f-4c6c-9742-8d8541d7d230 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:30.340782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1643983f-505f-4c6c-9742-8d8541d7d230 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:30.341439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1643983f-505f-4c6c-9742-8d8541d7d230 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:30.403792 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1643983f-505f-4c6c-9742-8d8541d7d230 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092324 Aug 23 18:34:30.418926 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3273/6684] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:34:30 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments => generated 25 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:34:30.587493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7b8098e2-2c7a-4e91-bd3d-72f0c98e0a5f tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:30.589448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7b8098e2-2c7a-4e91-bd3d-72f0c98e0a5f tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:30.599829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b8098e2-2c7a-4e91-bd3d-72f0c98e0a5f tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:30.601922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b8098e2-2c7a-4e91-bd3d-72f0c98e0a5f tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:30.603345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b8098e2-2c7a-4e91-bd3d-72f0c98e0a5f tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:30.607796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b8098e2-2c7a-4e91-bd3d-72f0c98e0a5f tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:30.608900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b8098e2-2c7a-4e91-bd3d-72f0c98e0a5f tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:30.609700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b8098e2-2c7a-4e91-bd3d-72f0c98e0a5f tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:30.624413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3284826a-07ed-48d1-80b7-5dcddafe3229 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:30.627252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3284826a-07ed-48d1-80b7-5dcddafe3229 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:30.642293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3284826a-07ed-48d1-80b7-5dcddafe3229 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:30.645309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3284826a-07ed-48d1-80b7-5dcddafe3229 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:30.647854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3284826a-07ed-48d1-80b7-5dcddafe3229 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:30.650756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3284826a-07ed-48d1-80b7-5dcddafe3229 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:30.651921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3284826a-07ed-48d1-80b7-5dcddafe3229 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:30.653081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3284826a-07ed-48d1-80b7-5dcddafe3229 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:30.753714 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3284826a-07ed-48d1-80b7-5dcddafe3229 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.136096 Aug 23 18:34:30.755084 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3274/6685] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:34:30 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80/os-volume_attachments => generated 25 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 18:34:30.774161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7b8098e2-2c7a-4e91-bd3d-72f0c98e0a5f tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:30.814830 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7b8098e2-2c7a-4e91-bd3d-72f0c98e0a5f tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1429 microversion: 2.1 time: 0.232486 Aug 23 18:34:30.817903 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3412/6686] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:30 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1429 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:30.852821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b0909f68-0b9c-4293-ab2b-470dc8cbd829 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:30.853327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b0909f68-0b9c-4293-ab2b-470dc8cbd829 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:30.863687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0909f68-0b9c-4293-ab2b-470dc8cbd829 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:30.864190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0909f68-0b9c-4293-ab2b-470dc8cbd829 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:30.864634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0909f68-0b9c-4293-ab2b-470dc8cbd829 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:30.866354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0909f68-0b9c-4293-ab2b-470dc8cbd829 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:30.866856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0909f68-0b9c-4293-ab2b-470dc8cbd829 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:30.867295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0909f68-0b9c-4293-ab2b-470dc8cbd829 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:30.923884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b0909f68-0b9c-4293-ab2b-470dc8cbd829 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:34:31.047542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f40809bd-88ac-42ea-9b5d-64eda320139c req-239f624e-b2c8-4789-af69-5c8fd49d4bb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775", "name": "network-vif-deleted", "tag": "f6177b8e-777e-42be-bcb4-fc0896dd58f8"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:31.071622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f40809bd-88ac-42ea-9b5d-64eda320139c req-239f624e-b2c8-4789-af69-5c8fd49d4bb8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:31.072060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f40809bd-88ac-42ea-9b5d-64eda320139c req-239f624e-b2c8-4789-af69-5c8fd49d4bb8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:31.072514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f40809bd-88ac-42ea-9b5d-64eda320139c req-239f624e-b2c8-4789-af69-5c8fd49d4bb8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:31.109921 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f40809bd-88ac-42ea-9b5d-64eda320139c req-239f624e-b2c8-4789-af69-5c8fd49d4bb8 service nova] Creating event network-vif-deleted:f6177b8e-777e-42be-bcb4-fc0896dd58f8 for instance 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 on n-h1-850468-16 Aug 23 18:34:31.118385 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b0909f68-0b9c-4293-ab2b-470dc8cbd829 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 204 len: 0 microversion: 2.1 time: 0.269814 Aug 23 18:34:31.119614 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3275/6687] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:34:30 2022] DELETE /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:34:31.136154 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f40809bd-88ac-42ea-9b5d-64eda320139c req-239f624e-b2c8-4789-af69-5c8fd49d4bb8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088704 Aug 23 18:34:31.139076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25795405-ec50-4182-91f9-8523e366cd9f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:31.139679 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3413/6688] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Aug 23 18:34:31.142948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-25795405-ec50-4182-91f9-8523e366cd9f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:31.154893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25795405-ec50-4182-91f9-8523e366cd9f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:31.155683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25795405-ec50-4182-91f9-8523e366cd9f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:31.156344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25795405-ec50-4182-91f9-8523e366cd9f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:31.157281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25795405-ec50-4182-91f9-8523e366cd9f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:31.157958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25795405-ec50-4182-91f9-8523e366cd9f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:31.158689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25795405-ec50-4182-91f9-8523e366cd9f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:31.431987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-25795405-ec50-4182-91f9-8523e366cd9f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:31.450966 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-25795405-ec50-4182-91f9-8523e366cd9f tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1675 microversion: 2.1 time: 0.325992 Aug 23 18:34:31.469140 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3276/6689] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:31 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1675 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:31.841378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:31.842365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:31.860753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:31.861679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:31.872731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:31.873901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:31.874765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:31.875541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:31.946733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:31.947626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:31.948643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:31.949180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lazy-loading 'fault' on Instance uuid 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:34:32.001019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:32.008282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:32.011893 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b3ee6092-02fd-48b3-a43e-d172237485a4 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1305 microversion: 2.1 time: 0.178205 Aug 23 18:34:32.012653 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3414/6690] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:31 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1305 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:32.483223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3c9cf77d-5ca1-41ee-9100-b013913a2f67 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:32.484655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3c9cf77d-5ca1-41ee-9100-b013913a2f67 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:32.493381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c9cf77d-5ca1-41ee-9100-b013913a2f67 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:32.494321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c9cf77d-5ca1-41ee-9100-b013913a2f67 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:32.495028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c9cf77d-5ca1-41ee-9100-b013913a2f67 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:32.496874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c9cf77d-5ca1-41ee-9100-b013913a2f67 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:32.497914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c9cf77d-5ca1-41ee-9100-b013913a2f67 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:32.498685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c9cf77d-5ca1-41ee-9100-b013913a2f67 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:32.793558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3c9cf77d-5ca1-41ee-9100-b013913a2f67 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:32.807264 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3c9cf77d-5ca1-41ee-9100-b013913a2f67 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1675 microversion: 2.1 time: 0.327623 Aug 23 18:34:32.808488 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3277/6691] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:32 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1675 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:33.043125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:33.044675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:33.063737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:33.064259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:33.064715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:33.065456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:33.066121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:33.066582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:33.143092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:33.143893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:33.144500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:33.145048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lazy-loading 'fault' on Instance uuid 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:34:33.204647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b6b19c6888274acbb3e9b59d98f4f631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fea6d4d66a0c4c5f8362e16fbbb41166', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:33.213058 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eae5d5f5-9195-4951-872f-1e77a977520b tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 200 len: 1305 microversion: 2.1 time: 0.183246 Aug 23 18:34:33.213645 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3415/6692] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:33 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 1305 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:33.321735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-255927c8-0730-408a-86b0-e020f3ae8988 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:33.322759 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-availability-zone:detail": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:34:33.322759 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:34:33.323920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-255927c8-0730-408a-86b0-e020f3ae8988 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:33.324547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-255927c8-0730-408a-86b0-e020f3ae8988 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:33.325061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-255927c8-0730-408a-86b0-e020f3ae8988 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:33.325873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-255927c8-0730-408a-86b0-e020f3ae8988 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:33.326414 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-255927c8-0730-408a-86b0-e020f3ae8988 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:33.326875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-255927c8-0730-408a-86b0-e020f3ae8988 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:33.355324 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-255927c8-0730-408a-86b0-e020f3ae8988 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 615 microversion: 2.1 time: 0.192119 Aug 23 18:34:33.355912 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3278/6693] 10.222.0.61 () {58 vars in 1185 bytes} [Tue Aug 23 18:34:33 2022] GET /compute/v2.1/os-availability-zone/detail => generated 615 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:34:33.461766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1613735795", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "availability_zone": "nova:n-h2-850468-16", "networks": [{"uuid": "c8d6f476-01b3-4084-86b1-f9694d6cfa20"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:33.529784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] validate_networks() for [('c8d6f476-01b3-4084-86b1-f9694d6cfa20', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:34:33.829331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b3df91a4-f6b7-4979-b6d3-6038404e8265 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:33.829956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b3df91a4-f6b7-4979-b6d3-6038404e8265 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:33.840690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3df91a4-f6b7-4979-b6d3-6038404e8265 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:33.841407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3df91a4-f6b7-4979-b6d3-6038404e8265 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:33.842013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3df91a4-f6b7-4979-b6d3-6038404e8265 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:33.842983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3df91a4-f6b7-4979-b6d3-6038404e8265 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:33.843445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3df91a4-f6b7-4979-b6d3-6038404e8265 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:33.844016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3df91a4-f6b7-4979-b6d3-6038404e8265 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:34.041541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:34:34.041976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:34:34.042462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:34:34.042964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:34:34.043392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:34:34.053696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:34.054194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:34.054681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:34.055423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:34.055889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:34.056325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:34.077196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Getting quotas for project 12058021b147406984f24aac5b82d435. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:34:34.083567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Getting quotas for user 9fa4b50d4b8c4bc9b9b74377b790e0c4 and project 12058021b147406984f24aac5b82d435. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:34:34.098401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:34:34.101942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:34:34.157349 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0d8de1f3-f622-4e45-ac0a-03d911b7d119 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700094 Aug 23 18:34:34.159632 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3416/6694] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:34:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:34:34.171698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-035370f0-e10a-4a07-80f2-31dc106ef8a2 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:34.172865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-035370f0-e10a-4a07-80f2-31dc106ef8a2 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:34.275772 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-035370f0-e10a-4a07-80f2-31dc106ef8a2 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1329 microversion: 2.1 time: 0.108396 Aug 23 18:34:34.299082 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3417/6695] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:34 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1329 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:34:34.306471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb78008a-66ea-463a-b866-d5806c431706 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:34.307383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eb78008a-66ea-463a-b866-d5806c431706 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] [instance: 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:34.317625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb78008a-66ea-463a-b866-d5806c431706 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:34.318275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb78008a-66ea-463a-b866-d5806c431706 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:34.318857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb78008a-66ea-463a-b866-d5806c431706 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:34.319892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb78008a-66ea-463a-b866-d5806c431706 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:34.320588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb78008a-66ea-463a-b866-d5806c431706 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:34.321241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb78008a-66ea-463a-b866-d5806c431706 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:34.338357 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-eb78008a-66ea-463a-b866-d5806c431706 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] HTTP exception thrown: Instance 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 could not be found. Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb78008a-66ea-463a-b866-d5806c431706 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Request method failure captured: Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 HTTP/1.1 Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBR2iUWOGwE8vjEptwsFR_5qNqLgEnqjUyDnYZcHmk0971MGsPR8lJ5vC5O9rNb2ZL8kXJVcqDkLd-dSGo9hgwh_q3OWfLW8--JbJqZ6GN84JoWnPSMw8LiPONHZ9MB_zi1Vn6rrLkkbGyM1tU4d7GhVQz2UBEhFi4Z8L0Erjp7QNyi4 Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: fea6d4d66a0c4c5f8362e16fbbb41166 Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-VolumesNegativeTest-285106326 Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fea6d4d66a0c4c5f8362e16fbbb41166"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fea6d4d66a0c4c5f8362e16fbbb41166"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fea6d4d66a0c4c5f8362e16fbbb41166"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fea6d4d66a0c4c5f8362e16fbbb41166"}]}] Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-VolumesNegativeTest-285106326 Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: fea6d4d66a0c4c5f8362e16fbbb41166 Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-VolumesNegativeTest-285106326 Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-VolumesNegativeTest-285106326-project Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b6b19c6888274acbb3e9b59d98f4f631 Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-VolumesNegativeTest-285106326-project Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 could not be found. Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775'} Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 could not be found. Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 could not be found. Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:34.340165 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:34.345951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:34.345951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:34.345951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:34.345951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:34:34.345951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:34:34.345951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 could not be found. Aug 23 18:34:34.345951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:34.345951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb78008a-66ea-463a-b866-d5806c431706 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] Returning 404 to user: Instance 1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:34:34.345951 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eb78008a-66ea-463a-b866-d5806c431706 tempest-VolumesNegativeTest-285106326 tempest-VolumesNegativeTest-285106326-project] 10.222.0.61 "GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775" status: 404 len: 111 microversion: 2.1 time: 0.041429 Aug 23 18:34:34.345951 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3418/6696] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:34 2022] GET /compute/v2.1/servers/1bf1ee9a-11ab-47b1-b4b1-bdb0ba5b8775 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:34:34.442423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b3df91a4-f6b7-4979-b6d3-6038404e8265 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:34.455629 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b3df91a4-f6b7-4979-b6d3-6038404e8265 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1675 microversion: 2.1 time: 0.629585 Aug 23 18:34:34.458920 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3279/6697] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:33 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1675 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:34:34.599198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-974b76dd-8513-403c-bdbd-069d67260bd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:34.602034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-974b76dd-8513-403c-bdbd-069d67260bd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:34.609762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-974b76dd-8513-403c-bdbd-069d67260bd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:34.610099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-974b76dd-8513-403c-bdbd-069d67260bd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:34.610730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-974b76dd-8513-403c-bdbd-069d67260bd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:34.611725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-974b76dd-8513-403c-bdbd-069d67260bd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:34.611992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-974b76dd-8513-403c-bdbd-069d67260bd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:34.612504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-974b76dd-8513-403c-bdbd-069d67260bd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:34.803096 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-974b76dd-8513-403c-bdbd-069d67260bd6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad/action" status: 200 len: 24563 microversion: 2.1 time: 0.456391 Aug 23 18:34:34.804403 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3419/6698] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:34:34 2022] POST /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad/action => generated 24563 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:34:35.300835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e66d4f40-370d-43c6-8318-c80245914e32 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:35.301472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e66d4f40-370d-43c6-8318-c80245914e32 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:35.316667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e66d4f40-370d-43c6-8318-c80245914e32 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:35.320628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e66d4f40-370d-43c6-8318-c80245914e32 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:35.323574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e66d4f40-370d-43c6-8318-c80245914e32 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:35.324854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e66d4f40-370d-43c6-8318-c80245914e32 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:35.325497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e66d4f40-370d-43c6-8318-c80245914e32 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:35.326160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e66d4f40-370d-43c6-8318-c80245914e32 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:35.463426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f222d272-5f80-4fc3-a7a1-34a842884d34 req-2f4856fe-edce-4123-bfd8-f25b57992612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9e3996c-f814-4ec8-8eec-3acd658b2d80", "name": "network-vif-deleted", "tag": "ec8a0555-a1c4-4e33-83c6-9a899fe1bddc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:35.485277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f222d272-5f80-4fc3-a7a1-34a842884d34 req-2f4856fe-edce-4123-bfd8-f25b57992612 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:35.485807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f222d272-5f80-4fc3-a7a1-34a842884d34 req-2f4856fe-edce-4123-bfd8-f25b57992612 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:35.486253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f222d272-5f80-4fc3-a7a1-34a842884d34 req-2f4856fe-edce-4123-bfd8-f25b57992612 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:35.520253 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f222d272-5f80-4fc3-a7a1-34a842884d34 req-2f4856fe-edce-4123-bfd8-f25b57992612 service nova] Creating event network-vif-deleted:ec8a0555-a1c4-4e33-83c6-9a899fe1bddc for instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 on n-h1-850468-16 Aug 23 18:34:35.532131 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e66d4f40-370d-43c6-8318-c80245914e32 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1338 microversion: 2.1 time: 0.236372 Aug 23 18:34:35.532717 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3280/6699] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:35 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1338 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:35.554110 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f222d272-5f80-4fc3-a7a1-34a842884d34 req-2f4856fe-edce-4123-bfd8-f25b57992612 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095470 Aug 23 18:34:35.564835 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3420/6700] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:34:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:34:35.566153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7c3ed0c5-d7f8-4fb8-89cc-6ed08d43e70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:35.566812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7c3ed0c5-d7f8-4fb8-89cc-6ed08d43e70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:35.580688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c3ed0c5-d7f8-4fb8-89cc-6ed08d43e70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:35.581188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c3ed0c5-d7f8-4fb8-89cc-6ed08d43e70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:35.581626 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c3ed0c5-d7f8-4fb8-89cc-6ed08d43e70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:35.582327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c3ed0c5-d7f8-4fb8-89cc-6ed08d43e70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:35.582980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c3ed0c5-d7f8-4fb8-89cc-6ed08d43e70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:35.586480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7c3ed0c5-d7f8-4fb8-89cc-6ed08d43e70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:35.709748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7c3ed0c5-d7f8-4fb8-89cc-6ed08d43e70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84923104c9a4be5801ac8721b3e3e6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '73c64d353c72438ab1c77f5d6c042cbe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:34:35.718968 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7c3ed0c5-d7f8-4fb8-89cc-6ed08d43e70b tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 200 len: 1323 microversion: 2.1 time: 0.167156 Aug 23 18:34:35.724389 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3281/6701] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:35 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 1323 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:36.561031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0e2658bf-8ac6-4de6-b691-40c1e9117fd4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:36.561755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0e2658bf-8ac6-4de6-b691-40c1e9117fd4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:36.576432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e2658bf-8ac6-4de6-b691-40c1e9117fd4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:36.577285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e2658bf-8ac6-4de6-b691-40c1e9117fd4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:36.577724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e2658bf-8ac6-4de6-b691-40c1e9117fd4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:36.578454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e2658bf-8ac6-4de6-b691-40c1e9117fd4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:36.580929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e2658bf-8ac6-4de6-b691-40c1e9117fd4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:36.581382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e2658bf-8ac6-4de6-b691-40c1e9117fd4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:36.744724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2932aece-b229-4bf8-8b09-707e4147abe2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:36.746041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2932aece-b229-4bf8-8b09-707e4147abe2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:36.756199 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0e2658bf-8ac6-4de6-b691-40c1e9117fd4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1436 microversion: 2.1 time: 0.196969 Aug 23 18:34:36.756842 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3421/6702] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:36 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1436 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:36.757218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2932aece-b229-4bf8-8b09-707e4147abe2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:36.758134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2932aece-b229-4bf8-8b09-707e4147abe2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:36.759212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2932aece-b229-4bf8-8b09-707e4147abe2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:36.760255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2932aece-b229-4bf8-8b09-707e4147abe2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:36.761374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2932aece-b229-4bf8-8b09-707e4147abe2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:36.761975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2932aece-b229-4bf8-8b09-707e4147abe2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:36.805935 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2932aece-b229-4bf8-8b09-707e4147abe2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] HTTP exception thrown: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2932aece-b229-4bf8-8b09-707e4147abe2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Request method failure captured: Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 HTTP/1.1 Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRvmCILQzYC7xcMrgx_Z5xSoeSGmidufQQqFkZX71eWkY9zWJvVqZv-AbHJuyltXL09lgxC6zekoiYAWR54NkG9Nqs5dHSK12_fKfUQULzL8xHtxfvQNzvqXJnH0C508CJuTGkuX9cVQfl_kpx6xvnyGflUE5m9UCCLUqLixEDSrHic Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 73c64d353c72438ab1c77f5d6c042cbe Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/73c64d353c72438ab1c77f5d6c042cbe"}]}] Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 73c64d353c72438ab1c77f5d6c042cbe Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeTestJSON-551385409-project Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f84923104c9a4be5801ac8721b3e3e6c Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeTestJSON-551385409-project Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f9e3996c-f814-4ec8-8eec-3acd658b2d80'} Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:36.813000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:36.819994 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:36.819994 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:36.819994 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:36.819994 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:34:36.819994 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:34:36.819994 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:36.819994 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:36.819994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2932aece-b229-4bf8-8b09-707e4147abe2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Returning 404 to user: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:34:36.823728 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2932aece-b229-4bf8-8b09-707e4147abe2 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 404 len: 111 microversion: 2.1 time: 0.077680 Aug 23 18:34:36.829047 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3282/6703] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:36 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:34:36.834863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e311b6a7-ad17-4ab1-9b71-c7af75070441 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '.version_select at 0x7f27df49d1f0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:36.861139 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e311b6a7-ad17-4ab1-9b71-c7af75070441 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048959482" status: 202 len: 0 microversion: 2.1 time: 0.030855 Aug 23 18:34:36.862392 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3422/6704] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 18:34:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2048959482 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:34:37.778303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b0efa8ac-c2c6-43f7-9c31-1233ebe7a766 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:37.778978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b0efa8ac-c2c6-43f7-9c31-1233ebe7a766 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:37.796357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0efa8ac-c2c6-43f7-9c31-1233ebe7a766 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:37.797040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0efa8ac-c2c6-43f7-9c31-1233ebe7a766 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:37.797703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0efa8ac-c2c6-43f7-9c31-1233ebe7a766 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:37.798662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0efa8ac-c2c6-43f7-9c31-1233ebe7a766 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:37.799481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0efa8ac-c2c6-43f7-9c31-1233ebe7a766 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:37.800398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0efa8ac-c2c6-43f7-9c31-1233ebe7a766 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:37.812117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:38.109462 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b0efa8ac-c2c6-43f7-9c31-1233ebe7a766 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1466 microversion: 2.1 time: 0.334883 Aug 23 18:34:38.110779 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3283/6705] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:37 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1466 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:38.585063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8e3e16fc-a518-44ad-a77e-128e942bacb6 req-ab5a2a16-b69b-4af0-a33c-9e7ed9d6307f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1", "tag": "4e84bde4-2b04-4af8-96f0-c4455224bf0e"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:38.607552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8e3e16fc-a518-44ad-a77e-128e942bacb6 req-ab5a2a16-b69b-4af0-a33c-9e7ed9d6307f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:38.608002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8e3e16fc-a518-44ad-a77e-128e942bacb6 req-ab5a2a16-b69b-4af0-a33c-9e7ed9d6307f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:38.608523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8e3e16fc-a518-44ad-a77e-128e942bacb6 req-ab5a2a16-b69b-4af0-a33c-9e7ed9d6307f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:38.633508 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8e3e16fc-a518-44ad-a77e-128e942bacb6 req-ab5a2a16-b69b-4af0-a33c-9e7ed9d6307f service nova] Creating event network-changed:4e84bde4-2b04-4af8-96f0-c4455224bf0e for instance c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 on n-h2-850468-16 Aug 23 18:34:38.638636 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8e3e16fc-a518-44ad-a77e-128e942bacb6 req-ab5a2a16-b69b-4af0-a33c-9e7ed9d6307f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057955 Aug 23 18:34:38.639249 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3423/6706] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:34:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:34:39.131973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ae973ac2-2ef1-46a2-afc8-4b8848987fa0 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:39.132603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ae973ac2-2ef1-46a2-afc8-4b8848987fa0 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:39.147526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae973ac2-2ef1-46a2-afc8-4b8848987fa0 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:39.148050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae973ac2-2ef1-46a2-afc8-4b8848987fa0 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:39.149728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae973ac2-2ef1-46a2-afc8-4b8848987fa0 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:39.150506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae973ac2-2ef1-46a2-afc8-4b8848987fa0 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:39.151908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae973ac2-2ef1-46a2-afc8-4b8848987fa0 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:39.152365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae973ac2-2ef1-46a2-afc8-4b8848987fa0 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:39.345344 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ae973ac2-2ef1-46a2-afc8-4b8848987fa0 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1466 microversion: 2.1 time: 0.217731 Aug 23 18:34:39.346027 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3284/6707] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:39 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1466 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:40.368803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e69c3fe3-f4fb-4d70-8539-eb6a134d39f3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:40.369508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e69c3fe3-f4fb-4d70-8539-eb6a134d39f3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:40.376101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e69c3fe3-f4fb-4d70-8539-eb6a134d39f3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:40.376845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e69c3fe3-f4fb-4d70-8539-eb6a134d39f3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:40.377285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e69c3fe3-f4fb-4d70-8539-eb6a134d39f3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:40.378000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e69c3fe3-f4fb-4d70-8539-eb6a134d39f3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:40.378454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e69c3fe3-f4fb-4d70-8539-eb6a134d39f3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:40.378908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e69c3fe3-f4fb-4d70-8539-eb6a134d39f3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:40.526002 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e69c3fe3-f4fb-4d70-8539-eb6a134d39f3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1466 microversion: 2.1 time: 0.162881 Aug 23 18:34:40.528007 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3424/6708] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:40 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1466 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:41.550709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c1c2cca2-9be4-4aff-9d61-30f2ae231220 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:41.553362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c1c2cca2-9be4-4aff-9d61-30f2ae231220 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:41.564844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c2cca2-9be4-4aff-9d61-30f2ae231220 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:41.565609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c2cca2-9be4-4aff-9d61-30f2ae231220 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:41.566760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c2cca2-9be4-4aff-9d61-30f2ae231220 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:41.568274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c2cca2-9be4-4aff-9d61-30f2ae231220 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:41.569189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c2cca2-9be4-4aff-9d61-30f2ae231220 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:41.570065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c2cca2-9be4-4aff-9d61-30f2ae231220 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:41.829371 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c1c2cca2-9be4-4aff-9d61-30f2ae231220 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1466 microversion: 2.1 time: 0.283676 Aug 23 18:34:41.841318 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3285/6709] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:41 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1466 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:42.857682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f452fd16-c28c-4db6-b1ec-f4856887cda3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:42.859147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f452fd16-c28c-4db6-b1ec-f4856887cda3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:42.867885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f452fd16-c28c-4db6-b1ec-f4856887cda3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:42.868748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f452fd16-c28c-4db6-b1ec-f4856887cda3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:42.869553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f452fd16-c28c-4db6-b1ec-f4856887cda3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:42.870305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f452fd16-c28c-4db6-b1ec-f4856887cda3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:42.871453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f452fd16-c28c-4db6-b1ec-f4856887cda3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:42.872163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f452fd16-c28c-4db6-b1ec-f4856887cda3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:43.043695 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f452fd16-c28c-4db6-b1ec-f4856887cda3 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1466 microversion: 2.1 time: 0.191258 Aug 23 18:34:43.044280 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3425/6710] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:42 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1466 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:44.065102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-26d9e510-a288-4d94-a585-eae5b7552bea tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:44.065730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-26d9e510-a288-4d94-a585-eae5b7552bea tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:44.070376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:44.074441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26d9e510-a288-4d94-a585-eae5b7552bea tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:44.075000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26d9e510-a288-4d94-a585-eae5b7552bea tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:44.075412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26d9e510-a288-4d94-a585-eae5b7552bea tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:44.076143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26d9e510-a288-4d94-a585-eae5b7552bea tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:44.076587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26d9e510-a288-4d94-a585-eae5b7552bea tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:44.077022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-26d9e510-a288-4d94-a585-eae5b7552bea tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:44.230435 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-26d9e510-a288-4d94-a585-eae5b7552bea tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1466 microversion: 2.1 time: 0.168811 Aug 23 18:34:44.231482 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3286/6711] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:44 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1466 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:45.008254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-328690e5-41be-448e-b124-f5ee2cf8e2cb tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:45.009081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-328690e5-41be-448e-b124-f5ee2cf8e2cb tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:45.015408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:45.016345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:45.021455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-328690e5-41be-448e-b124-f5ee2cf8e2cb tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:45.022763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-328690e5-41be-448e-b124-f5ee2cf8e2cb tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:45.023470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-328690e5-41be-448e-b124-f5ee2cf8e2cb tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:45.024417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-328690e5-41be-448e-b124-f5ee2cf8e2cb tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:45.025122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-328690e5-41be-448e-b124-f5ee2cf8e2cb tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:45.025778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-328690e5-41be-448e-b124-f5ee2cf8e2cb tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:45.043591 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-328690e5-41be-448e-b124-f5ee2cf8e2cb tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] HTTP exception thrown: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-328690e5-41be-448e-b124-f5ee2cf8e2cb tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Request method failure captured: Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 HTTP/1.1 Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBRvmCILQzYC7xcMrgx_Z5xSoeSGmidufQQqFkZX71eWkY9zWJvVqZv-AbHJuyltXL09lgxC6zekoiYAWR54NkG9Nqs5dHSK12_fKfUQULzL8xHtxfvQNzvqXJnH0C508CJuTGkuX9cVQfl_kpx6xvnyGflUE5m9UCCLUqLixEDSrHic Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 73c64d353c72438ab1c77f5d6c042cbe Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/73c64d353c72438ab1c77f5d6c042cbe"}]}] Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 73c64d353c72438ab1c77f5d6c042cbe Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-AttachVolumeTestJSON-551385409-project Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: f84923104c9a4be5801ac8721b3e3e6c Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-AttachVolumeTestJSON-551385409-project Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f9e3996c-f814-4ec8-8eec-3acd658b2d80'} Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:34:45.045614 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:34:45.049642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:45.049642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:45.049642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:45.049642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:45.049642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:45.049642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:45.049642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:45.049642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:34:45.049642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:34:45.049642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:45.049642 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:34:45.052479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-328690e5-41be-448e-b124-f5ee2cf8e2cb tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Returning 404 to user: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:34:45.053681 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-328690e5-41be-448e-b124-f5ee2cf8e2cb tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 404 len: 111 microversion: 2.1 time: 0.051979 Aug 23 18:34:45.055048 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3426/6712] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:34:45 2022] DELETE /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:34:45.062867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-57588ff1-5883-4aa1-b697-845b1f22d4f7 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:45.063737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-57588ff1-5883-4aa1-b697-845b1f22d4f7 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: f9e3996c-f814-4ec8-8eec-3acd658b2d80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:45.072004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57588ff1-5883-4aa1-b697-845b1f22d4f7 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:45.072614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57588ff1-5883-4aa1-b697-845b1f22d4f7 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:45.073065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57588ff1-5883-4aa1-b697-845b1f22d4f7 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:45.074024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57588ff1-5883-4aa1-b697-845b1f22d4f7 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:45.074488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57588ff1-5883-4aa1-b697-845b1f22d4f7 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:45.075001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-57588ff1-5883-4aa1-b697-845b1f22d4f7 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:45.093635 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-57588ff1-5883-4aa1-b697-845b1f22d4f7 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] HTTP exception thrown: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-57588ff1-5883-4aa1-b697-845b1f22d4f7 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Request method failure captured: Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 HTTP/1.1 Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRvmCILQzYC7xcMrgx_Z5xSoeSGmidufQQqFkZX71eWkY9zWJvVqZv-AbHJuyltXL09lgxC6zekoiYAWR54NkG9Nqs5dHSK12_fKfUQULzL8xHtxfvQNzvqXJnH0C508CJuTGkuX9cVQfl_kpx6xvnyGflUE5m9UCCLUqLixEDSrHic Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 73c64d353c72438ab1c77f5d6c042cbe Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/73c64d353c72438ab1c77f5d6c042cbe"}]}] Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 73c64d353c72438ab1c77f5d6c042cbe Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeTestJSON-551385409-project Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f84923104c9a4be5801ac8721b3e3e6c Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeTestJSON-551385409-project Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f9e3996c-f814-4ec8-8eec-3acd658b2d80'} Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:45.095464 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:45.100340 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:45.100340 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:45.100340 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:45.100340 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:34:45.100340 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:34:45.100340 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. Aug 23 18:34:45.100340 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:45.100340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-57588ff1-5883-4aa1-b697-845b1f22d4f7 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Returning 404 to user: Instance f9e3996c-f814-4ec8-8eec-3acd658b2d80 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:34:45.100340 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-57588ff1-5883-4aa1-b697-845b1f22d4f7 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80" status: 404 len: 111 microversion: 2.1 time: 0.038210 Aug 23 18:34:45.100340 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3287/6713] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:45 2022] GET /compute/v2.1/servers/f9e3996c-f814-4ec8-8eec-3acd658b2d80 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:34:45.262330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-de23de30-2439-4b7f-8773-f5afbac5552e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:45.263557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-de23de30-2439-4b7f-8773-f5afbac5552e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:45.273219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de23de30-2439-4b7f-8773-f5afbac5552e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:45.274069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de23de30-2439-4b7f-8773-f5afbac5552e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:45.274819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de23de30-2439-4b7f-8773-f5afbac5552e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:45.275741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de23de30-2439-4b7f-8773-f5afbac5552e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:45.276370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de23de30-2439-4b7f-8773-f5afbac5552e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:45.277016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de23de30-2439-4b7f-8773-f5afbac5552e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:45.452986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-50c1dd91-ac32-4921-a73c-aebf2e88d259 req-d992251e-2231-4bd8-bb46-6cf0b2b1cba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1", "name": "network-vif-plugged", "status": "completed", "tag": "4e84bde4-2b04-4af8-96f0-c4455224bf0e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:45.471793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-50c1dd91-ac32-4921-a73c-aebf2e88d259 req-d992251e-2231-4bd8-bb46-6cf0b2b1cba1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:45.472285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-50c1dd91-ac32-4921-a73c-aebf2e88d259 req-d992251e-2231-4bd8-bb46-6cf0b2b1cba1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:45.472724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-50c1dd91-ac32-4921-a73c-aebf2e88d259 req-d992251e-2231-4bd8-bb46-6cf0b2b1cba1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:45.509082 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-50c1dd91-ac32-4921-a73c-aebf2e88d259 req-d992251e-2231-4bd8-bb46-6cf0b2b1cba1 service nova] Creating event network-vif-plugged:4e84bde4-2b04-4af8-96f0-c4455224bf0e for instance c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 on n-h2-850468-16 Aug 23 18:34:45.529239 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-50c1dd91-ac32-4921-a73c-aebf2e88d259 req-d992251e-2231-4bd8-bb46-6cf0b2b1cba1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078142 Aug 23 18:34:45.530214 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3288/6714] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:34:45.558357 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-de23de30-2439-4b7f-8773-f5afbac5552e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1466 microversion: 2.1 time: 0.310102 Aug 23 18:34:45.560676 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3427/6715] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:45 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1466 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:46.583074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6ad3eb8f-e5bc-4da1-a64a-1e9745479e37 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:46.584526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6ad3eb8f-e5bc-4da1-a64a-1e9745479e37 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:46.587351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:46.593588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ad3eb8f-e5bc-4da1-a64a-1e9745479e37 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:46.594321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ad3eb8f-e5bc-4da1-a64a-1e9745479e37 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:46.594965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ad3eb8f-e5bc-4da1-a64a-1e9745479e37 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:46.595936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ad3eb8f-e5bc-4da1-a64a-1e9745479e37 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:46.596565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ad3eb8f-e5bc-4da1-a64a-1e9745479e37 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:46.597153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ad3eb8f-e5bc-4da1-a64a-1e9745479e37 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:46.747091 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6ad3eb8f-e5bc-4da1-a64a-1e9745479e37 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1466 microversion: 2.1 time: 0.168129 Aug 23 18:34:46.747677 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3289/6716] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:46 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1466 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:47.768708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f6151ba4-1a04-477b-bc7f-37718146610c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:47.769378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f6151ba4-1a04-477b-bc7f-37718146610c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:47.774249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:34:47.786143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6151ba4-1a04-477b-bc7f-37718146610c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:47.788640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6151ba4-1a04-477b-bc7f-37718146610c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:47.789690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6151ba4-1a04-477b-bc7f-37718146610c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:47.790918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6151ba4-1a04-477b-bc7f-37718146610c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:47.791750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6151ba4-1a04-477b-bc7f-37718146610c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:47.792548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6151ba4-1a04-477b-bc7f-37718146610c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:48.055105 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f6151ba4-1a04-477b-bc7f-37718146610c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1650 microversion: 2.1 time: 0.288893 Aug 23 18:34:48.069940 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3428/6717] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:47 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1650 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:48.075926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-58c81c7a-5670-4022-9629-7d26a85377d1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:48.077025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-58c81c7a-5670-4022-9629-7d26a85377d1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:48.086144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58c81c7a-5670-4022-9629-7d26a85377d1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:48.087205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58c81c7a-5670-4022-9629-7d26a85377d1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:48.087750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58c81c7a-5670-4022-9629-7d26a85377d1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:48.088672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58c81c7a-5670-4022-9629-7d26a85377d1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:48.089345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58c81c7a-5670-4022-9629-7d26a85377d1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:48.090217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58c81c7a-5670-4022-9629-7d26a85377d1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:48.276462 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-58c81c7a-5670-4022-9629-7d26a85377d1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1650 microversion: 2.1 time: 0.204490 Aug 23 18:34:48.277367 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3290/6718] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:48 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1650 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:48.298310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa57283b-a322-4a43-951a-8857e44c6ec7 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:48.299364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa57283b-a322-4a43-951a-8857e44c6ec7 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:48.308061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa57283b-a322-4a43-951a-8857e44c6ec7 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:48.312378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa57283b-a322-4a43-951a-8857e44c6ec7 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:48.312914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa57283b-a322-4a43-951a-8857e44c6ec7 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:48.313713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa57283b-a322-4a43-951a-8857e44c6ec7 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:48.315458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa57283b-a322-4a43-951a-8857e44c6ec7 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:48.316161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa57283b-a322-4a43-951a-8857e44c6ec7 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:48.422191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-02347710-65c8-4eab-877d-e0b9ede0e728 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:48.424631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-02347710-65c8-4eab-877d-e0b9ede0e728 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:48.460960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02347710-65c8-4eab-877d-e0b9ede0e728 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:48.461896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02347710-65c8-4eab-877d-e0b9ede0e728 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:48.466806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02347710-65c8-4eab-877d-e0b9ede0e728 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:48.468073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02347710-65c8-4eab-877d-e0b9ede0e728 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:48.468782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02347710-65c8-4eab-877d-e0b9ede0e728 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:48.469441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02347710-65c8-4eab-877d-e0b9ede0e728 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:48.504455 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-02347710-65c8-4eab-877d-e0b9ede0e728 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] HTTP exception thrown: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-02347710-65c8-4eab-877d-e0b9ede0e728 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Request method failure captured: Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 HTTP/1.1 Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRvmCILQzYC7xcMrgx_Z5xSoeSGmidufQQqFkZX71eWkY9zWJvVqZv-AbHJuyltXL09lgxC6zekoiYAWR54NkG9Nqs5dHSK12_fKfUQULzL8xHtxfvQNzvqXJnH0C508CJuTGkuX9cVQfl_kpx6xvnyGflUE5m9UCCLUqLixEDSrHic Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 73c64d353c72438ab1c77f5d6c042cbe Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/73c64d353c72438ab1c77f5d6c042cbe"}]}] Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 73c64d353c72438ab1c77f5d6c042cbe Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeTestJSON-551385409-project Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f84923104c9a4be5801ac8721b3e3e6c Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeTestJSON-551385409-project Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '181bbeec-159b-4f25-91cd-4c1d93687b11'} Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:34:48.506836 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-02347710-65c8-4eab-877d-e0b9ede0e728 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Returning 404 to user: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:34:48.512386 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-02347710-65c8-4eab-877d-e0b9ede0e728 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "DELETE /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 404 len: 111 microversion: 2.1 time: 0.096303 Aug 23 18:34:48.513701 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3291/6719] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:34:48 2022] DELETE /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:34:48.518623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d063dea-8cab-4d92-9c40-58ee09316d85 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:48.519240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5d063dea-8cab-4d92-9c40-58ee09316d85 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] [instance: 181bbeec-159b-4f25-91cd-4c1d93687b11] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:48.543739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d063dea-8cab-4d92-9c40-58ee09316d85 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:48.544518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d063dea-8cab-4d92-9c40-58ee09316d85 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:48.544985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d063dea-8cab-4d92-9c40-58ee09316d85 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:48.545744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d063dea-8cab-4d92-9c40-58ee09316d85 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:48.546209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d063dea-8cab-4d92-9c40-58ee09316d85 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:48.546670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5d063dea-8cab-4d92-9c40-58ee09316d85 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:48.563056 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-5d063dea-8cab-4d92-9c40-58ee09316d85 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] HTTP exception thrown: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d063dea-8cab-4d92-9c40-58ee09316d85 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Request method failure captured: Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 HTTP/1.1 Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRvmCILQzYC7xcMrgx_Z5xSoeSGmidufQQqFkZX71eWkY9zWJvVqZv-AbHJuyltXL09lgxC6zekoiYAWR54NkG9Nqs5dHSK12_fKfUQULzL8xHtxfvQNzvqXJnH0C508CJuTGkuX9cVQfl_kpx6xvnyGflUE5m9UCCLUqLixEDSrHic Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 73c64d353c72438ab1c77f5d6c042cbe Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/73c64d353c72438ab1c77f5d6c042cbe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/73c64d353c72438ab1c77f5d6c042cbe"}]}] Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 73c64d353c72438ab1c77f5d6c042cbe Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-AttachVolumeTestJSON-551385409 Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-AttachVolumeTestJSON-551385409-project Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: f84923104c9a4be5801ac8721b3e3e6c Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-AttachVolumeTestJSON-551385409-project Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '181bbeec-159b-4f25-91cd-4c1d93687b11'} Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:34:48.564798 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:48.569169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:34:48.569169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:34:48.569169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:34:48.569169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:34:48.569169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:34:48.569169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. Aug 23 18:34:48.569169 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:34:48.571554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5d063dea-8cab-4d92-9c40-58ee09316d85 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] Returning 404 to user: Instance 181bbeec-159b-4f25-91cd-4c1d93687b11 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:34:48.573500 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5d063dea-8cab-4d92-9c40-58ee09316d85 tempest-AttachVolumeTestJSON-551385409 tempest-AttachVolumeTestJSON-551385409-project] 10.222.0.61 "GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11" status: 404 len: 111 microversion: 2.1 time: 0.058631 Aug 23 18:34:48.580507 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa57283b-a322-4a43-951a-8857e44c6ec7 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1650 microversion: 2.1 time: 0.287457 Aug 23 18:34:48.581487 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3429/6720] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:48 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1650 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:48.604038 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3292/6721] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:48 2022] GET /compute/v2.1/servers/181bbeec-159b-4f25-91cd-4c1d93687b11 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:34:48.769110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-107388822", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "availability_zone": "nova:n-h1-850468-16", "networks": [{"uuid": "c8d6f476-01b3-4084-86b1-f9694d6cfa20"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:48.850774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] validate_networks() for [('c8d6f476-01b3-4084-86b1-f9694d6cfa20', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:34:49.879310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:34:49.880052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:34:49.880693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:34:49.881156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:34:49.881581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:34:49.906822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:49.907350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:49.907794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:49.908563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:49.909029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:49.909464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:49.955594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Getting quotas for project 12058021b147406984f24aac5b82d435. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:34:49.968736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Getting quotas for user 9fa4b50d4b8c4bc9b9b74377b790e0c4 and project 12058021b147406984f24aac5b82d435. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:34:50.004188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:34:50.008098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:34:50.157311 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-261e01c3-4686-46b9-909d-0084be9a6f9b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.392154 Aug 23 18:34:50.166860 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3430/6722] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:34:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 1402 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:34:50.171820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-134f50d5-6668-4558-b02e-6d5fade702f7 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:50.172472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-134f50d5-6668-4558-b02e-6d5fade702f7 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:50.443049 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-134f50d5-6668-4558-b02e-6d5fade702f7 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1328 microversion: 2.1 time: 0.269920 Aug 23 18:34:50.446248 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3293/6723] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:50 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1328 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:51.472821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b770dba1-7a89-459f-99f5-d573201e0592 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:51.473527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b770dba1-7a89-459f-99f5-d573201e0592 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:51.487237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b770dba1-7a89-459f-99f5-d573201e0592 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:51.487741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b770dba1-7a89-459f-99f5-d573201e0592 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:51.488184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b770dba1-7a89-459f-99f5-d573201e0592 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:51.488901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b770dba1-7a89-459f-99f5-d573201e0592 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:51.489443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b770dba1-7a89-459f-99f5-d573201e0592 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:51.490226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b770dba1-7a89-459f-99f5-d573201e0592 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:51.664801 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b770dba1-7a89-459f-99f5-d573201e0592 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1417 microversion: 2.1 time: 0.203141 Aug 23 18:34:51.690734 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3431/6724] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:51 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1417 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:52.693248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc570ef5-2c8f-43bd-82f5-b07c838e3529 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:52.694518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc570ef5-2c8f-43bd-82f5-b07c838e3529 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:52.710157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc570ef5-2c8f-43bd-82f5-b07c838e3529 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:52.710985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc570ef5-2c8f-43bd-82f5-b07c838e3529 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:52.712040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc570ef5-2c8f-43bd-82f5-b07c838e3529 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:52.713862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc570ef5-2c8f-43bd-82f5-b07c838e3529 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:52.714904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc570ef5-2c8f-43bd-82f5-b07c838e3529 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:52.715634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc570ef5-2c8f-43bd-82f5-b07c838e3529 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:52.917157 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc570ef5-2c8f-43bd-82f5-b07c838e3529 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1423 microversion: 2.1 time: 0.228961 Aug 23 18:34:52.918416 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3294/6725] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:52 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1423 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:53.940009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1237b674-6448-4d85-9f5a-b5469a7ba997 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:53.941326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1237b674-6448-4d85-9f5a-b5469a7ba997 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:53.950765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1237b674-6448-4d85-9f5a-b5469a7ba997 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:53.951660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1237b674-6448-4d85-9f5a-b5469a7ba997 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:53.952279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1237b674-6448-4d85-9f5a-b5469a7ba997 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:53.953230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1237b674-6448-4d85-9f5a-b5469a7ba997 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:53.953931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1237b674-6448-4d85-9f5a-b5469a7ba997 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:53.954583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1237b674-6448-4d85-9f5a-b5469a7ba997 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:54.432898 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1237b674-6448-4d85-9f5a-b5469a7ba997 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1465 microversion: 2.1 time: 0.496557 Aug 23 18:34:54.433569 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3432/6726] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:53 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1465 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:54.650815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-393ede00-576d-4d05-b517-6f7486a1ff67 req-125d0b82-0311-4cfa-acad-aebdc7c6ebdd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70e7f72d-3d56-490a-a96b-5e11089d692f", "tag": "0c3d18ab-7e1c-4397-8cc4-7e2c2da63c41"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:34:54.677947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-393ede00-576d-4d05-b517-6f7486a1ff67 req-125d0b82-0311-4cfa-acad-aebdc7c6ebdd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:54.678898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-393ede00-576d-4d05-b517-6f7486a1ff67 req-125d0b82-0311-4cfa-acad-aebdc7c6ebdd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:54.679538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-393ede00-576d-4d05-b517-6f7486a1ff67 req-125d0b82-0311-4cfa-acad-aebdc7c6ebdd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:54.702327 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-393ede00-576d-4d05-b517-6f7486a1ff67 req-125d0b82-0311-4cfa-acad-aebdc7c6ebdd service nova] Creating event network-changed:0c3d18ab-7e1c-4397-8cc4-7e2c2da63c41 for instance 70e7f72d-3d56-490a-a96b-5e11089d692f on n-h1-850468-16 Aug 23 18:34:54.709489 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-393ede00-576d-4d05-b517-6f7486a1ff67 req-125d0b82-0311-4cfa-acad-aebdc7c6ebdd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069394 Aug 23 18:34:54.710768 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3295/6727] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:34:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:34:55.455440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-da588a47-7f7b-4639-af4a-36734467aeb1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:55.457323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-da588a47-7f7b-4639-af4a-36734467aeb1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:55.472194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da588a47-7f7b-4639-af4a-36734467aeb1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:55.477115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da588a47-7f7b-4639-af4a-36734467aeb1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:55.479762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da588a47-7f7b-4639-af4a-36734467aeb1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:55.481026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da588a47-7f7b-4639-af4a-36734467aeb1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:55.482756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da588a47-7f7b-4639-af4a-36734467aeb1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:55.486360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da588a47-7f7b-4639-af4a-36734467aeb1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:55.790336 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-da588a47-7f7b-4639-af4a-36734467aeb1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1465 microversion: 2.1 time: 0.337645 Aug 23 18:34:55.791883 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3433/6728] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:55 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1465 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:56.814880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e20a9c84-e1a4-45bf-bb44-f5454e666559 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:56.816924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e20a9c84-e1a4-45bf-bb44-f5454e666559 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:56.832427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e20a9c84-e1a4-45bf-bb44-f5454e666559 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:56.836492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e20a9c84-e1a4-45bf-bb44-f5454e666559 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:56.836951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e20a9c84-e1a4-45bf-bb44-f5454e666559 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:56.839593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e20a9c84-e1a4-45bf-bb44-f5454e666559 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:56.840260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e20a9c84-e1a4-45bf-bb44-f5454e666559 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:56.841148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e20a9c84-e1a4-45bf-bb44-f5454e666559 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:57.083540 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e20a9c84-e1a4-45bf-bb44-f5454e666559 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1465 microversion: 2.1 time: 0.274270 Aug 23 18:34:57.084527 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3296/6729] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:56 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1465 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:58.108098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c3febb88-552a-4ef7-937d-c0c27de9eef6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:58.109327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c3febb88-552a-4ef7-937d-c0c27de9eef6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:58.119479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3febb88-552a-4ef7-937d-c0c27de9eef6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:58.120286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3febb88-552a-4ef7-937d-c0c27de9eef6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:58.120908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3febb88-552a-4ef7-937d-c0c27de9eef6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:58.121955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3febb88-552a-4ef7-937d-c0c27de9eef6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:58.122917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3febb88-552a-4ef7-937d-c0c27de9eef6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:58.123573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3febb88-552a-4ef7-937d-c0c27de9eef6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:58.356427 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c3febb88-552a-4ef7-937d-c0c27de9eef6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1465 microversion: 2.1 time: 0.253447 Aug 23 18:34:58.358390 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3434/6730] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:58 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1465 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:34:59.385137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-db8d6b2f-9edd-44f5-a363-72d04fdff61e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:34:59.386031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-db8d6b2f-9edd-44f5-a363-72d04fdff61e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:34:59.399747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db8d6b2f-9edd-44f5-a363-72d04fdff61e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:59.400470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db8d6b2f-9edd-44f5-a363-72d04fdff61e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:59.401195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db8d6b2f-9edd-44f5-a363-72d04fdff61e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:59.402718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db8d6b2f-9edd-44f5-a363-72d04fdff61e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:34:59.403413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db8d6b2f-9edd-44f5-a363-72d04fdff61e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:34:59.404068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db8d6b2f-9edd-44f5-a363-72d04fdff61e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:34:59.650811 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-db8d6b2f-9edd-44f5-a363-72d04fdff61e tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1465 microversion: 2.1 time: 0.271032 Aug 23 18:34:59.651434 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3297/6731] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:34:59 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1465 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:00.671038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1bf2c86a-cae5-487b-ae10-03e8f9ea6507 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:00.671668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1bf2c86a-cae5-487b-ae10-03e8f9ea6507 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:00.674731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:00.675611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:00.704591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bf2c86a-cae5-487b-ae10-03e8f9ea6507 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:00.705019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bf2c86a-cae5-487b-ae10-03e8f9ea6507 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:00.705476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bf2c86a-cae5-487b-ae10-03e8f9ea6507 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:00.706217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bf2c86a-cae5-487b-ae10-03e8f9ea6507 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:00.706721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bf2c86a-cae5-487b-ae10-03e8f9ea6507 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:00.707163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bf2c86a-cae5-487b-ae10-03e8f9ea6507 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:00.918663 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1bf2c86a-cae5-487b-ae10-03e8f9ea6507 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1465 microversion: 2.1 time: 0.250921 Aug 23 18:35:00.919259 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3435/6732] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:00 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1465 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:01.917503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ebc955d5-5201-473c-abe4-4c59bf52ba54 req-5e820f52-0eaf-4082-b7d7-02fa8c3ee579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e7f72d-3d56-490a-a96b-5e11089d692f", "name": "network-vif-plugged", "status": "completed", "tag": "0c3d18ab-7e1c-4397-8cc4-7e2c2da63c41"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:35:01.941555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0dc5b0d3-3e99-4a1a-9a6f-a84858472ac1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:01.943206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0dc5b0d3-3e99-4a1a-9a6f-a84858472ac1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:01.958630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:01.959339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0dc5b0d3-3e99-4a1a-9a6f-a84858472ac1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:01.960960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0dc5b0d3-3e99-4a1a-9a6f-a84858472ac1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:01.962734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0dc5b0d3-3e99-4a1a-9a6f-a84858472ac1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:01.964378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ebc955d5-5201-473c-abe4-4c59bf52ba54 req-5e820f52-0eaf-4082-b7d7-02fa8c3ee579 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:01.964862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0dc5b0d3-3e99-4a1a-9a6f-a84858472ac1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:01.966312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0dc5b0d3-3e99-4a1a-9a6f-a84858472ac1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:01.966873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0dc5b0d3-3e99-4a1a-9a6f-a84858472ac1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:01.967183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ebc955d5-5201-473c-abe4-4c59bf52ba54 req-5e820f52-0eaf-4082-b7d7-02fa8c3ee579 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:01.967709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ebc955d5-5201-473c-abe4-4c59bf52ba54 req-5e820f52-0eaf-4082-b7d7-02fa8c3ee579 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:02.001410 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ebc955d5-5201-473c-abe4-4c59bf52ba54 req-5e820f52-0eaf-4082-b7d7-02fa8c3ee579 service nova] Creating event network-vif-plugged:0c3d18ab-7e1c-4397-8cc4-7e2c2da63c41 for instance 70e7f72d-3d56-490a-a96b-5e11089d692f on n-h1-850468-16 Aug 23 18:35:02.022940 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ebc955d5-5201-473c-abe4-4c59bf52ba54 req-5e820f52-0eaf-4082-b7d7-02fa8c3ee579 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111676 Aug 23 18:35:02.026013 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3298/6733] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:35:02.289341 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0dc5b0d3-3e99-4a1a-9a6f-a84858472ac1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1465 microversion: 2.1 time: 0.351736 Aug 23 18:35:02.290013 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3436/6734] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:01 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1465 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:03.314929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1f08a00-f7fc-4841-8aa3-e6ba4afa6c84 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:03.316560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d1f08a00-f7fc-4841-8aa3-e6ba4afa6c84 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:03.328948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f08a00-f7fc-4841-8aa3-e6ba4afa6c84 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:03.331377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f08a00-f7fc-4841-8aa3-e6ba4afa6c84 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:03.331827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f08a00-f7fc-4841-8aa3-e6ba4afa6c84 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:03.333247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f08a00-f7fc-4841-8aa3-e6ba4afa6c84 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:03.333686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f08a00-f7fc-4841-8aa3-e6ba4afa6c84 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:03.334113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1f08a00-f7fc-4841-8aa3-e6ba4afa6c84 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:03.508523 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d1f08a00-f7fc-4841-8aa3-e6ba4afa6c84 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1465 microversion: 2.1 time: 0.200907 Aug 23 18:35:03.509421 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3299/6735] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:03 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1465 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:03.602140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1344986091", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6a226d88-c21d-47c5-92ba-5734adfde406", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b72a85dc-9cf5-4dba-9938-31cafa49248b"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:35:03.712974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] validate_networks() for [('b72a85dc-9cf5-4dba-9938-31cafa49248b', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:35:04.142231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:35:04.142714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:35:04.143201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:35:04.143616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:35:04.144075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:35:04.155747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:04.156542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:04.157191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:04.157923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:04.158393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:04.158852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:04.170040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:04.181763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:35:04.187476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for user c77b0208b95843d6a5dac5c4a1ac3d8a and project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:35:04.256457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:35:04.258489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6a226d88-c21d-47c5-92ba-5734adfde406',volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:35:04.422467 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3073dfb5-87c6-4444-8c12-5cfa7b9ad7ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.825610 Aug 23 18:35:04.423435 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3437/6736] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:35:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:35:04.436128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e3d7fb37-0c37-44dd-8428-a7e756209770 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:04.436750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e3d7fb37-0c37-44dd-8428-a7e756209770 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:04.506843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e3d7fb37-0c37-44dd-8428-a7e756209770 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:04.515970 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e3d7fb37-0c37-44dd-8428-a7e756209770 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1057 microversion: 2.1 time: 0.084059 Aug 23 18:35:04.530251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d26f9ffe-5496-4058-9946-a5b97fe37821 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:04.530798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d26f9ffe-5496-4058-9946-a5b97fe37821 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:04.531456 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3300/6737] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:04 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1057 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:04.539293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d26f9ffe-5496-4058-9946-a5b97fe37821 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:04.539955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d26f9ffe-5496-4058-9946-a5b97fe37821 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:04.540510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d26f9ffe-5496-4058-9946-a5b97fe37821 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:04.541807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d26f9ffe-5496-4058-9946-a5b97fe37821 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:04.542479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d26f9ffe-5496-4058-9946-a5b97fe37821 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:04.543041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d26f9ffe-5496-4058-9946-a5b97fe37821 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:04.736874 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d26f9ffe-5496-4058-9946-a5b97fe37821 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1649 microversion: 2.1 time: 0.210671 Aug 23 18:35:04.737822 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3438/6738] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:04 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1649 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:04.758939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1a830f59-1727-4384-ada2-9bf2cb2dbfb8 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:04.759562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1a830f59-1727-4384-ada2-9bf2cb2dbfb8 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:04.767787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a830f59-1727-4384-ada2-9bf2cb2dbfb8 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:04.768286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a830f59-1727-4384-ada2-9bf2cb2dbfb8 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:04.769663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a830f59-1727-4384-ada2-9bf2cb2dbfb8 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:04.771177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a830f59-1727-4384-ada2-9bf2cb2dbfb8 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:04.771652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a830f59-1727-4384-ada2-9bf2cb2dbfb8 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:04.772091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a830f59-1727-4384-ada2-9bf2cb2dbfb8 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:04.937176 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1a830f59-1727-4384-ada2-9bf2cb2dbfb8 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1649 microversion: 2.1 time: 0.182502 Aug 23 18:35:04.937771 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3301/6739] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:04 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1649 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:04.959117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-088fbe2e-c095-4fb3-9b52-e3f2b86773d4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:04.960858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-088fbe2e-c095-4fb3-9b52-e3f2b86773d4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:04.969047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-088fbe2e-c095-4fb3-9b52-e3f2b86773d4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:04.969638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-088fbe2e-c095-4fb3-9b52-e3f2b86773d4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:04.970180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-088fbe2e-c095-4fb3-9b52-e3f2b86773d4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:04.971068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-088fbe2e-c095-4fb3-9b52-e3f2b86773d4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:04.971774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-088fbe2e-c095-4fb3-9b52-e3f2b86773d4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:04.972262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-088fbe2e-c095-4fb3-9b52-e3f2b86773d4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:05.178275 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-088fbe2e-c095-4fb3-9b52-e3f2b86773d4 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1649 microversion: 2.1 time: 0.223900 Aug 23 18:35:05.179426 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3439/6740] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:04 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1649 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:05.199825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-20bd98c7-74f8-4309-95c0-c8adfe31d48f tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:05.200559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-20bd98c7-74f8-4309-95c0-c8adfe31d48f tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:05.209447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20bd98c7-74f8-4309-95c0-c8adfe31d48f tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:05.210237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20bd98c7-74f8-4309-95c0-c8adfe31d48f tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:05.210923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20bd98c7-74f8-4309-95c0-c8adfe31d48f tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:05.211950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20bd98c7-74f8-4309-95c0-c8adfe31d48f tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:05.212498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20bd98c7-74f8-4309-95c0-c8adfe31d48f tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:05.212992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20bd98c7-74f8-4309-95c0-c8adfe31d48f tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:05.257286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-20bd98c7-74f8-4309-95c0-c8adfe31d48f tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:35:05.409440 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-20bd98c7-74f8-4309-95c0-c8adfe31d48f tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "DELETE /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 204 len: 0 microversion: 2.1 time: 0.213198 Aug 23 18:35:05.410295 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3302/6741] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:35:05 2022] DELETE /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:35:05.419869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-57103036-2a3c-4711-b4be-8ef46fa9529c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:05.420497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-57103036-2a3c-4711-b4be-8ef46fa9529c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:05.427861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57103036-2a3c-4711-b4be-8ef46fa9529c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:05.428633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57103036-2a3c-4711-b4be-8ef46fa9529c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:05.429082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57103036-2a3c-4711-b4be-8ef46fa9529c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:05.429811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57103036-2a3c-4711-b4be-8ef46fa9529c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:05.430278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57103036-2a3c-4711-b4be-8ef46fa9529c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:05.430746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57103036-2a3c-4711-b4be-8ef46fa9529c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:05.539387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-15ae17cd-456d-43af-adb4-89d5724b325a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:05.541858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-15ae17cd-456d-43af-adb4-89d5724b325a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:05.550802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15ae17cd-456d-43af-adb4-89d5724b325a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:05.552666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15ae17cd-456d-43af-adb4-89d5724b325a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:05.553401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15ae17cd-456d-43af-adb4-89d5724b325a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:05.554685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15ae17cd-456d-43af-adb4-89d5724b325a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:05.555371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15ae17cd-456d-43af-adb4-89d5724b325a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:05.556113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-15ae17cd-456d-43af-adb4-89d5724b325a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:05.581468 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-57103036-2a3c-4711-b4be-8ef46fa9529c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1655 microversion: 2.1 time: 0.166021 Aug 23 18:35:05.595342 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3440/6742] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:05 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1655 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:05.642720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-15ae17cd-456d-43af-adb4-89d5724b325a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:05.652653 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-15ae17cd-456d-43af-adb4-89d5724b325a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1155 microversion: 2.1 time: 0.118971 Aug 23 18:35:05.653545 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3303/6743] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:05 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1155 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:06.605169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ab3be7d-02e3-41dc-9539-570a1c3ed1e6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:06.605782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8ab3be7d-02e3-41dc-9539-570a1c3ed1e6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:06.612521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ab3be7d-02e3-41dc-9539-570a1c3ed1e6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:06.613199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ab3be7d-02e3-41dc-9539-570a1c3ed1e6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:06.614568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ab3be7d-02e3-41dc-9539-570a1c3ed1e6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:06.615447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ab3be7d-02e3-41dc-9539-570a1c3ed1e6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:06.616108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ab3be7d-02e3-41dc-9539-570a1c3ed1e6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:06.616734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ab3be7d-02e3-41dc-9539-570a1c3ed1e6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:06.674399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6efce28f-df9a-4dc0-8f57-62aa0c933012 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:06.675238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6efce28f-df9a-4dc0-8f57-62aa0c933012 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:06.682661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6efce28f-df9a-4dc0-8f57-62aa0c933012 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:06.683156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6efce28f-df9a-4dc0-8f57-62aa0c933012 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:06.683595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6efce28f-df9a-4dc0-8f57-62aa0c933012 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:06.684304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6efce28f-df9a-4dc0-8f57-62aa0c933012 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:06.684758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6efce28f-df9a-4dc0-8f57-62aa0c933012 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:06.685212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6efce28f-df9a-4dc0-8f57-62aa0c933012 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:06.700811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:06.758051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6efce28f-df9a-4dc0-8f57-62aa0c933012 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:06.767454 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8ab3be7d-02e3-41dc-9539-570a1c3ed1e6 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1655 microversion: 2.1 time: 0.165153 Aug 23 18:35:06.768416 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3441/6744] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:06 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1655 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:06.774281 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6efce28f-df9a-4dc0-8f57-62aa0c933012 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1155 microversion: 2.1 time: 0.103161 Aug 23 18:35:06.777912 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3304/6745] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:06 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1155 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:35:07.800506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0bc71d04-d52d-4a39-8d49-231e35d3ab76 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:07.803887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0bc71d04-d52d-4a39-8d49-231e35d3ab76 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:07.805113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d6043dd3-6119-47f0-b821-e54bcf862699 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:07.805741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d6043dd3-6119-47f0-b821-e54bcf862699 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:07.820013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6043dd3-6119-47f0-b821-e54bcf862699 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:07.825956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6043dd3-6119-47f0-b821-e54bcf862699 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:07.826700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6043dd3-6119-47f0-b821-e54bcf862699 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:07.827616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6043dd3-6119-47f0-b821-e54bcf862699 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:07.828248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6043dd3-6119-47f0-b821-e54bcf862699 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:07.828875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6043dd3-6119-47f0-b821-e54bcf862699 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:07.836746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bc71d04-d52d-4a39-8d49-231e35d3ab76 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:07.837261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bc71d04-d52d-4a39-8d49-231e35d3ab76 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:07.837716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bc71d04-d52d-4a39-8d49-231e35d3ab76 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:07.838454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bc71d04-d52d-4a39-8d49-231e35d3ab76 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:07.846654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bc71d04-d52d-4a39-8d49-231e35d3ab76 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:07.847331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0bc71d04-d52d-4a39-8d49-231e35d3ab76 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:07.991409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d6043dd3-6119-47f0-b821-e54bcf862699 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:08.004490 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d6043dd3-6119-47f0-b821-e54bcf862699 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1173 microversion: 2.1 time: 0.203100 Aug 23 18:35:08.006264 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3305/6746] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:07 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1173 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:08.011069 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0bc71d04-d52d-4a39-8d49-231e35d3ab76 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 200 len: 1613 microversion: 2.1 time: 0.223533 Aug 23 18:35:08.013990 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3442/6747] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:07 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 1613 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:08.017511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-83009693-df2a-4770-a6cd-580785012d82 req-15198c41-841d-46a0-9607-ed321d1233b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70e7f72d-3d56-490a-a96b-5e11089d692f", "name": "network-vif-deleted", "tag": "0c3d18ab-7e1c-4397-8cc4-7e2c2da63c41"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:35:08.042159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-83009693-df2a-4770-a6cd-580785012d82 req-15198c41-841d-46a0-9607-ed321d1233b0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:08.042941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-83009693-df2a-4770-a6cd-580785012d82 req-15198c41-841d-46a0-9607-ed321d1233b0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:08.043546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-83009693-df2a-4770-a6cd-580785012d82 req-15198c41-841d-46a0-9607-ed321d1233b0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:08.071614 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-83009693-df2a-4770-a6cd-580785012d82 req-15198c41-841d-46a0-9607-ed321d1233b0 service nova] Creating event network-vif-deleted:0c3d18ab-7e1c-4397-8cc4-7e2c2da63c41 for instance 70e7f72d-3d56-490a-a96b-5e11089d692f on n-h1-850468-16 Aug 23 18:35:08.088076 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-83009693-df2a-4770-a6cd-580785012d82 req-15198c41-841d-46a0-9607-ed321d1233b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080211 Aug 23 18:35:08.088685 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3306/6748] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:35:09.026436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5238d549-e33a-43fe-ac46-e33e1967e925 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:09.027074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5238d549-e33a-43fe-ac46-e33e1967e925 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:09.035615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56dee25a-2e7d-4458-a01d-fffb8f71f94c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:09.037702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-56dee25a-2e7d-4458-a01d-fffb8f71f94c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: 70e7f72d-3d56-490a-a96b-5e11089d692f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:09.048088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5238d549-e33a-43fe-ac46-e33e1967e925 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:09.049042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5238d549-e33a-43fe-ac46-e33e1967e925 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:09.049523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5238d549-e33a-43fe-ac46-e33e1967e925 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:09.050210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5238d549-e33a-43fe-ac46-e33e1967e925 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:09.052504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56dee25a-2e7d-4458-a01d-fffb8f71f94c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:09.052987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56dee25a-2e7d-4458-a01d-fffb8f71f94c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:09.053599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56dee25a-2e7d-4458-a01d-fffb8f71f94c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:09.054280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5238d549-e33a-43fe-ac46-e33e1967e925 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:09.055218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56dee25a-2e7d-4458-a01d-fffb8f71f94c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:09.055661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56dee25a-2e7d-4458-a01d-fffb8f71f94c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:09.056092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56dee25a-2e7d-4458-a01d-fffb8f71f94c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:09.057080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5238d549-e33a-43fe-ac46-e33e1967e925 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:09.084609 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-56dee25a-2e7d-4458-a01d-fffb8f71f94c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] HTTP exception thrown: Instance 70e7f72d-3d56-490a-a96b-5e11089d692f could not be found. Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56dee25a-2e7d-4458-a01d-fffb8f71f94c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Request method failure captured: Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f HTTP/1.1 Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBR25l31a2l7NLH4isoZ7A72E2fqQRVsgAHJSQBxUJdrQSYWwRiH9kEAbuNbHX7sRZm8C-EimSRr725daieOWMtAc_1DgZZ3YAIHKeS4EuHYliz4AS9_mE61AJ9QAPPT2W-iXSy6An1BM-zZkS8VdHFsTaiEt6RQlSIfPyE20uCP4S2M Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 12058021b147406984f24aac5b82d435 Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestServerMultinode-456754752 Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_12058021b147406984f24aac5b82d435"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/12058021b147406984f24aac5b82d435"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/12058021b147406984f24aac5b82d435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/12058021b147406984f24aac5b82d435"}]}] Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestServerMultinode-456754752 Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 12058021b147406984f24aac5b82d435 Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestServerMultinode-456754752 Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestServerMultinode-456754752-project-admin Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 9fa4b50d4b8c4bc9b9b74377b790e0c4 Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestServerMultinode-456754752-project-admin Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 70e7f72d-3d56-490a-a96b-5e11089d692f could not be found. Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '70e7f72d-3d56-490a-a96b-5e11089d692f'} Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70e7f72d-3d56-490a-a96b-5e11089d692f could not be found. Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70e7f72d-3d56-490a-a96b-5e11089d692f could not be found. Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:35:09.086371 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:35:09.093895 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:35:09.093895 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:35:09.093895 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:35:09.093895 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:35:09.093895 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:35:09.093895 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70e7f72d-3d56-490a-a96b-5e11089d692f could not be found. Aug 23 18:35:09.093895 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:35:09.093895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56dee25a-2e7d-4458-a01d-fffb8f71f94c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Returning 404 to user: Instance 70e7f72d-3d56-490a-a96b-5e11089d692f could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:35:09.093895 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-56dee25a-2e7d-4458-a01d-fffb8f71f94c tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f" status: 404 len: 111 microversion: 2.1 time: 0.056209 Aug 23 18:35:09.093895 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3307/6749] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:09 2022] GET /compute/v2.1/servers/70e7f72d-3d56-490a-a96b-5e11089d692f => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:35:09.098369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e50dba48-d848-4057-bd8c-850aee537a03 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:09.099149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e50dba48-d848-4057-bd8c-850aee537a03 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:09.105888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e50dba48-d848-4057-bd8c-850aee537a03 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:09.106598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e50dba48-d848-4057-bd8c-850aee537a03 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:09.107192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e50dba48-d848-4057-bd8c-850aee537a03 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:09.108381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e50dba48-d848-4057-bd8c-850aee537a03 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:09.108832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e50dba48-d848-4057-bd8c-850aee537a03 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:09.109251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e50dba48-d848-4057-bd8c-850aee537a03 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:09.136580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e50dba48-d848-4057-bd8c-850aee537a03 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:35:09.271845 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e50dba48-d848-4057-bd8c-850aee537a03 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "DELETE /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 204 len: 0 microversion: 2.1 time: 0.176186 Aug 23 18:35:09.272660 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3308/6750] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:35:09 2022] DELETE /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:35:09.278523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5238d549-e33a-43fe-ac46-e33e1967e925 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:09.288051 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5238d549-e33a-43fe-ac46-e33e1967e925 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1215 microversion: 2.1 time: 0.265894 Aug 23 18:35:09.288645 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3443/6751] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:09 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1215 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:09.299439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3ba6d1ee-de71-49d5-af80-3127a42a47b1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:09.300428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3ba6d1ee-de71-49d5-af80-3127a42a47b1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:09.307627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ba6d1ee-de71-49d5-af80-3127a42a47b1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:09.308132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ba6d1ee-de71-49d5-af80-3127a42a47b1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:09.308574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ba6d1ee-de71-49d5-af80-3127a42a47b1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:09.309286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ba6d1ee-de71-49d5-af80-3127a42a47b1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:09.309742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ba6d1ee-de71-49d5-af80-3127a42a47b1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:09.310174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ba6d1ee-de71-49d5-af80-3127a42a47b1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:09.608603 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3ba6d1ee-de71-49d5-af80-3127a42a47b1 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1656 microversion: 2.1 time: 0.317084 Aug 23 18:35:09.609573 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3309/6752] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:09 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1656 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:10.108421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-890a261d-0636-47df-bd1c-8d8f88142c2e req-77340e37-6877-4135-ac1b-96f54d7294a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1546b865-ec3b-4ae6-824f-5567720d3926", "tag": "3d57b6df-cd3a-41c0-8990-9a26329c1e43"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:35:10.121049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-890a261d-0636-47df-bd1c-8d8f88142c2e req-77340e37-6877-4135-ac1b-96f54d7294a7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:10.121599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-890a261d-0636-47df-bd1c-8d8f88142c2e req-77340e37-6877-4135-ac1b-96f54d7294a7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:10.121989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-890a261d-0636-47df-bd1c-8d8f88142c2e req-77340e37-6877-4135-ac1b-96f54d7294a7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:10.134591 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-890a261d-0636-47df-bd1c-8d8f88142c2e req-77340e37-6877-4135-ac1b-96f54d7294a7 service nova] Creating event network-changed:3d57b6df-cd3a-41c0-8990-9a26329c1e43 for instance 1546b865-ec3b-4ae6-824f-5567720d3926 on n-h1-850468-16 Aug 23 18:35:10.139838 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-890a261d-0636-47df-bd1c-8d8f88142c2e req-77340e37-6877-4135-ac1b-96f54d7294a7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035858 Aug 23 18:35:10.140692 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3444/6753] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:35:10.316050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3d8a01c2-89d4-48ed-8316-aab29c7ddb60 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:10.318862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3d8a01c2-89d4-48ed-8316-aab29c7ddb60 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:10.339080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d8a01c2-89d4-48ed-8316-aab29c7ddb60 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:10.339876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d8a01c2-89d4-48ed-8316-aab29c7ddb60 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:10.340895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d8a01c2-89d4-48ed-8316-aab29c7ddb60 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:10.342090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d8a01c2-89d4-48ed-8316-aab29c7ddb60 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:10.342939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d8a01c2-89d4-48ed-8316-aab29c7ddb60 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:10.343855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3d8a01c2-89d4-48ed-8316-aab29c7ddb60 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:10.639806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e7d5aa62-a805-46b6-a155-f510b9d510d5 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:10.640804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e7d5aa62-a805-46b6-a155-f510b9d510d5 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:10.652293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7d5aa62-a805-46b6-a155-f510b9d510d5 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:10.653155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7d5aa62-a805-46b6-a155-f510b9d510d5 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:10.653821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7d5aa62-a805-46b6-a155-f510b9d510d5 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:10.654831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7d5aa62-a805-46b6-a155-f510b9d510d5 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:10.655672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7d5aa62-a805-46b6-a155-f510b9d510d5 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:10.656328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7d5aa62-a805-46b6-a155-f510b9d510d5 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:10.808858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3d8a01c2-89d4-48ed-8316-aab29c7ddb60 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:10.817597 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3d8a01c2-89d4-48ed-8316-aab29c7ddb60 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1215 microversion: 2.1 time: 0.510934 Aug 23 18:35:10.818311 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3310/6754] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:10 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1215 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:10.885430 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e7d5aa62-a805-46b6-a155-f510b9d510d5 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1656 microversion: 2.1 time: 0.250824 Aug 23 18:35:10.886026 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3445/6755] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:10 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1656 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:35:11.497825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-368028fb-7bd3-46ff-b08d-d277cde096c0 req-27a78f32-ac08-4d5c-b030-8de6e6985587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1", "name": "network-vif-deleted", "tag": "4e84bde4-2b04-4af8-96f0-c4455224bf0e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:35:11.513278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-368028fb-7bd3-46ff-b08d-d277cde096c0 req-27a78f32-ac08-4d5c-b030-8de6e6985587 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:11.514048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-368028fb-7bd3-46ff-b08d-d277cde096c0 req-27a78f32-ac08-4d5c-b030-8de6e6985587 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:11.514728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-368028fb-7bd3-46ff-b08d-d277cde096c0 req-27a78f32-ac08-4d5c-b030-8de6e6985587 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:11.530151 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-368028fb-7bd3-46ff-b08d-d277cde096c0 req-27a78f32-ac08-4d5c-b030-8de6e6985587 service nova] Creating event network-vif-deleted:4e84bde4-2b04-4af8-96f0-c4455224bf0e for instance c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 on n-h2-850468-16 Aug 23 18:35:11.537501 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-368028fb-7bd3-46ff-b08d-d277cde096c0 req-27a78f32-ac08-4d5c-b030-8de6e6985587 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044143 Aug 23 18:35:11.538833 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3311/6756] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:35:11.846182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bf511fa6-4d32-430c-93b6-28e29b5b9920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:11.846959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bf511fa6-4d32-430c-93b6-28e29b5b9920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:11.856218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf511fa6-4d32-430c-93b6-28e29b5b9920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:11.856860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf511fa6-4d32-430c-93b6-28e29b5b9920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:11.857438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf511fa6-4d32-430c-93b6-28e29b5b9920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:11.858264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf511fa6-4d32-430c-93b6-28e29b5b9920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:11.858984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf511fa6-4d32-430c-93b6-28e29b5b9920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:11.859526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf511fa6-4d32-430c-93b6-28e29b5b9920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:11.912952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:11.913683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:11.920407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:11.920907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:11.921353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:11.922231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:11.922965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:11.923437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:11.981694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:11.982400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:11.982971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:11.983402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lazy-loading 'fault' on Instance uuid c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:35:12.030104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bf511fa6-4d32-430c-93b6-28e29b5b9920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:12.040399 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bf511fa6-4d32-430c-93b6-28e29b5b9920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1215 microversion: 2.1 time: 0.199459 Aug 23 18:35:12.040597 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d9538b4a-7893-4290-a5ab-f4e8c4415d3b tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 200 len: 1456 microversion: 2.1 time: 0.135399 Aug 23 18:35:12.041657 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3312/6757] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:11 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 1456 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:12.054870 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3446/6758] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:11 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1215 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:13.061352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-39db06d8-540d-4425-9049-e01ce81d5f51 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:13.061988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-39db06d8-540d-4425-9049-e01ce81d5f51 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:13.062385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c30d605e-a702-4017-8da2-199bbacec099 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:13.064109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c30d605e-a702-4017-8da2-199bbacec099 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] [instance: c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:13.072493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39db06d8-540d-4425-9049-e01ce81d5f51 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:13.072493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39db06d8-540d-4425-9049-e01ce81d5f51 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:13.072493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39db06d8-540d-4425-9049-e01ce81d5f51 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:13.072775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39db06d8-540d-4425-9049-e01ce81d5f51 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:13.072857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c30d605e-a702-4017-8da2-199bbacec099 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:13.073031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39db06d8-540d-4425-9049-e01ce81d5f51 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:13.073250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c30d605e-a702-4017-8da2-199bbacec099 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:13.073651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39db06d8-540d-4425-9049-e01ce81d5f51 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:13.073763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c30d605e-a702-4017-8da2-199bbacec099 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:13.074983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c30d605e-a702-4017-8da2-199bbacec099 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:13.075568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c30d605e-a702-4017-8da2-199bbacec099 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:13.075714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c30d605e-a702-4017-8da2-199bbacec099 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:13.091904 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-c30d605e-a702-4017-8da2-199bbacec099 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] HTTP exception thrown: Instance c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 could not be found. Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c30d605e-a702-4017-8da2-199bbacec099 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Request method failure captured: Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 HTTP/1.1 Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBR25l31a2l7NLH4isoZ7A72E2fqQRVsgAHJSQBxUJdrQSYWwRiH9kEAbuNbHX7sRZm8C-EimSRr725daieOWMtAc_1DgZZ3YAIHKeS4EuHYliz4AS9_mE61AJ9QAPPT2W-iXSy6An1BM-zZkS8VdHFsTaiEt6RQlSIfPyE20uCP4S2M Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 12058021b147406984f24aac5b82d435 Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestServerMultinode-456754752 Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_12058021b147406984f24aac5b82d435"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/12058021b147406984f24aac5b82d435"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/12058021b147406984f24aac5b82d435"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/12058021b147406984f24aac5b82d435"}]}] Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestServerMultinode-456754752 Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 12058021b147406984f24aac5b82d435 Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestServerMultinode-456754752 Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestServerMultinode-456754752-project-admin Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 9fa4b50d4b8c4bc9b9b74377b790e0c4 Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestServerMultinode-456754752-project-admin Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 could not be found. Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1'} Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 could not be found. Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 could not be found. Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:35:13.093595 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:35:13.099622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:35:13.099622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:35:13.099622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:35:13.099622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:35:13.099622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:35:13.099622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 could not be found. Aug 23 18:35:13.099622 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:35:13.099622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c30d605e-a702-4017-8da2-199bbacec099 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] Returning 404 to user: Instance c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:35:13.099622 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c30d605e-a702-4017-8da2-199bbacec099 tempest-TestServerMultinode-456754752 tempest-TestServerMultinode-456754752-project-admin] 10.222.0.61 "GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1" status: 404 len: 111 microversion: 2.1 time: 0.037436 Aug 23 18:35:13.099622 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3447/6759] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:13 2022] GET /compute/v2.1/servers/c8ab9ce6-1ff0-4e46-93c9-9aead3817bd1 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:35:13.384180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-39db06d8-540d-4425-9049-e01ce81d5f51 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:13.392833 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-39db06d8-540d-4425-9049-e01ce81d5f51 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1203 microversion: 2.1 time: 0.335464 Aug 23 18:35:13.393559 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3313/6760] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:13 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1203 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:13.800961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "126e0038-c91e-4894-b027-98e76f88a186"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:35:13.804031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:13.810264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:13.810798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:13.811257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:13.811978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:13.812454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:13.812891 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:13.918477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:35:13.919008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:35:13.919716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:35:13.920140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:35:13.920568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:35:13.991378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:13.998103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:13.999053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:13.999991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:14.000967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:14.001664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:14.002328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:14.034640 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5aa262f8-c865-4286-ac7f-b2eca0ce3878 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad/action" status: 202 len: 1138 microversion: 2.1 time: 0.237621 Aug 23 18:35:14.035468 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3448/6761] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:35:13 2022] POST /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad/action => generated 1138 bytes in 239 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Aug 23 18:35:14.054345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-04c02f14-63a1-460a-83b0-188b65320647 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:14.055365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-04c02f14-63a1-460a-83b0-188b65320647 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:14.062310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04c02f14-63a1-460a-83b0-188b65320647 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:14.063745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04c02f14-63a1-460a-83b0-188b65320647 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:14.064452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04c02f14-63a1-460a-83b0-188b65320647 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:14.065426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04c02f14-63a1-460a-83b0-188b65320647 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:14.066107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04c02f14-63a1-460a-83b0-188b65320647 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:14.067921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-04c02f14-63a1-460a-83b0-188b65320647 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:14.300855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-04c02f14-63a1-460a-83b0-188b65320647 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:14.319317 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-04c02f14-63a1-460a-83b0-188b65320647 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.269583 Aug 23 18:35:14.330762 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3314/6762] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:14 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:14.415179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-31f14c14-3542-41cc-a2af-19f3842217f0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:14.415925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-31f14c14-3542-41cc-a2af-19f3842217f0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:14.426787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:14.432572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:14.435464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31f14c14-3542-41cc-a2af-19f3842217f0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:14.436511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31f14c14-3542-41cc-a2af-19f3842217f0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:14.436965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31f14c14-3542-41cc-a2af-19f3842217f0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:14.437702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31f14c14-3542-41cc-a2af-19f3842217f0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:14.438162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31f14c14-3542-41cc-a2af-19f3842217f0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:14.439512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31f14c14-3542-41cc-a2af-19f3842217f0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:14.641524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-31f14c14-3542-41cc-a2af-19f3842217f0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:14.651588 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-31f14c14-3542-41cc-a2af-19f3842217f0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1203 microversion: 2.1 time: 0.241619 Aug 23 18:35:14.652195 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3449/6763] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:14 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1203 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:15.343252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3998d759-84e1-4396-aed4-b6d8f24d6f09 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:15.344961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3998d759-84e1-4396-aed4-b6d8f24d6f09 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:15.349625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:15.356181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3998d759-84e1-4396-aed4-b6d8f24d6f09 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:15.356905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3998d759-84e1-4396-aed4-b6d8f24d6f09 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:15.357542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3998d759-84e1-4396-aed4-b6d8f24d6f09 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:15.358865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3998d759-84e1-4396-aed4-b6d8f24d6f09 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:15.359602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3998d759-84e1-4396-aed4-b6d8f24d6f09 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:15.360284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3998d759-84e1-4396-aed4-b6d8f24d6f09 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:15.679338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93c9a69c-95b1-4947-8da9-8d824376ea35 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:15.680802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-93c9a69c-95b1-4947-8da9-8d824376ea35 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:15.691548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93c9a69c-95b1-4947-8da9-8d824376ea35 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:15.693157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93c9a69c-95b1-4947-8da9-8d824376ea35 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:15.693928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93c9a69c-95b1-4947-8da9-8d824376ea35 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:15.695508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93c9a69c-95b1-4947-8da9-8d824376ea35 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:15.696432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93c9a69c-95b1-4947-8da9-8d824376ea35 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:15.697133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93c9a69c-95b1-4947-8da9-8d824376ea35 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:15.728799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3998d759-84e1-4396-aed4-b6d8f24d6f09 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:15.751246 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3998d759-84e1-4396-aed4-b6d8f24d6f09 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.412102 Aug 23 18:35:15.752234 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3315/6764] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:15 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:16.009517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93c9a69c-95b1-4947-8da9-8d824376ea35 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:16.018796 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93c9a69c-95b1-4947-8da9-8d824376ea35 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1203 microversion: 2.1 time: 0.346974 Aug 23 18:35:16.020585 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3450/6765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:15 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1203 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:35:16.776998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b3a8f930-880e-40a7-94f3-13337085773e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:16.777736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b3a8f930-880e-40a7-94f3-13337085773e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:16.779916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:16.785683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3a8f930-880e-40a7-94f3-13337085773e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:16.786229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3a8f930-880e-40a7-94f3-13337085773e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:16.786900 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3a8f930-880e-40a7-94f3-13337085773e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:16.788430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3a8f930-880e-40a7-94f3-13337085773e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:16.797173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3a8f930-880e-40a7-94f3-13337085773e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:16.797640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b3a8f930-880e-40a7-94f3-13337085773e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:17.042495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d95b59a3-b87b-49cd-bf3e-5a27f14ecef1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:17.043263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d95b59a3-b87b-49cd-bf3e-5a27f14ecef1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:17.050578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95b59a3-b87b-49cd-bf3e-5a27f14ecef1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:17.051904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95b59a3-b87b-49cd-bf3e-5a27f14ecef1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:17.052521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95b59a3-b87b-49cd-bf3e-5a27f14ecef1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:17.053536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95b59a3-b87b-49cd-bf3e-5a27f14ecef1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:17.054175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95b59a3-b87b-49cd-bf3e-5a27f14ecef1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:17.055028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95b59a3-b87b-49cd-bf3e-5a27f14ecef1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:17.310955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b3a8f930-880e-40a7-94f3-13337085773e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:17.322398 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b3a8f930-880e-40a7-94f3-13337085773e tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.552822 Aug 23 18:35:17.323043 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3316/6766] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:16 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:17.687328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d95b59a3-b87b-49cd-bf3e-5a27f14ecef1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:17.697313 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d95b59a3-b87b-49cd-bf3e-5a27f14ecef1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1203 microversion: 2.1 time: 0.659569 Aug 23 18:35:17.698634 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3451/6767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:17 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1203 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:35:18.344584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5520478-8e57-449d-8d9f-ce351a09c918 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:18.345213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a5520478-8e57-449d-8d9f-ce351a09c918 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:18.352653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5520478-8e57-449d-8d9f-ce351a09c918 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:18.353146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5520478-8e57-449d-8d9f-ce351a09c918 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:18.353590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5520478-8e57-449d-8d9f-ce351a09c918 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:18.354304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5520478-8e57-449d-8d9f-ce351a09c918 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:18.354793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5520478-8e57-449d-8d9f-ce351a09c918 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:18.355223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5520478-8e57-449d-8d9f-ce351a09c918 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:18.583444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a5520478-8e57-449d-8d9f-ce351a09c918 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:18.609874 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a5520478-8e57-449d-8d9f-ce351a09c918 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.269058 Aug 23 18:35:18.610960 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3317/6768] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:18 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:18.719460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c8d13fbc-221e-44e4-93e8-159c656968de tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:18.720316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c8d13fbc-221e-44e4-93e8-159c656968de tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:18.724562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:18.729115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8d13fbc-221e-44e4-93e8-159c656968de tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:18.729556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8d13fbc-221e-44e4-93e8-159c656968de tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:18.730179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8d13fbc-221e-44e4-93e8-159c656968de tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:18.731100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8d13fbc-221e-44e4-93e8-159c656968de tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:18.731594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8d13fbc-221e-44e4-93e8-159c656968de tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:18.731986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c8d13fbc-221e-44e4-93e8-159c656968de tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:18.962235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c8d13fbc-221e-44e4-93e8-159c656968de tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:18.971107 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c8d13fbc-221e-44e4-93e8-159c656968de tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1203 microversion: 2.1 time: 0.255866 Aug 23 18:35:18.971774 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3452/6769] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:18 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1203 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:19.633589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-27372e87-9af6-47ac-af03-581569412160 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:19.634988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-27372e87-9af6-47ac-af03-581569412160 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:19.643119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27372e87-9af6-47ac-af03-581569412160 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:19.643611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27372e87-9af6-47ac-af03-581569412160 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:19.645555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27372e87-9af6-47ac-af03-581569412160 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:19.646482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27372e87-9af6-47ac-af03-581569412160 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:19.647131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27372e87-9af6-47ac-af03-581569412160 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:19.647725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27372e87-9af6-47ac-af03-581569412160 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:19.893520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-27372e87-9af6-47ac-af03-581569412160 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:19.902557 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-27372e87-9af6-47ac-af03-581569412160 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.273851 Aug 23 18:35:19.903537 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3318/6770] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:19 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:19.994527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b53faa7a-720a-45ca-8d6f-aa1b0a6ba51e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:19.995808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b53faa7a-720a-45ca-8d6f-aa1b0a6ba51e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:20.004888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b53faa7a-720a-45ca-8d6f-aa1b0a6ba51e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:20.005546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b53faa7a-720a-45ca-8d6f-aa1b0a6ba51e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:20.006185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b53faa7a-720a-45ca-8d6f-aa1b0a6ba51e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:20.006942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b53faa7a-720a-45ca-8d6f-aa1b0a6ba51e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:20.007421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b53faa7a-720a-45ca-8d6f-aa1b0a6ba51e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:20.007840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b53faa7a-720a-45ca-8d6f-aa1b0a6ba51e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:20.186102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b53faa7a-720a-45ca-8d6f-aa1b0a6ba51e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:20.188826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:20.200783 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b53faa7a-720a-45ca-8d6f-aa1b0a6ba51e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1203 microversion: 2.1 time: 0.211303 Aug 23 18:35:20.201389 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3453/6771] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:19 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1203 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:20.925038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c7913b6-eff7-4e4f-9554-d1ed71659e1b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:20.927427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c7913b6-eff7-4e4f-9554-d1ed71659e1b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:20.936151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c7913b6-eff7-4e4f-9554-d1ed71659e1b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:20.936645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c7913b6-eff7-4e4f-9554-d1ed71659e1b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:20.937580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c7913b6-eff7-4e4f-9554-d1ed71659e1b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:20.938521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c7913b6-eff7-4e4f-9554-d1ed71659e1b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:20.939011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c7913b6-eff7-4e4f-9554-d1ed71659e1b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:20.939437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c7913b6-eff7-4e4f-9554-d1ed71659e1b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:21.184103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c7913b6-eff7-4e4f-9554-d1ed71659e1b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:21.195110 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c7913b6-eff7-4e4f-9554-d1ed71659e1b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.275383 Aug 23 18:35:21.196217 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3319/6772] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:20 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:21.222442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b5bccb21-3e2a-41e7-80a4-4a3f3e18d499 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:21.223179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b5bccb21-3e2a-41e7-80a4-4a3f3e18d499 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:21.232155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5bccb21-3e2a-41e7-80a4-4a3f3e18d499 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:21.232885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5bccb21-3e2a-41e7-80a4-4a3f3e18d499 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:21.234428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5bccb21-3e2a-41e7-80a4-4a3f3e18d499 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:21.235398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5bccb21-3e2a-41e7-80a4-4a3f3e18d499 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:21.235859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5bccb21-3e2a-41e7-80a4-4a3f3e18d499 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:21.236287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5bccb21-3e2a-41e7-80a4-4a3f3e18d499 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:21.399055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b5bccb21-3e2a-41e7-80a4-4a3f3e18d499 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:21.407845 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b5bccb21-3e2a-41e7-80a4-4a3f3e18d499 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1203 microversion: 2.1 time: 0.190062 Aug 23 18:35:21.409237 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3454/6773] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:21 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1203 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:22.218093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-52bf73ed-9e6c-49aa-bf03-9b66a386e084 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:22.219324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-52bf73ed-9e6c-49aa-bf03-9b66a386e084 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:22.226358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52bf73ed-9e6c-49aa-bf03-9b66a386e084 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:22.226883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52bf73ed-9e6c-49aa-bf03-9b66a386e084 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:22.227324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52bf73ed-9e6c-49aa-bf03-9b66a386e084 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:22.228220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52bf73ed-9e6c-49aa-bf03-9b66a386e084 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:22.228679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52bf73ed-9e6c-49aa-bf03-9b66a386e084 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:22.229103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-52bf73ed-9e6c-49aa-bf03-9b66a386e084 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:22.418144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-52bf73ed-9e6c-49aa-bf03-9b66a386e084 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:22.426378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:22.435117 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-52bf73ed-9e6c-49aa-bf03-9b66a386e084 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.220447 Aug 23 18:35:22.444792 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3320/6774] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:22 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:22.446572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-49fd8010-30da-4a30-b25d-f773504a3920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:22.450603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-49fd8010-30da-4a30-b25d-f773504a3920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:22.461242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49fd8010-30da-4a30-b25d-f773504a3920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:22.461768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49fd8010-30da-4a30-b25d-f773504a3920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:22.462236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49fd8010-30da-4a30-b25d-f773504a3920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:22.463047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49fd8010-30da-4a30-b25d-f773504a3920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:22.463535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49fd8010-30da-4a30-b25d-f773504a3920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:22.464011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49fd8010-30da-4a30-b25d-f773504a3920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:22.638351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-49fd8010-30da-4a30-b25d-f773504a3920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:22.651578 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-49fd8010-30da-4a30-b25d-f773504a3920 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1203 microversion: 2.1 time: 0.223365 Aug 23 18:35:22.652409 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3455/6775] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:22 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1203 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:23.461628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7ef4a04c-1c3f-48fe-959a-151e420ded08 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:23.462250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7ef4a04c-1c3f-48fe-959a-151e420ded08 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:23.470263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ef4a04c-1c3f-48fe-959a-151e420ded08 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:23.470780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ef4a04c-1c3f-48fe-959a-151e420ded08 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:23.471221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ef4a04c-1c3f-48fe-959a-151e420ded08 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:23.471926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ef4a04c-1c3f-48fe-959a-151e420ded08 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:23.472404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ef4a04c-1c3f-48fe-959a-151e420ded08 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:23.472849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ef4a04c-1c3f-48fe-959a-151e420ded08 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:23.661782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7ef4a04c-1c3f-48fe-959a-151e420ded08 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:23.671454 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7ef4a04c-1c3f-48fe-959a-151e420ded08 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.214883 Aug 23 18:35:23.672031 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3321/6776] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:23 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:23.674366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7a192ca-cc56-4bbc-b393-5d6c051aca01 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:23.675130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f7a192ca-cc56-4bbc-b393-5d6c051aca01 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:23.682796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7a192ca-cc56-4bbc-b393-5d6c051aca01 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:23.683425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7a192ca-cc56-4bbc-b393-5d6c051aca01 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:23.683975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7a192ca-cc56-4bbc-b393-5d6c051aca01 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:23.684975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7a192ca-cc56-4bbc-b393-5d6c051aca01 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:23.687934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7a192ca-cc56-4bbc-b393-5d6c051aca01 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:23.688512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7a192ca-cc56-4bbc-b393-5d6c051aca01 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:23.868644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f7a192ca-cc56-4bbc-b393-5d6c051aca01 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:23.878001 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f7a192ca-cc56-4bbc-b393-5d6c051aca01 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1203 microversion: 2.1 time: 0.208287 Aug 23 18:35:23.878611 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3456/6777] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:23 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1203 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:35:24.002534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-3ea995fa-b9a2-401a-b026-69b4bf6a3088 req-16dcf1c1-3eba-48d7-8c67-fde24bd164b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1546b865-ec3b-4ae6-824f-5567720d3926", "name": "network-vif-plugged", "status": "completed", "tag": "3d57b6df-cd3a-41c0-8990-9a26329c1e43"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:35:24.013575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3ea995fa-b9a2-401a-b026-69b4bf6a3088 req-16dcf1c1-3eba-48d7-8c67-fde24bd164b3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:24.014437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3ea995fa-b9a2-401a-b026-69b4bf6a3088 req-16dcf1c1-3eba-48d7-8c67-fde24bd164b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:24.014860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3ea995fa-b9a2-401a-b026-69b4bf6a3088 req-16dcf1c1-3eba-48d7-8c67-fde24bd164b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:24.026896 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-3ea995fa-b9a2-401a-b026-69b4bf6a3088 req-16dcf1c1-3eba-48d7-8c67-fde24bd164b3 service nova] Creating event network-vif-plugged:3d57b6df-cd3a-41c0-8990-9a26329c1e43 for instance 1546b865-ec3b-4ae6-824f-5567720d3926 on n-h1-850468-16 Aug 23 18:35:24.032449 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-3ea995fa-b9a2-401a-b026-69b4bf6a3088 req-16dcf1c1-3eba-48d7-8c67-fde24bd164b3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033523 Aug 23 18:35:24.033132 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3322/6778] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:35:24.694125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c752789a-6648-4131-8a33-e4b1bc830712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:24.695212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c752789a-6648-4131-8a33-e4b1bc830712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:24.702833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c752789a-6648-4131-8a33-e4b1bc830712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:24.703328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c752789a-6648-4131-8a33-e4b1bc830712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:24.703772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c752789a-6648-4131-8a33-e4b1bc830712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:24.704479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c752789a-6648-4131-8a33-e4b1bc830712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:24.704943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c752789a-6648-4131-8a33-e4b1bc830712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:24.705378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c752789a-6648-4131-8a33-e4b1bc830712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:24.851791 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c752789a-6648-4131-8a33-e4b1bc830712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:24.860920 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c752789a-6648-4131-8a33-e4b1bc830712 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.171453 Aug 23 18:35:24.861524 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3457/6779] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:24 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:24.905905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ddd3f8b3-6738-41a1-8c6c-940ab581222f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:24.907151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ddd3f8b3-6738-41a1-8c6c-940ab581222f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:24.914235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddd3f8b3-6738-41a1-8c6c-940ab581222f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:24.914764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddd3f8b3-6738-41a1-8c6c-940ab581222f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:24.915208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddd3f8b3-6738-41a1-8c6c-940ab581222f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:24.916106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddd3f8b3-6738-41a1-8c6c-940ab581222f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:24.916849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddd3f8b3-6738-41a1-8c6c-940ab581222f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:24.917276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ddd3f8b3-6738-41a1-8c6c-940ab581222f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:25.068647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ddd3f8b3-6738-41a1-8c6c-940ab581222f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:25.076503 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ddd3f8b3-6738-41a1-8c6c-940ab581222f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1203 microversion: 2.1 time: 0.179492 Aug 23 18:35:25.077082 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3323/6780] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:24 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1203 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:25.881805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e519c296-5a70-418c-bd11-bb02dd9c5382 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:25.882430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e519c296-5a70-418c-bd11-bb02dd9c5382 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:25.889438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e519c296-5a70-418c-bd11-bb02dd9c5382 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:25.889936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e519c296-5a70-418c-bd11-bb02dd9c5382 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:25.890589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e519c296-5a70-418c-bd11-bb02dd9c5382 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:25.891505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e519c296-5a70-418c-bd11-bb02dd9c5382 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:25.892138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e519c296-5a70-418c-bd11-bb02dd9c5382 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:25.892743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e519c296-5a70-418c-bd11-bb02dd9c5382 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:26.038441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e519c296-5a70-418c-bd11-bb02dd9c5382 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:26.046848 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e519c296-5a70-418c-bd11-bb02dd9c5382 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.169003 Aug 23 18:35:26.047617 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3458/6781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:25 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:26.097392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-65588765-e986-4fa2-bc61-a36aecd7052d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:26.099244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-65588765-e986-4fa2-bc61-a36aecd7052d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:26.106073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65588765-e986-4fa2-bc61-a36aecd7052d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:26.106585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65588765-e986-4fa2-bc61-a36aecd7052d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:26.107027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65588765-e986-4fa2-bc61-a36aecd7052d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:26.107724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65588765-e986-4fa2-bc61-a36aecd7052d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:26.108175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65588765-e986-4fa2-bc61-a36aecd7052d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:26.108599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-65588765-e986-4fa2-bc61-a36aecd7052d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:26.248030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-65588765-e986-4fa2-bc61-a36aecd7052d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:26.256564 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-65588765-e986-4fa2-bc61-a36aecd7052d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1391 microversion: 2.1 time: 0.163435 Aug 23 18:35:26.257143 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3324/6782] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:26 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1391 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:35:26.277837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-831faf85-7893-499b-b5db-4d564da61718 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:26.278454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-831faf85-7893-499b-b5db-4d564da61718 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:26.284592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-831faf85-7893-499b-b5db-4d564da61718 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:26.285116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-831faf85-7893-499b-b5db-4d564da61718 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:26.285831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-831faf85-7893-499b-b5db-4d564da61718 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:26.286418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-831faf85-7893-499b-b5db-4d564da61718 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:26.286957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-831faf85-7893-499b-b5db-4d564da61718 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:26.287393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-831faf85-7893-499b-b5db-4d564da61718 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:26.429254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-831faf85-7893-499b-b5db-4d564da61718 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:26.437196 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-831faf85-7893-499b-b5db-4d564da61718 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1391 microversion: 2.1 time: 0.163217 Aug 23 18:35:26.437773 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3459/6783] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:26 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:26.458045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7767b8d5-13d3-4b3e-ad2f-40484f94d977 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:26.458694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7767b8d5-13d3-4b3e-ad2f-40484f94d977 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:26.464703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7767b8d5-13d3-4b3e-ad2f-40484f94d977 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:26.465201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7767b8d5-13d3-4b3e-ad2f-40484f94d977 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:26.465916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7767b8d5-13d3-4b3e-ad2f-40484f94d977 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:26.466655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7767b8d5-13d3-4b3e-ad2f-40484f94d977 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:26.467119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7767b8d5-13d3-4b3e-ad2f-40484f94d977 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:26.467550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7767b8d5-13d3-4b3e-ad2f-40484f94d977 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:26.612538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7767b8d5-13d3-4b3e-ad2f-40484f94d977 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:26.621409 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7767b8d5-13d3-4b3e-ad2f-40484f94d977 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1391 microversion: 2.1 time: 0.167237 Aug 23 18:35:26.622085 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3325/6784] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:26 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:26.643647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e707e3d8-b7a4-4b05-8f09-23af44e1d24b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:26.644141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e707e3d8-b7a4-4b05-8f09-23af44e1d24b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:26.651888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e707e3d8-b7a4-4b05-8f09-23af44e1d24b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:26.652381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e707e3d8-b7a4-4b05-8f09-23af44e1d24b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:26.652881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e707e3d8-b7a4-4b05-8f09-23af44e1d24b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:26.653538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e707e3d8-b7a4-4b05-8f09-23af44e1d24b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:26.654003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e707e3d8-b7a4-4b05-8f09-23af44e1d24b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:26.654444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e707e3d8-b7a4-4b05-8f09-23af44e1d24b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:26.682586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e707e3d8-b7a4-4b05-8f09-23af44e1d24b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:35:26.762506 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e707e3d8-b7a4-4b05-8f09-23af44e1d24b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 204 len: 0 microversion: 2.1 time: 0.122471 Aug 23 18:35:26.764206 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3460/6785] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:35:26 2022] DELETE /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:35:26.778476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c26cc61b-c57b-4f62-9530-29e0bd862cda tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:26.780153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c26cc61b-c57b-4f62-9530-29e0bd862cda tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:26.791280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c26cc61b-c57b-4f62-9530-29e0bd862cda tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:26.791783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c26cc61b-c57b-4f62-9530-29e0bd862cda tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:26.792216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c26cc61b-c57b-4f62-9530-29e0bd862cda tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:26.792918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c26cc61b-c57b-4f62-9530-29e0bd862cda tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:26.793378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c26cc61b-c57b-4f62-9530-29e0bd862cda tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:26.793801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c26cc61b-c57b-4f62-9530-29e0bd862cda tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:26.933141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c26cc61b-c57b-4f62-9530-29e0bd862cda tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:26.940903 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c26cc61b-c57b-4f62-9530-29e0bd862cda tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1397 microversion: 2.1 time: 0.172477 Aug 23 18:35:26.941921 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3326/6786] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:26 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1397 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:27.070096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-54991ff0-5db4-45d2-abcd-6c98137d2050 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:27.070850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-54991ff0-5db4-45d2-abcd-6c98137d2050 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:27.077965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54991ff0-5db4-45d2-abcd-6c98137d2050 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:27.078594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54991ff0-5db4-45d2-abcd-6c98137d2050 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:27.079233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54991ff0-5db4-45d2-abcd-6c98137d2050 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:27.079953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54991ff0-5db4-45d2-abcd-6c98137d2050 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:27.080421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54991ff0-5db4-45d2-abcd-6c98137d2050 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:27.080885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-54991ff0-5db4-45d2-abcd-6c98137d2050 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:27.220562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-54991ff0-5db4-45d2-abcd-6c98137d2050 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:27.229996 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-54991ff0-5db4-45d2-abcd-6c98137d2050 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.164681 Aug 23 18:35:27.230797 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3461/6787] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:27 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:27.961165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8072a20-383c-4c4b-a95c-f76baf7bd191 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:27.961786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c8072a20-383c-4c4b-a95c-f76baf7bd191 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:27.968983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8072a20-383c-4c4b-a95c-f76baf7bd191 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:27.969477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8072a20-383c-4c4b-a95c-f76baf7bd191 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:27.969915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8072a20-383c-4c4b-a95c-f76baf7bd191 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:27.970643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8072a20-383c-4c4b-a95c-f76baf7bd191 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:27.971104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8072a20-383c-4c4b-a95c-f76baf7bd191 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:27.971599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8072a20-383c-4c4b-a95c-f76baf7bd191 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:28.112020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c8072a20-383c-4c4b-a95c-f76baf7bd191 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:28.121044 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c8072a20-383c-4c4b-a95c-f76baf7bd191 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1397 microversion: 2.1 time: 0.163569 Aug 23 18:35:28.122022 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3327/6788] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:27 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1397 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:28.252120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8b764f28-fe21-4f1b-b68e-aa00f811689b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:28.252865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8b764f28-fe21-4f1b-b68e-aa00f811689b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:28.261004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b764f28-fe21-4f1b-b68e-aa00f811689b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:28.261630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b764f28-fe21-4f1b-b68e-aa00f811689b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:28.262089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b764f28-fe21-4f1b-b68e-aa00f811689b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:28.262873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b764f28-fe21-4f1b-b68e-aa00f811689b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:28.263343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b764f28-fe21-4f1b-b68e-aa00f811689b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:28.263844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b764f28-fe21-4f1b-b68e-aa00f811689b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:28.407700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8b764f28-fe21-4f1b-b68e-aa00f811689b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:28.415794 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8b764f28-fe21-4f1b-b68e-aa00f811689b tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.167706 Aug 23 18:35:28.416371 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3462/6789] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:28 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:29.069721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-5f677c3b-3ed1-4135-aede-0062a05955fa req-5a3ccd30-e06d-4a5c-87b0-ff6e6c3ba72b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1546b865-ec3b-4ae6-824f-5567720d3926", "name": "network-vif-deleted", "tag": "3d57b6df-cd3a-41c0-8990-9a26329c1e43"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:35:29.082959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5f677c3b-3ed1-4135-aede-0062a05955fa req-5a3ccd30-e06d-4a5c-87b0-ff6e6c3ba72b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:29.082959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5f677c3b-3ed1-4135-aede-0062a05955fa req-5a3ccd30-e06d-4a5c-87b0-ff6e6c3ba72b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:29.082959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5f677c3b-3ed1-4135-aede-0062a05955fa req-5a3ccd30-e06d-4a5c-87b0-ff6e6c3ba72b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:29.100020 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5f677c3b-3ed1-4135-aede-0062a05955fa req-5a3ccd30-e06d-4a5c-87b0-ff6e6c3ba72b service nova] Creating event network-vif-deleted:3d57b6df-cd3a-41c0-8990-9a26329c1e43 for instance 1546b865-ec3b-4ae6-824f-5567720d3926 on n-h1-850468-16 Aug 23 18:35:29.111427 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-5f677c3b-3ed1-4135-aede-0062a05955fa req-5a3ccd30-e06d-4a5c-87b0-ff6e6c3ba72b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046733 Aug 23 18:35:29.112243 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3328/6790] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:35:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:35:29.144692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b21cb732-f067-4600-ba3d-aad39d05e4cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:29.146356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b21cb732-f067-4600-ba3d-aad39d05e4cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:29.153348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b21cb732-f067-4600-ba3d-aad39d05e4cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:29.154254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b21cb732-f067-4600-ba3d-aad39d05e4cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:29.155152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b21cb732-f067-4600-ba3d-aad39d05e4cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:29.156597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b21cb732-f067-4600-ba3d-aad39d05e4cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:29.157291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b21cb732-f067-4600-ba3d-aad39d05e4cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:29.158038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b21cb732-f067-4600-ba3d-aad39d05e4cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:29.233729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b21cb732-f067-4600-ba3d-aad39d05e4cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:29.247857 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b21cb732-f067-4600-ba3d-aad39d05e4cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1188 microversion: 2.1 time: 0.107622 Aug 23 18:35:29.248572 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3463/6791] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:29 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1188 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:29.437696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b791182e-a271-426a-88c4-d92b8275b274 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:29.438624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b791182e-a271-426a-88c4-d92b8275b274 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:29.446238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b791182e-a271-426a-88c4-d92b8275b274 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:29.446756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b791182e-a271-426a-88c4-d92b8275b274 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:29.447423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b791182e-a271-426a-88c4-d92b8275b274 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:29.448125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b791182e-a271-426a-88c4-d92b8275b274 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:29.448756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b791182e-a271-426a-88c4-d92b8275b274 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:29.449196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b791182e-a271-426a-88c4-d92b8275b274 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:29.596392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b791182e-a271-426a-88c4-d92b8275b274 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:29.605560 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b791182e-a271-426a-88c4-d92b8275b274 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.172005 Aug 23 18:35:29.606598 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3329/6792] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:29 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:30.270012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bafa2fff-3cbf-4641-902c-bb9f46df1a80 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:30.271770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bafa2fff-3cbf-4641-902c-bb9f46df1a80 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:30.280112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bafa2fff-3cbf-4641-902c-bb9f46df1a80 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:30.280831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bafa2fff-3cbf-4641-902c-bb9f46df1a80 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:30.281314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bafa2fff-3cbf-4641-902c-bb9f46df1a80 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:30.282037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bafa2fff-3cbf-4641-902c-bb9f46df1a80 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:30.282506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bafa2fff-3cbf-4641-902c-bb9f46df1a80 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:30.282968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bafa2fff-3cbf-4641-902c-bb9f46df1a80 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:30.356593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bafa2fff-3cbf-4641-902c-bb9f46df1a80 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:30.367071 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bafa2fff-3cbf-4641-902c-bb9f46df1a80 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1188 microversion: 2.1 time: 0.101579 Aug 23 18:35:30.367755 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3464/6793] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:30 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:30.631407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-be1711d3-dea0-4617-9dbc-79af987e1f7d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:30.632371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-be1711d3-dea0-4617-9dbc-79af987e1f7d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:30.642847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be1711d3-dea0-4617-9dbc-79af987e1f7d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:30.649780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be1711d3-dea0-4617-9dbc-79af987e1f7d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:30.650668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be1711d3-dea0-4617-9dbc-79af987e1f7d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:30.652180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be1711d3-dea0-4617-9dbc-79af987e1f7d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:30.659190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be1711d3-dea0-4617-9dbc-79af987e1f7d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:30.662252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be1711d3-dea0-4617-9dbc-79af987e1f7d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:30.827106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-be1711d3-dea0-4617-9dbc-79af987e1f7d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:30.836255 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-be1711d3-dea0-4617-9dbc-79af987e1f7d tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1693 microversion: 2.1 time: 0.211369 Aug 23 18:35:30.837957 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3330/6794] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:30 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1693 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:31.389383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d83df043-81d8-4a8d-94e0-126b1663627a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:31.390626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d83df043-81d8-4a8d-94e0-126b1663627a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:31.398688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d83df043-81d8-4a8d-94e0-126b1663627a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:31.399075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d83df043-81d8-4a8d-94e0-126b1663627a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:31.399525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d83df043-81d8-4a8d-94e0-126b1663627a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:31.400373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d83df043-81d8-4a8d-94e0-126b1663627a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:31.400869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d83df043-81d8-4a8d-94e0-126b1663627a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:31.401279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d83df043-81d8-4a8d-94e0-126b1663627a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:31.474486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d83df043-81d8-4a8d-94e0-126b1663627a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:31.482831 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d83df043-81d8-4a8d-94e0-126b1663627a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1188 microversion: 2.1 time: 0.097290 Aug 23 18:35:31.483495 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3465/6795] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:31 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1188 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:31.860412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e94aa27-7550-4a6b-8a8a-64af72178aa7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:31.861817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e94aa27-7550-4a6b-8a8a-64af72178aa7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:31.870704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e94aa27-7550-4a6b-8a8a-64af72178aa7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:31.871129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e94aa27-7550-4a6b-8a8a-64af72178aa7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:31.871610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e94aa27-7550-4a6b-8a8a-64af72178aa7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:31.872267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e94aa27-7550-4a6b-8a8a-64af72178aa7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:31.873233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e94aa27-7550-4a6b-8a8a-64af72178aa7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:31.873872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e94aa27-7550-4a6b-8a8a-64af72178aa7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:32.047940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e94aa27-7550-4a6b-8a8a-64af72178aa7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:32.059571 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e94aa27-7550-4a6b-8a8a-64af72178aa7 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1699 microversion: 2.1 time: 0.203089 Aug 23 18:35:32.060459 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3331/6796] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:31 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1699 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:32.505165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-30b89955-61d8-4589-a9fc-a5818fb0a6c4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:32.505784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-30b89955-61d8-4589-a9fc-a5818fb0a6c4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:32.513207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30b89955-61d8-4589-a9fc-a5818fb0a6c4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:32.513709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30b89955-61d8-4589-a9fc-a5818fb0a6c4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:32.514148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30b89955-61d8-4589-a9fc-a5818fb0a6c4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:32.514892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30b89955-61d8-4589-a9fc-a5818fb0a6c4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:32.515349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30b89955-61d8-4589-a9fc-a5818fb0a6c4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:32.515776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30b89955-61d8-4589-a9fc-a5818fb0a6c4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:32.614618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-30b89955-61d8-4589-a9fc-a5818fb0a6c4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:32.623454 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-30b89955-61d8-4589-a9fc-a5818fb0a6c4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1188 microversion: 2.1 time: 0.122601 Aug 23 18:35:32.624049 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3466/6797] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:32 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1188 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:33.081638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-72afe27f-67f2-4ba1-aa5a-c81473b483f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:33.082445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-72afe27f-67f2-4ba1-aa5a-c81473b483f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:33.089695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72afe27f-67f2-4ba1-aa5a-c81473b483f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:33.090184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72afe27f-67f2-4ba1-aa5a-c81473b483f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:33.090903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72afe27f-67f2-4ba1-aa5a-c81473b483f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:33.091993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72afe27f-67f2-4ba1-aa5a-c81473b483f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:33.092613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72afe27f-67f2-4ba1-aa5a-c81473b483f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:33.093468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72afe27f-67f2-4ba1-aa5a-c81473b483f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:33.254737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-72afe27f-67f2-4ba1-aa5a-c81473b483f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:33.264056 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-72afe27f-67f2-4ba1-aa5a-c81473b483f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1699 microversion: 2.1 time: 0.186497 Aug 23 18:35:33.264643 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3332/6798] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:33 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1699 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:33.645896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:33.646517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:33.654038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:33.654558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:33.655002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:33.655709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:33.656169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:33.656683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:33.691080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:33.691858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:33.692306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:33.692750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lazy-loading 'fault' on Instance uuid 1546b865-ec3b-4ae6-824f-5567720d3926 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:35:33.745336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:33.754172 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-45a48ad9-9cc0-4f6f-9ff7-8e419c888eae tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 200 len: 1193 microversion: 2.1 time: 0.112131 Aug 23 18:35:33.754895 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3467/6799] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:33 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 1193 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:34.286407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-90558cf7-0cd2-4a78-8d58-4e4dc786dfa3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:34.287818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-90558cf7-0cd2-4a78-8d58-4e4dc786dfa3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:34.295249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90558cf7-0cd2-4a78-8d58-4e4dc786dfa3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:34.295651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90558cf7-0cd2-4a78-8d58-4e4dc786dfa3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:34.296091 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90558cf7-0cd2-4a78-8d58-4e4dc786dfa3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:34.296805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90558cf7-0cd2-4a78-8d58-4e4dc786dfa3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:34.297260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90558cf7-0cd2-4a78-8d58-4e4dc786dfa3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:34.297818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90558cf7-0cd2-4a78-8d58-4e4dc786dfa3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:34.456172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-90558cf7-0cd2-4a78-8d58-4e4dc786dfa3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:34.467549 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-90558cf7-0cd2-4a78-8d58-4e4dc786dfa3 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1699 microversion: 2.1 time: 0.185777 Aug 23 18:35:34.469269 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3333/6800] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:34 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1699 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:34.777596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-067b5bee-5bbe-4687-baa6-8cd12b45c4c8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:34.778212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-067b5bee-5bbe-4687-baa6-8cd12b45c4c8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 1546b865-ec3b-4ae6-824f-5567720d3926] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:34.786137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-067b5bee-5bbe-4687-baa6-8cd12b45c4c8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:34.786654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-067b5bee-5bbe-4687-baa6-8cd12b45c4c8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:34.787102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-067b5bee-5bbe-4687-baa6-8cd12b45c4c8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:34.787809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-067b5bee-5bbe-4687-baa6-8cd12b45c4c8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:34.788264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-067b5bee-5bbe-4687-baa6-8cd12b45c4c8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:34.788691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-067b5bee-5bbe-4687-baa6-8cd12b45c4c8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:34.804225 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-067b5bee-5bbe-4687-baa6-8cd12b45c4c8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance 1546b865-ec3b-4ae6-824f-5567720d3926 could not be found. Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-067b5bee-5bbe-4687-baa6-8cd12b45c4c8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 HTTP/1.1 Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 1546b865-ec3b-4ae6-824f-5567720d3926 could not be found. Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '1546b865-ec3b-4ae6-824f-5567720d3926'} Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1546b865-ec3b-4ae6-824f-5567720d3926 could not be found. Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1546b865-ec3b-4ae6-824f-5567720d3926 could not be found. Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:35:34.805845 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:35:34.810887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:35:34.810887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:35:34.810887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:35:34.810887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:35:34.810887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:35:34.810887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1546b865-ec3b-4ae6-824f-5567720d3926 could not be found. Aug 23 18:35:34.810887 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:35:34.810887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-067b5bee-5bbe-4687-baa6-8cd12b45c4c8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance 1546b865-ec3b-4ae6-824f-5567720d3926 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:35:34.810887 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-067b5bee-5bbe-4687-baa6-8cd12b45c4c8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926" status: 404 len: 111 microversion: 2.1 time: 0.033762 Aug 23 18:35:34.810887 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3468/6801] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:34 2022] GET /compute/v2.1/servers/1546b865-ec3b-4ae6-824f-5567720d3926 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:35:35.493333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-63c94fa2-9670-4437-a43d-a8655012c5ef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:35.495044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-63c94fa2-9670-4437-a43d-a8655012c5ef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:35.513320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63c94fa2-9670-4437-a43d-a8655012c5ef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:35.513849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63c94fa2-9670-4437-a43d-a8655012c5ef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:35.514367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63c94fa2-9670-4437-a43d-a8655012c5ef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:35.520701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63c94fa2-9670-4437-a43d-a8655012c5ef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:35.521198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63c94fa2-9670-4437-a43d-a8655012c5ef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:35.521654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-63c94fa2-9670-4437-a43d-a8655012c5ef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:35.795134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-63c94fa2-9670-4437-a43d-a8655012c5ef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:35.819614 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-63c94fa2-9670-4437-a43d-a8655012c5ef tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1699 microversion: 2.1 time: 0.332005 Aug 23 18:35:35.822390 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3334/6802] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:35 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1699 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:36.100224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7ef9300b-cf04-4e36-815f-efeea278e685 req-ef3f5cf7-db4c-4cd4-9827-2df79cb6d523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f036fec-6fc7-4d25-8262-91c63d4004ad", "name": "network-vif-unplugged", "status": "completed", "tag": "913d6a7f-e98e-4663-bf84-b15992836ee5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:35:36.127735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7ef9300b-cf04-4e36-815f-efeea278e685 req-ef3f5cf7-db4c-4cd4-9827-2df79cb6d523 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:36.129024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7ef9300b-cf04-4e36-815f-efeea278e685 req-ef3f5cf7-db4c-4cd4-9827-2df79cb6d523 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:36.129717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7ef9300b-cf04-4e36-815f-efeea278e685 req-ef3f5cf7-db4c-4cd4-9827-2df79cb6d523 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:36.135626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:36.145133 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7ef9300b-cf04-4e36-815f-efeea278e685 req-ef3f5cf7-db4c-4cd4-9827-2df79cb6d523 service nova] Creating event network-vif-unplugged:913d6a7f-e98e-4663-bf84-b15992836ee5 for instance 5f036fec-6fc7-4d25-8262-91c63d4004ad on n-h2-850468-16 Aug 23 18:35:36.153184 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7ef9300b-cf04-4e36-815f-efeea278e685 req-ef3f5cf7-db4c-4cd4-9827-2df79cb6d523 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.058326 Aug 23 18:35:36.154433 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3469/6803] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:35:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:35:36.853760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-547fd87e-15a9-4868-a930-911596def153 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:36.856542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-547fd87e-15a9-4868-a930-911596def153 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:36.870676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-547fd87e-15a9-4868-a930-911596def153 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:36.871619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-547fd87e-15a9-4868-a930-911596def153 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:36.872406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-547fd87e-15a9-4868-a930-911596def153 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:36.877231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-547fd87e-15a9-4868-a930-911596def153 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:36.878214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-547fd87e-15a9-4868-a930-911596def153 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:36.884678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-547fd87e-15a9-4868-a930-911596def153 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:37.158173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-547fd87e-15a9-4868-a930-911596def153 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:37.170649 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-547fd87e-15a9-4868-a930-911596def153 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1684 microversion: 2.1 time: 0.328860 Aug 23 18:35:37.172281 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3335/6804] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:36 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1684 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:39.650499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c6193729-4db4-43dd-86f2-272263073c34 req-5069230e-f6d4-45b8-ae59-16e9dcdf0431 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f036fec-6fc7-4d25-8262-91c63d4004ad", "name": "network-vif-plugged", "status": "completed", "tag": "913d6a7f-e98e-4663-bf84-b15992836ee5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:35:39.664385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c6193729-4db4-43dd-86f2-272263073c34 req-5069230e-f6d4-45b8-ae59-16e9dcdf0431 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:39.665082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c6193729-4db4-43dd-86f2-272263073c34 req-5069230e-f6d4-45b8-ae59-16e9dcdf0431 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:39.665819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c6193729-4db4-43dd-86f2-272263073c34 req-5069230e-f6d4-45b8-ae59-16e9dcdf0431 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:39.678483 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c6193729-4db4-43dd-86f2-272263073c34 req-5069230e-f6d4-45b8-ae59-16e9dcdf0431 service nova] Creating event network-vif-plugged:913d6a7f-e98e-4663-bf84-b15992836ee5 for instance 5f036fec-6fc7-4d25-8262-91c63d4004ad on n-h2-850468-16 Aug 23 18:35:39.684119 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c6193729-4db4-43dd-86f2-272263073c34 req-5069230e-f6d4-45b8-ae59-16e9dcdf0431 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038820 Aug 23 18:35:39.685090 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3470/6805] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:35:41.119248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1845752239", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "6d0d1b12-cffe-4dda-bee5-1cad8f508e4b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b72a85dc-9cf5-4dba-9938-31cafa49248b"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:35:41.181347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] validate_networks() for [('b72a85dc-9cf5-4dba-9938-31cafa49248b', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:35:41.672368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:35:41.672800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:35:41.673283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:35:41.673704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:35:41.674150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:35:41.684901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:41.685509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:41.685941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:41.686712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:41.687179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:41.687612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:41.705817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:35:41.712294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for user c77b0208b95843d6a5dac5c4a1ac3d8a and project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:35:41.774285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:35:41.776590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6d0d1b12-cffe-4dda-bee5-1cad8f508e4b',volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:35:41.913278 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b0121b83-dfdf-4da2-ba47-83272e94ad9c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.798288 Aug 23 18:35:41.919203 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3336/6806] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:35:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:35:41.926057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a511ddb6-ed41-4c61-b0c2-4072050eeade tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:41.926879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a511ddb6-ed41-4c61-b0c2-4072050eeade tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:42.042077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a511ddb6-ed41-4c61-b0c2-4072050eeade tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:42.049699 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a511ddb6-ed41-4c61-b0c2-4072050eeade tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1057 microversion: 2.1 time: 0.128835 Aug 23 18:35:42.051175 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3471/6807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:41 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1057 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:43.073182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bde23789-a724-4679-ac56-3e2c934ea4b9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:43.073801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bde23789-a724-4679-ac56-3e2c934ea4b9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:43.080757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bde23789-a724-4679-ac56-3e2c934ea4b9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:43.082107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bde23789-a724-4679-ac56-3e2c934ea4b9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:43.084069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bde23789-a724-4679-ac56-3e2c934ea4b9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:43.084795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bde23789-a724-4679-ac56-3e2c934ea4b9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:43.085419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bde23789-a724-4679-ac56-3e2c934ea4b9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:43.086026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bde23789-a724-4679-ac56-3e2c934ea4b9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:43.195697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bde23789-a724-4679-ac56-3e2c934ea4b9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:43.205770 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bde23789-a724-4679-ac56-3e2c934ea4b9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1173 microversion: 2.1 time: 0.137455 Aug 23 18:35:43.207092 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3337/6808] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:43 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1173 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:44.227191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a8d06eb8-bddc-4dac-b0b1-93a4cb9ff9ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:44.227823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a8d06eb8-bddc-4dac-b0b1-93a4cb9ff9ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:44.236122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8d06eb8-bddc-4dac-b0b1-93a4cb9ff9ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:44.236616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8d06eb8-bddc-4dac-b0b1-93a4cb9ff9ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:44.237340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8d06eb8-bddc-4dac-b0b1-93a4cb9ff9ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:44.238597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8d06eb8-bddc-4dac-b0b1-93a4cb9ff9ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:44.239034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8d06eb8-bddc-4dac-b0b1-93a4cb9ff9ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:44.239648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8d06eb8-bddc-4dac-b0b1-93a4cb9ff9ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:44.449947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a8d06eb8-bddc-4dac-b0b1-93a4cb9ff9ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:44.461089 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a8d06eb8-bddc-4dac-b0b1-93a4cb9ff9ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1215 microversion: 2.1 time: 0.237746 Aug 23 18:35:44.462426 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3472/6809] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:44 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1215 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:44.567996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4178cd0e-52f3-4b23-957c-2ad5be03b654 req-ac150ecd-468f-4726-9f25-f3d6d3d991b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a62e728-05f9-4968-aa2a-297ea4bc4741", "tag": "24f96040-2086-4102-9490-d9dd154617e6"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:35:44.599976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4178cd0e-52f3-4b23-957c-2ad5be03b654 req-ac150ecd-468f-4726-9f25-f3d6d3d991b9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:44.600829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4178cd0e-52f3-4b23-957c-2ad5be03b654 req-ac150ecd-468f-4726-9f25-f3d6d3d991b9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:44.601481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4178cd0e-52f3-4b23-957c-2ad5be03b654 req-ac150ecd-468f-4726-9f25-f3d6d3d991b9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:44.625330 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4178cd0e-52f3-4b23-957c-2ad5be03b654 req-ac150ecd-468f-4726-9f25-f3d6d3d991b9 service nova] Creating event network-changed:24f96040-2086-4102-9490-d9dd154617e6 for instance 9a62e728-05f9-4968-aa2a-297ea4bc4741 on n-h1-850468-16 Aug 23 18:35:44.652224 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4178cd0e-52f3-4b23-957c-2ad5be03b654 req-ac150ecd-468f-4726-9f25-f3d6d3d991b9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087509 Aug 23 18:35:44.652892 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3338/6810] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:35:45.484703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5ba8bc50-76ca-4047-9770-5773eb88280b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:45.485496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5ba8bc50-76ca-4047-9770-5773eb88280b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:45.493199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc50-76ca-4047-9770-5773eb88280b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:45.494227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc50-76ca-4047-9770-5773eb88280b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:45.494887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc50-76ca-4047-9770-5773eb88280b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:45.495834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc50-76ca-4047-9770-5773eb88280b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:45.496624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc50-76ca-4047-9770-5773eb88280b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:45.497371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ba8bc50-76ca-4047-9770-5773eb88280b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:45.740001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5ba8bc50-76ca-4047-9770-5773eb88280b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:45.748350 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5ba8bc50-76ca-4047-9770-5773eb88280b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1215 microversion: 2.1 time: 0.267569 Aug 23 18:35:45.749249 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3473/6811] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:45 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1215 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:46.771839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2fc6fdf3-6153-4ca2-b654-48d7b51723b4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:46.772510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2fc6fdf3-6153-4ca2-b654-48d7b51723b4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:46.781230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fc6fdf3-6153-4ca2-b654-48d7b51723b4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:46.781876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fc6fdf3-6153-4ca2-b654-48d7b51723b4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:46.782555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fc6fdf3-6153-4ca2-b654-48d7b51723b4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:46.783320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fc6fdf3-6153-4ca2-b654-48d7b51723b4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:46.783807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fc6fdf3-6153-4ca2-b654-48d7b51723b4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:46.784937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2fc6fdf3-6153-4ca2-b654-48d7b51723b4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:46.957046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2fc6fdf3-6153-4ca2-b654-48d7b51723b4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:46.967073 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2fc6fdf3-6153-4ca2-b654-48d7b51723b4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1215 microversion: 2.1 time: 0.200408 Aug 23 18:35:46.967660 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3339/6812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:46 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1215 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:47.988883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6ced882e-471f-4402-8cd9-d07fe347c91e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:47.990396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6ced882e-471f-4402-8cd9-d07fe347c91e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:47.999334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ced882e-471f-4402-8cd9-d07fe347c91e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:48.000402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ced882e-471f-4402-8cd9-d07fe347c91e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:48.000857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ced882e-471f-4402-8cd9-d07fe347c91e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:48.001591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ced882e-471f-4402-8cd9-d07fe347c91e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:48.002058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ced882e-471f-4402-8cd9-d07fe347c91e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:48.002498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ced882e-471f-4402-8cd9-d07fe347c91e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:48.171547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6ced882e-471f-4402-8cd9-d07fe347c91e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:48.182820 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6ced882e-471f-4402-8cd9-d07fe347c91e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1215 microversion: 2.1 time: 0.198303 Aug 23 18:35:48.183413 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3474/6813] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:47 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1215 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:49.205617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-939a28ec-7b81-4417-9026-7d2ff981cc5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:49.206469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-939a28ec-7b81-4417-9026-7d2ff981cc5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:49.209976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:49.216596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-939a28ec-7b81-4417-9026-7d2ff981cc5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:49.217170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-939a28ec-7b81-4417-9026-7d2ff981cc5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:49.217676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-939a28ec-7b81-4417-9026-7d2ff981cc5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:49.218732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-939a28ec-7b81-4417-9026-7d2ff981cc5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:49.219268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-939a28ec-7b81-4417-9026-7d2ff981cc5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:49.220087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-939a28ec-7b81-4417-9026-7d2ff981cc5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:49.230004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=100 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:49.521845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-939a28ec-7b81-4417-9026-7d2ff981cc5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:49.532922 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-939a28ec-7b81-4417-9026-7d2ff981cc5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1203 microversion: 2.1 time: 0.331628 Aug 23 18:35:49.533625 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3340/6814] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:49 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1203 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:35:50.558684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6120246-6836-4917-aa0d-199fdba02d68 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:50.559319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6120246-6836-4917-aa0d-199fdba02d68 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:50.561303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:50.568283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6120246-6836-4917-aa0d-199fdba02d68 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:50.569234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6120246-6836-4917-aa0d-199fdba02d68 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:50.569234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6120246-6836-4917-aa0d-199fdba02d68 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:50.569949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6120246-6836-4917-aa0d-199fdba02d68 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:50.570419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6120246-6836-4917-aa0d-199fdba02d68 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:50.570886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6120246-6836-4917-aa0d-199fdba02d68 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:50.830788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6120246-6836-4917-aa0d-199fdba02d68 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:50.838690 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6120246-6836-4917-aa0d-199fdba02d68 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1203 microversion: 2.1 time: 0.285577 Aug 23 18:35:50.839245 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3475/6815] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:50 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1203 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:51.859122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8b73ab5a-4719-42b9-b03f-d115c7512215 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:51.859875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8b73ab5a-4719-42b9-b03f-d115c7512215 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:51.863265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:51.864418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:51.871146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b73ab5a-4719-42b9-b03f-d115c7512215 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:51.871636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b73ab5a-4719-42b9-b03f-d115c7512215 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:51.872069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b73ab5a-4719-42b9-b03f-d115c7512215 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:51.872767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b73ab5a-4719-42b9-b03f-d115c7512215 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:51.873216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b73ab5a-4719-42b9-b03f-d115c7512215 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:51.873636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8b73ab5a-4719-42b9-b03f-d115c7512215 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:52.011616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8b73ab5a-4719-42b9-b03f-d115c7512215 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:52.020893 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8b73ab5a-4719-42b9-b03f-d115c7512215 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1203 microversion: 2.1 time: 0.165615 Aug 23 18:35:52.021573 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3341/6816] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:51 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:53.046265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4741d294-fe33-4e52-8583-345d0ffcb2d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:53.047128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4741d294-fe33-4e52-8583-345d0ffcb2d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:53.050421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:35:53.055795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4741d294-fe33-4e52-8583-345d0ffcb2d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:53.056296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4741d294-fe33-4e52-8583-345d0ffcb2d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:53.056862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4741d294-fe33-4e52-8583-345d0ffcb2d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:53.057648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4741d294-fe33-4e52-8583-345d0ffcb2d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:53.058190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4741d294-fe33-4e52-8583-345d0ffcb2d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:53.058653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4741d294-fe33-4e52-8583-345d0ffcb2d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:53.204060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4741d294-fe33-4e52-8583-345d0ffcb2d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:53.213315 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4741d294-fe33-4e52-8583-345d0ffcb2d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1203 microversion: 2.1 time: 0.172074 Aug 23 18:35:53.214134 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3476/6817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:53 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:54.235985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77b34d96-f299-47ea-a95d-72eed7fdb632 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:54.236592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-77b34d96-f299-47ea-a95d-72eed7fdb632 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:54.243361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77b34d96-f299-47ea-a95d-72eed7fdb632 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:54.243850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77b34d96-f299-47ea-a95d-72eed7fdb632 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:54.244281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77b34d96-f299-47ea-a95d-72eed7fdb632 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:54.244974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77b34d96-f299-47ea-a95d-72eed7fdb632 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:54.245713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77b34d96-f299-47ea-a95d-72eed7fdb632 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:54.246149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77b34d96-f299-47ea-a95d-72eed7fdb632 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:54.382272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-77b34d96-f299-47ea-a95d-72eed7fdb632 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:54.390255 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-77b34d96-f299-47ea-a95d-72eed7fdb632 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1203 microversion: 2.1 time: 0.158435 Aug 23 18:35:54.390872 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3342/6818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:54 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:35:55.412798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5dceea9e-5913-4c18-b5a2-385f935adadf tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:55.413429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5dceea9e-5913-4c18-b5a2-385f935adadf tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:55.420519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5dceea9e-5913-4c18-b5a2-385f935adadf tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:55.421014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5dceea9e-5913-4c18-b5a2-385f935adadf tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:55.421462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5dceea9e-5913-4c18-b5a2-385f935adadf tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:55.422173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5dceea9e-5913-4c18-b5a2-385f935adadf tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:55.422660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5dceea9e-5913-4c18-b5a2-385f935adadf tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:55.423096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5dceea9e-5913-4c18-b5a2-385f935adadf tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:55.558822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5dceea9e-5913-4c18-b5a2-385f935adadf tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:55.566734 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5dceea9e-5913-4c18-b5a2-385f935adadf tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1203 microversion: 2.1 time: 0.158885 Aug 23 18:35:55.567323 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3477/6819] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:55 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1203 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:56.588699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-46d9a40b-4123-42b0-8196-1ca1d4d97aed tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:56.589338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-46d9a40b-4123-42b0-8196-1ca1d4d97aed tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:56.596990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-46d9a40b-4123-42b0-8196-1ca1d4d97aed tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:56.597709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-46d9a40b-4123-42b0-8196-1ca1d4d97aed tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:56.598227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-46d9a40b-4123-42b0-8196-1ca1d4d97aed tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:56.598960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-46d9a40b-4123-42b0-8196-1ca1d4d97aed tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:56.599457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-46d9a40b-4123-42b0-8196-1ca1d4d97aed tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:56.599887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-46d9a40b-4123-42b0-8196-1ca1d4d97aed tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:56.745032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-46d9a40b-4123-42b0-8196-1ca1d4d97aed tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:56.752946 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-46d9a40b-4123-42b0-8196-1ca1d4d97aed tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1203 microversion: 2.1 time: 0.168381 Aug 23 18:35:56.753611 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3343/6820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:56 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1203 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:35:57.774010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa380b1d-57f8-4dba-abf1-91e573d940df tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:57.774653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa380b1d-57f8-4dba-abf1-91e573d940df tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:57.781518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa380b1d-57f8-4dba-abf1-91e573d940df tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:57.781941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa380b1d-57f8-4dba-abf1-91e573d940df tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:57.782383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa380b1d-57f8-4dba-abf1-91e573d940df tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:57.783150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa380b1d-57f8-4dba-abf1-91e573d940df tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:57.783613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa380b1d-57f8-4dba-abf1-91e573d940df tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:57.784627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa380b1d-57f8-4dba-abf1-91e573d940df tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:57.920903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa380b1d-57f8-4dba-abf1-91e573d940df tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:57.930151 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa380b1d-57f8-4dba-abf1-91e573d940df tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1203 microversion: 2.1 time: 0.159937 Aug 23 18:35:57.930890 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3478/6821] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:57 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1203 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:35:58.951139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-28e852e0-b505-4898-b4a9-7418e93eb9e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:35:58.951759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-28e852e0-b505-4898-b4a9-7418e93eb9e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:35:58.959401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28e852e0-b505-4898-b4a9-7418e93eb9e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:58.959880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28e852e0-b505-4898-b4a9-7418e93eb9e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:58.960333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28e852e0-b505-4898-b4a9-7418e93eb9e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:58.961038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28e852e0-b505-4898-b4a9-7418e93eb9e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:35:58.961492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28e852e0-b505-4898-b4a9-7418e93eb9e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:35:58.962037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-28e852e0-b505-4898-b4a9-7418e93eb9e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:35:59.103617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-28e852e0-b505-4898-b4a9-7418e93eb9e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:35:59.113021 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-28e852e0-b505-4898-b4a9-7418e93eb9e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1203 microversion: 2.1 time: 0.164980 Aug 23 18:35:59.113624 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3344/6822] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:35:58 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1203 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:00.117703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-fd4eb6e8-5675-4e6c-92a7-abde61a48170 req-6c7302bc-900b-404f-b614-97b7f2131a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a62e728-05f9-4968-aa2a-297ea4bc4741", "name": "network-vif-plugged", "status": "completed", "tag": "24f96040-2086-4102-9490-d9dd154617e6"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:36:00.128919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fd4eb6e8-5675-4e6c-92a7-abde61a48170 req-6c7302bc-900b-404f-b614-97b7f2131a19 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:00.134088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b96d6dff-820e-4d02-8228-1fa8e1f3f5cd tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:00.134753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b96d6dff-820e-4d02-8228-1fa8e1f3f5cd tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:00.138983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fd4eb6e8-5675-4e6c-92a7-abde61a48170 req-6c7302bc-900b-404f-b614-97b7f2131a19 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:00.139433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fd4eb6e8-5675-4e6c-92a7-abde61a48170 req-6c7302bc-900b-404f-b614-97b7f2131a19 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:00.147589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b96d6dff-820e-4d02-8228-1fa8e1f3f5cd tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:00.148087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b96d6dff-820e-4d02-8228-1fa8e1f3f5cd tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:00.148530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b96d6dff-820e-4d02-8228-1fa8e1f3f5cd tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:00.149348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b96d6dff-820e-4d02-8228-1fa8e1f3f5cd tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:00.149703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b96d6dff-820e-4d02-8228-1fa8e1f3f5cd tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:00.150131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b96d6dff-820e-4d02-8228-1fa8e1f3f5cd tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:00.169057 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-fd4eb6e8-5675-4e6c-92a7-abde61a48170 req-6c7302bc-900b-404f-b614-97b7f2131a19 service nova] Creating event network-vif-plugged:24f96040-2086-4102-9490-d9dd154617e6 for instance 9a62e728-05f9-4968-aa2a-297ea4bc4741 on n-h1-850468-16 Aug 23 18:36:00.175246 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-fd4eb6e8-5675-4e6c-92a7-abde61a48170 req-6c7302bc-900b-404f-b614-97b7f2131a19 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060870 Aug 23 18:36:00.176804 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3479/6823] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:36:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:36:00.379376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b96d6dff-820e-4d02-8228-1fa8e1f3f5cd tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:00.387667 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b96d6dff-820e-4d02-8228-1fa8e1f3f5cd tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1203 microversion: 2.1 time: 0.257448 Aug 23 18:36:00.388377 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3345/6824] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:00 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1203 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:36:01.409961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a99bc186-8ba9-4ae2-a96b-9abd7a72e589 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:01.410721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a99bc186-8ba9-4ae2-a96b-9abd7a72e589 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:01.416915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a99bc186-8ba9-4ae2-a96b-9abd7a72e589 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:01.417403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a99bc186-8ba9-4ae2-a96b-9abd7a72e589 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:01.417846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a99bc186-8ba9-4ae2-a96b-9abd7a72e589 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:01.418557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a99bc186-8ba9-4ae2-a96b-9abd7a72e589 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:01.419022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a99bc186-8ba9-4ae2-a96b-9abd7a72e589 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:01.419453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a99bc186-8ba9-4ae2-a96b-9abd7a72e589 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:01.598251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a99bc186-8ba9-4ae2-a96b-9abd7a72e589 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:01.606839 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a99bc186-8ba9-4ae2-a96b-9abd7a72e589 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1203 microversion: 2.1 time: 0.202356 Aug 23 18:36:01.607522 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3480/6825] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:01 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1203 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:36:02.631126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a65b4c4d-ba7c-4c5b-9932-54bab78f029d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:02.631868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a65b4c4d-ba7c-4c5b-9932-54bab78f029d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:02.639508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a65b4c4d-ba7c-4c5b-9932-54bab78f029d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:02.640001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a65b4c4d-ba7c-4c5b-9932-54bab78f029d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:02.640625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a65b4c4d-ba7c-4c5b-9932-54bab78f029d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:02.641345 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a65b4c4d-ba7c-4c5b-9932-54bab78f029d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:02.642001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a65b4c4d-ba7c-4c5b-9932-54bab78f029d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:02.642704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a65b4c4d-ba7c-4c5b-9932-54bab78f029d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:02.782803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a65b4c4d-ba7c-4c5b-9932-54bab78f029d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:02.791537 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a65b4c4d-ba7c-4c5b-9932-54bab78f029d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1391 microversion: 2.1 time: 0.165046 Aug 23 18:36:02.792110 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3346/6826] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:02 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:02.811960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5550cca7-d258-49cd-9b09-218fc6f1e21a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:02.812863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5550cca7-d258-49cd-9b09-218fc6f1e21a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:02.820729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5550cca7-d258-49cd-9b09-218fc6f1e21a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:02.821297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5550cca7-d258-49cd-9b09-218fc6f1e21a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:02.821813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5550cca7-d258-49cd-9b09-218fc6f1e21a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:02.822642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5550cca7-d258-49cd-9b09-218fc6f1e21a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:02.823174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5550cca7-d258-49cd-9b09-218fc6f1e21a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:02.823616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5550cca7-d258-49cd-9b09-218fc6f1e21a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:02.959177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5550cca7-d258-49cd-9b09-218fc6f1e21a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:02.967366 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5550cca7-d258-49cd-9b09-218fc6f1e21a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1391 microversion: 2.1 time: 0.159481 Aug 23 18:36:02.967940 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3481/6827] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:02 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:02.988211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e9bdef48-b9e1-4f16-8586-37c5984c73ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:02.988911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e9bdef48-b9e1-4f16-8586-37c5984c73ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:02.994931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9bdef48-b9e1-4f16-8586-37c5984c73ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:02.995428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9bdef48-b9e1-4f16-8586-37c5984c73ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:02.995878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9bdef48-b9e1-4f16-8586-37c5984c73ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:02.996585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9bdef48-b9e1-4f16-8586-37c5984c73ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:02.997080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9bdef48-b9e1-4f16-8586-37c5984c73ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:02.997515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9bdef48-b9e1-4f16-8586-37c5984c73ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:03.135210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e9bdef48-b9e1-4f16-8586-37c5984c73ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:03.143784 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e9bdef48-b9e1-4f16-8586-37c5984c73ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1391 microversion: 2.1 time: 0.159169 Aug 23 18:36:03.144385 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3347/6828] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:02 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:03.163886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5baf1295-ffcd-4fb1-bef4-895de5c1e09c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:03.164537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5baf1295-ffcd-4fb1-bef4-895de5c1e09c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:03.171179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5baf1295-ffcd-4fb1-bef4-895de5c1e09c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:03.172391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5baf1295-ffcd-4fb1-bef4-895de5c1e09c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:03.172847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5baf1295-ffcd-4fb1-bef4-895de5c1e09c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:03.173569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5baf1295-ffcd-4fb1-bef4-895de5c1e09c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:03.174038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5baf1295-ffcd-4fb1-bef4-895de5c1e09c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:03.174681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5baf1295-ffcd-4fb1-bef4-895de5c1e09c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:03.201612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5baf1295-ffcd-4fb1-bef4-895de5c1e09c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:36:03.288580 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5baf1295-ffcd-4fb1-bef4-895de5c1e09c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 204 len: 0 microversion: 2.1 time: 0.127819 Aug 23 18:36:03.289206 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3482/6829] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:36:03 2022] DELETE /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:36:03.297836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc73cb3c-ac37-4e8f-bc00-4806a87b6fa4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:03.298774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fc73cb3c-ac37-4e8f-bc00-4806a87b6fa4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:03.306339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc73cb3c-ac37-4e8f-bc00-4806a87b6fa4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:03.307199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc73cb3c-ac37-4e8f-bc00-4806a87b6fa4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:03.307734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc73cb3c-ac37-4e8f-bc00-4806a87b6fa4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:03.308506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc73cb3c-ac37-4e8f-bc00-4806a87b6fa4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:03.309030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc73cb3c-ac37-4e8f-bc00-4806a87b6fa4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:03.309521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc73cb3c-ac37-4e8f-bc00-4806a87b6fa4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:03.445702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fc73cb3c-ac37-4e8f-bc00-4806a87b6fa4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:03.453553 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fc73cb3c-ac37-4e8f-bc00-4806a87b6fa4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1397 microversion: 2.1 time: 0.159851 Aug 23 18:36:03.454131 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3348/6830] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:03 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1397 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:36:04.476667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-859e01a7-85cf-4c2f-abb5-81588434030b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:04.477503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-859e01a7-85cf-4c2f-abb5-81588434030b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:04.484635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-859e01a7-85cf-4c2f-abb5-81588434030b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:04.485049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-859e01a7-85cf-4c2f-abb5-81588434030b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:04.485488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-859e01a7-85cf-4c2f-abb5-81588434030b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:04.486200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-859e01a7-85cf-4c2f-abb5-81588434030b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:04.486743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-859e01a7-85cf-4c2f-abb5-81588434030b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:04.487370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-859e01a7-85cf-4c2f-abb5-81588434030b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:04.781805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-859e01a7-85cf-4c2f-abb5-81588434030b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:04.790785 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-859e01a7-85cf-4c2f-abb5-81588434030b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1397 microversion: 2.1 time: 0.319820 Aug 23 18:36:04.791491 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3483/6831] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:04 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1397 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:05.742484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-27739830-acf8-4f16-9e27-b6b12a6e1321 req-c7dd361c-a5be-4984-9879-8d3f105656a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a62e728-05f9-4968-aa2a-297ea4bc4741", "name": "network-vif-deleted", "tag": "24f96040-2086-4102-9490-d9dd154617e6"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:36:05.758646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-27739830-acf8-4f16-9e27-b6b12a6e1321 req-c7dd361c-a5be-4984-9879-8d3f105656a2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:05.759542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-27739830-acf8-4f16-9e27-b6b12a6e1321 req-c7dd361c-a5be-4984-9879-8d3f105656a2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:05.760409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-27739830-acf8-4f16-9e27-b6b12a6e1321 req-c7dd361c-a5be-4984-9879-8d3f105656a2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:05.780717 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-27739830-acf8-4f16-9e27-b6b12a6e1321 req-c7dd361c-a5be-4984-9879-8d3f105656a2 service nova] Creating event network-vif-deleted:24f96040-2086-4102-9490-d9dd154617e6 for instance 9a62e728-05f9-4968-aa2a-297ea4bc4741 on n-h1-850468-16 Aug 23 18:36:05.791770 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-27739830-acf8-4f16-9e27-b6b12a6e1321 req-c7dd361c-a5be-4984-9879-8d3f105656a2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053065 Aug 23 18:36:05.795187 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3349/6832] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:36:05.813160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-42dd17c3-9e90-4b69-9f2a-426ed75e616c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:05.814142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-42dd17c3-9e90-4b69-9f2a-426ed75e616c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:05.823108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42dd17c3-9e90-4b69-9f2a-426ed75e616c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:05.823915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42dd17c3-9e90-4b69-9f2a-426ed75e616c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:05.824540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42dd17c3-9e90-4b69-9f2a-426ed75e616c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:05.825436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42dd17c3-9e90-4b69-9f2a-426ed75e616c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:05.826423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42dd17c3-9e90-4b69-9f2a-426ed75e616c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:05.827190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42dd17c3-9e90-4b69-9f2a-426ed75e616c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:05.917276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-42dd17c3-9e90-4b69-9f2a-426ed75e616c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:05.933694 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-42dd17c3-9e90-4b69-9f2a-426ed75e616c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1188 microversion: 2.1 time: 0.124743 Aug 23 18:36:05.934830 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3484/6833] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:05 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1188 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:36:06.958031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf206e70-8364-491c-b674-1b616145ae5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:06.959099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bf206e70-8364-491c-b674-1b616145ae5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:06.966581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf206e70-8364-491c-b674-1b616145ae5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:06.967081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf206e70-8364-491c-b674-1b616145ae5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:06.967522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf206e70-8364-491c-b674-1b616145ae5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:06.968234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf206e70-8364-491c-b674-1b616145ae5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:06.968880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf206e70-8364-491c-b674-1b616145ae5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:06.969314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf206e70-8364-491c-b674-1b616145ae5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:07.043033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bf206e70-8364-491c-b674-1b616145ae5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:07.052994 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bf206e70-8364-491c-b674-1b616145ae5d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1188 microversion: 2.1 time: 0.100623 Aug 23 18:36:07.054233 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3350/6834] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:06 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1188 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:08.075839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a35d671b-9432-4918-b3ac-1cc20389897a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:08.076457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a35d671b-9432-4918-b3ac-1cc20389897a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:08.084448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a35d671b-9432-4918-b3ac-1cc20389897a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:08.085185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a35d671b-9432-4918-b3ac-1cc20389897a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:08.085815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a35d671b-9432-4918-b3ac-1cc20389897a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:08.086855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a35d671b-9432-4918-b3ac-1cc20389897a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:08.087327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a35d671b-9432-4918-b3ac-1cc20389897a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:08.087916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a35d671b-9432-4918-b3ac-1cc20389897a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:08.169290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a35d671b-9432-4918-b3ac-1cc20389897a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:08.184413 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a35d671b-9432-4918-b3ac-1cc20389897a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1188 microversion: 2.1 time: 0.112379 Aug 23 18:36:08.185724 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3485/6835] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:08 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1188 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:36:09.212855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b4c3884e-b4de-4e2e-ba5b-691088bbf2e8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:09.214261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b4c3884e-b4de-4e2e-ba5b-691088bbf2e8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:09.225945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4c3884e-b4de-4e2e-ba5b-691088bbf2e8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:09.226881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4c3884e-b4de-4e2e-ba5b-691088bbf2e8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:09.227364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4c3884e-b4de-4e2e-ba5b-691088bbf2e8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:09.228224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4c3884e-b4de-4e2e-ba5b-691088bbf2e8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:09.228731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4c3884e-b4de-4e2e-ba5b-691088bbf2e8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:09.229462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b4c3884e-b4de-4e2e-ba5b-691088bbf2e8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:09.320931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b4c3884e-b4de-4e2e-ba5b-691088bbf2e8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:09.330066 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b4c3884e-b4de-4e2e-ba5b-691088bbf2e8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1188 microversion: 2.1 time: 0.121162 Aug 23 18:36:09.331548 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3351/6836] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:09 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1188 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:10.352548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3370d812-b71b-4e9e-ad5e-63cd43124e24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:10.353176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3370d812-b71b-4e9e-ad5e-63cd43124e24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:10.370334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3370d812-b71b-4e9e-ad5e-63cd43124e24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:10.371150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3370d812-b71b-4e9e-ad5e-63cd43124e24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:10.371815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3370d812-b71b-4e9e-ad5e-63cd43124e24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:10.372736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3370d812-b71b-4e9e-ad5e-63cd43124e24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:10.373380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3370d812-b71b-4e9e-ad5e-63cd43124e24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:10.373987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3370d812-b71b-4e9e-ad5e-63cd43124e24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:10.484197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3370d812-b71b-4e9e-ad5e-63cd43124e24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:10.495737 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3370d812-b71b-4e9e-ad5e-63cd43124e24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 200 len: 1188 microversion: 2.1 time: 0.146849 Aug 23 18:36:10.497553 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3486/6837] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:10 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 1188 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:11.518500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dd26e23e-a761-4e9a-9e0a-05a49f486750 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:11.519801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dd26e23e-a761-4e9a-9e0a-05a49f486750 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 9a62e728-05f9-4968-aa2a-297ea4bc4741] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:11.526315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd26e23e-a761-4e9a-9e0a-05a49f486750 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:11.526804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd26e23e-a761-4e9a-9e0a-05a49f486750 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:11.527387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd26e23e-a761-4e9a-9e0a-05a49f486750 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:11.528256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd26e23e-a761-4e9a-9e0a-05a49f486750 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:11.528793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd26e23e-a761-4e9a-9e0a-05a49f486750 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:11.529303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd26e23e-a761-4e9a-9e0a-05a49f486750 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:11.547871 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-dd26e23e-a761-4e9a-9e0a-05a49f486750 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance 9a62e728-05f9-4968-aa2a-297ea4bc4741 could not be found. Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dd26e23e-a761-4e9a-9e0a-05a49f486750 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 HTTP/1.1 Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 9a62e728-05f9-4968-aa2a-297ea4bc4741 could not be found. Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '9a62e728-05f9-4968-aa2a-297ea4bc4741'} Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a62e728-05f9-4968-aa2a-297ea4bc4741 could not be found. Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a62e728-05f9-4968-aa2a-297ea4bc4741 could not be found. Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:36:11.549862 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:36:11.555272 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:36:11.555272 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:36:11.555272 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:36:11.555272 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:36:11.555272 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:36:11.555272 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a62e728-05f9-4968-aa2a-297ea4bc4741 could not be found. Aug 23 18:36:11.555272 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:36:11.555272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dd26e23e-a761-4e9a-9e0a-05a49f486750 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance 9a62e728-05f9-4968-aa2a-297ea4bc4741 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:36:11.555272 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dd26e23e-a761-4e9a-9e0a-05a49f486750 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741" status: 404 len: 111 microversion: 2.1 time: 0.037962 Aug 23 18:36:11.555272 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3352/6838] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:11 2022] GET /compute/v2.1/servers/9a62e728-05f9-4968-aa2a-297ea4bc4741 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:36:13.448021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-de778359-1b97-4255-a1b2-8cce097478a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:36:13.452816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-de778359-1b97-4255-a1b2-8cce097478a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:13.461247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de778359-1b97-4255-a1b2-8cce097478a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:13.461740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de778359-1b97-4255-a1b2-8cce097478a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:13.462180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de778359-1b97-4255-a1b2-8cce097478a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:13.462914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de778359-1b97-4255-a1b2-8cce097478a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:13.463728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de778359-1b97-4255-a1b2-8cce097478a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:13.464543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de778359-1b97-4255-a1b2-8cce097478a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:13.468489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:36:13.521184 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-de778359-1b97-4255-a1b2-8cce097478a0 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "POST /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad/action" status: 200 len: 24572 microversion: 2.1 time: 0.076798 Aug 23 18:36:13.522123 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3487/6839] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:36:13 2022] POST /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad/action => generated 24572 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 18:36:36.370829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1058028366", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "181b6357-bc67-43e5-8d05-f7cc2e9109ae", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b72a85dc-9cf5-4dba-9938-31cafa49248b"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:36:36.386145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=25 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:36:36.386833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=68 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:36:36.628982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] validate_networks() for [('b72a85dc-9cf5-4dba-9938-31cafa49248b', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:36:37.106834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:36:37.107495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:36:37.108021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:36:37.108446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:36:37.108867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:36:37.119970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:37.120533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:37.120986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:37.121733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:37.122197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:37.122656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:37.147094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:36:37.154887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for user c77b0208b95843d6a5dac5c4a1ac3d8a and project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:36:37.172880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:36:37.175198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='181b6357-bc67-43e5-8d05-f7cc2e9109ae',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:36:37.257634 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8ff20b8d-e1e6-4c7b-9aa6-c673cdef8f6e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.890739 Aug 23 18:36:37.258196 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3353/6840] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:36:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 893 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:36:37.270759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac6b1314-eb81-4489-8d66-b95d03444dcc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:37.271636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac6b1314-eb81-4489-8d66-b95d03444dcc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:37.278455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:36:37.279979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:36:37.354000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac6b1314-eb81-4489-8d66-b95d03444dcc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:37.362770 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac6b1314-eb81-4489-8d66-b95d03444dcc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1057 microversion: 2.1 time: 0.097267 Aug 23 18:36:37.363669 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3488/6841] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:37 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1057 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:38.391531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc0152f2-8e80-4191-805c-ad8fc9f125f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:38.394095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc0152f2-8e80-4191-805c-ad8fc9f125f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:38.409143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc0152f2-8e80-4191-805c-ad8fc9f125f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:38.410162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc0152f2-8e80-4191-805c-ad8fc9f125f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:38.411472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc0152f2-8e80-4191-805c-ad8fc9f125f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:38.412820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc0152f2-8e80-4191-805c-ad8fc9f125f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:38.415761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc0152f2-8e80-4191-805c-ad8fc9f125f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:38.417018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc0152f2-8e80-4191-805c-ad8fc9f125f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:38.524365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bc0152f2-8e80-4191-805c-ad8fc9f125f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:38.561291 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc0152f2-8e80-4191-805c-ad8fc9f125f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1127 microversion: 2.1 time: 0.178654 Aug 23 18:36:38.561893 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3354/6842] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:38 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1127 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:39.583824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1876958f-550f-47d7-9f33-8a697b848689 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:39.584424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1876958f-550f-47d7-9f33-8a697b848689 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:39.591406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1876958f-550f-47d7-9f33-8a697b848689 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:39.592129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1876958f-550f-47d7-9f33-8a697b848689 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:39.592574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1876958f-550f-47d7-9f33-8a697b848689 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:39.593269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1876958f-550f-47d7-9f33-8a697b848689 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:39.593903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1876958f-550f-47d7-9f33-8a697b848689 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:39.594332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1876958f-550f-47d7-9f33-8a697b848689 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:39.746611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1876958f-550f-47d7-9f33-8a697b848689 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:39.757077 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1876958f-550f-47d7-9f33-8a697b848689 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.177922 Aug 23 18:36:39.758153 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3489/6843] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:39 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:40.371314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-0d8760fc-42a8-4539-a1db-7077b01432ef req-9bac5322-febf-4ffd-bb62-1311a5b1f613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f48b6e-c595-471b-a9f1-13c5dd8057db", "tag": "686b836a-4d57-49dd-85c4-b3c9b9f43097"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:36:40.400261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0d8760fc-42a8-4539-a1db-7077b01432ef req-9bac5322-febf-4ffd-bb62-1311a5b1f613 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:40.401482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0d8760fc-42a8-4539-a1db-7077b01432ef req-9bac5322-febf-4ffd-bb62-1311a5b1f613 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:40.402256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-0d8760fc-42a8-4539-a1db-7077b01432ef req-9bac5322-febf-4ffd-bb62-1311a5b1f613 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:40.425772 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-0d8760fc-42a8-4539-a1db-7077b01432ef req-9bac5322-febf-4ffd-bb62-1311a5b1f613 service nova] Creating event network-changed:686b836a-4d57-49dd-85c4-b3c9b9f43097 for instance f7f48b6e-c595-471b-a9f1-13c5dd8057db on n-h1-850468-16 Aug 23 18:36:40.433233 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-0d8760fc-42a8-4539-a1db-7077b01432ef req-9bac5322-febf-4ffd-bb62-1311a5b1f613 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068658 Aug 23 18:36:40.434534 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3355/6844] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:36:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:36:40.781363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a01c4e47-2f95-44ed-9564-db5d12bf8feb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:40.781998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a01c4e47-2f95-44ed-9564-db5d12bf8feb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:40.798027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a01c4e47-2f95-44ed-9564-db5d12bf8feb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:40.800379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a01c4e47-2f95-44ed-9564-db5d12bf8feb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:40.801572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a01c4e47-2f95-44ed-9564-db5d12bf8feb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:40.803364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a01c4e47-2f95-44ed-9564-db5d12bf8feb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:40.804218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a01c4e47-2f95-44ed-9564-db5d12bf8feb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:40.806526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a01c4e47-2f95-44ed-9564-db5d12bf8feb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:41.153854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a01c4e47-2f95-44ed-9564-db5d12bf8feb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:41.165206 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a01c4e47-2f95-44ed-9564-db5d12bf8feb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.387340 Aug 23 18:36:41.165973 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3490/6845] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:40 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:42.191109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0f7e47dc-b772-4e97-bcd2-d27975767176 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:42.192575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0f7e47dc-b772-4e97-bcd2-d27975767176 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:42.206466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f7e47dc-b772-4e97-bcd2-d27975767176 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:42.210885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f7e47dc-b772-4e97-bcd2-d27975767176 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:42.211568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f7e47dc-b772-4e97-bcd2-d27975767176 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:42.212664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f7e47dc-b772-4e97-bcd2-d27975767176 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:42.213342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f7e47dc-b772-4e97-bcd2-d27975767176 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:42.213979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f7e47dc-b772-4e97-bcd2-d27975767176 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:42.418359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0f7e47dc-b772-4e97-bcd2-d27975767176 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:42.427007 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0f7e47dc-b772-4e97-bcd2-d27975767176 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.243395 Aug 23 18:36:42.427987 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3356/6846] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:42 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:43.449441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e8e4c6ef-0e96-424a-a90d-99db39c8ecbc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:43.450658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e8e4c6ef-0e96-424a-a90d-99db39c8ecbc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:43.460992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8e4c6ef-0e96-424a-a90d-99db39c8ecbc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:43.461862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8e4c6ef-0e96-424a-a90d-99db39c8ecbc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:43.462596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8e4c6ef-0e96-424a-a90d-99db39c8ecbc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:43.463757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8e4c6ef-0e96-424a-a90d-99db39c8ecbc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:43.465220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8e4c6ef-0e96-424a-a90d-99db39c8ecbc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:43.466245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e8e4c6ef-0e96-424a-a90d-99db39c8ecbc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:43.734762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e8e4c6ef-0e96-424a-a90d-99db39c8ecbc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:43.747286 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e8e4c6ef-0e96-424a-a90d-99db39c8ecbc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.302048 Aug 23 18:36:43.755367 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3491/6847] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:43 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:44.773526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c3078e4f-2dba-45ca-81d1-23ce1636baa3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:44.774792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c3078e4f-2dba-45ca-81d1-23ce1636baa3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:44.787547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3078e4f-2dba-45ca-81d1-23ce1636baa3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:44.790166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3078e4f-2dba-45ca-81d1-23ce1636baa3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:44.792133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3078e4f-2dba-45ca-81d1-23ce1636baa3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:44.793066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3078e4f-2dba-45ca-81d1-23ce1636baa3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:44.796965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3078e4f-2dba-45ca-81d1-23ce1636baa3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:44.797702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3078e4f-2dba-45ca-81d1-23ce1636baa3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:45.057174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c3078e4f-2dba-45ca-81d1-23ce1636baa3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:45.068041 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c3078e4f-2dba-45ca-81d1-23ce1636baa3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.298692 Aug 23 18:36:45.068791 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3357/6848] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:44 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:46.001353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4fdbeb7d-57cd-4b4c-afbd-ef70afd2d3d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:46.002069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4fdbeb7d-57cd-4b4c-afbd-ef70afd2d3d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:46.012439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4fdbeb7d-57cd-4b4c-afbd-ef70afd2d3d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:46.013018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4fdbeb7d-57cd-4b4c-afbd-ef70afd2d3d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:46.013526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4fdbeb7d-57cd-4b4c-afbd-ef70afd2d3d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:46.014255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4fdbeb7d-57cd-4b4c-afbd-ef70afd2d3d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:46.014754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4fdbeb7d-57cd-4b4c-afbd-ef70afd2d3d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:46.015190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4fdbeb7d-57cd-4b4c-afbd-ef70afd2d3d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:46.035387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1e7915e0-d97e-4ee1-87c0-f2e57eb8dd49 req-0a4b43c4-cd86-4823-a228-d43533f12855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f036fec-6fc7-4d25-8262-91c63d4004ad", "tag": "913d6a7f-e98e-4663-bf84-b15992836ee5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:36:46.046010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4fdbeb7d-57cd-4b4c-afbd-ef70afd2d3d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:36:46.068193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1e7915e0-d97e-4ee1-87c0-f2e57eb8dd49 req-0a4b43c4-cd86-4823-a228-d43533f12855 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:46.069394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1e7915e0-d97e-4ee1-87c0-f2e57eb8dd49 req-0a4b43c4-cd86-4823-a228-d43533f12855 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:46.070208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1e7915e0-d97e-4ee1-87c0-f2e57eb8dd49 req-0a4b43c4-cd86-4823-a228-d43533f12855 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:46.089880 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1e7915e0-d97e-4ee1-87c0-f2e57eb8dd49 req-0a4b43c4-cd86-4823-a228-d43533f12855 service nova] Creating event network-changed:913d6a7f-e98e-4663-bf84-b15992836ee5 for instance 5f036fec-6fc7-4d25-8262-91c63d4004ad on n-h2-850468-16 Aug 23 18:36:46.098361 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1e7915e0-d97e-4ee1-87c0-f2e57eb8dd49 req-0a4b43c4-cd86-4823-a228-d43533f12855 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073710 Aug 23 18:36:46.099880 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3358/6849] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:36:46.121526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb63f380-674a-444a-90d4-a04222b173f3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:46.122936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eb63f380-674a-444a-90d4-a04222b173f3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:46.150371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb63f380-674a-444a-90d4-a04222b173f3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:46.153909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb63f380-674a-444a-90d4-a04222b173f3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:46.154751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb63f380-674a-444a-90d4-a04222b173f3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:46.155989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb63f380-674a-444a-90d4-a04222b173f3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:46.160163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb63f380-674a-444a-90d4-a04222b173f3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:46.163104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb63f380-674a-444a-90d4-a04222b173f3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:46.319075 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4fdbeb7d-57cd-4b4c-afbd-ef70afd2d3d6 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 204 len: 0 microversion: 2.1 time: 0.320951 Aug 23 18:36:46.321266 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3492/6850] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:36:45 2022] DELETE /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:36:46.339937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9a375980-4c79-4c27-8f4e-2f851f807a62 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:46.341252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9a375980-4c79-4c27-8f4e-2f851f807a62 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:46.353492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a375980-4c79-4c27-8f4e-2f851f807a62 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:46.359159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a375980-4c79-4c27-8f4e-2f851f807a62 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:46.364630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a375980-4c79-4c27-8f4e-2f851f807a62 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:46.365411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a375980-4c79-4c27-8f4e-2f851f807a62 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:46.365901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a375980-4c79-4c27-8f4e-2f851f807a62 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:46.366350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9a375980-4c79-4c27-8f4e-2f851f807a62 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:46.714204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9a375980-4c79-4c27-8f4e-2f851f807a62 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:46.727952 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9a375980-4c79-4c27-8f4e-2f851f807a62 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1690 microversion: 2.1 time: 0.399886 Aug 23 18:36:46.728922 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3493/6851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:46 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1690 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:46.892536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eb63f380-674a-444a-90d4-a04222b173f3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:46.906990 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eb63f380-674a-444a-90d4-a04222b173f3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.805244 Aug 23 18:36:46.921820 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3359/6852] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:46 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:47.774053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e9df2593-cc13-45a3-8f0e-d6dfabfce3fc tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:47.774716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e9df2593-cc13-45a3-8f0e-d6dfabfce3fc tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:47.777794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:36:47.795015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9df2593-cc13-45a3-8f0e-d6dfabfce3fc tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:47.795653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9df2593-cc13-45a3-8f0e-d6dfabfce3fc tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:47.795966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9df2593-cc13-45a3-8f0e-d6dfabfce3fc tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:47.796680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9df2593-cc13-45a3-8f0e-d6dfabfce3fc tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:47.797140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9df2593-cc13-45a3-8f0e-d6dfabfce3fc tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:47.797569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e9df2593-cc13-45a3-8f0e-d6dfabfce3fc tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:47.928978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-209a58b2-627e-4718-a66f-c7c16d5ce464 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:47.930637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-209a58b2-627e-4718-a66f-c7c16d5ce464 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:47.933738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:36:47.934692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:36:47.945640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-209a58b2-627e-4718-a66f-c7c16d5ce464 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:47.948328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-209a58b2-627e-4718-a66f-c7c16d5ce464 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:47.950738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-209a58b2-627e-4718-a66f-c7c16d5ce464 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:47.951864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-209a58b2-627e-4718-a66f-c7c16d5ce464 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:47.952480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-209a58b2-627e-4718-a66f-c7c16d5ce464 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:47.958433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-209a58b2-627e-4718-a66f-c7c16d5ce464 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:48.184501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e9df2593-cc13-45a3-8f0e-d6dfabfce3fc tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:48.197761 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e9df2593-cc13-45a3-8f0e-d6dfabfce3fc tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1690 microversion: 2.1 time: 0.427983 Aug 23 18:36:48.198726 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3494/6853] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:47 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1690 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:36:48.228140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-209a58b2-627e-4718-a66f-c7c16d5ce464 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:48.238154 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-209a58b2-627e-4718-a66f-c7c16d5ce464 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.313227 Aug 23 18:36:48.258125 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3360/6854] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:47 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:36:48.703752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6c6eca1e-d4e2-420c-8a1a-4258bf84e8df req-01301b34-5306-464e-b39a-03d07bd8f100 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f036fec-6fc7-4d25-8262-91c63d4004ad", "name": "network-vif-deleted", "tag": "913d6a7f-e98e-4663-bf84-b15992836ee5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:36:48.725763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6c6eca1e-d4e2-420c-8a1a-4258bf84e8df req-01301b34-5306-464e-b39a-03d07bd8f100 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:48.726617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6c6eca1e-d4e2-420c-8a1a-4258bf84e8df req-01301b34-5306-464e-b39a-03d07bd8f100 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:48.727414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6c6eca1e-d4e2-420c-8a1a-4258bf84e8df req-01301b34-5306-464e-b39a-03d07bd8f100 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:48.749433 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6c6eca1e-d4e2-420c-8a1a-4258bf84e8df req-01301b34-5306-464e-b39a-03d07bd8f100 service nova] Creating event network-vif-deleted:913d6a7f-e98e-4663-bf84-b15992836ee5 for instance 5f036fec-6fc7-4d25-8262-91c63d4004ad on n-h2-850468-16 Aug 23 18:36:48.783220 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6c6eca1e-d4e2-420c-8a1a-4258bf84e8df req-01301b34-5306-464e-b39a-03d07bd8f100 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083710 Aug 23 18:36:48.793246 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3495/6855] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:36:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:36:49.228310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:49.228955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:49.258328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:49.263007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:49.263472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:49.264933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:49.267232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:49.270160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:49.270492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-941c5715-e12f-4f3c-9090-cf7519667883 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:49.271250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-941c5715-e12f-4f3c-9090-cf7519667883 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:49.294074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-941c5715-e12f-4f3c-9090-cf7519667883 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:49.304795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-941c5715-e12f-4f3c-9090-cf7519667883 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:49.313242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-941c5715-e12f-4f3c-9090-cf7519667883 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:49.321893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-941c5715-e12f-4f3c-9090-cf7519667883 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:49.322517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-941c5715-e12f-4f3c-9090-cf7519667883 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:49.352910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-941c5715-e12f-4f3c-9090-cf7519667883 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.030s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:49.379483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:49.380353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:49.381036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:49.381755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lazy-loading 'fault' on Instance uuid 5f036fec-6fc7-4d25-8262-91c63d4004ad {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:36:49.595009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '399d321c5f564e8ba9d3e1ed7ae05184', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3be0a88f743407f9f59a08be6b73a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:49.621347 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-78f4ff3f-82f9-422e-8b64-093ed1134758 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 200 len: 1357 microversion: 2.1 time: 0.398294 Aug 23 18:36:49.623508 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3361/6856] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:49 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 1357 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:49.687774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-941c5715-e12f-4f3c-9090-cf7519667883 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:49.703743 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-941c5715-e12f-4f3c-9090-cf7519667883 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.435339 Aug 23 18:36:49.706563 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3496/6857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:49 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:36:50.657689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fb83e779-7cca-4da5-9590-fd0193e065f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:50.662213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fb83e779-7cca-4da5-9590-fd0193e065f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] [instance: 5f036fec-6fc7-4d25-8262-91c63d4004ad] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:50.677940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb83e779-7cca-4da5-9590-fd0193e065f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:50.678589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb83e779-7cca-4da5-9590-fd0193e065f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:50.679177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb83e779-7cca-4da5-9590-fd0193e065f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:50.680036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb83e779-7cca-4da5-9590-fd0193e065f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:50.680715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb83e779-7cca-4da5-9590-fd0193e065f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:50.681373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb83e779-7cca-4da5-9590-fd0193e065f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:50.697681 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-fb83e779-7cca-4da5-9590-fd0193e065f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] HTTP exception thrown: Instance 5f036fec-6fc7-4d25-8262-91c63d4004ad could not be found. Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fb83e779-7cca-4da5-9590-fd0193e065f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Request method failure captured: Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad HTTP/1.1 Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBRsdVVhpR5RMU_geeBK-NR3GIvIqLdesK6DUhp09zpynAbw0X6UfFtmOOX54Hda9Mc0jqJQ7C8EEh5MjgiSeR67w9GmLZU6f4UNZ39ll_bkclo_Oe7CkkS9H6snKI3zqjko4iBZoZ7CUVY6hBlmSeyIEToW2Imz7W3zNDzyrYaOVrRo Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: c3be0a88f743407f9f59a08be6b73a5e Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-301903974 Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_c3be0a88f743407f9f59a08be6b73a5e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c3be0a88f743407f9f59a08be6b73a5e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/c3be0a88f743407f9f59a08be6b73a5e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/c3be0a88f743407f9f59a08be6b73a5e"}]}] Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestNetworkAdvancedServerOps-301903974 Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: c3be0a88f743407f9f59a08be6b73a5e Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-301903974 Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestNetworkAdvancedServerOps-301903974-project Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 399d321c5f564e8ba9d3e1ed7ae05184 Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestNetworkAdvancedServerOps-301903974-project Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 5f036fec-6fc7-4d25-8262-91c63d4004ad could not be found. Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '5f036fec-6fc7-4d25-8262-91c63d4004ad'} Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f036fec-6fc7-4d25-8262-91c63d4004ad could not be found. Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f036fec-6fc7-4d25-8262-91c63d4004ad could not be found. Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:36:50.699721 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:36:50.704756 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:36:50.704756 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:36:50.704756 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:36:50.704756 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:36:50.704756 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:36:50.704756 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:36:50.704756 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f036fec-6fc7-4d25-8262-91c63d4004ad could not be found. Aug 23 18:36:50.704756 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:36:50.704756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fb83e779-7cca-4da5-9590-fd0193e065f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Returning 404 to user: Instance 5f036fec-6fc7-4d25-8262-91c63d4004ad could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:36:50.704756 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fb83e779-7cca-4da5-9590-fd0193e065f5 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad" status: 404 len: 111 microversion: 2.1 time: 0.055168 Aug 23 18:36:50.704756 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3362/6858] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:50 2022] GET /compute/v2.1/servers/5f036fec-6fc7-4d25-8262-91c63d4004ad => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:36:50.732678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-728f8347-93b2-4d6c-a185-242ce0c74067 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:50.733911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-728f8347-93b2-4d6c-a185-242ce0c74067 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:50.744226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-728f8347-93b2-4d6c-a185-242ce0c74067 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:50.744972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-728f8347-93b2-4d6c-a185-242ce0c74067 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:50.745586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-728f8347-93b2-4d6c-a185-242ce0c74067 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:50.746515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-728f8347-93b2-4d6c-a185-242ce0c74067 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:50.747246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-728f8347-93b2-4d6c-a185-242ce0c74067 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:50.748249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-728f8347-93b2-4d6c-a185-242ce0c74067 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:51.001738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-728f8347-93b2-4d6c-a185-242ce0c74067 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:51.009905 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-728f8347-93b2-4d6c-a185-242ce0c74067 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.281270 Aug 23 18:36:51.010502 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3497/6859] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:50 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:52.031161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff0aa101-180a-4ecd-80ad-8b0bf42e88d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:52.032598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff0aa101-180a-4ecd-80ad-8b0bf42e88d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:52.041929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff0aa101-180a-4ecd-80ad-8b0bf42e88d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:52.042697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff0aa101-180a-4ecd-80ad-8b0bf42e88d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:52.043344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff0aa101-180a-4ecd-80ad-8b0bf42e88d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:52.044229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff0aa101-180a-4ecd-80ad-8b0bf42e88d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:52.044898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff0aa101-180a-4ecd-80ad-8b0bf42e88d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:52.045494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff0aa101-180a-4ecd-80ad-8b0bf42e88d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:52.262851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff0aa101-180a-4ecd-80ad-8b0bf42e88d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:52.276236 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff0aa101-180a-4ecd-80ad-8b0bf42e88d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.248769 Aug 23 18:36:52.290457 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3363/6860] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:52 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:53.299800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-334304ad-68d2-4b9f-a063-9cd5201fea7e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:53.301312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-334304ad-68d2-4b9f-a063-9cd5201fea7e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:53.309640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-334304ad-68d2-4b9f-a063-9cd5201fea7e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:53.310331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-334304ad-68d2-4b9f-a063-9cd5201fea7e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:53.311232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-334304ad-68d2-4b9f-a063-9cd5201fea7e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:53.312169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-334304ad-68d2-4b9f-a063-9cd5201fea7e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:53.316318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-334304ad-68d2-4b9f-a063-9cd5201fea7e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:53.317071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-334304ad-68d2-4b9f-a063-9cd5201fea7e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:53.737931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-334304ad-68d2-4b9f-a063-9cd5201fea7e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:53.759491 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-334304ad-68d2-4b9f-a063-9cd5201fea7e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.464418 Aug 23 18:36:53.772138 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3498/6861] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:53 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:54.784673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d369a7cf-c147-4d10-9eb8-3bf931c8a61d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:54.785912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d369a7cf-c147-4d10-9eb8-3bf931c8a61d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:54.799111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d369a7cf-c147-4d10-9eb8-3bf931c8a61d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:54.802800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d369a7cf-c147-4d10-9eb8-3bf931c8a61d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:54.803509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d369a7cf-c147-4d10-9eb8-3bf931c8a61d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:54.804835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d369a7cf-c147-4d10-9eb8-3bf931c8a61d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:54.807313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d369a7cf-c147-4d10-9eb8-3bf931c8a61d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:54.808335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d369a7cf-c147-4d10-9eb8-3bf931c8a61d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:55.184966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d369a7cf-c147-4d10-9eb8-3bf931c8a61d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:55.194258 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d369a7cf-c147-4d10-9eb8-3bf931c8a61d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.414294 Aug 23 18:36:55.194886 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3364/6862] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:54 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:56.220630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5fbe1028-87ff-420a-9a8c-c9ea341a8436 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:56.221456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5fbe1028-87ff-420a-9a8c-c9ea341a8436 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:56.228469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fbe1028-87ff-420a-9a8c-c9ea341a8436 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:56.229036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fbe1028-87ff-420a-9a8c-c9ea341a8436 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:56.229547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fbe1028-87ff-420a-9a8c-c9ea341a8436 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:56.230320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fbe1028-87ff-420a-9a8c-c9ea341a8436 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:56.230934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fbe1028-87ff-420a-9a8c-c9ea341a8436 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:56.231433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5fbe1028-87ff-420a-9a8c-c9ea341a8436 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:56.396027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5fbe1028-87ff-420a-9a8c-c9ea341a8436 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:56.404624 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5fbe1028-87ff-420a-9a8c-c9ea341a8436 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.188123 Aug 23 18:36:56.405304 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3499/6863] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:56 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:56.533053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-54a24b0b-fff2-4979-a620-786cf5f2da93 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] Calling method '.version_select at 0x7f27df77a280>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:56.573979 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-54a24b0b-fff2-4979-a620-786cf5f2da93 tempest-TestNetworkAdvancedServerOps-301903974 tempest-TestNetworkAdvancedServerOps-301903974-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1728252424" status: 202 len: 0 microversion: 2.1 time: 0.043157 Aug 23 18:36:56.575865 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3365/6864] 10.222.0.61 () {58 vars in 1284 bytes} [Tue Aug 23 18:36:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1728252424 => generated 0 bytes in 48 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:36:57.426221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dc0873f6-15df-4f62-ac29-566141c39df3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:57.426886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc0873f6-15df-4f62-ac29-566141c39df3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:57.458426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc0873f6-15df-4f62-ac29-566141c39df3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:57.459173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc0873f6-15df-4f62-ac29-566141c39df3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:57.459627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc0873f6-15df-4f62-ac29-566141c39df3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:57.463597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc0873f6-15df-4f62-ac29-566141c39df3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:57.464054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc0873f6-15df-4f62-ac29-566141c39df3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:57.467111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dc0873f6-15df-4f62-ac29-566141c39df3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:57.674341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dc0873f6-15df-4f62-ac29-566141c39df3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:57.684266 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dc0873f6-15df-4f62-ac29-566141c39df3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1169 microversion: 2.1 time: 0.262537 Aug 23 18:36:57.685765 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3500/6865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:57 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1169 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:58.707833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec7f8712-4d94-4ac1-b2c7-b556f39c66e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:58.708544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ec7f8712-4d94-4ac1-b2c7-b556f39c66e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:58.715894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec7f8712-4d94-4ac1-b2c7-b556f39c66e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:58.716420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec7f8712-4d94-4ac1-b2c7-b556f39c66e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:58.716876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec7f8712-4d94-4ac1-b2c7-b556f39c66e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:58.717649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec7f8712-4d94-4ac1-b2c7-b556f39c66e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:58.718135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec7f8712-4d94-4ac1-b2c7-b556f39c66e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:58.718601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec7f8712-4d94-4ac1-b2c7-b556f39c66e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:58.885488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec7f8712-4d94-4ac1-b2c7-b556f39c66e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:36:58.893948 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec7f8712-4d94-4ac1-b2c7-b556f39c66e7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1203 microversion: 2.1 time: 0.191856 Aug 23 18:36:58.894559 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3366/6866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:58 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1203 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:36:59.917084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1f6a9837-07ef-4eed-b766-7cf3200164d8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:36:59.917675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1f6a9837-07ef-4eed-b766-7cf3200164d8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:36:59.925421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f6a9837-07ef-4eed-b766-7cf3200164d8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:59.925883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f6a9837-07ef-4eed-b766-7cf3200164d8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:59.926337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f6a9837-07ef-4eed-b766-7cf3200164d8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:36:59.927155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f6a9837-07ef-4eed-b766-7cf3200164d8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:36:59.927600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f6a9837-07ef-4eed-b766-7cf3200164d8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:36:59.928006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f6a9837-07ef-4eed-b766-7cf3200164d8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:00.114636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1f6a9837-07ef-4eed-b766-7cf3200164d8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:00.122929 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1f6a9837-07ef-4eed-b766-7cf3200164d8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1203 microversion: 2.1 time: 0.209822 Aug 23 18:37:00.123605 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3501/6867] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:36:59 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1203 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:01.145330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-53261a4e-46dd-4305-ad7c-2af1eac81400 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:01.146033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-53261a4e-46dd-4305-ad7c-2af1eac81400 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:01.153487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53261a4e-46dd-4305-ad7c-2af1eac81400 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:01.154173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53261a4e-46dd-4305-ad7c-2af1eac81400 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:01.154639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53261a4e-46dd-4305-ad7c-2af1eac81400 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:01.155343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53261a4e-46dd-4305-ad7c-2af1eac81400 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:01.155797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53261a4e-46dd-4305-ad7c-2af1eac81400 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:01.156221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53261a4e-46dd-4305-ad7c-2af1eac81400 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:01.305899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-53261a4e-46dd-4305-ad7c-2af1eac81400 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:01.315133 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-53261a4e-46dd-4305-ad7c-2af1eac81400 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1203 microversion: 2.1 time: 0.174884 Aug 23 18:37:01.315724 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3367/6868] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:01 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1203 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:02.336736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-da649b90-826d-4bc1-8e03-4db5d55c270c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:02.337395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-da649b90-826d-4bc1-8e03-4db5d55c270c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:02.344518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da649b90-826d-4bc1-8e03-4db5d55c270c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:02.345014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da649b90-826d-4bc1-8e03-4db5d55c270c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:02.345457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da649b90-826d-4bc1-8e03-4db5d55c270c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:02.346163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da649b90-826d-4bc1-8e03-4db5d55c270c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:02.346642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da649b90-826d-4bc1-8e03-4db5d55c270c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:02.347074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da649b90-826d-4bc1-8e03-4db5d55c270c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:02.503507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-da649b90-826d-4bc1-8e03-4db5d55c270c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:02.511480 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-da649b90-826d-4bc1-8e03-4db5d55c270c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1203 microversion: 2.1 time: 0.178666 Aug 23 18:37:02.512067 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3502/6869] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:02 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1203 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:03.533760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-815a5157-c7a3-4f00-8e66-a2e28d904569 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:03.534373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-815a5157-c7a3-4f00-8e66-a2e28d904569 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:03.541487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-815a5157-c7a3-4f00-8e66-a2e28d904569 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:03.541985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-815a5157-c7a3-4f00-8e66-a2e28d904569 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:03.542421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-815a5157-c7a3-4f00-8e66-a2e28d904569 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:03.543191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-815a5157-c7a3-4f00-8e66-a2e28d904569 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:03.543639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-815a5157-c7a3-4f00-8e66-a2e28d904569 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:03.544229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-815a5157-c7a3-4f00-8e66-a2e28d904569 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:03.692815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-815a5157-c7a3-4f00-8e66-a2e28d904569 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:03.701016 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-815a5157-c7a3-4f00-8e66-a2e28d904569 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1203 microversion: 2.1 time: 0.172499 Aug 23 18:37:03.709408 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3368/6870] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:03 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1203 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:04.723459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7207938e-e8ec-47c3-ae68-b4b837949b08 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:04.724096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7207938e-e8ec-47c3-ae68-b4b837949b08 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:04.731117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7207938e-e8ec-47c3-ae68-b4b837949b08 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:04.731626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7207938e-e8ec-47c3-ae68-b4b837949b08 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:04.732082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7207938e-e8ec-47c3-ae68-b4b837949b08 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:04.732809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7207938e-e8ec-47c3-ae68-b4b837949b08 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:04.733278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7207938e-e8ec-47c3-ae68-b4b837949b08 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:04.733710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7207938e-e8ec-47c3-ae68-b4b837949b08 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:04.916190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7207938e-e8ec-47c3-ae68-b4b837949b08 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:04.924680 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7207938e-e8ec-47c3-ae68-b4b837949b08 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1203 microversion: 2.1 time: 0.205867 Aug 23 18:37:04.925270 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3503/6871] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:04 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1203 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:37:05.945431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd88ab51-c3a9-4540-9b89-9fe6b3d31d34 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:05.945995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd88ab51-c3a9-4540-9b89-9fe6b3d31d34 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:05.960399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd88ab51-c3a9-4540-9b89-9fe6b3d31d34 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:05.960897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd88ab51-c3a9-4540-9b89-9fe6b3d31d34 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:05.961348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd88ab51-c3a9-4540-9b89-9fe6b3d31d34 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:05.962063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd88ab51-c3a9-4540-9b89-9fe6b3d31d34 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:05.962528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd88ab51-c3a9-4540-9b89-9fe6b3d31d34 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:05.962988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd88ab51-c3a9-4540-9b89-9fe6b3d31d34 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:06.106194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bd88ab51-c3a9-4540-9b89-9fe6b3d31d34 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:06.117835 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd88ab51-c3a9-4540-9b89-9fe6b3d31d34 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1203 microversion: 2.1 time: 0.176447 Aug 23 18:37:06.118423 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3369/6872] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:05 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1203 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:07.139407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bdc6ae18-d1da-46c5-99f1-9237ed39052a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:07.140034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bdc6ae18-d1da-46c5-99f1-9237ed39052a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:07.147975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdc6ae18-d1da-46c5-99f1-9237ed39052a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:07.148661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdc6ae18-d1da-46c5-99f1-9237ed39052a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:07.149848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdc6ae18-d1da-46c5-99f1-9237ed39052a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:07.151166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdc6ae18-d1da-46c5-99f1-9237ed39052a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:07.152128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdc6ae18-d1da-46c5-99f1-9237ed39052a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:07.153527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdc6ae18-d1da-46c5-99f1-9237ed39052a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:07.183192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:37:07.312471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bdc6ae18-d1da-46c5-99f1-9237ed39052a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:07.320638 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bdc6ae18-d1da-46c5-99f1-9237ed39052a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1203 microversion: 2.1 time: 0.185458 Aug 23 18:37:07.321229 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3504/6873] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:07 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1203 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:08.343870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4fa3a427-d80b-4d6c-991f-056a8d66bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:08.345888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4fa3a427-d80b-4d6c-991f-056a8d66bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:08.353182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:37:08.355032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4fa3a427-d80b-4d6c-991f-056a8d66bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:08.355865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4fa3a427-d80b-4d6c-991f-056a8d66bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:08.356536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4fa3a427-d80b-4d6c-991f-056a8d66bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:08.357720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4fa3a427-d80b-4d6c-991f-056a8d66bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:08.358385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4fa3a427-d80b-4d6c-991f-056a8d66bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:08.359040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4fa3a427-d80b-4d6c-991f-056a8d66bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:08.366403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=83 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:37:08.526678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4fa3a427-d80b-4d6c-991f-056a8d66bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:08.537483 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4fa3a427-d80b-4d6c-991f-056a8d66bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1203 microversion: 2.1 time: 0.199113 Aug 23 18:37:08.538340 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3370/6874] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:08 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1203 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:08.641895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-fa2e71d5-6161-49b3-8e6c-236acf9115b5 req-65082e60-a0d6-4d54-a0ac-58539977470e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f48b6e-c595-471b-a9f1-13c5dd8057db", "name": "network-vif-plugged", "status": "completed", "tag": "686b836a-4d57-49dd-85c4-b3c9b9f43097"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:37:08.648710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:37:08.653172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fa2e71d5-6161-49b3-8e6c-236acf9115b5 req-65082e60-a0d6-4d54-a0ac-58539977470e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:08.653666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fa2e71d5-6161-49b3-8e6c-236acf9115b5 req-65082e60-a0d6-4d54-a0ac-58539977470e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:08.654105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fa2e71d5-6161-49b3-8e6c-236acf9115b5 req-65082e60-a0d6-4d54-a0ac-58539977470e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:08.674043 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-fa2e71d5-6161-49b3-8e6c-236acf9115b5 req-65082e60-a0d6-4d54-a0ac-58539977470e service nova] Creating event network-vif-plugged:686b836a-4d57-49dd-85c4-b3c9b9f43097 for instance f7f48b6e-c595-471b-a9f1-13c5dd8057db on n-h1-850468-16 Aug 23 18:37:08.680356 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-fa2e71d5-6161-49b3-8e6c-236acf9115b5 req-65082e60-a0d6-4d54-a0ac-58539977470e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041866 Aug 23 18:37:08.681135 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3505/6875] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:37:09.558352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-221c5105-ea7e-43d2-9633-b9d7b85dd37d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:09.559059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-221c5105-ea7e-43d2-9633-b9d7b85dd37d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:09.567049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-221c5105-ea7e-43d2-9633-b9d7b85dd37d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:09.567523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-221c5105-ea7e-43d2-9633-b9d7b85dd37d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:09.567969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-221c5105-ea7e-43d2-9633-b9d7b85dd37d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:09.568687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-221c5105-ea7e-43d2-9633-b9d7b85dd37d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:09.569146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-221c5105-ea7e-43d2-9633-b9d7b85dd37d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:09.569667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-221c5105-ea7e-43d2-9633-b9d7b85dd37d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:09.706017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-221c5105-ea7e-43d2-9633-b9d7b85dd37d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:09.713834 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-221c5105-ea7e-43d2-9633-b9d7b85dd37d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1203 microversion: 2.1 time: 0.159332 Aug 23 18:37:09.714415 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3371/6876] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:09 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1203 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:10.737968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-34f97506-dcd5-4c0a-a4f1-204cb1031f95 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:10.738700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-34f97506-dcd5-4c0a-a4f1-204cb1031f95 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:10.744995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34f97506-dcd5-4c0a-a4f1-204cb1031f95 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:10.745739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34f97506-dcd5-4c0a-a4f1-204cb1031f95 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:10.746179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34f97506-dcd5-4c0a-a4f1-204cb1031f95 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:10.746908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34f97506-dcd5-4c0a-a4f1-204cb1031f95 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:10.747364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34f97506-dcd5-4c0a-a4f1-204cb1031f95 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:10.747789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34f97506-dcd5-4c0a-a4f1-204cb1031f95 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:10.887381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-34f97506-dcd5-4c0a-a4f1-204cb1031f95 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:10.896594 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-34f97506-dcd5-4c0a-a4f1-204cb1031f95 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1390 microversion: 2.1 time: 0.164795 Aug 23 18:37:10.897185 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3506/6877] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:10 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1390 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:10.917493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-20b32436-2409-4d7e-9dc7-4293010b58f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:10.918106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-20b32436-2409-4d7e-9dc7-4293010b58f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:10.924809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20b32436-2409-4d7e-9dc7-4293010b58f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:10.926032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20b32436-2409-4d7e-9dc7-4293010b58f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:10.926476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20b32436-2409-4d7e-9dc7-4293010b58f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:10.927231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20b32436-2409-4d7e-9dc7-4293010b58f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:10.927689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20b32436-2409-4d7e-9dc7-4293010b58f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:10.928109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20b32436-2409-4d7e-9dc7-4293010b58f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:11.073555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20b32436-2409-4d7e-9dc7-4293010b58f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:11.082129 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-20b32436-2409-4d7e-9dc7-4293010b58f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1390 microversion: 2.1 time: 0.168464 Aug 23 18:37:11.082729 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3372/6878] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:10 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1390 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:11.101553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0ee8314d-ccee-4488-9eb7-f0fe083368fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:11.102173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0ee8314d-ccee-4488-9eb7-f0fe083368fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:11.108290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ee8314d-ccee-4488-9eb7-f0fe083368fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:11.108953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ee8314d-ccee-4488-9eb7-f0fe083368fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:11.109401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ee8314d-ccee-4488-9eb7-f0fe083368fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:11.110254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ee8314d-ccee-4488-9eb7-f0fe083368fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:11.110827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ee8314d-ccee-4488-9eb7-f0fe083368fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:11.111265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ee8314d-ccee-4488-9eb7-f0fe083368fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:11.245527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0ee8314d-ccee-4488-9eb7-f0fe083368fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:11.253967 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0ee8314d-ccee-4488-9eb7-f0fe083368fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1390 microversion: 2.1 time: 0.156268 Aug 23 18:37:11.254573 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3507/6879] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:11 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1390 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:11.336282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1bff0444-f5a0-428e-98c5-d677667e7ae1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:11.336792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1bff0444-f5a0-428e-98c5-d677667e7ae1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:11.344067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bff0444-f5a0-428e-98c5-d677667e7ae1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:11.344667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bff0444-f5a0-428e-98c5-d677667e7ae1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:11.345382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bff0444-f5a0-428e-98c5-d677667e7ae1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:11.346220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bff0444-f5a0-428e-98c5-d677667e7ae1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:11.347041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bff0444-f5a0-428e-98c5-d677667e7ae1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:11.347176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1bff0444-f5a0-428e-98c5-d677667e7ae1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:11.376223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1bff0444-f5a0-428e-98c5-d677667e7ae1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:37:11.457828 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1bff0444-f5a0-428e-98c5-d677667e7ae1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 204 len: 0 microversion: 2.1 time: 0.125700 Aug 23 18:37:11.458417 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3373/6880] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:37:11 2022] DELETE /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:37:11.466981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-97cbe955-fc43-4528-927b-44c9137bb9ea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:11.467611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-97cbe955-fc43-4528-927b-44c9137bb9ea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:11.474661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97cbe955-fc43-4528-927b-44c9137bb9ea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:11.475139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97cbe955-fc43-4528-927b-44c9137bb9ea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:11.475584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97cbe955-fc43-4528-927b-44c9137bb9ea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:11.476295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97cbe955-fc43-4528-927b-44c9137bb9ea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:11.476865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97cbe955-fc43-4528-927b-44c9137bb9ea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:11.477184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-97cbe955-fc43-4528-927b-44c9137bb9ea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:11.626813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-97cbe955-fc43-4528-927b-44c9137bb9ea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:11.636860 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-97cbe955-fc43-4528-927b-44c9137bb9ea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1396 microversion: 2.1 time: 0.174044 Aug 23 18:37:11.637583 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3508/6881] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:11 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1396 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:12.659055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-01858834-6dd0-4a95-b8ea-bf9c6d25ec4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:12.660400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-01858834-6dd0-4a95-b8ea-bf9c6d25ec4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:12.668354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01858834-6dd0-4a95-b8ea-bf9c6d25ec4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:12.668845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01858834-6dd0-4a95-b8ea-bf9c6d25ec4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:12.669283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01858834-6dd0-4a95-b8ea-bf9c6d25ec4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:12.669978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01858834-6dd0-4a95-b8ea-bf9c6d25ec4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:12.670574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01858834-6dd0-4a95-b8ea-bf9c6d25ec4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:12.671011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01858834-6dd0-4a95-b8ea-bf9c6d25ec4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:12.808243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-01858834-6dd0-4a95-b8ea-bf9c6d25ec4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:12.816861 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-01858834-6dd0-4a95-b8ea-bf9c6d25ec4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1396 microversion: 2.1 time: 0.163120 Aug 23 18:37:12.817424 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3374/6882] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:12 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1396 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:13.618523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-d8d0af8f-7c37-475e-9a01-e46a90650e90 req-67660d1e-4026-4821-b42c-be147d0d7e1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f48b6e-c595-471b-a9f1-13c5dd8057db", "name": "network-vif-deleted", "tag": "686b836a-4d57-49dd-85c4-b3c9b9f43097"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:37:13.630422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d8d0af8f-7c37-475e-9a01-e46a90650e90 req-67660d1e-4026-4821-b42c-be147d0d7e1d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:13.631042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d8d0af8f-7c37-475e-9a01-e46a90650e90 req-67660d1e-4026-4821-b42c-be147d0d7e1d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:13.631545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d8d0af8f-7c37-475e-9a01-e46a90650e90 req-67660d1e-4026-4821-b42c-be147d0d7e1d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:13.645936 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-d8d0af8f-7c37-475e-9a01-e46a90650e90 req-67660d1e-4026-4821-b42c-be147d0d7e1d service nova] Creating event network-vif-deleted:686b836a-4d57-49dd-85c4-b3c9b9f43097 for instance f7f48b6e-c595-471b-a9f1-13c5dd8057db on n-h1-850468-16 Aug 23 18:37:13.652125 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-d8d0af8f-7c37-475e-9a01-e46a90650e90 req-67660d1e-4026-4821-b42c-be147d0d7e1d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037165 Aug 23 18:37:13.653659 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3509/6883] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:37:13.838472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f950af69-7ba7-4a60-8d15-84fca5add46f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:13.839151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f950af69-7ba7-4a60-8d15-84fca5add46f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:13.847183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f950af69-7ba7-4a60-8d15-84fca5add46f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:13.847667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f950af69-7ba7-4a60-8d15-84fca5add46f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:13.848102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f950af69-7ba7-4a60-8d15-84fca5add46f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:13.848824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f950af69-7ba7-4a60-8d15-84fca5add46f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:13.849274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f950af69-7ba7-4a60-8d15-84fca5add46f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:13.849698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f950af69-7ba7-4a60-8d15-84fca5add46f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:13.914236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f950af69-7ba7-4a60-8d15-84fca5add46f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:13.922780 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f950af69-7ba7-4a60-8d15-84fca5add46f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1188 microversion: 2.1 time: 0.087674 Aug 23 18:37:13.923476 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3375/6884] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:13 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1188 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:14.945705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3fa96550-c74c-4067-bb23-52afa747b38b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:14.946424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3fa96550-c74c-4067-bb23-52afa747b38b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:14.953296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fa96550-c74c-4067-bb23-52afa747b38b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:14.954522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fa96550-c74c-4067-bb23-52afa747b38b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:14.955015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fa96550-c74c-4067-bb23-52afa747b38b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:14.955742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fa96550-c74c-4067-bb23-52afa747b38b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:14.956210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fa96550-c74c-4067-bb23-52afa747b38b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:14.956649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fa96550-c74c-4067-bb23-52afa747b38b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:15.029139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3fa96550-c74c-4067-bb23-52afa747b38b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:15.038265 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3fa96550-c74c-4067-bb23-52afa747b38b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1188 microversion: 2.1 time: 0.098145 Aug 23 18:37:15.038876 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3510/6885] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:14 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1188 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:16.062688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-42a68222-f16a-4540-a437-85c3ae9053c1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:16.064023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-42a68222-f16a-4540-a437-85c3ae9053c1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:16.072840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42a68222-f16a-4540-a437-85c3ae9053c1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:16.073903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42a68222-f16a-4540-a437-85c3ae9053c1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:16.075046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42a68222-f16a-4540-a437-85c3ae9053c1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:16.076333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42a68222-f16a-4540-a437-85c3ae9053c1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:16.077075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42a68222-f16a-4540-a437-85c3ae9053c1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:16.077740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-42a68222-f16a-4540-a437-85c3ae9053c1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:16.156152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-42a68222-f16a-4540-a437-85c3ae9053c1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:16.168084 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-42a68222-f16a-4540-a437-85c3ae9053c1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1188 microversion: 2.1 time: 0.112025 Aug 23 18:37:16.169282 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3376/6886] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:16 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1188 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:17.192800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03cc9120-6d84-4eef-87f9-f18ba6518cfb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:17.193413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-03cc9120-6d84-4eef-87f9-f18ba6518cfb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:17.200925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03cc9120-6d84-4eef-87f9-f18ba6518cfb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:17.201412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03cc9120-6d84-4eef-87f9-f18ba6518cfb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:17.201855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03cc9120-6d84-4eef-87f9-f18ba6518cfb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:17.202571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03cc9120-6d84-4eef-87f9-f18ba6518cfb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:17.203039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03cc9120-6d84-4eef-87f9-f18ba6518cfb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:17.204232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03cc9120-6d84-4eef-87f9-f18ba6518cfb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:17.269982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-03cc9120-6d84-4eef-87f9-f18ba6518cfb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:17.278482 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-03cc9120-6d84-4eef-87f9-f18ba6518cfb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1188 microversion: 2.1 time: 0.090422 Aug 23 18:37:17.279089 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3511/6887] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:17 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:37:18.301424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:18.302582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:18.309673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:18.310292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:18.310856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:18.311757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:18.312613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:18.313746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:18.356855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:18.357684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:18.358350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:18.359170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lazy-loading 'fault' on Instance uuid f7f48b6e-c595-471b-a9f1-13c5dd8057db {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:37:18.427706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:18.440171 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d75c7728-ff71-424d-a1f1-01045da29cc6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 200 len: 1193 microversion: 2.1 time: 0.144653 Aug 23 18:37:18.440922 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3377/6888] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:18 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 1193 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:19.465326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-146c0c87-67fc-4bbe-bf9d-8dfa4b76a266 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:19.467127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-146c0c87-67fc-4bbe-bf9d-8dfa4b76a266 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:19.476883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146c0c87-67fc-4bbe-bf9d-8dfa4b76a266 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:19.477898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146c0c87-67fc-4bbe-bf9d-8dfa4b76a266 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:19.478706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146c0c87-67fc-4bbe-bf9d-8dfa4b76a266 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:19.479534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146c0c87-67fc-4bbe-bf9d-8dfa4b76a266 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:19.480102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146c0c87-67fc-4bbe-bf9d-8dfa4b76a266 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:19.480610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-146c0c87-67fc-4bbe-bf9d-8dfa4b76a266 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:19.497759 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-146c0c87-67fc-4bbe-bf9d-8dfa4b76a266 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-146c0c87-67fc-4bbe-bf9d-8dfa4b76a266 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db HTTP/1.1 Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f7f48b6e-c595-471b-a9f1-13c5dd8057db'} Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:37:19.499613 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:37:19.506054 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:37:19.506054 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:37:19.506054 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:37:19.506054 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:37:19.506054 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:37:19.506054 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:19.506054 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:37:19.506054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-146c0c87-67fc-4bbe-bf9d-8dfa4b76a266 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:37:19.506054 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-146c0c87-67fc-4bbe-bf9d-8dfa4b76a266 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 404 len: 111 microversion: 2.1 time: 0.041286 Aug 23 18:37:19.507274 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3512/6889] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:19 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:37:21.659788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1dcef8f9-1862-425d-933a-959fd5bcfa94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:21.660439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1dcef8f9-1862-425d-933a-959fd5bcfa94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:21.672408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1dcef8f9-1862-425d-933a-959fd5bcfa94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:21.673115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1dcef8f9-1862-425d-933a-959fd5bcfa94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:21.673644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1dcef8f9-1862-425d-933a-959fd5bcfa94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:21.674448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1dcef8f9-1862-425d-933a-959fd5bcfa94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:21.675011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1dcef8f9-1862-425d-933a-959fd5bcfa94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:21.675554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1dcef8f9-1862-425d-933a-959fd5bcfa94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:21.689920 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-1dcef8f9-1862-425d-933a-959fd5bcfa94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1dcef8f9-1862-425d-933a-959fd5bcfa94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db HTTP/1.1 Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f7f48b6e-c595-471b-a9f1-13c5dd8057db'} Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:37:21.691618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1dcef8f9-1862-425d-933a-959fd5bcfa94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1dcef8f9-1862-425d-933a-959fd5bcfa94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 404 len: 111 microversion: 2.1 time: 0.037922 Aug 23 18:37:21.697132 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3378/6890] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:37:21 2022] DELETE /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:37:21.702507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8bab4d4a-7e7f-4265-b447-4131aec314cb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:21.703276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8bab4d4a-7e7f-4265-b447-4131aec314cb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: f7f48b6e-c595-471b-a9f1-13c5dd8057db] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:21.711458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bab4d4a-7e7f-4265-b447-4131aec314cb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:21.712587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bab4d4a-7e7f-4265-b447-4131aec314cb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:21.713045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bab4d4a-7e7f-4265-b447-4131aec314cb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:21.713832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bab4d4a-7e7f-4265-b447-4131aec314cb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:21.714301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bab4d4a-7e7f-4265-b447-4131aec314cb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:21.714783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8bab4d4a-7e7f-4265-b447-4131aec314cb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:21.729474 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8bab4d4a-7e7f-4265-b447-4131aec314cb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8bab4d4a-7e7f-4265-b447-4131aec314cb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db HTTP/1.1 Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f7f48b6e-c595-471b-a9f1-13c5dd8057db'} Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:37:21.731127 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:37:21.735951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:37:21.735951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:37:21.735951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:37:21.735951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:37:21.735951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:37:21.735951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. Aug 23 18:37:21.735951 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:37:21.735951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8bab4d4a-7e7f-4265-b447-4131aec314cb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance f7f48b6e-c595-471b-a9f1-13c5dd8057db could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:37:21.735951 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8bab4d4a-7e7f-4265-b447-4131aec314cb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db" status: 404 len: 111 microversion: 2.1 time: 0.034470 Aug 23 18:37:21.736778 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3513/6891] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:21 2022] GET /compute/v2.1/servers/f7f48b6e-c595-471b-a9f1-13c5dd8057db => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:37:41.307430 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:37:41.308151 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 18:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:37:43.723329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-1119288292", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "853db2dc-1038-4241-ae7a-b7e81edcf9ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "b72a85dc-9cf5-4dba-9938-31cafa49248b"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:37:43.733143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:37:43.734333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=59,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:37:43.799615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] validate_networks() for [('b72a85dc-9cf5-4dba-9938-31cafa49248b', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:37:44.197048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:37:44.197511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:37:44.198115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:37:44.198406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:37:44.198853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:37:44.210267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:44.210901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:44.211342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:44.212081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:44.212539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:44.212965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:44.230349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:37:44.236872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for user c77b0208b95843d6a5dac5c4a1ac3d8a and project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:37:44.312526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:37:44.312526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='853db2dc-1038-4241-ae7a-b7e81edcf9ed',volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:37:44.470508 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3b1707b5-d63e-46b0-89ca-db2a255bb75b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.751717 Aug 23 18:37:44.471333 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3379/6892] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:37:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:37:44.482122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-20faf517-04bf-4640-864f-bbd7fa79ab52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:44.483376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-20faf517-04bf-4640-864f-bbd7fa79ab52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:44.488003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=17 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:37:44.490687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=40 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:37:44.560668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-20faf517-04bf-4640-864f-bbd7fa79ab52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:44.570163 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-20faf517-04bf-4640-864f-bbd7fa79ab52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1071 microversion: 2.1 time: 0.091596 Aug 23 18:37:44.574691 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3514/6893] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:44 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1071 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:45.594158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b9ac19fb-ef19-49d7-83e1-e9c722168e2a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:45.595958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b9ac19fb-ef19-49d7-83e1-e9c722168e2a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:45.604504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9ac19fb-ef19-49d7-83e1-e9c722168e2a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:45.605209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9ac19fb-ef19-49d7-83e1-e9c722168e2a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:45.605885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9ac19fb-ef19-49d7-83e1-e9c722168e2a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:45.606803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9ac19fb-ef19-49d7-83e1-e9c722168e2a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:45.607360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9ac19fb-ef19-49d7-83e1-e9c722168e2a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:45.607962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b9ac19fb-ef19-49d7-83e1-e9c722168e2a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:45.700527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b9ac19fb-ef19-49d7-83e1-e9c722168e2a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:45.713443 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b9ac19fb-ef19-49d7-83e1-e9c722168e2a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1177 microversion: 2.1 time: 0.125244 Aug 23 18:37:45.714139 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3380/6894] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:45 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1177 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:46.737379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5cfa2b3b-6e94-4eda-871d-09dd373c662c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:46.738014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5cfa2b3b-6e94-4eda-871d-09dd373c662c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:46.746618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cfa2b3b-6e94-4eda-871d-09dd373c662c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:46.747523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cfa2b3b-6e94-4eda-871d-09dd373c662c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:46.747974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cfa2b3b-6e94-4eda-871d-09dd373c662c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:46.748704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cfa2b3b-6e94-4eda-871d-09dd373c662c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:46.749169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cfa2b3b-6e94-4eda-871d-09dd373c662c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:46.750197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5cfa2b3b-6e94-4eda-871d-09dd373c662c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:47.279478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5cfa2b3b-6e94-4eda-871d-09dd373c662c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:47.291964 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5cfa2b3b-6e94-4eda-871d-09dd373c662c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1229 microversion: 2.1 time: 0.558742 Aug 23 18:37:47.302581 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3515/6895] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:46 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1229 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:47.911844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-d3b5e8b5-95f2-4b64-b3cc-c2e0d2ec218a req-93b0b9e5-7486-4ec5-ad4d-3558c2ce9961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4baada99-915d-4253-b596-48658702b4b5", "tag": "5c74b88e-5c90-481b-9037-83e5fc1674c4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:37:47.928391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d3b5e8b5-95f2-4b64-b3cc-c2e0d2ec218a req-93b0b9e5-7486-4ec5-ad4d-3558c2ce9961 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:47.929488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d3b5e8b5-95f2-4b64-b3cc-c2e0d2ec218a req-93b0b9e5-7486-4ec5-ad4d-3558c2ce9961 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:47.929488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d3b5e8b5-95f2-4b64-b3cc-c2e0d2ec218a req-93b0b9e5-7486-4ec5-ad4d-3558c2ce9961 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:47.942691 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-d3b5e8b5-95f2-4b64-b3cc-c2e0d2ec218a req-93b0b9e5-7486-4ec5-ad4d-3558c2ce9961 service nova] Creating event network-changed:5c74b88e-5c90-481b-9037-83e5fc1674c4 for instance 4baada99-915d-4253-b596-48658702b4b5 on n-h2-850468-16 Aug 23 18:37:47.948098 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-d3b5e8b5-95f2-4b64-b3cc-c2e0d2ec218a req-93b0b9e5-7486-4ec5-ad4d-3558c2ce9961 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.268441 Aug 23 18:37:47.949166 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3381/6896] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:37:48.316478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4cb2be4b-0930-4041-b330-1379dbbb7ff0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:48.317080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4cb2be4b-0930-4041-b330-1379dbbb7ff0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:48.324489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cb2be4b-0930-4041-b330-1379dbbb7ff0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:48.324988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cb2be4b-0930-4041-b330-1379dbbb7ff0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:48.325778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cb2be4b-0930-4041-b330-1379dbbb7ff0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:48.326803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cb2be4b-0930-4041-b330-1379dbbb7ff0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:48.328208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cb2be4b-0930-4041-b330-1379dbbb7ff0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:48.328815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4cb2be4b-0930-4041-b330-1379dbbb7ff0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:48.551034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4cb2be4b-0930-4041-b330-1379dbbb7ff0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:48.559289 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4cb2be4b-0930-4041-b330-1379dbbb7ff0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1229 microversion: 2.1 time: 0.248271 Aug 23 18:37:48.559998 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3516/6897] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:48 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1229 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:49.587252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5bc45f01-2529-4aaf-a598-ffa513d4ce5a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:49.588770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5bc45f01-2529-4aaf-a598-ffa513d4ce5a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:49.596003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bc45f01-2529-4aaf-a598-ffa513d4ce5a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:49.596751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bc45f01-2529-4aaf-a598-ffa513d4ce5a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:49.597790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bc45f01-2529-4aaf-a598-ffa513d4ce5a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:49.598516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bc45f01-2529-4aaf-a598-ffa513d4ce5a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:49.598991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bc45f01-2529-4aaf-a598-ffa513d4ce5a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:49.599417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5bc45f01-2529-4aaf-a598-ffa513d4ce5a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:49.768500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5bc45f01-2529-4aaf-a598-ffa513d4ce5a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:49.777328 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5bc45f01-2529-4aaf-a598-ffa513d4ce5a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1229 microversion: 2.1 time: 0.198763 Aug 23 18:37:49.778435 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3382/6898] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:49 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1229 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:50.801248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-58f7f3ee-9420-4912-97ba-164f267d46e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:50.802177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-58f7f3ee-9420-4912-97ba-164f267d46e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:50.809628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f7f3ee-9420-4912-97ba-164f267d46e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:50.810129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f7f3ee-9420-4912-97ba-164f267d46e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:50.810596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f7f3ee-9420-4912-97ba-164f267d46e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:50.811330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f7f3ee-9420-4912-97ba-164f267d46e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:50.812512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f7f3ee-9420-4912-97ba-164f267d46e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:50.813062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f7f3ee-9420-4912-97ba-164f267d46e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:50.975784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-58f7f3ee-9420-4912-97ba-164f267d46e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:50.988142 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-58f7f3ee-9420-4912-97ba-164f267d46e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1229 microversion: 2.1 time: 0.190909 Aug 23 18:37:50.997288 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3517/6899] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:50 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1229 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:52.009602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b5d4ac6e-01f0-4615-b24a-7514014cdcc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:52.010213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b5d4ac6e-01f0-4615-b24a-7514014cdcc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:52.017996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5d4ac6e-01f0-4615-b24a-7514014cdcc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:52.018691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5d4ac6e-01f0-4615-b24a-7514014cdcc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:52.019210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5d4ac6e-01f0-4615-b24a-7514014cdcc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:52.020000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5d4ac6e-01f0-4615-b24a-7514014cdcc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:52.020536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5d4ac6e-01f0-4615-b24a-7514014cdcc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:52.021066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b5d4ac6e-01f0-4615-b24a-7514014cdcc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:52.162801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b5d4ac6e-01f0-4615-b24a-7514014cdcc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:52.170717 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b5d4ac6e-01f0-4615-b24a-7514014cdcc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1217 microversion: 2.1 time: 0.165249 Aug 23 18:37:52.171755 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3383/6900] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:52 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:53.193933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b114a298-de45-4023-89a0-88469a06e262 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:53.194644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b114a298-de45-4023-89a0-88469a06e262 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:53.201138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b114a298-de45-4023-89a0-88469a06e262 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:53.201628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b114a298-de45-4023-89a0-88469a06e262 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:53.202065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b114a298-de45-4023-89a0-88469a06e262 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:53.203614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b114a298-de45-4023-89a0-88469a06e262 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:53.204077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b114a298-de45-4023-89a0-88469a06e262 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:53.204508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b114a298-de45-4023-89a0-88469a06e262 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:53.345803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b114a298-de45-4023-89a0-88469a06e262 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:53.355375 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b114a298-de45-4023-89a0-88469a06e262 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1217 microversion: 2.1 time: 0.166327 Aug 23 18:37:53.356179 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3518/6901] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:53 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:37:54.378746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aa8728f4-bf60-4945-b25e-b05ebd699186 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:54.380351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aa8728f4-bf60-4945-b25e-b05ebd699186 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:54.383084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:37:54.384011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:37:54.389909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa8728f4-bf60-4945-b25e-b05ebd699186 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:54.390508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa8728f4-bf60-4945-b25e-b05ebd699186 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:54.391061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa8728f4-bf60-4945-b25e-b05ebd699186 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:54.391806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa8728f4-bf60-4945-b25e-b05ebd699186 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:54.392275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa8728f4-bf60-4945-b25e-b05ebd699186 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:54.392704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa8728f4-bf60-4945-b25e-b05ebd699186 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:54.544441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aa8728f4-bf60-4945-b25e-b05ebd699186 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:54.554391 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aa8728f4-bf60-4945-b25e-b05ebd699186 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1217 microversion: 2.1 time: 0.180202 Aug 23 18:37:54.555194 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3384/6902] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:54 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1217 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:55.576028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-52584059-00c2-4fc9-94bf-3a7b20e6a715 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:55.576645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-52584059-00c2-4fc9-94bf-3a7b20e6a715 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:55.579736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:37:55.585016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52584059-00c2-4fc9-94bf-3a7b20e6a715 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:55.585560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52584059-00c2-4fc9-94bf-3a7b20e6a715 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:55.586036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52584059-00c2-4fc9-94bf-3a7b20e6a715 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:55.586771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52584059-00c2-4fc9-94bf-3a7b20e6a715 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:55.587250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52584059-00c2-4fc9-94bf-3a7b20e6a715 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:55.587663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52584059-00c2-4fc9-94bf-3a7b20e6a715 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:55.734820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-52584059-00c2-4fc9-94bf-3a7b20e6a715 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:55.742910 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-52584059-00c2-4fc9-94bf-3a7b20e6a715 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1217 microversion: 2.1 time: 0.170672 Aug 23 18:37:55.743604 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3519/6903] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:55 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1217 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:56.763870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-654d2687-f19c-4c63-ad04-d7fb5d313506 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:56.764491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-654d2687-f19c-4c63-ad04-d7fb5d313506 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:56.771895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-654d2687-f19c-4c63-ad04-d7fb5d313506 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:56.772594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-654d2687-f19c-4c63-ad04-d7fb5d313506 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:56.773070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-654d2687-f19c-4c63-ad04-d7fb5d313506 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:56.773769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-654d2687-f19c-4c63-ad04-d7fb5d313506 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:56.774224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-654d2687-f19c-4c63-ad04-d7fb5d313506 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:56.774676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-654d2687-f19c-4c63-ad04-d7fb5d313506 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:56.917174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-654d2687-f19c-4c63-ad04-d7fb5d313506 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:56.926790 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-654d2687-f19c-4c63-ad04-d7fb5d313506 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1217 microversion: 2.1 time: 0.166780 Aug 23 18:37:56.927726 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3385/6904] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:56 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1217 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:57.948700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2fad3c90-714a-4bf2-8258-12eb015137e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:57.949263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2fad3c90-714a-4bf2-8258-12eb015137e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:57.956719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2fad3c90-714a-4bf2-8258-12eb015137e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:57.957212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2fad3c90-714a-4bf2-8258-12eb015137e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:57.957655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2fad3c90-714a-4bf2-8258-12eb015137e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:57.958361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2fad3c90-714a-4bf2-8258-12eb015137e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:57.958852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2fad3c90-714a-4bf2-8258-12eb015137e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:57.959283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2fad3c90-714a-4bf2-8258-12eb015137e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:58.091826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2fad3c90-714a-4bf2-8258-12eb015137e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:58.100887 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2fad3c90-714a-4bf2-8258-12eb015137e2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1217 microversion: 2.1 time: 0.156281 Aug 23 18:37:58.101459 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3520/6905] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:57 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1217 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:37:59.121857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bce43275-da7e-4ac4-b8f2-dc5c4cc58334 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:37:59.122409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bce43275-da7e-4ac4-b8f2-dc5c4cc58334 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:37:59.130255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bce43275-da7e-4ac4-b8f2-dc5c4cc58334 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:59.130781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bce43275-da7e-4ac4-b8f2-dc5c4cc58334 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:59.131226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bce43275-da7e-4ac4-b8f2-dc5c4cc58334 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:59.131928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bce43275-da7e-4ac4-b8f2-dc5c4cc58334 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:37:59.132385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bce43275-da7e-4ac4-b8f2-dc5c4cc58334 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:37:59.132814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bce43275-da7e-4ac4-b8f2-dc5c4cc58334 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:37:59.273037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bce43275-da7e-4ac4-b8f2-dc5c4cc58334 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:37:59.281330 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bce43275-da7e-4ac4-b8f2-dc5c4cc58334 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1217 microversion: 2.1 time: 0.163444 Aug 23 18:37:59.281920 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3386/6906] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:37:59 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1217 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:00.303153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aff209a4-e5c4-42c1-9664-50ba4bc0fa1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:00.304462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aff209a4-e5c4-42c1-9664-50ba4bc0fa1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:00.312748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aff209a4-e5c4-42c1-9664-50ba4bc0fa1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:00.313357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aff209a4-e5c4-42c1-9664-50ba4bc0fa1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:00.313801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aff209a4-e5c4-42c1-9664-50ba4bc0fa1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:00.314734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aff209a4-e5c4-42c1-9664-50ba4bc0fa1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:00.315196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aff209a4-e5c4-42c1-9664-50ba4bc0fa1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:00.315627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aff209a4-e5c4-42c1-9664-50ba4bc0fa1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:00.471082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aff209a4-e5c4-42c1-9664-50ba4bc0fa1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:00.480989 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aff209a4-e5c4-42c1-9664-50ba4bc0fa1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1217 microversion: 2.1 time: 0.182108 Aug 23 18:38:00.481728 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3521/6907] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:00 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:01.501866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a02dd565-0de0-4941-a968-d9153c1a9b4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:01.502490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a02dd565-0de0-4941-a968-d9153c1a9b4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:01.509539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a02dd565-0de0-4941-a968-d9153c1a9b4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:01.510041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a02dd565-0de0-4941-a968-d9153c1a9b4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:01.510477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a02dd565-0de0-4941-a968-d9153c1a9b4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:01.511196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a02dd565-0de0-4941-a968-d9153c1a9b4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:01.511650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a02dd565-0de0-4941-a968-d9153c1a9b4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:01.512074 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a02dd565-0de0-4941-a968-d9153c1a9b4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:01.676332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a02dd565-0de0-4941-a968-d9153c1a9b4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:01.685264 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a02dd565-0de0-4941-a968-d9153c1a9b4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1217 microversion: 2.1 time: 0.187780 Aug 23 18:38:01.694293 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3387/6908] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:01 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1217 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:02.235228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-a962dc58-273c-4032-935f-3d27a4826554 req-112b34ba-e56b-48a6-a692-4c1edd183b96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4baada99-915d-4253-b596-48658702b4b5", "name": "network-vif-plugged", "status": "completed", "tag": "5c74b88e-5c90-481b-9037-83e5fc1674c4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:38:02.249565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a962dc58-273c-4032-935f-3d27a4826554 req-112b34ba-e56b-48a6-a692-4c1edd183b96 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:02.250176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a962dc58-273c-4032-935f-3d27a4826554 req-112b34ba-e56b-48a6-a692-4c1edd183b96 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:02.250838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a962dc58-273c-4032-935f-3d27a4826554 req-112b34ba-e56b-48a6-a692-4c1edd183b96 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:02.262396 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-a962dc58-273c-4032-935f-3d27a4826554 req-112b34ba-e56b-48a6-a692-4c1edd183b96 service nova] Creating event network-vif-plugged:5c74b88e-5c90-481b-9037-83e5fc1674c4 for instance 4baada99-915d-4253-b596-48658702b4b5 on n-h2-850468-16 Aug 23 18:38:02.268670 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-a962dc58-273c-4032-935f-3d27a4826554 req-112b34ba-e56b-48a6-a692-4c1edd183b96 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038507 Aug 23 18:38:02.269288 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3522/6909] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:38:02.707695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bde56b41-da6d-4123-83d1-dafa27a827ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:02.708322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bde56b41-da6d-4123-83d1-dafa27a827ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:02.715033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bde56b41-da6d-4123-83d1-dafa27a827ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:02.715777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bde56b41-da6d-4123-83d1-dafa27a827ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:02.716222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bde56b41-da6d-4123-83d1-dafa27a827ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:02.716932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bde56b41-da6d-4123-83d1-dafa27a827ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:02.717394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bde56b41-da6d-4123-83d1-dafa27a827ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:02.718444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bde56b41-da6d-4123-83d1-dafa27a827ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:02.857073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bde56b41-da6d-4123-83d1-dafa27a827ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:02.865570 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bde56b41-da6d-4123-83d1-dafa27a827ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1217 microversion: 2.1 time: 0.161636 Aug 23 18:38:02.866148 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3388/6910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:02 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1217 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:03.888167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48e50f20-74e0-4e0a-8424-cea0e0010ad2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:03.889048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-48e50f20-74e0-4e0a-8424-cea0e0010ad2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:03.897033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48e50f20-74e0-4e0a-8424-cea0e0010ad2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:03.897611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48e50f20-74e0-4e0a-8424-cea0e0010ad2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:03.898132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48e50f20-74e0-4e0a-8424-cea0e0010ad2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:03.898983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48e50f20-74e0-4e0a-8424-cea0e0010ad2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:03.899528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48e50f20-74e0-4e0a-8424-cea0e0010ad2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:03.899973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48e50f20-74e0-4e0a-8424-cea0e0010ad2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:04.096051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-48e50f20-74e0-4e0a-8424-cea0e0010ad2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:04.104103 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48e50f20-74e0-4e0a-8424-cea0e0010ad2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1405 microversion: 2.1 time: 0.220465 Aug 23 18:38:04.104767 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3523/6911] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:03 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1405 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:04.127041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4bbb8e67-49f0-4ee6-a581-ced262e78bbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:04.128695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4bbb8e67-49f0-4ee6-a581-ced262e78bbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:04.136149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bbb8e67-49f0-4ee6-a581-ced262e78bbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:04.136645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bbb8e67-49f0-4ee6-a581-ced262e78bbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:04.137088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bbb8e67-49f0-4ee6-a581-ced262e78bbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:04.137801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bbb8e67-49f0-4ee6-a581-ced262e78bbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:04.138258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bbb8e67-49f0-4ee6-a581-ced262e78bbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:04.138722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4bbb8e67-49f0-4ee6-a581-ced262e78bbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:04.279187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4bbb8e67-49f0-4ee6-a581-ced262e78bbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:04.287609 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4bbb8e67-49f0-4ee6-a581-ced262e78bbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1405 microversion: 2.1 time: 0.166505 Aug 23 18:38:04.288190 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3389/6912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:04 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:04.308367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-340b3c43-aa97-459e-9e67-817e845cde06 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1622644948"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:38:04.310717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-340b3c43-aa97-459e-9e67-817e845cde06 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:04.316702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-340b3c43-aa97-459e-9e67-817e845cde06 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:04.317195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-340b3c43-aa97-459e-9e67-817e845cde06 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:04.317647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-340b3c43-aa97-459e-9e67-817e845cde06 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:04.318360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-340b3c43-aa97-459e-9e67-817e845cde06 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:04.318854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-340b3c43-aa97-459e-9e67-817e845cde06 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:04.319294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-340b3c43-aa97-459e-9e67-817e845cde06 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:04.413755 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.compute.api [None req-340b3c43-aa97-459e-9e67-817e845cde06 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Attempting to quiesce instance before volume snapshot. Aug 23 18:38:04.480451 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.compute.api [None req-340b3c43-aa97-459e-9e67-817e845cde06 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Aug 23 18:38:04.555725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-340b3c43-aa97-459e-9e67-817e845cde06 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Creating snapshot from volume 853db2dc-1038-4241-ae7a-b7e81edcf9ed. {{(pid=128808) snapshot_instance /opt/stack/nova/nova/compute/api.py:3496}} Aug 23 18:38:05.588901 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-340b3c43-aa97-459e-9e67-817e845cde06 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "POST /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5/action" status: 202 len: 0 microversion: 2.1 time: 1.284380 Aug 23 18:38:05.590198 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3524/6913] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:38:04 2022] POST /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5/action => generated 0 bytes in 1286 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 18:38:06.815330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-1207874764", "imageRef": "5bbd0819-b1f7-4471-b40f-25e23cd2f557", "flavorRef": "452", "networks": [{"uuid": "b72a85dc-9cf5-4dba-9938-31cafa49248b"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:38:06.875257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] validate_networks() for [('b72a85dc-9cf5-4dba-9938-31cafa49248b', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:38:07.291098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:38:07.291551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:38:07.292025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:38:07.292433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:38:07.292842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:38:07.303398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:07.304120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:07.304564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:07.305342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:07.306088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:07.306468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:07.331706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:38:07.337031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for user c77b0208b95843d6a5dac5c4a1ac3d8a and project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:38:07.350185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:38:07.352790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='73296189-c1c4-40cc-a431-c1c3d54fd322',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:38:07.433026 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-420d69fa-968d-4358-ac12-70b742cf9baa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621910 Aug 23 18:38:07.439686 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3390/6914] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:38:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 624 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:38:07.446334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dc44d8f4-cce3-4665-a9a2-10bb6b463d4a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:07.447081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dc44d8f4-cce3-4665-a9a2-10bb6b463d4a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:07.511774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dc44d8f4-cce3-4665-a9a2-10bb6b463d4a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:07.520092 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dc44d8f4-cce3-4665-a9a2-10bb6b463d4a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1230 microversion: 2.1 time: 0.078856 Aug 23 18:38:07.531167 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3525/6915] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:07 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1230 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:08.545546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-09e75369-fcf5-444b-bb46-609d77a1110e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:08.546409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-09e75369-fcf5-444b-bb46-609d77a1110e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:08.552750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09e75369-fcf5-444b-bb46-609d77a1110e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:08.553060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09e75369-fcf5-444b-bb46-609d77a1110e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:08.553711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09e75369-fcf5-444b-bb46-609d77a1110e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:08.554433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09e75369-fcf5-444b-bb46-609d77a1110e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:08.554928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09e75369-fcf5-444b-bb46-609d77a1110e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:08.555363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09e75369-fcf5-444b-bb46-609d77a1110e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:08.648628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-09e75369-fcf5-444b-bb46-609d77a1110e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:08.657294 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-09e75369-fcf5-444b-bb46-609d77a1110e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1300 microversion: 2.1 time: 0.119255 Aug 23 18:38:08.657890 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3391/6916] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:08 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1300 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:09.679693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1bbef1cb-feab-45e9-b126-110954d27d8d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:09.680409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1bbef1cb-feab-45e9-b126-110954d27d8d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:09.697293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bbef1cb-feab-45e9-b126-110954d27d8d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:09.698029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bbef1cb-feab-45e9-b126-110954d27d8d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:09.698926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bbef1cb-feab-45e9-b126-110954d27d8d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:09.699888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bbef1cb-feab-45e9-b126-110954d27d8d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:09.700693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bbef1cb-feab-45e9-b126-110954d27d8d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:09.703020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1bbef1cb-feab-45e9-b126-110954d27d8d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:09.859092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1bbef1cb-feab-45e9-b126-110954d27d8d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:09.867118 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1bbef1cb-feab-45e9-b126-110954d27d8d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1342 microversion: 2.1 time: 0.192115 Aug 23 18:38:09.876793 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3526/6917] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:09 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1342 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:10.382645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f1e42ab0-9d33-48df-af50-75d552227751 req-c62d6ead-5941-4f8e-9996-788235c431cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d04c003c-27db-418d-a4df-d73f8cf38c85", "tag": "f709075d-c21b-4808-bc9c-d3fc1bc12eb4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:38:10.396902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f1e42ab0-9d33-48df-af50-75d552227751 req-c62d6ead-5941-4f8e-9996-788235c431cd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:10.397501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f1e42ab0-9d33-48df-af50-75d552227751 req-c62d6ead-5941-4f8e-9996-788235c431cd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:10.397949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f1e42ab0-9d33-48df-af50-75d552227751 req-c62d6ead-5941-4f8e-9996-788235c431cd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:10.416061 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f1e42ab0-9d33-48df-af50-75d552227751 req-c62d6ead-5941-4f8e-9996-788235c431cd service nova] Creating event network-changed:f709075d-c21b-4808-bc9c-d3fc1bc12eb4 for instance d04c003c-27db-418d-a4df-d73f8cf38c85 on n-h1-850468-16 Aug 23 18:38:10.422595 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f1e42ab0-9d33-48df-af50-75d552227751 req-c62d6ead-5941-4f8e-9996-788235c431cd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.243848 Aug 23 18:38:10.424236 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3392/6918] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:38:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:38:10.887992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f8e6da75-fad1-4299-97b4-ad38cb09cceb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:10.889941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f8e6da75-fad1-4299-97b4-ad38cb09cceb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:10.897824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8e6da75-fad1-4299-97b4-ad38cb09cceb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:10.898710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8e6da75-fad1-4299-97b4-ad38cb09cceb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:10.899409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8e6da75-fad1-4299-97b4-ad38cb09cceb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:10.900396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8e6da75-fad1-4299-97b4-ad38cb09cceb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:10.901110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8e6da75-fad1-4299-97b4-ad38cb09cceb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:10.901780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8e6da75-fad1-4299-97b4-ad38cb09cceb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:11.081120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f8e6da75-fad1-4299-97b4-ad38cb09cceb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:11.089497 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f8e6da75-fad1-4299-97b4-ad38cb09cceb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1342 microversion: 2.1 time: 0.205298 Aug 23 18:38:11.091937 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3527/6919] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:10 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1342 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:12.116566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c0cac9f3-e44b-443b-94fc-7b7a888d9253 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:12.118069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c0cac9f3-e44b-443b-94fc-7b7a888d9253 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:12.128214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0cac9f3-e44b-443b-94fc-7b7a888d9253 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:12.129054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0cac9f3-e44b-443b-94fc-7b7a888d9253 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:12.131053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0cac9f3-e44b-443b-94fc-7b7a888d9253 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:12.132017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0cac9f3-e44b-443b-94fc-7b7a888d9253 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:12.132712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0cac9f3-e44b-443b-94fc-7b7a888d9253 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:12.133250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0cac9f3-e44b-443b-94fc-7b7a888d9253 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:12.286827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c0cac9f3-e44b-443b-94fc-7b7a888d9253 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:12.295090 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c0cac9f3-e44b-443b-94fc-7b7a888d9253 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1342 microversion: 2.1 time: 0.184398 Aug 23 18:38:12.298384 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3393/6920] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:12 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1342 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:13.318377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-17878086-f8f2-4e56-b659-321e3db6bdf2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:13.320318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-17878086-f8f2-4e56-b659-321e3db6bdf2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:13.329247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17878086-f8f2-4e56-b659-321e3db6bdf2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:13.329764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17878086-f8f2-4e56-b659-321e3db6bdf2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:13.330229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17878086-f8f2-4e56-b659-321e3db6bdf2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:13.331012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17878086-f8f2-4e56-b659-321e3db6bdf2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:13.331491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17878086-f8f2-4e56-b659-321e3db6bdf2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:13.331937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17878086-f8f2-4e56-b659-321e3db6bdf2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:13.547269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-17878086-f8f2-4e56-b659-321e3db6bdf2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:13.555305 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-17878086-f8f2-4e56-b659-321e3db6bdf2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1342 microversion: 2.1 time: 0.241473 Aug 23 18:38:13.571575 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3528/6921] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:13 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1342 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:14.587673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-16f4d15a-295f-4259-a6d4-307cadc502d2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:14.588516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-16f4d15a-295f-4259-a6d4-307cadc502d2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:14.594063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:38:14.598529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16f4d15a-295f-4259-a6d4-307cadc502d2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:14.599411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16f4d15a-295f-4259-a6d4-307cadc502d2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:14.600625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16f4d15a-295f-4259-a6d4-307cadc502d2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:14.601921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16f4d15a-295f-4259-a6d4-307cadc502d2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:14.602814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16f4d15a-295f-4259-a6d4-307cadc502d2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:14.603400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-16f4d15a-295f-4259-a6d4-307cadc502d2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:14.611844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=75 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:38:14.870585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-16f4d15a-295f-4259-a6d4-307cadc502d2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:14.881205 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-16f4d15a-295f-4259-a6d4-307cadc502d2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1342 microversion: 2.1 time: 0.299284 Aug 23 18:38:14.882103 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3394/6922] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:14 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1342 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:15.904258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4ffab385-de20-4d8a-8b37-0adfe1d0e51b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:15.905514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4ffab385-de20-4d8a-8b37-0adfe1d0e51b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:15.908850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=35 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:38:15.928352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ffab385-de20-4d8a-8b37-0adfe1d0e51b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:15.931251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ffab385-de20-4d8a-8b37-0adfe1d0e51b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:15.932472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ffab385-de20-4d8a-8b37-0adfe1d0e51b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:15.934644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ffab385-de20-4d8a-8b37-0adfe1d0e51b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:15.938685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ffab385-de20-4d8a-8b37-0adfe1d0e51b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:15.939502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4ffab385-de20-4d8a-8b37-0adfe1d0e51b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:15.966769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=83,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:38:16.136291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4ffab385-de20-4d8a-8b37-0adfe1d0e51b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:16.145624 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4ffab385-de20-4d8a-8b37-0adfe1d0e51b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1342 microversion: 2.1 time: 0.245535 Aug 23 18:38:16.146791 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3529/6923] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:15 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1342 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:17.171536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dcebd8a5-24b3-449f-a8c3-b3cc24f77dd1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:17.172180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dcebd8a5-24b3-449f-a8c3-b3cc24f77dd1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:17.180467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcebd8a5-24b3-449f-a8c3-b3cc24f77dd1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:17.181222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcebd8a5-24b3-449f-a8c3-b3cc24f77dd1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:17.182086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcebd8a5-24b3-449f-a8c3-b3cc24f77dd1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:17.183785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcebd8a5-24b3-449f-a8c3-b3cc24f77dd1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:17.183785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcebd8a5-24b3-449f-a8c3-b3cc24f77dd1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:17.184013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dcebd8a5-24b3-449f-a8c3-b3cc24f77dd1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:17.316199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:38:17.329322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dcebd8a5-24b3-449f-a8c3-b3cc24f77dd1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:17.347285 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dcebd8a5-24b3-449f-a8c3-b3cc24f77dd1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1342 microversion: 2.1 time: 0.179276 Aug 23 18:38:17.357972 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3395/6924] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:17 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1342 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:38:18.371518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dae4eb28-cf0e-47e5-90c9-ae3fe02d6d64 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:18.372237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dae4eb28-cf0e-47e5-90c9-ae3fe02d6d64 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:18.377063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:38:18.387170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dae4eb28-cf0e-47e5-90c9-ae3fe02d6d64 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:18.391085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dae4eb28-cf0e-47e5-90c9-ae3fe02d6d64 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:18.392085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dae4eb28-cf0e-47e5-90c9-ae3fe02d6d64 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:18.394588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dae4eb28-cf0e-47e5-90c9-ae3fe02d6d64 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:18.395446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dae4eb28-cf0e-47e5-90c9-ae3fe02d6d64 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:18.396370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dae4eb28-cf0e-47e5-90c9-ae3fe02d6d64 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:18.593377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dae4eb28-cf0e-47e5-90c9-ae3fe02d6d64 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:18.603603 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dae4eb28-cf0e-47e5-90c9-ae3fe02d6d64 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1342 microversion: 2.1 time: 0.236309 Aug 23 18:38:18.606451 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3530/6925] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:18 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1342 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:19.625993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93e4e5f7-e895-435e-9a8e-2665c7fc1658 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:19.626953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-93e4e5f7-e895-435e-9a8e-2665c7fc1658 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:19.636287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:38:19.645301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93e4e5f7-e895-435e-9a8e-2665c7fc1658 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:19.646094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93e4e5f7-e895-435e-9a8e-2665c7fc1658 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:19.646632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93e4e5f7-e895-435e-9a8e-2665c7fc1658 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:19.647580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93e4e5f7-e895-435e-9a8e-2665c7fc1658 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:19.648263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93e4e5f7-e895-435e-9a8e-2665c7fc1658 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:19.648888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93e4e5f7-e895-435e-9a8e-2665c7fc1658 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:19.824189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-93e4e5f7-e895-435e-9a8e-2665c7fc1658 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:19.833975 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93e4e5f7-e895-435e-9a8e-2665c7fc1658 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1342 microversion: 2.1 time: 0.213494 Aug 23 18:38:19.834601 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3396/6926] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:19 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1342 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:20.858624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-42184a63-901a-4a90-9ffe-907cd9dd0d11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:20.859295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-42184a63-901a-4a90-9ffe-907cd9dd0d11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:20.867333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42184a63-901a-4a90-9ffe-907cd9dd0d11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:20.867849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42184a63-901a-4a90-9ffe-907cd9dd0d11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:20.868305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42184a63-901a-4a90-9ffe-907cd9dd0d11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:20.869213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42184a63-901a-4a90-9ffe-907cd9dd0d11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:20.869686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42184a63-901a-4a90-9ffe-907cd9dd0d11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:20.870298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-42184a63-901a-4a90-9ffe-907cd9dd0d11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:21.107498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-42184a63-901a-4a90-9ffe-907cd9dd0d11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:21.117885 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-42184a63-901a-4a90-9ffe-907cd9dd0d11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1342 microversion: 2.1 time: 0.264984 Aug 23 18:38:21.130481 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3531/6927] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:20 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1342 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:22.140795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c1ee42e2-3997-4f19-b0aa-3ef1bf411d56 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:22.142321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c1ee42e2-3997-4f19-b0aa-3ef1bf411d56 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:22.149902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1ee42e2-3997-4f19-b0aa-3ef1bf411d56 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:22.150755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1ee42e2-3997-4f19-b0aa-3ef1bf411d56 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:22.151649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1ee42e2-3997-4f19-b0aa-3ef1bf411d56 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:22.152734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1ee42e2-3997-4f19-b0aa-3ef1bf411d56 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:22.153423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1ee42e2-3997-4f19-b0aa-3ef1bf411d56 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:22.154079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1ee42e2-3997-4f19-b0aa-3ef1bf411d56 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:22.345959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c1ee42e2-3997-4f19-b0aa-3ef1bf411d56 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:22.357192 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c1ee42e2-3997-4f19-b0aa-3ef1bf411d56 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1342 microversion: 2.1 time: 0.220603 Aug 23 18:38:22.358736 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3397/6928] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:22 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1342 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:23.380843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8d7e4839-7c89-428a-b52b-e95d959ccf85 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:23.381568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8d7e4839-7c89-428a-b52b-e95d959ccf85 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:23.392181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d7e4839-7c89-428a-b52b-e95d959ccf85 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:23.398052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d7e4839-7c89-428a-b52b-e95d959ccf85 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:23.398589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d7e4839-7c89-428a-b52b-e95d959ccf85 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:23.400512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d7e4839-7c89-428a-b52b-e95d959ccf85 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:23.400883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d7e4839-7c89-428a-b52b-e95d959ccf85 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:23.402059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8d7e4839-7c89-428a-b52b-e95d959ccf85 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:23.657787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8d7e4839-7c89-428a-b52b-e95d959ccf85 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:23.668563 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8d7e4839-7c89-428a-b52b-e95d959ccf85 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1342 microversion: 2.1 time: 0.291359 Aug 23 18:38:23.672902 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3532/6929] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:23 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1342 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:24.696140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff85c973-5b78-4860-88a1-b213892d357c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:24.697734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff85c973-5b78-4860-88a1-b213892d357c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:24.716331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff85c973-5b78-4860-88a1-b213892d357c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:24.716726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff85c973-5b78-4860-88a1-b213892d357c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:24.717715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff85c973-5b78-4860-88a1-b213892d357c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:24.718473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff85c973-5b78-4860-88a1-b213892d357c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:24.719875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff85c973-5b78-4860-88a1-b213892d357c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:24.720593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff85c973-5b78-4860-88a1-b213892d357c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:24.984377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff85c973-5b78-4860-88a1-b213892d357c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:24.995415 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff85c973-5b78-4860-88a1-b213892d357c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1376 microversion: 2.1 time: 0.302790 Aug 23 18:38:24.997007 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3398/6930] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:24 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1376 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:26.017626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-73b197d0-07ca-4dd3-b7c0-befab0bd18d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:26.018264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-73b197d0-07ca-4dd3-b7c0-befab0bd18d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:26.028122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73b197d0-07ca-4dd3-b7c0-befab0bd18d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:26.028642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73b197d0-07ca-4dd3-b7c0-befab0bd18d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:26.029109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73b197d0-07ca-4dd3-b7c0-befab0bd18d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:26.030464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73b197d0-07ca-4dd3-b7c0-befab0bd18d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:26.030974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73b197d0-07ca-4dd3-b7c0-befab0bd18d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:26.031420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73b197d0-07ca-4dd3-b7c0-befab0bd18d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:26.190768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73b197d0-07ca-4dd3-b7c0-befab0bd18d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:26.199947 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-73b197d0-07ca-4dd3-b7c0-befab0bd18d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1376 microversion: 2.1 time: 0.186165 Aug 23 18:38:26.200684 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3533/6931] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:26 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1376 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:27.223514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ef686039-1cc2-4367-9d9f-3948057d7f10 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:27.225552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ef686039-1cc2-4367-9d9f-3948057d7f10 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:27.242622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef686039-1cc2-4367-9d9f-3948057d7f10 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:27.243711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef686039-1cc2-4367-9d9f-3948057d7f10 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:27.244272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef686039-1cc2-4367-9d9f-3948057d7f10 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:27.245253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef686039-1cc2-4367-9d9f-3948057d7f10 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:27.245912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef686039-1cc2-4367-9d9f-3948057d7f10 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:27.246625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ef686039-1cc2-4367-9d9f-3948057d7f10 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:27.558771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ef686039-1cc2-4367-9d9f-3948057d7f10 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:27.569344 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ef686039-1cc2-4367-9d9f-3948057d7f10 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1376 microversion: 2.1 time: 0.350455 Aug 23 18:38:27.569936 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3399/6932] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:27 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1376 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:28.593763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-81c16851-4acd-4fd3-a5ac-5c3dfde5dc28 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:28.594425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-81c16851-4acd-4fd3-a5ac-5c3dfde5dc28 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:28.601363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81c16851-4acd-4fd3-a5ac-5c3dfde5dc28 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:28.601977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81c16851-4acd-4fd3-a5ac-5c3dfde5dc28 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:28.602623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81c16851-4acd-4fd3-a5ac-5c3dfde5dc28 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:28.603528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81c16851-4acd-4fd3-a5ac-5c3dfde5dc28 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:28.604630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81c16851-4acd-4fd3-a5ac-5c3dfde5dc28 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:28.605494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-81c16851-4acd-4fd3-a5ac-5c3dfde5dc28 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:28.790408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-81c16851-4acd-4fd3-a5ac-5c3dfde5dc28 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:28.805220 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-81c16851-4acd-4fd3-a5ac-5c3dfde5dc28 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1376 microversion: 2.1 time: 0.217741 Aug 23 18:38:28.805939 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3534/6933] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:28 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1376 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:29.827849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4920e463-a42a-446c-81cb-cbb39bfc5218 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:29.829391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4920e463-a42a-446c-81cb-cbb39bfc5218 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:29.838027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4920e463-a42a-446c-81cb-cbb39bfc5218 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:29.838688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4920e463-a42a-446c-81cb-cbb39bfc5218 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:29.839494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4920e463-a42a-446c-81cb-cbb39bfc5218 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:29.840984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4920e463-a42a-446c-81cb-cbb39bfc5218 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:29.841570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4920e463-a42a-446c-81cb-cbb39bfc5218 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:29.842967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4920e463-a42a-446c-81cb-cbb39bfc5218 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:30.109292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4920e463-a42a-446c-81cb-cbb39bfc5218 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:30.118083 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4920e463-a42a-446c-81cb-cbb39bfc5218 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1376 microversion: 2.1 time: 0.294742 Aug 23 18:38:30.118787 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3400/6934] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:29 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1376 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:31.142277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-392e669e-7fd3-42a8-8a03-108f916c0777 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:31.143566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-392e669e-7fd3-42a8-8a03-108f916c0777 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:31.150582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-392e669e-7fd3-42a8-8a03-108f916c0777 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:31.151608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-392e669e-7fd3-42a8-8a03-108f916c0777 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:31.152016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-392e669e-7fd3-42a8-8a03-108f916c0777 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:31.152899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-392e669e-7fd3-42a8-8a03-108f916c0777 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:31.153523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-392e669e-7fd3-42a8-8a03-108f916c0777 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:31.153971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-392e669e-7fd3-42a8-8a03-108f916c0777 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:31.321422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-392e669e-7fd3-42a8-8a03-108f916c0777 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:31.332867 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-392e669e-7fd3-42a8-8a03-108f916c0777 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1376 microversion: 2.1 time: 0.194899 Aug 23 18:38:31.338786 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3535/6935] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:31 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1376 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:32.360740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-10557c73-2062-4b9e-9e39-bdfb1bb7a7bb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:32.361389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-10557c73-2062-4b9e-9e39-bdfb1bb7a7bb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:32.368274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10557c73-2062-4b9e-9e39-bdfb1bb7a7bb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:32.368762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10557c73-2062-4b9e-9e39-bdfb1bb7a7bb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:32.369203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10557c73-2062-4b9e-9e39-bdfb1bb7a7bb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:32.369895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10557c73-2062-4b9e-9e39-bdfb1bb7a7bb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:32.370354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10557c73-2062-4b9e-9e39-bdfb1bb7a7bb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:32.370808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10557c73-2062-4b9e-9e39-bdfb1bb7a7bb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:32.501904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-10557c73-2062-4b9e-9e39-bdfb1bb7a7bb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:32.509709 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-10557c73-2062-4b9e-9e39-bdfb1bb7a7bb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1376 microversion: 2.1 time: 0.153640 Aug 23 18:38:32.510278 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3401/6936] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:32 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1376 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:33.532054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c563e1cf-2a4a-4a13-b952-2f6002979663 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:33.532682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c563e1cf-2a4a-4a13-b952-2f6002979663 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:33.539643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c563e1cf-2a4a-4a13-b952-2f6002979663 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:33.540148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c563e1cf-2a4a-4a13-b952-2f6002979663 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:33.540608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c563e1cf-2a4a-4a13-b952-2f6002979663 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:33.541321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c563e1cf-2a4a-4a13-b952-2f6002979663 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:33.541846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c563e1cf-2a4a-4a13-b952-2f6002979663 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:33.542348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c563e1cf-2a4a-4a13-b952-2f6002979663 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:33.695497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c563e1cf-2a4a-4a13-b952-2f6002979663 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:33.704760 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c563e1cf-2a4a-4a13-b952-2f6002979663 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1376 microversion: 2.1 time: 0.177414 Aug 23 18:38:33.705366 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3536/6937] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:33 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1376 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:34.726488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb7769e5-814b-427a-a174-0d69d5bf5f70 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:34.727133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eb7769e5-814b-427a-a174-0d69d5bf5f70 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:34.735104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb7769e5-814b-427a-a174-0d69d5bf5f70 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:34.735607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb7769e5-814b-427a-a174-0d69d5bf5f70 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:34.736051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb7769e5-814b-427a-a174-0d69d5bf5f70 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:34.736755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb7769e5-814b-427a-a174-0d69d5bf5f70 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:34.737205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb7769e5-814b-427a-a174-0d69d5bf5f70 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:34.737634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb7769e5-814b-427a-a174-0d69d5bf5f70 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:34.900435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eb7769e5-814b-427a-a174-0d69d5bf5f70 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:34.913896 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eb7769e5-814b-427a-a174-0d69d5bf5f70 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1376 microversion: 2.1 time: 0.190734 Aug 23 18:38:34.915471 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3402/6938] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:34 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1376 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:35.096045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-b54d7fc5-46ba-4a46-9074-c1e900aca1cb req-40301fff-e676-4006-b5b1-bd2fb1c0981a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04c003c-27db-418d-a4df-d73f8cf38c85", "name": "network-vif-plugged", "status": "completed", "tag": "f709075d-c21b-4808-bc9c-d3fc1bc12eb4"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:38:35.112439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b54d7fc5-46ba-4a46-9074-c1e900aca1cb req-40301fff-e676-4006-b5b1-bd2fb1c0981a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:35.112936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b54d7fc5-46ba-4a46-9074-c1e900aca1cb req-40301fff-e676-4006-b5b1-bd2fb1c0981a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:35.113453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b54d7fc5-46ba-4a46-9074-c1e900aca1cb req-40301fff-e676-4006-b5b1-bd2fb1c0981a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:35.127729 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b54d7fc5-46ba-4a46-9074-c1e900aca1cb req-40301fff-e676-4006-b5b1-bd2fb1c0981a service nova] Creating event network-vif-plugged:f709075d-c21b-4808-bc9c-d3fc1bc12eb4 for instance d04c003c-27db-418d-a4df-d73f8cf38c85 on n-h1-850468-16 Aug 23 18:38:35.135612 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-b54d7fc5-46ba-4a46-9074-c1e900aca1cb req-40301fff-e676-4006-b5b1-bd2fb1c0981a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208547 Aug 23 18:38:35.136410 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3537/6939] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:38:35.936263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-223d0292-d6b7-467d-bff5-f5f9b0e91c94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:35.936881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-223d0292-d6b7-467d-bff5-f5f9b0e91c94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:35.945239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-223d0292-d6b7-467d-bff5-f5f9b0e91c94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:35.945859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-223d0292-d6b7-467d-bff5-f5f9b0e91c94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:35.946298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-223d0292-d6b7-467d-bff5-f5f9b0e91c94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:35.947015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-223d0292-d6b7-467d-bff5-f5f9b0e91c94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:35.947470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-223d0292-d6b7-467d-bff5-f5f9b0e91c94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:35.947894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-223d0292-d6b7-467d-bff5-f5f9b0e91c94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:36.105298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-223d0292-d6b7-467d-bff5-f5f9b0e91c94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:36.116216 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-223d0292-d6b7-467d-bff5-f5f9b0e91c94 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1376 microversion: 2.1 time: 0.183955 Aug 23 18:38:36.116933 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3403/6940] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:35 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1376 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:37.139433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2a862125-193c-429c-970d-07b6224c2e6f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:37.140863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2a862125-193c-429c-970d-07b6224c2e6f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:37.149062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a862125-193c-429c-970d-07b6224c2e6f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:37.149637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a862125-193c-429c-970d-07b6224c2e6f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:37.150309 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a862125-193c-429c-970d-07b6224c2e6f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:37.151080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a862125-193c-429c-970d-07b6224c2e6f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:37.151548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a862125-193c-429c-970d-07b6224c2e6f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:37.152037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a862125-193c-429c-970d-07b6224c2e6f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:37.303869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2a862125-193c-429c-970d-07b6224c2e6f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:37.311772 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2a862125-193c-429c-970d-07b6224c2e6f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1563 microversion: 2.1 time: 0.177723 Aug 23 18:38:37.312967 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3538/6941] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:37 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1563 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:37.333082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-abce07b2-a717-4295-9032-f77430fab32b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:37.333628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-abce07b2-a717-4295-9032-f77430fab32b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:37.340750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abce07b2-a717-4295-9032-f77430fab32b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:37.341228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abce07b2-a717-4295-9032-f77430fab32b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:37.341670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abce07b2-a717-4295-9032-f77430fab32b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:37.342356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abce07b2-a717-4295-9032-f77430fab32b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:37.342837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abce07b2-a717-4295-9032-f77430fab32b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:37.343348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-abce07b2-a717-4295-9032-f77430fab32b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:37.481627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-abce07b2-a717-4295-9032-f77430fab32b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:37.492906 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-abce07b2-a717-4295-9032-f77430fab32b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1563 microversion: 2.1 time: 0.163711 Aug 23 18:38:37.493507 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3404/6942] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:37 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1563 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:37.572287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7614b982-7124-4cfa-9583-0f85f2e5bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:37.572810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7614b982-7124-4cfa-9583-0f85f2e5bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:37.579694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7614b982-7124-4cfa-9583-0f85f2e5bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:37.580258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7614b982-7124-4cfa-9583-0f85f2e5bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:37.580695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7614b982-7124-4cfa-9583-0f85f2e5bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:37.581542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7614b982-7124-4cfa-9583-0f85f2e5bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:37.582014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7614b982-7124-4cfa-9583-0f85f2e5bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:37.582456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7614b982-7124-4cfa-9583-0f85f2e5bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:37.615123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7614b982-7124-4cfa-9583-0f85f2e5bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:38:37.700280 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7614b982-7124-4cfa-9583-0f85f2e5bf4d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 204 len: 0 microversion: 2.1 time: 0.132007 Aug 23 18:38:37.701397 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3539/6943] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:38:37 2022] DELETE /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:38:37.711725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3a8ee09c-de81-4e85-9b50-bf2888643a58 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:37.712347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3a8ee09c-de81-4e85-9b50-bf2888643a58 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:37.719506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a8ee09c-de81-4e85-9b50-bf2888643a58 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:37.720054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a8ee09c-de81-4e85-9b50-bf2888643a58 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:37.720508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a8ee09c-de81-4e85-9b50-bf2888643a58 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:37.721324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a8ee09c-de81-4e85-9b50-bf2888643a58 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:37.721784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a8ee09c-de81-4e85-9b50-bf2888643a58 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:37.722215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a8ee09c-de81-4e85-9b50-bf2888643a58 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:37.859458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3a8ee09c-de81-4e85-9b50-bf2888643a58 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:37.867962 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3a8ee09c-de81-4e85-9b50-bf2888643a58 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1569 microversion: 2.1 time: 0.160225 Aug 23 18:38:37.868465 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3405/6944] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:37 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:38.889754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-20c42f1c-47bd-452d-8030-bc66cbf536ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:38.891156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-20c42f1c-47bd-452d-8030-bc66cbf536ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:38.898243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20c42f1c-47bd-452d-8030-bc66cbf536ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:38.898788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20c42f1c-47bd-452d-8030-bc66cbf536ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:38.899337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20c42f1c-47bd-452d-8030-bc66cbf536ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:38.900059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20c42f1c-47bd-452d-8030-bc66cbf536ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:38.900534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20c42f1c-47bd-452d-8030-bc66cbf536ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:38.900979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20c42f1c-47bd-452d-8030-bc66cbf536ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:39.038165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-20c42f1c-47bd-452d-8030-bc66cbf536ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:39.045924 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-20c42f1c-47bd-452d-8030-bc66cbf536ca tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1569 microversion: 2.1 time: 0.160530 Aug 23 18:38:39.046635 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3540/6945] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:38 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:39.771570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-7e943119-f7c8-44d1-a6d1-cc5e8413938e req-288e1070-5f08-4a53-b061-499c905e2907 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d04c003c-27db-418d-a4df-d73f8cf38c85", "name": "network-vif-deleted", "tag": "f709075d-c21b-4808-bc9c-d3fc1bc12eb4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:38:39.789256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7e943119-f7c8-44d1-a6d1-cc5e8413938e req-288e1070-5f08-4a53-b061-499c905e2907 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:39.790005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7e943119-f7c8-44d1-a6d1-cc5e8413938e req-288e1070-5f08-4a53-b061-499c905e2907 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:39.790489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7e943119-f7c8-44d1-a6d1-cc5e8413938e req-288e1070-5f08-4a53-b061-499c905e2907 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:39.806384 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-7e943119-f7c8-44d1-a6d1-cc5e8413938e req-288e1070-5f08-4a53-b061-499c905e2907 service nova] Creating event network-vif-deleted:f709075d-c21b-4808-bc9c-d3fc1bc12eb4 for instance d04c003c-27db-418d-a4df-d73f8cf38c85 on n-h1-850468-16 Aug 23 18:38:39.812370 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-7e943119-f7c8-44d1-a6d1-cc5e8413938e req-288e1070-5f08-4a53-b061-499c905e2907 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047603 Aug 23 18:38:39.813298 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3406/6946] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:38:40.068033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d95b9902-540f-4139-ac69-26a17dcbc03e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:40.068601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d95b9902-540f-4139-ac69-26a17dcbc03e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:40.075477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95b9902-540f-4139-ac69-26a17dcbc03e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:40.075967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95b9902-540f-4139-ac69-26a17dcbc03e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:40.076437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95b9902-540f-4139-ac69-26a17dcbc03e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:40.077218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95b9902-540f-4139-ac69-26a17dcbc03e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:40.078191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95b9902-540f-4139-ac69-26a17dcbc03e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:40.078654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95b9902-540f-4139-ac69-26a17dcbc03e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:40.144727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d95b9902-540f-4139-ac69-26a17dcbc03e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:40.152598 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d95b9902-540f-4139-ac69-26a17dcbc03e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1361 microversion: 2.1 time: 0.088677 Aug 23 18:38:40.153167 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3541/6947] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:40 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1361 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:41.175443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-39b6dc1b-1e5e-49b8-a260-22f0255119cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:41.176150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-39b6dc1b-1e5e-49b8-a260-22f0255119cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:41.183364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39b6dc1b-1e5e-49b8-a260-22f0255119cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:41.184018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39b6dc1b-1e5e-49b8-a260-22f0255119cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:41.184502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39b6dc1b-1e5e-49b8-a260-22f0255119cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:41.185254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39b6dc1b-1e5e-49b8-a260-22f0255119cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:41.185797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39b6dc1b-1e5e-49b8-a260-22f0255119cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:41.186231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-39b6dc1b-1e5e-49b8-a260-22f0255119cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:41.255171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-39b6dc1b-1e5e-49b8-a260-22f0255119cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:41.263116 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-39b6dc1b-1e5e-49b8-a260-22f0255119cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1361 microversion: 2.1 time: 0.093062 Aug 23 18:38:41.266592 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3407/6948] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:41 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1361 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:38:42.285444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e7b99dfc-f7f0-45f9-8146-aac11846ac09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:42.286206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e7b99dfc-f7f0-45f9-8146-aac11846ac09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:42.293936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7b99dfc-f7f0-45f9-8146-aac11846ac09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:42.294450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7b99dfc-f7f0-45f9-8146-aac11846ac09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:42.294945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7b99dfc-f7f0-45f9-8146-aac11846ac09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:42.295696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7b99dfc-f7f0-45f9-8146-aac11846ac09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:42.296169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7b99dfc-f7f0-45f9-8146-aac11846ac09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:42.298086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7b99dfc-f7f0-45f9-8146-aac11846ac09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:42.363003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e7b99dfc-f7f0-45f9-8146-aac11846ac09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:42.370927 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e7b99dfc-f7f0-45f9-8146-aac11846ac09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1361 microversion: 2.1 time: 0.090448 Aug 23 18:38:42.371505 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3542/6949] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:42 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1361 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:43.394701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-79d010cd-e419-47bb-9376-a9180467cf1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:43.395268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-79d010cd-e419-47bb-9376-a9180467cf1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:43.401442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79d010cd-e419-47bb-9376-a9180467cf1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:43.401958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79d010cd-e419-47bb-9376-a9180467cf1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:43.402402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79d010cd-e419-47bb-9376-a9180467cf1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:43.403129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79d010cd-e419-47bb-9376-a9180467cf1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:43.403667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79d010cd-e419-47bb-9376-a9180467cf1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:43.404356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-79d010cd-e419-47bb-9376-a9180467cf1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:43.471554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-79d010cd-e419-47bb-9376-a9180467cf1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:43.479669 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-79d010cd-e419-47bb-9376-a9180467cf1f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1361 microversion: 2.1 time: 0.090901 Aug 23 18:38:43.480689 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3408/6950] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:43 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1361 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:44.502464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:44.503127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:44.520152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:44.520676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:44.523733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:44.524531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:44.525045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:44.525664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:44.572210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:44.572721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:44.573379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:44.574075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lazy-loading 'fault' on Instance uuid d04c003c-27db-418d-a4df-d73f8cf38c85 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:38:44.625310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:44.633332 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-26bc0131-de7f-4426-b6ed-dd1a711b480d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 200 len: 1320 microversion: 2.1 time: 0.136016 Aug 23 18:38:44.648347 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3543/6951] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:44 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 1320 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:45.656823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-551dc0b1-65a8-4b33-9f7b-d8f634587425 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:45.657608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-551dc0b1-65a8-4b33-9f7b-d8f634587425 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:45.660994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=30 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:38:45.667224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-551dc0b1-65a8-4b33-9f7b-d8f634587425 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:45.667817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-551dc0b1-65a8-4b33-9f7b-d8f634587425 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:45.668384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-551dc0b1-65a8-4b33-9f7b-d8f634587425 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:45.669248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-551dc0b1-65a8-4b33-9f7b-d8f634587425 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:45.669876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-551dc0b1-65a8-4b33-9f7b-d8f634587425 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:45.670514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-551dc0b1-65a8-4b33-9f7b-d8f634587425 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:45.673905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=86 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:38:45.688580 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-551dc0b1-65a8-4b33-9f7b-d8f634587425 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-551dc0b1-65a8-4b33-9f7b-d8f634587425 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 HTTP/1.1 Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'd04c003c-27db-418d-a4df-d73f8cf38c85'} Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:38:45.690263 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:45.695220 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:45.695220 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:38:45.695220 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:38:45.695220 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:38:45.695220 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:38:45.695220 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:45.695220 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:45.695220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-551dc0b1-65a8-4b33-9f7b-d8f634587425 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:38:45.695220 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-551dc0b1-65a8-4b33-9f7b-d8f634587425 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 404 len: 111 microversion: 2.1 time: 0.040049 Aug 23 18:38:45.695220 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3409/6952] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:45 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:38:50.005661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b59c83cb-932b-4881-a13c-3e6b75312a8b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:50.006198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b59c83cb-932b-4881-a13c-3e6b75312a8b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:50.009184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:38:50.014447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b59c83cb-932b-4881-a13c-3e6b75312a8b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:50.015720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b59c83cb-932b-4881-a13c-3e6b75312a8b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:50.016181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b59c83cb-932b-4881-a13c-3e6b75312a8b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:50.016903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b59c83cb-932b-4881-a13c-3e6b75312a8b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:50.017380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b59c83cb-932b-4881-a13c-3e6b75312a8b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:50.017830 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b59c83cb-932b-4881-a13c-3e6b75312a8b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:50.021331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:38:50.045336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b59c83cb-932b-4881-a13c-3e6b75312a8b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:38:50.123689 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b59c83cb-932b-4881-a13c-3e6b75312a8b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 204 len: 0 microversion: 2.1 time: 0.121577 Aug 23 18:38:50.124999 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3544/6953] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:38:50 2022] DELETE /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:38:50.133412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f012eb88-a78a-44c9-bab5-876b6ce6727c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:50.134034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f012eb88-a78a-44c9-bab5-876b6ce6727c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:50.141873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f012eb88-a78a-44c9-bab5-876b6ce6727c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:50.142359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f012eb88-a78a-44c9-bab5-876b6ce6727c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:50.142825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f012eb88-a78a-44c9-bab5-876b6ce6727c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:50.143527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f012eb88-a78a-44c9-bab5-876b6ce6727c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:50.144001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f012eb88-a78a-44c9-bab5-876b6ce6727c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:50.144408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f012eb88-a78a-44c9-bab5-876b6ce6727c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:50.276998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f012eb88-a78a-44c9-bab5-876b6ce6727c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:50.284888 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f012eb88-a78a-44c9-bab5-876b6ce6727c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1411 microversion: 2.1 time: 0.155576 Aug 23 18:38:50.285451 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3410/6954] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:50 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1411 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:51.308374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-033dd779-5fca-47a0-9321-3a8f9807d07d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:51.309142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-033dd779-5fca-47a0-9321-3a8f9807d07d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:51.318439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-033dd779-5fca-47a0-9321-3a8f9807d07d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:51.318966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-033dd779-5fca-47a0-9321-3a8f9807d07d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:51.319423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-033dd779-5fca-47a0-9321-3a8f9807d07d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:51.320151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-033dd779-5fca-47a0-9321-3a8f9807d07d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:51.320623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-033dd779-5fca-47a0-9321-3a8f9807d07d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:51.321394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-033dd779-5fca-47a0-9321-3a8f9807d07d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:51.472973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-033dd779-5fca-47a0-9321-3a8f9807d07d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:51.481387 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-033dd779-5fca-47a0-9321-3a8f9807d07d tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1411 microversion: 2.1 time: 0.179186 Aug 23 18:38:51.481964 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3545/6955] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:51 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1411 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:52.242976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-53aea418-305c-443f-b187-33d27bfa7d26 req-5d99dbae-87de-49d2-bb79-cf043064e42d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4baada99-915d-4253-b596-48658702b4b5", "name": "network-vif-deleted", "tag": "5c74b88e-5c90-481b-9037-83e5fc1674c4"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:38:52.254079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-53aea418-305c-443f-b187-33d27bfa7d26 req-5d99dbae-87de-49d2-bb79-cf043064e42d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:52.254581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-53aea418-305c-443f-b187-33d27bfa7d26 req-5d99dbae-87de-49d2-bb79-cf043064e42d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:52.255014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-53aea418-305c-443f-b187-33d27bfa7d26 req-5d99dbae-87de-49d2-bb79-cf043064e42d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:52.267449 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-53aea418-305c-443f-b187-33d27bfa7d26 req-5d99dbae-87de-49d2-bb79-cf043064e42d service nova] Creating event network-vif-deleted:5c74b88e-5c90-481b-9037-83e5fc1674c4 for instance 4baada99-915d-4253-b596-48658702b4b5 on n-h2-850468-16 Aug 23 18:38:52.272433 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-53aea418-305c-443f-b187-33d27bfa7d26 req-5d99dbae-87de-49d2-bb79-cf043064e42d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033147 Aug 23 18:38:52.273026 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3411/6956] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:38:52.504089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-78160a17-4942-4740-9bc9-524923869cab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:52.504658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-78160a17-4942-4740-9bc9-524923869cab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:52.511940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78160a17-4942-4740-9bc9-524923869cab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:52.513107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78160a17-4942-4740-9bc9-524923869cab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:52.513666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78160a17-4942-4740-9bc9-524923869cab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:52.514419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78160a17-4942-4740-9bc9-524923869cab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:52.515061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78160a17-4942-4740-9bc9-524923869cab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:52.515501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78160a17-4942-4740-9bc9-524923869cab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:52.588339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-78160a17-4942-4740-9bc9-524923869cab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:52.596725 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-78160a17-4942-4740-9bc9-524923869cab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1202 microversion: 2.1 time: 0.096722 Aug 23 18:38:52.602806 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3546/6957] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:52 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1202 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:53.618735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd248dee-a0cc-4e70-94c7-cb06de04456f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:53.619448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd248dee-a0cc-4e70-94c7-cb06de04456f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:53.627394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd248dee-a0cc-4e70-94c7-cb06de04456f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:53.627895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd248dee-a0cc-4e70-94c7-cb06de04456f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:53.628340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd248dee-a0cc-4e70-94c7-cb06de04456f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:53.629054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd248dee-a0cc-4e70-94c7-cb06de04456f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:53.629516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd248dee-a0cc-4e70-94c7-cb06de04456f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:53.629978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd248dee-a0cc-4e70-94c7-cb06de04456f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:53.697004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bd248dee-a0cc-4e70-94c7-cb06de04456f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:53.706336 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd248dee-a0cc-4e70-94c7-cb06de04456f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1202 microversion: 2.1 time: 0.092720 Aug 23 18:38:53.706963 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3412/6958] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:53 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1202 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:54.728019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0fde03a0-9dae-4d0a-8ba8-b02e81ed1b30 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:54.728775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0fde03a0-9dae-4d0a-8ba8-b02e81ed1b30 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:54.736669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fde03a0-9dae-4d0a-8ba8-b02e81ed1b30 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:54.737182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fde03a0-9dae-4d0a-8ba8-b02e81ed1b30 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:54.737637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fde03a0-9dae-4d0a-8ba8-b02e81ed1b30 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:54.738362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fde03a0-9dae-4d0a-8ba8-b02e81ed1b30 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:54.738859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fde03a0-9dae-4d0a-8ba8-b02e81ed1b30 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:54.739307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0fde03a0-9dae-4d0a-8ba8-b02e81ed1b30 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:54.803884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0fde03a0-9dae-4d0a-8ba8-b02e81ed1b30 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:54.811879 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0fde03a0-9dae-4d0a-8ba8-b02e81ed1b30 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1202 microversion: 2.1 time: 0.087771 Aug 23 18:38:54.812453 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3547/6959] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:54 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1202 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:55.833529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-312966d1-0a2a-43eb-b81e-5814e73d48d5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:55.834073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-312966d1-0a2a-43eb-b81e-5814e73d48d5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:55.841200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312966d1-0a2a-43eb-b81e-5814e73d48d5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:55.841691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312966d1-0a2a-43eb-b81e-5814e73d48d5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:55.842135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312966d1-0a2a-43eb-b81e-5814e73d48d5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:55.843487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312966d1-0a2a-43eb-b81e-5814e73d48d5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:55.843949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312966d1-0a2a-43eb-b81e-5814e73d48d5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:55.844382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-312966d1-0a2a-43eb-b81e-5814e73d48d5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:55.906766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-312966d1-0a2a-43eb-b81e-5814e73d48d5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:38:55.915294 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-312966d1-0a2a-43eb-b81e-5814e73d48d5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 200 len: 1202 microversion: 2.1 time: 0.085807 Aug 23 18:38:55.915868 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3413/6960] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:55 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 1202 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:38:56.936408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fc94a654-c30e-4505-8ee9-229e1a3c8a09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:56.937377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fc94a654-c30e-4505-8ee9-229e1a3c8a09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:56.944382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc94a654-c30e-4505-8ee9-229e1a3c8a09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:56.944890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc94a654-c30e-4505-8ee9-229e1a3c8a09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:56.945353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc94a654-c30e-4505-8ee9-229e1a3c8a09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:56.946082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc94a654-c30e-4505-8ee9-229e1a3c8a09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:56.946609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc94a654-c30e-4505-8ee9-229e1a3c8a09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:56.947060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc94a654-c30e-4505-8ee9-229e1a3c8a09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:56.960757 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-fc94a654-c30e-4505-8ee9-229e1a3c8a09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fc94a654-c30e-4505-8ee9-229e1a3c8a09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 HTTP/1.1 Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '4baada99-915d-4253-b596-48658702b4b5'} Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:38:56.962675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:56.969146 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:56.969146 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:38:56.969146 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:38:56.969146 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:38:56.969146 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:38:56.969146 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:56.969146 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:56.969146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fc94a654-c30e-4505-8ee9-229e1a3c8a09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:38:56.969146 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fc94a654-c30e-4505-8ee9-229e1a3c8a09 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 404 len: 111 microversion: 2.1 time: 0.031841 Aug 23 18:38:56.969146 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3548/6961] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:56 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:38:59.106759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd30bf01-1a7d-4208-8adc-4a1ebdb13467 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:59.107508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd30bf01-1a7d-4208-8adc-4a1ebdb13467 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:59.115286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd30bf01-1a7d-4208-8adc-4a1ebdb13467 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:59.116510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd30bf01-1a7d-4208-8adc-4a1ebdb13467 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:59.116971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd30bf01-1a7d-4208-8adc-4a1ebdb13467 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:59.117729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd30bf01-1a7d-4208-8adc-4a1ebdb13467 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:59.118188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd30bf01-1a7d-4208-8adc-4a1ebdb13467 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:59.118646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd30bf01-1a7d-4208-8adc-4a1ebdb13467 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:59.133886 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-bd30bf01-1a7d-4208-8adc-4a1ebdb13467 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd30bf01-1a7d-4208-8adc-4a1ebdb13467 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 HTTP/1.1 Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'd04c003c-27db-418d-a4df-d73f8cf38c85'} Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:38:59.135618 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd30bf01-1a7d-4208-8adc-4a1ebdb13467 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd30bf01-1a7d-4208-8adc-4a1ebdb13467 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 404 len: 111 microversion: 2.1 time: 0.034309 Aug 23 18:38:59.141282 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3414/6962] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:38:59 2022] DELETE /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:38:59.146708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-27c4782b-5ebf-4d5b-9bbc-27e92fd5849f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:59.147356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-27c4782b-5ebf-4d5b-9bbc-27e92fd5849f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: d04c003c-27db-418d-a4df-d73f8cf38c85] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:59.154681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27c4782b-5ebf-4d5b-9bbc-27e92fd5849f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:59.155227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27c4782b-5ebf-4d5b-9bbc-27e92fd5849f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:59.155704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27c4782b-5ebf-4d5b-9bbc-27e92fd5849f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:59.156409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27c4782b-5ebf-4d5b-9bbc-27e92fd5849f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:59.156886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27c4782b-5ebf-4d5b-9bbc-27e92fd5849f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:59.157334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-27c4782b-5ebf-4d5b-9bbc-27e92fd5849f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:59.171079 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-27c4782b-5ebf-4d5b-9bbc-27e92fd5849f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-27c4782b-5ebf-4d5b-9bbc-27e92fd5849f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 HTTP/1.1 Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'd04c003c-27db-418d-a4df-d73f8cf38c85'} Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:38:59.172664 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.177521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:59.177521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:38:59.177521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:38:59.177521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:38:59.177521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:38:59.177521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. Aug 23 18:38:59.177521 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.177521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-27c4782b-5ebf-4d5b-9bbc-27e92fd5849f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance d04c003c-27db-418d-a4df-d73f8cf38c85 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:38:59.177521 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-27c4782b-5ebf-4d5b-9bbc-27e92fd5849f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85" status: 404 len: 111 microversion: 2.1 time: 0.031366 Aug 23 18:38:59.177521 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3549/6963] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:59 2022] GET /compute/v2.1/servers/d04c003c-27db-418d-a4df-d73f8cf38c85 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:38:59.723198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b7876e18-0f89-4a63-93ed-c74988284751 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:59.723701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b7876e18-0f89-4a63-93ed-c74988284751 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:59.729839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7876e18-0f89-4a63-93ed-c74988284751 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:59.730328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7876e18-0f89-4a63-93ed-c74988284751 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:59.730791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7876e18-0f89-4a63-93ed-c74988284751 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:59.731495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7876e18-0f89-4a63-93ed-c74988284751 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:59.731950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7876e18-0f89-4a63-93ed-c74988284751 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:59.732376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7876e18-0f89-4a63-93ed-c74988284751 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:59.747709 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-b7876e18-0f89-4a63-93ed-c74988284751 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b7876e18-0f89-4a63-93ed-c74988284751 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 HTTP/1.1 Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '4baada99-915d-4253-b596-48658702b4b5'} Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:38:59.750028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b7876e18-0f89-4a63-93ed-c74988284751 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b7876e18-0f89-4a63-93ed-c74988284751 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 404 len: 111 microversion: 2.1 time: 0.033342 Aug 23 18:38:59.755141 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3415/6964] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:38:59 2022] DELETE /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:38:59.761621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a054b87-c676-47b8-b935-6171116e53a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:38:59.762293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6a054b87-c676-47b8-b935-6171116e53a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 4baada99-915d-4253-b596-48658702b4b5] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:38:59.769424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a054b87-c676-47b8-b935-6171116e53a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:59.769934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a054b87-c676-47b8-b935-6171116e53a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:59.770400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a054b87-c676-47b8-b935-6171116e53a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:59.771155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a054b87-c676-47b8-b935-6171116e53a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:38:59.771632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a054b87-c676-47b8-b935-6171116e53a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:38:59.772090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6a054b87-c676-47b8-b935-6171116e53a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:38:59.786924 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-6a054b87-c676-47b8-b935-6171116e53a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a054b87-c676-47b8-b935-6171116e53a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 HTTP/1.1 Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '4baada99-915d-4253-b596-48658702b4b5'} Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:38:59.788437 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.793380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:38:59.793380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:38:59.793380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:38:59.793380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:38:59.793380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:38:59.793380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. Aug 23 18:38:59.793380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:38:59.793380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6a054b87-c676-47b8-b935-6171116e53a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance 4baada99-915d-4253-b596-48658702b4b5 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:38:59.793380 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6a054b87-c676-47b8-b935-6171116e53a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5" status: 404 len: 111 microversion: 2.1 time: 0.032394 Aug 23 18:38:59.793380 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3550/6965] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:38:59 2022] GET /compute/v2.1/servers/4baada99-915d-4253-b596-48658702b4b5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:38:59.866507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c51e9865-a772-4cec-96bf-72f4a9f4831c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Action: 'create', calling method: .version_select at 0x7f27df710e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1889341503", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPnLDapA0kpwqJ4WKMBsRyEVb4py4Xg9yILM9+Rv4X+dnXo8vMeewhlmxfMHFYJcrO/WFE4L2pIiZ2+c16YGP9tDPNSFCXRbuC1a5z+GbGcleoBHcgzbTeykoNPKzYw1tw=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:38:59.882106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-c51e9865-a772-4cec-96bf-72f4a9f4831c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for project 318917738a5f43d5924bc941992f26a0. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:38:59.887297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-c51e9865-a772-4cec-96bf-72f4a9f4831c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for user c77b0208b95843d6a5dac5c4a1ac3d8a and project 318917738a5f43d5924bc941992f26a0. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:38:59.912074 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c51e9865-a772-4cec-96bf-72f4a9f4831c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.049419 Aug 23 18:38:59.912674 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3416/6966] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:38:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:39:16.182799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1839718825", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1889341503", "security_groups": [{"name": "tempest-secgroup-smoke-96222629"}], "block_device_mapping_v2": [{"uuid": "224ab8db-ee79-45fc-af21-4dc82d077455", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b72a85dc-9cf5-4dba-9938-31cafa49248b"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:39:16.193507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:39:16.194182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:39:16.304667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] validate_networks() for [('b72a85dc-9cf5-4dba-9938-31cafa49248b', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:39:16.859356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:39:16.859799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:39:16.860297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:39:16.860723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:39:16.861152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:39:16.870139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:16.870673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:16.871131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:16.871876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:16.872350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:16.872792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:16.889957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:39:16.895491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for user c77b0208b95843d6a5dac5c4a1ac3d8a and project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:39:16.953264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:39:16.955446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='224ab8db-ee79-45fc-af21-4dc82d077455',volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:39:17.090270 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc55f896-c856-4fe0-8384-d29c684c6cb5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.911502 Aug 23 18:39:17.091231 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3551/6967] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:39:16 2022] POST /compute/v2.1/servers => generated 404 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:39:17.101154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=25 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:39:17.101961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:39:17.102734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:39:17.107150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a3e4a89a-857b-4ed5-8c3d-d8794e043ae8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:17.107771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a3e4a89a-857b-4ed5-8c3d-d8794e043ae8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:17.166993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a3e4a89a-857b-4ed5-8c3d-d8794e043ae8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:17.174149 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a3e4a89a-857b-4ed5-8c3d-d8794e043ae8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1095 microversion: 2.1 time: 0.075014 Aug 23 18:39:17.174742 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3417/6968] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:17 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:39:18.199111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f48f0c78-ce9c-4773-836d-50018d2ba0b0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:18.200017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f48f0c78-ce9c-4773-836d-50018d2ba0b0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:18.209076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f48f0c78-ce9c-4773-836d-50018d2ba0b0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:18.209723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f48f0c78-ce9c-4773-836d-50018d2ba0b0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:18.210178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f48f0c78-ce9c-4773-836d-50018d2ba0b0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:18.210919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f48f0c78-ce9c-4773-836d-50018d2ba0b0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:18.211581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f48f0c78-ce9c-4773-836d-50018d2ba0b0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:18.212018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f48f0c78-ce9c-4773-836d-50018d2ba0b0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:18.285486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f48f0c78-ce9c-4773-836d-50018d2ba0b0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:18.296501 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f48f0c78-ce9c-4773-836d-50018d2ba0b0 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1211 microversion: 2.1 time: 0.103607 Aug 23 18:39:18.298584 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3552/6969] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:18 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1211 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:19.321654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f3862b46-c54f-4a60-8fea-fc588d86e778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:19.322478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f3862b46-c54f-4a60-8fea-fc588d86e778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:19.331026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3862b46-c54f-4a60-8fea-fc588d86e778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:19.331629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3862b46-c54f-4a60-8fea-fc588d86e778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:19.332178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3862b46-c54f-4a60-8fea-fc588d86e778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:19.332972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3862b46-c54f-4a60-8fea-fc588d86e778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:19.333500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3862b46-c54f-4a60-8fea-fc588d86e778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:19.334001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f3862b46-c54f-4a60-8fea-fc588d86e778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:19.618085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f3862b46-c54f-4a60-8fea-fc588d86e778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:19.625789 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f3862b46-c54f-4a60-8fea-fc588d86e778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1277 microversion: 2.1 time: 0.308005 Aug 23 18:39:19.642683 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3418/6970] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:19 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1277 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:19.844598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8dd87430-69fd-45c2-aec6-4eb570fdcd48 req-acb6e614-9379-442f-a820-ad24c0ab5a67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7273a59-b684-49f0-9804-4447afd7942a", "tag": "9d5e6320-a433-4f00-8d6c-039c65e4de3b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:39:19.856493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8dd87430-69fd-45c2-aec6-4eb570fdcd48 req-acb6e614-9379-442f-a820-ad24c0ab5a67 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:19.857287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8dd87430-69fd-45c2-aec6-4eb570fdcd48 req-acb6e614-9379-442f-a820-ad24c0ab5a67 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:19.857728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8dd87430-69fd-45c2-aec6-4eb570fdcd48 req-acb6e614-9379-442f-a820-ad24c0ab5a67 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:19.869606 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8dd87430-69fd-45c2-aec6-4eb570fdcd48 req-acb6e614-9379-442f-a820-ad24c0ab5a67 service nova] Creating event network-changed:9d5e6320-a433-4f00-8d6c-039c65e4de3b for instance a7273a59-b684-49f0-9804-4447afd7942a on n-h1-850468-16 Aug 23 18:39:19.875197 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8dd87430-69fd-45c2-aec6-4eb570fdcd48 req-acb6e614-9379-442f-a820-ad24c0ab5a67 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040167 Aug 23 18:39:19.875957 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3553/6971] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:39:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:39:20.646499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fa1a557e-ae4d-4f3c-a213-1d4a34020bb2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:20.647383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fa1a557e-ae4d-4f3c-a213-1d4a34020bb2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:20.654408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa1a557e-ae4d-4f3c-a213-1d4a34020bb2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:20.655086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa1a557e-ae4d-4f3c-a213-1d4a34020bb2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:20.655785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa1a557e-ae4d-4f3c-a213-1d4a34020bb2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:20.656594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa1a557e-ae4d-4f3c-a213-1d4a34020bb2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:20.657159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa1a557e-ae4d-4f3c-a213-1d4a34020bb2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:20.657707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fa1a557e-ae4d-4f3c-a213-1d4a34020bb2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:20.869456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fa1a557e-ae4d-4f3c-a213-1d4a34020bb2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:20.879541 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fa1a557e-ae4d-4f3c-a213-1d4a34020bb2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1277 microversion: 2.1 time: 0.237024 Aug 23 18:39:20.880411 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3419/6972] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:20 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:21.902997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6d9092a6-fd5e-41e1-bef6-5dbb6a8a7885 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:21.903697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6d9092a6-fd5e-41e1-bef6-5dbb6a8a7885 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:21.910760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d9092a6-fd5e-41e1-bef6-5dbb6a8a7885 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:21.911263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d9092a6-fd5e-41e1-bef6-5dbb6a8a7885 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:21.911714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d9092a6-fd5e-41e1-bef6-5dbb6a8a7885 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:21.912424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d9092a6-fd5e-41e1-bef6-5dbb6a8a7885 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:21.912893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d9092a6-fd5e-41e1-bef6-5dbb6a8a7885 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:21.913333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d9092a6-fd5e-41e1-bef6-5dbb6a8a7885 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:22.058185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6d9092a6-fd5e-41e1-bef6-5dbb6a8a7885 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:22.067439 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6d9092a6-fd5e-41e1-bef6-5dbb6a8a7885 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1277 microversion: 2.1 time: 0.169693 Aug 23 18:39:22.068040 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3554/6973] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:21 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:23.088905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-667251a9-137f-471e-93b5-d3ad4698f1ad tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:23.089531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-667251a9-137f-471e-93b5-d3ad4698f1ad tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:23.097442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-667251a9-137f-471e-93b5-d3ad4698f1ad tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:23.097937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-667251a9-137f-471e-93b5-d3ad4698f1ad tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:23.098395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-667251a9-137f-471e-93b5-d3ad4698f1ad tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:23.099121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-667251a9-137f-471e-93b5-d3ad4698f1ad tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:23.099577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-667251a9-137f-471e-93b5-d3ad4698f1ad tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:23.100009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-667251a9-137f-471e-93b5-d3ad4698f1ad tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:23.245848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-667251a9-137f-471e-93b5-d3ad4698f1ad tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:23.254234 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-667251a9-137f-471e-93b5-d3ad4698f1ad tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1277 microversion: 2.1 time: 0.169281 Aug 23 18:39:23.254841 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3420/6974] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:23 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:24.275638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5b1f093-e1a6-47f3-94eb-82dd14bc786e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:24.276271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e5b1f093-e1a6-47f3-94eb-82dd14bc786e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:24.283920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5b1f093-e1a6-47f3-94eb-82dd14bc786e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:24.284418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5b1f093-e1a6-47f3-94eb-82dd14bc786e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:24.284868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5b1f093-e1a6-47f3-94eb-82dd14bc786e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:24.285578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5b1f093-e1a6-47f3-94eb-82dd14bc786e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:24.286046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5b1f093-e1a6-47f3-94eb-82dd14bc786e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:24.286485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5b1f093-e1a6-47f3-94eb-82dd14bc786e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:24.417229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e5b1f093-e1a6-47f3-94eb-82dd14bc786e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:24.425167 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e5b1f093-e1a6-47f3-94eb-82dd14bc786e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1265 microversion: 2.1 time: 0.153445 Aug 23 18:39:24.425738 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3555/6975] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:24 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:25.446016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-088f7b02-09be-4589-98da-35ba9dda59cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:25.446668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-088f7b02-09be-4589-98da-35ba9dda59cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:25.454320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088f7b02-09be-4589-98da-35ba9dda59cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:25.454841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088f7b02-09be-4589-98da-35ba9dda59cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:25.455281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088f7b02-09be-4589-98da-35ba9dda59cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:25.455973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088f7b02-09be-4589-98da-35ba9dda59cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:25.456432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088f7b02-09be-4589-98da-35ba9dda59cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:25.456865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-088f7b02-09be-4589-98da-35ba9dda59cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:25.615884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-088f7b02-09be-4589-98da-35ba9dda59cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:25.624438 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-088f7b02-09be-4589-98da-35ba9dda59cc tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1265 microversion: 2.1 time: 0.181732 Aug 23 18:39:25.625108 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3421/6976] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:25 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:26.644997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8332d922-8823-4c69-93a8-329e658bbe81 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:26.645628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8332d922-8823-4c69-93a8-329e658bbe81 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:26.652595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8332d922-8823-4c69-93a8-329e658bbe81 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:26.653099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8332d922-8823-4c69-93a8-329e658bbe81 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:26.653557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8332d922-8823-4c69-93a8-329e658bbe81 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:26.654276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8332d922-8823-4c69-93a8-329e658bbe81 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:26.655406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8332d922-8823-4c69-93a8-329e658bbe81 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:26.655930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8332d922-8823-4c69-93a8-329e658bbe81 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:26.790841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8332d922-8823-4c69-93a8-329e658bbe81 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:26.799487 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8332d922-8823-4c69-93a8-329e658bbe81 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1265 microversion: 2.1 time: 0.158402 Aug 23 18:39:26.800098 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3556/6977] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:26 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:27.820339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83761445-b873-4c17-8715-baae23590fbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:27.820950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-83761445-b873-4c17-8715-baae23590fbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:27.823682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:39:27.830500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83761445-b873-4c17-8715-baae23590fbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:27.831018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83761445-b873-4c17-8715-baae23590fbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:27.831484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83761445-b873-4c17-8715-baae23590fbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:27.832176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83761445-b873-4c17-8715-baae23590fbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:27.832630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83761445-b873-4c17-8715-baae23590fbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:27.833104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83761445-b873-4c17-8715-baae23590fbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:27.970640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-83761445-b873-4c17-8715-baae23590fbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:27.978304 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-83761445-b873-4c17-8715-baae23590fbb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1265 microversion: 2.1 time: 0.161845 Aug 23 18:39:27.978903 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3422/6978] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:27 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:28.999843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fac785bd-1371-4870-90d6-bda2d871b3d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:29.000386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fac785bd-1371-4870-90d6-bda2d871b3d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:29.002344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:39:29.003038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:39:29.010276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fac785bd-1371-4870-90d6-bda2d871b3d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:29.010806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fac785bd-1371-4870-90d6-bda2d871b3d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:29.011260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fac785bd-1371-4870-90d6-bda2d871b3d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:29.012010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fac785bd-1371-4870-90d6-bda2d871b3d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:29.012501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fac785bd-1371-4870-90d6-bda2d871b3d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:29.012944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fac785bd-1371-4870-90d6-bda2d871b3d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:29.145025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fac785bd-1371-4870-90d6-bda2d871b3d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:29.152771 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fac785bd-1371-4870-90d6-bda2d871b3d1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1265 microversion: 2.1 time: 0.157825 Aug 23 18:39:29.153349 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3557/6979] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:28 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:30.172861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3f89c67c-3dae-4bc3-9705-843e6525fa78 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:30.173502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3f89c67c-3dae-4bc3-9705-843e6525fa78 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:30.180350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f89c67c-3dae-4bc3-9705-843e6525fa78 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:30.180837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f89c67c-3dae-4bc3-9705-843e6525fa78 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:30.181279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f89c67c-3dae-4bc3-9705-843e6525fa78 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:30.181974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f89c67c-3dae-4bc3-9705-843e6525fa78 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:30.182431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f89c67c-3dae-4bc3-9705-843e6525fa78 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:30.182884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f89c67c-3dae-4bc3-9705-843e6525fa78 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:30.315170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3f89c67c-3dae-4bc3-9705-843e6525fa78 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:30.322864 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3f89c67c-3dae-4bc3-9705-843e6525fa78 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1265 microversion: 2.1 time: 0.153898 Aug 23 18:39:30.323429 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3423/6980] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:30 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:31.345248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e7c8dfad-65f6-42cd-9432-a74d03cd2867 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:31.345881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e7c8dfad-65f6-42cd-9432-a74d03cd2867 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:31.352751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7c8dfad-65f6-42cd-9432-a74d03cd2867 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:31.353251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7c8dfad-65f6-42cd-9432-a74d03cd2867 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:31.353700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7c8dfad-65f6-42cd-9432-a74d03cd2867 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:31.354407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7c8dfad-65f6-42cd-9432-a74d03cd2867 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:31.354918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7c8dfad-65f6-42cd-9432-a74d03cd2867 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:31.355366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7c8dfad-65f6-42cd-9432-a74d03cd2867 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:31.494228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e7c8dfad-65f6-42cd-9432-a74d03cd2867 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:31.502971 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e7c8dfad-65f6-42cd-9432-a74d03cd2867 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1265 microversion: 2.1 time: 0.162987 Aug 23 18:39:31.503765 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3558/6981] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:31 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:32.524668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a6c2e7ba-e786-4af6-aabe-6428dc05ce54 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:32.525266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a6c2e7ba-e786-4af6-aabe-6428dc05ce54 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:32.533025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6c2e7ba-e786-4af6-aabe-6428dc05ce54 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:32.533511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6c2e7ba-e786-4af6-aabe-6428dc05ce54 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:32.533953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6c2e7ba-e786-4af6-aabe-6428dc05ce54 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:32.534684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6c2e7ba-e786-4af6-aabe-6428dc05ce54 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:32.535145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6c2e7ba-e786-4af6-aabe-6428dc05ce54 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:32.535573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6c2e7ba-e786-4af6-aabe-6428dc05ce54 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:32.677424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a6c2e7ba-e786-4af6-aabe-6428dc05ce54 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:32.685267 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a6c2e7ba-e786-4af6-aabe-6428dc05ce54 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1265 microversion: 2.1 time: 0.164532 Aug 23 18:39:32.686021 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3424/6982] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:32 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:33.121057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7cd61233-01e7-4b8d-984d-4fe7fb9481d7 req-8c5b3530-659c-4a89-84ba-e1ec1fab0421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7273a59-b684-49f0-9804-4447afd7942a", "name": "network-vif-plugged", "status": "completed", "tag": "9d5e6320-a433-4f00-8d6c-039c65e4de3b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:39:33.133325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7cd61233-01e7-4b8d-984d-4fe7fb9481d7 req-8c5b3530-659c-4a89-84ba-e1ec1fab0421 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:33.133874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7cd61233-01e7-4b8d-984d-4fe7fb9481d7 req-8c5b3530-659c-4a89-84ba-e1ec1fab0421 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:33.134321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7cd61233-01e7-4b8d-984d-4fe7fb9481d7 req-8c5b3530-659c-4a89-84ba-e1ec1fab0421 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:33.145940 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7cd61233-01e7-4b8d-984d-4fe7fb9481d7 req-8c5b3530-659c-4a89-84ba-e1ec1fab0421 service nova] Creating event network-vif-plugged:9d5e6320-a433-4f00-8d6c-039c65e4de3b for instance a7273a59-b684-49f0-9804-4447afd7942a on n-h1-850468-16 Aug 23 18:39:33.151196 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7cd61233-01e7-4b8d-984d-4fe7fb9481d7 req-8c5b3530-659c-4a89-84ba-e1ec1fab0421 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034100 Aug 23 18:39:33.152172 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3559/6983] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:39:33.706258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a0707ae3-6f1e-463c-a011-d6641ca3d1b6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:33.706892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a0707ae3-6f1e-463c-a011-d6641ca3d1b6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:33.713656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0707ae3-6f1e-463c-a011-d6641ca3d1b6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:33.714147 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0707ae3-6f1e-463c-a011-d6641ca3d1b6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:33.714607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0707ae3-6f1e-463c-a011-d6641ca3d1b6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:33.715296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0707ae3-6f1e-463c-a011-d6641ca3d1b6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:33.715998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0707ae3-6f1e-463c-a011-d6641ca3d1b6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:33.716419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a0707ae3-6f1e-463c-a011-d6641ca3d1b6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:33.853454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a0707ae3-6f1e-463c-a011-d6641ca3d1b6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:33.861767 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a0707ae3-6f1e-463c-a011-d6641ca3d1b6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1265 microversion: 2.1 time: 0.160369 Aug 23 18:39:33.862329 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3425/6984] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:33 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:34.884912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c1066227-0b15-4e8c-a12d-25e9b9f12d9b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:34.885695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c1066227-0b15-4e8c-a12d-25e9b9f12d9b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:34.892998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1066227-0b15-4e8c-a12d-25e9b9f12d9b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:34.893521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1066227-0b15-4e8c-a12d-25e9b9f12d9b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:34.893977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1066227-0b15-4e8c-a12d-25e9b9f12d9b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:34.894723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1066227-0b15-4e8c-a12d-25e9b9f12d9b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:34.895194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1066227-0b15-4e8c-a12d-25e9b9f12d9b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:34.895635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1066227-0b15-4e8c-a12d-25e9b9f12d9b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:35.037254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c1066227-0b15-4e8c-a12d-25e9b9f12d9b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:35.045036 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c1066227-0b15-4e8c-a12d-25e9b9f12d9b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1453 microversion: 2.1 time: 0.165283 Aug 23 18:39:35.045682 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3560/6985] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:34 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:35.065646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-035b06f6-857d-43d9-bc1b-f80e49039be8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:39:35.066297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-035b06f6-857d-43d9-bc1b-f80e49039be8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:39:35.073151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-035b06f6-857d-43d9-bc1b-f80e49039be8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:35.073642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-035b06f6-857d-43d9-bc1b-f80e49039be8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:35.074094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-035b06f6-857d-43d9-bc1b-f80e49039be8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:35.074825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-035b06f6-857d-43d9-bc1b-f80e49039be8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:35.075289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-035b06f6-857d-43d9-bc1b-f80e49039be8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:35.075720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-035b06f6-857d-43d9-bc1b-f80e49039be8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:35.212580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-035b06f6-857d-43d9-bc1b-f80e49039be8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:39:35.220651 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-035b06f6-857d-43d9-bc1b-f80e49039be8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1453 microversion: 2.1 time: 0.158873 Aug 23 18:39:35.221237 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3426/6986] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:39:35 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:39:36.809057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-15a87773-c226-42f5-a081-010b51caa761 req-ec598fa8-d636-47cc-b23a-ba7572ffa688 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a7273a59-b684-49f0-9804-4447afd7942a", "tag": "9d5e6320-a433-4f00-8d6c-039c65e4de3b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:39:36.819070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-15a87773-c226-42f5-a081-010b51caa761 req-ec598fa8-d636-47cc-b23a-ba7572ffa688 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:39:36.819576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-15a87773-c226-42f5-a081-010b51caa761 req-ec598fa8-d636-47cc-b23a-ba7572ffa688 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:39:36.820029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-15a87773-c226-42f5-a081-010b51caa761 req-ec598fa8-d636-47cc-b23a-ba7572ffa688 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:39:36.832841 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-15a87773-c226-42f5-a081-010b51caa761 req-ec598fa8-d636-47cc-b23a-ba7572ffa688 service nova] Creating event network-changed:9d5e6320-a433-4f00-8d6c-039c65e4de3b for instance a7273a59-b684-49f0-9804-4447afd7942a on n-h1-850468-16 Aug 23 18:39:36.838239 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-15a87773-c226-42f5-a081-010b51caa761 req-ec598fa8-d636-47cc-b23a-ba7572ffa688 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032837 Aug 23 18:39:36.839095 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3561/6987] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:39:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:41:01.317967 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:41:01.318533 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 18:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:41:01.851396 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:41:01.852131 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 18:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:41:22.394670 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:41:22.395367 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 18:41:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:41:34.125006 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 18:41:34.125836 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 18:41:34.126677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=22 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:41:34.127405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=54 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:41:34.208699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93270a15-71ae-4e11-895c-9624ad07ddc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:34.209200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-93270a15-71ae-4e11-895c-9624ad07ddc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:34.215808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93270a15-71ae-4e11-895c-9624ad07ddc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:34.216290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93270a15-71ae-4e11-895c-9624ad07ddc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:34.216725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93270a15-71ae-4e11-895c-9624ad07ddc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:34.217412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93270a15-71ae-4e11-895c-9624ad07ddc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:34.217866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93270a15-71ae-4e11-895c-9624ad07ddc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:34.218292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93270a15-71ae-4e11-895c-9624ad07ddc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:34.244977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-93270a15-71ae-4e11-895c-9624ad07ddc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:41:34.322215 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93270a15-71ae-4e11-895c-9624ad07ddc1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 204 len: 0 microversion: 2.1 time: 0.198143 Aug 23 18:41:34.323065 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3427/6988] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:41:34 2022] DELETE /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:41:34.329981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:41:34.330759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=50 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:41:34.335819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-94bcde92-c23e-4c63-b086-f25325a14fd3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:34.336554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-94bcde92-c23e-4c63-b086-f25325a14fd3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:34.344396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94bcde92-c23e-4c63-b086-f25325a14fd3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:34.344903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94bcde92-c23e-4c63-b086-f25325a14fd3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:34.345364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94bcde92-c23e-4c63-b086-f25325a14fd3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:34.346077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94bcde92-c23e-4c63-b086-f25325a14fd3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:34.346568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94bcde92-c23e-4c63-b086-f25325a14fd3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:34.347025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-94bcde92-c23e-4c63-b086-f25325a14fd3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:34.541748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-94bcde92-c23e-4c63-b086-f25325a14fd3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:34.549440 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-94bcde92-c23e-4c63-b086-f25325a14fd3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1578 microversion: 2.1 time: 0.221616 Aug 23 18:41:34.549999 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3562/6989] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:34 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1578 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:35.571579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e555f9f-7d96-46a0-a00b-2cc61c29b863 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:35.572203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e555f9f-7d96-46a0-a00b-2cc61c29b863 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:35.582427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e555f9f-7d96-46a0-a00b-2cc61c29b863 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:35.582949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e555f9f-7d96-46a0-a00b-2cc61c29b863 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:35.583388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e555f9f-7d96-46a0-a00b-2cc61c29b863 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:35.584087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e555f9f-7d96-46a0-a00b-2cc61c29b863 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:35.584545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e555f9f-7d96-46a0-a00b-2cc61c29b863 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:35.584971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e555f9f-7d96-46a0-a00b-2cc61c29b863 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:35.592462 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 59160. Aug 23 18:41:35.602628 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 59158. Aug 23 18:41:35.729658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7e555f9f-7d96-46a0-a00b-2cc61c29b863 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:35.737417 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e555f9f-7d96-46a0-a00b-2cc61c29b863 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1578 microversion: 2.1 time: 0.170789 Aug 23 18:41:35.737979 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3428/6990] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:35 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1578 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:36.759589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3f127cb3-ac5f-4d22-b480-d1f31f321a2b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:36.760331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3f127cb3-ac5f-4d22-b480-d1f31f321a2b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:36.767361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f127cb3-ac5f-4d22-b480-d1f31f321a2b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:36.767866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f127cb3-ac5f-4d22-b480-d1f31f321a2b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:36.768322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f127cb3-ac5f-4d22-b480-d1f31f321a2b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:36.769046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f127cb3-ac5f-4d22-b480-d1f31f321a2b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:36.769546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f127cb3-ac5f-4d22-b480-d1f31f321a2b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:36.769992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3f127cb3-ac5f-4d22-b480-d1f31f321a2b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:36.833907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3f127cb3-ac5f-4d22-b480-d1f31f321a2b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:36.842719 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3f127cb3-ac5f-4d22-b480-d1f31f321a2b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1512 microversion: 2.1 time: 0.087734 Aug 23 18:41:36.843293 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3563/6991] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:36 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1512 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:36.907607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ed4e8e25-d190-4280-bf37-1610645ac6fc req-c36bc633-e800-4610-830b-d9112f1eb80f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a7273a59-b684-49f0-9804-4447afd7942a", "name": "network-vif-deleted", "tag": "9d5e6320-a433-4f00-8d6c-039c65e4de3b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:41:36.924668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed4e8e25-d190-4280-bf37-1610645ac6fc req-c36bc633-e800-4610-830b-d9112f1eb80f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:36.925228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed4e8e25-d190-4280-bf37-1610645ac6fc req-c36bc633-e800-4610-830b-d9112f1eb80f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:36.925884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ed4e8e25-d190-4280-bf37-1610645ac6fc req-c36bc633-e800-4610-830b-d9112f1eb80f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:36.942469 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ed4e8e25-d190-4280-bf37-1610645ac6fc req-c36bc633-e800-4610-830b-d9112f1eb80f service nova] Creating event network-vif-deleted:9d5e6320-a433-4f00-8d6c-039c65e4de3b for instance a7273a59-b684-49f0-9804-4447afd7942a on n-h1-850468-16 Aug 23 18:41:36.949103 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ed4e8e25-d190-4280-bf37-1610645ac6fc req-c36bc633-e800-4610-830b-d9112f1eb80f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044997 Aug 23 18:41:36.949667 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3429/6992] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:41:37.865075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3a1fd5b7-d725-45ae-94af-395d67d4f355 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:37.865608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3a1fd5b7-d725-45ae-94af-395d67d4f355 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:37.873529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a1fd5b7-d725-45ae-94af-395d67d4f355 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:37.874044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a1fd5b7-d725-45ae-94af-395d67d4f355 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:37.874734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a1fd5b7-d725-45ae-94af-395d67d4f355 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:37.875483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a1fd5b7-d725-45ae-94af-395d67d4f355 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:37.875952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a1fd5b7-d725-45ae-94af-395d67d4f355 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:37.876393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a1fd5b7-d725-45ae-94af-395d67d4f355 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:37.943450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3a1fd5b7-d725-45ae-94af-395d67d4f355 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:37.952350 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3a1fd5b7-d725-45ae-94af-395d67d4f355 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1226 microversion: 2.1 time: 0.091256 Aug 23 18:41:37.953067 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3564/6993] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:37 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:38.975718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c1c1def5-7076-4d75-9d05-3b153fbc0566 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:38.976498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c1c1def5-7076-4d75-9d05-3b153fbc0566 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:38.982707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c1def5-7076-4d75-9d05-3b153fbc0566 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:38.983197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c1def5-7076-4d75-9d05-3b153fbc0566 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:38.983638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c1def5-7076-4d75-9d05-3b153fbc0566 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:38.984334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c1def5-7076-4d75-9d05-3b153fbc0566 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:38.984793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c1def5-7076-4d75-9d05-3b153fbc0566 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:38.985245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c1def5-7076-4d75-9d05-3b153fbc0566 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:39.161378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c1c1def5-7076-4d75-9d05-3b153fbc0566 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:39.170640 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c1c1def5-7076-4d75-9d05-3b153fbc0566 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1226 microversion: 2.1 time: 0.200120 Aug 23 18:41:39.171208 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3430/6994] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:38 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1226 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:40.191993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-09d043be-82a1-40e9-b903-333c602b5db1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:40.192633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-09d043be-82a1-40e9-b903-333c602b5db1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:40.200027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09d043be-82a1-40e9-b903-333c602b5db1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:40.200542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09d043be-82a1-40e9-b903-333c602b5db1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:40.201007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09d043be-82a1-40e9-b903-333c602b5db1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:40.201749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09d043be-82a1-40e9-b903-333c602b5db1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:40.202234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09d043be-82a1-40e9-b903-333c602b5db1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:40.202746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-09d043be-82a1-40e9-b903-333c602b5db1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:40.276487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-09d043be-82a1-40e9-b903-333c602b5db1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:40.284610 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-09d043be-82a1-40e9-b903-333c602b5db1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1226 microversion: 2.1 time: 0.096491 Aug 23 18:41:40.285199 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3565/6995] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:40 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:41.305333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:41.305889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:41.312889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:41.313376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:41.313820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:41.314523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:41.315008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:41.315745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:41.346390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:41.346909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:41.347352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:41.347806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lazy-loading 'fault' on Instance uuid a7273a59-b684-49f0-9804-4447afd7942a {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:41:41.396544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:41.405173 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e23ce419-5024-43cf-925a-3d8d842550f2 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 200 len: 1231 microversion: 2.1 time: 0.103898 Aug 23 18:41:41.405727 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3431/6996] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:41 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 1231 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:42.427085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e09abc94-d14d-41f5-8f58-fe25a644c81e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:42.427714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e09abc94-d14d-41f5-8f58-fe25a644c81e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:42.435715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e09abc94-d14d-41f5-8f58-fe25a644c81e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:42.436218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e09abc94-d14d-41f5-8f58-fe25a644c81e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:42.436670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e09abc94-d14d-41f5-8f58-fe25a644c81e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:42.437409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e09abc94-d14d-41f5-8f58-fe25a644c81e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:42.437902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e09abc94-d14d-41f5-8f58-fe25a644c81e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:42.438338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e09abc94-d14d-41f5-8f58-fe25a644c81e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:42.452479 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-e09abc94-d14d-41f5-8f58-fe25a644c81e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e09abc94-d14d-41f5-8f58-fe25a644c81e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a HTTP/1.1 Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'a7273a59-b684-49f0-9804-4447afd7942a'} Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:41:42.454142 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:41:42.457486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:41:42.457486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:41:42.457486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:41:42.457486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:41:42.457486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:41:42.457486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:41:42.457486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:41:42.457486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e09abc94-d14d-41f5-8f58-fe25a644c81e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:41:42.457486 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e09abc94-d14d-41f5-8f58-fe25a644c81e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 404 len: 111 microversion: 2.1 time: 0.032563 Aug 23 18:41:42.457486 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3566/6997] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:42 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:41:42.505854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-512757580", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1889341503", "security_groups": [{"name": "tempest-secgroup-smoke-96222629"}], "block_device_mapping_v2": [{"uuid": "224ab8db-ee79-45fc-af21-4dc82d077455", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b72a85dc-9cf5-4dba-9938-31cafa49248b"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:41:42.632690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] validate_networks() for [('b72a85dc-9cf5-4dba-9938-31cafa49248b', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:41:43.061679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:41:43.062130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:41:43.062630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:41:43.063038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:41:43.063447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:41:43.072869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:43.073344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:43.073774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:43.074499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:43.074977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:43.075397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:43.092673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:41:43.097961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for user c77b0208b95843d6a5dac5c4a1ac3d8a and project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:41:43.155997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:41:43.158142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='224ab8db-ee79-45fc-af21-4dc82d077455',volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:41:43.290679 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d9b8451e-a91b-4cae-acf2-f11b49baad52 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.788836 Aug 23 18:41:43.291259 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3432/6998] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:41:42 2022] POST /compute/v2.1/servers => generated 404 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:41:43.302286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d06c74e2-a5fc-4668-8421-1514bdc29778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:43.302945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d06c74e2-a5fc-4668-8421-1514bdc29778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:43.360628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d06c74e2-a5fc-4668-8421-1514bdc29778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:43.368636 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d06c74e2-a5fc-4668-8421-1514bdc29778 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1094 microversion: 2.1 time: 0.070378 Aug 23 18:41:43.369205 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3567/6999] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:43 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1094 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:44.390877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b7457782-7d16-4ca8-babf-52a9b5e0a402 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:44.391498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b7457782-7d16-4ca8-babf-52a9b5e0a402 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:44.398426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7457782-7d16-4ca8-babf-52a9b5e0a402 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:44.399033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7457782-7d16-4ca8-babf-52a9b5e0a402 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:44.399655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7457782-7d16-4ca8-babf-52a9b5e0a402 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:44.400507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7457782-7d16-4ca8-babf-52a9b5e0a402 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:44.400973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7457782-7d16-4ca8-babf-52a9b5e0a402 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:44.401407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b7457782-7d16-4ca8-babf-52a9b5e0a402 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:44.469160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b7457782-7d16-4ca8-babf-52a9b5e0a402 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:44.477218 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b7457782-7d16-4ca8-babf-52a9b5e0a402 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1200 microversion: 2.1 time: 0.091379 Aug 23 18:41:44.490524 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3433/7000] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:44 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1200 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:45.498212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00e02d1b-442f-4ab7-84e8-d21954783a0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:45.499041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-00e02d1b-442f-4ab7-84e8-d21954783a0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:45.507994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00e02d1b-442f-4ab7-84e8-d21954783a0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:45.508657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00e02d1b-442f-4ab7-84e8-d21954783a0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:45.509214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00e02d1b-442f-4ab7-84e8-d21954783a0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:45.510076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00e02d1b-442f-4ab7-84e8-d21954783a0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:45.510675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00e02d1b-442f-4ab7-84e8-d21954783a0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:45.511226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00e02d1b-442f-4ab7-84e8-d21954783a0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:46.092633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-00e02d1b-442f-4ab7-84e8-d21954783a0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:46.102400 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-00e02d1b-442f-4ab7-84e8-d21954783a0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1276 microversion: 2.1 time: 0.607770 Aug 23 18:41:46.103048 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3568/7001] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:45 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1276 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:46.193146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-acddb134-d88f-4d62-9b5d-036140065988 req-6f0b52b8-4dfe-4901-a481-57f4fc0e7b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb", "tag": "5b5e0f0d-b2ed-4883-8c39-3c770555ae73"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:41:46.204893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-acddb134-d88f-4d62-9b5d-036140065988 req-6f0b52b8-4dfe-4901-a481-57f4fc0e7b91 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:46.205728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-acddb134-d88f-4d62-9b5d-036140065988 req-6f0b52b8-4dfe-4901-a481-57f4fc0e7b91 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:46.206352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-acddb134-d88f-4d62-9b5d-036140065988 req-6f0b52b8-4dfe-4901-a481-57f4fc0e7b91 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:46.219241 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-acddb134-d88f-4d62-9b5d-036140065988 req-6f0b52b8-4dfe-4901-a481-57f4fc0e7b91 service nova] Creating event network-changed:5b5e0f0d-b2ed-4883-8c39-3c770555ae73 for instance 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb on n-h2-850468-16 Aug 23 18:41:46.224273 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-acddb134-d88f-4d62-9b5d-036140065988 req-6f0b52b8-4dfe-4901-a481-57f4fc0e7b91 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034772 Aug 23 18:41:46.224966 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3434/7002] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:41:47.124368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-17e5bd29-eb1b-4eef-982f-109983088d66 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:47.126250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-17e5bd29-eb1b-4eef-982f-109983088d66 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:47.134569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17e5bd29-eb1b-4eef-982f-109983088d66 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:47.135080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17e5bd29-eb1b-4eef-982f-109983088d66 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:47.135695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17e5bd29-eb1b-4eef-982f-109983088d66 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:47.136412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17e5bd29-eb1b-4eef-982f-109983088d66 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:47.136883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17e5bd29-eb1b-4eef-982f-109983088d66 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:47.137328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-17e5bd29-eb1b-4eef-982f-109983088d66 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:47.274349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-17e5bd29-eb1b-4eef-982f-109983088d66 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:47.282164 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-17e5bd29-eb1b-4eef-982f-109983088d66 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1276 microversion: 2.1 time: 0.162362 Aug 23 18:41:47.282736 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3569/7003] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:47 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1276 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:48.305377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-43ca969b-448f-4943-a4d0-66d000fe31f5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:48.306122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-43ca969b-448f-4943-a4d0-66d000fe31f5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:48.312548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43ca969b-448f-4943-a4d0-66d000fe31f5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:48.313043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43ca969b-448f-4943-a4d0-66d000fe31f5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:48.313486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43ca969b-448f-4943-a4d0-66d000fe31f5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:48.314190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43ca969b-448f-4943-a4d0-66d000fe31f5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:48.314679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43ca969b-448f-4943-a4d0-66d000fe31f5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:48.315139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43ca969b-448f-4943-a4d0-66d000fe31f5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:48.459014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-43ca969b-448f-4943-a4d0-66d000fe31f5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:48.468408 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-43ca969b-448f-4943-a4d0-66d000fe31f5 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1276 microversion: 2.1 time: 0.168622 Aug 23 18:41:48.468974 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3435/7004] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:48 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1276 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:49.489523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51b04b9e-82bd-421f-a2b0-65dc77fd997e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:49.490057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51b04b9e-82bd-421f-a2b0-65dc77fd997e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:49.497696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51b04b9e-82bd-421f-a2b0-65dc77fd997e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:49.498464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51b04b9e-82bd-421f-a2b0-65dc77fd997e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:49.498954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51b04b9e-82bd-421f-a2b0-65dc77fd997e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:49.499695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51b04b9e-82bd-421f-a2b0-65dc77fd997e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:49.500177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51b04b9e-82bd-421f-a2b0-65dc77fd997e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:49.500627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51b04b9e-82bd-421f-a2b0-65dc77fd997e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:49.642530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-51b04b9e-82bd-421f-a2b0-65dc77fd997e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:49.651002 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51b04b9e-82bd-421f-a2b0-65dc77fd997e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1276 microversion: 2.1 time: 0.165563 Aug 23 18:41:49.651570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3570/7005] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:49 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:50.671001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c6d652ac-638c-4c34-9bcf-d29bab5802eb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:50.671614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c6d652ac-638c-4c34-9bcf-d29bab5802eb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:50.678743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6d652ac-638c-4c34-9bcf-d29bab5802eb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:50.679228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6d652ac-638c-4c34-9bcf-d29bab5802eb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:50.679669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6d652ac-638c-4c34-9bcf-d29bab5802eb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:50.680622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6d652ac-638c-4c34-9bcf-d29bab5802eb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:50.681447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6d652ac-638c-4c34-9bcf-d29bab5802eb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:50.682016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6d652ac-638c-4c34-9bcf-d29bab5802eb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:50.819086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c6d652ac-638c-4c34-9bcf-d29bab5802eb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:50.826929 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c6d652ac-638c-4c34-9bcf-d29bab5802eb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1264 microversion: 2.1 time: 0.159762 Aug 23 18:41:50.827497 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3436/7006] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:50 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:51.848966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9fe5abda-486b-455b-b384-b5d22915e095 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:51.849600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9fe5abda-486b-455b-b384-b5d22915e095 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:51.857081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9fe5abda-486b-455b-b384-b5d22915e095 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:51.857586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9fe5abda-486b-455b-b384-b5d22915e095 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:51.858037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9fe5abda-486b-455b-b384-b5d22915e095 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:51.858783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9fe5abda-486b-455b-b384-b5d22915e095 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:51.859263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9fe5abda-486b-455b-b384-b5d22915e095 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:51.859706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9fe5abda-486b-455b-b384-b5d22915e095 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:51.992709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9fe5abda-486b-455b-b384-b5d22915e095 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:52.000751 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9fe5abda-486b-455b-b384-b5d22915e095 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1264 microversion: 2.1 time: 0.155742 Aug 23 18:41:52.001576 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3571/7007] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:51 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:53.023617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb4cdeb9-8632-4b94-a0ce-9cd140395fc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:53.024191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eb4cdeb9-8632-4b94-a0ce-9cd140395fc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:53.031372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb4cdeb9-8632-4b94-a0ce-9cd140395fc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:53.031869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb4cdeb9-8632-4b94-a0ce-9cd140395fc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:53.032305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb4cdeb9-8632-4b94-a0ce-9cd140395fc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:53.033009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb4cdeb9-8632-4b94-a0ce-9cd140395fc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:53.033454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb4cdeb9-8632-4b94-a0ce-9cd140395fc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:53.033888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb4cdeb9-8632-4b94-a0ce-9cd140395fc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:53.082555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:41:53.105445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:41:53.176847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eb4cdeb9-8632-4b94-a0ce-9cd140395fc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:53.187848 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eb4cdeb9-8632-4b94-a0ce-9cd140395fc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1264 microversion: 2.1 time: 0.167241 Aug 23 18:41:53.187848 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3437/7008] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:53 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1264 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:54.209043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c59e3db-dd06-40a4-b09c-969cff9cfec9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:54.209674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1c59e3db-dd06-40a4-b09c-969cff9cfec9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:54.213039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:41:54.219273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c59e3db-dd06-40a4-b09c-969cff9cfec9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:54.219784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c59e3db-dd06-40a4-b09c-969cff9cfec9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:54.220245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c59e3db-dd06-40a4-b09c-969cff9cfec9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:54.221026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c59e3db-dd06-40a4-b09c-969cff9cfec9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:54.221502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c59e3db-dd06-40a4-b09c-969cff9cfec9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:54.221949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c59e3db-dd06-40a4-b09c-969cff9cfec9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:54.360303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c59e3db-dd06-40a4-b09c-969cff9cfec9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:54.368355 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c59e3db-dd06-40a4-b09c-969cff9cfec9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1264 microversion: 2.1 time: 0.163106 Aug 23 18:41:54.368944 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3572/7009] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:54 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:55.393391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-51041e69-cb30-4202-9c09-973b0aac8e55 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:55.393999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-51041e69-cb30-4202-9c09-973b0aac8e55 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:55.402031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51041e69-cb30-4202-9c09-973b0aac8e55 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:55.402738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51041e69-cb30-4202-9c09-973b0aac8e55 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:55.403183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51041e69-cb30-4202-9c09-973b0aac8e55 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:55.403876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51041e69-cb30-4202-9c09-973b0aac8e55 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:55.404328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51041e69-cb30-4202-9c09-973b0aac8e55 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:55.404748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51041e69-cb30-4202-9c09-973b0aac8e55 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:55.538821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-51041e69-cb30-4202-9c09-973b0aac8e55 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:55.547303 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-51041e69-cb30-4202-9c09-973b0aac8e55 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1264 microversion: 2.1 time: 0.157818 Aug 23 18:41:55.547884 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3438/7010] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:55 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:56.568082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c30105ba-cf7d-4ba7-a701-3716607d61ef tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:56.568744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c30105ba-cf7d-4ba7-a701-3716607d61ef tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:56.575779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c30105ba-cf7d-4ba7-a701-3716607d61ef tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:56.576281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c30105ba-cf7d-4ba7-a701-3716607d61ef tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:56.576736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c30105ba-cf7d-4ba7-a701-3716607d61ef tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:56.577499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c30105ba-cf7d-4ba7-a701-3716607d61ef tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:56.577972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c30105ba-cf7d-4ba7-a701-3716607d61ef tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:56.578418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c30105ba-cf7d-4ba7-a701-3716607d61ef tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:56.713753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c30105ba-cf7d-4ba7-a701-3716607d61ef tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:56.721806 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c30105ba-cf7d-4ba7-a701-3716607d61ef tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1264 microversion: 2.1 time: 0.157609 Aug 23 18:41:56.722389 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3573/7011] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:56 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:57.743099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-690cc6f4-905c-4eb6-a774-8cd0b7198fd9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:57.744266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-690cc6f4-905c-4eb6-a774-8cd0b7198fd9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:57.751176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-690cc6f4-905c-4eb6-a774-8cd0b7198fd9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:57.751666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-690cc6f4-905c-4eb6-a774-8cd0b7198fd9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:57.752113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-690cc6f4-905c-4eb6-a774-8cd0b7198fd9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:57.752818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-690cc6f4-905c-4eb6-a774-8cd0b7198fd9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:57.753277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-690cc6f4-905c-4eb6-a774-8cd0b7198fd9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:57.753703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-690cc6f4-905c-4eb6-a774-8cd0b7198fd9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:57.889537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-690cc6f4-905c-4eb6-a774-8cd0b7198fd9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:57.897314 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-690cc6f4-905c-4eb6-a774-8cd0b7198fd9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1264 microversion: 2.1 time: 0.158167 Aug 23 18:41:57.897896 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3439/7012] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:57 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:58.919220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-28f8403a-4612-463b-ae6d-9689407e70d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:41:58.919767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-28f8403a-4612-463b-ae6d-9689407e70d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:41:58.926660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28f8403a-4612-463b-ae6d-9689407e70d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:58.927168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28f8403a-4612-463b-ae6d-9689407e70d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:58.927622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28f8403a-4612-463b-ae6d-9689407e70d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:58.928335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28f8403a-4612-463b-ae6d-9689407e70d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:58.928806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28f8403a-4612-463b-ae6d-9689407e70d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:58.929254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28f8403a-4612-463b-ae6d-9689407e70d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:59.069093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-28f8403a-4612-463b-ae6d-9689407e70d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:41:59.077121 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-28f8403a-4612-463b-ae6d-9689407e70d3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1264 microversion: 2.1 time: 0.162585 Aug 23 18:41:59.077703 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3574/7013] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:41:58 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:41:59.727404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-c68a909a-cb4b-4892-8308-f1f65823b5a3 req-dd26c2d0-dc05-439f-a5c9-51ef7fa51cae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb", "name": "network-vif-plugged", "status": "completed", "tag": "5b5e0f0d-b2ed-4883-8c39-3c770555ae73"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:41:59.738402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c68a909a-cb4b-4892-8308-f1f65823b5a3 req-dd26c2d0-dc05-439f-a5c9-51ef7fa51cae service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:41:59.738930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c68a909a-cb4b-4892-8308-f1f65823b5a3 req-dd26c2d0-dc05-439f-a5c9-51ef7fa51cae service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:41:59.739392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c68a909a-cb4b-4892-8308-f1f65823b5a3 req-dd26c2d0-dc05-439f-a5c9-51ef7fa51cae service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:41:59.751290 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-c68a909a-cb4b-4892-8308-f1f65823b5a3 req-dd26c2d0-dc05-439f-a5c9-51ef7fa51cae service nova] Creating event network-vif-plugged:5b5e0f0d-b2ed-4883-8c39-3c770555ae73 for instance 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb on n-h2-850468-16 Aug 23 18:41:59.756398 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-c68a909a-cb4b-4892-8308-f1f65823b5a3 req-dd26c2d0-dc05-439f-a5c9-51ef7fa51cae service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032710 Aug 23 18:41:59.757163 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3440/7014] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:42:00.098709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-693abf4e-7bff-4f39-8725-4131d01036f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:42:00.099340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-693abf4e-7bff-4f39-8725-4131d01036f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:42:00.106575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-693abf4e-7bff-4f39-8725-4131d01036f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:42:00.107081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-693abf4e-7bff-4f39-8725-4131d01036f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:42:00.107534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-693abf4e-7bff-4f39-8725-4131d01036f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:42:00.108241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-693abf4e-7bff-4f39-8725-4131d01036f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:42:00.108756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-693abf4e-7bff-4f39-8725-4131d01036f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:42:00.109154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-693abf4e-7bff-4f39-8725-4131d01036f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:42:00.241405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-693abf4e-7bff-4f39-8725-4131d01036f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:42:00.249474 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-693abf4e-7bff-4f39-8725-4131d01036f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1264 microversion: 2.1 time: 0.154666 Aug 23 18:42:00.250053 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3575/7015] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:42:00 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:42:01.272224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f70e8a25-85ba-4ed9-b302-fb28d052baa9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:42:01.272932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f70e8a25-85ba-4ed9-b302-fb28d052baa9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:42:01.280119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f70e8a25-85ba-4ed9-b302-fb28d052baa9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:42:01.280621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f70e8a25-85ba-4ed9-b302-fb28d052baa9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:42:01.281049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f70e8a25-85ba-4ed9-b302-fb28d052baa9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:42:01.281752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f70e8a25-85ba-4ed9-b302-fb28d052baa9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:42:01.282205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f70e8a25-85ba-4ed9-b302-fb28d052baa9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:42:01.282662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f70e8a25-85ba-4ed9-b302-fb28d052baa9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:42:01.419774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f70e8a25-85ba-4ed9-b302-fb28d052baa9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:42:01.427500 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f70e8a25-85ba-4ed9-b302-fb28d052baa9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1451 microversion: 2.1 time: 0.160374 Aug 23 18:42:01.428063 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3441/7016] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:42:01 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:42:01.447965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8b732a76-4b68-45b2-88ee-f7034de242f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:42:01.448595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8b732a76-4b68-45b2-88ee-f7034de242f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:42:01.455508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b732a76-4b68-45b2-88ee-f7034de242f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:42:01.455949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b732a76-4b68-45b2-88ee-f7034de242f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:42:01.456400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b732a76-4b68-45b2-88ee-f7034de242f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:42:01.457109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b732a76-4b68-45b2-88ee-f7034de242f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:42:01.457585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b732a76-4b68-45b2-88ee-f7034de242f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:42:01.458023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b732a76-4b68-45b2-88ee-f7034de242f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:42:01.593315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8b732a76-4b68-45b2-88ee-f7034de242f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:42:01.601182 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8b732a76-4b68-45b2-88ee-f7034de242f4 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1451 microversion: 2.1 time: 0.157534 Aug 23 18:42:01.601797 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3576/7017] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:42:01 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:42:03.305445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-9391868c-0f44-49aa-a785-e9df2e49bba5 req-0c8e314e-0238-4681-9e42-b321f39aacf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb", "tag": "5b5e0f0d-b2ed-4883-8c39-3c770555ae73"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:42:03.315815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9391868c-0f44-49aa-a785-e9df2e49bba5 req-0c8e314e-0238-4681-9e42-b321f39aacf7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:42:03.316291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9391868c-0f44-49aa-a785-e9df2e49bba5 req-0c8e314e-0238-4681-9e42-b321f39aacf7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:42:03.316720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9391868c-0f44-49aa-a785-e9df2e49bba5 req-0c8e314e-0238-4681-9e42-b321f39aacf7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:42:03.329056 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-9391868c-0f44-49aa-a785-e9df2e49bba5 req-0c8e314e-0238-4681-9e42-b321f39aacf7 service nova] Creating event network-changed:5b5e0f0d-b2ed-4883-8c39-3c770555ae73 for instance 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb on n-h2-850468-16 Aug 23 18:42:03.334159 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-9391868c-0f44-49aa-a785-e9df2e49bba5 req-0c8e314e-0238-4681-9e42-b321f39aacf7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032372 Aug 23 18:42:03.334799 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3442/7018] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:42:53.051062 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:42:53.051599 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 18:42:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:43:53.114125 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a3fd44c-0004-4783-9f1a-6f2fcc77fcee] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 18:43:53.115204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=32 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:43:53.116110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=80 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:43:53.120686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2050816382", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1889341503", "security_groups": [{"name": "tempest-secgroup-smoke-96222629"}], "block_device_mapping_v2": [{"uuid": "9b4d1aad-43a9-4d18-a385-680848810cea", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b72a85dc-9cf5-4dba-9938-31cafa49248b"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:43:53.240328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] validate_networks() for [('b72a85dc-9cf5-4dba-9938-31cafa49248b', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:43:53.935737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:43:53.936197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:43:53.936688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:43:53.937110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:43:53.937533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:43:53.947150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:43:53.947646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:43:53.948131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:43:53.948866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:43:53.949336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:43:53.949775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:43:53.967774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:43:53.973722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Getting quotas for user c77b0208b95843d6a5dac5c4a1ac3d8a and project 318917738a5f43d5924bc941992f26a0. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:43:54.030775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:43:54.032973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9b4d1aad-43a9-4d18-a385-680848810cea',volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:43:54.149349 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a3fd44c-0004-4783-9f1a-6f2fcc77fcee] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 59350. Aug 23 18:43:54.166252 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3fbc2b73-d28f-4be1-982a-dea4b99c6cc8 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.054958 Aug 23 18:43:54.166952 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3577/7019] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:43:53 2022] POST /compute/v2.1/servers => generated 404 bytes in 1056 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:43:54.176793 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 23 18:43:54.177796 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 23 18:43:54.178584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:43:54.179335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:43:54.184104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-55878abd-4478-43bb-9930-28bfb52d721c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:43:54.184752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-55878abd-4478-43bb-9930-28bfb52d721c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:43:54.245897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-55878abd-4478-43bb-9930-28bfb52d721c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:43:54.252876 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-55878abd-4478-43bb-9930-28bfb52d721c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1095 microversion: 2.1 time: 0.078825 Aug 23 18:43:54.253444 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3443/7020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:43:54 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:43:55.275116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ba1a1ed1-f0fb-4527-a42a-ec2d6c32e8fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:43:55.275827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ba1a1ed1-f0fb-4527-a42a-ec2d6c32e8fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:43:55.329992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ba1a1ed1-f0fb-4527-a42a-ec2d6c32e8fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:43:55.337464 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ba1a1ed1-f0fb-4527-a42a-ec2d6c32e8fa tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1095 microversion: 2.1 time: 0.067503 Aug 23 18:43:55.338033 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3578/7021] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:43:55 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:43:56.358463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cd56ba2c-088a-4d01-b704-af0c900664d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:43:56.359157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cd56ba2c-088a-4d01-b704-af0c900664d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:43:56.369594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd56ba2c-088a-4d01-b704-af0c900664d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:43:56.370090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd56ba2c-088a-4d01-b704-af0c900664d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:43:56.370880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd56ba2c-088a-4d01-b704-af0c900664d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:43:56.371969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd56ba2c-088a-4d01-b704-af0c900664d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:43:56.372478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd56ba2c-088a-4d01-b704-af0c900664d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:43:56.373247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd56ba2c-088a-4d01-b704-af0c900664d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:43:56.382487 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 59376. Aug 23 18:43:56.392832 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 59378. Aug 23 18:43:56.446049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cd56ba2c-088a-4d01-b704-af0c900664d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:43:56.454385 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cd56ba2c-088a-4d01-b704-af0c900664d6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1145 microversion: 2.1 time: 0.099747 Aug 23 18:43:56.454994 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3444/7022] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:43:56 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1145 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:43:57.478099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03b5a1e9-a457-4219-9523-6cf4b3567bab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:43:57.478765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-03b5a1e9-a457-4219-9523-6cf4b3567bab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:43:57.486947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03b5a1e9-a457-4219-9523-6cf4b3567bab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:43:57.487672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03b5a1e9-a457-4219-9523-6cf4b3567bab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:43:57.488659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03b5a1e9-a457-4219-9523-6cf4b3567bab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:43:57.489404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03b5a1e9-a457-4219-9523-6cf4b3567bab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:43:57.489887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03b5a1e9-a457-4219-9523-6cf4b3567bab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:43:57.490334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03b5a1e9-a457-4219-9523-6cf4b3567bab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:43:57.564770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-03b5a1e9-a457-4219-9523-6cf4b3567bab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:43:57.573620 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-03b5a1e9-a457-4219-9523-6cf4b3567bab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1211 microversion: 2.1 time: 0.100467 Aug 23 18:43:57.574212 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3579/7023] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:43:57 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:43:58.595214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d8b77c8-783a-4c4a-b730-5dcaff962757 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:43:58.595933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d8b77c8-783a-4c4a-b730-5dcaff962757 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:43:58.602659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d8b77c8-783a-4c4a-b730-5dcaff962757 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:43:58.603141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d8b77c8-783a-4c4a-b730-5dcaff962757 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:43:58.603582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d8b77c8-783a-4c4a-b730-5dcaff962757 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:43:58.604297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d8b77c8-783a-4c4a-b730-5dcaff962757 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:43:58.604752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d8b77c8-783a-4c4a-b730-5dcaff962757 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:43:58.605184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d8b77c8-783a-4c4a-b730-5dcaff962757 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:43:58.817076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7d8b77c8-783a-4c4a-b730-5dcaff962757 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:43:58.825630 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d8b77c8-783a-4c4a-b730-5dcaff962757 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1277 microversion: 2.1 time: 0.234398 Aug 23 18:43:58.826233 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3445/7024] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:43:58 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1277 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:43:59.185828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-cae1d879-e304-4f56-ac7b-d6b9b5e6e14e req-e669929c-2dd5-4197-9d53-acd624425edd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f0f158-62d4-4913-96f1-548af3b52ae2", "tag": "b0b5901d-380a-4bd7-8ac7-b9cd1e6d78ae"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:43:59.199526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cae1d879-e304-4f56-ac7b-d6b9b5e6e14e req-e669929c-2dd5-4197-9d53-acd624425edd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:43:59.200103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cae1d879-e304-4f56-ac7b-d6b9b5e6e14e req-e669929c-2dd5-4197-9d53-acd624425edd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:43:59.200639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cae1d879-e304-4f56-ac7b-d6b9b5e6e14e req-e669929c-2dd5-4197-9d53-acd624425edd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:43:59.216033 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-cae1d879-e304-4f56-ac7b-d6b9b5e6e14e req-e669929c-2dd5-4197-9d53-acd624425edd service nova] Creating event network-changed:b0b5901d-380a-4bd7-8ac7-b9cd1e6d78ae for instance 97f0f158-62d4-4913-96f1-548af3b52ae2 on n-h1-850468-16 Aug 23 18:43:59.222316 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-cae1d879-e304-4f56-ac7b-d6b9b5e6e14e req-e669929c-2dd5-4197-9d53-acd624425edd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119617 Aug 23 18:43:59.223223 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3580/7025] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:43:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:43:59.847966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f2df6ca2-9647-404b-9485-2c2659f86738 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:43:59.848886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f2df6ca2-9647-404b-9485-2c2659f86738 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:43:59.857247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2df6ca2-9647-404b-9485-2c2659f86738 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:43:59.857962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2df6ca2-9647-404b-9485-2c2659f86738 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:43:59.858476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2df6ca2-9647-404b-9485-2c2659f86738 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:43:59.859306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2df6ca2-9647-404b-9485-2c2659f86738 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:43:59.859932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2df6ca2-9647-404b-9485-2c2659f86738 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:43:59.860597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2df6ca2-9647-404b-9485-2c2659f86738 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:00.094359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f2df6ca2-9647-404b-9485-2c2659f86738 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:00.104269 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f2df6ca2-9647-404b-9485-2c2659f86738 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1277 microversion: 2.1 time: 0.261088 Aug 23 18:44:00.105026 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3446/7026] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:43:59 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:01.130516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2d2c1d64-f679-4546-be03-92e6a2334e31 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:01.131532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2d2c1d64-f679-4546-be03-92e6a2334e31 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:01.139986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d2c1d64-f679-4546-be03-92e6a2334e31 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:01.140492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d2c1d64-f679-4546-be03-92e6a2334e31 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:01.141236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d2c1d64-f679-4546-be03-92e6a2334e31 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:01.142207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d2c1d64-f679-4546-be03-92e6a2334e31 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:01.142714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d2c1d64-f679-4546-be03-92e6a2334e31 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:01.143403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2d2c1d64-f679-4546-be03-92e6a2334e31 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:01.308544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2d2c1d64-f679-4546-be03-92e6a2334e31 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:01.318391 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2d2c1d64-f679-4546-be03-92e6a2334e31 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1277 microversion: 2.1 time: 0.194179 Aug 23 18:44:01.318951 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3581/7027] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:01 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1277 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:02.340157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-60ac3620-08cd-4afa-bfda-0f10fa6550f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:02.341037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-60ac3620-08cd-4afa-bfda-0f10fa6550f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:02.348202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60ac3620-08cd-4afa-bfda-0f10fa6550f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:02.348685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60ac3620-08cd-4afa-bfda-0f10fa6550f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:02.349122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60ac3620-08cd-4afa-bfda-0f10fa6550f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:02.349821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60ac3620-08cd-4afa-bfda-0f10fa6550f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:02.350270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60ac3620-08cd-4afa-bfda-0f10fa6550f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:02.350724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60ac3620-08cd-4afa-bfda-0f10fa6550f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:02.497043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-60ac3620-08cd-4afa-bfda-0f10fa6550f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:02.505840 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-60ac3620-08cd-4afa-bfda-0f10fa6550f9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1277 microversion: 2.1 time: 0.169671 Aug 23 18:44:02.506456 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3447/7028] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:02 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1277 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:03.527195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-24a5aa53-4c88-435d-8051-015f40c0a9a3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:03.527837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-24a5aa53-4c88-435d-8051-015f40c0a9a3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:03.535481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24a5aa53-4c88-435d-8051-015f40c0a9a3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:03.535979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24a5aa53-4c88-435d-8051-015f40c0a9a3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:03.536432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24a5aa53-4c88-435d-8051-015f40c0a9a3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:03.537148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24a5aa53-4c88-435d-8051-015f40c0a9a3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:03.537624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24a5aa53-4c88-435d-8051-015f40c0a9a3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:03.538068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-24a5aa53-4c88-435d-8051-015f40c0a9a3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:03.671521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-24a5aa53-4c88-435d-8051-015f40c0a9a3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:03.679667 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-24a5aa53-4c88-435d-8051-015f40c0a9a3 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1265 microversion: 2.1 time: 0.156441 Aug 23 18:44:03.680235 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3582/7029] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:03 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:04.701654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-43ee0477-04f1-4eb0-ac66-946f5fc7ba79 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:04.702269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-43ee0477-04f1-4eb0-ac66-946f5fc7ba79 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:04.704968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:44:04.711892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43ee0477-04f1-4eb0-ac66-946f5fc7ba79 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:04.712377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43ee0477-04f1-4eb0-ac66-946f5fc7ba79 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:04.712813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43ee0477-04f1-4eb0-ac66-946f5fc7ba79 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:04.713499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43ee0477-04f1-4eb0-ac66-946f5fc7ba79 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:04.713948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43ee0477-04f1-4eb0-ac66-946f5fc7ba79 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:04.714369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43ee0477-04f1-4eb0-ac66-946f5fc7ba79 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:04.845844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-43ee0477-04f1-4eb0-ac66-946f5fc7ba79 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:04.854441 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-43ee0477-04f1-4eb0-ac66-946f5fc7ba79 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1265 microversion: 2.1 time: 0.156928 Aug 23 18:44:04.855027 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3448/7030] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:04 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:05.876171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3a6cca31-e624-4aab-b27c-eef373de1c8c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:05.876800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3a6cca31-e624-4aab-b27c-eef373de1c8c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:05.878954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:44:05.880122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:44:05.886015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a6cca31-e624-4aab-b27c-eef373de1c8c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:05.886520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a6cca31-e624-4aab-b27c-eef373de1c8c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:05.886998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a6cca31-e624-4aab-b27c-eef373de1c8c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:05.887716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a6cca31-e624-4aab-b27c-eef373de1c8c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:05.888196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a6cca31-e624-4aab-b27c-eef373de1c8c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:05.888640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3a6cca31-e624-4aab-b27c-eef373de1c8c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:06.020969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3a6cca31-e624-4aab-b27c-eef373de1c8c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:06.028708 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3a6cca31-e624-4aab-b27c-eef373de1c8c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1265 microversion: 2.1 time: 0.156621 Aug 23 18:44:06.029274 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3583/7031] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:05 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:07.050102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3a2cfb5b-9e42-4a03-bdb4-292d9f603acb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:07.050748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3a2cfb5b-9e42-4a03-bdb4-292d9f603acb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:07.057561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a2cfb5b-9e42-4a03-bdb4-292d9f603acb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:07.058058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a2cfb5b-9e42-4a03-bdb4-292d9f603acb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:07.058504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a2cfb5b-9e42-4a03-bdb4-292d9f603acb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:07.059225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a2cfb5b-9e42-4a03-bdb4-292d9f603acb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:07.059689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a2cfb5b-9e42-4a03-bdb4-292d9f603acb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:07.060122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a2cfb5b-9e42-4a03-bdb4-292d9f603acb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:07.191803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3a2cfb5b-9e42-4a03-bdb4-292d9f603acb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:07.199776 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3a2cfb5b-9e42-4a03-bdb4-292d9f603acb tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1265 microversion: 2.1 time: 0.153534 Aug 23 18:44:07.200288 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3449/7032] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:07 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:08.220735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dd1cf3b8-9556-4677-8108-98fb41ad8aa6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:08.221385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dd1cf3b8-9556-4677-8108-98fb41ad8aa6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:08.228352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd1cf3b8-9556-4677-8108-98fb41ad8aa6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:08.228851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd1cf3b8-9556-4677-8108-98fb41ad8aa6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:08.229304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd1cf3b8-9556-4677-8108-98fb41ad8aa6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:08.230014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd1cf3b8-9556-4677-8108-98fb41ad8aa6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:08.230490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd1cf3b8-9556-4677-8108-98fb41ad8aa6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:08.230959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dd1cf3b8-9556-4677-8108-98fb41ad8aa6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:08.367228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dd1cf3b8-9556-4677-8108-98fb41ad8aa6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:08.375049 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dd1cf3b8-9556-4677-8108-98fb41ad8aa6 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1265 microversion: 2.1 time: 0.158254 Aug 23 18:44:08.375627 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3584/7033] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:08 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:44:09.396336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-337731cd-b70e-4ccd-bb14-c57f90c9dbe1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:09.396953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-337731cd-b70e-4ccd-bb14-c57f90c9dbe1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:09.403947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-337731cd-b70e-4ccd-bb14-c57f90c9dbe1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:09.404440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-337731cd-b70e-4ccd-bb14-c57f90c9dbe1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:09.404880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-337731cd-b70e-4ccd-bb14-c57f90c9dbe1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:09.405586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-337731cd-b70e-4ccd-bb14-c57f90c9dbe1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:09.406043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-337731cd-b70e-4ccd-bb14-c57f90c9dbe1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:09.406474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-337731cd-b70e-4ccd-bb14-c57f90c9dbe1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:09.550841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-337731cd-b70e-4ccd-bb14-c57f90c9dbe1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:09.558622 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-337731cd-b70e-4ccd-bb14-c57f90c9dbe1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1265 microversion: 2.1 time: 0.166135 Aug 23 18:44:09.559195 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3450/7034] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:09 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:10.579442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03226e5e-a95e-48f6-91af-10e97168e62f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:10.580066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-03226e5e-a95e-48f6-91af-10e97168e62f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:10.587498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03226e5e-a95e-48f6-91af-10e97168e62f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:10.587998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03226e5e-a95e-48f6-91af-10e97168e62f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:10.588452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03226e5e-a95e-48f6-91af-10e97168e62f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:10.589161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03226e5e-a95e-48f6-91af-10e97168e62f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:10.589636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03226e5e-a95e-48f6-91af-10e97168e62f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:10.590078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-03226e5e-a95e-48f6-91af-10e97168e62f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:10.725122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-03226e5e-a95e-48f6-91af-10e97168e62f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:10.733118 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-03226e5e-a95e-48f6-91af-10e97168e62f tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1265 microversion: 2.1 time: 0.157632 Aug 23 18:44:10.733778 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3585/7035] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:10 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:11.754466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-935bf264-05b9-4406-a94d-928fdb433a04 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:11.755107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-935bf264-05b9-4406-a94d-928fdb433a04 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:11.762938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-935bf264-05b9-4406-a94d-928fdb433a04 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:11.763428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-935bf264-05b9-4406-a94d-928fdb433a04 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:11.763866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-935bf264-05b9-4406-a94d-928fdb433a04 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:11.764589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-935bf264-05b9-4406-a94d-928fdb433a04 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:11.765047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-935bf264-05b9-4406-a94d-928fdb433a04 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:11.765472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-935bf264-05b9-4406-a94d-928fdb433a04 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:11.898241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-935bf264-05b9-4406-a94d-928fdb433a04 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:11.905995 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-935bf264-05b9-4406-a94d-928fdb433a04 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1265 microversion: 2.1 time: 0.155475 Aug 23 18:44:11.906576 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3451/7036] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:11 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:12.845439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-146f61cb-ee02-4990-be26-cea2aef49d1e req-e56636ee-b1f3-4da1-a186-27be31e1fcdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f0f158-62d4-4913-96f1-548af3b52ae2", "name": "network-vif-plugged", "status": "completed", "tag": "b0b5901d-380a-4bd7-8ac7-b9cd1e6d78ae"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:44:12.855191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-146f61cb-ee02-4990-be26-cea2aef49d1e req-e56636ee-b1f3-4da1-a186-27be31e1fcdd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:12.855692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-146f61cb-ee02-4990-be26-cea2aef49d1e req-e56636ee-b1f3-4da1-a186-27be31e1fcdd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:12.856148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-146f61cb-ee02-4990-be26-cea2aef49d1e req-e56636ee-b1f3-4da1-a186-27be31e1fcdd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:12.867241 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-146f61cb-ee02-4990-be26-cea2aef49d1e req-e56636ee-b1f3-4da1-a186-27be31e1fcdd service nova] Creating event network-vif-plugged:b0b5901d-380a-4bd7-8ac7-b9cd1e6d78ae for instance 97f0f158-62d4-4913-96f1-548af3b52ae2 on n-h1-850468-16 Aug 23 18:44:12.872227 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-146f61cb-ee02-4990-be26-cea2aef49d1e req-e56636ee-b1f3-4da1-a186-27be31e1fcdd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093180 Aug 23 18:44:12.872815 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3586/7037] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:44:12.927428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3ddf9f25-e069-46a8-ba2c-4bf0f124068b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:12.928046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3ddf9f25-e069-46a8-ba2c-4bf0f124068b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:12.934944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ddf9f25-e069-46a8-ba2c-4bf0f124068b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:12.935441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ddf9f25-e069-46a8-ba2c-4bf0f124068b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:12.935883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ddf9f25-e069-46a8-ba2c-4bf0f124068b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:12.936615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ddf9f25-e069-46a8-ba2c-4bf0f124068b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:12.937078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ddf9f25-e069-46a8-ba2c-4bf0f124068b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:12.937508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3ddf9f25-e069-46a8-ba2c-4bf0f124068b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:13.104760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3ddf9f25-e069-46a8-ba2c-4bf0f124068b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:13.113634 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3ddf9f25-e069-46a8-ba2c-4bf0f124068b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1265 microversion: 2.1 time: 0.190534 Aug 23 18:44:13.114203 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3452/7038] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:12 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:14.136200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-02665360-132b-4407-8b1e-55447f2f8427 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:14.136923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-02665360-132b-4407-8b1e-55447f2f8427 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:14.143156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02665360-132b-4407-8b1e-55447f2f8427 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:14.143655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02665360-132b-4407-8b1e-55447f2f8427 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:14.144111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02665360-132b-4407-8b1e-55447f2f8427 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:14.144822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02665360-132b-4407-8b1e-55447f2f8427 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:14.145292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02665360-132b-4407-8b1e-55447f2f8427 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:14.145735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-02665360-132b-4407-8b1e-55447f2f8427 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:14.286201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-02665360-132b-4407-8b1e-55447f2f8427 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:14.294188 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-02665360-132b-4407-8b1e-55447f2f8427 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1265 microversion: 2.1 time: 0.163059 Aug 23 18:44:14.294827 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3587/7039] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:14 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:15.316135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d42bd6ca-41f3-4aa0-bfb0-93c832bff80e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:15.316755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d42bd6ca-41f3-4aa0-bfb0-93c832bff80e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:15.325169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d42bd6ca-41f3-4aa0-bfb0-93c832bff80e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:15.325665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d42bd6ca-41f3-4aa0-bfb0-93c832bff80e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:15.326098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d42bd6ca-41f3-4aa0-bfb0-93c832bff80e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:15.327038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d42bd6ca-41f3-4aa0-bfb0-93c832bff80e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:15.327498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d42bd6ca-41f3-4aa0-bfb0-93c832bff80e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:15.327924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d42bd6ca-41f3-4aa0-bfb0-93c832bff80e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:15.466053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d42bd6ca-41f3-4aa0-bfb0-93c832bff80e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:15.475267 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d42bd6ca-41f3-4aa0-bfb0-93c832bff80e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1452 microversion: 2.1 time: 0.163614 Aug 23 18:44:15.475848 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3453/7040] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:15 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:44:15.495438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-49d64666-f6c0-40d5-aa60-dd8344008901 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:44:15.496206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-49d64666-f6c0-40d5-aa60-dd8344008901 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:44:15.503554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49d64666-f6c0-40d5-aa60-dd8344008901 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:15.504144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49d64666-f6c0-40d5-aa60-dd8344008901 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:15.504660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49d64666-f6c0-40d5-aa60-dd8344008901 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:15.505687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49d64666-f6c0-40d5-aa60-dd8344008901 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:15.506189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49d64666-f6c0-40d5-aa60-dd8344008901 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:15.506668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-49d64666-f6c0-40d5-aa60-dd8344008901 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:15.641772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-49d64666-f6c0-40d5-aa60-dd8344008901 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:44:15.650508 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-49d64666-f6c0-40d5-aa60-dd8344008901 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1452 microversion: 2.1 time: 0.158988 Aug 23 18:44:15.651103 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3588/7041] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:44:15 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:44:17.351373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-052e34ac-6445-43f5-9bb8-028a91a3f1e6 req-77ec1d4e-249e-4278-bf31-28379aeeec61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f0f158-62d4-4913-96f1-548af3b52ae2", "tag": "b0b5901d-380a-4bd7-8ac7-b9cd1e6d78ae"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:44:17.360871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-052e34ac-6445-43f5-9bb8-028a91a3f1e6 req-77ec1d4e-249e-4278-bf31-28379aeeec61 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:44:17.361419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-052e34ac-6445-43f5-9bb8-028a91a3f1e6 req-77ec1d4e-249e-4278-bf31-28379aeeec61 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:44:17.361917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-052e34ac-6445-43f5-9bb8-028a91a3f1e6 req-77ec1d4e-249e-4278-bf31-28379aeeec61 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:44:17.373554 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-052e34ac-6445-43f5-9bb8-028a91a3f1e6 req-77ec1d4e-249e-4278-bf31-28379aeeec61 service nova] Creating event network-changed:b0b5901d-380a-4bd7-8ac7-b9cd1e6d78ae for instance 97f0f158-62d4-4913-96f1-548af3b52ae2 on n-h1-850468-16 Aug 23 18:44:17.380588 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-052e34ac-6445-43f5-9bb8-028a91a3f1e6 req-77ec1d4e-249e-4278-bf31-28379aeeec61 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098019 Aug 23 18:44:17.381350 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3454/7042] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:44:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:44:21.327602 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:44:21.328148 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 18:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:44:21.792882 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:44:21.793398 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 18:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:44:21.858998 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:44:21.859196 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 18:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:45:56.996640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=26 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:45:56.997386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=62 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:45:57.000041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:45:57.002170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=54 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:45:57.006334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b68915e2-f331-4e6e-8aaa-fa27f86f2313 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:45:57.006889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b68915e2-f331-4e6e-8aaa-fa27f86f2313 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:45:57.014071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-dab61ff8-f5fc-47c1-88a2-e23b72cc61e5 req-709f3240-5def-4555-bcd1-d913c9547941 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97f0f158-62d4-4913-96f1-548af3b52ae2", "tag": "b0b5901d-380a-4bd7-8ac7-b9cd1e6d78ae"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:45:57.019054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b68915e2-f331-4e6e-8aaa-fa27f86f2313 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:45:57.019620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b68915e2-f331-4e6e-8aaa-fa27f86f2313 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:45:57.020677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b68915e2-f331-4e6e-8aaa-fa27f86f2313 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:45:57.021418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b68915e2-f331-4e6e-8aaa-fa27f86f2313 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:45:57.022050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b68915e2-f331-4e6e-8aaa-fa27f86f2313 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:45:57.022510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b68915e2-f331-4e6e-8aaa-fa27f86f2313 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:45:57.026337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dab61ff8-f5fc-47c1-88a2-e23b72cc61e5 req-709f3240-5def-4555-bcd1-d913c9547941 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:45:57.027417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dab61ff8-f5fc-47c1-88a2-e23b72cc61e5 req-709f3240-5def-4555-bcd1-d913c9547941 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:45:57.027417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dab61ff8-f5fc-47c1-88a2-e23b72cc61e5 req-709f3240-5def-4555-bcd1-d913c9547941 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:45:57.039572 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-dab61ff8-f5fc-47c1-88a2-e23b72cc61e5 req-709f3240-5def-4555-bcd1-d913c9547941 service nova] Creating event network-changed:b0b5901d-380a-4bd7-8ac7-b9cd1e6d78ae for instance 97f0f158-62d4-4913-96f1-548af3b52ae2 on n-h1-850468-16 Aug 23 18:45:57.045392 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-dab61ff8-f5fc-47c1-88a2-e23b72cc61e5 req-709f3240-5def-4555-bcd1-d913c9547941 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051111 Aug 23 18:45:57.046304 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3455/7043] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:45:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:45:57.053742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b68915e2-f331-4e6e-8aaa-fa27f86f2313 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:45:57.161002 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b68915e2-f331-4e6e-8aaa-fa27f86f2313 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 204 len: 0 microversion: 2.1 time: 0.168747 Aug 23 18:45:57.161888 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3589/7044] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:45:56 2022] DELETE /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:45:57.170781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1f1c79c1-1fde-4b85-b83f-0533a296de0a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:45:57.171970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1f1c79c1-1fde-4b85-b83f-0533a296de0a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:45:57.178232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f1c79c1-1fde-4b85-b83f-0533a296de0a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:45:57.178861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f1c79c1-1fde-4b85-b83f-0533a296de0a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:45:57.179304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f1c79c1-1fde-4b85-b83f-0533a296de0a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:45:57.180018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f1c79c1-1fde-4b85-b83f-0533a296de0a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:45:57.180471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f1c79c1-1fde-4b85-b83f-0533a296de0a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:45:57.180892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f1c79c1-1fde-4b85-b83f-0533a296de0a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:45:57.365691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1f1c79c1-1fde-4b85-b83f-0533a296de0a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:45:57.373744 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1f1c79c1-1fde-4b85-b83f-0533a296de0a tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1577 microversion: 2.1 time: 0.207503 Aug 23 18:45:57.374329 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3456/7045] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:45:57 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1577 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:45:58.401048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8eaefbd3-0dc0-4243-a784-31d58663cbea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:45:58.401812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8eaefbd3-0dc0-4243-a784-31d58663cbea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:45:58.410084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8eaefbd3-0dc0-4243-a784-31d58663cbea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:45:58.410612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8eaefbd3-0dc0-4243-a784-31d58663cbea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:45:58.411076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8eaefbd3-0dc0-4243-a784-31d58663cbea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:45:58.411811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8eaefbd3-0dc0-4243-a784-31d58663cbea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:45:58.412342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8eaefbd3-0dc0-4243-a784-31d58663cbea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:45:58.412792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8eaefbd3-0dc0-4243-a784-31d58663cbea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:45:58.555612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8eaefbd3-0dc0-4243-a784-31d58663cbea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:45:58.564750 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8eaefbd3-0dc0-4243-a784-31d58663cbea tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1577 microversion: 2.1 time: 0.168078 Aug 23 18:45:58.565345 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3590/7046] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:45:58 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:45:59.405695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-d54c33a7-6886-4398-b1a0-b756aaa18633 req-e122b457-f183-4b9c-81bf-f35780873d44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97f0f158-62d4-4913-96f1-548af3b52ae2", "name": "network-vif-deleted", "tag": "b0b5901d-380a-4bd7-8ac7-b9cd1e6d78ae"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:45:59.418815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d54c33a7-6886-4398-b1a0-b756aaa18633 req-e122b457-f183-4b9c-81bf-f35780873d44 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:45:59.419228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d54c33a7-6886-4398-b1a0-b756aaa18633 req-e122b457-f183-4b9c-81bf-f35780873d44 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:45:59.419939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d54c33a7-6886-4398-b1a0-b756aaa18633 req-e122b457-f183-4b9c-81bf-f35780873d44 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:45:59.432344 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-d54c33a7-6886-4398-b1a0-b756aaa18633 req-e122b457-f183-4b9c-81bf-f35780873d44 service nova] Creating event network-vif-deleted:b0b5901d-380a-4bd7-8ac7-b9cd1e6d78ae for instance 97f0f158-62d4-4913-96f1-548af3b52ae2 on n-h1-850468-16 Aug 23 18:45:59.437262 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-d54c33a7-6886-4398-b1a0-b756aaa18633 req-e122b457-f183-4b9c-81bf-f35780873d44 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035308 Aug 23 18:45:59.437849 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3457/7047] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:45:59.585910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ba630602-d084-4d01-a69c-6384a52b60e1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:45:59.586564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ba630602-d084-4d01-a69c-6384a52b60e1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:45:59.593920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba630602-d084-4d01-a69c-6384a52b60e1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:45:59.594516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba630602-d084-4d01-a69c-6384a52b60e1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:45:59.594988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba630602-d084-4d01-a69c-6384a52b60e1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:45:59.595725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba630602-d084-4d01-a69c-6384a52b60e1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:45:59.596204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba630602-d084-4d01-a69c-6384a52b60e1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:45:59.596660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba630602-d084-4d01-a69c-6384a52b60e1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:45:59.668266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ba630602-d084-4d01-a69c-6384a52b60e1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:45:59.679228 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ba630602-d084-4d01-a69c-6384a52b60e1 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1226 microversion: 2.1 time: 0.096551 Aug 23 18:45:59.680146 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3591/7048] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:45:59 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:00.702217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ad1d4676-abbb-48bd-a046-3e685b8fbe13 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:00.703157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ad1d4676-abbb-48bd-a046-3e685b8fbe13 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:00.710196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad1d4676-abbb-48bd-a046-3e685b8fbe13 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:00.710720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad1d4676-abbb-48bd-a046-3e685b8fbe13 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:00.711163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad1d4676-abbb-48bd-a046-3e685b8fbe13 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:00.711865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad1d4676-abbb-48bd-a046-3e685b8fbe13 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:00.712321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad1d4676-abbb-48bd-a046-3e685b8fbe13 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:00.712750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ad1d4676-abbb-48bd-a046-3e685b8fbe13 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:00.786765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ad1d4676-abbb-48bd-a046-3e685b8fbe13 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:00.794665 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ad1d4676-abbb-48bd-a046-3e685b8fbe13 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1226 microversion: 2.1 time: 0.097523 Aug 23 18:46:00.795231 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3458/7049] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:00 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1226 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:01.378909 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:46:01.379423 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 18:46:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:46:01.815762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-beb6d348-f377-4de2-8b83-4fb728261a4c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:01.816397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-beb6d348-f377-4de2-8b83-4fb728261a4c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:01.823689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beb6d348-f377-4de2-8b83-4fb728261a4c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:01.824198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beb6d348-f377-4de2-8b83-4fb728261a4c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:01.824655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beb6d348-f377-4de2-8b83-4fb728261a4c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:01.825386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beb6d348-f377-4de2-8b83-4fb728261a4c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:01.825857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beb6d348-f377-4de2-8b83-4fb728261a4c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:01.826299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beb6d348-f377-4de2-8b83-4fb728261a4c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:01.897446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-beb6d348-f377-4de2-8b83-4fb728261a4c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:01.905677 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-beb6d348-f377-4de2-8b83-4fb728261a4c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1226 microversion: 2.1 time: 0.094566 Aug 23 18:46:01.906266 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3592/7050] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:01 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1226 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:02.927568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ec5cb81d-7c4c-48df-a9d8-fcc6d248e2ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:02.928096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ec5cb81d-7c4c-48df-a9d8-fcc6d248e2ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:02.934936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec5cb81d-7c4c-48df-a9d8-fcc6d248e2ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:02.935423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec5cb81d-7c4c-48df-a9d8-fcc6d248e2ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:02.935890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec5cb81d-7c4c-48df-a9d8-fcc6d248e2ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:02.936578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec5cb81d-7c4c-48df-a9d8-fcc6d248e2ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:02.937026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec5cb81d-7c4c-48df-a9d8-fcc6d248e2ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:02.937446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ec5cb81d-7c4c-48df-a9d8-fcc6d248e2ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:03.000124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ec5cb81d-7c4c-48df-a9d8-fcc6d248e2ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:03.009079 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ec5cb81d-7c4c-48df-a9d8-fcc6d248e2ba tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 200 len: 1226 microversion: 2.1 time: 0.085466 Aug 23 18:46:03.009651 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3459/7051] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:02 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:04.029843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c68867d-34ee-4669-9b84-e0bb8934b8a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:04.030485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4c68867d-34ee-4669-9b84-e0bb8934b8a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 97f0f158-62d4-4913-96f1-548af3b52ae2] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:04.038456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c68867d-34ee-4669-9b84-e0bb8934b8a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:04.038992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c68867d-34ee-4669-9b84-e0bb8934b8a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:04.039448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c68867d-34ee-4669-9b84-e0bb8934b8a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:04.040194 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c68867d-34ee-4669-9b84-e0bb8934b8a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:04.040632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c68867d-34ee-4669-9b84-e0bb8934b8a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:04.041073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c68867d-34ee-4669-9b84-e0bb8934b8a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:04.060024 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-4c68867d-34ee-4669-9b84-e0bb8934b8a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance 97f0f158-62d4-4913-96f1-548af3b52ae2 could not be found. Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c68867d-34ee-4669-9b84-e0bb8934b8a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 HTTP/1.1 Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 97f0f158-62d4-4913-96f1-548af3b52ae2 could not be found. Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '97f0f158-62d4-4913-96f1-548af3b52ae2'} Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97f0f158-62d4-4913-96f1-548af3b52ae2 could not be found. Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97f0f158-62d4-4913-96f1-548af3b52ae2 could not be found. Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:04.061702 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:04.066821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:04.066821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:04.066821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:04.066821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:46:04.066821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:46:04.066821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97f0f158-62d4-4913-96f1-548af3b52ae2 could not be found. Aug 23 18:46:04.066821 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:04.066821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c68867d-34ee-4669-9b84-e0bb8934b8a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance 97f0f158-62d4-4913-96f1-548af3b52ae2 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:46:04.066821 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4c68867d-34ee-4669-9b84-e0bb8934b8a9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2" status: 404 len: 111 microversion: 2.1 time: 0.037591 Aug 23 18:46:04.066821 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3593/7052] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:04 2022] GET /compute/v2.1/servers/97f0f158-62d4-4913-96f1-548af3b52ae2 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:46:10.301970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d37eafde-49b2-4a7b-ad60-19dd043d18ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:10.302642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d37eafde-49b2-4a7b-ad60-19dd043d18ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:10.304512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-99fe01ba-b05e-48be-855e-80e8004d1b25 req-2253eea9-9fdd-47aa-921c-05f63f5da0c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb", "tag": "5b5e0f0d-b2ed-4883-8c39-3c770555ae73"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:46:10.310099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d37eafde-49b2-4a7b-ad60-19dd043d18ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:10.310692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d37eafde-49b2-4a7b-ad60-19dd043d18ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:10.311603 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d37eafde-49b2-4a7b-ad60-19dd043d18ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:10.312327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d37eafde-49b2-4a7b-ad60-19dd043d18ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:10.313441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d37eafde-49b2-4a7b-ad60-19dd043d18ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:10.313870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d37eafde-49b2-4a7b-ad60-19dd043d18ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:10.316503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-99fe01ba-b05e-48be-855e-80e8004d1b25 req-2253eea9-9fdd-47aa-921c-05f63f5da0c2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:10.317245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-99fe01ba-b05e-48be-855e-80e8004d1b25 req-2253eea9-9fdd-47aa-921c-05f63f5da0c2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:10.317692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-99fe01ba-b05e-48be-855e-80e8004d1b25 req-2253eea9-9fdd-47aa-921c-05f63f5da0c2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:10.330037 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-99fe01ba-b05e-48be-855e-80e8004d1b25 req-2253eea9-9fdd-47aa-921c-05f63f5da0c2 service nova] Creating event network-changed:5b5e0f0d-b2ed-4883-8c39-3c770555ae73 for instance 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb on n-h2-850468-16 Aug 23 18:46:10.335377 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-99fe01ba-b05e-48be-855e-80e8004d1b25 req-2253eea9-9fdd-47aa-921c-05f63f5da0c2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035058 Aug 23 18:46:10.336668 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3594/7053] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:46:10.348488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d37eafde-49b2-4a7b-ad60-19dd043d18ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:46:10.696978 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d37eafde-49b2-4a7b-ad60-19dd043d18ab tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 204 len: 0 microversion: 2.1 time: 0.399969 Aug 23 18:46:10.700751 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3460/7054] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:46:10 2022] DELETE /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:46:10.708436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2166d40e-36ea-4553-92b2-93225943f573 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:10.712475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2166d40e-36ea-4553-92b2-93225943f573 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:10.723510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2166d40e-36ea-4553-92b2-93225943f573 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:10.724130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2166d40e-36ea-4553-92b2-93225943f573 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:10.724675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2166d40e-36ea-4553-92b2-93225943f573 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:10.725499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2166d40e-36ea-4553-92b2-93225943f573 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:10.726078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2166d40e-36ea-4553-92b2-93225943f573 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:10.726656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2166d40e-36ea-4553-92b2-93225943f573 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:10.880287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2166d40e-36ea-4553-92b2-93225943f573 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:10.888080 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2166d40e-36ea-4553-92b2-93225943f573 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1576 microversion: 2.1 time: 0.185761 Aug 23 18:46:10.888652 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3595/7055] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:10 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1576 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:11.911930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66d4f208-c23d-4ac6-9963-5693772bc1c7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:11.912629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66d4f208-c23d-4ac6-9963-5693772bc1c7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:11.920311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66d4f208-c23d-4ac6-9963-5693772bc1c7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:11.920787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66d4f208-c23d-4ac6-9963-5693772bc1c7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:11.921228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66d4f208-c23d-4ac6-9963-5693772bc1c7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:11.921936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66d4f208-c23d-4ac6-9963-5693772bc1c7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:11.923181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66d4f208-c23d-4ac6-9963-5693772bc1c7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:11.923779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66d4f208-c23d-4ac6-9963-5693772bc1c7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:12.058358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66d4f208-c23d-4ac6-9963-5693772bc1c7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:12.066683 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66d4f208-c23d-4ac6-9963-5693772bc1c7 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1457 microversion: 2.1 time: 0.160599 Aug 23 18:46:12.067259 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3461/7056] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:11 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1457 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:46:12.862853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-1f4576af-64d9-4b6f-9853-b4b7f772e867 req-0e536389-8e79-47de-a852-bb38792eca7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb", "name": "network-vif-deleted", "tag": "5b5e0f0d-b2ed-4883-8c39-3c770555ae73"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:46:12.874342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1f4576af-64d9-4b6f-9853-b4b7f772e867 req-0e536389-8e79-47de-a852-bb38792eca7c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:12.874783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1f4576af-64d9-4b6f-9853-b4b7f772e867 req-0e536389-8e79-47de-a852-bb38792eca7c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:12.876135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1f4576af-64d9-4b6f-9853-b4b7f772e867 req-0e536389-8e79-47de-a852-bb38792eca7c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:12.888311 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-1f4576af-64d9-4b6f-9853-b4b7f772e867 req-0e536389-8e79-47de-a852-bb38792eca7c service nova] Creating event network-vif-deleted:5b5e0f0d-b2ed-4883-8c39-3c770555ae73 for instance 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb on n-h2-850468-16 Aug 23 18:46:12.894789 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-1f4576af-64d9-4b6f-9853-b4b7f772e867 req-0e536389-8e79-47de-a852-bb38792eca7c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035755 Aug 23 18:46:12.895395 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3596/7057] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:46:13.088480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3c56c6b2-042a-48ca-8bc8-ce9704460a24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:13.089027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3c56c6b2-042a-48ca-8bc8-ce9704460a24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:13.096932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c56c6b2-042a-48ca-8bc8-ce9704460a24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:13.097428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c56c6b2-042a-48ca-8bc8-ce9704460a24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:13.097872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c56c6b2-042a-48ca-8bc8-ce9704460a24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:13.098610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c56c6b2-042a-48ca-8bc8-ce9704460a24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:13.099076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c56c6b2-042a-48ca-8bc8-ce9704460a24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:13.099511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3c56c6b2-042a-48ca-8bc8-ce9704460a24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:13.172865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3c56c6b2-042a-48ca-8bc8-ce9704460a24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:13.181231 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3c56c6b2-042a-48ca-8bc8-ce9704460a24 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1225 microversion: 2.1 time: 0.096660 Aug 23 18:46:13.181804 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3462/7058] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:13 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:14.205119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-25a61f6b-cd7c-4b75-9cd3-777b8090da11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:14.205837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-25a61f6b-cd7c-4b75-9cd3-777b8090da11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:14.212161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25a61f6b-cd7c-4b75-9cd3-777b8090da11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:14.212657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25a61f6b-cd7c-4b75-9cd3-777b8090da11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:14.213105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25a61f6b-cd7c-4b75-9cd3-777b8090da11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:14.213817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25a61f6b-cd7c-4b75-9cd3-777b8090da11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:14.214288 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25a61f6b-cd7c-4b75-9cd3-777b8090da11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:14.219853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25a61f6b-cd7c-4b75-9cd3-777b8090da11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:14.280963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-25a61f6b-cd7c-4b75-9cd3-777b8090da11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:14.290419 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-25a61f6b-cd7c-4b75-9cd3-777b8090da11 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1225 microversion: 2.1 time: 0.091102 Aug 23 18:46:14.291058 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3597/7059] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:14 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:15.311023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d5c0260-5e5b-40ab-ab94-06caeb5ffd0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:15.311658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2d5c0260-5e5b-40ab-ab94-06caeb5ffd0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:15.319561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d5c0260-5e5b-40ab-ab94-06caeb5ffd0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:15.320058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d5c0260-5e5b-40ab-ab94-06caeb5ffd0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:15.320504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d5c0260-5e5b-40ab-ab94-06caeb5ffd0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:15.321224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d5c0260-5e5b-40ab-ab94-06caeb5ffd0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:15.321685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d5c0260-5e5b-40ab-ab94-06caeb5ffd0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:15.322954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d5c0260-5e5b-40ab-ab94-06caeb5ffd0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:15.390887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2d5c0260-5e5b-40ab-ab94-06caeb5ffd0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:15.399958 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2d5c0260-5e5b-40ab-ab94-06caeb5ffd0e tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1225 microversion: 2.1 time: 0.093078 Aug 23 18:46:15.400622 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3463/7060] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:15 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:16.422268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fa1d1710-bda4-43bd-9747-51d48a76a44c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:16.423548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fa1d1710-bda4-43bd-9747-51d48a76a44c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:16.430439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa1d1710-bda4-43bd-9747-51d48a76a44c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:16.431021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa1d1710-bda4-43bd-9747-51d48a76a44c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:16.431595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa1d1710-bda4-43bd-9747-51d48a76a44c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:16.432322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa1d1710-bda4-43bd-9747-51d48a76a44c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:16.432794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa1d1710-bda4-43bd-9747-51d48a76a44c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:16.433310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa1d1710-bda4-43bd-9747-51d48a76a44c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:16.510803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fa1d1710-bda4-43bd-9747-51d48a76a44c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c77b0208b95843d6a5dac5c4a1ac3d8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '318917738a5f43d5924bc941992f26a0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:16.523332 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fa1d1710-bda4-43bd-9747-51d48a76a44c tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 200 len: 1225 microversion: 2.1 time: 0.105336 Aug 23 18:46:16.523872 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3598/7061] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:16 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:17.544916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95b3238c-28c0-4bc3-ad24-563bd720a8c9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:17.545529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-95b3238c-28c0-4bc3-ad24-563bd720a8c9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:17.553447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95b3238c-28c0-4bc3-ad24-563bd720a8c9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:17.553936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95b3238c-28c0-4bc3-ad24-563bd720a8c9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:17.554374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95b3238c-28c0-4bc3-ad24-563bd720a8c9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:17.555093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95b3238c-28c0-4bc3-ad24-563bd720a8c9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:17.555731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95b3238c-28c0-4bc3-ad24-563bd720a8c9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:17.556164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95b3238c-28c0-4bc3-ad24-563bd720a8c9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:17.569782 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-95b3238c-28c0-4bc3-ad24-563bd720a8c9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb could not be found. Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95b3238c-28c0-4bc3-ad24-563bd720a8c9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb HTTP/1.1 Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb could not be found. Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb'} Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb could not be found. Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb could not be found. Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:17.571448 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:17.575623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:17.575623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:17.575623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:17.575623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:46:17.575623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:46:17.575623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb could not be found. Aug 23 18:46:17.575623 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:17.575623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95b3238c-28c0-4bc3-ad24-563bd720a8c9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance 34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:46:17.575623 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-95b3238c-28c0-4bc3-ad24-563bd720a8c9 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb" status: 404 len: 111 microversion: 2.1 time: 0.031842 Aug 23 18:46:17.575623 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3464/7062] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:17 2022] GET /compute/v2.1/servers/34cef0a8-ae6a-4d5c-8f77-6d5b41dd41bb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:46:18.024939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3d7d5ed-7c20-4425-892e-a79a73bfd2af tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:18.025464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f3d7d5ed-7c20-4425-892e-a79a73bfd2af tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:18.033551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3d7d5ed-7c20-4425-892e-a79a73bfd2af tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:18.034083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3d7d5ed-7c20-4425-892e-a79a73bfd2af tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:18.034573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3d7d5ed-7c20-4425-892e-a79a73bfd2af tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:18.035315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3d7d5ed-7c20-4425-892e-a79a73bfd2af tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:18.035790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3d7d5ed-7c20-4425-892e-a79a73bfd2af tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:18.036236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3d7d5ed-7c20-4425-892e-a79a73bfd2af tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:18.049759 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-f3d7d5ed-7c20-4425-892e-a79a73bfd2af tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3d7d5ed-7c20-4425-892e-a79a73bfd2af tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a HTTP/1.1 Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'a7273a59-b684-49f0-9804-4447afd7942a'} Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:46:18.051486 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3d7d5ed-7c20-4425-892e-a79a73bfd2af tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f3d7d5ed-7c20-4425-892e-a79a73bfd2af tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 404 len: 111 microversion: 2.1 time: 0.031991 Aug 23 18:46:18.055264 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3599/7063] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:46:18 2022] DELETE /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:46:18.061426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d383749-6320-40d2-8ea5-83fb8027526b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:18.062037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2d383749-6320-40d2-8ea5-83fb8027526b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] [instance: a7273a59-b684-49f0-9804-4447afd7942a] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:18.068698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d383749-6320-40d2-8ea5-83fb8027526b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:18.069159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d383749-6320-40d2-8ea5-83fb8027526b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:18.069593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d383749-6320-40d2-8ea5-83fb8027526b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:18.070286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d383749-6320-40d2-8ea5-83fb8027526b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:18.070770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d383749-6320-40d2-8ea5-83fb8027526b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:18.071196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2d383749-6320-40d2-8ea5-83fb8027526b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:18.085445 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-2d383749-6320-40d2-8ea5-83fb8027526b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] HTTP exception thrown: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d383749-6320-40d2-8ea5-83fb8027526b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Request method failure captured: Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a HTTP/1.1 Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBR3MtHpVLyXdgs4jkdP8JIEOEGEAb6H3oBW8n3OY6FTr9DPsG-7OjOf0E1XVp-u82IzaaKPxTrdJsT7OWWC9s8P58nP0eDJfcUYzXaH_K9q-0WKzgv7KQzJu8bQ6Whdnt0OwqDVEZo6jFEcm2xQeV9iozQyCeMJySN7qpBIhAowOr1E Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/318917738a5f43d5924bc941992f26a0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/318917738a5f43d5924bc941992f26a0"}]}] Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestVolumeBootPattern-623587935 Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 318917738a5f43d5924bc941992f26a0 Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestVolumeBootPattern-623587935 Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: c77b0208b95843d6a5dac5c4a1ac3d8a Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestVolumeBootPattern-623587935-project Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'a7273a59-b684-49f0-9804-4447afd7942a'} Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:18.087000 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:18.091089 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:18.091089 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:18.091089 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:18.091089 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:46:18.091089 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:46:18.091089 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. Aug 23 18:46:18.091089 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:18.091089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2d383749-6320-40d2-8ea5-83fb8027526b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Returning 404 to user: Instance a7273a59-b684-49f0-9804-4447afd7942a could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:46:18.091089 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2d383749-6320-40d2-8ea5-83fb8027526b tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a" status: 404 len: 111 microversion: 2.1 time: 0.030867 Aug 23 18:46:18.091089 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3465/7064] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:18 2022] GET /compute/v2.1/servers/a7273a59-b684-49f0-9804-4447afd7942a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:46:21.508059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-402bd3d1-2fdd-4a1f-8b26-20bf8bc93e30 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] Calling method '.version_select at 0x7f27df835f70>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:21.543824 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-402bd3d1-2fdd-4a1f-8b26-20bf8bc93e30 tempest-TestVolumeBootPattern-623587935 tempest-TestVolumeBootPattern-623587935-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1889341503" status: 202 len: 0 microversion: 2.1 time: 0.039352 Aug 23 18:46:21.545265 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3600/7065] 10.222.0.61 () {58 vars in 1263 bytes} [Tue Aug 23 18:46:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1889341503 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:46:40.005185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:46:40.005993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:46:40.128591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-448533801", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:46:40.367336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] validate_networks() for None {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:46:40.559112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:46:40.559536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:46:40.560009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:46:40.560418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:46:40.560830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:46:40.569839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:40.570319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:40.570797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:40.571582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:40.572017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:40.572443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:40.589255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Getting quotas for project 8625b87ec89f455fab6353d3f2cc115d. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:46:40.594747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Getting quotas for user 8bee6d4a233e4daeb2f80cecc32d3e17 and project 8625b87ec89f455fab6353d3f2cc115d. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:46:40.607923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:46:40.610198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:46:40.658569 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fbda81c1-d4e0-49b5-8907-f162f10b2ee3 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.657867 Aug 23 18:46:40.659211 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3466/7066] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:46:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:46:40.669377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:46:40.670374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:46:40.674935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bb4d765c-28f6-4f5a-a3ca-6ba37c206593 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:40.675569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bb4d765c-28f6-4f5a-a3ca-6ba37c206593 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:40.848134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bb4d765c-28f6-4f5a-a3ca-6ba37c206593 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:40.855123 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bb4d765c-28f6-4f5a-a3ca-6ba37c206593 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1221 microversion: 2.1 time: 0.187575 Aug 23 18:46:40.855685 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3601/7067] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:40 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1221 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:46:41.876279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-145976a3-7043-4f86-b3ae-e54649a974b6 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:41.876898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-145976a3-7043-4f86-b3ae-e54649a974b6 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:41.884693 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-145976a3-7043-4f86-b3ae-e54649a974b6 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:41.885121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-145976a3-7043-4f86-b3ae-e54649a974b6 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:41.885567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-145976a3-7043-4f86-b3ae-e54649a974b6 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:41.886269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-145976a3-7043-4f86-b3ae-e54649a974b6 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:41.886756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-145976a3-7043-4f86-b3ae-e54649a974b6 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:41.887188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-145976a3-7043-4f86-b3ae-e54649a974b6 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:41.956459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-145976a3-7043-4f86-b3ae-e54649a974b6 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:41.964210 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-145976a3-7043-4f86-b3ae-e54649a974b6 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1279 microversion: 2.1 time: 0.092142 Aug 23 18:46:41.964789 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3467/7068] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:41 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1279 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:42.988685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7026e31-f1ce-40cb-9da9-61f3a7ec0622 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:42.989207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f7026e31-f1ce-40cb-9da9-61f3a7ec0622 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:42.997447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7026e31-f1ce-40cb-9da9-61f3a7ec0622 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:42.998034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7026e31-f1ce-40cb-9da9-61f3a7ec0622 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:42.998489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7026e31-f1ce-40cb-9da9-61f3a7ec0622 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:42.999414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7026e31-f1ce-40cb-9da9-61f3a7ec0622 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:42.999956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7026e31-f1ce-40cb-9da9-61f3a7ec0622 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:43.000403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7026e31-f1ce-40cb-9da9-61f3a7ec0622 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:43.187496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f7026e31-f1ce-40cb-9da9-61f3a7ec0622 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:43.195928 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f7026e31-f1ce-40cb-9da9-61f3a7ec0622 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1321 microversion: 2.1 time: 0.211934 Aug 23 18:46:43.196685 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3602/7069] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:42 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:43.228144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-613bc649-d205-40ce-a572-ad0d9be228d3 req-a09af36b-ee01-4775-b63b-9e29d5103c7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ef78edf-f2cb-4dfb-98e1-c57c91960f21", "tag": "f1caf41d-dca4-466e-87de-76d311fce123"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:46:43.240479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-613bc649-d205-40ce-a572-ad0d9be228d3 req-a09af36b-ee01-4775-b63b-9e29d5103c7a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:43.241477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-613bc649-d205-40ce-a572-ad0d9be228d3 req-a09af36b-ee01-4775-b63b-9e29d5103c7a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:43.242219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-613bc649-d205-40ce-a572-ad0d9be228d3 req-a09af36b-ee01-4775-b63b-9e29d5103c7a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:43.256315 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-613bc649-d205-40ce-a572-ad0d9be228d3 req-a09af36b-ee01-4775-b63b-9e29d5103c7a service nova] Creating event network-changed:f1caf41d-dca4-466e-87de-76d311fce123 for instance 2ef78edf-f2cb-4dfb-98e1-c57c91960f21 on n-h2-850468-16 Aug 23 18:46:43.261602 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-613bc649-d205-40ce-a572-ad0d9be228d3 req-a09af36b-ee01-4775-b63b-9e29d5103c7a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037294 Aug 23 18:46:43.262463 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3468/7070] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:46:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:46:44.218674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6b602265-7975-4a49-8c5e-4bc79c1756dc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:44.219301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6b602265-7975-4a49-8c5e-4bc79c1756dc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:44.226667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b602265-7975-4a49-8c5e-4bc79c1756dc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:44.227178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b602265-7975-4a49-8c5e-4bc79c1756dc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:44.227628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b602265-7975-4a49-8c5e-4bc79c1756dc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:44.228350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b602265-7975-4a49-8c5e-4bc79c1756dc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:44.228814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b602265-7975-4a49-8c5e-4bc79c1756dc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:44.229244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b602265-7975-4a49-8c5e-4bc79c1756dc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:44.366523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6b602265-7975-4a49-8c5e-4bc79c1756dc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:44.374151 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6b602265-7975-4a49-8c5e-4bc79c1756dc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1321 microversion: 2.1 time: 0.159724 Aug 23 18:46:44.374754 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3603/7071] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:44 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:45.397558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a352c33-17b3-4e99-950e-6ffe1feda6a4 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:45.398293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a352c33-17b3-4e99-950e-6ffe1feda6a4 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:45.404525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a352c33-17b3-4e99-950e-6ffe1feda6a4 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:45.405012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a352c33-17b3-4e99-950e-6ffe1feda6a4 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:45.405503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a352c33-17b3-4e99-950e-6ffe1feda6a4 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:45.406200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a352c33-17b3-4e99-950e-6ffe1feda6a4 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:45.406672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a352c33-17b3-4e99-950e-6ffe1feda6a4 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:45.407095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a352c33-17b3-4e99-950e-6ffe1feda6a4 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:45.540631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a352c33-17b3-4e99-950e-6ffe1feda6a4 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:45.549065 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a352c33-17b3-4e99-950e-6ffe1feda6a4 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1321 microversion: 2.1 time: 0.156637 Aug 23 18:46:45.549836 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3469/7072] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:45 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:46.571587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-304a7ec6-4b60-4b3c-bacb-daf7065a5b53 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:46.572219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-304a7ec6-4b60-4b3c-bacb-daf7065a5b53 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:46.579091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-304a7ec6-4b60-4b3c-bacb-daf7065a5b53 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:46.579628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-304a7ec6-4b60-4b3c-bacb-daf7065a5b53 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:46.580085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-304a7ec6-4b60-4b3c-bacb-daf7065a5b53 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:46.580794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-304a7ec6-4b60-4b3c-bacb-daf7065a5b53 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:46.581273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-304a7ec6-4b60-4b3c-bacb-daf7065a5b53 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:46.581716 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-304a7ec6-4b60-4b3c-bacb-daf7065a5b53 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:46.714389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-304a7ec6-4b60-4b3c-bacb-daf7065a5b53 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:46.723393 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-304a7ec6-4b60-4b3c-bacb-daf7065a5b53 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1321 microversion: 2.1 time: 0.155741 Aug 23 18:46:46.723968 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3604/7073] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:46 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:47.744823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-adcca281-51c1-4cc6-9959-d6f0ea12183e tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:47.745372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-adcca281-51c1-4cc6-9959-d6f0ea12183e tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:47.752763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adcca281-51c1-4cc6-9959-d6f0ea12183e tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:47.753254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adcca281-51c1-4cc6-9959-d6f0ea12183e tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:47.753705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adcca281-51c1-4cc6-9959-d6f0ea12183e tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:47.754404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adcca281-51c1-4cc6-9959-d6f0ea12183e tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:47.754899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adcca281-51c1-4cc6-9959-d6f0ea12183e tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:47.755337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adcca281-51c1-4cc6-9959-d6f0ea12183e tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:47.887141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-adcca281-51c1-4cc6-9959-d6f0ea12183e tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:47.894865 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-adcca281-51c1-4cc6-9959-d6f0ea12183e tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1321 microversion: 2.1 time: 0.153996 Aug 23 18:46:47.895427 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3470/7074] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:47 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:48.916078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-983711e7-f8e1-4836-93af-ee9f5389b042 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:48.916635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-983711e7-f8e1-4836-93af-ee9f5389b042 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:48.923568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-983711e7-f8e1-4836-93af-ee9f5389b042 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:48.924071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-983711e7-f8e1-4836-93af-ee9f5389b042 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:48.924529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-983711e7-f8e1-4836-93af-ee9f5389b042 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:48.925249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-983711e7-f8e1-4836-93af-ee9f5389b042 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:48.925724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-983711e7-f8e1-4836-93af-ee9f5389b042 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:48.926170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-983711e7-f8e1-4836-93af-ee9f5389b042 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:49.058722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-983711e7-f8e1-4836-93af-ee9f5389b042 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:49.067155 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-983711e7-f8e1-4836-93af-ee9f5389b042 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1321 microversion: 2.1 time: 0.155104 Aug 23 18:46:49.067740 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3605/7075] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:48 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:50.088008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-06899e9c-f5c8-47ca-af72-f982478ab5bc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:50.088659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-06899e9c-f5c8-47ca-af72-f982478ab5bc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:50.096426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06899e9c-f5c8-47ca-af72-f982478ab5bc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:50.096913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06899e9c-f5c8-47ca-af72-f982478ab5bc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:50.097356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06899e9c-f5c8-47ca-af72-f982478ab5bc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:50.098056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06899e9c-f5c8-47ca-af72-f982478ab5bc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:50.098514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06899e9c-f5c8-47ca-af72-f982478ab5bc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:50.098964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06899e9c-f5c8-47ca-af72-f982478ab5bc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:50.231816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-06899e9c-f5c8-47ca-af72-f982478ab5bc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:50.240984 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-06899e9c-f5c8-47ca-af72-f982478ab5bc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1321 microversion: 2.1 time: 0.156884 Aug 23 18:46:50.241557 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3471/7076] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:50 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:51.203042 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c415e055-b2d4-45ec-9183-5b1824abd364 req-3e067e42-076d-4000-9289-0fa3b5260f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef78edf-f2cb-4dfb-98e1-c57c91960f21", "name": "network-vif-plugged", "status": "completed", "tag": "f1caf41d-dca4-466e-87de-76d311fce123"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:46:51.210096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:46:51.217635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c415e055-b2d4-45ec-9183-5b1824abd364 req-3e067e42-076d-4000-9289-0fa3b5260f64 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:51.218178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c415e055-b2d4-45ec-9183-5b1824abd364 req-3e067e42-076d-4000-9289-0fa3b5260f64 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:51.218652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c415e055-b2d4-45ec-9183-5b1824abd364 req-3e067e42-076d-4000-9289-0fa3b5260f64 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:51.230867 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c415e055-b2d4-45ec-9183-5b1824abd364 req-3e067e42-076d-4000-9289-0fa3b5260f64 service nova] Creating event network-vif-plugged:f1caf41d-dca4-466e-87de-76d311fce123 for instance 2ef78edf-f2cb-4dfb-98e1-c57c91960f21 on n-h2-850468-16 Aug 23 18:46:51.236922 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c415e055-b2d4-45ec-9183-5b1824abd364 req-3e067e42-076d-4000-9289-0fa3b5260f64 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036952 Aug 23 18:46:51.237546 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3606/7077] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:46:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:46:51.264823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-242e1358-be86-4993-99c8-be61bdf540fd tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:51.265410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-242e1358-be86-4993-99c8-be61bdf540fd tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:51.271766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:46:51.272880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:46:51.282145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-242e1358-be86-4993-99c8-be61bdf540fd tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:51.283770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-242e1358-be86-4993-99c8-be61bdf540fd tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:51.284227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-242e1358-be86-4993-99c8-be61bdf540fd tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:51.284958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-242e1358-be86-4993-99c8-be61bdf540fd tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:51.285400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-242e1358-be86-4993-99c8-be61bdf540fd tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:51.285832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-242e1358-be86-4993-99c8-be61bdf540fd tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:51.424075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-242e1358-be86-4993-99c8-be61bdf540fd tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:51.431778 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-242e1358-be86-4993-99c8-be61bdf540fd tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1321 microversion: 2.1 time: 0.173895 Aug 23 18:46:51.432337 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3472/7078] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:51 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:46:52.455390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93e8bcd2-b04d-4d11-b5b8-358a4da5f1ff tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:52.456112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-93e8bcd2-b04d-4d11-b5b8-358a4da5f1ff tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:52.462643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93e8bcd2-b04d-4d11-b5b8-358a4da5f1ff tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:52.463151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93e8bcd2-b04d-4d11-b5b8-358a4da5f1ff tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:52.463610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93e8bcd2-b04d-4d11-b5b8-358a4da5f1ff tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:52.464324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93e8bcd2-b04d-4d11-b5b8-358a4da5f1ff tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:52.464793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93e8bcd2-b04d-4d11-b5b8-358a4da5f1ff tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:52.465488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93e8bcd2-b04d-4d11-b5b8-358a4da5f1ff tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:52.598326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93e8bcd2-b04d-4d11-b5b8-358a4da5f1ff tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:52.606167 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93e8bcd2-b04d-4d11-b5b8-358a4da5f1ff tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1321 microversion: 2.1 time: 0.156598 Aug 23 18:46:52.606769 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3607/7079] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:52 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:53.627483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-53a87a97-cee0-4e77-b0d9-e453b33fd909 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:53.628131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-53a87a97-cee0-4e77-b0d9-e453b33fd909 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:53.635200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53a87a97-cee0-4e77-b0d9-e453b33fd909 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:53.635682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53a87a97-cee0-4e77-b0d9-e453b33fd909 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:53.636153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53a87a97-cee0-4e77-b0d9-e453b33fd909 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:53.636852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53a87a97-cee0-4e77-b0d9-e453b33fd909 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:53.637307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53a87a97-cee0-4e77-b0d9-e453b33fd909 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:53.637731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53a87a97-cee0-4e77-b0d9-e453b33fd909 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:53.770044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-53a87a97-cee0-4e77-b0d9-e453b33fd909 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:53.777758 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-53a87a97-cee0-4e77-b0d9-e453b33fd909 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1470 microversion: 2.1 time: 0.154354 Aug 23 18:46:53.778314 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3473/7080] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:53 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:53.854512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-97734d82-0a80-4211-8850-6d27488fffe1 tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Calling method '.version_select at 0x7f27ec34ff70>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:53.920645 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-97734d82-0a80-4211-8850-6d27488fffe1 tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2d9b7028d3c3465b8f29d97959f14639" status: 200 len: 371 microversion: 2.1 time: 0.123997 Aug 23 18:46:53.921226 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3608/7081] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Aug 23 18:46:53 2022] GET /compute/v2.1/os-quota-sets/2d9b7028d3c3465b8f29d97959f14639 => generated 371 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:46:53.932653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6764761f-8b11-4601-b454-5af2b9f8cc3a tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-1081402382", "id": 1256546727, "os-flavor-access:is_public": "True"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:46:53.935667 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:46:53.935667 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:46:53.949998 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6764761f-8b11-4601-b454-5af2b9f8cc3a tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.021037 Aug 23 18:46:53.950582 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3474/7082] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:46:53 2022] POST /compute/v2.1/flavors => generated 438 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:46:53.962853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1256546727"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:46:53.965744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:53.972584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:53.973089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:53.973551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:53.974273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:53.974787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:53.975243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:54.111649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4dca57f2ab524074b3200487968a495b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9b7028d3c3465b8f29d97959f14639', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:54.118140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-1081402382 {{(pid=128808) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 18:46:54.124663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:54.125160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:54.125612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:54.126983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:54.127450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:54.127888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:54.154149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Getting quotas for project 8625b87ec89f455fab6353d3f2cc115d. Resources: {'cores', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:46:54.159374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Getting quotas for user 8bee6d4a233e4daeb2f80cecc32d3e17 and project 8625b87ec89f455fab6353d3f2cc115d. Resources: {'cores', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:46:54.172489 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.compute.api [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] ram quota exceeded for 2d9b7028d3c3465b8f29d97959f14639, tried to resize instance. Aug 23 18:46:54.173664 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Request method failure captured: Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21/action HTTP/1.1 Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 39 Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSCP6q2w9VC4s4i1l4L8tFobR524Nt-TBhrAC8nUyn_-2-8KUxvOeURjMcQ_O23WyR0oK-Z0j4TO_Gl7HLpEpewjAn9QDd0g4El0t0qvNERI_0KPYW-Jg3WSqWWq3etl-6BDEuScz30L_3ozk4dPZb_i1rSGeLtSJZ39N7tI7jobVKc Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 2d9b7028d3c3465b8f29d97959f14639 Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-830794493 Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Role: reader,member,admin Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: reader,member,admin Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d9b7028d3c3465b8f29d97959f14639"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d9b7028d3c3465b8f29d97959f14639"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d9b7028d3c3465b8f29d97959f14639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d9b7028d3c3465b8f29d97959f14639"}]}] Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersAdminNegativeTestJSON-830794493 Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 2d9b7028d3c3465b8f29d97959f14639 Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-830794493 Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersAdminNegativeTestJSON-830794493-project-admin Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 4dca57f2ab524074b3200487968a495b Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersAdminNegativeTestJSON-830794493-project-admin Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: {"resize": {"flavorRef": "1256546727"}} Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '2ef78edf-f2cb-4dfb-98e1-c57c91960f21', 'body': {'resize': {'flavorRef': '1256546727'}}} Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3863, in _check_quota_for_upsize Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:46:54.175941 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4229, in resize Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3881, in _check_quota_for_upsize Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4f1e522f-68cd-4c02-90f1-78a912a81e0f tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21/action" status: 403 len: 118 microversion: 2.1 time: 0.218469 Aug 23 18:46:54.179697 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3609/7083] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:46:53 2022] POST /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21/action => generated 118 bytes in 220 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:46:54.186478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7f2edd76-f8bb-42a0-8600-0df644c18c95 tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:54.187266 n-d-850468-16 devstack@n-api.service[128807]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:46:54.187266 n-d-850468-16 devstack@n-api.service[128807]: warnings.warn(msg) Aug 23 18:46:54.203566 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7f2edd76-f8bb-42a0-8600-0df644c18c95 tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1256546727" status: 202 len: 0 microversion: 2.1 time: 0.020893 Aug 23 18:46:54.204123 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3475/7084] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 18:46:54 2022] DELETE /compute/v2.1/flavors/1256546727 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:46:54.211976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7dd7ff2b-481d-4e4c-a697-b9d8d85e612b tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:54.233193 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7dd7ff2b-481d-4e4c-a697-b9d8d85e612b tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024760 Aug 23 18:46:54.233775 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3610/7085] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 18:46:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:54.254190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3ea61d56-5bd4-44ea-9cef-b2ca50df72ec tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Calling method '.version_select at 0x7f27df5f63a0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:54.327826 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3ea61d56-5bd4-44ea-9cef-b2ca50df72ec tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] 10.222.0.61 "GET /compute/v2.1/os-quota-sets/2d9b7028d3c3465b8f29d97959f14639" status: 200 len: 371 microversion: 2.1 time: 0.077629 Aug 23 18:46:54.328337 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3476/7086] 10.222.0.61 () {58 vars in 1242 bytes} [Tue Aug 23 18:46:54 2022] GET /compute/v2.1/os-quota-sets/2d9b7028d3c3465b8f29d97959f14639 => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:46:54.339706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-617dd783-4b98-498b-abe3-efebc3ef3345 tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-127861688", "id": 1681022876, "os-flavor-access:is_public": "True"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:46:54.343041 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:46:54.343041 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:46:54.358927 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-617dd783-4b98-498b-abe3-efebc3ef3345 tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] 10.222.0.61 "POST /compute/v2.1/flavors" status: 200 len: 436 microversion: 2.1 time: 0.022878 Aug 23 18:46:54.359507 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3611/7087] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:46:54 2022] POST /compute/v2.1/flavors => generated 436 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:46:54.372379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1681022876"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:46:54.374726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:54.381016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:54.381505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:54.381950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:54.382671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:54.383133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:54.383563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:54.521022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4dca57f2ab524074b3200487968a495b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d9b7028d3c3465b8f29d97959f14639', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:54.527676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-127861688 {{(pid=128807) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 18:46:54.534817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:54.535301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:54.535740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:54.536476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:54.536935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:54.537361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:54.558067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Getting quotas for project 8625b87ec89f455fab6353d3f2cc115d. Resources: {'cores', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:46:54.563089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Getting quotas for user 8bee6d4a233e4daeb2f80cecc32d3e17 and project 8625b87ec89f455fab6353d3f2cc115d. Resources: {'cores', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:46:54.575024 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.compute.api [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] cores quota exceeded for 2d9b7028d3c3465b8f29d97959f14639, tried to resize instance. Aug 23 18:46:54.575562 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Request method failure captured: Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21/action HTTP/1.1 Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 39 Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSCP6q2w9VC4s4i1l4L8tFobR524Nt-TBhrAC8nUyn_-2-8KUxvOeURjMcQ_O23WyR0oK-Z0j4TO_Gl7HLpEpewjAn9QDd0g4El0t0qvNERI_0KPYW-Jg3WSqWWq3etl-6BDEuScz30L_3ozk4dPZb_i1rSGeLtSJZ39N7tI7jobVKc Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 2d9b7028d3c3465b8f29d97959f14639 Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-830794493 Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Role: reader,member,admin Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: reader,member,admin Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_2d9b7028d3c3465b8f29d97959f14639"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d9b7028d3c3465b8f29d97959f14639"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/2d9b7028d3c3465b8f29d97959f14639"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/2d9b7028d3c3465b8f29d97959f14639"}]}] Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersAdminNegativeTestJSON-830794493 Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 2d9b7028d3c3465b8f29d97959f14639 Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-830794493 Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersAdminNegativeTestJSON-830794493-project-admin Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 4dca57f2ab524074b3200487968a495b Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersAdminNegativeTestJSON-830794493-project-admin Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: {"resize": {"flavorRef": "1681022876"}} Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2ef78edf-f2cb-4dfb-98e1-c57c91960f21', 'body': {'resize': {'flavorRef': '1681022876'}}} Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3863, in _check_quota_for_upsize Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:46:54.577616 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4229, in resize Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3881, in _check_quota_for_upsize Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-83966964-3892-499c-93f9-ebbb6e0e667e tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] 10.222.0.61 "POST /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21/action" status: 403 len: 113 microversion: 2.1 time: 0.210581 Aug 23 18:46:54.582368 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3477/7088] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:46:54 2022] POST /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21/action => generated 113 bytes in 212 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:46:54.588709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b14c8d99-541a-4342-b4ae-6c9f7c1c9179 tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:54.589458 n-d-850468-16 devstack@n-api.service[128808]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:delete": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 23 18:46:54.589458 n-d-850468-16 devstack@n-api.service[128808]: warnings.warn(msg) Aug 23 18:46:54.606409 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b14c8d99-541a-4342-b4ae-6c9f7c1c9179 tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] 10.222.0.61 "DELETE /compute/v2.1/flavors/1681022876" status: 202 len: 0 microversion: 2.1 time: 0.021333 Aug 23 18:46:54.606976 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3612/7089] 10.222.0.61 () {58 vars in 1161 bytes} [Tue Aug 23 18:46:54 2022] DELETE /compute/v2.1/flavors/1681022876 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:46:54.614895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b9efd3f4-4a8d-4c08-aca8-7c8a444da8ed tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:54.634777 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b9efd3f4-4a8d-4c08-aca8-7c8a444da8ed tempest-ServersAdminNegativeTestJSON-830794493 tempest-ServersAdminNegativeTestJSON-830794493-project-admin] 10.222.0.61 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.023441 Aug 23 18:46:54.635355 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3478/7090] 10.222.0.61 () {58 vars in 1146 bytes} [Tue Aug 23 18:46:54 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:54.655225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0c4514fb-9ce8-40c0-881d-7af56b029473 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:54.655734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0c4514fb-9ce8-40c0-881d-7af56b029473 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:54.662507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4514fb-9ce8-40c0-881d-7af56b029473 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:54.663032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4514fb-9ce8-40c0-881d-7af56b029473 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:54.663484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4514fb-9ce8-40c0-881d-7af56b029473 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:54.664188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4514fb-9ce8-40c0-881d-7af56b029473 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:54.664651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4514fb-9ce8-40c0-881d-7af56b029473 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:54.665090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c4514fb-9ce8-40c0-881d-7af56b029473 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:54.691964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0c4514fb-9ce8-40c0-881d-7af56b029473 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:46:54.772394 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0c4514fb-9ce8-40c0-881d-7af56b029473 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 204 len: 0 microversion: 2.1 time: 0.120790 Aug 23 18:46:54.772995 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3613/7091] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:46:54 2022] DELETE /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:46:54.781183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e01b2c1-d8e0-4145-9887-9da07e69dd60 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:54.781810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e01b2c1-d8e0-4145-9887-9da07e69dd60 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:54.789247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e01b2c1-d8e0-4145-9887-9da07e69dd60 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:54.789737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e01b2c1-d8e0-4145-9887-9da07e69dd60 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:54.790178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e01b2c1-d8e0-4145-9887-9da07e69dd60 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:54.790937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e01b2c1-d8e0-4145-9887-9da07e69dd60 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:54.791399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e01b2c1-d8e0-4145-9887-9da07e69dd60 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:54.791833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e01b2c1-d8e0-4145-9887-9da07e69dd60 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:54.931274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e01b2c1-d8e0-4145-9887-9da07e69dd60 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:54.939834 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e01b2c1-d8e0-4145-9887-9da07e69dd60 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1476 microversion: 2.1 time: 0.162348 Aug 23 18:46:54.940411 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3479/7092] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:54 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1476 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:46:55.961997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7a22d961-3839-4500-ae22-fc8164bfb296 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:55.962783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7a22d961-3839-4500-ae22-fc8164bfb296 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:55.969843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a22d961-3839-4500-ae22-fc8164bfb296 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:55.970516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a22d961-3839-4500-ae22-fc8164bfb296 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:55.971031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a22d961-3839-4500-ae22-fc8164bfb296 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:55.971748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a22d961-3839-4500-ae22-fc8164bfb296 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:55.972220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a22d961-3839-4500-ae22-fc8164bfb296 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:55.972663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7a22d961-3839-4500-ae22-fc8164bfb296 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:56.108734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7a22d961-3839-4500-ae22-fc8164bfb296 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:56.118052 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7a22d961-3839-4500-ae22-fc8164bfb296 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1476 microversion: 2.1 time: 0.160365 Aug 23 18:46:56.118635 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3614/7093] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:55 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1476 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:56.696789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-11b483e9-9a54-4013-8e93-57ff6bd80880 req-77baa7c5-615e-4904-9ff6-1df179d1e4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ef78edf-f2cb-4dfb-98e1-c57c91960f21", "name": "network-vif-deleted", "tag": "f1caf41d-dca4-466e-87de-76d311fce123"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:46:56.707751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-11b483e9-9a54-4013-8e93-57ff6bd80880 req-77baa7c5-615e-4904-9ff6-1df179d1e4df service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:56.708246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-11b483e9-9a54-4013-8e93-57ff6bd80880 req-77baa7c5-615e-4904-9ff6-1df179d1e4df service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:56.708704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-11b483e9-9a54-4013-8e93-57ff6bd80880 req-77baa7c5-615e-4904-9ff6-1df179d1e4df service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:56.723100 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-11b483e9-9a54-4013-8e93-57ff6bd80880 req-77baa7c5-615e-4904-9ff6-1df179d1e4df service nova] Creating event network-vif-deleted:f1caf41d-dca4-466e-87de-76d311fce123 for instance 2ef78edf-f2cb-4dfb-98e1-c57c91960f21 on n-h2-850468-16 Aug 23 18:46:56.728692 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-11b483e9-9a54-4013-8e93-57ff6bd80880 req-77baa7c5-615e-4904-9ff6-1df179d1e4df service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035671 Aug 23 18:46:56.729874 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3480/7094] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:46:57.138661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:57.139304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:57.146252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:57.146871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:57.147497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:57.148425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:57.149049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:57.149637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:57.181064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:57.181559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:57.182011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:57.182469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lazy-loading 'fault' on Instance uuid 2ef78edf-f2cb-4dfb-98e1-c57c91960f21 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:46:57.228470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8bee6d4a233e4daeb2f80cecc32d3e17', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8625b87ec89f455fab6353d3f2cc115d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:46:57.237119 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-52959977-79c4-4704-8597-bc8fe2cc60cc tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 200 len: 1311 microversion: 2.1 time: 0.102481 Aug 23 18:46:57.237672 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3615/7095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:57 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 1311 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:46:58.259886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-51a97c4f-1abd-4b50-906e-f451ece7e469 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:46:58.260620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-51a97c4f-1abd-4b50-906e-f451ece7e469 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] [instance: 2ef78edf-f2cb-4dfb-98e1-c57c91960f21] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:46:58.267720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51a97c4f-1abd-4b50-906e-f451ece7e469 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:58.268214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51a97c4f-1abd-4b50-906e-f451ece7e469 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:58.268652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51a97c4f-1abd-4b50-906e-f451ece7e469 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:58.269357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51a97c4f-1abd-4b50-906e-f451ece7e469 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:46:58.269811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51a97c4f-1abd-4b50-906e-f451ece7e469 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:46:58.270237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-51a97c4f-1abd-4b50-906e-f451ece7e469 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:46:58.284836 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-51a97c4f-1abd-4b50-906e-f451ece7e469 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] HTTP exception thrown: Instance 2ef78edf-f2cb-4dfb-98e1-c57c91960f21 could not be found. Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-51a97c4f-1abd-4b50-906e-f451ece7e469 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Request method failure captured: Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 HTTP/1.1 Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSCPhH_0RT3zcQNNrThZlgIzqjsv1iEvWKPMLKP96Y29027RyIKdJ8fRKrM9mBt-RP0CuNXirgfLOJGAjOrCgpOXOclRNfr_elXGthhK7qKAYL_9dnGbWKkDXbkTs_qPxh2insusPDiNI7Jc4vkecdoaV0GPyrIsejQo4YijW4j-7KY Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 8625b87ec89f455fab6353d3f2cc115d Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1653569515 Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_8625b87ec89f455fab6353d3f2cc115d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8625b87ec89f455fab6353d3f2cc115d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/8625b87ec89f455fab6353d3f2cc115d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/8625b87ec89f455fab6353d3f2cc115d"}]}] Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1653569515 Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 8625b87ec89f455fab6353d3f2cc115d Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1653569515 Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersAdminNegativeTestJSON-1653569515-project Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 8bee6d4a233e4daeb2f80cecc32d3e17 Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1653569515-project Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 2ef78edf-f2cb-4dfb-98e1-c57c91960f21 could not be found. Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2ef78edf-f2cb-4dfb-98e1-c57c91960f21'} Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ef78edf-f2cb-4dfb-98e1-c57c91960f21 could not be found. Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ef78edf-f2cb-4dfb-98e1-c57c91960f21 could not be found. Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:58.286638 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:46:58.290871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:58.290871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:46:58.290871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:46:58.290871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:46:58.290871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:46:58.290871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:46:58.290871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ef78edf-f2cb-4dfb-98e1-c57c91960f21 could not be found. Aug 23 18:46:58.290871 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:46:58.290871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-51a97c4f-1abd-4b50-906e-f451ece7e469 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] Returning 404 to user: Instance 2ef78edf-f2cb-4dfb-98e1-c57c91960f21 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:46:58.290871 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-51a97c4f-1abd-4b50-906e-f451ece7e469 tempest-ServersAdminNegativeTestJSON-1653569515 tempest-ServersAdminNegativeTestJSON-1653569515-project] 10.222.0.61 "GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21" status: 404 len: 111 microversion: 2.1 time: 0.033515 Aug 23 18:46:58.290871 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3481/7096] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:46:58 2022] GET /compute/v2.1/servers/2ef78edf-f2cb-4dfb-98e1-c57c91960f21 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:47:04.535141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:04.535939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:04.651021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-99011002", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "d67434cd-5c81-4864-92b2-e52261aa7fe4"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:47:04.704427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] validate_networks() for [('d67434cd-5c81-4864-92b2-e52261aa7fe4', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:47:05.100529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:47:05.100969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:47:05.101747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:47:05.102181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:47:05.102692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:47:05.111832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:05.112334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:05.112787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:05.113531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:05.114002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:05.114444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:05.131202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Getting quotas for project fd83e17a33b2401d849e746a173ff128. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:47:05.136482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Getting quotas for user 7a2e201b94db4e09a083655dcda8214c and project fd83e17a33b2401d849e746a173ff128. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:47:05.149748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:47:05.152125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:47:05.200230 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0207bbf8-563a-4011-ad39-19947e43b9ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.671335 Aug 23 18:47:05.201058 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3616/7097] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:47:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:47:05.214285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a5ad319-6db0-4c48-98bc-16a6a8e9c477 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:05.215457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a5ad319-6db0-4c48-98bc-16a6a8e9c477 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:05.234098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:05.235372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:05.291733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a5ad319-6db0-4c48-98bc-16a6a8e9c477 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:05.301751 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a5ad319-6db0-4c48-98bc-16a6a8e9c477 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1213 microversion: 2.1 time: 0.092424 Aug 23 18:47:05.313788 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3482/7098] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:05 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:06.323543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-328d52e4-ae3f-410c-91b4-1353ca01a821 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:06.324170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-328d52e4-ae3f-410c-91b4-1353ca01a821 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:06.336098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-328d52e4-ae3f-410c-91b4-1353ca01a821 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:06.336842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-328d52e4-ae3f-410c-91b4-1353ca01a821 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:06.337470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-328d52e4-ae3f-410c-91b4-1353ca01a821 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:06.338351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-328d52e4-ae3f-410c-91b4-1353ca01a821 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:06.338987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-328d52e4-ae3f-410c-91b4-1353ca01a821 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:06.339614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-328d52e4-ae3f-410c-91b4-1353ca01a821 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:06.423049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-328d52e4-ae3f-410c-91b4-1353ca01a821 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:06.436869 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-328d52e4-ae3f-410c-91b4-1353ca01a821 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1273 microversion: 2.1 time: 0.116761 Aug 23 18:47:06.437473 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3617/7099] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:06 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1273 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:07.459700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dbe32a49-7ed9-47f3-979c-b3a14249b9fd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:07.462193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dbe32a49-7ed9-47f3-979c-b3a14249b9fd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:07.471282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbe32a49-7ed9-47f3-979c-b3a14249b9fd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:07.472049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbe32a49-7ed9-47f3-979c-b3a14249b9fd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:07.472494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbe32a49-7ed9-47f3-979c-b3a14249b9fd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:07.473379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbe32a49-7ed9-47f3-979c-b3a14249b9fd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:07.474001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbe32a49-7ed9-47f3-979c-b3a14249b9fd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:07.474627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbe32a49-7ed9-47f3-979c-b3a14249b9fd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:07.665463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dbe32a49-7ed9-47f3-979c-b3a14249b9fd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:07.676065 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dbe32a49-7ed9-47f3-979c-b3a14249b9fd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1313 microversion: 2.1 time: 0.220346 Aug 23 18:47:07.677234 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3483/7100] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:07 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:07.774884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6f035c5e-203a-4bce-ba25-ed9e528bc992 req-27cc5d13-b445-4de4-959c-3c7ef47a1ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8deeaa04-4d68-46b6-850e-32aca714f115", "tag": "4710bc5e-c07d-419e-982e-fe167fd63665"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:47:07.795736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6f035c5e-203a-4bce-ba25-ed9e528bc992 req-27cc5d13-b445-4de4-959c-3c7ef47a1ae9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:07.797550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6f035c5e-203a-4bce-ba25-ed9e528bc992 req-27cc5d13-b445-4de4-959c-3c7ef47a1ae9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:07.799006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6f035c5e-203a-4bce-ba25-ed9e528bc992 req-27cc5d13-b445-4de4-959c-3c7ef47a1ae9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:07.818106 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6f035c5e-203a-4bce-ba25-ed9e528bc992 req-27cc5d13-b445-4de4-959c-3c7ef47a1ae9 service nova] Creating event network-changed:4710bc5e-c07d-419e-982e-fe167fd63665 for instance 8deeaa04-4d68-46b6-850e-32aca714f115 on n-h2-850468-16 Aug 23 18:47:07.823818 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6f035c5e-203a-4bce-ba25-ed9e528bc992 req-27cc5d13-b445-4de4-959c-3c7ef47a1ae9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054776 Aug 23 18:47:07.825385 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3618/7101] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:47:08.698750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8e18ee49-a57a-4dfc-98d9-133739f87079 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:08.699373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8e18ee49-a57a-4dfc-98d9-133739f87079 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:08.706985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e18ee49-a57a-4dfc-98d9-133739f87079 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:08.707475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e18ee49-a57a-4dfc-98d9-133739f87079 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:08.707917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e18ee49-a57a-4dfc-98d9-133739f87079 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:08.708787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e18ee49-a57a-4dfc-98d9-133739f87079 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:08.709285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e18ee49-a57a-4dfc-98d9-133739f87079 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:08.709989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8e18ee49-a57a-4dfc-98d9-133739f87079 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:08.844352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8e18ee49-a57a-4dfc-98d9-133739f87079 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:08.852246 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8e18ee49-a57a-4dfc-98d9-133739f87079 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1313 microversion: 2.1 time: 0.157428 Aug 23 18:47:08.852809 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3484/7102] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:08 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:09.874688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f68fe4af-6515-4bbf-a72a-bf88abfeac5f tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:09.875412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f68fe4af-6515-4bbf-a72a-bf88abfeac5f tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:09.882679 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f68fe4af-6515-4bbf-a72a-bf88abfeac5f tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:09.883186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f68fe4af-6515-4bbf-a72a-bf88abfeac5f tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:09.883643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f68fe4af-6515-4bbf-a72a-bf88abfeac5f tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:09.884360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f68fe4af-6515-4bbf-a72a-bf88abfeac5f tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:09.884834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f68fe4af-6515-4bbf-a72a-bf88abfeac5f tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:09.885277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f68fe4af-6515-4bbf-a72a-bf88abfeac5f tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:10.018262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f68fe4af-6515-4bbf-a72a-bf88abfeac5f tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:10.026005 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f68fe4af-6515-4bbf-a72a-bf88abfeac5f tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1313 microversion: 2.1 time: 0.156505 Aug 23 18:47:10.026600 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3619/7103] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:09 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:11.047720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-00a686fb-fd1d-44f3-b22a-4c3d10bde741 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:11.048343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-00a686fb-fd1d-44f3-b22a-4c3d10bde741 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:11.051925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=4,nova_api:DELETE=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:11.057525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00a686fb-fd1d-44f3-b22a-4c3d10bde741 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:11.058007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00a686fb-fd1d-44f3-b22a-4c3d10bde741 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:11.058448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00a686fb-fd1d-44f3-b22a-4c3d10bde741 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:11.059249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00a686fb-fd1d-44f3-b22a-4c3d10bde741 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:11.059710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00a686fb-fd1d-44f3-b22a-4c3d10bde741 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:11.060139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00a686fb-fd1d-44f3-b22a-4c3d10bde741 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:11.066109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=76 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:11.194163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-00a686fb-fd1d-44f3-b22a-4c3d10bde741 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:11.201898 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-00a686fb-fd1d-44f3-b22a-4c3d10bde741 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1313 microversion: 2.1 time: 0.158439 Aug 23 18:47:11.202502 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3485/7104] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:11 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:12.222917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8aa2b792-de1f-4c27-8094-1947e3c8465c tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:12.223543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8aa2b792-de1f-4c27-8094-1947e3c8465c tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:12.226326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=4,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:12.232068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8aa2b792-de1f-4c27-8094-1947e3c8465c tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:12.232644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8aa2b792-de1f-4c27-8094-1947e3c8465c tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:12.233092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8aa2b792-de1f-4c27-8094-1947e3c8465c tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:12.233795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8aa2b792-de1f-4c27-8094-1947e3c8465c tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:12.234255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8aa2b792-de1f-4c27-8094-1947e3c8465c tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:12.234718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8aa2b792-de1f-4c27-8094-1947e3c8465c tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:12.239262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:12.367665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8aa2b792-de1f-4c27-8094-1947e3c8465c tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:12.375451 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8aa2b792-de1f-4c27-8094-1947e3c8465c tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1313 microversion: 2.1 time: 0.156654 Aug 23 18:47:12.376022 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3620/7105] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:12 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:13.396469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95098a55-1812-4587-a560-ef4a3dfbb9b2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:13.397105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-95098a55-1812-4587-a560-ef4a3dfbb9b2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:13.404067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95098a55-1812-4587-a560-ef4a3dfbb9b2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:13.404644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95098a55-1812-4587-a560-ef4a3dfbb9b2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:13.405121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95098a55-1812-4587-a560-ef4a3dfbb9b2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:13.405828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95098a55-1812-4587-a560-ef4a3dfbb9b2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:13.406290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95098a55-1812-4587-a560-ef4a3dfbb9b2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:13.406763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95098a55-1812-4587-a560-ef4a3dfbb9b2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:13.543312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-95098a55-1812-4587-a560-ef4a3dfbb9b2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:13.552738 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-95098a55-1812-4587-a560-ef4a3dfbb9b2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1313 microversion: 2.1 time: 0.160725 Aug 23 18:47:13.553397 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3486/7106] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:13 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:14.576348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9d42dcd6-a654-451a-aef9-5ceb50269632 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:14.576976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9d42dcd6-a654-451a-aef9-5ceb50269632 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:14.583685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d42dcd6-a654-451a-aef9-5ceb50269632 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:14.584182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d42dcd6-a654-451a-aef9-5ceb50269632 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:14.584634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d42dcd6-a654-451a-aef9-5ceb50269632 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:14.585340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d42dcd6-a654-451a-aef9-5ceb50269632 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:14.585812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d42dcd6-a654-451a-aef9-5ceb50269632 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:14.586269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d42dcd6-a654-451a-aef9-5ceb50269632 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:14.720704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9d42dcd6-a654-451a-aef9-5ceb50269632 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:14.729059 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9d42dcd6-a654-451a-aef9-5ceb50269632 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1313 microversion: 2.1 time: 0.157544 Aug 23 18:47:14.729636 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3621/7107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:14 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:15.261723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-02a22d56-e739-4ccd-9179-8400c5fb879f req-daf851e4-550d-4926-b589-de772fd7da51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8deeaa04-4d68-46b6-850e-32aca714f115", "name": "network-vif-plugged", "status": "completed", "tag": "4710bc5e-c07d-419e-982e-fe167fd63665"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:47:15.272328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-02a22d56-e739-4ccd-9179-8400c5fb879f req-daf851e4-550d-4926-b589-de772fd7da51 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:15.272808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-02a22d56-e739-4ccd-9179-8400c5fb879f req-daf851e4-550d-4926-b589-de772fd7da51 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:15.273250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-02a22d56-e739-4ccd-9179-8400c5fb879f req-daf851e4-550d-4926-b589-de772fd7da51 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:15.284970 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-02a22d56-e739-4ccd-9179-8400c5fb879f req-daf851e4-550d-4926-b589-de772fd7da51 service nova] Creating event network-vif-plugged:4710bc5e-c07d-419e-982e-fe167fd63665 for instance 8deeaa04-4d68-46b6-850e-32aca714f115 on n-h2-850468-16 Aug 23 18:47:15.290214 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-02a22d56-e739-4ccd-9179-8400c5fb879f req-daf851e4-550d-4926-b589-de772fd7da51 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032283 Aug 23 18:47:15.290842 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3487/7108] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:47:15.751005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b2538a6e-4d7a-44f5-9feb-cc3e01d05d13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:15.751640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b2538a6e-4d7a-44f5-9feb-cc3e01d05d13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:15.753616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:15.754290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:15.761760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2538a6e-4d7a-44f5-9feb-cc3e01d05d13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:15.762404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2538a6e-4d7a-44f5-9feb-cc3e01d05d13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:15.762936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2538a6e-4d7a-44f5-9feb-cc3e01d05d13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:15.763667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2538a6e-4d7a-44f5-9feb-cc3e01d05d13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:15.764144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2538a6e-4d7a-44f5-9feb-cc3e01d05d13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:15.764594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2538a6e-4d7a-44f5-9feb-cc3e01d05d13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:15.898919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b2538a6e-4d7a-44f5-9feb-cc3e01d05d13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:15.907168 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b2538a6e-4d7a-44f5-9feb-cc3e01d05d13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1313 microversion: 2.1 time: 0.160158 Aug 23 18:47:15.907769 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3622/7109] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:15 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:16.926317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:16.931343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8472bd42-7a1f-4079-9f8e-22b82932dff9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:16.932062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8472bd42-7a1f-4079-9f8e-22b82932dff9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:16.938512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8472bd42-7a1f-4079-9f8e-22b82932dff9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:16.939032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8472bd42-7a1f-4079-9f8e-22b82932dff9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:16.939475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8472bd42-7a1f-4079-9f8e-22b82932dff9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:16.940172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8472bd42-7a1f-4079-9f8e-22b82932dff9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:16.940633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8472bd42-7a1f-4079-9f8e-22b82932dff9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:16.941064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8472bd42-7a1f-4079-9f8e-22b82932dff9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:17.075075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8472bd42-7a1f-4079-9f8e-22b82932dff9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:17.083284 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8472bd42-7a1f-4079-9f8e-22b82932dff9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1501 microversion: 2.1 time: 0.158808 Aug 23 18:47:17.083854 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3488/7110] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:16 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1501 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:17.104191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:47:17.106483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:17.113360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:17.113859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:17.114311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:17.115039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:17.115508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:17.115946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:17.192411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:17.198359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Old instance type m1.heat2, new instance type m1.heat {{(pid=128808) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 18:47:17.204790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:47:17.205227 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:47:17.205718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:47:17.206142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:47:17.207113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:47:17.314519 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aad688dd-643a-4dda-a27d-7f719e6b3135 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "POST /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115/action" status: 202 len: 0 microversion: 2.1 time: 0.214094 Aug 23 18:47:17.315324 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3623/7111] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:47:17 2022] POST /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:47:17.323445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a3feb8bf-9fde-4b4b-afd8-fefcb5da02df tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:17.324073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a3feb8bf-9fde-4b4b-afd8-fefcb5da02df tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:17.329974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3feb8bf-9fde-4b4b-afd8-fefcb5da02df tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:17.330463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3feb8bf-9fde-4b4b-afd8-fefcb5da02df tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:17.330934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3feb8bf-9fde-4b4b-afd8-fefcb5da02df tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:17.332174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3feb8bf-9fde-4b4b-afd8-fefcb5da02df tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:17.332642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3feb8bf-9fde-4b4b-afd8-fefcb5da02df tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:17.333277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3feb8bf-9fde-4b4b-afd8-fefcb5da02df tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:17.467679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a3feb8bf-9fde-4b4b-afd8-fefcb5da02df tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:17.477737 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a3feb8bf-9fde-4b4b-afd8-fefcb5da02df tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1510 microversion: 2.1 time: 0.158066 Aug 23 18:47:17.478319 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3489/7112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:17 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:18.503060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f5985bde-a5c3-4d14-9ffd-b64528ce1df4 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:18.504342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f5985bde-a5c3-4d14-9ffd-b64528ce1df4 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:18.511664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5985bde-a5c3-4d14-9ffd-b64528ce1df4 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:18.512166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5985bde-a5c3-4d14-9ffd-b64528ce1df4 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:18.512618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5985bde-a5c3-4d14-9ffd-b64528ce1df4 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:18.513343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5985bde-a5c3-4d14-9ffd-b64528ce1df4 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:18.513808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5985bde-a5c3-4d14-9ffd-b64528ce1df4 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:18.514332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f5985bde-a5c3-4d14-9ffd-b64528ce1df4 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:18.655310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f5985bde-a5c3-4d14-9ffd-b64528ce1df4 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:18.664702 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f5985bde-a5c3-4d14-9ffd-b64528ce1df4 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1510 microversion: 2.1 time: 0.166894 Aug 23 18:47:18.665322 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3624/7113] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:18 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1510 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:19.686887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-01539694-6433-4423-835d-a1778e406365 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:19.687514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-01539694-6433-4423-835d-a1778e406365 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:19.695708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01539694-6433-4423-835d-a1778e406365 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:19.696199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01539694-6433-4423-835d-a1778e406365 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:19.696642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01539694-6433-4423-835d-a1778e406365 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:19.697339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01539694-6433-4423-835d-a1778e406365 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:19.697807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01539694-6433-4423-835d-a1778e406365 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:19.698235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-01539694-6433-4423-835d-a1778e406365 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:19.838182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-01539694-6433-4423-835d-a1778e406365 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:19.846207 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-01539694-6433-4423-835d-a1778e406365 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.163288 Aug 23 18:47:19.846890 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3490/7114] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:19 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:20.867500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6d067d77-472a-4a42-b036-45308fd23253 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:20.868136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6d067d77-472a-4a42-b036-45308fd23253 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:20.875204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d067d77-472a-4a42-b036-45308fd23253 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:20.875711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d067d77-472a-4a42-b036-45308fd23253 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:20.876195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d067d77-472a-4a42-b036-45308fd23253 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:20.876909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d067d77-472a-4a42-b036-45308fd23253 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:20.877380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d067d77-472a-4a42-b036-45308fd23253 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:20.877824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6d067d77-472a-4a42-b036-45308fd23253 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:21.009366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6d067d77-472a-4a42-b036-45308fd23253 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:21.017183 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6d067d77-472a-4a42-b036-45308fd23253 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.153495 Aug 23 18:47:21.017698 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3625/7115] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:20 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:22.039325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-21ac93a3-2e09-4242-b6a9-bbb2f26e0a80 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:22.039948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-21ac93a3-2e09-4242-b6a9-bbb2f26e0a80 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:22.047480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21ac93a3-2e09-4242-b6a9-bbb2f26e0a80 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:22.047965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21ac93a3-2e09-4242-b6a9-bbb2f26e0a80 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:22.048407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21ac93a3-2e09-4242-b6a9-bbb2f26e0a80 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:22.049112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21ac93a3-2e09-4242-b6a9-bbb2f26e0a80 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:22.049572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21ac93a3-2e09-4242-b6a9-bbb2f26e0a80 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:22.050003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-21ac93a3-2e09-4242-b6a9-bbb2f26e0a80 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:22.181464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-21ac93a3-2e09-4242-b6a9-bbb2f26e0a80 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:22.189237 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-21ac93a3-2e09-4242-b6a9-bbb2f26e0a80 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.154006 Aug 23 18:47:22.189810 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3491/7116] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:22 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:23.210268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-74647f90-c721-434a-b78a-e8a2798c4380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:23.210920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-74647f90-c721-434a-b78a-e8a2798c4380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:23.218274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74647f90-c721-434a-b78a-e8a2798c4380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:23.218797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74647f90-c721-434a-b78a-e8a2798c4380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:23.219246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74647f90-c721-434a-b78a-e8a2798c4380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:23.219945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74647f90-c721-434a-b78a-e8a2798c4380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:23.220409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74647f90-c721-434a-b78a-e8a2798c4380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:23.220845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74647f90-c721-434a-b78a-e8a2798c4380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:23.353220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-74647f90-c721-434a-b78a-e8a2798c4380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:23.361057 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-74647f90-c721-434a-b78a-e8a2798c4380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.154655 Aug 23 18:47:23.361633 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3626/7117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:23 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:24.383788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1b579dd1-4404-49e4-ae96-37e86167f355 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:24.384417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1b579dd1-4404-49e4-ae96-37e86167f355 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:24.391454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b579dd1-4404-49e4-ae96-37e86167f355 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:24.391949 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b579dd1-4404-49e4-ae96-37e86167f355 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:24.392395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b579dd1-4404-49e4-ae96-37e86167f355 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:24.393102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b579dd1-4404-49e4-ae96-37e86167f355 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:24.393566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b579dd1-4404-49e4-ae96-37e86167f355 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:24.394644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1b579dd1-4404-49e4-ae96-37e86167f355 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:24.528673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1b579dd1-4404-49e4-ae96-37e86167f355 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:24.537619 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1b579dd1-4404-49e4-ae96-37e86167f355 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.157796 Aug 23 18:47:24.538193 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3492/7118] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:24 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:25.557910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f8f10bbf-2c12-415f-9ec2-e586e8c6b7c9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:25.558560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f8f10bbf-2c12-415f-9ec2-e586e8c6b7c9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:25.565247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8f10bbf-2c12-415f-9ec2-e586e8c6b7c9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:25.566570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8f10bbf-2c12-415f-9ec2-e586e8c6b7c9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:25.566862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8f10bbf-2c12-415f-9ec2-e586e8c6b7c9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:25.567576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8f10bbf-2c12-415f-9ec2-e586e8c6b7c9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:25.568050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8f10bbf-2c12-415f-9ec2-e586e8c6b7c9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:25.568493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f8f10bbf-2c12-415f-9ec2-e586e8c6b7c9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:25.708206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f8f10bbf-2c12-415f-9ec2-e586e8c6b7c9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:25.716424 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f8f10bbf-2c12-415f-9ec2-e586e8c6b7c9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.162463 Aug 23 18:47:25.716995 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3627/7119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:25 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:26.738297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-13ec1c57-a6fa-4e16-a9f5-fb1da2c5c501 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:26.738968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-13ec1c57-a6fa-4e16-a9f5-fb1da2c5c501 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:26.746406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13ec1c57-a6fa-4e16-a9f5-fb1da2c5c501 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:26.746928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13ec1c57-a6fa-4e16-a9f5-fb1da2c5c501 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:26.747366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13ec1c57-a6fa-4e16-a9f5-fb1da2c5c501 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:26.748062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13ec1c57-a6fa-4e16-a9f5-fb1da2c5c501 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:26.748517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13ec1c57-a6fa-4e16-a9f5-fb1da2c5c501 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:26.748948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13ec1c57-a6fa-4e16-a9f5-fb1da2c5c501 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:26.879190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-13ec1c57-a6fa-4e16-a9f5-fb1da2c5c501 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:26.887041 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-13ec1c57-a6fa-4e16-a9f5-fb1da2c5c501 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.152977 Aug 23 18:47:26.887576 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3493/7120] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:26 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:27.908669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-77192005-3bc0-4102-99be-124c7497e557 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:27.909345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-77192005-3bc0-4102-99be-124c7497e557 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:27.916693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77192005-3bc0-4102-99be-124c7497e557 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:27.917182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77192005-3bc0-4102-99be-124c7497e557 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:27.917628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77192005-3bc0-4102-99be-124c7497e557 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:27.918319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77192005-3bc0-4102-99be-124c7497e557 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:27.918808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77192005-3bc0-4102-99be-124c7497e557 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:27.919244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77192005-3bc0-4102-99be-124c7497e557 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:28.053797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-77192005-3bc0-4102-99be-124c7497e557 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:28.061527 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-77192005-3bc0-4102-99be-124c7497e557 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.156766 Aug 23 18:47:28.062091 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3628/7121] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:27 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:29.083404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d88239d5-badf-4495-80ee-92fbbe21f5ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:29.083975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d88239d5-badf-4495-80ee-92fbbe21f5ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:29.091276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d88239d5-badf-4495-80ee-92fbbe21f5ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:29.091769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d88239d5-badf-4495-80ee-92fbbe21f5ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:29.092217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d88239d5-badf-4495-80ee-92fbbe21f5ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:29.092920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d88239d5-badf-4495-80ee-92fbbe21f5ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:29.093381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d88239d5-badf-4495-80ee-92fbbe21f5ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:29.093818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d88239d5-badf-4495-80ee-92fbbe21f5ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:29.222675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d88239d5-badf-4495-80ee-92fbbe21f5ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:29.230439 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d88239d5-badf-4495-80ee-92fbbe21f5ae tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.151136 Aug 23 18:47:29.231036 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3494/7122] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:29 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:30.251836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-326c328b-3f8e-48c3-b5dc-606dbf0abbcc tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:30.252465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-326c328b-3f8e-48c3-b5dc-606dbf0abbcc tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:30.259866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-326c328b-3f8e-48c3-b5dc-606dbf0abbcc tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:30.260368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-326c328b-3f8e-48c3-b5dc-606dbf0abbcc tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:30.260817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-326c328b-3f8e-48c3-b5dc-606dbf0abbcc tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:30.261524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-326c328b-3f8e-48c3-b5dc-606dbf0abbcc tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:30.261990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-326c328b-3f8e-48c3-b5dc-606dbf0abbcc tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:30.262428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-326c328b-3f8e-48c3-b5dc-606dbf0abbcc tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:30.391886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-326c328b-3f8e-48c3-b5dc-606dbf0abbcc tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:30.400210 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-326c328b-3f8e-48c3-b5dc-606dbf0abbcc tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.152318 Aug 23 18:47:30.400782 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3629/7123] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:30 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:31.421059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf8b5960-04c1-4a1f-8c2f-1071fb1ea8b6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:31.421682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bf8b5960-04c1-4a1f-8c2f-1071fb1ea8b6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:31.429008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8b5960-04c1-4a1f-8c2f-1071fb1ea8b6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:31.429503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8b5960-04c1-4a1f-8c2f-1071fb1ea8b6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:31.429950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8b5960-04c1-4a1f-8c2f-1071fb1ea8b6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:31.430769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8b5960-04c1-4a1f-8c2f-1071fb1ea8b6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:31.431236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8b5960-04c1-4a1f-8c2f-1071fb1ea8b6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:31.431671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf8b5960-04c1-4a1f-8c2f-1071fb1ea8b6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:31.564970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bf8b5960-04c1-4a1f-8c2f-1071fb1ea8b6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:31.572938 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bf8b5960-04c1-4a1f-8c2f-1071fb1ea8b6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.155880 Aug 23 18:47:31.573499 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3495/7124] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:31 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:32.595162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9d87261d-5320-45d5-b457-dc25c1611f0a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:32.595790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9d87261d-5320-45d5-b457-dc25c1611f0a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:32.603256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d87261d-5320-45d5-b457-dc25c1611f0a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:32.603755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d87261d-5320-45d5-b457-dc25c1611f0a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:32.604205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d87261d-5320-45d5-b457-dc25c1611f0a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:32.604913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d87261d-5320-45d5-b457-dc25c1611f0a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:32.605382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d87261d-5320-45d5-b457-dc25c1611f0a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:32.605823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d87261d-5320-45d5-b457-dc25c1611f0a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:32.739210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9d87261d-5320-45d5-b457-dc25c1611f0a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:32.746986 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9d87261d-5320-45d5-b457-dc25c1611f0a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.155629 Aug 23 18:47:32.747565 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3630/7125] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:32 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:33.767380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ceca41a-a0dc-4163-9d90-1620f64b6ebd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:33.767923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9ceca41a-a0dc-4163-9d90-1620f64b6ebd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:33.775221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ceca41a-a0dc-4163-9d90-1620f64b6ebd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:33.775713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ceca41a-a0dc-4163-9d90-1620f64b6ebd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:33.776159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ceca41a-a0dc-4163-9d90-1620f64b6ebd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:33.776863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ceca41a-a0dc-4163-9d90-1620f64b6ebd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:33.777329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ceca41a-a0dc-4163-9d90-1620f64b6ebd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:33.777757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ceca41a-a0dc-4163-9d90-1620f64b6ebd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:33.909768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9ceca41a-a0dc-4163-9d90-1620f64b6ebd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:33.918210 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9ceca41a-a0dc-4163-9d90-1620f64b6ebd tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.154897 Aug 23 18:47:33.918825 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3496/7126] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:33 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:34.941219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae6b4e2e-79aa-4c4e-87e1-5770c17733b7 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:34.941792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae6b4e2e-79aa-4c4e-87e1-5770c17733b7 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:34.949064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae6b4e2e-79aa-4c4e-87e1-5770c17733b7 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:34.949567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae6b4e2e-79aa-4c4e-87e1-5770c17733b7 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:34.950028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae6b4e2e-79aa-4c4e-87e1-5770c17733b7 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:34.950779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae6b4e2e-79aa-4c4e-87e1-5770c17733b7 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:34.951248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae6b4e2e-79aa-4c4e-87e1-5770c17733b7 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:34.951693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae6b4e2e-79aa-4c4e-87e1-5770c17733b7 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:35.085343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ae6b4e2e-79aa-4c4e-87e1-5770c17733b7 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:35.093320 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae6b4e2e-79aa-4c4e-87e1-5770c17733b7 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.156130 Aug 23 18:47:35.093921 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3631/7127] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:34 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:36.116143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-22ee0334-bf3a-46bd-8265-d91c6112bf17 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:36.116770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-22ee0334-bf3a-46bd-8265-d91c6112bf17 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:36.123665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22ee0334-bf3a-46bd-8265-d91c6112bf17 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:36.124157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22ee0334-bf3a-46bd-8265-d91c6112bf17 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:36.124600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22ee0334-bf3a-46bd-8265-d91c6112bf17 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:36.125311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22ee0334-bf3a-46bd-8265-d91c6112bf17 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:36.125770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22ee0334-bf3a-46bd-8265-d91c6112bf17 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:36.126204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22ee0334-bf3a-46bd-8265-d91c6112bf17 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:36.258395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22ee0334-bf3a-46bd-8265-d91c6112bf17 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:36.266199 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-22ee0334-bf3a-46bd-8265-d91c6112bf17 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.154651 Aug 23 18:47:36.266925 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3497/7128] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:36 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:37.288418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a3c01652-5595-4c5e-bd36-2113eee9cd13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:37.289050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a3c01652-5595-4c5e-bd36-2113eee9cd13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:37.295744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3c01652-5595-4c5e-bd36-2113eee9cd13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:37.296251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3c01652-5595-4c5e-bd36-2113eee9cd13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:37.296706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3c01652-5595-4c5e-bd36-2113eee9cd13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:37.297422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3c01652-5595-4c5e-bd36-2113eee9cd13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:37.297895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3c01652-5595-4c5e-bd36-2113eee9cd13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:37.298340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3c01652-5595-4c5e-bd36-2113eee9cd13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:37.431838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a3c01652-5595-4c5e-bd36-2113eee9cd13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:37.439531 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a3c01652-5595-4c5e-bd36-2113eee9cd13 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.155730 Aug 23 18:47:37.440097 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3632/7129] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:37 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:47:38.461386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f7f1cf47-a118-4ef3-9f6e-0a4f649abff5 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:38.462006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f7f1cf47-a118-4ef3-9f6e-0a4f649abff5 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:38.469228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7f1cf47-a118-4ef3-9f6e-0a4f649abff5 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:38.469716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7f1cf47-a118-4ef3-9f6e-0a4f649abff5 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:38.470181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7f1cf47-a118-4ef3-9f6e-0a4f649abff5 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:38.470897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7f1cf47-a118-4ef3-9f6e-0a4f649abff5 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:38.471359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7f1cf47-a118-4ef3-9f6e-0a4f649abff5 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:38.471791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7f1cf47-a118-4ef3-9f6e-0a4f649abff5 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:38.601807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f7f1cf47-a118-4ef3-9f6e-0a4f649abff5 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:38.609583 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f7f1cf47-a118-4ef3-9f6e-0a4f649abff5 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.152285 Aug 23 18:47:38.610160 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3498/7130] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:38 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:39.632433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8cb5e30b-ce03-43f9-8573-e9c40b30f3e0 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:39.633089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8cb5e30b-ce03-43f9-8573-e9c40b30f3e0 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:39.640116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cb5e30b-ce03-43f9-8573-e9c40b30f3e0 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:39.640611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cb5e30b-ce03-43f9-8573-e9c40b30f3e0 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:39.641054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cb5e30b-ce03-43f9-8573-e9c40b30f3e0 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:39.641758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cb5e30b-ce03-43f9-8573-e9c40b30f3e0 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:39.642221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cb5e30b-ce03-43f9-8573-e9c40b30f3e0 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:39.642685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8cb5e30b-ce03-43f9-8573-e9c40b30f3e0 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:39.774810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8cb5e30b-ce03-43f9-8573-e9c40b30f3e0 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:39.782382 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8cb5e30b-ce03-43f9-8573-e9c40b30f3e0 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.154571 Aug 23 18:47:39.782972 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3633/7131] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:39 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:40.804781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b41959e5-cd9a-46de-9158-8be693c5b401 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:40.805406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b41959e5-cd9a-46de-9158-8be693c5b401 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:40.812502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b41959e5-cd9a-46de-9158-8be693c5b401 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:40.813000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b41959e5-cd9a-46de-9158-8be693c5b401 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:40.813445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b41959e5-cd9a-46de-9158-8be693c5b401 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:40.814157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b41959e5-cd9a-46de-9158-8be693c5b401 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:40.814652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b41959e5-cd9a-46de-9158-8be693c5b401 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:40.815082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b41959e5-cd9a-46de-9158-8be693c5b401 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:40.946926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b41959e5-cd9a-46de-9158-8be693c5b401 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:40.954971 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b41959e5-cd9a-46de-9158-8be693c5b401 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.154817 Aug 23 18:47:40.955649 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3499/7132] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:40 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:41.800819 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:47:41.801040 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 18:47:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:47:41.976840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5b4d305f-b160-4819-bcce-6778eb7003a2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:41.977384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5b4d305f-b160-4819-bcce-6778eb7003a2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:41.984266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b4d305f-b160-4819-bcce-6778eb7003a2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:41.984768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b4d305f-b160-4819-bcce-6778eb7003a2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:41.985249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b4d305f-b160-4819-bcce-6778eb7003a2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:41.985961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b4d305f-b160-4819-bcce-6778eb7003a2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:41.986427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b4d305f-b160-4819-bcce-6778eb7003a2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:41.986896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b4d305f-b160-4819-bcce-6778eb7003a2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:42.117740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5b4d305f-b160-4819-bcce-6778eb7003a2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:42.125603 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5b4d305f-b160-4819-bcce-6778eb7003a2 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.153254 Aug 23 18:47:42.126175 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3634/7133] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:41 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:43.146410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5afeeec2-d1c5-4035-94ab-99c6b023cc27 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:43.147095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5afeeec2-d1c5-4035-94ab-99c6b023cc27 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:43.149788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=30 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:43.155184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5afeeec2-d1c5-4035-94ab-99c6b023cc27 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:43.155672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5afeeec2-d1c5-4035-94ab-99c6b023cc27 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:43.156107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5afeeec2-d1c5-4035-94ab-99c6b023cc27 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:43.156813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5afeeec2-d1c5-4035-94ab-99c6b023cc27 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:43.157268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5afeeec2-d1c5-4035-94ab-99c6b023cc27 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:43.157697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5afeeec2-d1c5-4035-94ab-99c6b023cc27 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:43.160427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=86 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:43.294484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5afeeec2-d1c5-4035-94ab-99c6b023cc27 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:43.302301 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5afeeec2-d1c5-4035-94ab-99c6b023cc27 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.159888 Aug 23 18:47:43.302961 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3500/7134] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:43 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:44.323784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-213dfc71-c3e8-4f38-9831-e423c062d5ab tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:44.324445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-213dfc71-c3e8-4f38-9831-e423c062d5ab tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:44.327107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=34 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:44.332319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-213dfc71-c3e8-4f38-9831-e423c062d5ab tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:44.332841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-213dfc71-c3e8-4f38-9831-e423c062d5ab tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:44.333293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-213dfc71-c3e8-4f38-9831-e423c062d5ab tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:44.334009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-213dfc71-c3e8-4f38-9831-e423c062d5ab tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:44.334469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-213dfc71-c3e8-4f38-9831-e423c062d5ab tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:44.334925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-213dfc71-c3e8-4f38-9831-e423c062d5ab tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:44.337655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:47:44.474590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-213dfc71-c3e8-4f38-9831-e423c062d5ab tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:44.482320 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-213dfc71-c3e8-4f38-9831-e423c062d5ab tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.162396 Aug 23 18:47:44.482925 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3635/7135] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:44 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:45.502870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4cf28b36-63d8-43a8-aecc-aa9ee5dcb9d9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:45.503504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4cf28b36-63d8-43a8-aecc-aa9ee5dcb9d9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:45.510666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cf28b36-63d8-43a8-aecc-aa9ee5dcb9d9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:45.511167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cf28b36-63d8-43a8-aecc-aa9ee5dcb9d9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:45.511615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cf28b36-63d8-43a8-aecc-aa9ee5dcb9d9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:45.512350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cf28b36-63d8-43a8-aecc-aa9ee5dcb9d9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:45.512849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cf28b36-63d8-43a8-aecc-aa9ee5dcb9d9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:45.513286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cf28b36-63d8-43a8-aecc-aa9ee5dcb9d9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:45.645752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4cf28b36-63d8-43a8-aecc-aa9ee5dcb9d9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:45.653616 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4cf28b36-63d8-43a8-aecc-aa9ee5dcb9d9 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1515 microversion: 2.1 time: 0.154782 Aug 23 18:47:45.654189 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3501/7136] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:45 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:46.674789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-77972cc6-f88f-45d2-bb04-4362aa4f9873 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:46.675415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-77972cc6-f88f-45d2-bb04-4362aa4f9873 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:46.683491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77972cc6-f88f-45d2-bb04-4362aa4f9873 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:46.684000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77972cc6-f88f-45d2-bb04-4362aa4f9873 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:46.684453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77972cc6-f88f-45d2-bb04-4362aa4f9873 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:46.685177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77972cc6-f88f-45d2-bb04-4362aa4f9873 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:46.685648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77972cc6-f88f-45d2-bb04-4362aa4f9873 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:46.686090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77972cc6-f88f-45d2-bb04-4362aa4f9873 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:46.820518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-77972cc6-f88f-45d2-bb04-4362aa4f9873 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:46.829399 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-77972cc6-f88f-45d2-bb04-4362aa4f9873 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1514 microversion: 2.1 time: 0.158636 Aug 23 18:47:46.830068 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3636/7137] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:46 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:47.073959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-706ed379-f4db-4cfb-81ab-7835a462da06 req-467098f9-3436-4c64-9f30-eb789f1ead3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8deeaa04-4d68-46b6-850e-32aca714f115", "name": "network-vif-unplugged", "status": "completed", "tag": "4710bc5e-c07d-419e-982e-fe167fd63665"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:47:47.085379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-706ed379-f4db-4cfb-81ab-7835a462da06 req-467098f9-3436-4c64-9f30-eb789f1ead3a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:47.085863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-706ed379-f4db-4cfb-81ab-7835a462da06 req-467098f9-3436-4c64-9f30-eb789f1ead3a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:47.086291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-706ed379-f4db-4cfb-81ab-7835a462da06 req-467098f9-3436-4c64-9f30-eb789f1ead3a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:47.098428 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-706ed379-f4db-4cfb-81ab-7835a462da06 req-467098f9-3436-4c64-9f30-eb789f1ead3a service nova] Creating event network-vif-unplugged:4710bc5e-c07d-419e-982e-fe167fd63665 for instance 8deeaa04-4d68-46b6-850e-32aca714f115 on n-h1-850468-16 Aug 23 18:47:47.104941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-706ed379-f4db-4cfb-81ab-7835a462da06 req-467098f9-3436-4c64-9f30-eb789f1ead3a service nova] Instance 8deeaa04-4d68-46b6-850e-32aca714f115 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:47:47.116910 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-706ed379-f4db-4cfb-81ab-7835a462da06 req-467098f9-3436-4c64-9f30-eb789f1ead3a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046586 Aug 23 18:47:47.117535 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3502/7138] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:47:47.852425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-451f0223-ee08-472f-9b21-80c608491eaf tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:47.853055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-451f0223-ee08-472f-9b21-80c608491eaf tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:47.859979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-451f0223-ee08-472f-9b21-80c608491eaf tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:47.860478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-451f0223-ee08-472f-9b21-80c608491eaf tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:47.860932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-451f0223-ee08-472f-9b21-80c608491eaf tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:47.861645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-451f0223-ee08-472f-9b21-80c608491eaf tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:47.862116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-451f0223-ee08-472f-9b21-80c608491eaf tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:47.862581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-451f0223-ee08-472f-9b21-80c608491eaf tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:48.007888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-451f0223-ee08-472f-9b21-80c608491eaf tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:48.016463 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-451f0223-ee08-472f-9b21-80c608491eaf tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1514 microversion: 2.1 time: 0.167970 Aug 23 18:47:48.027863 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3637/7139] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:47 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1514 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:49.040690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ba1c1cc6-ac45-4c56-9fd4-56829a74d604 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:49.041328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ba1c1cc6-ac45-4c56-9fd4-56829a74d604 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:49.047624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba1c1cc6-ac45-4c56-9fd4-56829a74d604 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:49.048110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba1c1cc6-ac45-4c56-9fd4-56829a74d604 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:49.048552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba1c1cc6-ac45-4c56-9fd4-56829a74d604 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:49.049246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba1c1cc6-ac45-4c56-9fd4-56829a74d604 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:49.049710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba1c1cc6-ac45-4c56-9fd4-56829a74d604 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:49.050137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ba1c1cc6-ac45-4c56-9fd4-56829a74d604 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:49.143720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f7fa5f96-f8a5-4747-ab27-ea2b04b18923 req-e4183223-be0a-43a7-8052-3563ab6ba670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8deeaa04-4d68-46b6-850e-32aca714f115", "tag": "4710bc5e-c07d-419e-982e-fe167fd63665"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:47:49.154614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f7fa5f96-f8a5-4747-ab27-ea2b04b18923 req-e4183223-be0a-43a7-8052-3563ab6ba670 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:49.155202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f7fa5f96-f8a5-4747-ab27-ea2b04b18923 req-e4183223-be0a-43a7-8052-3563ab6ba670 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:49.155726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f7fa5f96-f8a5-4747-ab27-ea2b04b18923 req-e4183223-be0a-43a7-8052-3563ab6ba670 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:49.167450 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f7fa5f96-f8a5-4747-ab27-ea2b04b18923 req-e4183223-be0a-43a7-8052-3563ab6ba670 service nova] Creating event network-changed:4710bc5e-c07d-419e-982e-fe167fd63665 for instance 8deeaa04-4d68-46b6-850e-32aca714f115 on n-h1-850468-16 Aug 23 18:47:49.172862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-f7fa5f96-f8a5-4747-ab27-ea2b04b18923 req-e4183223-be0a-43a7-8052-3563ab6ba670 service nova] Instance 8deeaa04-4d68-46b6-850e-32aca714f115 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:47:49.184647 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f7fa5f96-f8a5-4747-ab27-ea2b04b18923 req-e4183223-be0a-43a7-8052-3563ab6ba670 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044810 Aug 23 18:47:49.185257 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3638/7140] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:47:49.188353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ba1c1cc6-ac45-4c56-9fd4-56829a74d604 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:49.196982 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ba1c1cc6-ac45-4c56-9fd4-56829a74d604 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1512 microversion: 2.1 time: 0.161617 Aug 23 18:47:49.197582 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3503/7141] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:49 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1512 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:50.220948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ae128516-8b6a-4090-a09c-d4f141729380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:50.221672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ae128516-8b6a-4090-a09c-d4f141729380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:50.228231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae128516-8b6a-4090-a09c-d4f141729380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:50.228735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae128516-8b6a-4090-a09c-d4f141729380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:50.229192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae128516-8b6a-4090-a09c-d4f141729380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:50.229946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae128516-8b6a-4090-a09c-d4f141729380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:50.230419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae128516-8b6a-4090-a09c-d4f141729380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:50.230895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ae128516-8b6a-4090-a09c-d4f141729380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:50.366485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ae128516-8b6a-4090-a09c-d4f141729380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:50.374484 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ae128516-8b6a-4090-a09c-d4f141729380 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1512 microversion: 2.1 time: 0.159090 Aug 23 18:47:50.375106 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3639/7142] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:50 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:51.396941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-32fbd093-fd73-48a9-a3e2-7e0d6b1f332e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:51.397466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-32fbd093-fd73-48a9-a3e2-7e0d6b1f332e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:51.404428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32fbd093-fd73-48a9-a3e2-7e0d6b1f332e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:51.404921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32fbd093-fd73-48a9-a3e2-7e0d6b1f332e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:51.405363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32fbd093-fd73-48a9-a3e2-7e0d6b1f332e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:51.406068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32fbd093-fd73-48a9-a3e2-7e0d6b1f332e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:51.406524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32fbd093-fd73-48a9-a3e2-7e0d6b1f332e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:51.406970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32fbd093-fd73-48a9-a3e2-7e0d6b1f332e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:51.924803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-32fbd093-fd73-48a9-a3e2-7e0d6b1f332e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:51.933331 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-32fbd093-fd73-48a9-a3e2-7e0d6b1f332e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1509 microversion: 2.1 time: 0.540699 Aug 23 18:47:51.933943 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3504/7143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:51 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1509 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:51.954397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-01bb03b6-8bcf-4679-b112-e2dd6a12290a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:51.954962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-01bb03b6-8bcf-4679-b112-e2dd6a12290a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:51.961914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01bb03b6-8bcf-4679-b112-e2dd6a12290a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:51.962420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01bb03b6-8bcf-4679-b112-e2dd6a12290a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:51.962903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01bb03b6-8bcf-4679-b112-e2dd6a12290a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:51.963622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01bb03b6-8bcf-4679-b112-e2dd6a12290a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:51.964096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01bb03b6-8bcf-4679-b112-e2dd6a12290a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:51.964539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01bb03b6-8bcf-4679-b112-e2dd6a12290a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:51.992299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-01bb03b6-8bcf-4679-b112-e2dd6a12290a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:47:52.042323 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.compute.api [None req-01bb03b6-8bcf-4679-b112-e2dd6a12290a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Found an unconfirmed migration during delete, id: 16, status: finished Aug 23 18:47:53.428765 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-01bb03b6-8bcf-4679-b112-e2dd6a12290a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 204 len: 0 microversion: 2.1 time: 1.477955 Aug 23 18:47:53.429552 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3640/7144] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:47:51 2022] DELETE /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 0 bytes in 1480 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:47:53.438416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0fb8b06f-d974-491a-a7f8-bb260a816e4a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:53.439068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0fb8b06f-d974-491a-a7f8-bb260a816e4a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:53.446788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fb8b06f-d974-491a-a7f8-bb260a816e4a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:53.447279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fb8b06f-d974-491a-a7f8-bb260a816e4a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:53.447717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fb8b06f-d974-491a-a7f8-bb260a816e4a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:53.448423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fb8b06f-d974-491a-a7f8-bb260a816e4a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:53.448876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fb8b06f-d974-491a-a7f8-bb260a816e4a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:53.449301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fb8b06f-d974-491a-a7f8-bb260a816e4a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:53.588316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0fb8b06f-d974-491a-a7f8-bb260a816e4a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:53.596520 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0fb8b06f-d974-491a-a7f8-bb260a816e4a tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1501 microversion: 2.1 time: 0.162872 Aug 23 18:47:53.597095 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3505/7145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:53 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:53.819378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-af27b716-38df-41cc-8a06-7867d18073c4 req-80d3ae98-8cbf-4592-a2da-e9fc66bb9465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8deeaa04-4d68-46b6-850e-32aca714f115", "name": "network-vif-plugged", "status": "completed", "tag": "4710bc5e-c07d-419e-982e-fe167fd63665"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:47:53.830558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-af27b716-38df-41cc-8a06-7867d18073c4 req-80d3ae98-8cbf-4592-a2da-e9fc66bb9465 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:53.831139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-af27b716-38df-41cc-8a06-7867d18073c4 req-80d3ae98-8cbf-4592-a2da-e9fc66bb9465 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:53.831602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-af27b716-38df-41cc-8a06-7867d18073c4 req-80d3ae98-8cbf-4592-a2da-e9fc66bb9465 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:53.843970 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-af27b716-38df-41cc-8a06-7867d18073c4 req-80d3ae98-8cbf-4592-a2da-e9fc66bb9465 service nova] Creating event network-vif-plugged:4710bc5e-c07d-419e-982e-fe167fd63665 for instance 8deeaa04-4d68-46b6-850e-32aca714f115 on n-h1-850468-16 Aug 23 18:47:53.849766 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-af27b716-38df-41cc-8a06-7867d18073c4 req-80d3ae98-8cbf-4592-a2da-e9fc66bb9465 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034161 Aug 23 18:47:53.850387 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3641/7146] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:47:54.618378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1f08e963-a772-4308-8813-b7bd8adcda20 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:54.619021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1f08e963-a772-4308-8813-b7bd8adcda20 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:54.625967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f08e963-a772-4308-8813-b7bd8adcda20 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:54.626458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f08e963-a772-4308-8813-b7bd8adcda20 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:54.626933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f08e963-a772-4308-8813-b7bd8adcda20 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:54.627645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f08e963-a772-4308-8813-b7bd8adcda20 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:54.628107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f08e963-a772-4308-8813-b7bd8adcda20 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:54.628539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1f08e963-a772-4308-8813-b7bd8adcda20 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:54.759211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1f08e963-a772-4308-8813-b7bd8adcda20 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:54.767443 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1f08e963-a772-4308-8813-b7bd8adcda20 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1501 microversion: 2.1 time: 0.153076 Aug 23 18:47:54.768032 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3506/7147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:54 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1501 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:55.515570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-982fba4a-1d28-4dca-993a-7f9e56ab4720 req-f7679f20-2814-4899-8725-cb29b01c338e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8deeaa04-4d68-46b6-850e-32aca714f115", "name": "network-vif-deleted", "tag": "4710bc5e-c07d-419e-982e-fe167fd63665"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:47:55.526067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-982fba4a-1d28-4dca-993a-7f9e56ab4720 req-f7679f20-2814-4899-8725-cb29b01c338e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:55.526931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-982fba4a-1d28-4dca-993a-7f9e56ab4720 req-f7679f20-2814-4899-8725-cb29b01c338e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:55.527535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-982fba4a-1d28-4dca-993a-7f9e56ab4720 req-f7679f20-2814-4899-8725-cb29b01c338e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:55.541433 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-982fba4a-1d28-4dca-993a-7f9e56ab4720 req-f7679f20-2814-4899-8725-cb29b01c338e service nova] Creating event network-vif-deleted:4710bc5e-c07d-419e-982e-fe167fd63665 for instance 8deeaa04-4d68-46b6-850e-32aca714f115 on n-h1-850468-16 Aug 23 18:47:55.547819 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-982fba4a-1d28-4dca-993a-7f9e56ab4720 req-f7679f20-2814-4899-8725-cb29b01c338e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039953 Aug 23 18:47:55.548870 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3642/7148] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:47:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:47:55.789407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:55.789983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:55.797021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:55.797509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:55.797952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:55.798677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:55.799138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:55.799572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:55.832202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:55.832691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:55.833349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:55.833952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lazy-loading 'fault' on Instance uuid 8deeaa04-4d68-46b6-850e-32aca714f115 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:47:55.877964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a2e201b94db4e09a083655dcda8214c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd83e17a33b2401d849e746a173ff128', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:47:55.886217 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9dae75f7-cf16-4370-b146-f06dbc1bea33 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 200 len: 1303 microversion: 2.1 time: 0.101355 Aug 23 18:47:55.886832 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3507/7149] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:55 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:47:56.909580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0ac243c7-2a0d-4279-984a-6ba4b2d384cb tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:56.910219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0ac243c7-2a0d-4279-984a-6ba4b2d384cb tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:56.917340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ac243c7-2a0d-4279-984a-6ba4b2d384cb tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:56.917849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ac243c7-2a0d-4279-984a-6ba4b2d384cb tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:56.918299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ac243c7-2a0d-4279-984a-6ba4b2d384cb tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:56.919026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ac243c7-2a0d-4279-984a-6ba4b2d384cb tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:56.919496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ac243c7-2a0d-4279-984a-6ba4b2d384cb tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:56.919936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0ac243c7-2a0d-4279-984a-6ba4b2d384cb tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:56.932917 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-0ac243c7-2a0d-4279-984a-6ba4b2d384cb tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] HTTP exception thrown: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0ac243c7-2a0d-4279-984a-6ba4b2d384cb tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Request method failure captured: Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 HTTP/1.1 Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSComNYBoNs5emOqOigB_ieFrVfdaFaMSl9WNXtynmuRxfyPmYKfn-O6TrfmvwxICtvCgMLOkl8BEMaMnAse5txG0AcvfKvz6nhIhdsgCJ39Z-Qckc1nplXBhG632XY20Jyybp0YyA471slqMqY9s99DZAwNfqEQyVsdLW0zLWQdBl0 Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: fd83e17a33b2401d849e746a173ff128 Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersTestJSON-1535575948 Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd83e17a33b2401d849e746a173ff128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd83e17a33b2401d849e746a173ff128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd83e17a33b2401d849e746a173ff128"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd83e17a33b2401d849e746a173ff128"}]}] Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersTestJSON-1535575948 Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: fd83e17a33b2401d849e746a173ff128 Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersTestJSON-1535575948 Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersTestJSON-1535575948-project Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 7a2e201b94db4e09a083655dcda8214c Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersTestJSON-1535575948-project Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '8deeaa04-4d68-46b6-850e-32aca714f115'} Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:47:56.934641 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:47:56.939175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:47:56.939175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:47:56.939175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:47:56.939175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:47:56.939175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:47:56.939175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:56.939175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:47:56.939175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0ac243c7-2a0d-4279-984a-6ba4b2d384cb tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Returning 404 to user: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:47:56.939175 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0ac243c7-2a0d-4279-984a-6ba4b2d384cb tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 404 len: 111 microversion: 2.1 time: 0.032620 Aug 23 18:47:56.939175 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3643/7150] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:56 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:47:56.949272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc765d5e-2113-43a4-afdd-b3142b06071e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:56.949810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bc765d5e-2113-43a4-afdd-b3142b06071e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:56.956152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc765d5e-2113-43a4-afdd-b3142b06071e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:56.956648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc765d5e-2113-43a4-afdd-b3142b06071e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:56.957099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc765d5e-2113-43a4-afdd-b3142b06071e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:56.958319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc765d5e-2113-43a4-afdd-b3142b06071e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:56.958815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc765d5e-2113-43a4-afdd-b3142b06071e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:56.959254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bc765d5e-2113-43a4-afdd-b3142b06071e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:56.972859 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-bc765d5e-2113-43a4-afdd-b3142b06071e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] HTTP exception thrown: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc765d5e-2113-43a4-afdd-b3142b06071e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Request method failure captured: Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 HTTP/1.1 Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSComNYBoNs5emOqOigB_ieFrVfdaFaMSl9WNXtynmuRxfyPmYKfn-O6TrfmvwxICtvCgMLOkl8BEMaMnAse5txG0AcvfKvz6nhIhdsgCJ39Z-Qckc1nplXBhG632XY20Jyybp0YyA471slqMqY9s99DZAwNfqEQyVsdLW0zLWQdBl0 Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fd83e17a33b2401d849e746a173ff128 Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-DeleteServersTestJSON-1535575948 Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd83e17a33b2401d849e746a173ff128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd83e17a33b2401d849e746a173ff128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd83e17a33b2401d849e746a173ff128"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd83e17a33b2401d849e746a173ff128"}]}] Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-DeleteServersTestJSON-1535575948 Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fd83e17a33b2401d849e746a173ff128 Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-DeleteServersTestJSON-1535575948 Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-DeleteServersTestJSON-1535575948-project Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 7a2e201b94db4e09a083655dcda8214c Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-DeleteServersTestJSON-1535575948-project Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '8deeaa04-4d68-46b6-850e-32aca714f115'} Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:47:56.975300 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bc765d5e-2113-43a4-afdd-b3142b06071e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Returning 404 to user: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bc765d5e-2113-43a4-afdd-b3142b06071e tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 404 len: 111 microversion: 2.1 time: 0.031843 Aug 23 18:47:56.979519 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3508/7151] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:47:56 2022] DELETE /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:47:56.985605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7e2363b-e917-4c0f-bf98-064581080ad6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:47:56.986272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b7e2363b-e917-4c0f-bf98-064581080ad6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] [instance: 8deeaa04-4d68-46b6-850e-32aca714f115] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:47:56.992405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7e2363b-e917-4c0f-bf98-064581080ad6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:56.992904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7e2363b-e917-4c0f-bf98-064581080ad6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:56.993362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7e2363b-e917-4c0f-bf98-064581080ad6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:56.994101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7e2363b-e917-4c0f-bf98-064581080ad6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:47:56.994597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7e2363b-e917-4c0f-bf98-064581080ad6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:47:56.995041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b7e2363b-e917-4c0f-bf98-064581080ad6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:47:57.008268 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-b7e2363b-e917-4c0f-bf98-064581080ad6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] HTTP exception thrown: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7e2363b-e917-4c0f-bf98-064581080ad6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Request method failure captured: Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 HTTP/1.1 Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSComNYBoNs5emOqOigB_ieFrVfdaFaMSl9WNXtynmuRxfyPmYKfn-O6TrfmvwxICtvCgMLOkl8BEMaMnAse5txG0AcvfKvz6nhIhdsgCJ39Z-Qckc1nplXBhG632XY20Jyybp0YyA471slqMqY9s99DZAwNfqEQyVsdLW0zLWQdBl0 Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: fd83e17a33b2401d849e746a173ff128 Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-DeleteServersTestJSON-1535575948 Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fd83e17a33b2401d849e746a173ff128"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd83e17a33b2401d849e746a173ff128"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fd83e17a33b2401d849e746a173ff128"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fd83e17a33b2401d849e746a173ff128"}]}] Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-DeleteServersTestJSON-1535575948 Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: fd83e17a33b2401d849e746a173ff128 Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-DeleteServersTestJSON-1535575948 Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-DeleteServersTestJSON-1535575948-project Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 7a2e201b94db4e09a083655dcda8214c Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-DeleteServersTestJSON-1535575948-project Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '8deeaa04-4d68-46b6-850e-32aca714f115'} Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:47:57.009828 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:47:57.014074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:47:57.014074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:47:57.014074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:47:57.014074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:47:57.014074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:47:57.014074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. Aug 23 18:47:57.014074 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:47:57.014074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b7e2363b-e917-4c0f-bf98-064581080ad6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] Returning 404 to user: Instance 8deeaa04-4d68-46b6-850e-32aca714f115 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:47:57.014074 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b7e2363b-e917-4c0f-bf98-064581080ad6 tempest-DeleteServersTestJSON-1535575948 tempest-DeleteServersTestJSON-1535575948-project] 10.222.0.61 "GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115" status: 404 len: 111 microversion: 2.1 time: 0.029851 Aug 23 18:47:57.014074 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3644/7152] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:47:56 2022] GET /compute/v2.1/servers/8deeaa04-4d68-46b6-850e-32aca714f115 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:48:05.599426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1184599228", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "6b53e5f1-dbe2-413b-a56a-ca4fc3629181"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:05.659766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] validate_networks() for [('6b53e5f1-dbe2-413b-a56a-ca4fc3629181', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:48:06.094242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:48:06.094903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:48:06.095417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:48:06.095838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:48:06.096260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:48:06.106738 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:06.107230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:06.107675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:06.108415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:06.108873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:06.109310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:06.127943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Getting quotas for project 913cf53eec1347568188b18338680766. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:48:06.134786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Getting quotas for user e7931ea2803147adb121fefdfcd189b2 and project 913cf53eec1347568188b18338680766. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:48:06.148596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:48:06.150961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:48:06.206506 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9d8e1a9d-b9d0-40a8-857e-75dfef98ab80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.780605 Aug 23 18:48:06.207696 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3509/7153] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:48:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:48:06.220785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3d1c8e93-fbda-4f5d-acf9-d159bba459bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:06.221572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3d1c8e93-fbda-4f5d-acf9-d159bba459bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:06.290882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3d1c8e93-fbda-4f5d-acf9-d159bba459bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:06.299902 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3d1c8e93-fbda-4f5d-acf9-d159bba459bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1218 microversion: 2.1 time: 0.083142 Aug 23 18:48:06.300502 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3645/7154] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:06 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:07.323473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d01d138-989d-439a-9a7a-7e538da1db7a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:07.329808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d01d138-989d-439a-9a7a-7e538da1db7a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:07.341640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d01d138-989d-439a-9a7a-7e538da1db7a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:07.343157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d01d138-989d-439a-9a7a-7e538da1db7a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:07.343957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d01d138-989d-439a-9a7a-7e538da1db7a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:07.345068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d01d138-989d-439a-9a7a-7e538da1db7a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:07.345549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d01d138-989d-439a-9a7a-7e538da1db7a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:07.346069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d01d138-989d-439a-9a7a-7e538da1db7a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:07.449716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7d01d138-989d-439a-9a7a-7e538da1db7a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:07.457799 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d01d138-989d-439a-9a7a-7e538da1db7a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1288 microversion: 2.1 time: 0.140803 Aug 23 18:48:07.471751 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3510/7155] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:07 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1288 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:08.481814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-336bdbe2-2458-46e8-aa26-227caeeff45c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:08.482652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-336bdbe2-2458-46e8-aa26-227caeeff45c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:08.487121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:48:08.493237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336bdbe2-2458-46e8-aa26-227caeeff45c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:08.493908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336bdbe2-2458-46e8-aa26-227caeeff45c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:08.494480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336bdbe2-2458-46e8-aa26-227caeeff45c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:08.495315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336bdbe2-2458-46e8-aa26-227caeeff45c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:08.495878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336bdbe2-2458-46e8-aa26-227caeeff45c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:08.496415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-336bdbe2-2458-46e8-aa26-227caeeff45c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:08.654394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-336bdbe2-2458-46e8-aa26-227caeeff45c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:08.664388 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-336bdbe2-2458-46e8-aa26-227caeeff45c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.188667 Aug 23 18:48:08.665401 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3646/7156] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:08 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:48:08.686773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-dfd3de15-6ce3-47bc-8bde-64b22326b99d req-278b064a-3a10-40af-9dff-5f2c5a490336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22137238-7b55-4edf-b87e-3879ecdfd7ed", "tag": "c4a1089a-66b5-45e5-8097-1a6ebef2e36b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:08.699314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dfd3de15-6ce3-47bc-8bde-64b22326b99d req-278b064a-3a10-40af-9dff-5f2c5a490336 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:08.700060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dfd3de15-6ce3-47bc-8bde-64b22326b99d req-278b064a-3a10-40af-9dff-5f2c5a490336 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:08.700510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-dfd3de15-6ce3-47bc-8bde-64b22326b99d req-278b064a-3a10-40af-9dff-5f2c5a490336 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:08.714946 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-dfd3de15-6ce3-47bc-8bde-64b22326b99d req-278b064a-3a10-40af-9dff-5f2c5a490336 service nova] Creating event network-changed:c4a1089a-66b5-45e5-8097-1a6ebef2e36b for instance 22137238-7b55-4edf-b87e-3879ecdfd7ed on n-h1-850468-16 Aug 23 18:48:08.724397 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-dfd3de15-6ce3-47bc-8bde-64b22326b99d req-278b064a-3a10-40af-9dff-5f2c5a490336 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038095 Aug 23 18:48:08.725668 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3511/7157] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:48:09.686774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bac68605-c94f-4233-9290-cdf335686451 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:09.687415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bac68605-c94f-4233-9290-cdf335686451 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:09.695275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bac68605-c94f-4233-9290-cdf335686451 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:09.695773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bac68605-c94f-4233-9290-cdf335686451 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:09.696222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bac68605-c94f-4233-9290-cdf335686451 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:09.696932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bac68605-c94f-4233-9290-cdf335686451 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:09.697396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bac68605-c94f-4233-9290-cdf335686451 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:09.697829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bac68605-c94f-4233-9290-cdf335686451 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:09.835829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bac68605-c94f-4233-9290-cdf335686451 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:09.843990 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bac68605-c94f-4233-9290-cdf335686451 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.161212 Aug 23 18:48:09.844690 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3647/7158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:09 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:10.867286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5bce7e8-aa51-4a5a-84a8-f6b21fa9547c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:10.867995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a5bce7e8-aa51-4a5a-84a8-f6b21fa9547c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:10.874332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5bce7e8-aa51-4a5a-84a8-f6b21fa9547c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:10.874840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5bce7e8-aa51-4a5a-84a8-f6b21fa9547c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:10.875284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5bce7e8-aa51-4a5a-84a8-f6b21fa9547c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:10.875986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5bce7e8-aa51-4a5a-84a8-f6b21fa9547c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:10.876450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5bce7e8-aa51-4a5a-84a8-f6b21fa9547c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:10.876880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5bce7e8-aa51-4a5a-84a8-f6b21fa9547c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:11.019395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a5bce7e8-aa51-4a5a-84a8-f6b21fa9547c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:11.027741 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a5bce7e8-aa51-4a5a-84a8-f6b21fa9547c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.166304 Aug 23 18:48:11.028534 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3512/7159] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:10 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:12.053550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ff883246-d350-4f2c-8526-880070d171a6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:12.054570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ff883246-d350-4f2c-8526-880070d171a6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:12.062958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff883246-d350-4f2c-8526-880070d171a6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:12.063465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff883246-d350-4f2c-8526-880070d171a6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:12.064085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff883246-d350-4f2c-8526-880070d171a6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:12.064808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff883246-d350-4f2c-8526-880070d171a6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:12.065284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff883246-d350-4f2c-8526-880070d171a6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:12.065728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ff883246-d350-4f2c-8526-880070d171a6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:12.201040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ff883246-d350-4f2c-8526-880070d171a6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:12.209267 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ff883246-d350-4f2c-8526-880070d171a6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.161012 Aug 23 18:48:12.209844 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3648/7160] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:12 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:48:13.230084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f12e140d-cbfe-4406-bea6-6a5b7ab42d2f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:13.230740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f12e140d-cbfe-4406-bea6-6a5b7ab42d2f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:13.233530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:48:13.239319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f12e140d-cbfe-4406-bea6-6a5b7ab42d2f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:13.239999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f12e140d-cbfe-4406-bea6-6a5b7ab42d2f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:13.240557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f12e140d-cbfe-4406-bea6-6a5b7ab42d2f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:13.241311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f12e140d-cbfe-4406-bea6-6a5b7ab42d2f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:13.241767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f12e140d-cbfe-4406-bea6-6a5b7ab42d2f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:13.242196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f12e140d-cbfe-4406-bea6-6a5b7ab42d2f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:13.246634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=66 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:48:13.378828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f12e140d-cbfe-4406-bea6-6a5b7ab42d2f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:13.386728 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f12e140d-cbfe-4406-bea6-6a5b7ab42d2f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.160570 Aug 23 18:48:13.387297 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3513/7161] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:13 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:13.935461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-bc3f4ec7-870e-4e86-bae7-2bcfe5adb562 req-1df2d521-1387-4897-a11d-2f66ab014fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22137238-7b55-4edf-b87e-3879ecdfd7ed", "name": "network-vif-plugged", "status": "completed", "tag": "c4a1089a-66b5-45e5-8097-1a6ebef2e36b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:13.946253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bc3f4ec7-870e-4e86-bae7-2bcfe5adb562 req-1df2d521-1387-4897-a11d-2f66ab014fb4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:13.946777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bc3f4ec7-870e-4e86-bae7-2bcfe5adb562 req-1df2d521-1387-4897-a11d-2f66ab014fb4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:13.947407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bc3f4ec7-870e-4e86-bae7-2bcfe5adb562 req-1df2d521-1387-4897-a11d-2f66ab014fb4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:13.958841 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-bc3f4ec7-870e-4e86-bae7-2bcfe5adb562 req-1df2d521-1387-4897-a11d-2f66ab014fb4 service nova] Creating event network-vif-plugged:c4a1089a-66b5-45e5-8097-1a6ebef2e36b for instance 22137238-7b55-4edf-b87e-3879ecdfd7ed on n-h1-850468-16 Aug 23 18:48:13.964529 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-bc3f4ec7-870e-4e86-bae7-2bcfe5adb562 req-1df2d521-1387-4897-a11d-2f66ab014fb4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032770 Aug 23 18:48:13.965134 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3649/7162] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:48:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:48:14.408262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-22b52714-b0f5-4445-820e-85094d6e9166 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:14.408885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-22b52714-b0f5-4445-820e-85094d6e9166 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:14.416212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22b52714-b0f5-4445-820e-85094d6e9166 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:14.416719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22b52714-b0f5-4445-820e-85094d6e9166 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:14.417159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22b52714-b0f5-4445-820e-85094d6e9166 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:14.417872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22b52714-b0f5-4445-820e-85094d6e9166 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:14.418335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22b52714-b0f5-4445-820e-85094d6e9166 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:14.418815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-22b52714-b0f5-4445-820e-85094d6e9166 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:14.552168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-22b52714-b0f5-4445-820e-85094d6e9166 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:14.560545 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-22b52714-b0f5-4445-820e-85094d6e9166 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1318 microversion: 2.1 time: 0.156317 Aug 23 18:48:14.561118 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3514/7163] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:14 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:15.583843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb05121d-8ba2-4676-b721-a6f63c464b18 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:15.585871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eb05121d-8ba2-4676-b721-a6f63c464b18 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:15.589215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:48:15.595477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb05121d-8ba2-4676-b721-a6f63c464b18 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:15.595991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb05121d-8ba2-4676-b721-a6f63c464b18 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:15.596448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb05121d-8ba2-4676-b721-a6f63c464b18 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:15.597177 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb05121d-8ba2-4676-b721-a6f63c464b18 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:15.597860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb05121d-8ba2-4676-b721-a6f63c464b18 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:15.598305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb05121d-8ba2-4676-b721-a6f63c464b18 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:15.740328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eb05121d-8ba2-4676-b721-a6f63c464b18 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:15.748922 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eb05121d-8ba2-4676-b721-a6f63c464b18 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1508 microversion: 2.1 time: 0.171252 Aug 23 18:48:15.749502 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3650/7164] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:15 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:15.770003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9fc9ba39-71fd-472b-bedd-60620fd7fd7d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:15.770806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9fc9ba39-71fd-472b-bedd-60620fd7fd7d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:15.778811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc9ba39-71fd-472b-bedd-60620fd7fd7d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:15.779310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc9ba39-71fd-472b-bedd-60620fd7fd7d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:15.779759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc9ba39-71fd-472b-bedd-60620fd7fd7d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:15.780475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc9ba39-71fd-472b-bedd-60620fd7fd7d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:15.780925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc9ba39-71fd-472b-bedd-60620fd7fd7d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:15.781367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fc9ba39-71fd-472b-bedd-60620fd7fd7d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:15.919716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9fc9ba39-71fd-472b-bedd-60620fd7fd7d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:15.927902 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9fc9ba39-71fd-472b-bedd-60620fd7fd7d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1508 microversion: 2.1 time: 0.161832 Aug 23 18:48:15.928640 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3515/7165] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:15 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:15.949117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-423bb040-9c0c-4433-a64e-cc60b92e398d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:15.951490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-423bb040-9c0c-4433-a64e-cc60b92e398d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:15.957492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-423bb040-9c0c-4433-a64e-cc60b92e398d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:15.957987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-423bb040-9c0c-4433-a64e-cc60b92e398d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:15.958432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-423bb040-9c0c-4433-a64e-cc60b92e398d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:15.959163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-423bb040-9c0c-4433-a64e-cc60b92e398d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:15.959627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-423bb040-9c0c-4433-a64e-cc60b92e398d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:15.960743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-423bb040-9c0c-4433-a64e-cc60b92e398d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:16.024987 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-423bb040-9c0c-4433-a64e-cc60b92e398d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "PUT /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1080 microversion: 2.1 time: 0.080990 Aug 23 18:48:16.025784 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3651/7166] 10.222.0.61 () {60 vars in 1256 bytes} [Tue Aug 23 18:48:15 2022] PUT /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1080 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:16.042869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0ee1b12e-f710-420b-93e1-360c4f6f6668 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:16.043573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0ee1b12e-f710-420b-93e1-360c4f6f6668 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:16.049655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ee1b12e-f710-420b-93e1-360c4f6f6668 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:16.050174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ee1b12e-f710-420b-93e1-360c4f6f6668 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:16.050819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ee1b12e-f710-420b-93e1-360c4f6f6668 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:16.051533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ee1b12e-f710-420b-93e1-360c4f6f6668 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:16.051986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ee1b12e-f710-420b-93e1-360c4f6f6668 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:16.052415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0ee1b12e-f710-420b-93e1-360c4f6f6668 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:16.117720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:48:16.143248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:48:16.195021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0ee1b12e-f710-420b-93e1-360c4f6f6668 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:16.203054 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0ee1b12e-f710-420b-93e1-360c4f6f6668 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1506 microversion: 2.1 time: 0.164535 Aug 23 18:48:16.203646 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3516/7167] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:16 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1506 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:16.223427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-11b39916-af04-45ad-8c1d-497eb97d1924 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:16.224160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-11b39916-af04-45ad-8c1d-497eb97d1924 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:16.230685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11b39916-af04-45ad-8c1d-497eb97d1924 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:16.231272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11b39916-af04-45ad-8c1d-497eb97d1924 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:16.231799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11b39916-af04-45ad-8c1d-497eb97d1924 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:16.232592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11b39916-af04-45ad-8c1d-497eb97d1924 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:16.233160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11b39916-af04-45ad-8c1d-497eb97d1924 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:16.233677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11b39916-af04-45ad-8c1d-497eb97d1924 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:16.296536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:48:16.369485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-11b39916-af04-45ad-8c1d-497eb97d1924 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:16.377987 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-11b39916-af04-45ad-8c1d-497eb97d1924 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1506 microversion: 2.1 time: 0.158525 Aug 23 18:48:16.378578 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3652/7168] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:16 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:16.398857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:16.401303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:16.407353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:16.407839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:16.408281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:16.408982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:16.409474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:16.409903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:16.438659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:16.445332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Old instance type m1.heat2, new instance type m1.heat {{(pid=128807) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 18:48:16.452351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:48:16.452784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:48:16.453388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:48:16.453667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:48:16.454082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:48:16.523571 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-093e2f04-86e0-46e6-998a-c308a408183a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "POST /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed/action" status: 202 len: 0 microversion: 2.1 time: 0.129187 Aug 23 18:48:16.524574 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3517/7169] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:48:16 2022] POST /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed/action => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:48:16.532951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c903665d-9609-43a1-8ddb-2bed5b6a125d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:16.533750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c903665d-9609-43a1-8ddb-2bed5b6a125d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:16.541636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c903665d-9609-43a1-8ddb-2bed5b6a125d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:16.542276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c903665d-9609-43a1-8ddb-2bed5b6a125d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:16.543172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c903665d-9609-43a1-8ddb-2bed5b6a125d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:16.543647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c903665d-9609-43a1-8ddb-2bed5b6a125d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:16.544615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c903665d-9609-43a1-8ddb-2bed5b6a125d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:16.544615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c903665d-9609-43a1-8ddb-2bed5b6a125d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:16.728908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c903665d-9609-43a1-8ddb-2bed5b6a125d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:16.737268 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c903665d-9609-43a1-8ddb-2bed5b6a125d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1517 microversion: 2.1 time: 0.208485 Aug 23 18:48:16.737834 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3653/7170] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:16 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1517 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:48:17.759970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-66cb17ac-59f9-4ca4-bebc-6ce10dc23a01 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:17.760657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-66cb17ac-59f9-4ca4-bebc-6ce10dc23a01 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:17.766918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66cb17ac-59f9-4ca4-bebc-6ce10dc23a01 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:17.767347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66cb17ac-59f9-4ca4-bebc-6ce10dc23a01 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:17.767790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66cb17ac-59f9-4ca4-bebc-6ce10dc23a01 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:17.768496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66cb17ac-59f9-4ca4-bebc-6ce10dc23a01 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:17.768975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66cb17ac-59f9-4ca4-bebc-6ce10dc23a01 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:17.769387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-66cb17ac-59f9-4ca4-bebc-6ce10dc23a01 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:17.995574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-66cb17ac-59f9-4ca4-bebc-6ce10dc23a01 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:18.003457 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-66cb17ac-59f9-4ca4-bebc-6ce10dc23a01 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1517 microversion: 2.1 time: 0.248944 Aug 23 18:48:18.004034 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3518/7171] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:17 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1517 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:19.025658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b5e633d2-aefb-4982-816d-a5fe56ae62e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:19.026178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b5e633d2-aefb-4982-816d-a5fe56ae62e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:19.032995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5e633d2-aefb-4982-816d-a5fe56ae62e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:19.033485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5e633d2-aefb-4982-816d-a5fe56ae62e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:19.033928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5e633d2-aefb-4982-816d-a5fe56ae62e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:19.034660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5e633d2-aefb-4982-816d-a5fe56ae62e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:19.035123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5e633d2-aefb-4982-816d-a5fe56ae62e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:19.035557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b5e633d2-aefb-4982-816d-a5fe56ae62e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:19.169365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b5e633d2-aefb-4982-816d-a5fe56ae62e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:19.177003 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b5e633d2-aefb-4982-816d-a5fe56ae62e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.155861 Aug 23 18:48:19.177567 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3654/7172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:19 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:20.199419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-90360db6-1cfa-43fb-870a-06323ee5e655 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:20.200037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-90360db6-1cfa-43fb-870a-06323ee5e655 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:20.206935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90360db6-1cfa-43fb-870a-06323ee5e655 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:20.207417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90360db6-1cfa-43fb-870a-06323ee5e655 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:20.207857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90360db6-1cfa-43fb-870a-06323ee5e655 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:20.208548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90360db6-1cfa-43fb-870a-06323ee5e655 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:20.209001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90360db6-1cfa-43fb-870a-06323ee5e655 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:20.209426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90360db6-1cfa-43fb-870a-06323ee5e655 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:20.344252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-90360db6-1cfa-43fb-870a-06323ee5e655 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:20.352833 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-90360db6-1cfa-43fb-870a-06323ee5e655 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.157680 Aug 23 18:48:20.353398 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3519/7173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:20 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:21.373432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-854fd2fe-7d50-4e5c-9d28-74062e44a721 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:21.374063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-854fd2fe-7d50-4e5c-9d28-74062e44a721 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:21.380987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-854fd2fe-7d50-4e5c-9d28-74062e44a721 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:21.381594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-854fd2fe-7d50-4e5c-9d28-74062e44a721 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:21.382595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-854fd2fe-7d50-4e5c-9d28-74062e44a721 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:21.383331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-854fd2fe-7d50-4e5c-9d28-74062e44a721 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:21.383805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-854fd2fe-7d50-4e5c-9d28-74062e44a721 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:21.384254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-854fd2fe-7d50-4e5c-9d28-74062e44a721 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:21.516532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-854fd2fe-7d50-4e5c-9d28-74062e44a721 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:21.525748 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-854fd2fe-7d50-4e5c-9d28-74062e44a721 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.156274 Aug 23 18:48:21.526337 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3655/7174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:21 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:22.547552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b5acfbe-58f8-4c26-a404-b17a64d537eb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:22.548170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7b5acfbe-58f8-4c26-a404-b17a64d537eb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:22.555284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b5acfbe-58f8-4c26-a404-b17a64d537eb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:22.555778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b5acfbe-58f8-4c26-a404-b17a64d537eb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:22.556216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b5acfbe-58f8-4c26-a404-b17a64d537eb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:22.556916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b5acfbe-58f8-4c26-a404-b17a64d537eb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:22.557368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b5acfbe-58f8-4c26-a404-b17a64d537eb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:22.557794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7b5acfbe-58f8-4c26-a404-b17a64d537eb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:22.693513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7b5acfbe-58f8-4c26-a404-b17a64d537eb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:22.702132 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7b5acfbe-58f8-4c26-a404-b17a64d537eb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.158531 Aug 23 18:48:22.702736 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3520/7175] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:22 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:23.724429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-344ee66d-20cb-480e-99bd-06e6613db177 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:23.725048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-344ee66d-20cb-480e-99bd-06e6613db177 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:23.732530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-344ee66d-20cb-480e-99bd-06e6613db177 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:23.733021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-344ee66d-20cb-480e-99bd-06e6613db177 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:23.733469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-344ee66d-20cb-480e-99bd-06e6613db177 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:23.734170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-344ee66d-20cb-480e-99bd-06e6613db177 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:23.734667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-344ee66d-20cb-480e-99bd-06e6613db177 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:23.735102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-344ee66d-20cb-480e-99bd-06e6613db177 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:23.868281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-344ee66d-20cb-480e-99bd-06e6613db177 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:23.876118 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-344ee66d-20cb-480e-99bd-06e6613db177 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.155538 Aug 23 18:48:23.876691 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3656/7176] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:23 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:24.897902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-757f5407-b733-446c-ac8c-d4522fc00240 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:24.898492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-757f5407-b733-446c-ac8c-d4522fc00240 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:24.905399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-757f5407-b733-446c-ac8c-d4522fc00240 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:24.905885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-757f5407-b733-446c-ac8c-d4522fc00240 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:24.906329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-757f5407-b733-446c-ac8c-d4522fc00240 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:24.907052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-757f5407-b733-446c-ac8c-d4522fc00240 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:24.907515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-757f5407-b733-446c-ac8c-d4522fc00240 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:24.907945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-757f5407-b733-446c-ac8c-d4522fc00240 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:25.036292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-757f5407-b733-446c-ac8c-d4522fc00240 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:25.044005 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-757f5407-b733-446c-ac8c-d4522fc00240 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.150836 Aug 23 18:48:25.044586 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3521/7177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:24 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:26.065333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ed2d079f-10c0-43b5-a242-e6b4406bd6aa tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:26.065936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ed2d079f-10c0-43b5-a242-e6b4406bd6aa tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:26.073246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed2d079f-10c0-43b5-a242-e6b4406bd6aa tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:26.073740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed2d079f-10c0-43b5-a242-e6b4406bd6aa tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:26.074193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed2d079f-10c0-43b5-a242-e6b4406bd6aa tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:26.074922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed2d079f-10c0-43b5-a242-e6b4406bd6aa tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:26.075386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed2d079f-10c0-43b5-a242-e6b4406bd6aa tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:26.075820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed2d079f-10c0-43b5-a242-e6b4406bd6aa tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:26.205676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ed2d079f-10c0-43b5-a242-e6b4406bd6aa tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:26.213675 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ed2d079f-10c0-43b5-a242-e6b4406bd6aa tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.152429 Aug 23 18:48:26.214251 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3657/7178] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:26 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:27.235192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fea2ff94-9a74-41db-8ef6-6d7e4f670ce4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:27.235814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fea2ff94-9a74-41db-8ef6-6d7e4f670ce4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:27.242947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fea2ff94-9a74-41db-8ef6-6d7e4f670ce4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:27.243437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fea2ff94-9a74-41db-8ef6-6d7e4f670ce4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:27.243887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fea2ff94-9a74-41db-8ef6-6d7e4f670ce4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:27.244584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fea2ff94-9a74-41db-8ef6-6d7e4f670ce4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:27.245043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fea2ff94-9a74-41db-8ef6-6d7e4f670ce4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:27.245473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fea2ff94-9a74-41db-8ef6-6d7e4f670ce4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:27.377272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fea2ff94-9a74-41db-8ef6-6d7e4f670ce4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:27.385189 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fea2ff94-9a74-41db-8ef6-6d7e4f670ce4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.153943 Aug 23 18:48:27.385753 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3522/7179] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:27 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:28.406800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1971bc96-5895-49f3-a081-0dda9d985de4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:28.407428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1971bc96-5895-49f3-a081-0dda9d985de4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:28.414774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1971bc96-5895-49f3-a081-0dda9d985de4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:28.415285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1971bc96-5895-49f3-a081-0dda9d985de4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:28.415739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1971bc96-5895-49f3-a081-0dda9d985de4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:28.416453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1971bc96-5895-49f3-a081-0dda9d985de4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:28.416922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1971bc96-5895-49f3-a081-0dda9d985de4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:28.417364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1971bc96-5895-49f3-a081-0dda9d985de4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:28.551090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1971bc96-5895-49f3-a081-0dda9d985de4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:28.559579 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1971bc96-5895-49f3-a081-0dda9d985de4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.156683 Aug 23 18:48:28.560138 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3658/7180] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:28 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:29.580594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eeede9a8-7fc7-4d8a-ac2b-94b1061f703d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:29.581210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eeede9a8-7fc7-4d8a-ac2b-94b1061f703d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:29.588750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eeede9a8-7fc7-4d8a-ac2b-94b1061f703d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:29.589231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eeede9a8-7fc7-4d8a-ac2b-94b1061f703d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:29.589664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eeede9a8-7fc7-4d8a-ac2b-94b1061f703d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:29.590653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eeede9a8-7fc7-4d8a-ac2b-94b1061f703d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:29.591100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eeede9a8-7fc7-4d8a-ac2b-94b1061f703d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:29.591524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eeede9a8-7fc7-4d8a-ac2b-94b1061f703d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:29.725993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eeede9a8-7fc7-4d8a-ac2b-94b1061f703d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:29.734421 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eeede9a8-7fc7-4d8a-ac2b-94b1061f703d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.157716 Aug 23 18:48:29.735021 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3523/7181] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:29 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:30.755630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-78055bce-9967-4532-9ef1-31eda202c10a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:30.756258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-78055bce-9967-4532-9ef1-31eda202c10a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:30.763204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78055bce-9967-4532-9ef1-31eda202c10a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:30.763701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78055bce-9967-4532-9ef1-31eda202c10a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:30.764157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78055bce-9967-4532-9ef1-31eda202c10a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:30.764863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78055bce-9967-4532-9ef1-31eda202c10a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:30.765333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78055bce-9967-4532-9ef1-31eda202c10a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:30.765775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78055bce-9967-4532-9ef1-31eda202c10a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:30.893647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-78055bce-9967-4532-9ef1-31eda202c10a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:30.901297 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-78055bce-9967-4532-9ef1-31eda202c10a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.149561 Aug 23 18:48:30.901869 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3659/7182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:30 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:31.922350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c32b7680-01a1-4583-8ec1-93720c1d2aaf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:31.922993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c32b7680-01a1-4583-8ec1-93720c1d2aaf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:31.930217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c32b7680-01a1-4583-8ec1-93720c1d2aaf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:31.930736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c32b7680-01a1-4583-8ec1-93720c1d2aaf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:31.931172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c32b7680-01a1-4583-8ec1-93720c1d2aaf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:31.931862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c32b7680-01a1-4583-8ec1-93720c1d2aaf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:31.932319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c32b7680-01a1-4583-8ec1-93720c1d2aaf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:31.932742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c32b7680-01a1-4583-8ec1-93720c1d2aaf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:32.063282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c32b7680-01a1-4583-8ec1-93720c1d2aaf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:32.071214 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c32b7680-01a1-4583-8ec1-93720c1d2aaf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.152816 Aug 23 18:48:32.071784 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3524/7183] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:31 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:33.092902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7d424c14-f4c4-47c4-8e63-a38c4528a1d2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:33.093455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7d424c14-f4c4-47c4-8e63-a38c4528a1d2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:33.100814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d424c14-f4c4-47c4-8e63-a38c4528a1d2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:33.101311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d424c14-f4c4-47c4-8e63-a38c4528a1d2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:33.101763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d424c14-f4c4-47c4-8e63-a38c4528a1d2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:33.102472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d424c14-f4c4-47c4-8e63-a38c4528a1d2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:33.102967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d424c14-f4c4-47c4-8e63-a38c4528a1d2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:33.103407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7d424c14-f4c4-47c4-8e63-a38c4528a1d2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:33.245533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7d424c14-f4c4-47c4-8e63-a38c4528a1d2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:33.253162 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7d424c14-f4c4-47c4-8e63-a38c4528a1d2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.164491 Aug 23 18:48:33.253735 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3660/7184] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:33 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:34.275092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0e7b0efc-c1cd-4d67-8094-92203bdeb9d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:34.275702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0e7b0efc-c1cd-4d67-8094-92203bdeb9d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:34.282596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7b0efc-c1cd-4d67-8094-92203bdeb9d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:34.283076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7b0efc-c1cd-4d67-8094-92203bdeb9d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:34.283509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7b0efc-c1cd-4d67-8094-92203bdeb9d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:34.284194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7b0efc-c1cd-4d67-8094-92203bdeb9d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:34.284644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7b0efc-c1cd-4d67-8094-92203bdeb9d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:34.285066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0e7b0efc-c1cd-4d67-8094-92203bdeb9d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:34.418624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0e7b0efc-c1cd-4d67-8094-92203bdeb9d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:34.426727 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0e7b0efc-c1cd-4d67-8094-92203bdeb9d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.155835 Aug 23 18:48:34.427338 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3525/7185] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:34 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:35.449388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f101cb1e-4740-4608-89e7-6d7737efeb3d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:35.450161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f101cb1e-4740-4608-89e7-6d7737efeb3d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:35.457493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f101cb1e-4740-4608-89e7-6d7737efeb3d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:35.458015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f101cb1e-4740-4608-89e7-6d7737efeb3d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:35.458526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f101cb1e-4740-4608-89e7-6d7737efeb3d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:35.459147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f101cb1e-4740-4608-89e7-6d7737efeb3d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:35.460462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f101cb1e-4740-4608-89e7-6d7737efeb3d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:35.460990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f101cb1e-4740-4608-89e7-6d7737efeb3d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:35.591570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f101cb1e-4740-4608-89e7-6d7737efeb3d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:35.599346 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f101cb1e-4740-4608-89e7-6d7737efeb3d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.153846 Aug 23 18:48:35.599960 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3661/7186] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:35 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:36.620697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-be36f8d8-e83d-4feb-a686-c1be1ed40015 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:36.621313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-be36f8d8-e83d-4feb-a686-c1be1ed40015 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:36.628223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be36f8d8-e83d-4feb-a686-c1be1ed40015 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:36.628725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be36f8d8-e83d-4feb-a686-c1be1ed40015 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:36.629150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be36f8d8-e83d-4feb-a686-c1be1ed40015 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:36.629844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be36f8d8-e83d-4feb-a686-c1be1ed40015 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:36.630299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be36f8d8-e83d-4feb-a686-c1be1ed40015 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:36.630751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-be36f8d8-e83d-4feb-a686-c1be1ed40015 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:36.766395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-be36f8d8-e83d-4feb-a686-c1be1ed40015 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:36.776019 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-be36f8d8-e83d-4feb-a686-c1be1ed40015 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.159318 Aug 23 18:48:36.776591 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3526/7187] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:36 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:37.797071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e0cb4b7c-b4bf-437e-9066-b226e22ea17c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:37.797593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e0cb4b7c-b4bf-437e-9066-b226e22ea17c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:37.805302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0cb4b7c-b4bf-437e-9066-b226e22ea17c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:37.805943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0cb4b7c-b4bf-437e-9066-b226e22ea17c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:37.806433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0cb4b7c-b4bf-437e-9066-b226e22ea17c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:37.806956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0cb4b7c-b4bf-437e-9066-b226e22ea17c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:37.807418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0cb4b7c-b4bf-437e-9066-b226e22ea17c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:37.807853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0cb4b7c-b4bf-437e-9066-b226e22ea17c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:37.826630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:48:37.945921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e0cb4b7c-b4bf-437e-9066-b226e22ea17c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:37.953588 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e0cb4b7c-b4bf-437e-9066-b226e22ea17c tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.160490 Aug 23 18:48:37.954154 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3662/7188] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:37 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:38.976271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-05fb43a5-4603-4c45-9d37-900065af5673 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:38.976819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-05fb43a5-4603-4c45-9d37-900065af5673 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:38.983834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05fb43a5-4603-4c45-9d37-900065af5673 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:38.984323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05fb43a5-4603-4c45-9d37-900065af5673 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:38.984766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05fb43a5-4603-4c45-9d37-900065af5673 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:38.985461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05fb43a5-4603-4c45-9d37-900065af5673 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:38.985956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05fb43a5-4603-4c45-9d37-900065af5673 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:38.986381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05fb43a5-4603-4c45-9d37-900065af5673 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:39.119155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-05fb43a5-4603-4c45-9d37-900065af5673 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:39.126919 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-05fb43a5-4603-4c45-9d37-900065af5673 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.155369 Aug 23 18:48:39.127486 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3527/7189] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:38 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:40.148490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-965a63f0-a5d3-4a0d-9633-d40c9c2263b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:40.149117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-965a63f0-a5d3-4a0d-9633-d40c9c2263b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:40.156026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-965a63f0-a5d3-4a0d-9633-d40c9c2263b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:40.156523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-965a63f0-a5d3-4a0d-9633-d40c9c2263b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:40.156975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-965a63f0-a5d3-4a0d-9633-d40c9c2263b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:40.157684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-965a63f0-a5d3-4a0d-9633-d40c9c2263b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:40.158154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-965a63f0-a5d3-4a0d-9633-d40c9c2263b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:40.158623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-965a63f0-a5d3-4a0d-9633-d40c9c2263b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:40.287052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-965a63f0-a5d3-4a0d-9633-d40c9c2263b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:40.294949 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-965a63f0-a5d3-4a0d-9633-d40c9c2263b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.150872 Aug 23 18:48:40.295525 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3663/7190] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:40 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:41.316397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-830dc8c8-565a-4427-b11c-0a343da94b80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:41.317018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-830dc8c8-565a-4427-b11c-0a343da94b80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:41.324675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-830dc8c8-565a-4427-b11c-0a343da94b80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:41.325158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-830dc8c8-565a-4427-b11c-0a343da94b80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:41.325597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-830dc8c8-565a-4427-b11c-0a343da94b80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:41.326292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-830dc8c8-565a-4427-b11c-0a343da94b80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:41.326787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-830dc8c8-565a-4427-b11c-0a343da94b80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:41.327221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-830dc8c8-565a-4427-b11c-0a343da94b80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:41.342964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:48:41.469940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-830dc8c8-565a-4427-b11c-0a343da94b80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:41.478301 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-830dc8c8-565a-4427-b11c-0a343da94b80 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.165827 Aug 23 18:48:41.478994 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3528/7191] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:41 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:42.500380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-93386d68-3159-46d3-9c96-9946e0097a7f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:42.501415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-93386d68-3159-46d3-9c96-9946e0097a7f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:42.509477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93386d68-3159-46d3-9c96-9946e0097a7f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:42.509973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93386d68-3159-46d3-9c96-9946e0097a7f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:42.510418 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93386d68-3159-46d3-9c96-9946e0097a7f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:42.511158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93386d68-3159-46d3-9c96-9946e0097a7f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:42.511620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93386d68-3159-46d3-9c96-9946e0097a7f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:42.512056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-93386d68-3159-46d3-9c96-9946e0097a7f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:42.641778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-93386d68-3159-46d3-9c96-9946e0097a7f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:42.649641 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-93386d68-3159-46d3-9c96-9946e0097a7f tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.153204 Aug 23 18:48:42.650203 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3664/7192] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:42 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:43.670273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a8b2608-72d1-44cd-a86a-718580def888 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:43.670928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a8b2608-72d1-44cd-a86a-718580def888 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:43.673582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=36 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:48:43.679878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a8b2608-72d1-44cd-a86a-718580def888 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:43.680366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a8b2608-72d1-44cd-a86a-718580def888 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:43.680805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a8b2608-72d1-44cd-a86a-718580def888 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:43.681503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a8b2608-72d1-44cd-a86a-718580def888 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:43.681955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a8b2608-72d1-44cd-a86a-718580def888 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:43.682378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a8b2608-72d1-44cd-a86a-718580def888 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:43.814835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a8b2608-72d1-44cd-a86a-718580def888 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:43.822855 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a8b2608-72d1-44cd-a86a-718580def888 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.156533 Aug 23 18:48:43.823421 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3529/7193] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:43 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:44.844105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-78435af2-2b1d-42b7-b533-899409cd9837 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:44.844740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-78435af2-2b1d-42b7-b533-899409cd9837 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:44.852416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78435af2-2b1d-42b7-b533-899409cd9837 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:44.852929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78435af2-2b1d-42b7-b533-899409cd9837 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:44.853381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78435af2-2b1d-42b7-b533-899409cd9837 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:44.854096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78435af2-2b1d-42b7-b533-899409cd9837 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:44.854585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78435af2-2b1d-42b7-b533-899409cd9837 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:44.855030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78435af2-2b1d-42b7-b533-899409cd9837 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:44.990058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-78435af2-2b1d-42b7-b533-899409cd9837 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:44.998338 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-78435af2-2b1d-42b7-b533-899409cd9837 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1522 microversion: 2.1 time: 0.158456 Aug 23 18:48:44.998944 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3665/7194] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:44 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:46.019881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e8f181bb-690b-4b2b-a5e6-7b3c0ae9fbc4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:46.020582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e8f181bb-690b-4b2b-a5e6-7b3c0ae9fbc4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:46.028281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8f181bb-690b-4b2b-a5e6-7b3c0ae9fbc4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:46.028770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8f181bb-690b-4b2b-a5e6-7b3c0ae9fbc4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:46.029214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8f181bb-690b-4b2b-a5e6-7b3c0ae9fbc4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:46.029920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8f181bb-690b-4b2b-a5e6-7b3c0ae9fbc4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:46.030383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8f181bb-690b-4b2b-a5e6-7b3c0ae9fbc4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:46.030840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8f181bb-690b-4b2b-a5e6-7b3c0ae9fbc4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:46.166796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e8f181bb-690b-4b2b-a5e6-7b3c0ae9fbc4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:46.175105 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e8f181bb-690b-4b2b-a5e6-7b3c0ae9fbc4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1521 microversion: 2.1 time: 0.159067 Aug 23 18:48:46.175698 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3530/7195] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:46 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:46.185339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6d0892dc-c44f-4bef-a7a7-16aeee48e17f req-f1f31490-d5aa-4308-9c87-3a10a717be1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22137238-7b55-4edf-b87e-3879ecdfd7ed", "name": "network-vif-unplugged", "status": "completed", "tag": "c4a1089a-66b5-45e5-8097-1a6ebef2e36b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:46.192812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=32 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:48:46.198857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6d0892dc-c44f-4bef-a7a7-16aeee48e17f req-f1f31490-d5aa-4308-9c87-3a10a717be1a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:46.199335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6d0892dc-c44f-4bef-a7a7-16aeee48e17f req-f1f31490-d5aa-4308-9c87-3a10a717be1a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:46.199967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6d0892dc-c44f-4bef-a7a7-16aeee48e17f req-f1f31490-d5aa-4308-9c87-3a10a717be1a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:46.215136 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6d0892dc-c44f-4bef-a7a7-16aeee48e17f req-f1f31490-d5aa-4308-9c87-3a10a717be1a service nova] Creating event network-vif-unplugged:c4a1089a-66b5-45e5-8097-1a6ebef2e36b for instance 22137238-7b55-4edf-b87e-3879ecdfd7ed on n-h2-850468-16 Aug 23 18:48:46.220821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-6d0892dc-c44f-4bef-a7a7-16aeee48e17f req-f1f31490-d5aa-4308-9c87-3a10a717be1a service nova] Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:48:46.232489 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6d0892dc-c44f-4bef-a7a7-16aeee48e17f req-f1f31490-d5aa-4308-9c87-3a10a717be1a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051191 Aug 23 18:48:46.233106 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3666/7196] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:48:47.199036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cc363cf3-4981-44bf-b9a6-25a6f6bc43ed tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:47.199794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cc363cf3-4981-44bf-b9a6-25a6f6bc43ed tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:47.206516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc363cf3-4981-44bf-b9a6-25a6f6bc43ed tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:47.207029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc363cf3-4981-44bf-b9a6-25a6f6bc43ed tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:47.207469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc363cf3-4981-44bf-b9a6-25a6f6bc43ed tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:47.208160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc363cf3-4981-44bf-b9a6-25a6f6bc43ed tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:47.208614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc363cf3-4981-44bf-b9a6-25a6f6bc43ed tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:47.209123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc363cf3-4981-44bf-b9a6-25a6f6bc43ed tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:47.341066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cc363cf3-4981-44bf-b9a6-25a6f6bc43ed tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:47.348820 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cc363cf3-4981-44bf-b9a6-25a6f6bc43ed tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1519 microversion: 2.1 time: 0.154335 Aug 23 18:48:47.349928 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3531/7197] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:47 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:48:48.262595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-d65751da-d6a1-43c2-88e2-fc49bed8b3c4 req-e7116af8-c2c8-462b-9e06-822e560ddc49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22137238-7b55-4edf-b87e-3879ecdfd7ed", "tag": "c4a1089a-66b5-45e5-8097-1a6ebef2e36b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:48.272590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d65751da-d6a1-43c2-88e2-fc49bed8b3c4 req-e7116af8-c2c8-462b-9e06-822e560ddc49 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:48.273079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d65751da-d6a1-43c2-88e2-fc49bed8b3c4 req-e7116af8-c2c8-462b-9e06-822e560ddc49 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:48.273524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d65751da-d6a1-43c2-88e2-fc49bed8b3c4 req-e7116af8-c2c8-462b-9e06-822e560ddc49 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:48.284785 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-d65751da-d6a1-43c2-88e2-fc49bed8b3c4 req-e7116af8-c2c8-462b-9e06-822e560ddc49 service nova] Creating event network-changed:c4a1089a-66b5-45e5-8097-1a6ebef2e36b for instance 22137238-7b55-4edf-b87e-3879ecdfd7ed on n-h2-850468-16 Aug 23 18:48:48.290226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-d65751da-d6a1-43c2-88e2-fc49bed8b3c4 req-e7116af8-c2c8-462b-9e06-822e560ddc49 service nova] Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:48:48.300952 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-d65751da-d6a1-43c2-88e2-fc49bed8b3c4 req-e7116af8-c2c8-462b-9e06-822e560ddc49 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043314 Aug 23 18:48:48.301942 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3667/7198] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:48:48.372980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-641c8a32-4d47-4a53-a4b0-7af16ecc16dc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:48.373605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-641c8a32-4d47-4a53-a4b0-7af16ecc16dc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:48.380618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641c8a32-4d47-4a53-a4b0-7af16ecc16dc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:48.381934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641c8a32-4d47-4a53-a4b0-7af16ecc16dc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:48.382528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641c8a32-4d47-4a53-a4b0-7af16ecc16dc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:48.383273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641c8a32-4d47-4a53-a4b0-7af16ecc16dc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:48.383730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641c8a32-4d47-4a53-a4b0-7af16ecc16dc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:48.384161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-641c8a32-4d47-4a53-a4b0-7af16ecc16dc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:48.847201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-641c8a32-4d47-4a53-a4b0-7af16ecc16dc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:48.855854 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-641c8a32-4d47-4a53-a4b0-7af16ecc16dc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1519 microversion: 2.1 time: 0.487717 Aug 23 18:48:48.856415 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3532/7199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:48 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1519 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:48:49.879485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-36cead17-f85a-4753-977c-28c250ffc4ad tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:49.882228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-36cead17-f85a-4753-977c-28c250ffc4ad tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:49.891724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36cead17-f85a-4753-977c-28c250ffc4ad tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:49.892139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36cead17-f85a-4753-977c-28c250ffc4ad tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:49.892789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36cead17-f85a-4753-977c-28c250ffc4ad tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:49.893514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36cead17-f85a-4753-977c-28c250ffc4ad tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:49.894105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36cead17-f85a-4753-977c-28c250ffc4ad tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:49.894569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-36cead17-f85a-4753-977c-28c250ffc4ad tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:50.437741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-36cead17-f85a-4753-977c-28c250ffc4ad tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:50.447587 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-36cead17-f85a-4753-977c-28c250ffc4ad tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1519 microversion: 2.1 time: 0.572842 Aug 23 18:48:50.448181 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3668/7200] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:49 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1519 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:51.469502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a9092837-456b-4a9c-8e63-597dd4131af0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:51.470111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a9092837-456b-4a9c-8e63-597dd4131af0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:51.477852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9092837-456b-4a9c-8e63-597dd4131af0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:51.478340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9092837-456b-4a9c-8e63-597dd4131af0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:51.478811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9092837-456b-4a9c-8e63-597dd4131af0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:51.479516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9092837-456b-4a9c-8e63-597dd4131af0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:51.479999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9092837-456b-4a9c-8e63-597dd4131af0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:51.480430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9092837-456b-4a9c-8e63-597dd4131af0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:51.620917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a9092837-456b-4a9c-8e63-597dd4131af0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:51.628928 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a9092837-456b-4a9c-8e63-597dd4131af0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1516 microversion: 2.1 time: 0.163585 Aug 23 18:48:51.629827 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3533/7201] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:51 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1516 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:51.649936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ccf17a33-d928-4ca9-9949-69522380c0bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:51.650498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ccf17a33-d928-4ca9-9949-69522380c0bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:51.657302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ccf17a33-d928-4ca9-9949-69522380c0bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:51.657812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ccf17a33-d928-4ca9-9949-69522380c0bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:51.658266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ccf17a33-d928-4ca9-9949-69522380c0bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:51.659011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ccf17a33-d928-4ca9-9949-69522380c0bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:51.659486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ccf17a33-d928-4ca9-9949-69522380c0bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:51.659931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ccf17a33-d928-4ca9-9949-69522380c0bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:51.722834 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ccf17a33-d928-4ca9-9949-69522380c0bc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "POST /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed/action" status: 204 len: 0 microversion: 2.1 time: 0.077097 Aug 23 18:48:51.723394 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3669/7202] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:48:51 2022] POST /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed/action => generated 0 bytes in 79 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:48:51.732532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-03077e37-d154-42e4-8a15-b3054414ebbf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:51.733155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-03077e37-d154-42e4-8a15-b3054414ebbf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:51.739851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03077e37-d154-42e4-8a15-b3054414ebbf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:51.740974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03077e37-d154-42e4-8a15-b3054414ebbf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:51.741821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03077e37-d154-42e4-8a15-b3054414ebbf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:51.742700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03077e37-d154-42e4-8a15-b3054414ebbf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:51.743397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03077e37-d154-42e4-8a15-b3054414ebbf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:51.743837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03077e37-d154-42e4-8a15-b3054414ebbf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:52.017632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-03077e37-d154-42e4-8a15-b3054414ebbf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:52.027483 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-03077e37-d154-42e4-8a15-b3054414ebbf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1516 microversion: 2.1 time: 0.299009 Aug 23 18:48:52.028073 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3534/7203] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:51 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1516 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:53.050937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3ffb2163-cc80-4f49-9f96-7ae9036ac89b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:53.051705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3ffb2163-cc80-4f49-9f96-7ae9036ac89b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:53.058372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ffb2163-cc80-4f49-9f96-7ae9036ac89b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:53.058900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ffb2163-cc80-4f49-9f96-7ae9036ac89b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:53.059354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ffb2163-cc80-4f49-9f96-7ae9036ac89b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:53.060062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ffb2163-cc80-4f49-9f96-7ae9036ac89b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:53.060637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ffb2163-cc80-4f49-9f96-7ae9036ac89b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:53.061104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ffb2163-cc80-4f49-9f96-7ae9036ac89b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:53.199131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3ffb2163-cc80-4f49-9f96-7ae9036ac89b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:53.206858 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3ffb2163-cc80-4f49-9f96-7ae9036ac89b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1508 microversion: 2.1 time: 0.161253 Aug 23 18:48:53.207424 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3670/7204] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:53 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1508 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:53.228059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a8cf3f4e-ecef-42a4-bfaa-12097da4feb7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:53.228792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a8cf3f4e-ecef-42a4-bfaa-12097da4feb7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:53.235683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8cf3f4e-ecef-42a4-bfaa-12097da4feb7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:53.236174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8cf3f4e-ecef-42a4-bfaa-12097da4feb7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:53.236612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8cf3f4e-ecef-42a4-bfaa-12097da4feb7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:53.237310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8cf3f4e-ecef-42a4-bfaa-12097da4feb7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:53.237768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8cf3f4e-ecef-42a4-bfaa-12097da4feb7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:53.238196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a8cf3f4e-ecef-42a4-bfaa-12097da4feb7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:53.369331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a8cf3f4e-ecef-42a4-bfaa-12097da4feb7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:53.377191 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a8cf3f4e-ecef-42a4-bfaa-12097da4feb7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1508 microversion: 2.1 time: 0.153710 Aug 23 18:48:53.377782 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3535/7205] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:53 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:53.400859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-03eaed04-2925-447d-b72e-5dfd3943ebcd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Action: 'create', calling method: .version_select at 0x7f27df5dc670>, body: {"keypair": {"name": "tempest-keypair-906590861", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLXHxKx4F+cg1cw+1lGIa2RNb91DE8zI22jpoW4O9b3mgPPiBVaU8eC5rZgS5DxXGEWEHnj8qtHT6ZA9WD6jEPPS41BrhOxz7endwJsEBy3ZUFljh1VeTgOVCt6tcfyCng=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:53.416928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-03eaed04-2925-447d-b72e-5dfd3943ebcd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Getting quotas for project 913cf53eec1347568188b18338680766. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:48:53.422059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-03eaed04-2925-447d-b72e-5dfd3943ebcd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Getting quotas for user e7931ea2803147adb121fefdfcd189b2 and project 913cf53eec1347568188b18338680766. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:48:53.447134 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-03eaed04-2925-447d-b72e-5dfd3943ebcd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050149 Aug 23 18:48:53.447910 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3671/7206] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:48:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:48:53.727966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-841cf0b0-c474-4e94-a2e0-773eba9aef86 req-d2c3bbe2-539e-4a38-8f36-d41a4c55e111 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22137238-7b55-4edf-b87e-3879ecdfd7ed", "name": "network-vif-plugged", "status": "completed", "tag": "c4a1089a-66b5-45e5-8097-1a6ebef2e36b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:53.739038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-841cf0b0-c474-4e94-a2e0-773eba9aef86 req-d2c3bbe2-539e-4a38-8f36-d41a4c55e111 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:53.739462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-841cf0b0-c474-4e94-a2e0-773eba9aef86 req-d2c3bbe2-539e-4a38-8f36-d41a4c55e111 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:53.740247 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-841cf0b0-c474-4e94-a2e0-773eba9aef86 req-d2c3bbe2-539e-4a38-8f36-d41a4c55e111 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:53.753882 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-841cf0b0-c474-4e94-a2e0-773eba9aef86 req-d2c3bbe2-539e-4a38-8f36-d41a4c55e111 service nova] Creating event network-vif-plugged:c4a1089a-66b5-45e5-8097-1a6ebef2e36b for instance 22137238-7b55-4edf-b87e-3879ecdfd7ed on n-h2-850468-16 Aug 23 18:48:53.759334 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-841cf0b0-c474-4e94-a2e0-773eba9aef86 req-d2c3bbe2-539e-4a38-8f36-d41a4c55e111 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035889 Aug 23 18:48:53.760449 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3536/7207] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:48:54.665507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f073a972-8343-4512-8476-f7f2073628fc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:54.666132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f073a972-8343-4512-8476-f7f2073628fc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:54.672877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f073a972-8343-4512-8476-f7f2073628fc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:54.673370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f073a972-8343-4512-8476-f7f2073628fc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:54.673815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f073a972-8343-4512-8476-f7f2073628fc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:54.674515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f073a972-8343-4512-8476-f7f2073628fc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:54.675009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f073a972-8343-4512-8476-f7f2073628fc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:54.675447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f073a972-8343-4512-8476-f7f2073628fc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:54.809380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f073a972-8343-4512-8476-f7f2073628fc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:54.817106 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f073a972-8343-4512-8476-f7f2073628fc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 200 len: 1508 microversion: 2.1 time: 0.157005 Aug 23 18:48:54.817602 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3672/7208] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:54 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:54.838752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-14d411ea-13c8-4202-988f-427505940a2a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:54.839352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-14d411ea-13c8-4202-988f-427505940a2a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:54.845779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14d411ea-13c8-4202-988f-427505940a2a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:54.846266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14d411ea-13c8-4202-988f-427505940a2a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:54.846745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14d411ea-13c8-4202-988f-427505940a2a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:54.847731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14d411ea-13c8-4202-988f-427505940a2a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:54.848199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14d411ea-13c8-4202-988f-427505940a2a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:54.848631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-14d411ea-13c8-4202-988f-427505940a2a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:54.873711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-14d411ea-13c8-4202-988f-427505940a2a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:48:54.949267 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-14d411ea-13c8-4202-988f-427505940a2a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "DELETE /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 204 len: 0 microversion: 2.1 time: 0.115458 Aug 23 18:48:54.949863 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3537/7209] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:48:54 2022] DELETE /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:48:55.007465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-607869087", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "6b53e5f1-dbe2-413b-a56a-ca4fc3629181"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:55.059835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] validate_networks() for [('6b53e5f1-dbe2-413b-a56a-ca4fc3629181', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:48:55.435244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:48:55.435689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:48:55.436180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:48:55.436631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:48:55.437061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:48:55.446746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:55.447242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:55.447718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:55.448461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:55.448926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:55.449501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:55.465986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Getting quotas for project 913cf53eec1347568188b18338680766. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:48:55.471260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Getting quotas for user e7931ea2803147adb121fefdfcd189b2 and project 913cf53eec1347568188b18338680766. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:48:55.484060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:48:55.486359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:48:55.531518 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9622ca0e-9e10-40ce-ad8c-16d936a36bfc tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.528494 Aug 23 18:48:55.532173 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3673/7210] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:48:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 530 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:48:55.544318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-08f0d2e4-db58-44e2-8b05-ea232fe22b26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:55.545024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-08f0d2e4-db58-44e2-8b05-ea232fe22b26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:55.604625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-08f0d2e4-db58-44e2-8b05-ea232fe22b26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:55.611871 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-08f0d2e4-db58-44e2-8b05-ea232fe22b26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1217 microversion: 2.1 time: 0.071774 Aug 23 18:48:55.625851 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3538/7211] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:55 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1217 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:48:56.636346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6085b06e-e563-4440-8ac1-8f7a4f149feb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:56.637015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6085b06e-e563-4440-8ac1-8f7a4f149feb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:56.648761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6085b06e-e563-4440-8ac1-8f7a4f149feb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:56.649416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6085b06e-e563-4440-8ac1-8f7a4f149feb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:56.649881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6085b06e-e563-4440-8ac1-8f7a4f149feb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:56.650646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6085b06e-e563-4440-8ac1-8f7a4f149feb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:56.651299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6085b06e-e563-4440-8ac1-8f7a4f149feb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:56.652617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6085b06e-e563-4440-8ac1-8f7a4f149feb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:56.730534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6085b06e-e563-4440-8ac1-8f7a4f149feb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:56.737932 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6085b06e-e563-4440-8ac1-8f7a4f149feb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1277 microversion: 2.1 time: 0.108008 Aug 23 18:48:56.744236 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3674/7212] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:56 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1277 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:57.378440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4ac77a72-5c80-4aeb-9275-2c2bee389689 req-4179b916-6a42-4e6c-9b8f-b8aecb37928b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22137238-7b55-4edf-b87e-3879ecdfd7ed", "name": "network-vif-deleted", "tag": "c4a1089a-66b5-45e5-8097-1a6ebef2e36b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:57.392467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4ac77a72-5c80-4aeb-9275-2c2bee389689 req-4179b916-6a42-4e6c-9b8f-b8aecb37928b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:57.392950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4ac77a72-5c80-4aeb-9275-2c2bee389689 req-4179b916-6a42-4e6c-9b8f-b8aecb37928b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:57.393572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4ac77a72-5c80-4aeb-9275-2c2bee389689 req-4179b916-6a42-4e6c-9b8f-b8aecb37928b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:57.408279 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4ac77a72-5c80-4aeb-9275-2c2bee389689 req-4179b916-6a42-4e6c-9b8f-b8aecb37928b service nova] Creating event network-vif-deleted:c4a1089a-66b5-45e5-8097-1a6ebef2e36b for instance 22137238-7b55-4edf-b87e-3879ecdfd7ed on n-h2-850468-16 Aug 23 18:48:57.415529 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4ac77a72-5c80-4aeb-9275-2c2bee389689 req-4179b916-6a42-4e6c-9b8f-b8aecb37928b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041820 Aug 23 18:48:57.416148 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3539/7213] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:48:57.760409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e0f42a66-bfe4-4f0a-897d-d80dfa67bb58 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:57.761147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e0f42a66-bfe4-4f0a-897d-d80dfa67bb58 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:57.768182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0f42a66-bfe4-4f0a-897d-d80dfa67bb58 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:57.768758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0f42a66-bfe4-4f0a-897d-d80dfa67bb58 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:57.769290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0f42a66-bfe4-4f0a-897d-d80dfa67bb58 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:57.770066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0f42a66-bfe4-4f0a-897d-d80dfa67bb58 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:57.770632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0f42a66-bfe4-4f0a-897d-d80dfa67bb58 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:57.772569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e0f42a66-bfe4-4f0a-897d-d80dfa67bb58 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:57.907603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e0f42a66-bfe4-4f0a-897d-d80dfa67bb58 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:57.915936 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e0f42a66-bfe4-4f0a-897d-d80dfa67bb58 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1317 microversion: 2.1 time: 0.159469 Aug 23 18:48:57.916529 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3675/7214] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:57 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1317 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:48:58.030018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-97345026-0471-44d1-9aca-0416d244b8fd req-5dffc7b3-85b3-4332-827b-b40744bfc9c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db46fe09-029c-447e-a19b-67540d5246e8", "tag": "98ba1ead-9ffe-40a2-8a9a-ebdf636365dc"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:48:58.041088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-97345026-0471-44d1-9aca-0416d244b8fd req-5dffc7b3-85b3-4332-827b-b40744bfc9c3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:58.041666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-97345026-0471-44d1-9aca-0416d244b8fd req-5dffc7b3-85b3-4332-827b-b40744bfc9c3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:58.042947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-97345026-0471-44d1-9aca-0416d244b8fd req-5dffc7b3-85b3-4332-827b-b40744bfc9c3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:58.055277 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-97345026-0471-44d1-9aca-0416d244b8fd req-5dffc7b3-85b3-4332-827b-b40744bfc9c3 service nova] Creating event network-changed:98ba1ead-9ffe-40a2-8a9a-ebdf636365dc for instance db46fe09-029c-447e-a19b-67540d5246e8 on n-h1-850468-16 Aug 23 18:48:58.060401 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-97345026-0471-44d1-9aca-0416d244b8fd req-5dffc7b3-85b3-4332-827b-b40744bfc9c3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035349 Aug 23 18:48:58.061173 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3540/7215] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:48:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:48:58.937304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-658ab38d-c4f1-4c75-bfb3-2ded12c98079 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:48:58.937884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-658ab38d-c4f1-4c75-bfb3-2ded12c98079 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:48:58.945753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-658ab38d-c4f1-4c75-bfb3-2ded12c98079 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:58.946244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-658ab38d-c4f1-4c75-bfb3-2ded12c98079 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:58.946729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-658ab38d-c4f1-4c75-bfb3-2ded12c98079 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:58.947438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-658ab38d-c4f1-4c75-bfb3-2ded12c98079 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:48:58.947920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-658ab38d-c4f1-4c75-bfb3-2ded12c98079 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:48:58.948358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-658ab38d-c4f1-4c75-bfb3-2ded12c98079 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:48:59.152410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-658ab38d-c4f1-4c75-bfb3-2ded12c98079 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:48:59.160488 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-658ab38d-c4f1-4c75-bfb3-2ded12c98079 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1317 microversion: 2.1 time: 0.227115 Aug 23 18:48:59.161171 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3676/7216] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:48:58 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1317 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:00.188032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f10f5d62-6a38-4ab3-a22c-b1e3a1cc7ccf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:00.188748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f10f5d62-6a38-4ab3-a22c-b1e3a1cc7ccf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:00.195260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f10f5d62-6a38-4ab3-a22c-b1e3a1cc7ccf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:00.195749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f10f5d62-6a38-4ab3-a22c-b1e3a1cc7ccf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:00.196196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f10f5d62-6a38-4ab3-a22c-b1e3a1cc7ccf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:00.197055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f10f5d62-6a38-4ab3-a22c-b1e3a1cc7ccf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:00.197526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f10f5d62-6a38-4ab3-a22c-b1e3a1cc7ccf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:00.197959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f10f5d62-6a38-4ab3-a22c-b1e3a1cc7ccf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:00.413210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f10f5d62-6a38-4ab3-a22c-b1e3a1cc7ccf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:00.420974 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f10f5d62-6a38-4ab3-a22c-b1e3a1cc7ccf tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1317 microversion: 2.1 time: 0.238295 Aug 23 18:49:00.421842 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3541/7217] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:00 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1317 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:01.442636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-858ab084-c67b-4774-a66e-e5ff51e111e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:01.444186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-858ab084-c67b-4774-a66e-e5ff51e111e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:01.451062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-858ab084-c67b-4774-a66e-e5ff51e111e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:01.451561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-858ab084-c67b-4774-a66e-e5ff51e111e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:01.452014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-858ab084-c67b-4774-a66e-e5ff51e111e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:01.452731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-858ab084-c67b-4774-a66e-e5ff51e111e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:01.453200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-858ab084-c67b-4774-a66e-e5ff51e111e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:01.453642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-858ab084-c67b-4774-a66e-e5ff51e111e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:01.673090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-858ab084-c67b-4774-a66e-e5ff51e111e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:01.681471 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-858ab084-c67b-4774-a66e-e5ff51e111e2 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1317 microversion: 2.1 time: 0.242840 Aug 23 18:49:01.682046 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3677/7218] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:01 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1317 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:02.702208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ab7026ba-343d-4989-85e5-4e11341482da tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:02.702849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ab7026ba-343d-4989-85e5-4e11341482da tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:02.709869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab7026ba-343d-4989-85e5-4e11341482da tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:02.710356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab7026ba-343d-4989-85e5-4e11341482da tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:02.710839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab7026ba-343d-4989-85e5-4e11341482da tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:02.711550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab7026ba-343d-4989-85e5-4e11341482da tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:02.712016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab7026ba-343d-4989-85e5-4e11341482da tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:02.712451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ab7026ba-343d-4989-85e5-4e11341482da tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:02.847843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ab7026ba-343d-4989-85e5-4e11341482da tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:02.855900 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ab7026ba-343d-4989-85e5-4e11341482da tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1317 microversion: 2.1 time: 0.157648 Aug 23 18:49:02.856470 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3542/7219] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:02 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:03.877384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e3e6d80-f8e6-4b03-bc01-490b4625d8f4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:03.877963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e3e6d80-f8e6-4b03-bc01-490b4625d8f4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:03.885525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e3e6d80-f8e6-4b03-bc01-490b4625d8f4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:03.886029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e3e6d80-f8e6-4b03-bc01-490b4625d8f4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:03.886511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e3e6d80-f8e6-4b03-bc01-490b4625d8f4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:03.887337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e3e6d80-f8e6-4b03-bc01-490b4625d8f4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:03.887803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e3e6d80-f8e6-4b03-bc01-490b4625d8f4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:03.888245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e3e6d80-f8e6-4b03-bc01-490b4625d8f4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:04.021829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8e3e6d80-f8e6-4b03-bc01-490b4625d8f4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:04.030232 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e3e6d80-f8e6-4b03-bc01-490b4625d8f4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1317 microversion: 2.1 time: 0.156976 Aug 23 18:49:04.030871 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3678/7220] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:03 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1317 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:05.051347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d98c951a-d533-4151-827c-def993963789 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:05.051967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d98c951a-d533-4151-827c-def993963789 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:05.059427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d98c951a-d533-4151-827c-def993963789 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:05.059915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d98c951a-d533-4151-827c-def993963789 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:05.060360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d98c951a-d533-4151-827c-def993963789 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:05.061069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d98c951a-d533-4151-827c-def993963789 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:05.061529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d98c951a-d533-4151-827c-def993963789 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:05.061962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d98c951a-d533-4151-827c-def993963789 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:05.193294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d98c951a-d533-4151-827c-def993963789 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:05.201695 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d98c951a-d533-4151-827c-def993963789 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1317 microversion: 2.1 time: 0.154215 Aug 23 18:49:05.202269 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3543/7221] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:05 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:06.222600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-010de002-3a6a-4400-8bff-af3ebbedf76e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:06.223405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-010de002-3a6a-4400-8bff-af3ebbedf76e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:06.226505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:06.227447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=10 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:06.233913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010de002-3a6a-4400-8bff-af3ebbedf76e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:06.234515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010de002-3a6a-4400-8bff-af3ebbedf76e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:06.235010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010de002-3a6a-4400-8bff-af3ebbedf76e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:06.235724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010de002-3a6a-4400-8bff-af3ebbedf76e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:06.236201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010de002-3a6a-4400-8bff-af3ebbedf76e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:06.236650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-010de002-3a6a-4400-8bff-af3ebbedf76e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:06.240021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-6d7d446a-07af-4fd5-ba0a-d136b3925d23 req-9e5e08df-b711-4004-b062-e6e71456285f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db46fe09-029c-447e-a19b-67540d5246e8", "name": "network-vif-plugged", "status": "completed", "tag": "98ba1ead-9ffe-40a2-8a9a-ebdf636365dc"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:49:06.249929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:06.253724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6d7d446a-07af-4fd5-ba0a-d136b3925d23 req-9e5e08df-b711-4004-b062-e6e71456285f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:06.254404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6d7d446a-07af-4fd5-ba0a-d136b3925d23 req-9e5e08df-b711-4004-b062-e6e71456285f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:06.255184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6d7d446a-07af-4fd5-ba0a-d136b3925d23 req-9e5e08df-b711-4004-b062-e6e71456285f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:06.268435 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-6d7d446a-07af-4fd5-ba0a-d136b3925d23 req-9e5e08df-b711-4004-b062-e6e71456285f service nova] Creating event network-vif-plugged:98ba1ead-9ffe-40a2-8a9a-ebdf636365dc for instance db46fe09-029c-447e-a19b-67540d5246e8 on n-h1-850468-16 Aug 23 18:49:06.274919 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-6d7d446a-07af-4fd5-ba0a-d136b3925d23 req-9e5e08df-b711-4004-b062-e6e71456285f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037994 Aug 23 18:49:06.275756 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3544/7222] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:49:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:49:06.387315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-010de002-3a6a-4400-8bff-af3ebbedf76e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:06.395100 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-010de002-3a6a-4400-8bff-af3ebbedf76e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1317 microversion: 2.1 time: 0.176573 Aug 23 18:49:06.395682 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3679/7223] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:06 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1317 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:07.417588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-222bbbcc-feb0-4057-8f5b-5a85ed7173e6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:07.418302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-222bbbcc-feb0-4057-8f5b-5a85ed7173e6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:07.424591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-222bbbcc-feb0-4057-8f5b-5a85ed7173e6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:07.425082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-222bbbcc-feb0-4057-8f5b-5a85ed7173e6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:07.425526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-222bbbcc-feb0-4057-8f5b-5a85ed7173e6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:07.426233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-222bbbcc-feb0-4057-8f5b-5a85ed7173e6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:07.426725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-222bbbcc-feb0-4057-8f5b-5a85ed7173e6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:07.427157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-222bbbcc-feb0-4057-8f5b-5a85ed7173e6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:07.645064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-222bbbcc-feb0-4057-8f5b-5a85ed7173e6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:07.653487 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-222bbbcc-feb0-4057-8f5b-5a85ed7173e6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1317 microversion: 2.1 time: 0.240969 Aug 23 18:49:07.654068 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3545/7224] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:07 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1317 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:08.674861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-07f7623d-2db3-4abb-a98b-9debc4b1f5fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:08.675487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-07f7623d-2db3-4abb-a98b-9debc4b1f5fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:08.683303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07f7623d-2db3-4abb-a98b-9debc4b1f5fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:08.683799 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07f7623d-2db3-4abb-a98b-9debc4b1f5fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:08.684246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07f7623d-2db3-4abb-a98b-9debc4b1f5fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:08.684951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07f7623d-2db3-4abb-a98b-9debc4b1f5fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:08.685414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07f7623d-2db3-4abb-a98b-9debc4b1f5fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:08.685853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-07f7623d-2db3-4abb-a98b-9debc4b1f5fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:08.688405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:08.826261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-07f7623d-2db3-4abb-a98b-9debc4b1f5fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:08.834098 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-07f7623d-2db3-4abb-a98b-9debc4b1f5fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1507 microversion: 2.1 time: 0.163280 Aug 23 18:49:08.834708 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3680/7225] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:08 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:08.854683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c6fb789e-eb18-48f5-b829-2f9113589d6b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:08.855301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c6fb789e-eb18-48f5-b829-2f9113589d6b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:08.862118 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6fb789e-eb18-48f5-b829-2f9113589d6b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:08.862645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6fb789e-eb18-48f5-b829-2f9113589d6b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:08.863088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6fb789e-eb18-48f5-b829-2f9113589d6b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:08.863789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6fb789e-eb18-48f5-b829-2f9113589d6b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:08.864246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6fb789e-eb18-48f5-b829-2f9113589d6b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:08.864670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6fb789e-eb18-48f5-b829-2f9113589d6b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:08.997620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c6fb789e-eb18-48f5-b829-2f9113589d6b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:09.005360 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c6fb789e-eb18-48f5-b829-2f9113589d6b tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1507 microversion: 2.1 time: 0.154688 Aug 23 18:49:09.005936 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3546/7226] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:08 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:09.025074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:49:09.027527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:09.033529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:09.034038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:09.034498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:09.035233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:09.035706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:09.036151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:09.064416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:09.070254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Old instance type m1.heat2, new instance type m1.heat {{(pid=128808) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 18:49:09.076572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:49:09.077012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:49:09.077509 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:49:09.077938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:49:09.078369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:49:09.141794 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-db024481-d452-4f9c-8179-aee46d302e56 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "POST /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8/action" status: 202 len: 0 microversion: 2.1 time: 0.120654 Aug 23 18:49:09.142508 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3681/7227] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:49:09 2022] POST /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:49:09.150625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9dee828c-da97-4493-942c-91d0e1224ca5 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:09.151253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9dee828c-da97-4493-942c-91d0e1224ca5 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:09.157361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dee828c-da97-4493-942c-91d0e1224ca5 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:09.157858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dee828c-da97-4493-942c-91d0e1224ca5 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:09.158335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dee828c-da97-4493-942c-91d0e1224ca5 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:09.159046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dee828c-da97-4493-942c-91d0e1224ca5 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:09.159512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dee828c-da97-4493-942c-91d0e1224ca5 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:09.159952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dee828c-da97-4493-942c-91d0e1224ca5 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:09.164744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:09.297202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9dee828c-da97-4493-942c-91d0e1224ca5 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:09.307281 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9dee828c-da97-4493-942c-91d0e1224ca5 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1514 microversion: 2.1 time: 0.160444 Aug 23 18:49:09.307876 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3547/7228] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:09 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1514 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:10.329814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e97934f6-c0ef-4876-b43e-6152eacba9b4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:10.330444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e97934f6-c0ef-4876-b43e-6152eacba9b4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:10.337552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e97934f6-c0ef-4876-b43e-6152eacba9b4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:10.338055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e97934f6-c0ef-4876-b43e-6152eacba9b4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:10.338746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e97934f6-c0ef-4876-b43e-6152eacba9b4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:10.339500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e97934f6-c0ef-4876-b43e-6152eacba9b4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:10.339965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e97934f6-c0ef-4876-b43e-6152eacba9b4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:10.340690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e97934f6-c0ef-4876-b43e-6152eacba9b4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:10.482610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e97934f6-c0ef-4876-b43e-6152eacba9b4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:10.490424 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e97934f6-c0ef-4876-b43e-6152eacba9b4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1514 microversion: 2.1 time: 0.165583 Aug 23 18:49:10.491029 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3682/7229] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:10 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:11.511666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aa603472-411a-458d-95d8-88de3a8669c1 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:11.512284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aa603472-411a-458d-95d8-88de3a8669c1 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:11.519617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa603472-411a-458d-95d8-88de3a8669c1 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:11.520103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa603472-411a-458d-95d8-88de3a8669c1 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:11.520599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa603472-411a-458d-95d8-88de3a8669c1 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:11.521307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa603472-411a-458d-95d8-88de3a8669c1 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:11.521767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa603472-411a-458d-95d8-88de3a8669c1 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:11.522218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa603472-411a-458d-95d8-88de3a8669c1 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:11.655633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aa603472-411a-458d-95d8-88de3a8669c1 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:11.664205 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aa603472-411a-458d-95d8-88de3a8669c1 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.156376 Aug 23 18:49:11.664708 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3548/7230] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:11 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:12.685262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fdf77914-8bff-4715-bda1-e27624977a03 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:12.685897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fdf77914-8bff-4715-bda1-e27624977a03 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:12.692788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdf77914-8bff-4715-bda1-e27624977a03 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:12.693291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdf77914-8bff-4715-bda1-e27624977a03 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:12.693750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdf77914-8bff-4715-bda1-e27624977a03 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:12.695107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdf77914-8bff-4715-bda1-e27624977a03 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:12.695604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdf77914-8bff-4715-bda1-e27624977a03 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:12.696054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fdf77914-8bff-4715-bda1-e27624977a03 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:12.828987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fdf77914-8bff-4715-bda1-e27624977a03 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:12.836773 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fdf77914-8bff-4715-bda1-e27624977a03 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.155436 Aug 23 18:49:12.837411 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3683/7231] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:12 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:13.858489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e9a73db3-8a27-4f07-b6b3-ffd132a2b827 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:13.859048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e9a73db3-8a27-4f07-b6b3-ffd132a2b827 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:13.861852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:13.868214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9a73db3-8a27-4f07-b6b3-ffd132a2b827 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:13.868706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9a73db3-8a27-4f07-b6b3-ffd132a2b827 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:13.869148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9a73db3-8a27-4f07-b6b3-ffd132a2b827 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:13.869852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9a73db3-8a27-4f07-b6b3-ffd132a2b827 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:13.870310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9a73db3-8a27-4f07-b6b3-ffd132a2b827 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:13.870772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e9a73db3-8a27-4f07-b6b3-ffd132a2b827 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:14.012028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e9a73db3-8a27-4f07-b6b3-ffd132a2b827 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:14.019818 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e9a73db3-8a27-4f07-b6b3-ffd132a2b827 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.165320 Aug 23 18:49:14.020403 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3549/7232] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:13 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:15.041374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-306d544b-fe81-4f5e-904d-6bd10ceaecdd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:15.041991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-306d544b-fe81-4f5e-904d-6bd10ceaecdd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:15.048948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-306d544b-fe81-4f5e-904d-6bd10ceaecdd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:15.049451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-306d544b-fe81-4f5e-904d-6bd10ceaecdd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:15.049908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-306d544b-fe81-4f5e-904d-6bd10ceaecdd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:15.050661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-306d544b-fe81-4f5e-904d-6bd10ceaecdd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:15.051137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-306d544b-fe81-4f5e-904d-6bd10ceaecdd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:15.051585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-306d544b-fe81-4f5e-904d-6bd10ceaecdd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:15.181482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-306d544b-fe81-4f5e-904d-6bd10ceaecdd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:15.189167 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-306d544b-fe81-4f5e-904d-6bd10ceaecdd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.152301 Aug 23 18:49:15.189739 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3684/7233] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:15 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:16.210499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5b558cc8-aeef-4ba3-9085-7f5d1d963ccd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:16.211144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5b558cc8-aeef-4ba3-9085-7f5d1d963ccd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:16.218743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b558cc8-aeef-4ba3-9085-7f5d1d963ccd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:16.219257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b558cc8-aeef-4ba3-9085-7f5d1d963ccd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:16.219710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b558cc8-aeef-4ba3-9085-7f5d1d963ccd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:16.220447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b558cc8-aeef-4ba3-9085-7f5d1d963ccd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:16.220898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b558cc8-aeef-4ba3-9085-7f5d1d963ccd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:16.221352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5b558cc8-aeef-4ba3-9085-7f5d1d963ccd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:16.355293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5b558cc8-aeef-4ba3-9085-7f5d1d963ccd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:16.363259 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5b558cc8-aeef-4ba3-9085-7f5d1d963ccd tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.156891 Aug 23 18:49:16.374779 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3550/7234] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:16 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:17.385472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6badd626-3684-41cb-848e-12dd932d3221 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:17.386099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6badd626-3684-41cb-848e-12dd932d3221 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:17.388956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:17.394267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6badd626-3684-41cb-848e-12dd932d3221 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:17.394792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6badd626-3684-41cb-848e-12dd932d3221 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:17.395242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6badd626-3684-41cb-848e-12dd932d3221 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:17.395940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6badd626-3684-41cb-848e-12dd932d3221 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:17.396402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6badd626-3684-41cb-848e-12dd932d3221 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:17.396837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6badd626-3684-41cb-848e-12dd932d3221 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:17.534577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6badd626-3684-41cb-848e-12dd932d3221 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:17.543709 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6badd626-3684-41cb-848e-12dd932d3221 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.162126 Aug 23 18:49:17.544393 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3685/7235] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:17 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:49:18.565769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-00a5578a-3575-4ab0-abf3-933fd1bd9509 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:18.566410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-00a5578a-3575-4ab0-abf3-933fd1bd9509 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:18.574002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00a5578a-3575-4ab0-abf3-933fd1bd9509 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:18.574491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00a5578a-3575-4ab0-abf3-933fd1bd9509 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:18.574963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00a5578a-3575-4ab0-abf3-933fd1bd9509 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:18.575665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00a5578a-3575-4ab0-abf3-933fd1bd9509 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:18.576122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00a5578a-3575-4ab0-abf3-933fd1bd9509 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:18.576555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-00a5578a-3575-4ab0-abf3-933fd1bd9509 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:18.712879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-00a5578a-3575-4ab0-abf3-933fd1bd9509 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:18.721102 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-00a5578a-3575-4ab0-abf3-933fd1bd9509 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.159283 Aug 23 18:49:18.721682 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3551/7236] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:18 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:19.743824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-319188e0-59e1-4585-a6d4-9853487b68d4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:19.744462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-319188e0-59e1-4585-a6d4-9853487b68d4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:19.751424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-319188e0-59e1-4585-a6d4-9853487b68d4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:19.751957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-319188e0-59e1-4585-a6d4-9853487b68d4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:19.752488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-319188e0-59e1-4585-a6d4-9853487b68d4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:19.753271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-319188e0-59e1-4585-a6d4-9853487b68d4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:19.753811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-319188e0-59e1-4585-a6d4-9853487b68d4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:19.754326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-319188e0-59e1-4585-a6d4-9853487b68d4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:19.890165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-319188e0-59e1-4585-a6d4-9853487b68d4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:19.898006 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-319188e0-59e1-4585-a6d4-9853487b68d4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.159340 Aug 23 18:49:19.898594 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3686/7237] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:19 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:20.919745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6ad400b8-63f8-4e8e-ab0a-cf77be0031e8 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:20.920270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6ad400b8-63f8-4e8e-ab0a-cf77be0031e8 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:20.927238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ad400b8-63f8-4e8e-ab0a-cf77be0031e8 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:20.927722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ad400b8-63f8-4e8e-ab0a-cf77be0031e8 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:20.928166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ad400b8-63f8-4e8e-ab0a-cf77be0031e8 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:20.929080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ad400b8-63f8-4e8e-ab0a-cf77be0031e8 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:20.929544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ad400b8-63f8-4e8e-ab0a-cf77be0031e8 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:20.929976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ad400b8-63f8-4e8e-ab0a-cf77be0031e8 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:21.059779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6ad400b8-63f8-4e8e-ab0a-cf77be0031e8 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:21.067503 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6ad400b8-63f8-4e8e-ab0a-cf77be0031e8 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.151853 Aug 23 18:49:21.068071 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3552/7238] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:20 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:22.088804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-88630e8d-a290-40b1-a33f-7caee381fea9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:22.089432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-88630e8d-a290-40b1-a33f-7caee381fea9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:22.096510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88630e8d-a290-40b1-a33f-7caee381fea9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:22.097001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88630e8d-a290-40b1-a33f-7caee381fea9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:22.097445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88630e8d-a290-40b1-a33f-7caee381fea9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:22.098140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88630e8d-a290-40b1-a33f-7caee381fea9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:22.098627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88630e8d-a290-40b1-a33f-7caee381fea9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:22.099060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-88630e8d-a290-40b1-a33f-7caee381fea9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:22.232712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-88630e8d-a290-40b1-a33f-7caee381fea9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:22.240478 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-88630e8d-a290-40b1-a33f-7caee381fea9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.156142 Aug 23 18:49:22.241036 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3687/7239] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:22 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:23.262213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-87fe8de0-c60d-4f05-9abf-27f4765f1deb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:23.262852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-87fe8de0-c60d-4f05-9abf-27f4765f1deb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:23.269778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87fe8de0-c60d-4f05-9abf-27f4765f1deb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:23.270199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87fe8de0-c60d-4f05-9abf-27f4765f1deb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:23.270666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87fe8de0-c60d-4f05-9abf-27f4765f1deb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:23.271358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87fe8de0-c60d-4f05-9abf-27f4765f1deb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:23.271808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87fe8de0-c60d-4f05-9abf-27f4765f1deb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:23.272230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-87fe8de0-c60d-4f05-9abf-27f4765f1deb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:23.406874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-87fe8de0-c60d-4f05-9abf-27f4765f1deb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:23.414689 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-87fe8de0-c60d-4f05-9abf-27f4765f1deb tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.156383 Aug 23 18:49:23.415263 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3553/7240] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:23 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:24.435940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3c465367-2444-4d5f-8ca8-0c47158b023d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:24.436606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3c465367-2444-4d5f-8ca8-0c47158b023d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:24.443289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c465367-2444-4d5f-8ca8-0c47158b023d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:24.443788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c465367-2444-4d5f-8ca8-0c47158b023d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:24.444881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c465367-2444-4d5f-8ca8-0c47158b023d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:24.445605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c465367-2444-4d5f-8ca8-0c47158b023d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:24.446075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c465367-2444-4d5f-8ca8-0c47158b023d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:24.446519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c465367-2444-4d5f-8ca8-0c47158b023d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:24.581045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3c465367-2444-4d5f-8ca8-0c47158b023d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:24.589139 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3c465367-2444-4d5f-8ca8-0c47158b023d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.157159 Aug 23 18:49:24.589710 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3688/7241] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:24 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:25.610385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d6d9c440-6d90-46de-843a-04d3d3b3bfc7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:25.611033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d6d9c440-6d90-46de-843a-04d3d3b3bfc7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:25.618344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6d9c440-6d90-46de-843a-04d3d3b3bfc7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:25.618873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6d9c440-6d90-46de-843a-04d3d3b3bfc7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:25.619324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6d9c440-6d90-46de-843a-04d3d3b3bfc7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:25.620031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6d9c440-6d90-46de-843a-04d3d3b3bfc7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:25.620493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6d9c440-6d90-46de-843a-04d3d3b3bfc7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:25.620954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6d9c440-6d90-46de-843a-04d3d3b3bfc7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:25.751873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d6d9c440-6d90-46de-843a-04d3d3b3bfc7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:25.760147 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d6d9c440-6d90-46de-843a-04d3d3b3bfc7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.153687 Aug 23 18:49:25.760725 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3554/7242] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:25 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:26.781190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b2350cc9-70e0-4ad4-a945-804b947c82b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:26.781821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b2350cc9-70e0-4ad4-a945-804b947c82b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:26.788899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2350cc9-70e0-4ad4-a945-804b947c82b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:26.789386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2350cc9-70e0-4ad4-a945-804b947c82b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:26.789843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2350cc9-70e0-4ad4-a945-804b947c82b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:26.791295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2350cc9-70e0-4ad4-a945-804b947c82b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:26.791773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2350cc9-70e0-4ad4-a945-804b947c82b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:26.792223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2350cc9-70e0-4ad4-a945-804b947c82b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:26.922657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b2350cc9-70e0-4ad4-a945-804b947c82b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:26.930343 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b2350cc9-70e0-4ad4-a945-804b947c82b3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.153067 Aug 23 18:49:26.931600 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3689/7243] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:26 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:27.952895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45b6a28c-023b-4d11-ab36-942db969cc08 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:27.953529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-45b6a28c-023b-4d11-ab36-942db969cc08 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:27.959861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45b6a28c-023b-4d11-ab36-942db969cc08 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:27.960351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45b6a28c-023b-4d11-ab36-942db969cc08 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:27.960796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45b6a28c-023b-4d11-ab36-942db969cc08 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:27.961500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45b6a28c-023b-4d11-ab36-942db969cc08 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:27.962731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45b6a28c-023b-4d11-ab36-942db969cc08 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:27.963239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45b6a28c-023b-4d11-ab36-942db969cc08 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:28.095886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-45b6a28c-023b-4d11-ab36-942db969cc08 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:28.104451 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-45b6a28c-023b-4d11-ab36-942db969cc08 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.155676 Aug 23 18:49:28.105031 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3555/7244] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:27 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:29.125785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ee8a2d80-d45d-4fd3-a796-33e4e6d59cb3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:29.126313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ee8a2d80-d45d-4fd3-a796-33e4e6d59cb3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:29.133363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee8a2d80-d45d-4fd3-a796-33e4e6d59cb3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:29.134921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee8a2d80-d45d-4fd3-a796-33e4e6d59cb3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:29.135382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee8a2d80-d45d-4fd3-a796-33e4e6d59cb3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:29.136095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee8a2d80-d45d-4fd3-a796-33e4e6d59cb3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:29.136562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee8a2d80-d45d-4fd3-a796-33e4e6d59cb3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:29.137001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ee8a2d80-d45d-4fd3-a796-33e4e6d59cb3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:29.269956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ee8a2d80-d45d-4fd3-a796-33e4e6d59cb3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:29.277729 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ee8a2d80-d45d-4fd3-a796-33e4e6d59cb3 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.155940 Aug 23 18:49:29.278301 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3690/7245] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:29 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:30.299870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-285c53de-9a65-48d6-b599-14491d20cb26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:30.300490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-285c53de-9a65-48d6-b599-14491d20cb26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:30.307515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-285c53de-9a65-48d6-b599-14491d20cb26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:30.308008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-285c53de-9a65-48d6-b599-14491d20cb26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:30.308453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-285c53de-9a65-48d6-b599-14491d20cb26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:30.309160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-285c53de-9a65-48d6-b599-14491d20cb26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:30.309623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-285c53de-9a65-48d6-b599-14491d20cb26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:30.310055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-285c53de-9a65-48d6-b599-14491d20cb26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:30.443398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-285c53de-9a65-48d6-b599-14491d20cb26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:30.451277 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-285c53de-9a65-48d6-b599-14491d20cb26 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.155373 Aug 23 18:49:30.451854 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3556/7246] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:30 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:31.473018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a05a66a9-c5c2-4a58-94df-2b17cc65e044 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:31.473655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a05a66a9-c5c2-4a58-94df-2b17cc65e044 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:31.481001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a05a66a9-c5c2-4a58-94df-2b17cc65e044 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:31.481508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a05a66a9-c5c2-4a58-94df-2b17cc65e044 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:31.481969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a05a66a9-c5c2-4a58-94df-2b17cc65e044 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:31.482737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a05a66a9-c5c2-4a58-94df-2b17cc65e044 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:31.483196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a05a66a9-c5c2-4a58-94df-2b17cc65e044 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:31.483972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a05a66a9-c5c2-4a58-94df-2b17cc65e044 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:31.612863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a05a66a9-c5c2-4a58-94df-2b17cc65e044 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:31.620950 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a05a66a9-c5c2-4a58-94df-2b17cc65e044 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.152089 Aug 23 18:49:31.621555 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3691/7247] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:31 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:32.642369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9769cb4-61b1-4012-835a-943fa9ec08e7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:32.643066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d9769cb4-61b1-4012-835a-943fa9ec08e7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:32.650794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9769cb4-61b1-4012-835a-943fa9ec08e7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:32.651295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9769cb4-61b1-4012-835a-943fa9ec08e7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:32.651735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9769cb4-61b1-4012-835a-943fa9ec08e7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:32.652430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9769cb4-61b1-4012-835a-943fa9ec08e7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:32.652881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9769cb4-61b1-4012-835a-943fa9ec08e7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:32.653305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9769cb4-61b1-4012-835a-943fa9ec08e7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:32.785158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d9769cb4-61b1-4012-835a-943fa9ec08e7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:32.793309 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d9769cb4-61b1-4012-835a-943fa9ec08e7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.154845 Aug 23 18:49:32.793938 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3557/7248] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:32 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:33.815203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-51326197-49f3-4502-b643-2f12f159b5a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:33.815765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-51326197-49f3-4502-b643-2f12f159b5a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:33.823216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51326197-49f3-4502-b643-2f12f159b5a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:33.823740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51326197-49f3-4502-b643-2f12f159b5a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:33.824196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51326197-49f3-4502-b643-2f12f159b5a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:33.824905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51326197-49f3-4502-b643-2f12f159b5a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:33.825379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51326197-49f3-4502-b643-2f12f159b5a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:33.825823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-51326197-49f3-4502-b643-2f12f159b5a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:33.957495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-51326197-49f3-4502-b643-2f12f159b5a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:33.966478 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-51326197-49f3-4502-b643-2f12f159b5a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.155298 Aug 23 18:49:33.967208 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3692/7249] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:33 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:34.987729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96466044-05a0-4439-92a5-a143be9e0f4d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:34.988251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-96466044-05a0-4439-92a5-a143be9e0f4d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:34.995425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96466044-05a0-4439-92a5-a143be9e0f4d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:34.995913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96466044-05a0-4439-92a5-a143be9e0f4d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:34.996353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96466044-05a0-4439-92a5-a143be9e0f4d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:34.997049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96466044-05a0-4439-92a5-a143be9e0f4d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:34.997506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96466044-05a0-4439-92a5-a143be9e0f4d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:34.997934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96466044-05a0-4439-92a5-a143be9e0f4d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:35.129224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-96466044-05a0-4439-92a5-a143be9e0f4d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:35.137803 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-96466044-05a0-4439-92a5-a143be9e0f4d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.154511 Aug 23 18:49:35.138378 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3558/7250] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:34 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:36.159607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac4121b2-0755-464c-8eee-68eb53845861 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:36.160266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac4121b2-0755-464c-8eee-68eb53845861 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:36.167719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac4121b2-0755-464c-8eee-68eb53845861 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:36.168218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac4121b2-0755-464c-8eee-68eb53845861 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:36.168673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac4121b2-0755-464c-8eee-68eb53845861 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:36.169383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac4121b2-0755-464c-8eee-68eb53845861 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:36.169853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac4121b2-0755-464c-8eee-68eb53845861 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:36.170301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac4121b2-0755-464c-8eee-68eb53845861 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:36.309480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac4121b2-0755-464c-8eee-68eb53845861 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:36.317275 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac4121b2-0755-464c-8eee-68eb53845861 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.161605 Aug 23 18:49:36.317845 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3693/7251] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:36 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:37.339310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47aa1d59-8660-4e58-8f23-ac125345f844 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:37.339924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-47aa1d59-8660-4e58-8f23-ac125345f844 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:37.347133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47aa1d59-8660-4e58-8f23-ac125345f844 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:37.347616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47aa1d59-8660-4e58-8f23-ac125345f844 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:37.348054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47aa1d59-8660-4e58-8f23-ac125345f844 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:37.348745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47aa1d59-8660-4e58-8f23-ac125345f844 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:37.349197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47aa1d59-8660-4e58-8f23-ac125345f844 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:37.349620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47aa1d59-8660-4e58-8f23-ac125345f844 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:37.479908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-47aa1d59-8660-4e58-8f23-ac125345f844 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:37.487683 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-47aa1d59-8660-4e58-8f23-ac125345f844 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1519 microversion: 2.1 time: 0.152818 Aug 23 18:49:37.488257 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3559/7252] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:37 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1519 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:38.508765 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6751571b-f503-4e7d-9112-6e0e808782d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:38.509381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6751571b-f503-4e7d-9112-6e0e808782d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:38.516341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6751571b-f503-4e7d-9112-6e0e808782d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:38.516901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6751571b-f503-4e7d-9112-6e0e808782d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:38.517540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6751571b-f503-4e7d-9112-6e0e808782d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:38.518133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6751571b-f503-4e7d-9112-6e0e808782d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:38.518637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6751571b-f503-4e7d-9112-6e0e808782d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:38.519081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6751571b-f503-4e7d-9112-6e0e808782d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:38.693206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-5067cb69-13b4-4f48-af64-45a42382551e req-d3ca49df-7549-4a67-8ff3-c6ea7dec396b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db46fe09-029c-447e-a19b-67540d5246e8", "name": "network-vif-unplugged", "status": "completed", "tag": "98ba1ead-9ffe-40a2-8a9a-ebdf636365dc"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:49:38.703363 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5067cb69-13b4-4f48-af64-45a42382551e req-d3ca49df-7549-4a67-8ff3-c6ea7dec396b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:38.704451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5067cb69-13b4-4f48-af64-45a42382551e req-d3ca49df-7549-4a67-8ff3-c6ea7dec396b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:38.704895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5067cb69-13b4-4f48-af64-45a42382551e req-d3ca49df-7549-4a67-8ff3-c6ea7dec396b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:38.717814 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5067cb69-13b4-4f48-af64-45a42382551e req-d3ca49df-7549-4a67-8ff3-c6ea7dec396b service nova] Creating event network-vif-unplugged:98ba1ead-9ffe-40a2-8a9a-ebdf636365dc for instance db46fe09-029c-447e-a19b-67540d5246e8 on n-h2-850468-16 Aug 23 18:49:38.723624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-5067cb69-13b4-4f48-af64-45a42382551e req-d3ca49df-7549-4a67-8ff3-c6ea7dec396b service nova] Instance db46fe09-029c-447e-a19b-67540d5246e8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:49:38.735565 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-5067cb69-13b4-4f48-af64-45a42382551e req-d3ca49df-7549-4a67-8ff3-c6ea7dec396b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.097813 Aug 23 18:49:38.736320 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3560/7253] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:49:38.800119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6751571b-f503-4e7d-9112-6e0e808782d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:38.802348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:38.809648 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6751571b-f503-4e7d-9112-6e0e808782d9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1518 microversion: 2.1 time: 0.304821 Aug 23 18:49:38.810269 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3694/7254] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:38 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1518 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:39.833830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1e9a63f-4654-4a43-992c-2edcac38b91a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:39.834451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d1e9a63f-4654-4a43-992c-2edcac38b91a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:39.841512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e9a63f-4654-4a43-992c-2edcac38b91a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:39.841998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e9a63f-4654-4a43-992c-2edcac38b91a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:39.842442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e9a63f-4654-4a43-992c-2edcac38b91a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:39.843160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e9a63f-4654-4a43-992c-2edcac38b91a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:39.843617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e9a63f-4654-4a43-992c-2edcac38b91a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:39.844041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1e9a63f-4654-4a43-992c-2edcac38b91a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:39.846706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=82 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:39.978779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d1e9a63f-4654-4a43-992c-2edcac38b91a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:39.987015 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d1e9a63f-4654-4a43-992c-2edcac38b91a tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1516 microversion: 2.1 time: 0.158397 Aug 23 18:49:39.987623 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3561/7255] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:39 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:40.759609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-1186eb52-bf91-4752-8ef5-a5d3df42df07 req-7f6fea05-c215-4f0d-bb8b-dbc8a2596cea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db46fe09-029c-447e-a19b-67540d5246e8", "tag": "98ba1ead-9ffe-40a2-8a9a-ebdf636365dc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:49:40.770311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1186eb52-bf91-4752-8ef5-a5d3df42df07 req-7f6fea05-c215-4f0d-bb8b-dbc8a2596cea service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:40.770827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1186eb52-bf91-4752-8ef5-a5d3df42df07 req-7f6fea05-c215-4f0d-bb8b-dbc8a2596cea service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:40.771273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1186eb52-bf91-4752-8ef5-a5d3df42df07 req-7f6fea05-c215-4f0d-bb8b-dbc8a2596cea service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:40.783693 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-1186eb52-bf91-4752-8ef5-a5d3df42df07 req-7f6fea05-c215-4f0d-bb8b-dbc8a2596cea service nova] Creating event network-changed:98ba1ead-9ffe-40a2-8a9a-ebdf636365dc for instance db46fe09-029c-447e-a19b-67540d5246e8 on n-h2-850468-16 Aug 23 18:49:40.788996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-1186eb52-bf91-4752-8ef5-a5d3df42df07 req-7f6fea05-c215-4f0d-bb8b-dbc8a2596cea service nova] Instance db46fe09-029c-447e-a19b-67540d5246e8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:49:40.800931 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-1186eb52-bf91-4752-8ef5-a5d3df42df07 req-7f6fea05-c215-4f0d-bb8b-dbc8a2596cea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046397 Aug 23 18:49:40.801541 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3695/7256] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:49:41.010381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-09d6a0eb-f18d-483e-a2e7-7882a2dfa05e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:41.011117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-09d6a0eb-f18d-483e-a2e7-7882a2dfa05e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:41.018437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09d6a0eb-f18d-483e-a2e7-7882a2dfa05e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:41.018975 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09d6a0eb-f18d-483e-a2e7-7882a2dfa05e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:41.019412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09d6a0eb-f18d-483e-a2e7-7882a2dfa05e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:41.020122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09d6a0eb-f18d-483e-a2e7-7882a2dfa05e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:41.020573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09d6a0eb-f18d-483e-a2e7-7882a2dfa05e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:41.020995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-09d6a0eb-f18d-483e-a2e7-7882a2dfa05e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:41.463303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-09d6a0eb-f18d-483e-a2e7-7882a2dfa05e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:41.471590 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-09d6a0eb-f18d-483e-a2e7-7882a2dfa05e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1516 microversion: 2.1 time: 0.465815 Aug 23 18:49:41.472195 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3562/7257] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:41 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1516 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:42.495043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c1880b3b-fef7-4923-b61b-257cd824f915 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:42.495797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c1880b3b-fef7-4923-b61b-257cd824f915 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:42.502110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1880b3b-fef7-4923-b61b-257cd824f915 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:42.502648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1880b3b-fef7-4923-b61b-257cd824f915 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:42.503101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1880b3b-fef7-4923-b61b-257cd824f915 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:42.503825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1880b3b-fef7-4923-b61b-257cd824f915 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:42.504306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1880b3b-fef7-4923-b61b-257cd824f915 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:42.505348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c1880b3b-fef7-4923-b61b-257cd824f915 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:42.640794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c1880b3b-fef7-4923-b61b-257cd824f915 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:42.648528 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c1880b3b-fef7-4923-b61b-257cd824f915 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1513 microversion: 2.1 time: 0.159360 Aug 23 18:49:42.649158 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3696/7258] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:42 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:42.669197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d5acffe-c1b9-468b-b081-b2921a439d52 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:49:42.669759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d5acffe-c1b9-468b-b081-b2921a439d52 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:42.676476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d5acffe-c1b9-468b-b081-b2921a439d52 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:42.676959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d5acffe-c1b9-468b-b081-b2921a439d52 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:42.677397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d5acffe-c1b9-468b-b081-b2921a439d52 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:42.678090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d5acffe-c1b9-468b-b081-b2921a439d52 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:42.678596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d5acffe-c1b9-468b-b081-b2921a439d52 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:42.678993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d5acffe-c1b9-468b-b081-b2921a439d52 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:42.736428 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d5acffe-c1b9-468b-b081-b2921a439d52 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "POST /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8/action" status: 204 len: 0 microversion: 2.1 time: 0.071617 Aug 23 18:49:42.737068 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3563/7259] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:49:42 2022] POST /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8/action => generated 0 bytes in 73 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:49:42.745793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-654bcd9a-1647-426b-8ba9-426dd217c0e9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:42.746457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-654bcd9a-1647-426b-8ba9-426dd217c0e9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:42.752446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-654bcd9a-1647-426b-8ba9-426dd217c0e9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:42.752994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-654bcd9a-1647-426b-8ba9-426dd217c0e9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:42.753595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-654bcd9a-1647-426b-8ba9-426dd217c0e9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:42.754593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-654bcd9a-1647-426b-8ba9-426dd217c0e9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:42.755072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-654bcd9a-1647-426b-8ba9-426dd217c0e9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:42.755517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-654bcd9a-1647-426b-8ba9-426dd217c0e9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:42.892315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-654bcd9a-1647-426b-8ba9-426dd217c0e9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:42.901188 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-654bcd9a-1647-426b-8ba9-426dd217c0e9 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1513 microversion: 2.1 time: 0.159759 Aug 23 18:49:42.901761 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3697/7260] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:42 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:43.922903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ae528e33-4b63-4188-9963-a15b4255f9a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:43.924225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ae528e33-4b63-4188-9963-a15b4255f9a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:43.929865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=30 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:43.932971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae528e33-4b63-4188-9963-a15b4255f9a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:43.933914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae528e33-4b63-4188-9963-a15b4255f9a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:43.936060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae528e33-4b63-4188-9963-a15b4255f9a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:43.937035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae528e33-4b63-4188-9963-a15b4255f9a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:43.937692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae528e33-4b63-4188-9963-a15b4255f9a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:43.938320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae528e33-4b63-4188-9963-a15b4255f9a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:44.105260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ae528e33-4b63-4188-9963-a15b4255f9a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:44.114862 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ae528e33-4b63-4188-9963-a15b4255f9a4 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1513 microversion: 2.1 time: 0.197146 Aug 23 18:49:44.115571 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3564/7261] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:43 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1513 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:45.136522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-78137b06-a33b-43a3-a73c-62fc8ad90281 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:45.137154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-78137b06-a33b-43a3-a73c-62fc8ad90281 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:45.143973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78137b06-a33b-43a3-a73c-62fc8ad90281 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:45.144473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78137b06-a33b-43a3-a73c-62fc8ad90281 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:45.144927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78137b06-a33b-43a3-a73c-62fc8ad90281 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:45.145640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78137b06-a33b-43a3-a73c-62fc8ad90281 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:45.146113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78137b06-a33b-43a3-a73c-62fc8ad90281 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:45.146581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-78137b06-a33b-43a3-a73c-62fc8ad90281 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:45.280692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-78137b06-a33b-43a3-a73c-62fc8ad90281 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:45.288419 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-78137b06-a33b-43a3-a73c-62fc8ad90281 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1505 microversion: 2.1 time: 0.156476 Aug 23 18:49:45.288997 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3698/7262] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:45 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1505 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:45.308971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dbeded72-9087-4d19-8fdc-1910831c9d95 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:45.309592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dbeded72-9087-4d19-8fdc-1910831c9d95 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:45.316662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbeded72-9087-4d19-8fdc-1910831c9d95 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:45.317148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbeded72-9087-4d19-8fdc-1910831c9d95 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:45.317593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbeded72-9087-4d19-8fdc-1910831c9d95 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:45.318290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbeded72-9087-4d19-8fdc-1910831c9d95 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:45.318777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbeded72-9087-4d19-8fdc-1910831c9d95 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:45.319208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dbeded72-9087-4d19-8fdc-1910831c9d95 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:45.452259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dbeded72-9087-4d19-8fdc-1910831c9d95 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:45.460135 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dbeded72-9087-4d19-8fdc-1910831c9d95 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1505 microversion: 2.1 time: 0.155604 Aug 23 18:49:45.460716 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3565/7263] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:45 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1505 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:45.482004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-64bdc307-971d-4653-9319-fce919c2732d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:45.482582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-64bdc307-971d-4653-9319-fce919c2732d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:45.488599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64bdc307-971d-4653-9319-fce919c2732d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:45.489096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64bdc307-971d-4653-9319-fce919c2732d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:45.489544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64bdc307-971d-4653-9319-fce919c2732d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:45.490249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64bdc307-971d-4653-9319-fce919c2732d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:45.490752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64bdc307-971d-4653-9319-fce919c2732d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:45.491190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-64bdc307-971d-4653-9319-fce919c2732d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:45.618812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-64bdc307-971d-4653-9319-fce919c2732d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:45.626584 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-64bdc307-971d-4653-9319-fce919c2732d tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1505 microversion: 2.1 time: 0.148589 Aug 23 18:49:45.627158 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3699/7264] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:45 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1505 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:45.646671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9b27ab22-d974-4afa-9cb8-389b4e92d4f7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:45.647175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9b27ab22-d974-4afa-9cb8-389b4e92d4f7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:45.653960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b27ab22-d974-4afa-9cb8-389b4e92d4f7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:45.654444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b27ab22-d974-4afa-9cb8-389b4e92d4f7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:45.654950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b27ab22-d974-4afa-9cb8-389b4e92d4f7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:45.655646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b27ab22-d974-4afa-9cb8-389b4e92d4f7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:45.656108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b27ab22-d974-4afa-9cb8-389b4e92d4f7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:45.656538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b27ab22-d974-4afa-9cb8-389b4e92d4f7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:45.681383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9b27ab22-d974-4afa-9cb8-389b4e92d4f7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:49:45.756324 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9b27ab22-d974-4afa-9cb8-389b4e92d4f7 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "DELETE /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 204 len: 0 microversion: 2.1 time: 0.113197 Aug 23 18:49:45.756944 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3566/7265] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:49:45 2022] DELETE /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:49:45.772584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eeeab443-81b2-4131-a5b9-4a45b27c00c6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:45.772584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eeeab443-81b2-4131-a5b9-4a45b27c00c6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:45.779273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eeeab443-81b2-4131-a5b9-4a45b27c00c6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:45.779777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eeeab443-81b2-4131-a5b9-4a45b27c00c6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:45.780242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eeeab443-81b2-4131-a5b9-4a45b27c00c6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:45.780957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eeeab443-81b2-4131-a5b9-4a45b27c00c6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:45.781426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eeeab443-81b2-4131-a5b9-4a45b27c00c6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:45.781867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eeeab443-81b2-4131-a5b9-4a45b27c00c6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:45.806933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eeeab443-81b2-4131-a5b9-4a45b27c00c6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:49:45.856037 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.compute.api [None req-eeeab443-81b2-4131-a5b9-4a45b27c00c6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Instance is already in deleting state, ignoring this request Aug 23 18:49:45.856886 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eeeab443-81b2-4131-a5b9-4a45b27c00c6 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "DELETE /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 204 len: 0 microversion: 2.1 time: 0.089278 Aug 23 18:49:45.857457 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3700/7266] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:49:45 2022] DELETE /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:49:45.866036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d8e27fbe-5c77-4120-8754-c628e73b9a6e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:45.866770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d8e27fbe-5c77-4120-8754-c628e73b9a6e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:45.874642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8e27fbe-5c77-4120-8754-c628e73b9a6e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:45.875119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8e27fbe-5c77-4120-8754-c628e73b9a6e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:45.875561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8e27fbe-5c77-4120-8754-c628e73b9a6e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:45.876265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8e27fbe-5c77-4120-8754-c628e73b9a6e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:45.876723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8e27fbe-5c77-4120-8754-c628e73b9a6e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:45.877150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8e27fbe-5c77-4120-8754-c628e73b9a6e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:46.017128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d8e27fbe-5c77-4120-8754-c628e73b9a6e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:46.025550 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d8e27fbe-5c77-4120-8754-c628e73b9a6e tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1511 microversion: 2.1 time: 0.163785 Aug 23 18:49:46.026126 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3567/7267] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:45 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1511 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:49:46.036255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-e2907698-90df-4faf-b9f6-e58421d06a99 req-d0373c02-d823-4fb9-810f-eba69f946f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db46fe09-029c-447e-a19b-67540d5246e8", "name": "network-vif-plugged", "status": "completed", "tag": "98ba1ead-9ffe-40a2-8a9a-ebdf636365dc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:49:46.046676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e2907698-90df-4faf-b9f6-e58421d06a99 req-d0373c02-d823-4fb9-810f-eba69f946f33 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:46.047179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e2907698-90df-4faf-b9f6-e58421d06a99 req-d0373c02-d823-4fb9-810f-eba69f946f33 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:46.047608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e2907698-90df-4faf-b9f6-e58421d06a99 req-d0373c02-d823-4fb9-810f-eba69f946f33 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:46.058323 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-e2907698-90df-4faf-b9f6-e58421d06a99 req-d0373c02-d823-4fb9-810f-eba69f946f33 service nova] Creating event network-vif-plugged:98ba1ead-9ffe-40a2-8a9a-ebdf636365dc for instance db46fe09-029c-447e-a19b-67540d5246e8 on n-h2-850468-16 Aug 23 18:49:46.063238 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-e2907698-90df-4faf-b9f6-e58421d06a99 req-d0373c02-d823-4fb9-810f-eba69f946f33 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086640 Aug 23 18:49:46.063817 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3701/7268] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:49:47.045875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86bc90a4-3275-446e-9483-62da4decc6fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:47.046492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-86bc90a4-3275-446e-9483-62da4decc6fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:47.053369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86bc90a4-3275-446e-9483-62da4decc6fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:47.053856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86bc90a4-3275-446e-9483-62da4decc6fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:47.054293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86bc90a4-3275-446e-9483-62da4decc6fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:47.055543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86bc90a4-3275-446e-9483-62da4decc6fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:47.056012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86bc90a4-3275-446e-9483-62da4decc6fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:47.056551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86bc90a4-3275-446e-9483-62da4decc6fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:47.192189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-86bc90a4-3275-446e-9483-62da4decc6fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7931ea2803147adb121fefdfcd189b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '913cf53eec1347568188b18338680766', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:49:47.200849 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-86bc90a4-3275-446e-9483-62da4decc6fe tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 200 len: 1511 microversion: 2.1 time: 0.158849 Aug 23 18:49:47.201444 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3568/7269] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:47 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 1511 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:49:47.672772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-972b80bb-fa91-4917-af9c-14b73b31cf0f req-225dd195-e2ce-40f6-972e-f0adc55a41b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db46fe09-029c-447e-a19b-67540d5246e8", "name": "network-vif-deleted", "tag": "98ba1ead-9ffe-40a2-8a9a-ebdf636365dc"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:49:47.677970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=34 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:47.685248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-972b80bb-fa91-4917-af9c-14b73b31cf0f req-225dd195-e2ce-40f6-972e-f0adc55a41b3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:47.685745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-972b80bb-fa91-4917-af9c-14b73b31cf0f req-225dd195-e2ce-40f6-972e-f0adc55a41b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:47.686199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-972b80bb-fa91-4917-af9c-14b73b31cf0f req-225dd195-e2ce-40f6-972e-f0adc55a41b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:47.700111 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-972b80bb-fa91-4917-af9c-14b73b31cf0f req-225dd195-e2ce-40f6-972e-f0adc55a41b3 service nova] Creating event network-vif-deleted:98ba1ead-9ffe-40a2-8a9a-ebdf636365dc for instance db46fe09-029c-447e-a19b-67540d5246e8 on n-h2-850468-16 Aug 23 18:49:47.705490 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-972b80bb-fa91-4917-af9c-14b73b31cf0f req-225dd195-e2ce-40f6-972e-f0adc55a41b3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037600 Aug 23 18:49:47.709502 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3702/7270] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:49:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:49:48.222324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e2afb9d3-d10d-43a6-bca7-4e820e98cb15 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:48.222997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e2afb9d3-d10d-43a6-bca7-4e820e98cb15 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: db46fe09-029c-447e-a19b-67540d5246e8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:48.230388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2afb9d3-d10d-43a6-bca7-4e820e98cb15 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:48.230912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2afb9d3-d10d-43a6-bca7-4e820e98cb15 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:48.231356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2afb9d3-d10d-43a6-bca7-4e820e98cb15 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:48.232055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2afb9d3-d10d-43a6-bca7-4e820e98cb15 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:48.232513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2afb9d3-d10d-43a6-bca7-4e820e98cb15 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:48.232944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2afb9d3-d10d-43a6-bca7-4e820e98cb15 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:48.247034 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-e2afb9d3-d10d-43a6-bca7-4e820e98cb15 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] HTTP exception thrown: Instance db46fe09-029c-447e-a19b-67540d5246e8 could not be found. Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e2afb9d3-d10d-43a6-bca7-4e820e98cb15 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Request method failure captured: Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 HTTP/1.1 Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSDlhTRNyFtj3hSkj2FSbyiiNyTU2k_aP7q9cSIppkMmstV866EEW9kyQ_njts5Qt5LJkAwWCEnmoIoviOk3tR1lZjV5K3E1dm3f3bAVXTopmZKMZHihzbBp1zW0BGuLdRd9OfRiBb2J7JKpiPwSGeHwcaB2ZdYgpg8zN1gxUFYBdRc Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 913cf53eec1347568188b18338680766 Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1815058672 Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_913cf53eec1347568188b18338680766"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/913cf53eec1347568188b18338680766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/913cf53eec1347568188b18338680766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/913cf53eec1347568188b18338680766"}]}] Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerDiskConfigTestJSON-1815058672 Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 913cf53eec1347568188b18338680766 Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1815058672 Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerDiskConfigTestJSON-1815058672-project Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: e7931ea2803147adb121fefdfcd189b2 Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerDiskConfigTestJSON-1815058672-project Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance db46fe09-029c-447e-a19b-67540d5246e8 could not be found. Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'db46fe09-029c-447e-a19b-67540d5246e8'} Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db46fe09-029c-447e-a19b-67540d5246e8 could not be found. Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db46fe09-029c-447e-a19b-67540d5246e8 could not be found. Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:49:48.248703 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.252967 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:49:48.252967 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:49:48.252967 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:49:48.252967 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:49:48.252967 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:49:48.252967 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db46fe09-029c-447e-a19b-67540d5246e8 could not be found. Aug 23 18:49:48.252967 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.252967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e2afb9d3-d10d-43a6-bca7-4e820e98cb15 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Returning 404 to user: Instance db46fe09-029c-447e-a19b-67540d5246e8 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:49:48.252967 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e2afb9d3-d10d-43a6-bca7-4e820e98cb15 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8" status: 404 len: 111 microversion: 2.1 time: 0.031746 Aug 23 18:49:48.252967 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3569/7271] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:48 2022] GET /compute/v2.1/servers/db46fe09-029c-447e-a19b-67540d5246e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:49:48.259772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1fc6360a-4985-4baa-84f6-a6534075a0a1 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '.version_select at 0x7f27dc3f2e50>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:48.280405 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1fc6360a-4985-4baa-84f6-a6534075a0a1 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-906590861" status: 202 len: 0 microversion: 2.1 time: 0.024924 Aug 23 18:49:48.280982 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3703/7272] 10.222.0.61 () {58 vars in 1218 bytes} [Tue Aug 23 18:49:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-906590861 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:49:48.909915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f869b503-c180-421a-84c2-9814ac38d642 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:48.910422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f869b503-c180-421a-84c2-9814ac38d642 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:48.919246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f869b503-c180-421a-84c2-9814ac38d642 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:48.919751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f869b503-c180-421a-84c2-9814ac38d642 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:48.920199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f869b503-c180-421a-84c2-9814ac38d642 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:48.920920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f869b503-c180-421a-84c2-9814ac38d642 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:48.921384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f869b503-c180-421a-84c2-9814ac38d642 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:48.921811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f869b503-c180-421a-84c2-9814ac38d642 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:48.937325 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-f869b503-c180-421a-84c2-9814ac38d642 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] HTTP exception thrown: Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed could not be found. Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f869b503-c180-421a-84c2-9814ac38d642 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Request method failure captured: Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed HTTP/1.1 Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSDlhTRNyFtj3hSkj2FSbyiiNyTU2k_aP7q9cSIppkMmstV866EEW9kyQ_njts5Qt5LJkAwWCEnmoIoviOk3tR1lZjV5K3E1dm3f3bAVXTopmZKMZHihzbBp1zW0BGuLdRd9OfRiBb2J7JKpiPwSGeHwcaB2ZdYgpg8zN1gxUFYBdRc Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 913cf53eec1347568188b18338680766 Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1815058672 Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_913cf53eec1347568188b18338680766"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/913cf53eec1347568188b18338680766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/913cf53eec1347568188b18338680766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/913cf53eec1347568188b18338680766"}]}] Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerDiskConfigTestJSON-1815058672 Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 913cf53eec1347568188b18338680766 Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1815058672 Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerDiskConfigTestJSON-1815058672-project Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: e7931ea2803147adb121fefdfcd189b2 Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerDiskConfigTestJSON-1815058672-project Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed could not be found. Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '22137238-7b55-4edf-b87e-3879ecdfd7ed'} Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed could not be found. Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:49:48.938937 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed could not be found. Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed could not be found. Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f869b503-c180-421a-84c2-9814ac38d642 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Returning 404 to user: Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f869b503-c180-421a-84c2-9814ac38d642 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "DELETE /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 404 len: 111 microversion: 2.1 time: 0.034369 Aug 23 18:49:48.943087 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3570/7273] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:49:48 2022] DELETE /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:49:48.950053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1a53f35a-6893-4bd9-a72f-7ca2c6db0ff0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:48.950842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1a53f35a-6893-4bd9-a72f-7ca2c6db0ff0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] [instance: 22137238-7b55-4edf-b87e-3879ecdfd7ed] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:48.957604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a53f35a-6893-4bd9-a72f-7ca2c6db0ff0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:48.958102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a53f35a-6893-4bd9-a72f-7ca2c6db0ff0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:48.958566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a53f35a-6893-4bd9-a72f-7ca2c6db0ff0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:48.959283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a53f35a-6893-4bd9-a72f-7ca2c6db0ff0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:48.959747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a53f35a-6893-4bd9-a72f-7ca2c6db0ff0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:48.960182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1a53f35a-6893-4bd9-a72f-7ca2c6db0ff0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:48.974947 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-1a53f35a-6893-4bd9-a72f-7ca2c6db0ff0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] HTTP exception thrown: Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed could not be found. Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1a53f35a-6893-4bd9-a72f-7ca2c6db0ff0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Request method failure captured: Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed HTTP/1.1 Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSDlhTRNyFtj3hSkj2FSbyiiNyTU2k_aP7q9cSIppkMmstV866EEW9kyQ_njts5Qt5LJkAwWCEnmoIoviOk3tR1lZjV5K3E1dm3f3bAVXTopmZKMZHihzbBp1zW0BGuLdRd9OfRiBb2J7JKpiPwSGeHwcaB2ZdYgpg8zN1gxUFYBdRc Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 913cf53eec1347568188b18338680766 Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1815058672 Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_913cf53eec1347568188b18338680766"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/913cf53eec1347568188b18338680766"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/913cf53eec1347568188b18338680766"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/913cf53eec1347568188b18338680766"}]}] Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerDiskConfigTestJSON-1815058672 Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 913cf53eec1347568188b18338680766 Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1815058672 Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerDiskConfigTestJSON-1815058672-project Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: e7931ea2803147adb121fefdfcd189b2 Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerDiskConfigTestJSON-1815058672-project Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed could not be found. Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '22137238-7b55-4edf-b87e-3879ecdfd7ed'} Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed could not be found. Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed could not be found. Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:49:48.976579 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.980913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:49:48.980913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:49:48.980913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:49:48.980913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:49:48.980913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:49:48.980913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed could not be found. Aug 23 18:49:48.980913 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:49:48.980913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1a53f35a-6893-4bd9-a72f-7ca2c6db0ff0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] Returning 404 to user: Instance 22137238-7b55-4edf-b87e-3879ecdfd7ed could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:49:48.980913 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1a53f35a-6893-4bd9-a72f-7ca2c6db0ff0 tempest-ServerDiskConfigTestJSON-1815058672 tempest-ServerDiskConfigTestJSON-1815058672-project] 10.222.0.61 "GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed" status: 404 len: 111 microversion: 2.1 time: 0.033494 Aug 23 18:49:48.980913 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3704/7274] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:48 2022] GET /compute/v2.1/servers/22137238-7b55-4edf-b87e-3879ecdfd7ed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:49:57.812315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ab3e988b-77d3-4a91-bc85-b323ac7e33bd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'create', calling method: .version_select at 0x7f27ec8283a0>, body: {"keypair": {"name": "tempest-keypair-1650899182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMdFIBlfdwjbOzjBNbJuZmtSXxQj/K5YNCgeSwnHwvYk6t/wcg7RpBXGAVOswc4QwQdtEmeeUEtD+Y8RkUQckKlpz3Hme7aVGyE/OV4cLyQc8P6W/irgxbKOoucNAF4wYA=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:49:57.832892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-ab3e988b-77d3-4a91-bc85-b323ac7e33bd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:49:57.839524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-ab3e988b-77d3-4a91-bc85-b323ac7e33bd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for user b1b1944b15d547e4b68df40cb65a74a6 and project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:49:57.871184 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ab3e988b-77d3-4a91-bc85-b323ac7e33bd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.183601 Aug 23 18:49:57.871782 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3571/7275] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:49:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:49:59.219446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1066321414", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3617bced-c0f9-4fd5-b74f-8bf14b45f3c8"}], "security_groups": [{"name": "tempest-securitygroup--974773066"}], "key_name": "tempest-keypair-1650899182", "user_data": "}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:49:59.230374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=6,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:59.232062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:49:59.350857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] validate_networks() for [('3617bced-c0f9-4fd5-b74f-8bf14b45f3c8', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:49:59.822400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:49:59.822970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:49:59.823676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:49:59.824187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:49:59.824730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:49:59.836739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:59.837690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:59.838654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:59.839878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:49:59.840943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:49:59.841894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:49:59.860533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:49:59.866041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for user b1b1944b15d547e4b68df40cb65a74a6 and project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:49:59.881760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:49:59.884930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:49:59.942789 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-45b4e722-8f42-42ed-b5df-c2cf1ceb9512 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.728030 Aug 23 18:49:59.943362 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3705/7276] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:49:59 2022] POST /compute/v2.1/servers => generated 408 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:49:59.954410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-26faa1c7-6cfc-4230-9ba7-173412907c11 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:49:59.955382 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-26faa1c7-6cfc-4230-9ba7-173412907c11 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:49:59.962689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:50:00.042356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-26faa1c7-6cfc-4230-9ba7-173412907c11 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:50:00.051039 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-26faa1c7-6cfc-4230-9ba7-173412907c11 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1239 microversion: 2.1 time: 0.100494 Aug 23 18:50:00.051625 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3572/7277] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:49:59 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1239 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:50:01.075003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d05a5e73-aaf2-40a0-b431-d6875b4f43d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:50:01.075968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d05a5e73-aaf2-40a0-b431-d6875b4f43d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:50:01.085522 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d05a5e73-aaf2-40a0-b431-d6875b4f43d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:01.087184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d05a5e73-aaf2-40a0-b431-d6875b4f43d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:01.087881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d05a5e73-aaf2-40a0-b431-d6875b4f43d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:01.089093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d05a5e73-aaf2-40a0-b431-d6875b4f43d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:01.089727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d05a5e73-aaf2-40a0-b431-d6875b4f43d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:01.090667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d05a5e73-aaf2-40a0-b431-d6875b4f43d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:01.165582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d05a5e73-aaf2-40a0-b431-d6875b4f43d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:50:01.173674 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d05a5e73-aaf2-40a0-b431-d6875b4f43d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1299 microversion: 2.1 time: 0.105455 Aug 23 18:50:01.174330 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3706/7278] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:50:01 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1299 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:50:02.194704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b654065f-24cf-4317-ac95-a536a2c07917 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:50:02.195920 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b654065f-24cf-4317-ac95-a536a2c07917 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:50:02.202994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b654065f-24cf-4317-ac95-a536a2c07917 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:02.203481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b654065f-24cf-4317-ac95-a536a2c07917 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:02.203925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b654065f-24cf-4317-ac95-a536a2c07917 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:02.204628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b654065f-24cf-4317-ac95-a536a2c07917 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:02.205090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b654065f-24cf-4317-ac95-a536a2c07917 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:02.205519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b654065f-24cf-4317-ac95-a536a2c07917 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:02.434211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b654065f-24cf-4317-ac95-a536a2c07917 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:50:02.441896 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b654065f-24cf-4317-ac95-a536a2c07917 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1364 microversion: 2.1 time: 0.251185 Aug 23 18:50:02.442472 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3573/7279] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:50:02 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:50:02.680434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-1c762f5e-f903-444d-9831-048e04090afd req-6cc0d720-5305-462e-bf2f-0ca3f57e3b01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7abc616-30c6-4600-bd6b-744387339865", "tag": "57032415-20c8-4fb5-94cf-11e7c480a19b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:50:02.689960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1c762f5e-f903-444d-9831-048e04090afd req-6cc0d720-5305-462e-bf2f-0ca3f57e3b01 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:02.690773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1c762f5e-f903-444d-9831-048e04090afd req-6cc0d720-5305-462e-bf2f-0ca3f57e3b01 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:02.691219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-1c762f5e-f903-444d-9831-048e04090afd req-6cc0d720-5305-462e-bf2f-0ca3f57e3b01 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:02.704778 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-1c762f5e-f903-444d-9831-048e04090afd req-6cc0d720-5305-462e-bf2f-0ca3f57e3b01 service nova] Creating event network-changed:57032415-20c8-4fb5-94cf-11e7c480a19b for instance d7abc616-30c6-4600-bd6b-744387339865 on n-h1-850468-16 Aug 23 18:50:02.710156 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-1c762f5e-f903-444d-9831-048e04090afd req-6cc0d720-5305-462e-bf2f-0ca3f57e3b01 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103537 Aug 23 18:50:02.710930 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3707/7280] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:50:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:50:03.463755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77a0bd09-2e85-4917-a112-a2871ee6118f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:50:03.464372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-77a0bd09-2e85-4917-a112-a2871ee6118f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:50:03.471525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77a0bd09-2e85-4917-a112-a2871ee6118f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:03.472010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77a0bd09-2e85-4917-a112-a2871ee6118f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:03.472454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77a0bd09-2e85-4917-a112-a2871ee6118f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:03.473151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77a0bd09-2e85-4917-a112-a2871ee6118f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:03.473608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77a0bd09-2e85-4917-a112-a2871ee6118f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:03.474037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77a0bd09-2e85-4917-a112-a2871ee6118f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:03.612127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-77a0bd09-2e85-4917-a112-a2871ee6118f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:50:03.621905 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-77a0bd09-2e85-4917-a112-a2871ee6118f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1364 microversion: 2.1 time: 0.162601 Aug 23 18:50:03.622484 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3574/7281] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:50:03 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:50:04.644702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-11acdb84-842a-44a8-9634-793b60ce6e61 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:50:04.645450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-11acdb84-842a-44a8-9634-793b60ce6e61 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:50:04.651870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11acdb84-842a-44a8-9634-793b60ce6e61 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:04.652368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11acdb84-842a-44a8-9634-793b60ce6e61 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:04.652820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11acdb84-842a-44a8-9634-793b60ce6e61 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:04.653523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11acdb84-842a-44a8-9634-793b60ce6e61 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:04.653990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11acdb84-842a-44a8-9634-793b60ce6e61 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:04.654426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11acdb84-842a-44a8-9634-793b60ce6e61 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:04.793728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-11acdb84-842a-44a8-9634-793b60ce6e61 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:50:04.801588 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-11acdb84-842a-44a8-9634-793b60ce6e61 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1364 microversion: 2.1 time: 0.162027 Aug 23 18:50:04.802150 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3708/7282] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:50:04 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:50:05.823256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-62d3bd8b-7f98-4429-9e4b-cec29043da2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:50:05.823783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-62d3bd8b-7f98-4429-9e4b-cec29043da2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:50:05.830676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62d3bd8b-7f98-4429-9e4b-cec29043da2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:05.831164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62d3bd8b-7f98-4429-9e4b-cec29043da2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:05.831610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62d3bd8b-7f98-4429-9e4b-cec29043da2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:05.832313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62d3bd8b-7f98-4429-9e4b-cec29043da2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:05.832769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62d3bd8b-7f98-4429-9e4b-cec29043da2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:05.833205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-62d3bd8b-7f98-4429-9e4b-cec29043da2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:05.970987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-62d3bd8b-7f98-4429-9e4b-cec29043da2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:50:05.979516 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-62d3bd8b-7f98-4429-9e4b-cec29043da2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1364 microversion: 2.1 time: 0.161071 Aug 23 18:50:05.980103 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3575/7283] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:50:05 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:50:07.001725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6b8ec93-696c-4d7e-8cc9-db4403cd5d7b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:50:07.002343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6b8ec93-696c-4d7e-8cc9-db4403cd5d7b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:50:07.010145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6b8ec93-696c-4d7e-8cc9-db4403cd5d7b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:07.010674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6b8ec93-696c-4d7e-8cc9-db4403cd5d7b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:07.011126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6b8ec93-696c-4d7e-8cc9-db4403cd5d7b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:07.011840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6b8ec93-696c-4d7e-8cc9-db4403cd5d7b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:07.012303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6b8ec93-696c-4d7e-8cc9-db4403cd5d7b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:07.012737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6b8ec93-696c-4d7e-8cc9-db4403cd5d7b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:07.151062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6b8ec93-696c-4d7e-8cc9-db4403cd5d7b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:50:07.159783 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6b8ec93-696c-4d7e-8cc9-db4403cd5d7b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1364 microversion: 2.1 time: 0.162322 Aug 23 18:50:07.160594 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3709/7284] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:50:06 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:50:08.182280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b37ca09d-2c48-43e9-9f73-b243ef7c9af8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:50:08.182930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b37ca09d-2c48-43e9-9f73-b243ef7c9af8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:50:08.189958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b37ca09d-2c48-43e9-9f73-b243ef7c9af8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:08.190456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b37ca09d-2c48-43e9-9f73-b243ef7c9af8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:08.191057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b37ca09d-2c48-43e9-9f73-b243ef7c9af8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:08.191768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b37ca09d-2c48-43e9-9f73-b243ef7c9af8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:08.192232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b37ca09d-2c48-43e9-9f73-b243ef7c9af8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:08.192662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b37ca09d-2c48-43e9-9f73-b243ef7c9af8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:08.326692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b37ca09d-2c48-43e9-9f73-b243ef7c9af8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:50:08.334322 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b37ca09d-2c48-43e9-9f73-b243ef7c9af8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1364 microversion: 2.1 time: 0.156214 Aug 23 18:50:08.334922 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3576/7285] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:50:08 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:50:08.511622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-df16fd2e-cc1e-4644-86d8-c1a4577b008a req-c0f4a48b-ae54-4953-bed4-06784ca43601 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7abc616-30c6-4600-bd6b-744387339865", "name": "network-vif-plugged", "status": "completed", "tag": "57032415-20c8-4fb5-94cf-11e7c480a19b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:50:08.522667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-df16fd2e-cc1e-4644-86d8-c1a4577b008a req-c0f4a48b-ae54-4953-bed4-06784ca43601 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:08.523320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-df16fd2e-cc1e-4644-86d8-c1a4577b008a req-c0f4a48b-ae54-4953-bed4-06784ca43601 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:08.524073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-df16fd2e-cc1e-4644-86d8-c1a4577b008a req-c0f4a48b-ae54-4953-bed4-06784ca43601 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:08.535318 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-df16fd2e-cc1e-4644-86d8-c1a4577b008a req-c0f4a48b-ae54-4953-bed4-06784ca43601 service nova] Creating event network-vif-plugged:57032415-20c8-4fb5-94cf-11e7c480a19b for instance d7abc616-30c6-4600-bd6b-744387339865 on n-h1-850468-16 Aug 23 18:50:08.540464 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-df16fd2e-cc1e-4644-86d8-c1a4577b008a req-c0f4a48b-ae54-4953-bed4-06784ca43601 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033440 Aug 23 18:50:08.541267 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3710/7286] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:50:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:50:09.355930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a90a251d-4398-4a0e-aee1-935d0f3c55c5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:50:09.356537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a90a251d-4398-4a0e-aee1-935d0f3c55c5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:50:09.363396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a90a251d-4398-4a0e-aee1-935d0f3c55c5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:09.363885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a90a251d-4398-4a0e-aee1-935d0f3c55c5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:09.364325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a90a251d-4398-4a0e-aee1-935d0f3c55c5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:09.365020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a90a251d-4398-4a0e-aee1-935d0f3c55c5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:09.365477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a90a251d-4398-4a0e-aee1-935d0f3c55c5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:09.365906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a90a251d-4398-4a0e-aee1-935d0f3c55c5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:09.500700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a90a251d-4398-4a0e-aee1-935d0f3c55c5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:50:09.508984 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a90a251d-4398-4a0e-aee1-935d0f3c55c5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1364 microversion: 2.1 time: 0.157113 Aug 23 18:50:09.509554 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3577/7287] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:50:09 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:50:10.527938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:50:10.528735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:50:10.532899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-75deb2d6-2e3d-45ff-83d9-a6f30ef83c21 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:50:10.533621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-75deb2d6-2e3d-45ff-83d9-a6f30ef83c21 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:50:10.541518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75deb2d6-2e3d-45ff-83d9-a6f30ef83c21 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:10.542012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75deb2d6-2e3d-45ff-83d9-a6f30ef83c21 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:10.542460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75deb2d6-2e3d-45ff-83d9-a6f30ef83c21 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:10.543188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75deb2d6-2e3d-45ff-83d9-a6f30ef83c21 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:10.543656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75deb2d6-2e3d-45ff-83d9-a6f30ef83c21 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:10.544093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-75deb2d6-2e3d-45ff-83d9-a6f30ef83c21 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:10.676012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-75deb2d6-2e3d-45ff-83d9-a6f30ef83c21 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:50:10.684396 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-75deb2d6-2e3d-45ff-83d9-a6f30ef83c21 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1552 microversion: 2.1 time: 0.158263 Aug 23 18:50:10.684970 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3711/7288] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:50:10 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:50:10.704467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-58e705bb-6ce3-44f8-b9b9-2c711fd95048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:50:10.705032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-58e705bb-6ce3-44f8-b9b9-2c711fd95048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:50:10.706923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:50:10.713283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58e705bb-6ce3-44f8-b9b9-2c711fd95048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:10.713779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58e705bb-6ce3-44f8-b9b9-2c711fd95048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:10.714225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58e705bb-6ce3-44f8-b9b9-2c711fd95048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:10.714960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58e705bb-6ce3-44f8-b9b9-2c711fd95048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:10.715690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58e705bb-6ce3-44f8-b9b9-2c711fd95048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:10.716125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-58e705bb-6ce3-44f8-b9b9-2c711fd95048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:10.796052 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-58e705bb-6ce3-44f8-b9b9-2c711fd95048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095416 Aug 23 18:50:10.796644 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3578/7289] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:50:10 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:50:11.720904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3a35ae1f-437a-4dc8-ad1d-944e033d04c4 req-dad14999-7102-4b4e-afd1-3cbe9b1bd091 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7abc616-30c6-4600-bd6b-744387339865", "tag": "57032415-20c8-4fb5-94cf-11e7c480a19b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:50:11.732665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3a35ae1f-437a-4dc8-ad1d-944e033d04c4 req-dad14999-7102-4b4e-afd1-3cbe9b1bd091 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:50:11.733430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3a35ae1f-437a-4dc8-ad1d-944e033d04c4 req-dad14999-7102-4b4e-afd1-3cbe9b1bd091 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:50:11.733871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3a35ae1f-437a-4dc8-ad1d-944e033d04c4 req-dad14999-7102-4b4e-afd1-3cbe9b1bd091 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:50:11.745538 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3a35ae1f-437a-4dc8-ad1d-944e033d04c4 req-dad14999-7102-4b4e-afd1-3cbe9b1bd091 service nova] Creating event network-changed:57032415-20c8-4fb5-94cf-11e7c480a19b for instance d7abc616-30c6-4600-bd6b-744387339865 on n-h1-850468-16 Aug 23 18:50:11.750421 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3a35ae1f-437a-4dc8-ad1d-944e033d04c4 req-dad14999-7102-4b4e-afd1-3cbe9b1bd091 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033540 Aug 23 18:50:11.751124 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3712/7290] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:51:01.870742 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:51:01.871311 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 18:51:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:51:26.836001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:51:26.837484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=34 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:51:26.843706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fe63cca0-ad0d-47d9-af3f-2a7e6cd7befa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:26.844538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe63cca0-ad0d-47d9-af3f-2a7e6cd7befa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:26.857048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe63cca0-ad0d-47d9-af3f-2a7e6cd7befa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:26.857719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe63cca0-ad0d-47d9-af3f-2a7e6cd7befa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:26.858167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe63cca0-ad0d-47d9-af3f-2a7e6cd7befa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:26.858936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe63cca0-ad0d-47d9-af3f-2a7e6cd7befa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:26.859407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe63cca0-ad0d-47d9-af3f-2a7e6cd7befa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:26.859846 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe63cca0-ad0d-47d9-af3f-2a7e6cd7befa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:27.003874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fe63cca0-ad0d-47d9-af3f-2a7e6cd7befa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:27.012306 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fe63cca0-ad0d-47d9-af3f-2a7e6cd7befa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1670 microversion: 2.1 time: 0.179553 Aug 23 18:51:27.012870 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3579/7291] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:26 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1670 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:27.030955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:51:27.031714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=32 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:51:27.036051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a4c6b01d-e9e7-40a2-92c6-557b530e8567 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:27.036793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a4c6b01d-e9e7-40a2-92c6-557b530e8567 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:27.046997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4c6b01d-e9e7-40a2-92c6-557b530e8567 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:27.047501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4c6b01d-e9e7-40a2-92c6-557b530e8567 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:27.047951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4c6b01d-e9e7-40a2-92c6-557b530e8567 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:27.048663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4c6b01d-e9e7-40a2-92c6-557b530e8567 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:27.049131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4c6b01d-e9e7-40a2-92c6-557b530e8567 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:27.049572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4c6b01d-e9e7-40a2-92c6-557b530e8567 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:27.192441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a4c6b01d-e9e7-40a2-92c6-557b530e8567 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:27.200796 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a4c6b01d-e9e7-40a2-92c6-557b530e8567 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1670 microversion: 2.1 time: 0.172480 Aug 23 18:51:27.201299 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3713/7292] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:27 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1670 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:27.221015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-05cb2f4a-c40f-4cba-a1a5-8afbe00ea8f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:27.221632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-05cb2f4a-c40f-4cba-a1a5-8afbe00ea8f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:27.230852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05cb2f4a-c40f-4cba-a1a5-8afbe00ea8f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:27.231341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05cb2f4a-c40f-4cba-a1a5-8afbe00ea8f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:27.231783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05cb2f4a-c40f-4cba-a1a5-8afbe00ea8f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:27.232482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05cb2f4a-c40f-4cba-a1a5-8afbe00ea8f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:27.232938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05cb2f4a-c40f-4cba-a1a5-8afbe00ea8f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:27.233369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05cb2f4a-c40f-4cba-a1a5-8afbe00ea8f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:27.371443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-05cb2f4a-c40f-4cba-a1a5-8afbe00ea8f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:27.379318 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-05cb2f4a-c40f-4cba-a1a5-8afbe00ea8f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1670 microversion: 2.1 time: 0.162146 Aug 23 18:51:27.379894 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3580/7293] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:27 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1670 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:27.399383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:51:27.401600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:27.409882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:27.410388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:27.410878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:27.411591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:27.412067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:27.412510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:27.441367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:27.448057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Old instance type m1.heat2, new instance type m1.heat {{(pid=128808) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 18:51:27.454756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:51:27.455138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:51:27.455632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:51:27.456061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:51:27.456510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:51:27.523070 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8e4c8aae-9807-44c3-bb0d-eb9dd7b14529 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865/action" status: 202 len: 0 microversion: 2.1 time: 0.127481 Aug 23 18:51:27.523672 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3714/7294] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:51:27 2022] POST /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:51:27.532671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-428de5b0-5ee1-4466-b5ae-4a95e9f460a2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:27.533399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-428de5b0-5ee1-4466-b5ae-4a95e9f460a2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:27.539740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-428de5b0-5ee1-4466-b5ae-4a95e9f460a2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:27.540662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-428de5b0-5ee1-4466-b5ae-4a95e9f460a2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:27.541166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-428de5b0-5ee1-4466-b5ae-4a95e9f460a2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:27.541935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-428de5b0-5ee1-4466-b5ae-4a95e9f460a2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:27.542444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-428de5b0-5ee1-4466-b5ae-4a95e9f460a2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:27.543473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-428de5b0-5ee1-4466-b5ae-4a95e9f460a2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:27.685479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-428de5b0-5ee1-4466-b5ae-4a95e9f460a2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:27.693694 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-428de5b0-5ee1-4466-b5ae-4a95e9f460a2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1679 microversion: 2.1 time: 0.165104 Aug 23 18:51:27.694698 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3581/7295] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:27 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:28.716364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-80a2291f-d268-4f65-a1fb-948833338594 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:28.716992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-80a2291f-d268-4f65-a1fb-948833338594 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:28.723974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80a2291f-d268-4f65-a1fb-948833338594 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:28.724465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80a2291f-d268-4f65-a1fb-948833338594 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:28.724939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80a2291f-d268-4f65-a1fb-948833338594 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:28.725644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80a2291f-d268-4f65-a1fb-948833338594 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:28.726107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80a2291f-d268-4f65-a1fb-948833338594 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:28.726561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80a2291f-d268-4f65-a1fb-948833338594 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:28.864290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-80a2291f-d268-4f65-a1fb-948833338594 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:28.872148 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-80a2291f-d268-4f65-a1fb-948833338594 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1679 microversion: 2.1 time: 0.160113 Aug 23 18:51:28.872718 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3715/7296] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:28 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1679 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:29.894336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c478f368-ad91-414f-8885-d27a826b659f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:29.895040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c478f368-ad91-414f-8885-d27a826b659f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:29.902065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c478f368-ad91-414f-8885-d27a826b659f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:29.902561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c478f368-ad91-414f-8885-d27a826b659f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:29.903014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c478f368-ad91-414f-8885-d27a826b659f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:29.903704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c478f368-ad91-414f-8885-d27a826b659f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:29.904155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c478f368-ad91-414f-8885-d27a826b659f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:29.904578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c478f368-ad91-414f-8885-d27a826b659f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:30.037806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c478f368-ad91-414f-8885-d27a826b659f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:30.046000 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c478f368-ad91-414f-8885-d27a826b659f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1684 microversion: 2.1 time: 0.155557 Aug 23 18:51:30.046587 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3582/7297] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:29 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:31.068278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-63abdb93-5b28-4c3e-b73d-9270f2cef241 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:31.068806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-63abdb93-5b28-4c3e-b73d-9270f2cef241 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:31.076083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63abdb93-5b28-4c3e-b73d-9270f2cef241 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:31.076574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63abdb93-5b28-4c3e-b73d-9270f2cef241 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:31.077018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63abdb93-5b28-4c3e-b73d-9270f2cef241 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:31.077752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63abdb93-5b28-4c3e-b73d-9270f2cef241 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:31.078207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63abdb93-5b28-4c3e-b73d-9270f2cef241 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:31.078658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63abdb93-5b28-4c3e-b73d-9270f2cef241 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:31.207237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-63abdb93-5b28-4c3e-b73d-9270f2cef241 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:31.215939 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-63abdb93-5b28-4c3e-b73d-9270f2cef241 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1684 microversion: 2.1 time: 0.151667 Aug 23 18:51:31.216506 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3716/7298] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:31 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:32.237282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-171a48ce-ad55-485b-9c4f-ba133d7b481f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:32.237938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-171a48ce-ad55-485b-9c4f-ba133d7b481f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:32.245275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-171a48ce-ad55-485b-9c4f-ba133d7b481f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:32.245760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-171a48ce-ad55-485b-9c4f-ba133d7b481f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:32.246204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-171a48ce-ad55-485b-9c4f-ba133d7b481f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:32.246926 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-171a48ce-ad55-485b-9c4f-ba133d7b481f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:32.247387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-171a48ce-ad55-485b-9c4f-ba133d7b481f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:32.247817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-171a48ce-ad55-485b-9c4f-ba133d7b481f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:32.381389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-171a48ce-ad55-485b-9c4f-ba133d7b481f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:32.390159 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-171a48ce-ad55-485b-9c4f-ba133d7b481f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1684 microversion: 2.1 time: 0.156803 Aug 23 18:51:32.390829 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3583/7299] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:32 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1684 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:33.411519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b05a055-518d-463f-a53a-8e4fe25d271a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:33.412165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b05a055-518d-463f-a53a-8e4fe25d271a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:33.419436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b05a055-518d-463f-a53a-8e4fe25d271a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:33.419929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b05a055-518d-463f-a53a-8e4fe25d271a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:33.420374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b05a055-518d-463f-a53a-8e4fe25d271a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:33.421069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b05a055-518d-463f-a53a-8e4fe25d271a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:33.421533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b05a055-518d-463f-a53a-8e4fe25d271a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:33.421962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b05a055-518d-463f-a53a-8e4fe25d271a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:33.554958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b05a055-518d-463f-a53a-8e4fe25d271a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:33.563749 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b05a055-518d-463f-a53a-8e4fe25d271a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1684 microversion: 2.1 time: 0.156115 Aug 23 18:51:33.564314 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3717/7300] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:33 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1684 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:34.585025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0bb6482b-4eb7-4e66-8907-9bd50ad9f56e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:34.585639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0bb6482b-4eb7-4e66-8907-9bd50ad9f56e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:34.593569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bb6482b-4eb7-4e66-8907-9bd50ad9f56e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:34.594054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bb6482b-4eb7-4e66-8907-9bd50ad9f56e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:34.594494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bb6482b-4eb7-4e66-8907-9bd50ad9f56e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:34.595316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bb6482b-4eb7-4e66-8907-9bd50ad9f56e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:34.595773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bb6482b-4eb7-4e66-8907-9bd50ad9f56e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:34.596204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0bb6482b-4eb7-4e66-8907-9bd50ad9f56e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:34.737854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0bb6482b-4eb7-4e66-8907-9bd50ad9f56e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:34.746275 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0bb6482b-4eb7-4e66-8907-9bd50ad9f56e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1684 microversion: 2.1 time: 0.165177 Aug 23 18:51:34.746877 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3584/7301] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:34 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1684 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:35.768013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f337c461-8f9a-40f1-a882-d5dede0be897 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:35.768639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f337c461-8f9a-40f1-a882-d5dede0be897 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:35.776107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f337c461-8f9a-40f1-a882-d5dede0be897 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:35.776598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f337c461-8f9a-40f1-a882-d5dede0be897 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:35.777041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f337c461-8f9a-40f1-a882-d5dede0be897 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:35.777741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f337c461-8f9a-40f1-a882-d5dede0be897 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:35.778205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f337c461-8f9a-40f1-a882-d5dede0be897 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:35.778667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f337c461-8f9a-40f1-a882-d5dede0be897 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:35.907960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f337c461-8f9a-40f1-a882-d5dede0be897 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:35.915980 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f337c461-8f9a-40f1-a882-d5dede0be897 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1684 microversion: 2.1 time: 0.151566 Aug 23 18:51:35.916550 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3718/7302] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:35 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:36.937064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e7f53303-68aa-4121-8f85-f4ec5a8586ce tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:36.937585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e7f53303-68aa-4121-8f85-f4ec5a8586ce tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:36.944541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7f53303-68aa-4121-8f85-f4ec5a8586ce tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:36.945026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7f53303-68aa-4121-8f85-f4ec5a8586ce tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:36.945467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7f53303-68aa-4121-8f85-f4ec5a8586ce tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:36.946167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7f53303-68aa-4121-8f85-f4ec5a8586ce tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:36.947150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7f53303-68aa-4121-8f85-f4ec5a8586ce tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:36.947652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7f53303-68aa-4121-8f85-f4ec5a8586ce tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:37.077775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e7f53303-68aa-4121-8f85-f4ec5a8586ce tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:37.085579 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e7f53303-68aa-4121-8f85-f4ec5a8586ce tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1684 microversion: 2.1 time: 0.152566 Aug 23 18:51:37.086159 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3585/7303] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:36 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1684 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:38.107548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9688972d-6a05-44a2-b0bf-87b4e58d5775 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:38.108203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9688972d-6a05-44a2-b0bf-87b4e58d5775 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:38.115101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9688972d-6a05-44a2-b0bf-87b4e58d5775 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:38.115602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9688972d-6a05-44a2-b0bf-87b4e58d5775 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:38.116055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9688972d-6a05-44a2-b0bf-87b4e58d5775 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:38.116757 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9688972d-6a05-44a2-b0bf-87b4e58d5775 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:38.117225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9688972d-6a05-44a2-b0bf-87b4e58d5775 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:38.117663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9688972d-6a05-44a2-b0bf-87b4e58d5775 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:38.255440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9688972d-6a05-44a2-b0bf-87b4e58d5775 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:38.263301 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9688972d-6a05-44a2-b0bf-87b4e58d5775 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1684 microversion: 2.1 time: 0.159655 Aug 23 18:51:38.263872 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3719/7304] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:38 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1684 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:39.284904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1739c71f-2c53-4950-bd87-b4db91e87687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:39.285522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1739c71f-2c53-4950-bd87-b4db91e87687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:39.293046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1739c71f-2c53-4950-bd87-b4db91e87687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:39.293526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1739c71f-2c53-4950-bd87-b4db91e87687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:39.293963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1739c71f-2c53-4950-bd87-b4db91e87687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:39.294692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1739c71f-2c53-4950-bd87-b4db91e87687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:39.295146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1739c71f-2c53-4950-bd87-b4db91e87687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:39.295572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1739c71f-2c53-4950-bd87-b4db91e87687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:39.425131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1739c71f-2c53-4950-bd87-b4db91e87687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:39.433029 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1739c71f-2c53-4950-bd87-b4db91e87687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1684 microversion: 2.1 time: 0.152061 Aug 23 18:51:39.433604 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3586/7305] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:39 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1684 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:40.455005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-eb280aba-b982-4b41-b924-b21e93ba41d1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:40.455645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-eb280aba-b982-4b41-b924-b21e93ba41d1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:40.463068 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb280aba-b982-4b41-b924-b21e93ba41d1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:40.463568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb280aba-b982-4b41-b924-b21e93ba41d1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:40.464025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb280aba-b982-4b41-b924-b21e93ba41d1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:40.464736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb280aba-b982-4b41-b924-b21e93ba41d1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:40.465474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb280aba-b982-4b41-b924-b21e93ba41d1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:40.465920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-eb280aba-b982-4b41-b924-b21e93ba41d1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:40.597171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-eb280aba-b982-4b41-b924-b21e93ba41d1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:40.605711 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-eb280aba-b982-4b41-b924-b21e93ba41d1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1684 microversion: 2.1 time: 0.154565 Aug 23 18:51:40.606291 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3720/7306] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:40 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1684 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:41.627637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-231eddef-e226-4530-9cf3-c5cefefcdbe1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:41.628482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-231eddef-e226-4530-9cf3-c5cefefcdbe1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:41.637027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-231eddef-e226-4530-9cf3-c5cefefcdbe1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:41.637521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-231eddef-e226-4530-9cf3-c5cefefcdbe1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:41.637963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-231eddef-e226-4530-9cf3-c5cefefcdbe1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:41.638753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-231eddef-e226-4530-9cf3-c5cefefcdbe1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:41.639215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-231eddef-e226-4530-9cf3-c5cefefcdbe1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:41.639642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-231eddef-e226-4530-9cf3-c5cefefcdbe1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:41.786607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-231eddef-e226-4530-9cf3-c5cefefcdbe1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:41.795849 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-231eddef-e226-4530-9cf3-c5cefefcdbe1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1683 microversion: 2.1 time: 0.172333 Aug 23 18:51:41.796421 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3587/7307] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:41 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1683 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:41.833832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-0d02933a-dec6-4513-acb7-c84ee786d9dd req-3518b9e7-71d4-45d3-9744-2d2e5441a690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7abc616-30c6-4600-bd6b-744387339865", "name": "network-vif-unplugged", "status": "completed", "tag": "57032415-20c8-4fb5-94cf-11e7c480a19b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:51:41.845950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0d02933a-dec6-4513-acb7-c84ee786d9dd req-3518b9e7-71d4-45d3-9744-2d2e5441a690 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:41.846443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0d02933a-dec6-4513-acb7-c84ee786d9dd req-3518b9e7-71d4-45d3-9744-2d2e5441a690 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:41.846914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-0d02933a-dec6-4513-acb7-c84ee786d9dd req-3518b9e7-71d4-45d3-9744-2d2e5441a690 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:41.859987 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-0d02933a-dec6-4513-acb7-c84ee786d9dd req-3518b9e7-71d4-45d3-9744-2d2e5441a690 service nova] Creating event network-vif-unplugged:57032415-20c8-4fb5-94cf-11e7c480a19b for instance d7abc616-30c6-4600-bd6b-744387339865 on n-h2-850468-16 Aug 23 18:51:41.865711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-0d02933a-dec6-4513-acb7-c84ee786d9dd req-3518b9e7-71d4-45d3-9744-2d2e5441a690 service nova] Instance d7abc616-30c6-4600-bd6b-744387339865 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:51:41.877896 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-0d02933a-dec6-4513-acb7-c84ee786d9dd req-3518b9e7-71d4-45d3-9744-2d2e5441a690 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047982 Aug 23 18:51:41.878704 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3721/7308] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:51:42.818066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fee38437-689a-4abe-8709-a35b9b957a56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:42.818707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fee38437-689a-4abe-8709-a35b9b957a56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:42.826092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fee38437-689a-4abe-8709-a35b9b957a56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:42.826704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fee38437-689a-4abe-8709-a35b9b957a56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:42.827151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fee38437-689a-4abe-8709-a35b9b957a56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:42.827853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fee38437-689a-4abe-8709-a35b9b957a56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:42.828309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fee38437-689a-4abe-8709-a35b9b957a56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:42.828731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fee38437-689a-4abe-8709-a35b9b957a56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:42.971104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fee38437-689a-4abe-8709-a35b9b957a56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:42.979488 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fee38437-689a-4abe-8709-a35b9b957a56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1683 microversion: 2.1 time: 0.166158 Aug 23 18:51:42.980090 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3588/7309] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:42 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1683 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:43.908165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-78e46e93-16e6-49b8-be1f-f27b2a8171eb req-d3b3d71d-6320-4a81-9db6-2c5cbd4ecf83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d7abc616-30c6-4600-bd6b-744387339865", "tag": "57032415-20c8-4fb5-94cf-11e7c480a19b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:51:43.919235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-78e46e93-16e6-49b8-be1f-f27b2a8171eb req-d3b3d71d-6320-4a81-9db6-2c5cbd4ecf83 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:43.919821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-78e46e93-16e6-49b8-be1f-f27b2a8171eb req-d3b3d71d-6320-4a81-9db6-2c5cbd4ecf83 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:43.920364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-78e46e93-16e6-49b8-be1f-f27b2a8171eb req-d3b3d71d-6320-4a81-9db6-2c5cbd4ecf83 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:43.932435 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-78e46e93-16e6-49b8-be1f-f27b2a8171eb req-d3b3d71d-6320-4a81-9db6-2c5cbd4ecf83 service nova] Creating event network-changed:57032415-20c8-4fb5-94cf-11e7c480a19b for instance d7abc616-30c6-4600-bd6b-744387339865 on n-h2-850468-16 Aug 23 18:51:43.937667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-78e46e93-16e6-49b8-be1f-f27b2a8171eb req-d3b3d71d-6320-4a81-9db6-2c5cbd4ecf83 service nova] Instance d7abc616-30c6-4600-bd6b-744387339865 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:51:43.948254 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-78e46e93-16e6-49b8-be1f-f27b2a8171eb req-d3b3d71d-6320-4a81-9db6-2c5cbd4ecf83 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044169 Aug 23 18:51:43.948846 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3722/7310] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:51:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:51:44.000687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6995e133-d878-4f16-8266-f34733fda25a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:44.001360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6995e133-d878-4f16-8266-f34733fda25a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:44.008218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6995e133-d878-4f16-8266-f34733fda25a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:44.009217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6995e133-d878-4f16-8266-f34733fda25a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:44.009680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6995e133-d878-4f16-8266-f34733fda25a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:44.010386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6995e133-d878-4f16-8266-f34733fda25a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:44.010875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6995e133-d878-4f16-8266-f34733fda25a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:44.011314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6995e133-d878-4f16-8266-f34733fda25a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:44.240519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6995e133-d878-4f16-8266-f34733fda25a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:44.248523 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6995e133-d878-4f16-8266-f34733fda25a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1681 microversion: 2.1 time: 0.251787 Aug 23 18:51:44.249122 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3589/7311] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:43 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1681 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:45.270570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b1c52dea-86c1-4db7-bf1a-f733868d6bdc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:45.271307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b1c52dea-86c1-4db7-bf1a-f733868d6bdc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:45.277397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1c52dea-86c1-4db7-bf1a-f733868d6bdc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:45.277889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1c52dea-86c1-4db7-bf1a-f733868d6bdc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:45.278341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1c52dea-86c1-4db7-bf1a-f733868d6bdc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:45.279064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1c52dea-86c1-4db7-bf1a-f733868d6bdc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:45.279555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1c52dea-86c1-4db7-bf1a-f733868d6bdc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:45.279992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b1c52dea-86c1-4db7-bf1a-f733868d6bdc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:45.497737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b1c52dea-86c1-4db7-bf1a-f733868d6bdc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:45.505472 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b1c52dea-86c1-4db7-bf1a-f733868d6bdc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1681 microversion: 2.1 time: 0.239996 Aug 23 18:51:45.506056 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3723/7312] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:45 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1681 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:46.528165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fca33e26-8175-45fa-9f0e-3e174645c2ea tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:46.528992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fca33e26-8175-45fa-9f0e-3e174645c2ea tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:46.535824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fca33e26-8175-45fa-9f0e-3e174645c2ea tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:46.536307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fca33e26-8175-45fa-9f0e-3e174645c2ea tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:46.536740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fca33e26-8175-45fa-9f0e-3e174645c2ea tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:46.537433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fca33e26-8175-45fa-9f0e-3e174645c2ea tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:46.537880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fca33e26-8175-45fa-9f0e-3e174645c2ea tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:46.538304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fca33e26-8175-45fa-9f0e-3e174645c2ea tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:46.677113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fca33e26-8175-45fa-9f0e-3e174645c2ea tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:46.685487 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fca33e26-8175-45fa-9f0e-3e174645c2ea tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1678 microversion: 2.1 time: 0.162148 Aug 23 18:51:46.686073 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3590/7313] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:46 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:46.706647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2a0be602-af53-4d3d-89dc-10d80ce9d0b7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:51:46.707183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2a0be602-af53-4d3d-89dc-10d80ce9d0b7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:46.715323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a0be602-af53-4d3d-89dc-10d80ce9d0b7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:46.715829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a0be602-af53-4d3d-89dc-10d80ce9d0b7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:46.716474 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a0be602-af53-4d3d-89dc-10d80ce9d0b7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:46.717185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a0be602-af53-4d3d-89dc-10d80ce9d0b7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:46.717656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a0be602-af53-4d3d-89dc-10d80ce9d0b7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:46.718095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a0be602-af53-4d3d-89dc-10d80ce9d0b7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:46.778008 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2a0be602-af53-4d3d-89dc-10d80ce9d0b7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865/action" status: 204 len: 0 microversion: 2.1 time: 0.075103 Aug 23 18:51:46.779006 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3724/7314] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:51:46 2022] POST /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:51:46.787688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-848290af-55f0-42e2-8836-559f7e573c27 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:46.788314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-848290af-55f0-42e2-8836-559f7e573c27 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:46.794909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-848290af-55f0-42e2-8836-559f7e573c27 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:46.795405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-848290af-55f0-42e2-8836-559f7e573c27 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:46.795841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-848290af-55f0-42e2-8836-559f7e573c27 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:46.796549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-848290af-55f0-42e2-8836-559f7e573c27 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:46.797039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-848290af-55f0-42e2-8836-559f7e573c27 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:46.797469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-848290af-55f0-42e2-8836-559f7e573c27 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:47.010286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-848290af-55f0-42e2-8836-559f7e573c27 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:47.019489 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-848290af-55f0-42e2-8836-559f7e573c27 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1678 microversion: 2.1 time: 0.236205 Aug 23 18:51:47.020079 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3591/7315] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:46 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1678 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:48.042742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a8c2934-e10a-4e53-837f-d22ecfd419a7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:48.043469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8a8c2934-e10a-4e53-837f-d22ecfd419a7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:48.049643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a8c2934-e10a-4e53-837f-d22ecfd419a7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:48.050079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a8c2934-e10a-4e53-837f-d22ecfd419a7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:48.050534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a8c2934-e10a-4e53-837f-d22ecfd419a7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:48.051273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a8c2934-e10a-4e53-837f-d22ecfd419a7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:48.051743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a8c2934-e10a-4e53-837f-d22ecfd419a7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:48.052184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a8c2934-e10a-4e53-837f-d22ecfd419a7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:48.495170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2bc0d43d-38d4-46b7-8e8f-7849de6f0fa2 req-d9bb3a62-d6d3-46bf-b27f-d82c6c023c22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7abc616-30c6-4600-bd6b-744387339865", "name": "network-vif-plugged", "status": "completed", "tag": "57032415-20c8-4fb5-94cf-11e7c480a19b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:51:48.507837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2bc0d43d-38d4-46b7-8e8f-7849de6f0fa2 req-d9bb3a62-d6d3-46bf-b27f-d82c6c023c22 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:48.508482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2bc0d43d-38d4-46b7-8e8f-7849de6f0fa2 req-d9bb3a62-d6d3-46bf-b27f-d82c6c023c22 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:48.509701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2bc0d43d-38d4-46b7-8e8f-7849de6f0fa2 req-d9bb3a62-d6d3-46bf-b27f-d82c6c023c22 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:48.522156 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2bc0d43d-38d4-46b7-8e8f-7849de6f0fa2 req-d9bb3a62-d6d3-46bf-b27f-d82c6c023c22 service nova] Creating event network-vif-plugged:57032415-20c8-4fb5-94cf-11e7c480a19b for instance d7abc616-30c6-4600-bd6b-744387339865 on n-h2-850468-16 Aug 23 18:51:48.530586 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2bc0d43d-38d4-46b7-8e8f-7849de6f0fa2 req-d9bb3a62-d6d3-46bf-b27f-d82c6c023c22 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042417 Aug 23 18:51:48.531597 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3592/7316] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:51:48.560519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8a8c2934-e10a-4e53-837f-d22ecfd419a7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:48.568272 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8a8c2934-e10a-4e53-837f-d22ecfd419a7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1670 microversion: 2.1 time: 0.530810 Aug 23 18:51:48.568843 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3725/7317] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:48 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1670 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:48.590019 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-90f5c721-cb19-4c25-8f6f-b5819fa37dcd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:48.590941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-90f5c721-cb19-4c25-8f6f-b5819fa37dcd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:48.597334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90f5c721-cb19-4c25-8f6f-b5819fa37dcd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:48.597817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90f5c721-cb19-4c25-8f6f-b5819fa37dcd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:48.598249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90f5c721-cb19-4c25-8f6f-b5819fa37dcd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:48.599013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90f5c721-cb19-4c25-8f6f-b5819fa37dcd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:48.599466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90f5c721-cb19-4c25-8f6f-b5819fa37dcd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:48.599888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-90f5c721-cb19-4c25-8f6f-b5819fa37dcd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:48.732296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-90f5c721-cb19-4c25-8f6f-b5819fa37dcd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:48.740347 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-90f5c721-cb19-4c25-8f6f-b5819fa37dcd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1670 microversion: 2.1 time: 0.154922 Aug 23 18:51:48.741153 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3593/7318] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:48 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1670 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:48.763762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-454f9558-6be6-4429-8e34-16a56c67f3af tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:48.764006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-454f9558-6be6-4429-8e34-16a56c67f3af tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:48.770101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-454f9558-6be6-4429-8e34-16a56c67f3af tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:48.770640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-454f9558-6be6-4429-8e34-16a56c67f3af tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:48.771098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-454f9558-6be6-4429-8e34-16a56c67f3af tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:48.771818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-454f9558-6be6-4429-8e34-16a56c67f3af tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:48.772287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-454f9558-6be6-4429-8e34-16a56c67f3af tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:48.772916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-454f9558-6be6-4429-8e34-16a56c67f3af tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:48.904314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-454f9558-6be6-4429-8e34-16a56c67f3af tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:48.912149 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-454f9558-6be6-4429-8e34-16a56c67f3af tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1670 microversion: 2.1 time: 0.153509 Aug 23 18:51:48.912730 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3726/7319] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:48 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1670 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:48.932672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-104841b4-748b-49c8-95cc-006cd28b41be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:48.933178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-104841b4-748b-49c8-95cc-006cd28b41be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:48.939076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-104841b4-748b-49c8-95cc-006cd28b41be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:48.939561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-104841b4-748b-49c8-95cc-006cd28b41be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:48.940004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-104841b4-748b-49c8-95cc-006cd28b41be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:48.940697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-104841b4-748b-49c8-95cc-006cd28b41be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:48.941156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-104841b4-748b-49c8-95cc-006cd28b41be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:48.941585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-104841b4-748b-49c8-95cc-006cd28b41be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:48.967150 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-104841b4-748b-49c8-95cc-006cd28b41be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:51:49.012952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:51:49.043992 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-104841b4-748b-49c8-95cc-006cd28b41be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 204 len: 0 microversion: 2.1 time: 0.115631 Aug 23 18:51:49.044563 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3594/7320] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:51:48 2022] DELETE /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:51:49.052810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-04200b02-6722-4709-b4fa-59ea35aa4abb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:49.053438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-04200b02-6722-4709-b4fa-59ea35aa4abb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:49.060270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04200b02-6722-4709-b4fa-59ea35aa4abb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:49.060764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04200b02-6722-4709-b4fa-59ea35aa4abb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:49.062032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04200b02-6722-4709-b4fa-59ea35aa4abb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:49.063053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04200b02-6722-4709-b4fa-59ea35aa4abb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:49.063535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04200b02-6722-4709-b4fa-59ea35aa4abb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:49.063978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-04200b02-6722-4709-b4fa-59ea35aa4abb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:49.197073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-04200b02-6722-4709-b4fa-59ea35aa4abb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:49.199494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:51:49.206511 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-04200b02-6722-4709-b4fa-59ea35aa4abb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1676 microversion: 2.1 time: 0.157568 Aug 23 18:51:49.207112 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3727/7321] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:49 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:51:50.229630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e2e1d92c-9a6a-43ea-afc8-ad4d396b356e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:50.230341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e2e1d92c-9a6a-43ea-afc8-ad4d396b356e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:50.237252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2e1d92c-9a6a-43ea-afc8-ad4d396b356e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:50.237742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2e1d92c-9a6a-43ea-afc8-ad4d396b356e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:50.238187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2e1d92c-9a6a-43ea-afc8-ad4d396b356e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:50.238919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2e1d92c-9a6a-43ea-afc8-ad4d396b356e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:50.239379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2e1d92c-9a6a-43ea-afc8-ad4d396b356e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:50.239809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e2e1d92c-9a6a-43ea-afc8-ad4d396b356e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:50.376660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e2e1d92c-9a6a-43ea-afc8-ad4d396b356e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:50.385161 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e2e1d92c-9a6a-43ea-afc8-ad4d396b356e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1676 microversion: 2.1 time: 0.159840 Aug 23 18:51:50.385731 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3595/7322] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:50 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:51.406489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-01828a59-00f5-4b8a-9813-809736b58fee tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:51.407230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-01828a59-00f5-4b8a-9813-809736b58fee tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:51.415874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01828a59-00f5-4b8a-9813-809736b58fee tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:51.416488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01828a59-00f5-4b8a-9813-809736b58fee tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:51.417138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01828a59-00f5-4b8a-9813-809736b58fee tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:51.417867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01828a59-00f5-4b8a-9813-809736b58fee tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:51.418343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01828a59-00f5-4b8a-9813-809736b58fee tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:51.418815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-01828a59-00f5-4b8a-9813-809736b58fee tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:51.508148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-01828a59-00f5-4b8a-9813-809736b58fee tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:51.516948 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-01828a59-00f5-4b8a-9813-809736b58fee tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 200 len: 1609 microversion: 2.1 time: 0.114362 Aug 23 18:51:51.517802 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3728/7323] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:51 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 1609 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:51.547010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-ffeb1c70-0546-4ed0-80d2-eafde706dad7 req-4028d80b-abf7-4a43-ac16-882c8f779203 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d7abc616-30c6-4600-bd6b-744387339865", "name": "network-vif-deleted", "tag": "57032415-20c8-4fb5-94cf-11e7c480a19b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:51:51.564140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ffeb1c70-0546-4ed0-80d2-eafde706dad7 req-4028d80b-abf7-4a43-ac16-882c8f779203 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:51.565013 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ffeb1c70-0546-4ed0-80d2-eafde706dad7 req-4028d80b-abf7-4a43-ac16-882c8f779203 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:51.565557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-ffeb1c70-0546-4ed0-80d2-eafde706dad7 req-4028d80b-abf7-4a43-ac16-882c8f779203 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:51.581813 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-ffeb1c70-0546-4ed0-80d2-eafde706dad7 req-4028d80b-abf7-4a43-ac16-882c8f779203 service nova] Creating event network-vif-deleted:57032415-20c8-4fb5-94cf-11e7c480a19b for instance d7abc616-30c6-4600-bd6b-744387339865 on n-h2-850468-16 Aug 23 18:51:51.586861 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-ffeb1c70-0546-4ed0-80d2-eafde706dad7 req-4028d80b-abf7-4a43-ac16-882c8f779203 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043516 Aug 23 18:51:51.587801 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3596/7324] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:51:52.540690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d95d43e5-8176-4e44-9e82-10d6b3b0708a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:52.541323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d95d43e5-8176-4e44-9e82-10d6b3b0708a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:52.548060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95d43e5-8176-4e44-9e82-10d6b3b0708a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:52.548550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95d43e5-8176-4e44-9e82-10d6b3b0708a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:52.548998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95d43e5-8176-4e44-9e82-10d6b3b0708a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:52.549690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95d43e5-8176-4e44-9e82-10d6b3b0708a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:52.550149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95d43e5-8176-4e44-9e82-10d6b3b0708a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:52.550626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d95d43e5-8176-4e44-9e82-10d6b3b0708a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:52.564531 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-d95d43e5-8176-4e44-9e82-10d6b3b0708a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d95d43e5-8176-4e44-9e82-10d6b3b0708a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 HTTP/1.1 Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'd7abc616-30c6-4600-bd6b-744387339865'} Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:51:52.566187 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:51:52.570378 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:51:52.570378 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:51:52.570378 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:51:52.570378 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:51:52.570378 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:51:52.570378 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:51:52.570378 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:51:52.570378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d95d43e5-8176-4e44-9e82-10d6b3b0708a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:51:52.570378 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d95d43e5-8176-4e44-9e82-10d6b3b0708a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 404 len: 111 microversion: 2.1 time: 0.031292 Aug 23 18:51:52.570378 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3729/7325] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:52 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:51:52.583190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ac96ad8d-5278-4315-935b-227590591078 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:52.583891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ac96ad8d-5278-4315-935b-227590591078 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:52.590011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac96ad8d-5278-4315-935b-227590591078 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:52.590798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac96ad8d-5278-4315-935b-227590591078 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:52.591235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac96ad8d-5278-4315-935b-227590591078 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:52.591925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac96ad8d-5278-4315-935b-227590591078 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:52.592390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac96ad8d-5278-4315-935b-227590591078 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:52.592802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac96ad8d-5278-4315-935b-227590591078 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:52.606448 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-ac96ad8d-5278-4315-935b-227590591078 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ac96ad8d-5278-4315-935b-227590591078 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 HTTP/1.1 Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'd7abc616-30c6-4600-bd6b-744387339865'} Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:51:52.608159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:51:52.612011 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:51:52.612011 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:51:52.612011 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:51:52.612011 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:51:52.612011 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:51:52.612011 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:51:52.612011 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:51:52.612011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ac96ad8d-5278-4315-935b-227590591078 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:51:52.612011 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ac96ad8d-5278-4315-935b-227590591078 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 404 len: 111 microversion: 2.1 time: 0.031614 Aug 23 18:51:52.612011 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3597/7326] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:52 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:51:52.660413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-661632042", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "3617bced-c0f9-4fd5-b74f-8bf14b45f3c8"}], "security_groups": [{"name": "tempest-securitygroup--974773066"}], "key_name": "tempest-keypair-1650899182", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:51:52.765993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] validate_networks() for [('3617bced-c0f9-4fd5-b74f-8bf14b45f3c8', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:51:53.236003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:51:53.236441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:51:53.236931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:51:53.237354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:51:53.237779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:51:53.249492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:53.249992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:53.250435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:53.251204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:53.251672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:53.252108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:53.271372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:51:53.276852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for user b1b1944b15d547e4b68df40cb65a74a6 and project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:51:53.288870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:51:53.291471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:51:53.337836 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-acadc157-098d-4c47-bf98-a677f040a0e3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.681248 Aug 23 18:51:53.338487 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3730/7327] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:51:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:51:53.349751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b6f8918a-8cc0-4e2e-ba3d-885022c128a6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:53.350368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b6f8918a-8cc0-4e2e-ba3d-885022c128a6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:53.409387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b6f8918a-8cc0-4e2e-ba3d-885022c128a6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:53.419198 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b6f8918a-8cc0-4e2e-ba3d-885022c128a6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1238 microversion: 2.1 time: 0.073180 Aug 23 18:51:53.419779 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3598/7328] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:53 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:54.442329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e90a7fde-3e09-4dc8-909e-ffc6604f25be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:54.443498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e90a7fde-3e09-4dc8-909e-ffc6604f25be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:54.451578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e90a7fde-3e09-4dc8-909e-ffc6604f25be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:54.452163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e90a7fde-3e09-4dc8-909e-ffc6604f25be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:54.452626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e90a7fde-3e09-4dc8-909e-ffc6604f25be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:54.453500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e90a7fde-3e09-4dc8-909e-ffc6604f25be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:54.453979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e90a7fde-3e09-4dc8-909e-ffc6604f25be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:54.454414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e90a7fde-3e09-4dc8-909e-ffc6604f25be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:54.523575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e90a7fde-3e09-4dc8-909e-ffc6604f25be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:54.532070 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e90a7fde-3e09-4dc8-909e-ffc6604f25be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1296 microversion: 2.1 time: 0.094487 Aug 23 18:51:54.532640 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3731/7329] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:54 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:55.553397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e92e1bbe-57c2-4604-bb7f-26a49bb7352b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:55.554020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e92e1bbe-57c2-4604-bb7f-26a49bb7352b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:55.562692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e92e1bbe-57c2-4604-bb7f-26a49bb7352b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:55.563190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e92e1bbe-57c2-4604-bb7f-26a49bb7352b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:55.563631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e92e1bbe-57c2-4604-bb7f-26a49bb7352b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:55.564335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e92e1bbe-57c2-4604-bb7f-26a49bb7352b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:55.564792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e92e1bbe-57c2-4604-bb7f-26a49bb7352b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:55.565223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e92e1bbe-57c2-4604-bb7f-26a49bb7352b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:55.759355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-03403879-12d3-4a4b-8e68-d78948ec8a7e req-cb60beef-a718-404f-bfc3-26ffef3a8d74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639380c8-172e-482b-ba05-7939dafc76fe", "tag": "031f54e6-30af-448c-aff2-ee6f7951f659"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:51:55.771216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-03403879-12d3-4a4b-8e68-d78948ec8a7e req-cb60beef-a718-404f-bfc3-26ffef3a8d74 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:55.771717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-03403879-12d3-4a4b-8e68-d78948ec8a7e req-cb60beef-a718-404f-bfc3-26ffef3a8d74 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:55.772259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-03403879-12d3-4a4b-8e68-d78948ec8a7e req-cb60beef-a718-404f-bfc3-26ffef3a8d74 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:55.777565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e92e1bbe-57c2-4604-bb7f-26a49bb7352b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:55.788337 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e92e1bbe-57c2-4604-bb7f-26a49bb7352b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1363 microversion: 2.1 time: 0.238873 Aug 23 18:51:55.788934 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3599/7330] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:55 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:55.805251 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-03403879-12d3-4a4b-8e68-d78948ec8a7e req-cb60beef-a718-404f-bfc3-26ffef3a8d74 service nova] Creating event network-changed:031f54e6-30af-448c-aff2-ee6f7951f659 for instance 639380c8-172e-482b-ba05-7939dafc76fe on n-h1-850468-16 Aug 23 18:51:55.811227 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-03403879-12d3-4a4b-8e68-d78948ec8a7e req-cb60beef-a718-404f-bfc3-26ffef3a8d74 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056142 Aug 23 18:51:55.811941 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3732/7331] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:51:56.813275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fef7a8c5-585e-41a7-bdeb-bf6ac4d1a2f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:56.813894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fef7a8c5-585e-41a7-bdeb-bf6ac4d1a2f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:56.820043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fef7a8c5-585e-41a7-bdeb-bf6ac4d1a2f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:56.820538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fef7a8c5-585e-41a7-bdeb-bf6ac4d1a2f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:56.821654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fef7a8c5-585e-41a7-bdeb-bf6ac4d1a2f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:56.822534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fef7a8c5-585e-41a7-bdeb-bf6ac4d1a2f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:56.823018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fef7a8c5-585e-41a7-bdeb-bf6ac4d1a2f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:56.823454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fef7a8c5-585e-41a7-bdeb-bf6ac4d1a2f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:56.963245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fef7a8c5-585e-41a7-bdeb-bf6ac4d1a2f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:56.971254 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fef7a8c5-585e-41a7-bdeb-bf6ac4d1a2f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1363 microversion: 2.1 time: 0.162176 Aug 23 18:51:56.971825 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3600/7332] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:56 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:57.994607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3c75416a-657e-4453-b6a9-701ca4780ca8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:57.995238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3c75416a-657e-4453-b6a9-701ca4780ca8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:57.997206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:51:58.002567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c75416a-657e-4453-b6a9-701ca4780ca8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:58.003088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c75416a-657e-4453-b6a9-701ca4780ca8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:58.003534 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c75416a-657e-4453-b6a9-701ca4780ca8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:58.004231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c75416a-657e-4453-b6a9-701ca4780ca8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:58.004694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c75416a-657e-4453-b6a9-701ca4780ca8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:58.005133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c75416a-657e-4453-b6a9-701ca4780ca8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:58.137248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3c75416a-657e-4453-b6a9-701ca4780ca8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:58.144959 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3c75416a-657e-4453-b6a9-701ca4780ca8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1363 microversion: 2.1 time: 0.156098 Aug 23 18:51:58.145524 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3733/7333] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:57 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:51:59.167428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b821011-222a-462d-82c3-d70987e7d7e0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:51:59.168045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4b821011-222a-462d-82c3-d70987e7d7e0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:51:59.170902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:51:59.176124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b821011-222a-462d-82c3-d70987e7d7e0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:59.176613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b821011-222a-462d-82c3-d70987e7d7e0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:59.177055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b821011-222a-462d-82c3-d70987e7d7e0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:59.177753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b821011-222a-462d-82c3-d70987e7d7e0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:51:59.178208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b821011-222a-462d-82c3-d70987e7d7e0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:51:59.178662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b821011-222a-462d-82c3-d70987e7d7e0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:51:59.310169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4b821011-222a-462d-82c3-d70987e7d7e0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:51:59.317906 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b821011-222a-462d-82c3-d70987e7d7e0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1363 microversion: 2.1 time: 0.154790 Aug 23 18:51:59.318488 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3601/7334] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:51:59 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:52:00.339415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1f75d08c-52ab-45aa-992d-263a4fd01e7c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:52:00.340045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1f75d08c-52ab-45aa-992d-263a4fd01e7c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:52:00.347103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f75d08c-52ab-45aa-992d-263a4fd01e7c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:00.347598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f75d08c-52ab-45aa-992d-263a4fd01e7c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:00.348045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f75d08c-52ab-45aa-992d-263a4fd01e7c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:00.348741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f75d08c-52ab-45aa-992d-263a4fd01e7c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:00.349209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f75d08c-52ab-45aa-992d-263a4fd01e7c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:00.349643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1f75d08c-52ab-45aa-992d-263a4fd01e7c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:00.483218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1f75d08c-52ab-45aa-992d-263a4fd01e7c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:52:00.490799 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1f75d08c-52ab-45aa-992d-263a4fd01e7c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1363 microversion: 2.1 time: 0.155321 Aug 23 18:52:00.491361 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3734/7335] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:52:00 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:52:01.511459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b26be5d9-9021-4633-8201-bdfb2161762e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:52:01.512071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b26be5d9-9021-4633-8201-bdfb2161762e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:52:01.518869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b26be5d9-9021-4633-8201-bdfb2161762e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:01.519349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b26be5d9-9021-4633-8201-bdfb2161762e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:01.519785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b26be5d9-9021-4633-8201-bdfb2161762e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:01.520493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b26be5d9-9021-4633-8201-bdfb2161762e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:01.520928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b26be5d9-9021-4633-8201-bdfb2161762e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:01.521351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b26be5d9-9021-4633-8201-bdfb2161762e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:01.663060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b26be5d9-9021-4633-8201-bdfb2161762e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:52:01.672805 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b26be5d9-9021-4633-8201-bdfb2161762e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1363 microversion: 2.1 time: 0.165133 Aug 23 18:52:01.673595 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3602/7336] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:52:01 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:52:02.693977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-26db5e6c-9160-441e-b073-7c22cfb5de99 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:52:02.694658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-26db5e6c-9160-441e-b073-7c22cfb5de99 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:52:02.701942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26db5e6c-9160-441e-b073-7c22cfb5de99 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:02.702437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26db5e6c-9160-441e-b073-7c22cfb5de99 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:02.702913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26db5e6c-9160-441e-b073-7c22cfb5de99 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:02.703637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26db5e6c-9160-441e-b073-7c22cfb5de99 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:02.704081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26db5e6c-9160-441e-b073-7c22cfb5de99 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:02.704516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-26db5e6c-9160-441e-b073-7c22cfb5de99 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:02.841624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-26db5e6c-9160-441e-b073-7c22cfb5de99 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:52:02.849380 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-26db5e6c-9160-441e-b073-7c22cfb5de99 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1363 microversion: 2.1 time: 0.159310 Aug 23 18:52:02.849964 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3735/7337] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:52:02 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:52:03.137458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-d78d0fae-e2b3-4df9-9124-cf8a75bb4adf req-5c0ef964-86e0-45d3-b772-8455e2f39fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639380c8-172e-482b-ba05-7939dafc76fe", "name": "network-vif-plugged", "status": "completed", "tag": "031f54e6-30af-448c-aff2-ee6f7951f659"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:52:03.148485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d78d0fae-e2b3-4df9-9124-cf8a75bb4adf req-5c0ef964-86e0-45d3-b772-8455e2f39fc2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:03.149177 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d78d0fae-e2b3-4df9-9124-cf8a75bb4adf req-5c0ef964-86e0-45d3-b772-8455e2f39fc2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:03.149797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-d78d0fae-e2b3-4df9-9124-cf8a75bb4adf req-5c0ef964-86e0-45d3-b772-8455e2f39fc2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:03.161932 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-d78d0fae-e2b3-4df9-9124-cf8a75bb4adf req-5c0ef964-86e0-45d3-b772-8455e2f39fc2 service nova] Creating event network-vif-plugged:031f54e6-30af-448c-aff2-ee6f7951f659 for instance 639380c8-172e-482b-ba05-7939dafc76fe on n-h1-850468-16 Aug 23 18:52:03.167635 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-d78d0fae-e2b3-4df9-9124-cf8a75bb4adf req-5c0ef964-86e0-45d3-b772-8455e2f39fc2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034642 Aug 23 18:52:03.168256 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3603/7338] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:52:03.871981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-acfeb7a6-11b8-4c5a-8c0e-a6b62523e92a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:52:03.872997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-acfeb7a6-11b8-4c5a-8c0e-a6b62523e92a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:52:03.875518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:52:03.876582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:52:03.886777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acfeb7a6-11b8-4c5a-8c0e-a6b62523e92a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:03.887289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acfeb7a6-11b8-4c5a-8c0e-a6b62523e92a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:03.887749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acfeb7a6-11b8-4c5a-8c0e-a6b62523e92a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:03.888477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acfeb7a6-11b8-4c5a-8c0e-a6b62523e92a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:03.888984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acfeb7a6-11b8-4c5a-8c0e-a6b62523e92a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:03.889433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acfeb7a6-11b8-4c5a-8c0e-a6b62523e92a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:04.027173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-acfeb7a6-11b8-4c5a-8c0e-a6b62523e92a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:52:04.034958 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-acfeb7a6-11b8-4c5a-8c0e-a6b62523e92a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1363 microversion: 2.1 time: 0.167761 Aug 23 18:52:04.035650 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3736/7339] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:52:03 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:52:05.053864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:52:05.059685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8439d148-f70f-449d-84cd-0c07f456c617 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:52:05.060402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8439d148-f70f-449d-84cd-0c07f456c617 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:52:05.067016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8439d148-f70f-449d-84cd-0c07f456c617 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:05.067507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8439d148-f70f-449d-84cd-0c07f456c617 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:05.067943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8439d148-f70f-449d-84cd-0c07f456c617 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:05.068645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8439d148-f70f-449d-84cd-0c07f456c617 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:05.069093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8439d148-f70f-449d-84cd-0c07f456c617 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:05.069514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8439d148-f70f-449d-84cd-0c07f456c617 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:05.203364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8439d148-f70f-449d-84cd-0c07f456c617 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:52:05.211116 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8439d148-f70f-449d-84cd-0c07f456c617 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1550 microversion: 2.1 time: 0.158283 Aug 23 18:52:05.212323 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3604/7340] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:52:05 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:52:05.233222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5432cceb-607a-4065-93e6-ca4554204ad3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:52:05.233735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5432cceb-607a-4065-93e6-ca4554204ad3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:52:05.240969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5432cceb-607a-4065-93e6-ca4554204ad3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:05.241470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5432cceb-607a-4065-93e6-ca4554204ad3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:05.241922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5432cceb-607a-4065-93e6-ca4554204ad3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:05.243196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5432cceb-607a-4065-93e6-ca4554204ad3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:05.243666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5432cceb-607a-4065-93e6-ca4554204ad3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:05.244107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5432cceb-607a-4065-93e6-ca4554204ad3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:05.319619 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5432cceb-607a-4065-93e6-ca4554204ad3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090245 Aug 23 18:52:05.320225 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3737/7341] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:52:05 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:52:06.253375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-cc80d5ed-7619-43d5-a7db-9f6fb4d93ed0 req-b3a6fd23-4295-43f6-ad1b-b84d56af4d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639380c8-172e-482b-ba05-7939dafc76fe", "tag": "031f54e6-30af-448c-aff2-ee6f7951f659"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:52:06.264623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cc80d5ed-7619-43d5-a7db-9f6fb4d93ed0 req-b3a6fd23-4295-43f6-ad1b-b84d56af4d86 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:52:06.265108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cc80d5ed-7619-43d5-a7db-9f6fb4d93ed0 req-b3a6fd23-4295-43f6-ad1b-b84d56af4d86 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:52:06.265543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cc80d5ed-7619-43d5-a7db-9f6fb4d93ed0 req-b3a6fd23-4295-43f6-ad1b-b84d56af4d86 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:52:06.279779 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-cc80d5ed-7619-43d5-a7db-9f6fb4d93ed0 req-b3a6fd23-4295-43f6-ad1b-b84d56af4d86 service nova] Creating event network-changed:031f54e6-30af-448c-aff2-ee6f7951f659 for instance 639380c8-172e-482b-ba05-7939dafc76fe on n-h1-850468-16 Aug 23 18:52:06.285747 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-cc80d5ed-7619-43d5-a7db-9f6fb4d93ed0 req-b3a6fd23-4295-43f6-ad1b-b84d56af4d86 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036146 Aug 23 18:52:06.286692 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3605/7342] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:52:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:52:41.341293 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:52:41.341821 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 18:52:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:52:41.811161 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:52:41.811700 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 18:52:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:53:18.334014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=9 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:53:18.334833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=47 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:53:18.339285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fd44e723-038d-4da5-837f-cdf3c07c6b2c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:53:18.346446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd44e723-038d-4da5-837f-cdf3c07c6b2c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:18.346977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd44e723-038d-4da5-837f-cdf3c07c6b2c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:18.347432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd44e723-038d-4da5-837f-cdf3c07c6b2c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:18.370761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fd44e723-038d-4da5-837f-cdf3c07c6b2c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Going to try to stop instance {{(pid=128808) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 18:53:18.411550 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fd44e723-038d-4da5-837f-cdf3c07c6b2c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe/action" status: 202 len: 0 microversion: 2.1 time: 0.079773 Aug 23 18:53:18.412151 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3738/7343] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:53:18 2022] POST /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:53:18.419713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=9 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:53:18.420889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:53:18.425373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f2efd445-f999-4b84-8b41-44e3e13b2bc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:18.426088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f2efd445-f999-4b84-8b41-44e3e13b2bc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:18.434640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2efd445-f999-4b84-8b41-44e3e13b2bc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:18.435139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2efd445-f999-4b84-8b41-44e3e13b2bc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:18.435578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2efd445-f999-4b84-8b41-44e3e13b2bc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:18.436289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2efd445-f999-4b84-8b41-44e3e13b2bc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:18.436755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2efd445-f999-4b84-8b41-44e3e13b2bc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:18.437192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f2efd445-f999-4b84-8b41-44e3e13b2bc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:18.586950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f2efd445-f999-4b84-8b41-44e3e13b2bc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:18.595268 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f2efd445-f999-4b84-8b41-44e3e13b2bc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.178702 Aug 23 18:53:18.595867 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3606/7344] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:18 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:19.617837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7dc16b58-fed7-4e23-b0ad-5e0991db7767 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:19.618561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7dc16b58-fed7-4e23-b0ad-5e0991db7767 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:19.625186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dc16b58-fed7-4e23-b0ad-5e0991db7767 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:19.625678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dc16b58-fed7-4e23-b0ad-5e0991db7767 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:19.626127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dc16b58-fed7-4e23-b0ad-5e0991db7767 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:19.626865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dc16b58-fed7-4e23-b0ad-5e0991db7767 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:19.627329 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dc16b58-fed7-4e23-b0ad-5e0991db7767 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:19.627794 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dc16b58-fed7-4e23-b0ad-5e0991db7767 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:19.768819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7dc16b58-fed7-4e23-b0ad-5e0991db7767 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:19.777168 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7dc16b58-fed7-4e23-b0ad-5e0991db7767 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.163844 Aug 23 18:53:19.777732 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3739/7345] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:19 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:20.799335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e829e24-cb00-40dc-9220-bbc42da9bd4a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:20.800024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e829e24-cb00-40dc-9220-bbc42da9bd4a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:20.806760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e829e24-cb00-40dc-9220-bbc42da9bd4a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:20.807750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e829e24-cb00-40dc-9220-bbc42da9bd4a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:20.808455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e829e24-cb00-40dc-9220-bbc42da9bd4a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:20.809200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e829e24-cb00-40dc-9220-bbc42da9bd4a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:20.809658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e829e24-cb00-40dc-9220-bbc42da9bd4a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:20.810087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e829e24-cb00-40dc-9220-bbc42da9bd4a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:20.940225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7e829e24-cb00-40dc-9220-bbc42da9bd4a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:20.947924 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e829e24-cb00-40dc-9220-bbc42da9bd4a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.152579 Aug 23 18:53:20.949138 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3607/7346] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:20 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:21.970391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a2249fe1-d5af-416e-9ad9-2d7795d25926 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:21.970944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a2249fe1-d5af-416e-9ad9-2d7795d25926 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:21.978334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2249fe1-d5af-416e-9ad9-2d7795d25926 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:21.978871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2249fe1-d5af-416e-9ad9-2d7795d25926 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:21.979560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2249fe1-d5af-416e-9ad9-2d7795d25926 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:21.980289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2249fe1-d5af-416e-9ad9-2d7795d25926 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:21.980788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2249fe1-d5af-416e-9ad9-2d7795d25926 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:21.981191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2249fe1-d5af-416e-9ad9-2d7795d25926 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:22.115058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a2249fe1-d5af-416e-9ad9-2d7795d25926 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:22.123223 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a2249fe1-d5af-416e-9ad9-2d7795d25926 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.156761 Aug 23 18:53:22.123798 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3740/7347] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:21 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:23.145268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-952fe474-8e9a-4b91-b828-b4464837ee87 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:23.145884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-952fe474-8e9a-4b91-b828-b4464837ee87 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:23.153678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-952fe474-8e9a-4b91-b828-b4464837ee87 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:23.154162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-952fe474-8e9a-4b91-b828-b4464837ee87 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:23.154620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-952fe474-8e9a-4b91-b828-b4464837ee87 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:23.155315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-952fe474-8e9a-4b91-b828-b4464837ee87 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:23.155769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-952fe474-8e9a-4b91-b828-b4464837ee87 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:23.156217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-952fe474-8e9a-4b91-b828-b4464837ee87 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:23.289970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-952fe474-8e9a-4b91-b828-b4464837ee87 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:23.298630 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-952fe474-8e9a-4b91-b828-b4464837ee87 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.157292 Aug 23 18:53:23.299211 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3608/7348] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:23 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:24.319871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8dfa28cb-b809-40df-a3a2-386d550a29c7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:24.320506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8dfa28cb-b809-40df-a3a2-386d550a29c7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:24.327127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfa28cb-b809-40df-a3a2-386d550a29c7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:24.327625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfa28cb-b809-40df-a3a2-386d550a29c7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:24.328074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfa28cb-b809-40df-a3a2-386d550a29c7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:24.328775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfa28cb-b809-40df-a3a2-386d550a29c7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:24.329243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfa28cb-b809-40df-a3a2-386d550a29c7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:24.329681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8dfa28cb-b809-40df-a3a2-386d550a29c7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:24.466350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8dfa28cb-b809-40df-a3a2-386d550a29c7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:24.474154 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8dfa28cb-b809-40df-a3a2-386d550a29c7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.158170 Aug 23 18:53:24.474746 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3741/7349] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:24 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:25.496404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3661dd6f-1b6a-4010-87e1-b3e06e3cc7e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:25.497024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3661dd6f-1b6a-4010-87e1-b3e06e3cc7e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:25.503924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3661dd6f-1b6a-4010-87e1-b3e06e3cc7e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:25.504415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3661dd6f-1b6a-4010-87e1-b3e06e3cc7e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:25.504858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3661dd6f-1b6a-4010-87e1-b3e06e3cc7e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:25.505559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3661dd6f-1b6a-4010-87e1-b3e06e3cc7e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:25.506022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3661dd6f-1b6a-4010-87e1-b3e06e3cc7e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:25.506453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3661dd6f-1b6a-4010-87e1-b3e06e3cc7e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:25.641507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3661dd6f-1b6a-4010-87e1-b3e06e3cc7e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:25.649364 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3661dd6f-1b6a-4010-87e1-b3e06e3cc7e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.157409 Aug 23 18:53:25.649935 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3609/7350] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:25 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:26.671336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5edccd46-2d55-4c5b-a858-fed453f33ba7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:26.671959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5edccd46-2d55-4c5b-a858-fed453f33ba7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:26.678770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5edccd46-2d55-4c5b-a858-fed453f33ba7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:26.679264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5edccd46-2d55-4c5b-a858-fed453f33ba7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:26.679727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5edccd46-2d55-4c5b-a858-fed453f33ba7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:26.680410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5edccd46-2d55-4c5b-a858-fed453f33ba7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:26.680867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5edccd46-2d55-4c5b-a858-fed453f33ba7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:26.681300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5edccd46-2d55-4c5b-a858-fed453f33ba7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:26.815926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5edccd46-2d55-4c5b-a858-fed453f33ba7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:26.823893 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5edccd46-2d55-4c5b-a858-fed453f33ba7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.157304 Aug 23 18:53:26.824472 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3742/7351] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:26 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:27.845557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b07b466-dcba-4d93-9c41-71b0088382fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:27.846196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4b07b466-dcba-4d93-9c41-71b0088382fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:27.852364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b07b466-dcba-4d93-9c41-71b0088382fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:27.852850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b07b466-dcba-4d93-9c41-71b0088382fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:27.853291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b07b466-dcba-4d93-9c41-71b0088382fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:27.854578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b07b466-dcba-4d93-9c41-71b0088382fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:27.855128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b07b466-dcba-4d93-9c41-71b0088382fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:27.855559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b07b466-dcba-4d93-9c41-71b0088382fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:27.982716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4b07b466-dcba-4d93-9c41-71b0088382fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:27.990396 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b07b466-dcba-4d93-9c41-71b0088382fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.148925 Aug 23 18:53:27.990989 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3610/7352] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:27 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:53:29.011448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d9664079-5324-4e1c-8da9-7d2c5970383d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:29.012016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d9664079-5324-4e1c-8da9-7d2c5970383d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:29.018888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9664079-5324-4e1c-8da9-7d2c5970383d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:29.019382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9664079-5324-4e1c-8da9-7d2c5970383d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:29.019828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9664079-5324-4e1c-8da9-7d2c5970383d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:29.020524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9664079-5324-4e1c-8da9-7d2c5970383d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:29.020989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9664079-5324-4e1c-8da9-7d2c5970383d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:29.021422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d9664079-5324-4e1c-8da9-7d2c5970383d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:29.153312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d9664079-5324-4e1c-8da9-7d2c5970383d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:29.160995 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d9664079-5324-4e1c-8da9-7d2c5970383d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1655 microversion: 2.1 time: 0.153857 Aug 23 18:53:29.161550 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3743/7353] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:29 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1655 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:29.183085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:53:29.185311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:29.192133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:29.192613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:29.193047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:29.193735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:29.194183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:29.194650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:29.225991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:29.232752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Old instance type m1.heat2, new instance type m1.heat {{(pid=128807) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 18:53:29.239209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:53:29.239631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:53:29.240143 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:53:29.240554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:53:29.240960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:53:29.303655 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-604476d1-0e74-48f4-b2aa-d25f93dbccaa tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe/action" status: 202 len: 0 microversion: 2.1 time: 0.125070 Aug 23 18:53:29.304186 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3611/7354] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:53:29 2022] POST /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:53:29.312668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-500a43c3-6d26-40b6-bcba-2eeba5ec59c2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:29.313292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-500a43c3-6d26-40b6-bcba-2eeba5ec59c2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:29.319066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-500a43c3-6d26-40b6-bcba-2eeba5ec59c2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:29.319561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-500a43c3-6d26-40b6-bcba-2eeba5ec59c2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:29.320005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-500a43c3-6d26-40b6-bcba-2eeba5ec59c2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:29.320814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-500a43c3-6d26-40b6-bcba-2eeba5ec59c2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:29.321273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-500a43c3-6d26-40b6-bcba-2eeba5ec59c2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:29.321707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-500a43c3-6d26-40b6-bcba-2eeba5ec59c2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:29.506711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-500a43c3-6d26-40b6-bcba-2eeba5ec59c2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:29.516207 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-500a43c3-6d26-40b6-bcba-2eeba5ec59c2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.207278 Aug 23 18:53:29.516793 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3744/7355] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:29 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:30.540036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-24fc153a-5654-4855-ae73-4010a91b8687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:30.540637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-24fc153a-5654-4855-ae73-4010a91b8687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:30.546907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24fc153a-5654-4855-ae73-4010a91b8687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:30.547393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24fc153a-5654-4855-ae73-4010a91b8687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:30.547842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24fc153a-5654-4855-ae73-4010a91b8687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:30.548527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24fc153a-5654-4855-ae73-4010a91b8687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:30.548989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24fc153a-5654-4855-ae73-4010a91b8687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:30.549415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-24fc153a-5654-4855-ae73-4010a91b8687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:30.684581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-24fc153a-5654-4855-ae73-4010a91b8687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:30.692365 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-24fc153a-5654-4855-ae73-4010a91b8687 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.157114 Aug 23 18:53:30.692934 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3612/7356] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:30 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:31.713652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-37cf7b91-6631-424f-b65a-b3f6f9980fc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:31.715273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-37cf7b91-6631-424f-b65a-b3f6f9980fc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:31.722388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37cf7b91-6631-424f-b65a-b3f6f9980fc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:31.723054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37cf7b91-6631-424f-b65a-b3f6f9980fc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:31.723633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37cf7b91-6631-424f-b65a-b3f6f9980fc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:31.724475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37cf7b91-6631-424f-b65a-b3f6f9980fc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:31.725018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37cf7b91-6631-424f-b65a-b3f6f9980fc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:31.725445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-37cf7b91-6631-424f-b65a-b3f6f9980fc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:31.859815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-37cf7b91-6631-424f-b65a-b3f6f9980fc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:31.867730 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-37cf7b91-6631-424f-b65a-b3f6f9980fc1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.157935 Aug 23 18:53:31.868301 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3745/7357] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:31 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:32.889166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9ae26fcd-147d-4e44-a651-6402865282e6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:32.889696 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9ae26fcd-147d-4e44-a651-6402865282e6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:32.896705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ae26fcd-147d-4e44-a651-6402865282e6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:32.897185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ae26fcd-147d-4e44-a651-6402865282e6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:32.897621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ae26fcd-147d-4e44-a651-6402865282e6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:32.898311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ae26fcd-147d-4e44-a651-6402865282e6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:32.898790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ae26fcd-147d-4e44-a651-6402865282e6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:32.899217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9ae26fcd-147d-4e44-a651-6402865282e6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:33.028482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9ae26fcd-147d-4e44-a651-6402865282e6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:33.036180 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9ae26fcd-147d-4e44-a651-6402865282e6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.151130 Aug 23 18:53:33.036731 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3613/7358] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:32 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:34.058532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f131edf6-598c-49d9-9606-ff433f4d171d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:34.059264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f131edf6-598c-49d9-9606-ff433f4d171d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:34.066046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f131edf6-598c-49d9-9606-ff433f4d171d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:34.066562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f131edf6-598c-49d9-9606-ff433f4d171d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:34.067029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f131edf6-598c-49d9-9606-ff433f4d171d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:34.067738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f131edf6-598c-49d9-9606-ff433f4d171d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:34.068206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f131edf6-598c-49d9-9606-ff433f4d171d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:34.068644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f131edf6-598c-49d9-9606-ff433f4d171d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:34.197008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f131edf6-598c-49d9-9606-ff433f4d171d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:34.206499 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f131edf6-598c-49d9-9606-ff433f4d171d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.152437 Aug 23 18:53:34.207114 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3746/7359] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:34 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:35.228746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c0385f00-9ae4-4c50-8b24-62d19f924750 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:35.229418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c0385f00-9ae4-4c50-8b24-62d19f924750 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:35.237303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0385f00-9ae4-4c50-8b24-62d19f924750 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:35.237798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0385f00-9ae4-4c50-8b24-62d19f924750 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:35.238237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0385f00-9ae4-4c50-8b24-62d19f924750 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:35.239005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0385f00-9ae4-4c50-8b24-62d19f924750 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:35.239468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0385f00-9ae4-4c50-8b24-62d19f924750 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:35.239897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c0385f00-9ae4-4c50-8b24-62d19f924750 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:35.405897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c0385f00-9ae4-4c50-8b24-62d19f924750 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:35.413808 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c0385f00-9ae4-4c50-8b24-62d19f924750 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1678 microversion: 2.1 time: 0.189015 Aug 23 18:53:35.414379 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3614/7360] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:35 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:36.436457 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bab1c37b-cd3e-46f5-85e6-6296540af484 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:36.437131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bab1c37b-cd3e-46f5-85e6-6296540af484 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:36.443516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bab1c37b-cd3e-46f5-85e6-6296540af484 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:36.444009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bab1c37b-cd3e-46f5-85e6-6296540af484 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:36.444453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bab1c37b-cd3e-46f5-85e6-6296540af484 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:36.445151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bab1c37b-cd3e-46f5-85e6-6296540af484 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:36.445613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bab1c37b-cd3e-46f5-85e6-6296540af484 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:36.446047 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bab1c37b-cd3e-46f5-85e6-6296540af484 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:36.584801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bab1c37b-cd3e-46f5-85e6-6296540af484 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:36.593392 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bab1c37b-cd3e-46f5-85e6-6296540af484 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1683 microversion: 2.1 time: 0.161601 Aug 23 18:53:36.594092 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3747/7361] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:36 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:37.615398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e475939b-0d51-4838-a07e-70d25b64ecbd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:37.616708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e475939b-0d51-4838-a07e-70d25b64ecbd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:37.624818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e475939b-0d51-4838-a07e-70d25b64ecbd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:37.625314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e475939b-0d51-4838-a07e-70d25b64ecbd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:37.625754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e475939b-0d51-4838-a07e-70d25b64ecbd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:37.626498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e475939b-0d51-4838-a07e-70d25b64ecbd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:37.627000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e475939b-0d51-4838-a07e-70d25b64ecbd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:37.627437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e475939b-0d51-4838-a07e-70d25b64ecbd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:37.763646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e475939b-0d51-4838-a07e-70d25b64ecbd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:37.771495 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e475939b-0d51-4838-a07e-70d25b64ecbd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1682 microversion: 2.1 time: 0.160021 Aug 23 18:53:37.772067 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3615/7362] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:37 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:37.900814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-bded871e-279b-4b42-a4f4-72b20f2062de req-f683e94b-8809-4570-8137-2fd7689393ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639380c8-172e-482b-ba05-7939dafc76fe", "name": "network-vif-unplugged", "status": "completed", "tag": "031f54e6-30af-448c-aff2-ee6f7951f659"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:53:37.912105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bded871e-279b-4b42-a4f4-72b20f2062de req-f683e94b-8809-4570-8137-2fd7689393ed service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:37.912693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bded871e-279b-4b42-a4f4-72b20f2062de req-f683e94b-8809-4570-8137-2fd7689393ed service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:37.913202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bded871e-279b-4b42-a4f4-72b20f2062de req-f683e94b-8809-4570-8137-2fd7689393ed service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:37.925228 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-bded871e-279b-4b42-a4f4-72b20f2062de req-f683e94b-8809-4570-8137-2fd7689393ed service nova] Creating event network-vif-unplugged:031f54e6-30af-448c-aff2-ee6f7951f659 for instance 639380c8-172e-482b-ba05-7939dafc76fe on n-h2-850468-16 Aug 23 18:53:37.930769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-bded871e-279b-4b42-a4f4-72b20f2062de req-f683e94b-8809-4570-8137-2fd7689393ed service nova] Instance 639380c8-172e-482b-ba05-7939dafc76fe is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:53:37.944192 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-bded871e-279b-4b42-a4f4-72b20f2062de req-f683e94b-8809-4570-8137-2fd7689393ed service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047212 Aug 23 18:53:37.944803 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3748/7363] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:53:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:53:38.795102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d4a77e3e-92b2-4e14-b76b-2bbccfbb3182 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:38.795805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d4a77e3e-92b2-4e14-b76b-2bbccfbb3182 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:38.803002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4a77e3e-92b2-4e14-b76b-2bbccfbb3182 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:38.803564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4a77e3e-92b2-4e14-b76b-2bbccfbb3182 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:38.804099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4a77e3e-92b2-4e14-b76b-2bbccfbb3182 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:38.804809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4a77e3e-92b2-4e14-b76b-2bbccfbb3182 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:38.805271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4a77e3e-92b2-4e14-b76b-2bbccfbb3182 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:38.805701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4a77e3e-92b2-4e14-b76b-2bbccfbb3182 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:38.944747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d4a77e3e-92b2-4e14-b76b-2bbccfbb3182 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:38.953549 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d4a77e3e-92b2-4e14-b76b-2bbccfbb3182 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1682 microversion: 2.1 time: 0.163043 Aug 23 18:53:38.954121 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3616/7364] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:38 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:39.976987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa8e2199-f5e7-4d91-b1bf-79b49ca870d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:39.977718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa8e2199-f5e7-4d91-b1bf-79b49ca870d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:39.984812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa8e2199-f5e7-4d91-b1bf-79b49ca870d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:39.985311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa8e2199-f5e7-4d91-b1bf-79b49ca870d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:39.985790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa8e2199-f5e7-4d91-b1bf-79b49ca870d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:39.986501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa8e2199-f5e7-4d91-b1bf-79b49ca870d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:39.986997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa8e2199-f5e7-4d91-b1bf-79b49ca870d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:39.987434 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa8e2199-f5e7-4d91-b1bf-79b49ca870d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:39.988541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-c29ea0de-ffde-4f83-b640-0917acc89deb req-4a53bfc5-9f3b-456c-82b0-e3f5bfdce502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "639380c8-172e-482b-ba05-7939dafc76fe", "tag": "031f54e6-30af-448c-aff2-ee6f7951f659"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:53:39.999790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c29ea0de-ffde-4f83-b640-0917acc89deb req-4a53bfc5-9f3b-456c-82b0-e3f5bfdce502 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:40.000279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c29ea0de-ffde-4f83-b640-0917acc89deb req-4a53bfc5-9f3b-456c-82b0-e3f5bfdce502 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:40.000716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c29ea0de-ffde-4f83-b640-0917acc89deb req-4a53bfc5-9f3b-456c-82b0-e3f5bfdce502 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:40.016054 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-c29ea0de-ffde-4f83-b640-0917acc89deb req-4a53bfc5-9f3b-456c-82b0-e3f5bfdce502 service nova] Creating event network-changed:031f54e6-30af-448c-aff2-ee6f7951f659 for instance 639380c8-172e-482b-ba05-7939dafc76fe on n-h2-850468-16 Aug 23 18:53:40.021601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-c29ea0de-ffde-4f83-b640-0917acc89deb req-4a53bfc5-9f3b-456c-82b0-e3f5bfdce502 service nova] Instance 639380c8-172e-482b-ba05-7939dafc76fe is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:53:40.032657 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-c29ea0de-ffde-4f83-b640-0917acc89deb req-4a53bfc5-9f3b-456c-82b0-e3f5bfdce502 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047795 Aug 23 18:53:40.033285 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3617/7365] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:53:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:53:40.127510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aa8e2199-f5e7-4d91-b1bf-79b49ca870d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:40.135257 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa8e2199-f5e7-4d91-b1bf-79b49ca870d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1680 microversion: 2.1 time: 0.163502 Aug 23 18:53:40.135871 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3749/7366] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:39 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:41.157397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5e4e7a74-f2e9-4464-8c6e-b86dd70e67d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:41.158094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5e4e7a74-f2e9-4464-8c6e-b86dd70e67d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:41.165131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e4e7a74-f2e9-4464-8c6e-b86dd70e67d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:41.165618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e4e7a74-f2e9-4464-8c6e-b86dd70e67d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:41.166052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e4e7a74-f2e9-4464-8c6e-b86dd70e67d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:41.166794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e4e7a74-f2e9-4464-8c6e-b86dd70e67d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:41.167280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e4e7a74-f2e9-4464-8c6e-b86dd70e67d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:41.167702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5e4e7a74-f2e9-4464-8c6e-b86dd70e67d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:41.300284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5e4e7a74-f2e9-4464-8c6e-b86dd70e67d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:41.308638 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5e4e7a74-f2e9-4464-8c6e-b86dd70e67d3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1680 microversion: 2.1 time: 0.155521 Aug 23 18:53:41.309205 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3618/7367] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:41 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:53:42.329633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-323108dd-37c2-410b-9b92-f59738ab4eac tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:42.330214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-323108dd-37c2-410b-9b92-f59738ab4eac tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:42.337033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-323108dd-37c2-410b-9b92-f59738ab4eac tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:42.337533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-323108dd-37c2-410b-9b92-f59738ab4eac tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:42.337987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-323108dd-37c2-410b-9b92-f59738ab4eac tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:42.339501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-323108dd-37c2-410b-9b92-f59738ab4eac tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:42.340009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-323108dd-37c2-410b-9b92-f59738ab4eac tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:42.340703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-323108dd-37c2-410b-9b92-f59738ab4eac tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:42.471157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-323108dd-37c2-410b-9b92-f59738ab4eac tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:42.479122 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-323108dd-37c2-410b-9b92-f59738ab4eac tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1676 microversion: 2.1 time: 0.153529 Aug 23 18:53:42.479716 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3750/7368] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:42 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:42.500195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8a8852f2-25ba-498b-b43f-f4c40b2d8272 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:53:42.500720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8a8852f2-25ba-498b-b43f-f4c40b2d8272 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:42.507557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a8852f2-25ba-498b-b43f-f4c40b2d8272 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:42.508043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a8852f2-25ba-498b-b43f-f4c40b2d8272 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:42.508483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a8852f2-25ba-498b-b43f-f4c40b2d8272 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:42.509179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a8852f2-25ba-498b-b43f-f4c40b2d8272 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:42.509638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a8852f2-25ba-498b-b43f-f4c40b2d8272 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:42.510065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8a8852f2-25ba-498b-b43f-f4c40b2d8272 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:42.568711 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8a8852f2-25ba-498b-b43f-f4c40b2d8272 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe/action" status: 204 len: 0 microversion: 2.1 time: 0.072222 Aug 23 18:53:42.569374 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3619/7369] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:53:42 2022] POST /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe/action => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:53:42.578155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bd2bf8f5-a6b1-4f48-b11a-8ebbd729d60c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:42.578816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bd2bf8f5-a6b1-4f48-b11a-8ebbd729d60c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:42.584706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd2bf8f5-a6b1-4f48-b11a-8ebbd729d60c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:42.585148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd2bf8f5-a6b1-4f48-b11a-8ebbd729d60c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:42.585702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd2bf8f5-a6b1-4f48-b11a-8ebbd729d60c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:42.586504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd2bf8f5-a6b1-4f48-b11a-8ebbd729d60c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:42.587007 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd2bf8f5-a6b1-4f48-b11a-8ebbd729d60c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:42.587561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd2bf8f5-a6b1-4f48-b11a-8ebbd729d60c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:42.728121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bd2bf8f5-a6b1-4f48-b11a-8ebbd729d60c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:42.739308 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bd2bf8f5-a6b1-4f48-b11a-8ebbd729d60c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1676 microversion: 2.1 time: 0.164782 Aug 23 18:53:42.739918 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3751/7370] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:42 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1676 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:43.762730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1eb3f97c-e4d9-4ef8-9d14-719b457a7c84 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:43.763437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1eb3f97c-e4d9-4ef8-9d14-719b457a7c84 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:43.769619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1eb3f97c-e4d9-4ef8-9d14-719b457a7c84 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:43.770112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1eb3f97c-e4d9-4ef8-9d14-719b457a7c84 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:43.770560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1eb3f97c-e4d9-4ef8-9d14-719b457a7c84 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:43.771271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1eb3f97c-e4d9-4ef8-9d14-719b457a7c84 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:43.771730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1eb3f97c-e4d9-4ef8-9d14-719b457a7c84 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:43.772159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1eb3f97c-e4d9-4ef8-9d14-719b457a7c84 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:43.786985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:53:43.905327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1eb3f97c-e4d9-4ef8-9d14-719b457a7c84 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:43.912968 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1eb3f97c-e4d9-4ef8-9d14-719b457a7c84 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1676 microversion: 2.1 time: 0.155455 Aug 23 18:53:43.913539 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3620/7371] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:43 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:44.935462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-14cb63ae-59fb-4343-98b8-23719424ee2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:44.936124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-14cb63ae-59fb-4343-98b8-23719424ee2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:44.942887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14cb63ae-59fb-4343-98b8-23719424ee2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:44.943397 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14cb63ae-59fb-4343-98b8-23719424ee2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:44.943884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14cb63ae-59fb-4343-98b8-23719424ee2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:44.944605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14cb63ae-59fb-4343-98b8-23719424ee2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:44.945078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14cb63ae-59fb-4343-98b8-23719424ee2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:44.945523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-14cb63ae-59fb-4343-98b8-23719424ee2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:45.037192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-a8509ff2-003c-43b0-a195-3777ed707c56 req-c37dbb41-1db8-4639-8680-e2d614c097b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639380c8-172e-482b-ba05-7939dafc76fe", "name": "network-vif-plugged", "status": "completed", "tag": "031f54e6-30af-448c-aff2-ee6f7951f659"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:53:45.050340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a8509ff2-003c-43b0-a195-3777ed707c56 req-c37dbb41-1db8-4639-8680-e2d614c097b0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:45.051297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a8509ff2-003c-43b0-a195-3777ed707c56 req-c37dbb41-1db8-4639-8680-e2d614c097b0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:45.051951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a8509ff2-003c-43b0-a195-3777ed707c56 req-c37dbb41-1db8-4639-8680-e2d614c097b0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:45.073719 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-a8509ff2-003c-43b0-a195-3777ed707c56 req-c37dbb41-1db8-4639-8680-e2d614c097b0 service nova] Creating event network-vif-plugged:031f54e6-30af-448c-aff2-ee6f7951f659 for instance 639380c8-172e-482b-ba05-7939dafc76fe on n-h2-850468-16 Aug 23 18:53:45.079549 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-a8509ff2-003c-43b0-a195-3777ed707c56 req-c37dbb41-1db8-4639-8680-e2d614c097b0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046717 Aug 23 18:53:45.080491 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3621/7372] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:53:45.084777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-14cb63ae-59fb-4343-98b8-23719424ee2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:45.094135 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-14cb63ae-59fb-4343-98b8-23719424ee2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1655 microversion: 2.1 time: 0.162984 Aug 23 18:53:45.094900 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3752/7373] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:44 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1655 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:45.115471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a08af8bb-62a3-487b-8401-a3f4b7946dbb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:45.116208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a08af8bb-62a3-487b-8401-a3f4b7946dbb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:45.122452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a08af8bb-62a3-487b-8401-a3f4b7946dbb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:45.122972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a08af8bb-62a3-487b-8401-a3f4b7946dbb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:45.123416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a08af8bb-62a3-487b-8401-a3f4b7946dbb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:45.124114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a08af8bb-62a3-487b-8401-a3f4b7946dbb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:45.124573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a08af8bb-62a3-487b-8401-a3f4b7946dbb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:45.125005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a08af8bb-62a3-487b-8401-a3f4b7946dbb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:45.261697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a08af8bb-62a3-487b-8401-a3f4b7946dbb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:45.269510 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a08af8bb-62a3-487b-8401-a3f4b7946dbb tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1655 microversion: 2.1 time: 0.158271 Aug 23 18:53:45.270066 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3622/7374] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:45 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1655 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:45.290924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce34fd53-6a40-47f5-857d-058a57c91919 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:53:45.297490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce34fd53-6a40-47f5-857d-058a57c91919 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:45.297985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce34fd53-6a40-47f5-857d-058a57c91919 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:45.298444 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce34fd53-6a40-47f5-857d-058a57c91919 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:45.321015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ce34fd53-6a40-47f5-857d-058a57c91919 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Going to try to start instance {{(pid=128808) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 18:53:45.325403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:53:45.363870 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce34fd53-6a40-47f5-857d-058a57c91919 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe/action" status: 202 len: 0 microversion: 2.1 time: 0.076706 Aug 23 18:53:45.364472 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3753/7375] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:53:45 2022] POST /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:53:45.373602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-625ed91f-054b-48cf-8851-20f68568699b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:45.374220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-625ed91f-054b-48cf-8851-20f68568699b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:45.380756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-625ed91f-054b-48cf-8851-20f68568699b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:45.381417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-625ed91f-054b-48cf-8851-20f68568699b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:45.381950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-625ed91f-054b-48cf-8851-20f68568699b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:45.382704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-625ed91f-054b-48cf-8851-20f68568699b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:45.383168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-625ed91f-054b-48cf-8851-20f68568699b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:45.383602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-625ed91f-054b-48cf-8851-20f68568699b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:45.522869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-625ed91f-054b-48cf-8851-20f68568699b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:45.531498 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-625ed91f-054b-48cf-8851-20f68568699b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1664 microversion: 2.1 time: 0.162569 Aug 23 18:53:45.532085 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3623/7376] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:45 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1664 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:46.556629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-69fe900b-27a5-4635-a28d-245592de5eab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:46.557889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-69fe900b-27a5-4635-a28d-245592de5eab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:46.564398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69fe900b-27a5-4635-a28d-245592de5eab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:46.564908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69fe900b-27a5-4635-a28d-245592de5eab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:46.565361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69fe900b-27a5-4635-a28d-245592de5eab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:46.566081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69fe900b-27a5-4635-a28d-245592de5eab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:46.566570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69fe900b-27a5-4635-a28d-245592de5eab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:46.567022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-69fe900b-27a5-4635-a28d-245592de5eab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:46.783731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-69fe900b-27a5-4635-a28d-245592de5eab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:46.792000 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-69fe900b-27a5-4635-a28d-245592de5eab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1668 microversion: 2.1 time: 0.241765 Aug 23 18:53:46.793022 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3754/7377] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:46 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1668 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:46.813701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de3d12b7-f18d-4423-8229-686228392a68 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:46.814292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-de3d12b7-f18d-4423-8229-686228392a68 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:46.821286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de3d12b7-f18d-4423-8229-686228392a68 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:46.821779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de3d12b7-f18d-4423-8229-686228392a68 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:46.822221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de3d12b7-f18d-4423-8229-686228392a68 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:46.823546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de3d12b7-f18d-4423-8229-686228392a68 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:46.824015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de3d12b7-f18d-4423-8229-686228392a68 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:46.824470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de3d12b7-f18d-4423-8229-686228392a68 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:46.853662 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-de3d12b7-f18d-4423-8229-686228392a68 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:53:46.935923 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-de3d12b7-f18d-4423-8229-686228392a68 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "DELETE /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 204 len: 0 microversion: 2.1 time: 0.125536 Aug 23 18:53:46.936651 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3624/7378] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:53:46 2022] DELETE /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:53:46.945470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-40029317-dbfb-4f9b-9d05-e7cb59093498 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:46.946245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-40029317-dbfb-4f9b-9d05-e7cb59093498 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:46.953051 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40029317-dbfb-4f9b-9d05-e7cb59093498 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:46.953546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40029317-dbfb-4f9b-9d05-e7cb59093498 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:46.953992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40029317-dbfb-4f9b-9d05-e7cb59093498 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:46.954774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40029317-dbfb-4f9b-9d05-e7cb59093498 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:46.955220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40029317-dbfb-4f9b-9d05-e7cb59093498 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:46.955651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40029317-dbfb-4f9b-9d05-e7cb59093498 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:47.090955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-40029317-dbfb-4f9b-9d05-e7cb59093498 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:47.098683 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-40029317-dbfb-4f9b-9d05-e7cb59093498 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1674 microversion: 2.1 time: 0.157423 Aug 23 18:53:47.099257 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3755/7379] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:46 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:48.123883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bcdb0672-9606-4c54-b81a-6050b99c5b56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:48.124734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bcdb0672-9606-4c54-b81a-6050b99c5b56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:48.131867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bcdb0672-9606-4c54-b81a-6050b99c5b56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:48.132506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bcdb0672-9606-4c54-b81a-6050b99c5b56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:48.133022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bcdb0672-9606-4c54-b81a-6050b99c5b56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:48.133817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bcdb0672-9606-4c54-b81a-6050b99c5b56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:48.134347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bcdb0672-9606-4c54-b81a-6050b99c5b56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:48.134944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bcdb0672-9606-4c54-b81a-6050b99c5b56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:48.280770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bcdb0672-9606-4c54-b81a-6050b99c5b56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:48.288975 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bcdb0672-9606-4c54-b81a-6050b99c5b56 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1674 microversion: 2.1 time: 0.171834 Aug 23 18:53:48.289578 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3625/7380] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:48 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:49.231394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7b243e7a-c2fd-48ea-b0e7-b2e2ba17615a req-2b63758e-4524-416b-8c0f-5e69fb26dd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "639380c8-172e-482b-ba05-7939dafc76fe", "name": "network-vif-deleted", "tag": "031f54e6-30af-448c-aff2-ee6f7951f659"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:53:49.240152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=37 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:53:49.246096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7b243e7a-c2fd-48ea-b0e7-b2e2ba17615a req-2b63758e-4524-416b-8c0f-5e69fb26dd9c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:49.246630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7b243e7a-c2fd-48ea-b0e7-b2e2ba17615a req-2b63758e-4524-416b-8c0f-5e69fb26dd9c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:49.247075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7b243e7a-c2fd-48ea-b0e7-b2e2ba17615a req-2b63758e-4524-416b-8c0f-5e69fb26dd9c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:49.260499 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7b243e7a-c2fd-48ea-b0e7-b2e2ba17615a req-2b63758e-4524-416b-8c0f-5e69fb26dd9c service nova] Creating event network-vif-deleted:031f54e6-30af-448c-aff2-ee6f7951f659 for instance 639380c8-172e-482b-ba05-7939dafc76fe on n-h2-850468-16 Aug 23 18:53:49.266127 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7b243e7a-c2fd-48ea-b0e7-b2e2ba17615a req-2b63758e-4524-416b-8c0f-5e69fb26dd9c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039196 Aug 23 18:53:49.267102 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3756/7381] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:53:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:53:49.312461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:49.313308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:49.316931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:53:49.323406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:49.323987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:49.324430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:49.325149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:49.325612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:49.326038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:49.367342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:49.367835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:49.368277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:49.368734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lazy-loading 'fault' on Instance uuid 639380c8-172e-482b-ba05-7939dafc76fe {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:53:49.416767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:49.426203 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-82a3ada2-2a90-4750-906d-631879a6c557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 200 len: 1328 microversion: 2.1 time: 0.118417 Aug 23 18:53:49.427076 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3626/7382] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:49 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 1328 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:50.449076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-40b05224-ec26-4078-a3c0-db4d7a1b7048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:50.449801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-40b05224-ec26-4078-a3c0-db4d7a1b7048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:50.457008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40b05224-ec26-4078-a3c0-db4d7a1b7048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:50.457508 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40b05224-ec26-4078-a3c0-db4d7a1b7048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:50.457960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40b05224-ec26-4078-a3c0-db4d7a1b7048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:50.458706 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40b05224-ec26-4078-a3c0-db4d7a1b7048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:50.459179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40b05224-ec26-4078-a3c0-db4d7a1b7048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:50.459621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-40b05224-ec26-4078-a3c0-db4d7a1b7048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:50.473224 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-40b05224-ec26-4078-a3c0-db4d7a1b7048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-40b05224-ec26-4078-a3c0-db4d7a1b7048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe HTTP/1.1 Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '639380c8-172e-482b-ba05-7939dafc76fe'} Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:53:50.474906 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:53:50.480137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:53:50.480137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:53:50.480137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:53:50.480137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:53:50.480137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:53:50.480137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:53:50.480137 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:53:50.480137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-40b05224-ec26-4078-a3c0-db4d7a1b7048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:53:50.480137 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-40b05224-ec26-4078-a3c0-db4d7a1b7048 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 404 len: 111 microversion: 2.1 time: 0.031582 Aug 23 18:53:50.480137 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3757/7383] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:50 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:53:50.496545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bef386b6-0968-43a6-911d-71eef4c59a19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:50.497163 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bef386b6-0968-43a6-911d-71eef4c59a19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:50.503868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bef386b6-0968-43a6-911d-71eef4c59a19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:50.504357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bef386b6-0968-43a6-911d-71eef4c59a19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:50.504795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bef386b6-0968-43a6-911d-71eef4c59a19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:50.505496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bef386b6-0968-43a6-911d-71eef4c59a19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:50.505951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bef386b6-0968-43a6-911d-71eef4c59a19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:50.506378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bef386b6-0968-43a6-911d-71eef4c59a19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:50.519593 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-bef386b6-0968-43a6-911d-71eef4c59a19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bef386b6-0968-43a6-911d-71eef4c59a19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe HTTP/1.1 Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '639380c8-172e-482b-ba05-7939dafc76fe'} Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:53:50.521237 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:53:50.525624 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:53:50.525624 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:53:50.525624 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:53:50.525624 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:53:50.525624 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:53:50.525624 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:53:50.525624 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:53:50.525624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bef386b6-0968-43a6-911d-71eef4c59a19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:53:50.525624 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bef386b6-0968-43a6-911d-71eef4c59a19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 404 len: 111 microversion: 2.1 time: 0.030864 Aug 23 18:53:50.525624 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3627/7384] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:50 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:53:50.571256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1139877111", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "3617bced-c0f9-4fd5-b74f-8bf14b45f3c8"}], "security_groups": [{"name": "tempest-securitygroup--974773066"}], "key_name": "tempest-keypair-1650899182", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:53:50.679685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] validate_networks() for [('3617bced-c0f9-4fd5-b74f-8bf14b45f3c8', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:53:51.049893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:53:51.050356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:53:51.050872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:53:51.051325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:53:51.051749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:53:51.061405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:51.061894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:51.062339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:51.063111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:51.063578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:51.064012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:51.081471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:53:51.086963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for user b1b1944b15d547e4b68df40cb65a74a6 and project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:53:51.099701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:53:51.102000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:53:51.150888 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac0d8b61-9721-4b6d-ada5-96ac4502a34d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.583349 Aug 23 18:53:51.151808 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3758/7385] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:53:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:53:51.163053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-53554a98-23ed-485c-85ed-e7b66bae2bed tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:51.163670 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-53554a98-23ed-485c-85ed-e7b66bae2bed tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:51.224204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-53554a98-23ed-485c-85ed-e7b66bae2bed tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:51.232185 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-53554a98-23ed-485c-85ed-e7b66bae2bed tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1239 microversion: 2.1 time: 0.073162 Aug 23 18:53:51.233158 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3628/7386] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:51 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1239 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:52.255648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c70b5f8d-e765-4ebf-bcc0-fff6277ed608 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:52.256190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c70b5f8d-e765-4ebf-bcc0-fff6277ed608 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:52.264759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c70b5f8d-e765-4ebf-bcc0-fff6277ed608 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:52.265272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c70b5f8d-e765-4ebf-bcc0-fff6277ed608 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:52.265735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c70b5f8d-e765-4ebf-bcc0-fff6277ed608 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:52.266463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c70b5f8d-e765-4ebf-bcc0-fff6277ed608 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:52.266966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c70b5f8d-e765-4ebf-bcc0-fff6277ed608 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:52.267414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c70b5f8d-e765-4ebf-bcc0-fff6277ed608 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:52.366313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c70b5f8d-e765-4ebf-bcc0-fff6277ed608 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:52.376011 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c70b5f8d-e765-4ebf-bcc0-fff6277ed608 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1291 microversion: 2.1 time: 0.123864 Aug 23 18:53:52.377128 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3759/7387] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:52 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1291 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:53.400073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-44f6fdaf-411b-4a3e-8930-6d560e26c432 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:53.401676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-44f6fdaf-411b-4a3e-8930-6d560e26c432 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:53.409344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44f6fdaf-411b-4a3e-8930-6d560e26c432 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:53.409909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44f6fdaf-411b-4a3e-8930-6d560e26c432 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:53.410580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44f6fdaf-411b-4a3e-8930-6d560e26c432 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:53.411393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44f6fdaf-411b-4a3e-8930-6d560e26c432 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:53.411927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44f6fdaf-411b-4a3e-8930-6d560e26c432 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:53.412429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44f6fdaf-411b-4a3e-8930-6d560e26c432 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:53.651570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-44f6fdaf-411b-4a3e-8930-6d560e26c432 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:53.659593 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-44f6fdaf-411b-4a3e-8930-6d560e26c432 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1364 microversion: 2.1 time: 0.263525 Aug 23 18:53:53.660172 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3629/7388] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:53 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:53.902464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-b1acaacd-7026-476f-b1ed-0e96eab1214f req-ff082f83-dcd5-4d74-bff3-9383635bff10 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca799a2-75ee-4936-8eb6-478d2363d9c8", "tag": "92fee22c-5739-4057-a3f6-6bb8fb20e0df"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:53:53.914700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b1acaacd-7026-476f-b1ed-0e96eab1214f req-ff082f83-dcd5-4d74-bff3-9383635bff10 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:53.915416 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b1acaacd-7026-476f-b1ed-0e96eab1214f req-ff082f83-dcd5-4d74-bff3-9383635bff10 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:53.916034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-b1acaacd-7026-476f-b1ed-0e96eab1214f req-ff082f83-dcd5-4d74-bff3-9383635bff10 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:53.929043 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-b1acaacd-7026-476f-b1ed-0e96eab1214f req-ff082f83-dcd5-4d74-bff3-9383635bff10 service nova] Creating event network-changed:92fee22c-5739-4057-a3f6-6bb8fb20e0df for instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 on n-h1-850468-16 Aug 23 18:53:53.934871 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-b1acaacd-7026-476f-b1ed-0e96eab1214f req-ff082f83-dcd5-4d74-bff3-9383635bff10 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036489 Aug 23 18:53:53.935663 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3760/7389] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:53:54.681465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6447317-bcbd-4b79-bbac-7eb0d7264376 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:54.682283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6447317-bcbd-4b79-bbac-7eb0d7264376 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:54.689251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6447317-bcbd-4b79-bbac-7eb0d7264376 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:54.689745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6447317-bcbd-4b79-bbac-7eb0d7264376 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:54.690189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6447317-bcbd-4b79-bbac-7eb0d7264376 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:54.690933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6447317-bcbd-4b79-bbac-7eb0d7264376 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:54.691394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6447317-bcbd-4b79-bbac-7eb0d7264376 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:54.691829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6447317-bcbd-4b79-bbac-7eb0d7264376 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:54.825394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f6447317-bcbd-4b79-bbac-7eb0d7264376 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:54.833133 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6447317-bcbd-4b79-bbac-7eb0d7264376 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1364 microversion: 2.1 time: 0.155680 Aug 23 18:53:54.833705 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3630/7390] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:54 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:55.857331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c0039c42-9f3a-4f16-80cd-9305cbd156ba tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:55.858049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c0039c42-9f3a-4f16-80cd-9305cbd156ba tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:55.864176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0039c42-9f3a-4f16-80cd-9305cbd156ba tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:55.864677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0039c42-9f3a-4f16-80cd-9305cbd156ba tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:55.865130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0039c42-9f3a-4f16-80cd-9305cbd156ba tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:55.865831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0039c42-9f3a-4f16-80cd-9305cbd156ba tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:55.866296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0039c42-9f3a-4f16-80cd-9305cbd156ba tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:55.866763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c0039c42-9f3a-4f16-80cd-9305cbd156ba tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:55.995082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c0039c42-9f3a-4f16-80cd-9305cbd156ba tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:56.002843 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c0039c42-9f3a-4f16-80cd-9305cbd156ba tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1364 microversion: 2.1 time: 0.151172 Aug 23 18:53:56.003409 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3761/7391] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:55 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:57.024421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2c04da45-a59b-4660-be47-78f1c9c19135 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:57.025043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2c04da45-a59b-4660-be47-78f1c9c19135 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:57.032057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c04da45-a59b-4660-be47-78f1c9c19135 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:57.032542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c04da45-a59b-4660-be47-78f1c9c19135 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:57.032983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c04da45-a59b-4660-be47-78f1c9c19135 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:57.033679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c04da45-a59b-4660-be47-78f1c9c19135 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:57.034135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c04da45-a59b-4660-be47-78f1c9c19135 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:57.034586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c04da45-a59b-4660-be47-78f1c9c19135 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:57.171621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2c04da45-a59b-4660-be47-78f1c9c19135 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:57.180208 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2c04da45-a59b-4660-be47-78f1c9c19135 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1364 microversion: 2.1 time: 0.159683 Aug 23 18:53:57.180684 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3631/7392] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:57 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:58.201512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7ef25b2-4b7b-4597-9709-048241b3154c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:58.202165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f7ef25b2-4b7b-4597-9709-048241b3154c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:58.209304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7ef25b2-4b7b-4597-9709-048241b3154c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:58.209802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7ef25b2-4b7b-4597-9709-048241b3154c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:58.210253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7ef25b2-4b7b-4597-9709-048241b3154c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:58.210990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7ef25b2-4b7b-4597-9709-048241b3154c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:58.211463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7ef25b2-4b7b-4597-9709-048241b3154c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:58.211901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7ef25b2-4b7b-4597-9709-048241b3154c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:58.341971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f7ef25b2-4b7b-4597-9709-048241b3154c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:58.349568 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f7ef25b2-4b7b-4597-9709-048241b3154c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1364 microversion: 2.1 time: 0.152038 Aug 23 18:53:58.350125 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3762/7393] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:58 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:59.371854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8efe71f7-b764-4b10-b366-594a0b7f8c6c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:53:59.372495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8efe71f7-b764-4b10-b366-594a0b7f8c6c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:53:59.379411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8efe71f7-b764-4b10-b366-594a0b7f8c6c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:59.379914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8efe71f7-b764-4b10-b366-594a0b7f8c6c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:59.380335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8efe71f7-b764-4b10-b366-594a0b7f8c6c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:59.381034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8efe71f7-b764-4b10-b366-594a0b7f8c6c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:59.381501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8efe71f7-b764-4b10-b366-594a0b7f8c6c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:59.381928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8efe71f7-b764-4b10-b366-594a0b7f8c6c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:59.509776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8efe71f7-b764-4b10-b366-594a0b7f8c6c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:53:59.518315 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8efe71f7-b764-4b10-b366-594a0b7f8c6c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1364 microversion: 2.1 time: 0.150513 Aug 23 18:53:59.518919 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3632/7394] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:53:59 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:53:59.733858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-613b9664-97fa-413c-abd3-06ef6d050187 req-e1e4bde6-f3fb-4818-af19-42969757060f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca799a2-75ee-4936-8eb6-478d2363d9c8", "name": "network-vif-plugged", "status": "completed", "tag": "92fee22c-5739-4057-a3f6-6bb8fb20e0df"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:53:59.744083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-613b9664-97fa-413c-abd3-06ef6d050187 req-e1e4bde6-f3fb-4818-af19-42969757060f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:53:59.745232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-613b9664-97fa-413c-abd3-06ef6d050187 req-e1e4bde6-f3fb-4818-af19-42969757060f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:53:59.746228 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-613b9664-97fa-413c-abd3-06ef6d050187 req-e1e4bde6-f3fb-4818-af19-42969757060f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:53:59.757312 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-613b9664-97fa-413c-abd3-06ef6d050187 req-e1e4bde6-f3fb-4818-af19-42969757060f service nova] Creating event network-vif-plugged:92fee22c-5739-4057-a3f6-6bb8fb20e0df for instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 on n-h1-850468-16 Aug 23 18:53:59.763219 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-613b9664-97fa-413c-abd3-06ef6d050187 req-e1e4bde6-f3fb-4818-af19-42969757060f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032965 Aug 23 18:53:59.763822 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3763/7395] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:53:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:54:00.540164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2bd7443a-db53-4045-8b6d-839ff67de0de tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:54:00.540775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2bd7443a-db53-4045-8b6d-839ff67de0de tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:54:00.548609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bd7443a-db53-4045-8b6d-839ff67de0de tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:54:00.548873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bd7443a-db53-4045-8b6d-839ff67de0de tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:54:00.549310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bd7443a-db53-4045-8b6d-839ff67de0de tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:54:00.550009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bd7443a-db53-4045-8b6d-839ff67de0de tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:54:00.550459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bd7443a-db53-4045-8b6d-839ff67de0de tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:54:00.550908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2bd7443a-db53-4045-8b6d-839ff67de0de tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:54:00.684729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2bd7443a-db53-4045-8b6d-839ff67de0de tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:54:00.692578 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2bd7443a-db53-4045-8b6d-839ff67de0de tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1364 microversion: 2.1 time: 0.156312 Aug 23 18:54:00.693136 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3633/7396] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:54:00 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:54:01.712220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:54:01.713498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:54:01.719016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9ca65c07-231c-4d63-89aa-e9b310e34482 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:54:01.719770 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9ca65c07-231c-4d63-89aa-e9b310e34482 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:54:01.727239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ca65c07-231c-4d63-89aa-e9b310e34482 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:54:01.727736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ca65c07-231c-4d63-89aa-e9b310e34482 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:54:01.728191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ca65c07-231c-4d63-89aa-e9b310e34482 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:54:01.729484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ca65c07-231c-4d63-89aa-e9b310e34482 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:54:01.730306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ca65c07-231c-4d63-89aa-e9b310e34482 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:54:01.730838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9ca65c07-231c-4d63-89aa-e9b310e34482 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:54:01.920758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9ca65c07-231c-4d63-89aa-e9b310e34482 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:54:01.928543 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9ca65c07-231c-4d63-89aa-e9b310e34482 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1551 microversion: 2.1 time: 0.219017 Aug 23 18:54:01.929119 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3764/7397] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:54:01 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1551 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:54:01.950683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-81641655-fbdd-4ad9-9bee-a00d13ef9841 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:54:01.951210 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-81641655-fbdd-4ad9-9bee-a00d13ef9841 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:54:01.954618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:54:01.959669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81641655-fbdd-4ad9-9bee-a00d13ef9841 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:54:01.960157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81641655-fbdd-4ad9-9bee-a00d13ef9841 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:54:01.960594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81641655-fbdd-4ad9-9bee-a00d13ef9841 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:54:01.961289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81641655-fbdd-4ad9-9bee-a00d13ef9841 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:54:01.961747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81641655-fbdd-4ad9-9bee-a00d13ef9841 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:54:01.962170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-81641655-fbdd-4ad9-9bee-a00d13ef9841 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:54:02.040620 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-81641655-fbdd-4ad9-9bee-a00d13ef9841 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094419 Aug 23 18:54:02.041273 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3634/7398] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:54:01 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:54:03.253917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5f13af05-1ac1-4744-b57a-4db797b5581f req-dea81e42-c103-4143-adf5-a93b8baa59eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca799a2-75ee-4936-8eb6-478d2363d9c8", "tag": "92fee22c-5739-4057-a3f6-6bb8fb20e0df"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:54:03.264279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5f13af05-1ac1-4744-b57a-4db797b5581f req-dea81e42-c103-4143-adf5-a93b8baa59eb service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:54:03.264768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5f13af05-1ac1-4744-b57a-4db797b5581f req-dea81e42-c103-4143-adf5-a93b8baa59eb service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:54:03.265213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5f13af05-1ac1-4744-b57a-4db797b5581f req-dea81e42-c103-4143-adf5-a93b8baa59eb service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:54:03.276818 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5f13af05-1ac1-4744-b57a-4db797b5581f req-dea81e42-c103-4143-adf5-a93b8baa59eb service nova] Creating event network-changed:92fee22c-5739-4057-a3f6-6bb8fb20e0df for instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 on n-h1-850468-16 Aug 23 18:54:03.281821 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5f13af05-1ac1-4744-b57a-4db797b5581f req-dea81e42-c103-4143-adf5-a93b8baa59eb service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031550 Aug 23 18:54:03.282926 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3765/7399] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:54:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:55:17.083344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=21 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:55:17.084081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:55:17.133794 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:55:17.136144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:17.142275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:17.142801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:17.143246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:17.143940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:17.144398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:17.144833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:17.173682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:17.179403 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Old instance type m1.heat2, new instance type m1.heat {{(pid=128807) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 18:55:17.187952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:55:17.188394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:55:17.188886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:55:17.189315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:55:17.189734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:55:17.256609 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff0aadc4-a6a7-4dc7-b1c0-35f9cefc9ec6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8/action" status: 202 len: 0 microversion: 2.1 time: 0.175628 Aug 23 18:55:17.257231 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3635/7400] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:55:17 2022] POST /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8/action => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:55:17.265085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:55:17.265857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:55:17.270532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d7a84aad-d239-4f86-ab23-e1656b982201 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:17.271244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d7a84aad-d239-4f86-ab23-e1656b982201 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:17.280326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7a84aad-d239-4f86-ab23-e1656b982201 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:17.280983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7a84aad-d239-4f86-ab23-e1656b982201 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:17.281477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7a84aad-d239-4f86-ab23-e1656b982201 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:17.282302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7a84aad-d239-4f86-ab23-e1656b982201 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:17.282812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7a84aad-d239-4f86-ab23-e1656b982201 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:17.283260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d7a84aad-d239-4f86-ab23-e1656b982201 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:17.445133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d7a84aad-d239-4f86-ab23-e1656b982201 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:17.453884 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d7a84aad-d239-4f86-ab23-e1656b982201 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1678 microversion: 2.1 time: 0.192167 Aug 23 18:55:17.454457 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3766/7401] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:17 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:18.475266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7ffe4ed6-4c30-4ab7-a2f6-ed81faa2fa20 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:18.475896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7ffe4ed6-4c30-4ab7-a2f6-ed81faa2fa20 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:18.484519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ffe4ed6-4c30-4ab7-a2f6-ed81faa2fa20 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:18.485009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ffe4ed6-4c30-4ab7-a2f6-ed81faa2fa20 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:18.485443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ffe4ed6-4c30-4ab7-a2f6-ed81faa2fa20 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:18.486141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ffe4ed6-4c30-4ab7-a2f6-ed81faa2fa20 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:18.486797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ffe4ed6-4c30-4ab7-a2f6-ed81faa2fa20 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:18.487028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7ffe4ed6-4c30-4ab7-a2f6-ed81faa2fa20 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:18.736540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7ffe4ed6-4c30-4ab7-a2f6-ed81faa2fa20 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:18.744294 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7ffe4ed6-4c30-4ab7-a2f6-ed81faa2fa20 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1678 microversion: 2.1 time: 0.272931 Aug 23 18:55:18.744870 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3636/7402] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:18 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1678 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:19.765374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-12ee23b1-3927-45d0-aa6d-e44508374f26 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:19.765933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-12ee23b1-3927-45d0-aa6d-e44508374f26 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:19.772707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12ee23b1-3927-45d0-aa6d-e44508374f26 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:19.773206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12ee23b1-3927-45d0-aa6d-e44508374f26 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:19.773658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12ee23b1-3927-45d0-aa6d-e44508374f26 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:19.774364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12ee23b1-3927-45d0-aa6d-e44508374f26 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:19.774864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12ee23b1-3927-45d0-aa6d-e44508374f26 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:19.775311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-12ee23b1-3927-45d0-aa6d-e44508374f26 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:19.906136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-12ee23b1-3927-45d0-aa6d-e44508374f26 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:19.913882 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-12ee23b1-3927-45d0-aa6d-e44508374f26 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.152550 Aug 23 18:55:19.914452 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3767/7403] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:19 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:20.937817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b56c1a10-8c69-492e-9a00-8d0b30b50e15 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:20.938370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b56c1a10-8c69-492e-9a00-8d0b30b50e15 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:20.945191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b56c1a10-8c69-492e-9a00-8d0b30b50e15 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:20.945671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b56c1a10-8c69-492e-9a00-8d0b30b50e15 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:20.946109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b56c1a10-8c69-492e-9a00-8d0b30b50e15 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:20.946826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b56c1a10-8c69-492e-9a00-8d0b30b50e15 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:20.947278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b56c1a10-8c69-492e-9a00-8d0b30b50e15 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:20.947699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b56c1a10-8c69-492e-9a00-8d0b30b50e15 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:21.089444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b56c1a10-8c69-492e-9a00-8d0b30b50e15 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:21.097871 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b56c1a10-8c69-492e-9a00-8d0b30b50e15 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.165150 Aug 23 18:55:21.098441 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3637/7404] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:20 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:22.119778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-897ca44d-c690-4575-9203-a8b7b1a1ad75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:22.120428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-897ca44d-c690-4575-9203-a8b7b1a1ad75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:22.127959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-897ca44d-c690-4575-9203-a8b7b1a1ad75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:22.128455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-897ca44d-c690-4575-9203-a8b7b1a1ad75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:22.128902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-897ca44d-c690-4575-9203-a8b7b1a1ad75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:22.129609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-897ca44d-c690-4575-9203-a8b7b1a1ad75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:22.130071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-897ca44d-c690-4575-9203-a8b7b1a1ad75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:22.130503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-897ca44d-c690-4575-9203-a8b7b1a1ad75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:22.266806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-897ca44d-c690-4575-9203-a8b7b1a1ad75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:22.274688 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-897ca44d-c690-4575-9203-a8b7b1a1ad75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.158653 Aug 23 18:55:22.275262 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3768/7405] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:22 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:23.296687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-761bd0a7-86bd-49eb-b643-f975f152d49a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:23.297300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-761bd0a7-86bd-49eb-b643-f975f152d49a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:23.304114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-761bd0a7-86bd-49eb-b643-f975f152d49a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:23.304594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-761bd0a7-86bd-49eb-b643-f975f152d49a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:23.305034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-761bd0a7-86bd-49eb-b643-f975f152d49a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:23.305730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-761bd0a7-86bd-49eb-b643-f975f152d49a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:23.306188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-761bd0a7-86bd-49eb-b643-f975f152d49a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:23.306669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-761bd0a7-86bd-49eb-b643-f975f152d49a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:23.437408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-761bd0a7-86bd-49eb-b643-f975f152d49a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:23.445182 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-761bd0a7-86bd-49eb-b643-f975f152d49a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.152628 Aug 23 18:55:23.445748 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3638/7406] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:23 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:24.466755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac1bda34-7ec2-4c52-84db-e1b4143a7fe6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:24.467393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac1bda34-7ec2-4c52-84db-e1b4143a7fe6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:24.473932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac1bda34-7ec2-4c52-84db-e1b4143a7fe6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:24.474435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac1bda34-7ec2-4c52-84db-e1b4143a7fe6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:24.474905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac1bda34-7ec2-4c52-84db-e1b4143a7fe6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:24.475602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac1bda34-7ec2-4c52-84db-e1b4143a7fe6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:24.476062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac1bda34-7ec2-4c52-84db-e1b4143a7fe6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:24.476494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac1bda34-7ec2-4c52-84db-e1b4143a7fe6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:24.606943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac1bda34-7ec2-4c52-84db-e1b4143a7fe6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:24.615136 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac1bda34-7ec2-4c52-84db-e1b4143a7fe6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.152519 Aug 23 18:55:24.615715 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3769/7407] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:24 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:25.636843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9788b78d-39de-46ef-a746-737f47f0469a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:25.637615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9788b78d-39de-46ef-a746-737f47f0469a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:25.644549 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9788b78d-39de-46ef-a746-737f47f0469a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:25.645037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9788b78d-39de-46ef-a746-737f47f0469a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:25.645480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9788b78d-39de-46ef-a746-737f47f0469a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:25.646170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9788b78d-39de-46ef-a746-737f47f0469a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:25.646654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9788b78d-39de-46ef-a746-737f47f0469a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:25.647083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9788b78d-39de-46ef-a746-737f47f0469a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:25.786640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9788b78d-39de-46ef-a746-737f47f0469a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:25.794570 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9788b78d-39de-46ef-a746-737f47f0469a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.161746 Aug 23 18:55:25.795146 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3639/7408] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:25 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:26.815621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7ca76a65-30c3-4614-a89d-b2ec44d2c651 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:26.816256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7ca76a65-30c3-4614-a89d-b2ec44d2c651 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:26.823393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ca76a65-30c3-4614-a89d-b2ec44d2c651 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:26.823901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ca76a65-30c3-4614-a89d-b2ec44d2c651 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:26.824670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ca76a65-30c3-4614-a89d-b2ec44d2c651 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:26.825594 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ca76a65-30c3-4614-a89d-b2ec44d2c651 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:26.826075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ca76a65-30c3-4614-a89d-b2ec44d2c651 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:26.826560 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ca76a65-30c3-4614-a89d-b2ec44d2c651 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:26.959168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7ca76a65-30c3-4614-a89d-b2ec44d2c651 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:26.969448 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7ca76a65-30c3-4614-a89d-b2ec44d2c651 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.157632 Aug 23 18:55:26.970203 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3770/7409] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:26 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:27.991176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5812b006-7f50-4748-9233-b956f9e0d0e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:27.991789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5812b006-7f50-4748-9233-b956f9e0d0e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:27.998407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5812b006-7f50-4748-9233-b956f9e0d0e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:27.998914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5812b006-7f50-4748-9233-b956f9e0d0e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:27.999355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5812b006-7f50-4748-9233-b956f9e0d0e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:28.000045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5812b006-7f50-4748-9233-b956f9e0d0e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:28.000529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5812b006-7f50-4748-9233-b956f9e0d0e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:28.000999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5812b006-7f50-4748-9233-b956f9e0d0e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:28.129137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5812b006-7f50-4748-9233-b956f9e0d0e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:28.137585 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5812b006-7f50-4748-9233-b956f9e0d0e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.149714 Aug 23 18:55:28.138225 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3640/7410] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:27 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:29.159197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-903d1b1c-3c27-46c5-824f-f77a220cef2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:29.159847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-903d1b1c-3c27-46c5-824f-f77a220cef2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:29.166727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-903d1b1c-3c27-46c5-824f-f77a220cef2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:29.167226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-903d1b1c-3c27-46c5-824f-f77a220cef2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:29.167677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-903d1b1c-3c27-46c5-824f-f77a220cef2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:29.168456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-903d1b1c-3c27-46c5-824f-f77a220cef2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:29.168925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-903d1b1c-3c27-46c5-824f-f77a220cef2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:29.169362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-903d1b1c-3c27-46c5-824f-f77a220cef2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:29.302686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-903d1b1c-3c27-46c5-824f-f77a220cef2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:29.311368 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-903d1b1c-3c27-46c5-824f-f77a220cef2f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.156102 Aug 23 18:55:29.311924 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3771/7411] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:29 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:30.333604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9c72506e-57ff-420e-bfb5-bd13314babb3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:30.334226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9c72506e-57ff-420e-bfb5-bd13314babb3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:30.341899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c72506e-57ff-420e-bfb5-bd13314babb3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:30.342391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c72506e-57ff-420e-bfb5-bd13314babb3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:30.342980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c72506e-57ff-420e-bfb5-bd13314babb3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:30.343680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c72506e-57ff-420e-bfb5-bd13314babb3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:30.344142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c72506e-57ff-420e-bfb5-bd13314babb3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:30.344575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c72506e-57ff-420e-bfb5-bd13314babb3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:30.477182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9c72506e-57ff-420e-bfb5-bd13314babb3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:30.485703 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9c72506e-57ff-420e-bfb5-bd13314babb3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.156124 Aug 23 18:55:30.486275 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3641/7412] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:30 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:31.507073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-65272c47-1efe-4fa7-ae44-e12389e32691 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:31.507606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-65272c47-1efe-4fa7-ae44-e12389e32691 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:31.515244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65272c47-1efe-4fa7-ae44-e12389e32691 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:31.515743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65272c47-1efe-4fa7-ae44-e12389e32691 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:31.516183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65272c47-1efe-4fa7-ae44-e12389e32691 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:31.516883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65272c47-1efe-4fa7-ae44-e12389e32691 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:31.517347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65272c47-1efe-4fa7-ae44-e12389e32691 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:31.517785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65272c47-1efe-4fa7-ae44-e12389e32691 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:31.649710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65272c47-1efe-4fa7-ae44-e12389e32691 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:31.658588 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-65272c47-1efe-4fa7-ae44-e12389e32691 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.155369 Aug 23 18:55:31.659162 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3772/7413] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:31 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:32.680962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2c8974db-710b-4988-842d-5bfad175e557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:32.681589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2c8974db-710b-4988-842d-5bfad175e557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:32.689284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c8974db-710b-4988-842d-5bfad175e557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:32.689772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c8974db-710b-4988-842d-5bfad175e557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:32.690214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c8974db-710b-4988-842d-5bfad175e557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:32.691011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c8974db-710b-4988-842d-5bfad175e557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:32.691479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c8974db-710b-4988-842d-5bfad175e557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:32.691907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2c8974db-710b-4988-842d-5bfad175e557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:32.844839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2c8974db-710b-4988-842d-5bfad175e557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:32.852542 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2c8974db-710b-4988-842d-5bfad175e557 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.175484 Aug 23 18:55:32.853110 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3642/7414] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:32 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:33.875057 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-82d07ae6-6629-4a59-8d80-8f06c35d9f24 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:33.875688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-82d07ae6-6629-4a59-8d80-8f06c35d9f24 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:33.882510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82d07ae6-6629-4a59-8d80-8f06c35d9f24 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:33.883044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82d07ae6-6629-4a59-8d80-8f06c35d9f24 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:33.883503 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82d07ae6-6629-4a59-8d80-8f06c35d9f24 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:33.884282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82d07ae6-6629-4a59-8d80-8f06c35d9f24 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:33.884690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82d07ae6-6629-4a59-8d80-8f06c35d9f24 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:33.885132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-82d07ae6-6629-4a59-8d80-8f06c35d9f24 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:34.017190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-82d07ae6-6629-4a59-8d80-8f06c35d9f24 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:34.024923 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-82d07ae6-6629-4a59-8d80-8f06c35d9f24 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.153778 Aug 23 18:55:34.025488 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3773/7415] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:33 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:35.046633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96c4f2ff-0c9e-4c2f-8c20-e140b3bb4082 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:35.047154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-96c4f2ff-0c9e-4c2f-8c20-e140b3bb4082 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:35.053861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96c4f2ff-0c9e-4c2f-8c20-e140b3bb4082 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:35.054343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96c4f2ff-0c9e-4c2f-8c20-e140b3bb4082 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:35.054805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96c4f2ff-0c9e-4c2f-8c20-e140b3bb4082 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:35.055493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96c4f2ff-0c9e-4c2f-8c20-e140b3bb4082 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:35.055945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96c4f2ff-0c9e-4c2f-8c20-e140b3bb4082 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:35.056369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96c4f2ff-0c9e-4c2f-8c20-e140b3bb4082 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:35.187972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-96c4f2ff-0c9e-4c2f-8c20-e140b3bb4082 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:35.195624 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-96c4f2ff-0c9e-4c2f-8c20-e140b3bb4082 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1683 microversion: 2.1 time: 0.153824 Aug 23 18:55:35.196187 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3643/7416] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:35 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:36.218109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1227f9f3-4106-4b9c-9386-1d2c0837c616 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:36.218779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1227f9f3-4106-4b9c-9386-1d2c0837c616 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:36.225313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1227f9f3-4106-4b9c-9386-1d2c0837c616 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:36.225819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1227f9f3-4106-4b9c-9386-1d2c0837c616 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:36.226276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1227f9f3-4106-4b9c-9386-1d2c0837c616 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:36.227025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1227f9f3-4106-4b9c-9386-1d2c0837c616 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:36.227496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1227f9f3-4106-4b9c-9386-1d2c0837c616 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:36.227937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1227f9f3-4106-4b9c-9386-1d2c0837c616 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:36.360087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1227f9f3-4106-4b9c-9386-1d2c0837c616 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:36.368041 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1227f9f3-4106-4b9c-9386-1d2c0837c616 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1682 microversion: 2.1 time: 0.154655 Aug 23 18:55:36.368616 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3774/7417] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:36 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:36.596622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f2c054ce-5868-477c-8103-162af066f192 req-7989bd98-6d21-4dba-b91a-91d4aaf36fcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca799a2-75ee-4936-8eb6-478d2363d9c8", "name": "network-vif-unplugged", "status": "completed", "tag": "92fee22c-5739-4057-a3f6-6bb8fb20e0df"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:55:36.607229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f2c054ce-5868-477c-8103-162af066f192 req-7989bd98-6d21-4dba-b91a-91d4aaf36fcc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:36.607725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f2c054ce-5868-477c-8103-162af066f192 req-7989bd98-6d21-4dba-b91a-91d4aaf36fcc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:36.608161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f2c054ce-5868-477c-8103-162af066f192 req-7989bd98-6d21-4dba-b91a-91d4aaf36fcc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:36.623219 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f2c054ce-5868-477c-8103-162af066f192 req-7989bd98-6d21-4dba-b91a-91d4aaf36fcc service nova] Creating event network-vif-unplugged:92fee22c-5739-4057-a3f6-6bb8fb20e0df for instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 on n-h2-850468-16 Aug 23 18:55:36.628941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-f2c054ce-5868-477c-8103-162af066f192 req-7989bd98-6d21-4dba-b91a-91d4aaf36fcc service nova] Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:55:36.641119 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f2c054ce-5868-477c-8103-162af066f192 req-7989bd98-6d21-4dba-b91a-91d4aaf36fcc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.102292 Aug 23 18:55:36.641783 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3644/7418] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:55:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:55:37.390471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e05be97e-e921-4d3a-bece-c1833d687ea5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:37.391120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e05be97e-e921-4d3a-bece-c1833d687ea5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:37.398040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e05be97e-e921-4d3a-bece-c1833d687ea5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:37.398568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e05be97e-e921-4d3a-bece-c1833d687ea5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:37.399043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e05be97e-e921-4d3a-bece-c1833d687ea5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:37.399748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e05be97e-e921-4d3a-bece-c1833d687ea5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:37.400209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e05be97e-e921-4d3a-bece-c1833d687ea5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:37.400643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e05be97e-e921-4d3a-bece-c1833d687ea5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:37.540346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e05be97e-e921-4d3a-bece-c1833d687ea5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:37.549391 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e05be97e-e921-4d3a-bece-c1833d687ea5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1682 microversion: 2.1 time: 0.163898 Aug 23 18:55:37.549899 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3775/7419] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:37 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:38.573244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fd4c7e20-da0a-460e-a5ee-09cae952c21f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:38.573948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fd4c7e20-da0a-460e-a5ee-09cae952c21f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:38.580349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fd4c7e20-da0a-460e-a5ee-09cae952c21f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:38.580839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fd4c7e20-da0a-460e-a5ee-09cae952c21f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:38.581282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fd4c7e20-da0a-460e-a5ee-09cae952c21f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:38.581974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fd4c7e20-da0a-460e-a5ee-09cae952c21f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:38.582432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fd4c7e20-da0a-460e-a5ee-09cae952c21f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:38.582899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fd4c7e20-da0a-460e-a5ee-09cae952c21f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:38.665101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4b3605d7-3a30-4222-8a82-6a48b89b9be7 req-849eff9e-f93c-4b8f-b894-21183f8c045a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca799a2-75ee-4936-8eb6-478d2363d9c8", "tag": "92fee22c-5739-4057-a3f6-6bb8fb20e0df"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:55:38.678366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4b3605d7-3a30-4222-8a82-6a48b89b9be7 req-849eff9e-f93c-4b8f-b894-21183f8c045a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:38.678931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4b3605d7-3a30-4222-8a82-6a48b89b9be7 req-849eff9e-f93c-4b8f-b894-21183f8c045a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:38.679383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4b3605d7-3a30-4222-8a82-6a48b89b9be7 req-849eff9e-f93c-4b8f-b894-21183f8c045a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:38.692047 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4b3605d7-3a30-4222-8a82-6a48b89b9be7 req-849eff9e-f93c-4b8f-b894-21183f8c045a service nova] Creating event network-changed:92fee22c-5739-4057-a3f6-6bb8fb20e0df for instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 on n-h2-850468-16 Aug 23 18:55:38.697460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-4b3605d7-3a30-4222-8a82-6a48b89b9be7 req-849eff9e-f93c-4b8f-b894-21183f8c045a service nova] Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:55:38.713235 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4b3605d7-3a30-4222-8a82-6a48b89b9be7 req-849eff9e-f93c-4b8f-b894-21183f8c045a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052850 Aug 23 18:55:38.714064 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3776/7420] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:55:38.733384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fd4c7e20-da0a-460e-a5ee-09cae952c21f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:38.741905 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fd4c7e20-da0a-460e-a5ee-09cae952c21f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1680 microversion: 2.1 time: 0.173848 Aug 23 18:55:38.742602 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3645/7421] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:38 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1680 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:39.765973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dfefa3a9-dfa4-48a7-b19f-c048b3980300 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:39.766733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dfefa3a9-dfa4-48a7-b19f-c048b3980300 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:39.772806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfefa3a9-dfa4-48a7-b19f-c048b3980300 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:39.773305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfefa3a9-dfa4-48a7-b19f-c048b3980300 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:39.773750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfefa3a9-dfa4-48a7-b19f-c048b3980300 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:39.774450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfefa3a9-dfa4-48a7-b19f-c048b3980300 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:39.774940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfefa3a9-dfa4-48a7-b19f-c048b3980300 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:39.775376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfefa3a9-dfa4-48a7-b19f-c048b3980300 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:39.908912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dfefa3a9-dfa4-48a7-b19f-c048b3980300 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:39.916713 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dfefa3a9-dfa4-48a7-b19f-c048b3980300 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1680 microversion: 2.1 time: 0.156671 Aug 23 18:55:39.917230 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3777/7422] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:39 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:40.937373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a32e464-da7d-48e1-bbc6-56b6d6156947 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:40.937994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a32e464-da7d-48e1-bbc6-56b6d6156947 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:40.944924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a32e464-da7d-48e1-bbc6-56b6d6156947 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:40.945413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a32e464-da7d-48e1-bbc6-56b6d6156947 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:40.945854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a32e464-da7d-48e1-bbc6-56b6d6156947 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:40.946565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a32e464-da7d-48e1-bbc6-56b6d6156947 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:40.947041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a32e464-da7d-48e1-bbc6-56b6d6156947 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:40.947462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a32e464-da7d-48e1-bbc6-56b6d6156947 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:41.097682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a32e464-da7d-48e1-bbc6-56b6d6156947 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:41.106114 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a32e464-da7d-48e1-bbc6-56b6d6156947 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1677 microversion: 2.1 time: 0.172033 Aug 23 18:55:41.107088 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3646/7423] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:40 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:41.127081 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:55:41.127641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:41.134674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:41.135179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:41.135630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:41.136339 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:41.137023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:41.137431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:41.176279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:41.176685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:41.177131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:41.177873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:41.178344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:41.178818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:41.201246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'cores', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:55:41.207030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for user b1b1944b15d547e4b68df40cb65a74a6 and project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'cores', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:55:41.307601 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6ee3ff2a-deb2-41fa-adb3-b056c42d80be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8/action" status: 202 len: 0 microversion: 2.1 time: 0.184262 Aug 23 18:55:41.308236 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3778/7424] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:55:41 2022] POST /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8/action => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:55:41.317610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c7586d4d-edf1-464d-b2c0-a466b06ecd80 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:41.318463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7586d4d-edf1-464d-b2c0-a466b06ecd80 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:41.325325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7586d4d-edf1-464d-b2c0-a466b06ecd80 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:41.325864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7586d4d-edf1-464d-b2c0-a466b06ecd80 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:41.326429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7586d4d-edf1-464d-b2c0-a466b06ecd80 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:41.327303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7586d4d-edf1-464d-b2c0-a466b06ecd80 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:41.327877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7586d4d-edf1-464d-b2c0-a466b06ecd80 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:41.328369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7586d4d-edf1-464d-b2c0-a466b06ecd80 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:41.529101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c7586d4d-edf1-464d-b2c0-a466b06ecd80 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:41.537200 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c7586d4d-edf1-464d-b2c0-a466b06ecd80 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1676 microversion: 2.1 time: 0.223625 Aug 23 18:55:41.537794 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3647/7425] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:41 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1676 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:41.662750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f60e0378-7c51-48bf-926b-88c0afdff4f3 req-baf843f9-a6da-4dcc-a649-6b9af0f6514c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca799a2-75ee-4936-8eb6-478d2363d9c8", "name": "network-vif-plugged", "status": "completed", "tag": "92fee22c-5739-4057-a3f6-6bb8fb20e0df"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:55:41.673330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f60e0378-7c51-48bf-926b-88c0afdff4f3 req-baf843f9-a6da-4dcc-a649-6b9af0f6514c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:41.673812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f60e0378-7c51-48bf-926b-88c0afdff4f3 req-baf843f9-a6da-4dcc-a649-6b9af0f6514c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:41.674255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f60e0378-7c51-48bf-926b-88c0afdff4f3 req-baf843f9-a6da-4dcc-a649-6b9af0f6514c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:41.689342 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f60e0378-7c51-48bf-926b-88c0afdff4f3 req-baf843f9-a6da-4dcc-a649-6b9af0f6514c service nova] Creating event network-vif-plugged:92fee22c-5739-4057-a3f6-6bb8fb20e0df for instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 on n-h2-850468-16 Aug 23 18:55:41.696250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-f60e0378-7c51-48bf-926b-88c0afdff4f3 req-baf843f9-a6da-4dcc-a649-6b9af0f6514c service nova] Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:55:41.708692 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f60e0378-7c51-48bf-926b-88c0afdff4f3 req-baf843f9-a6da-4dcc-a649-6b9af0f6514c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124676 Aug 23 18:55:41.709319 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3779/7426] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:55:42.559342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-da872947-412a-40e0-a518-84858bddacc7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:42.559954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-da872947-412a-40e0-a518-84858bddacc7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:42.566820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da872947-412a-40e0-a518-84858bddacc7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:42.567305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da872947-412a-40e0-a518-84858bddacc7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:42.567740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da872947-412a-40e0-a518-84858bddacc7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:42.568430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da872947-412a-40e0-a518-84858bddacc7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:42.568879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da872947-412a-40e0-a518-84858bddacc7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:42.569302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da872947-412a-40e0-a518-84858bddacc7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:42.700750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-da872947-412a-40e0-a518-84858bddacc7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:42.708451 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-da872947-412a-40e0-a518-84858bddacc7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1676 microversion: 2.1 time: 0.153690 Aug 23 18:55:42.709028 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3648/7427] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:42 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:43.729926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-012ac581-e0f4-4371-8a34-7c0bc9c7aedd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:43.731601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-012ac581-e0f4-4371-8a34-7c0bc9c7aedd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:43.738267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-012ac581-e0f4-4371-8a34-7c0bc9c7aedd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:43.738800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-012ac581-e0f4-4371-8a34-7c0bc9c7aedd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:43.739253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-012ac581-e0f4-4371-8a34-7c0bc9c7aedd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:43.739959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-012ac581-e0f4-4371-8a34-7c0bc9c7aedd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:43.740427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-012ac581-e0f4-4371-8a34-7c0bc9c7aedd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:43.740866 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-012ac581-e0f4-4371-8a34-7c0bc9c7aedd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:43.745002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:55:43.878851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-012ac581-e0f4-4371-8a34-7c0bc9c7aedd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:43.894695 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-012ac581-e0f4-4371-8a34-7c0bc9c7aedd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1676 microversion: 2.1 time: 0.161327 Aug 23 18:55:43.895330 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3780/7428] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:43 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:44.595419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-33f89023-fcee-4cbe-863e-db631cadb510 req-35b6f87c-2c82-4b25-b2fc-66ef4990e63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca799a2-75ee-4936-8eb6-478d2363d9c8", "name": "network-vif-unplugged", "status": "completed", "tag": "92fee22c-5739-4057-a3f6-6bb8fb20e0df"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:55:44.606289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-33f89023-fcee-4cbe-863e-db631cadb510 req-35b6f87c-2c82-4b25-b2fc-66ef4990e63a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:44.606792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-33f89023-fcee-4cbe-863e-db631cadb510 req-35b6f87c-2c82-4b25-b2fc-66ef4990e63a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:44.607227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-33f89023-fcee-4cbe-863e-db631cadb510 req-35b6f87c-2c82-4b25-b2fc-66ef4990e63a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:44.621688 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-33f89023-fcee-4cbe-863e-db631cadb510 req-35b6f87c-2c82-4b25-b2fc-66ef4990e63a service nova] Creating event network-vif-unplugged:92fee22c-5739-4057-a3f6-6bb8fb20e0df for instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 on n-h1-850468-16 Aug 23 18:55:44.627538 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-33f89023-fcee-4cbe-863e-db631cadb510 req-35b6f87c-2c82-4b25-b2fc-66ef4990e63a service nova] Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:55:44.638888 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-33f89023-fcee-4cbe-863e-db631cadb510 req-35b6f87c-2c82-4b25-b2fc-66ef4990e63a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048635 Aug 23 18:55:44.639847 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3649/7429] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:55:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:55:44.915831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f0edb20f-4bbf-4a42-bb94-2397979495bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:44.916468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f0edb20f-4bbf-4a42-bb94-2397979495bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:44.923559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0edb20f-4bbf-4a42-bb94-2397979495bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:44.924061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0edb20f-4bbf-4a42-bb94-2397979495bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:44.924510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0edb20f-4bbf-4a42-bb94-2397979495bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:44.925378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0edb20f-4bbf-4a42-bb94-2397979495bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:44.926271 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0edb20f-4bbf-4a42-bb94-2397979495bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:44.927101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0edb20f-4bbf-4a42-bb94-2397979495bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:45.073909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f0edb20f-4bbf-4a42-bb94-2397979495bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:45.082195 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f0edb20f-4bbf-4a42-bb94-2397979495bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1676 microversion: 2.1 time: 0.170238 Aug 23 18:55:45.082800 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3781/7430] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:44 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1676 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:46.105958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-12342e38-6c20-40cd-9db8-d0b6b606d58f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:46.106708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-12342e38-6c20-40cd-9db8-d0b6b606d58f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:46.113149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12342e38-6c20-40cd-9db8-d0b6b606d58f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:46.113635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12342e38-6c20-40cd-9db8-d0b6b606d58f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:46.114072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12342e38-6c20-40cd-9db8-d0b6b606d58f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:46.114793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12342e38-6c20-40cd-9db8-d0b6b606d58f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:46.115250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12342e38-6c20-40cd-9db8-d0b6b606d58f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:46.115676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12342e38-6c20-40cd-9db8-d0b6b606d58f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:46.245016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-12342e38-6c20-40cd-9db8-d0b6b606d58f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:46.249405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:55:46.254517 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-12342e38-6c20-40cd-9db8-d0b6b606d58f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1676 microversion: 2.1 time: 0.154388 Aug 23 18:55:46.255121 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3650/7431] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:46 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:46.654561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-750697ec-726a-4a40-b6e6-f240839537a8 req-8accc98e-40ba-424b-8be0-154ec2ce767f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca799a2-75ee-4936-8eb6-478d2363d9c8", "tag": "92fee22c-5739-4057-a3f6-6bb8fb20e0df"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:55:46.664636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-750697ec-726a-4a40-b6e6-f240839537a8 req-8accc98e-40ba-424b-8be0-154ec2ce767f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:46.665116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-750697ec-726a-4a40-b6e6-f240839537a8 req-8accc98e-40ba-424b-8be0-154ec2ce767f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:46.665556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-750697ec-726a-4a40-b6e6-f240839537a8 req-8accc98e-40ba-424b-8be0-154ec2ce767f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:46.677542 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-750697ec-726a-4a40-b6e6-f240839537a8 req-8accc98e-40ba-424b-8be0-154ec2ce767f service nova] Creating event network-changed:92fee22c-5739-4057-a3f6-6bb8fb20e0df for instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 on n-h1-850468-16 Aug 23 18:55:46.682753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-750697ec-726a-4a40-b6e6-f240839537a8 req-8accc98e-40ba-424b-8be0-154ec2ce767f service nova] Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:55:46.694083 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-750697ec-726a-4a40-b6e6-f240839537a8 req-8accc98e-40ba-424b-8be0-154ec2ce767f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043408 Aug 23 18:55:46.694702 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3782/7432] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:55:47.276453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c79f6a2b-864d-479b-85ed-6dce7d2d889b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:47.276995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c79f6a2b-864d-479b-85ed-6dce7d2d889b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:47.281408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=37 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:55:47.289085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c79f6a2b-864d-479b-85ed-6dce7d2d889b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:47.289570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c79f6a2b-864d-479b-85ed-6dce7d2d889b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:47.290006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c79f6a2b-864d-479b-85ed-6dce7d2d889b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:47.290725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c79f6a2b-864d-479b-85ed-6dce7d2d889b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:47.291178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c79f6a2b-864d-479b-85ed-6dce7d2d889b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:47.291602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c79f6a2b-864d-479b-85ed-6dce7d2d889b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:47.430300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c79f6a2b-864d-479b-85ed-6dce7d2d889b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:47.439042 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c79f6a2b-864d-479b-85ed-6dce7d2d889b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1676 microversion: 2.1 time: 0.166283 Aug 23 18:55:47.440565 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3651/7433] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:47 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1676 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:48.463687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-23f1b650-2be7-446e-bee0-eb5ecde096dc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:48.465572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-23f1b650-2be7-446e-bee0-eb5ecde096dc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:48.468694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:55:48.475473 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23f1b650-2be7-446e-bee0-eb5ecde096dc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:48.475750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23f1b650-2be7-446e-bee0-eb5ecde096dc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:48.476213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23f1b650-2be7-446e-bee0-eb5ecde096dc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:48.476940 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23f1b650-2be7-446e-bee0-eb5ecde096dc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:48.477422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23f1b650-2be7-446e-bee0-eb5ecde096dc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:48.477867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-23f1b650-2be7-446e-bee0-eb5ecde096dc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:48.627304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-23f1b650-2be7-446e-bee0-eb5ecde096dc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:48.637031 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-23f1b650-2be7-446e-bee0-eb5ecde096dc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1676 microversion: 2.1 time: 0.178057 Aug 23 18:55:48.637860 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3783/7434] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:48 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1676 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:49.658819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fcd16333-3732-4ff9-acfc-d517da8b2430 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:49.659429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fcd16333-3732-4ff9-acfc-d517da8b2430 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:49.666408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcd16333-3732-4ff9-acfc-d517da8b2430 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:49.666928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcd16333-3732-4ff9-acfc-d517da8b2430 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:49.667361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcd16333-3732-4ff9-acfc-d517da8b2430 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:49.668043 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcd16333-3732-4ff9-acfc-d517da8b2430 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:49.668496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcd16333-3732-4ff9-acfc-d517da8b2430 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:49.669496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fcd16333-3732-4ff9-acfc-d517da8b2430 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:49.802320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fcd16333-3732-4ff9-acfc-d517da8b2430 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:49.810670 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fcd16333-3732-4ff9-acfc-d517da8b2430 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1669 microversion: 2.1 time: 0.155543 Aug 23 18:55:49.811446 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3652/7435] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:49 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:49.831249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3ca4160-5c0e-4d77-83ca-b6f09f8ba3fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:49.831877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d3ca4160-5c0e-4d77-83ca-b6f09f8ba3fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:49.838602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3ca4160-5c0e-4d77-83ca-b6f09f8ba3fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:49.839124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3ca4160-5c0e-4d77-83ca-b6f09f8ba3fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:49.839571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3ca4160-5c0e-4d77-83ca-b6f09f8ba3fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:49.840532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3ca4160-5c0e-4d77-83ca-b6f09f8ba3fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:49.841624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3ca4160-5c0e-4d77-83ca-b6f09f8ba3fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:49.842052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3ca4160-5c0e-4d77-83ca-b6f09f8ba3fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:49.974487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d3ca4160-5c0e-4d77-83ca-b6f09f8ba3fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:49.982997 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d3ca4160-5c0e-4d77-83ca-b6f09f8ba3fe tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1669 microversion: 2.1 time: 0.155470 Aug 23 18:55:49.983571 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3784/7436] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:49 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1669 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:50.002964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6990f3c-b503-46ba-b522-5520f0dc87a0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:50.003518 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6990f3c-b503-46ba-b522-5520f0dc87a0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:50.009443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6990f3c-b503-46ba-b522-5520f0dc87a0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:50.009936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6990f3c-b503-46ba-b522-5520f0dc87a0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:50.010384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6990f3c-b503-46ba-b522-5520f0dc87a0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:50.011113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6990f3c-b503-46ba-b522-5520f0dc87a0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:50.011574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6990f3c-b503-46ba-b522-5520f0dc87a0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:50.012004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6990f3c-b503-46ba-b522-5520f0dc87a0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:50.143893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f6990f3c-b503-46ba-b522-5520f0dc87a0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:50.151597 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6990f3c-b503-46ba-b522-5520f0dc87a0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1669 microversion: 2.1 time: 0.152527 Aug 23 18:55:50.152170 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3653/7437] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:49 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:50.174297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dbb6428a-dd01-455c-bd65-ba64baa1f1d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:50.174845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dbb6428a-dd01-455c-bd65-ba64baa1f1d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:50.181122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbb6428a-dd01-455c-bd65-ba64baa1f1d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:50.181620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbb6428a-dd01-455c-bd65-ba64baa1f1d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:50.182073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbb6428a-dd01-455c-bd65-ba64baa1f1d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:50.182841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbb6428a-dd01-455c-bd65-ba64baa1f1d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:50.183319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbb6428a-dd01-455c-bd65-ba64baa1f1d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:50.183763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dbb6428a-dd01-455c-bd65-ba64baa1f1d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:50.208390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dbb6428a-dd01-455c-bd65-ba64baa1f1d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:55:50.285986 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dbb6428a-dd01-455c-bd65-ba64baa1f1d7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 204 len: 0 microversion: 2.1 time: 0.114939 Aug 23 18:55:50.286936 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3785/7438] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:55:50 2022] DELETE /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:55:50.297548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cd578330-da24-43e0-8dcc-3facf8c1bac5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:50.298799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cd578330-da24-43e0-8dcc-3facf8c1bac5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:50.305707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd578330-da24-43e0-8dcc-3facf8c1bac5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:50.306355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd578330-da24-43e0-8dcc-3facf8c1bac5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:50.307125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd578330-da24-43e0-8dcc-3facf8c1bac5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:50.307838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd578330-da24-43e0-8dcc-3facf8c1bac5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:50.308288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd578330-da24-43e0-8dcc-3facf8c1bac5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:50.308807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd578330-da24-43e0-8dcc-3facf8c1bac5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:50.441246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cd578330-da24-43e0-8dcc-3facf8c1bac5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:50.449286 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cd578330-da24-43e0-8dcc-3facf8c1bac5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1675 microversion: 2.1 time: 0.157911 Aug 23 18:55:50.450075 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3654/7439] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:50 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:51.472904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0efeccca-9d2e-4781-b89a-5a00f6af17e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:51.473632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0efeccca-9d2e-4781-b89a-5a00f6af17e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:51.476501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:55:51.482740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0efeccca-9d2e-4781-b89a-5a00f6af17e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:51.483250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0efeccca-9d2e-4781-b89a-5a00f6af17e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:51.483703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0efeccca-9d2e-4781-b89a-5a00f6af17e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:51.484450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0efeccca-9d2e-4781-b89a-5a00f6af17e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:51.484920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0efeccca-9d2e-4781-b89a-5a00f6af17e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:51.485795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0efeccca-9d2e-4781-b89a-5a00f6af17e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:51.619161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0efeccca-9d2e-4781-b89a-5a00f6af17e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:51.627731 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0efeccca-9d2e-4781-b89a-5a00f6af17e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1675 microversion: 2.1 time: 0.159068 Aug 23 18:55:51.628534 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3786/7440] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:51 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:52.649583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8324280c-ba9c-4b9b-b705-5ec499150480 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:52.650772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8324280c-ba9c-4b9b-b705-5ec499150480 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:52.657646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8324280c-ba9c-4b9b-b705-5ec499150480 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:52.658142 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8324280c-ba9c-4b9b-b705-5ec499150480 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:52.658610 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8324280c-ba9c-4b9b-b705-5ec499150480 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:52.659396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8324280c-ba9c-4b9b-b705-5ec499150480 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:52.659856 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8324280c-ba9c-4b9b-b705-5ec499150480 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:52.660287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8324280c-ba9c-4b9b-b705-5ec499150480 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:52.747272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8324280c-ba9c-4b9b-b705-5ec499150480 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:52.755552 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8324280c-ba9c-4b9b-b705-5ec499150480 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 200 len: 1608 microversion: 2.1 time: 0.109971 Aug 23 18:55:52.756355 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3655/7441] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:52 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 1608 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:52.780626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-a8f377f0-f8dc-4fda-bbd3-84cd05be4e0f req-f176dcf4-4e5a-4859-b3af-488978ea548e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca799a2-75ee-4936-8eb6-478d2363d9c8", "name": "network-vif-deleted", "tag": "92fee22c-5739-4057-a3f6-6bb8fb20e0df"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:55:52.790570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a8f377f0-f8dc-4fda-bbd3-84cd05be4e0f req-f176dcf4-4e5a-4859-b3af-488978ea548e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:52.791052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a8f377f0-f8dc-4fda-bbd3-84cd05be4e0f req-f176dcf4-4e5a-4859-b3af-488978ea548e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:52.791495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a8f377f0-f8dc-4fda-bbd3-84cd05be4e0f req-f176dcf4-4e5a-4859-b3af-488978ea548e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:52.802607 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-a8f377f0-f8dc-4fda-bbd3-84cd05be4e0f req-f176dcf4-4e5a-4859-b3af-488978ea548e service nova] Creating event network-vif-deleted:92fee22c-5739-4057-a3f6-6bb8fb20e0df for instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 on n-h1-850468-16 Aug 23 18:55:52.807699 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-a8f377f0-f8dc-4fda-bbd3-84cd05be4e0f req-f176dcf4-4e5a-4859-b3af-488978ea548e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031518 Aug 23 18:55:52.808582 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3787/7442] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:55:53.777686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b3a47af-de43-4e8c-934a-094230050239 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:53.778514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b3a47af-de43-4e8c-934a-094230050239 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:53.785887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b3a47af-de43-4e8c-934a-094230050239 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:53.786381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b3a47af-de43-4e8c-934a-094230050239 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:53.786851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b3a47af-de43-4e8c-934a-094230050239 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:53.787569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b3a47af-de43-4e8c-934a-094230050239 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:53.788030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b3a47af-de43-4e8c-934a-094230050239 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:53.788463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b3a47af-de43-4e8c-934a-094230050239 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:53.805075 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-3b3a47af-de43-4e8c-934a-094230050239 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b3a47af-de43-4e8c-934a-094230050239 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 HTTP/1.1 Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2ca799a2-75ee-4936-8eb6-478d2363d9c8'} Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:55:53.806861 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:55:53.812593 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:55:53.812593 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:55:53.812593 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:55:53.812593 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:55:53.812593 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:55:53.812593 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:55:53.812593 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:55:53.812593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b3a47af-de43-4e8c-934a-094230050239 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:55:53.812593 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3b3a47af-de43-4e8c-934a-094230050239 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 404 len: 111 microversion: 2.1 time: 0.035093 Aug 23 18:55:53.812593 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3656/7443] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:53 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:55:53.832310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cfae8074-0013-4a18-a63e-513015e4438f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:53.833026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cfae8074-0013-4a18-a63e-513015e4438f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:53.839517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfae8074-0013-4a18-a63e-513015e4438f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:53.840276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfae8074-0013-4a18-a63e-513015e4438f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:53.840833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfae8074-0013-4a18-a63e-513015e4438f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:53.841553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfae8074-0013-4a18-a63e-513015e4438f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:53.842015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfae8074-0013-4a18-a63e-513015e4438f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:53.842450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfae8074-0013-4a18-a63e-513015e4438f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:53.856050 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-cfae8074-0013-4a18-a63e-513015e4438f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cfae8074-0013-4a18-a63e-513015e4438f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 HTTP/1.1 Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '2ca799a2-75ee-4936-8eb6-478d2363d9c8'} Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:55:53.857862 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:55:53.861779 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:55:53.861779 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:55:53.861779 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:55:53.861779 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:55:53.861779 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:55:53.861779 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:55:53.861779 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:55:53.861779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cfae8074-0013-4a18-a63e-513015e4438f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:55:53.861779 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cfae8074-0013-4a18-a63e-513015e4438f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 404 len: 111 microversion: 2.1 time: 0.032286 Aug 23 18:55:53.861779 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3788/7444] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:53 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:55:53.909417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-261950248", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "3617bced-c0f9-4fd5-b74f-8bf14b45f3c8"}], "security_groups": [{"name": "tempest-securitygroup--974773066"}], "key_name": "tempest-keypair-1650899182", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:55:54.014470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] validate_networks() for [('3617bced-c0f9-4fd5-b74f-8bf14b45f3c8', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:55:54.467376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:55:54.467808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:55:54.468292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:55:54.468709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:55:54.469125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:55:54.478217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:54.478743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:54.479185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:54.479922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:54.480383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:54.480815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:54.500557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:55:54.505917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for user b1b1944b15d547e4b68df40cb65a74a6 and project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:55:54.519224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:55:54.521569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:55:54.569230 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a3064aeb-e929-4f18-8437-26bcdbf83bf3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.663630 Aug 23 18:55:54.569885 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3657/7445] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:55:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 23 18:55:54.581925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-81edc14e-c83f-4b7c-963b-b12f5aeae7d9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:54.582570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-81edc14e-c83f-4b7c-963b-b12f5aeae7d9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:54.638392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-81edc14e-c83f-4b7c-963b-b12f5aeae7d9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:54.645291 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-81edc14e-c83f-4b7c-963b-b12f5aeae7d9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1238 microversion: 2.1 time: 0.067452 Aug 23 18:55:54.645872 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3789/7446] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:54 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:55.668035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a7f678f6-d7e2-482a-9b76-2b8b43bee94b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:55.669576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a7f678f6-d7e2-482a-9b76-2b8b43bee94b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:55.678024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7f678f6-d7e2-482a-9b76-2b8b43bee94b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:55.678645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7f678f6-d7e2-482a-9b76-2b8b43bee94b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:55.679155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7f678f6-d7e2-482a-9b76-2b8b43bee94b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:55.680141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7f678f6-d7e2-482a-9b76-2b8b43bee94b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:55.680616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7f678f6-d7e2-482a-9b76-2b8b43bee94b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:55.681597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7f678f6-d7e2-482a-9b76-2b8b43bee94b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:55.761588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a7f678f6-d7e2-482a-9b76-2b8b43bee94b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:55.775973 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a7f678f6-d7e2-482a-9b76-2b8b43bee94b tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1298 microversion: 2.1 time: 0.112857 Aug 23 18:55:55.777082 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3658/7447] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:55 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1298 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:56.807563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-585191d6-877f-4bd6-999d-4cb517c6899a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:56.808313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-585191d6-877f-4bd6-999d-4cb517c6899a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:56.818174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-585191d6-877f-4bd6-999d-4cb517c6899a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:56.818738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-585191d6-877f-4bd6-999d-4cb517c6899a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:56.819229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-585191d6-877f-4bd6-999d-4cb517c6899a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:56.819970 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-585191d6-877f-4bd6-999d-4cb517c6899a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:56.820665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-585191d6-877f-4bd6-999d-4cb517c6899a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:56.821324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-585191d6-877f-4bd6-999d-4cb517c6899a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:56.966012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-585191d6-877f-4bd6-999d-4cb517c6899a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:56.974093 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-585191d6-877f-4bd6-999d-4cb517c6899a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1363 microversion: 2.1 time: 0.178751 Aug 23 18:55:56.974724 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3790/7448] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:56 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:57.339605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-02950c78-593a-43e7-8940-64a76813bd2e req-f94d9fd5-1914-488e-a2f0-69ae5f204b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd5dd1c-1232-4d1a-951f-eebd0280ab56", "tag": "30c45c34-b0c4-483d-b481-6114a60bf7c5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:55:57.350919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-02950c78-593a-43e7-8940-64a76813bd2e req-f94d9fd5-1914-488e-a2f0-69ae5f204b8a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:57.351467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-02950c78-593a-43e7-8940-64a76813bd2e req-f94d9fd5-1914-488e-a2f0-69ae5f204b8a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:57.352001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-02950c78-593a-43e7-8940-64a76813bd2e req-f94d9fd5-1914-488e-a2f0-69ae5f204b8a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:57.366293 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-02950c78-593a-43e7-8940-64a76813bd2e req-f94d9fd5-1914-488e-a2f0-69ae5f204b8a service nova] Creating event network-changed:30c45c34-b0c4-483d-b481-6114a60bf7c5 for instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 on n-h2-850468-16 Aug 23 18:55:57.371469 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-02950c78-593a-43e7-8940-64a76813bd2e req-f94d9fd5-1914-488e-a2f0-69ae5f204b8a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035830 Aug 23 18:55:57.372857 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3659/7449] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:55:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:55:57.996400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5ba82c5e-7d66-492c-b409-0f6bede763e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:57.997612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5ba82c5e-7d66-492c-b409-0f6bede763e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:58.004419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ba82c5e-7d66-492c-b409-0f6bede763e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:58.004931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ba82c5e-7d66-492c-b409-0f6bede763e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:58.005381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ba82c5e-7d66-492c-b409-0f6bede763e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:58.006093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ba82c5e-7d66-492c-b409-0f6bede763e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:58.006582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ba82c5e-7d66-492c-b409-0f6bede763e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:58.007030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ba82c5e-7d66-492c-b409-0f6bede763e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:58.138423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5ba82c5e-7d66-492c-b409-0f6bede763e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:58.146090 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5ba82c5e-7d66-492c-b409-0f6bede763e9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1363 microversion: 2.1 time: 0.153721 Aug 23 18:55:58.146697 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3791/7450] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:57 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:55:59.170296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3accb721-c775-40c8-8a37-fc8d51ed3f83 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:55:59.171012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3accb721-c775-40c8-8a37-fc8d51ed3f83 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:55:59.177407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3accb721-c775-40c8-8a37-fc8d51ed3f83 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:59.177896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3accb721-c775-40c8-8a37-fc8d51ed3f83 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:59.178335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3accb721-c775-40c8-8a37-fc8d51ed3f83 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:59.179088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3accb721-c775-40c8-8a37-fc8d51ed3f83 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:55:59.179570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3accb721-c775-40c8-8a37-fc8d51ed3f83 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:55:59.179999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3accb721-c775-40c8-8a37-fc8d51ed3f83 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:55:59.314763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3accb721-c775-40c8-8a37-fc8d51ed3f83 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:55:59.322489 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3accb721-c775-40c8-8a37-fc8d51ed3f83 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1363 microversion: 2.1 time: 0.157897 Aug 23 18:55:59.323080 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3660/7451] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:55:59 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:56:00.344840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c20fd05e-e0ad-4c9d-bf02-d6033537256f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:56:00.345371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c20fd05e-e0ad-4c9d-bf02-d6033537256f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:56:00.352252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c20fd05e-e0ad-4c9d-bf02-d6033537256f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:56:00.352755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c20fd05e-e0ad-4c9d-bf02-d6033537256f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:56:00.353212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c20fd05e-e0ad-4c9d-bf02-d6033537256f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:56:00.353927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c20fd05e-e0ad-4c9d-bf02-d6033537256f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:56:00.354402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c20fd05e-e0ad-4c9d-bf02-d6033537256f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:56:00.354879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c20fd05e-e0ad-4c9d-bf02-d6033537256f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:56:00.488142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c20fd05e-e0ad-4c9d-bf02-d6033537256f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:56:00.495796 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c20fd05e-e0ad-4c9d-bf02-d6033537256f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1363 microversion: 2.1 time: 0.155770 Aug 23 18:56:00.496360 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3792/7452] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:56:00 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:56:01.349238 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:56:01.349878 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 18:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:56:01.394258 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:56:01.394516 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 18:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:56:01.517425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91632e9b-613c-4f0d-aa0c-1714b2749da3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:56:01.518067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-91632e9b-613c-4f0d-aa0c-1714b2749da3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:56:01.524993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91632e9b-613c-4f0d-aa0c-1714b2749da3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:56:01.525486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91632e9b-613c-4f0d-aa0c-1714b2749da3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:56:01.525915 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91632e9b-613c-4f0d-aa0c-1714b2749da3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:56:01.526635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91632e9b-613c-4f0d-aa0c-1714b2749da3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:56:01.527090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91632e9b-613c-4f0d-aa0c-1714b2749da3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:56:01.527514 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91632e9b-613c-4f0d-aa0c-1714b2749da3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:56:01.664029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-cc074c28-f622-4877-9fd1-97d10df4ec37 req-0dfd12f4-adbc-4405-ae5f-a22916378e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd5dd1c-1232-4d1a-951f-eebd0280ab56", "name": "network-vif-plugged", "status": "completed", "tag": "30c45c34-b0c4-483d-b481-6114a60bf7c5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:56:01.665001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-91632e9b-613c-4f0d-aa0c-1714b2749da3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:56:01.674504 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-91632e9b-613c-4f0d-aa0c-1714b2749da3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1363 microversion: 2.1 time: 0.161038 Aug 23 18:56:01.675120 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3661/7453] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:56:01 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:56:01.677960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cc074c28-f622-4877-9fd1-97d10df4ec37 req-0dfd12f4-adbc-4405-ae5f-a22916378e97 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:56:01.678515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cc074c28-f622-4877-9fd1-97d10df4ec37 req-0dfd12f4-adbc-4405-ae5f-a22916378e97 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:56:01.679062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cc074c28-f622-4877-9fd1-97d10df4ec37 req-0dfd12f4-adbc-4405-ae5f-a22916378e97 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:56:01.692314 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-cc074c28-f622-4877-9fd1-97d10df4ec37 req-0dfd12f4-adbc-4405-ae5f-a22916378e97 service nova] Creating event network-vif-plugged:30c45c34-b0c4-483d-b481-6114a60bf7c5 for instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 on n-h2-850468-16 Aug 23 18:56:01.697770 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-cc074c28-f622-4877-9fd1-97d10df4ec37 req-0dfd12f4-adbc-4405-ae5f-a22916378e97 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037590 Aug 23 18:56:01.698566 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3793/7454] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:56:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:56:01.820137 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:56:01.820332 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 18:56:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:56:02.697636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c1c2150c-612b-42ed-90cd-e63774caaf33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:56:02.698274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c1c2150c-612b-42ed-90cd-e63774caaf33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:56:02.705122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c2150c-612b-42ed-90cd-e63774caaf33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:56:02.705817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c2150c-612b-42ed-90cd-e63774caaf33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:56:02.706259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c2150c-612b-42ed-90cd-e63774caaf33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:56:02.707015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c2150c-612b-42ed-90cd-e63774caaf33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:56:02.707476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c2150c-612b-42ed-90cd-e63774caaf33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:56:02.707902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c1c2150c-612b-42ed-90cd-e63774caaf33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:56:02.844066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c1c2150c-612b-42ed-90cd-e63774caaf33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:56:02.852001 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c1c2150c-612b-42ed-90cd-e63774caaf33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1363 microversion: 2.1 time: 0.158314 Aug 23 18:56:02.852570 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3662/7455] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:56:02 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:56:03.876263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f030cf9-07bd-4620-9f18-a2b29afac486 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:56:03.876975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0f030cf9-07bd-4620-9f18-a2b29afac486 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:56:03.883763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f030cf9-07bd-4620-9f18-a2b29afac486 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:56:03.884202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f030cf9-07bd-4620-9f18-a2b29afac486 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:56:03.884649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f030cf9-07bd-4620-9f18-a2b29afac486 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:56:03.885353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f030cf9-07bd-4620-9f18-a2b29afac486 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:56:03.885814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f030cf9-07bd-4620-9f18-a2b29afac486 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:56:03.886249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f030cf9-07bd-4620-9f18-a2b29afac486 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:56:04.017484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0f030cf9-07bd-4620-9f18-a2b29afac486 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:56:04.025161 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0f030cf9-07bd-4620-9f18-a2b29afac486 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1551 microversion: 2.1 time: 0.155054 Aug 23 18:56:04.025738 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3794/7456] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:56:03 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1551 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:56:04.047355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b2b2207f-e983-4355-b9db-861f30d79b50 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:56:04.047858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b2b2207f-e983-4355-b9db-861f30d79b50 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:56:04.054674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2b2207f-e983-4355-b9db-861f30d79b50 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:56:04.055154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2b2207f-e983-4355-b9db-861f30d79b50 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:56:04.055587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2b2207f-e983-4355-b9db-861f30d79b50 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:56:04.056275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2b2207f-e983-4355-b9db-861f30d79b50 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:56:04.056730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2b2207f-e983-4355-b9db-861f30d79b50 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:56:04.057153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b2b2207f-e983-4355-b9db-861f30d79b50 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:56:04.133339 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b2b2207f-e983-4355-b9db-861f30d79b50 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090500 Aug 23 18:56:04.134017 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3663/7457] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 18:56:04 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:56:05.060761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-c6925e56-5fba-4ed6-a171-a37cc848244c req-32b7b911-9f3f-4492-85d6-3ccf504e5461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd5dd1c-1232-4d1a-951f-eebd0280ab56", "tag": "30c45c34-b0c4-483d-b481-6114a60bf7c5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:56:05.065546 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:56:05.072343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c6925e56-5fba-4ed6-a171-a37cc848244c req-32b7b911-9f3f-4492-85d6-3ccf504e5461 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:56:05.072833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c6925e56-5fba-4ed6-a171-a37cc848244c req-32b7b911-9f3f-4492-85d6-3ccf504e5461 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:56:05.073277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-c6925e56-5fba-4ed6-a171-a37cc848244c req-32b7b911-9f3f-4492-85d6-3ccf504e5461 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:56:05.087527 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-c6925e56-5fba-4ed6-a171-a37cc848244c req-32b7b911-9f3f-4492-85d6-3ccf504e5461 service nova] Creating event network-changed:30c45c34-b0c4-483d-b481-6114a60bf7c5 for instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 on n-h2-850468-16 Aug 23 18:56:05.093128 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-c6925e56-5fba-4ed6-a171-a37cc848244c req-32b7b911-9f3f-4492-85d6-3ccf504e5461 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037266 Aug 23 18:56:05.094853 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3795/7458] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:57:18.363296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:57:18.364245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:57:18.366264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:57:18.367054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=64 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:57:18.371817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4b8a7c0e-a119-4c69-ae44-d91cbf0746cc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:18.372383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4b8a7c0e-a119-4c69-ae44-d91cbf0746cc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:18.381106 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b8a7c0e-a119-4c69-ae44-d91cbf0746cc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:18.381586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b8a7c0e-a119-4c69-ae44-d91cbf0746cc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:18.382021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b8a7c0e-a119-4c69-ae44-d91cbf0746cc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:18.382754 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b8a7c0e-a119-4c69-ae44-d91cbf0746cc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:18.383217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b8a7c0e-a119-4c69-ae44-d91cbf0746cc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:18.383642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4b8a7c0e-a119-4c69-ae44-d91cbf0746cc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:18.512133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4b8a7c0e-a119-4c69-ae44-d91cbf0746cc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:18.519938 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4b8a7c0e-a119-4c69-ae44-d91cbf0746cc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1669 microversion: 2.1 time: 0.157712 Aug 23 18:57:18.520507 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3664/7459] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:18 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:18.541230 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:57:18.542043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:57:18.547792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-68279ef2-56fe-4826-ae73-091cf2aa4f8e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36832cd5-08d1-419f-b168-18f272455ac2"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:57:18.550213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-68279ef2-56fe-4826-ae73-091cf2aa4f8e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:18.558788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68279ef2-56fe-4826-ae73-091cf2aa4f8e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:18.559285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68279ef2-56fe-4826-ae73-091cf2aa4f8e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:18.559738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68279ef2-56fe-4826-ae73-091cf2aa4f8e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:18.560450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68279ef2-56fe-4826-ae73-091cf2aa4f8e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:18.560916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68279ef2-56fe-4826-ae73-091cf2aa4f8e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:18.561354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68279ef2-56fe-4826-ae73-091cf2aa4f8e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:18.801123 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-68279ef2-56fe-4826-ae73-091cf2aa4f8e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262604 Aug 23 18:57:18.801816 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3796/7460] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 18:57:18 2022] POST /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:57:30.742169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:57:30.744503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:30.746832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:57:30.747482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:57:30.753826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:30.754317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:30.754781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:30.755482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:30.755941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:30.756371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:30.799291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:30.805607 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Old instance type m1.heat2, new instance type m1.heat {{(pid=128807) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 18:57:30.812557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:57:30.812976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:57:30.813455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:57:30.813861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:57:30.814267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:57:30.880548 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1fe0ec96-234b-4813-93cb-7340676948bf tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56/action" status: 202 len: 0 microversion: 2.1 time: 0.142263 Aug 23 18:57:30.881173 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3665/7461] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:57:30 2022] POST /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 23 18:57:30.888283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:57:30.889111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:57:30.893296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f80ee5b-8bb7-460a-ad36-4f9ba275a059 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:30.894125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f80ee5b-8bb7-460a-ad36-4f9ba275a059 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:30.901427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f80ee5b-8bb7-460a-ad36-4f9ba275a059 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:30.901931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f80ee5b-8bb7-460a-ad36-4f9ba275a059 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:30.902376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f80ee5b-8bb7-460a-ad36-4f9ba275a059 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:30.903109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f80ee5b-8bb7-460a-ad36-4f9ba275a059 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:30.903576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f80ee5b-8bb7-460a-ad36-4f9ba275a059 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:30.904004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f80ee5b-8bb7-460a-ad36-4f9ba275a059 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:31.062035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f80ee5b-8bb7-460a-ad36-4f9ba275a059 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:31.071411 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f80ee5b-8bb7-460a-ad36-4f9ba275a059 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1724 microversion: 2.1 time: 0.185168 Aug 23 18:57:31.072154 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3797/7462] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:30 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:32.093726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3bf5e16e-f45a-4fbf-bc48-bb40dfd4f7d0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:32.094302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3bf5e16e-f45a-4fbf-bc48-bb40dfd4f7d0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:32.101505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bf5e16e-f45a-4fbf-bc48-bb40dfd4f7d0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:32.101989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bf5e16e-f45a-4fbf-bc48-bb40dfd4f7d0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:32.102432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bf5e16e-f45a-4fbf-bc48-bb40dfd4f7d0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:32.103223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bf5e16e-f45a-4fbf-bc48-bb40dfd4f7d0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:32.103684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bf5e16e-f45a-4fbf-bc48-bb40dfd4f7d0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:32.104115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bf5e16e-f45a-4fbf-bc48-bb40dfd4f7d0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:32.238532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3bf5e16e-f45a-4fbf-bc48-bb40dfd4f7d0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:32.246870 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3bf5e16e-f45a-4fbf-bc48-bb40dfd4f7d0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1724 microversion: 2.1 time: 0.157401 Aug 23 18:57:32.247435 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3666/7463] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:32 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:33.269797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b82aaf92-eb1f-425e-9147-7a14dfafdee0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:33.270493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b82aaf92-eb1f-425e-9147-7a14dfafdee0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:33.277353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b82aaf92-eb1f-425e-9147-7a14dfafdee0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:33.277853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b82aaf92-eb1f-425e-9147-7a14dfafdee0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:33.278322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b82aaf92-eb1f-425e-9147-7a14dfafdee0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:33.279037 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b82aaf92-eb1f-425e-9147-7a14dfafdee0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:33.279505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b82aaf92-eb1f-425e-9147-7a14dfafdee0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:33.279942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b82aaf92-eb1f-425e-9147-7a14dfafdee0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:33.416409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b82aaf92-eb1f-425e-9147-7a14dfafdee0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:33.425044 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b82aaf92-eb1f-425e-9147-7a14dfafdee0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1724 microversion: 2.1 time: 0.159770 Aug 23 18:57:33.426088 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3798/7464] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:33 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:34.446050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3481b5ec-5119-4ead-bb20-96ed2027f5e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:34.446705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3481b5ec-5119-4ead-bb20-96ed2027f5e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:34.453546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3481b5ec-5119-4ead-bb20-96ed2027f5e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:34.454034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3481b5ec-5119-4ead-bb20-96ed2027f5e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:34.454476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3481b5ec-5119-4ead-bb20-96ed2027f5e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:34.455240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3481b5ec-5119-4ead-bb20-96ed2027f5e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:34.455819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3481b5ec-5119-4ead-bb20-96ed2027f5e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:34.456257 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3481b5ec-5119-4ead-bb20-96ed2027f5e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:34.594824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3481b5ec-5119-4ead-bb20-96ed2027f5e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:34.603874 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3481b5ec-5119-4ead-bb20-96ed2027f5e2 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1724 microversion: 2.1 time: 0.161616 Aug 23 18:57:34.604464 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3667/7465] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:34 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:35.625317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a0371b4b-3135-4c30-8df2-810d4b5f0aa6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:35.625941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a0371b4b-3135-4c30-8df2-810d4b5f0aa6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:35.635312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0371b4b-3135-4c30-8df2-810d4b5f0aa6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:35.635516 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0371b4b-3135-4c30-8df2-810d4b5f0aa6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:35.635969 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0371b4b-3135-4c30-8df2-810d4b5f0aa6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:35.636685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0371b4b-3135-4c30-8df2-810d4b5f0aa6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:35.637150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0371b4b-3135-4c30-8df2-810d4b5f0aa6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:35.637587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0371b4b-3135-4c30-8df2-810d4b5f0aa6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:35.785346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a0371b4b-3135-4c30-8df2-810d4b5f0aa6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:35.796247 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a0371b4b-3135-4c30-8df2-810d4b5f0aa6 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1724 microversion: 2.1 time: 0.174710 Aug 23 18:57:35.796748 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3799/7466] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:35 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:36.818183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-437ce5d7-ecfd-4085-bf50-4c98de4c757e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:36.818751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-437ce5d7-ecfd-4085-bf50-4c98de4c757e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:36.825985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-437ce5d7-ecfd-4085-bf50-4c98de4c757e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:36.826477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-437ce5d7-ecfd-4085-bf50-4c98de4c757e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:36.826943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-437ce5d7-ecfd-4085-bf50-4c98de4c757e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:36.827650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-437ce5d7-ecfd-4085-bf50-4c98de4c757e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:36.828110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-437ce5d7-ecfd-4085-bf50-4c98de4c757e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:36.828550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-437ce5d7-ecfd-4085-bf50-4c98de4c757e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:36.958508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-437ce5d7-ecfd-4085-bf50-4c98de4c757e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:36.967079 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-437ce5d7-ecfd-4085-bf50-4c98de4c757e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.153420 Aug 23 18:57:36.967651 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3668/7467] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:36 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:37.989448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e35a4f5d-c16c-4084-81d4-ceefaab08785 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:37.989988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e35a4f5d-c16c-4084-81d4-ceefaab08785 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:37.996946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e35a4f5d-c16c-4084-81d4-ceefaab08785 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:37.997441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e35a4f5d-c16c-4084-81d4-ceefaab08785 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:37.997889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e35a4f5d-c16c-4084-81d4-ceefaab08785 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:37.998644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e35a4f5d-c16c-4084-81d4-ceefaab08785 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:37.999109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e35a4f5d-c16c-4084-81d4-ceefaab08785 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:37.999541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e35a4f5d-c16c-4084-81d4-ceefaab08785 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:38.129762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e35a4f5d-c16c-4084-81d4-ceefaab08785 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:38.138128 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e35a4f5d-c16c-4084-81d4-ceefaab08785 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.153295 Aug 23 18:57:38.138722 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3800/7468] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:37 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:39.160563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0d8a8be4-b1d3-4b03-ae1d-642f203c4f37 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:39.161172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0d8a8be4-b1d3-4b03-ae1d-642f203c4f37 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:39.168097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d8a8be4-b1d3-4b03-ae1d-642f203c4f37 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:39.168855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d8a8be4-b1d3-4b03-ae1d-642f203c4f37 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:39.169294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d8a8be4-b1d3-4b03-ae1d-642f203c4f37 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:39.169979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d8a8be4-b1d3-4b03-ae1d-642f203c4f37 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:39.170430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d8a8be4-b1d3-4b03-ae1d-642f203c4f37 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:39.170880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0d8a8be4-b1d3-4b03-ae1d-642f203c4f37 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:39.303890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0d8a8be4-b1d3-4b03-ae1d-642f203c4f37 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:39.312113 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0d8a8be4-b1d3-4b03-ae1d-642f203c4f37 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.155670 Aug 23 18:57:39.312695 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3669/7469] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:39 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:40.334450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-74327d88-f17d-456f-9296-c80758b6df9f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:40.335112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-74327d88-f17d-456f-9296-c80758b6df9f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:40.342894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74327d88-f17d-456f-9296-c80758b6df9f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:40.343404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74327d88-f17d-456f-9296-c80758b6df9f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:40.343859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74327d88-f17d-456f-9296-c80758b6df9f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:40.344577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74327d88-f17d-456f-9296-c80758b6df9f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:40.345048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74327d88-f17d-456f-9296-c80758b6df9f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:40.345494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-74327d88-f17d-456f-9296-c80758b6df9f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:40.478237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-74327d88-f17d-456f-9296-c80758b6df9f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:40.487810 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-74327d88-f17d-456f-9296-c80758b6df9f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.157467 Aug 23 18:57:40.488190 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3801/7470] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:40 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:57:41.509717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d330442f-0342-4e33-9d93-b4597d56021f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:41.511149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d330442f-0342-4e33-9d93-b4597d56021f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:41.519078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d330442f-0342-4e33-9d93-b4597d56021f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:41.519573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d330442f-0342-4e33-9d93-b4597d56021f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:41.520016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d330442f-0342-4e33-9d93-b4597d56021f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:41.520726 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d330442f-0342-4e33-9d93-b4597d56021f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:41.521212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d330442f-0342-4e33-9d93-b4597d56021f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:41.521778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d330442f-0342-4e33-9d93-b4597d56021f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:41.662477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d330442f-0342-4e33-9d93-b4597d56021f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:41.671150 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d330442f-0342-4e33-9d93-b4597d56021f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.165315 Aug 23 18:57:41.671734 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3670/7471] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:41 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:57:42.693796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-485062f6-1d03-4033-81ad-3da5219384a4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:42.694422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-485062f6-1d03-4033-81ad-3da5219384a4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:42.701555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485062f6-1d03-4033-81ad-3da5219384a4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:42.702055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485062f6-1d03-4033-81ad-3da5219384a4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:42.702833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485062f6-1d03-4033-81ad-3da5219384a4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:42.703567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485062f6-1d03-4033-81ad-3da5219384a4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:42.704038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485062f6-1d03-4033-81ad-3da5219384a4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:42.704482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-485062f6-1d03-4033-81ad-3da5219384a4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:42.839852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-485062f6-1d03-4033-81ad-3da5219384a4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:42.848862 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-485062f6-1d03-4033-81ad-3da5219384a4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.159702 Aug 23 18:57:42.849437 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3802/7472] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:42 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:43.870338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dc90291c-6af3-4a8b-bd8b-bb3a9a8a8c6e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:43.870987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dc90291c-6af3-4a8b-bd8b-bb3a9a8a8c6e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:43.878510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc90291c-6af3-4a8b-bd8b-bb3a9a8a8c6e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:43.879093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc90291c-6af3-4a8b-bd8b-bb3a9a8a8c6e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:43.879530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc90291c-6af3-4a8b-bd8b-bb3a9a8a8c6e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:43.880229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc90291c-6af3-4a8b-bd8b-bb3a9a8a8c6e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:43.880685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc90291c-6af3-4a8b-bd8b-bb3a9a8a8c6e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:43.881113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc90291c-6af3-4a8b-bd8b-bb3a9a8a8c6e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:44.015927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dc90291c-6af3-4a8b-bd8b-bb3a9a8a8c6e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:44.026889 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dc90291c-6af3-4a8b-bd8b-bb3a9a8a8c6e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.160380 Aug 23 18:57:44.027475 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3671/7473] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:43 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:45.049116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-671c0cb8-63ec-464e-802e-b0f54d4caee4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:45.049761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-671c0cb8-63ec-464e-802e-b0f54d4caee4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:45.056745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-671c0cb8-63ec-464e-802e-b0f54d4caee4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:45.057317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-671c0cb8-63ec-464e-802e-b0f54d4caee4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:45.057774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-671c0cb8-63ec-464e-802e-b0f54d4caee4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:45.058476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-671c0cb8-63ec-464e-802e-b0f54d4caee4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:45.058964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-671c0cb8-63ec-464e-802e-b0f54d4caee4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:45.059399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-671c0cb8-63ec-464e-802e-b0f54d4caee4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:45.190086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-671c0cb8-63ec-464e-802e-b0f54d4caee4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:45.198959 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-671c0cb8-63ec-464e-802e-b0f54d4caee4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.153877 Aug 23 18:57:45.199525 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3803/7474] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:45 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:46.221253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-36d10002-cdb2-46bb-b898-5ec96fbffa19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:46.222102 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-36d10002-cdb2-46bb-b898-5ec96fbffa19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:46.228725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36d10002-cdb2-46bb-b898-5ec96fbffa19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:46.229204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36d10002-cdb2-46bb-b898-5ec96fbffa19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:46.229637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36d10002-cdb2-46bb-b898-5ec96fbffa19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:46.230326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36d10002-cdb2-46bb-b898-5ec96fbffa19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:46.230805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36d10002-cdb2-46bb-b898-5ec96fbffa19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:46.231233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-36d10002-cdb2-46bb-b898-5ec96fbffa19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:46.366788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-36d10002-cdb2-46bb-b898-5ec96fbffa19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:46.375145 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-36d10002-cdb2-46bb-b898-5ec96fbffa19 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.158441 Aug 23 18:57:46.375714 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3672/7475] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:46 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:47.396379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-91e2ff90-a4ab-4e52-93e4-ab290277b31d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:47.397011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-91e2ff90-a4ab-4e52-93e4-ab290277b31d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:47.404171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91e2ff90-a4ab-4e52-93e4-ab290277b31d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:47.404660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91e2ff90-a4ab-4e52-93e4-ab290277b31d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:47.405103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91e2ff90-a4ab-4e52-93e4-ab290277b31d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:47.405802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91e2ff90-a4ab-4e52-93e4-ab290277b31d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:47.406268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91e2ff90-a4ab-4e52-93e4-ab290277b31d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:47.406732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-91e2ff90-a4ab-4e52-93e4-ab290277b31d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:47.540586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-91e2ff90-a4ab-4e52-93e4-ab290277b31d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:47.550398 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-91e2ff90-a4ab-4e52-93e4-ab290277b31d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.157982 Aug 23 18:57:47.550997 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3804/7476] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:47 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:48.571724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5128d3c3-077d-4ec4-8bb1-c0e5a7ad17ef tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:48.572369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5128d3c3-077d-4ec4-8bb1-c0e5a7ad17ef tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:48.579293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5128d3c3-077d-4ec4-8bb1-c0e5a7ad17ef tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:48.579836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5128d3c3-077d-4ec4-8bb1-c0e5a7ad17ef tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:48.580393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5128d3c3-077d-4ec4-8bb1-c0e5a7ad17ef tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:48.581107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5128d3c3-077d-4ec4-8bb1-c0e5a7ad17ef tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:48.581565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5128d3c3-077d-4ec4-8bb1-c0e5a7ad17ef tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:48.581993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5128d3c3-077d-4ec4-8bb1-c0e5a7ad17ef tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:48.713815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5128d3c3-077d-4ec4-8bb1-c0e5a7ad17ef tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:48.722891 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5128d3c3-077d-4ec4-8bb1-c0e5a7ad17ef tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.155072 Aug 23 18:57:48.723456 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3673/7477] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:48 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:49.744912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8b9b6fdc-5dd8-444d-9db5-17169151f818 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:49.745547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8b9b6fdc-5dd8-444d-9db5-17169151f818 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:49.752452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b9b6fdc-5dd8-444d-9db5-17169151f818 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:49.752950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b9b6fdc-5dd8-444d-9db5-17169151f818 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:49.753396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b9b6fdc-5dd8-444d-9db5-17169151f818 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:49.754102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b9b6fdc-5dd8-444d-9db5-17169151f818 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:49.754578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b9b6fdc-5dd8-444d-9db5-17169151f818 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:49.755016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8b9b6fdc-5dd8-444d-9db5-17169151f818 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:49.888317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8b9b6fdc-5dd8-444d-9db5-17169151f818 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:49.897424 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8b9b6fdc-5dd8-444d-9db5-17169151f818 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.156438 Aug 23 18:57:49.898014 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3805/7478] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:49 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:50.919865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0b581bc9-63d3-4eba-80e2-14318a527441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:50.920399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0b581bc9-63d3-4eba-80e2-14318a527441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:50.927418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0b581bc9-63d3-4eba-80e2-14318a527441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:50.927899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0b581bc9-63d3-4eba-80e2-14318a527441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:50.928333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0b581bc9-63d3-4eba-80e2-14318a527441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:50.929021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0b581bc9-63d3-4eba-80e2-14318a527441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:50.929473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0b581bc9-63d3-4eba-80e2-14318a527441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:50.929898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0b581bc9-63d3-4eba-80e2-14318a527441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:51.066513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0b581bc9-63d3-4eba-80e2-14318a527441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:51.074737 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0b581bc9-63d3-4eba-80e2-14318a527441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.158883 Aug 23 18:57:51.075307 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3674/7479] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:50 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:52.097112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-32739d9b-0d70-4bf4-a7e4-10ff770a4bae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:52.097629 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-32739d9b-0d70-4bf4-a7e4-10ff770a4bae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:52.104894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32739d9b-0d70-4bf4-a7e4-10ff770a4bae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:52.105388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32739d9b-0d70-4bf4-a7e4-10ff770a4bae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:52.105834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32739d9b-0d70-4bf4-a7e4-10ff770a4bae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:52.106529 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32739d9b-0d70-4bf4-a7e4-10ff770a4bae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:52.107017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32739d9b-0d70-4bf4-a7e4-10ff770a4bae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:52.107448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-32739d9b-0d70-4bf4-a7e4-10ff770a4bae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:52.246651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-32739d9b-0d70-4bf4-a7e4-10ff770a4bae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:52.255662 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-32739d9b-0d70-4bf4-a7e4-10ff770a4bae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.162677 Aug 23 18:57:52.256226 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3806/7480] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:52 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:53.277928 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c671de75-6356-44ce-822b-6dd133222c33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:53.278562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c671de75-6356-44ce-822b-6dd133222c33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:53.286327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c671de75-6356-44ce-822b-6dd133222c33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:53.286843 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c671de75-6356-44ce-822b-6dd133222c33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:53.287286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c671de75-6356-44ce-822b-6dd133222c33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:53.287980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c671de75-6356-44ce-822b-6dd133222c33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:53.288439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c671de75-6356-44ce-822b-6dd133222c33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:53.288867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c671de75-6356-44ce-822b-6dd133222c33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:53.418411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c671de75-6356-44ce-822b-6dd133222c33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:53.427381 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c671de75-6356-44ce-822b-6dd133222c33 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.153383 Aug 23 18:57:53.427962 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3675/7481] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:53 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:54.449386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5a25b4aa-08f7-41bc-ae00-33c43f89bae1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:54.449932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5a25b4aa-08f7-41bc-ae00-33c43f89bae1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:54.457590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a25b4aa-08f7-41bc-ae00-33c43f89bae1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:54.458105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a25b4aa-08f7-41bc-ae00-33c43f89bae1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:54.459164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a25b4aa-08f7-41bc-ae00-33c43f89bae1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:54.459924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a25b4aa-08f7-41bc-ae00-33c43f89bae1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:54.460403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a25b4aa-08f7-41bc-ae00-33c43f89bae1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:54.460856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5a25b4aa-08f7-41bc-ae00-33c43f89bae1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:54.595250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5a25b4aa-08f7-41bc-ae00-33c43f89bae1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:54.603656 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5a25b4aa-08f7-41bc-ae00-33c43f89bae1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.158303 Aug 23 18:57:54.604232 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3807/7482] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:54 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:55.625239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-71593215-3732-47d1-9338-20286da9833f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:55.625871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-71593215-3732-47d1-9338-20286da9833f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:55.637760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-71593215-3732-47d1-9338-20286da9833f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:55.638244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-71593215-3732-47d1-9338-20286da9833f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:55.638708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-71593215-3732-47d1-9338-20286da9833f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:55.639411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-71593215-3732-47d1-9338-20286da9833f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:55.639870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-71593215-3732-47d1-9338-20286da9833f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:55.640293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-71593215-3732-47d1-9338-20286da9833f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:55.775067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-71593215-3732-47d1-9338-20286da9833f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:55.783792 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-71593215-3732-47d1-9338-20286da9833f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1729 microversion: 2.1 time: 0.162396 Aug 23 18:57:55.784368 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3676/7483] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:55 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:56.588898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8ef7dfca-847d-4108-928a-8b04ff368a19 req-0847cf46-fc0d-4293-8bea-3b93cd9d430f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd5dd1c-1232-4d1a-951f-eebd0280ab56", "name": "network-vif-unplugged", "status": "completed", "tag": "30c45c34-b0c4-483d-b481-6114a60bf7c5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:57:56.600670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8ef7dfca-847d-4108-928a-8b04ff368a19 req-0847cf46-fc0d-4293-8bea-3b93cd9d430f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:56.601193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8ef7dfca-847d-4108-928a-8b04ff368a19 req-0847cf46-fc0d-4293-8bea-3b93cd9d430f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:56.601640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8ef7dfca-847d-4108-928a-8b04ff368a19 req-0847cf46-fc0d-4293-8bea-3b93cd9d430f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:56.614465 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8ef7dfca-847d-4108-928a-8b04ff368a19 req-0847cf46-fc0d-4293-8bea-3b93cd9d430f service nova] Creating event network-vif-unplugged:30c45c34-b0c4-483d-b481-6114a60bf7c5 for instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 on n-h1-850468-16 Aug 23 18:57:56.620245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-8ef7dfca-847d-4108-928a-8b04ff368a19 req-0847cf46-fc0d-4293-8bea-3b93cd9d430f service nova] Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:57:56.634358 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8ef7dfca-847d-4108-928a-8b04ff368a19 req-0847cf46-fc0d-4293-8bea-3b93cd9d430f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049218 Aug 23 18:57:56.635117 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3808/7484] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:57:56.806168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-756431fd-cfbe-45c6-8c61-f22cda3e4253 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:56.806825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-756431fd-cfbe-45c6-8c61-f22cda3e4253 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:56.812721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-756431fd-cfbe-45c6-8c61-f22cda3e4253 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:56.813209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-756431fd-cfbe-45c6-8c61-f22cda3e4253 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:56.813647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-756431fd-cfbe-45c6-8c61-f22cda3e4253 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:56.814519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-756431fd-cfbe-45c6-8c61-f22cda3e4253 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:56.815008 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-756431fd-cfbe-45c6-8c61-f22cda3e4253 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:56.815441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-756431fd-cfbe-45c6-8c61-f22cda3e4253 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:57.022060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-756431fd-cfbe-45c6-8c61-f22cda3e4253 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:57.033562 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-756431fd-cfbe-45c6-8c61-f22cda3e4253 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1728 microversion: 2.1 time: 0.230895 Aug 23 18:57:57.034317 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3677/7485] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:56 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1728 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:58.057018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0dde9f7d-66e1-4d8f-a8ad-9a45d9cf390e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:58.057622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0dde9f7d-66e1-4d8f-a8ad-9a45d9cf390e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:58.063971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0dde9f7d-66e1-4d8f-a8ad-9a45d9cf390e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:58.064479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0dde9f7d-66e1-4d8f-a8ad-9a45d9cf390e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:58.064933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0dde9f7d-66e1-4d8f-a8ad-9a45d9cf390e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:58.065649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0dde9f7d-66e1-4d8f-a8ad-9a45d9cf390e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:58.066123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0dde9f7d-66e1-4d8f-a8ad-9a45d9cf390e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:58.066587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0dde9f7d-66e1-4d8f-a8ad-9a45d9cf390e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:58.202147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0dde9f7d-66e1-4d8f-a8ad-9a45d9cf390e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:58.211454 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0dde9f7d-66e1-4d8f-a8ad-9a45d9cf390e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1726 microversion: 2.1 time: 0.159637 Aug 23 18:57:58.212026 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3809/7486] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:58 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:57:58.678428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-78d36fb9-2c10-4dca-855f-cd8743e48b4b req-a105e0d8-7165-4a4d-83bd-28a5a77a5d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd5dd1c-1232-4d1a-951f-eebd0280ab56", "tag": "30c45c34-b0c4-483d-b481-6114a60bf7c5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:57:58.689220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-78d36fb9-2c10-4dca-855f-cd8743e48b4b req-a105e0d8-7165-4a4d-83bd-28a5a77a5d96 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:58.689699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-78d36fb9-2c10-4dca-855f-cd8743e48b4b req-a105e0d8-7165-4a4d-83bd-28a5a77a5d96 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:58.690133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-78d36fb9-2c10-4dca-855f-cd8743e48b4b req-a105e0d8-7165-4a4d-83bd-28a5a77a5d96 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:58.703281 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-78d36fb9-2c10-4dca-855f-cd8743e48b4b req-a105e0d8-7165-4a4d-83bd-28a5a77a5d96 service nova] Creating event network-changed:30c45c34-b0c4-483d-b481-6114a60bf7c5 for instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 on n-h1-850468-16 Aug 23 18:57:58.709362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-78d36fb9-2c10-4dca-855f-cd8743e48b4b req-a105e0d8-7165-4a4d-83bd-28a5a77a5d96 service nova] Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:57:58.721654 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-78d36fb9-2c10-4dca-855f-cd8743e48b4b req-a105e0d8-7165-4a4d-83bd-28a5a77a5d96 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046988 Aug 23 18:57:58.722261 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3678/7487] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:57:59.234014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bd6400d7-33ea-4e58-8c3b-5f91e61c9aa0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:57:59.235289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bd6400d7-33ea-4e58-8c3b-5f91e61c9aa0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:57:59.243909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd6400d7-33ea-4e58-8c3b-5f91e61c9aa0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:59.244433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd6400d7-33ea-4e58-8c3b-5f91e61c9aa0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:59.244982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd6400d7-33ea-4e58-8c3b-5f91e61c9aa0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:59.245788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd6400d7-33ea-4e58-8c3b-5f91e61c9aa0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:57:59.246431 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd6400d7-33ea-4e58-8c3b-5f91e61c9aa0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:57:59.246988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd6400d7-33ea-4e58-8c3b-5f91e61c9aa0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:57:59.391073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bd6400d7-33ea-4e58-8c3b-5f91e61c9aa0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:57:59.401081 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bd6400d7-33ea-4e58-8c3b-5f91e61c9aa0 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1726 microversion: 2.1 time: 0.171376 Aug 23 18:57:59.402149 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3810/7488] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:57:59 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1726 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:00.426259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e04c6832-8ddc-49f2-b132-04200e3e54b8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:00.427110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e04c6832-8ddc-49f2-b132-04200e3e54b8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:00.434608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e04c6832-8ddc-49f2-b132-04200e3e54b8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:00.435096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e04c6832-8ddc-49f2-b132-04200e3e54b8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:00.435532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e04c6832-8ddc-49f2-b132-04200e3e54b8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:00.436222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e04c6832-8ddc-49f2-b132-04200e3e54b8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:00.436677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e04c6832-8ddc-49f2-b132-04200e3e54b8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:00.437129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e04c6832-8ddc-49f2-b132-04200e3e54b8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:00.572573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e04c6832-8ddc-49f2-b132-04200e3e54b8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:00.582095 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e04c6832-8ddc-49f2-b132-04200e3e54b8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1726 microversion: 2.1 time: 0.160499 Aug 23 18:58:00.582706 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3679/7489] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:00 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1726 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:01.604148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a91ec99-ac44-417a-bf1b-3d79df95ea3c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:01.604780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8a91ec99-ac44-417a-bf1b-3d79df95ea3c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:01.607595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=29 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:58:01.613780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a91ec99-ac44-417a-bf1b-3d79df95ea3c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:01.614295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a91ec99-ac44-417a-bf1b-3d79df95ea3c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:01.614788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a91ec99-ac44-417a-bf1b-3d79df95ea3c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:01.615513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a91ec99-ac44-417a-bf1b-3d79df95ea3c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:01.615988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a91ec99-ac44-417a-bf1b-3d79df95ea3c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:01.616423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a91ec99-ac44-417a-bf1b-3d79df95ea3c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:01.619453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=83 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:58:02.010417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8a91ec99-ac44-417a-bf1b-3d79df95ea3c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:02.019532 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8a91ec99-ac44-417a-bf1b-3d79df95ea3c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1726 microversion: 2.1 time: 0.419205 Aug 23 18:58:02.020324 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3811/7490] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:01 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1726 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:03.041209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ca503eb0-2efc-46b9-bf08-6160f6f93d51 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:03.041757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ca503eb0-2efc-46b9-bf08-6160f6f93d51 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:03.044564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=35 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:58:03.050888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca503eb0-2efc-46b9-bf08-6160f6f93d51 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:03.051376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca503eb0-2efc-46b9-bf08-6160f6f93d51 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:03.051818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca503eb0-2efc-46b9-bf08-6160f6f93d51 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:03.052524 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca503eb0-2efc-46b9-bf08-6160f6f93d51 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:03.052979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca503eb0-2efc-46b9-bf08-6160f6f93d51 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:03.053407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ca503eb0-2efc-46b9-bf08-6160f6f93d51 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:03.056179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:58:03.186373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ca503eb0-2efc-46b9-bf08-6160f6f93d51 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:03.195573 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ca503eb0-2efc-46b9-bf08-6160f6f93d51 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1726 microversion: 2.1 time: 0.158357 Aug 23 18:58:03.196148 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3680/7491] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:03 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:04.217266 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-90b69496-7b98-4322-bf1e-2766a1f0a030 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:04.217896 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-90b69496-7b98-4322-bf1e-2766a1f0a030 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:04.225354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90b69496-7b98-4322-bf1e-2766a1f0a030 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:04.225845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90b69496-7b98-4322-bf1e-2766a1f0a030 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:04.226293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90b69496-7b98-4322-bf1e-2766a1f0a030 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:04.227021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90b69496-7b98-4322-bf1e-2766a1f0a030 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:04.227488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90b69496-7b98-4322-bf1e-2766a1f0a030 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:04.227924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-90b69496-7b98-4322-bf1e-2766a1f0a030 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:04.364790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-90b69496-7b98-4322-bf1e-2766a1f0a030 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:04.372999 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-90b69496-7b98-4322-bf1e-2766a1f0a030 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1726 microversion: 2.1 time: 0.160023 Aug 23 18:58:04.373555 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3812/7492] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:04 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1726 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:05.394921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-05759948-2dac-4ec6-9b1f-ad7b66d5a325 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:05.395541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-05759948-2dac-4ec6-9b1f-ad7b66d5a325 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:05.402612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05759948-2dac-4ec6-9b1f-ad7b66d5a325 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:05.403105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05759948-2dac-4ec6-9b1f-ad7b66d5a325 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:05.403545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05759948-2dac-4ec6-9b1f-ad7b66d5a325 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:05.404241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05759948-2dac-4ec6-9b1f-ad7b66d5a325 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:05.404697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05759948-2dac-4ec6-9b1f-ad7b66d5a325 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:05.405123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-05759948-2dac-4ec6-9b1f-ad7b66d5a325 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:05.538508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-05759948-2dac-4ec6-9b1f-ad7b66d5a325 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:05.546944 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-05759948-2dac-4ec6-9b1f-ad7b66d5a325 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1726 microversion: 2.1 time: 0.156147 Aug 23 18:58:05.547523 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3681/7493] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:05 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1726 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:06.568351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-77305075-385f-46c5-aa44-4b398d9754dd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:06.569014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-77305075-385f-46c5-aa44-4b398d9754dd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:06.575724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77305075-385f-46c5-aa44-4b398d9754dd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:06.576220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77305075-385f-46c5-aa44-4b398d9754dd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:06.576666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77305075-385f-46c5-aa44-4b398d9754dd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:06.577367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77305075-385f-46c5-aa44-4b398d9754dd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:06.577833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77305075-385f-46c5-aa44-4b398d9754dd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:06.578269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77305075-385f-46c5-aa44-4b398d9754dd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:06.718701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-77305075-385f-46c5-aa44-4b398d9754dd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:06.727460 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-77305075-385f-46c5-aa44-4b398d9754dd tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1726 microversion: 2.1 time: 0.163049 Aug 23 18:58:06.728089 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3813/7494] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:06 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:07.749314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8601180d-566d-470a-ba19-f0b046c46ed3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:07.749931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8601180d-566d-470a-ba19-f0b046c46ed3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:07.758418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8601180d-566d-470a-ba19-f0b046c46ed3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:07.758964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8601180d-566d-470a-ba19-f0b046c46ed3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:07.759416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8601180d-566d-470a-ba19-f0b046c46ed3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:07.760126 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8601180d-566d-470a-ba19-f0b046c46ed3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:07.760586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8601180d-566d-470a-ba19-f0b046c46ed3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:07.761018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8601180d-566d-470a-ba19-f0b046c46ed3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:07.988637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8601180d-566d-470a-ba19-f0b046c46ed3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:07.997174 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8601180d-566d-470a-ba19-f0b046c46ed3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1726 microversion: 2.1 time: 0.251707 Aug 23 18:58:07.997751 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3682/7495] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:07 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1726 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:09.019294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6dfbb1ab-0616-475b-8aa6-710c42d27039 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:09.019873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6dfbb1ab-0616-475b-8aa6-710c42d27039 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:09.026821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dfbb1ab-0616-475b-8aa6-710c42d27039 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:09.027327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dfbb1ab-0616-475b-8aa6-710c42d27039 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:09.027786 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dfbb1ab-0616-475b-8aa6-710c42d27039 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:09.028505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dfbb1ab-0616-475b-8aa6-710c42d27039 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:09.028981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dfbb1ab-0616-475b-8aa6-710c42d27039 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:09.029449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dfbb1ab-0616-475b-8aa6-710c42d27039 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:09.176575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6dfbb1ab-0616-475b-8aa6-710c42d27039 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:09.185278 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6dfbb1ab-0616-475b-8aa6-710c42d27039 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1726 microversion: 2.1 time: 0.170382 Aug 23 18:58:09.185891 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3814/7496] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:09 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1726 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:10.213392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6b1bc570-291a-46c1-9c13-24382d04d3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:10.214002 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6b1bc570-291a-46c1-9c13-24382d04d3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:10.222294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b1bc570-291a-46c1-9c13-24382d04d3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:10.222803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b1bc570-291a-46c1-9c13-24382d04d3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:10.223245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b1bc570-291a-46c1-9c13-24382d04d3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:10.223937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b1bc570-291a-46c1-9c13-24382d04d3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:10.224393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b1bc570-291a-46c1-9c13-24382d04d3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:10.224818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b1bc570-291a-46c1-9c13-24382d04d3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:10.359637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6b1bc570-291a-46c1-9c13-24382d04d3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:10.368418 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6b1bc570-291a-46c1-9c13-24382d04d3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1726 microversion: 2.1 time: 0.158898 Aug 23 18:58:10.368996 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3683/7497] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:10 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1726 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:11.390030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ab4af4c7-ea74-46f0-a516-6f5f921acca5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:11.390687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab4af4c7-ea74-46f0-a516-6f5f921acca5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:11.398236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab4af4c7-ea74-46f0-a516-6f5f921acca5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:11.398779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab4af4c7-ea74-46f0-a516-6f5f921acca5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:11.399235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab4af4c7-ea74-46f0-a516-6f5f921acca5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:11.399974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab4af4c7-ea74-46f0-a516-6f5f921acca5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:11.400448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab4af4c7-ea74-46f0-a516-6f5f921acca5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:11.400892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab4af4c7-ea74-46f0-a516-6f5f921acca5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:11.533501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ab4af4c7-ea74-46f0-a516-6f5f921acca5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:11.542275 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ab4af4c7-ea74-46f0-a516-6f5f921acca5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1723 microversion: 2.1 time: 0.156104 Aug 23 18:58:11.542892 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3815/7498] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:11 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:11.562925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:58:11.563577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:11.570415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:11.570910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:11.571352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:11.572054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:11.572509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:11.572934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:11.614061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:11.614580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:11.615016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:11.615762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:11.616225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:11.616657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:11.638018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'cores', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:58:11.644825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Getting quotas for user b1b1944b15d547e4b68df40cb65a74a6 and project 70da5a93b1b5409fa093b0a8c99b2861. Resources: {'cores', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:58:11.747509 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3b4724aa-4340-422c-a603-626e7373b264 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "POST /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56/action" status: 202 len: 0 microversion: 2.1 time: 0.188215 Aug 23 18:58:11.752065 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3684/7499] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:58:11 2022] POST /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:58:11.759079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3e70cdeb-6aba-4c49-9af3-3dffc6f8c91a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:11.759649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3e70cdeb-6aba-4c49-9af3-3dffc6f8c91a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:11.769163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e70cdeb-6aba-4c49-9af3-3dffc6f8c91a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:11.769681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e70cdeb-6aba-4c49-9af3-3dffc6f8c91a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:11.770156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e70cdeb-6aba-4c49-9af3-3dffc6f8c91a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:11.770933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e70cdeb-6aba-4c49-9af3-3dffc6f8c91a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:11.771408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e70cdeb-6aba-4c49-9af3-3dffc6f8c91a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:11.771858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e70cdeb-6aba-4c49-9af3-3dffc6f8c91a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:11.909045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e70cdeb-6aba-4c49-9af3-3dffc6f8c91a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:11.917559 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3e70cdeb-6aba-4c49-9af3-3dffc6f8c91a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.164070 Aug 23 18:58:11.918140 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3816/7500] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:11 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:12.940560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-72540763-498e-453b-9d7d-402509f09441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:12.941184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-72540763-498e-453b-9d7d-402509f09441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:12.947591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72540763-498e-453b-9d7d-402509f09441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:12.948076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72540763-498e-453b-9d7d-402509f09441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:12.948511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72540763-498e-453b-9d7d-402509f09441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:12.949198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72540763-498e-453b-9d7d-402509f09441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:12.949652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72540763-498e-453b-9d7d-402509f09441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:12.950077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-72540763-498e-453b-9d7d-402509f09441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:13.090488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-72540763-498e-453b-9d7d-402509f09441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:13.099617 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-72540763-498e-453b-9d7d-402509f09441 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.164470 Aug 23 18:58:13.100200 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3685/7501] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:12 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:13.146025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-9a68590b-f366-4a8f-888f-b5dd45252047 req-c54863fe-cb56-4c4b-a16c-bc622ed1df11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd5dd1c-1232-4d1a-951f-eebd0280ab56", "name": "network-vif-plugged", "status": "completed", "tag": "30c45c34-b0c4-483d-b481-6114a60bf7c5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:58:13.158693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9a68590b-f366-4a8f-888f-b5dd45252047 req-c54863fe-cb56-4c4b-a16c-bc622ed1df11 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:13.159196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9a68590b-f366-4a8f-888f-b5dd45252047 req-c54863fe-cb56-4c4b-a16c-bc622ed1df11 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:13.159644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-9a68590b-f366-4a8f-888f-b5dd45252047 req-c54863fe-cb56-4c4b-a16c-bc622ed1df11 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:13.171364 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-9a68590b-f366-4a8f-888f-b5dd45252047 req-c54863fe-cb56-4c4b-a16c-bc622ed1df11 service nova] Creating event network-vif-plugged:30c45c34-b0c4-483d-b481-6114a60bf7c5 for instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 on n-h1-850468-16 Aug 23 18:58:13.177277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-9a68590b-f366-4a8f-888f-b5dd45252047 req-c54863fe-cb56-4c4b-a16c-bc622ed1df11 service nova] Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:58:13.188407 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-9a68590b-f366-4a8f-888f-b5dd45252047 req-c54863fe-cb56-4c4b-a16c-bc622ed1df11 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047343 Aug 23 18:58:13.189024 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3817/7502] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:58:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:58:14.122284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ed1aeec1-837b-4027-89a6-1ea65b631533 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:14.123096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ed1aeec1-837b-4027-89a6-1ea65b631533 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:14.131397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed1aeec1-837b-4027-89a6-1ea65b631533 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:14.131957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed1aeec1-837b-4027-89a6-1ea65b631533 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:14.132494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed1aeec1-837b-4027-89a6-1ea65b631533 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:14.133323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed1aeec1-837b-4027-89a6-1ea65b631533 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:14.133779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed1aeec1-837b-4027-89a6-1ea65b631533 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:14.134199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ed1aeec1-837b-4027-89a6-1ea65b631533 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:14.272528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ed1aeec1-837b-4027-89a6-1ea65b631533 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:14.281044 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ed1aeec1-837b-4027-89a6-1ea65b631533 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.162681 Aug 23 18:58:14.281621 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3686/7503] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:14 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:15.304476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-884de1a9-f4d3-43fc-842b-b708283283d4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:15.305124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-884de1a9-f4d3-43fc-842b-b708283283d4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:15.312045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884de1a9-f4d3-43fc-842b-b708283283d4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:15.312045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884de1a9-f4d3-43fc-842b-b708283283d4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:15.312391 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884de1a9-f4d3-43fc-842b-b708283283d4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:15.313108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884de1a9-f4d3-43fc-842b-b708283283d4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:15.314374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884de1a9-f4d3-43fc-842b-b708283283d4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:15.314862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-884de1a9-f4d3-43fc-842b-b708283283d4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:15.455682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-884de1a9-f4d3-43fc-842b-b708283283d4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:15.465815 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-884de1a9-f4d3-43fc-842b-b708283283d4 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.166670 Aug 23 18:58:15.466602 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3818/7504] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:15 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:16.489791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-17c527a5-8d28-4a68-98c4-a1514242acb8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:16.490646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-17c527a5-8d28-4a68-98c4-a1514242acb8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:16.512823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17c527a5-8d28-4a68-98c4-a1514242acb8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:16.513434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17c527a5-8d28-4a68-98c4-a1514242acb8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:16.514151 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17c527a5-8d28-4a68-98c4-a1514242acb8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:16.514982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17c527a5-8d28-4a68-98c4-a1514242acb8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:16.515410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17c527a5-8d28-4a68-98c4-a1514242acb8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:16.515988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17c527a5-8d28-4a68-98c4-a1514242acb8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:16.995810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-17c527a5-8d28-4a68-98c4-a1514242acb8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:17.004935 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-17c527a5-8d28-4a68-98c4-a1514242acb8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.520396 Aug 23 18:58:17.005522 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3687/7505] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:16 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:17.347365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7fcfacb4-d7ba-4d42-a475-f0e15e0b467d req-74329e6a-bfbb-4aad-8ac2-677419185ead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd5dd1c-1232-4d1a-951f-eebd0280ab56", "name": "network-vif-unplugged", "status": "completed", "tag": "30c45c34-b0c4-483d-b481-6114a60bf7c5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:58:17.357906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7fcfacb4-d7ba-4d42-a475-f0e15e0b467d req-74329e6a-bfbb-4aad-8ac2-677419185ead service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:17.358405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7fcfacb4-d7ba-4d42-a475-f0e15e0b467d req-74329e6a-bfbb-4aad-8ac2-677419185ead service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:17.358890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7fcfacb4-d7ba-4d42-a475-f0e15e0b467d req-74329e6a-bfbb-4aad-8ac2-677419185ead service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:17.371803 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7fcfacb4-d7ba-4d42-a475-f0e15e0b467d req-74329e6a-bfbb-4aad-8ac2-677419185ead service nova] Creating event network-vif-unplugged:30c45c34-b0c4-483d-b481-6114a60bf7c5 for instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 on n-h2-850468-16 Aug 23 18:58:17.377882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-7fcfacb4-d7ba-4d42-a475-f0e15e0b467d req-74329e6a-bfbb-4aad-8ac2-677419185ead service nova] Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:58:17.388592 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7fcfacb4-d7ba-4d42-a475-f0e15e0b467d req-74329e6a-bfbb-4aad-8ac2-677419185ead service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045520 Aug 23 18:58:17.389355 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3819/7506] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:58:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:58:18.027228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-20c9495f-febd-4f66-a72d-53633bff6640 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:18.027946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-20c9495f-febd-4f66-a72d-53633bff6640 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:18.035561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20c9495f-febd-4f66-a72d-53633bff6640 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:18.036044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20c9495f-febd-4f66-a72d-53633bff6640 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:18.036475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20c9495f-febd-4f66-a72d-53633bff6640 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:18.037170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20c9495f-febd-4f66-a72d-53633bff6640 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:18.037621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20c9495f-febd-4f66-a72d-53633bff6640 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:18.038048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20c9495f-febd-4f66-a72d-53633bff6640 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:18.277780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20c9495f-febd-4f66-a72d-53633bff6640 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:18.286367 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-20c9495f-febd-4f66-a72d-53633bff6640 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.263084 Aug 23 18:58:18.286950 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3688/7507] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:18 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:19.310572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-34887ae7-f61c-40e5-ab2a-973895445f4d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:19.311185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-34887ae7-f61c-40e5-ab2a-973895445f4d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:19.318310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34887ae7-f61c-40e5-ab2a-973895445f4d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:19.318849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34887ae7-f61c-40e5-ab2a-973895445f4d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:19.319299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34887ae7-f61c-40e5-ab2a-973895445f4d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:19.320003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34887ae7-f61c-40e5-ab2a-973895445f4d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:19.320470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34887ae7-f61c-40e5-ab2a-973895445f4d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:19.320907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-34887ae7-f61c-40e5-ab2a-973895445f4d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:19.418864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-673c5cbb-f457-4a85-b087-413aefef6f2a req-b6570b96-db89-46b4-a620-d33c57b27511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cd5dd1c-1232-4d1a-951f-eebd0280ab56", "tag": "30c45c34-b0c4-483d-b481-6114a60bf7c5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:58:19.430577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-673c5cbb-f457-4a85-b087-413aefef6f2a req-b6570b96-db89-46b4-a620-d33c57b27511 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:19.432312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-673c5cbb-f457-4a85-b087-413aefef6f2a req-b6570b96-db89-46b4-a620-d33c57b27511 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:19.432759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-673c5cbb-f457-4a85-b087-413aefef6f2a req-b6570b96-db89-46b4-a620-d33c57b27511 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:19.445067 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-673c5cbb-f457-4a85-b087-413aefef6f2a req-b6570b96-db89-46b4-a620-d33c57b27511 service nova] Creating event network-changed:30c45c34-b0c4-483d-b481-6114a60bf7c5 for instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 on n-h2-850468-16 Aug 23 18:58:19.450779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-673c5cbb-f457-4a85-b087-413aefef6f2a req-b6570b96-db89-46b4-a620-d33c57b27511 service nova] Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 18:58:19.458643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-34887ae7-f61c-40e5-ab2a-973895445f4d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:19.463150 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-673c5cbb-f457-4a85-b087-413aefef6f2a req-b6570b96-db89-46b4-a620-d33c57b27511 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047776 Aug 23 18:58:19.463935 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3689/7508] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:58:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:58:19.467544 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-34887ae7-f61c-40e5-ab2a-973895445f4d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.162506 Aug 23 18:58:19.468900 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3820/7509] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:19 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:20.492407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f13ef77b-67bd-4f70-8a11-3bc1813d8732 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:20.493052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f13ef77b-67bd-4f70-8a11-3bc1813d8732 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:20.499500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f13ef77b-67bd-4f70-8a11-3bc1813d8732 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:20.499993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f13ef77b-67bd-4f70-8a11-3bc1813d8732 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:20.500435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f13ef77b-67bd-4f70-8a11-3bc1813d8732 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:20.501326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f13ef77b-67bd-4f70-8a11-3bc1813d8732 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:20.502034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f13ef77b-67bd-4f70-8a11-3bc1813d8732 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:20.502466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f13ef77b-67bd-4f70-8a11-3bc1813d8732 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:20.650457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f13ef77b-67bd-4f70-8a11-3bc1813d8732 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:20.659537 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f13ef77b-67bd-4f70-8a11-3bc1813d8732 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.172566 Aug 23 18:58:20.660125 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3690/7510] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:20 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:21.681492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-349f2a6f-e4bd-44b6-b863-f2819463405d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:21.682126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-349f2a6f-e4bd-44b6-b863-f2819463405d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:21.689930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-349f2a6f-e4bd-44b6-b863-f2819463405d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:21.690433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-349f2a6f-e4bd-44b6-b863-f2819463405d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:21.690908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-349f2a6f-e4bd-44b6-b863-f2819463405d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:21.691627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-349f2a6f-e4bd-44b6-b863-f2819463405d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:21.692097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-349f2a6f-e4bd-44b6-b863-f2819463405d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:21.692588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-349f2a6f-e4bd-44b6-b863-f2819463405d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:21.835256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-349f2a6f-e4bd-44b6-b863-f2819463405d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:21.843958 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-349f2a6f-e4bd-44b6-b863-f2819463405d tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.166505 Aug 23 18:58:21.844607 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3821/7511] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:21 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:22.866188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c013e0c9-c1f2-403b-9b78-eed8c15cc938 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:22.866827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c013e0c9-c1f2-403b-9b78-eed8c15cc938 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:22.869694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:58:22.876673 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c013e0c9-c1f2-403b-9b78-eed8c15cc938 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:22.877181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c013e0c9-c1f2-403b-9b78-eed8c15cc938 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:22.877804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c013e0c9-c1f2-403b-9b78-eed8c15cc938 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:22.878536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c013e0c9-c1f2-403b-9b78-eed8c15cc938 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:22.879033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c013e0c9-c1f2-403b-9b78-eed8c15cc938 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:22.879507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c013e0c9-c1f2-403b-9b78-eed8c15cc938 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:23.016105 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c013e0c9-c1f2-403b-9b78-eed8c15cc938 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:23.025546 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c013e0c9-c1f2-403b-9b78-eed8c15cc938 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.163316 Aug 23 18:58:23.026589 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3691/7512] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:22 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:24.048623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ecd103a8-650d-47f8-adcc-7cd8835ff65f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:24.049170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ecd103a8-650d-47f8-adcc-7cd8835ff65f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:24.056070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecd103a8-650d-47f8-adcc-7cd8835ff65f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:24.056573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecd103a8-650d-47f8-adcc-7cd8835ff65f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:24.057034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecd103a8-650d-47f8-adcc-7cd8835ff65f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:24.057748 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecd103a8-650d-47f8-adcc-7cd8835ff65f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:24.058221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecd103a8-650d-47f8-adcc-7cd8835ff65f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:24.058698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ecd103a8-650d-47f8-adcc-7cd8835ff65f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:24.190931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ecd103a8-650d-47f8-adcc-7cd8835ff65f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:24.199504 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ecd103a8-650d-47f8-adcc-7cd8835ff65f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.155080 Aug 23 18:58:24.200083 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3822/7513] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:24 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:25.221694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47bb0f69-dd24-4d70-a2a7-46dd3d96e9f5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:25.222310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-47bb0f69-dd24-4d70-a2a7-46dd3d96e9f5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:25.229193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47bb0f69-dd24-4d70-a2a7-46dd3d96e9f5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:25.229684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47bb0f69-dd24-4d70-a2a7-46dd3d96e9f5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:25.230131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47bb0f69-dd24-4d70-a2a7-46dd3d96e9f5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:25.230864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47bb0f69-dd24-4d70-a2a7-46dd3d96e9f5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:25.231325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47bb0f69-dd24-4d70-a2a7-46dd3d96e9f5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:25.231760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47bb0f69-dd24-4d70-a2a7-46dd3d96e9f5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:25.360921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-47bb0f69-dd24-4d70-a2a7-46dd3d96e9f5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:25.369251 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-47bb0f69-dd24-4d70-a2a7-46dd3d96e9f5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.152436 Aug 23 18:58:25.369831 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3692/7514] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:25 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:26.390528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d195cb68-2b59-424e-a06f-179bb35fa3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:26.391213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d195cb68-2b59-424e-a06f-179bb35fa3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:26.398203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d195cb68-2b59-424e-a06f-179bb35fa3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:26.398737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d195cb68-2b59-424e-a06f-179bb35fa3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:26.399199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d195cb68-2b59-424e-a06f-179bb35fa3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:26.399908 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d195cb68-2b59-424e-a06f-179bb35fa3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:26.400378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d195cb68-2b59-424e-a06f-179bb35fa3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:26.400818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d195cb68-2b59-424e-a06f-179bb35fa3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:26.539470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d195cb68-2b59-424e-a06f-179bb35fa3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:26.548802 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d195cb68-2b59-424e-a06f-179bb35fa3f8 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.162067 Aug 23 18:58:26.549402 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3823/7515] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:26 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:27.569466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fe21456f-c732-4507-be74-f879843e5162 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:27.570063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe21456f-c732-4507-be74-f879843e5162 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:27.576639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe21456f-c732-4507-be74-f879843e5162 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:27.577124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe21456f-c732-4507-be74-f879843e5162 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:27.577560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe21456f-c732-4507-be74-f879843e5162 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:27.578250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe21456f-c732-4507-be74-f879843e5162 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:27.578739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe21456f-c732-4507-be74-f879843e5162 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:27.579166 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe21456f-c732-4507-be74-f879843e5162 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:27.716557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fe21456f-c732-4507-be74-f879843e5162 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:27.725384 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fe21456f-c732-4507-be74-f879843e5162 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.159926 Aug 23 18:58:27.725955 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3693/7516] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:27 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:28.747351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4bd78a09-57ad-42cd-bfe2-bd280d4e596c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:28.747989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4bd78a09-57ad-42cd-bfe2-bd280d4e596c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:28.755263 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4bd78a09-57ad-42cd-bfe2-bd280d4e596c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:28.755763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4bd78a09-57ad-42cd-bfe2-bd280d4e596c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:28.756216 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4bd78a09-57ad-42cd-bfe2-bd280d4e596c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:28.756930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4bd78a09-57ad-42cd-bfe2-bd280d4e596c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:28.757402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4bd78a09-57ad-42cd-bfe2-bd280d4e596c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:28.757841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4bd78a09-57ad-42cd-bfe2-bd280d4e596c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:28.888055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4bd78a09-57ad-42cd-bfe2-bd280d4e596c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:28.896953 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4bd78a09-57ad-42cd-bfe2-bd280d4e596c tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.153527 Aug 23 18:58:28.897533 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3824/7517] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:28 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:29.918810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8c633af3-1eb4-48c7-a391-b0f8cc159d94 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:29.919434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8c633af3-1eb4-48c7-a391-b0f8cc159d94 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:29.927366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c633af3-1eb4-48c7-a391-b0f8cc159d94 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:29.927857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c633af3-1eb4-48c7-a391-b0f8cc159d94 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:29.928292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c633af3-1eb4-48c7-a391-b0f8cc159d94 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:29.928993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c633af3-1eb4-48c7-a391-b0f8cc159d94 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:29.929472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c633af3-1eb4-48c7-a391-b0f8cc159d94 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:29.929891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8c633af3-1eb4-48c7-a391-b0f8cc159d94 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:29.934189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:58:30.071132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8c633af3-1eb4-48c7-a391-b0f8cc159d94 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:30.079641 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8c633af3-1eb4-48c7-a391-b0f8cc159d94 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.164801 Aug 23 18:58:30.080249 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3694/7518] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:29 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:31.101734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-30c549e3-d394-4b39-9410-316ea2df815a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:31.102408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-30c549e3-d394-4b39-9410-316ea2df815a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:31.109359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30c549e3-d394-4b39-9410-316ea2df815a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:31.109879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30c549e3-d394-4b39-9410-316ea2df815a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:31.110334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30c549e3-d394-4b39-9410-316ea2df815a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:31.111181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30c549e3-d394-4b39-9410-316ea2df815a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:31.111639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30c549e3-d394-4b39-9410-316ea2df815a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:31.112087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-30c549e3-d394-4b39-9410-316ea2df815a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:31.242289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-30c549e3-d394-4b39-9410-316ea2df815a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:31.251157 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-30c549e3-d394-4b39-9410-316ea2df815a tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1722 microversion: 2.1 time: 0.152881 Aug 23 18:58:31.251815 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3825/7519] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:31 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:32.273589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-97609402-682c-476d-8cbf-a4e5d5061487 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:32.274233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-97609402-682c-476d-8cbf-a4e5d5061487 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:32.281297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97609402-682c-476d-8cbf-a4e5d5061487 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:32.281782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97609402-682c-476d-8cbf-a4e5d5061487 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:32.282219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97609402-682c-476d-8cbf-a4e5d5061487 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:32.282935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97609402-682c-476d-8cbf-a4e5d5061487 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:32.283392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97609402-682c-476d-8cbf-a4e5d5061487 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:32.283827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-97609402-682c-476d-8cbf-a4e5d5061487 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:32.420721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-97609402-682c-476d-8cbf-a4e5d5061487 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:32.430664 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-97609402-682c-476d-8cbf-a4e5d5061487 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1715 microversion: 2.1 time: 0.160808 Aug 23 18:58:32.431377 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3695/7520] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:32 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1715 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:32.452859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-598c1d0d-2634-488f-8275-28a450374868 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:32.453733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-598c1d0d-2634-488f-8275-28a450374868 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:32.456631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=30 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:58:32.461981 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-598c1d0d-2634-488f-8275-28a450374868 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:32.462480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-598c1d0d-2634-488f-8275-28a450374868 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:32.462958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-598c1d0d-2634-488f-8275-28a450374868 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:32.463669 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-598c1d0d-2634-488f-8275-28a450374868 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:32.464140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-598c1d0d-2634-488f-8275-28a450374868 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:32.464607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-598c1d0d-2634-488f-8275-28a450374868 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:32.469986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=86 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:58:32.549766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f23e411f-32db-43b9-92c0-814e9597f970 req-a1d8f977-988f-464d-9377-7d2644b0f92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd5dd1c-1232-4d1a-951f-eebd0280ab56", "name": "network-vif-plugged", "status": "completed", "tag": "30c45c34-b0c4-483d-b481-6114a60bf7c5"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:58:32.559840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f23e411f-32db-43b9-92c0-814e9597f970 req-a1d8f977-988f-464d-9377-7d2644b0f92c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:32.560444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f23e411f-32db-43b9-92c0-814e9597f970 req-a1d8f977-988f-464d-9377-7d2644b0f92c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:32.560887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f23e411f-32db-43b9-92c0-814e9597f970 req-a1d8f977-988f-464d-9377-7d2644b0f92c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:32.573899 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f23e411f-32db-43b9-92c0-814e9597f970 req-a1d8f977-988f-464d-9377-7d2644b0f92c service nova] Creating event network-vif-plugged:30c45c34-b0c4-483d-b481-6114a60bf7c5 for instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 on n-h2-850468-16 Aug 23 18:58:32.579130 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f23e411f-32db-43b9-92c0-814e9597f970 req-a1d8f977-988f-464d-9377-7d2644b0f92c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034069 Aug 23 18:58:32.579941 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3696/7521] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:58:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:58:32.603245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-598c1d0d-2634-488f-8275-28a450374868 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:32.612483 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-598c1d0d-2634-488f-8275-28a450374868 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1715 microversion: 2.1 time: 0.163496 Aug 23 18:58:32.613284 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3826/7522] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:32 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:32.634641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fab0e5a9-efb1-445d-b62a-fbe0508d2404 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:32.635476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fab0e5a9-efb1-445d-b62a-fbe0508d2404 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:32.642100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fab0e5a9-efb1-445d-b62a-fbe0508d2404 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:32.642639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fab0e5a9-efb1-445d-b62a-fbe0508d2404 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:32.643077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fab0e5a9-efb1-445d-b62a-fbe0508d2404 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:32.643778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fab0e5a9-efb1-445d-b62a-fbe0508d2404 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:32.644234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fab0e5a9-efb1-445d-b62a-fbe0508d2404 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:32.644659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fab0e5a9-efb1-445d-b62a-fbe0508d2404 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:32.778412 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fab0e5a9-efb1-445d-b62a-fbe0508d2404 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:32.788380 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fab0e5a9-efb1-445d-b62a-fbe0508d2404 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1715 microversion: 2.1 time: 0.157952 Aug 23 18:58:32.788889 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3697/7523] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:32 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1715 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:32.808870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-614dc628-3ff8-4ece-9f9e-124747d9af52 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:32.809390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-614dc628-3ff8-4ece-9f9e-124747d9af52 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:32.816187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-614dc628-3ff8-4ece-9f9e-124747d9af52 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:32.816713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-614dc628-3ff8-4ece-9f9e-124747d9af52 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:32.817173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-614dc628-3ff8-4ece-9f9e-124747d9af52 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:32.817885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-614dc628-3ff8-4ece-9f9e-124747d9af52 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:32.818362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-614dc628-3ff8-4ece-9f9e-124747d9af52 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:32.818836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-614dc628-3ff8-4ece-9f9e-124747d9af52 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:32.844390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-614dc628-3ff8-4ece-9f9e-124747d9af52 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:58:32.920729 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-614dc628-3ff8-4ece-9f9e-124747d9af52 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 204 len: 0 microversion: 2.1 time: 0.115514 Aug 23 18:58:32.921413 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3827/7524] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:58:32 2022] DELETE /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:58:32.929700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-45f40a89-b9bd-48ef-884c-55807ec8cef7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:32.930408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-45f40a89-b9bd-48ef-884c-55807ec8cef7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:32.936543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45f40a89-b9bd-48ef-884c-55807ec8cef7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:32.937023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45f40a89-b9bd-48ef-884c-55807ec8cef7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:32.937457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45f40a89-b9bd-48ef-884c-55807ec8cef7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:32.938896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45f40a89-b9bd-48ef-884c-55807ec8cef7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:32.939351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45f40a89-b9bd-48ef-884c-55807ec8cef7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:32.939771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-45f40a89-b9bd-48ef-884c-55807ec8cef7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:33.068028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-45f40a89-b9bd-48ef-884c-55807ec8cef7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:33.076340 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-45f40a89-b9bd-48ef-884c-55807ec8cef7 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1721 microversion: 2.1 time: 0.150558 Aug 23 18:58:33.076917 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3698/7525] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:32 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:58:34.099226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3da7dae7-2df0-4caf-ba85-0825f72e2597 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:34.099860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3da7dae7-2df0-4caf-ba85-0825f72e2597 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:34.106670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3da7dae7-2df0-4caf-ba85-0825f72e2597 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:34.107168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3da7dae7-2df0-4caf-ba85-0825f72e2597 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:34.107620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3da7dae7-2df0-4caf-ba85-0825f72e2597 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:34.108321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3da7dae7-2df0-4caf-ba85-0825f72e2597 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:34.108784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3da7dae7-2df0-4caf-ba85-0825f72e2597 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:34.109224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3da7dae7-2df0-4caf-ba85-0825f72e2597 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:34.239643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3da7dae7-2df0-4caf-ba85-0825f72e2597 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:34.248013 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3da7dae7-2df0-4caf-ba85-0825f72e2597 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1721 microversion: 2.1 time: 0.153183 Aug 23 18:58:34.248597 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3828/7526] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:34 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:35.270298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eacfdd5c-67e2-49d3-ad7f-dba6b0e8b6ae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:35.271555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eacfdd5c-67e2-49d3-ad7f-dba6b0e8b6ae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:35.274413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:58:35.279839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eacfdd5c-67e2-49d3-ad7f-dba6b0e8b6ae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:35.280346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eacfdd5c-67e2-49d3-ad7f-dba6b0e8b6ae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:35.280826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eacfdd5c-67e2-49d3-ad7f-dba6b0e8b6ae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:35.282035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eacfdd5c-67e2-49d3-ad7f-dba6b0e8b6ae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:35.282491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eacfdd5c-67e2-49d3-ad7f-dba6b0e8b6ae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:35.282957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eacfdd5c-67e2-49d3-ad7f-dba6b0e8b6ae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:35.381007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eacfdd5c-67e2-49d3-ad7f-dba6b0e8b6ae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:35.391821 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eacfdd5c-67e2-49d3-ad7f-dba6b0e8b6ae tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1654 microversion: 2.1 time: 0.124458 Aug 23 18:58:35.401391 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3699/7527] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:35 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1654 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:35.596675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-72e82f78-3942-483c-bf9e-033b359691a8 req-ab5908ed-451f-4184-9764-c220f90cc042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cd5dd1c-1232-4d1a-951f-eebd0280ab56", "name": "network-vif-deleted", "tag": "30c45c34-b0c4-483d-b481-6114a60bf7c5"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:58:35.610581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-72e82f78-3942-483c-bf9e-033b359691a8 req-ab5908ed-451f-4184-9764-c220f90cc042 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:35.611164 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-72e82f78-3942-483c-bf9e-033b359691a8 req-ab5908ed-451f-4184-9764-c220f90cc042 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:35.611685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-72e82f78-3942-483c-bf9e-033b359691a8 req-ab5908ed-451f-4184-9764-c220f90cc042 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:35.639014 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-72e82f78-3942-483c-bf9e-033b359691a8 req-ab5908ed-451f-4184-9764-c220f90cc042 service nova] Creating event network-vif-deleted:30c45c34-b0c4-483d-b481-6114a60bf7c5 for instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 on n-h2-850468-16 Aug 23 18:58:35.646245 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-72e82f78-3942-483c-bf9e-033b359691a8 req-ab5908ed-451f-4184-9764-c220f90cc042 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055063 Aug 23 18:58:35.647233 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3829/7528] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:58:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:58:36.414331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dc636090-b1f9-4c4e-b6db-c68c42a65348 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:36.415275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dc636090-b1f9-4c4e-b6db-c68c42a65348 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:36.423191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc636090-b1f9-4c4e-b6db-c68c42a65348 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:36.423989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc636090-b1f9-4c4e-b6db-c68c42a65348 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:36.424831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc636090-b1f9-4c4e-b6db-c68c42a65348 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:36.425828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc636090-b1f9-4c4e-b6db-c68c42a65348 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:36.426315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc636090-b1f9-4c4e-b6db-c68c42a65348 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:36.427115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dc636090-b1f9-4c4e-b6db-c68c42a65348 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:36.504149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dc636090-b1f9-4c4e-b6db-c68c42a65348 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:36.513532 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dc636090-b1f9-4c4e-b6db-c68c42a65348 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1369 microversion: 2.1 time: 0.103463 Aug 23 18:58:36.514323 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3700/7529] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:36 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:37.536665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1399dbad-cda5-4808-a324-f70d4319d114 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:37.537278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1399dbad-cda5-4808-a324-f70d4319d114 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:37.544232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1399dbad-cda5-4808-a324-f70d4319d114 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:37.544729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1399dbad-cda5-4808-a324-f70d4319d114 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:37.545242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1399dbad-cda5-4808-a324-f70d4319d114 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:37.545953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1399dbad-cda5-4808-a324-f70d4319d114 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:37.546422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1399dbad-cda5-4808-a324-f70d4319d114 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:37.546887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1399dbad-cda5-4808-a324-f70d4319d114 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:37.613993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1399dbad-cda5-4808-a324-f70d4319d114 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:37.624570 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1399dbad-cda5-4808-a324-f70d4319d114 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1369 microversion: 2.1 time: 0.093256 Aug 23 18:58:37.625647 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3830/7530] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:37 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:38.646160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e73ff8d2-a338-4a9e-9778-7ac51a393ed1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:38.646922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e73ff8d2-a338-4a9e-9778-7ac51a393ed1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:38.654036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e73ff8d2-a338-4a9e-9778-7ac51a393ed1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:38.654522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e73ff8d2-a338-4a9e-9778-7ac51a393ed1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:38.654983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e73ff8d2-a338-4a9e-9778-7ac51a393ed1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:38.655682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e73ff8d2-a338-4a9e-9778-7ac51a393ed1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:38.656138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e73ff8d2-a338-4a9e-9778-7ac51a393ed1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:38.657324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e73ff8d2-a338-4a9e-9778-7ac51a393ed1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:38.724886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e73ff8d2-a338-4a9e-9778-7ac51a393ed1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:38.733479 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e73ff8d2-a338-4a9e-9778-7ac51a393ed1 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1369 microversion: 2.1 time: 0.091411 Aug 23 18:58:38.734063 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3701/7531] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:38 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:39.754967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a3919dd3-03bd-45e1-a27f-48c2ab5f51f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:39.755605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a3919dd3-03bd-45e1-a27f-48c2ab5f51f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:39.763336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3919dd3-03bd-45e1-a27f-48c2ab5f51f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:39.764173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3919dd3-03bd-45e1-a27f-48c2ab5f51f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:39.764676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3919dd3-03bd-45e1-a27f-48c2ab5f51f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:39.765538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3919dd3-03bd-45e1-a27f-48c2ab5f51f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:39.766690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3919dd3-03bd-45e1-a27f-48c2ab5f51f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:39.767186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a3919dd3-03bd-45e1-a27f-48c2ab5f51f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:39.838519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a3919dd3-03bd-45e1-a27f-48c2ab5f51f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1b1944b15d547e4b68df40cb65a74a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70da5a93b1b5409fa093b0a8c99b2861', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:39.848316 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a3919dd3-03bd-45e1-a27f-48c2ab5f51f3 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 200 len: 1369 microversion: 2.1 time: 0.097844 Aug 23 18:58:39.848901 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3831/7532] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:39 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:40.870154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93b3817b-22dd-46a0-b79c-492fe99d794f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:40.870781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-93b3817b-22dd-46a0-b79c-492fe99d794f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:40.878080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b3817b-22dd-46a0-b79c-492fe99d794f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:40.878582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b3817b-22dd-46a0-b79c-492fe99d794f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:40.879021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b3817b-22dd-46a0-b79c-492fe99d794f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:40.879709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b3817b-22dd-46a0-b79c-492fe99d794f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:40.880161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b3817b-22dd-46a0-b79c-492fe99d794f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:40.880582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93b3817b-22dd-46a0-b79c-492fe99d794f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:40.894666 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-93b3817b-22dd-46a0-b79c-492fe99d794f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93b3817b-22dd-46a0-b79c-492fe99d794f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 HTTP/1.1 Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '6cd5dd1c-1232-4d1a-951f-eebd0280ab56'} Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:40.896269 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:40.900796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:40.900796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:40.900796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:40.900796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:58:40.900796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:58:40.900796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:40.900796 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:40.900796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93b3817b-22dd-46a0-b79c-492fe99d794f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:58:40.900796 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93b3817b-22dd-46a0-b79c-492fe99d794f tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 404 len: 111 microversion: 2.1 time: 0.031458 Aug 23 18:58:40.900796 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3702/7533] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:40 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:58:40.959533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-769eb965-2148-4a85-a055-6ad0dc374719 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:40.961780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-769eb965-2148-4a85-a055-6ad0dc374719 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:40.969024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-769eb965-2148-4a85-a055-6ad0dc374719 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:40.969588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-769eb965-2148-4a85-a055-6ad0dc374719 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:40.970045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-769eb965-2148-4a85-a055-6ad0dc374719 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:40.970790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-769eb965-2148-4a85-a055-6ad0dc374719 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:40.971269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-769eb965-2148-4a85-a055-6ad0dc374719 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:40.971717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-769eb965-2148-4a85-a055-6ad0dc374719 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:40.984264 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-769eb965-2148-4a85-a055-6ad0dc374719 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-769eb965-2148-4a85-a055-6ad0dc374719 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56/os-volume_attachments HTTP/1.1 Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'server_id': '6cd5dd1c-1232-4d1a-951f-eebd0280ab56'} Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:58:40.986123 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-769eb965-2148-4a85-a055-6ad0dc374719 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-769eb965-2148-4a85-a055-6ad0dc374719 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032064 Aug 23 18:58:40.990004 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3832/7534] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 18:58:40 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:58:44.308241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9010ba90-52e4-41f5-ade8-ab8a67cae99e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:44.308757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9010ba90-52e4-41f5-ade8-ab8a67cae99e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:44.316025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9010ba90-52e4-41f5-ade8-ab8a67cae99e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.316522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9010ba90-52e4-41f5-ade8-ab8a67cae99e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.316972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9010ba90-52e4-41f5-ade8-ab8a67cae99e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.317676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9010ba90-52e4-41f5-ade8-ab8a67cae99e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.318139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9010ba90-52e4-41f5-ade8-ab8a67cae99e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.318595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9010ba90-52e4-41f5-ade8-ab8a67cae99e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.332545 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-9010ba90-52e4-41f5-ade8-ab8a67cae99e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9010ba90-52e4-41f5-ade8-ab8a67cae99e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 HTTP/1.1 Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '6cd5dd1c-1232-4d1a-951f-eebd0280ab56'} Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:58:44.334122 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9010ba90-52e4-41f5-ade8-ab8a67cae99e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9010ba90-52e4-41f5-ade8-ab8a67cae99e tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 404 len: 111 microversion: 2.1 time: 0.031271 Aug 23 18:58:44.337820 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3703/7535] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:58:44 2022] DELETE /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:58:44.344938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a09ec8ce-e3fd-4727-bd3d-d2aabea88ddc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:44.345574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a09ec8ce-e3fd-4727-bd3d-d2aabea88ddc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 6cd5dd1c-1232-4d1a-951f-eebd0280ab56] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:44.352592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a09ec8ce-e3fd-4727-bd3d-d2aabea88ddc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.353091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a09ec8ce-e3fd-4727-bd3d-d2aabea88ddc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.353542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a09ec8ce-e3fd-4727-bd3d-d2aabea88ddc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.354250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a09ec8ce-e3fd-4727-bd3d-d2aabea88ddc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.354745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a09ec8ce-e3fd-4727-bd3d-d2aabea88ddc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.355189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a09ec8ce-e3fd-4727-bd3d-d2aabea88ddc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.369148 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-a09ec8ce-e3fd-4727-bd3d-d2aabea88ddc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a09ec8ce-e3fd-4727-bd3d-d2aabea88ddc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 HTTP/1.1 Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '6cd5dd1c-1232-4d1a-951f-eebd0280ab56'} Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.370723 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.375190 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.375190 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.375190 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.375190 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:58:44.375190 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:58:44.375190 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. Aug 23 18:58:44.375190 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.375190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a09ec8ce-e3fd-4727-bd3d-d2aabea88ddc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance 6cd5dd1c-1232-4d1a-951f-eebd0280ab56 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:58:44.375190 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a09ec8ce-e3fd-4727-bd3d-d2aabea88ddc tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56" status: 404 len: 111 microversion: 2.1 time: 0.031931 Aug 23 18:58:44.375190 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3833/7536] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:44 2022] GET /compute/v2.1/servers/6cd5dd1c-1232-4d1a-951f-eebd0280ab56 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:58:44.380837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e384efad-26db-4b2c-a80b-a6357a363974 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:44.381339 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e384efad-26db-4b2c-a80b-a6357a363974 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:44.387367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e384efad-26db-4b2c-a80b-a6357a363974 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.387853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e384efad-26db-4b2c-a80b-a6357a363974 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.388294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e384efad-26db-4b2c-a80b-a6357a363974 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.388988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e384efad-26db-4b2c-a80b-a6357a363974 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.389451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e384efad-26db-4b2c-a80b-a6357a363974 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.389879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e384efad-26db-4b2c-a80b-a6357a363974 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.404585 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-e384efad-26db-4b2c-a80b-a6357a363974 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e384efad-26db-4b2c-a80b-a6357a363974 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 HTTP/1.1 Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2ca799a2-75ee-4936-8eb6-478d2363d9c8'} Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:58:44.407052 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e384efad-26db-4b2c-a80b-a6357a363974 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:58:44.411395 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e384efad-26db-4b2c-a80b-a6357a363974 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "DELETE /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 404 len: 111 microversion: 2.1 time: 0.031888 Aug 23 18:58:44.412425 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3704/7537] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:58:44 2022] DELETE /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:58:44.417863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcbe25d1-2ff5-4b8d-89ae-f5bb25a49ef9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:44.418513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fcbe25d1-2ff5-4b8d-89ae-f5bb25a49ef9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 2ca799a2-75ee-4936-8eb6-478d2363d9c8] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:44.425340 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcbe25d1-2ff5-4b8d-89ae-f5bb25a49ef9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.425864 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcbe25d1-2ff5-4b8d-89ae-f5bb25a49ef9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.426325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcbe25d1-2ff5-4b8d-89ae-f5bb25a49ef9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.427100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcbe25d1-2ff5-4b8d-89ae-f5bb25a49ef9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.427657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcbe25d1-2ff5-4b8d-89ae-f5bb25a49ef9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.428110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcbe25d1-2ff5-4b8d-89ae-f5bb25a49ef9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.447422 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-fcbe25d1-2ff5-4b8d-89ae-f5bb25a49ef9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcbe25d1-2ff5-4b8d-89ae-f5bb25a49ef9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 HTTP/1.1 Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '2ca799a2-75ee-4936-8eb6-478d2363d9c8'} Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.449020 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.457258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.457258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.457258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.457258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:58:44.457258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:58:44.457258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. Aug 23 18:58:44.457258 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.457258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcbe25d1-2ff5-4b8d-89ae-f5bb25a49ef9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance 2ca799a2-75ee-4936-8eb6-478d2363d9c8 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:58:44.457258 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fcbe25d1-2ff5-4b8d-89ae-f5bb25a49ef9 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8" status: 404 len: 111 microversion: 2.1 time: 0.036808 Aug 23 18:58:44.457258 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3834/7538] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:44 2022] GET /compute/v2.1/servers/2ca799a2-75ee-4936-8eb6-478d2363d9c8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:58:44.460304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ae36caff-9472-443e-84e0-7a203b5dc396 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:44.460812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ae36caff-9472-443e-84e0-7a203b5dc396 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:44.467544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae36caff-9472-443e-84e0-7a203b5dc396 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.468227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae36caff-9472-443e-84e0-7a203b5dc396 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.468715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae36caff-9472-443e-84e0-7a203b5dc396 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.469988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae36caff-9472-443e-84e0-7a203b5dc396 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.470710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae36caff-9472-443e-84e0-7a203b5dc396 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.470966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ae36caff-9472-443e-84e0-7a203b5dc396 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.485836 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-ae36caff-9472-443e-84e0-7a203b5dc396 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ae36caff-9472-443e-84e0-7a203b5dc396 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe HTTP/1.1 Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '639380c8-172e-482b-ba05-7939dafc76fe'} Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:58:44.487465 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ae36caff-9472-443e-84e0-7a203b5dc396 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ae36caff-9472-443e-84e0-7a203b5dc396 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "DELETE /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 404 len: 111 microversion: 2.1 time: 0.032868 Aug 23 18:58:44.494369 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3705/7539] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:58:44 2022] DELETE /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:58:44.498135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-52ba457a-6393-4fec-9cf7-d6dae241bcab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:44.498831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-52ba457a-6393-4fec-9cf7-d6dae241bcab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: 639380c8-172e-482b-ba05-7939dafc76fe] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:44.506232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52ba457a-6393-4fec-9cf7-d6dae241bcab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.506869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52ba457a-6393-4fec-9cf7-d6dae241bcab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.507254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52ba457a-6393-4fec-9cf7-d6dae241bcab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.507985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52ba457a-6393-4fec-9cf7-d6dae241bcab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.508460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52ba457a-6393-4fec-9cf7-d6dae241bcab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.508911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52ba457a-6393-4fec-9cf7-d6dae241bcab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.523079 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-52ba457a-6393-4fec-9cf7-d6dae241bcab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-52ba457a-6393-4fec-9cf7-d6dae241bcab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe HTTP/1.1 Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '639380c8-172e-482b-ba05-7939dafc76fe'} Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.524759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.532653 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.532653 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.532653 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.532653 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:58:44.532653 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:58:44.532653 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. Aug 23 18:58:44.532653 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.532653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-52ba457a-6393-4fec-9cf7-d6dae241bcab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance 639380c8-172e-482b-ba05-7939dafc76fe could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:58:44.532653 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-52ba457a-6393-4fec-9cf7-d6dae241bcab tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe" status: 404 len: 111 microversion: 2.1 time: 0.032241 Aug 23 18:58:44.532653 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3835/7540] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:44 2022] GET /compute/v2.1/servers/639380c8-172e-482b-ba05-7939dafc76fe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:58:44.534968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1d704f1e-eb57-482b-9625-096f1e335c75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:44.535476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1d704f1e-eb57-482b-9625-096f1e335c75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:44.541582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d704f1e-eb57-482b-9625-096f1e335c75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.542070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d704f1e-eb57-482b-9625-096f1e335c75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.542515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d704f1e-eb57-482b-9625-096f1e335c75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.543233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d704f1e-eb57-482b-9625-096f1e335c75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.543811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d704f1e-eb57-482b-9625-096f1e335c75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.544248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1d704f1e-eb57-482b-9625-096f1e335c75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.560621 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-1d704f1e-eb57-482b-9625-096f1e335c75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1d704f1e-eb57-482b-9625-096f1e335c75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 HTTP/1.1 Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'd7abc616-30c6-4600-bd6b-744387339865'} Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:58:44.562194 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1d704f1e-eb57-482b-9625-096f1e335c75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1d704f1e-eb57-482b-9625-096f1e335c75 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 404 len: 111 microversion: 2.1 time: 0.033522 Aug 23 18:58:44.570430 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3706/7541] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:58:44 2022] DELETE /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:58:44.573769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ed075bef-0c9d-451b-9abc-5a0f8ef495d5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:44.574565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ed075bef-0c9d-451b-9abc-5a0f8ef495d5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] [instance: d7abc616-30c6-4600-bd6b-744387339865] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:44.580877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed075bef-0c9d-451b-9abc-5a0f8ef495d5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.581378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed075bef-0c9d-451b-9abc-5a0f8ef495d5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.582015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed075bef-0c9d-451b-9abc-5a0f8ef495d5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.582773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed075bef-0c9d-451b-9abc-5a0f8ef495d5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:44.583244 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed075bef-0c9d-451b-9abc-5a0f8ef495d5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:44.583685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed075bef-0c9d-451b-9abc-5a0f8ef495d5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:44.597937 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-ed075bef-0c9d-451b-9abc-5a0f8ef495d5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] HTTP exception thrown: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ed075bef-0c9d-451b-9abc-5a0f8ef495d5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Request method failure captured: Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 HTTP/1.1 Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSFVwqKWuml4FH4l4VDqbluFuYJ9WDhHf8e53_zHtuOmtjBosGp7iVpOBwNgsfNTKqsBOzTC7aEBHnb6WjaVwxWS3NsDV-Arw3SXRivKC_6qb5COGhkoKgV6ItNyjTez_IwydCIBUDBwIuDS67-m7f4I-UAwxEPEDg1UffaZYS263tA Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/70da5a93b1b5409fa093b0a8c99b2861"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/70da5a93b1b5409fa093b0a8c99b2861"}]}] Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 70da5a93b1b5409fa093b0a8c99b2861 Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServerActionsTestJSON-1060451713 Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: b1b1944b15d547e4b68df40cb65a74a6 Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServerActionsTestJSON-1060451713-project Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'd7abc616-30c6-4600-bd6b-744387339865'} Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:58:44.599528 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.604090 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:58:44.604090 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:58:44.604090 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:58:44.604090 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:58:44.604090 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:58:44.604090 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. Aug 23 18:58:44.604090 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:58:44.604090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ed075bef-0c9d-451b-9abc-5a0f8ef495d5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Returning 404 to user: Instance d7abc616-30c6-4600-bd6b-744387339865 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:58:44.604090 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ed075bef-0c9d-451b-9abc-5a0f8ef495d5 tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865" status: 404 len: 111 microversion: 2.1 time: 0.031603 Aug 23 18:58:44.604090 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3836/7542] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:44 2022] GET /compute/v2.1/servers/d7abc616-30c6-4600-bd6b-744387339865 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:58:44.610796 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9d4f3a4f-d974-4c97-a08c-3877e0cb91be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] Calling method '.version_select at 0x7f27dfbb4f70>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:44.636039 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9d4f3a4f-d974-4c97-a08c-3877e0cb91be tempest-ServerActionsTestJSON-1060451713 tempest-ServerActionsTestJSON-1060451713-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650899182" status: 202 len: 0 microversion: 2.1 time: 0.029697 Aug 23 18:58:44.636742 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3707/7543] 10.222.0.61 () {58 vars in 1221 bytes} [Tue Aug 23 18:58:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1650899182 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 18:58:54.086628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-198613594", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "319261ca-c8da-44e5-90f6-6c7e99577df5"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:58:54.147784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] validate_networks() for [('319261ca-c8da-44e5-90f6-6c7e99577df5', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:58:54.589154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:58:54.635138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:58:54.636599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:58:54.637267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:58:54.638013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:58:54.639256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:58:54.651121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:54.651621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:54.652075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:54.652818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:54.653289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:54.653725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:54.674392 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Getting quotas for project ce2327beca704d1a9f7ebea036422b20. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:58:54.680378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Getting quotas for user 5aab0e36ea0347ac91ede1536c7546aa and project ce2327beca704d1a9f7ebea036422b20. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:58:54.698963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:58:54.701413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:58:54.756324 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9bb59f7a-cc4c-47cb-b3e0-f09b3eee8190 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.824948 Aug 23 18:58:54.763245 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3837/7544] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:58:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:58:54.767646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=53 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:58:54.768556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:58:54.774934 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-df1e53f1-04c0-47b2-8475-e75bdf7e31bb tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:54.775636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-df1e53f1-04c0-47b2-8475-e75bdf7e31bb tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:54.848893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-df1e53f1-04c0-47b2-8475-e75bdf7e31bb tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:54.856548 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-df1e53f1-04c0-47b2-8475-e75bdf7e31bb tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1216 microversion: 2.1 time: 0.091773 Aug 23 18:58:54.857346 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3708/7545] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:54 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1216 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:55.883849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b437e4f5-660a-4a69-adce-d86031c7b1d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:55.885104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b437e4f5-660a-4a69-adce-d86031c7b1d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:55.894153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b437e4f5-660a-4a69-adce-d86031c7b1d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:55.894712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b437e4f5-660a-4a69-adce-d86031c7b1d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:55.895176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b437e4f5-660a-4a69-adce-d86031c7b1d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:55.895913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b437e4f5-660a-4a69-adce-d86031c7b1d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:55.896570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b437e4f5-660a-4a69-adce-d86031c7b1d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:55.897025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b437e4f5-660a-4a69-adce-d86031c7b1d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:55.985476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b437e4f5-660a-4a69-adce-d86031c7b1d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:55.994979 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b437e4f5-660a-4a69-adce-d86031c7b1d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1286 microversion: 2.1 time: 0.121197 Aug 23 18:58:55.995957 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3838/7546] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:55 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1286 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:57.018195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-76ae4cf6-7fe3-490a-86b8-7fbec49eaf71 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:57.019671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-76ae4cf6-7fe3-490a-86b8-7fbec49eaf71 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:57.028978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76ae4cf6-7fe3-490a-86b8-7fbec49eaf71 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:57.031308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76ae4cf6-7fe3-490a-86b8-7fbec49eaf71 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:57.031996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76ae4cf6-7fe3-490a-86b8-7fbec49eaf71 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:57.033195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76ae4cf6-7fe3-490a-86b8-7fbec49eaf71 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:57.033859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76ae4cf6-7fe3-490a-86b8-7fbec49eaf71 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:57.034724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-76ae4cf6-7fe3-490a-86b8-7fbec49eaf71 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:57.251798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-76ae4cf6-7fe3-490a-86b8-7fbec49eaf71 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:57.262283 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-76ae4cf6-7fe3-490a-86b8-7fbec49eaf71 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1316 microversion: 2.1 time: 0.248660 Aug 23 18:58:57.263197 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3709/7547] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:57 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1316 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:57.302939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-67852183-e7fb-4f9a-8b72-27f32bbef493 req-37da6860-af2e-4371-b4cd-18fb3599bb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f140ec47-4e0c-465b-9481-66b318db7a89", "tag": "d292f84f-0ebf-4154-8f62-d425ecde9613"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:58:57.324261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-67852183-e7fb-4f9a-8b72-27f32bbef493 req-37da6860-af2e-4371-b4cd-18fb3599bb79 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:57.325105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-67852183-e7fb-4f9a-8b72-27f32bbef493 req-37da6860-af2e-4371-b4cd-18fb3599bb79 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:57.325650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-67852183-e7fb-4f9a-8b72-27f32bbef493 req-37da6860-af2e-4371-b4cd-18fb3599bb79 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:57.339338 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-67852183-e7fb-4f9a-8b72-27f32bbef493 req-37da6860-af2e-4371-b4cd-18fb3599bb79 service nova] Creating event network-changed:d292f84f-0ebf-4154-8f62-d425ecde9613 for instance f140ec47-4e0c-465b-9481-66b318db7a89 on n-h2-850468-16 Aug 23 18:58:57.346196 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-67852183-e7fb-4f9a-8b72-27f32bbef493 req-37da6860-af2e-4371-b4cd-18fb3599bb79 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047848 Aug 23 18:58:57.347265 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3839/7548] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:58:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:58:58.283476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-74e67c89-a79b-4f10-a14b-87cdeb568047 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:58.284114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-74e67c89-a79b-4f10-a14b-87cdeb568047 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:58.291044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74e67c89-a79b-4f10-a14b-87cdeb568047 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:58.291528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74e67c89-a79b-4f10-a14b-87cdeb568047 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:58.291971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74e67c89-a79b-4f10-a14b-87cdeb568047 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:58.292668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74e67c89-a79b-4f10-a14b-87cdeb568047 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:58.293123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74e67c89-a79b-4f10-a14b-87cdeb568047 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:58.293552 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74e67c89-a79b-4f10-a14b-87cdeb568047 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:58.424703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-74e67c89-a79b-4f10-a14b-87cdeb568047 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:58.432448 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-74e67c89-a79b-4f10-a14b-87cdeb568047 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1316 microversion: 2.1 time: 0.153317 Aug 23 18:58:58.433020 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3710/7549] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:58 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:58:59.455229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bdd3864f-b43a-4d94-a93f-826b1eb92fa2 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:58:59.455954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bdd3864f-b43a-4d94-a93f-826b1eb92fa2 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:58:59.463111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdd3864f-b43a-4d94-a93f-826b1eb92fa2 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:59.463717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdd3864f-b43a-4d94-a93f-826b1eb92fa2 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:59.464170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdd3864f-b43a-4d94-a93f-826b1eb92fa2 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:59.464883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdd3864f-b43a-4d94-a93f-826b1eb92fa2 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:58:59.465616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdd3864f-b43a-4d94-a93f-826b1eb92fa2 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:58:59.466061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bdd3864f-b43a-4d94-a93f-826b1eb92fa2 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:58:59.605841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bdd3864f-b43a-4d94-a93f-826b1eb92fa2 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:58:59.613668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bdd3864f-b43a-4d94-a93f-826b1eb92fa2 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1316 microversion: 2.1 time: 0.164260 Aug 23 18:58:59.614437 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3840/7550] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:58:59 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1316 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:00.637589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d9ac93e3-b2ee-4b27-a00e-f6f125806ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:00.638226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d9ac93e3-b2ee-4b27-a00e-f6f125806ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:00.645334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9ac93e3-b2ee-4b27-a00e-f6f125806ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:00.645831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9ac93e3-b2ee-4b27-a00e-f6f125806ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:00.646280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9ac93e3-b2ee-4b27-a00e-f6f125806ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:00.647017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9ac93e3-b2ee-4b27-a00e-f6f125806ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:00.647480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9ac93e3-b2ee-4b27-a00e-f6f125806ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:00.647916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d9ac93e3-b2ee-4b27-a00e-f6f125806ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:00.782434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d9ac93e3-b2ee-4b27-a00e-f6f125806ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:00.790331 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d9ac93e3-b2ee-4b27-a00e-f6f125806ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1316 microversion: 2.1 time: 0.156595 Aug 23 18:59:00.790945 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3711/7551] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:00 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:01.811142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4296ecbf-1581-4fb8-aeb1-2c30fe7de8cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:01.811682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4296ecbf-1581-4fb8-aeb1-2c30fe7de8cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:01.818656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4296ecbf-1581-4fb8-aeb1-2c30fe7de8cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:01.819159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4296ecbf-1581-4fb8-aeb1-2c30fe7de8cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:01.819614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4296ecbf-1581-4fb8-aeb1-2c30fe7de8cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:01.820321 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4296ecbf-1581-4fb8-aeb1-2c30fe7de8cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:01.820793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4296ecbf-1581-4fb8-aeb1-2c30fe7de8cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:01.821236 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4296ecbf-1581-4fb8-aeb1-2c30fe7de8cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:02.050071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4296ecbf-1581-4fb8-aeb1-2c30fe7de8cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:02.057895 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4296ecbf-1581-4fb8-aeb1-2c30fe7de8cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1316 microversion: 2.1 time: 0.250839 Aug 23 18:59:02.058490 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3841/7552] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:01 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1316 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:02.700477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-3a124bbd-3d71-4fd7-a5bf-ac0bc9c13f44 req-350d18cf-54ef-4963-9e26-cfea0d04696d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f140ec47-4e0c-465b-9481-66b318db7a89", "name": "network-vif-plugged", "status": "completed", "tag": "d292f84f-0ebf-4154-8f62-d425ecde9613"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:59:02.713079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3a124bbd-3d71-4fd7-a5bf-ac0bc9c13f44 req-350d18cf-54ef-4963-9e26-cfea0d04696d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:02.713584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3a124bbd-3d71-4fd7-a5bf-ac0bc9c13f44 req-350d18cf-54ef-4963-9e26-cfea0d04696d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:02.714026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3a124bbd-3d71-4fd7-a5bf-ac0bc9c13f44 req-350d18cf-54ef-4963-9e26-cfea0d04696d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:02.726467 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-3a124bbd-3d71-4fd7-a5bf-ac0bc9c13f44 req-350d18cf-54ef-4963-9e26-cfea0d04696d service nova] Creating event network-vif-plugged:d292f84f-0ebf-4154-8f62-d425ecde9613 for instance f140ec47-4e0c-465b-9481-66b318db7a89 on n-h2-850468-16 Aug 23 18:59:02.731792 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-3a124bbd-3d71-4fd7-a5bf-ac0bc9c13f44 req-350d18cf-54ef-4963-9e26-cfea0d04696d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035132 Aug 23 18:59:02.732739 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3712/7553] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:59:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:59:03.080258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1d78fcda-ff14-458a-a2e8-74e8aacf0c8c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:03.080883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1d78fcda-ff14-458a-a2e8-74e8aacf0c8c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:03.083684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:03.089045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d78fcda-ff14-458a-a2e8-74e8aacf0c8c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:03.089477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d78fcda-ff14-458a-a2e8-74e8aacf0c8c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:03.090187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d78fcda-ff14-458a-a2e8-74e8aacf0c8c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:03.090932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d78fcda-ff14-458a-a2e8-74e8aacf0c8c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:03.091404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d78fcda-ff14-458a-a2e8-74e8aacf0c8c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:03.091843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d78fcda-ff14-458a-a2e8-74e8aacf0c8c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:03.220367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d78fcda-ff14-458a-a2e8-74e8aacf0c8c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:03.228051 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1d78fcda-ff14-458a-a2e8-74e8aacf0c8c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1316 microversion: 2.1 time: 0.152340 Aug 23 18:59:03.228617 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3842/7554] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:03 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:04.251907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4240d41e-987d-4c03-a2f4-51a3127cdf3a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:04.252539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4240d41e-987d-4c03-a2f4-51a3127cdf3a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:04.259132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4240d41e-987d-4c03-a2f4-51a3127cdf3a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:04.259614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4240d41e-987d-4c03-a2f4-51a3127cdf3a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:04.260050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4240d41e-987d-4c03-a2f4-51a3127cdf3a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:04.260740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4240d41e-987d-4c03-a2f4-51a3127cdf3a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:04.261189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4240d41e-987d-4c03-a2f4-51a3127cdf3a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:04.261618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4240d41e-987d-4c03-a2f4-51a3127cdf3a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:04.393459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4240d41e-987d-4c03-a2f4-51a3127cdf3a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:04.401436 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4240d41e-987d-4c03-a2f4-51a3127cdf3a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1506 microversion: 2.1 time: 0.155887 Aug 23 18:59:04.402010 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3713/7555] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:04 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:04.462021 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-827577975", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "319261ca-c8da-44e5-90f6-6c7e99577df5"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:59:04.515543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] validate_networks() for [('319261ca-c8da-44e5-90f6-6c7e99577df5', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:59:04.662131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:04.690184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:05.109718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:59:05.110159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:59:05.110692 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:59:05.111120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:59:05.111574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:59:05.120363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:05.120851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:05.121300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:05.122030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:05.122495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:05.122955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:05.142798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Getting quotas for project ce2327beca704d1a9f7ebea036422b20. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:59:05.147926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Getting quotas for user 5aab0e36ea0347ac91ede1536c7546aa and project ce2327beca704d1a9f7ebea036422b20. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:59:05.160480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:59:05.162797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:59:05.212216 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-117302ba-bf43-49ec-857e-f590ce56e966 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.754084 Aug 23 18:59:05.212887 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3843/7556] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:59:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 755 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:59:05.224050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-42fc0842-704a-408d-926b-efa6dbb4ee39 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:05.224672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-42fc0842-704a-408d-926b-efa6dbb4ee39 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:05.226777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:05.279391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-42fc0842-704a-408d-926b-efa6dbb4ee39 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:05.286276 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-42fc0842-704a-408d-926b-efa6dbb4ee39 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1216 microversion: 2.1 time: 0.066112 Aug 23 18:59:05.286969 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3714/7557] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:05 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1216 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:06.307966 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d19a85cb-77f5-4f22-adae-6549b10b4ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:06.308603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d19a85cb-77f5-4f22-adae-6549b10b4ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:06.316591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d19a85cb-77f5-4f22-adae-6549b10b4ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:06.317105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d19a85cb-77f5-4f22-adae-6549b10b4ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:06.317555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d19a85cb-77f5-4f22-adae-6549b10b4ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:06.318274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d19a85cb-77f5-4f22-adae-6549b10b4ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:06.318777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d19a85cb-77f5-4f22-adae-6549b10b4ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:06.319214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d19a85cb-77f5-4f22-adae-6549b10b4ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:06.391044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d19a85cb-77f5-4f22-adae-6549b10b4ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:06.401011 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d19a85cb-77f5-4f22-adae-6549b10b4ecd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1276 microversion: 2.1 time: 0.097840 Aug 23 18:59:06.401729 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3844/7558] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:06 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1276 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:07.421965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-67e28d6a-d8e5-4a9d-803c-4a8e9799201f tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:07.422519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-67e28d6a-d8e5-4a9d-803c-4a8e9799201f tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:07.430252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67e28d6a-d8e5-4a9d-803c-4a8e9799201f tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:07.430789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67e28d6a-d8e5-4a9d-803c-4a8e9799201f tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:07.431236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67e28d6a-d8e5-4a9d-803c-4a8e9799201f tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:07.431956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67e28d6a-d8e5-4a9d-803c-4a8e9799201f tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:07.432419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67e28d6a-d8e5-4a9d-803c-4a8e9799201f tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:07.432855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-67e28d6a-d8e5-4a9d-803c-4a8e9799201f tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:07.628580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-67e28d6a-d8e5-4a9d-803c-4a8e9799201f tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:07.639074 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-67e28d6a-d8e5-4a9d-803c-4a8e9799201f tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1316 microversion: 2.1 time: 0.221062 Aug 23 18:59:07.640104 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3715/7559] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:07 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1316 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:07.667071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-d3eadd4f-3091-4eb4-9808-e6e8b0a03ea4 req-b0a1e579-60a4-459d-af3c-b05ac3687856 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "306e2615-68ad-465d-8948-5d79478439fd", "tag": "8e9a0431-08a2-4490-a746-560bcb015669"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:59:07.685894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d3eadd4f-3091-4eb4-9808-e6e8b0a03ea4 req-b0a1e579-60a4-459d-af3c-b05ac3687856 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:07.686311 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d3eadd4f-3091-4eb4-9808-e6e8b0a03ea4 req-b0a1e579-60a4-459d-af3c-b05ac3687856 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:07.686875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d3eadd4f-3091-4eb4-9808-e6e8b0a03ea4 req-b0a1e579-60a4-459d-af3c-b05ac3687856 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:07.699304 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-d3eadd4f-3091-4eb4-9808-e6e8b0a03ea4 req-b0a1e579-60a4-459d-af3c-b05ac3687856 service nova] Creating event network-changed:8e9a0431-08a2-4490-a746-560bcb015669 for instance 306e2615-68ad-465d-8948-5d79478439fd on n-h1-850468-16 Aug 23 18:59:07.704741 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-d3eadd4f-3091-4eb4-9808-e6e8b0a03ea4 req-b0a1e579-60a4-459d-af3c-b05ac3687856 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041648 Aug 23 18:59:07.705359 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3845/7560] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:59:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:59:08.665058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-31233467-0fde-4178-964c-893787d7783a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:08.665676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-31233467-0fde-4178-964c-893787d7783a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:08.672906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31233467-0fde-4178-964c-893787d7783a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:08.673426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31233467-0fde-4178-964c-893787d7783a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:08.673873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31233467-0fde-4178-964c-893787d7783a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:08.674606 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31233467-0fde-4178-964c-893787d7783a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:08.675071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31233467-0fde-4178-964c-893787d7783a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:08.675505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-31233467-0fde-4178-964c-893787d7783a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:08.809675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-31233467-0fde-4178-964c-893787d7783a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:08.818035 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-31233467-0fde-4178-964c-893787d7783a tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1316 microversion: 2.1 time: 0.156936 Aug 23 18:59:08.818630 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3716/7561] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:08 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:09.841132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b3bcf3ec-172f-4ebd-9feb-ab4ff6a475cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:09.841862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b3bcf3ec-172f-4ebd-9feb-ab4ff6a475cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:09.848780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3bcf3ec-172f-4ebd-9feb-ab4ff6a475cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:09.849291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3bcf3ec-172f-4ebd-9feb-ab4ff6a475cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:09.849751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3bcf3ec-172f-4ebd-9feb-ab4ff6a475cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:09.850475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3bcf3ec-172f-4ebd-9feb-ab4ff6a475cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:09.850983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3bcf3ec-172f-4ebd-9feb-ab4ff6a475cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:09.851429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b3bcf3ec-172f-4ebd-9feb-ab4ff6a475cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:09.989992 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b3bcf3ec-172f-4ebd-9feb-ab4ff6a475cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:09.997732 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b3bcf3ec-172f-4ebd-9feb-ab4ff6a475cd tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1316 microversion: 2.1 time: 0.162080 Aug 23 18:59:09.998330 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3846/7562] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:09 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:11.018712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4a21cd89-1bd3-426b-ac0a-5ec778ed191b tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:11.019336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4a21cd89-1bd3-426b-ac0a-5ec778ed191b tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:11.026152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a21cd89-1bd3-426b-ac0a-5ec778ed191b tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:11.026671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a21cd89-1bd3-426b-ac0a-5ec778ed191b tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:11.027108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a21cd89-1bd3-426b-ac0a-5ec778ed191b tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:11.027790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a21cd89-1bd3-426b-ac0a-5ec778ed191b tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:11.028240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a21cd89-1bd3-426b-ac0a-5ec778ed191b tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:11.028663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a21cd89-1bd3-426b-ac0a-5ec778ed191b tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:11.164789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4a21cd89-1bd3-426b-ac0a-5ec778ed191b tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:11.172664 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4a21cd89-1bd3-426b-ac0a-5ec778ed191b tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1316 microversion: 2.1 time: 0.158106 Aug 23 18:59:11.173235 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3717/7563] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:11 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:12.194009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b894a4c2-42cd-48c9-bfe3-6ef8d9f10e32 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:12.194857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b894a4c2-42cd-48c9-bfe3-6ef8d9f10e32 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:12.201825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b894a4c2-42cd-48c9-bfe3-6ef8d9f10e32 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:12.202379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b894a4c2-42cd-48c9-bfe3-6ef8d9f10e32 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:12.202935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b894a4c2-42cd-48c9-bfe3-6ef8d9f10e32 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:12.203648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b894a4c2-42cd-48c9-bfe3-6ef8d9f10e32 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:12.204115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b894a4c2-42cd-48c9-bfe3-6ef8d9f10e32 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:12.204555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b894a4c2-42cd-48c9-bfe3-6ef8d9f10e32 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:12.342205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b894a4c2-42cd-48c9-bfe3-6ef8d9f10e32 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:12.349938 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b894a4c2-42cd-48c9-bfe3-6ef8d9f10e32 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1316 microversion: 2.1 time: 0.159885 Aug 23 18:59:12.350507 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3847/7564] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:12 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:13.371418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-86585ea0-786c-4a79-86a8-5aa67d15db76 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:13.372038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-86585ea0-786c-4a79-86a8-5aa67d15db76 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:13.379502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86585ea0-786c-4a79-86a8-5aa67d15db76 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:13.380000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86585ea0-786c-4a79-86a8-5aa67d15db76 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:13.380448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86585ea0-786c-4a79-86a8-5aa67d15db76 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:13.381157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86585ea0-786c-4a79-86a8-5aa67d15db76 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:13.381621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86585ea0-786c-4a79-86a8-5aa67d15db76 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:13.382052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-86585ea0-786c-4a79-86a8-5aa67d15db76 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:13.453936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-eddffe41-0ad4-4802-a860-4ac56d23e289 req-1be5723b-98a0-4061-bec8-ade169e4f6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "306e2615-68ad-465d-8948-5d79478439fd", "name": "network-vif-plugged", "status": "completed", "tag": "8e9a0431-08a2-4490-a746-560bcb015669"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:59:13.465441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eddffe41-0ad4-4802-a860-4ac56d23e289 req-1be5723b-98a0-4061-bec8-ade169e4f6ec service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:13.466146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eddffe41-0ad4-4802-a860-4ac56d23e289 req-1be5723b-98a0-4061-bec8-ade169e4f6ec service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:13.466828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-eddffe41-0ad4-4802-a860-4ac56d23e289 req-1be5723b-98a0-4061-bec8-ade169e4f6ec service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:13.480166 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-eddffe41-0ad4-4802-a860-4ac56d23e289 req-1be5723b-98a0-4061-bec8-ade169e4f6ec service nova] Creating event network-vif-plugged:8e9a0431-08a2-4490-a746-560bcb015669 for instance 306e2615-68ad-465d-8948-5d79478439fd on n-h1-850468-16 Aug 23 18:59:13.486025 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-eddffe41-0ad4-4802-a860-4ac56d23e289 req-1be5723b-98a0-4061-bec8-ade169e4f6ec service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036963 Aug 23 18:59:13.486758 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3848/7565] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:59:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 18:59:13.523875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-86585ea0-786c-4a79-86a8-5aa67d15db76 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:13.532489 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-86585ea0-786c-4a79-86a8-5aa67d15db76 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1316 microversion: 2.1 time: 0.164968 Aug 23 18:59:13.536646 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3718/7566] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:13 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1316 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:14.555423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cf5b8384-2361-43c2-8cfa-1758d63613e1 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:14.556142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cf5b8384-2361-43c2-8cfa-1758d63613e1 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:14.563708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf5b8384-2361-43c2-8cfa-1758d63613e1 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:14.564192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf5b8384-2361-43c2-8cfa-1758d63613e1 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:14.564647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf5b8384-2361-43c2-8cfa-1758d63613e1 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:14.565358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf5b8384-2361-43c2-8cfa-1758d63613e1 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:14.565822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf5b8384-2361-43c2-8cfa-1758d63613e1 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:14.566256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cf5b8384-2361-43c2-8cfa-1758d63613e1 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:14.701766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cf5b8384-2361-43c2-8cfa-1758d63613e1 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:14.710202 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cf5b8384-2361-43c2-8cfa-1758d63613e1 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1316 microversion: 2.1 time: 0.159202 Aug 23 18:59:14.710807 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3849/7567] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:14 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1316 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:15.732156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f1b26e11-e153-48ef-9d69-88b8dfa1e254 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:15.732777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f1b26e11-e153-48ef-9d69-88b8dfa1e254 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:15.735648 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:15.741182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1b26e11-e153-48ef-9d69-88b8dfa1e254 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:15.741659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1b26e11-e153-48ef-9d69-88b8dfa1e254 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:15.742093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1b26e11-e153-48ef-9d69-88b8dfa1e254 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:15.742870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1b26e11-e153-48ef-9d69-88b8dfa1e254 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:15.743348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1b26e11-e153-48ef-9d69-88b8dfa1e254 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:15.743775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f1b26e11-e153-48ef-9d69-88b8dfa1e254 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:15.879883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f1b26e11-e153-48ef-9d69-88b8dfa1e254 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:15.888326 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f1b26e11-e153-48ef-9d69-88b8dfa1e254 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1506 microversion: 2.1 time: 0.159897 Aug 23 18:59:15.888841 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3719/7568] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:15 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:15.911574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e47a361d-b50a-471d-9c40-f9b0348e2eef tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:15.912129 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e47a361d-b50a-471d-9c40-f9b0348e2eef tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:15.914154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:15.915089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:15.922928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e47a361d-b50a-471d-9c40-f9b0348e2eef tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:15.923442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e47a361d-b50a-471d-9c40-f9b0348e2eef tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:15.923899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e47a361d-b50a-471d-9c40-f9b0348e2eef tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:15.924639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e47a361d-b50a-471d-9c40-f9b0348e2eef tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:15.925115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e47a361d-b50a-471d-9c40-f9b0348e2eef tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:15.925564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e47a361d-b50a-471d-9c40-f9b0348e2eef tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:15.953099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e47a361d-b50a-471d-9c40-f9b0348e2eef tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:59:16.033535 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e47a361d-b50a-471d-9c40-f9b0348e2eef tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "DELETE /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 204 len: 0 microversion: 2.1 time: 0.125627 Aug 23 18:59:16.034276 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3850/7569] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:59:15 2022] DELETE /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 18:59:16.042033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d3d5526-a743-4aa9-aa76-8d1ffff84f51 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:16.042657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d3d5526-a743-4aa9-aa76-8d1ffff84f51 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:16.049503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d3d5526-a743-4aa9-aa76-8d1ffff84f51 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:16.050006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d3d5526-a743-4aa9-aa76-8d1ffff84f51 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:16.050446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d3d5526-a743-4aa9-aa76-8d1ffff84f51 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:16.051178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d3d5526-a743-4aa9-aa76-8d1ffff84f51 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:16.051636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d3d5526-a743-4aa9-aa76-8d1ffff84f51 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:16.052065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d3d5526-a743-4aa9-aa76-8d1ffff84f51 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:16.185860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6d3d5526-a743-4aa9-aa76-8d1ffff84f51 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:16.194187 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d3d5526-a743-4aa9-aa76-8d1ffff84f51 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1512 microversion: 2.1 time: 0.155982 Aug 23 18:59:16.194726 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3720/7570] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:16 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:59:17.216505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5200e54c-21f1-4c18-ab7a-d302ec90820c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:17.217246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5200e54c-21f1-4c18-ab7a-d302ec90820c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:17.225012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5200e54c-21f1-4c18-ab7a-d302ec90820c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:17.225513 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5200e54c-21f1-4c18-ab7a-d302ec90820c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:17.225967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5200e54c-21f1-4c18-ab7a-d302ec90820c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:17.226771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5200e54c-21f1-4c18-ab7a-d302ec90820c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:17.227423 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5200e54c-21f1-4c18-ab7a-d302ec90820c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:17.227867 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5200e54c-21f1-4c18-ab7a-d302ec90820c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:17.365890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5200e54c-21f1-4c18-ab7a-d302ec90820c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:17.373705 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5200e54c-21f1-4c18-ab7a-d302ec90820c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1512 microversion: 2.1 time: 0.162198 Aug 23 18:59:17.374510 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3851/7571] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:17 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1512 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:17.967297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-671160a0-d8e5-4cad-b993-d2572cd56c94 req-70891d7a-e0ae-4753-aaa9-242a8ff40806 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "306e2615-68ad-465d-8948-5d79478439fd", "name": "network-vif-deleted", "tag": "8e9a0431-08a2-4490-a746-560bcb015669"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:59:17.982309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-671160a0-d8e5-4cad-b993-d2572cd56c94 req-70891d7a-e0ae-4753-aaa9-242a8ff40806 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:17.982913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-671160a0-d8e5-4cad-b993-d2572cd56c94 req-70891d7a-e0ae-4753-aaa9-242a8ff40806 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:17.983561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-671160a0-d8e5-4cad-b993-d2572cd56c94 req-70891d7a-e0ae-4753-aaa9-242a8ff40806 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:17.997790 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-671160a0-d8e5-4cad-b993-d2572cd56c94 req-70891d7a-e0ae-4753-aaa9-242a8ff40806 service nova] Creating event network-vif-deleted:8e9a0431-08a2-4490-a746-560bcb015669 for instance 306e2615-68ad-465d-8948-5d79478439fd on n-h1-850468-16 Aug 23 18:59:18.004846 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-671160a0-d8e5-4cad-b993-d2572cd56c94 req-70891d7a-e0ae-4753-aaa9-242a8ff40806 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043121 Aug 23 18:59:18.006730 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3721/7572] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:59:18.395726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:18.397092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:18.404242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:18.404745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:18.406013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:18.407100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:18.407577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:18.408019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:18.443626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:18.444125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:18.444577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:18.445046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lazy-loading 'fault' on Instance uuid 306e2615-68ad-465d-8948-5d79478439fd {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:59:18.491281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:18.499458 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4176ac52-1f26-413d-98c2-0fa3bd4e1824 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 200 len: 1306 microversion: 2.1 time: 0.107953 Aug 23 18:59:18.500043 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3852/7573] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:18 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 1306 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:19.521620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-473acefa-fcb3-4ade-ae5f-54f59c335f6d tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:19.522669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-473acefa-fcb3-4ade-ae5f-54f59c335f6d tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:19.529416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-473acefa-fcb3-4ade-ae5f-54f59c335f6d tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:19.529894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-473acefa-fcb3-4ade-ae5f-54f59c335f6d tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:19.530332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-473acefa-fcb3-4ade-ae5f-54f59c335f6d tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:19.531720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-473acefa-fcb3-4ade-ae5f-54f59c335f6d tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:19.532176 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-473acefa-fcb3-4ade-ae5f-54f59c335f6d tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:19.532599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-473acefa-fcb3-4ade-ae5f-54f59c335f6d tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:19.545936 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-473acefa-fcb3-4ade-ae5f-54f59c335f6d tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] HTTP exception thrown: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-473acefa-fcb3-4ade-ae5f-54f59c335f6d tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Request method failure captured: Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd HTTP/1.1 Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSNtmQ_mD4EI39QQN8Va_XQ_CmDBcBNnAJ5F5X9NUlveKcfw0cimEpB3uSxWDoH1J08eVMuhnSuyBJYnwDjIPaIqZ2Cv-e4DQQtR7nHiXVgS-BE_jMu9PKv9JTuIHhBBI0TL7Z8ay0oga0GeHSpAN63n0jT-_XeJGsY_nVf9UiJY91s Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}] Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 5aab0e36ea0347ac91ede1536c7546aa Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '306e2615-68ad-465d-8948-5d79478439fd'} Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:19.548236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:19.553342 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:19.553342 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:19.553342 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:19.553342 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:59:19.553342 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:59:19.553342 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:19.553342 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:19.553342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-473acefa-fcb3-4ade-ae5f-54f59c335f6d tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Returning 404 to user: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:59:19.553342 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-473acefa-fcb3-4ade-ae5f-54f59c335f6d tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 404 len: 111 microversion: 2.1 time: 0.033582 Aug 23 18:59:19.553342 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3722/7574] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:19 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:59:19.558952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-235e6c2b-0582-4383-9ce9-c02e1df21b87 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:19.559592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-235e6c2b-0582-4383-9ce9-c02e1df21b87 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:19.566715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-235e6c2b-0582-4383-9ce9-c02e1df21b87 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:19.567224 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-235e6c2b-0582-4383-9ce9-c02e1df21b87 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:19.567677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-235e6c2b-0582-4383-9ce9-c02e1df21b87 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:19.568532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-235e6c2b-0582-4383-9ce9-c02e1df21b87 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:19.568999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-235e6c2b-0582-4383-9ce9-c02e1df21b87 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:19.569683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-235e6c2b-0582-4383-9ce9-c02e1df21b87 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:19.705566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-235e6c2b-0582-4383-9ce9-c02e1df21b87 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:19.713330 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-235e6c2b-0582-4383-9ce9-c02e1df21b87 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1506 microversion: 2.1 time: 0.158446 Aug 23 18:59:19.713904 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3853/7575] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:19 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1506 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:19.734311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-84e4ef2d-0200-4ddc-b73b-11b1a12ad623 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:59:19.736591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-84e4ef2d-0200-4ddc-b73b-11b1a12ad623 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 2ec4779a-3e4e-45b2-bd21-4d77a2548416] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:19.742145 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-84e4ef2d-0200-4ddc-b73b-11b1a12ad623 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] HTTP exception thrown: Instance 2ec4779a-3e4e-45b2-bd21-4d77a2548416 could not be found. Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-84e4ef2d-0200-4ddc-b73b-11b1a12ad623 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Request method failure captured: Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/2ec4779a-3e4e-45b2-bd21-4d77a2548416/action HTTP/1.1 Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 32 Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSNtmQ_mD4EI39QQN8Va_XQ_CmDBcBNnAJ5F5X9NUlveKcfw0cimEpB3uSxWDoH1J08eVMuhnSuyBJYnwDjIPaIqZ2Cv-e4DQQtR7nHiXVgS-BE_jMu9PKv9JTuIHhBBI0TL7Z8ay0oga0GeHSpAN63n0jT-_XeJGsY_nVf9UiJY91s Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}] Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 5aab0e36ea0347ac91ede1536c7546aa Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: {"resize": {"flavorRef": "452"}} Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 2ec4779a-3e4e-45b2-bd21-4d77a2548416 could not be found. Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '2ec4779a-3e4e-45b2-bd21-4d77a2548416', 'body': {'resize': {'flavorRef': '452'}}} Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2940, in _get_instance Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ec4779a-3e4e-45b2-bd21-4d77a2548416 could not be found. Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:59:19.743736 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ec4779a-3e4e-45b2-bd21-4d77a2548416 could not be found. Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ec4779a-3e4e-45b2-bd21-4d77a2548416 could not be found. Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-84e4ef2d-0200-4ddc-b73b-11b1a12ad623 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Returning 404 to user: Instance 2ec4779a-3e4e-45b2-bd21-4d77a2548416 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-84e4ef2d-0200-4ddc-b73b-11b1a12ad623 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "POST /compute/v2.1/servers/2ec4779a-3e4e-45b2-bd21-4d77a2548416/action" status: 404 len: 111 microversion: 2.1 time: 0.015025 Aug 23 18:59:19.748100 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3723/7576] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:59:19 2022] POST /compute/v2.1/servers/2ec4779a-3e4e-45b2-bd21-4d77a2548416/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:59:19.753536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c3dc413b-8d9d-44f0-bb75-62c5c78a96b5 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:19.754174 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c3dc413b-8d9d-44f0-bb75-62c5c78a96b5 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:19.760219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3dc413b-8d9d-44f0-bb75-62c5c78a96b5 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:19.760722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3dc413b-8d9d-44f0-bb75-62c5c78a96b5 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:19.761180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3dc413b-8d9d-44f0-bb75-62c5c78a96b5 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:19.761903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3dc413b-8d9d-44f0-bb75-62c5c78a96b5 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:19.762378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3dc413b-8d9d-44f0-bb75-62c5c78a96b5 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:19.762861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3dc413b-8d9d-44f0-bb75-62c5c78a96b5 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:19.893137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c3dc413b-8d9d-44f0-bb75-62c5c78a96b5 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:19.896801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:19.902600 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c3dc413b-8d9d-44f0-bb75-62c5c78a96b5 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1506 microversion: 2.1 time: 0.152713 Aug 23 18:59:19.903184 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3854/7577] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:19 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 18:59:19.924422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0a2d8d2e-7a87-4554-81eb-5d06dcf75491 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:19.925041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0a2d8d2e-7a87-4554-81eb-5d06dcf75491 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:19.931901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a2d8d2e-7a87-4554-81eb-5d06dcf75491 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:19.932387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a2d8d2e-7a87-4554-81eb-5d06dcf75491 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:19.932825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a2d8d2e-7a87-4554-81eb-5d06dcf75491 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:19.933516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a2d8d2e-7a87-4554-81eb-5d06dcf75491 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:19.933970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a2d8d2e-7a87-4554-81eb-5d06dcf75491 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:19.934395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a2d8d2e-7a87-4554-81eb-5d06dcf75491 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.066534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0a2d8d2e-7a87-4554-81eb-5d06dcf75491 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:20.074428 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0a2d8d2e-7a87-4554-81eb-5d06dcf75491 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1506 microversion: 2.1 time: 0.154253 Aug 23 18:59:20.075022 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3724/7578] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:19 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:20.097502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "db4db913-0089-46be-b447-e9e48b453a63"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:59:20.099740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:20.106711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.107214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.107668 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.108381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.109073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.109401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.149879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:20.155500 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] HTTP exception thrown: Flavor db4db913-0089-46be-b447-e9e48b453a63 could not be found. Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Request method failure captured: Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: request: POST /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89/action HTTP/1.1 Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 65 Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSNtmQ_mD4EI39QQN8Va_XQ_CmDBcBNnAJ5F5X9NUlveKcfw0cimEpB3uSxWDoH1J08eVMuhnSuyBJYnwDjIPaIqZ2Cv-e4DQQtR7nHiXVgS-BE_jMu9PKv9JTuIHhBBI0TL7Z8ay0oga0GeHSpAN63n0jT-_XeJGsY_nVf9UiJY91s Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}] Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 5aab0e36ea0347ac91ede1536c7546aa Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: {"resize": {"flavorRef": "db4db913-0089-46be-b447-e9e48b453a63"}} Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: exception: Flavor db4db913-0089-46be-b447-e9e48b453a63 could not be found. Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f140ec47-4e0c-465b-9481-66b318db7a89', 'body': {'resize': {'flavorRef': 'db4db913-0089-46be-b447-e9e48b453a63'}}} Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 375, in inner Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 360, in wrapper Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 343, in wrapper Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4185, in resize Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:59:20.174924 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor db4db913-0089-46be-b447-e9e48b453a63 could not be found. Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor db4db913-0089-46be-b447-e9e48b453a63 could not be found. Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor db4db913-0089-46be-b447-e9e48b453a63 could not be found. Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Returning 400 to user: Flavor db4db913-0089-46be-b447-e9e48b453a63 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f033e20-464f-41b2-bd3d-c906cc087f92 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "POST /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89/action" status: 400 len: 107 microversion: 2.1 time: 0.084192 Aug 23 18:59:20.178693 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3855/7579] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:59:20 2022] POST /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89/action => generated 107 bytes in 85 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:59:20.185233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5a946701-1a04-457a-a41c-2211f6c7439c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:20.185841 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5a946701-1a04-457a-a41c-2211f6c7439c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:20.192660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a946701-1a04-457a-a41c-2211f6c7439c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.193140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a946701-1a04-457a-a41c-2211f6c7439c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.193574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a946701-1a04-457a-a41c-2211f6c7439c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.194288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a946701-1a04-457a-a41c-2211f6c7439c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.194773 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a946701-1a04-457a-a41c-2211f6c7439c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.195203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5a946701-1a04-457a-a41c-2211f6c7439c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.328868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5a946701-1a04-457a-a41c-2211f6c7439c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:20.336541 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5a946701-1a04-457a-a41c-2211f6c7439c tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1506 microversion: 2.1 time: 0.155172 Aug 23 18:59:20.337104 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3725/7580] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:20 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:20.357660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b2321874-5022-49fd-aacc-7b65689f1b21 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:20.358229 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b2321874-5022-49fd-aacc-7b65689f1b21 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:20.364849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2321874-5022-49fd-aacc-7b65689f1b21 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.365354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2321874-5022-49fd-aacc-7b65689f1b21 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.365808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2321874-5022-49fd-aacc-7b65689f1b21 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.366519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2321874-5022-49fd-aacc-7b65689f1b21 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.367010 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2321874-5022-49fd-aacc-7b65689f1b21 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.367453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b2321874-5022-49fd-aacc-7b65689f1b21 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.498750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b2321874-5022-49fd-aacc-7b65689f1b21 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:20.507265 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b2321874-5022-49fd-aacc-7b65689f1b21 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1506 microversion: 2.1 time: 0.153566 Aug 23 18:59:20.507870 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3856/7581] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:20 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:20.527319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b09fa31d-2a88-4091-95e8-67b279ad82ff tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b09fa31d-2a88-4091-95e8-67b279ad82ff tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Request method failure captured: Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: request: POST /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89/action HTTP/1.1 Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 29 Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSNtmQ_mD4EI39QQN8Va_XQ_CmDBcBNnAJ5F5X9NUlveKcfw0cimEpB3uSxWDoH1J08eVMuhnSuyBJYnwDjIPaIqZ2Cv-e4DQQtR7nHiXVgS-BE_jMu9PKv9JTuIHhBBI0TL7Z8ay0oga0GeHSpAN63n0jT-_XeJGsY_nVf9UiJY91s Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}] Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 5aab0e36ea0347ac91ede1536c7546aa Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: {"resize": {"flavorRef": ""}} Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': 'f140ec47-4e0c-465b-9481-66b318db7a89', 'body': {'resize': {'flavorRef': ''}}} Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise error Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi On instance['resize']: Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi '' Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.531087 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:20.535714 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.535714 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:20.535714 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:20.535714 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:20.535714 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 23 18:59:20.535714 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 23 18:59:20.535714 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Aug 23 18:59:20.535714 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.535714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b09fa31d-2a88-4091-95e8-67b279ad82ff tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:59:20.535714 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b09fa31d-2a88-4091-95e8-67b279ad82ff tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "POST /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89/action" status: 400 len: 113 microversion: 2.1 time: 0.009171 Aug 23 18:59:20.535714 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3726/7582] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 18:59:20 2022] POST /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89/action => generated 113 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 23 18:59:20.540888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ba73a471-9e10-49cd-96f9-13cbd8d12839 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:20.541517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ba73a471-9e10-49cd-96f9-13cbd8d12839 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:20.548197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba73a471-9e10-49cd-96f9-13cbd8d12839 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.548695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba73a471-9e10-49cd-96f9-13cbd8d12839 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.549155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba73a471-9e10-49cd-96f9-13cbd8d12839 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.549859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba73a471-9e10-49cd-96f9-13cbd8d12839 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.550325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba73a471-9e10-49cd-96f9-13cbd8d12839 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.550796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ba73a471-9e10-49cd-96f9-13cbd8d12839 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.691414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ba73a471-9e10-49cd-96f9-13cbd8d12839 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:20.699621 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ba73a471-9e10-49cd-96f9-13cbd8d12839 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1506 microversion: 2.1 time: 0.162457 Aug 23 18:59:20.700202 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3857/7583] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:20 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1506 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:20.725735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4725e9e9-a648-4f67-9300-f2b75ee07873 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:20.726235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4725e9e9-a648-4f67-9300-f2b75ee07873 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:20.733331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4725e9e9-a648-4f67-9300-f2b75ee07873 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.733824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4725e9e9-a648-4f67-9300-f2b75ee07873 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.734267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4725e9e9-a648-4f67-9300-f2b75ee07873 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.734984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4725e9e9-a648-4f67-9300-f2b75ee07873 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.735447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4725e9e9-a648-4f67-9300-f2b75ee07873 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.735879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4725e9e9-a648-4f67-9300-f2b75ee07873 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.748870 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-4725e9e9-a648-4f67-9300-f2b75ee07873 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] HTTP exception thrown: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4725e9e9-a648-4f67-9300-f2b75ee07873 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Request method failure captured: Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd HTTP/1.1 Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSNtmQ_mD4EI39QQN8Va_XQ_CmDBcBNnAJ5F5X9NUlveKcfw0cimEpB3uSxWDoH1J08eVMuhnSuyBJYnwDjIPaIqZ2Cv-e4DQQtR7nHiXVgS-BE_jMu9PKv9JTuIHhBBI0TL7Z8ay0oga0GeHSpAN63n0jT-_XeJGsY_nVf9UiJY91s Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}] Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 5aab0e36ea0347ac91ede1536c7546aa Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '306e2615-68ad-465d-8948-5d79478439fd'} Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:59:20.751028 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4725e9e9-a648-4f67-9300-f2b75ee07873 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Returning 404 to user: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4725e9e9-a648-4f67-9300-f2b75ee07873 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "DELETE /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 404 len: 111 microversion: 2.1 time: 0.031376 Aug 23 18:59:20.754769 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3727/7584] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:59:20 2022] DELETE /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:59:20.761258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cfc2a0f4-5bcc-47a4-9c66-2fc19e7d2783 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:20.761888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cfc2a0f4-5bcc-47a4-9c66-2fc19e7d2783 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: 306e2615-68ad-465d-8948-5d79478439fd] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:20.769989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfc2a0f4-5bcc-47a4-9c66-2fc19e7d2783 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.770524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfc2a0f4-5bcc-47a4-9c66-2fc19e7d2783 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.771252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfc2a0f4-5bcc-47a4-9c66-2fc19e7d2783 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.771968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfc2a0f4-5bcc-47a4-9c66-2fc19e7d2783 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.772438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfc2a0f4-5bcc-47a4-9c66-2fc19e7d2783 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.772877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfc2a0f4-5bcc-47a4-9c66-2fc19e7d2783 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.786960 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-cfc2a0f4-5bcc-47a4-9c66-2fc19e7d2783 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] HTTP exception thrown: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cfc2a0f4-5bcc-47a4-9c66-2fc19e7d2783 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Request method failure captured: Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd HTTP/1.1 Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSNtmQ_mD4EI39QQN8Va_XQ_CmDBcBNnAJ5F5X9NUlveKcfw0cimEpB3uSxWDoH1J08eVMuhnSuyBJYnwDjIPaIqZ2Cv-e4DQQtR7nHiXVgS-BE_jMu9PKv9JTuIHhBBI0TL7Z8ay0oga0GeHSpAN63n0jT-_XeJGsY_nVf9UiJY91s Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}] Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 5aab0e36ea0347ac91ede1536c7546aa Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '306e2615-68ad-465d-8948-5d79478439fd'} Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:20.788675 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.793353 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:20.793353 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:20.793353 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:20.793353 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:59:20.793353 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:59:20.793353 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. Aug 23 18:59:20.793353 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:20.793353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cfc2a0f4-5bcc-47a4-9c66-2fc19e7d2783 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Returning 404 to user: Instance 306e2615-68ad-465d-8948-5d79478439fd could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:59:20.793353 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cfc2a0f4-5bcc-47a4-9c66-2fc19e7d2783 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd" status: 404 len: 111 microversion: 2.1 time: 0.032784 Aug 23 18:59:20.793353 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3858/7585] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:20 2022] GET /compute/v2.1/servers/306e2615-68ad-465d-8948-5d79478439fd => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 18:59:20.799059 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c04ad935-2ece-46db-b5ee-e13525ed75d7 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:20.799562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c04ad935-2ece-46db-b5ee-e13525ed75d7 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:20.805563 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c04ad935-2ece-46db-b5ee-e13525ed75d7 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.806067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c04ad935-2ece-46db-b5ee-e13525ed75d7 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.806488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c04ad935-2ece-46db-b5ee-e13525ed75d7 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.807277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c04ad935-2ece-46db-b5ee-e13525ed75d7 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.807737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c04ad935-2ece-46db-b5ee-e13525ed75d7 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.808167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c04ad935-2ece-46db-b5ee-e13525ed75d7 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.834217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c04ad935-2ece-46db-b5ee-e13525ed75d7 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 18:59:20.909562 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c04ad935-2ece-46db-b5ee-e13525ed75d7 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "DELETE /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 204 len: 0 microversion: 2.1 time: 0.114305 Aug 23 18:59:20.910218 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3728/7586] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 18:59:20 2022] DELETE /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 18:59:20.919911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e1761b98-a38b-4e5b-a586-75795d733755 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:20.920541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e1761b98-a38b-4e5b-a586-75795d733755 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:20.926922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1761b98-a38b-4e5b-a586-75795d733755 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.927440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1761b98-a38b-4e5b-a586-75795d733755 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.927871 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1761b98-a38b-4e5b-a586-75795d733755 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:20.928579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1761b98-a38b-4e5b-a586-75795d733755 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:20.929049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1761b98-a38b-4e5b-a586-75795d733755 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:20.929487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e1761b98-a38b-4e5b-a586-75795d733755 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:21.064443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e1761b98-a38b-4e5b-a586-75795d733755 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:21.072236 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e1761b98-a38b-4e5b-a586-75795d733755 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1512 microversion: 2.1 time: 0.157396 Aug 23 18:59:21.072801 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3859/7587] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:20 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:21.357348 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 18:59:21.357582 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 18:59:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 18:59:22.094873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1a2935f2-53ae-4d30-ba82-4785eaf252d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:22.095505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1a2935f2-53ae-4d30-ba82-4785eaf252d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:22.102283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a2935f2-53ae-4d30-ba82-4785eaf252d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:22.102806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a2935f2-53ae-4d30-ba82-4785eaf252d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:22.103272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a2935f2-53ae-4d30-ba82-4785eaf252d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:22.103976 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a2935f2-53ae-4d30-ba82-4785eaf252d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:22.104437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a2935f2-53ae-4d30-ba82-4785eaf252d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:22.104862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a2935f2-53ae-4d30-ba82-4785eaf252d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:22.123472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:22.237781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1a2935f2-53ae-4d30-ba82-4785eaf252d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:22.245543 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1a2935f2-53ae-4d30-ba82-4785eaf252d0 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1512 microversion: 2.1 time: 0.156029 Aug 23 18:59:22.246105 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3729/7588] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:22 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:23.037570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8f749de6-3fd9-44c1-9604-c6141d7ee304 req-cf117768-fd2d-47c1-ba4c-c8a5887d6fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f140ec47-4e0c-465b-9481-66b318db7a89", "name": "network-vif-deleted", "tag": "d292f84f-0ebf-4154-8f62-d425ecde9613"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:59:23.051694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8f749de6-3fd9-44c1-9604-c6141d7ee304 req-cf117768-fd2d-47c1-ba4c-c8a5887d6fd5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:23.052197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8f749de6-3fd9-44c1-9604-c6141d7ee304 req-cf117768-fd2d-47c1-ba4c-c8a5887d6fd5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:23.052647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8f749de6-3fd9-44c1-9604-c6141d7ee304 req-cf117768-fd2d-47c1-ba4c-c8a5887d6fd5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:23.066352 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8f749de6-3fd9-44c1-9604-c6141d7ee304 req-cf117768-fd2d-47c1-ba4c-c8a5887d6fd5 service nova] Creating event network-vif-deleted:d292f84f-0ebf-4154-8f62-d425ecde9613 for instance f140ec47-4e0c-465b-9481-66b318db7a89 on n-h2-850468-16 Aug 23 18:59:23.072931 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8f749de6-3fd9-44c1-9604-c6141d7ee304 req-cf117768-fd2d-47c1-ba4c-c8a5887d6fd5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039167 Aug 23 18:59:23.073545 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3860/7589] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:59:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:59:23.266609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:23.267191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:23.273993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:23.274467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:23.274931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:23.275618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:23.276083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:23.276496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:23.307612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:23.308093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:23.308526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:23.308969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lazy-loading 'fault' on Instance uuid f140ec47-4e0c-465b-9481-66b318db7a89 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 18:59:23.350128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5aab0e36ea0347ac91ede1536c7546aa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce2327beca704d1a9f7ebea036422b20', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:23.357724 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b0b733b5-8eb2-423c-9abc-85d489bf50e4 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 200 len: 1306 microversion: 2.1 time: 0.095070 Aug 23 18:59:23.358276 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3730/7590] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:23 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 1306 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:24.381149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1aa584ba-049a-4f4e-a112-130f29eb78a3 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:24.381883 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1aa584ba-049a-4f4e-a112-130f29eb78a3 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] [instance: f140ec47-4e0c-465b-9481-66b318db7a89] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:24.388699 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1aa584ba-049a-4f4e-a112-130f29eb78a3 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:24.389205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1aa584ba-049a-4f4e-a112-130f29eb78a3 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:24.389665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1aa584ba-049a-4f4e-a112-130f29eb78a3 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:24.390390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1aa584ba-049a-4f4e-a112-130f29eb78a3 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:24.390899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1aa584ba-049a-4f4e-a112-130f29eb78a3 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:24.391351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1aa584ba-049a-4f4e-a112-130f29eb78a3 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:24.404529 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-1aa584ba-049a-4f4e-a112-130f29eb78a3 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] HTTP exception thrown: Instance f140ec47-4e0c-465b-9481-66b318db7a89 could not be found. Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1aa584ba-049a-4f4e-a112-130f29eb78a3 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Request method failure captured: Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 HTTP/1.1 Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSNtmQ_mD4EI39QQN8Va_XQ_CmDBcBNnAJ5F5X9NUlveKcfw0cimEpB3uSxWDoH1J08eVMuhnSuyBJYnwDjIPaIqZ2Cv-e4DQQtR7nHiXVgS-BE_jMu9PKv9JTuIHhBBI0TL7Z8ay0oga0GeHSpAN63n0jT-_XeJGsY_nVf9UiJY91s Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ce2327beca704d1a9f7ebea036422b20"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ce2327beca704d1a9f7ebea036422b20"}]}] Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ce2327beca704d1a9f7ebea036422b20 Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1103889221 Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 5aab0e36ea0347ac91ede1536c7546aa Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-ServersNegativeTestJSON-1103889221-project Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance f140ec47-4e0c-465b-9481-66b318db7a89 could not be found. Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'f140ec47-4e0c-465b-9481-66b318db7a89'} Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f140ec47-4e0c-465b-9481-66b318db7a89 could not be found. Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f140ec47-4e0c-465b-9481-66b318db7a89 could not be found. Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 18:59:24.406175 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:24.410362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 18:59:24.410362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 18:59:24.410362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 18:59:24.410362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 18:59:24.410362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 18:59:24.410362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f140ec47-4e0c-465b-9481-66b318db7a89 could not be found. Aug 23 18:59:24.410362 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 18:59:24.410362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1aa584ba-049a-4f4e-a112-130f29eb78a3 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] Returning 404 to user: Instance f140ec47-4e0c-465b-9481-66b318db7a89 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 18:59:24.410362 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1aa584ba-049a-4f4e-a112-130f29eb78a3 tempest-ServersNegativeTestJSON-1103889221 tempest-ServersNegativeTestJSON-1103889221-project] 10.222.0.61 "GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89" status: 404 len: 111 microversion: 2.1 time: 0.031068 Aug 23 18:59:24.410362 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3861/7591] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:24 2022] GET /compute/v2.1/servers/f140ec47-4e0c-465b-9481-66b318db7a89 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 18:59:55.729464 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:55.730211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=10 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:55.919625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dbeace17-5f69-4949-ac8b-6074cb37e9c1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Action: 'create', calling method: .version_select at 0x7f27eca113a0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-232757359", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBo9fRhPeUSR6xCJrnNk/oVYd4DltKdlkl+iCQmxy5psJRoTZcVVfmCRub5xIDr6TIIupcUe11jvnI6GKp1qRFUOZQsovHWzANNbrqME7FzbwcU2wQ79cITARwldRjhi8g=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:59:55.938609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-dbeace17-5f69-4949-ac8b-6074cb37e9c1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Getting quotas for project ac1076498a3b42aea98e3dfc425d0601. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:59:55.944248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-dbeace17-5f69-4949-ac8b-6074cb37e9c1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Getting quotas for user 2486d131fa044a3e8b7db76f589c29b4 and project ac1076498a3b42aea98e3dfc425d0601. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:59:55.972866 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dbeace17-5f69-4949-ac8b-6074cb37e9c1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.248709 Aug 23 18:59:55.973492 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3731/7592] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 18:59:55 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 18:59:56.028665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1804931348", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-232757359", "networks": [{"uuid": "46e28cab-3ae6-4155-8e47-f74a01643583"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:59:56.039607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:56.040618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=28 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 18:59:56.094840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] validate_networks() for [('46e28cab-3ae6-4155-8e47-f74a01643583', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 18:59:56.480868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 18:59:56.481317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 18:59:56.481814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 18:59:56.482278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 18:59:56.483403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 18:59:56.492356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:56.492892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:56.493384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:56.494132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:56.494635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:56.495089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:56.512946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Getting quotas for project ac1076498a3b42aea98e3dfc425d0601. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 18:59:56.518780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Getting quotas for user 2486d131fa044a3e8b7db76f589c29b4 and project ac1076498a3b42aea98e3dfc425d0601. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 18:59:56.531885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 18:59:56.534240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 18:59:56.580860 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3fcf2cc1-896b-4680-b732-528f80c53a19 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556369 Aug 23 18:59:56.581509 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3862/7593] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 18:59:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 18:59:56.593130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7fec37fd-c65e-4b5b-9ac0-9e8c4267ffa7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:56.594447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7fec37fd-c65e-4b5b-9ac0-9e8c4267ffa7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:56.656449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7fec37fd-c65e-4b5b-9ac0-9e8c4267ffa7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:56.665204 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7fec37fd-c65e-4b5b-9ac0-9e8c4267ffa7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1262 microversion: 2.1 time: 0.076859 Aug 23 18:59:56.665949 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3732/7594] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:56 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1262 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:57.687305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cd1fb0f1-9523-46a9-a403-d6b5ca6e10e3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:57.687944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cd1fb0f1-9523-46a9-a403-d6b5ca6e10e3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:57.695885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd1fb0f1-9523-46a9-a403-d6b5ca6e10e3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:57.696599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd1fb0f1-9523-46a9-a403-d6b5ca6e10e3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:57.697217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd1fb0f1-9523-46a9-a403-d6b5ca6e10e3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:57.697997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd1fb0f1-9523-46a9-a403-d6b5ca6e10e3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:57.698478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd1fb0f1-9523-46a9-a403-d6b5ca6e10e3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:57.699094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cd1fb0f1-9523-46a9-a403-d6b5ca6e10e3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:57.775410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cd1fb0f1-9523-46a9-a403-d6b5ca6e10e3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:57.787247 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cd1fb0f1-9523-46a9-a403-d6b5ca6e10e3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1322 microversion: 2.1 time: 0.104604 Aug 23 18:59:57.788450 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3863/7595] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:57 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1322 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:58.810077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4cd636ea-01b5-47a4-91e5-7a0ab919295c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 18:59:58.811509 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4cd636ea-01b5-47a4-91e5-7a0ab919295c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 18:59:58.820279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd636ea-01b5-47a4-91e5-7a0ab919295c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:58.820910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd636ea-01b5-47a4-91e5-7a0ab919295c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:58.821656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd636ea-01b5-47a4-91e5-7a0ab919295c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:58.822476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd636ea-01b5-47a4-91e5-7a0ab919295c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:58.823290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd636ea-01b5-47a4-91e5-7a0ab919295c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:58.823812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd636ea-01b5-47a4-91e5-7a0ab919295c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:59.061640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4cd636ea-01b5-47a4-91e5-7a0ab919295c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 18:59:59.069637 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4cd636ea-01b5-47a4-91e5-7a0ab919295c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1362 microversion: 2.1 time: 0.264009 Aug 23 18:59:59.070247 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3733/7596] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 18:59:58 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1362 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 18:59:59.158773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f0bb3d99-db1e-464c-8378-f2d1c4d16cb7 req-502c6b13-562a-4061-904d-8aa35ef2871b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53b644cd-1fc0-4d2b-a849-a9b5d66c580d", "tag": "bd45aa1f-e0e1-45d2-af19-40438758206b"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 18:59:59.183287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f0bb3d99-db1e-464c-8378-f2d1c4d16cb7 req-502c6b13-562a-4061-904d-8aa35ef2871b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 18:59:59.184096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f0bb3d99-db1e-464c-8378-f2d1c4d16cb7 req-502c6b13-562a-4061-904d-8aa35ef2871b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 18:59:59.184542 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f0bb3d99-db1e-464c-8378-f2d1c4d16cb7 req-502c6b13-562a-4061-904d-8aa35ef2871b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 18:59:59.203960 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f0bb3d99-db1e-464c-8378-f2d1c4d16cb7 req-502c6b13-562a-4061-904d-8aa35ef2871b service nova] Creating event network-changed:bd45aa1f-e0e1-45d2-af19-40438758206b for instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d on n-h2-850468-16 Aug 23 18:59:59.209159 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f0bb3d99-db1e-464c-8378-f2d1c4d16cb7 req-502c6b13-562a-4061-904d-8aa35ef2871b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055468 Aug 23 18:59:59.210112 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3864/7597] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 18:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:00:00.092898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-41d65f0e-a17f-45b6-afc8-71e01c519589 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:00.093443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-41d65f0e-a17f-45b6-afc8-71e01c519589 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:00.102186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41d65f0e-a17f-45b6-afc8-71e01c519589 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:00.103104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41d65f0e-a17f-45b6-afc8-71e01c519589 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:00.103656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41d65f0e-a17f-45b6-afc8-71e01c519589 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:00.104479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41d65f0e-a17f-45b6-afc8-71e01c519589 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:00.105055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41d65f0e-a17f-45b6-afc8-71e01c519589 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:00.105587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-41d65f0e-a17f-45b6-afc8-71e01c519589 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:00.255303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-41d65f0e-a17f-45b6-afc8-71e01c519589 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:00.263591 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-41d65f0e-a17f-45b6-afc8-71e01c519589 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1362 microversion: 2.1 time: 0.175838 Aug 23 19:00:00.264173 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3734/7598] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:00 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:01.286066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bb02c0ad-0ab9-4659-b354-eaae0c763972 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:01.286977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bb02c0ad-0ab9-4659-b354-eaae0c763972 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:01.294832 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb02c0ad-0ab9-4659-b354-eaae0c763972 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:01.295472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb02c0ad-0ab9-4659-b354-eaae0c763972 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:01.295841 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb02c0ad-0ab9-4659-b354-eaae0c763972 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:01.296572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb02c0ad-0ab9-4659-b354-eaae0c763972 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:01.297055 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb02c0ad-0ab9-4659-b354-eaae0c763972 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:01.297658 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bb02c0ad-0ab9-4659-b354-eaae0c763972 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:01.437540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bb02c0ad-0ab9-4659-b354-eaae0c763972 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:01.445377 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bb02c0ad-0ab9-4659-b354-eaae0c763972 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1362 microversion: 2.1 time: 0.163720 Aug 23 19:00:01.445952 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3865/7599] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:01 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:02.466336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf5e4e85-d40a-4a42-a65c-3ba994acd916 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:02.467161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bf5e4e85-d40a-4a42-a65c-3ba994acd916 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:02.474306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf5e4e85-d40a-4a42-a65c-3ba994acd916 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:02.474775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf5e4e85-d40a-4a42-a65c-3ba994acd916 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:02.475217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf5e4e85-d40a-4a42-a65c-3ba994acd916 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:02.475914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf5e4e85-d40a-4a42-a65c-3ba994acd916 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:02.476379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf5e4e85-d40a-4a42-a65c-3ba994acd916 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:02.476808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf5e4e85-d40a-4a42-a65c-3ba994acd916 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:02.614614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bf5e4e85-d40a-4a42-a65c-3ba994acd916 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:02.622727 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bf5e4e85-d40a-4a42-a65c-3ba994acd916 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1362 microversion: 2.1 time: 0.160500 Aug 23 19:00:02.624183 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3735/7600] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:02 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:03.644797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-35bbbb3c-d24f-400c-979e-32e213044add tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:03.645427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-35bbbb3c-d24f-400c-979e-32e213044add tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:03.652352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35bbbb3c-d24f-400c-979e-32e213044add tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:03.652852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35bbbb3c-d24f-400c-979e-32e213044add tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:03.653301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35bbbb3c-d24f-400c-979e-32e213044add tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:03.654521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35bbbb3c-d24f-400c-979e-32e213044add tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:03.655158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35bbbb3c-d24f-400c-979e-32e213044add tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:03.655756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-35bbbb3c-d24f-400c-979e-32e213044add tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:04.030793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-35bbbb3c-d24f-400c-979e-32e213044add tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:04.039075 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-35bbbb3c-d24f-400c-979e-32e213044add tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1362 microversion: 2.1 time: 0.398190 Aug 23 19:00:04.039658 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3866/7601] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:03 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1362 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:05.061317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-013e8c2f-3f95-4296-b622-9024a14a7e23 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:05.061931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-013e8c2f-3f95-4296-b622-9024a14a7e23 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:05.068865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-013e8c2f-3f95-4296-b622-9024a14a7e23 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:05.069346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-013e8c2f-3f95-4296-b622-9024a14a7e23 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:05.069786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-013e8c2f-3f95-4296-b622-9024a14a7e23 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:05.070483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-013e8c2f-3f95-4296-b622-9024a14a7e23 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:05.070963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-013e8c2f-3f95-4296-b622-9024a14a7e23 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:05.071388 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-013e8c2f-3f95-4296-b622-9024a14a7e23 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:05.201618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-013e8c2f-3f95-4296-b622-9024a14a7e23 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:05.209648 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-013e8c2f-3f95-4296-b622-9024a14a7e23 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1362 microversion: 2.1 time: 0.152757 Aug 23 19:00:05.210219 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3736/7602] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:05 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:06.230635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0e63e37d-e8b4-4e2c-9ffb-62509b563837 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:06.231202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0e63e37d-e8b4-4e2c-9ffb-62509b563837 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:06.238435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e63e37d-e8b4-4e2c-9ffb-62509b563837 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:06.238961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e63e37d-e8b4-4e2c-9ffb-62509b563837 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:06.239411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e63e37d-e8b4-4e2c-9ffb-62509b563837 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:06.240117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e63e37d-e8b4-4e2c-9ffb-62509b563837 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:06.240582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e63e37d-e8b4-4e2c-9ffb-62509b563837 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:06.241020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e63e37d-e8b4-4e2c-9ffb-62509b563837 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:06.374087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0e63e37d-e8b4-4e2c-9ffb-62509b563837 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:06.381909 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0e63e37d-e8b4-4e2c-9ffb-62509b563837 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1362 microversion: 2.1 time: 0.155234 Aug 23 19:00:06.382509 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3867/7603] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:06 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:06.932129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-753c80a6-1152-4bb2-90ca-c6e3ead61c33 req-e38bf429-95d9-4277-b0bf-f49427e00de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b644cd-1fc0-4d2b-a849-a9b5d66c580d", "name": "network-vif-plugged", "status": "completed", "tag": "bd45aa1f-e0e1-45d2-af19-40438758206b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:00:06.938227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:06.945507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-753c80a6-1152-4bb2-90ca-c6e3ead61c33 req-e38bf429-95d9-4277-b0bf-f49427e00de5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:06.945995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-753c80a6-1152-4bb2-90ca-c6e3ead61c33 req-e38bf429-95d9-4277-b0bf-f49427e00de5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:06.946437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-753c80a6-1152-4bb2-90ca-c6e3ead61c33 req-e38bf429-95d9-4277-b0bf-f49427e00de5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:06.958971 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-753c80a6-1152-4bb2-90ca-c6e3ead61c33 req-e38bf429-95d9-4277-b0bf-f49427e00de5 service nova] Creating event network-vif-plugged:bd45aa1f-e0e1-45d2-af19-40438758206b for instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d on n-h2-850468-16 Aug 23 19:00:06.964269 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-753c80a6-1152-4bb2-90ca-c6e3ead61c33 req-e38bf429-95d9-4277-b0bf-f49427e00de5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036103 Aug 23 19:00:06.964859 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3737/7604] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:00:07.403217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-591222c0-d9a6-41c4-a913-e13a48cec2e5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:07.404015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-591222c0-d9a6-41c4-a913-e13a48cec2e5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:07.406002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:07.406863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:07.413724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-591222c0-d9a6-41c4-a913-e13a48cec2e5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:07.414260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-591222c0-d9a6-41c4-a913-e13a48cec2e5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:07.414756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-591222c0-d9a6-41c4-a913-e13a48cec2e5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:07.415487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-591222c0-d9a6-41c4-a913-e13a48cec2e5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:07.415963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-591222c0-d9a6-41c4-a913-e13a48cec2e5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:07.416413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-591222c0-d9a6-41c4-a913-e13a48cec2e5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:07.552595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-591222c0-d9a6-41c4-a913-e13a48cec2e5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:07.560884 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-591222c0-d9a6-41c4-a913-e13a48cec2e5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1362 microversion: 2.1 time: 0.161110 Aug 23 19:00:07.561594 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3868/7605] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:07 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:08.583588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bdb659db-728f-457c-8338-3dccd6c5c3d1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:08.584130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bdb659db-728f-457c-8338-3dccd6c5c3d1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:08.590595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bdb659db-728f-457c-8338-3dccd6c5c3d1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:08.591084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bdb659db-728f-457c-8338-3dccd6c5c3d1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:08.592125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bdb659db-728f-457c-8338-3dccd6c5c3d1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:08.592771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bdb659db-728f-457c-8338-3dccd6c5c3d1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:08.593218 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bdb659db-728f-457c-8338-3dccd6c5c3d1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:08.593644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bdb659db-728f-457c-8338-3dccd6c5c3d1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:08.724031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bdb659db-728f-457c-8338-3dccd6c5c3d1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:08.731838 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bdb659db-728f-457c-8338-3dccd6c5c3d1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1554 microversion: 2.1 time: 0.153517 Aug 23 19:00:08.732743 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3738/7606] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:08 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:00:08.752834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3e82a1fe-9ab6-4402-8801-624e2351bbb1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:08.753466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3e82a1fe-9ab6-4402-8801-624e2351bbb1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:08.760298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e82a1fe-9ab6-4402-8801-624e2351bbb1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:08.760795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e82a1fe-9ab6-4402-8801-624e2351bbb1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:08.761249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e82a1fe-9ab6-4402-8801-624e2351bbb1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:08.761955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e82a1fe-9ab6-4402-8801-624e2351bbb1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:08.762420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e82a1fe-9ab6-4402-8801-624e2351bbb1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:08.762897 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e82a1fe-9ab6-4402-8801-624e2351bbb1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:08.891048 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e82a1fe-9ab6-4402-8801-624e2351bbb1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:08.898870 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3e82a1fe-9ab6-4402-8801-624e2351bbb1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1554 microversion: 2.1 time: 0.150231 Aug 23 19:00:08.899443 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3869/7607] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:08 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:10.593645 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07e78df6-0bb4-4397-8575-a3b2517612c4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af36e17a-9ed9-467b-bb9f-cdba6ada50a7"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:00:10.596065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07e78df6-0bb4-4397-8575-a3b2517612c4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:10.603173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07e78df6-0bb4-4397-8575-a3b2517612c4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:10.603660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07e78df6-0bb4-4397-8575-a3b2517612c4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:10.604107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07e78df6-0bb4-4397-8575-a3b2517612c4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:10.604808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07e78df6-0bb4-4397-8575-a3b2517612c4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:10.605281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07e78df6-0bb4-4397-8575-a3b2517612c4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:10.605691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07e78df6-0bb4-4397-8575-a3b2517612c4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:10.866205 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-07e78df6-0bb4-4397-8575-a3b2517612c4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "POST /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276700 Aug 23 19:00:10.867031 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3739/7608] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 19:00:10 2022] POST /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments => generated 194 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:00:21.583349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-95d9e2bc-7d6c-4cb2-8874-66c528efa4ae tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:21.583930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-95d9e2bc-7d6c-4cb2-8874-66c528efa4ae tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:21.586818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:21.587581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=40 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:21.594570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95d9e2bc-7d6c-4cb2-8874-66c528efa4ae tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:21.595077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95d9e2bc-7d6c-4cb2-8874-66c528efa4ae tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:21.595533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95d9e2bc-7d6c-4cb2-8874-66c528efa4ae tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:21.596247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95d9e2bc-7d6c-4cb2-8874-66c528efa4ae tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:21.596718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95d9e2bc-7d6c-4cb2-8874-66c528efa4ae tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:21.597159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-95d9e2bc-7d6c-4cb2-8874-66c528efa4ae tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:21.678885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-95d9e2bc-7d6c-4cb2-8874-66c528efa4ae tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lazy-loading 'services' on Instance uuid 53b644cd-1fc0-4d2b-a849-a9b5d66c580d {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:00:21.751144 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-95d9e2bc-7d6c-4cb2-8874-66c528efa4ae tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "DELETE /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments/af36e17a-9ed9-467b-bb9f-cdba6ada50a7" status: 202 len: 0 microversion: 2.1 time: 0.171445 Aug 23 19:00:21.751781 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3870/7609] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 19:00:21 2022] DELETE /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments/af36e17a-9ed9-467b-bb9f-cdba6ada50a7 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:00:21.759181 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:21.759970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:21.765103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a6d83a5f-eb04-4d2b-b705-93564151b1ff tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:21.767741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a6d83a5f-eb04-4d2b-b705-93564151b1ff tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:21.776706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6d83a5f-eb04-4d2b-b705-93564151b1ff tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:21.777326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6d83a5f-eb04-4d2b-b705-93564151b1ff tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:21.777911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6d83a5f-eb04-4d2b-b705-93564151b1ff tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:21.778729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6d83a5f-eb04-4d2b-b705-93564151b1ff tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:21.779259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6d83a5f-eb04-4d2b-b705-93564151b1ff tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:21.780523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a6d83a5f-eb04-4d2b-b705-93564151b1ff tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:21.815702 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a6d83a5f-eb04-4d2b-b705-93564151b1ff tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058727 Aug 23 19:00:21.816266 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3740/7610] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:00:21 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:00:22.830089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-99719e5b-45fc-4fa6-9c2d-de60eceef798 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:22.832499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-99719e5b-45fc-4fa6-9c2d-de60eceef798 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:22.839599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99719e5b-45fc-4fa6-9c2d-de60eceef798 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:22.840357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99719e5b-45fc-4fa6-9c2d-de60eceef798 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:22.840803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99719e5b-45fc-4fa6-9c2d-de60eceef798 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:22.841557 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99719e5b-45fc-4fa6-9c2d-de60eceef798 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:22.842144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99719e5b-45fc-4fa6-9c2d-de60eceef798 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:22.842620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-99719e5b-45fc-4fa6-9c2d-de60eceef798 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:22.873934 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-99719e5b-45fc-4fa6-9c2d-de60eceef798 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048384 Aug 23 19:00:22.874545 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3871/7611] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:00:22 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:00:23.885855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1413c524-3abf-4000-839c-05b61e365f32 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:23.888125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1413c524-3abf-4000-839c-05b61e365f32 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:23.895743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1413c524-3abf-4000-839c-05b61e365f32 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:23.896080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1413c524-3abf-4000-839c-05b61e365f32 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:23.897005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1413c524-3abf-4000-839c-05b61e365f32 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:23.897194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1413c524-3abf-4000-839c-05b61e365f32 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:23.897652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1413c524-3abf-4000-839c-05b61e365f32 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:23.898078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1413c524-3abf-4000-839c-05b61e365f32 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:23.931059 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1413c524-3abf-4000-839c-05b61e365f32 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049293 Aug 23 19:00:23.931632 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3741/7612] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:00:23 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:00:24.943538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-59855dd6-768d-4cbf-ad16-bb7024e96bd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:24.945709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-59855dd6-768d-4cbf-ad16-bb7024e96bd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:24.952959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59855dd6-768d-4cbf-ad16-bb7024e96bd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:24.953463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59855dd6-768d-4cbf-ad16-bb7024e96bd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:24.953921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59855dd6-768d-4cbf-ad16-bb7024e96bd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:24.954686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59855dd6-768d-4cbf-ad16-bb7024e96bd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:24.955163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59855dd6-768d-4cbf-ad16-bb7024e96bd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:24.955611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59855dd6-768d-4cbf-ad16-bb7024e96bd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:24.986094 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-59855dd6-768d-4cbf-ad16-bb7024e96bd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046854 Aug 23 19:00:24.986730 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3872/7613] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:00:24 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:00:25.999149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-74843667-b4d8-439f-9bb6-133646988af0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:26.001316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-74843667-b4d8-439f-9bb6-133646988af0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:26.008399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74843667-b4d8-439f-9bb6-133646988af0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:26.008890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74843667-b4d8-439f-9bb6-133646988af0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:26.009331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74843667-b4d8-439f-9bb6-133646988af0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:26.010035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74843667-b4d8-439f-9bb6-133646988af0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:26.010495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74843667-b4d8-439f-9bb6-133646988af0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:26.010951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74843667-b4d8-439f-9bb6-133646988af0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:26.041517 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-74843667-b4d8-439f-9bb6-133646988af0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047099 Aug 23 19:00:26.042078 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3742/7614] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:00:25 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:00:27.054803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-48fffd85-5a9a-4b69-a469-b13f0c532432 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:27.056994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-48fffd85-5a9a-4b69-a469-b13f0c532432 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:27.064842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48fffd85-5a9a-4b69-a469-b13f0c532432 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:27.065344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48fffd85-5a9a-4b69-a469-b13f0c532432 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:27.065803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48fffd85-5a9a-4b69-a469-b13f0c532432 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:27.066528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48fffd85-5a9a-4b69-a469-b13f0c532432 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:27.067845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48fffd85-5a9a-4b69-a469-b13f0c532432 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:27.068338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-48fffd85-5a9a-4b69-a469-b13f0c532432 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:27.099259 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-48fffd85-5a9a-4b69-a469-b13f0c532432 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048716 Aug 23 19:00:27.099816 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3873/7615] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:00:27 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 19:00:27.111286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-44e21ec8-f8c5-468e-910f-d1a0751ff599 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:27.111797 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-44e21ec8-f8c5-468e-910f-d1a0751ff599 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:27.118371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44e21ec8-f8c5-468e-910f-d1a0751ff599 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:27.118897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44e21ec8-f8c5-468e-910f-d1a0751ff599 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:27.119340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44e21ec8-f8c5-468e-910f-d1a0751ff599 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:27.120044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44e21ec8-f8c5-468e-910f-d1a0751ff599 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:27.120506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44e21ec8-f8c5-468e-910f-d1a0751ff599 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:27.120938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-44e21ec8-f8c5-468e-910f-d1a0751ff599 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:27.280979 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-44e21ec8-f8c5-468e-910f-d1a0751ff599 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] HTTP exception thrown: Instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d is not attached to volume af36e17a-9ed9-467b-bb9f-cdba6ada50a7 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-44e21ec8-f8c5-468e-910f-d1a0751ff599 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Request method failure captured: Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments/af36e17a-9ed9-467b-bb9f-cdba6ada50a7 HTTP/1.1 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSOmj61W42CsVevuMqCyMg6qxJF9_oktCpbRJmJHz1rNf0TevlTVMLPZzm1-u6Cpvnhp9pcoxArQTl8iAB_u0VuxZEmcv-QQ67U6fIRgMC7zu6mf2k7TXmHQvEsDILOXxjHgrMiVW1dBAQ6G7k8Kxv2_l9TmS6vgH_cOtJB6MzCz8Vg Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ac1076498a3b42aea98e3dfc425d0601 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac1076498a3b42aea98e3dfc425d0601"}]}] Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ac1076498a3b42aea98e3dfc425d0601 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestEncryptedCinderVolumes-1816140811-project Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2486d131fa044a3e8b7db76f589c29b4 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestEncryptedCinderVolumes-1816140811-project Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d is not attached to volume af36e17a-9ed9-467b-bb9f-cdba6ada50a7 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': '53b644cd-1fc0-4d2b-a849-a9b5d66c580d', 'id': 'af36e17a-9ed9-467b-bb9f-cdba6ada50a7'} Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id af36e17a-9ed9-467b-bb9f-cdba6ada50a7. Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d is not attached to volume af36e17a-9ed9-467b-bb9f-cdba6ada50a7 Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:00:27.289813 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:00:27.295490 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:00:27.295490 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:00:27.295490 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d is not attached to volume af36e17a-9ed9-467b-bb9f-cdba6ada50a7 Aug 23 19:00:27.295490 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:00:27.295490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-44e21ec8-f8c5-468e-910f-d1a0751ff599 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Returning 404 to user: Instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d is not attached to volume af36e17a-9ed9-467b-bb9f-cdba6ada50a7 {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:00:27.295490 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-44e21ec8-f8c5-468e-910f-d1a0751ff599 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "DELETE /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments/af36e17a-9ed9-467b-bb9f-cdba6ada50a7" status: 404 len: 154 microversion: 2.1 time: 0.185025 Aug 23 19:00:27.295490 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3743/7616] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 19:00:27 2022] DELETE /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d/os-volume_attachments/af36e17a-9ed9-467b-bb9f-cdba6ada50a7 => generated 154 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:00:30.628497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cbf8c37e-8c0a-4e9f-8021-ba7d89cce66c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:30.629011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cbf8c37e-8c0a-4e9f-8021-ba7d89cce66c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:30.636676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbf8c37e-8c0a-4e9f-8021-ba7d89cce66c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:30.637196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbf8c37e-8c0a-4e9f-8021-ba7d89cce66c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:30.637662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbf8c37e-8c0a-4e9f-8021-ba7d89cce66c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:30.639383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbf8c37e-8c0a-4e9f-8021-ba7d89cce66c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:30.639876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbf8c37e-8c0a-4e9f-8021-ba7d89cce66c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:30.640333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cbf8c37e-8c0a-4e9f-8021-ba7d89cce66c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:30.670459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cbf8c37e-8c0a-4e9f-8021-ba7d89cce66c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:00:30.756046 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cbf8c37e-8c0a-4e9f-8021-ba7d89cce66c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "DELETE /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 204 len: 0 microversion: 2.1 time: 0.131282 Aug 23 19:00:30.756657 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3874/7617] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:00:30 2022] DELETE /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:00:30.765680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b50bfbda-354c-446a-aa88-e8848679d3a8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:30.766370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b50bfbda-354c-446a-aa88-e8848679d3a8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:30.775307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b50bfbda-354c-446a-aa88-e8848679d3a8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:30.775799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b50bfbda-354c-446a-aa88-e8848679d3a8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:30.776234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b50bfbda-354c-446a-aa88-e8848679d3a8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:30.776968 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b50bfbda-354c-446a-aa88-e8848679d3a8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:30.777452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b50bfbda-354c-446a-aa88-e8848679d3a8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:30.777873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b50bfbda-354c-446a-aa88-e8848679d3a8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:30.913472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b50bfbda-354c-446a-aa88-e8848679d3a8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:30.922083 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b50bfbda-354c-446a-aa88-e8848679d3a8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1560 microversion: 2.1 time: 0.161097 Aug 23 19:00:30.922675 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3744/7618] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:30 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:00:31.944346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b203df56-fd9b-4b4e-9ad4-af0181b0fe16 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:31.945066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b203df56-fd9b-4b4e-9ad4-af0181b0fe16 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:31.952435 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b203df56-fd9b-4b4e-9ad4-af0181b0fe16 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:31.952930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b203df56-fd9b-4b4e-9ad4-af0181b0fe16 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:31.953378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b203df56-fd9b-4b4e-9ad4-af0181b0fe16 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:31.954080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b203df56-fd9b-4b4e-9ad4-af0181b0fe16 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:31.954559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b203df56-fd9b-4b4e-9ad4-af0181b0fe16 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:31.955006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b203df56-fd9b-4b4e-9ad4-af0181b0fe16 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:32.090119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b203df56-fd9b-4b4e-9ad4-af0181b0fe16 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:32.099220 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b203df56-fd9b-4b4e-9ad4-af0181b0fe16 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1560 microversion: 2.1 time: 0.159270 Aug 23 19:00:32.099786 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3875/7619] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:31 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:32.929611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-c0dfff49-5a95-4d06-a0bf-6fdf67daa745 req-bf96f30a-69e8-47ec-b9d7-4b5a0a41c927 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53b644cd-1fc0-4d2b-a849-a9b5d66c580d", "name": "network-vif-deleted", "tag": "bd45aa1f-e0e1-45d2-af19-40438758206b"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:00:32.940761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c0dfff49-5a95-4d06-a0bf-6fdf67daa745 req-bf96f30a-69e8-47ec-b9d7-4b5a0a41c927 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:32.941341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c0dfff49-5a95-4d06-a0bf-6fdf67daa745 req-bf96f30a-69e8-47ec-b9d7-4b5a0a41c927 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:32.941776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c0dfff49-5a95-4d06-a0bf-6fdf67daa745 req-bf96f30a-69e8-47ec-b9d7-4b5a0a41c927 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:32.955713 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-c0dfff49-5a95-4d06-a0bf-6fdf67daa745 req-bf96f30a-69e8-47ec-b9d7-4b5a0a41c927 service nova] Creating event network-vif-deleted:bd45aa1f-e0e1-45d2-af19-40438758206b for instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d on n-h2-850468-16 Aug 23 19:00:32.961059 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-c0dfff49-5a95-4d06-a0bf-6fdf67daa745 req-bf96f30a-69e8-47ec-b9d7-4b5a0a41c927 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035218 Aug 23 19:00:32.961728 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3745/7620] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:00:33.121487 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:33.122193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:33.129338 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:33.129837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:33.130291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:33.131120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:33.131585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:33.132030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:33.165289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:33.165708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:33.166157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:33.166647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lazy-loading 'fault' on Instance uuid 53b644cd-1fc0-4d2b-a849-a9b5d66c580d {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:00:33.207299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:33.215188 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bf64f457-acc8-488e-9ba9-da437650a721 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 200 len: 1352 microversion: 2.1 time: 0.097466 Aug 23 19:00:33.215775 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3876/7621] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:33 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 1352 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:34.239116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91ca5a2e-559b-468a-987b-c1ba2e744a88 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:34.239751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-91ca5a2e-559b-468a-987b-c1ba2e744a88 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 53b644cd-1fc0-4d2b-a849-a9b5d66c580d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:34.245927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91ca5a2e-559b-468a-987b-c1ba2e744a88 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:34.246422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91ca5a2e-559b-468a-987b-c1ba2e744a88 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:34.246909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91ca5a2e-559b-468a-987b-c1ba2e744a88 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:34.247727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91ca5a2e-559b-468a-987b-c1ba2e744a88 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:34.248268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91ca5a2e-559b-468a-987b-c1ba2e744a88 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:34.248702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-91ca5a2e-559b-468a-987b-c1ba2e744a88 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:34.261855 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-91ca5a2e-559b-468a-987b-c1ba2e744a88 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] HTTP exception thrown: Instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d could not be found. Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91ca5a2e-559b-468a-987b-c1ba2e744a88 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Request method failure captured: Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d HTTP/1.1 Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSOmj61W42CsVevuMqCyMg6qxJF9_oktCpbRJmJHz1rNf0TevlTVMLPZzm1-u6Cpvnhp9pcoxArQTl8iAB_u0VuxZEmcv-QQ67U6fIRgMC7zu6mf2k7TXmHQvEsDILOXxjHgrMiVW1dBAQ6G7k8Kxv2_l9TmS6vgH_cOtJB6MzCz8Vg Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ac1076498a3b42aea98e3dfc425d0601 Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac1076498a3b42aea98e3dfc425d0601"}]}] Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ac1076498a3b42aea98e3dfc425d0601 Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestEncryptedCinderVolumes-1816140811-project Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2486d131fa044a3e8b7db76f589c29b4 Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestEncryptedCinderVolumes-1816140811-project Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d could not be found. Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '53b644cd-1fc0-4d2b-a849-a9b5d66c580d'} Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d could not be found. Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d could not be found. Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:00:34.263632 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:00:34.268303 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:00:34.268303 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:00:34.268303 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:00:34.268303 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:00:34.268303 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:00:34.268303 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:00:34.268303 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d could not be found. Aug 23 19:00:34.268303 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:00:34.268303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-91ca5a2e-559b-468a-987b-c1ba2e744a88 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Returning 404 to user: Instance 53b644cd-1fc0-4d2b-a849-a9b5d66c580d could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:00:34.268303 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-91ca5a2e-559b-468a-987b-c1ba2e744a88 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d" status: 404 len: 111 microversion: 2.1 time: 0.031183 Aug 23 19:00:34.268303 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3746/7622] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:34 2022] GET /compute/v2.1/servers/53b644cd-1fc0-4d2b-a849-a9b5d66c580d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:00:34.274076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-86405b88-b64a-4791-a85c-14f0c93c089e tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '.version_select at 0x7f27ec3b4b80>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:34.299567 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-86405b88-b64a-4791-a85c-14f0c93c089e tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-232757359" status: 202 len: 0 microversion: 2.1 time: 0.029407 Aug 23 19:00:34.300151 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3877/7623] 10.222.0.61 () {58 vars in 1275 bytes} [Tue Aug 23 19:00:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-232757359 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:00:34.318157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-734e7329-cf9d-46a2-8666-b6214d69f715 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Action: 'create', calling method: .version_select at 0x7f27dfa00a60>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1605648350", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNynp47MBBY1jw1Qmu7b7gxaPfc/jOnPzCmfBUviBjVBWeko7BQMR0Ah/xyNLIRdUj02QI+k6EkiripfgrK//BN21+0Lx4+bi9FqMMFU4+r8PQmnSmM6/saeR3iNTO8eBw=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:00:34.333569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-734e7329-cf9d-46a2-8666-b6214d69f715 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Getting quotas for project ac1076498a3b42aea98e3dfc425d0601. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:00:34.342931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-734e7329-cf9d-46a2-8666-b6214d69f715 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Getting quotas for user 2486d131fa044a3e8b7db76f589c29b4 and project ac1076498a3b42aea98e3dfc425d0601. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:00:34.367851 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-734e7329-cf9d-46a2-8666-b6214d69f715 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.053605 Aug 23 19:00:34.368456 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3747/7624] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 19:00:34 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:00:34.422977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-799278252", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1605648350", "networks": [{"uuid": "46e28cab-3ae6-4155-8e47-f74a01643583"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:00:34.476708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] validate_networks() for [('46e28cab-3ae6-4155-8e47-f74a01643583', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:00:34.862571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:00:34.863022 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:00:34.863525 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:00:34.863962 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:00:34.864400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:00:34.873988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:34.874493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:34.874984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:34.875740 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:34.876221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:34.876672 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:34.893810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Getting quotas for project ac1076498a3b42aea98e3dfc425d0601. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:00:34.899171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Getting quotas for user 2486d131fa044a3e8b7db76f589c29b4 and project ac1076498a3b42aea98e3dfc425d0601. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:00:34.911999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:00:34.914359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:00:34.962489 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a134907d-8012-4391-9efb-85ef80b2df57 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.544016 Aug 23 19:00:34.966797 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3878/7625] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 546 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:00:34.974704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-18f1279a-e0fc-4477-8ff3-f1ea0a6c48a1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:34.975318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-18f1279a-e0fc-4477-8ff3-f1ea0a6c48a1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:35.031278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-18f1279a-e0fc-4477-8ff3-f1ea0a6c48a1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:35.038413 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-18f1279a-e0fc-4477-8ff3-f1ea0a6c48a1 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1262 microversion: 2.1 time: 0.067568 Aug 23 19:00:35.039018 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3748/7626] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:34 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:36.061498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a4f42dd7-3e24-484e-b0a1-568fd7e1e472 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:36.064328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a4f42dd7-3e24-484e-b0a1-568fd7e1e472 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:36.070644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4f42dd7-3e24-484e-b0a1-568fd7e1e472 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:36.071149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4f42dd7-3e24-484e-b0a1-568fd7e1e472 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:36.071604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4f42dd7-3e24-484e-b0a1-568fd7e1e472 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:36.072531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4f42dd7-3e24-484e-b0a1-568fd7e1e472 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:36.073005 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4f42dd7-3e24-484e-b0a1-568fd7e1e472 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:36.073451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a4f42dd7-3e24-484e-b0a1-568fd7e1e472 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:36.136054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a4f42dd7-3e24-484e-b0a1-568fd7e1e472 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:36.144670 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a4f42dd7-3e24-484e-b0a1-568fd7e1e472 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1320 microversion: 2.1 time: 0.088873 Aug 23 19:00:36.145265 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3879/7627] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:36 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1320 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:37.166869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c93bfd2e-d87e-427e-b29d-719e474a68c0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:37.167480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c93bfd2e-d87e-427e-b29d-719e474a68c0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:37.178526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c93bfd2e-d87e-427e-b29d-719e474a68c0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:37.179281 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c93bfd2e-d87e-427e-b29d-719e474a68c0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:37.179766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c93bfd2e-d87e-427e-b29d-719e474a68c0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:37.180650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c93bfd2e-d87e-427e-b29d-719e474a68c0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:37.181101 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c93bfd2e-d87e-427e-b29d-719e474a68c0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:37.181527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c93bfd2e-d87e-427e-b29d-719e474a68c0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:37.412562 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c93bfd2e-d87e-427e-b29d-719e474a68c0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:37.424148 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c93bfd2e-d87e-427e-b29d-719e474a68c0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1362 microversion: 2.1 time: 0.261479 Aug 23 19:00:37.425657 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3749/7628] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:37 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1362 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:37.460415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-529c5216-81e6-4343-b99d-76f8edc07d77 req-ff601737-2704-49e6-8e65-c07614d2f468 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f416bb7-3ae2-4a58-b60b-fb294d9a403f", "tag": "242ba1a6-38e3-4e54-af9f-bb6909e84808"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:00:37.470851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-529c5216-81e6-4343-b99d-76f8edc07d77 req-ff601737-2704-49e6-8e65-c07614d2f468 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:37.471350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-529c5216-81e6-4343-b99d-76f8edc07d77 req-ff601737-2704-49e6-8e65-c07614d2f468 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:37.471789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-529c5216-81e6-4343-b99d-76f8edc07d77 req-ff601737-2704-49e6-8e65-c07614d2f468 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:37.483906 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-529c5216-81e6-4343-b99d-76f8edc07d77 req-ff601737-2704-49e6-8e65-c07614d2f468 service nova] Creating event network-changed:242ba1a6-38e3-4e54-af9f-bb6909e84808 for instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f on n-h2-850468-16 Aug 23 19:00:37.488899 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-529c5216-81e6-4343-b99d-76f8edc07d77 req-ff601737-2704-49e6-8e65-c07614d2f468 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109378 Aug 23 19:00:37.489541 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3880/7629] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:00:38.445327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-95050738-5ea2-4c29-be03-d3201b6cc1c3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:38.445947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-95050738-5ea2-4c29-be03-d3201b6cc1c3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:38.453416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95050738-5ea2-4c29-be03-d3201b6cc1c3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:38.453901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95050738-5ea2-4c29-be03-d3201b6cc1c3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:38.454348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95050738-5ea2-4c29-be03-d3201b6cc1c3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:38.455081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95050738-5ea2-4c29-be03-d3201b6cc1c3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:38.455540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95050738-5ea2-4c29-be03-d3201b6cc1c3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:38.455971 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-95050738-5ea2-4c29-be03-d3201b6cc1c3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:38.583591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-95050738-5ea2-4c29-be03-d3201b6cc1c3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:38.591684 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-95050738-5ea2-4c29-be03-d3201b6cc1c3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1362 microversion: 2.1 time: 0.150119 Aug 23 19:00:38.592303 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3750/7630] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:38 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:39.612426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f180c7a-9194-4b87-a5c9-34e16b3014c5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:39.613155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f180c7a-9194-4b87-a5c9-34e16b3014c5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:39.620255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f180c7a-9194-4b87-a5c9-34e16b3014c5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:39.620752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f180c7a-9194-4b87-a5c9-34e16b3014c5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:39.621204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f180c7a-9194-4b87-a5c9-34e16b3014c5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:39.621917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f180c7a-9194-4b87-a5c9-34e16b3014c5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:39.622385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f180c7a-9194-4b87-a5c9-34e16b3014c5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:39.623360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f180c7a-9194-4b87-a5c9-34e16b3014c5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:39.759994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f180c7a-9194-4b87-a5c9-34e16b3014c5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:39.768244 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f180c7a-9194-4b87-a5c9-34e16b3014c5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1362 microversion: 2.1 time: 0.160156 Aug 23 19:00:39.768820 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3881/7631] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:39 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:40.789332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-74fcc323-121a-42f8-8b87-5e0a58f6784d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:40.789953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-74fcc323-121a-42f8-8b87-5e0a58f6784d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:40.797660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74fcc323-121a-42f8-8b87-5e0a58f6784d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:40.798088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74fcc323-121a-42f8-8b87-5e0a58f6784d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:40.798529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74fcc323-121a-42f8-8b87-5e0a58f6784d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:40.799248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74fcc323-121a-42f8-8b87-5e0a58f6784d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:40.799707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74fcc323-121a-42f8-8b87-5e0a58f6784d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:40.800139 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-74fcc323-121a-42f8-8b87-5e0a58f6784d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:40.928904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-74fcc323-121a-42f8-8b87-5e0a58f6784d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:40.937399 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-74fcc323-121a-42f8-8b87-5e0a58f6784d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1362 microversion: 2.1 time: 0.151975 Aug 23 19:00:40.937980 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3751/7632] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:40 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:41.958610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a66c7b7-e1b5-4e28-a502-7c103e0a3a71 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:41.959312 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8a66c7b7-e1b5-4e28-a502-7c103e0a3a71 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:41.966756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a66c7b7-e1b5-4e28-a502-7c103e0a3a71 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:41.967695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a66c7b7-e1b5-4e28-a502-7c103e0a3a71 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:41.968347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a66c7b7-e1b5-4e28-a502-7c103e0a3a71 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:41.969105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a66c7b7-e1b5-4e28-a502-7c103e0a3a71 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:41.969588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a66c7b7-e1b5-4e28-a502-7c103e0a3a71 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:41.970046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a66c7b7-e1b5-4e28-a502-7c103e0a3a71 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:42.099482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8a66c7b7-e1b5-4e28-a502-7c103e0a3a71 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:42.107990 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8a66c7b7-e1b5-4e28-a502-7c103e0a3a71 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1362 microversion: 2.1 time: 0.152618 Aug 23 19:00:42.108569 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3882/7633] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:41 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:43.129437 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3a043a21-6bc4-466a-9988-62295a3e58b0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:43.130058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3a043a21-6bc4-466a-9988-62295a3e58b0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:43.136884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a043a21-6bc4-466a-9988-62295a3e58b0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:43.137369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a043a21-6bc4-466a-9988-62295a3e58b0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:43.137837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a043a21-6bc4-466a-9988-62295a3e58b0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:43.138660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a043a21-6bc4-466a-9988-62295a3e58b0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:43.139208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a043a21-6bc4-466a-9988-62295a3e58b0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:43.139655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3a043a21-6bc4-466a-9988-62295a3e58b0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:43.277367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3a043a21-6bc4-466a-9988-62295a3e58b0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:43.285602 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3a043a21-6bc4-466a-9988-62295a3e58b0 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1362 microversion: 2.1 time: 0.160081 Aug 23 19:00:43.286173 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3752/7634] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:43 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:44.306595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1c12381d-16d1-450d-b4f2-7afc4ccec38b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:44.307120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1c12381d-16d1-450d-b4f2-7afc4ccec38b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:44.314347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c12381d-16d1-450d-b4f2-7afc4ccec38b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:44.314887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c12381d-16d1-450d-b4f2-7afc4ccec38b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:44.315347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c12381d-16d1-450d-b4f2-7afc4ccec38b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:44.316061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c12381d-16d1-450d-b4f2-7afc4ccec38b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:44.316540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c12381d-16d1-450d-b4f2-7afc4ccec38b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:44.316985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1c12381d-16d1-450d-b4f2-7afc4ccec38b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:44.446065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1c12381d-16d1-450d-b4f2-7afc4ccec38b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:44.454483 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1c12381d-16d1-450d-b4f2-7afc4ccec38b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1362 microversion: 2.1 time: 0.151922 Aug 23 19:00:44.455200 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3883/7635] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:44 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:45.163300 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:45.221186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-1e3d0a63-c252-4ffd-854d-63ab147429dc req-9613a822-0275-49ae-8fa4-c8eda06af36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f416bb7-3ae2-4a58-b60b-fb294d9a403f", "name": "network-vif-plugged", "status": "completed", "tag": "242ba1a6-38e3-4e54-af9f-bb6909e84808"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:00:45.231544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1e3d0a63-c252-4ffd-854d-63ab147429dc req-9613a822-0275-49ae-8fa4-c8eda06af36e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:45.232526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1e3d0a63-c252-4ffd-854d-63ab147429dc req-9613a822-0275-49ae-8fa4-c8eda06af36e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:45.233144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-1e3d0a63-c252-4ffd-854d-63ab147429dc req-9613a822-0275-49ae-8fa4-c8eda06af36e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:45.244516 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-1e3d0a63-c252-4ffd-854d-63ab147429dc req-9613a822-0275-49ae-8fa4-c8eda06af36e service nova] Creating event network-vif-plugged:242ba1a6-38e3-4e54-af9f-bb6909e84808 for instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f on n-h2-850468-16 Aug 23 19:00:45.249976 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-1e3d0a63-c252-4ffd-854d-63ab147429dc req-9613a822-0275-49ae-8fa4-c8eda06af36e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092112 Aug 23 19:00:45.250609 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3753/7636] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:00:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:00:45.477318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7578e661-636a-45ac-bf31-d7ee1885d0ca tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:45.477944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7578e661-636a-45ac-bf31-d7ee1885d0ca tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:45.479975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:45.480847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:45.487927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7578e661-636a-45ac-bf31-d7ee1885d0ca tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:45.488367 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7578e661-636a-45ac-bf31-d7ee1885d0ca tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:45.488817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7578e661-636a-45ac-bf31-d7ee1885d0ca tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:45.489530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7578e661-636a-45ac-bf31-d7ee1885d0ca tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:45.490003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7578e661-636a-45ac-bf31-d7ee1885d0ca tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:45.490446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7578e661-636a-45ac-bf31-d7ee1885d0ca tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:45.623446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7578e661-636a-45ac-bf31-d7ee1885d0ca tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:45.631765 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7578e661-636a-45ac-bf31-d7ee1885d0ca tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1362 microversion: 2.1 time: 0.158296 Aug 23 19:00:45.632349 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3884/7637] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:45 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:46.653199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f4ba548e-7c81-46b8-90ab-3cd6d590f758 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:46.654732 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f4ba548e-7c81-46b8-90ab-3cd6d590f758 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:46.661804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4ba548e-7c81-46b8-90ab-3cd6d590f758 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:46.662295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4ba548e-7c81-46b8-90ab-3cd6d590f758 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:46.662774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4ba548e-7c81-46b8-90ab-3cd6d590f758 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:46.663471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4ba548e-7c81-46b8-90ab-3cd6d590f758 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:46.663929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4ba548e-7c81-46b8-90ab-3cd6d590f758 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:46.664358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f4ba548e-7c81-46b8-90ab-3cd6d590f758 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:46.800383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f4ba548e-7c81-46b8-90ab-3cd6d590f758 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:46.808218 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f4ba548e-7c81-46b8-90ab-3cd6d590f758 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1553 microversion: 2.1 time: 0.159326 Aug 23 19:00:46.808791 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3754/7638] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:46 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:00:46.829079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-65bcfa9d-ef1a-4133-9446-d6180f1cb23e tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:46.829717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-65bcfa9d-ef1a-4133-9446-d6180f1cb23e tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:46.836681 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65bcfa9d-ef1a-4133-9446-d6180f1cb23e tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:46.837183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65bcfa9d-ef1a-4133-9446-d6180f1cb23e tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:46.837643 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65bcfa9d-ef1a-4133-9446-d6180f1cb23e tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:46.838371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65bcfa9d-ef1a-4133-9446-d6180f1cb23e tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:46.838870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65bcfa9d-ef1a-4133-9446-d6180f1cb23e tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:46.839320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-65bcfa9d-ef1a-4133-9446-d6180f1cb23e tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:46.972869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-65bcfa9d-ef1a-4133-9446-d6180f1cb23e tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:00:46.980635 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-65bcfa9d-ef1a-4133-9446-d6180f1cb23e tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1553 microversion: 2.1 time: 0.155460 Aug 23 19:00:46.981214 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3885/7639] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:00:46 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1553 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:00:48.500451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0786fa0e-376d-4643-8f7c-c56f63d578ef tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:00:48.502867 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0786fa0e-376d-4643-8f7c-c56f63d578ef tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:48.509676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0786fa0e-376d-4643-8f7c-c56f63d578ef tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:48.510157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0786fa0e-376d-4643-8f7c-c56f63d578ef tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:48.510619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0786fa0e-376d-4643-8f7c-c56f63d578ef tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:48.511312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0786fa0e-376d-4643-8f7c-c56f63d578ef tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:48.511763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0786fa0e-376d-4643-8f7c-c56f63d578ef tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:48.512270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0786fa0e-376d-4643-8f7c-c56f63d578ef tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:48.758910 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0786fa0e-376d-4643-8f7c-c56f63d578ef tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "POST /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262405 Aug 23 19:00:48.759574 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3755/7640] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 19:00:48 2022] POST /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:00:59.462063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3d0c458-8cdf-4767-94e1-bc6edc56dec4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:59.462641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d3d0c458-8cdf-4767-94e1-bc6edc56dec4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:59.466511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:59.467237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:59.471645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3d0c458-8cdf-4767-94e1-bc6edc56dec4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:59.472154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3d0c458-8cdf-4767-94e1-bc6edc56dec4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:59.472616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3d0c458-8cdf-4767-94e1-bc6edc56dec4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:59.473343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3d0c458-8cdf-4767-94e1-bc6edc56dec4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:59.473820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3d0c458-8cdf-4767-94e1-bc6edc56dec4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:59.474286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3d0c458-8cdf-4767-94e1-bc6edc56dec4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:59.564070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-d3d0c458-8cdf-4767-94e1-bc6edc56dec4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lazy-loading 'services' on Instance uuid 8f416bb7-3ae2-4a58-b60b-fb294d9a403f {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:00:59.646772 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d3d0c458-8cdf-4767-94e1-bc6edc56dec4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments/2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac" status: 202 len: 0 microversion: 2.1 time: 0.188624 Aug 23 19:00:59.647383 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3886/7641] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 19:00:59 2022] DELETE /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments/2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:00:59.653989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:59.655067 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:00:59.659225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-efb07c4a-0830-4ffa-8b6b-675a0a986f02 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:00:59.661660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-efb07c4a-0830-4ffa-8b6b-675a0a986f02 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:00:59.673304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efb07c4a-0830-4ffa-8b6b-675a0a986f02 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:59.674588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efb07c4a-0830-4ffa-8b6b-675a0a986f02 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:59.674588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efb07c4a-0830-4ffa-8b6b-675a0a986f02 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:59.675555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efb07c4a-0830-4ffa-8b6b-675a0a986f02 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:00:59.675679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efb07c4a-0830-4ffa-8b6b-675a0a986f02 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:00:59.676041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-efb07c4a-0830-4ffa-8b6b-675a0a986f02 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:00:59.715245 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-efb07c4a-0830-4ffa-8b6b-675a0a986f02 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063027 Aug 23 19:00:59.716676 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3756/7642] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:00:59 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:00.732549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e5a9b34f-8314-4d7a-b65c-e8fe4bdb0f5b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:00.734983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e5a9b34f-8314-4d7a-b65c-e8fe4bdb0f5b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:00.741393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5a9b34f-8314-4d7a-b65c-e8fe4bdb0f5b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:00.741894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5a9b34f-8314-4d7a-b65c-e8fe4bdb0f5b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:00.742354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5a9b34f-8314-4d7a-b65c-e8fe4bdb0f5b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:00.743107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5a9b34f-8314-4d7a-b65c-e8fe4bdb0f5b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:00.743587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5a9b34f-8314-4d7a-b65c-e8fe4bdb0f5b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:00.744034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e5a9b34f-8314-4d7a-b65c-e8fe4bdb0f5b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:00.778651 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e5a9b34f-8314-4d7a-b65c-e8fe4bdb0f5b tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051186 Aug 23 19:01:00.779150 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3887/7643] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:01:00 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:01.791077 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-13c01684-23eb-420c-aa1b-714f3c961f67 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:01.793548 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-13c01684-23eb-420c-aa1b-714f3c961f67 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:01.802037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13c01684-23eb-420c-aa1b-714f3c961f67 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:01.802557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13c01684-23eb-420c-aa1b-714f3c961f67 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:01.803083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13c01684-23eb-420c-aa1b-714f3c961f67 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:01.803811 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13c01684-23eb-420c-aa1b-714f3c961f67 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:01.804271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13c01684-23eb-420c-aa1b-714f3c961f67 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:01.804733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-13c01684-23eb-420c-aa1b-714f3c961f67 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:01.837003 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-13c01684-23eb-420c-aa1b-714f3c961f67 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049946 Aug 23 19:01:01.837582 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3757/7644] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:01:01 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:02.849837 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3bc13205-07cb-4190-ba6c-0dd761e00759 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:02.852106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3bc13205-07cb-4190-ba6c-0dd761e00759 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:02.859776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bc13205-07cb-4190-ba6c-0dd761e00759 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:02.860272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bc13205-07cb-4190-ba6c-0dd761e00759 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:02.860722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bc13205-07cb-4190-ba6c-0dd761e00759 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:02.861437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bc13205-07cb-4190-ba6c-0dd761e00759 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:02.861899 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bc13205-07cb-4190-ba6c-0dd761e00759 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:02.862336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bc13205-07cb-4190-ba6c-0dd761e00759 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:02.892493 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3bc13205-07cb-4190-ba6c-0dd761e00759 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046854 Aug 23 19:01:02.893070 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3888/7645] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:01:02 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:03.904946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7334033d-31dc-42ac-852b-207867ab8249 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:03.907275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7334033d-31dc-42ac-852b-207867ab8249 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:03.914168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7334033d-31dc-42ac-852b-207867ab8249 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:03.914682 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7334033d-31dc-42ac-852b-207867ab8249 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:03.915127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7334033d-31dc-42ac-852b-207867ab8249 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:03.915830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7334033d-31dc-42ac-852b-207867ab8249 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:03.916297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7334033d-31dc-42ac-852b-207867ab8249 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:03.916728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7334033d-31dc-42ac-852b-207867ab8249 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:03.948660 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7334033d-31dc-42ac-852b-207867ab8249 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047606 Aug 23 19:01:03.949768 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3758/7646] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:01:03 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:04.962305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4c7a10f5-0ca5-4f8d-a956-32ecfa056a00 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:04.964492 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4c7a10f5-0ca5-4f8d-a956-32ecfa056a00 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:04.971808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c7a10f5-0ca5-4f8d-a956-32ecfa056a00 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:04.972303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c7a10f5-0ca5-4f8d-a956-32ecfa056a00 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:04.972760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c7a10f5-0ca5-4f8d-a956-32ecfa056a00 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:04.973470 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c7a10f5-0ca5-4f8d-a956-32ecfa056a00 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:04.973941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c7a10f5-0ca5-4f8d-a956-32ecfa056a00 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:04.974394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4c7a10f5-0ca5-4f8d-a956-32ecfa056a00 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:05.006397 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4c7a10f5-0ca5-4f8d-a956-32ecfa056a00 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048200 Aug 23 19:01:05.006999 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3889/7647] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:01:04 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 19:01:05.018324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93acc06d-afa8-46b7-8293-2b4e6741fdd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:05.018844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-93acc06d-afa8-46b7-8293-2b4e6741fdd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:05.025286 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93acc06d-afa8-46b7-8293-2b4e6741fdd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:05.025767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93acc06d-afa8-46b7-8293-2b4e6741fdd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:05.026201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93acc06d-afa8-46b7-8293-2b4e6741fdd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:05.026923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93acc06d-afa8-46b7-8293-2b4e6741fdd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:05.027376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93acc06d-afa8-46b7-8293-2b4e6741fdd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:05.027801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-93acc06d-afa8-46b7-8293-2b4e6741fdd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:05.108736 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-93acc06d-afa8-46b7-8293-2b4e6741fdd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] HTTP exception thrown: Instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f is not attached to volume 2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93acc06d-afa8-46b7-8293-2b4e6741fdd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Request method failure captured: Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments/2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac HTTP/1.1 Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSOmj61W42CsVevuMqCyMg6qxJF9_oktCpbRJmJHz1rNf0TevlTVMLPZzm1-u6Cpvnhp9pcoxArQTl8iAB_u0VuxZEmcv-QQ67U6fIRgMC7zu6mf2k7TXmHQvEsDILOXxjHgrMiVW1dBAQ6G7k8Kxv2_l9TmS6vgH_cOtJB6MzCz8Vg Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: ac1076498a3b42aea98e3dfc425d0601 Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac1076498a3b42aea98e3dfc425d0601"}]}] Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: ac1076498a3b42aea98e3dfc425d0601 Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestEncryptedCinderVolumes-1816140811-project Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2486d131fa044a3e8b7db76f589c29b4 Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestEncryptedCinderVolumes-1816140811-project Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f is not attached to volume 2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': '8f416bb7-3ae2-4a58-b60b-fb294d9a403f', 'id': '2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac'} Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac. Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f is not attached to volume 2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:01:05.110385 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:01:05.115159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:01:05.115159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:01:05.115159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f is not attached to volume 2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac Aug 23 19:01:05.115159 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:01:05.115159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-93acc06d-afa8-46b7-8293-2b4e6741fdd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Returning 404 to user: Instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f is not attached to volume 2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:01:05.115159 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-93acc06d-afa8-46b7-8293-2b4e6741fdd8 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments/2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac" status: 404 len: 154 microversion: 2.1 time: 0.097604 Aug 23 19:01:05.115159 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3759/7648] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 19:01:05 2022] DELETE /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f/os-volume_attachments/2cc4fa42-d9fc-4400-b787-46b1fc2eb9ac => generated 154 bytes in 100 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:01:08.451045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-05f26015-468a-428f-9eba-61dc9b4aa259 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:08.451608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-05f26015-468a-428f-9eba-61dc9b4aa259 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:08.458575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05f26015-468a-428f-9eba-61dc9b4aa259 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:08.459107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05f26015-468a-428f-9eba-61dc9b4aa259 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:08.459567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05f26015-468a-428f-9eba-61dc9b4aa259 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:08.460292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05f26015-468a-428f-9eba-61dc9b4aa259 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:08.460772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05f26015-468a-428f-9eba-61dc9b4aa259 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:08.461221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-05f26015-468a-428f-9eba-61dc9b4aa259 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:08.489935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-05f26015-468a-428f-9eba-61dc9b4aa259 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:01:08.572142 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-05f26015-468a-428f-9eba-61dc9b4aa259 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 204 len: 0 microversion: 2.1 time: 0.124915 Aug 23 19:01:08.573605 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3890/7649] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:01:08 2022] DELETE /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:01:08.582455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9f1e8e9d-e859-4dff-a6d0-a108477ef242 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:08.583240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9f1e8e9d-e859-4dff-a6d0-a108477ef242 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:08.594092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f1e8e9d-e859-4dff-a6d0-a108477ef242 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:08.594639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f1e8e9d-e859-4dff-a6d0-a108477ef242 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:08.595149 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f1e8e9d-e859-4dff-a6d0-a108477ef242 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:08.595922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f1e8e9d-e859-4dff-a6d0-a108477ef242 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:08.596565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f1e8e9d-e859-4dff-a6d0-a108477ef242 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:08.596996 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f1e8e9d-e859-4dff-a6d0-a108477ef242 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:08.732554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9f1e8e9d-e859-4dff-a6d0-a108477ef242 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:08.740490 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9f1e8e9d-e859-4dff-a6d0-a108477ef242 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1559 microversion: 2.1 time: 0.161941 Aug 23 19:01:08.741064 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3760/7650] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:08 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:09.762036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6e52e34f-8c9b-449c-b501-10c5128a8b01 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:09.762875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6e52e34f-8c9b-449c-b501-10c5128a8b01 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:09.769646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e52e34f-8c9b-449c-b501-10c5128a8b01 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:09.770144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e52e34f-8c9b-449c-b501-10c5128a8b01 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:09.770625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e52e34f-8c9b-449c-b501-10c5128a8b01 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:09.771341 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e52e34f-8c9b-449c-b501-10c5128a8b01 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:09.771807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e52e34f-8c9b-449c-b501-10c5128a8b01 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:09.772243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6e52e34f-8c9b-449c-b501-10c5128a8b01 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:09.908889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6e52e34f-8c9b-449c-b501-10c5128a8b01 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:09.916614 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6e52e34f-8c9b-449c-b501-10c5128a8b01 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1559 microversion: 2.1 time: 0.159040 Aug 23 19:01:09.917184 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3891/7651] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:09 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:10.938481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c4de999c-d2f7-46c5-85a0-c82e9438e0d3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:10.939122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c4de999c-d2f7-46c5-85a0-c82e9438e0d3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:10.946892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4de999c-d2f7-46c5-85a0-c82e9438e0d3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:10.947386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4de999c-d2f7-46c5-85a0-c82e9438e0d3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:10.947876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4de999c-d2f7-46c5-85a0-c82e9438e0d3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:10.948588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4de999c-d2f7-46c5-85a0-c82e9438e0d3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:10.949072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4de999c-d2f7-46c5-85a0-c82e9438e0d3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:10.949735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c4de999c-d2f7-46c5-85a0-c82e9438e0d3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:10.971253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5ca35ba5-32db-428b-a145-ed501e3912f2 req-ab5afeb9-f531-4d05-8156-4f0a4e94f89a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f416bb7-3ae2-4a58-b60b-fb294d9a403f", "name": "network-vif-deleted", "tag": "242ba1a6-38e3-4e54-af9f-bb6909e84808"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:01:10.987601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5ca35ba5-32db-428b-a145-ed501e3912f2 req-ab5afeb9-f531-4d05-8156-4f0a4e94f89a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:10.989979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5ca35ba5-32db-428b-a145-ed501e3912f2 req-ab5afeb9-f531-4d05-8156-4f0a4e94f89a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:10.990690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5ca35ba5-32db-428b-a145-ed501e3912f2 req-ab5afeb9-f531-4d05-8156-4f0a4e94f89a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:11.009399 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5ca35ba5-32db-428b-a145-ed501e3912f2 req-ab5afeb9-f531-4d05-8156-4f0a4e94f89a service nova] Creating event network-vif-deleted:242ba1a6-38e3-4e54-af9f-bb6909e84808 for instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f on n-h2-850468-16 Aug 23 19:01:11.017856 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5ca35ba5-32db-428b-a145-ed501e3912f2 req-ab5afeb9-f531-4d05-8156-4f0a4e94f89a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050924 Aug 23 19:01:11.019505 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3892/7652] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:01:11.044195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c4de999c-d2f7-46c5-85a0-c82e9438e0d3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:11.052461 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c4de999c-d2f7-46c5-85a0-c82e9438e0d3 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 200 len: 1517 microversion: 2.1 time: 0.118351 Aug 23 19:01:11.053062 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3761/7653] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:10 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 1517 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:12.075941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1e4917d2-0e97-49b2-9a46-2b9871a299aa tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:12.076654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1e4917d2-0e97-49b2-9a46-2b9871a299aa tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 8f416bb7-3ae2-4a58-b60b-fb294d9a403f] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:12.083925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e4917d2-0e97-49b2-9a46-2b9871a299aa tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:12.084439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e4917d2-0e97-49b2-9a46-2b9871a299aa tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:12.084902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e4917d2-0e97-49b2-9a46-2b9871a299aa tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:12.085640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e4917d2-0e97-49b2-9a46-2b9871a299aa tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:12.086116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e4917d2-0e97-49b2-9a46-2b9871a299aa tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:12.086587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e4917d2-0e97-49b2-9a46-2b9871a299aa tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:12.101961 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-1e4917d2-0e97-49b2-9a46-2b9871a299aa tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] HTTP exception thrown: Instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f could not be found. Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1e4917d2-0e97-49b2-9a46-2b9871a299aa tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Request method failure captured: Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f HTTP/1.1 Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSOmj61W42CsVevuMqCyMg6qxJF9_oktCpbRJmJHz1rNf0TevlTVMLPZzm1-u6Cpvnhp9pcoxArQTl8iAB_u0VuxZEmcv-QQ67U6fIRgMC7zu6mf2k7TXmHQvEsDILOXxjHgrMiVW1dBAQ6G7k8Kxv2_l9TmS6vgH_cOtJB6MzCz8Vg Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ac1076498a3b42aea98e3dfc425d0601 Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac1076498a3b42aea98e3dfc425d0601"}]}] Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ac1076498a3b42aea98e3dfc425d0601 Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestEncryptedCinderVolumes-1816140811-project Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2486d131fa044a3e8b7db76f589c29b4 Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestEncryptedCinderVolumes-1816140811-project Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f could not be found. Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '8f416bb7-3ae2-4a58-b60b-fb294d9a403f'} Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f could not be found. Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f could not be found. Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:12.103689 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:01:12.108982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:12.108982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:01:12.108982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:01:12.108982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:01:12.108982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:01:12.108982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:01:12.108982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f could not be found. Aug 23 19:01:12.108982 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:12.108982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1e4917d2-0e97-49b2-9a46-2b9871a299aa tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Returning 404 to user: Instance 8f416bb7-3ae2-4a58-b60b-fb294d9a403f could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:01:12.108982 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1e4917d2-0e97-49b2-9a46-2b9871a299aa tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f" status: 404 len: 111 microversion: 2.1 time: 0.034192 Aug 23 19:01:12.108982 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3893/7654] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:12 2022] GET /compute/v2.1/servers/8f416bb7-3ae2-4a58-b60b-fb294d9a403f => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:01:12.114090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3d6bd93b-05a3-4a0d-8db3-92de5388069a tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '.version_select at 0x7f27df9c3ca0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:12.134429 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3d6bd93b-05a3-4a0d-8db3-92de5388069a tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1605648350" status: 202 len: 0 microversion: 2.1 time: 0.024226 Aug 23 19:01:12.135123 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3762/7655] 10.222.0.61 () {58 vars in 1278 bytes} [Tue Aug 23 19:01:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1605648350 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:01:12.154385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e3e3a66e-e3d1-4970-9265-f84c353a2310 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Action: 'create', calling method: .version_select at 0x7f27df662b80>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1325482700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBISA6K4q8td+r6XjK7tP1PGppiiKLMNhYO9+XBQkFfRDUuaBHXiahX9UJSFyxo+x/NDyUU2mCicbneSdHLtqpkr27iIMIVWrr1bhWssirrjx3QECmcvCCO/SlQcWHJNrqg=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:01:12.169782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-e3e3a66e-e3d1-4970-9265-f84c353a2310 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Getting quotas for project ac1076498a3b42aea98e3dfc425d0601. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:01:12.178991 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-e3e3a66e-e3d1-4970-9265-f84c353a2310 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Getting quotas for user 2486d131fa044a3e8b7db76f589c29b4 and project ac1076498a3b42aea98e3dfc425d0601. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:01:12.202331 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e3e3a66e-e3d1-4970-9265-f84c353a2310 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.052918 Aug 23 19:01:12.202982 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3894/7656] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 19:01:12 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:12.254298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1462975058", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1325482700", "networks": [{"uuid": "46e28cab-3ae6-4155-8e47-f74a01643583"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:01:12.307435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] validate_networks() for [('46e28cab-3ae6-4155-8e47-f74a01643583', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:01:12.732813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:01:12.733242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:01:12.733718 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:01:12.734127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:01:12.734556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:01:12.743357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:12.743835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:12.744266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:12.744993 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:12.745444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:12.745869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:12.764055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Getting quotas for project ac1076498a3b42aea98e3dfc425d0601. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:01:12.769316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Getting quotas for user 2486d131fa044a3e8b7db76f589c29b4 and project ac1076498a3b42aea98e3dfc425d0601. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:01:12.782232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:01:12.784578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:01:12.832124 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1208ebbe-e8f8-44ba-8225-57cb31776470 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581637 Aug 23 19:01:12.832805 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3763/7657] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:01:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:01:12.843973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3e73d201-aa2d-426b-8fe3-5092357abb2d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:12.844602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3e73d201-aa2d-426b-8fe3-5092357abb2d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:12.900331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e73d201-aa2d-426b-8fe3-5092357abb2d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:12.907518 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3e73d201-aa2d-426b-8fe3-5092357abb2d tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1263 microversion: 2.1 time: 0.067970 Aug 23 19:01:12.908188 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3895/7658] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:12 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1263 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:13.932705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a99a76b-5956-4efb-ad20-c5670396d5f4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:13.933708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a99a76b-5956-4efb-ad20-c5670396d5f4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:13.943110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a99a76b-5956-4efb-ad20-c5670396d5f4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:13.943891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a99a76b-5956-4efb-ad20-c5670396d5f4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:13.944857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a99a76b-5956-4efb-ad20-c5670396d5f4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:13.945744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a99a76b-5956-4efb-ad20-c5670396d5f4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:13.946364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a99a76b-5956-4efb-ad20-c5670396d5f4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:13.946981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a99a76b-5956-4efb-ad20-c5670396d5f4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:14.040473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a99a76b-5956-4efb-ad20-c5670396d5f4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:14.051067 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a99a76b-5956-4efb-ad20-c5670396d5f4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1323 microversion: 2.1 time: 0.125748 Aug 23 19:01:14.051972 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3764/7659] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:13 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1323 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:15.072481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1d4f08fd-8ee6-4bf7-ac66-b90f404446ad tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:15.073124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1d4f08fd-8ee6-4bf7-ac66-b90f404446ad tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:15.080024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d4f08fd-8ee6-4bf7-ac66-b90f404446ad tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:15.080538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d4f08fd-8ee6-4bf7-ac66-b90f404446ad tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:15.081006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d4f08fd-8ee6-4bf7-ac66-b90f404446ad tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:15.081736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d4f08fd-8ee6-4bf7-ac66-b90f404446ad tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:15.082218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d4f08fd-8ee6-4bf7-ac66-b90f404446ad tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:15.082695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1d4f08fd-8ee6-4bf7-ac66-b90f404446ad tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:15.222937 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1d4f08fd-8ee6-4bf7-ac66-b90f404446ad tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:15.230357 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1d4f08fd-8ee6-4bf7-ac66-b90f404446ad tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1363 microversion: 2.1 time: 0.161741 Aug 23 19:01:15.230989 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3896/7660] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:15 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:15.308109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4c995330-f8d7-4866-9ba5-de207a30c7b4 req-0b1116b6-6c90-46ee-b1d4-fc360db6e54c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cfe0658-a036-4106-9266-0ed29578e1b7", "tag": "0d4a37bf-f933-4dcd-a7a6-fb95c48b0d13"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:01:15.320692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4c995330-f8d7-4866-9ba5-de207a30c7b4 req-0b1116b6-6c90-46ee-b1d4-fc360db6e54c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:15.321312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4c995330-f8d7-4866-9ba5-de207a30c7b4 req-0b1116b6-6c90-46ee-b1d4-fc360db6e54c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:15.322235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4c995330-f8d7-4866-9ba5-de207a30c7b4 req-0b1116b6-6c90-46ee-b1d4-fc360db6e54c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:15.336197 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4c995330-f8d7-4866-9ba5-de207a30c7b4 req-0b1116b6-6c90-46ee-b1d4-fc360db6e54c service nova] Creating event network-changed:0d4a37bf-f933-4dcd-a7a6-fb95c48b0d13 for instance 3cfe0658-a036-4106-9266-0ed29578e1b7 on n-h1-850468-16 Aug 23 19:01:15.342453 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4c995330-f8d7-4866-9ba5-de207a30c7b4 req-0b1116b6-6c90-46ee-b1d4-fc360db6e54c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038140 Aug 23 19:01:15.343115 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3765/7661] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:01:16.253822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-92271ee3-61ef-4f70-97bc-0344936aef04 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:16.254485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-92271ee3-61ef-4f70-97bc-0344936aef04 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:16.261483 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92271ee3-61ef-4f70-97bc-0344936aef04 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:16.262002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92271ee3-61ef-4f70-97bc-0344936aef04 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:16.263118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92271ee3-61ef-4f70-97bc-0344936aef04 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:16.263842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92271ee3-61ef-4f70-97bc-0344936aef04 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:16.264315 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92271ee3-61ef-4f70-97bc-0344936aef04 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:16.264778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-92271ee3-61ef-4f70-97bc-0344936aef04 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:16.408562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-92271ee3-61ef-4f70-97bc-0344936aef04 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:16.416909 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-92271ee3-61ef-4f70-97bc-0344936aef04 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1363 microversion: 2.1 time: 0.167171 Aug 23 19:01:16.417583 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3897/7662] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:16 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:17.440943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3bc63fb3-31c9-48fa-8bad-0c64731a9345 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:17.441781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3bc63fb3-31c9-48fa-8bad-0c64731a9345 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:17.447966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bc63fb3-31c9-48fa-8bad-0c64731a9345 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:17.448441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bc63fb3-31c9-48fa-8bad-0c64731a9345 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:17.448874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bc63fb3-31c9-48fa-8bad-0c64731a9345 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:17.449560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bc63fb3-31c9-48fa-8bad-0c64731a9345 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:17.450499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bc63fb3-31c9-48fa-8bad-0c64731a9345 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:17.450953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3bc63fb3-31c9-48fa-8bad-0c64731a9345 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:17.585122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3bc63fb3-31c9-48fa-8bad-0c64731a9345 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:17.593450 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3bc63fb3-31c9-48fa-8bad-0c64731a9345 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1363 microversion: 2.1 time: 0.157627 Aug 23 19:01:17.594128 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3766/7663] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:17 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:18.614826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e02efd9a-98ec-49df-9e91-b2563d908dd7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:18.615462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e02efd9a-98ec-49df-9e91-b2563d908dd7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:18.623272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e02efd9a-98ec-49df-9e91-b2563d908dd7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:18.623704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e02efd9a-98ec-49df-9e91-b2563d908dd7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:18.624157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e02efd9a-98ec-49df-9e91-b2563d908dd7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:18.624995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e02efd9a-98ec-49df-9e91-b2563d908dd7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:18.625527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e02efd9a-98ec-49df-9e91-b2563d908dd7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:18.625994 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e02efd9a-98ec-49df-9e91-b2563d908dd7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:18.758617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e02efd9a-98ec-49df-9e91-b2563d908dd7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:18.767185 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e02efd9a-98ec-49df-9e91-b2563d908dd7 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1363 microversion: 2.1 time: 0.156487 Aug 23 19:01:18.767810 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3898/7664] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:18 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:19.789595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd4ddbb1-122e-486d-b9fb-1b7f1aa0d23a tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:19.790206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd4ddbb1-122e-486d-b9fb-1b7f1aa0d23a tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:19.797226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd4ddbb1-122e-486d-b9fb-1b7f1aa0d23a tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:19.797715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd4ddbb1-122e-486d-b9fb-1b7f1aa0d23a tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:19.798153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd4ddbb1-122e-486d-b9fb-1b7f1aa0d23a tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:19.798873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd4ddbb1-122e-486d-b9fb-1b7f1aa0d23a tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:19.799330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd4ddbb1-122e-486d-b9fb-1b7f1aa0d23a tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:19.799758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd4ddbb1-122e-486d-b9fb-1b7f1aa0d23a tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:19.935297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bd4ddbb1-122e-486d-b9fb-1b7f1aa0d23a tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:19.943616 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd4ddbb1-122e-486d-b9fb-1b7f1aa0d23a tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1363 microversion: 2.1 time: 0.157952 Aug 23 19:01:19.944207 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3767/7665] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:19 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:20.964421 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4912efcf-c4c7-4f8a-905f-a7e420702778 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:20.965754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4912efcf-c4c7-4f8a-905f-a7e420702778 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:20.972711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4912efcf-c4c7-4f8a-905f-a7e420702778 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:20.973214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4912efcf-c4c7-4f8a-905f-a7e420702778 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:20.973674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4912efcf-c4c7-4f8a-905f-a7e420702778 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:20.974396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4912efcf-c4c7-4f8a-905f-a7e420702778 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:20.974901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4912efcf-c4c7-4f8a-905f-a7e420702778 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:20.975351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4912efcf-c4c7-4f8a-905f-a7e420702778 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:21.113714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4912efcf-c4c7-4f8a-905f-a7e420702778 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:21.121484 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4912efcf-c4c7-4f8a-905f-a7e420702778 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1363 microversion: 2.1 time: 0.161126 Aug 23 19:01:21.122060 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3899/7666] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:20 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:21.944312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-5361e282-478a-4f3a-a492-4a5c2707cffd req-45baa5ff-f30d-465a-969a-52facc8a2043 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cfe0658-a036-4106-9266-0ed29578e1b7", "name": "network-vif-plugged", "status": "completed", "tag": "0d4a37bf-f933-4dcd-a7a6-fb95c48b0d13"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:01:21.955512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5361e282-478a-4f3a-a492-4a5c2707cffd req-45baa5ff-f30d-465a-969a-52facc8a2043 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:21.956053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5361e282-478a-4f3a-a492-4a5c2707cffd req-45baa5ff-f30d-465a-969a-52facc8a2043 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:21.956433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-5361e282-478a-4f3a-a492-4a5c2707cffd req-45baa5ff-f30d-465a-969a-52facc8a2043 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:21.968909 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-5361e282-478a-4f3a-a492-4a5c2707cffd req-45baa5ff-f30d-465a-969a-52facc8a2043 service nova] Creating event network-vif-plugged:0d4a37bf-f933-4dcd-a7a6-fb95c48b0d13 for instance 3cfe0658-a036-4106-9266-0ed29578e1b7 on n-h1-850468-16 Aug 23 19:01:21.974046 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-5361e282-478a-4f3a-a492-4a5c2707cffd req-45baa5ff-f30d-465a-969a-52facc8a2043 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033899 Aug 23 19:01:21.974668 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3768/7667] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:01:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:22.142137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4a4f076e-5b09-4424-a544-e2c5f5ce8399 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:22.142797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4a4f076e-5b09-4424-a544-e2c5f5ce8399 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:22.149838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a4f076e-5b09-4424-a544-e2c5f5ce8399 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:22.150343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a4f076e-5b09-4424-a544-e2c5f5ce8399 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:22.150834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a4f076e-5b09-4424-a544-e2c5f5ce8399 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:22.151564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a4f076e-5b09-4424-a544-e2c5f5ce8399 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:22.152039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a4f076e-5b09-4424-a544-e2c5f5ce8399 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:22.152490 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4a4f076e-5b09-4424-a544-e2c5f5ce8399 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:22.284718 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4a4f076e-5b09-4424-a544-e2c5f5ce8399 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:22.292712 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4a4f076e-5b09-4424-a544-e2c5f5ce8399 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1363 microversion: 2.1 time: 0.154672 Aug 23 19:01:22.293371 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3900/7668] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:22 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:23.314677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cec14037-21f4-4876-af51-0e8d35d6fd90 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:23.315393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cec14037-21f4-4876-af51-0e8d35d6fd90 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:23.317365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:01:23.318033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:01:23.325631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cec14037-21f4-4876-af51-0e8d35d6fd90 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:23.326222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cec14037-21f4-4876-af51-0e8d35d6fd90 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:23.326699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cec14037-21f4-4876-af51-0e8d35d6fd90 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:23.327417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cec14037-21f4-4876-af51-0e8d35d6fd90 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:23.327881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cec14037-21f4-4876-af51-0e8d35d6fd90 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:23.328314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cec14037-21f4-4876-af51-0e8d35d6fd90 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:23.467369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cec14037-21f4-4876-af51-0e8d35d6fd90 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:23.475140 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cec14037-21f4-4876-af51-0e8d35d6fd90 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1363 microversion: 2.1 time: 0.164880 Aug 23 19:01:23.475932 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3769/7669] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:23 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:24.497052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fb667f60-918a-4376-ba40-a1a418b5bee4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:24.497971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fb667f60-918a-4376-ba40-a1a418b5bee4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:24.499848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:01:24.505628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb667f60-918a-4376-ba40-a1a418b5bee4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:24.506125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb667f60-918a-4376-ba40-a1a418b5bee4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:24.506600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb667f60-918a-4376-ba40-a1a418b5bee4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:24.507308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb667f60-918a-4376-ba40-a1a418b5bee4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:24.507774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb667f60-918a-4376-ba40-a1a418b5bee4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:24.508212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fb667f60-918a-4376-ba40-a1a418b5bee4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:24.642873 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fb667f60-918a-4376-ba40-a1a418b5bee4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:24.650848 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fb667f60-918a-4376-ba40-a1a418b5bee4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1554 microversion: 2.1 time: 0.158243 Aug 23 19:01:24.651425 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3901/7670] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:24 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:24.671776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c70e515-7244-4b43-aac9-15639462d73c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:24.672394 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c70e515-7244-4b43-aac9-15639462d73c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:24.679259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c70e515-7244-4b43-aac9-15639462d73c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:24.679752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c70e515-7244-4b43-aac9-15639462d73c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:24.680201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c70e515-7244-4b43-aac9-15639462d73c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:24.680887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c70e515-7244-4b43-aac9-15639462d73c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:24.681343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c70e515-7244-4b43-aac9-15639462d73c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:24.681771 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c70e515-7244-4b43-aac9-15639462d73c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:24.812402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4c70e515-7244-4b43-aac9-15639462d73c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:24.820256 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c70e515-7244-4b43-aac9-15639462d73c tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1554 microversion: 2.1 time: 0.152429 Aug 23 19:01:24.820829 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3770/7671] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:24 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:26.305947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b38d0bce-c9d4-47ba-8bae-a19458639bee tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6023db19-1401-4b96-8bb3-3c3d7d038559"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:01:26.308333 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b38d0bce-c9d4-47ba-8bae-a19458639bee tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:26.315758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b38d0bce-c9d4-47ba-8bae-a19458639bee tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:26.316258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b38d0bce-c9d4-47ba-8bae-a19458639bee tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:26.316720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b38d0bce-c9d4-47ba-8bae-a19458639bee tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:26.317433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b38d0bce-c9d4-47ba-8bae-a19458639bee tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:26.317907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b38d0bce-c9d4-47ba-8bae-a19458639bee tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:26.318349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b38d0bce-c9d4-47ba-8bae-a19458639bee tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:26.538345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:01:26.561327 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b38d0bce-c9d4-47ba-8bae-a19458639bee tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "POST /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.259214 Aug 23 19:01:26.562722 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3902/7672] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 19:01:26 2022] POST /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments => generated 194 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:37.269702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e5ade9b1-2b4e-41ad-aa6d-8a3f4e4a0feb tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:37.270318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e5ade9b1-2b4e-41ad-aa6d-8a3f4e4a0feb tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:37.272528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:01:37.273324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=72 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:01:37.278822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5ade9b1-2b4e-41ad-aa6d-8a3f4e4a0feb tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:37.279303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5ade9b1-2b4e-41ad-aa6d-8a3f4e4a0feb tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:37.279734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5ade9b1-2b4e-41ad-aa6d-8a3f4e4a0feb tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:37.280423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5ade9b1-2b4e-41ad-aa6d-8a3f4e4a0feb tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:37.280872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5ade9b1-2b4e-41ad-aa6d-8a3f4e4a0feb tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:37.281294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e5ade9b1-2b4e-41ad-aa6d-8a3f4e4a0feb tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:37.367487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-e5ade9b1-2b4e-41ad-aa6d-8a3f4e4a0feb tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lazy-loading 'services' on Instance uuid 3cfe0658-a036-4106-9266-0ed29578e1b7 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:01:37.438407 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e5ade9b1-2b4e-41ad-aa6d-8a3f4e4a0feb tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments/6023db19-1401-4b96-8bb3-3c3d7d038559" status: 202 len: 0 microversion: 2.1 time: 0.172512 Aug 23 19:01:37.442750 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3771/7673] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 19:01:37 2022] DELETE /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments/6023db19-1401-4b96-8bb3-3c3d7d038559 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:01:37.446808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:01:37.447592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:01:37.452417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c89dafd7-8151-49d1-9838-985bf7e7d586 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:37.455931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c89dafd7-8151-49d1-9838-985bf7e7d586 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:37.466656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c89dafd7-8151-49d1-9838-985bf7e7d586 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:37.467087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c89dafd7-8151-49d1-9838-985bf7e7d586 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:37.467544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c89dafd7-8151-49d1-9838-985bf7e7d586 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:37.468267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c89dafd7-8151-49d1-9838-985bf7e7d586 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:37.468738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c89dafd7-8151-49d1-9838-985bf7e7d586 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:37.469472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c89dafd7-8151-49d1-9838-985bf7e7d586 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:37.503746 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c89dafd7-8151-49d1-9838-985bf7e7d586 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058920 Aug 23 19:01:37.504311 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3903/7674] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:01:37 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:38.519069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3eb97315-b2c9-47c1-96be-de045b019539 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:38.521534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3eb97315-b2c9-47c1-96be-de045b019539 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:38.527910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3eb97315-b2c9-47c1-96be-de045b019539 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:38.528455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3eb97315-b2c9-47c1-96be-de045b019539 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:38.528959 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3eb97315-b2c9-47c1-96be-de045b019539 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:38.529715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3eb97315-b2c9-47c1-96be-de045b019539 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:38.530167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3eb97315-b2c9-47c1-96be-de045b019539 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:38.530609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3eb97315-b2c9-47c1-96be-de045b019539 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:38.561952 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3eb97315-b2c9-47c1-96be-de045b019539 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048914 Aug 23 19:01:38.562554 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3772/7675] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:01:38 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:39.573648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f07d089e-9ae7-4f9a-bfe1-a05ad4c4fb74 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:39.576139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f07d089e-9ae7-4f9a-bfe1-a05ad4c4fb74 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:39.583954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f07d089e-9ae7-4f9a-bfe1-a05ad4c4fb74 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:39.584545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f07d089e-9ae7-4f9a-bfe1-a05ad4c4fb74 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:39.584982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f07d089e-9ae7-4f9a-bfe1-a05ad4c4fb74 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:39.585773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f07d089e-9ae7-4f9a-bfe1-a05ad4c4fb74 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:39.586300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f07d089e-9ae7-4f9a-bfe1-a05ad4c4fb74 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:39.586857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f07d089e-9ae7-4f9a-bfe1-a05ad4c4fb74 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:39.622267 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f07d089e-9ae7-4f9a-bfe1-a05ad4c4fb74 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052593 Aug 23 19:01:39.623100 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3904/7676] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:01:39 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:40.635340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4d8d3eb8-c062-4842-a37d-08931d603995 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:40.637609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4d8d3eb8-c062-4842-a37d-08931d603995 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:40.644731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d8d3eb8-c062-4842-a37d-08931d603995 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:40.645295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d8d3eb8-c062-4842-a37d-08931d603995 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:40.645805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d8d3eb8-c062-4842-a37d-08931d603995 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:40.646611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d8d3eb8-c062-4842-a37d-08931d603995 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:40.647072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d8d3eb8-c062-4842-a37d-08931d603995 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:40.647503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4d8d3eb8-c062-4842-a37d-08931d603995 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:40.677901 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4d8d3eb8-c062-4842-a37d-08931d603995 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047284 Aug 23 19:01:40.678473 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3773/7677] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:01:40 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:41.690034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d97be840-19d7-4603-bc76-f24a707f4e26 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:41.692484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d97be840-19d7-4603-bc76-f24a707f4e26 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:41.699926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d97be840-19d7-4603-bc76-f24a707f4e26 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:41.700439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d97be840-19d7-4603-bc76-f24a707f4e26 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:41.700942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d97be840-19d7-4603-bc76-f24a707f4e26 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:41.701666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d97be840-19d7-4603-bc76-f24a707f4e26 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:41.702144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d97be840-19d7-4603-bc76-f24a707f4e26 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:41.702615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d97be840-19d7-4603-bc76-f24a707f4e26 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:41.733938 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d97be840-19d7-4603-bc76-f24a707f4e26 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048365 Aug 23 19:01:41.734433 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3905/7678] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:01:41 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:42.745487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4ae5d200-ad48-4d26-be42-46fd9f990420 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:42.747820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4ae5d200-ad48-4d26-be42-46fd9f990420 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:42.755686 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ae5d200-ad48-4d26-be42-46fd9f990420 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:42.756168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ae5d200-ad48-4d26-be42-46fd9f990420 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:42.756609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ae5d200-ad48-4d26-be42-46fd9f990420 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:42.757308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ae5d200-ad48-4d26-be42-46fd9f990420 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:42.757764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ae5d200-ad48-4d26-be42-46fd9f990420 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:42.758193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ae5d200-ad48-4d26-be42-46fd9f990420 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:42.787165 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4ae5d200-ad48-4d26-be42-46fd9f990420 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045749 Aug 23 19:01:42.787735 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3774/7679] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:01:42 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 19:01:42.799624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0982062c-b141-4b12-9ae1-a082406b1534 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:42.800128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0982062c-b141-4b12-9ae1-a082406b1534 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:42.806901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0982062c-b141-4b12-9ae1-a082406b1534 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:42.807393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0982062c-b141-4b12-9ae1-a082406b1534 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:42.807840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0982062c-b141-4b12-9ae1-a082406b1534 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:42.808543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0982062c-b141-4b12-9ae1-a082406b1534 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:42.809013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0982062c-b141-4b12-9ae1-a082406b1534 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:42.809449 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0982062c-b141-4b12-9ae1-a082406b1534 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:42.892327 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-0982062c-b141-4b12-9ae1-a082406b1534 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] HTTP exception thrown: Instance 3cfe0658-a036-4106-9266-0ed29578e1b7 is not attached to volume 6023db19-1401-4b96-8bb3-3c3d7d038559 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0982062c-b141-4b12-9ae1-a082406b1534 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Request method failure captured: Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments/6023db19-1401-4b96-8bb3-3c3d7d038559 HTTP/1.1 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSOmj61W42CsVevuMqCyMg6qxJF9_oktCpbRJmJHz1rNf0TevlTVMLPZzm1-u6Cpvnhp9pcoxArQTl8iAB_u0VuxZEmcv-QQ67U6fIRgMC7zu6mf2k7TXmHQvEsDILOXxjHgrMiVW1dBAQ6G7k8Kxv2_l9TmS6vgH_cOtJB6MzCz8Vg Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ac1076498a3b42aea98e3dfc425d0601 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac1076498a3b42aea98e3dfc425d0601"}]}] Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ac1076498a3b42aea98e3dfc425d0601 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestEncryptedCinderVolumes-1816140811-project Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2486d131fa044a3e8b7db76f589c29b4 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestEncryptedCinderVolumes-1816140811-project Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 3cfe0658-a036-4106-9266-0ed29578e1b7 is not attached to volume 6023db19-1401-4b96-8bb3-3c3d7d038559 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'server_id': '3cfe0658-a036-4106-9266-0ed29578e1b7', 'id': '6023db19-1401-4b96-8bb3-3c3d7d038559'} Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 6023db19-1401-4b96-8bb3-3c3d7d038559. Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cfe0658-a036-4106-9266-0ed29578e1b7 is not attached to volume 6023db19-1401-4b96-8bb3-3c3d7d038559 Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:01:42.894237 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:01:42.899031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:01:42.899031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:01:42.899031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cfe0658-a036-4106-9266-0ed29578e1b7 is not attached to volume 6023db19-1401-4b96-8bb3-3c3d7d038559 Aug 23 19:01:42.899031 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:42.899031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0982062c-b141-4b12-9ae1-a082406b1534 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Returning 404 to user: Instance 3cfe0658-a036-4106-9266-0ed29578e1b7 is not attached to volume 6023db19-1401-4b96-8bb3-3c3d7d038559 {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:01:42.899031 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0982062c-b141-4b12-9ae1-a082406b1534 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments/6023db19-1401-4b96-8bb3-3c3d7d038559" status: 404 len: 154 microversion: 2.1 time: 0.101471 Aug 23 19:01:42.899031 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3906/7680] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 19:01:42 2022] DELETE /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7/os-volume_attachments/6023db19-1401-4b96-8bb3-3c3d7d038559 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:01:46.237449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e10286ef-2ba2-4c50-a53c-eccc1272e7b4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:46.238039 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e10286ef-2ba2-4c50-a53c-eccc1272e7b4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:46.245197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e10286ef-2ba2-4c50-a53c-eccc1272e7b4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:46.245695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e10286ef-2ba2-4c50-a53c-eccc1272e7b4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:46.246145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e10286ef-2ba2-4c50-a53c-eccc1272e7b4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:46.246898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e10286ef-2ba2-4c50-a53c-eccc1272e7b4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:46.247366 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e10286ef-2ba2-4c50-a53c-eccc1272e7b4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:46.247801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e10286ef-2ba2-4c50-a53c-eccc1272e7b4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:46.278467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e10286ef-2ba2-4c50-a53c-eccc1272e7b4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:01:46.362268 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e10286ef-2ba2-4c50-a53c-eccc1272e7b4 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "DELETE /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 204 len: 0 microversion: 2.1 time: 0.128551 Aug 23 19:01:46.363017 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3775/7681] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:01:46 2022] DELETE /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:01:46.371320 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e4243a15-d238-4acd-b8d8-22d9207c41dc tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:46.372191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e4243a15-d238-4acd-b8d8-22d9207c41dc tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:46.380258 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4243a15-d238-4acd-b8d8-22d9207c41dc tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:46.380753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4243a15-d238-4acd-b8d8-22d9207c41dc tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:46.381204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4243a15-d238-4acd-b8d8-22d9207c41dc tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:46.381919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4243a15-d238-4acd-b8d8-22d9207c41dc tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:46.382531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4243a15-d238-4acd-b8d8-22d9207c41dc tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:46.382995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e4243a15-d238-4acd-b8d8-22d9207c41dc tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:46.527046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e4243a15-d238-4acd-b8d8-22d9207c41dc tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:46.538197 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e4243a15-d238-4acd-b8d8-22d9207c41dc tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1560 microversion: 2.1 time: 0.170693 Aug 23 19:01:46.538833 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3907/7682] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:46 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:47.561089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fb405915-3c19-4b39-ac1b-3b7f617a07b5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:47.561713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fb405915-3c19-4b39-ac1b-3b7f617a07b5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:47.568863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb405915-3c19-4b39-ac1b-3b7f617a07b5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:47.569350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb405915-3c19-4b39-ac1b-3b7f617a07b5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:47.569786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb405915-3c19-4b39-ac1b-3b7f617a07b5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:47.570481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb405915-3c19-4b39-ac1b-3b7f617a07b5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:47.570960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb405915-3c19-4b39-ac1b-3b7f617a07b5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:47.571383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fb405915-3c19-4b39-ac1b-3b7f617a07b5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:47.706763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fb405915-3c19-4b39-ac1b-3b7f617a07b5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:47.714503 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fb405915-3c19-4b39-ac1b-3b7f617a07b5 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1560 microversion: 2.1 time: 0.158319 Aug 23 19:01:47.715363 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3776/7683] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:47 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:48.683130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5a69abb6-2874-496f-aa4e-c97db8208c74 req-aef5357b-9d78-46bb-a481-284017470477 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cfe0658-a036-4106-9266-0ed29578e1b7", "name": "network-vif-deleted", "tag": "0d4a37bf-f933-4dcd-a7a6-fb95c48b0d13"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:01:48.696295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5a69abb6-2874-496f-aa4e-c97db8208c74 req-aef5357b-9d78-46bb-a481-284017470477 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:48.696798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5a69abb6-2874-496f-aa4e-c97db8208c74 req-aef5357b-9d78-46bb-a481-284017470477 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:48.697923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5a69abb6-2874-496f-aa4e-c97db8208c74 req-aef5357b-9d78-46bb-a481-284017470477 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:48.712560 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5a69abb6-2874-496f-aa4e-c97db8208c74 req-aef5357b-9d78-46bb-a481-284017470477 service nova] Creating event network-vif-deleted:0d4a37bf-f933-4dcd-a7a6-fb95c48b0d13 for instance 3cfe0658-a036-4106-9266-0ed29578e1b7 on n-h1-850468-16 Aug 23 19:01:48.717925 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5a69abb6-2874-496f-aa4e-c97db8208c74 req-aef5357b-9d78-46bb-a481-284017470477 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038509 Aug 23 19:01:48.721762 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3908/7684] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:01:48.739140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25c5253b-ad20-4907-8f93-d6ae914b7212 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:48.740445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-25c5253b-ad20-4907-8f93-d6ae914b7212 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:48.748529 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25c5253b-ad20-4907-8f93-d6ae914b7212 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:48.749055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25c5253b-ad20-4907-8f93-d6ae914b7212 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:48.749677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25c5253b-ad20-4907-8f93-d6ae914b7212 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:48.751665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25c5253b-ad20-4907-8f93-d6ae914b7212 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:48.752289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25c5253b-ad20-4907-8f93-d6ae914b7212 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:48.752878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25c5253b-ad20-4907-8f93-d6ae914b7212 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:48.823654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-25c5253b-ad20-4907-8f93-d6ae914b7212 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2486d131fa044a3e8b7db76f589c29b4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac1076498a3b42aea98e3dfc425d0601', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:01:48.832316 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-25c5253b-ad20-4907-8f93-d6ae914b7212 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 200 len: 1348 microversion: 2.1 time: 0.099210 Aug 23 19:01:48.832971 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3777/7685] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:48 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:01:49.856674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-408b06ff-585b-4c4f-afe0-39b218850816 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:49.857306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-408b06ff-585b-4c4f-afe0-39b218850816 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] [instance: 3cfe0658-a036-4106-9266-0ed29578e1b7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:01:49.864420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-408b06ff-585b-4c4f-afe0-39b218850816 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:49.864918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-408b06ff-585b-4c4f-afe0-39b218850816 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:49.865370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-408b06ff-585b-4c4f-afe0-39b218850816 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:49.866080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-408b06ff-585b-4c4f-afe0-39b218850816 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:01:49.866603 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-408b06ff-585b-4c4f-afe0-39b218850816 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:01:49.867050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-408b06ff-585b-4c4f-afe0-39b218850816 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:01:49.881144 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-408b06ff-585b-4c4f-afe0-39b218850816 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] HTTP exception thrown: Instance 3cfe0658-a036-4106-9266-0ed29578e1b7 could not be found. Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-408b06ff-585b-4c4f-afe0-39b218850816 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Request method failure captured: Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 HTTP/1.1 Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSOmj61W42CsVevuMqCyMg6qxJF9_oktCpbRJmJHz1rNf0TevlTVMLPZzm1-u6Cpvnhp9pcoxArQTl8iAB_u0VuxZEmcv-QQ67U6fIRgMC7zu6mf2k7TXmHQvEsDILOXxjHgrMiVW1dBAQ6G7k8Kxv2_l9TmS6vgH_cOtJB6MzCz8Vg Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: ac1076498a3b42aea98e3dfc425d0601 Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/ac1076498a3b42aea98e3dfc425d0601"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/ac1076498a3b42aea98e3dfc425d0601"}]}] Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: ac1076498a3b42aea98e3dfc425d0601 Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1816140811 Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestEncryptedCinderVolumes-1816140811-project Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2486d131fa044a3e8b7db76f589c29b4 Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestEncryptedCinderVolumes-1816140811-project Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 3cfe0658-a036-4106-9266-0ed29578e1b7 could not be found. Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '3cfe0658-a036-4106-9266-0ed29578e1b7'} Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3cfe0658-a036-4106-9266-0ed29578e1b7 could not be found. Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3cfe0658-a036-4106-9266-0ed29578e1b7 could not be found. Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:49.882878 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:01:49.887499 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:49.887499 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:01:49.887499 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:01:49.887499 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:01:49.887499 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:01:49.887499 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:01:49.887499 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3cfe0658-a036-4106-9266-0ed29578e1b7 could not be found. Aug 23 19:01:49.887499 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:01:49.887499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-408b06ff-585b-4c4f-afe0-39b218850816 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Returning 404 to user: Instance 3cfe0658-a036-4106-9266-0ed29578e1b7 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:01:49.887499 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-408b06ff-585b-4c4f-afe0-39b218850816 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7" status: 404 len: 111 microversion: 2.1 time: 0.033012 Aug 23 19:01:49.887499 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3909/7686] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:01:49 2022] GET /compute/v2.1/servers/3cfe0658-a036-4106-9266-0ed29578e1b7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:01:49.893429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ca86d60-2630-40b4-983a-3f6cb5a12105 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] Calling method '.version_select at 0x7f27ec9d2820>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:01:49.913261 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8ca86d60-2630-40b4-983a-3f6cb5a12105 tempest-TestEncryptedCinderVolumes-1816140811 tempest-TestEncryptedCinderVolumes-1816140811-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1325482700" status: 202 len: 0 microversion: 2.1 time: 0.023967 Aug 23 19:01:49.913840 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3778/7687] 10.222.0.61 () {58 vars in 1278 bytes} [Tue Aug 23 19:01:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1325482700 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:02:16.652127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-504a40a0-ce21-4b15-b9df-aa1c3026093d tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Action: 'create', calling method: .version_select at 0x7f27df77d1f0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1396331113", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhBxN3VEWG4OCQbD5lPYC2E5Nav0u9Bm8ceOmKDmd35qf6OZKy/cRQ1Uj/W0ET/guMa8ZGHTpvcb3wfLI+rK8REigXaa5AgxhxDN2ipi8NtcrdqTxAYKigmY7T4wJ51AQ=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:02:16.659246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=14 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:02:16.660035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=34 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:02:16.672389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-504a40a0-ce21-4b15-b9df-aa1c3026093d tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Getting quotas for project 6f5ae2dcaf834c5dba288379fd82fd0d. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:02:16.678982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-504a40a0-ce21-4b15-b9df-aa1c3026093d tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Getting quotas for user 470fc9d56e3743baa2906b2d7485284d and project 6f5ae2dcaf834c5dba288379fd82fd0d. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:02:16.702222 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-504a40a0-ce21-4b15-b9df-aa1c3026093d tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.054361 Aug 23 19:02:16.702868 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3910/7688] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 19:02:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:02:16.754384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:02:16.755295 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:02:16.762510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-52092743", "imageRef": "81256a62-f3b8-4b49-89c7-6f527285f08b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1396331113", "networks": [{"uuid": "7774ea68-748d-4900-8929-c3ec96edc294"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:02:16.818522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] validate_networks() for [('7774ea68-748d-4900-8929-c3ec96edc294', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:02:17.191715 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:02:17.192183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:02:17.192671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:02:17.193117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:02:17.193540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:02:17.202724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:17.203219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:17.203694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:17.205356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:17.206314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:17.207165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:17.225570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Getting quotas for project 6f5ae2dcaf834c5dba288379fd82fd0d. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:02:17.230992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Getting quotas for user 470fc9d56e3743baa2906b2d7485284d and project 6f5ae2dcaf834c5dba288379fd82fd0d. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:02:17.244255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:02:17.246512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='81256a62-f3b8-4b49-89c7-6f527285f08b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:02:17.295237 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4a472b40-6f78-44aa-97bb-70b05578f518 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.543759 Aug 23 19:02:17.296097 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3779/7689] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:02:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:02:17.307598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e2071a93-7086-45d1-9fa7-ca50da38435d tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:17.308368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e2071a93-7086-45d1-9fa7-ca50da38435d tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:17.366714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e2071a93-7086-45d1-9fa7-ca50da38435d tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:17.374815 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e2071a93-7086-45d1-9fa7-ca50da38435d tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1257 microversion: 2.1 time: 0.071116 Aug 23 19:02:17.375381 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3911/7690] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:17 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1257 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:18.397558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-55d54bed-e209-4df8-9d71-820f32b66b57 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:18.398873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-55d54bed-e209-4df8-9d71-820f32b66b57 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:18.405849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55d54bed-e209-4df8-9d71-820f32b66b57 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:18.406657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55d54bed-e209-4df8-9d71-820f32b66b57 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:18.407104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55d54bed-e209-4df8-9d71-820f32b66b57 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:18.408672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55d54bed-e209-4df8-9d71-820f32b66b57 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:18.408952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55d54bed-e209-4df8-9d71-820f32b66b57 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:18.409570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-55d54bed-e209-4df8-9d71-820f32b66b57 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:18.491688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-55d54bed-e209-4df8-9d71-820f32b66b57 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:18.499456 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-55d54bed-e209-4df8-9d71-820f32b66b57 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1327 microversion: 2.1 time: 0.107094 Aug 23 19:02:18.500054 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3780/7691] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:18 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:02:19.535152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0e663135-0fe6-4065-9295-e3576ce6ad8f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:19.535960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0e663135-0fe6-4065-9295-e3576ce6ad8f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:19.547347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e663135-0fe6-4065-9295-e3576ce6ad8f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:19.548062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e663135-0fe6-4065-9295-e3576ce6ad8f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:19.549163 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e663135-0fe6-4065-9295-e3576ce6ad8f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:19.550038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e663135-0fe6-4065-9295-e3576ce6ad8f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:19.550632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e663135-0fe6-4065-9295-e3576ce6ad8f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:19.551178 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e663135-0fe6-4065-9295-e3576ce6ad8f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:19.746448 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0e663135-0fe6-4065-9295-e3576ce6ad8f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:19.756508 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0e663135-0fe6-4065-9295-e3576ce6ad8f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.238151 Aug 23 19:02:19.757237 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3912/7692] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:19 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:20.777634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6b9527b9-fa5f-4d1a-b941-094d6d7a019f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:20.778254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6b9527b9-fa5f-4d1a-b941-094d6d7a019f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:20.785614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b9527b9-fa5f-4d1a-b941-094d6d7a019f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:20.786107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b9527b9-fa5f-4d1a-b941-094d6d7a019f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:20.786567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b9527b9-fa5f-4d1a-b941-094d6d7a019f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:20.787289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b9527b9-fa5f-4d1a-b941-094d6d7a019f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:20.787755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b9527b9-fa5f-4d1a-b941-094d6d7a019f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:20.788190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6b9527b9-fa5f-4d1a-b941-094d6d7a019f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:20.929003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6b9527b9-fa5f-4d1a-b941-094d6d7a019f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:20.936710 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6b9527b9-fa5f-4d1a-b941-094d6d7a019f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.162994 Aug 23 19:02:20.937276 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3781/7693] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:20 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:21.958294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-da910e3e-4cfd-4dc9-9522-f7f3ccd1329b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:21.959011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-da910e3e-4cfd-4dc9-9522-f7f3ccd1329b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:21.966732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da910e3e-4cfd-4dc9-9522-f7f3ccd1329b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:21.967253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da910e3e-4cfd-4dc9-9522-f7f3ccd1329b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:21.967713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da910e3e-4cfd-4dc9-9522-f7f3ccd1329b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:21.968446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da910e3e-4cfd-4dc9-9522-f7f3ccd1329b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:21.969097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da910e3e-4cfd-4dc9-9522-f7f3ccd1329b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:21.969697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-da910e3e-4cfd-4dc9-9522-f7f3ccd1329b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:22.116361 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-da910e3e-4cfd-4dc9-9522-f7f3ccd1329b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:22.129037 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-da910e3e-4cfd-4dc9-9522-f7f3ccd1329b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.175299 Aug 23 19:02:22.130004 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3913/7694] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:21 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:23.149242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-10dd0c92-9472-45b2-a099-db8eb3aff82f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:23.149853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-10dd0c92-9472-45b2-a099-db8eb3aff82f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:23.156650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10dd0c92-9472-45b2-a099-db8eb3aff82f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:23.157131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10dd0c92-9472-45b2-a099-db8eb3aff82f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:23.158078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10dd0c92-9472-45b2-a099-db8eb3aff82f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:23.158793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10dd0c92-9472-45b2-a099-db8eb3aff82f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:23.159245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10dd0c92-9472-45b2-a099-db8eb3aff82f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:23.159667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-10dd0c92-9472-45b2-a099-db8eb3aff82f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:23.302519 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-10dd0c92-9472-45b2-a099-db8eb3aff82f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:23.317507 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-10dd0c92-9472-45b2-a099-db8eb3aff82f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.171987 Aug 23 19:02:23.318115 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3782/7695] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:23 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:24.341597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-af090e6b-113a-4b17-aa11-09e18db892cf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:24.342310 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-af090e6b-113a-4b17-aa11-09e18db892cf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:24.350056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af090e6b-113a-4b17-aa11-09e18db892cf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:24.350599 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af090e6b-113a-4b17-aa11-09e18db892cf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:24.351122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af090e6b-113a-4b17-aa11-09e18db892cf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:24.351797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af090e6b-113a-4b17-aa11-09e18db892cf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:24.352278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af090e6b-113a-4b17-aa11-09e18db892cf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:24.352753 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af090e6b-113a-4b17-aa11-09e18db892cf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:24.502060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-af090e6b-113a-4b17-aa11-09e18db892cf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:24.510090 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-af090e6b-113a-4b17-aa11-09e18db892cf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.172984 Aug 23 19:02:24.510701 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3914/7696] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:24 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:25.540449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a30a4e15-2e41-4a10-8fbc-d63d5dac2f35 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:25.541778 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a30a4e15-2e41-4a10-8fbc-d63d5dac2f35 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:25.549619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a30a4e15-2e41-4a10-8fbc-d63d5dac2f35 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:25.550113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a30a4e15-2e41-4a10-8fbc-d63d5dac2f35 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:25.550575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a30a4e15-2e41-4a10-8fbc-d63d5dac2f35 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:25.551296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a30a4e15-2e41-4a10-8fbc-d63d5dac2f35 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:25.551759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a30a4e15-2e41-4a10-8fbc-d63d5dac2f35 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:25.552454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a30a4e15-2e41-4a10-8fbc-d63d5dac2f35 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:25.705885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a30a4e15-2e41-4a10-8fbc-d63d5dac2f35 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:25.714399 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a30a4e15-2e41-4a10-8fbc-d63d5dac2f35 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.177818 Aug 23 19:02:25.721059 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3783/7697] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:25 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:26.735852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7dd882aa-9262-4d4d-a4b2-7c5339912344 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:26.736524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7dd882aa-9262-4d4d-a4b2-7c5339912344 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:26.743622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dd882aa-9262-4d4d-a4b2-7c5339912344 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:26.744117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dd882aa-9262-4d4d-a4b2-7c5339912344 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:26.744566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dd882aa-9262-4d4d-a4b2-7c5339912344 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:26.745268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dd882aa-9262-4d4d-a4b2-7c5339912344 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:26.745736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dd882aa-9262-4d4d-a4b2-7c5339912344 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:26.746173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7dd882aa-9262-4d4d-a4b2-7c5339912344 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:26.886953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7dd882aa-9262-4d4d-a4b2-7c5339912344 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:26.895242 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7dd882aa-9262-4d4d-a4b2-7c5339912344 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.163421 Aug 23 19:02:26.895835 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3915/7698] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:26 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:27.917270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c7eb3034-b0f4-447f-861f-f2661b2c3fa6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:27.917890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7eb3034-b0f4-447f-861f-f2661b2c3fa6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:27.920090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:02:27.920786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:02:27.927180 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7eb3034-b0f4-447f-861f-f2661b2c3fa6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:27.927672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7eb3034-b0f4-447f-861f-f2661b2c3fa6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:27.928119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7eb3034-b0f4-447f-861f-f2661b2c3fa6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:27.928824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7eb3034-b0f4-447f-861f-f2661b2c3fa6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:27.929283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7eb3034-b0f4-447f-861f-f2661b2c3fa6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:27.929717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7eb3034-b0f4-447f-861f-f2661b2c3fa6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:28.059770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c7eb3034-b0f4-447f-861f-f2661b2c3fa6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:28.067540 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c7eb3034-b0f4-447f-861f-f2661b2c3fa6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.154177 Aug 23 19:02:28.068111 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3784/7699] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:27 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:29.087750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1168861f-cdc7-4e1f-a41a-77ae10725389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:29.088383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1168861f-cdc7-4e1f-a41a-77ae10725389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:29.090575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:02:29.097438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1168861f-cdc7-4e1f-a41a-77ae10725389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:29.097947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1168861f-cdc7-4e1f-a41a-77ae10725389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:29.098402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1168861f-cdc7-4e1f-a41a-77ae10725389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:29.099143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1168861f-cdc7-4e1f-a41a-77ae10725389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:29.099617 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1168861f-cdc7-4e1f-a41a-77ae10725389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:29.100059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1168861f-cdc7-4e1f-a41a-77ae10725389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:29.231634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1168861f-cdc7-4e1f-a41a-77ae10725389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:29.240019 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1168861f-cdc7-4e1f-a41a-77ae10725389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.156181 Aug 23 19:02:29.240600 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3916/7700] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:29 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:30.260929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-153a6564-f6a2-4472-9c73-c17e016412f0 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:30.261465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-153a6564-f6a2-4472-9c73-c17e016412f0 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:30.268950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-153a6564-f6a2-4472-9c73-c17e016412f0 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:30.269427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-153a6564-f6a2-4472-9c73-c17e016412f0 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:30.269864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-153a6564-f6a2-4472-9c73-c17e016412f0 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:30.270577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-153a6564-f6a2-4472-9c73-c17e016412f0 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:30.271029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-153a6564-f6a2-4472-9c73-c17e016412f0 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:30.271451 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-153a6564-f6a2-4472-9c73-c17e016412f0 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:30.404757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-153a6564-f6a2-4472-9c73-c17e016412f0 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:30.413091 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-153a6564-f6a2-4472-9c73-c17e016412f0 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.156165 Aug 23 19:02:30.413661 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3785/7701] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:30 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:31.355412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-25718d55-9d76-4567-ab88-dc5b332a2dc1 req-99f5f0d8-be3d-44a2-9cee-3f0a32c14229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc3e13b-4e01-4c24-862d-51665c845839", "tag": "2d0c7601-b6a4-423b-b782-183605e4abc7"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:02:31.377548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-25718d55-9d76-4567-ab88-dc5b332a2dc1 req-99f5f0d8-be3d-44a2-9cee-3f0a32c14229 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:31.377548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-25718d55-9d76-4567-ab88-dc5b332a2dc1 req-99f5f0d8-be3d-44a2-9cee-3f0a32c14229 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:31.377548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-25718d55-9d76-4567-ab88-dc5b332a2dc1 req-99f5f0d8-be3d-44a2-9cee-3f0a32c14229 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:31.403078 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-25718d55-9d76-4567-ab88-dc5b332a2dc1 req-99f5f0d8-be3d-44a2-9cee-3f0a32c14229 service nova] Creating event network-changed:2d0c7601-b6a4-423b-b782-183605e4abc7 for instance 5fc3e13b-4e01-4c24-862d-51665c845839 on n-h2-850468-16 Aug 23 19:02:31.405697 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-25718d55-9d76-4567-ab88-dc5b332a2dc1 req-99f5f0d8-be3d-44a2-9cee-3f0a32c14229 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054098 Aug 23 19:02:31.410834 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3917/7702] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:02:31.454318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a4374936-7907-41a2-89dd-9c4d1a76c04a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:31.461577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a4374936-7907-41a2-89dd-9c4d1a76c04a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:31.475859 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4374936-7907-41a2-89dd-9c4d1a76c04a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:31.476348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4374936-7907-41a2-89dd-9c4d1a76c04a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:31.476784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4374936-7907-41a2-89dd-9c4d1a76c04a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:31.477489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4374936-7907-41a2-89dd-9c4d1a76c04a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:31.477942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4374936-7907-41a2-89dd-9c4d1a76c04a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:31.478359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a4374936-7907-41a2-89dd-9c4d1a76c04a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:31.764877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a4374936-7907-41a2-89dd-9c4d1a76c04a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:31.773161 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a4374936-7907-41a2-89dd-9c4d1a76c04a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.341557 Aug 23 19:02:31.773741 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3786/7703] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:31 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:32.796804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0051876f-89dc-4a77-b905-a718340b9b05 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:32.797655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0051876f-89dc-4a77-b905-a718340b9b05 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:32.804064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0051876f-89dc-4a77-b905-a718340b9b05 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:32.804575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0051876f-89dc-4a77-b905-a718340b9b05 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:32.805033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0051876f-89dc-4a77-b905-a718340b9b05 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:32.805745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0051876f-89dc-4a77-b905-a718340b9b05 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:32.806234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0051876f-89dc-4a77-b905-a718340b9b05 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:32.806702 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0051876f-89dc-4a77-b905-a718340b9b05 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:32.937968 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0051876f-89dc-4a77-b905-a718340b9b05 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:32.945902 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0051876f-89dc-4a77-b905-a718340b9b05 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.154352 Aug 23 19:02:32.946470 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3918/7704] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:32 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:33.967319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4ac4f444-477f-43e6-bd06-d7b8d238898e tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:33.967863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4ac4f444-477f-43e6-bd06-d7b8d238898e tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:33.975420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ac4f444-477f-43e6-bd06-d7b8d238898e tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:33.975906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ac4f444-477f-43e6-bd06-d7b8d238898e tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:33.976341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ac4f444-477f-43e6-bd06-d7b8d238898e tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:33.977034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ac4f444-477f-43e6-bd06-d7b8d238898e tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:33.977483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ac4f444-477f-43e6-bd06-d7b8d238898e tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:33.977904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4ac4f444-477f-43e6-bd06-d7b8d238898e tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:34.109123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4ac4f444-477f-43e6-bd06-d7b8d238898e tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:34.116939 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4ac4f444-477f-43e6-bd06-d7b8d238898e tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.153954 Aug 23 19:02:34.117507 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3787/7705] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:33 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:35.138422 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-842c5ca5-1644-46ca-ad54-8a9772c2e389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:35.139085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-842c5ca5-1644-46ca-ad54-8a9772c2e389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:35.146277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-842c5ca5-1644-46ca-ad54-8a9772c2e389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:35.146813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-842c5ca5-1644-46ca-ad54-8a9772c2e389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:35.147267 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-842c5ca5-1644-46ca-ad54-8a9772c2e389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:35.147982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-842c5ca5-1644-46ca-ad54-8a9772c2e389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:35.148451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-842c5ca5-1644-46ca-ad54-8a9772c2e389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:35.148892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-842c5ca5-1644-46ca-ad54-8a9772c2e389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:35.284762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-842c5ca5-1644-46ca-ad54-8a9772c2e389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:35.292489 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-842c5ca5-1644-46ca-ad54-8a9772c2e389 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.158032 Aug 23 19:02:35.293061 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3919/7706] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:35 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:36.313447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d998495e-02e1-40bd-b646-eeb93cd624df tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:36.314992 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d998495e-02e1-40bd-b646-eeb93cd624df tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:36.321798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d998495e-02e1-40bd-b646-eeb93cd624df tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:36.322299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d998495e-02e1-40bd-b646-eeb93cd624df tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:36.322748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d998495e-02e1-40bd-b646-eeb93cd624df tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:36.323445 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d998495e-02e1-40bd-b646-eeb93cd624df tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:36.323895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d998495e-02e1-40bd-b646-eeb93cd624df tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:36.324319 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d998495e-02e1-40bd-b646-eeb93cd624df tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:36.457226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d998495e-02e1-40bd-b646-eeb93cd624df tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:36.465174 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d998495e-02e1-40bd-b646-eeb93cd624df tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.155483 Aug 23 19:02:36.465750 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3788/7707] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:36 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:37.487797 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ed4f0782-b0f7-405e-af96-8307b444a505 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:37.488459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ed4f0782-b0f7-405e-af96-8307b444a505 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:37.495126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed4f0782-b0f7-405e-af96-8307b444a505 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:37.495618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed4f0782-b0f7-405e-af96-8307b444a505 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:37.496097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed4f0782-b0f7-405e-af96-8307b444a505 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:37.496812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed4f0782-b0f7-405e-af96-8307b444a505 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:37.497281 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed4f0782-b0f7-405e-af96-8307b444a505 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:37.497904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed4f0782-b0f7-405e-af96-8307b444a505 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:37.637670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ed4f0782-b0f7-405e-af96-8307b444a505 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:37.646455 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ed4f0782-b0f7-405e-af96-8307b444a505 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.163218 Aug 23 19:02:37.647098 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3920/7708] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:37 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:38.667730 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-38cbe843-1510-475a-959b-85adbfe82373 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:38.668347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-38cbe843-1510-475a-959b-85adbfe82373 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:38.676116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38cbe843-1510-475a-959b-85adbfe82373 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:38.676605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38cbe843-1510-475a-959b-85adbfe82373 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:38.677045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38cbe843-1510-475a-959b-85adbfe82373 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:38.677740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38cbe843-1510-475a-959b-85adbfe82373 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:38.678196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38cbe843-1510-475a-959b-85adbfe82373 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:38.678647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-38cbe843-1510-475a-959b-85adbfe82373 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:38.809927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-38cbe843-1510-475a-959b-85adbfe82373 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:38.817929 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-38cbe843-1510-475a-959b-85adbfe82373 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.154066 Aug 23 19:02:38.818523 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3789/7709] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:38 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:39.683808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-bd1341d3-9a49-4731-9d0e-dffc3d5a1bc9 req-adc2f666-6d06-424f-9af1-2c12973c4c45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc3e13b-4e01-4c24-862d-51665c845839", "name": "network-vif-plugged", "status": "completed", "tag": "2d0c7601-b6a4-423b-b782-183605e4abc7"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:02:39.696890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bd1341d3-9a49-4731-9d0e-dffc3d5a1bc9 req-adc2f666-6d06-424f-9af1-2c12973c4c45 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:39.697705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bd1341d3-9a49-4731-9d0e-dffc3d5a1bc9 req-adc2f666-6d06-424f-9af1-2c12973c4c45 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:39.698388 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bd1341d3-9a49-4731-9d0e-dffc3d5a1bc9 req-adc2f666-6d06-424f-9af1-2c12973c4c45 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:39.710296 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-bd1341d3-9a49-4731-9d0e-dffc3d5a1bc9 req-adc2f666-6d06-424f-9af1-2c12973c4c45 service nova] Creating event network-vif-plugged:2d0c7601-b6a4-423b-b782-183605e4abc7 for instance 5fc3e13b-4e01-4c24-862d-51665c845839 on n-h2-850468-16 Aug 23 19:02:39.715575 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-bd1341d3-9a49-4731-9d0e-dffc3d5a1bc9 req-adc2f666-6d06-424f-9af1-2c12973c4c45 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035281 Aug 23 19:02:39.716165 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3921/7710] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:02:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:02:39.839020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-92b8099a-9c05-4db5-babf-02ec353a3aca tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:39.839646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-92b8099a-9c05-4db5-babf-02ec353a3aca tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:39.846801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92b8099a-9c05-4db5-babf-02ec353a3aca tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:39.847290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92b8099a-9c05-4db5-babf-02ec353a3aca tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:39.847728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92b8099a-9c05-4db5-babf-02ec353a3aca tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:39.848442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92b8099a-9c05-4db5-babf-02ec353a3aca tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:39.848896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92b8099a-9c05-4db5-babf-02ec353a3aca tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:39.849321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-92b8099a-9c05-4db5-babf-02ec353a3aca tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:39.977780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-92b8099a-9c05-4db5-babf-02ec353a3aca tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:39.986114 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-92b8099a-9c05-4db5-babf-02ec353a3aca tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.150420 Aug 23 19:02:39.986716 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3790/7711] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:39 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:41.008655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f73e5521-b736-4610-a48d-e8736387d554 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:41.009290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f73e5521-b736-4610-a48d-e8736387d554 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:41.015456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f73e5521-b736-4610-a48d-e8736387d554 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:41.015948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f73e5521-b736-4610-a48d-e8736387d554 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:41.017033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f73e5521-b736-4610-a48d-e8736387d554 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:41.018302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f73e5521-b736-4610-a48d-e8736387d554 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:41.018810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f73e5521-b736-4610-a48d-e8736387d554 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:41.019253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f73e5521-b736-4610-a48d-e8736387d554 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:41.161495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f73e5521-b736-4610-a48d-e8736387d554 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:41.169426 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f73e5521-b736-4610-a48d-e8736387d554 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1357 microversion: 2.1 time: 0.165912 Aug 23 19:02:41.170009 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3922/7712] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:41 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1357 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:42.190005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3505bb0f-1a38-4fb5-8ea8-bd55dcab9228 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:42.190651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3505bb0f-1a38-4fb5-8ea8-bd55dcab9228 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:42.197554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3505bb0f-1a38-4fb5-8ea8-bd55dcab9228 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:42.198046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3505bb0f-1a38-4fb5-8ea8-bd55dcab9228 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:42.198498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3505bb0f-1a38-4fb5-8ea8-bd55dcab9228 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:42.199227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3505bb0f-1a38-4fb5-8ea8-bd55dcab9228 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:42.199688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3505bb0f-1a38-4fb5-8ea8-bd55dcab9228 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:42.200121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3505bb0f-1a38-4fb5-8ea8-bd55dcab9228 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:42.331680 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3505bb0f-1a38-4fb5-8ea8-bd55dcab9228 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:42.339464 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3505bb0f-1a38-4fb5-8ea8-bd55dcab9228 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1546 microversion: 2.1 time: 0.153444 Aug 23 19:02:42.340309 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3791/7713] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:42 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1546 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:42.360622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a8788e0b-6379-430f-b22f-3e3046de7407 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:42.361257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a8788e0b-6379-430f-b22f-3e3046de7407 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:42.368170 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8788e0b-6379-430f-b22f-3e3046de7407 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:42.368670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8788e0b-6379-430f-b22f-3e3046de7407 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:42.369126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8788e0b-6379-430f-b22f-3e3046de7407 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:42.369839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8788e0b-6379-430f-b22f-3e3046de7407 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:42.370307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8788e0b-6379-430f-b22f-3e3046de7407 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:42.370773 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8788e0b-6379-430f-b22f-3e3046de7407 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:42.504821 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a8788e0b-6379-430f-b22f-3e3046de7407 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:42.512604 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a8788e0b-6379-430f-b22f-3e3046de7407 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1546 microversion: 2.1 time: 0.156028 Aug 23 19:02:42.513223 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3923/7714] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:42 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1546 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:42.533182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-157d46c1-28f6-4e9a-abf3-2208df1d61b9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:42.537984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-157d46c1-28f6-4e9a-abf3-2208df1d61b9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:42.538799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-157d46c1-28f6-4e9a-abf3-2208df1d61b9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Searching by: {'deleted': False, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 19:02:42.544098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-157d46c1-28f6-4e9a-abf3-2208df1d61b9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:42.544585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-157d46c1-28f6-4e9a-abf3-2208df1d61b9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:42.545028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-157d46c1-28f6-4e9a-abf3-2208df1d61b9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:42.545791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-157d46c1-28f6-4e9a-abf3-2208df1d61b9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:42.546253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-157d46c1-28f6-4e9a-abf3-2208df1d61b9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:42.546722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-157d46c1-28f6-4e9a-abf3-2208df1d61b9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:42.570613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-157d46c1-28f6-4e9a-abf3-2208df1d61b9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 19:02:42.597521 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-157d46c1-28f6-4e9a-abf3-2208df1d61b9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.068366 Aug 23 19:02:42.598102 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3792/7715] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 19:02:42 2022] GET /compute/v2.1/servers => generated 341 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:02:42.609275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-77b27b56-6305-4b4a-aa9e-17282478cd9f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:42.609909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-77b27b56-6305-4b4a-aa9e-17282478cd9f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:42.616600 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77b27b56-6305-4b4a-aa9e-17282478cd9f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:42.617094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77b27b56-6305-4b4a-aa9e-17282478cd9f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:42.617548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77b27b56-6305-4b4a-aa9e-17282478cd9f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:42.618261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77b27b56-6305-4b4a-aa9e-17282478cd9f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:42.618796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77b27b56-6305-4b4a-aa9e-17282478cd9f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:42.619241 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-77b27b56-6305-4b4a-aa9e-17282478cd9f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:42.756916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-77b27b56-6305-4b4a-aa9e-17282478cd9f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:42.769227 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-77b27b56-6305-4b4a-aa9e-17282478cd9f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1546 microversion: 2.1 time: 0.163430 Aug 23 19:02:42.770245 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3924/7716] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:42 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1546 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:02:44.323439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d791e90b-96c0-4207-9178-b4078b8a8f59 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6f9f626-60fb-49c2-929e-810b0c1652e1"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:02:44.325861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d791e90b-96c0-4207-9178-b4078b8a8f59 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:44.333566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d791e90b-96c0-4207-9178-b4078b8a8f59 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:44.334055 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d791e90b-96c0-4207-9178-b4078b8a8f59 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:44.334501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d791e90b-96c0-4207-9178-b4078b8a8f59 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:44.335230 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d791e90b-96c0-4207-9178-b4078b8a8f59 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:44.335694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d791e90b-96c0-4207-9178-b4078b8a8f59 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:44.336127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d791e90b-96c0-4207-9178-b4078b8a8f59 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:44.575088 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d791e90b-96c0-4207-9178-b4078b8a8f59 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "POST /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255415 Aug 23 19:02:44.575751 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3793/7717] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 19:02:44 2022] POST /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:02:57.628036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bc9c1e69-a84b-46ff-beba-6c7fb7968b73 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:02:57.629307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bc9c1e69-a84b-46ff-beba-6c7fb7968b73 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:02:57.632075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:02:57.632933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=70 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:02:57.639593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc9c1e69-a84b-46ff-beba-6c7fb7968b73 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:57.640109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc9c1e69-a84b-46ff-beba-6c7fb7968b73 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:57.640569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc9c1e69-a84b-46ff-beba-6c7fb7968b73 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:57.641297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc9c1e69-a84b-46ff-beba-6c7fb7968b73 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:57.641779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc9c1e69-a84b-46ff-beba-6c7fb7968b73 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:57.642414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bc9c1e69-a84b-46ff-beba-6c7fb7968b73 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:57.778116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bc9c1e69-a84b-46ff-beba-6c7fb7968b73 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:02:57.787116 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bc9c1e69-a84b-46ff-beba-6c7fb7968b73 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1592 microversion: 2.1 time: 0.163531 Aug 23 19:02:57.787704 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3925/7718] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:02:57 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1592 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:02:59.741543 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:02:59.742332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:02:59.743023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:02:59.747152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-059b6e54-7605-4e13-baf6-0013ca75b0b6 req-f2748e08-955f-4f0f-a506-52f4cca5706b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc3e13b-4e01-4c24-862d-51665c845839", "tag": "2d0c7601-b6a4-423b-b782-183605e4abc7"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:02:59.759373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-059b6e54-7605-4e13-baf6-0013ca75b0b6 req-f2748e08-955f-4f0f-a506-52f4cca5706b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:02:59.759884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-059b6e54-7605-4e13-baf6-0013ca75b0b6 req-f2748e08-955f-4f0f-a506-52f4cca5706b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:02:59.760315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-059b6e54-7605-4e13-baf6-0013ca75b0b6 req-f2748e08-955f-4f0f-a506-52f4cca5706b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:02:59.772877 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-059b6e54-7605-4e13-baf6-0013ca75b0b6 req-f2748e08-955f-4f0f-a506-52f4cca5706b service nova] Creating event network-changed:2d0c7601-b6a4-423b-b782-183605e4abc7 for instance 5fc3e13b-4e01-4c24-862d-51665c845839 on n-h2-850468-16 Aug 23 19:02:59.778130 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-059b6e54-7605-4e13-baf6-0013ca75b0b6 req-f2748e08-955f-4f0f-a506-52f4cca5706b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038318 Aug 23 19:02:59.778997 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3794/7719] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:03:00.812607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-efd34175-91a9-46bf-a144-4e4e7e8293d5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1594680239"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:03:00.813396 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-efd34175-91a9-46bf-a144-4e4e7e8293d5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:03:00.822036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-efd34175-91a9-46bf-a144-4e4e7e8293d5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:03:00.822595 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-efd34175-91a9-46bf-a144-4e4e7e8293d5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:03:00.823044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-efd34175-91a9-46bf-a144-4e4e7e8293d5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:03:00.823785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-efd34175-91a9-46bf-a144-4e4e7e8293d5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:03:00.824327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-efd34175-91a9-46bf-a144-4e4e7e8293d5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:03:00.824777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-efd34175-91a9-46bf-a144-4e4e7e8293d5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:03:00.959355 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.network.security_group_api [None req-efd34175-91a9-46bf-a144-4e4e7e8293d5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Adding security group bf4b7482-02f4-4ae3-9d0a-06e87e63ad8c to port 2d0c7601-b6a4-423b-b782-183605e4abc7 Aug 23 19:03:01.277529 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-efd34175-91a9-46bf-a144-4e4e7e8293d5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "POST /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/action" status: 202 len: 0 microversion: 2.1 time: 0.469623 Aug 23 19:03:01.281211 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3926/7720] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:03:00 2022] POST /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:03:01.289311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-08fdd1ba-8295-4f91-a53b-52636c30e1d6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:03:01.290014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-08fdd1ba-8295-4f91-a53b-52636c30e1d6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:03:01.305737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08fdd1ba-8295-4f91-a53b-52636c30e1d6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:03:01.306253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08fdd1ba-8295-4f91-a53b-52636c30e1d6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:03:01.306762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08fdd1ba-8295-4f91-a53b-52636c30e1d6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:03:01.307631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08fdd1ba-8295-4f91-a53b-52636c30e1d6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:03:01.308103 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08fdd1ba-8295-4f91-a53b-52636c30e1d6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:03:01.308637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-08fdd1ba-8295-4f91-a53b-52636c30e1d6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:03:01.471733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-d5162060-292a-473d-b94c-88dbc204b302 req-aae4dac9-f6c1-45ee-afb0-e2572d7c17b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc3e13b-4e01-4c24-862d-51665c845839", "tag": "2d0c7601-b6a4-423b-b782-183605e4abc7"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:03:01.481851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d5162060-292a-473d-b94c-88dbc204b302 req-aae4dac9-f6c1-45ee-afb0-e2572d7c17b6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:03:01.482570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d5162060-292a-473d-b94c-88dbc204b302 req-aae4dac9-f6c1-45ee-afb0-e2572d7c17b6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:03:01.483221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-d5162060-292a-473d-b94c-88dbc204b302 req-aae4dac9-f6c1-45ee-afb0-e2572d7c17b6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:03:01.495882 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-d5162060-292a-473d-b94c-88dbc204b302 req-aae4dac9-f6c1-45ee-afb0-e2572d7c17b6 service nova] Creating event network-changed:2d0c7601-b6a4-423b-b782-183605e4abc7 for instance 5fc3e13b-4e01-4c24-862d-51665c845839 on n-h2-850468-16 Aug 23 19:03:01.501151 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-d5162060-292a-473d-b94c-88dbc204b302 req-aae4dac9-f6c1-45ee-afb0-e2572d7c17b6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.206895 Aug 23 19:03:01.502574 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3927/7721] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:03:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:03:01.507964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-08fdd1ba-8295-4f91-a53b-52636c30e1d6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:03:01.517720 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-08fdd1ba-8295-4f91-a53b-52636c30e1d6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1758 microversion: 2.1 time: 0.233353 Aug 23 19:03:01.518733 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3795/7722] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:03:01 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1758 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:04:21.368751 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:04:21.369319 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:04:21.834709 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:04:21.835285 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:04:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:05:14.486980 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a3fd44c-0004-4783-9f1a-6f2fcc77fcee] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:05:14.487985 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ea61cea-341f-4994-9508-d9cf4674c693] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:05:14.488563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:05:14.489488 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=12 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:05:14.496015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a0438bfe-05b6-4cc5-bf24-3d20a34c36cd tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:05:14.498307 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a0438bfe-05b6-4cc5-bf24-3d20a34c36cd tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:05:14.505914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0438bfe-05b6-4cc5-bf24-3d20a34c36cd tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:14.506414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0438bfe-05b6-4cc5-bf24-3d20a34c36cd tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:14.507591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0438bfe-05b6-4cc5-bf24-3d20a34c36cd tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:14.508302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0438bfe-05b6-4cc5-bf24-3d20a34c36cd tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:14.508775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0438bfe-05b6-4cc5-bf24-3d20a34c36cd tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:14.509217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0438bfe-05b6-4cc5-bf24-3d20a34c36cd tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:14.584812 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a0438bfe-05b6-4cc5-bf24-3d20a34c36cd tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "POST /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/action" status: 202 len: 0 microversion: 2.1 time: 0.099222 Aug 23 19:05:14.586040 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3928/7723] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:05:14 2022] POST /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:05:14.592338 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 19:05:14.593243 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 19:05:14.594069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:05:14.594873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:05:14.598916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6f92cac-bec5-4d1e-96fa-4176374f16e7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:05:14.599534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6f92cac-bec5-4d1e-96fa-4176374f16e7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:05:14.607476 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6f92cac-bec5-4d1e-96fa-4176374f16e7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:14.607963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6f92cac-bec5-4d1e-96fa-4176374f16e7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:14.608402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6f92cac-bec5-4d1e-96fa-4176374f16e7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:14.609120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6f92cac-bec5-4d1e-96fa-4176374f16e7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:14.609576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6f92cac-bec5-4d1e-96fa-4176374f16e7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:14.610001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6f92cac-bec5-4d1e-96fa-4176374f16e7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:14.866597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f6f92cac-bec5-4d1e-96fa-4176374f16e7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:05:14.875848 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6f92cac-bec5-4d1e-96fa-4176374f16e7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1760 microversion: 2.1 time: 0.285262 Aug 23 19:05:14.876427 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3796/7724] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:05:14 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1760 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:05:15.899002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-479e5e4a-aadb-4062-b04a-618ba23e0fd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:05:15.899825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-479e5e4a-aadb-4062-b04a-618ba23e0fd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:05:15.914143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-479e5e4a-aadb-4062-b04a-618ba23e0fd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:15.914694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-479e5e4a-aadb-4062-b04a-618ba23e0fd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:15.915161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-479e5e4a-aadb-4062-b04a-618ba23e0fd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:15.915885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-479e5e4a-aadb-4062-b04a-618ba23e0fd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:15.916359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-479e5e4a-aadb-4062-b04a-618ba23e0fd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:15.916803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-479e5e4a-aadb-4062-b04a-618ba23e0fd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:15.921583 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ea61cea-341f-4994-9508-d9cf4674c693] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 34558. Aug 23 19:05:15.925281 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a3fd44c-0004-4783-9f1a-6f2fcc77fcee] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 34556. Aug 23 19:05:16.136906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-479e5e4a-aadb-4062-b04a-618ba23e0fd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:05:16.145273 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-479e5e4a-aadb-4062-b04a-618ba23e0fd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1765 microversion: 2.1 time: 0.251266 Aug 23 19:05:16.145847 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3929/7725] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:05:15 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1765 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:05:17.172289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd11f779-6025-45a6-8bf3-00741d99edba tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:05:17.172910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd11f779-6025-45a6-8bf3-00741d99edba tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:05:17.184978 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd11f779-6025-45a6-8bf3-00741d99edba tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:17.185466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd11f779-6025-45a6-8bf3-00741d99edba tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:17.185941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd11f779-6025-45a6-8bf3-00741d99edba tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:17.186681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd11f779-6025-45a6-8bf3-00741d99edba tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:17.187140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd11f779-6025-45a6-8bf3-00741d99edba tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:17.187575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bd11f779-6025-45a6-8bf3-00741d99edba tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:17.195279 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 34566. Aug 23 19:05:17.195279 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 34568. Aug 23 19:05:17.332747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bd11f779-6025-45a6-8bf3-00741d99edba tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:05:17.341945 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd11f779-6025-45a6-8bf3-00741d99edba tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1765 microversion: 2.1 time: 0.173632 Aug 23 19:05:17.347226 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3797/7726] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:05:17 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1765 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:05:18.363447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-00b56f60-9164-4833-a7de-cf8f020346aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:05:18.363996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-00b56f60-9164-4833-a7de-cf8f020346aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:05:18.370985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00b56f60-9164-4833-a7de-cf8f020346aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:18.371484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00b56f60-9164-4833-a7de-cf8f020346aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:18.371943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00b56f60-9164-4833-a7de-cf8f020346aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:18.372645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00b56f60-9164-4833-a7de-cf8f020346aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:18.373112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00b56f60-9164-4833-a7de-cf8f020346aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:18.373577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-00b56f60-9164-4833-a7de-cf8f020346aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:18.520872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-00b56f60-9164-4833-a7de-cf8f020346aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:05:18.530484 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-00b56f60-9164-4833-a7de-cf8f020346aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1765 microversion: 2.1 time: 0.171125 Aug 23 19:05:18.531087 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3930/7727] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:05:18 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1765 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:05:19.552919 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-17680e6b-5f59-4242-8126-f6795242bcd7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:05:19.554045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-17680e6b-5f59-4242-8126-f6795242bcd7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:05:19.560874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17680e6b-5f59-4242-8126-f6795242bcd7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:19.561354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17680e6b-5f59-4242-8126-f6795242bcd7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:19.561791 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17680e6b-5f59-4242-8126-f6795242bcd7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:19.562482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17680e6b-5f59-4242-8126-f6795242bcd7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:19.562951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17680e6b-5f59-4242-8126-f6795242bcd7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:19.563377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-17680e6b-5f59-4242-8126-f6795242bcd7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:19.709299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-17680e6b-5f59-4242-8126-f6795242bcd7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:05:19.718794 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-17680e6b-5f59-4242-8126-f6795242bcd7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1765 microversion: 2.1 time: 0.169644 Aug 23 19:05:19.719362 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3798/7728] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:05:19 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1765 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:05:20.740308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-80698d79-0a9a-43fc-bd43-2d98a73913f1 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:05:20.740936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-80698d79-0a9a-43fc-bd43-2d98a73913f1 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:05:20.748123 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80698d79-0a9a-43fc-bd43-2d98a73913f1 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:20.748620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80698d79-0a9a-43fc-bd43-2d98a73913f1 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:20.749073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80698d79-0a9a-43fc-bd43-2d98a73913f1 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:20.749778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80698d79-0a9a-43fc-bd43-2d98a73913f1 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:05:20.750243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80698d79-0a9a-43fc-bd43-2d98a73913f1 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:05:20.750714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-80698d79-0a9a-43fc-bd43-2d98a73913f1 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:05:20.897183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-80698d79-0a9a-43fc-bd43-2d98a73913f1 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:05:20.906237 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-80698d79-0a9a-43fc-bd43-2d98a73913f1 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1758 microversion: 2.1 time: 0.169852 Aug 23 19:05:20.906831 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3931/7729] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:05:20 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:06:01.407956 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:06:01.408750 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:06:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:06:49.992535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:06:49.993206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=18 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:06:49.998169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-943e4361-13da-4ebf-895a-15ecfa281673 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1594680239"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:06:49.998746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-943e4361-13da-4ebf-895a-15ecfa281673 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:06:50.005473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-943e4361-13da-4ebf-895a-15ecfa281673 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:50.005961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-943e4361-13da-4ebf-895a-15ecfa281673 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:50.006402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-943e4361-13da-4ebf-895a-15ecfa281673 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:50.007134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-943e4361-13da-4ebf-895a-15ecfa281673 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:50.007594 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-943e4361-13da-4ebf-895a-15ecfa281673 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:50.008025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-943e4361-13da-4ebf-895a-15ecfa281673 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:50.184908 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.network.security_group_api [None req-943e4361-13da-4ebf-895a-15ecfa281673 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Removing security group bf4b7482-02f4-4ae3-9d0a-06e87e63ad8c from port 2d0c7601-b6a4-423b-b782-183605e4abc7 Aug 23 19:06:50.495418 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-943e4361-13da-4ebf-895a-15ecfa281673 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "POST /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/action" status: 202 len: 0 microversion: 2.1 time: 0.503424 Aug 23 19:06:50.496392 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3799/7730] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:06:49 2022] POST /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/action => generated 0 bytes in 506 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:06:50.507840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:06:50.508812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:06:50.587782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-e049a9bc-3698-441d-9556-eddafd110792 req-7345f97a-c4a0-40d9-a92b-42de32622a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc3e13b-4e01-4c24-862d-51665c845839", "tag": "2d0c7601-b6a4-423b-b782-183605e4abc7"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:06:50.598453 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e049a9bc-3698-441d-9556-eddafd110792 req-7345f97a-c4a0-40d9-a92b-42de32622a13 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:50.599287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e049a9bc-3698-441d-9556-eddafd110792 req-7345f97a-c4a0-40d9-a92b-42de32622a13 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:50.599801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e049a9bc-3698-441d-9556-eddafd110792 req-7345f97a-c4a0-40d9-a92b-42de32622a13 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:50.612017 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-e049a9bc-3698-441d-9556-eddafd110792 req-7345f97a-c4a0-40d9-a92b-42de32622a13 service nova] Creating event network-changed:2d0c7601-b6a4-423b-b782-183605e4abc7 for instance 5fc3e13b-4e01-4c24-862d-51665c845839 on n-h2-850468-16 Aug 23 19:06:50.621023 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-e049a9bc-3698-441d-9556-eddafd110792 req-7345f97a-c4a0-40d9-a92b-42de32622a13 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117949 Aug 23 19:06:50.622162 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3932/7731] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:06:51.718249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-66d088a0-398e-466e-99e0-c19871086525 req-11ecffd5-6241-42f4-8772-9f83c31dd1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fc3e13b-4e01-4c24-862d-51665c845839", "tag": "2d0c7601-b6a4-423b-b782-183605e4abc7"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:06:51.729018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-66d088a0-398e-466e-99e0-c19871086525 req-11ecffd5-6241-42f4-8772-9f83c31dd1b4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:51.729498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-66d088a0-398e-466e-99e0-c19871086525 req-11ecffd5-6241-42f4-8772-9f83c31dd1b4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:51.731009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-66d088a0-398e-466e-99e0-c19871086525 req-11ecffd5-6241-42f4-8772-9f83c31dd1b4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:51.744530 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-66d088a0-398e-466e-99e0-c19871086525 req-11ecffd5-6241-42f4-8772-9f83c31dd1b4 service nova] Creating event network-changed:2d0c7601-b6a4-423b-b782-183605e4abc7 for instance 5fc3e13b-4e01-4c24-862d-51665c845839 on n-h2-850468-16 Aug 23 19:06:51.750930 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-66d088a0-398e-466e-99e0-c19871086525 req-11ecffd5-6241-42f4-8772-9f83c31dd1b4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037023 Aug 23 19:06:51.751886 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3800/7732] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:06:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:06:51.764131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fa9eb8d1-9c2e-467e-a076-47132da48cb2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:06:51.764763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fa9eb8d1-9c2e-467e-a076-47132da48cb2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:06:51.771337 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa9eb8d1-9c2e-467e-a076-47132da48cb2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:51.772063 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa9eb8d1-9c2e-467e-a076-47132da48cb2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:51.772531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa9eb8d1-9c2e-467e-a076-47132da48cb2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:51.773268 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa9eb8d1-9c2e-467e-a076-47132da48cb2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:51.773745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa9eb8d1-9c2e-467e-a076-47132da48cb2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:51.774193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fa9eb8d1-9c2e-467e-a076-47132da48cb2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:51.872779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-fa9eb8d1-9c2e-467e-a076-47132da48cb2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lazy-loading 'services' on Instance uuid 5fc3e13b-4e01-4c24-862d-51665c845839 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:06:51.958388 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fa9eb8d1-9c2e-467e-a076-47132da48cb2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments/e6f9f626-60fb-49c2-929e-810b0c1652e1" status: 202 len: 0 microversion: 2.1 time: 0.201543 Aug 23 19:06:51.959063 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3933/7733] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 19:06:51 2022] DELETE /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments/e6f9f626-60fb-49c2-929e-810b0c1652e1 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:06:51.969751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5500c170-a36f-42c8-8458-39da87cc5f76 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:06:51.972421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5500c170-a36f-42c8-8458-39da87cc5f76 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:06:51.981026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5500c170-a36f-42c8-8458-39da87cc5f76 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:51.981830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5500c170-a36f-42c8-8458-39da87cc5f76 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:51.982275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5500c170-a36f-42c8-8458-39da87cc5f76 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:51.983305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5500c170-a36f-42c8-8458-39da87cc5f76 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:51.983772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5500c170-a36f-42c8-8458-39da87cc5f76 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:51.984199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5500c170-a36f-42c8-8458-39da87cc5f76 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:52.018060 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5500c170-a36f-42c8-8458-39da87cc5f76 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054116 Aug 23 19:06:52.018668 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3801/7734] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:06:51 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:06:53.032450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2263b62c-0973-4832-afcb-5cdfb43d1f6c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:06:53.034762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2263b62c-0973-4832-afcb-5cdfb43d1f6c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:06:53.041673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2263b62c-0973-4832-afcb-5cdfb43d1f6c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:53.042182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2263b62c-0973-4832-afcb-5cdfb43d1f6c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:53.042754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2263b62c-0973-4832-afcb-5cdfb43d1f6c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:53.043389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2263b62c-0973-4832-afcb-5cdfb43d1f6c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:53.043863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2263b62c-0973-4832-afcb-5cdfb43d1f6c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:53.044314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2263b62c-0973-4832-afcb-5cdfb43d1f6c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:53.074993 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2263b62c-0973-4832-afcb-5cdfb43d1f6c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047868 Aug 23 19:06:53.075558 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3934/7735] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:06:53 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:06:54.087554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c13de332-8be8-4f81-8eb5-cd7065602fd5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:06:54.092003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c13de332-8be8-4f81-8eb5-cd7065602fd5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:06:54.098743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c13de332-8be8-4f81-8eb5-cd7065602fd5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:54.099241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c13de332-8be8-4f81-8eb5-cd7065602fd5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:54.099687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c13de332-8be8-4f81-8eb5-cd7065602fd5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:54.100391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c13de332-8be8-4f81-8eb5-cd7065602fd5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:54.100848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c13de332-8be8-4f81-8eb5-cd7065602fd5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:54.101279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c13de332-8be8-4f81-8eb5-cd7065602fd5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:54.132150 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c13de332-8be8-4f81-8eb5-cd7065602fd5 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048629 Aug 23 19:06:54.132821 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3802/7736] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:06:54 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:06:55.145653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f0c5c7fc-09c4-425e-abd0-1ba7717a2cc6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:06:55.147885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f0c5c7fc-09c4-425e-abd0-1ba7717a2cc6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:06:55.155906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0c5c7fc-09c4-425e-abd0-1ba7717a2cc6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:55.156405 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0c5c7fc-09c4-425e-abd0-1ba7717a2cc6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:55.156856 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0c5c7fc-09c4-425e-abd0-1ba7717a2cc6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:55.157566 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0c5c7fc-09c4-425e-abd0-1ba7717a2cc6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:55.158033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0c5c7fc-09c4-425e-abd0-1ba7717a2cc6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:55.158472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f0c5c7fc-09c4-425e-abd0-1ba7717a2cc6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:55.189632 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f0c5c7fc-09c4-425e-abd0-1ba7717a2cc6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047990 Aug 23 19:06:55.190204 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3935/7737] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:06:55 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:06:56.201428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-02c0f582-ec78-4343-a120-2f51a77e9716 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:06:56.203609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-02c0f582-ec78-4343-a120-2f51a77e9716 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:06:56.210612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02c0f582-ec78-4343-a120-2f51a77e9716 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:56.211100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02c0f582-ec78-4343-a120-2f51a77e9716 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:56.211537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02c0f582-ec78-4343-a120-2f51a77e9716 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:56.212241 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02c0f582-ec78-4343-a120-2f51a77e9716 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:56.212689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02c0f582-ec78-4343-a120-2f51a77e9716 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:56.213113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-02c0f582-ec78-4343-a120-2f51a77e9716 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:56.245098 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-02c0f582-ec78-4343-a120-2f51a77e9716 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047752 Aug 23 19:06:56.246401 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3803/7738] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:06:56 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:06:57.258389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b6bee4c4-0491-4061-96e6-399c138a7b39 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:06:57.260624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b6bee4c4-0491-4061-96e6-399c138a7b39 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:06:57.268356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6bee4c4-0491-4061-96e6-399c138a7b39 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:57.268849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6bee4c4-0491-4061-96e6-399c138a7b39 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:57.269296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6bee4c4-0491-4061-96e6-399c138a7b39 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:57.270002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6bee4c4-0491-4061-96e6-399c138a7b39 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:57.270468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6bee4c4-0491-4061-96e6-399c138a7b39 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:57.270929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b6bee4c4-0491-4061-96e6-399c138a7b39 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:57.302284 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b6bee4c4-0491-4061-96e6-399c138a7b39 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047930 Aug 23 19:06:57.302885 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3936/7739] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:06:57 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 19:06:57.314075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d6e66648-d9eb-44b6-8e0f-8f9d3729736b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:06:57.314630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d6e66648-d9eb-44b6-8e0f-8f9d3729736b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:06:57.321396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6e66648-d9eb-44b6-8e0f-8f9d3729736b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:57.321893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6e66648-d9eb-44b6-8e0f-8f9d3729736b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:57.322316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6e66648-d9eb-44b6-8e0f-8f9d3729736b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:57.323041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6e66648-d9eb-44b6-8e0f-8f9d3729736b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:06:57.323623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6e66648-d9eb-44b6-8e0f-8f9d3729736b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:06:57.324722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d6e66648-d9eb-44b6-8e0f-8f9d3729736b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:06:57.401377 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-d6e66648-d9eb-44b6-8e0f-8f9d3729736b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] HTTP exception thrown: Instance 5fc3e13b-4e01-4c24-862d-51665c845839 is not attached to volume e6f9f626-60fb-49c2-929e-810b0c1652e1 Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d6e66648-d9eb-44b6-8e0f-8f9d3729736b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Request method failure captured: Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: request: DELETE /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments/e6f9f626-60fb-49c2-929e-810b0c1652e1 HTTP/1.1 Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSQpWwzXicSjrPvt6Y7v_7MSQtrnYuiZwfvChNgThUvARwd3aUREdbYuQRzkccs7dWAtUVlWxQYXtMtwqkwoh0DLBq_TCwQkaXABnmRnJ8W08Drile_HJkBIBpKIy9HWcs5krN9XZGLqUVdnRDpjCBC8GCHxUHKX1UWLssZXaoxXGpA Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 6f5ae2dcaf834c5dba288379fd82fd0d Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestMinimumBasicScenario-1983537687 Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6f5ae2dcaf834c5dba288379fd82fd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f5ae2dcaf834c5dba288379fd82fd0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6f5ae2dcaf834c5dba288379fd82fd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f5ae2dcaf834c5dba288379fd82fd0d"}]}] Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestMinimumBasicScenario-1983537687 Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 6f5ae2dcaf834c5dba288379fd82fd0d Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1983537687 Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestMinimumBasicScenario-1983537687-project Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 470fc9d56e3743baa2906b2d7485284d Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestMinimumBasicScenario-1983537687-project Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 5fc3e13b-4e01-4c24-862d-51665c845839 is not attached to volume e6f9f626-60fb-49c2-929e-810b0c1652e1 Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'server_id': '5fc3e13b-4e01-4c24-862d-51665c845839', 'id': 'e6f9f626-60fb-49c2-929e-810b0c1652e1'} Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id e6f9f626-60fb-49c2-929e-810b0c1652e1. Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc3e13b-4e01-4c24-862d-51665c845839 is not attached to volume e6f9f626-60fb-49c2-929e-810b0c1652e1 Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:06:57.403558 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:06:57.408236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:06:57.408236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:06:57.408236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc3e13b-4e01-4c24-862d-51665c845839 is not attached to volume e6f9f626-60fb-49c2-929e-810b0c1652e1 Aug 23 19:06:57.408236 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:06:57.408236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d6e66648-d9eb-44b6-8e0f-8f9d3729736b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Returning 404 to user: Instance 5fc3e13b-4e01-4c24-862d-51665c845839 is not attached to volume e6f9f626-60fb-49c2-929e-810b0c1652e1 {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:06:57.408236 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d6e66648-d9eb-44b6-8e0f-8f9d3729736b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments/e6f9f626-60fb-49c2-929e-810b0c1652e1" status: 404 len: 154 microversion: 2.1 time: 0.095169 Aug 23 19:06:57.408236 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3804/7740] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 19:06:57 2022] DELETE /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839/os-volume_attachments/e6f9f626-60fb-49c2-929e-810b0c1652e1 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:07:00.667647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fcfd683c-8fad-4ce8-9a58-c772727ab6a6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:00.668584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fcfd683c-8fad-4ce8-9a58-c772727ab6a6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:00.675161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcfd683c-8fad-4ce8-9a58-c772727ab6a6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:00.675663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcfd683c-8fad-4ce8-9a58-c772727ab6a6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:00.676119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcfd683c-8fad-4ce8-9a58-c772727ab6a6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:00.676860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcfd683c-8fad-4ce8-9a58-c772727ab6a6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:00.677334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcfd683c-8fad-4ce8-9a58-c772727ab6a6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:00.677781 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fcfd683c-8fad-4ce8-9a58-c772727ab6a6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:00.706348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fcfd683c-8fad-4ce8-9a58-c772727ab6a6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:07:00.796683 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fcfd683c-8fad-4ce8-9a58-c772727ab6a6 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 204 len: 0 microversion: 2.1 time: 0.132634 Aug 23 19:07:00.800057 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3937/7741] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:07:00 2022] DELETE /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:07:00.806107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2972c6a0-f665-4c22-a4ea-79239125b544 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:00.806787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2972c6a0-f665-4c22-a4ea-79239125b544 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:00.814849 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2972c6a0-f665-4c22-a4ea-79239125b544 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:00.815323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2972c6a0-f665-4c22-a4ea-79239125b544 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:00.815790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2972c6a0-f665-4c22-a4ea-79239125b544 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:00.816503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2972c6a0-f665-4c22-a4ea-79239125b544 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:00.816954 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2972c6a0-f665-4c22-a4ea-79239125b544 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:00.817376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2972c6a0-f665-4c22-a4ea-79239125b544 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:00.950882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2972c6a0-f665-4c22-a4ea-79239125b544 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:00.959211 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2972c6a0-f665-4c22-a4ea-79239125b544 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1552 microversion: 2.1 time: 0.157807 Aug 23 19:07:00.959776 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3805/7742] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:00 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:01.983128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f9eed85-06b5-4313-ad7a-d07737f9ef89 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:01.983853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0f9eed85-06b5-4313-ad7a-d07737f9ef89 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:01.991016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f9eed85-06b5-4313-ad7a-d07737f9ef89 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:01.991645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f9eed85-06b5-4313-ad7a-d07737f9ef89 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:01.992208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f9eed85-06b5-4313-ad7a-d07737f9ef89 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:01.992925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f9eed85-06b5-4313-ad7a-d07737f9ef89 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:01.993403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f9eed85-06b5-4313-ad7a-d07737f9ef89 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:01.993852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f9eed85-06b5-4313-ad7a-d07737f9ef89 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:02.132652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0f9eed85-06b5-4313-ad7a-d07737f9ef89 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:02.141138 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0f9eed85-06b5-4313-ad7a-d07737f9ef89 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1552 microversion: 2.1 time: 0.163323 Aug 23 19:07:02.141722 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3938/7743] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:01 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1552 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:02.943747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-99af40de-6164-43fb-b249-a4dd0f07fc42 req-50fa3d68-de01-4b45-8d07-126bf02703b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fc3e13b-4e01-4c24-862d-51665c845839", "name": "network-vif-deleted", "tag": "2d0c7601-b6a4-423b-b782-183605e4abc7"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:07:02.955125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-99af40de-6164-43fb-b249-a4dd0f07fc42 req-50fa3d68-de01-4b45-8d07-126bf02703b5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:02.955612 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-99af40de-6164-43fb-b249-a4dd0f07fc42 req-50fa3d68-de01-4b45-8d07-126bf02703b5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:02.956046 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-99af40de-6164-43fb-b249-a4dd0f07fc42 req-50fa3d68-de01-4b45-8d07-126bf02703b5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:02.969726 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-99af40de-6164-43fb-b249-a4dd0f07fc42 req-50fa3d68-de01-4b45-8d07-126bf02703b5 service nova] Creating event network-vif-deleted:2d0c7601-b6a4-423b-b782-183605e4abc7 for instance 5fc3e13b-4e01-4c24-862d-51665c845839 on n-h2-850468-16 Aug 23 19:07:02.974651 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-99af40de-6164-43fb-b249-a4dd0f07fc42 req-50fa3d68-de01-4b45-8d07-126bf02703b5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034610 Aug 23 19:07:02.975266 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3806/7744] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:07:03.162186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:03.162769 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:03.170375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:03.170904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:03.171371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:03.172083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:03.172558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:03.173004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:03.203342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:03.203840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:03.204294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:03.204764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lazy-loading 'fault' on Instance uuid 5fc3e13b-4e01-4c24-862d-51665c845839 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:07:03.248344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:03.256541 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6510e8c6-79d9-4fac-b1ca-fd95b9065bd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 200 len: 1347 microversion: 2.1 time: 0.098315 Aug 23 19:07:03.257136 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3939/7745] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:03 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 1347 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:04.278702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc906c6c-88c5-41f2-967e-ef17b876b646 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:04.279411 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fc906c6c-88c5-41f2-967e-ef17b876b646 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 5fc3e13b-4e01-4c24-862d-51665c845839] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:04.285678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc906c6c-88c5-41f2-967e-ef17b876b646 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:04.286164 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc906c6c-88c5-41f2-967e-ef17b876b646 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:04.286630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc906c6c-88c5-41f2-967e-ef17b876b646 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:04.287326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc906c6c-88c5-41f2-967e-ef17b876b646 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:04.287781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc906c6c-88c5-41f2-967e-ef17b876b646 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:04.288209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc906c6c-88c5-41f2-967e-ef17b876b646 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:04.301380 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-fc906c6c-88c5-41f2-967e-ef17b876b646 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] HTTP exception thrown: Instance 5fc3e13b-4e01-4c24-862d-51665c845839 could not be found. Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc906c6c-88c5-41f2-967e-ef17b876b646 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Request method failure captured: Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 HTTP/1.1 Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSQpWwzXicSjrPvt6Y7v_7MSQtrnYuiZwfvChNgThUvARwd3aUREdbYuQRzkccs7dWAtUVlWxQYXtMtwqkwoh0DLBq_TCwQkaXABnmRnJ8W08Drile_HJkBIBpKIy9HWcs5krN9XZGLqUVdnRDpjCBC8GCHxUHKX1UWLssZXaoxXGpA Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 6f5ae2dcaf834c5dba288379fd82fd0d Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestMinimumBasicScenario-1983537687 Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6f5ae2dcaf834c5dba288379fd82fd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f5ae2dcaf834c5dba288379fd82fd0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6f5ae2dcaf834c5dba288379fd82fd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f5ae2dcaf834c5dba288379fd82fd0d"}]}] Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestMinimumBasicScenario-1983537687 Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 6f5ae2dcaf834c5dba288379fd82fd0d Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1983537687 Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestMinimumBasicScenario-1983537687-project Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 470fc9d56e3743baa2906b2d7485284d Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestMinimumBasicScenario-1983537687-project Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 5fc3e13b-4e01-4c24-862d-51665c845839 could not be found. Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '5fc3e13b-4e01-4c24-862d-51665c845839'} Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fc3e13b-4e01-4c24-862d-51665c845839 could not be found. Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fc3e13b-4e01-4c24-862d-51665c845839 could not be found. Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:07:04.303078 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:07:04.308362 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:07:04.308362 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:07:04.308362 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:07:04.308362 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:07:04.308362 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:07:04.308362 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fc3e13b-4e01-4c24-862d-51665c845839 could not be found. Aug 23 19:07:04.308362 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:07:04.308362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc906c6c-88c5-41f2-967e-ef17b876b646 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Returning 404 to user: Instance 5fc3e13b-4e01-4c24-862d-51665c845839 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:07:04.308362 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fc906c6c-88c5-41f2-967e-ef17b876b646 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839" status: 404 len: 111 microversion: 2.1 time: 0.030946 Aug 23 19:07:04.308362 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3807/7746] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:04 2022] GET /compute/v2.1/servers/5fc3e13b-4e01-4c24-862d-51665c845839 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:07:04.313996 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f8bc803-3b2c-4cbd-a7a6-6902e71d70d2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '.version_select at 0x7f27df5dc700>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:04.337689 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7f8bc803-3b2c-4cbd-a7a6-6902e71d70d2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1396331113" status: 202 len: 0 microversion: 2.1 time: 0.027478 Aug 23 19:07:04.338267 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3940/7747] 10.222.0.61 () {58 vars in 1272 bytes} [Tue Aug 23 19:07:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1396331113 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:07:13.281614 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7f941d67-5da8-43d0-9e9b-3a47e6f20cd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Action: 'create', calling method: .version_select at 0x7f27dfa718b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-351697345", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCa0Bkdpt9zUi+d2O0fuohCENFDm7bz3Ra+LcUyt+YTikDjfEsTGHQAVSiyDjeHcddIJuYbtahWYbLrNqD80oNVBjPaaqXUqoeeiMATEAE+IYGCbGi4Kgq7kWUpVU/0A5g=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:07:13.298942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7f941d67-5da8-43d0-9e9b-3a47e6f20cd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Getting quotas for project 6f5ae2dcaf834c5dba288379fd82fd0d. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:07:13.304024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7f941d67-5da8-43d0-9e9b-3a47e6f20cd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Getting quotas for user 470fc9d56e3743baa2906b2d7485284d and project 6f5ae2dcaf834c5dba288379fd82fd0d. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:07:13.329690 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7f941d67-5da8-43d0-9e9b-3a47e6f20cd8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.104247 Aug 23 19:07:13.330277 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3808/7748] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 19:07:13 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:07:13.378586 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:07:13.383380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1996681182", "imageRef": "8e1cca86-885d-42c0-950a-2946142e65b3", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-351697345", "networks": [{"uuid": "7774ea68-748d-4900-8929-c3ec96edc294"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:07:13.435912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] validate_networks() for [('7774ea68-748d-4900-8929-c3ec96edc294', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:07:14.099376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:07:14.099848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:07:14.100349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:07:14.100783 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:07:14.101217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:07:14.110259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:14.110800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:14.111261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:14.112015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:14.112496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:14.113004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:14.130808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Getting quotas for project 6f5ae2dcaf834c5dba288379fd82fd0d. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:07:14.139118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Getting quotas for user 470fc9d56e3743baa2906b2d7485284d and project 6f5ae2dcaf834c5dba288379fd82fd0d. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:07:14.153496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:07:14.155816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8e1cca86-885d-42c0-950a-2946142e65b3',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:07:14.203601 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d3454d6b-fee9-4b14-a4dc-99b1fb8b20aa tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826792 Aug 23 19:07:14.204273 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3941/7749] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:07:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:07:14.216245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bd607948-23c5-461c-8e53-b65fda7cbb96 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:14.216960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bd607948-23c5-461c-8e53-b65fda7cbb96 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:14.273397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bd607948-23c5-461c-8e53-b65fda7cbb96 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:14.280992 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bd607948-23c5-461c-8e53-b65fda7cbb96 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1258 microversion: 2.1 time: 0.070065 Aug 23 19:07:14.281571 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3809/7750] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:14 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1258 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:15.302518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-667ae938-55aa-4842-a421-d0b63d84b5e9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:15.304848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-667ae938-55aa-4842-a421-d0b63d84b5e9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:15.311682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-667ae938-55aa-4842-a421-d0b63d84b5e9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:15.312200 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-667ae938-55aa-4842-a421-d0b63d84b5e9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:15.312662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-667ae938-55aa-4842-a421-d0b63d84b5e9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:15.313615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-667ae938-55aa-4842-a421-d0b63d84b5e9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:15.314097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-667ae938-55aa-4842-a421-d0b63d84b5e9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:15.314725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-667ae938-55aa-4842-a421-d0b63d84b5e9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:15.386191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-667ae938-55aa-4842-a421-d0b63d84b5e9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:15.396201 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-667ae938-55aa-4842-a421-d0b63d84b5e9 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1328 microversion: 2.1 time: 0.098584 Aug 23 19:07:15.406897 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3942/7751] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:15 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1328 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:16.420171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-db7f2bd0-2bed-45c0-b5cc-e15838341808 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:16.421511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-db7f2bd0-2bed-45c0-b5cc-e15838341808 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:16.428803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=40 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:07:16.431833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db7f2bd0-2bed-45c0-b5cc-e15838341808 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:16.432666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db7f2bd0-2bed-45c0-b5cc-e15838341808 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:16.433423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db7f2bd0-2bed-45c0-b5cc-e15838341808 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:16.434306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db7f2bd0-2bed-45c0-b5cc-e15838341808 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:16.434942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db7f2bd0-2bed-45c0-b5cc-e15838341808 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:16.435539 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db7f2bd0-2bed-45c0-b5cc-e15838341808 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:16.641267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-db7f2bd0-2bed-45c0-b5cc-e15838341808 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:16.654747 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-db7f2bd0-2bed-45c0-b5cc-e15838341808 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.238644 Aug 23 19:07:16.671492 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3810/7752] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:16 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:17.678673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dfbc96b5-daf4-42f1-a4e6-08214ac0c372 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:17.679814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dfbc96b5-daf4-42f1-a4e6-08214ac0c372 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:17.686072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfbc96b5-daf4-42f1-a4e6-08214ac0c372 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:17.686704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfbc96b5-daf4-42f1-a4e6-08214ac0c372 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:17.687231 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfbc96b5-daf4-42f1-a4e6-08214ac0c372 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:17.688030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfbc96b5-daf4-42f1-a4e6-08214ac0c372 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:17.688585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfbc96b5-daf4-42f1-a4e6-08214ac0c372 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:17.689100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dfbc96b5-daf4-42f1-a4e6-08214ac0c372 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:17.841910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dfbc96b5-daf4-42f1-a4e6-08214ac0c372 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:17.850723 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dfbc96b5-daf4-42f1-a4e6-08214ac0c372 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.177080 Aug 23 19:07:17.864668 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3943/7753] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:17 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:18.873159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff595bdb-5cf3-4550-8f31-346474801c17 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:18.873800 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff595bdb-5cf3-4550-8f31-346474801c17 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:18.880638 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff595bdb-5cf3-4550-8f31-346474801c17 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:18.881125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff595bdb-5cf3-4550-8f31-346474801c17 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:18.881605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff595bdb-5cf3-4550-8f31-346474801c17 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:18.882349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff595bdb-5cf3-4550-8f31-346474801c17 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:18.883020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff595bdb-5cf3-4550-8f31-346474801c17 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:18.883447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff595bdb-5cf3-4550-8f31-346474801c17 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:19.029386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff595bdb-5cf3-4550-8f31-346474801c17 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:19.038580 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff595bdb-5cf3-4550-8f31-346474801c17 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.169840 Aug 23 19:07:19.039170 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3811/7754] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:18 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:20.061347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3cd050c6-0f60-4cf0-9e50-72f4d0a71158 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:20.062060 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3cd050c6-0f60-4cf0-9e50-72f4d0a71158 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:20.070295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cd050c6-0f60-4cf0-9e50-72f4d0a71158 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:20.070926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cd050c6-0f60-4cf0-9e50-72f4d0a71158 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:20.071456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cd050c6-0f60-4cf0-9e50-72f4d0a71158 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:20.072291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cd050c6-0f60-4cf0-9e50-72f4d0a71158 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:20.072948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cd050c6-0f60-4cf0-9e50-72f4d0a71158 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:20.073761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cd050c6-0f60-4cf0-9e50-72f4d0a71158 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:20.224253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3cd050c6-0f60-4cf0-9e50-72f4d0a71158 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:20.234095 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3cd050c6-0f60-4cf0-9e50-72f4d0a71158 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.177587 Aug 23 19:07:20.247570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3944/7755] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:20 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:21.257109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8102b96e-3a02-468e-b515-4485e6cc4651 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:21.257958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8102b96e-3a02-468e-b515-4485e6cc4651 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:21.260722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:07:21.267220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8102b96e-3a02-468e-b515-4485e6cc4651 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:21.268065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8102b96e-3a02-468e-b515-4485e6cc4651 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:21.268925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8102b96e-3a02-468e-b515-4485e6cc4651 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:21.269876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8102b96e-3a02-468e-b515-4485e6cc4651 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:21.270347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8102b96e-3a02-468e-b515-4485e6cc4651 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:21.270809 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8102b96e-3a02-468e-b515-4485e6cc4651 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:21.446358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8102b96e-3a02-468e-b515-4485e6cc4651 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:21.455194 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8102b96e-3a02-468e-b515-4485e6cc4651 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.202726 Aug 23 19:07:21.458580 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3812/7756] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:21 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:22.477564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2a42439c-32b9-4b79-b4cc-19af3fd64916 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:22.478580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2a42439c-32b9-4b79-b4cc-19af3fd64916 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:22.481744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:07:22.488182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a42439c-32b9-4b79-b4cc-19af3fd64916 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:22.488693 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a42439c-32b9-4b79-b4cc-19af3fd64916 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:22.489179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a42439c-32b9-4b79-b4cc-19af3fd64916 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:22.489903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a42439c-32b9-4b79-b4cc-19af3fd64916 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:22.490370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a42439c-32b9-4b79-b4cc-19af3fd64916 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:22.490900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2a42439c-32b9-4b79-b4cc-19af3fd64916 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:22.641381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2a42439c-32b9-4b79-b4cc-19af3fd64916 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:22.649375 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2a42439c-32b9-4b79-b4cc-19af3fd64916 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.175925 Aug 23 19:07:22.649963 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3945/7757] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:22 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:23.670416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a5b8959c-0a5e-4fc3-9c0f-0aa97f72ae63 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:23.671087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a5b8959c-0a5e-4fc3-9c0f-0aa97f72ae63 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:23.677947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5b8959c-0a5e-4fc3-9c0f-0aa97f72ae63 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:23.678427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5b8959c-0a5e-4fc3-9c0f-0aa97f72ae63 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:23.678901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5b8959c-0a5e-4fc3-9c0f-0aa97f72ae63 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:23.679592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5b8959c-0a5e-4fc3-9c0f-0aa97f72ae63 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:23.680045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5b8959c-0a5e-4fc3-9c0f-0aa97f72ae63 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:23.680470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a5b8959c-0a5e-4fc3-9c0f-0aa97f72ae63 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:23.811599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a5b8959c-0a5e-4fc3-9c0f-0aa97f72ae63 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:23.819349 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a5b8959c-0a5e-4fc3-9c0f-0aa97f72ae63 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.152912 Aug 23 19:07:23.819910 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3813/7758] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:23 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:24.841622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-28777fe4-096e-433b-97be-eb5814814f24 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:24.842247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-28777fe4-096e-433b-97be-eb5814814f24 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:24.845009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:07:24.845683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:07:24.851390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28777fe4-096e-433b-97be-eb5814814f24 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:24.852225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28777fe4-096e-433b-97be-eb5814814f24 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:24.852683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28777fe4-096e-433b-97be-eb5814814f24 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:24.853400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28777fe4-096e-433b-97be-eb5814814f24 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:24.853868 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28777fe4-096e-433b-97be-eb5814814f24 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:24.855225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28777fe4-096e-433b-97be-eb5814814f24 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:24.988359 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-28777fe4-096e-433b-97be-eb5814814f24 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:24.996841 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-28777fe4-096e-433b-97be-eb5814814f24 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.159703 Aug 23 19:07:24.997454 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3946/7759] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:24 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:26.017389 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-53913cc1-f8e2-4b1f-9575-f8098aee8fdf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:26.018006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-53913cc1-f8e2-4b1f-9575-f8098aee8fdf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:26.019922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:07:26.026228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53913cc1-f8e2-4b1f-9575-f8098aee8fdf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:26.026755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53913cc1-f8e2-4b1f-9575-f8098aee8fdf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:26.027199 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53913cc1-f8e2-4b1f-9575-f8098aee8fdf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:26.027896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53913cc1-f8e2-4b1f-9575-f8098aee8fdf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:26.028350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53913cc1-f8e2-4b1f-9575-f8098aee8fdf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:26.028781 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-53913cc1-f8e2-4b1f-9575-f8098aee8fdf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:26.160861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-53913cc1-f8e2-4b1f-9575-f8098aee8fdf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:26.169280 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-53913cc1-f8e2-4b1f-9575-f8098aee8fdf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.155732 Aug 23 19:07:26.169853 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3814/7760] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:26 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:26.933124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4b156dd7-042b-4d38-9448-9d223db9df01 req-bc6a5801-9066-49c9-8258-235009da8f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f751743-0315-47a9-86d2-1198ada02ae7", "tag": "8abb5e25-2f25-4272-8fc3-19ac776b382f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:07:26.944076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4b156dd7-042b-4d38-9448-9d223db9df01 req-bc6a5801-9066-49c9-8258-235009da8f30 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:26.944571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4b156dd7-042b-4d38-9448-9d223db9df01 req-bc6a5801-9066-49c9-8258-235009da8f30 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:26.945016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4b156dd7-042b-4d38-9448-9d223db9df01 req-bc6a5801-9066-49c9-8258-235009da8f30 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:26.957859 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4b156dd7-042b-4d38-9448-9d223db9df01 req-bc6a5801-9066-49c9-8258-235009da8f30 service nova] Creating event network-changed:8abb5e25-2f25-4272-8fc3-19ac776b382f for instance 9f751743-0315-47a9-86d2-1198ada02ae7 on n-h1-850468-16 Aug 23 19:07:26.964087 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4b156dd7-042b-4d38-9448-9d223db9df01 req-bc6a5801-9066-49c9-8258-235009da8f30 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034305 Aug 23 19:07:26.965311 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3947/7761] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:07:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:07:27.193116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a45fe20c-cb9c-469f-be0b-b7b77d210729 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:27.193731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a45fe20c-cb9c-469f-be0b-b7b77d210729 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:27.200678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a45fe20c-cb9c-469f-be0b-b7b77d210729 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:27.201167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a45fe20c-cb9c-469f-be0b-b7b77d210729 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:27.201605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a45fe20c-cb9c-469f-be0b-b7b77d210729 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:27.202308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a45fe20c-cb9c-469f-be0b-b7b77d210729 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:27.202790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a45fe20c-cb9c-469f-be0b-b7b77d210729 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:27.203221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a45fe20c-cb9c-469f-be0b-b7b77d210729 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:27.411531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a45fe20c-cb9c-469f-be0b-b7b77d210729 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:27.420171 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a45fe20c-cb9c-469f-be0b-b7b77d210729 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.230935 Aug 23 19:07:27.420848 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3815/7762] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:27 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:28.441656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f7f6a95-3ce0-4076-a5c7-7225496b1c07 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:28.442289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7f7f6a95-3ce0-4076-a5c7-7225496b1c07 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:28.448588 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f7f6a95-3ce0-4076-a5c7-7225496b1c07 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:28.449171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f7f6a95-3ce0-4076-a5c7-7225496b1c07 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:28.449622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f7f6a95-3ce0-4076-a5c7-7225496b1c07 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:28.450327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f7f6a95-3ce0-4076-a5c7-7225496b1c07 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:28.450814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f7f6a95-3ce0-4076-a5c7-7225496b1c07 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:28.451255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f7f6a95-3ce0-4076-a5c7-7225496b1c07 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:28.582092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7f7f6a95-3ce0-4076-a5c7-7225496b1c07 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:28.590378 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7f7f6a95-3ce0-4076-a5c7-7225496b1c07 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.153688 Aug 23 19:07:28.590976 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3948/7763] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:28 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:29.611031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5cceabdd-1e47-4c50-9190-5b1dcd630b11 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:29.611683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5cceabdd-1e47-4c50-9190-5b1dcd630b11 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:29.620378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cceabdd-1e47-4c50-9190-5b1dcd630b11 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:29.621243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cceabdd-1e47-4c50-9190-5b1dcd630b11 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:29.621692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cceabdd-1e47-4c50-9190-5b1dcd630b11 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:29.622416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cceabdd-1e47-4c50-9190-5b1dcd630b11 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:29.622910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cceabdd-1e47-4c50-9190-5b1dcd630b11 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:29.623346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5cceabdd-1e47-4c50-9190-5b1dcd630b11 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:29.770061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5cceabdd-1e47-4c50-9190-5b1dcd630b11 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:29.777909 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5cceabdd-1e47-4c50-9190-5b1dcd630b11 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.170736 Aug 23 19:07:29.778481 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3816/7764] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:29 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:30.798814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a2a87911-5945-4eb0-8465-2c630cb9ffd2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:30.799446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a2a87911-5945-4eb0-8465-2c630cb9ffd2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:30.807801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2a87911-5945-4eb0-8465-2c630cb9ffd2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:30.808647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2a87911-5945-4eb0-8465-2c630cb9ffd2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:30.809450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2a87911-5945-4eb0-8465-2c630cb9ffd2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:30.810477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2a87911-5945-4eb0-8465-2c630cb9ffd2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:30.811378 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2a87911-5945-4eb0-8465-2c630cb9ffd2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:30.812000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a2a87911-5945-4eb0-8465-2c630cb9ffd2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:30.944904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a2a87911-5945-4eb0-8465-2c630cb9ffd2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:30.953338 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a2a87911-5945-4eb0-8465-2c630cb9ffd2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.158487 Aug 23 19:07:30.953913 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3949/7765] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:30 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:07:31.974911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-479da1f0-4464-4072-aa76-f0ad54083e10 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:31.975893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-479da1f0-4464-4072-aa76-f0ad54083e10 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:31.985946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-479da1f0-4464-4072-aa76-f0ad54083e10 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:31.986709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-479da1f0-4464-4072-aa76-f0ad54083e10 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:31.987273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-479da1f0-4464-4072-aa76-f0ad54083e10 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:31.991479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-479da1f0-4464-4072-aa76-f0ad54083e10 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:31.991962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-479da1f0-4464-4072-aa76-f0ad54083e10 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:31.992401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-479da1f0-4464-4072-aa76-f0ad54083e10 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:32.133170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-479da1f0-4464-4072-aa76-f0ad54083e10 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:32.141804 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-479da1f0-4464-4072-aa76-f0ad54083e10 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.171356 Aug 23 19:07:32.142372 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3817/7766] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:31 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:33.162582 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7b300269-f28b-456e-bc64-3c17634d7313 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:33.163220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7b300269-f28b-456e-bc64-3c17634d7313 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:33.171274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b300269-f28b-456e-bc64-3c17634d7313 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:33.171782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b300269-f28b-456e-bc64-3c17634d7313 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:33.172240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b300269-f28b-456e-bc64-3c17634d7313 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:33.172982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b300269-f28b-456e-bc64-3c17634d7313 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:33.173456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b300269-f28b-456e-bc64-3c17634d7313 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:33.173904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7b300269-f28b-456e-bc64-3c17634d7313 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:33.307166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7b300269-f28b-456e-bc64-3c17634d7313 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:33.315035 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7b300269-f28b-456e-bc64-3c17634d7313 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.156430 Aug 23 19:07:33.315627 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3950/7767] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:33 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:33.830685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-a253cf8e-07ac-4d3d-a1b7-d24943516cbf req-e8da638b-8bac-4f8c-a499-7efc9742a74d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f751743-0315-47a9-86d2-1198ada02ae7", "name": "network-vif-plugged", "status": "completed", "tag": "8abb5e25-2f25-4272-8fc3-19ac776b382f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:07:33.841034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a253cf8e-07ac-4d3d-a1b7-d24943516cbf req-e8da638b-8bac-4f8c-a499-7efc9742a74d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:33.841148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a253cf8e-07ac-4d3d-a1b7-d24943516cbf req-e8da638b-8bac-4f8c-a499-7efc9742a74d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:33.841559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-a253cf8e-07ac-4d3d-a1b7-d24943516cbf req-e8da638b-8bac-4f8c-a499-7efc9742a74d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:33.852552 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-a253cf8e-07ac-4d3d-a1b7-d24943516cbf req-e8da638b-8bac-4f8c-a499-7efc9742a74d service nova] Creating event network-vif-plugged:8abb5e25-2f25-4272-8fc3-19ac776b382f for instance 9f751743-0315-47a9-86d2-1198ada02ae7 on n-h1-850468-16 Aug 23 19:07:33.858444 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-a253cf8e-07ac-4d3d-a1b7-d24943516cbf req-e8da638b-8bac-4f8c-a499-7efc9742a74d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088443 Aug 23 19:07:33.859083 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3818/7768] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:07:34.335880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3dba091-f1ad-46b5-8d9f-1e2f9730b758 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:34.336511 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d3dba091-f1ad-46b5-8d9f-1e2f9730b758 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:34.344254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3dba091-f1ad-46b5-8d9f-1e2f9730b758 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:34.344751 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3dba091-f1ad-46b5-8d9f-1e2f9730b758 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:34.345207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3dba091-f1ad-46b5-8d9f-1e2f9730b758 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:34.345918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3dba091-f1ad-46b5-8d9f-1e2f9730b758 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:34.346389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3dba091-f1ad-46b5-8d9f-1e2f9730b758 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:34.346858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3dba091-f1ad-46b5-8d9f-1e2f9730b758 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:34.482767 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d3dba091-f1ad-46b5-8d9f-1e2f9730b758 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:34.490496 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d3dba091-f1ad-46b5-8d9f-1e2f9730b758 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1358 microversion: 2.1 time: 0.158585 Aug 23 19:07:34.491098 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3951/7769] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:34 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:35.513033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0a70f90f-5897-4944-81c7-31b1b4f187ef tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:35.513747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0a70f90f-5897-4944-81c7-31b1b4f187ef tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:35.520924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a70f90f-5897-4944-81c7-31b1b4f187ef tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:35.521415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a70f90f-5897-4944-81c7-31b1b4f187ef tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:35.521861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a70f90f-5897-4944-81c7-31b1b4f187ef tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:35.522579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a70f90f-5897-4944-81c7-31b1b4f187ef tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:35.523045 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a70f90f-5897-4944-81c7-31b1b4f187ef tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:35.523691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a70f90f-5897-4944-81c7-31b1b4f187ef tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:35.657541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0a70f90f-5897-4944-81c7-31b1b4f187ef tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:35.665431 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0a70f90f-5897-4944-81c7-31b1b4f187ef tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1547 microversion: 2.1 time: 0.157753 Aug 23 19:07:35.666010 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3819/7770] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:35 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:35.686485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b231dcc3-1bbd-467d-be59-7bf7fe023987 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:35.687175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b231dcc3-1bbd-467d-be59-7bf7fe023987 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:35.694114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b231dcc3-1bbd-467d-be59-7bf7fe023987 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:35.694652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b231dcc3-1bbd-467d-be59-7bf7fe023987 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:35.695111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b231dcc3-1bbd-467d-be59-7bf7fe023987 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:35.695822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b231dcc3-1bbd-467d-be59-7bf7fe023987 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:35.696294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b231dcc3-1bbd-467d-be59-7bf7fe023987 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:35.696762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b231dcc3-1bbd-467d-be59-7bf7fe023987 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:35.827408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b231dcc3-1bbd-467d-be59-7bf7fe023987 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:35.835187 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b231dcc3-1bbd-467d-be59-7bf7fe023987 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1547 microversion: 2.1 time: 0.153223 Aug 23 19:07:35.835766 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3952/7771] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:35 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1547 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:35.854979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0cfafb06-69c6-493a-817f-a99d149e5723 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:35.859510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0cfafb06-69c6-493a-817f-a99d149e5723 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:35.860265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0cfafb06-69c6-493a-817f-a99d149e5723 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Searching by: {'deleted': False, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d'} {{(pid=128807) get_all /opt/stack/nova/nova/compute/api.py:3004}} Aug 23 19:07:35.865507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cfafb06-69c6-493a-817f-a99d149e5723 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:35.865981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cfafb06-69c6-493a-817f-a99d149e5723 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:35.866410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cfafb06-69c6-493a-817f-a99d149e5723 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:35.867194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cfafb06-69c6-493a-817f-a99d149e5723 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:35.867644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cfafb06-69c6-493a-817f-a99d149e5723 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:35.868065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0cfafb06-69c6-493a-817f-a99d149e5723 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:35.891475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.multi_cell_list [None req-0cfafb06-69c6-493a-817f-a99d149e5723 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=128807) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 23 19:07:35.919160 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0cfafb06-69c6-493a-817f-a99d149e5723 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068071 Aug 23 19:07:35.919737 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3820/7772] 10.222.0.61 () {58 vars in 1125 bytes} [Tue Aug 23 19:07:35 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:07:35.931094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3d5f2ce9-573b-43de-862a-e7964017482f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:35.931730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3d5f2ce9-573b-43de-862a-e7964017482f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:35.937960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d5f2ce9-573b-43de-862a-e7964017482f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:35.938454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d5f2ce9-573b-43de-862a-e7964017482f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:35.938946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d5f2ce9-573b-43de-862a-e7964017482f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:35.939635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d5f2ce9-573b-43de-862a-e7964017482f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:35.940103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d5f2ce9-573b-43de-862a-e7964017482f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:35.940536 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3d5f2ce9-573b-43de-862a-e7964017482f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:36.068132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3d5f2ce9-573b-43de-862a-e7964017482f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:36.076709 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3d5f2ce9-573b-43de-862a-e7964017482f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1547 microversion: 2.1 time: 0.149470 Aug 23 19:07:36.077281 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3953/7773] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:35 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:37.581760 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e7dc78e2-a714-4e6a-aecb-2df308d6491b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "84ec5018-7a04-4a5f-9a8e-604de4c9aac8"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:07:37.584165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e7dc78e2-a714-4e6a-aecb-2df308d6491b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:37.591490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7dc78e2-a714-4e6a-aecb-2df308d6491b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:37.591981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7dc78e2-a714-4e6a-aecb-2df308d6491b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:37.592422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7dc78e2-a714-4e6a-aecb-2df308d6491b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:37.593134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7dc78e2-a714-4e6a-aecb-2df308d6491b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:37.593597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7dc78e2-a714-4e6a-aecb-2df308d6491b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:37.594034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e7dc78e2-a714-4e6a-aecb-2df308d6491b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:37.831501 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e7dc78e2-a714-4e6a-aecb-2df308d6491b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "POST /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253603 Aug 23 19:07:37.832351 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3821/7774] 10.222.0.61 () {60 vars in 1323 bytes} [Tue Aug 23 19:07:37 2022] POST /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:07:41.891013 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:07:41.891647 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:07:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:07:48.597199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5c63645d-f761-4290-8c21-197f7312ac69 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:48.597835 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5c63645d-f761-4290-8c21-197f7312ac69 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:48.600240 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=17 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:07:48.600914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=70 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:07:48.606724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c63645d-f761-4290-8c21-197f7312ac69 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:48.607237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c63645d-f761-4290-8c21-197f7312ac69 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:48.607698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c63645d-f761-4290-8c21-197f7312ac69 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:48.608424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c63645d-f761-4290-8c21-197f7312ac69 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:48.608903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c63645d-f761-4290-8c21-197f7312ac69 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:48.609352 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5c63645d-f761-4290-8c21-197f7312ac69 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:48.744636 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5c63645d-f761-4290-8c21-197f7312ac69 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:48.753680 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5c63645d-f761-4290-8c21-197f7312ac69 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1593 microversion: 2.1 time: 0.160526 Aug 23 19:07:48.754256 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3954/7775] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:48 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1593 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:50.437439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-7272ebdb-2752-4e50-aab7-c03a49030df2 req-de21076f-751a-4bfd-90e0-7687f28fde5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f751743-0315-47a9-86d2-1198ada02ae7", "tag": "8abb5e25-2f25-4272-8fc3-19ac776b382f"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:07:50.443127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:07:50.444409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=19 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:07:50.445324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:07:50.452005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7272ebdb-2752-4e50-aab7-c03a49030df2 req-de21076f-751a-4bfd-90e0-7687f28fde5b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:50.452491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7272ebdb-2752-4e50-aab7-c03a49030df2 req-de21076f-751a-4bfd-90e0-7687f28fde5b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:50.453203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7272ebdb-2752-4e50-aab7-c03a49030df2 req-de21076f-751a-4bfd-90e0-7687f28fde5b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:50.467215 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-7272ebdb-2752-4e50-aab7-c03a49030df2 req-de21076f-751a-4bfd-90e0-7687f28fde5b service nova] Creating event network-changed:8abb5e25-2f25-4272-8fc3-19ac776b382f for instance 9f751743-0315-47a9-86d2-1198ada02ae7 on n-h1-850468-16 Aug 23 19:07:50.473505 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-7272ebdb-2752-4e50-aab7-c03a49030df2 req-de21076f-751a-4bfd-90e0-7687f28fde5b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040957 Aug 23 19:07:50.474125 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3822/7776] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:07:51.533768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a148c823-bbd0-40c0-a913-374408436b53 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1404568757"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:07:51.534358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a148c823-bbd0-40c0-a913-374408436b53 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:51.541763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a148c823-bbd0-40c0-a913-374408436b53 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:51.542264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a148c823-bbd0-40c0-a913-374408436b53 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:51.542762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a148c823-bbd0-40c0-a913-374408436b53 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:51.544090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a148c823-bbd0-40c0-a913-374408436b53 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:51.544885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a148c823-bbd0-40c0-a913-374408436b53 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:51.545331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a148c823-bbd0-40c0-a913-374408436b53 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:51.690395 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.network.security_group_api [None req-a148c823-bbd0-40c0-a913-374408436b53 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Adding security group 4624b639-3368-4329-87a2-c107e22c911e to port 8abb5e25-2f25-4272-8fc3-19ac776b382f Aug 23 19:07:52.014243 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a148c823-bbd0-40c0-a913-374408436b53 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "POST /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/action" status: 202 len: 0 microversion: 2.1 time: 0.484400 Aug 23 19:07:52.014990 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3955/7777] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:07:51 2022] POST /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/action => generated 0 bytes in 486 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:07:52.023599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-85f821f5-de29-4e30-b2da-275f0ae9f338 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:07:52.024458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-85f821f5-de29-4e30-b2da-275f0ae9f338 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:07:52.033023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-85f821f5-de29-4e30-b2da-275f0ae9f338 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:52.033643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-85f821f5-de29-4e30-b2da-275f0ae9f338 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:52.034178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-85f821f5-de29-4e30-b2da-275f0ae9f338 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:52.035006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-85f821f5-de29-4e30-b2da-275f0ae9f338 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:52.035589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-85f821f5-de29-4e30-b2da-275f0ae9f338 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:52.036128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-85f821f5-de29-4e30-b2da-275f0ae9f338 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:52.205010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-85f821f5-de29-4e30-b2da-275f0ae9f338 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:07:52.213606 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-85f821f5-de29-4e30-b2da-275f0ae9f338 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1758 microversion: 2.1 time: 0.194287 Aug 23 19:07:52.214188 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3823/7778] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:07:52 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1758 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:07:52.488023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-2ab7fc44-bceb-4ecd-b8f3-b188b880a29b req-16344acd-eb19-45ca-a0a6-aa694870b52c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f751743-0315-47a9-86d2-1198ada02ae7", "tag": "8abb5e25-2f25-4272-8fc3-19ac776b382f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:07:52.497520 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2ab7fc44-bceb-4ecd-b8f3-b188b880a29b req-16344acd-eb19-45ca-a0a6-aa694870b52c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:07:52.498019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2ab7fc44-bceb-4ecd-b8f3-b188b880a29b req-16344acd-eb19-45ca-a0a6-aa694870b52c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:07:52.498475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2ab7fc44-bceb-4ecd-b8f3-b188b880a29b req-16344acd-eb19-45ca-a0a6-aa694870b52c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:07:52.510426 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-2ab7fc44-bceb-4ecd-b8f3-b188b880a29b req-16344acd-eb19-45ca-a0a6-aa694870b52c service nova] Creating event network-changed:8abb5e25-2f25-4272-8fc3-19ac776b382f for instance 9f751743-0315-47a9-86d2-1198ada02ae7 on n-h1-850468-16 Aug 23 19:07:52.517635 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-2ab7fc44-bceb-4ecd-b8f3-b188b880a29b req-16344acd-eb19-45ca-a0a6-aa694870b52c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033709 Aug 23 19:07:52.518345 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3956/7779] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:07:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:08:53.091891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:08:53.092569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:08:53.097224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0f70697c-3b94-4026-ba8e-d6ea28857bbf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:08:53.099724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0f70697c-3b94-4026-ba8e-d6ea28857bbf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:08:53.106395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f70697c-3b94-4026-ba8e-d6ea28857bbf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:53.106907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f70697c-3b94-4026-ba8e-d6ea28857bbf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:53.107343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f70697c-3b94-4026-ba8e-d6ea28857bbf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:53.108038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f70697c-3b94-4026-ba8e-d6ea28857bbf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:53.108493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f70697c-3b94-4026-ba8e-d6ea28857bbf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:53.108929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f70697c-3b94-4026-ba8e-d6ea28857bbf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:53.182357 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0f70697c-3b94-4026-ba8e-d6ea28857bbf tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "POST /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/action" status: 202 len: 0 microversion: 2.1 time: 0.092234 Aug 23 19:08:53.183041 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3824/7780] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:08:53 2022] POST /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:08:53.192001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:08:53.192766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=12 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:08:53.197961 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d1fe3f19-031c-4c7b-b40e-ee185ead9e3c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:08:53.198881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d1fe3f19-031c-4c7b-b40e-ee185ead9e3c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:08:53.207776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1fe3f19-031c-4c7b-b40e-ee185ead9e3c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:53.208273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1fe3f19-031c-4c7b-b40e-ee185ead9e3c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:53.209213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1fe3f19-031c-4c7b-b40e-ee185ead9e3c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:53.210155 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1fe3f19-031c-4c7b-b40e-ee185ead9e3c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:53.210656 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1fe3f19-031c-4c7b-b40e-ee185ead9e3c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:53.211098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d1fe3f19-031c-4c7b-b40e-ee185ead9e3c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:53.359645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d1fe3f19-031c-4c7b-b40e-ee185ead9e3c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:08:53.368214 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d1fe3f19-031c-4c7b-b40e-ee185ead9e3c tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1750 microversion: 2.1 time: 0.180151 Aug 23 19:08:53.368795 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3957/7781] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:08:53 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1750 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:08:54.390907 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a45a0657-276a-4869-b587-12d8f5f97798 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:08:54.391629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a45a0657-276a-4869-b587-12d8f5f97798 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:08:54.398709 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a45a0657-276a-4869-b587-12d8f5f97798 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:54.399200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a45a0657-276a-4869-b587-12d8f5f97798 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:54.399640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a45a0657-276a-4869-b587-12d8f5f97798 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:54.400358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a45a0657-276a-4869-b587-12d8f5f97798 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:54.400806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a45a0657-276a-4869-b587-12d8f5f97798 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:54.401226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a45a0657-276a-4869-b587-12d8f5f97798 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:54.547439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a45a0657-276a-4869-b587-12d8f5f97798 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:08:54.556741 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a45a0657-276a-4869-b587-12d8f5f97798 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1755 microversion: 2.1 time: 0.171199 Aug 23 19:08:54.557306 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3825/7782] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:08:54 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:08:55.579160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-038af0fb-ecbd-4175-941c-a8e919bf3f3f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:08:55.579780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-038af0fb-ecbd-4175-941c-a8e919bf3f3f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:08:55.587181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-038af0fb-ecbd-4175-941c-a8e919bf3f3f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:55.587687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-038af0fb-ecbd-4175-941c-a8e919bf3f3f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:55.588148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-038af0fb-ecbd-4175-941c-a8e919bf3f3f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:55.588872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-038af0fb-ecbd-4175-941c-a8e919bf3f3f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:55.589348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-038af0fb-ecbd-4175-941c-a8e919bf3f3f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:55.589793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-038af0fb-ecbd-4175-941c-a8e919bf3f3f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:55.739480 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-038af0fb-ecbd-4175-941c-a8e919bf3f3f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:08:55.747769 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-038af0fb-ecbd-4175-941c-a8e919bf3f3f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1755 microversion: 2.1 time: 0.172557 Aug 23 19:08:55.748343 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3958/7783] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:08:55 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:08:56.770114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-96059059-3011-4044-91dd-c58ab01d17f3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:08:56.770761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-96059059-3011-4044-91dd-c58ab01d17f3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:08:56.777608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96059059-3011-4044-91dd-c58ab01d17f3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:56.778099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96059059-3011-4044-91dd-c58ab01d17f3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:56.778550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96059059-3011-4044-91dd-c58ab01d17f3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:56.779254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96059059-3011-4044-91dd-c58ab01d17f3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:56.779741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96059059-3011-4044-91dd-c58ab01d17f3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:56.780169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-96059059-3011-4044-91dd-c58ab01d17f3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:56.927663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-96059059-3011-4044-91dd-c58ab01d17f3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:08:56.935879 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-96059059-3011-4044-91dd-c58ab01d17f3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1755 microversion: 2.1 time: 0.170317 Aug 23 19:08:56.936444 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3826/7784] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:08:56 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:08:57.957802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f45ba2fe-56cc-4bc9-8787-5a6861890f02 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:08:57.958351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f45ba2fe-56cc-4bc9-8787-5a6861890f02 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:08:57.965217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f45ba2fe-56cc-4bc9-8787-5a6861890f02 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:57.965723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f45ba2fe-56cc-4bc9-8787-5a6861890f02 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:57.966179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f45ba2fe-56cc-4bc9-8787-5a6861890f02 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:57.966914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f45ba2fe-56cc-4bc9-8787-5a6861890f02 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:57.967390 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f45ba2fe-56cc-4bc9-8787-5a6861890f02 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:57.967834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f45ba2fe-56cc-4bc9-8787-5a6861890f02 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:58.114189 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f45ba2fe-56cc-4bc9-8787-5a6861890f02 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:08:58.122624 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f45ba2fe-56cc-4bc9-8787-5a6861890f02 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1755 microversion: 2.1 time: 0.168903 Aug 23 19:08:58.123200 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3959/7785] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:08:57 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:08:59.144677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-768fd0ac-93a0-454d-9127-9e59c852acfe tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:08:59.145328 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-768fd0ac-93a0-454d-9127-9e59c852acfe tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:08:59.152202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-768fd0ac-93a0-454d-9127-9e59c852acfe tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:59.152689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-768fd0ac-93a0-454d-9127-9e59c852acfe tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:59.153130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-768fd0ac-93a0-454d-9127-9e59c852acfe tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:59.153833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-768fd0ac-93a0-454d-9127-9e59c852acfe tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:08:59.154293 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-768fd0ac-93a0-454d-9127-9e59c852acfe tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:08:59.154755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-768fd0ac-93a0-454d-9127-9e59c852acfe tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:08:59.300951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-768fd0ac-93a0-454d-9127-9e59c852acfe tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:08:59.309243 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-768fd0ac-93a0-454d-9127-9e59c852acfe tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1755 microversion: 2.1 time: 0.169026 Aug 23 19:08:59.309807 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3827/7786] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:08:59 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1755 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:09:00.329916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d3165b79-2394-4b36-bc55-6e62005005b7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:09:00.330564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d3165b79-2394-4b36-bc55-6e62005005b7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:09:00.337657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3165b79-2394-4b36-bc55-6e62005005b7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:09:00.338150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3165b79-2394-4b36-bc55-6e62005005b7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:09:00.338662 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3165b79-2394-4b36-bc55-6e62005005b7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:09:00.339504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3165b79-2394-4b36-bc55-6e62005005b7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:09:00.339971 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3165b79-2394-4b36-bc55-6e62005005b7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:09:00.340410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d3165b79-2394-4b36-bc55-6e62005005b7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:09:00.489121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d3165b79-2394-4b36-bc55-6e62005005b7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:09:00.497478 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d3165b79-2394-4b36-bc55-6e62005005b7 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1755 microversion: 2.1 time: 0.171636 Aug 23 19:09:00.498158 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3960/7787] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:09:00 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:09:01.519085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d6fa8d3-78ba-4841-9ba6-0f3ccaa935a4 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:09:01.520070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d6fa8d3-78ba-4841-9ba6-0f3ccaa935a4 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:09:01.528023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d6fa8d3-78ba-4841-9ba6-0f3ccaa935a4 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:09:01.528571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d6fa8d3-78ba-4841-9ba6-0f3ccaa935a4 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:09:01.529277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d6fa8d3-78ba-4841-9ba6-0f3ccaa935a4 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:09:01.529986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d6fa8d3-78ba-4841-9ba6-0f3ccaa935a4 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:09:01.530446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d6fa8d3-78ba-4841-9ba6-0f3ccaa935a4 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:09:01.530916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d6fa8d3-78ba-4841-9ba6-0f3ccaa935a4 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:09:01.678874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6d6fa8d3-78ba-4841-9ba6-0f3ccaa935a4 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:09:01.687079 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d6fa8d3-78ba-4841-9ba6-0f3ccaa935a4 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1755 microversion: 2.1 time: 0.172634 Aug 23 19:09:01.687639 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3828/7788] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:09:01 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1755 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:09:02.708844 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6034f912-0942-477a-8e62-aa69f66f2090 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:09:02.709481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6034f912-0942-477a-8e62-aa69f66f2090 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:09:02.716438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6034f912-0942-477a-8e62-aa69f66f2090 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:09:02.716946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6034f912-0942-477a-8e62-aa69f66f2090 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:09:02.717403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6034f912-0942-477a-8e62-aa69f66f2090 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:09:02.718126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6034f912-0942-477a-8e62-aa69f66f2090 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:09:02.718624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6034f912-0942-477a-8e62-aa69f66f2090 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:09:02.719073 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6034f912-0942-477a-8e62-aa69f66f2090 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:09:02.872822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6034f912-0942-477a-8e62-aa69f66f2090 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:09:02.881812 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6034f912-0942-477a-8e62-aa69f66f2090 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1755 microversion: 2.1 time: 0.176863 Aug 23 19:09:02.882389 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3961/7789] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:09:02 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1755 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:09:03.903998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d341a1de-1deb-4f79-854c-d43650fea5a8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:09:03.904616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d341a1de-1deb-4f79-854c-d43650fea5a8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:09:03.912111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d341a1de-1deb-4f79-854c-d43650fea5a8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:09:03.912599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d341a1de-1deb-4f79-854c-d43650fea5a8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:09:03.913035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d341a1de-1deb-4f79-854c-d43650fea5a8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:09:03.913731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d341a1de-1deb-4f79-854c-d43650fea5a8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:09:03.914186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d341a1de-1deb-4f79-854c-d43650fea5a8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:09:03.914633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d341a1de-1deb-4f79-854c-d43650fea5a8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:09:04.060621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d341a1de-1deb-4f79-854c-d43650fea5a8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:09:04.069510 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d341a1de-1deb-4f79-854c-d43650fea5a8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1755 microversion: 2.1 time: 0.169667 Aug 23 19:09:04.070078 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3829/7790] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:09:03 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1755 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:09:05.092038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-553f5ee4-f078-448f-a9b6-5c98cf6a0b7f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:09:05.092648 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-553f5ee4-f078-448f-a9b6-5c98cf6a0b7f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:09:05.100018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-553f5ee4-f078-448f-a9b6-5c98cf6a0b7f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:09:05.100515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-553f5ee4-f078-448f-a9b6-5c98cf6a0b7f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:09:05.100963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-553f5ee4-f078-448f-a9b6-5c98cf6a0b7f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:09:05.101673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-553f5ee4-f078-448f-a9b6-5c98cf6a0b7f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:09:05.102141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-553f5ee4-f078-448f-a9b6-5c98cf6a0b7f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:09:05.102601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-553f5ee4-f078-448f-a9b6-5c98cf6a0b7f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:09:05.248741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-553f5ee4-f078-448f-a9b6-5c98cf6a0b7f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:09:05.257355 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-553f5ee4-f078-448f-a9b6-5c98cf6a0b7f tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1758 microversion: 2.1 time: 0.169352 Aug 23 19:09:05.257936 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3962/7791] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:09:05 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1758 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:09:21.380408 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:09:21.381151 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:09:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:10:08.689939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=12 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:10:08.690818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:10:08.694839 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0c0880c8-d994-4159-80e7-0ac7c7b5f311 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1404568757"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:10:08.695380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0c0880c8-d994-4159-80e7-0ac7c7b5f311 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:08.702316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c0880c8-d994-4159-80e7-0ac7c7b5f311 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:08.702828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c0880c8-d994-4159-80e7-0ac7c7b5f311 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:08.703270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c0880c8-d994-4159-80e7-0ac7c7b5f311 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:08.703966 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c0880c8-d994-4159-80e7-0ac7c7b5f311 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:08.705034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c0880c8-d994-4159-80e7-0ac7c7b5f311 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:08.705653 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0c0880c8-d994-4159-80e7-0ac7c7b5f311 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:08.840464 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.network.security_group_api [None req-0c0880c8-d994-4159-80e7-0ac7c7b5f311 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Removing security group 4624b639-3368-4329-87a2-c107e22c911e from port 8abb5e25-2f25-4272-8fc3-19ac776b382f Aug 23 19:10:09.143654 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0c0880c8-d994-4159-80e7-0ac7c7b5f311 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "POST /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/action" status: 202 len: 0 microversion: 2.1 time: 0.455849 Aug 23 19:10:09.148083 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3830/7792] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:10:08 2022] POST /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:10:09.154162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=12 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:10:09.155111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=36 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:10:09.166532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f82eea0a-03d0-473e-8ad9-bd0845cd2bb0 req-862ab8aa-59ab-4211-92d4-f06b1ee7669d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f751743-0315-47a9-86d2-1198ada02ae7", "tag": "8abb5e25-2f25-4272-8fc3-19ac776b382f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:10:09.190196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f82eea0a-03d0-473e-8ad9-bd0845cd2bb0 req-862ab8aa-59ab-4211-92d4-f06b1ee7669d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:09.191149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f82eea0a-03d0-473e-8ad9-bd0845cd2bb0 req-862ab8aa-59ab-4211-92d4-f06b1ee7669d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:09.192649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f82eea0a-03d0-473e-8ad9-bd0845cd2bb0 req-862ab8aa-59ab-4211-92d4-f06b1ee7669d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:09.209486 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f82eea0a-03d0-473e-8ad9-bd0845cd2bb0 req-862ab8aa-59ab-4211-92d4-f06b1ee7669d service nova] Creating event network-changed:8abb5e25-2f25-4272-8fc3-19ac776b382f for instance 9f751743-0315-47a9-86d2-1198ada02ae7 on n-h1-850468-16 Aug 23 19:10:09.220681 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f82eea0a-03d0-473e-8ad9-bd0845cd2bb0 req-862ab8aa-59ab-4211-92d4-f06b1ee7669d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068009 Aug 23 19:10:09.221937 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3963/7793] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:10:10.463545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0abde1c8-9a0e-425e-bb71-325e9dcca711 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:10.464174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0abde1c8-9a0e-425e-bb71-325e9dcca711 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:10.471747 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0abde1c8-9a0e-425e-bb71-325e9dcca711 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:10.472332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0abde1c8-9a0e-425e-bb71-325e9dcca711 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:10.473044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0abde1c8-9a0e-425e-bb71-325e9dcca711 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:10.473852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0abde1c8-9a0e-425e-bb71-325e9dcca711 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:10.474431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0abde1c8-9a0e-425e-bb71-325e9dcca711 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:10.474979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0abde1c8-9a0e-425e-bb71-325e9dcca711 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:10.569235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-0abde1c8-9a0e-425e-bb71-325e9dcca711 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lazy-loading 'services' on Instance uuid 9f751743-0315-47a9-86d2-1198ada02ae7 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:10:10.577232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-bfa6870d-049e-439e-9525-28c5f45a733f req-142e40c2-ab88-476e-9661-0362137574cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f751743-0315-47a9-86d2-1198ada02ae7", "tag": "8abb5e25-2f25-4272-8fc3-19ac776b382f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:10:10.589283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bfa6870d-049e-439e-9525-28c5f45a733f req-142e40c2-ab88-476e-9661-0362137574cd service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:10.595412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bfa6870d-049e-439e-9525-28c5f45a733f req-142e40c2-ab88-476e-9661-0362137574cd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:10.595950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-bfa6870d-049e-439e-9525-28c5f45a733f req-142e40c2-ab88-476e-9661-0362137574cd service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:10.613870 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-bfa6870d-049e-439e-9525-28c5f45a733f req-142e40c2-ab88-476e-9661-0362137574cd service nova] Creating event network-changed:8abb5e25-2f25-4272-8fc3-19ac776b382f for instance 9f751743-0315-47a9-86d2-1198ada02ae7 on n-h1-850468-16 Aug 23 19:10:10.623317 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-bfa6870d-049e-439e-9525-28c5f45a733f req-142e40c2-ab88-476e-9661-0362137574cd service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162374 Aug 23 19:10:10.624670 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3964/7794] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:10:10.677480 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0abde1c8-9a0e-425e-bb71-325e9dcca711 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments/84ec5018-7a04-4a5f-9a8e-604de4c9aac8" status: 202 len: 0 microversion: 2.1 time: 0.219234 Aug 23 19:10:10.678929 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3831/7795] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 19:10:10 2022] DELETE /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments/84ec5018-7a04-4a5f-9a8e-604de4c9aac8 => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:10:10.690795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d5dc1654-9a5a-4b8b-befc-0647f1525d95 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:10.693290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d5dc1654-9a5a-4b8b-befc-0647f1525d95 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:10.704787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5dc1654-9a5a-4b8b-befc-0647f1525d95 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:10.705370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5dc1654-9a5a-4b8b-befc-0647f1525d95 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:10.706101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5dc1654-9a5a-4b8b-befc-0647f1525d95 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:10.707197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5dc1654-9a5a-4b8b-befc-0647f1525d95 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:10.707684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5dc1654-9a5a-4b8b-befc-0647f1525d95 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:10.708134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d5dc1654-9a5a-4b8b-befc-0647f1525d95 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:10.746973 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d5dc1654-9a5a-4b8b-befc-0647f1525d95 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062066 Aug 23 19:10:10.747948 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3965/7796] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:10:10 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:10:11.760667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ac7276b0-697a-48d2-98ea-e994d67dd549 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:11.763124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ac7276b0-697a-48d2-98ea-e994d67dd549 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:11.771141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac7276b0-697a-48d2-98ea-e994d67dd549 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:11.771622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac7276b0-697a-48d2-98ea-e994d67dd549 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:11.772057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac7276b0-697a-48d2-98ea-e994d67dd549 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:11.772758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac7276b0-697a-48d2-98ea-e994d67dd549 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:11.773209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac7276b0-697a-48d2-98ea-e994d67dd549 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:11.773628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac7276b0-697a-48d2-98ea-e994d67dd549 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:11.806431 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ac7276b0-697a-48d2-98ea-e994d67dd549 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050128 Aug 23 19:10:11.807045 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3832/7797] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:10:11 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:10:12.819739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7596318a-4104-4e52-b3c8-06f56939ed08 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:12.822065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7596318a-4104-4e52-b3c8-06f56939ed08 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:12.829958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7596318a-4104-4e52-b3c8-06f56939ed08 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:12.830466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7596318a-4104-4e52-b3c8-06f56939ed08 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:12.831016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7596318a-4104-4e52-b3c8-06f56939ed08 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:12.831761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7596318a-4104-4e52-b3c8-06f56939ed08 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:12.832237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7596318a-4104-4e52-b3c8-06f56939ed08 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:12.832684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7596318a-4104-4e52-b3c8-06f56939ed08 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:12.868322 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7596318a-4104-4e52-b3c8-06f56939ed08 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053230 Aug 23 19:10:12.868927 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3966/7798] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:10:12 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:10:13.880406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0719d925-c561-42f7-9db9-7bd781ad2ad8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:13.882665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0719d925-c561-42f7-9db9-7bd781ad2ad8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:13.889891 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0719d925-c561-42f7-9db9-7bd781ad2ad8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:13.890308 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0719d925-c561-42f7-9db9-7bd781ad2ad8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:13.890804 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0719d925-c561-42f7-9db9-7bd781ad2ad8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:13.891498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0719d925-c561-42f7-9db9-7bd781ad2ad8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:13.892079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0719d925-c561-42f7-9db9-7bd781ad2ad8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:13.892526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0719d925-c561-42f7-9db9-7bd781ad2ad8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:13.922415 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0719d925-c561-42f7-9db9-7bd781ad2ad8 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046106 Aug 23 19:10:13.923789 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3833/7799] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:10:13 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:10:14.935383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3ae2cd1e-545d-4623-8caa-c74737f0a148 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:14.937577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3ae2cd1e-545d-4623-8caa-c74737f0a148 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:14.945265 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ae2cd1e-545d-4623-8caa-c74737f0a148 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:14.945758 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ae2cd1e-545d-4623-8caa-c74737f0a148 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:14.946205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ae2cd1e-545d-4623-8caa-c74737f0a148 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:14.946941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ae2cd1e-545d-4623-8caa-c74737f0a148 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:14.947410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ae2cd1e-545d-4623-8caa-c74737f0a148 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:14.947843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3ae2cd1e-545d-4623-8caa-c74737f0a148 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:14.978634 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3ae2cd1e-545d-4623-8caa-c74737f0a148 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047204 Aug 23 19:10:14.979208 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3967/7800] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:10:14 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:10:15.991830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f6451abb-d013-4a36-b4f4-c3247546083a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:15.994000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f6451abb-d013-4a36-b4f4-c3247546083a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:16.001035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6451abb-d013-4a36-b4f4-c3247546083a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:16.002736 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6451abb-d013-4a36-b4f4-c3247546083a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:16.003206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6451abb-d013-4a36-b4f4-c3247546083a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:16.003901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6451abb-d013-4a36-b4f4-c3247546083a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:16.004354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6451abb-d013-4a36-b4f4-c3247546083a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:16.004810 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f6451abb-d013-4a36-b4f4-c3247546083a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:16.034621 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f6451abb-d013-4a36-b4f4-c3247546083a tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046811 Aug 23 19:10:16.040843 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3834/7801] 10.222.0.61 () {58 vars in 1302 bytes} [Tue Aug 23 19:10:15 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 23 19:10:16.046410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-569a2cbf-6b4e-4094-a9a5-39fc88fd5349 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:16.046963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-569a2cbf-6b4e-4094-a9a5-39fc88fd5349 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:16.054127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-569a2cbf-6b4e-4094-a9a5-39fc88fd5349 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:16.054673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-569a2cbf-6b4e-4094-a9a5-39fc88fd5349 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:16.055134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-569a2cbf-6b4e-4094-a9a5-39fc88fd5349 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:16.055860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-569a2cbf-6b4e-4094-a9a5-39fc88fd5349 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:16.056334 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-569a2cbf-6b4e-4094-a9a5-39fc88fd5349 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:16.056782 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-569a2cbf-6b4e-4094-a9a5-39fc88fd5349 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:16.271321 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-569a2cbf-6b4e-4094-a9a5-39fc88fd5349 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] HTTP exception thrown: Instance 9f751743-0315-47a9-86d2-1198ada02ae7 is not attached to volume 84ec5018-7a04-4a5f-9a8e-604de4c9aac8 Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-569a2cbf-6b4e-4094-a9a5-39fc88fd5349 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Request method failure captured: Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: request: DELETE /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments/84ec5018-7a04-4a5f-9a8e-604de4c9aac8 HTTP/1.1 Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSQpWwzXicSjrPvt6Y7v_7MSQtrnYuiZwfvChNgThUvARwd3aUREdbYuQRzkccs7dWAtUVlWxQYXtMtwqkwoh0DLBq_TCwQkaXABnmRnJ8W08Drile_HJkBIBpKIy9HWcs5krN9XZGLqUVdnRDpjCBC8GCHxUHKX1UWLssZXaoxXGpA Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 6f5ae2dcaf834c5dba288379fd82fd0d Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestMinimumBasicScenario-1983537687 Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6f5ae2dcaf834c5dba288379fd82fd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f5ae2dcaf834c5dba288379fd82fd0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6f5ae2dcaf834c5dba288379fd82fd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f5ae2dcaf834c5dba288379fd82fd0d"}]}] Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestMinimumBasicScenario-1983537687 Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 6f5ae2dcaf834c5dba288379fd82fd0d Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1983537687 Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestMinimumBasicScenario-1983537687-project Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 470fc9d56e3743baa2906b2d7485284d Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestMinimumBasicScenario-1983537687-project Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 9f751743-0315-47a9-86d2-1198ada02ae7 is not attached to volume 84ec5018-7a04-4a5f-9a8e-604de4c9aac8 Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'server_id': '9f751743-0315-47a9-86d2-1198ada02ae7', 'id': '84ec5018-7a04-4a5f-9a8e-604de4c9aac8'} Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 84ec5018-7a04-4a5f-9a8e-604de4c9aac8. Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f751743-0315-47a9-86d2-1198ada02ae7 is not attached to volume 84ec5018-7a04-4a5f-9a8e-604de4c9aac8 Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:10:16.272954 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:10:16.277294 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:10:16.277294 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:10:16.277294 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f751743-0315-47a9-86d2-1198ada02ae7 is not attached to volume 84ec5018-7a04-4a5f-9a8e-604de4c9aac8 Aug 23 19:10:16.277294 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:10:16.277294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-569a2cbf-6b4e-4094-a9a5-39fc88fd5349 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Returning 404 to user: Instance 9f751743-0315-47a9-86d2-1198ada02ae7 is not attached to volume 84ec5018-7a04-4a5f-9a8e-604de4c9aac8 {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:10:16.277294 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-569a2cbf-6b4e-4094-a9a5-39fc88fd5349 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments/84ec5018-7a04-4a5f-9a8e-604de4c9aac8" status: 404 len: 154 microversion: 2.1 time: 0.232290 Aug 23 19:10:16.277294 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3968/7802] 10.222.0.61 () {58 vars in 1416 bytes} [Tue Aug 23 19:10:16 2022] DELETE /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7/os-volume_attachments/84ec5018-7a04-4a5f-9a8e-604de4c9aac8 => generated 154 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:10:19.536323 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9723d7fc-58c8-4fe2-82dd-b63a1d1f44f2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:19.536852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9723d7fc-58c8-4fe2-82dd-b63a1d1f44f2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:19.543239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9723d7fc-58c8-4fe2-82dd-b63a1d1f44f2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:19.543721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9723d7fc-58c8-4fe2-82dd-b63a1d1f44f2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:19.544154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9723d7fc-58c8-4fe2-82dd-b63a1d1f44f2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:19.544925 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9723d7fc-58c8-4fe2-82dd-b63a1d1f44f2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:19.545377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9723d7fc-58c8-4fe2-82dd-b63a1d1f44f2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:19.545802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9723d7fc-58c8-4fe2-82dd-b63a1d1f44f2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:19.570779 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9723d7fc-58c8-4fe2-82dd-b63a1d1f44f2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:10:19.657464 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9723d7fc-58c8-4fe2-82dd-b63a1d1f44f2 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "DELETE /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 204 len: 0 microversion: 2.1 time: 0.126131 Aug 23 19:10:19.659021 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3835/7803] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:10:19 2022] DELETE /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:10:19.667437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2c0af06b-ef51-4337-81d1-4dbebd3de80b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:19.668441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2c0af06b-ef51-4337-81d1-4dbebd3de80b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:19.675574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c0af06b-ef51-4337-81d1-4dbebd3de80b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:19.676086 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c0af06b-ef51-4337-81d1-4dbebd3de80b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:19.676541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c0af06b-ef51-4337-81d1-4dbebd3de80b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:19.677273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c0af06b-ef51-4337-81d1-4dbebd3de80b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:19.677742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c0af06b-ef51-4337-81d1-4dbebd3de80b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:19.678183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c0af06b-ef51-4337-81d1-4dbebd3de80b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:19.814764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2c0af06b-ef51-4337-81d1-4dbebd3de80b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:19.823357 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2c0af06b-ef51-4337-81d1-4dbebd3de80b tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1553 microversion: 2.1 time: 0.159889 Aug 23 19:10:19.823933 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3969/7804] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:19 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:20.845405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9c27ec51-f07c-46fb-914e-3b89a51cead3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:20.846033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9c27ec51-f07c-46fb-914e-3b89a51cead3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:20.852888 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c27ec51-f07c-46fb-914e-3b89a51cead3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:20.853444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c27ec51-f07c-46fb-914e-3b89a51cead3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:20.853815 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c27ec51-f07c-46fb-914e-3b89a51cead3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:20.854505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c27ec51-f07c-46fb-914e-3b89a51cead3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:20.854991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c27ec51-f07c-46fb-914e-3b89a51cead3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:20.855681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9c27ec51-f07c-46fb-914e-3b89a51cead3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:20.992561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9c27ec51-f07c-46fb-914e-3b89a51cead3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:21.000276 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9c27ec51-f07c-46fb-914e-3b89a51cead3 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1553 microversion: 2.1 time: 0.159316 Aug 23 19:10:21.000844 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3836/7805] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:20 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:21.900664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-57d020b4-b07a-423c-bd25-1a5556e2862a req-c5e05b9e-2eef-481a-95ee-c98e2cb702ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f751743-0315-47a9-86d2-1198ada02ae7", "name": "network-vif-deleted", "tag": "8abb5e25-2f25-4272-8fc3-19ac776b382f"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:10:21.912039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-57d020b4-b07a-423c-bd25-1a5556e2862a req-c5e05b9e-2eef-481a-95ee-c98e2cb702ef service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:21.912541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-57d020b4-b07a-423c-bd25-1a5556e2862a req-c5e05b9e-2eef-481a-95ee-c98e2cb702ef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:21.913098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-57d020b4-b07a-423c-bd25-1a5556e2862a req-c5e05b9e-2eef-481a-95ee-c98e2cb702ef service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:21.925007 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-57d020b4-b07a-423c-bd25-1a5556e2862a req-c5e05b9e-2eef-481a-95ee-c98e2cb702ef service nova] Creating event network-vif-deleted:8abb5e25-2f25-4272-8fc3-19ac776b382f for instance 9f751743-0315-47a9-86d2-1198ada02ae7 on n-h1-850468-16 Aug 23 19:10:21.930038 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-57d020b4-b07a-423c-bd25-1a5556e2862a req-c5e05b9e-2eef-481a-95ee-c98e2cb702ef service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033161 Aug 23 19:10:21.930659 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3970/7806] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:10:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:10:22.022239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:22.022951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:22.029833 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:22.030383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:22.030914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:22.031667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:22.032208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:22.032694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:22.067663 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:22.068153 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:22.068615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:22.069057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lazy-loading 'fault' on Instance uuid 9f751743-0315-47a9-86d2-1198ada02ae7 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:10:22.110681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '470fc9d56e3743baa2906b2d7485284d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f5ae2dcaf834c5dba288379fd82fd0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:22.118878 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-12a6aa1d-9f46-4eb1-8ad6-3e3b1ce454ec tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 200 len: 1348 microversion: 2.1 time: 0.101449 Aug 23 19:10:22.119466 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3837/7807] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:22 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 1348 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:23.141929 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7f06e86-2215-4d06-b134-1051221df9bb tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:23.142737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c7f06e86-2215-4d06-b134-1051221df9bb tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] [instance: 9f751743-0315-47a9-86d2-1198ada02ae7] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:23.150368 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7f06e86-2215-4d06-b134-1051221df9bb tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:23.150901 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7f06e86-2215-4d06-b134-1051221df9bb tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:23.151351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7f06e86-2215-4d06-b134-1051221df9bb tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:23.152070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7f06e86-2215-4d06-b134-1051221df9bb tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:23.152539 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7f06e86-2215-4d06-b134-1051221df9bb tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:23.152974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c7f06e86-2215-4d06-b134-1051221df9bb tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:23.168326 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-c7f06e86-2215-4d06-b134-1051221df9bb tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] HTTP exception thrown: Instance 9f751743-0315-47a9-86d2-1198ada02ae7 could not be found. Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7f06e86-2215-4d06-b134-1051221df9bb tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Request method failure captured: Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 HTTP/1.1 Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSQpWwzXicSjrPvt6Y7v_7MSQtrnYuiZwfvChNgThUvARwd3aUREdbYuQRzkccs7dWAtUVlWxQYXtMtwqkwoh0DLBq_TCwQkaXABnmRnJ8W08Drile_HJkBIBpKIy9HWcs5krN9XZGLqUVdnRDpjCBC8GCHxUHKX1UWLssZXaoxXGpA Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 6f5ae2dcaf834c5dba288379fd82fd0d Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestMinimumBasicScenario-1983537687 Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_6f5ae2dcaf834c5dba288379fd82fd0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f5ae2dcaf834c5dba288379fd82fd0d"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/6f5ae2dcaf834c5dba288379fd82fd0d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/6f5ae2dcaf834c5dba288379fd82fd0d"}]}] Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestMinimumBasicScenario-1983537687 Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 6f5ae2dcaf834c5dba288379fd82fd0d Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1983537687 Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestMinimumBasicScenario-1983537687-project Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 470fc9d56e3743baa2906b2d7485284d Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestMinimumBasicScenario-1983537687-project Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 9f751743-0315-47a9-86d2-1198ada02ae7 could not be found. Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '9f751743-0315-47a9-86d2-1198ada02ae7'} Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f751743-0315-47a9-86d2-1198ada02ae7 could not be found. Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f751743-0315-47a9-86d2-1198ada02ae7 could not be found. Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:10:23.170028 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:10:23.175798 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:10:23.175798 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:10:23.175798 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:10:23.175798 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:10:23.175798 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:10:23.175798 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f751743-0315-47a9-86d2-1198ada02ae7 could not be found. Aug 23 19:10:23.175798 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:10:23.175798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c7f06e86-2215-4d06-b134-1051221df9bb tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Returning 404 to user: Instance 9f751743-0315-47a9-86d2-1198ada02ae7 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:10:23.175798 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c7f06e86-2215-4d06-b134-1051221df9bb tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7" status: 404 len: 111 microversion: 2.1 time: 0.034803 Aug 23 19:10:23.175798 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3971/7808] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:23 2022] GET /compute/v2.1/servers/9f751743-0315-47a9-86d2-1198ada02ae7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:10:23.182893 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bff0990f-a296-41a8-bdce-a45c55218019 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] Calling method '.version_select at 0x7f27df5ea4c0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:23.205067 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bff0990f-a296-41a8-bdce-a45c55218019 tempest-TestMinimumBasicScenario-1983537687 tempest-TestMinimumBasicScenario-1983537687-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-351697345" status: 202 len: 0 microversion: 2.1 time: 0.025968 Aug 23 19:10:23.205867 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3838/7809] 10.222.0.61 () {58 vars in 1269 bytes} [Tue Aug 23 19:10:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-351697345 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:10:32.512784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce1066e3-146e-4fe2-8a48-cd25943f2b05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'create', calling method: .version_select at 0x7f27ec3b4310>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-885954245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB1ABXKUZQljq26oITJwlhqljcxz656KGsNee6apvkoBeaDhzYu9gkhJwmcrPIDEMiFZnOD9Oes8KqFJdB6AncN3GC6huCbhdlYCY69669gnu3BjbdWBj9TkNPUqQxmeNQ=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:10:32.529825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ce1066e3-146e-4fe2-8a48-cd25943f2b05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:10:32.535251 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-ce1066e3-146e-4fe2-8a48-cd25943f2b05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for user 2887d531d5a9449c9cb350a5b1dd73d2 and project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:10:32.563844 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce1066e3-146e-4fe2-8a48-cd25943f2b05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.215217 Aug 23 19:10:32.564431 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3972/7810] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 19:10:32 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:10:38.565075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:10:38.571127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:10:38.575808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-422129214", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "20e7d81f-7ca4-438b-9bbc-9ca60324f6e9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-885954245", "security_groups": [{"name": "tempest-secgroup-smoke-1561423106"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:10:38.715356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] validate_networks() for [('20e7d81f-7ca4-438b-9bbc-9ca60324f6e9', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:10:39.181784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:10:39.182217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:10:39.182735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:10:39.183158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:10:39.183577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:10:39.193581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:39.194220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:39.195040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:39.195466 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:39.195933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:39.196386 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:39.214104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:10:39.220268 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for user 2887d531d5a9449c9cb350a5b1dd73d2 and project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:10:39.234515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:10:39.236876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:10:39.285541 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6197ca21-7d17-4051-a2b5-74112bab7de0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722193 Aug 23 19:10:39.291953 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3839/7811] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:10:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:10:39.294412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=38 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:10:39.301577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-db7f767a-d668-452f-8a97-81f62c83af41 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:39.302213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-db7f767a-d668-452f-8a97-81f62c83af41 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:39.304133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:10:39.392097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-db7f767a-d668-452f-8a97-81f62c83af41 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:39.401389 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-db7f767a-d668-452f-8a97-81f62c83af41 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1265 microversion: 2.1 time: 0.107826 Aug 23 19:10:39.401963 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3973/7812] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:39 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1265 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:40.425868 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-99831db7-ad76-4264-af5d-87874df54361 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:40.426825 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-99831db7-ad76-4264-af5d-87874df54361 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:40.435958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99831db7-ad76-4264-af5d-87874df54361 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:40.437022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99831db7-ad76-4264-af5d-87874df54361 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:40.437665 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99831db7-ad76-4264-af5d-87874df54361 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:40.438656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99831db7-ad76-4264-af5d-87874df54361 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:40.439615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99831db7-ad76-4264-af5d-87874df54361 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:40.440252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99831db7-ad76-4264-af5d-87874df54361 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:40.553776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-99831db7-ad76-4264-af5d-87874df54361 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:40.561940 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-99831db7-ad76-4264-af5d-87874df54361 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1317 microversion: 2.1 time: 0.142529 Aug 23 19:10:40.564401 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3840/7813] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:40 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1317 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:41.587476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-43d27436-5d72-4dbd-94a9-e74c3318e4ca tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:41.588120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-43d27436-5d72-4dbd-94a9-e74c3318e4ca tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:41.597663 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d27436-5d72-4dbd-94a9-e74c3318e4ca tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:41.598292 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d27436-5d72-4dbd-94a9-e74c3318e4ca tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:41.598784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d27436-5d72-4dbd-94a9-e74c3318e4ca tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:41.599532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d27436-5d72-4dbd-94a9-e74c3318e4ca tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:41.599990 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d27436-5d72-4dbd-94a9-e74c3318e4ca tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:41.600445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-43d27436-5d72-4dbd-94a9-e74c3318e4ca tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:41.741823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-43d27436-5d72-4dbd-94a9-e74c3318e4ca tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:41.749964 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-43d27436-5d72-4dbd-94a9-e74c3318e4ca tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1391 microversion: 2.1 time: 0.166461 Aug 23 19:10:41.750781 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3974/7814] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:41 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:41.998764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-3a7092b0-c7a6-49fc-964e-4d5cd1159e46 req-3601ae25-ece9-4ba9-b503-bdf59fce3f41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9c0d49-38f7-4df4-bd38-1cc854392c80", "tag": "79dca042-6947-4adc-a9c5-140637c9aa60"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:10:42.009942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3a7092b0-c7a6-49fc-964e-4d5cd1159e46 req-3601ae25-ece9-4ba9-b503-bdf59fce3f41 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:42.010425 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3a7092b0-c7a6-49fc-964e-4d5cd1159e46 req-3601ae25-ece9-4ba9-b503-bdf59fce3f41 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:42.010892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-3a7092b0-c7a6-49fc-964e-4d5cd1159e46 req-3601ae25-ece9-4ba9-b503-bdf59fce3f41 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:42.022260 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-3a7092b0-c7a6-49fc-964e-4d5cd1159e46 req-3601ae25-ece9-4ba9-b503-bdf59fce3f41 service nova] Creating event network-changed:79dca042-6947-4adc-a9c5-140637c9aa60 for instance 6e9c0d49-38f7-4df4-bd38-1cc854392c80 on n-h2-850468-16 Aug 23 19:10:42.027354 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-3a7092b0-c7a6-49fc-964e-4d5cd1159e46 req-3601ae25-ece9-4ba9-b503-bdf59fce3f41 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032435 Aug 23 19:10:42.028142 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3841/7815] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:10:42.772458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6fcfd105-ccf5-4887-9393-4a0c439a8074 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:42.773091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6fcfd105-ccf5-4887-9393-4a0c439a8074 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:42.780152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fcfd105-ccf5-4887-9393-4a0c439a8074 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:42.780651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fcfd105-ccf5-4887-9393-4a0c439a8074 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:42.781108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fcfd105-ccf5-4887-9393-4a0c439a8074 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:42.781819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fcfd105-ccf5-4887-9393-4a0c439a8074 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:42.782290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fcfd105-ccf5-4887-9393-4a0c439a8074 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:42.782776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6fcfd105-ccf5-4887-9393-4a0c439a8074 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:42.914889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6fcfd105-ccf5-4887-9393-4a0c439a8074 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:42.922623 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6fcfd105-ccf5-4887-9393-4a0c439a8074 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1391 microversion: 2.1 time: 0.154677 Aug 23 19:10:42.923194 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3975/7816] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:42 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:43.943969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-03b139f1-0d32-4d94-81be-bacf600b16a5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:43.944687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-03b139f1-0d32-4d94-81be-bacf600b16a5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:43.950942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03b139f1-0d32-4d94-81be-bacf600b16a5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:43.951429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03b139f1-0d32-4d94-81be-bacf600b16a5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:43.951869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03b139f1-0d32-4d94-81be-bacf600b16a5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:43.952561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03b139f1-0d32-4d94-81be-bacf600b16a5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:43.953017 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03b139f1-0d32-4d94-81be-bacf600b16a5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:43.953443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03b139f1-0d32-4d94-81be-bacf600b16a5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:44.086500 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-03b139f1-0d32-4d94-81be-bacf600b16a5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:44.094175 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-03b139f1-0d32-4d94-81be-bacf600b16a5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1391 microversion: 2.1 time: 0.155526 Aug 23 19:10:44.094775 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3842/7817] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:43 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1391 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:45.116065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-dcfa7487-a91f-4a66-a839-cbecdc8e3fea tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:45.116649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-dcfa7487-a91f-4a66-a839-cbecdc8e3fea tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:45.123608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcfa7487-a91f-4a66-a839-cbecdc8e3fea tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:45.124116 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcfa7487-a91f-4a66-a839-cbecdc8e3fea tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:45.124605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcfa7487-a91f-4a66-a839-cbecdc8e3fea tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:45.125326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcfa7487-a91f-4a66-a839-cbecdc8e3fea tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:45.125805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcfa7487-a91f-4a66-a839-cbecdc8e3fea tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:45.126257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-dcfa7487-a91f-4a66-a839-cbecdc8e3fea tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:45.265707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-dcfa7487-a91f-4a66-a839-cbecdc8e3fea tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:45.274622 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-dcfa7487-a91f-4a66-a839-cbecdc8e3fea tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1391 microversion: 2.1 time: 0.162538 Aug 23 19:10:45.275232 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3976/7818] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:45 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1391 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:46.296568 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-77b4e096-09e9-424b-b9a1-4fa6a776ce1a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:46.297269 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-77b4e096-09e9-424b-b9a1-4fa6a776ce1a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:46.304058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77b4e096-09e9-424b-b9a1-4fa6a776ce1a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:46.304540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77b4e096-09e9-424b-b9a1-4fa6a776ce1a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:46.304977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77b4e096-09e9-424b-b9a1-4fa6a776ce1a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:46.305675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77b4e096-09e9-424b-b9a1-4fa6a776ce1a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:46.306128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77b4e096-09e9-424b-b9a1-4fa6a776ce1a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:46.306567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-77b4e096-09e9-424b-b9a1-4fa6a776ce1a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:46.451855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-77b4e096-09e9-424b-b9a1-4fa6a776ce1a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:46.459694 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-77b4e096-09e9-424b-b9a1-4fa6a776ce1a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1391 microversion: 2.1 time: 0.167810 Aug 23 19:10:46.460257 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3843/7819] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:46 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1391 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:47.480717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-561ea608-d55f-449e-bed5-b5411a4813d9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:47.481353 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-561ea608-d55f-449e-bed5-b5411a4813d9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:47.488631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-561ea608-d55f-449e-bed5-b5411a4813d9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:47.489145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-561ea608-d55f-449e-bed5-b5411a4813d9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:47.489608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-561ea608-d55f-449e-bed5-b5411a4813d9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:47.490335 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-561ea608-d55f-449e-bed5-b5411a4813d9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:47.490846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-561ea608-d55f-449e-bed5-b5411a4813d9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:47.491301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-561ea608-d55f-449e-bed5-b5411a4813d9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:47.624905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-561ea608-d55f-449e-bed5-b5411a4813d9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:47.633713 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-561ea608-d55f-449e-bed5-b5411a4813d9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1391 microversion: 2.1 time: 0.156902 Aug 23 19:10:47.634300 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3977/7820] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:47 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:48.261750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-8a4b26fe-bd46-48e0-9b20-e04b14f4ede3 req-dd09bcb3-4768-4057-9b1a-b2eb63c9b074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9c0d49-38f7-4df4-bd38-1cc854392c80", "name": "network-vif-plugged", "status": "completed", "tag": "79dca042-6947-4adc-a9c5-140637c9aa60"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:10:48.271826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8a4b26fe-bd46-48e0-9b20-e04b14f4ede3 req-dd09bcb3-4768-4057-9b1a-b2eb63c9b074 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:48.272313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8a4b26fe-bd46-48e0-9b20-e04b14f4ede3 req-dd09bcb3-4768-4057-9b1a-b2eb63c9b074 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:48.272751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-8a4b26fe-bd46-48e0-9b20-e04b14f4ede3 req-dd09bcb3-4768-4057-9b1a-b2eb63c9b074 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:48.284503 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-8a4b26fe-bd46-48e0-9b20-e04b14f4ede3 req-dd09bcb3-4768-4057-9b1a-b2eb63c9b074 service nova] Creating event network-vif-plugged:79dca042-6947-4adc-a9c5-140637c9aa60 for instance 6e9c0d49-38f7-4df4-bd38-1cc854392c80 on n-h2-850468-16 Aug 23 19:10:48.291099 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-8a4b26fe-bd46-48e0-9b20-e04b14f4ede3 req-dd09bcb3-4768-4057-9b1a-b2eb63c9b074 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033933 Aug 23 19:10:48.291888 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3844/7821] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:10:48.654934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-84eedcd3-b51e-4954-818a-a56071a87b4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:48.655572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-84eedcd3-b51e-4954-818a-a56071a87b4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:48.663159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84eedcd3-b51e-4954-818a-a56071a87b4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:48.663657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84eedcd3-b51e-4954-818a-a56071a87b4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:48.664113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84eedcd3-b51e-4954-818a-a56071a87b4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:48.664818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84eedcd3-b51e-4954-818a-a56071a87b4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:48.665282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84eedcd3-b51e-4954-818a-a56071a87b4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:48.665725 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-84eedcd3-b51e-4954-818a-a56071a87b4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:48.802274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-84eedcd3-b51e-4954-818a-a56071a87b4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:48.810063 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-84eedcd3-b51e-4954-818a-a56071a87b4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1391 microversion: 2.1 time: 0.159207 Aug 23 19:10:48.810655 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3978/7822] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:48 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:49.831287 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-090ad836-5da7-4333-abc5-1395f00883e9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:49.832007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-090ad836-5da7-4333-abc5-1395f00883e9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:49.834053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:10:49.834803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:10:49.841917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-090ad836-5da7-4333-abc5-1395f00883e9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:49.842405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-090ad836-5da7-4333-abc5-1395f00883e9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:49.842871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-090ad836-5da7-4333-abc5-1395f00883e9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:49.843571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-090ad836-5da7-4333-abc5-1395f00883e9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:49.844023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-090ad836-5da7-4333-abc5-1395f00883e9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:49.844446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-090ad836-5da7-4333-abc5-1395f00883e9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:49.985945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-090ad836-5da7-4333-abc5-1395f00883e9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:49.994374 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-090ad836-5da7-4333-abc5-1395f00883e9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1562 microversion: 2.1 time: 0.167379 Aug 23 19:10:49.994981 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3845/7823] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:49 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1562 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:50.014667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-20c2081c-731b-44f6-9de3-cdc6e50eb72e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:50.015270 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-20c2081c-731b-44f6-9de3-cdc6e50eb72e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:50.017135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:10:50.023188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20c2081c-731b-44f6-9de3-cdc6e50eb72e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:50.023696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20c2081c-731b-44f6-9de3-cdc6e50eb72e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:50.024154 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20c2081c-731b-44f6-9de3-cdc6e50eb72e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:50.024874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20c2081c-731b-44f6-9de3-cdc6e50eb72e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:50.025350 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20c2081c-731b-44f6-9de3-cdc6e50eb72e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:50.025802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-20c2081c-731b-44f6-9de3-cdc6e50eb72e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:50.157264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-20c2081c-731b-44f6-9de3-cdc6e50eb72e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:50.165607 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-20c2081c-731b-44f6-9de3-cdc6e50eb72e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1562 microversion: 2.1 time: 0.154436 Aug 23 19:10:50.165970 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3979/7824] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:50 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:10:52.010521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d097601b-4ec4-4fbb-a7ce-0e40068c6ecd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:10:52.011174 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d097601b-4ec4-4fbb-a7ce-0e40068c6ecd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:10:52.015569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-81474ca9-d4ed-4a9e-b3cd-1994b4c6579f req-d36fee36-882b-4e3f-8aa8-23207589218e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9c0d49-38f7-4df4-bd38-1cc854392c80", "tag": "79dca042-6947-4adc-a9c5-140637c9aa60"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:10:52.018168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d097601b-4ec4-4fbb-a7ce-0e40068c6ecd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:52.018725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d097601b-4ec4-4fbb-a7ce-0e40068c6ecd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:52.019173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d097601b-4ec4-4fbb-a7ce-0e40068c6ecd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:52.020580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d097601b-4ec4-4fbb-a7ce-0e40068c6ecd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:52.021242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d097601b-4ec4-4fbb-a7ce-0e40068c6ecd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:52.021683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d097601b-4ec4-4fbb-a7ce-0e40068c6ecd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:52.028676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-81474ca9-d4ed-4a9e-b3cd-1994b4c6579f req-d36fee36-882b-4e3f-8aa8-23207589218e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:10:52.029175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-81474ca9-d4ed-4a9e-b3cd-1994b4c6579f req-d36fee36-882b-4e3f-8aa8-23207589218e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:10:52.029627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-81474ca9-d4ed-4a9e-b3cd-1994b4c6579f req-d36fee36-882b-4e3f-8aa8-23207589218e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:10:52.042308 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-81474ca9-d4ed-4a9e-b3cd-1994b4c6579f req-d36fee36-882b-4e3f-8aa8-23207589218e service nova] Creating event network-changed:79dca042-6947-4adc-a9c5-140637c9aa60 for instance 6e9c0d49-38f7-4df4-bd38-1cc854392c80 on n-h2-850468-16 Aug 23 19:10:52.047451 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-81474ca9-d4ed-4a9e-b3cd-1994b4c6579f req-d36fee36-882b-4e3f-8aa8-23207589218e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036340 Aug 23 19:10:52.048053 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3980/7825] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:10:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:10:52.259175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d097601b-4ec4-4fbb-a7ce-0e40068c6ecd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:10:52.270259 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d097601b-4ec4-4fbb-a7ce-0e40068c6ecd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1562 microversion: 2.1 time: 0.264002 Aug 23 19:10:52.270983 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3846/7826] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:10:52 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1562 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:11:25.560689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=17 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:11:25.561455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=38 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:11:25.565788 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5b9ed6bb-ae12-429d-9756-5c8ddbeeeded tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:11:25.568226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5b9ed6bb-ae12-429d-9756-5c8ddbeeeded tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:11:25.576148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b9ed6bb-ae12-429d-9756-5c8ddbeeeded tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:25.576655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b9ed6bb-ae12-429d-9756-5c8ddbeeeded tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:25.577172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b9ed6bb-ae12-429d-9756-5c8ddbeeeded tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:25.577842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b9ed6bb-ae12-429d-9756-5c8ddbeeeded tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:25.578326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b9ed6bb-ae12-429d-9756-5c8ddbeeeded tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:25.578803 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b9ed6bb-ae12-429d-9756-5c8ddbeeeded tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:25.632945 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5b9ed6bb-ae12-429d-9756-5c8ddbeeeded tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80/action" status: 200 len: 24571 microversion: 2.1 time: 0.074309 Aug 23 19:11:25.633618 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3981/7827] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:11:25 2022] POST /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80/action => generated 24571 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:11:55.845037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:11:55.845806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=36 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:11:55.849862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c300b47e-c2aa-4a80-a981-bdc321e64c0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:11:55.850393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c300b47e-c2aa-4a80-a981-bdc321e64c0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:11:55.858192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c300b47e-c2aa-4a80-a981-bdc321e64c0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:55.858699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c300b47e-c2aa-4a80-a981-bdc321e64c0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:55.859137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c300b47e-c2aa-4a80-a981-bdc321e64c0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:55.859830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c300b47e-c2aa-4a80-a981-bdc321e64c0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:55.860309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c300b47e-c2aa-4a80-a981-bdc321e64c0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:55.860707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c300b47e-c2aa-4a80-a981-bdc321e64c0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:55.928310 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c300b47e-c2aa-4a80-a981-bdc321e64c0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80/action" status: 202 len: 0 microversion: 2.1 time: 0.084746 Aug 23 19:11:55.929407 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3847/7828] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:11:55 2022] POST /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:11:55.938563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-60896e95-7284-4458-8bd2-a9f7192ff768 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:11:55.939305 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-60896e95-7284-4458-8bd2-a9f7192ff768 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:11:55.943393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:11:55.944212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:11:55.950088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60896e95-7284-4458-8bd2-a9f7192ff768 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:55.950860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60896e95-7284-4458-8bd2-a9f7192ff768 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:55.951495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60896e95-7284-4458-8bd2-a9f7192ff768 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:55.952259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60896e95-7284-4458-8bd2-a9f7192ff768 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:55.952737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60896e95-7284-4458-8bd2-a9f7192ff768 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:55.953181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-60896e95-7284-4458-8bd2-a9f7192ff768 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:56.088467 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-60896e95-7284-4458-8bd2-a9f7192ff768 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:11:56.097185 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-60896e95-7284-4458-8bd2-a9f7192ff768 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1685 microversion: 2.1 time: 0.162947 Aug 23 19:11:56.097740 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3982/7829] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:11:55 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1685 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:11:57.121580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e49b16b-51e7-49b4-ad6f-32292a881e61 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:11:57.122213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e49b16b-51e7-49b4-ad6f-32292a881e61 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:11:57.128499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e49b16b-51e7-49b4-ad6f-32292a881e61 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:57.128988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e49b16b-51e7-49b4-ad6f-32292a881e61 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:57.129432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e49b16b-51e7-49b4-ad6f-32292a881e61 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:57.130131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e49b16b-51e7-49b4-ad6f-32292a881e61 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:57.130617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e49b16b-51e7-49b4-ad6f-32292a881e61 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:57.131051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e49b16b-51e7-49b4-ad6f-32292a881e61 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:57.314100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e49b16b-51e7-49b4-ad6f-32292a881e61 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:11:57.321932 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e49b16b-51e7-49b4-ad6f-32292a881e61 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1665 microversion: 2.1 time: 0.206121 Aug 23 19:11:57.322519 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3848/7830] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:11:57 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1665 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:11:58.419173 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bfd45270-ea87-42cc-99a5-fd339e880cd4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:11:58.421380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bfd45270-ea87-42cc-99a5-fd339e880cd4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:11:58.431789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfd45270-ea87-42cc-99a5-fd339e880cd4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:58.432289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfd45270-ea87-42cc-99a5-fd339e880cd4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:58.432743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfd45270-ea87-42cc-99a5-fd339e880cd4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:58.433842 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfd45270-ea87-42cc-99a5-fd339e880cd4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:58.434369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfd45270-ea87-42cc-99a5-fd339e880cd4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:58.434849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bfd45270-ea87-42cc-99a5-fd339e880cd4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:58.485962 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bfd45270-ea87-42cc-99a5-fd339e880cd4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80/action" status: 200 len: 32646 microversion: 2.1 time: 0.070726 Aug 23 19:11:58.486651 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3983/7831] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:11:58 2022] POST /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80/action => generated 32646 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:11:58.498515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fc5adfc5-9b74-44cd-b18f-0745e18a9145 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:11:58.499062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fc5adfc5-9b74-44cd-b18f-0745e18a9145 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:11:58.505963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc5adfc5-9b74-44cd-b18f-0745e18a9145 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:58.506438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc5adfc5-9b74-44cd-b18f-0745e18a9145 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:58.506899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc5adfc5-9b74-44cd-b18f-0745e18a9145 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:58.507595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc5adfc5-9b74-44cd-b18f-0745e18a9145 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:58.508048 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc5adfc5-9b74-44cd-b18f-0745e18a9145 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:58.508471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fc5adfc5-9b74-44cd-b18f-0745e18a9145 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:58.573345 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fc5adfc5-9b74-44cd-b18f-0745e18a9145 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80/action" status: 202 len: 0 microversion: 2.1 time: 0.078475 Aug 23 19:11:58.574809 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3849/7832] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:11:58 2022] POST /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:11:58.583777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cfb1da37-aafe-42ef-b40f-f0552b59b353 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:11:58.584504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cfb1da37-aafe-42ef-b40f-f0552b59b353 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:11:58.592690 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfb1da37-aafe-42ef-b40f-f0552b59b353 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:58.593609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfb1da37-aafe-42ef-b40f-f0552b59b353 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:58.593750 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfb1da37-aafe-42ef-b40f-f0552b59b353 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:58.594413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfb1da37-aafe-42ef-b40f-f0552b59b353 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:58.594921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfb1da37-aafe-42ef-b40f-f0552b59b353 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:58.595379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cfb1da37-aafe-42ef-b40f-f0552b59b353 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:58.737197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cfb1da37-aafe-42ef-b40f-f0552b59b353 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:11:58.746310 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cfb1da37-aafe-42ef-b40f-f0552b59b353 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1672 microversion: 2.1 time: 0.166313 Aug 23 19:11:58.746531 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3984/7833] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:11:58 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:11:59.768512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a9381658-acb1-4e79-b791-a1dfbc063abc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:11:59.769229 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a9381658-acb1-4e79-b791-a1dfbc063abc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:11:59.776248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9381658-acb1-4e79-b791-a1dfbc063abc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:59.776737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9381658-acb1-4e79-b791-a1dfbc063abc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:59.777762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9381658-acb1-4e79-b791-a1dfbc063abc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:59.778461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9381658-acb1-4e79-b791-a1dfbc063abc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:11:59.778945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9381658-acb1-4e79-b791-a1dfbc063abc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:11:59.779379 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a9381658-acb1-4e79-b791-a1dfbc063abc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:11:59.914182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a9381658-acb1-4e79-b791-a1dfbc063abc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:11:59.922663 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a9381658-acb1-4e79-b791-a1dfbc063abc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1680 microversion: 2.1 time: 0.158410 Aug 23 19:11:59.923233 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3850/7834] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:11:59 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:00.017894 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-986e9531-0c7e-474e-869d-5b1fcfb11a89 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:12:00.020131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-986e9531-0c7e-474e-869d-5b1fcfb11a89 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:00.027726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-986e9531-0c7e-474e-869d-5b1fcfb11a89 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:00.028221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-986e9531-0c7e-474e-869d-5b1fcfb11a89 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:00.028670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-986e9531-0c7e-474e-869d-5b1fcfb11a89 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:00.029382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-986e9531-0c7e-474e-869d-5b1fcfb11a89 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:00.029850 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-986e9531-0c7e-474e-869d-5b1fcfb11a89 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:00.030290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-986e9531-0c7e-474e-869d-5b1fcfb11a89 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:00.083125 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-986e9531-0c7e-474e-869d-5b1fcfb11a89 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80/action" status: 200 len: 38448 microversion: 2.1 time: 0.069022 Aug 23 19:12:00.084067 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3985/7835] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:12:00 2022] POST /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80/action => generated 38448 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:12:01.054152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2288ae16-d0a9-444f-b519-280b95e3880b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:01.054694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2288ae16-d0a9-444f-b519-280b95e3880b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:01.064901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2288ae16-d0a9-444f-b519-280b95e3880b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:01.065750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2288ae16-d0a9-444f-b519-280b95e3880b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:01.066194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2288ae16-d0a9-444f-b519-280b95e3880b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:01.066931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2288ae16-d0a9-444f-b519-280b95e3880b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:01.068030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2288ae16-d0a9-444f-b519-280b95e3880b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:01.068515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2288ae16-d0a9-444f-b519-280b95e3880b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:01.095770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2288ae16-d0a9-444f-b519-280b95e3880b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:12:01.120664 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-941102ee-dd76-491a-a88a-0d2802c137f6 req-e86540c8-2e8b-42e3-89dd-d383759920f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e9c0d49-38f7-4df4-bd38-1cc854392c80", "tag": "79dca042-6947-4adc-a9c5-140637c9aa60"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:12:01.132049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-941102ee-dd76-491a-a88a-0d2802c137f6 req-e86540c8-2e8b-42e3-89dd-d383759920f9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:01.132872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-941102ee-dd76-491a-a88a-0d2802c137f6 req-e86540c8-2e8b-42e3-89dd-d383759920f9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:01.133549 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-941102ee-dd76-491a-a88a-0d2802c137f6 req-e86540c8-2e8b-42e3-89dd-d383759920f9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:01.145582 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-941102ee-dd76-491a-a88a-0d2802c137f6 req-e86540c8-2e8b-42e3-89dd-d383759920f9 service nova] Creating event network-changed:79dca042-6947-4adc-a9c5-140637c9aa60 for instance 6e9c0d49-38f7-4df4-bd38-1cc854392c80 on n-h2-850468-16 Aug 23 19:12:01.150521 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-941102ee-dd76-491a-a88a-0d2802c137f6 req-e86540c8-2e8b-42e3-89dd-d383759920f9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097783 Aug 23 19:12:01.151557 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3986/7836] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:12:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:12:01.188711 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2288ae16-d0a9-444f-b519-280b95e3880b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "DELETE /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 204 len: 0 microversion: 2.1 time: 0.138458 Aug 23 19:12:01.189317 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3851/7837] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:12:01 2022] DELETE /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:12:01.198848 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3cc8fee7-0894-4f72-a1d1-51cd06a9a997 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:01.199810 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3cc8fee7-0894-4f72-a1d1-51cd06a9a997 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:01.208924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cc8fee7-0894-4f72-a1d1-51cd06a9a997 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:01.209591 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cc8fee7-0894-4f72-a1d1-51cd06a9a997 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:01.210362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cc8fee7-0894-4f72-a1d1-51cd06a9a997 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:01.211585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cc8fee7-0894-4f72-a1d1-51cd06a9a997 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:01.212150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cc8fee7-0894-4f72-a1d1-51cd06a9a997 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:01.212676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cc8fee7-0894-4f72-a1d1-51cd06a9a997 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:01.353306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3cc8fee7-0894-4f72-a1d1-51cd06a9a997 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:01.362153 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3cc8fee7-0894-4f72-a1d1-51cd06a9a997 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1686 microversion: 2.1 time: 0.168093 Aug 23 19:12:01.363124 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3987/7838] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:01 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1686 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:12:02.385433 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-27b8a63d-a165-4c6a-be77-fd74dc509216 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:02.386306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-27b8a63d-a165-4c6a-be77-fd74dc509216 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:02.393478 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27b8a63d-a165-4c6a-be77-fd74dc509216 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:02.394222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27b8a63d-a165-4c6a-be77-fd74dc509216 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:02.394845 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27b8a63d-a165-4c6a-be77-fd74dc509216 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:02.395911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27b8a63d-a165-4c6a-be77-fd74dc509216 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:02.396168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27b8a63d-a165-4c6a-be77-fd74dc509216 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:02.396589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-27b8a63d-a165-4c6a-be77-fd74dc509216 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:02.945006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-27b8a63d-a165-4c6a-be77-fd74dc509216 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:02.953692 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-27b8a63d-a165-4c6a-be77-fd74dc509216 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1686 microversion: 2.1 time: 0.573097 Aug 23 19:12:02.954514 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3852/7839] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:02 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1686 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:03.304012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-554631f0-9e26-431d-8fc7-2266e55be6b0 req-06502106-0e4b-4249-b624-0838bcbb38e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e9c0d49-38f7-4df4-bd38-1cc854392c80", "name": "network-vif-deleted", "tag": "79dca042-6947-4adc-a9c5-140637c9aa60"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:12:03.314982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-554631f0-9e26-431d-8fc7-2266e55be6b0 req-06502106-0e4b-4249-b624-0838bcbb38e5 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:03.315475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-554631f0-9e26-431d-8fc7-2266e55be6b0 req-06502106-0e4b-4249-b624-0838bcbb38e5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:03.315920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-554631f0-9e26-431d-8fc7-2266e55be6b0 req-06502106-0e4b-4249-b624-0838bcbb38e5 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:03.327265 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-554631f0-9e26-431d-8fc7-2266e55be6b0 req-06502106-0e4b-4249-b624-0838bcbb38e5 service nova] Creating event network-vif-deleted:79dca042-6947-4adc-a9c5-140637c9aa60 for instance 6e9c0d49-38f7-4df4-bd38-1cc854392c80 on n-h2-850468-16 Aug 23 19:12:03.332656 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-554631f0-9e26-431d-8fc7-2266e55be6b0 req-06502106-0e4b-4249-b624-0838bcbb38e5 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032645 Aug 23 19:12:03.333204 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3988/7840] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:12:03.975541 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:03.976749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:03.985085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:03.985580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:03.986025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:03.986762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:03.987216 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:03.987647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:04.020577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:04.021061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:04.021684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:04.022325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lazy-loading 'fault' on Instance uuid 6e9c0d49-38f7-4df4-bd38-1cc854392c80 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:12:04.066130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:04.073223 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c788f4b5-d7fe-4252-924d-2ea7b4e918b2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 200 len: 1355 microversion: 2.1 time: 0.101585 Aug 23 19:12:04.073786 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3853/7841] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:03 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 1355 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:05.096604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f1312841-dc68-4c41-b27a-d9480184d258 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:05.097239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f1312841-dc68-4c41-b27a-d9480184d258 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 6e9c0d49-38f7-4df4-bd38-1cc854392c80] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:05.103485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f1312841-dc68-4c41-b27a-d9480184d258 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:05.103989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f1312841-dc68-4c41-b27a-d9480184d258 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:05.104443 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f1312841-dc68-4c41-b27a-d9480184d258 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:05.105183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f1312841-dc68-4c41-b27a-d9480184d258 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:05.105762 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f1312841-dc68-4c41-b27a-d9480184d258 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:05.106201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f1312841-dc68-4c41-b27a-d9480184d258 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:05.119528 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-f1312841-dc68-4c41-b27a-d9480184d258 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] HTTP exception thrown: Instance 6e9c0d49-38f7-4df4-bd38-1cc854392c80 could not be found. Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f1312841-dc68-4c41-b27a-d9480184d258 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Request method failure captured: Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 HTTP/1.1 Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSYnx1WT4Gq2W98xrb4v7A_NZEqhPSI9Nnx0JtMEtpxu6ASOeeNPsAUHO7NTkLBeC-b0QKnbzfLy_iy-WFwk6pin00WncrZMV-1kc-S_LC8OXBre2xGrhEMDXxk9aYiPr88-JSsp-T-qo3q5YV-u1YQ_T_pJ5tOz5fWaqLFzc6WKr6Y Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 7b28c141b95b4205a6557e8d9a7fc07a Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b28c141b95b4205a6557e8d9a7fc07a"}]}] Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 7b28c141b95b4205a6557e8d9a7fc07a Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestNetworkAdvancedServerOps-267656723-project Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2887d531d5a9449c9cb350a5b1dd73d2 Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestNetworkAdvancedServerOps-267656723-project Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 6e9c0d49-38f7-4df4-bd38-1cc854392c80 could not be found. Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '6e9c0d49-38f7-4df4-bd38-1cc854392c80'} Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e9c0d49-38f7-4df4-bd38-1cc854392c80 could not be found. Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e9c0d49-38f7-4df4-bd38-1cc854392c80 could not be found. Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:12:05.121647 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:12:05.126475 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:12:05.126475 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:12:05.126475 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:12:05.126475 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:12:05.126475 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:12:05.126475 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:12:05.126475 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e9c0d49-38f7-4df4-bd38-1cc854392c80 could not be found. Aug 23 19:12:05.126475 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:12:05.126475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f1312841-dc68-4c41-b27a-d9480184d258 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Returning 404 to user: Instance 6e9c0d49-38f7-4df4-bd38-1cc854392c80 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:12:05.126475 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f1312841-dc68-4c41-b27a-d9480184d258 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80" status: 404 len: 111 microversion: 2.1 time: 0.031699 Aug 23 19:12:05.126475 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3989/7842] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:05 2022] GET /compute/v2.1/servers/6e9c0d49-38f7-4df4-bd38-1cc854392c80 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:12:08.438399 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aaaf81bd-cf69-42e3-9ec5-0e883cbc8467 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '.version_select at 0x7f27dfaa7e50>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:08.464225 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aaaf81bd-cf69-42e3-9ec5-0e883cbc8467 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-885954245" status: 202 len: 0 microversion: 2.1 time: 0.031551 Aug 23 19:12:08.465559 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3854/7843] 10.222.0.61 () {58 vars in 1281 bytes} [Tue Aug 23 19:12:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-885954245 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:12:08.495004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d12c7781-0eae-427f-9c8f-16b55aa96038 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'create', calling method: .version_select at 0x7f27dfa92ee0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1932318943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDMP2Bb/rUM1AGyz9B14yMEQWZuVGXGGcpt78le9rDjABiVNVBc3rN3vgeMqtvVMAzulTDrmn4NaqNQRLrWuHlccZvurSiIMBR3tfMODbqxyF7KXUQNkOffedti9yWG8zA=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:12:08.513734 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d12c7781-0eae-427f-9c8f-16b55aa96038 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:12:08.519085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-d12c7781-0eae-427f-9c8f-16b55aa96038 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for user 2887d531d5a9449c9cb350a5b1dd73d2 and project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:12:08.542145 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d12c7781-0eae-427f-9c8f-16b55aa96038 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.051312 Aug 23 19:12:08.542806 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3990/7844] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 19:12:08 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:12:14.088632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:12:14.093561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1427610816", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "e40f4134-7f78-40b9-b320-fb5a283280b8"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1932318943", "security_groups": [{"name": "tempest-secgroup-smoke-809938376"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:12:14.215034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] validate_networks() for [('e40f4134-7f78-40b9-b320-fb5a283280b8', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:12:14.730587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:12:14.731317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:12:14.731734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:12:14.732249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:12:14.732767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:12:14.753503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:14.757661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:14.758409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:14.759659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:14.760374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:14.762468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:14.789422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:12:14.796111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for user 2887d531d5a9449c9cb350a5b1dd73d2 and project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:12:14.817262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:12:14.820115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:12:14.880766 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4c05aef5-7c5a-4377-a1ac-48723933c53f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.793808 Aug 23 19:12:14.881993 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3855/7845] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:12:14 2022] POST /compute/v2.1/servers => generated 405 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:12:14.895103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-02010e53-d607-4014-be8c-9c9194f1ca2d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:14.896065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-02010e53-d607-4014-be8c-9c9194f1ca2d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:14.978226 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-02010e53-d607-4014-be8c-9c9194f1ca2d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:14.987439 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-02010e53-d607-4014-be8c-9c9194f1ca2d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1267 microversion: 2.1 time: 0.098140 Aug 23 19:12:14.990221 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3991/7846] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:14 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1267 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:16.010525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b93f9a2f-afce-4559-88a9-6c720721d0db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:16.012520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b93f9a2f-afce-4559-88a9-6c720721d0db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:16.033063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b93f9a2f-afce-4559-88a9-6c720721d0db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:16.034589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b93f9a2f-afce-4559-88a9-6c720721d0db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:16.035667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b93f9a2f-afce-4559-88a9-6c720721d0db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:16.036596 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b93f9a2f-afce-4559-88a9-6c720721d0db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:16.037502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b93f9a2f-afce-4559-88a9-6c720721d0db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:16.038129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b93f9a2f-afce-4559-88a9-6c720721d0db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:16.126299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b93f9a2f-afce-4559-88a9-6c720721d0db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:16.136897 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b93f9a2f-afce-4559-88a9-6c720721d0db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1327 microversion: 2.1 time: 0.131046 Aug 23 19:12:16.138645 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3856/7847] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:16 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1327 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:17.159029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-adcc575a-dd48-4671-97b9-78abf6f4f2ef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:17.159697 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-adcc575a-dd48-4671-97b9-78abf6f4f2ef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:17.161915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=32 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:12:17.173017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adcc575a-dd48-4671-97b9-78abf6f4f2ef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:17.173833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adcc575a-dd48-4671-97b9-78abf6f4f2ef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:17.174308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adcc575a-dd48-4671-97b9-78abf6f4f2ef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:17.175077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adcc575a-dd48-4671-97b9-78abf6f4f2ef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:17.175722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adcc575a-dd48-4671-97b9-78abf6f4f2ef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:17.176342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-adcc575a-dd48-4671-97b9-78abf6f4f2ef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:17.397077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-adcc575a-dd48-4671-97b9-78abf6f4f2ef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:17.406027 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-adcc575a-dd48-4671-97b9-78abf6f4f2ef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1392 microversion: 2.1 time: 0.251288 Aug 23 19:12:17.406660 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3992/7848] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:17 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1392 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:17.729282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-4fa0fd4b-a7f3-45ff-9fc7-15c068362670 req-8e3413da-6adb-4035-8eac-077d8d5ac10b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5103a801-969f-4e87-8468-f1ace44d0e37", "tag": "53ff4cb1-7501-4db9-8899-f82b6ab66089"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:12:17.739687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4fa0fd4b-a7f3-45ff-9fc7-15c068362670 req-8e3413da-6adb-4035-8eac-077d8d5ac10b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:17.740404 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4fa0fd4b-a7f3-45ff-9fc7-15c068362670 req-8e3413da-6adb-4035-8eac-077d8d5ac10b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:17.741030 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-4fa0fd4b-a7f3-45ff-9fc7-15c068362670 req-8e3413da-6adb-4035-8eac-077d8d5ac10b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:17.753712 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-4fa0fd4b-a7f3-45ff-9fc7-15c068362670 req-8e3413da-6adb-4035-8eac-077d8d5ac10b service nova] Creating event network-changed:53ff4cb1-7501-4db9-8899-f82b6ab66089 for instance 5103a801-969f-4e87-8468-f1ace44d0e37 on n-h2-850468-16 Aug 23 19:12:17.758820 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-4fa0fd4b-a7f3-45ff-9fc7-15c068362670 req-8e3413da-6adb-4035-8eac-077d8d5ac10b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034002 Aug 23 19:12:17.759605 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3857/7849] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:12:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:12:18.428122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2c726f92-1943-4e6a-87b8-bb7e1ea62ca6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:18.428815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2c726f92-1943-4e6a-87b8-bb7e1ea62ca6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:18.436745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c726f92-1943-4e6a-87b8-bb7e1ea62ca6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:18.437481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c726f92-1943-4e6a-87b8-bb7e1ea62ca6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:18.438180 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c726f92-1943-4e6a-87b8-bb7e1ea62ca6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:18.439148 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c726f92-1943-4e6a-87b8-bb7e1ea62ca6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:18.439626 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c726f92-1943-4e6a-87b8-bb7e1ea62ca6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:18.440141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2c726f92-1943-4e6a-87b8-bb7e1ea62ca6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:18.577547 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2c726f92-1943-4e6a-87b8-bb7e1ea62ca6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:18.585543 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2c726f92-1943-4e6a-87b8-bb7e1ea62ca6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1392 microversion: 2.1 time: 0.161358 Aug 23 19:12:18.586142 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3993/7850] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:18 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:19.608248 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3af41418-08b3-4ce0-aec0-b06ccaec3ddd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:19.608953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3af41418-08b3-4ce0-aec0-b06ccaec3ddd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:19.615503 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3af41418-08b3-4ce0-aec0-b06ccaec3ddd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:19.615990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3af41418-08b3-4ce0-aec0-b06ccaec3ddd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:19.616431 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3af41418-08b3-4ce0-aec0-b06ccaec3ddd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:19.617131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3af41418-08b3-4ce0-aec0-b06ccaec3ddd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:19.617585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3af41418-08b3-4ce0-aec0-b06ccaec3ddd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:19.618015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3af41418-08b3-4ce0-aec0-b06ccaec3ddd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:19.752482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3af41418-08b3-4ce0-aec0-b06ccaec3ddd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:19.760597 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3af41418-08b3-4ce0-aec0-b06ccaec3ddd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1392 microversion: 2.1 time: 0.157877 Aug 23 19:12:19.761127 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3858/7851] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:19 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:20.782195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f07f62ae-5ea2-4fd0-8dc9-073c77239557 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:20.782926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f07f62ae-5ea2-4fd0-8dc9-073c77239557 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:20.789826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f07f62ae-5ea2-4fd0-8dc9-073c77239557 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:20.790331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f07f62ae-5ea2-4fd0-8dc9-073c77239557 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:20.790814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f07f62ae-5ea2-4fd0-8dc9-073c77239557 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:20.791592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f07f62ae-5ea2-4fd0-8dc9-073c77239557 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:20.792009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f07f62ae-5ea2-4fd0-8dc9-073c77239557 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:20.792454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f07f62ae-5ea2-4fd0-8dc9-073c77239557 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:20.930054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f07f62ae-5ea2-4fd0-8dc9-073c77239557 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:20.938248 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f07f62ae-5ea2-4fd0-8dc9-073c77239557 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1392 microversion: 2.1 time: 0.160815 Aug 23 19:12:20.938858 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3994/7852] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:20 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:21.958974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-33dc8cf6-3dbc-4b62-bea1-250c519f1855 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:21.959591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-33dc8cf6-3dbc-4b62-bea1-250c519f1855 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:21.966983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33dc8cf6-3dbc-4b62-bea1-250c519f1855 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:21.967472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33dc8cf6-3dbc-4b62-bea1-250c519f1855 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:21.967931 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33dc8cf6-3dbc-4b62-bea1-250c519f1855 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:21.968622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33dc8cf6-3dbc-4b62-bea1-250c519f1855 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:21.969073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33dc8cf6-3dbc-4b62-bea1-250c519f1855 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:21.969496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-33dc8cf6-3dbc-4b62-bea1-250c519f1855 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:22.105628 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-33dc8cf6-3dbc-4b62-bea1-250c519f1855 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:22.113902 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-33dc8cf6-3dbc-4b62-bea1-250c519f1855 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1392 microversion: 2.1 time: 0.158796 Aug 23 19:12:22.114798 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3859/7853] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:21 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:23.136771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-308fb537-924e-464f-b4c2-65e2ef648f95 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:23.138245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-308fb537-924e-464f-b4c2-65e2ef648f95 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:23.144285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-308fb537-924e-464f-b4c2-65e2ef648f95 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:23.144792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-308fb537-924e-464f-b4c2-65e2ef648f95 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:23.145252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-308fb537-924e-464f-b4c2-65e2ef648f95 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:23.145967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-308fb537-924e-464f-b4c2-65e2ef648f95 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:23.146445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-308fb537-924e-464f-b4c2-65e2ef648f95 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:23.146923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-308fb537-924e-464f-b4c2-65e2ef648f95 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:23.279606 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-308fb537-924e-464f-b4c2-65e2ef648f95 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:23.287391 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-308fb537-924e-464f-b4c2-65e2ef648f95 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1392 microversion: 2.1 time: 0.155437 Aug 23 19:12:23.287979 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3995/7854] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:23 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:12:24.307876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-43388394-097b-4fd9-b031-a3373a6c8ad5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:24.308491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-43388394-097b-4fd9-b031-a3373a6c8ad5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:24.316000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43388394-097b-4fd9-b031-a3373a6c8ad5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:24.316484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43388394-097b-4fd9-b031-a3373a6c8ad5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:24.316924 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43388394-097b-4fd9-b031-a3373a6c8ad5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:24.317668 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43388394-097b-4fd9-b031-a3373a6c8ad5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:24.318070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43388394-097b-4fd9-b031-a3373a6c8ad5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:24.318496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-43388394-097b-4fd9-b031-a3373a6c8ad5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:24.459310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-43388394-097b-4fd9-b031-a3373a6c8ad5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:24.467347 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-43388394-097b-4fd9-b031-a3373a6c8ad5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1392 microversion: 2.1 time: 0.163387 Aug 23 19:12:24.467915 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3860/7855] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:24 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1392 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:24.708085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-01675ea1-5bcb-4450-96c7-9a6ea258c22d req-6e6c58b2-c9a0-4223-a9de-879f1c74128f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5103a801-969f-4e87-8468-f1ace44d0e37", "name": "network-vif-plugged", "status": "completed", "tag": "53ff4cb1-7501-4db9-8899-f82b6ab66089"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:12:24.719737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-01675ea1-5bcb-4450-96c7-9a6ea258c22d req-6e6c58b2-c9a0-4223-a9de-879f1c74128f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:24.720301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-01675ea1-5bcb-4450-96c7-9a6ea258c22d req-6e6c58b2-c9a0-4223-a9de-879f1c74128f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:24.720675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-01675ea1-5bcb-4450-96c7-9a6ea258c22d req-6e6c58b2-c9a0-4223-a9de-879f1c74128f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:24.732018 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-01675ea1-5bcb-4450-96c7-9a6ea258c22d req-6e6c58b2-c9a0-4223-a9de-879f1c74128f service nova] Creating event network-vif-plugged:53ff4cb1-7501-4db9-8899-f82b6ab66089 for instance 5103a801-969f-4e87-8468-f1ace44d0e37 on n-h2-850468-16 Aug 23 19:12:24.737244 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-01675ea1-5bcb-4450-96c7-9a6ea258c22d req-6e6c58b2-c9a0-4223-a9de-879f1c74128f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032872 Aug 23 19:12:24.737883 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3996/7856] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:12:25.489787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d104b96d-4552-4b20-8b40-3e8e723a7222 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:25.490659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d104b96d-4552-4b20-8b40-3e8e723a7222 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:25.493417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:12:25.494555 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:12:25.502958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d104b96d-4552-4b20-8b40-3e8e723a7222 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:25.503446 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d104b96d-4552-4b20-8b40-3e8e723a7222 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:25.503880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d104b96d-4552-4b20-8b40-3e8e723a7222 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:25.504583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d104b96d-4552-4b20-8b40-3e8e723a7222 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:25.505035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d104b96d-4552-4b20-8b40-3e8e723a7222 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:25.505458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d104b96d-4552-4b20-8b40-3e8e723a7222 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:25.660313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d104b96d-4552-4b20-8b40-3e8e723a7222 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:25.669325 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d104b96d-4552-4b20-8b40-3e8e723a7222 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1392 microversion: 2.1 time: 0.182912 Aug 23 19:12:25.669909 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3861/7857] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:25 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:26.688570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:12:26.693666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1e888875-80d2-4140-af9f-2ea21115ff3b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:26.694417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1e888875-80d2-4140-af9f-2ea21115ff3b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:26.696221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:12:26.703300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e888875-80d2-4140-af9f-2ea21115ff3b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:26.703798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e888875-80d2-4140-af9f-2ea21115ff3b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:26.704252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e888875-80d2-4140-af9f-2ea21115ff3b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:26.704955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e888875-80d2-4140-af9f-2ea21115ff3b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:26.705420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e888875-80d2-4140-af9f-2ea21115ff3b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:26.705860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1e888875-80d2-4140-af9f-2ea21115ff3b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:26.843934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1e888875-80d2-4140-af9f-2ea21115ff3b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:26.851785 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1e888875-80d2-4140-af9f-2ea21115ff3b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1564 microversion: 2.1 time: 0.164175 Aug 23 19:12:26.852358 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3997/7858] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:26 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1564 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:26.872847 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0f96a316-7003-4a2e-bc53-08956f60ad42 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:26.873475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0f96a316-7003-4a2e-bc53-08956f60ad42 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:26.876194 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:12:26.881396 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f96a316-7003-4a2e-bc53-08956f60ad42 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:26.881871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f96a316-7003-4a2e-bc53-08956f60ad42 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:26.882305 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f96a316-7003-4a2e-bc53-08956f60ad42 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:26.883015 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f96a316-7003-4a2e-bc53-08956f60ad42 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:26.883465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f96a316-7003-4a2e-bc53-08956f60ad42 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:26.883886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0f96a316-7003-4a2e-bc53-08956f60ad42 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:27.024734 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0f96a316-7003-4a2e-bc53-08956f60ad42 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:27.032483 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0f96a316-7003-4a2e-bc53-08956f60ad42 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1564 microversion: 2.1 time: 0.164312 Aug 23 19:12:27.033050 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3862/7859] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:26 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:28.613005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2dc3eaeb-d9b1-4775-a546-b71109fbf8cc req-3933528e-11f0-4818-afcf-aaeb22e262da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5103a801-969f-4e87-8468-f1ace44d0e37", "tag": "53ff4cb1-7501-4db9-8899-f82b6ab66089"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:12:28.616561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5b02d2b5-bee2-4a66-9218-e5d89dbc30a9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:12:28.625478 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5b02d2b5-bee2-4a66-9218-e5d89dbc30a9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:12:28.636092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b02d2b5-bee2-4a66-9218-e5d89dbc30a9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:28.636607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b02d2b5-bee2-4a66-9218-e5d89dbc30a9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:28.637067 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b02d2b5-bee2-4a66-9218-e5d89dbc30a9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:28.637930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b02d2b5-bee2-4a66-9218-e5d89dbc30a9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:28.638387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b02d2b5-bee2-4a66-9218-e5d89dbc30a9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:28.638862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5b02d2b5-bee2-4a66-9218-e5d89dbc30a9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:28.646362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2dc3eaeb-d9b1-4775-a546-b71109fbf8cc req-3933528e-11f0-4818-afcf-aaeb22e262da service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:12:28.646871 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2dc3eaeb-d9b1-4775-a546-b71109fbf8cc req-3933528e-11f0-4818-afcf-aaeb22e262da service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:12:28.647309 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2dc3eaeb-d9b1-4775-a546-b71109fbf8cc req-3933528e-11f0-4818-afcf-aaeb22e262da service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:12:28.659664 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2dc3eaeb-d9b1-4775-a546-b71109fbf8cc req-3933528e-11f0-4818-afcf-aaeb22e262da service nova] Creating event network-changed:53ff4cb1-7501-4db9-8899-f82b6ab66089 for instance 5103a801-969f-4e87-8468-f1ace44d0e37 on n-h2-850468-16 Aug 23 19:12:28.666422 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2dc3eaeb-d9b1-4775-a546-b71109fbf8cc req-3933528e-11f0-4818-afcf-aaeb22e262da service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056952 Aug 23 19:12:28.667932 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3863/7860] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:12:28.879313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5b02d2b5-bee2-4a66-9218-e5d89dbc30a9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:12:28.887285 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5b02d2b5-bee2-4a66-9218-e5d89dbc30a9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1564 microversion: 2.1 time: 0.281629 Aug 23 19:12:28.888024 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3998/7861] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:12:28 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1564 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:12:41.419345 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:12:41.419961 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:12:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:13:00.212722 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:13:00.213472 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=42 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:13:00.218238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f7bff97b-cd01-49f2-88ca-8481af885c70 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:13:00.221096 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f7bff97b-cd01-49f2-88ca-8481af885c70 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:00.228138 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7bff97b-cd01-49f2-88ca-8481af885c70 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:00.228535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7bff97b-cd01-49f2-88ca-8481af885c70 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:00.228973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7bff97b-cd01-49f2-88ca-8481af885c70 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:00.229666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7bff97b-cd01-49f2-88ca-8481af885c70 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:00.230124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7bff97b-cd01-49f2-88ca-8481af885c70 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:00.230601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f7bff97b-cd01-49f2-88ca-8481af885c70 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:00.282744 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f7bff97b-cd01-49f2-88ca-8481af885c70 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37/action" status: 200 len: 24572 microversion: 2.1 time: 0.071983 Aug 23 19:13:00.283373 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3864/7862] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:13:00 2022] POST /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37/action => generated 24572 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:13:30.585925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-190d18e3-8406-438e-a0ce-31f1eea75233 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:13:30.588225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-190d18e3-8406-438e-a0ce-31f1eea75233 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:30.590289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:13:30.591162 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=38 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:13:30.596843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-190d18e3-8406-438e-a0ce-31f1eea75233 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:30.597348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-190d18e3-8406-438e-a0ce-31f1eea75233 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:30.597801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-190d18e3-8406-438e-a0ce-31f1eea75233 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:30.598523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-190d18e3-8406-438e-a0ce-31f1eea75233 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:30.599088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-190d18e3-8406-438e-a0ce-31f1eea75233 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:30.599533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-190d18e3-8406-438e-a0ce-31f1eea75233 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:30.674873 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-190d18e3-8406-438e-a0ce-31f1eea75233 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37/action" status: 202 len: 0 microversion: 2.1 time: 0.093734 Aug 23 19:13:30.675502 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 3999/7863] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:13:30 2022] POST /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:13:30.686051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e8b9a1c0-0210-49d5-a444-e1196e94844e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:13:30.686892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e8b9a1c0-0210-49d5-a444-e1196e94844e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:30.690336 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:13:30.691089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:13:30.700342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8b9a1c0-0210-49d5-a444-e1196e94844e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:30.700837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8b9a1c0-0210-49d5-a444-e1196e94844e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:30.701284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8b9a1c0-0210-49d5-a444-e1196e94844e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:30.702533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8b9a1c0-0210-49d5-a444-e1196e94844e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:30.703031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8b9a1c0-0210-49d5-a444-e1196e94844e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:30.704018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e8b9a1c0-0210-49d5-a444-e1196e94844e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:30.849347 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e8b9a1c0-0210-49d5-a444-e1196e94844e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:13:30.857247 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e8b9a1c0-0210-49d5-a444-e1196e94844e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1675 microversion: 2.1 time: 0.177054 Aug 23 19:13:30.857828 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3865/7864] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:13:30 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1675 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:13:31.882881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6c6fc3f6-c3e9-48d6-aca3-40214a3d9cc2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:13:31.883616 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6c6fc3f6-c3e9-48d6-aca3-40214a3d9cc2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:31.889860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c6fc3f6-c3e9-48d6-aca3-40214a3d9cc2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:31.890303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c6fc3f6-c3e9-48d6-aca3-40214a3d9cc2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:31.890792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c6fc3f6-c3e9-48d6-aca3-40214a3d9cc2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:31.892035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c6fc3f6-c3e9-48d6-aca3-40214a3d9cc2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:31.892510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c6fc3f6-c3e9-48d6-aca3-40214a3d9cc2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:31.892957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6c6fc3f6-c3e9-48d6-aca3-40214a3d9cc2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:32.028911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6c6fc3f6-c3e9-48d6-aca3-40214a3d9cc2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:13:32.037442 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6c6fc3f6-c3e9-48d6-aca3-40214a3d9cc2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1680 microversion: 2.1 time: 0.159999 Aug 23 19:13:32.037996 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4000/7865] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:13:31 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:13:33.058479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-34132e62-a232-4595-8b79-18eeae4803bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:13:33.059050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-34132e62-a232-4595-8b79-18eeae4803bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:33.066550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34132e62-a232-4595-8b79-18eeae4803bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:33.067054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34132e62-a232-4595-8b79-18eeae4803bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:33.067490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34132e62-a232-4595-8b79-18eeae4803bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:33.068191 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34132e62-a232-4595-8b79-18eeae4803bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:33.068640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34132e62-a232-4595-8b79-18eeae4803bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:33.069065 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-34132e62-a232-4595-8b79-18eeae4803bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:33.205621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-34132e62-a232-4595-8b79-18eeae4803bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:13:33.213350 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-34132e62-a232-4595-8b79-18eeae4803bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1680 microversion: 2.1 time: 0.158817 Aug 23 19:13:33.213932 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3866/7866] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:13:33 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:13:34.235185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7f993e6f-093f-417c-b15f-80a6e48ef077 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:13:34.235912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7f993e6f-093f-417c-b15f-80a6e48ef077 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:34.242713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f993e6f-093f-417c-b15f-80a6e48ef077 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:34.243207 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f993e6f-093f-417c-b15f-80a6e48ef077 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:34.243916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f993e6f-093f-417c-b15f-80a6e48ef077 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:34.244624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f993e6f-093f-417c-b15f-80a6e48ef077 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:34.245093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f993e6f-093f-417c-b15f-80a6e48ef077 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:34.245531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7f993e6f-093f-417c-b15f-80a6e48ef077 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:34.381854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7f993e6f-093f-417c-b15f-80a6e48ef077 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:13:34.389540 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7f993e6f-093f-417c-b15f-80a6e48ef077 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1680 microversion: 2.1 time: 0.158892 Aug 23 19:13:34.390101 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4001/7867] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:13:34 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:13:35.410115 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a7aa4aad-49b2-4b39-9cbf-ee7ebd361e16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:13:35.410750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a7aa4aad-49b2-4b39-9cbf-ee7ebd361e16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:35.417698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7aa4aad-49b2-4b39-9cbf-ee7ebd361e16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:35.418179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7aa4aad-49b2-4b39-9cbf-ee7ebd361e16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:35.418643 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7aa4aad-49b2-4b39-9cbf-ee7ebd361e16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:35.419338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7aa4aad-49b2-4b39-9cbf-ee7ebd361e16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:35.419787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7aa4aad-49b2-4b39-9cbf-ee7ebd361e16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:35.420208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a7aa4aad-49b2-4b39-9cbf-ee7ebd361e16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:35.550224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a7aa4aad-49b2-4b39-9cbf-ee7ebd361e16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:13:35.557994 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a7aa4aad-49b2-4b39-9cbf-ee7ebd361e16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1680 microversion: 2.1 time: 0.151799 Aug 23 19:13:35.558620 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3867/7868] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:13:35 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:13:36.580545 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-73f47d14-e260-48d2-9c70-8c5ddf108e85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:13:36.581078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-73f47d14-e260-48d2-9c70-8c5ddf108e85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:36.587988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f47d14-e260-48d2-9c70-8c5ddf108e85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:36.588495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f47d14-e260-48d2-9c70-8c5ddf108e85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:36.588954 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f47d14-e260-48d2-9c70-8c5ddf108e85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:36.589674 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f47d14-e260-48d2-9c70-8c5ddf108e85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:36.590150 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f47d14-e260-48d2-9c70-8c5ddf108e85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:36.590622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-73f47d14-e260-48d2-9c70-8c5ddf108e85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:36.730009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-73f47d14-e260-48d2-9c70-8c5ddf108e85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:13:36.737946 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-73f47d14-e260-48d2-9c70-8c5ddf108e85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1680 microversion: 2.1 time: 0.161937 Aug 23 19:13:36.738530 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4002/7869] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:13:36 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1680 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:13:37.763132 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bbcce78d-45d5-494e-8b3c-708cb93fe76f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:13:37.763742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bbcce78d-45d5-494e-8b3c-708cb93fe76f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:37.771881 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbcce78d-45d5-494e-8b3c-708cb93fe76f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:37.772374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbcce78d-45d5-494e-8b3c-708cb93fe76f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:37.772819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbcce78d-45d5-494e-8b3c-708cb93fe76f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:37.773498 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbcce78d-45d5-494e-8b3c-708cb93fe76f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:37.773950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbcce78d-45d5-494e-8b3c-708cb93fe76f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:37.774589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bbcce78d-45d5-494e-8b3c-708cb93fe76f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:37.915000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bbcce78d-45d5-494e-8b3c-708cb93fe76f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:13:37.923389 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bbcce78d-45d5-494e-8b3c-708cb93fe76f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1680 microversion: 2.1 time: 0.163573 Aug 23 19:13:37.923955 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3868/7870] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:13:37 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1680 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:13:38.945213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d03f6409-e32f-4856-950d-b1cfdb7a3993 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:13:38.945795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d03f6409-e32f-4856-950d-b1cfdb7a3993 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:38.952676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d03f6409-e32f-4856-950d-b1cfdb7a3993 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:38.953175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d03f6409-e32f-4856-950d-b1cfdb7a3993 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:38.953709 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d03f6409-e32f-4856-950d-b1cfdb7a3993 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:38.954624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d03f6409-e32f-4856-950d-b1cfdb7a3993 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:38.955097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d03f6409-e32f-4856-950d-b1cfdb7a3993 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:38.955538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d03f6409-e32f-4856-950d-b1cfdb7a3993 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:39.085168 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d03f6409-e32f-4856-950d-b1cfdb7a3993 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:13:39.092943 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d03f6409-e32f-4856-950d-b1cfdb7a3993 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1680 microversion: 2.1 time: 0.151749 Aug 23 19:13:39.093523 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4003/7871] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:13:38 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1680 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:13:40.115895 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-373c5e10-052c-4ce2-b2d5-3b74a8caf685 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:13:40.116508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-373c5e10-052c-4ce2-b2d5-3b74a8caf685 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:40.123567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-373c5e10-052c-4ce2-b2d5-3b74a8caf685 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:40.124053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-373c5e10-052c-4ce2-b2d5-3b74a8caf685 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:40.124494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-373c5e10-052c-4ce2-b2d5-3b74a8caf685 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:40.125190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-373c5e10-052c-4ce2-b2d5-3b74a8caf685 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:40.125689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-373c5e10-052c-4ce2-b2d5-3b74a8caf685 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:40.126208 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-373c5e10-052c-4ce2-b2d5-3b74a8caf685 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:40.256047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-373c5e10-052c-4ce2-b2d5-3b74a8caf685 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:13:40.263825 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-373c5e10-052c-4ce2-b2d5-3b74a8caf685 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1680 microversion: 2.1 time: 0.152313 Aug 23 19:13:40.264398 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3869/7872] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:13:40 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1680 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:13:41.285544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-afb63830-8bff-48bd-a9d5-381142787b25 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:13:41.286171 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-afb63830-8bff-48bd-a9d5-381142787b25 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:41.293570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-afb63830-8bff-48bd-a9d5-381142787b25 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:41.293766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-afb63830-8bff-48bd-a9d5-381142787b25 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:41.294191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-afb63830-8bff-48bd-a9d5-381142787b25 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:41.294924 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-afb63830-8bff-48bd-a9d5-381142787b25 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:41.295389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-afb63830-8bff-48bd-a9d5-381142787b25 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:41.295829 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-afb63830-8bff-48bd-a9d5-381142787b25 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:41.432447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-afb63830-8bff-48bd-a9d5-381142787b25 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:13:41.440939 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-afb63830-8bff-48bd-a9d5-381142787b25 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1680 microversion: 2.1 time: 0.159534 Aug 23 19:13:41.441525 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4004/7873] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:13:41 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:13:42.463667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5de369bf-f0c4-4b65-af3c-82e563cd0c0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:13:42.464419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5de369bf-f0c4-4b65-af3c-82e563cd0c0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:13:42.471421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5de369bf-f0c4-4b65-af3c-82e563cd0c0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:42.471911 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5de369bf-f0c4-4b65-af3c-82e563cd0c0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:42.472354 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5de369bf-f0c4-4b65-af3c-82e563cd0c0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:42.473056 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5de369bf-f0c4-4b65-af3c-82e563cd0c0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:13:42.473521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5de369bf-f0c4-4b65-af3c-82e563cd0c0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:13:42.473988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5de369bf-f0c4-4b65-af3c-82e563cd0c0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:13:42.611037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5de369bf-f0c4-4b65-af3c-82e563cd0c0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:13:42.618844 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5de369bf-f0c4-4b65-af3c-82e563cd0c0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1683 microversion: 2.1 time: 0.159074 Aug 23 19:13:42.619678 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3870/7874] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:13:42 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:14.837108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aa872420-fde4-4745-833d-65e0a953b66e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:14:14.840003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aa872420-fde4-4745-833d-65e0a953b66e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:14.842504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=12 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:14:14.843217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:14:14.850303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa872420-fde4-4745-833d-65e0a953b66e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:14.850838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa872420-fde4-4745-833d-65e0a953b66e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:14.851299 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa872420-fde4-4745-833d-65e0a953b66e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:14.852023 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa872420-fde4-4745-833d-65e0a953b66e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:14.852500 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa872420-fde4-4745-833d-65e0a953b66e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:14.852948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aa872420-fde4-4745-833d-65e0a953b66e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:14.914051 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aa872420-fde4-4745-833d-65e0a953b66e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37/action" status: 200 len: 69116 microversion: 2.1 time: 0.080598 Aug 23 19:14:14.914664 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4005/7875] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:14:14 2022] POST /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37/action => generated 69116 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:14:21.390651 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:14:21.391322 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:14:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:14:31.932654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3f61d13a-63d6-415d-af20-6bc526f694da tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:31.938691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3f61d13a-63d6-415d-af20-6bc526f694da tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:31.938876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4bb649f4-b3a7-4841-91ba-54aad5ee6967 req-7513ed45-501d-43c1-b49d-10a54bb195ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5103a801-969f-4e87-8468-f1ace44d0e37", "tag": "53ff4cb1-7501-4db9-8899-f82b6ab66089"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:14:31.941242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=12 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:14:31.942676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=36 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:14:31.946618 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:14:31.947398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:14:31.947999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f61d13a-63d6-415d-af20-6bc526f694da tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:31.948774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f61d13a-63d6-415d-af20-6bc526f694da tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:31.949131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f61d13a-63d6-415d-af20-6bc526f694da tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:31.949882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f61d13a-63d6-415d-af20-6bc526f694da tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:31.950387 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f61d13a-63d6-415d-af20-6bc526f694da tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:31.950792 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3f61d13a-63d6-415d-af20-6bc526f694da tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:31.953061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4bb649f4-b3a7-4841-91ba-54aad5ee6967 req-7513ed45-501d-43c1-b49d-10a54bb195ea service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:31.953565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4bb649f4-b3a7-4841-91ba-54aad5ee6967 req-7513ed45-501d-43c1-b49d-10a54bb195ea service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:31.954018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4bb649f4-b3a7-4841-91ba-54aad5ee6967 req-7513ed45-501d-43c1-b49d-10a54bb195ea service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:31.969976 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4bb649f4-b3a7-4841-91ba-54aad5ee6967 req-7513ed45-501d-43c1-b49d-10a54bb195ea service nova] Creating event network-changed:53ff4cb1-7501-4db9-8899-f82b6ab66089 for instance 5103a801-969f-4e87-8468-f1ace44d0e37 on n-h2-850468-16 Aug 23 19:14:31.976920 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4bb649f4-b3a7-4841-91ba-54aad5ee6967 req-7513ed45-501d-43c1-b49d-10a54bb195ea service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042175 Aug 23 19:14:31.977541 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4006/7876] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:14:31.981587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3f61d13a-63d6-415d-af20-6bc526f694da tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:14:32.072432 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3f61d13a-63d6-415d-af20-6bc526f694da tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 204 len: 0 microversion: 2.1 time: 0.143344 Aug 23 19:14:32.073394 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3871/7877] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:14:31 2022] DELETE /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 19:14:32.084277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8f246f67-8b10-4460-8003-5c88e7106d5f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:32.085775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8f246f67-8b10-4460-8003-5c88e7106d5f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:32.092570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f246f67-8b10-4460-8003-5c88e7106d5f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:32.093218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f246f67-8b10-4460-8003-5c88e7106d5f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:32.093694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f246f67-8b10-4460-8003-5c88e7106d5f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:32.094572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f246f67-8b10-4460-8003-5c88e7106d5f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:32.095167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f246f67-8b10-4460-8003-5c88e7106d5f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:32.095624 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8f246f67-8b10-4460-8003-5c88e7106d5f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:32.253130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8f246f67-8b10-4460-8003-5c88e7106d5f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:32.261979 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8f246f67-8b10-4460-8003-5c88e7106d5f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1689 microversion: 2.1 time: 0.184169 Aug 23 19:14:32.262613 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4007/7878] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:32 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:33.286158 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2cbbfba7-cd48-406d-bcca-1248a4aa7fa4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:33.287000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2cbbfba7-cd48-406d-bcca-1248a4aa7fa4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:33.294042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cbbfba7-cd48-406d-bcca-1248a4aa7fa4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:33.294525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cbbfba7-cd48-406d-bcca-1248a4aa7fa4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:33.294986 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cbbfba7-cd48-406d-bcca-1248a4aa7fa4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:33.295674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cbbfba7-cd48-406d-bcca-1248a4aa7fa4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:33.296129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cbbfba7-cd48-406d-bcca-1248a4aa7fa4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:33.296550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2cbbfba7-cd48-406d-bcca-1248a4aa7fa4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:33.441349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2cbbfba7-cd48-406d-bcca-1248a4aa7fa4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:33.450081 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2cbbfba7-cd48-406d-bcca-1248a4aa7fa4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1689 microversion: 2.1 time: 0.168667 Aug 23 19:14:33.450676 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3872/7879] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:33 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:34.132834 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6dda096b-3726-4f95-9301-a965b4709cc5 req-be8c9ca7-c950-489b-942d-8bfe1d81c2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5103a801-969f-4e87-8468-f1ace44d0e37", "name": "network-vif-deleted", "tag": "53ff4cb1-7501-4db9-8899-f82b6ab66089"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:14:34.143128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6dda096b-3726-4f95-9301-a965b4709cc5 req-be8c9ca7-c950-489b-942d-8bfe1d81c2dc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:34.143620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6dda096b-3726-4f95-9301-a965b4709cc5 req-be8c9ca7-c950-489b-942d-8bfe1d81c2dc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:34.144071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6dda096b-3726-4f95-9301-a965b4709cc5 req-be8c9ca7-c950-489b-942d-8bfe1d81c2dc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:34.156576 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6dda096b-3726-4f95-9301-a965b4709cc5 req-be8c9ca7-c950-489b-942d-8bfe1d81c2dc service nova] Creating event network-vif-deleted:53ff4cb1-7501-4db9-8899-f82b6ab66089 for instance 5103a801-969f-4e87-8468-f1ace44d0e37 on n-h2-850468-16 Aug 23 19:14:34.162428 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6dda096b-3726-4f95-9301-a965b4709cc5 req-be8c9ca7-c950-489b-942d-8bfe1d81c2dc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033723 Aug 23 19:14:34.163070 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4008/7880] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:14:34.472157 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:34.472782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:34.480179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:34.481075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:34.481922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:34.482669 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:34.483137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:34.483573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:34.520995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:34.521735 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:34.522299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:34.522905 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lazy-loading 'fault' on Instance uuid 5103a801-969f-4e87-8468-f1ace44d0e37 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:14:34.571455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:34.579225 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e74c880f-fa42-4955-a2cd-3234b76ca6fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 200 len: 1357 microversion: 2.1 time: 0.111037 Aug 23 19:14:34.579793 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3873/7881] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:34 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 1357 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:35.603502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6120c12f-a937-4aa8-8c34-2ea7ed5220e1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:35.604252 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6120c12f-a937-4aa8-8c34-2ea7ed5220e1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5103a801-969f-4e87-8468-f1ace44d0e37] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:35.610472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6120c12f-a937-4aa8-8c34-2ea7ed5220e1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:35.611003 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6120c12f-a937-4aa8-8c34-2ea7ed5220e1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:35.611462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6120c12f-a937-4aa8-8c34-2ea7ed5220e1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:35.612175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6120c12f-a937-4aa8-8c34-2ea7ed5220e1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:35.612650 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6120c12f-a937-4aa8-8c34-2ea7ed5220e1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:35.613093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6120c12f-a937-4aa8-8c34-2ea7ed5220e1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:35.627008 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-6120c12f-a937-4aa8-8c34-2ea7ed5220e1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] HTTP exception thrown: Instance 5103a801-969f-4e87-8468-f1ace44d0e37 could not be found. Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6120c12f-a937-4aa8-8c34-2ea7ed5220e1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Request method failure captured: Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 HTTP/1.1 Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSYnx1WT4Gq2W98xrb4v7A_NZEqhPSI9Nnx0JtMEtpxu6ASOeeNPsAUHO7NTkLBeC-b0QKnbzfLy_iy-WFwk6pin00WncrZMV-1kc-S_LC8OXBre2xGrhEMDXxk9aYiPr88-JSsp-T-qo3q5YV-u1YQ_T_pJ5tOz5fWaqLFzc6WKr6Y Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 7b28c141b95b4205a6557e8d9a7fc07a Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b28c141b95b4205a6557e8d9a7fc07a"}]}] Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 7b28c141b95b4205a6557e8d9a7fc07a Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestNetworkAdvancedServerOps-267656723-project Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2887d531d5a9449c9cb350a5b1dd73d2 Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestNetworkAdvancedServerOps-267656723-project Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 5103a801-969f-4e87-8468-f1ace44d0e37 could not be found. Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '5103a801-969f-4e87-8468-f1ace44d0e37'} Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5103a801-969f-4e87-8468-f1ace44d0e37 could not be found. Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5103a801-969f-4e87-8468-f1ace44d0e37 could not be found. Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:14:35.628695 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:14:35.633724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:14:35.633724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:14:35.633724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:14:35.633724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:14:35.633724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:14:35.633724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:14:35.633724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5103a801-969f-4e87-8468-f1ace44d0e37 could not be found. Aug 23 19:14:35.633724 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:14:35.633724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6120c12f-a937-4aa8-8c34-2ea7ed5220e1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Returning 404 to user: Instance 5103a801-969f-4e87-8468-f1ace44d0e37 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:14:35.633724 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6120c12f-a937-4aa8-8c34-2ea7ed5220e1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37" status: 404 len: 111 microversion: 2.1 time: 0.032604 Aug 23 19:14:35.633724 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4009/7882] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:35 2022] GET /compute/v2.1/servers/5103a801-969f-4e87-8468-f1ace44d0e37 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:14:38.932086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bbc597ab-63ab-4053-b146-5be3d9606571 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '.version_select at 0x7f27df9c4700>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:38.952934 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bbc597ab-63ab-4053-b146-5be3d9606571 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1932318943" status: 202 len: 0 microversion: 2.1 time: 0.024681 Aug 23 19:14:38.953523 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3874/7883] 10.222.0.61 () {58 vars in 1284 bytes} [Tue Aug 23 19:14:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1932318943 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:14:38.982727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ecfe0a7-644f-4263-9baf-65e9376955b1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'create', calling method: .version_select at 0x7f27ec60b1f0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1001967081", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXf8UHu21CJ3ztdtUzpG/yQjQKo/YzSQ/62wYAmoFYBV5cFRDoE0wOUVsEyca3/RfzHboIOz4wqJRD6h4RqxT3KpzFxla/jsDKRzCjn886J4kQOp9oiENjfgw0kduWK6A=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:14:39.000847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-2ecfe0a7-644f-4263-9baf-65e9376955b1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:14:39.007886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-2ecfe0a7-644f-4263-9baf-65e9376955b1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for user 2887d531d5a9449c9cb350a5b1dd73d2 and project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:14:39.039197 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2ecfe0a7-644f-4263-9baf-65e9376955b1 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.060389 Aug 23 19:14:39.039934 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4010/7884] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 19:14:38 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:14:44.915475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:14:44.920647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-738098866", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "f9922c74-3e4a-4e3e-bc78-71d2e51955b9"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1001967081", "security_groups": [{"name": "tempest-secgroup-smoke-883366482"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:14:45.045564 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] validate_networks() for [('f9922c74-3e4a-4e3e-bc78-71d2e51955b9', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:14:45.457970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:14:45.459099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:14:45.459571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:14:45.459981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:14:45.460400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:14:45.469402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:45.469918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:45.470334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:45.471100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:45.471576 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:45.471974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:45.489246 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:14:45.495597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for user 2887d531d5a9449c9cb350a5b1dd73d2 and project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:14:45.509318 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:14:45.511678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:14:45.560658 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fe99c4ad-7319-4d76-9038-a4a6c2bb5dd5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.645782 Aug 23 19:14:45.561957 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3875/7885] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:14:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:14:45.575056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e64fcb25-ddad-4f95-8688-47fad404f1cb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:45.578403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e64fcb25-ddad-4f95-8688-47fad404f1cb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:45.624134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=12 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:14:45.673900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e64fcb25-ddad-4f95-8688-47fad404f1cb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:45.684057 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e64fcb25-ddad-4f95-8688-47fad404f1cb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1266 microversion: 2.1 time: 0.114023 Aug 23 19:14:45.684984 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4011/7886] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:45 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1266 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:46.709254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25c66235-474c-4b89-b191-8e2fe537a5d8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:46.712289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-25c66235-474c-4b89-b191-8e2fe537a5d8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:46.722710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25c66235-474c-4b89-b191-8e2fe537a5d8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:46.723757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25c66235-474c-4b89-b191-8e2fe537a5d8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:46.725168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25c66235-474c-4b89-b191-8e2fe537a5d8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:46.726362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25c66235-474c-4b89-b191-8e2fe537a5d8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:46.727316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25c66235-474c-4b89-b191-8e2fe537a5d8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:46.727981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25c66235-474c-4b89-b191-8e2fe537a5d8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:46.848192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-25c66235-474c-4b89-b191-8e2fe537a5d8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:46.860889 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-25c66235-474c-4b89-b191-8e2fe537a5d8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1326 microversion: 2.1 time: 0.159025 Aug 23 19:14:46.862422 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3876/7887] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:46 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1326 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:47.887285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1827759f-8263-413b-abc7-6fcf53abeaef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:47.887915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1827759f-8263-413b-abc7-6fcf53abeaef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:47.894552 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1827759f-8263-413b-abc7-6fcf53abeaef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:47.895070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1827759f-8263-413b-abc7-6fcf53abeaef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:47.895531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1827759f-8263-413b-abc7-6fcf53abeaef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:47.896661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1827759f-8263-413b-abc7-6fcf53abeaef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:47.897324 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1827759f-8263-413b-abc7-6fcf53abeaef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:47.897948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1827759f-8263-413b-abc7-6fcf53abeaef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:48.037479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1827759f-8263-413b-abc7-6fcf53abeaef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:48.046264 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1827759f-8263-413b-abc7-6fcf53abeaef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1391 microversion: 2.1 time: 0.162875 Aug 23 19:14:48.046993 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4012/7888] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:47 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:48.285301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-51d54097-eef2-4abf-a35a-9a95c8a451eb req-48e39ca3-8736-4b13-a480-c782a5ff11d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0712c4b-dc54-489d-9a86-0787b099a2d1", "tag": "4a27c9b9-545f-4677-a494-6f2c0b3fb951"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:14:48.295989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-51d54097-eef2-4abf-a35a-9a95c8a451eb req-48e39ca3-8736-4b13-a480-c782a5ff11d9 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:48.296611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-51d54097-eef2-4abf-a35a-9a95c8a451eb req-48e39ca3-8736-4b13-a480-c782a5ff11d9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:48.297183 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-51d54097-eef2-4abf-a35a-9a95c8a451eb req-48e39ca3-8736-4b13-a480-c782a5ff11d9 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:48.309899 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-51d54097-eef2-4abf-a35a-9a95c8a451eb req-48e39ca3-8736-4b13-a480-c782a5ff11d9 service nova] Creating event network-changed:4a27c9b9-545f-4677-a494-6f2c0b3fb951 for instance d0712c4b-dc54-489d-9a86-0787b099a2d1 on n-h1-850468-16 Aug 23 19:14:48.314853 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-51d54097-eef2-4abf-a35a-9a95c8a451eb req-48e39ca3-8736-4b13-a480-c782a5ff11d9 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035962 Aug 23 19:14:48.315523 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3877/7889] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:14:49.068615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-61f911df-db13-4730-b880-fd4826e1a7f0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:49.069331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-61f911df-db13-4730-b880-fd4826e1a7f0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:49.076206 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61f911df-db13-4730-b880-fd4826e1a7f0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:49.076703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61f911df-db13-4730-b880-fd4826e1a7f0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:49.077157 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61f911df-db13-4730-b880-fd4826e1a7f0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:49.077863 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61f911df-db13-4730-b880-fd4826e1a7f0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:49.078332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61f911df-db13-4730-b880-fd4826e1a7f0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:49.078800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-61f911df-db13-4730-b880-fd4826e1a7f0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:49.217284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-61f911df-db13-4730-b880-fd4826e1a7f0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:49.225150 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-61f911df-db13-4730-b880-fd4826e1a7f0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1391 microversion: 2.1 time: 0.160626 Aug 23 19:14:49.225733 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4013/7890] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:49 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:50.247152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-068187fb-ddd6-4378-8e6a-ce4c202fce99 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:50.248110 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-068187fb-ddd6-4378-8e6a-ce4c202fce99 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:50.254317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-068187fb-ddd6-4378-8e6a-ce4c202fce99 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:50.254832 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-068187fb-ddd6-4378-8e6a-ce4c202fce99 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:50.255272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-068187fb-ddd6-4378-8e6a-ce4c202fce99 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:50.256864 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-068187fb-ddd6-4378-8e6a-ce4c202fce99 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:50.257325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-068187fb-ddd6-4378-8e6a-ce4c202fce99 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:50.257756 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-068187fb-ddd6-4378-8e6a-ce4c202fce99 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:50.391465 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-068187fb-ddd6-4378-8e6a-ce4c202fce99 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:50.400118 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-068187fb-ddd6-4378-8e6a-ce4c202fce99 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1391 microversion: 2.1 time: 0.158126 Aug 23 19:14:50.400691 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3878/7891] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:50 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:51.421565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ce6a5be7-b22b-43a9-906b-b0ff66d87f0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:51.422093 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ce6a5be7-b22b-43a9-906b-b0ff66d87f0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:51.429739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce6a5be7-b22b-43a9-906b-b0ff66d87f0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:51.430234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce6a5be7-b22b-43a9-906b-b0ff66d87f0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:51.430708 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce6a5be7-b22b-43a9-906b-b0ff66d87f0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:51.431414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce6a5be7-b22b-43a9-906b-b0ff66d87f0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:51.431881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce6a5be7-b22b-43a9-906b-b0ff66d87f0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:51.432318 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ce6a5be7-b22b-43a9-906b-b0ff66d87f0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:51.563847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ce6a5be7-b22b-43a9-906b-b0ff66d87f0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:51.572424 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ce6a5be7-b22b-43a9-906b-b0ff66d87f0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1391 microversion: 2.1 time: 0.154902 Aug 23 19:14:51.573000 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4014/7892] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:51 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1391 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:52.592656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-436fae6e-6fb7-4044-8603-004e5058bb05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:52.593255 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-436fae6e-6fb7-4044-8603-004e5058bb05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:52.600022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-436fae6e-6fb7-4044-8603-004e5058bb05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:52.600507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-436fae6e-6fb7-4044-8603-004e5058bb05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:52.600951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-436fae6e-6fb7-4044-8603-004e5058bb05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:52.601651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-436fae6e-6fb7-4044-8603-004e5058bb05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:52.602111 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-436fae6e-6fb7-4044-8603-004e5058bb05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:52.602569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-436fae6e-6fb7-4044-8603-004e5058bb05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:52.745955 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-436fae6e-6fb7-4044-8603-004e5058bb05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:52.753817 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-436fae6e-6fb7-4044-8603-004e5058bb05 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1391 microversion: 2.1 time: 0.165169 Aug 23 19:14:52.754390 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3879/7893] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:52 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1391 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:53.776294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aefe1066-bf45-48d1-b3bf-bcc0ba9dae9d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:53.776927 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aefe1066-bf45-48d1-b3bf-bcc0ba9dae9d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:53.782979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aefe1066-bf45-48d1-b3bf-bcc0ba9dae9d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:53.783485 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aefe1066-bf45-48d1-b3bf-bcc0ba9dae9d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:53.783941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aefe1066-bf45-48d1-b3bf-bcc0ba9dae9d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:53.784652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aefe1066-bf45-48d1-b3bf-bcc0ba9dae9d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:53.785127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aefe1066-bf45-48d1-b3bf-bcc0ba9dae9d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:53.785571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aefe1066-bf45-48d1-b3bf-bcc0ba9dae9d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:53.922464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aefe1066-bf45-48d1-b3bf-bcc0ba9dae9d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:53.931633 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aefe1066-bf45-48d1-b3bf-bcc0ba9dae9d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1391 microversion: 2.1 time: 0.160243 Aug 23 19:14:53.932226 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4015/7894] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:53 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:54.952416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a33d816f-ddba-4b5a-8bf5-6f861d34996d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:54.953029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a33d816f-ddba-4b5a-8bf5-6f861d34996d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:54.960463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a33d816f-ddba-4b5a-8bf5-6f861d34996d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:54.960944 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a33d816f-ddba-4b5a-8bf5-6f861d34996d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:54.961377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a33d816f-ddba-4b5a-8bf5-6f861d34996d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:54.962316 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a33d816f-ddba-4b5a-8bf5-6f861d34996d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:54.962531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a33d816f-ddba-4b5a-8bf5-6f861d34996d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:54.963068 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a33d816f-ddba-4b5a-8bf5-6f861d34996d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:55.101469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a33d816f-ddba-4b5a-8bf5-6f861d34996d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:55.109233 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a33d816f-ddba-4b5a-8bf5-6f861d34996d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1391 microversion: 2.1 time: 0.160790 Aug 23 19:14:55.109798 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3880/7895] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:54 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:56.082096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:14:56.131274 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1a3b994a-ad12-4221-b4bf-58ab8da6dd0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:56.132861 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1a3b994a-ad12-4221-b4bf-58ab8da6dd0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:56.135159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:14:56.136024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:14:56.143513 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a3b994a-ad12-4221-b4bf-58ab8da6dd0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:56.143717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f78d5b9d-6276-45eb-9ae6-60dac201066f req-c1e66eeb-f7e0-4c53-9692-a9e0018e278f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0712c4b-dc54-489d-9a86-0787b099a2d1", "name": "network-vif-plugged", "status": "completed", "tag": "4a27c9b9-545f-4677-a494-6f2c0b3fb951"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:14:56.144010 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a3b994a-ad12-4221-b4bf-58ab8da6dd0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:56.144454 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a3b994a-ad12-4221-b4bf-58ab8da6dd0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:56.145170 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a3b994a-ad12-4221-b4bf-58ab8da6dd0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:56.145659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a3b994a-ad12-4221-b4bf-58ab8da6dd0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:56.146086 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1a3b994a-ad12-4221-b4bf-58ab8da6dd0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:56.154079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f78d5b9d-6276-45eb-9ae6-60dac201066f req-c1e66eeb-f7e0-4c53-9692-a9e0018e278f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:56.154612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f78d5b9d-6276-45eb-9ae6-60dac201066f req-c1e66eeb-f7e0-4c53-9692-a9e0018e278f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:56.155070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f78d5b9d-6276-45eb-9ae6-60dac201066f req-c1e66eeb-f7e0-4c53-9692-a9e0018e278f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:56.166825 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f78d5b9d-6276-45eb-9ae6-60dac201066f req-c1e66eeb-f7e0-4c53-9692-a9e0018e278f service nova] Creating event network-vif-plugged:4a27c9b9-545f-4677-a494-6f2c0b3fb951 for instance d0712c4b-dc54-489d-9a86-0787b099a2d1 on n-h1-850468-16 Aug 23 19:14:56.172056 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f78d5b9d-6276-45eb-9ae6-60dac201066f req-c1e66eeb-f7e0-4c53-9692-a9e0018e278f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096301 Aug 23 19:14:56.172594 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4016/7896] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:14:56.328120 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1a3b994a-ad12-4221-b4bf-58ab8da6dd0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:56.336727 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1a3b994a-ad12-4221-b4bf-58ab8da6dd0d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1391 microversion: 2.1 time: 0.209867 Aug 23 19:14:56.337407 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3881/7897] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:56 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1391 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:14:57.358849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fc3dfd66-7d11-496f-9551-0bf2c8f0eb4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:57.359580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fc3dfd66-7d11-496f-9551-0bf2c8f0eb4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:57.367193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc3dfd66-7d11-496f-9551-0bf2c8f0eb4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:57.367675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc3dfd66-7d11-496f-9551-0bf2c8f0eb4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:57.368141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc3dfd66-7d11-496f-9551-0bf2c8f0eb4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:57.368887 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc3dfd66-7d11-496f-9551-0bf2c8f0eb4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:57.369466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc3dfd66-7d11-496f-9551-0bf2c8f0eb4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:57.369808 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fc3dfd66-7d11-496f-9551-0bf2c8f0eb4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:57.504213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fc3dfd66-7d11-496f-9551-0bf2c8f0eb4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:57.512850 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fc3dfd66-7d11-496f-9551-0bf2c8f0eb4a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1391 microversion: 2.1 time: 0.159185 Aug 23 19:14:57.513422 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4017/7898] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:57 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:58.534757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-603c3110-cb15-433a-bd77-421b4b9d06f4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:58.535380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-603c3110-cb15-433a-bd77-421b4b9d06f4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:58.542313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-603c3110-cb15-433a-bd77-421b4b9d06f4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:58.542835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-603c3110-cb15-433a-bd77-421b4b9d06f4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:58.543283 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-603c3110-cb15-433a-bd77-421b4b9d06f4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:58.543981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-603c3110-cb15-433a-bd77-421b4b9d06f4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:58.544438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-603c3110-cb15-433a-bd77-421b4b9d06f4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:58.544897 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-603c3110-cb15-433a-bd77-421b4b9d06f4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:58.683625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-603c3110-cb15-433a-bd77-421b4b9d06f4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:58.691556 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-603c3110-cb15-433a-bd77-421b4b9d06f4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1564 microversion: 2.1 time: 0.160770 Aug 23 19:14:58.692128 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3882/7899] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:58 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:14:58.714430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-63a3958d-7752-4dfa-b869-100671d48861 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:14:58.715105 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-63a3958d-7752-4dfa-b869-100671d48861 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:14:58.722032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63a3958d-7752-4dfa-b869-100671d48861 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:58.722553 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63a3958d-7752-4dfa-b869-100671d48861 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:58.723026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63a3958d-7752-4dfa-b869-100671d48861 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:58.723738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63a3958d-7752-4dfa-b869-100671d48861 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:14:58.724215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63a3958d-7752-4dfa-b869-100671d48861 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:14:58.725192 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-63a3958d-7752-4dfa-b869-100671d48861 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:14:58.860976 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-63a3958d-7752-4dfa-b869-100671d48861 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:14:58.869466 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-63a3958d-7752-4dfa-b869-100671d48861 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1564 microversion: 2.1 time: 0.158937 Aug 23 19:14:58.870043 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4018/7900] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:14:58 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1564 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:15:00.457416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-da8c1219-2e7f-4222-a98d-abb489857ab4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:15:00.463526 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-7deb9d81-0e0d-4fa3-a84c-c05399d515c7 req-49eb3f66-5003-47c1-ac4d-b0065f4cdcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0712c4b-dc54-489d-9a86-0787b099a2d1", "tag": "4a27c9b9-545f-4677-a494-6f2c0b3fb951"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:15:00.464242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-da8c1219-2e7f-4222-a98d-abb489857ab4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:15:00.476468 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da8c1219-2e7f-4222-a98d-abb489857ab4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:15:00.477070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da8c1219-2e7f-4222-a98d-abb489857ab4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:15:00.477584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da8c1219-2e7f-4222-a98d-abb489857ab4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:15:00.478368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da8c1219-2e7f-4222-a98d-abb489857ab4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:15:00.479165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da8c1219-2e7f-4222-a98d-abb489857ab4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:15:00.479415 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-da8c1219-2e7f-4222-a98d-abb489857ab4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:15:00.483523 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7deb9d81-0e0d-4fa3-a84c-c05399d515c7 req-49eb3f66-5003-47c1-ac4d-b0065f4cdcf2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:15:00.483931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7deb9d81-0e0d-4fa3-a84c-c05399d515c7 req-49eb3f66-5003-47c1-ac4d-b0065f4cdcf2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:15:00.484436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-7deb9d81-0e0d-4fa3-a84c-c05399d515c7 req-49eb3f66-5003-47c1-ac4d-b0065f4cdcf2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:15:00.496528 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-7deb9d81-0e0d-4fa3-a84c-c05399d515c7 req-49eb3f66-5003-47c1-ac4d-b0065f4cdcf2 service nova] Creating event network-changed:4a27c9b9-545f-4677-a494-6f2c0b3fb951 for instance d0712c4b-dc54-489d-9a86-0787b099a2d1 on n-h1-850468-16 Aug 23 19:15:00.502033 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-7deb9d81-0e0d-4fa3-a84c-c05399d515c7 req-49eb3f66-5003-47c1-ac4d-b0065f4cdcf2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042706 Aug 23 19:15:00.502822 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4019/7901] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:15:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:15:00.709969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-da8c1219-2e7f-4222-a98d-abb489857ab4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:15:00.718280 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-da8c1219-2e7f-4222-a98d-abb489857ab4 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1564 microversion: 2.1 time: 0.264519 Aug 23 19:15:00.718930 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3883/7902] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:15:00 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1564 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:15:31.994356 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:15:31.995072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=40 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:15:32.054000 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-705dcf4b-9f15-43d5-825d-6301d220b914 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:15:32.056764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-705dcf4b-9f15-43d5-825d-6301d220b914 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:15:32.063020 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-705dcf4b-9f15-43d5-825d-6301d220b914 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:15:32.063521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-705dcf4b-9f15-43d5-825d-6301d220b914 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:15:32.063972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-705dcf4b-9f15-43d5-825d-6301d220b914 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:15:32.064676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-705dcf4b-9f15-43d5-825d-6301d220b914 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:15:32.065146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-705dcf4b-9f15-43d5-825d-6301d220b914 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:15:32.065583 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-705dcf4b-9f15-43d5-825d-6301d220b914 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:15:32.135539 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-705dcf4b-9f15-43d5-825d-6301d220b914 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1/action" status: 200 len: 24568 microversion: 2.1 time: 0.143217 Aug 23 19:15:32.136176 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4020/7903] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:15:31 2022] POST /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1/action => generated 24568 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:16:01.428298 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:16:01.429020 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:16:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:16:02.566904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:16:02.567664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=46 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:16:02.572575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:16:02.574932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:02.582331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:02.582842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:02.583288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:02.583988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:02.584449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:02.584883 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:02.671710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:02.678245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Old instance type m1.heat2, new instance type m1.heat {{(pid=128807) resize /opt/stack/nova/nova/compute/api.py:4205}} Aug 23 19:16:02.684918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:16:02.685343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:16:02.685827 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:16:02.686245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:16:02.686691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:16:02.753508 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-904f8000-e65e-49bc-86b0-dbe482086c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1/action" status: 202 len: 0 microversion: 2.1 time: 0.188488 Aug 23 19:16:02.754130 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3884/7904] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:16:02 2022] POST /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1/action => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:16:02.763302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0db80550-4d6a-407a-8176-d92c3541f322 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:02.764029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0db80550-4d6a-407a-8176-d92c3541f322 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:02.766568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:16:02.767238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:16:02.773625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0db80550-4d6a-407a-8176-d92c3541f322 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:02.774889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0db80550-4d6a-407a-8176-d92c3541f322 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:02.775366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0db80550-4d6a-407a-8176-d92c3541f322 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:02.776275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0db80550-4d6a-407a-8176-d92c3541f322 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:02.776733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0db80550-4d6a-407a-8176-d92c3541f322 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:02.777181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0db80550-4d6a-407a-8176-d92c3541f322 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:02.990132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0db80550-4d6a-407a-8176-d92c3541f322 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:02.999855 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0db80550-4d6a-407a-8176-d92c3541f322 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1691 microversion: 2.1 time: 0.241160 Aug 23 19:16:03.000621 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4021/7905] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:02 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1691 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:16:04.023439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-685ecb8a-ff6a-44e3-9353-aa82eb8d8947 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:04.024487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-685ecb8a-ff6a-44e3-9353-aa82eb8d8947 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:04.031137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-685ecb8a-ff6a-44e3-9353-aa82eb8d8947 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:04.031697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-685ecb8a-ff6a-44e3-9353-aa82eb8d8947 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:04.032233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-685ecb8a-ff6a-44e3-9353-aa82eb8d8947 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:04.033212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-685ecb8a-ff6a-44e3-9353-aa82eb8d8947 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:04.033798 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-685ecb8a-ff6a-44e3-9353-aa82eb8d8947 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:04.034285 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-685ecb8a-ff6a-44e3-9353-aa82eb8d8947 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:04.174441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-685ecb8a-ff6a-44e3-9353-aa82eb8d8947 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:04.182472 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-685ecb8a-ff6a-44e3-9353-aa82eb8d8947 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1691 microversion: 2.1 time: 0.164305 Aug 23 19:16:04.183071 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3885/7906] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:04 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:05.204273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ebb3569e-883c-4275-8502-83ba356cdfaf tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:05.204918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ebb3569e-883c-4275-8502-83ba356cdfaf tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:05.212792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebb3569e-883c-4275-8502-83ba356cdfaf tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:05.213302 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebb3569e-883c-4275-8502-83ba356cdfaf tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:05.213768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebb3569e-883c-4275-8502-83ba356cdfaf tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:05.214495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebb3569e-883c-4275-8502-83ba356cdfaf tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:05.215008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebb3569e-883c-4275-8502-83ba356cdfaf tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:05.215462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ebb3569e-883c-4275-8502-83ba356cdfaf tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:05.346446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ebb3569e-883c-4275-8502-83ba356cdfaf tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:05.354256 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ebb3569e-883c-4275-8502-83ba356cdfaf tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1696 microversion: 2.1 time: 0.153978 Aug 23 19:16:05.354862 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4022/7907] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:05 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:06.375233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5ba4c7e4-c65f-413d-9d47-0686ac61dce9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:06.375851 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5ba4c7e4-c65f-413d-9d47-0686ac61dce9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:06.383034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ba4c7e4-c65f-413d-9d47-0686ac61dce9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:06.384192 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ba4c7e4-c65f-413d-9d47-0686ac61dce9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:06.384742 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ba4c7e4-c65f-413d-9d47-0686ac61dce9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:06.385444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ba4c7e4-c65f-413d-9d47-0686ac61dce9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:06.385906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ba4c7e4-c65f-413d-9d47-0686ac61dce9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:06.386338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5ba4c7e4-c65f-413d-9d47-0686ac61dce9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:06.517712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5ba4c7e4-c65f-413d-9d47-0686ac61dce9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:06.525721 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5ba4c7e4-c65f-413d-9d47-0686ac61dce9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1696 microversion: 2.1 time: 0.154391 Aug 23 19:16:06.526298 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3886/7908] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:06 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:07.546928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-752e1236-dba0-4971-b668-98f04adbbb9e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:07.547562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-752e1236-dba0-4971-b668-98f04adbbb9e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:07.554370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-752e1236-dba0-4971-b668-98f04adbbb9e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:07.554913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-752e1236-dba0-4971-b668-98f04adbbb9e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:07.555420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-752e1236-dba0-4971-b668-98f04adbbb9e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:07.556673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-752e1236-dba0-4971-b668-98f04adbbb9e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:07.557152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-752e1236-dba0-4971-b668-98f04adbbb9e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:07.557598 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-752e1236-dba0-4971-b668-98f04adbbb9e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:07.693153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-752e1236-dba0-4971-b668-98f04adbbb9e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:07.701115 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-752e1236-dba0-4971-b668-98f04adbbb9e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1696 microversion: 2.1 time: 0.158145 Aug 23 19:16:07.701686 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4023/7909] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:07 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1696 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:08.722042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c54f0cef-b263-4d50-9bed-48de95c4d931 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:08.722602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c54f0cef-b263-4d50-9bed-48de95c4d931 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:08.729862 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c54f0cef-b263-4d50-9bed-48de95c4d931 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:08.730346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c54f0cef-b263-4d50-9bed-48de95c4d931 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:08.730816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c54f0cef-b263-4d50-9bed-48de95c4d931 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:08.731512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c54f0cef-b263-4d50-9bed-48de95c4d931 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:08.731969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c54f0cef-b263-4d50-9bed-48de95c4d931 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:08.732400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c54f0cef-b263-4d50-9bed-48de95c4d931 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:08.869099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c54f0cef-b263-4d50-9bed-48de95c4d931 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:08.877263 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c54f0cef-b263-4d50-9bed-48de95c4d931 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1696 microversion: 2.1 time: 0.159168 Aug 23 19:16:08.877840 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3887/7910] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:08 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:09.898684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0290bc7c-a376-4925-8c65-8f19b1df1bba tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:09.899385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0290bc7c-a376-4925-8c65-8f19b1df1bba tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:09.906275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0290bc7c-a376-4925-8c65-8f19b1df1bba tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:09.906811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0290bc7c-a376-4925-8c65-8f19b1df1bba tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:09.907273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0290bc7c-a376-4925-8c65-8f19b1df1bba tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:09.907988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0290bc7c-a376-4925-8c65-8f19b1df1bba tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:09.908521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0290bc7c-a376-4925-8c65-8f19b1df1bba tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:09.908973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0290bc7c-a376-4925-8c65-8f19b1df1bba tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:10.039712 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0290bc7c-a376-4925-8c65-8f19b1df1bba tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:10.048255 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0290bc7c-a376-4925-8c65-8f19b1df1bba tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1696 microversion: 2.1 time: 0.153646 Aug 23 19:16:10.048827 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4024/7911] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:09 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1696 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:11.069816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a10d455-dc67-4fe3-8ec1-9a07f794828b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:11.070435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a10d455-dc67-4fe3-8ec1-9a07f794828b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:11.078080 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a10d455-dc67-4fe3-8ec1-9a07f794828b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:11.078593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a10d455-dc67-4fe3-8ec1-9a07f794828b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:11.079047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a10d455-dc67-4fe3-8ec1-9a07f794828b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:11.079750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a10d455-dc67-4fe3-8ec1-9a07f794828b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:11.080211 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a10d455-dc67-4fe3-8ec1-9a07f794828b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:11.080641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a10d455-dc67-4fe3-8ec1-9a07f794828b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:11.211561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a10d455-dc67-4fe3-8ec1-9a07f794828b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:11.220449 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a10d455-dc67-4fe3-8ec1-9a07f794828b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1696 microversion: 2.1 time: 0.154535 Aug 23 19:16:11.221026 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3888/7912] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:11 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1696 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:12.241687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b0e53d8f-9650-4802-8e6b-3985899b7029 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:12.242342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b0e53d8f-9650-4802-8e6b-3985899b7029 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:12.250395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0e53d8f-9650-4802-8e6b-3985899b7029 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:12.250930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0e53d8f-9650-4802-8e6b-3985899b7029 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:12.251383 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0e53d8f-9650-4802-8e6b-3985899b7029 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:12.252344 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0e53d8f-9650-4802-8e6b-3985899b7029 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:12.252811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0e53d8f-9650-4802-8e6b-3985899b7029 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:12.253253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b0e53d8f-9650-4802-8e6b-3985899b7029 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:12.388660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b0e53d8f-9650-4802-8e6b-3985899b7029 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:12.396399 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b0e53d8f-9650-4802-8e6b-3985899b7029 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1696 microversion: 2.1 time: 0.158613 Aug 23 19:16:12.396978 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4025/7913] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:12 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1696 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:13.419360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8d092af1-e0b3-40bb-aff2-000d758ebc8d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:13.419972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8d092af1-e0b3-40bb-aff2-000d758ebc8d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:13.426965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d092af1-e0b3-40bb-aff2-000d758ebc8d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:13.427448 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d092af1-e0b3-40bb-aff2-000d758ebc8d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:13.427886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d092af1-e0b3-40bb-aff2-000d758ebc8d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:13.428574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d092af1-e0b3-40bb-aff2-000d758ebc8d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:13.429035 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d092af1-e0b3-40bb-aff2-000d758ebc8d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:13.429461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8d092af1-e0b3-40bb-aff2-000d758ebc8d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:13.563276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8d092af1-e0b3-40bb-aff2-000d758ebc8d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:13.571243 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8d092af1-e0b3-40bb-aff2-000d758ebc8d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1696 microversion: 2.1 time: 0.156381 Aug 23 19:16:13.572049 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3889/7914] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:13 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1696 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:14.592412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3eeb9a9c-cfb8-42fe-8aae-a95dbe2782b5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:14.593044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3eeb9a9c-cfb8-42fe-8aae-a95dbe2782b5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:14.600140 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3eeb9a9c-cfb8-42fe-8aae-a95dbe2782b5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:14.600644 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3eeb9a9c-cfb8-42fe-8aae-a95dbe2782b5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:14.601100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3eeb9a9c-cfb8-42fe-8aae-a95dbe2782b5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:14.601849 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3eeb9a9c-cfb8-42fe-8aae-a95dbe2782b5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:14.602330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3eeb9a9c-cfb8-42fe-8aae-a95dbe2782b5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:14.602795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3eeb9a9c-cfb8-42fe-8aae-a95dbe2782b5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:14.740246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3eeb9a9c-cfb8-42fe-8aae-a95dbe2782b5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:14.748738 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3eeb9a9c-cfb8-42fe-8aae-a95dbe2782b5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1696 microversion: 2.1 time: 0.160228 Aug 23 19:16:14.749436 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4026/7915] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:14 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1696 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:15.771657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e716e722-187a-4ff4-bba7-5507f4a6d2fb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:15.772401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e716e722-187a-4ff4-bba7-5507f4a6d2fb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:15.779652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e716e722-187a-4ff4-bba7-5507f4a6d2fb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:15.780129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e716e722-187a-4ff4-bba7-5507f4a6d2fb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:15.780558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e716e722-187a-4ff4-bba7-5507f4a6d2fb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:15.781252 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e716e722-187a-4ff4-bba7-5507f4a6d2fb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:15.781703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e716e722-187a-4ff4-bba7-5507f4a6d2fb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:15.782122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e716e722-187a-4ff4-bba7-5507f4a6d2fb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:15.922378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e716e722-187a-4ff4-bba7-5507f4a6d2fb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:15.931773 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e716e722-187a-4ff4-bba7-5507f4a6d2fb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1696 microversion: 2.1 time: 0.163116 Aug 23 19:16:15.932512 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3890/7916] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:15 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1696 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:16.953888 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e287268f-3fdc-4ce0-bdf6-51f2a6d371e6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:16.954614 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e287268f-3fdc-4ce0-bdf6-51f2a6d371e6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:16.960661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e287268f-3fdc-4ce0-bdf6-51f2a6d371e6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:16.961167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e287268f-3fdc-4ce0-bdf6-51f2a6d371e6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:16.961623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e287268f-3fdc-4ce0-bdf6-51f2a6d371e6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:16.962889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e287268f-3fdc-4ce0-bdf6-51f2a6d371e6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:16.963363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e287268f-3fdc-4ce0-bdf6-51f2a6d371e6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:16.963807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e287268f-3fdc-4ce0-bdf6-51f2a6d371e6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:17.172548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e287268f-3fdc-4ce0-bdf6-51f2a6d371e6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:17.180414 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e287268f-3fdc-4ce0-bdf6-51f2a6d371e6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1695 microversion: 2.1 time: 0.230952 Aug 23 19:16:17.181311 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4027/7917] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:16 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1695 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:17.605125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f9bb43dc-ddb5-4aba-a28a-d70ef66f6d71 req-4f6ffa34-9aca-43ca-a150-3e1a24ed5844 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0712c4b-dc54-489d-9a86-0787b099a2d1", "name": "network-vif-unplugged", "status": "completed", "tag": "4a27c9b9-545f-4677-a494-6f2c0b3fb951"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:16:17.614879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f9bb43dc-ddb5-4aba-a28a-d70ef66f6d71 req-4f6ffa34-9aca-43ca-a150-3e1a24ed5844 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:17.615364 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f9bb43dc-ddb5-4aba-a28a-d70ef66f6d71 req-4f6ffa34-9aca-43ca-a150-3e1a24ed5844 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:17.615793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f9bb43dc-ddb5-4aba-a28a-d70ef66f6d71 req-4f6ffa34-9aca-43ca-a150-3e1a24ed5844 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:17.629673 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f9bb43dc-ddb5-4aba-a28a-d70ef66f6d71 req-4f6ffa34-9aca-43ca-a150-3e1a24ed5844 service nova] Creating event network-vif-unplugged:4a27c9b9-545f-4677-a494-6f2c0b3fb951 for instance d0712c4b-dc54-489d-9a86-0787b099a2d1 on n-h2-850468-16 Aug 23 19:16:17.638042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [req-f9bb43dc-ddb5-4aba-a28a-d70ef66f6d71 req-4f6ffa34-9aca-43ca-a150-3e1a24ed5844 service nova] Instance d0712c4b-dc54-489d-9a86-0787b099a2d1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128807) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 19:16:17.649107 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f9bb43dc-ddb5-4aba-a28a-d70ef66f6d71 req-4f6ffa34-9aca-43ca-a150-3e1a24ed5844 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108671 Aug 23 19:16:17.649828 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3891/7918] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:16:18.203277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a8675e1a-308d-4645-8566-8ad30d006566 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:18.203933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a8675e1a-308d-4645-8566-8ad30d006566 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:18.210997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8675e1a-308d-4645-8566-8ad30d006566 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:18.211497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8675e1a-308d-4645-8566-8ad30d006566 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:18.212112 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8675e1a-308d-4645-8566-8ad30d006566 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:18.213122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8675e1a-308d-4645-8566-8ad30d006566 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:18.213652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8675e1a-308d-4645-8566-8ad30d006566 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:18.214101 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a8675e1a-308d-4645-8566-8ad30d006566 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:18.431877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a8675e1a-308d-4645-8566-8ad30d006566 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:18.439948 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a8675e1a-308d-4645-8566-8ad30d006566 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1695 microversion: 2.1 time: 0.240796 Aug 23 19:16:18.440947 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4028/7919] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:18 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1695 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:19.463226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2784b713-ea7a-42d6-8661-c37a6d569e0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:19.463921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2784b713-ea7a-42d6-8661-c37a6d569e0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:19.470007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2784b713-ea7a-42d6-8661-c37a6d569e0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:19.470488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2784b713-ea7a-42d6-8661-c37a6d569e0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:19.470951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2784b713-ea7a-42d6-8661-c37a6d569e0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:19.471636 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2784b713-ea7a-42d6-8661-c37a6d569e0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:19.472083 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2784b713-ea7a-42d6-8661-c37a6d569e0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:19.472504 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2784b713-ea7a-42d6-8661-c37a6d569e0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:19.609637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2784b713-ea7a-42d6-8661-c37a6d569e0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:19.617400 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2784b713-ea7a-42d6-8661-c37a6d569e0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1693 microversion: 2.1 time: 0.159706 Aug 23 19:16:19.617985 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3892/7920] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:19 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1693 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:19.664710 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-6c6610b7-d869-49bc-93cf-95c25a84254e req-8c3b5098-2735-415d-8346-f8528e94f176 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0712c4b-dc54-489d-9a86-0787b099a2d1", "tag": "4a27c9b9-545f-4677-a494-6f2c0b3fb951"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:16:19.675384 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6c6610b7-d869-49bc-93cf-95c25a84254e req-8c3b5098-2735-415d-8346-f8528e94f176 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:19.675880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6c6610b7-d869-49bc-93cf-95c25a84254e req-8c3b5098-2735-415d-8346-f8528e94f176 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:19.676327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-6c6610b7-d869-49bc-93cf-95c25a84254e req-8c3b5098-2735-415d-8346-f8528e94f176 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:19.688717 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-6c6610b7-d869-49bc-93cf-95c25a84254e req-8c3b5098-2735-415d-8346-f8528e94f176 service nova] Creating event network-changed:4a27c9b9-545f-4677-a494-6f2c0b3fb951 for instance d0712c4b-dc54-489d-9a86-0787b099a2d1 on n-h2-850468-16 Aug 23 19:16:19.694018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [req-6c6610b7-d869-49bc-93cf-95c25a84254e req-8c3b5098-2735-415d-8346-f8528e94f176 service nova] Instance d0712c4b-dc54-489d-9a86-0787b099a2d1 is migrating within the same cell, copying events to all relevant hosts: {'n-h2-850468-16', 'n-h1-850468-16'} {{(pid=128808) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5933}} Aug 23 19:16:19.704668 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-6c6610b7-d869-49bc-93cf-95c25a84254e req-8c3b5098-2735-415d-8346-f8528e94f176 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043797 Aug 23 19:16:19.705259 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4029/7921] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:16:20.640078 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c12a5960-02c8-4ba9-ab82-ff3ee74efea3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:20.640695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c12a5960-02c8-4ba9-ab82-ff3ee74efea3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:20.647557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c12a5960-02c8-4ba9-ab82-ff3ee74efea3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:20.648049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c12a5960-02c8-4ba9-ab82-ff3ee74efea3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:20.648491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c12a5960-02c8-4ba9-ab82-ff3ee74efea3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:20.649187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c12a5960-02c8-4ba9-ab82-ff3ee74efea3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:20.650155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c12a5960-02c8-4ba9-ab82-ff3ee74efea3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:20.650595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c12a5960-02c8-4ba9-ab82-ff3ee74efea3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:20.782266 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c12a5960-02c8-4ba9-ab82-ff3ee74efea3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:20.789933 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c12a5960-02c8-4ba9-ab82-ff3ee74efea3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1693 microversion: 2.1 time: 0.153735 Aug 23 19:16:20.791690 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3893/7922] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:20 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:21.814612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bd11db07-3ea1-49ad-9bb9-1daed3fd0c7d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:21.815360 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bd11db07-3ea1-49ad-9bb9-1daed3fd0c7d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:21.821817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd11db07-3ea1-49ad-9bb9-1daed3fd0c7d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:21.822349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd11db07-3ea1-49ad-9bb9-1daed3fd0c7d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:21.822843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd11db07-3ea1-49ad-9bb9-1daed3fd0c7d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:21.823558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd11db07-3ea1-49ad-9bb9-1daed3fd0c7d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:21.824031 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd11db07-3ea1-49ad-9bb9-1daed3fd0c7d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:21.824472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bd11db07-3ea1-49ad-9bb9-1daed3fd0c7d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:21.965379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-bd11db07-3ea1-49ad-9bb9-1daed3fd0c7d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:21.973446 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bd11db07-3ea1-49ad-9bb9-1daed3fd0c7d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1690 microversion: 2.1 time: 0.164003 Aug 23 19:16:21.974031 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4030/7923] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:21 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:21.995707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5931d36a-9cf8-453e-b78e-644ab1362e78 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:16:21.996261 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5931d36a-9cf8-453e-b78e-644ab1362e78 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:22.003570 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5931d36a-9cf8-453e-b78e-644ab1362e78 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:22.004073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5931d36a-9cf8-453e-b78e-644ab1362e78 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:22.004517 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5931d36a-9cf8-453e-b78e-644ab1362e78 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:22.005224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5931d36a-9cf8-453e-b78e-644ab1362e78 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:22.005687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5931d36a-9cf8-453e-b78e-644ab1362e78 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:22.006117 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5931d36a-9cf8-453e-b78e-644ab1362e78 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:22.066658 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5931d36a-9cf8-453e-b78e-644ab1362e78 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1/action" status: 204 len: 0 microversion: 2.1 time: 0.075329 Aug 23 19:16:22.067580 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3894/7924] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:16:21 2022] POST /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1/action => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:16:22.076475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8360cdb3-9fc1-4dfa-85f2-b0566625a02b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:22.077317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8360cdb3-9fc1-4dfa-85f2-b0566625a02b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:22.083727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8360cdb3-9fc1-4dfa-85f2-b0566625a02b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:22.084276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8360cdb3-9fc1-4dfa-85f2-b0566625a02b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:22.084828 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8360cdb3-9fc1-4dfa-85f2-b0566625a02b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:22.085670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8360cdb3-9fc1-4dfa-85f2-b0566625a02b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:22.086176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8360cdb3-9fc1-4dfa-85f2-b0566625a02b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:22.086678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8360cdb3-9fc1-4dfa-85f2-b0566625a02b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:22.239142 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8360cdb3-9fc1-4dfa-85f2-b0566625a02b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:22.248240 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8360cdb3-9fc1-4dfa-85f2-b0566625a02b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1690 microversion: 2.1 time: 0.175666 Aug 23 19:16:22.248952 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4031/7925] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:22 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:22.270659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-af1dff42-d66c-48c9-9778-0bf1c7a8ca16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:22.271422 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-af1dff42-d66c-48c9-9778-0bf1c7a8ca16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:22.278185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af1dff42-d66c-48c9-9778-0bf1c7a8ca16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:22.278745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af1dff42-d66c-48c9-9778-0bf1c7a8ca16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:22.279189 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af1dff42-d66c-48c9-9778-0bf1c7a8ca16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:22.279902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af1dff42-d66c-48c9-9778-0bf1c7a8ca16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:22.280356 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af1dff42-d66c-48c9-9778-0bf1c7a8ca16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:22.280780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af1dff42-d66c-48c9-9778-0bf1c7a8ca16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:22.657802 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-af1dff42-d66c-48c9-9778-0bf1c7a8ca16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:22.667302 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-af1dff42-d66c-48c9-9778-0bf1c7a8ca16 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1690 microversion: 2.1 time: 0.400898 Aug 23 19:16:22.667997 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3895/7926] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:22 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1690 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:23.691452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-41e9f4a3-8d7a-47d0-95c3-5c30e8564718 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:16:23.692185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-41e9f4a3-8d7a-47d0-95c3-5c30e8564718 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:23.699235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-41e9f4a3-8d7a-47d0-95c3-5c30e8564718 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:23.699813 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-41e9f4a3-8d7a-47d0-95c3-5c30e8564718 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:23.700272 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-41e9f4a3-8d7a-47d0-95c3-5c30e8564718 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:23.701293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-41e9f4a3-8d7a-47d0-95c3-5c30e8564718 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:23.701774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-41e9f4a3-8d7a-47d0-95c3-5c30e8564718 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:23.702221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-41e9f4a3-8d7a-47d0-95c3-5c30e8564718 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:23.838731 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-41e9f4a3-8d7a-47d0-95c3-5c30e8564718 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:16:23.846997 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-41e9f4a3-8d7a-47d0-95c3-5c30e8564718 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1682 microversion: 2.1 time: 0.160328 Aug 23 19:16:23.847461 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4032/7927] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:16:23 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:16:24.156909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-7ace260e-4195-411a-b424-f0a4362b6eaf req-bcbab74f-5cda-46c3-b6ae-9713bd70383e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0712c4b-dc54-489d-9a86-0787b099a2d1", "name": "network-vif-plugged", "status": "completed", "tag": "4a27c9b9-545f-4677-a494-6f2c0b3fb951"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:16:24.167812 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7ace260e-4195-411a-b424-f0a4362b6eaf req-bcbab74f-5cda-46c3-b6ae-9713bd70383e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:24.168297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7ace260e-4195-411a-b424-f0a4362b6eaf req-bcbab74f-5cda-46c3-b6ae-9713bd70383e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:24.169193 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-7ace260e-4195-411a-b424-f0a4362b6eaf req-bcbab74f-5cda-46c3-b6ae-9713bd70383e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:24.180676 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-7ace260e-4195-411a-b424-f0a4362b6eaf req-bcbab74f-5cda-46c3-b6ae-9713bd70383e service nova] Creating event network-vif-plugged:4a27c9b9-545f-4677-a494-6f2c0b3fb951 for instance d0712c4b-dc54-489d-9a86-0787b099a2d1 on n-h2-850468-16 Aug 23 19:16:24.186172 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-7ace260e-4195-411a-b424-f0a4362b6eaf req-bcbab74f-5cda-46c3-b6ae-9713bd70383e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032999 Aug 23 19:16:24.186944 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3896/7928] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:16:54.074824 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6b51e2ac-e4e9-486c-a58b-bf6fadb6e270 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:16:54.077030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6b51e2ac-e4e9-486c-a58b-bf6fadb6e270 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:16:54.079372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=24 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:16:54.080169 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=70 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:16:54.086248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b51e2ac-e4e9-486c-a58b-bf6fadb6e270 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:54.086793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b51e2ac-e4e9-486c-a58b-bf6fadb6e270 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:54.087255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b51e2ac-e4e9-486c-a58b-bf6fadb6e270 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:54.088579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b51e2ac-e4e9-486c-a58b-bf6fadb6e270 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:16:54.089056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b51e2ac-e4e9-486c-a58b-bf6fadb6e270 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:16:54.089535 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6b51e2ac-e4e9-486c-a58b-bf6fadb6e270 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:16:54.159810 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6b51e2ac-e4e9-486c-a58b-bf6fadb6e270 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1/action" status: 200 len: 24581 microversion: 2.1 time: 0.089556 Aug 23 19:16:54.160553 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4033/7929] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:16:54 2022] POST /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1/action => generated 24581 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:17:17.703084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=30 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:17:17.704058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:17:17.708456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-2972f9d8-4281-4c52-9c76-c407c68da73a req-f94ce08a-d05b-43e4-95ab-96b59680c7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d0712c4b-dc54-489d-9a86-0787b099a2d1", "tag": "4a27c9b9-545f-4677-a494-6f2c0b3fb951"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:17:17.709011 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0a2d3348-a833-4edf-a3a5-c07bb1ae9e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:17.709535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0a2d3348-a833-4edf-a3a5-c07bb1ae9e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:17.716427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:17:17.717855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:17:17.719330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a2d3348-a833-4edf-a3a5-c07bb1ae9e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:17.719877 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a2d3348-a833-4edf-a3a5-c07bb1ae9e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:17.720284 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a2d3348-a833-4edf-a3a5-c07bb1ae9e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:17.721009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a2d3348-a833-4edf-a3a5-c07bb1ae9e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:17.721502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a2d3348-a833-4edf-a3a5-c07bb1ae9e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:17.721940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0a2d3348-a833-4edf-a3a5-c07bb1ae9e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:17.724530 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2972f9d8-4281-4c52-9c76-c407c68da73a req-f94ce08a-d05b-43e4-95ab-96b59680c7d2 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:17.725130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2972f9d8-4281-4c52-9c76-c407c68da73a req-f94ce08a-d05b-43e4-95ab-96b59680c7d2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:17.725735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-2972f9d8-4281-4c52-9c76-c407c68da73a req-f94ce08a-d05b-43e4-95ab-96b59680c7d2 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:17.742617 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-2972f9d8-4281-4c52-9c76-c407c68da73a req-f94ce08a-d05b-43e4-95ab-96b59680c7d2 service nova] Creating event network-changed:4a27c9b9-545f-4677-a494-6f2c0b3fb951 for instance d0712c4b-dc54-489d-9a86-0787b099a2d1 on n-h2-850468-16 Aug 23 19:17:17.748617 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-2972f9d8-4281-4c52-9c76-c407c68da73a req-f94ce08a-d05b-43e4-95ab-96b59680c7d2 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045203 Aug 23 19:17:17.749439 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4034/7930] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:17:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:17:17.753943 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0a2d3348-a833-4edf-a3a5-c07bb1ae9e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:17:17.849650 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0a2d3348-a833-4edf-a3a5-c07bb1ae9e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "DELETE /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 204 len: 0 microversion: 2.1 time: 0.148609 Aug 23 19:17:17.850629 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3897/7931] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:17:17 2022] DELETE /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:17:17.861875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8c3bea8b-fc19-4a17-8e00-331914649544 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:17.862691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8c3bea8b-fc19-4a17-8e00-331914649544 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:17.871982 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c3bea8b-fc19-4a17-8e00-331914649544 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:17.872749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c3bea8b-fc19-4a17-8e00-331914649544 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:17.873219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c3bea8b-fc19-4a17-8e00-331914649544 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:17.873949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c3bea8b-fc19-4a17-8e00-331914649544 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:17.874425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c3bea8b-fc19-4a17-8e00-331914649544 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:17.874951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8c3bea8b-fc19-4a17-8e00-331914649544 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:18.029609 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8c3bea8b-fc19-4a17-8e00-331914649544 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:18.037464 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8c3bea8b-fc19-4a17-8e00-331914649544 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1688 microversion: 2.1 time: 0.180988 Aug 23 19:17:18.038048 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4035/7932] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:17 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:19.065369 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b69a71ea-3c9e-4f06-99c5-21633d29613c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:19.066069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b69a71ea-3c9e-4f06-99c5-21633d29613c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:19.072860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b69a71ea-3c9e-4f06-99c5-21633d29613c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:19.073980 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b69a71ea-3c9e-4f06-99c5-21633d29613c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:19.074863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b69a71ea-3c9e-4f06-99c5-21633d29613c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:19.075624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b69a71ea-3c9e-4f06-99c5-21633d29613c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:19.076094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b69a71ea-3c9e-4f06-99c5-21633d29613c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:19.076530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b69a71ea-3c9e-4f06-99c5-21633d29613c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:19.263367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b69a71ea-3c9e-4f06-99c5-21633d29613c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:19.271329 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b69a71ea-3c9e-4f06-99c5-21633d29613c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1688 microversion: 2.1 time: 0.210817 Aug 23 19:17:19.271890 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3898/7933] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:19 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1688 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:20.065785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-e5800207-9c6d-47f0-b57f-5367877c9e0d req-77d20352-8abc-4c49-8a94-1f2479eadbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d0712c4b-dc54-489d-9a86-0787b099a2d1", "name": "network-vif-deleted", "tag": "4a27c9b9-545f-4677-a494-6f2c0b3fb951"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:17:20.079277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e5800207-9c6d-47f0-b57f-5367877c9e0d req-77d20352-8abc-4c49-8a94-1f2479eadbf8 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:20.079771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e5800207-9c6d-47f0-b57f-5367877c9e0d req-77d20352-8abc-4c49-8a94-1f2479eadbf8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:20.080222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-e5800207-9c6d-47f0-b57f-5367877c9e0d req-77d20352-8abc-4c49-8a94-1f2479eadbf8 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:20.093050 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-e5800207-9c6d-47f0-b57f-5367877c9e0d req-77d20352-8abc-4c49-8a94-1f2479eadbf8 service nova] Creating event network-vif-deleted:4a27c9b9-545f-4677-a494-6f2c0b3fb951 for instance d0712c4b-dc54-489d-9a86-0787b099a2d1 on n-h2-850468-16 Aug 23 19:17:20.097947 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-e5800207-9c6d-47f0-b57f-5367877c9e0d req-77d20352-8abc-4c49-8a94-1f2479eadbf8 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035934 Aug 23 19:17:20.098570 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4036/7934] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:17:20.293511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:20.294054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:20.300923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:20.301405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:20.301840 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:20.302533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:20.303012 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:20.303438 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:20.335917 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:20.336405 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:20.336848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:20.337307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lazy-loading 'fault' on Instance uuid d0712c4b-dc54-489d-9a86-0787b099a2d1 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:17:20.381533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:20.389648 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b74ecdb5-f039-4e7f-872e-58fbd6fbb398 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 200 len: 1356 microversion: 2.1 time: 0.100655 Aug 23 19:17:20.390247 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3899/7935] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:20 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 1356 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:21.412362 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7c29a51-ab22-4e1d-b1ca-b2e055490df5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:21.413090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f7c29a51-ab22-4e1d-b1ca-b2e055490df5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: d0712c4b-dc54-489d-9a86-0787b099a2d1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:21.420002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7c29a51-ab22-4e1d-b1ca-b2e055490df5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:21.420512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7c29a51-ab22-4e1d-b1ca-b2e055490df5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:21.420989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7c29a51-ab22-4e1d-b1ca-b2e055490df5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:21.421707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7c29a51-ab22-4e1d-b1ca-b2e055490df5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:21.422185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7c29a51-ab22-4e1d-b1ca-b2e055490df5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:21.422661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7c29a51-ab22-4e1d-b1ca-b2e055490df5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:21.436113 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-f7c29a51-ab22-4e1d-b1ca-b2e055490df5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] HTTP exception thrown: Instance d0712c4b-dc54-489d-9a86-0787b099a2d1 could not be found. Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7c29a51-ab22-4e1d-b1ca-b2e055490df5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Request method failure captured: Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 HTTP/1.1 Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSYnx1WT4Gq2W98xrb4v7A_NZEqhPSI9Nnx0JtMEtpxu6ASOeeNPsAUHO7NTkLBeC-b0QKnbzfLy_iy-WFwk6pin00WncrZMV-1kc-S_LC8OXBre2xGrhEMDXxk9aYiPr88-JSsp-T-qo3q5YV-u1YQ_T_pJ5tOz5fWaqLFzc6WKr6Y Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 7b28c141b95b4205a6557e8d9a7fc07a Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b28c141b95b4205a6557e8d9a7fc07a"}]}] Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 7b28c141b95b4205a6557e8d9a7fc07a Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestNetworkAdvancedServerOps-267656723-project Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2887d531d5a9449c9cb350a5b1dd73d2 Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestNetworkAdvancedServerOps-267656723-project Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance d0712c4b-dc54-489d-9a86-0787b099a2d1 could not be found. Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'd0712c4b-dc54-489d-9a86-0787b099a2d1'} Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d0712c4b-dc54-489d-9a86-0787b099a2d1 could not be found. Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d0712c4b-dc54-489d-9a86-0787b099a2d1 could not be found. Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:17:21.437759 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:17:21.442880 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:17:21.442880 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:17:21.442880 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:17:21.442880 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:17:21.442880 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:17:21.442880 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:17:21.442880 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d0712c4b-dc54-489d-9a86-0787b099a2d1 could not be found. Aug 23 19:17:21.442880 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:17:21.442880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7c29a51-ab22-4e1d-b1ca-b2e055490df5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Returning 404 to user: Instance d0712c4b-dc54-489d-9a86-0787b099a2d1 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:17:21.442880 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f7c29a51-ab22-4e1d-b1ca-b2e055490df5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1" status: 404 len: 111 microversion: 2.1 time: 0.032094 Aug 23 19:17:21.442880 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4037/7936] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:21 2022] GET /compute/v2.1/servers/d0712c4b-dc54-489d-9a86-0787b099a2d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:17:24.433546 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-10d893fc-25f8-4321-b9df-658b654973b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '.version_select at 0x7f27df9c40d0>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:24.439113 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [None req-10d893fc-25f8-4321-b9df-658b654973b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [5b22d8ef-03cc-4341-ab6b-d5561bf06d31] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:17:25.448913 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [None req-10d893fc-25f8-4321-b9df-658b654973b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [5b22d8ef-03cc-4341-ab6b-d5561bf06d31] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 35878. Aug 23 19:17:25.468880 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-10d893fc-25f8-4321-b9df-658b654973b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1001967081" status: 202 len: 0 microversion: 2.1 time: 1.039627 Aug 23 19:17:25.469457 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3900/7937] 10.222.0.61 () {58 vars in 1284 bytes} [Tue Aug 23 19:17:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1001967081 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:17:25.497928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-769c348c-084f-4ec9-b667-e3529fd9b5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'create', calling method: .version_select at 0x7f27f1aa6af0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-755837785", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLigD9JC8pa9CAzkjOnspWP7f2J660ewp0AaFJ+undiD+w/kkL67m9SxtsL2KgpjBoNJ/M8DA3mCGwJLFc7BHEXR3lMbWZxo9yOnRkyX+VScOGVGoYhKNc5A4t0zTStpZA=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:17:25.514234 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-769c348c-084f-4ec9-b667-e3529fd9b5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:17:25.520197 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-769c348c-084f-4ec9-b667-e3529fd9b5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for user 2887d531d5a9449c9cb350a5b1dd73d2 and project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:17:25.533162 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [None req-769c348c-084f-4ec9-b667-e3529fd9b5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [ee013254-ad44-4cb4-b5e8-493e981442a5] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:17:26.540058 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [None req-769c348c-084f-4ec9-b667-e3529fd9b5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [ee013254-ad44-4cb4-b5e8-493e981442a5] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 35882. Aug 23 19:17:26.555489 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-769c348c-084f-4ec9-b667-e3529fd9b5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 1.062175 Aug 23 19:17:26.556095 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4038/7938] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 19:17:25 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:17:32.114439 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:17:32.118727 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1816260073", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "d702a1a1-ad6a-4405-8b08-d174a8e12bb5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-755837785", "security_groups": [{"name": "tempest-secgroup-smoke-1905482347"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:17:32.237774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] validate_networks() for [('d702a1a1-ad6a-4405-8b08-d174a8e12bb5', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:17:32.702021 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:17:32.702449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:17:32.704212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:17:32.704817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:17:32.705186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:17:32.715535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:32.716049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:32.716502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:32.717728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:32.718699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:32.719432 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:32.739037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:17:32.745169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for user 2887d531d5a9449c9cb350a5b1dd73d2 and project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:17:32.763725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:17:32.767303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:17:32.826058 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bb0377be-7cbb-492a-8e0a-c912c092789e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.713346 Aug 23 19:17:32.827045 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3901/7939] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:17:32 2022] POST /compute/v2.1/servers => generated 406 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:17:32.839159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b5082218-be8e-47fe-a670-9dcbf5db1d5c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:32.840577 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b5082218-be8e-47fe-a670-9dcbf5db1d5c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:32.847701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=12 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:17:32.918639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b5082218-be8e-47fe-a670-9dcbf5db1d5c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:32.927227 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b5082218-be8e-47fe-a670-9dcbf5db1d5c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1266 microversion: 2.1 time: 0.092033 Aug 23 19:17:32.927906 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4039/7940] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:32 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:33.950064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-02511a6e-2922-43d6-aa1d-a60cf11b14a3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:33.950712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-02511a6e-2922-43d6-aa1d-a60cf11b14a3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:34.014481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-02511a6e-2922-43d6-aa1d-a60cf11b14a3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:34.021425 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-02511a6e-2922-43d6-aa1d-a60cf11b14a3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1266 microversion: 2.1 time: 0.075695 Aug 23 19:17:34.022026 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3902/7941] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:33 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:35.044735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a781caf-3094-457c-b348-58b140cd1d8a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:35.045398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8a781caf-3094-457c-b348-58b140cd1d8a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:35.106922 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8a781caf-3094-457c-b348-58b140cd1d8a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:35.114308 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8a781caf-3094-457c-b348-58b140cd1d8a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1266 microversion: 2.1 time: 0.075234 Aug 23 19:17:35.115333 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4040/7942] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:35 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1266 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:36.135298 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-510f985e-6951-45ed-a9c7-07df56b85bef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:36.135916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-510f985e-6951-45ed-a9c7-07df56b85bef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:36.189990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-510f985e-6951-45ed-a9c7-07df56b85bef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:36.196992 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-510f985e-6951-45ed-a9c7-07df56b85bef tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1266 microversion: 2.1 time: 0.065536 Aug 23 19:17:36.197760 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3903/7943] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:36 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1266 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:37.218380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c6cc6db0-1b19-4f6c-83f6-afb7aba272d2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:37.219029 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c6cc6db0-1b19-4f6c-83f6-afb7aba272d2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:37.226419 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6cc6db0-1b19-4f6c-83f6-afb7aba272d2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:37.226953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6cc6db0-1b19-4f6c-83f6-afb7aba272d2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:37.227408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6cc6db0-1b19-4f6c-83f6-afb7aba272d2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:37.228115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6cc6db0-1b19-4f6c-83f6-afb7aba272d2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:37.228584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6cc6db0-1b19-4f6c-83f6-afb7aba272d2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:37.229026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c6cc6db0-1b19-4f6c-83f6-afb7aba272d2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:37.290083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c6cc6db0-1b19-4f6c-83f6-afb7aba272d2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:37.298414 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c6cc6db0-1b19-4f6c-83f6-afb7aba272d2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1270 microversion: 2.1 time: 0.083966 Aug 23 19:17:37.298951 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4041/7944] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:37 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1270 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:38.319906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-df6ad180-e7c8-4759-9aa3-287805e20f85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:38.320485 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-df6ad180-e7c8-4759-9aa3-287805e20f85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:38.328752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df6ad180-e7c8-4759-9aa3-287805e20f85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:38.329239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df6ad180-e7c8-4759-9aa3-287805e20f85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:38.329692 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df6ad180-e7c8-4759-9aa3-287805e20f85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:38.330721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df6ad180-e7c8-4759-9aa3-287805e20f85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:38.331173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df6ad180-e7c8-4759-9aa3-287805e20f85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:38.331598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-df6ad180-e7c8-4759-9aa3-287805e20f85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:38.397393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-df6ad180-e7c8-4759-9aa3-287805e20f85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:38.405162 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-df6ad180-e7c8-4759-9aa3-287805e20f85 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1324 microversion: 2.1 time: 0.089365 Aug 23 19:17:38.405738 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3904/7945] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:38 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1324 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:17:39.250393 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5cdbde6b-de94-460d-a240-59aea2d964c7 req-d9959eb5-9966-4d2e-8470-a2c51fe2aa33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e2fb18-700b-4f2e-90da-c418d64f8b04", "tag": "7a3ecc2b-8f36-4885-a335-8de425fec79e"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:17:39.262212 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5cdbde6b-de94-460d-a240-59aea2d964c7 req-d9959eb5-9966-4d2e-8470-a2c51fe2aa33 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:39.263998 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5cdbde6b-de94-460d-a240-59aea2d964c7 req-d9959eb5-9966-4d2e-8470-a2c51fe2aa33 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:39.264532 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5cdbde6b-de94-460d-a240-59aea2d964c7 req-d9959eb5-9966-4d2e-8470-a2c51fe2aa33 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:39.276597 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5cdbde6b-de94-460d-a240-59aea2d964c7 req-d9959eb5-9966-4d2e-8470-a2c51fe2aa33 service nova] Creating event network-changed:7a3ecc2b-8f36-4885-a335-8de425fec79e for instance 07e2fb18-700b-4f2e-90da-c418d64f8b04 on n-h2-850468-16 Aug 23 19:17:39.281752 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5cdbde6b-de94-460d-a240-59aea2d964c7 req-d9959eb5-9966-4d2e-8470-a2c51fe2aa33 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035701 Aug 23 19:17:39.282449 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4042/7946] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:17:39.426124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-0fbcd791-db2c-4b1a-a463-40524acbeae2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:39.426704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-0fbcd791-db2c-4b1a-a463-40524acbeae2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:39.434483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fbcd791-db2c-4b1a-a463-40524acbeae2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:39.435172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fbcd791-db2c-4b1a-a463-40524acbeae2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:39.435763 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fbcd791-db2c-4b1a-a463-40524acbeae2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:39.436477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fbcd791-db2c-4b1a-a463-40524acbeae2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:39.436981 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fbcd791-db2c-4b1a-a463-40524acbeae2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:39.437417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-0fbcd791-db2c-4b1a-a463-40524acbeae2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:39.579705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-0fbcd791-db2c-4b1a-a463-40524acbeae2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:39.587800 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-0fbcd791-db2c-4b1a-a463-40524acbeae2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1392 microversion: 2.1 time: 0.165635 Aug 23 19:17:39.588397 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3905/7947] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:39 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:40.610290 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5306853c-dbef-4616-aed8-5c9027bae399 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:40.611044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5306853c-dbef-4616-aed8-5c9027bae399 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:40.617413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5306853c-dbef-4616-aed8-5c9027bae399 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:40.617921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5306853c-dbef-4616-aed8-5c9027bae399 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:40.618376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5306853c-dbef-4616-aed8-5c9027bae399 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:40.619118 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5306853c-dbef-4616-aed8-5c9027bae399 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:40.619593 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5306853c-dbef-4616-aed8-5c9027bae399 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:40.620039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5306853c-dbef-4616-aed8-5c9027bae399 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:40.756930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5306853c-dbef-4616-aed8-5c9027bae399 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:40.764635 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5306853c-dbef-4616-aed8-5c9027bae399 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1392 microversion: 2.1 time: 0.160123 Aug 23 19:17:40.765205 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4043/7948] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:40 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:41.785622 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3db95081-d763-40f2-85b0-83c491b0183d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:41.786155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3db95081-d763-40f2-85b0-83c491b0183d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:41.792947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3db95081-d763-40f2-85b0-83c491b0183d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:41.793507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3db95081-d763-40f2-85b0-83c491b0183d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:41.794042 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3db95081-d763-40f2-85b0-83c491b0183d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:41.794785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3db95081-d763-40f2-85b0-83c491b0183d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:41.795226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3db95081-d763-40f2-85b0-83c491b0183d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:41.795654 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3db95081-d763-40f2-85b0-83c491b0183d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:41.934589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3db95081-d763-40f2-85b0-83c491b0183d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:41.942742 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3db95081-d763-40f2-85b0-83c491b0183d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1392 microversion: 2.1 time: 0.161107 Aug 23 19:17:41.943317 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3906/7949] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:41 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:42.964645 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-af5999d6-44a2-43dd-bd92-10e7ad1535f6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:42.965695 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-af5999d6-44a2-43dd-bd92-10e7ad1535f6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:42.972852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af5999d6-44a2-43dd-bd92-10e7ad1535f6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:42.973347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af5999d6-44a2-43dd-bd92-10e7ad1535f6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:42.973793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af5999d6-44a2-43dd-bd92-10e7ad1535f6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:42.974496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af5999d6-44a2-43dd-bd92-10e7ad1535f6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:42.974986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af5999d6-44a2-43dd-bd92-10e7ad1535f6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:42.975424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-af5999d6-44a2-43dd-bd92-10e7ad1535f6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:43.115217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-af5999d6-44a2-43dd-bd92-10e7ad1535f6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:43.126063 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-af5999d6-44a2-43dd-bd92-10e7ad1535f6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1392 microversion: 2.1 time: 0.165169 Aug 23 19:17:43.126790 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4044/7950] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:42 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:44.147803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-56e197d5-d9ce-4aca-bbae-e1e1d407c5db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:44.148423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-56e197d5-d9ce-4aca-bbae-e1e1d407c5db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:44.150786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:17:44.159661 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56e197d5-d9ce-4aca-bbae-e1e1d407c5db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:44.160152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56e197d5-d9ce-4aca-bbae-e1e1d407c5db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:44.160593 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56e197d5-d9ce-4aca-bbae-e1e1d407c5db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:44.161377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56e197d5-d9ce-4aca-bbae-e1e1d407c5db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:44.161746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56e197d5-d9ce-4aca-bbae-e1e1d407c5db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:44.162173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-56e197d5-d9ce-4aca-bbae-e1e1d407c5db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:44.307784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-56e197d5-d9ce-4aca-bbae-e1e1d407c5db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:44.316473 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-56e197d5-d9ce-4aca-bbae-e1e1d407c5db tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1392 microversion: 2.1 time: 0.172659 Aug 23 19:17:44.317057 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3907/7951] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:44 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:44.474355 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-cd44c2dd-3b62-4834-9169-3e82d6b4ad56 req-e81f1d36-20e7-4c88-a949-d878a3a97cf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e2fb18-700b-4f2e-90da-c418d64f8b04", "name": "network-vif-plugged", "status": "completed", "tag": "7a3ecc2b-8f36-4885-a335-8de425fec79e"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:17:44.485707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cd44c2dd-3b62-4834-9169-3e82d6b4ad56 req-e81f1d36-20e7-4c88-a949-d878a3a97cf0 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:44.486238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cd44c2dd-3b62-4834-9169-3e82d6b4ad56 req-e81f1d36-20e7-4c88-a949-d878a3a97cf0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:44.486730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-cd44c2dd-3b62-4834-9169-3e82d6b4ad56 req-e81f1d36-20e7-4c88-a949-d878a3a97cf0 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:44.498267 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-cd44c2dd-3b62-4834-9169-3e82d6b4ad56 req-e81f1d36-20e7-4c88-a949-d878a3a97cf0 service nova] Creating event network-vif-plugged:7a3ecc2b-8f36-4885-a335-8de425fec79e for instance 07e2fb18-700b-4f2e-90da-c418d64f8b04 on n-h2-850468-16 Aug 23 19:17:44.503233 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-cd44c2dd-3b62-4834-9169-3e82d6b4ad56 req-e81f1d36-20e7-4c88-a949-d878a3a97cf0 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032772 Aug 23 19:17:44.503836 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4045/7952] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:17:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:17:45.338313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fdb876b3-6c9e-4611-8735-d08d54ac7615 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:45.338876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fdb876b3-6c9e-4611-8735-d08d54ac7615 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:45.346001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdb876b3-6c9e-4611-8735-d08d54ac7615 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:45.346486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdb876b3-6c9e-4611-8735-d08d54ac7615 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:45.346960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdb876b3-6c9e-4611-8735-d08d54ac7615 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:45.347657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdb876b3-6c9e-4611-8735-d08d54ac7615 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:45.348119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdb876b3-6c9e-4611-8735-d08d54ac7615 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:45.348553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdb876b3-6c9e-4611-8735-d08d54ac7615 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:45.483887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fdb876b3-6c9e-4611-8735-d08d54ac7615 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:45.491531 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fdb876b3-6c9e-4611-8735-d08d54ac7615 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1392 microversion: 2.1 time: 0.157311 Aug 23 19:17:45.492089 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3908/7953] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:45 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:46.510605 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:17:46.516087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8a86093e-056a-477c-8dca-483ac89f83e5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:46.516838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8a86093e-056a-477c-8dca-483ac89f83e5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:46.523415 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a86093e-056a-477c-8dca-483ac89f83e5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:46.523915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a86093e-056a-477c-8dca-483ac89f83e5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:46.524366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a86093e-056a-477c-8dca-483ac89f83e5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:46.525076 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a86093e-056a-477c-8dca-483ac89f83e5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:46.525544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a86093e-056a-477c-8dca-483ac89f83e5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:46.525983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8a86093e-056a-477c-8dca-483ac89f83e5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:46.671789 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8a86093e-056a-477c-8dca-483ac89f83e5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:46.679671 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8a86093e-056a-477c-8dca-483ac89f83e5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1563 microversion: 2.1 time: 0.170077 Aug 23 19:17:46.680246 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4046/7954] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:46 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1563 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:46.702204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf4b95e2-ece3-4f55-9096-ce78341bee0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:46.705481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf4b95e2-ece3-4f55-9096-ce78341bee0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:46.705481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=10 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:17:46.710434 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4b95e2-ece3-4f55-9096-ce78341bee0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:46.710952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4b95e2-ece3-4f55-9096-ce78341bee0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:46.711392 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4b95e2-ece3-4f55-9096-ce78341bee0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:46.712089 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4b95e2-ece3-4f55-9096-ce78341bee0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:46.712597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4b95e2-ece3-4f55-9096-ce78341bee0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:46.713023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf4b95e2-ece3-4f55-9096-ce78341bee0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:46.848589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf4b95e2-ece3-4f55-9096-ce78341bee0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:46.856909 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf4b95e2-ece3-4f55-9096-ce78341bee0f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1563 microversion: 2.1 time: 0.158386 Aug 23 19:17:46.857477 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3909/7955] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:46 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1563 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:17:48.709359 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-c6d6f0a8-ab63-406b-b86e-aaa6bad19eff req-c97f633f-b4d9-4b13-a713-6c2268f8530d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e2fb18-700b-4f2e-90da-c418d64f8b04", "tag": "7a3ecc2b-8f36-4885-a335-8de425fec79e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:17:48.711181 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-11b8b603-6eaf-4d2a-bb08-b516dca6d44f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:17:48.711914 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-11b8b603-6eaf-4d2a-bb08-b516dca6d44f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:17:48.714220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:17:48.719814 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:17:48.720165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11b8b603-6eaf-4d2a-bb08-b516dca6d44f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:48.721544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11b8b603-6eaf-4d2a-bb08-b516dca6d44f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:48.722131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11b8b603-6eaf-4d2a-bb08-b516dca6d44f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:48.722521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c6d6f0a8-ab63-406b-b86e-aaa6bad19eff req-c97f633f-b4d9-4b13-a713-6c2268f8530d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:48.723029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c6d6f0a8-ab63-406b-b86e-aaa6bad19eff req-c97f633f-b4d9-4b13-a713-6c2268f8530d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:48.723460 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c6d6f0a8-ab63-406b-b86e-aaa6bad19eff req-c97f633f-b4d9-4b13-a713-6c2268f8530d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:48.723917 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11b8b603-6eaf-4d2a-bb08-b516dca6d44f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:17:48.724707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11b8b603-6eaf-4d2a-bb08-b516dca6d44f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:17:48.725670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-11b8b603-6eaf-4d2a-bb08-b516dca6d44f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:17:48.741155 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-c6d6f0a8-ab63-406b-b86e-aaa6bad19eff req-c97f633f-b4d9-4b13-a713-6c2268f8530d service nova] Creating event network-changed:7a3ecc2b-8f36-4885-a335-8de425fec79e for instance 07e2fb18-700b-4f2e-90da-c418d64f8b04 on n-h2-850468-16 Aug 23 19:17:48.748896 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-c6d6f0a8-ab63-406b-b86e-aaa6bad19eff req-c97f633f-b4d9-4b13-a713-6c2268f8530d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043376 Aug 23 19:17:48.749500 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3910/7956] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:17:48.961839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-11b8b603-6eaf-4d2a-bb08-b516dca6d44f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:17:48.971408 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-11b8b603-6eaf-4d2a-bb08-b516dca6d44f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1563 microversion: 2.1 time: 0.267939 Aug 23 19:17:48.972157 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4047/7957] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:17:48 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1563 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:18:22.258938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e1a0490b-f3cc-45d3-bc25-86252285aa29 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:18:22.261233 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e1a0490b-f3cc-45d3-bc25-86252285aa29 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:18:22.264270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=40 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:18:22.271168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1a0490b-f3cc-45d3-bc25-86252285aa29 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:22.271646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1a0490b-f3cc-45d3-bc25-86252285aa29 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:22.272097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1a0490b-f3cc-45d3-bc25-86252285aa29 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:22.272788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1a0490b-f3cc-45d3-bc25-86252285aa29 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:22.273238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1a0490b-f3cc-45d3-bc25-86252285aa29 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:22.273660 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e1a0490b-f3cc-45d3-bc25-86252285aa29 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:22.324396 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e1a0490b-f3cc-45d3-bc25-86252285aa29 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04/action" status: 200 len: 24575 microversion: 2.1 time: 0.069993 Aug 23 19:18:22.325040 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3911/7958] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:18:22 2022] POST /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04/action => generated 24575 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:18:52.662874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:18:52.663676 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=34 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:18:52.667680 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-33591cb9-b5aa-4bef-9900-2802b859ee0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:18:52.674983 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33591cb9-b5aa-4bef-9900-2802b859ee0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:52.675484 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33591cb9-b5aa-4bef-9900-2802b859ee0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:52.675935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-33591cb9-b5aa-4bef-9900-2802b859ee0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:52.698597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-33591cb9-b5aa-4bef-9900-2802b859ee0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Going to try to stop instance {{(pid=128808) force_stop /opt/stack/nova/nova/compute/api.py:2749}} Aug 23 19:18:52.745029 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-33591cb9-b5aa-4bef-9900-2802b859ee0e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04/action" status: 202 len: 0 microversion: 2.1 time: 0.083663 Aug 23 19:18:52.745623 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4048/7959] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:18:52 2022] POST /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:18:52.756291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d1958d23-9dfa-4cf7-84c4-2f03e161ee8b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:18:52.756999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d1958d23-9dfa-4cf7-84c4-2f03e161ee8b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:18:52.761098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:18:52.761733 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:18:52.766906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1958d23-9dfa-4cf7-84c4-2f03e161ee8b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:52.767450 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1958d23-9dfa-4cf7-84c4-2f03e161ee8b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:52.767892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1958d23-9dfa-4cf7-84c4-2f03e161ee8b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:52.768620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1958d23-9dfa-4cf7-84c4-2f03e161ee8b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:52.769076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1958d23-9dfa-4cf7-84c4-2f03e161ee8b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:52.769505 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d1958d23-9dfa-4cf7-84c4-2f03e161ee8b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:52.908123 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d1958d23-9dfa-4cf7-84c4-2f03e161ee8b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:18:52.915877 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d1958d23-9dfa-4cf7-84c4-2f03e161ee8b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.163819 Aug 23 19:18:52.916433 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3912/7960] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:18:52 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:18:53.937471 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f7036dcd-5b26-48f9-b03c-b2b5ffa76a82 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:18:53.938298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f7036dcd-5b26-48f9-b03c-b2b5ffa76a82 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:18:53.946147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7036dcd-5b26-48f9-b03c-b2b5ffa76a82 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:53.946682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7036dcd-5b26-48f9-b03c-b2b5ffa76a82 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:53.947166 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7036dcd-5b26-48f9-b03c-b2b5ffa76a82 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:53.947862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7036dcd-5b26-48f9-b03c-b2b5ffa76a82 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:53.948701 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7036dcd-5b26-48f9-b03c-b2b5ffa76a82 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:53.948800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f7036dcd-5b26-48f9-b03c-b2b5ffa76a82 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:54.089412 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f7036dcd-5b26-48f9-b03c-b2b5ffa76a82 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:18:54.098667 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f7036dcd-5b26-48f9-b03c-b2b5ffa76a82 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.165604 Aug 23 19:18:54.099253 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4049/7961] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:18:53 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:18:55.119927 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6ef8e1d1-4e2b-4ae8-bebb-30af57bc55d6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:18:55.120540 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6ef8e1d1-4e2b-4ae8-bebb-30af57bc55d6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:18:55.128003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ef8e1d1-4e2b-4ae8-bebb-30af57bc55d6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:55.128490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ef8e1d1-4e2b-4ae8-bebb-30af57bc55d6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:55.128932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ef8e1d1-4e2b-4ae8-bebb-30af57bc55d6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:55.129631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ef8e1d1-4e2b-4ae8-bebb-30af57bc55d6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:55.130092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ef8e1d1-4e2b-4ae8-bebb-30af57bc55d6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:55.130521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6ef8e1d1-4e2b-4ae8-bebb-30af57bc55d6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:55.260592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6ef8e1d1-4e2b-4ae8-bebb-30af57bc55d6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:18:55.269103 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6ef8e1d1-4e2b-4ae8-bebb-30af57bc55d6 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.153077 Aug 23 19:18:55.269669 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3913/7962] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:18:55 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:18:56.290533 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-52d13371-6350-4e04-afe3-93e96cf49880 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:18:56.291185 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-52d13371-6350-4e04-afe3-93e96cf49880 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:18:56.298683 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52d13371-6350-4e04-afe3-93e96cf49880 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:56.299184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52d13371-6350-4e04-afe3-93e96cf49880 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:56.299640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52d13371-6350-4e04-afe3-93e96cf49880 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:56.300363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52d13371-6350-4e04-afe3-93e96cf49880 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:56.300833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52d13371-6350-4e04-afe3-93e96cf49880 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:56.301280 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-52d13371-6350-4e04-afe3-93e96cf49880 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:56.434138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-52d13371-6350-4e04-afe3-93e96cf49880 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:18:56.442805 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-52d13371-6350-4e04-afe3-93e96cf49880 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.156196 Aug 23 19:18:56.443393 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4050/7963] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:18:56 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:18:57.464807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-af15eb3f-f726-448b-a082-77f2b28b20ff tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:18:57.465427 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-af15eb3f-f726-448b-a082-77f2b28b20ff tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:18:57.472751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af15eb3f-f726-448b-a082-77f2b28b20ff tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:57.473237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af15eb3f-f726-448b-a082-77f2b28b20ff tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:57.473674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af15eb3f-f726-448b-a082-77f2b28b20ff tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:57.474368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af15eb3f-f726-448b-a082-77f2b28b20ff tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:57.474850 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af15eb3f-f726-448b-a082-77f2b28b20ff tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:57.475277 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-af15eb3f-f726-448b-a082-77f2b28b20ff tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:57.610251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-af15eb3f-f726-448b-a082-77f2b28b20ff tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:18:57.618148 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-af15eb3f-f726-448b-a082-77f2b28b20ff tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.157217 Aug 23 19:18:57.618751 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3914/7964] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:18:57 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:18:58.641456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-fd323221-ab64-49e8-ad87-ebbc82f3a5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:18:58.642342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-fd323221-ab64-49e8-ad87-ebbc82f3a5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:18:58.649035 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd323221-ab64-49e8-ad87-ebbc82f3a5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:58.649531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd323221-ab64-49e8-ad87-ebbc82f3a5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:58.649980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd323221-ab64-49e8-ad87-ebbc82f3a5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:58.650713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd323221-ab64-49e8-ad87-ebbc82f3a5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:58.651183 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd323221-ab64-49e8-ad87-ebbc82f3a5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:58.651655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-fd323221-ab64-49e8-ad87-ebbc82f3a5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:58.787592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-fd323221-ab64-49e8-ad87-ebbc82f3a5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:18:58.795662 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-fd323221-ab64-49e8-ad87-ebbc82f3a5dd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.158827 Aug 23 19:18:58.796239 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4051/7965] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:18:58 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:18:59.816260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d8b65954-3763-4020-9c6a-610fb0721a1e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:18:59.816887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d8b65954-3763-4020-9c6a-610fb0721a1e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:18:59.823770 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8b65954-3763-4020-9c6a-610fb0721a1e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:59.824262 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8b65954-3763-4020-9c6a-610fb0721a1e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:59.824703 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8b65954-3763-4020-9c6a-610fb0721a1e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:59.825402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8b65954-3763-4020-9c6a-610fb0721a1e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:18:59.825860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8b65954-3763-4020-9c6a-610fb0721a1e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:18:59.826290 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d8b65954-3763-4020-9c6a-610fb0721a1e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:18:59.960133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d8b65954-3763-4020-9c6a-610fb0721a1e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:18:59.967859 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d8b65954-3763-4020-9c6a-610fb0721a1e tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.155670 Aug 23 19:18:59.968432 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3915/7966] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:18:59 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:19:00.989308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-76d3d015-4c6c-4fe1-96b3-80ed04730876 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:19:00.989939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-76d3d015-4c6c-4fe1-96b3-80ed04730876 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:19:00.997402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76d3d015-4c6c-4fe1-96b3-80ed04730876 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:00.997905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76d3d015-4c6c-4fe1-96b3-80ed04730876 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:00.998354 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76d3d015-4c6c-4fe1-96b3-80ed04730876 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:00.999097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76d3d015-4c6c-4fe1-96b3-80ed04730876 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:00.999568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76d3d015-4c6c-4fe1-96b3-80ed04730876 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:01.000038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-76d3d015-4c6c-4fe1-96b3-80ed04730876 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:01.131892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-76d3d015-4c6c-4fe1-96b3-80ed04730876 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:19:01.139867 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-76d3d015-4c6c-4fe1-96b3-80ed04730876 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.154553 Aug 23 19:19:01.140445 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4052/7967] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:19:00 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:19:02.162098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fdd2cd20-47c8-41b7-ae03-117b54dcffcd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:19:02.162757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fdd2cd20-47c8-41b7-ae03-117b54dcffcd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:19:02.169588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdd2cd20-47c8-41b7-ae03-117b54dcffcd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:02.170075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdd2cd20-47c8-41b7-ae03-117b54dcffcd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:02.170567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdd2cd20-47c8-41b7-ae03-117b54dcffcd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:02.171254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdd2cd20-47c8-41b7-ae03-117b54dcffcd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:02.171711 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdd2cd20-47c8-41b7-ae03-117b54dcffcd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:02.172226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdd2cd20-47c8-41b7-ae03-117b54dcffcd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:02.309350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fdd2cd20-47c8-41b7-ae03-117b54dcffcd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:19:02.317718 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fdd2cd20-47c8-41b7-ae03-117b54dcffcd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.159490 Aug 23 19:19:02.318289 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3916/7968] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:19:02 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:19:03.341502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-62db437d-8e62-41b4-a3b5-3c1064b8c209 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:19:03.342126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-62db437d-8e62-41b4-a3b5-3c1064b8c209 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:19:03.349515 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62db437d-8e62-41b4-a3b5-3c1064b8c209 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:03.350008 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62db437d-8e62-41b4-a3b5-3c1064b8c209 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:03.350455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62db437d-8e62-41b4-a3b5-3c1064b8c209 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:03.351179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62db437d-8e62-41b4-a3b5-3c1064b8c209 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:03.351652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62db437d-8e62-41b4-a3b5-3c1064b8c209 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:03.352090 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-62db437d-8e62-41b4-a3b5-3c1064b8c209 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:03.488058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-62db437d-8e62-41b4-a3b5-3c1064b8c209 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:19:03.495973 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-62db437d-8e62-41b4-a3b5-3c1064b8c209 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.159082 Aug 23 19:19:03.496548 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4053/7969] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:19:03 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:19:04.519107 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7d8b9581-ff32-4eb4-bc00-1e50aca994d3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:19:04.519725 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7d8b9581-ff32-4eb4-bc00-1e50aca994d3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:19:04.527009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d8b9581-ff32-4eb4-bc00-1e50aca994d3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:04.527534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d8b9581-ff32-4eb4-bc00-1e50aca994d3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:04.527979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d8b9581-ff32-4eb4-bc00-1e50aca994d3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:04.528698 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d8b9581-ff32-4eb4-bc00-1e50aca994d3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:04.529156 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d8b9581-ff32-4eb4-bc00-1e50aca994d3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:04.529590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7d8b9581-ff32-4eb4-bc00-1e50aca994d3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:04.661357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7d8b9581-ff32-4eb4-bc00-1e50aca994d3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:19:04.669186 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7d8b9581-ff32-4eb4-bc00-1e50aca994d3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.154472 Aug 23 19:19:04.669756 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3917/7970] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:19:04 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:19:05.691426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a058d33b-3f10-4e82-8005-8b6452719389 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:19:05.692061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a058d33b-3f10-4e82-8005-8b6452719389 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:19:05.698957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a058d33b-3f10-4e82-8005-8b6452719389 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:05.699460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a058d33b-3f10-4e82-8005-8b6452719389 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:05.699918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a058d33b-3f10-4e82-8005-8b6452719389 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:05.700632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a058d33b-3f10-4e82-8005-8b6452719389 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:05.701108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a058d33b-3f10-4e82-8005-8b6452719389 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:05.701550 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a058d33b-3f10-4e82-8005-8b6452719389 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:05.842468 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a058d33b-3f10-4e82-8005-8b6452719389 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:19:05.851016 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a058d33b-3f10-4e82-8005-8b6452719389 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.163513 Aug 23 19:19:05.851603 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4054/7971] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:19:05 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:19:06.873265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7a9ad45f-5cef-45ea-8c86-7072fbaa22e7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:19:06.873822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7a9ad45f-5cef-45ea-8c86-7072fbaa22e7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:19:06.881452 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9ad45f-5cef-45ea-8c86-7072fbaa22e7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:06.881929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9ad45f-5cef-45ea-8c86-7072fbaa22e7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:06.882361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9ad45f-5cef-45ea-8c86-7072fbaa22e7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:06.883071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9ad45f-5cef-45ea-8c86-7072fbaa22e7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:06.883523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9ad45f-5cef-45ea-8c86-7072fbaa22e7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:06.884198 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7a9ad45f-5cef-45ea-8c86-7072fbaa22e7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:07.021092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7a9ad45f-5cef-45ea-8c86-7072fbaa22e7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:19:07.028810 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7a9ad45f-5cef-45ea-8c86-7072fbaa22e7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1692 microversion: 2.1 time: 0.159511 Aug 23 19:19:07.029391 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3918/7972] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:19:06 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1692 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:19:08.051043 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-70635173-c0a1-4cff-87d0-950dbc36c23c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:19:08.051700 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-70635173-c0a1-4cff-87d0-950dbc36c23c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:19:08.058502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70635173-c0a1-4cff-87d0-950dbc36c23c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:08.059038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70635173-c0a1-4cff-87d0-950dbc36c23c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:08.059493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70635173-c0a1-4cff-87d0-950dbc36c23c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:08.060215 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70635173-c0a1-4cff-87d0-950dbc36c23c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:08.060686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70635173-c0a1-4cff-87d0-950dbc36c23c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:08.061135 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70635173-c0a1-4cff-87d0-950dbc36c23c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:08.192793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-70635173-c0a1-4cff-87d0-950dbc36c23c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:19:08.200640 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-70635173-c0a1-4cff-87d0-950dbc36c23c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1669 microversion: 2.1 time: 0.154221 Aug 23 19:19:08.201207 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4055/7973] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:19:08 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:19:09.292951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-35452d88-e695-4dd7-9c17-a8d4d211ac94 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:19:09.295060 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-35452d88-e695-4dd7-9c17-a8d4d211ac94 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:19:09.301879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35452d88-e695-4dd7-9c17-a8d4d211ac94 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:09.302358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35452d88-e695-4dd7-9c17-a8d4d211ac94 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:09.302844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35452d88-e695-4dd7-9c17-a8d4d211ac94 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:09.303531 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35452d88-e695-4dd7-9c17-a8d4d211ac94 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:09.303985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35452d88-e695-4dd7-9c17-a8d4d211ac94 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:09.304406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-35452d88-e695-4dd7-9c17-a8d4d211ac94 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:09.356392 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-35452d88-e695-4dd7-9c17-a8d4d211ac94 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04/action" status: 200 len: 35578 microversion: 2.1 time: 0.067243 Aug 23 19:19:09.357050 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3919/7974] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:19:09 2022] POST /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04/action => generated 35578 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:19:09.368754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f20b073f-221e-41b9-ab7c-2540c69232f9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:19:09.376196 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f20b073f-221e-41b9-ab7c-2540c69232f9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:09.376756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f20b073f-221e-41b9-ab7c-2540c69232f9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:09.377213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f20b073f-221e-41b9-ab7c-2540c69232f9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:09.399623 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f20b073f-221e-41b9-ab7c-2540c69232f9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Going to try to start instance {{(pid=128808) start /opt/stack/nova/nova/compute/api.py:2772}} Aug 23 19:19:09.444414 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f20b073f-221e-41b9-ab7c-2540c69232f9 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04/action" status: 202 len: 0 microversion: 2.1 time: 0.079386 Aug 23 19:19:09.445045 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4056/7975] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:19:09 2022] POST /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:19:09.454683 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-aa67c112-8586-4596-9649-3b0df9ea9b52 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:19:09.455384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-aa67c112-8586-4596-9649-3b0df9ea9b52 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:19:09.462483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa67c112-8586-4596-9649-3b0df9ea9b52 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:09.462997 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa67c112-8586-4596-9649-3b0df9ea9b52 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:09.463453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa67c112-8586-4596-9649-3b0df9ea9b52 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:09.464185 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa67c112-8586-4596-9649-3b0df9ea9b52 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:09.464623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa67c112-8586-4596-9649-3b0df9ea9b52 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:09.465050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-aa67c112-8586-4596-9649-3b0df9ea9b52 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:09.611740 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-aa67c112-8586-4596-9649-3b0df9ea9b52 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:19:09.620130 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-aa67c112-8586-4596-9649-3b0df9ea9b52 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1678 microversion: 2.1 time: 0.170408 Aug 23 19:19:09.620718 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3920/7976] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:19:09 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:19:10.643439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e2af17f7-8895-4c8b-943c-b78bd4438937 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:19:10.644176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e2af17f7-8895-4c8b-943c-b78bd4438937 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:19:10.651314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2af17f7-8895-4c8b-943c-b78bd4438937 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:10.651831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2af17f7-8895-4c8b-943c-b78bd4438937 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:10.652294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2af17f7-8895-4c8b-943c-b78bd4438937 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:10.653018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2af17f7-8895-4c8b-943c-b78bd4438937 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:10.653495 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2af17f7-8895-4c8b-943c-b78bd4438937 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:10.653943 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e2af17f7-8895-4c8b-943c-b78bd4438937 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:10.790408 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e2af17f7-8895-4c8b-943c-b78bd4438937 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:19:10.799864 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e2af17f7-8895-4c8b-943c-b78bd4438937 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1682 microversion: 2.1 time: 0.160907 Aug 23 19:19:10.800450 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4057/7977] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:19:10 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:19:21.437344 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:19:21.438580 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:19:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:19:43.026271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7672dba9-6df8-4fcd-9a30-5e46f966006d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:19:43.028479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7672dba9-6df8-4fcd-9a30-5e46f966006d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:19:43.031217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=18 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:19:43.031878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=52 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:19:43.038362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7672dba9-6df8-4fcd-9a30-5e46f966006d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:43.038876 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7672dba9-6df8-4fcd-9a30-5e46f966006d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:43.039320 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7672dba9-6df8-4fcd-9a30-5e46f966006d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:43.040023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7672dba9-6df8-4fcd-9a30-5e46f966006d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:19:43.040481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7672dba9-6df8-4fcd-9a30-5e46f966006d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:19:43.040909 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7672dba9-6df8-4fcd-9a30-5e46f966006d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:19:43.097755 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7672dba9-6df8-4fcd-9a30-5e46f966006d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04/action" status: 200 len: 60139 microversion: 2.1 time: 0.075026 Aug 23 19:19:43.098511 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3921/7978] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:19:43 2022] POST /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04/action => generated 60139 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:20:07.256282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ab503b00-22d3-4099-a888-e7f18de42c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:07.256838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab503b00-22d3-4099-a888-e7f18de42c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:07.259389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=20 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:20:07.260041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-f94c6428-8ed4-4b60-a211-a1d63a785b63 req-ce995cc7-b9c6-4a27-9c78-bfb117b81f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07e2fb18-700b-4f2e-90da-c418d64f8b04", "tag": "7a3ecc2b-8f36-4885-a335-8de425fec79e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:20:07.260874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:20:07.267071 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab503b00-22d3-4099-a888-e7f18de42c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:07.267634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab503b00-22d3-4099-a888-e7f18de42c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:07.268071 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:20:07.268348 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab503b00-22d3-4099-a888-e7f18de42c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:07.268854 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=4 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:20:07.269250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab503b00-22d3-4099-a888-e7f18de42c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:07.269711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab503b00-22d3-4099-a888-e7f18de42c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:07.270121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ab503b00-22d3-4099-a888-e7f18de42c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:07.274499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f94c6428-8ed4-4b60-a211-a1d63a785b63 req-ce995cc7-b9c6-4a27-9c78-bfb117b81f2d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:07.275234 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f94c6428-8ed4-4b60-a211-a1d63a785b63 req-ce995cc7-b9c6-4a27-9c78-bfb117b81f2d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:07.275737 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-f94c6428-8ed4-4b60-a211-a1d63a785b63 req-ce995cc7-b9c6-4a27-9c78-bfb117b81f2d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:07.289133 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-f94c6428-8ed4-4b60-a211-a1d63a785b63 req-ce995cc7-b9c6-4a27-9c78-bfb117b81f2d service nova] Creating event network-changed:7a3ecc2b-8f36-4885-a335-8de425fec79e for instance 07e2fb18-700b-4f2e-90da-c418d64f8b04 on n-h2-850468-16 Aug 23 19:20:07.294511 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-f94c6428-8ed4-4b60-a211-a1d63a785b63 req-ce995cc7-b9c6-4a27-9c78-bfb117b81f2d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039468 Aug 23 19:20:07.295538 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3922/7979] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:20:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:20:07.299761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ab503b00-22d3-4099-a888-e7f18de42c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:20:07.385179 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ab503b00-22d3-4099-a888-e7f18de42c71 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "DELETE /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 204 len: 0 microversion: 2.1 time: 0.133242 Aug 23 19:20:07.389402 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4058/7980] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:20:07 2022] DELETE /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:20:07.397717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-e227dae4-7add-4502-ab3c-3e03d644c81f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:07.405951 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-e227dae4-7add-4502-ab3c-3e03d644c81f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:07.415679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e227dae4-7add-4502-ab3c-3e03d644c81f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:07.416400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e227dae4-7add-4502-ab3c-3e03d644c81f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:07.417124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e227dae4-7add-4502-ab3c-3e03d644c81f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:07.418122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e227dae4-7add-4502-ab3c-3e03d644c81f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:07.418865 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e227dae4-7add-4502-ab3c-3e03d644c81f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:07.419533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-e227dae4-7add-4502-ab3c-3e03d644c81f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:07.570214 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-e227dae4-7add-4502-ab3c-3e03d644c81f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:07.578061 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-e227dae4-7add-4502-ab3c-3e03d644c81f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1688 microversion: 2.1 time: 0.185629 Aug 23 19:20:07.578647 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3923/7981] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:07 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:08.600127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3e774058-a0c2-425d-ad4c-8a262140fae5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:08.600846 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3e774058-a0c2-425d-ad4c-8a262140fae5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:08.608385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e774058-a0c2-425d-ad4c-8a262140fae5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:08.609049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e774058-a0c2-425d-ad4c-8a262140fae5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:08.609328 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e774058-a0c2-425d-ad4c-8a262140fae5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:08.610046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e774058-a0c2-425d-ad4c-8a262140fae5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:08.610514 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e774058-a0c2-425d-ad4c-8a262140fae5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:08.610978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3e774058-a0c2-425d-ad4c-8a262140fae5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:08.796374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3e774058-a0c2-425d-ad4c-8a262140fae5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:08.805193 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3e774058-a0c2-425d-ad4c-8a262140fae5 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1688 microversion: 2.1 time: 0.209904 Aug 23 19:20:08.805777 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4059/7982] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:08 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1688 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:09.477987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-49a5ee87-a1c2-4f9f-a011-794d62c18571 req-96bc536a-de10-4907-a0e6-4f0b6b03ff05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07e2fb18-700b-4f2e-90da-c418d64f8b04", "name": "network-vif-deleted", "tag": "7a3ecc2b-8f36-4885-a335-8de425fec79e"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:20:09.489018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-49a5ee87-a1c2-4f9f-a011-794d62c18571 req-96bc536a-de10-4907-a0e6-4f0b6b03ff05 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:09.489494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-49a5ee87-a1c2-4f9f-a011-794d62c18571 req-96bc536a-de10-4907-a0e6-4f0b6b03ff05 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:09.489918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-49a5ee87-a1c2-4f9f-a011-794d62c18571 req-96bc536a-de10-4907-a0e6-4f0b6b03ff05 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:09.501597 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-49a5ee87-a1c2-4f9f-a011-794d62c18571 req-96bc536a-de10-4907-a0e6-4f0b6b03ff05 service nova] Creating event network-vif-deleted:7a3ecc2b-8f36-4885-a335-8de425fec79e for instance 07e2fb18-700b-4f2e-90da-c418d64f8b04 on n-h2-850468-16 Aug 23 19:20:09.506912 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-49a5ee87-a1c2-4f9f-a011-794d62c18571 req-96bc536a-de10-4907-a0e6-4f0b6b03ff05 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032367 Aug 23 19:20:09.507591 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3924/7983] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:20:09.827187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:09.827823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:09.834898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:09.835410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:09.836110 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:09.836839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:09.837521 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:09.837973 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:09.874131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:09.875115 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:09.875806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:09.876517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lazy-loading 'fault' on Instance uuid 07e2fb18-700b-4f2e-90da-c418d64f8b04 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:20:09.929205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:09.937462 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7adb42e0-8d90-41d5-9363-81f293dd0c0a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 200 len: 1356 microversion: 2.1 time: 0.114208 Aug 23 19:20:09.938044 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4060/7984] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:09 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 1356 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:10.961597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ce398f75-5fa9-43ed-9b2a-e328b82e7afc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:10.962306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ce398f75-5fa9-43ed-9b2a-e328b82e7afc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 07e2fb18-700b-4f2e-90da-c418d64f8b04] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:10.968502 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce398f75-5fa9-43ed-9b2a-e328b82e7afc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:10.968982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce398f75-5fa9-43ed-9b2a-e328b82e7afc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:10.969416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce398f75-5fa9-43ed-9b2a-e328b82e7afc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:10.970104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce398f75-5fa9-43ed-9b2a-e328b82e7afc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:10.970916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce398f75-5fa9-43ed-9b2a-e328b82e7afc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:10.972051 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ce398f75-5fa9-43ed-9b2a-e328b82e7afc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:10.985903 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-ce398f75-5fa9-43ed-9b2a-e328b82e7afc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] HTTP exception thrown: Instance 07e2fb18-700b-4f2e-90da-c418d64f8b04 could not be found. Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ce398f75-5fa9-43ed-9b2a-e328b82e7afc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Request method failure captured: Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 HTTP/1.1 Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSYnx1WT4Gq2W98xrb4v7A_NZEqhPSI9Nnx0JtMEtpxu6ASOeeNPsAUHO7NTkLBeC-b0QKnbzfLy_iy-WFwk6pin00WncrZMV-1kc-S_LC8OXBre2xGrhEMDXxk9aYiPr88-JSsp-T-qo3q5YV-u1YQ_T_pJ5tOz5fWaqLFzc6WKr6Y Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: 7b28c141b95b4205a6557e8d9a7fc07a Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b28c141b95b4205a6557e8d9a7fc07a"}]}] Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: 7b28c141b95b4205a6557e8d9a7fc07a Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestNetworkAdvancedServerOps-267656723-project Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 2887d531d5a9449c9cb350a5b1dd73d2 Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestNetworkAdvancedServerOps-267656723-project Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 07e2fb18-700b-4f2e-90da-c418d64f8b04 could not be found. Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '07e2fb18-700b-4f2e-90da-c418d64f8b04'} Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07e2fb18-700b-4f2e-90da-c418d64f8b04 could not be found. Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07e2fb18-700b-4f2e-90da-c418d64f8b04 could not be found. Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:20:10.987923 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:20:10.992953 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:20:10.992953 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:20:10.992953 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:20:10.992953 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:20:10.992953 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:20:10.992953 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:20:10.992953 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07e2fb18-700b-4f2e-90da-c418d64f8b04 could not be found. Aug 23 19:20:10.992953 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:20:10.992953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ce398f75-5fa9-43ed-9b2a-e328b82e7afc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Returning 404 to user: Instance 07e2fb18-700b-4f2e-90da-c418d64f8b04 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:20:10.992953 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ce398f75-5fa9-43ed-9b2a-e328b82e7afc tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04" status: 404 len: 111 microversion: 2.1 time: 0.033838 Aug 23 19:20:10.992953 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3925/7985] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:10 2022] GET /compute/v2.1/servers/07e2fb18-700b-4f2e-90da-c418d64f8b04 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:20:14.018812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2dd141b5-7bb6-46bd-a95b-9d4047becaca tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '.version_select at 0x7f27ec82b940>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:14.040299 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2dd141b5-7bb6-46bd-a95b-9d4047becaca tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-755837785" status: 202 len: 0 microversion: 2.1 time: 0.025682 Aug 23 19:20:14.040903 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4061/7986] 10.222.0.61 () {58 vars in 1281 bytes} [Tue Aug 23 19:20:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-755837785 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:20:14.077961 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-98a344f0-9306-4e0b-a267-c93a174428c2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'create', calling method: .version_select at 0x7f27df69fca0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-679897525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1I9t9UwFoHT+N1BwzVIDmygOfnsnZcRYrEGMPydvsNLfI8iwuf4v+scR0TJ/mkd/qPKD5XFg1qwthKFE86JqXifZjxMJXTeSe1d4COOuWOTfbAV65xOqYVkZBW8dDMLA=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:20:14.097774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-98a344f0-9306-4e0b-a267-c93a174428c2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:20:14.102896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-98a344f0-9306-4e0b-a267-c93a174428c2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for user 2887d531d5a9449c9cb350a5b1dd73d2 and project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:20:14.127110 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-98a344f0-9306-4e0b-a267-c93a174428c2 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.052923 Aug 23 19:20:14.128359 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3926/7987] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 19:20:14 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:20:19.766802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1813685947", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "networks": [{"uuid": "bb1e80c3-59b0-41ba-80a0-cfb9ff9d2a43"}], "key_name": "tempest-TestNetworkAdvancedServerOps-679897525", "security_groups": [{"name": "tempest-secgroup-smoke-1411800101"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:20:19.893011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] validate_networks() for [('bb1e80c3-59b0-41ba-80a0-cfb9ff9d2a43', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:20:19.934327 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:20:20.681481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:20:20.682030 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:20:20.682647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:20:20.683147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:20:20.683677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:20:20.693895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:20.694497 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:20.695082 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:20.695893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:20.696438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:20.696957 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:20.714836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:20:20.720209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Getting quotas for user 2887d531d5a9449c9cb350a5b1dd73d2 and project 7b28c141b95b4205a6557e8d9a7fc07a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:20:20.732889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:20:20.735256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:20:20.785634 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-50ca41ca-25cb-43cf-9b26-721732f0fd63 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.024348 Aug 23 19:20:20.786691 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4062/7988] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:20:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 1026 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:20:20.797134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5c11ccbf-4d4d-4468-b007-91a531f0465a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:20.798340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5c11ccbf-4d4d-4468-b007-91a531f0465a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:20.861769 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5c11ccbf-4d4d-4468-b007-91a531f0465a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:20.870941 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5c11ccbf-4d4d-4468-b007-91a531f0465a tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1266 microversion: 2.1 time: 0.077524 Aug 23 19:20:20.871558 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3927/7989] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:20 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1266 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:20:21.894366 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0f486753-d2fb-4d9e-80b6-95331bad9bbb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:21.895351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0f486753-d2fb-4d9e-80b6-95331bad9bbb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:21.907720 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f486753-d2fb-4d9e-80b6-95331bad9bbb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:21.908232 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f486753-d2fb-4d9e-80b6-95331bad9bbb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:21.908790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f486753-d2fb-4d9e-80b6-95331bad9bbb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:21.909458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f486753-d2fb-4d9e-80b6-95331bad9bbb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:21.909938 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f486753-d2fb-4d9e-80b6-95331bad9bbb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:21.910461 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0f486753-d2fb-4d9e-80b6-95331bad9bbb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:22.012245 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0f486753-d2fb-4d9e-80b6-95331bad9bbb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:22.027793 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0f486753-d2fb-4d9e-80b6-95331bad9bbb tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1326 microversion: 2.1 time: 0.138353 Aug 23 19:20:22.042566 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4063/7990] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:21 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1326 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:23.051816 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-565af706-61d6-48a2-9145-c11746193e6d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:23.052956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-565af706-61d6-48a2-9145-c11746193e6d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:23.055418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=12 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:20:23.064063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-565af706-61d6-48a2-9145-c11746193e6d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:23.064572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-565af706-61d6-48a2-9145-c11746193e6d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:23.066100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-565af706-61d6-48a2-9145-c11746193e6d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:23.067041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-565af706-61d6-48a2-9145-c11746193e6d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:23.067501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-565af706-61d6-48a2-9145-c11746193e6d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:23.067929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-565af706-61d6-48a2-9145-c11746193e6d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:23.201362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-565af706-61d6-48a2-9145-c11746193e6d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:23.210009 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-565af706-61d6-48a2-9145-c11746193e6d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1392 microversion: 2.1 time: 0.163162 Aug 23 19:20:23.210609 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3928/7991] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:23 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:23.425124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-09d6e21a-4a9a-492a-bb5c-a79c5498bbc5 req-3fd165c0-5927-4e96-a3a7-8c056feda3b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5df92002-3b67-4a7e-a63f-7aec16b7d699", "tag": "059358df-425d-4e8b-8566-73ff33d4ba02"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:20:23.442684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-09d6e21a-4a9a-492a-bb5c-a79c5498bbc5 req-3fd165c0-5927-4e96-a3a7-8c056feda3b3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:23.443107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-09d6e21a-4a9a-492a-bb5c-a79c5498bbc5 req-3fd165c0-5927-4e96-a3a7-8c056feda3b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:23.443744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-09d6e21a-4a9a-492a-bb5c-a79c5498bbc5 req-3fd165c0-5927-4e96-a3a7-8c056feda3b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:23.457243 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-09d6e21a-4a9a-492a-bb5c-a79c5498bbc5 req-3fd165c0-5927-4e96-a3a7-8c056feda3b3 service nova] Creating event network-changed:059358df-425d-4e8b-8566-73ff33d4ba02 for instance 5df92002-3b67-4a7e-a63f-7aec16b7d699 on n-h2-850468-16 Aug 23 19:20:23.462376 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-09d6e21a-4a9a-492a-bb5c-a79c5498bbc5 req-3fd165c0-5927-4e96-a3a7-8c056feda3b3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041017 Aug 23 19:20:23.463035 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4064/7992] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:20:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:20:24.231687 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-705b10b1-734a-4b86-9705-613f250c42e8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:24.232294 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-705b10b1-734a-4b86-9705-613f250c42e8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:24.239483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-705b10b1-734a-4b86-9705-613f250c42e8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:24.239965 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-705b10b1-734a-4b86-9705-613f250c42e8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:24.240402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-705b10b1-734a-4b86-9705-613f250c42e8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:24.241079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-705b10b1-734a-4b86-9705-613f250c42e8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:24.241533 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-705b10b1-734a-4b86-9705-613f250c42e8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:24.241956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-705b10b1-734a-4b86-9705-613f250c42e8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:24.374171 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-705b10b1-734a-4b86-9705-613f250c42e8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:24.382429 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-705b10b1-734a-4b86-9705-613f250c42e8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1392 microversion: 2.1 time: 0.154673 Aug 23 19:20:24.383035 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3929/7993] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:24 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:20:25.405910 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-70495722-6c25-4440-bb27-ae2875722416 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:25.406657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-70495722-6c25-4440-bb27-ae2875722416 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:25.414768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70495722-6c25-4440-bb27-ae2875722416 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:25.415278 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70495722-6c25-4440-bb27-ae2875722416 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:25.415736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70495722-6c25-4440-bb27-ae2875722416 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:25.416452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70495722-6c25-4440-bb27-ae2875722416 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:25.416926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70495722-6c25-4440-bb27-ae2875722416 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:25.417373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-70495722-6c25-4440-bb27-ae2875722416 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:25.550074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-70495722-6c25-4440-bb27-ae2875722416 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:25.558086 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-70495722-6c25-4440-bb27-ae2875722416 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1392 microversion: 2.1 time: 0.157312 Aug 23 19:20:25.558692 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4065/7994] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:25 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:26.579828 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9fffe0e3-91ef-488d-a584-52c4cf00018d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:26.580447 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9fffe0e3-91ef-488d-a584-52c4cf00018d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:26.587421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fffe0e3-91ef-488d-a584-52c4cf00018d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:26.587908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fffe0e3-91ef-488d-a584-52c4cf00018d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:26.588349 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fffe0e3-91ef-488d-a584-52c4cf00018d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:26.589040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fffe0e3-91ef-488d-a584-52c4cf00018d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:26.589525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fffe0e3-91ef-488d-a584-52c4cf00018d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:26.589958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9fffe0e3-91ef-488d-a584-52c4cf00018d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:26.725994 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9fffe0e3-91ef-488d-a584-52c4cf00018d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:26.733859 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9fffe0e3-91ef-488d-a584-52c4cf00018d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1392 microversion: 2.1 time: 0.157949 Aug 23 19:20:26.734427 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3930/7995] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:26 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:27.755363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7ed153b6-a565-415f-a401-f6d026d0c0bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:27.755995 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7ed153b6-a565-415f-a401-f6d026d0c0bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:27.763130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ed153b6-a565-415f-a401-f6d026d0c0bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:27.763634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ed153b6-a565-415f-a401-f6d026d0c0bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:27.764085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ed153b6-a565-415f-a401-f6d026d0c0bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:27.764795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ed153b6-a565-415f-a401-f6d026d0c0bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:27.765264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ed153b6-a565-415f-a401-f6d026d0c0bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:27.765704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7ed153b6-a565-415f-a401-f6d026d0c0bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:27.905703 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7ed153b6-a565-415f-a401-f6d026d0c0bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:27.913468 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7ed153b6-a565-415f-a401-f6d026d0c0bd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1392 microversion: 2.1 time: 0.162306 Aug 23 19:20:27.914036 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4066/7996] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:27 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:28.934440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-adf7b003-fd1d-489f-bdef-83cc744c23f8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:28.935127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-adf7b003-fd1d-489f-bdef-83cc744c23f8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:28.943085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adf7b003-fd1d-489f-bdef-83cc744c23f8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:28.943567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adf7b003-fd1d-489f-bdef-83cc744c23f8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:28.944003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adf7b003-fd1d-489f-bdef-83cc744c23f8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:28.944689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adf7b003-fd1d-489f-bdef-83cc744c23f8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:28.945141 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adf7b003-fd1d-489f-bdef-83cc744c23f8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:28.945571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-adf7b003-fd1d-489f-bdef-83cc744c23f8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:29.085135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-adf7b003-fd1d-489f-bdef-83cc744c23f8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:29.092777 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-adf7b003-fd1d-489f-bdef-83cc744c23f8 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1392 microversion: 2.1 time: 0.162163 Aug 23 19:20:29.093876 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3931/7997] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:28 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:29.185915 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4795e951-8e00-4d62-82f8-d26c1f3c6b49 req-5af4f1b5-c92d-4484-954a-412d2c8acc63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5df92002-3b67-4a7e-a63f-7aec16b7d699", "name": "network-vif-plugged", "status": "completed", "tag": "059358df-425d-4e8b-8566-73ff33d4ba02"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:20:29.195745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4795e951-8e00-4d62-82f8-d26c1f3c6b49 req-5af4f1b5-c92d-4484-954a-412d2c8acc63 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:29.196237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4795e951-8e00-4d62-82f8-d26c1f3c6b49 req-5af4f1b5-c92d-4484-954a-412d2c8acc63 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:29.196838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4795e951-8e00-4d62-82f8-d26c1f3c6b49 req-5af4f1b5-c92d-4484-954a-412d2c8acc63 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:29.208214 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4795e951-8e00-4d62-82f8-d26c1f3c6b49 req-5af4f1b5-c92d-4484-954a-412d2c8acc63 service nova] Creating event network-vif-plugged:059358df-425d-4e8b-8566-73ff33d4ba02 for instance 5df92002-3b67-4a7e-a63f-7aec16b7d699 on n-h2-850468-16 Aug 23 19:20:29.213673 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4795e951-8e00-4d62-82f8-d26c1f3c6b49 req-5af4f1b5-c92d-4484-954a-412d2c8acc63 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094814 Aug 23 19:20:29.214296 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4067/7998] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:20:30.115440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d33b52c2-89e9-45d6-9fe3-1af50959190c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:30.115962 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d33b52c2-89e9-45d6-9fe3-1af50959190c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:30.122750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d33b52c2-89e9-45d6-9fe3-1af50959190c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:30.123344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d33b52c2-89e9-45d6-9fe3-1af50959190c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:30.123780 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d33b52c2-89e9-45d6-9fe3-1af50959190c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:30.124462 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d33b52c2-89e9-45d6-9fe3-1af50959190c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:30.124918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d33b52c2-89e9-45d6-9fe3-1af50959190c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:30.125342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d33b52c2-89e9-45d6-9fe3-1af50959190c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:30.260537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d33b52c2-89e9-45d6-9fe3-1af50959190c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:30.270219 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d33b52c2-89e9-45d6-9fe3-1af50959190c tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1392 microversion: 2.1 time: 0.159058 Aug 23 19:20:30.271048 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3932/7999] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:30 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1392 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:31.290167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:20:31.290988 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:20:31.295085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c3449e32-e633-4dca-acab-8731686b3e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:31.295819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c3449e32-e633-4dca-acab-8731686b3e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:31.303300 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3449e32-e633-4dca-acab-8731686b3e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:31.303806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3449e32-e633-4dca-acab-8731686b3e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:31.304262 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3449e32-e633-4dca-acab-8731686b3e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:31.304979 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3449e32-e633-4dca-acab-8731686b3e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:31.305454 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3449e32-e633-4dca-acab-8731686b3e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:31.305898 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3449e32-e633-4dca-acab-8731686b3e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:31.437512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c3449e32-e633-4dca-acab-8731686b3e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:31.445355 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c3449e32-e633-4dca-acab-8731686b3e27 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1564 microversion: 2.1 time: 0.156983 Aug 23 19:20:31.445923 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4068/8000] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:31 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:31.465956 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c3a3b000-aac3-4841-836d-e28c752fc2fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:31.466604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c3a3b000-aac3-4841-836d-e28c752fc2fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:31.468515 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:20:31.475094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3a3b000-aac3-4841-836d-e28c752fc2fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:31.475595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3a3b000-aac3-4841-836d-e28c752fc2fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:31.476024 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3a3b000-aac3-4841-836d-e28c752fc2fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:31.477344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3a3b000-aac3-4841-836d-e28c752fc2fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:31.477820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3a3b000-aac3-4841-836d-e28c752fc2fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:31.478253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c3a3b000-aac3-4841-836d-e28c752fc2fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:31.615751 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c3a3b000-aac3-4841-836d-e28c752fc2fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:31.623647 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c3a3b000-aac3-4841-836d-e28c752fc2fd tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1564 microversion: 2.1 time: 0.161568 Aug 23 19:20:31.624268 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3933/8001] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:31 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1564 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:33.604044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-085e859e-1c93-41ba-87d7-62d7449b1f65 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:20:33.605493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-085e859e-1c93-41ba-87d7-62d7449b1f65 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:20:33.614079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-085e859e-1c93-41ba-87d7-62d7449b1f65 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:33.614843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-085e859e-1c93-41ba-87d7-62d7449b1f65 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:33.615518 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-085e859e-1c93-41ba-87d7-62d7449b1f65 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:33.616417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-085e859e-1c93-41ba-87d7-62d7449b1f65 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:33.617074 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-085e859e-1c93-41ba-87d7-62d7449b1f65 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:33.617678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-085e859e-1c93-41ba-87d7-62d7449b1f65 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:33.770655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-55a4f229-dc44-42c4-a1f9-d1c77dc8dded req-fdf817da-e9a7-4c2b-aa0f-ab639095f021 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5df92002-3b67-4a7e-a63f-7aec16b7d699", "tag": "059358df-425d-4e8b-8566-73ff33d4ba02"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:20:33.771659 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-085e859e-1c93-41ba-87d7-62d7449b1f65 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:20:33.780042 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-085e859e-1c93-41ba-87d7-62d7449b1f65 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1564 microversion: 2.1 time: 0.182639 Aug 23 19:20:33.780393 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-55a4f229-dc44-42c4-a1f9-d1c77dc8dded req-fdf817da-e9a7-4c2b-aa0f-ab639095f021 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:20:33.782591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-55a4f229-dc44-42c4-a1f9-d1c77dc8dded req-fdf817da-e9a7-4c2b-aa0f-ab639095f021 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:20:33.782808 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4069/8002] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:20:33 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1564 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:20:33.782903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-55a4f229-dc44-42c4-a1f9-d1c77dc8dded req-fdf817da-e9a7-4c2b-aa0f-ab639095f021 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:20:33.794920 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-55a4f229-dc44-42c4-a1f9-d1c77dc8dded req-fdf817da-e9a7-4c2b-aa0f-ab639095f021 service nova] Creating event network-changed:059358df-425d-4e8b-8566-73ff33d4ba02 for instance 5df92002-3b67-4a7e-a63f-7aec16b7d699 on n-h2-850468-16 Aug 23 19:20:33.801332 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-55a4f229-dc44-42c4-a1f9-d1c77dc8dded req-fdf817da-e9a7-4c2b-aa0f-ab639095f021 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.198526 Aug 23 19:20:33.801957 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3934/8003] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:20:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:21:05.079965 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-28087145-279c-4a7c-9941-adb2be75a433 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:21:05.082248 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-28087145-279c-4a7c-9941-adb2be75a433 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:05.084630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:21:05.085294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=36 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:21:05.093045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28087145-279c-4a7c-9941-adb2be75a433 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:05.093619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28087145-279c-4a7c-9941-adb2be75a433 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:05.094077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28087145-279c-4a7c-9941-adb2be75a433 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:05.094826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28087145-279c-4a7c-9941-adb2be75a433 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:05.095294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28087145-279c-4a7c-9941-adb2be75a433 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:05.095730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-28087145-279c-4a7c-9941-adb2be75a433 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:05.155830 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-28087145-279c-4a7c-9941-adb2be75a433 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699/action" status: 200 len: 24572 microversion: 2.1 time: 0.079346 Aug 23 19:21:05.156565 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4070/8004] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:21:05 2022] POST /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699/action => generated 24572 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:21:44.210221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:21:44.211639 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=38 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:21:44.216863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-de341cc7-3e02-47d4-986a-a0a33dbe545b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:21:44.217499 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-de341cc7-3e02-47d4-986a-a0a33dbe545b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:44.225260 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de341cc7-3e02-47d4-986a-a0a33dbe545b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:44.225903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de341cc7-3e02-47d4-986a-a0a33dbe545b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:44.226351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de341cc7-3e02-47d4-986a-a0a33dbe545b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:44.227087 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de341cc7-3e02-47d4-986a-a0a33dbe545b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:44.227553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de341cc7-3e02-47d4-986a-a0a33dbe545b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:44.227989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-de341cc7-3e02-47d4-986a-a0a33dbe545b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:44.251744 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-de341cc7-3e02-47d4-986a-a0a33dbe545b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lazy-loading 'flavor' on Instance uuid 5df92002-3b67-4a7e-a63f-7aec16b7d699 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:21:44.316680 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-de341cc7-3e02-47d4-986a-a0a33dbe545b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699/action" status: 202 len: 0 microversion: 2.1 time: 0.109172 Aug 23 19:21:44.317311 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3935/8005] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:21:44 2022] POST /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:21:44.327642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5563bdbc-7d67-47da-85ba-e6b7326003d0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:21:44.328375 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5563bdbc-7d67-47da-85ba-e6b7326003d0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:44.331133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:21:44.331792 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:21:44.338062 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5563bdbc-7d67-47da-85ba-e6b7326003d0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:44.338675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5563bdbc-7d67-47da-85ba-e6b7326003d0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:44.339475 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5563bdbc-7d67-47da-85ba-e6b7326003d0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:44.340198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5563bdbc-7d67-47da-85ba-e6b7326003d0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:44.340667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5563bdbc-7d67-47da-85ba-e6b7326003d0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:44.341108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5563bdbc-7d67-47da-85ba-e6b7326003d0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:44.523121 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5563bdbc-7d67-47da-85ba-e6b7326003d0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:21:44.531614 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5563bdbc-7d67-47da-85ba-e6b7326003d0 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1690 microversion: 2.1 time: 0.209330 Aug 23 19:21:44.532181 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4071/8006] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:21:44 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1690 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:21:45.556270 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9b91c58c-43a2-4141-a679-e960768e606b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:21:45.556972 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9b91c58c-43a2-4141-a679-e960768e606b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:45.563397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b91c58c-43a2-4141-a679-e960768e606b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:45.563889 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b91c58c-43a2-4141-a679-e960768e606b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:45.564326 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b91c58c-43a2-4141-a679-e960768e606b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:45.565020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b91c58c-43a2-4141-a679-e960768e606b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:45.565474 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b91c58c-43a2-4141-a679-e960768e606b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:45.565898 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b91c58c-43a2-4141-a679-e960768e606b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:45.705987 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9b91c58c-43a2-4141-a679-e960768e606b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:21:45.713735 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9b91c58c-43a2-4141-a679-e960768e606b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1690 microversion: 2.1 time: 0.162574 Aug 23 19:21:45.714297 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3936/8007] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:21:45 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1690 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:21:46.737323 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4b0fcf70-22ef-4c18-bf5f-eb4b62c1ea4f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:21:46.738027 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4b0fcf70-22ef-4c18-bf5f-eb4b62c1ea4f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:46.744482 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b0fcf70-22ef-4c18-bf5f-eb4b62c1ea4f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:46.744986 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b0fcf70-22ef-4c18-bf5f-eb4b62c1ea4f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:46.745438 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b0fcf70-22ef-4c18-bf5f-eb4b62c1ea4f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:46.746146 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b0fcf70-22ef-4c18-bf5f-eb4b62c1ea4f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:46.746639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b0fcf70-22ef-4c18-bf5f-eb4b62c1ea4f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:46.747083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4b0fcf70-22ef-4c18-bf5f-eb4b62c1ea4f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:46.882858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4b0fcf70-22ef-4c18-bf5f-eb4b62c1ea4f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:21:46.891663 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4b0fcf70-22ef-4c18-bf5f-eb4b62c1ea4f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1673 microversion: 2.1 time: 0.159405 Aug 23 19:21:46.892237 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4072/8008] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:21:46 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:21:47.987795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f834c28b-5f96-4262-8bad-e45e6e144721 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:21:47.989988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f834c28b-5f96-4262-8bad-e45e6e144721 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:47.996243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f834c28b-5f96-4262-8bad-e45e6e144721 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:47.996831 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f834c28b-5f96-4262-8bad-e45e6e144721 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:47.997272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f834c28b-5f96-4262-8bad-e45e6e144721 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:47.998633 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f834c28b-5f96-4262-8bad-e45e6e144721 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:47.999097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f834c28b-5f96-4262-8bad-e45e6e144721 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:47.999522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f834c28b-5f96-4262-8bad-e45e6e144721 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:48.050710 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f834c28b-5f96-4262-8bad-e45e6e144721 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699/action" status: 200 len: 38348 microversion: 2.1 time: 0.066796 Aug 23 19:21:48.051359 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3937/8009] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:21:47 2022] POST /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699/action => generated 38348 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:21:48.063826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6121124a-87ab-43cb-832b-ea24629ce92f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:21:48.064389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6121124a-87ab-43cb-832b-ea24629ce92f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:48.071382 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6121124a-87ab-43cb-832b-ea24629ce92f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:48.071900 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6121124a-87ab-43cb-832b-ea24629ce92f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:48.072365 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6121124a-87ab-43cb-832b-ea24629ce92f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:48.073084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6121124a-87ab-43cb-832b-ea24629ce92f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:48.073561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6121124a-87ab-43cb-832b-ea24629ce92f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:48.074013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6121124a-87ab-43cb-832b-ea24629ce92f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:48.140908 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6121124a-87ab-43cb-832b-ea24629ce92f tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699/action" status: 202 len: 0 microversion: 2.1 time: 0.081505 Aug 23 19:21:48.141571 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4073/8010] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:21:48 2022] POST /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:21:48.150963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d67655b1-bb6d-485b-8e11-e441ebc0d8e3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:21:48.151664 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d67655b1-bb6d-485b-8e11-e441ebc0d8e3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:48.159130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d67655b1-bb6d-485b-8e11-e441ebc0d8e3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:48.159671 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d67655b1-bb6d-485b-8e11-e441ebc0d8e3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:48.160124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d67655b1-bb6d-485b-8e11-e441ebc0d8e3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:48.160953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d67655b1-bb6d-485b-8e11-e441ebc0d8e3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:48.161409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d67655b1-bb6d-485b-8e11-e441ebc0d8e3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:48.161826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d67655b1-bb6d-485b-8e11-e441ebc0d8e3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:48.301842 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d67655b1-bb6d-485b-8e11-e441ebc0d8e3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:21:48.309517 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d67655b1-bb6d-485b-8e11-e441ebc0d8e3 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1679 microversion: 2.1 time: 0.162785 Aug 23 19:21:48.310083 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3938/8011] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:21:48 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1679 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:21:49.333619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-685e9414-6e02-4dd5-b828-8fa4c96a3431 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:21:49.334347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-685e9414-6e02-4dd5-b828-8fa4c96a3431 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:49.340652 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-685e9414-6e02-4dd5-b828-8fa4c96a3431 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:49.341158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-685e9414-6e02-4dd5-b828-8fa4c96a3431 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:49.342237 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-685e9414-6e02-4dd5-b828-8fa4c96a3431 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:49.342989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-685e9414-6e02-4dd5-b828-8fa4c96a3431 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:49.343465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-685e9414-6e02-4dd5-b828-8fa4c96a3431 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:49.343912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-685e9414-6e02-4dd5-b828-8fa4c96a3431 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:49.473920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-685e9414-6e02-4dd5-b828-8fa4c96a3431 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:21:49.481750 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-685e9414-6e02-4dd5-b828-8fa4c96a3431 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1679 microversion: 2.1 time: 0.153270 Aug 23 19:21:49.482938 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4074/8012] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:21:49 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:21:50.504182 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-573ba308-1556-4c49-9abd-442752ba1848 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:21:50.504837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-573ba308-1556-4c49-9abd-442752ba1848 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:50.512455 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-573ba308-1556-4c49-9abd-442752ba1848 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:50.512939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-573ba308-1556-4c49-9abd-442752ba1848 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:50.513397 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-573ba308-1556-4c49-9abd-442752ba1848 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:50.514084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-573ba308-1556-4c49-9abd-442752ba1848 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:50.514852 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-573ba308-1556-4c49-9abd-442752ba1848 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:50.515280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-573ba308-1556-4c49-9abd-442752ba1848 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:50.649630 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-573ba308-1556-4c49-9abd-442752ba1848 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:21:50.658146 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-573ba308-1556-4c49-9abd-442752ba1848 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1682 microversion: 2.1 time: 0.157940 Aug 23 19:21:50.658803 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3939/8013] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:21:50 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:21:50.753050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9380d495-3540-47ab-bc6d-4b12f5ef8280 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:21:50.755357 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9380d495-3540-47ab-bc6d-4b12f5ef8280 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:50.762078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9380d495-3540-47ab-bc6d-4b12f5ef8280 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:50.762601 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9380d495-3540-47ab-bc6d-4b12f5ef8280 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:50.763059 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9380d495-3540-47ab-bc6d-4b12f5ef8280 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:50.764233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9380d495-3540-47ab-bc6d-4b12f5ef8280 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:50.764955 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9380d495-3540-47ab-bc6d-4b12f5ef8280 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:50.765400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9380d495-3540-47ab-bc6d-4b12f5ef8280 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:50.814659 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9380d495-3540-47ab-bc6d-4b12f5ef8280 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "POST /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699/action" status: 200 len: 38348 microversion: 2.1 time: 0.065338 Aug 23 19:21:50.815310 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4075/8014] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:21:50 2022] POST /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699/action => generated 38348 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 23 19:21:52.068767 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6c36338c-1dc4-4703-8ef6-bfc743492767 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:21:52.069282 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6c36338c-1dc4-4703-8ef6-bfc743492767 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:52.085713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c36338c-1dc4-4703-8ef6-bfc743492767 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:52.086353 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c36338c-1dc4-4703-8ef6-bfc743492767 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:52.086826 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c36338c-1dc4-4703-8ef6-bfc743492767 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:52.087536 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c36338c-1dc4-4703-8ef6-bfc743492767 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:52.087995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c36338c-1dc4-4703-8ef6-bfc743492767 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:52.088423 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6c36338c-1dc4-4703-8ef6-bfc743492767 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:52.118256 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6c36338c-1dc4-4703-8ef6-bfc743492767 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:21:52.140214 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-248d6554-81af-4758-b3b3-3513b32cf006 req-9ab94817-77ff-4b83-82fb-78cdb60d5d05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5df92002-3b67-4a7e-a63f-7aec16b7d699", "tag": "059358df-425d-4e8b-8566-73ff33d4ba02"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:21:52.153426 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-248d6554-81af-4758-b3b3-3513b32cf006 req-9ab94817-77ff-4b83-82fb-78cdb60d5d05 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:52.155325 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-248d6554-81af-4758-b3b3-3513b32cf006 req-9ab94817-77ff-4b83-82fb-78cdb60d5d05 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:52.156097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-248d6554-81af-4758-b3b3-3513b32cf006 req-9ab94817-77ff-4b83-82fb-78cdb60d5d05 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:52.167948 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-248d6554-81af-4758-b3b3-3513b32cf006 req-9ab94817-77ff-4b83-82fb-78cdb60d5d05 service nova] Creating event network-changed:059358df-425d-4e8b-8566-73ff33d4ba02 for instance 5df92002-3b67-4a7e-a63f-7aec16b7d699 on n-h2-850468-16 Aug 23 19:21:52.173817 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-248d6554-81af-4758-b3b3-3513b32cf006 req-9ab94817-77ff-4b83-82fb-78cdb60d5d05 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101692 Aug 23 19:21:52.174443 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4076/8015] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:21:52.481489 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6c36338c-1dc4-4703-8ef6-bfc743492767 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "DELETE /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 204 len: 0 microversion: 2.1 time: 0.416119 Aug 23 19:21:52.485757 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3940/8016] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:21:52 2022] DELETE /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:21:52.492113 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4df35807-84b3-49b4-b609-55cc39132323 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:21:52.493111 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4df35807-84b3-49b4-b609-55cc39132323 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:52.500025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4df35807-84b3-49b4-b609-55cc39132323 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:52.500528 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4df35807-84b3-49b4-b609-55cc39132323 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:52.500985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4df35807-84b3-49b4-b609-55cc39132323 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:52.501698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4df35807-84b3-49b4-b609-55cc39132323 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:52.502161 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4df35807-84b3-49b4-b609-55cc39132323 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:52.502814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4df35807-84b3-49b4-b609-55cc39132323 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:52.646053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4df35807-84b3-49b4-b609-55cc39132323 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:21:52.654304 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4df35807-84b3-49b4-b609-55cc39132323 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1688 microversion: 2.1 time: 0.166217 Aug 23 19:21:52.655167 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4077/8017] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:21:52 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1688 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:21:53.677681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-237246ed-0120-4cba-b140-f848d879029d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:21:53.678381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-237246ed-0120-4cba-b140-f848d879029d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:53.685805 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-237246ed-0120-4cba-b140-f848d879029d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:53.686304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-237246ed-0120-4cba-b140-f848d879029d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:53.686787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-237246ed-0120-4cba-b140-f848d879029d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:53.687484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-237246ed-0120-4cba-b140-f848d879029d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:53.687946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-237246ed-0120-4cba-b140-f848d879029d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:53.688374 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-237246ed-0120-4cba-b140-f848d879029d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:53.830886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-237246ed-0120-4cba-b140-f848d879029d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:21:53.838716 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-237246ed-0120-4cba-b140-f848d879029d tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1688 microversion: 2.1 time: 0.165223 Aug 23 19:21:53.839281 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3941/8018] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:21:53 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:21:54.650465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-439f515b-541f-4d5f-a67c-9ae855a1fc64 req-5952245f-5f3f-4474-ba92-51ca836ce804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5df92002-3b67-4a7e-a63f-7aec16b7d699", "name": "network-vif-deleted", "tag": "059358df-425d-4e8b-8566-73ff33d4ba02"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:21:54.663277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-439f515b-541f-4d5f-a67c-9ae855a1fc64 req-5952245f-5f3f-4474-ba92-51ca836ce804 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:54.663785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-439f515b-541f-4d5f-a67c-9ae855a1fc64 req-5952245f-5f3f-4474-ba92-51ca836ce804 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:54.664238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-439f515b-541f-4d5f-a67c-9ae855a1fc64 req-5952245f-5f3f-4474-ba92-51ca836ce804 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:54.678637 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-439f515b-541f-4d5f-a67c-9ae855a1fc64 req-5952245f-5f3f-4474-ba92-51ca836ce804 service nova] Creating event network-vif-deleted:059358df-425d-4e8b-8566-73ff33d4ba02 for instance 5df92002-3b67-4a7e-a63f-7aec16b7d699 on n-h2-850468-16 Aug 23 19:21:54.684011 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-439f515b-541f-4d5f-a67c-9ae855a1fc64 req-5952245f-5f3f-4474-ba92-51ca836ce804 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037978 Aug 23 19:21:54.684618 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4078/8019] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:21:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:21:54.862729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:21:54.863271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:54.869267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:54.869755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:54.870196 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:54.870922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:54.871384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:54.871818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:54.903510 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:54.903999 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:54.905200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:54.905970 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lazy-loading 'fault' on Instance uuid 5df92002-3b67-4a7e-a63f-7aec16b7d699 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:21:54.949942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2887d531d5a9449c9cb350a5b1dd73d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7b28c141b95b4205a6557e8d9a7fc07a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:21:54.959423 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-25847a0a-460e-460f-abe3-42cda3bc82b7 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 200 len: 1356 microversion: 2.1 time: 0.102275 Aug 23 19:21:54.960001 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3942/8020] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:21:54 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 1356 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:21:55.981510 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5207963c-39f7-4555-9456-fe8071d1e131 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:21:55.982211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5207963c-39f7-4555-9456-fe8071d1e131 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] [instance: 5df92002-3b67-4a7e-a63f-7aec16b7d699] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:21:55.989494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5207963c-39f7-4555-9456-fe8071d1e131 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:55.989999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5207963c-39f7-4555-9456-fe8071d1e131 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:55.990463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5207963c-39f7-4555-9456-fe8071d1e131 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:55.991208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5207963c-39f7-4555-9456-fe8071d1e131 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:21:55.991686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5207963c-39f7-4555-9456-fe8071d1e131 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:21:55.992137 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5207963c-39f7-4555-9456-fe8071d1e131 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:21:56.005693 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-5207963c-39f7-4555-9456-fe8071d1e131 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] HTTP exception thrown: Instance 5df92002-3b67-4a7e-a63f-7aec16b7d699 could not be found. Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5207963c-39f7-4555-9456-fe8071d1e131 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Request method failure captured: Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 HTTP/1.1 Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSYnx1WT4Gq2W98xrb4v7A_NZEqhPSI9Nnx0JtMEtpxu6ASOeeNPsAUHO7NTkLBeC-b0QKnbzfLy_iy-WFwk6pin00WncrZMV-1kc-S_LC8OXBre2xGrhEMDXxk9aYiPr88-JSsp-T-qo3q5YV-u1YQ_T_pJ5tOz5fWaqLFzc6WKr6Y Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: 7b28c141b95b4205a6557e8d9a7fc07a Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/7b28c141b95b4205a6557e8d9a7fc07a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/7b28c141b95b4205a6557e8d9a7fc07a"}]}] Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: 7b28c141b95b4205a6557e8d9a7fc07a Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-267656723 Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestNetworkAdvancedServerOps-267656723-project Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 2887d531d5a9449c9cb350a5b1dd73d2 Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestNetworkAdvancedServerOps-267656723-project Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 5df92002-3b67-4a7e-a63f-7aec16b7d699 could not be found. Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '5df92002-3b67-4a7e-a63f-7aec16b7d699'} Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5df92002-3b67-4a7e-a63f-7aec16b7d699 could not be found. Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5df92002-3b67-4a7e-a63f-7aec16b7d699 could not be found. Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:21:56.007380 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:21:56.012019 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:21:56.012019 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:21:56.012019 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:21:56.012019 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:21:56.012019 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:21:56.012019 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:21:56.012019 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5df92002-3b67-4a7e-a63f-7aec16b7d699 could not be found. Aug 23 19:21:56.012019 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:21:56.012019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5207963c-39f7-4555-9456-fe8071d1e131 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Returning 404 to user: Instance 5df92002-3b67-4a7e-a63f-7aec16b7d699 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:21:56.012019 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5207963c-39f7-4555-9456-fe8071d1e131 tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699" status: 404 len: 111 microversion: 2.1 time: 0.031701 Aug 23 19:21:56.012019 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4079/8021] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:21:55 2022] GET /compute/v2.1/servers/5df92002-3b67-4a7e-a63f-7aec16b7d699 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:21:59.027352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8b5f9b97-3968-4ede-abcc-72b4d1b5203b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] Calling method '.version_select at 0x7f27df510670>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:21:59.052140 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8b5f9b97-3968-4ede-abcc-72b4d1b5203b tempest-TestNetworkAdvancedServerOps-267656723 tempest-TestNetworkAdvancedServerOps-267656723-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-679897525" status: 202 len: 0 microversion: 2.1 time: 0.032324 Aug 23 19:21:59.052721 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3943/8022] 10.222.0.61 () {58 vars in 1281 bytes} [Tue Aug 23 19:21:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-679897525 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:22:10.116920 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=18 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:22:10.117675 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:22:10.296496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6104587e-d4dd-4440-93e8-2ed6ce3866cf tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Action: 'create', calling method: .version_select at 0x7f27dfa5bd30>, body: {"keypair": {"name": "tempest-TestShelveInstance-1607716027", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAj4gOekX7MnN96vTWouXy6xslIOvphSz0+AjEyT6V7nSLOh7AQ47RHUcuQ/ifUeoHCdt3o+yVN7E4I+YvguySaKVE88ag+15Ovgmkrb1SC78Msb4IIaR0rUGw2SjDshUQ=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:22:10.312774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-6104587e-d4dd-4440-93e8-2ed6ce3866cf tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Getting quotas for project fe1c90987d924f30b44cdf96f95a06b7. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:22:10.319562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-6104587e-d4dd-4440-93e8-2ed6ce3866cf tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Getting quotas for user 09e640037b8a4b84a0d3ea13d1db365a and project fe1c90987d924f30b44cdf96f95a06b7. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:22:10.346985 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6104587e-d4dd-4440-93e8-2ed6ce3866cf tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.235635 Aug 23 19:22:10.347606 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4080/8023] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 19:22:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:22:11.474583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:22:11.476152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:22:11.480685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-197934233", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1607716027", "security_groups": [{"name": "tempest-secgroup-smoke-1682466534"}], "networks": [{"uuid": "8a4f9d82-c3d2-40ba-a208-e331586e16a2"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:22:11.605649 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] validate_networks() for [('8a4f9d82-c3d2-40ba-a208-e331586e16a2', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:22:12.123530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:22:12.123957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:22:12.124442 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:22:12.124882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:22:12.125338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:22:12.134224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:12.134819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:12.135267 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:12.136005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:12.136467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:12.136896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:12.155435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Getting quotas for project fe1c90987d924f30b44cdf96f95a06b7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:22:12.160741 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Getting quotas for user 09e640037b8a4b84a0d3ea13d1db365a and project fe1c90987d924f30b44cdf96f95a06b7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:22:12.173342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:22:12.175617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:22:12.222580 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [d01953b9-1879-4ef3-aa8a-f87a155e3d0c] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:22:13.231966 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [d01953b9-1879-4ef3-aa8a-f87a155e3d0c] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36416. Aug 23 19:22:13.236908 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-82f35b0d-335f-4ad8-86f3-6629d7be5380 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.764154 Aug 23 19:22:13.238105 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3944/8024] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:22:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 1766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:22:13.250279 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8df1aeb1-ad6d-4006-8d54-9b8e4d86aff4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:13.251033 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8df1aeb1-ad6d-4006-8d54-9b8e4d86aff4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:13.308269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8df1aeb1-ad6d-4006-8d54-9b8e4d86aff4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:13.316695 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8df1aeb1-ad6d-4006-8d54-9b8e4d86aff4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1246 microversion: 2.1 time: 0.071820 Aug 23 19:22:13.317333 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4081/8025] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:13 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1246 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:14.340146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f34275e1-135a-4fd4-bbf3-3ebea73a6427 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:14.341528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f34275e1-135a-4fd4-bbf3-3ebea73a6427 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:14.411357 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f34275e1-135a-4fd4-bbf3-3ebea73a6427 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:14.422638 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f34275e1-135a-4fd4-bbf3-3ebea73a6427 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1246 microversion: 2.1 time: 0.088788 Aug 23 19:22:14.423246 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3945/8026] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:14 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:15.446567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5376ff74-3f39-4519-8e51-579f5e60dacc tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:15.447585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5376ff74-3f39-4519-8e51-579f5e60dacc tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:15.506666 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5376ff74-3f39-4519-8e51-579f5e60dacc tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:15.515753 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5376ff74-3f39-4519-8e51-579f5e60dacc tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1246 microversion: 2.1 time: 0.072814 Aug 23 19:22:15.516425 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4082/8027] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:15 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1246 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:16.537238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ac91ceb-28b8-49e1-b97e-4c68fff01be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:16.537863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1ac91ceb-28b8-49e1-b97e-4c68fff01be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:16.626583 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1ac91ceb-28b8-49e1-b97e-4c68fff01be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:16.634198 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1ac91ceb-28b8-49e1-b97e-4c68fff01be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1246 microversion: 2.1 time: 0.100867 Aug 23 19:22:16.634881 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3946/8028] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:16 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:17.657013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3581dacb-b60f-41d3-a1bc-488b1781e6b6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:17.658072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3581dacb-b60f-41d3-a1bc-488b1781e6b6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:17.664802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3581dacb-b60f-41d3-a1bc-488b1781e6b6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:17.665296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3581dacb-b60f-41d3-a1bc-488b1781e6b6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:17.665744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3581dacb-b60f-41d3-a1bc-488b1781e6b6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:17.666451 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3581dacb-b60f-41d3-a1bc-488b1781e6b6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:17.666946 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3581dacb-b60f-41d3-a1bc-488b1781e6b6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:17.667381 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3581dacb-b60f-41d3-a1bc-488b1781e6b6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:17.729455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3581dacb-b60f-41d3-a1bc-488b1781e6b6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:17.738386 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3581dacb-b60f-41d3-a1bc-488b1781e6b6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1250 microversion: 2.1 time: 0.086523 Aug 23 19:22:17.738994 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4083/8029] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:17 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:22:18.760079 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f99ac36a-269c-4916-9023-9a1d663d8624 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:18.760619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f99ac36a-269c-4916-9023-9a1d663d8624 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:18.768044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f99ac36a-269c-4916-9023-9a1d663d8624 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:18.768527 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f99ac36a-269c-4916-9023-9a1d663d8624 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:18.769050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f99ac36a-269c-4916-9023-9a1d663d8624 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:18.769750 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f99ac36a-269c-4916-9023-9a1d663d8624 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:18.770225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f99ac36a-269c-4916-9023-9a1d663d8624 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:18.770679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f99ac36a-269c-4916-9023-9a1d663d8624 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:18.834701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f99ac36a-269c-4916-9023-9a1d663d8624 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:18.842664 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f99ac36a-269c-4916-9023-9a1d663d8624 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1304 microversion: 2.1 time: 0.086765 Aug 23 19:22:18.843246 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3947/8030] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:18 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:22:19.666433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-a8122be5-26a5-48c6-90b8-4f2bd4bc77bb req-959855a2-8f90-4c62-a43e-a61a43ce5797 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf03bee0-66a6-43cf-8937-23694db7fe68", "tag": "63bed575-463f-4500-a956-312208b65bba"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:22:19.680790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a8122be5-26a5-48c6-90b8-4f2bd4bc77bb req-959855a2-8f90-4c62-a43e-a61a43ce5797 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:19.687567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a8122be5-26a5-48c6-90b8-4f2bd4bc77bb req-959855a2-8f90-4c62-a43e-a61a43ce5797 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:19.689417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a8122be5-26a5-48c6-90b8-4f2bd4bc77bb req-959855a2-8f90-4c62-a43e-a61a43ce5797 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:19.704045 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-a8122be5-26a5-48c6-90b8-4f2bd4bc77bb req-959855a2-8f90-4c62-a43e-a61a43ce5797 service nova] Creating event network-changed:63bed575-463f-4500-a956-312208b65bba for instance bf03bee0-66a6-43cf-8937-23694db7fe68 on n-h2-850468-16 Aug 23 19:22:19.709186 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-a8122be5-26a5-48c6-90b8-4f2bd4bc77bb req-959855a2-8f90-4c62-a43e-a61a43ce5797 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046579 Aug 23 19:22:19.709994 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4084/8031] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:22:19.864350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2b6d3546-4a8f-45db-a72f-7f8ad44be32d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:19.865033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2b6d3546-4a8f-45db-a72f-7f8ad44be32d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:19.872026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b6d3546-4a8f-45db-a72f-7f8ad44be32d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:19.872522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b6d3546-4a8f-45db-a72f-7f8ad44be32d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:19.873743 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b6d3546-4a8f-45db-a72f-7f8ad44be32d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:19.874378 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b6d3546-4a8f-45db-a72f-7f8ad44be32d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:19.874939 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b6d3546-4a8f-45db-a72f-7f8ad44be32d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:19.875337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2b6d3546-4a8f-45db-a72f-7f8ad44be32d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:20.063238 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2b6d3546-4a8f-45db-a72f-7f8ad44be32d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:20.071304 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2b6d3546-4a8f-45db-a72f-7f8ad44be32d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1372 microversion: 2.1 time: 0.211295 Aug 23 19:22:20.071885 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3948/8032] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:19 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1372 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:21.095686 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a0c8194c-f473-430c-b332-cf867258d28d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:21.096347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a0c8194c-f473-430c-b332-cf867258d28d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:21.102604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0c8194c-f473-430c-b332-cf867258d28d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:21.103099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0c8194c-f473-430c-b332-cf867258d28d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:21.103548 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0c8194c-f473-430c-b332-cf867258d28d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:21.104250 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0c8194c-f473-430c-b332-cf867258d28d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:21.104715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0c8194c-f473-430c-b332-cf867258d28d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:21.105152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a0c8194c-f473-430c-b332-cf867258d28d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:21.242870 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a0c8194c-f473-430c-b332-cf867258d28d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:21.251226 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a0c8194c-f473-430c-b332-cf867258d28d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1372 microversion: 2.1 time: 0.161673 Aug 23 19:22:21.251803 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4085/8033] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:21 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:22.272752 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6e218059-80ce-4cd2-81ea-0f19b132d5b8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:22.273371 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6e218059-80ce-4cd2-81ea-0f19b132d5b8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:22.276073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:22:22.281906 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e218059-80ce-4cd2-81ea-0f19b132d5b8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:22.282407 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e218059-80ce-4cd2-81ea-0f19b132d5b8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:22.282912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e218059-80ce-4cd2-81ea-0f19b132d5b8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:22.283629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e218059-80ce-4cd2-81ea-0f19b132d5b8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:22.284095 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e218059-80ce-4cd2-81ea-0f19b132d5b8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:22.284532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6e218059-80ce-4cd2-81ea-0f19b132d5b8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:22.422152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6e218059-80ce-4cd2-81ea-0f19b132d5b8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:22.430281 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6e218059-80ce-4cd2-81ea-0f19b132d5b8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1372 microversion: 2.1 time: 0.161052 Aug 23 19:22:22.431096 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3949/8034] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:22 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:23.452398 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f6949570-9ea0-41d3-a9ff-e13017c9f9f7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:23.453025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f6949570-9ea0-41d3-a9ff-e13017c9f9f7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:23.459796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6949570-9ea0-41d3-a9ff-e13017c9f9f7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:23.460291 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6949570-9ea0-41d3-a9ff-e13017c9f9f7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:23.460737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6949570-9ea0-41d3-a9ff-e13017c9f9f7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:23.461441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6949570-9ea0-41d3-a9ff-e13017c9f9f7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:23.461907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6949570-9ea0-41d3-a9ff-e13017c9f9f7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:23.462373 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f6949570-9ea0-41d3-a9ff-e13017c9f9f7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:23.605506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f6949570-9ea0-41d3-a9ff-e13017c9f9f7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:23.615054 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f6949570-9ea0-41d3-a9ff-e13017c9f9f7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1372 microversion: 2.1 time: 0.166679 Aug 23 19:22:23.616139 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4086/8035] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:23 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1372 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:24.637023 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-487cc372-a679-4162-9091-0866e2524cd0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:24.637675 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-487cc372-a679-4162-9091-0866e2524cd0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:24.645097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-487cc372-a679-4162-9091-0866e2524cd0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:24.645587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-487cc372-a679-4162-9091-0866e2524cd0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:24.646028 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-487cc372-a679-4162-9091-0866e2524cd0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:24.646886 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-487cc372-a679-4162-9091-0866e2524cd0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:24.647346 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-487cc372-a679-4162-9091-0866e2524cd0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:24.647776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-487cc372-a679-4162-9091-0866e2524cd0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:24.781482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-487cc372-a679-4162-9091-0866e2524cd0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:24.789120 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-487cc372-a679-4162-9091-0866e2524cd0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1372 microversion: 2.1 time: 0.156020 Aug 23 19:22:24.789689 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3950/8036] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:24 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:25.750967 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-709ff8b3-867e-48fc-b0f7-035c67937086 req-7dd5b1a2-7ca3-4bfc-9e79-6540802a9933 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf03bee0-66a6-43cf-8937-23694db7fe68", "name": "network-vif-plugged", "status": "completed", "tag": "63bed575-463f-4500-a956-312208b65bba"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:22:25.757144 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=8 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:22:25.766019 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-709ff8b3-867e-48fc-b0f7-035c67937086 req-7dd5b1a2-7ca3-4bfc-9e79-6540802a9933 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:25.766489 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-709ff8b3-867e-48fc-b0f7-035c67937086 req-7dd5b1a2-7ca3-4bfc-9e79-6540802a9933 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:25.767046 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-709ff8b3-867e-48fc-b0f7-035c67937086 req-7dd5b1a2-7ca3-4bfc-9e79-6540802a9933 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:25.778565 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-709ff8b3-867e-48fc-b0f7-035c67937086 req-7dd5b1a2-7ca3-4bfc-9e79-6540802a9933 service nova] Creating event network-vif-plugged:63bed575-463f-4500-a956-312208b65bba for instance bf03bee0-66a6-43cf-8937-23694db7fe68 on n-h2-850468-16 Aug 23 19:22:25.784115 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-709ff8b3-867e-48fc-b0f7-035c67937086 req-7dd5b1a2-7ca3-4bfc-9e79-6540802a9933 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038680 Aug 23 19:22:25.784722 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4087/8037] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:22:25.811202 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-99ac9d72-5bcd-4b99-abb8-7e5b9645c1ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:25.811973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-99ac9d72-5bcd-4b99-abb8-7e5b9645c1ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:25.818983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99ac9d72-5bcd-4b99-abb8-7e5b9645c1ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:25.819835 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99ac9d72-5bcd-4b99-abb8-7e5b9645c1ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:25.820279 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99ac9d72-5bcd-4b99-abb8-7e5b9645c1ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:25.821254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99ac9d72-5bcd-4b99-abb8-7e5b9645c1ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:25.821716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99ac9d72-5bcd-4b99-abb8-7e5b9645c1ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:25.822137 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99ac9d72-5bcd-4b99-abb8-7e5b9645c1ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:25.960776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-99ac9d72-5bcd-4b99-abb8-7e5b9645c1ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:25.968659 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-99ac9d72-5bcd-4b99-abb8-7e5b9645c1ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1372 microversion: 2.1 time: 0.161974 Aug 23 19:22:25.969169 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3951/8038] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:25 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:26.990233 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7c89e17c-68e2-44ef-8fb1-5e95e92f3f49 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:26.991026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7c89e17c-68e2-44ef-8fb1-5e95e92f3f49 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:26.999025 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c89e17c-68e2-44ef-8fb1-5e95e92f3f49 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:26.999628 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c89e17c-68e2-44ef-8fb1-5e95e92f3f49 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:27.000080 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c89e17c-68e2-44ef-8fb1-5e95e92f3f49 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:27.000790 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c89e17c-68e2-44ef-8fb1-5e95e92f3f49 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:27.001260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c89e17c-68e2-44ef-8fb1-5e95e92f3f49 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:27.001727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7c89e17c-68e2-44ef-8fb1-5e95e92f3f49 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:27.139187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7c89e17c-68e2-44ef-8fb1-5e95e92f3f49 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:27.147342 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7c89e17c-68e2-44ef-8fb1-5e95e92f3f49 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1372 microversion: 2.1 time: 0.161426 Aug 23 19:22:27.147909 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4088/8039] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:26 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:28.168963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-68306c2e-8c7c-4c82-ab47-a4c566531cc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:28.169640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-68306c2e-8c7c-4c82-ab47-a4c566531cc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:28.171712 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=10 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:22:28.177824 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68306c2e-8c7c-4c82-ab47-a4c566531cc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:28.178312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68306c2e-8c7c-4c82-ab47-a4c566531cc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:28.178784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68306c2e-8c7c-4c82-ab47-a4c566531cc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:28.179484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68306c2e-8c7c-4c82-ab47-a4c566531cc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:28.179942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68306c2e-8c7c-4c82-ab47-a4c566531cc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:28.180373 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68306c2e-8c7c-4c82-ab47-a4c566531cc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:28.312057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-68306c2e-8c7c-4c82-ab47-a4c566531cc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:28.319794 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-68306c2e-8c7c-4c82-ab47-a4c566531cc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1557 microversion: 2.1 time: 0.154853 Aug 23 19:22:28.320368 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3952/8040] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:28 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:28.340097 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0e801e8c-2a6f-45f3-adf8-bde22d7035f3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:22:28.340759 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0e801e8c-2a6f-45f3-adf8-bde22d7035f3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:22:28.347826 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e801e8c-2a6f-45f3-adf8-bde22d7035f3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:28.348332 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e801e8c-2a6f-45f3-adf8-bde22d7035f3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:28.348798 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e801e8c-2a6f-45f3-adf8-bde22d7035f3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:28.349517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e801e8c-2a6f-45f3-adf8-bde22d7035f3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:28.349993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e801e8c-2a6f-45f3-adf8-bde22d7035f3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:28.350441 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e801e8c-2a6f-45f3-adf8-bde22d7035f3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:28.480651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0e801e8c-2a6f-45f3-adf8-bde22d7035f3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:22:28.488902 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0e801e8c-2a6f-45f3-adf8-bde22d7035f3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1557 microversion: 2.1 time: 0.152708 Aug 23 19:22:28.489478 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4089/8041] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:22:28 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:22:30.378532 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-bf7bc1eb-630a-4cd8-8284-421ade124da9 req-637a72f4-a799-4dcc-b815-152355fa45ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf03bee0-66a6-43cf-8937-23694db7fe68", "tag": "63bed575-463f-4500-a956-312208b65bba"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:22:30.389209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bf7bc1eb-630a-4cd8-8284-421ade124da9 req-637a72f4-a799-4dcc-b815-152355fa45ee service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:22:30.389697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bf7bc1eb-630a-4cd8-8284-421ade124da9 req-637a72f4-a799-4dcc-b815-152355fa45ee service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:22:30.390205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-bf7bc1eb-630a-4cd8-8284-421ade124da9 req-637a72f4-a799-4dcc-b815-152355fa45ee service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:22:30.401432 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-bf7bc1eb-630a-4cd8-8284-421ade124da9 req-637a72f4-a799-4dcc-b815-152355fa45ee service nova] Creating event network-changed:63bed575-463f-4500-a956-312208b65bba for instance bf03bee0-66a6-43cf-8937-23694db7fe68 on n-h2-850468-16 Aug 23 19:22:30.407147 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-bf7bc1eb-630a-4cd8-8284-421ade124da9 req-637a72f4-a799-4dcc-b815-152355fa45ee service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032400 Aug 23 19:22:30.407743 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3953/8042] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:22:41.446954 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:22:41.447640 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:22:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:24:56.639140 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a3fd44c-0004-4783-9f1a-6f2fcc77fcee] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 19:24:56.640317 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ea61cea-341f-4994-9508-d9cf4674c693] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 19:24:56.640874 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:24:56.641631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=34 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:24:56.646343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6ddcf0cc-802b-4368-a986-56417e49a0f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:24:56.646919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6ddcf0cc-802b-4368-a986-56417e49a0f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:24:56.653820 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ddcf0cc-802b-4368-a986-56417e49a0f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:24:56.654316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ddcf0cc-802b-4368-a986-56417e49a0f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:24:56.654787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ddcf0cc-802b-4368-a986-56417e49a0f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:24:56.655493 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ddcf0cc-802b-4368-a986-56417e49a0f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:24:56.655987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ddcf0cc-802b-4368-a986-56417e49a0f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:24:56.656425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6ddcf0cc-802b-4368-a986-56417e49a0f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:24:56.680499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-6ddcf0cc-802b-4368-a986-56417e49a0f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lazy-loading 'flavor' on Instance uuid bf03bee0-66a6-43cf-8937-23694db7fe68 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:24:56.860524 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6ddcf0cc-802b-4368-a986-56417e49a0f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "POST /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68/action" status: 202 len: 0 microversion: 2.1 time: 0.222974 Aug 23 19:24:56.861275 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4090/8043] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:24:56 2022] POST /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:24:56.867714 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:24:56.868532 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:24:56.869140 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:24:56.869910 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=40 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:24:56.874341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-750836b8-53f3-46b1-aa74-d768a89ab949 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:24:56.875090 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-750836b8-53f3-46b1-aa74-d768a89ab949 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:24:56.884453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-750836b8-53f3-46b1-aa74-d768a89ab949 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:24:56.884887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-750836b8-53f3-46b1-aa74-d768a89ab949 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:24:56.885335 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-750836b8-53f3-46b1-aa74-d768a89ab949 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:24:56.886052 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-750836b8-53f3-46b1-aa74-d768a89ab949 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:24:56.886520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-750836b8-53f3-46b1-aa74-d768a89ab949 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:24:56.886990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-750836b8-53f3-46b1-aa74-d768a89ab949 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:24:57.025168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-750836b8-53f3-46b1-aa74-d768a89ab949 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:24:57.033133 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-750836b8-53f3-46b1-aa74-d768a89ab949 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1681 microversion: 2.1 time: 0.167275 Aug 23 19:24:57.033695 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3954/8044] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:24:56 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:24:58.055117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-59e692ec-1e5f-42d4-bffb-6191e52de133 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:24:58.055852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-59e692ec-1e5f-42d4-bffb-6191e52de133 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:24:58.072242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59e692ec-1e5f-42d4-bffb-6191e52de133 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:24:58.072755 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59e692ec-1e5f-42d4-bffb-6191e52de133 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:24:58.073210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59e692ec-1e5f-42d4-bffb-6191e52de133 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:24:58.073933 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59e692ec-1e5f-42d4-bffb-6191e52de133 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:24:58.074407 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59e692ec-1e5f-42d4-bffb-6191e52de133 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:24:58.074881 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-59e692ec-1e5f-42d4-bffb-6191e52de133 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:24:58.078937 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ea61cea-341f-4994-9508-d9cf4674c693] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36544. Aug 23 19:24:58.084499 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a3fd44c-0004-4783-9f1a-6f2fcc77fcee] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36542. Aug 23 19:24:58.213855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-59e692ec-1e5f-42d4-bffb-6191e52de133 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:24:58.221652 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-59e692ec-1e5f-42d4-bffb-6191e52de133 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1681 microversion: 2.1 time: 0.171291 Aug 23 19:24:58.222219 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4091/8045] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:24:58 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:24:59.244426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07b3535a-fef8-4e5d-ac43-86f931b1939a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:24:59.245049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07b3535a-fef8-4e5d-ac43-86f931b1939a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:24:59.253930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07b3535a-fef8-4e5d-ac43-86f931b1939a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:24:59.254577 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07b3535a-fef8-4e5d-ac43-86f931b1939a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:24:59.255016 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07b3535a-fef8-4e5d-ac43-86f931b1939a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:24:59.255721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07b3535a-fef8-4e5d-ac43-86f931b1939a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:24:59.256184 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07b3535a-fef8-4e5d-ac43-86f931b1939a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:24:59.256615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07b3535a-fef8-4e5d-ac43-86f931b1939a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:24:59.262627 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36548. Aug 23 19:24:59.276670 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36550. Aug 23 19:24:59.394973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-07b3535a-fef8-4e5d-ac43-86f931b1939a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:24:59.402739 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-07b3535a-fef8-4e5d-ac43-86f931b1939a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1681 microversion: 2.1 time: 0.162343 Aug 23 19:24:59.403318 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3955/8046] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:24:59 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:00.425001 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0c9ecf8c-e7a7-4d4f-95ed-046f9434d08a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:00.425630 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0c9ecf8c-e7a7-4d4f-95ed-046f9434d08a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:00.433151 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c9ecf8c-e7a7-4d4f-95ed-046f9434d08a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:00.433647 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c9ecf8c-e7a7-4d4f-95ed-046f9434d08a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:00.434098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c9ecf8c-e7a7-4d4f-95ed-046f9434d08a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:00.434839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c9ecf8c-e7a7-4d4f-95ed-046f9434d08a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:00.435304 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c9ecf8c-e7a7-4d4f-95ed-046f9434d08a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:00.435744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0c9ecf8c-e7a7-4d4f-95ed-046f9434d08a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:00.567501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0c9ecf8c-e7a7-4d4f-95ed-046f9434d08a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:00.575266 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0c9ecf8c-e7a7-4d4f-95ed-046f9434d08a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1681 microversion: 2.1 time: 0.154236 Aug 23 19:25:00.575835 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4092/8047] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:00 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:01.597050 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cf8d032b-72da-4ef3-8deb-d04363eca94b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:01.597642 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cf8d032b-72da-4ef3-8deb-d04363eca94b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:01.605480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf8d032b-72da-4ef3-8deb-d04363eca94b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:01.605964 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf8d032b-72da-4ef3-8deb-d04363eca94b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:01.606400 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf8d032b-72da-4ef3-8deb-d04363eca94b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:01.607122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf8d032b-72da-4ef3-8deb-d04363eca94b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:01.607575 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf8d032b-72da-4ef3-8deb-d04363eca94b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:01.608014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cf8d032b-72da-4ef3-8deb-d04363eca94b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:01.741144 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cf8d032b-72da-4ef3-8deb-d04363eca94b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:01.748927 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cf8d032b-72da-4ef3-8deb-d04363eca94b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1681 microversion: 2.1 time: 0.155830 Aug 23 19:25:01.749507 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3956/8048] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:01 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:02.770845 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ac82bf0b-b5fa-417c-818c-fbb96ef55f86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:02.772039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ac82bf0b-b5fa-417c-818c-fbb96ef55f86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:02.779698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac82bf0b-b5fa-417c-818c-fbb96ef55f86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:02.780198 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac82bf0b-b5fa-417c-818c-fbb96ef55f86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:02.780651 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac82bf0b-b5fa-417c-818c-fbb96ef55f86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:02.781414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac82bf0b-b5fa-417c-818c-fbb96ef55f86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:02.781885 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac82bf0b-b5fa-417c-818c-fbb96ef55f86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:02.782330 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ac82bf0b-b5fa-417c-818c-fbb96ef55f86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:02.921903 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ac82bf0b-b5fa-417c-818c-fbb96ef55f86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:02.930880 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ac82bf0b-b5fa-417c-818c-fbb96ef55f86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1681 microversion: 2.1 time: 0.164429 Aug 23 19:25:02.931445 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4093/8049] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:02 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:03.951945 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f95523c8-4d35-448f-88fa-a3d02f3232d4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:03.952491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f95523c8-4d35-448f-88fa-a3d02f3232d4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:03.959302 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f95523c8-4d35-448f-88fa-a3d02f3232d4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:03.959786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f95523c8-4d35-448f-88fa-a3d02f3232d4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:03.960224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f95523c8-4d35-448f-88fa-a3d02f3232d4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:03.960922 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f95523c8-4d35-448f-88fa-a3d02f3232d4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:03.961380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f95523c8-4d35-448f-88fa-a3d02f3232d4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:03.961808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f95523c8-4d35-448f-88fa-a3d02f3232d4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:04.095215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f95523c8-4d35-448f-88fa-a3d02f3232d4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:04.103053 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f95523c8-4d35-448f-88fa-a3d02f3232d4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1681 microversion: 2.1 time: 0.155034 Aug 23 19:25:04.103632 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3957/8050] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:03 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:05.124766 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6dc03f9f-e477-451e-83c2-5db63161282e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:05.125296 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6dc03f9f-e477-451e-83c2-5db63161282e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:05.133045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dc03f9f-e477-451e-83c2-5db63161282e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:05.133638 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dc03f9f-e477-451e-83c2-5db63161282e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:05.134094 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dc03f9f-e477-451e-83c2-5db63161282e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:05.134825 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dc03f9f-e477-451e-83c2-5db63161282e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:05.135294 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dc03f9f-e477-451e-83c2-5db63161282e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:05.135732 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6dc03f9f-e477-451e-83c2-5db63161282e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:05.267464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6dc03f9f-e477-451e-83c2-5db63161282e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:05.276597 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6dc03f9f-e477-451e-83c2-5db63161282e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1681 microversion: 2.1 time: 0.155815 Aug 23 19:25:05.277172 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4094/8051] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:05 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:06.297602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-07495300-fa42-47d8-9410-4ffc2ce74169 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:06.298220 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-07495300-fa42-47d8-9410-4ffc2ce74169 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:06.306232 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07495300-fa42-47d8-9410-4ffc2ce74169 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:06.306758 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07495300-fa42-47d8-9410-4ffc2ce74169 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:06.307197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07495300-fa42-47d8-9410-4ffc2ce74169 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:06.307896 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07495300-fa42-47d8-9410-4ffc2ce74169 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:06.308352 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07495300-fa42-47d8-9410-4ffc2ce74169 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:06.308777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-07495300-fa42-47d8-9410-4ffc2ce74169 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:06.439990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-07495300-fa42-47d8-9410-4ffc2ce74169 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:06.448449 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-07495300-fa42-47d8-9410-4ffc2ce74169 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1681 microversion: 2.1 time: 0.154872 Aug 23 19:25:06.449017 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3958/8052] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:06 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:07.470032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0289f161-433b-4c9c-afcb-ae2b7fa6e1c6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:07.470694 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0289f161-433b-4c9c-afcb-ae2b7fa6e1c6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:07.477733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0289f161-433b-4c9c-afcb-ae2b7fa6e1c6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:07.478238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0289f161-433b-4c9c-afcb-ae2b7fa6e1c6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:07.478728 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0289f161-433b-4c9c-afcb-ae2b7fa6e1c6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:07.479445 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0289f161-433b-4c9c-afcb-ae2b7fa6e1c6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:07.479918 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0289f161-433b-4c9c-afcb-ae2b7fa6e1c6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:07.480364 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0289f161-433b-4c9c-afcb-ae2b7fa6e1c6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:07.616923 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0289f161-433b-4c9c-afcb-ae2b7fa6e1c6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:07.624750 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0289f161-433b-4c9c-afcb-ae2b7fa6e1c6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1681 microversion: 2.1 time: 0.158733 Aug 23 19:25:07.625318 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4095/8053] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:07 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:08.648244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cc9c0aaa-f63b-40de-b1ea-9ae54b96befa tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:08.648866 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cc9c0aaa-f63b-40de-b1ea-9ae54b96befa tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:08.655765 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc9c0aaa-f63b-40de-b1ea-9ae54b96befa tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:08.656250 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc9c0aaa-f63b-40de-b1ea-9ae54b96befa tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:08.656688 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc9c0aaa-f63b-40de-b1ea-9ae54b96befa tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:08.657417 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc9c0aaa-f63b-40de-b1ea-9ae54b96befa tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:08.657874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc9c0aaa-f63b-40de-b1ea-9ae54b96befa tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:08.658303 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cc9c0aaa-f63b-40de-b1ea-9ae54b96befa tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:08.803772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cc9c0aaa-f63b-40de-b1ea-9ae54b96befa tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:08.811812 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cc9c0aaa-f63b-40de-b1ea-9ae54b96befa tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1702 microversion: 2.1 time: 0.168731 Aug 23 19:25:08.812393 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3959/8054] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:08 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1702 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:09.835573 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-25271b28-d402-49ee-95c1-2f69b24bd050 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:09.836257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-25271b28-d402-49ee-95c1-2f69b24bd050 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:09.843077 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25271b28-d402-49ee-95c1-2f69b24bd050 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:09.843569 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25271b28-d402-49ee-95c1-2f69b24bd050 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:09.844040 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25271b28-d402-49ee-95c1-2f69b24bd050 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:09.844745 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25271b28-d402-49ee-95c1-2f69b24bd050 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:09.845213 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25271b28-d402-49ee-95c1-2f69b24bd050 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:09.845653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-25271b28-d402-49ee-95c1-2f69b24bd050 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:09.978058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-25271b28-d402-49ee-95c1-2f69b24bd050 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:09.985739 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-25271b28-d402-49ee-95c1-2f69b24bd050 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1702 microversion: 2.1 time: 0.154886 Aug 23 19:25:09.986300 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4096/8055] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:09 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1702 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:10.683998 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-9526a529-0c76-43a4-bc10-7a41d0b5390b req-7a60c890-9c5d-4ac9-823e-f142aeac971c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf03bee0-66a6-43cf-8937-23694db7fe68", "name": "network-vif-plugged", "status": "completed", "tag": "63bed575-463f-4500-a956-312208b65bba"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:25:10.696481 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9526a529-0c76-43a4-bc10-7a41d0b5390b req-7a60c890-9c5d-4ac9-823e-f142aeac971c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:10.696983 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9526a529-0c76-43a4-bc10-7a41d0b5390b req-7a60c890-9c5d-4ac9-823e-f142aeac971c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:10.697848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-9526a529-0c76-43a4-bc10-7a41d0b5390b req-7a60c890-9c5d-4ac9-823e-f142aeac971c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:10.709469 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-9526a529-0c76-43a4-bc10-7a41d0b5390b req-7a60c890-9c5d-4ac9-823e-f142aeac971c service nova] Creating event network-vif-plugged:63bed575-463f-4500-a956-312208b65bba for instance bf03bee0-66a6-43cf-8937-23694db7fe68 on n-h2-850468-16 Aug 23 19:25:10.714697 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-9526a529-0c76-43a4-bc10-7a41d0b5390b req-7a60c890-9c5d-4ac9-823e-f142aeac971c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035000 Aug 23 19:25:10.715287 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3960/8056] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:25:11.008420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e7124c2b-08e6-4ade-ba3f-996437bdc5a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:11.009052 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e7124c2b-08e6-4ade-ba3f-996437bdc5a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:11.015902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7124c2b-08e6-4ade-ba3f-996437bdc5a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:11.016404 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7124c2b-08e6-4ade-ba3f-996437bdc5a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:11.016879 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7124c2b-08e6-4ade-ba3f-996437bdc5a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:11.017578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7124c2b-08e6-4ade-ba3f-996437bdc5a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:11.018050 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7124c2b-08e6-4ade-ba3f-996437bdc5a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:11.018494 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e7124c2b-08e6-4ade-ba3f-996437bdc5a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:11.150608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e7124c2b-08e6-4ade-ba3f-996437bdc5a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:11.158366 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e7124c2b-08e6-4ade-ba3f-996437bdc5a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1702 microversion: 2.1 time: 0.154562 Aug 23 19:25:11.158965 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4097/8057] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:11 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1702 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:12.180004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-54bef1e1-a8d7-4a72-98d4-7637a2af7206 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:12.180637 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-54bef1e1-a8d7-4a72-98d4-7637a2af7206 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:12.187768 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54bef1e1-a8d7-4a72-98d4-7637a2af7206 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:12.188259 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54bef1e1-a8d7-4a72-98d4-7637a2af7206 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:12.188704 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54bef1e1-a8d7-4a72-98d4-7637a2af7206 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:12.189413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54bef1e1-a8d7-4a72-98d4-7637a2af7206 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:12.189879 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54bef1e1-a8d7-4a72-98d4-7637a2af7206 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:12.190310 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-54bef1e1-a8d7-4a72-98d4-7637a2af7206 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:12.324377 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-54bef1e1-a8d7-4a72-98d4-7637a2af7206 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:12.332194 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-54bef1e1-a8d7-4a72-98d4-7637a2af7206 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1702 microversion: 2.1 time: 0.156924 Aug 23 19:25:12.332782 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3961/8058] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:12 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1702 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:13.354070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-de8cb26e-87b7-43dd-8b7c-bd5c2364ecb9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:13.354761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-de8cb26e-87b7-43dd-8b7c-bd5c2364ecb9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:13.365684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de8cb26e-87b7-43dd-8b7c-bd5c2364ecb9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:13.366273 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de8cb26e-87b7-43dd-8b7c-bd5c2364ecb9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:13.367049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de8cb26e-87b7-43dd-8b7c-bd5c2364ecb9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:13.367558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de8cb26e-87b7-43dd-8b7c-bd5c2364ecb9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:13.367952 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de8cb26e-87b7-43dd-8b7c-bd5c2364ecb9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:13.368394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-de8cb26e-87b7-43dd-8b7c-bd5c2364ecb9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:13.511613 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-de8cb26e-87b7-43dd-8b7c-bd5c2364ecb9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:13.520086 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-de8cb26e-87b7-43dd-8b7c-bd5c2364ecb9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1697 microversion: 2.1 time: 0.170367 Aug 23 19:25:13.521179 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4098/8059] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:13 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:14.544885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1ee34132-9fe0-4dfd-a523-021e2c897cf2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:14.545537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1ee34132-9fe0-4dfd-a523-021e2c897cf2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:14.552772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ee34132-9fe0-4dfd-a523-021e2c897cf2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:14.553516 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ee34132-9fe0-4dfd-a523-021e2c897cf2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:14.553958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ee34132-9fe0-4dfd-a523-021e2c897cf2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:14.554694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ee34132-9fe0-4dfd-a523-021e2c897cf2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:14.555148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ee34132-9fe0-4dfd-a523-021e2c897cf2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:14.555571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1ee34132-9fe0-4dfd-a523-021e2c897cf2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:14.719190 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1ee34132-9fe0-4dfd-a523-021e2c897cf2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:14.728339 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1ee34132-9fe0-4dfd-a523-021e2c897cf2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1697 microversion: 2.1 time: 0.188840 Aug 23 19:25:14.728930 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3962/8060] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:14 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1697 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:15.750102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9f595b73-5852-4a22-a971-45ac62680153 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:15.751102 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9f595b73-5852-4a22-a971-45ac62680153 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:15.776114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f595b73-5852-4a22-a971-45ac62680153 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:15.777018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f595b73-5852-4a22-a971-45ac62680153 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:15.779491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f595b73-5852-4a22-a971-45ac62680153 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:15.780481 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f595b73-5852-4a22-a971-45ac62680153 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:15.785259 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f595b73-5852-4a22-a971-45ac62680153 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:15.786072 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9f595b73-5852-4a22-a971-45ac62680153 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:15.976386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9f595b73-5852-4a22-a971-45ac62680153 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:15.987079 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9f595b73-5852-4a22-a971-45ac62680153 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1697 microversion: 2.1 time: 0.241538 Aug 23 19:25:15.988065 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4099/8061] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:15 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1697 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:17.010098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-db083a50-6e5d-4af3-bc75-5e0b800889e5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:17.011506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-db083a50-6e5d-4af3-bc75-5e0b800889e5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:17.018697 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db083a50-6e5d-4af3-bc75-5e0b800889e5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:17.019178 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db083a50-6e5d-4af3-bc75-5e0b800889e5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:17.019790 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db083a50-6e5d-4af3-bc75-5e0b800889e5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:17.021918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db083a50-6e5d-4af3-bc75-5e0b800889e5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:17.022587 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db083a50-6e5d-4af3-bc75-5e0b800889e5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:17.023227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-db083a50-6e5d-4af3-bc75-5e0b800889e5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:17.173493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-db083a50-6e5d-4af3-bc75-5e0b800889e5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:17.185722 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-db083a50-6e5d-4af3-bc75-5e0b800889e5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1697 microversion: 2.1 time: 0.179977 Aug 23 19:25:17.186524 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3963/8062] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:17 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1697 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:18.209531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b89ce806-4438-42d0-b47e-de3c1677a123 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:18.210948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b89ce806-4438-42d0-b47e-de3c1677a123 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:18.218564 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b89ce806-4438-42d0-b47e-de3c1677a123 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:18.219455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b89ce806-4438-42d0-b47e-de3c1677a123 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:18.219989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b89ce806-4438-42d0-b47e-de3c1677a123 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:18.220760 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b89ce806-4438-42d0-b47e-de3c1677a123 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:18.221235 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b89ce806-4438-42d0-b47e-de3c1677a123 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:18.221684 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b89ce806-4438-42d0-b47e-de3c1677a123 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:18.368276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b89ce806-4438-42d0-b47e-de3c1677a123 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:18.376990 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b89ce806-4438-42d0-b47e-de3c1677a123 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1697 microversion: 2.1 time: 0.172118 Aug 23 19:25:18.377793 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4100/8063] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:18 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1697 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:19.399391 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ff703943-58be-4a2e-a2e4-cfe9c8cca5c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:19.400788 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ff703943-58be-4a2e-a2e4-cfe9c8cca5c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:19.407913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff703943-58be-4a2e-a2e4-cfe9c8cca5c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:19.408398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff703943-58be-4a2e-a2e4-cfe9c8cca5c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:19.409075 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff703943-58be-4a2e-a2e4-cfe9c8cca5c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:19.409787 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff703943-58be-4a2e-a2e4-cfe9c8cca5c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:19.410245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff703943-58be-4a2e-a2e4-cfe9c8cca5c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:19.410699 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ff703943-58be-4a2e-a2e4-cfe9c8cca5c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:19.596258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ff703943-58be-4a2e-a2e4-cfe9c8cca5c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:19.607058 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ff703943-58be-4a2e-a2e4-cfe9c8cca5c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1697 microversion: 2.1 time: 0.211841 Aug 23 19:25:19.627768 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3964/8064] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:19 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1697 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:20.630476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a5c2e50f-ef13-4bf2-8931-8fb295358cdd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:20.631249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a5c2e50f-ef13-4bf2-8931-8fb295358cdd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:20.641959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5c2e50f-ef13-4bf2-8931-8fb295358cdd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:20.643015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5c2e50f-ef13-4bf2-8931-8fb295358cdd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:20.643015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5c2e50f-ef13-4bf2-8931-8fb295358cdd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:20.643814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5c2e50f-ef13-4bf2-8931-8fb295358cdd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:20.644246 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5c2e50f-ef13-4bf2-8931-8fb295358cdd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:20.644527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a5c2e50f-ef13-4bf2-8931-8fb295358cdd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:20.810704 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a5c2e50f-ef13-4bf2-8931-8fb295358cdd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:20.821692 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a5c2e50f-ef13-4bf2-8931-8fb295358cdd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1697 microversion: 2.1 time: 0.195285 Aug 23 19:25:20.822850 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4101/8065] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:20 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1697 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:21.844413 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eb49f552-e6f1-46d3-bba9-6c700cb48354 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:21.845221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-eb49f552-e6f1-46d3-bba9-6c700cb48354 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:21.852032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb49f552-e6f1-46d3-bba9-6c700cb48354 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:21.852520 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb49f552-e6f1-46d3-bba9-6c700cb48354 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:21.852957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb49f552-e6f1-46d3-bba9-6c700cb48354 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:21.853655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb49f552-e6f1-46d3-bba9-6c700cb48354 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:21.854109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb49f552-e6f1-46d3-bba9-6c700cb48354 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:21.854534 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-eb49f552-e6f1-46d3-bba9-6c700cb48354 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:22.007332 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-eb49f552-e6f1-46d3-bba9-6c700cb48354 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:22.015714 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eb49f552-e6f1-46d3-bba9-6c700cb48354 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1697 microversion: 2.1 time: 0.175186 Aug 23 19:25:22.016416 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3965/8066] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:21 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1697 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:23.038285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0b8db80f-667b-4a35-87fd-0f62b39a5880 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:23.038944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0b8db80f-667b-4a35-87fd-0f62b39a5880 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:23.045831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b8db80f-667b-4a35-87fd-0f62b39a5880 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:23.046326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b8db80f-667b-4a35-87fd-0f62b39a5880 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:23.046953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b8db80f-667b-4a35-87fd-0f62b39a5880 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:23.047592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b8db80f-667b-4a35-87fd-0f62b39a5880 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:23.048058 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b8db80f-667b-4a35-87fd-0f62b39a5880 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:23.048496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0b8db80f-667b-4a35-87fd-0f62b39a5880 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:23.539707 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0b8db80f-667b-4a35-87fd-0f62b39a5880 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:23.547497 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0b8db80f-667b-4a35-87fd-0f62b39a5880 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1679 microversion: 2.1 time: 0.514123 Aug 23 19:25:23.548106 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4102/8067] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:23 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1679 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:24.569880 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-dd401377-3389-4f94-a447-1b964b7b8294 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:24.570424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-dd401377-3389-4f94-a447-1b964b7b8294 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:24.577221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd401377-3389-4f94-a447-1b964b7b8294 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:24.577708 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd401377-3389-4f94-a447-1b964b7b8294 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:24.578145 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd401377-3389-4f94-a447-1b964b7b8294 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:24.578874 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd401377-3389-4f94-a447-1b964b7b8294 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:24.579321 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd401377-3389-4f94-a447-1b964b7b8294 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:24.579748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-dd401377-3389-4f94-a447-1b964b7b8294 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:24.715749 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-dd401377-3389-4f94-a447-1b964b7b8294 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:24.725596 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-dd401377-3389-4f94-a447-1b964b7b8294 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1679 microversion: 2.1 time: 0.160419 Aug 23 19:25:24.726314 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3966/8068] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:24 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1679 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:24.735336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-08b1ecf4-234b-4b18-bb6e-e78158c368bb req-04d2ccb6-51a4-466c-858a-0a122585c63e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf03bee0-66a6-43cf-8937-23694db7fe68", "name": "network-vif-unplugged", "status": "completed", "tag": "63bed575-463f-4500-a956-312208b65bba"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:25:24.747016 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-08b1ecf4-234b-4b18-bb6e-e78158c368bb req-04d2ccb6-51a4-466c-858a-0a122585c63e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:24.747524 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-08b1ecf4-234b-4b18-bb6e-e78158c368bb req-04d2ccb6-51a4-466c-858a-0a122585c63e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:24.748006 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-08b1ecf4-234b-4b18-bb6e-e78158c368bb req-04d2ccb6-51a4-466c-858a-0a122585c63e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:24.760352 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-08b1ecf4-234b-4b18-bb6e-e78158c368bb req-04d2ccb6-51a4-466c-858a-0a122585c63e service nova] Creating event network-vif-unplugged:63bed575-463f-4500-a956-312208b65bba for instance bf03bee0-66a6-43cf-8937-23694db7fe68 on n-h2-850468-16 Aug 23 19:25:24.765482 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-08b1ecf4-234b-4b18-bb6e-e78158c368bb req-04d2ccb6-51a4-466c-858a-0a122585c63e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033959 Aug 23 19:25:24.766090 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4103/8069] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:25:25.747492 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6d800500-1a62-4aed-82fd-47c9a41a85ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:25.748119 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6d800500-1a62-4aed-82fd-47c9a41a85ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:25.755038 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d800500-1a62-4aed-82fd-47c9a41a85ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:25.756348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d800500-1a62-4aed-82fd-47c9a41a85ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:25.756916 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d800500-1a62-4aed-82fd-47c9a41a85ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:25.757629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d800500-1a62-4aed-82fd-47c9a41a85ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:25.758099 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d800500-1a62-4aed-82fd-47c9a41a85ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:25.758560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6d800500-1a62-4aed-82fd-47c9a41a85ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:25.898337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-6d800500-1a62-4aed-82fd-47c9a41a85ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:25.906227 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6d800500-1a62-4aed-82fd-47c9a41a85ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1622 microversion: 2.1 time: 0.162718 Aug 23 19:25:25.906878 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3967/8070] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:25 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1622 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:25.930009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-58f51d5d-e08d-4668-bcf5-d76e519931b5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:25:25.930777 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-58f51d5d-e08d-4668-bcf5-d76e519931b5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:25.936975 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f51d5d-e08d-4668-bcf5-d76e519931b5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:25.937476 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f51d5d-e08d-4668-bcf5-d76e519931b5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:25.937932 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f51d5d-e08d-4668-bcf5-d76e519931b5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:25.938673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f51d5d-e08d-4668-bcf5-d76e519931b5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:25.939147 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f51d5d-e08d-4668-bcf5-d76e519931b5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:25.939589 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-58f51d5d-e08d-4668-bcf5-d76e519931b5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:26.037459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-58f51d5d-e08d-4668-bcf5-d76e519931b5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128808) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 19:25:26.072091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:25:26.105256 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-58f51d5d-e08d-4668-bcf5-d76e519931b5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "POST /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68/action" status: 202 len: 0 microversion: 2.1 time: 0.181454 Aug 23 19:25:26.105878 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4104/8071] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:25:25 2022] POST /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68/action => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:25:26.114053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a683133d-e29b-4757-8aaa-76cc57b51dbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:26.114803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a683133d-e29b-4757-8aaa-76cc57b51dbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:26.121497 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a683133d-e29b-4757-8aaa-76cc57b51dbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:26.121990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a683133d-e29b-4757-8aaa-76cc57b51dbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:26.122458 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a683133d-e29b-4757-8aaa-76cc57b51dbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:26.123200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a683133d-e29b-4757-8aaa-76cc57b51dbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:26.123657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a683133d-e29b-4757-8aaa-76cc57b51dbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:26.124088 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a683133d-e29b-4757-8aaa-76cc57b51dbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:26.261772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a683133d-e29b-4757-8aaa-76cc57b51dbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:26.269653 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a683133d-e29b-4757-8aaa-76cc57b51dbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1630 microversion: 2.1 time: 0.159494 Aug 23 19:25:26.270782 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3968/8072] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:26 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1630 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:27.292752 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3bc8604a-ef1d-444b-9b29-d8b2ff1b7771 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:27.293301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3bc8604a-ef1d-444b-9b29-d8b2ff1b7771 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:27.295190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:25:27.304619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bc8604a-ef1d-444b-9b29-d8b2ff1b7771 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:27.305119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bc8604a-ef1d-444b-9b29-d8b2ff1b7771 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:27.305580 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bc8604a-ef1d-444b-9b29-d8b2ff1b7771 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:27.306295 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bc8604a-ef1d-444b-9b29-d8b2ff1b7771 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:27.306801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bc8604a-ef1d-444b-9b29-d8b2ff1b7771 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:27.307247 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3bc8604a-ef1d-444b-9b29-d8b2ff1b7771 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:27.447221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3bc8604a-ef1d-444b-9b29-d8b2ff1b7771 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:27.455161 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3bc8604a-ef1d-444b-9b29-d8b2ff1b7771 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.167311 Aug 23 19:25:27.455836 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4105/8073] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:27 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:28.477484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-523e12a0-1b6d-4b19-94da-ca5aaaf4f5d8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:28.478027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-523e12a0-1b6d-4b19-94da-ca5aaaf4f5d8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:28.480830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=31 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:25:28.485573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-523e12a0-1b6d-4b19-94da-ca5aaaf4f5d8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:28.486066 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-523e12a0-1b6d-4b19-94da-ca5aaaf4f5d8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:28.486511 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-523e12a0-1b6d-4b19-94da-ca5aaaf4f5d8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:28.487245 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-523e12a0-1b6d-4b19-94da-ca5aaaf4f5d8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:28.487705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-523e12a0-1b6d-4b19-94da-ca5aaaf4f5d8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:28.488135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-523e12a0-1b6d-4b19-94da-ca5aaaf4f5d8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:28.492914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=87 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:25:28.533326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-364d5834-2a9a-4522-8300-c05849c63712 req-e4b7994f-1188-4449-aae2-f4976cb50300 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf03bee0-66a6-43cf-8937-23694db7fe68", "tag": "63bed575-463f-4500-a956-312208b65bba"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:25:28.543926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-364d5834-2a9a-4522-8300-c05849c63712 req-e4b7994f-1188-4449-aae2-f4976cb50300 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:28.544501 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-364d5834-2a9a-4522-8300-c05849c63712 req-e4b7994f-1188-4449-aae2-f4976cb50300 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:28.545209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-364d5834-2a9a-4522-8300-c05849c63712 req-e4b7994f-1188-4449-aae2-f4976cb50300 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:28.557212 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-364d5834-2a9a-4522-8300-c05849c63712 req-e4b7994f-1188-4449-aae2-f4976cb50300 service nova] Creating event network-changed:63bed575-463f-4500-a956-312208b65bba for instance bf03bee0-66a6-43cf-8937-23694db7fe68 on n-h1-850468-16 Aug 23 19:25:28.562326 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-364d5834-2a9a-4522-8300-c05849c63712 req-e4b7994f-1188-4449-aae2-f4976cb50300 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034197 Aug 23 19:25:28.563230 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4106/8074] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:25:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:25:28.772424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-523e12a0-1b6d-4b19-94da-ca5aaaf4f5d8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:28.780925 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-523e12a0-1b6d-4b19-94da-ca5aaaf4f5d8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.307487 Aug 23 19:25:28.781509 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3969/8075] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:28 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:29.805491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3cc7e747-2115-4e4f-bd3d-6486bf57ad9c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:29.806219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3cc7e747-2115-4e4f-bd3d-6486bf57ad9c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:29.813205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cc7e747-2115-4e4f-bd3d-6486bf57ad9c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:29.813737 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cc7e747-2115-4e4f-bd3d-6486bf57ad9c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:29.814195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cc7e747-2115-4e4f-bd3d-6486bf57ad9c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:29.815149 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cc7e747-2115-4e4f-bd3d-6486bf57ad9c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:29.815847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cc7e747-2115-4e4f-bd3d-6486bf57ad9c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:29.816458 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3cc7e747-2115-4e4f-bd3d-6486bf57ad9c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:29.969642 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3cc7e747-2115-4e4f-bd3d-6486bf57ad9c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:29.978188 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3cc7e747-2115-4e4f-bd3d-6486bf57ad9c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.178916 Aug 23 19:25:29.978810 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4107/8076] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:29 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:31.000484 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c94225a3-7aac-493b-862d-c2c4f4b92142 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:31.001063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c94225a3-7aac-493b-862d-c2c4f4b92142 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:31.009355 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c94225a3-7aac-493b-862d-c2c4f4b92142 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:31.009853 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c94225a3-7aac-493b-862d-c2c4f4b92142 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:31.010297 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c94225a3-7aac-493b-862d-c2c4f4b92142 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:31.011040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c94225a3-7aac-493b-862d-c2c4f4b92142 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:31.011501 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c94225a3-7aac-493b-862d-c2c4f4b92142 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:31.011932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c94225a3-7aac-493b-862d-c2c4f4b92142 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:31.167408 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c94225a3-7aac-493b-862d-c2c4f4b92142 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:31.176433 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c94225a3-7aac-493b-862d-c2c4f4b92142 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.180232 Aug 23 19:25:31.191171 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3970/8077] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:30 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:32.202417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1612061c-56bc-47e2-9d94-c9eea2e86fa4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:32.203125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1612061c-56bc-47e2-9d94-c9eea2e86fa4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:32.209993 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1612061c-56bc-47e2-9d94-c9eea2e86fa4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:32.211153 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1612061c-56bc-47e2-9d94-c9eea2e86fa4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:32.211861 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1612061c-56bc-47e2-9d94-c9eea2e86fa4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:32.212456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1612061c-56bc-47e2-9d94-c9eea2e86fa4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:32.212930 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1612061c-56bc-47e2-9d94-c9eea2e86fa4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:32.213374 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1612061c-56bc-47e2-9d94-c9eea2e86fa4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:32.372376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1612061c-56bc-47e2-9d94-c9eea2e86fa4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:32.381112 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1612061c-56bc-47e2-9d94-c9eea2e86fa4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.185759 Aug 23 19:25:32.381858 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4108/8078] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:32 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:25:33.404168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-104872fb-ccf3-4ce6-88e0-1a77ce020f8d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:33.405179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-104872fb-ccf3-4ce6-88e0-1a77ce020f8d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:33.414651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-104872fb-ccf3-4ce6-88e0-1a77ce020f8d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:33.414651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-104872fb-ccf3-4ce6-88e0-1a77ce020f8d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:33.414651 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-104872fb-ccf3-4ce6-88e0-1a77ce020f8d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:33.415020 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-104872fb-ccf3-4ce6-88e0-1a77ce020f8d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:33.415348 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-104872fb-ccf3-4ce6-88e0-1a77ce020f8d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:33.415785 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-104872fb-ccf3-4ce6-88e0-1a77ce020f8d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:33.576358 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-104872fb-ccf3-4ce6-88e0-1a77ce020f8d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:33.585121 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-104872fb-ccf3-4ce6-88e0-1a77ce020f8d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.185595 Aug 23 19:25:33.585818 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3971/8079] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:33 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:34.606372 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b9d5d062-dfb3-4f66-a8b3-113879baa07e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:34.607049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b9d5d062-dfb3-4f66-a8b3-113879baa07e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:34.614298 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9d5d062-dfb3-4f66-a8b3-113879baa07e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:34.614823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9d5d062-dfb3-4f66-a8b3-113879baa07e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:34.615928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9d5d062-dfb3-4f66-a8b3-113879baa07e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:34.616657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9d5d062-dfb3-4f66-a8b3-113879baa07e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:34.617184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9d5d062-dfb3-4f66-a8b3-113879baa07e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:34.617565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b9d5d062-dfb3-4f66-a8b3-113879baa07e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:34.780045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b9d5d062-dfb3-4f66-a8b3-113879baa07e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:34.789188 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b9d5d062-dfb3-4f66-a8b3-113879baa07e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.186436 Aug 23 19:25:34.789797 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4109/8080] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:34 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:35.813026 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2a023e68-26fb-43f4-9ec4-4d706f35eb01 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:35.814033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2a023e68-26fb-43f4-9ec4-4d706f35eb01 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:35.821616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a023e68-26fb-43f4-9ec4-4d706f35eb01 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:35.822231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a023e68-26fb-43f4-9ec4-4d706f35eb01 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:35.822705 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a023e68-26fb-43f4-9ec4-4d706f35eb01 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:35.823424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a023e68-26fb-43f4-9ec4-4d706f35eb01 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:35.823936 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a023e68-26fb-43f4-9ec4-4d706f35eb01 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:35.824370 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2a023e68-26fb-43f4-9ec4-4d706f35eb01 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:35.979127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2a023e68-26fb-43f4-9ec4-4d706f35eb01 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:35.987121 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2a023e68-26fb-43f4-9ec4-4d706f35eb01 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.179237 Aug 23 19:25:35.987899 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3972/8081] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:35 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:37.009729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c2bdd7ba-d5ec-44a1-8985-1d980c1cbbb8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:37.010306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c2bdd7ba-d5ec-44a1-8985-1d980c1cbbb8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:37.017159 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2bdd7ba-d5ec-44a1-8985-1d980c1cbbb8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:37.017665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2bdd7ba-d5ec-44a1-8985-1d980c1cbbb8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:37.018133 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2bdd7ba-d5ec-44a1-8985-1d980c1cbbb8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:37.018892 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2bdd7ba-d5ec-44a1-8985-1d980c1cbbb8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:37.019369 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2bdd7ba-d5ec-44a1-8985-1d980c1cbbb8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:37.019818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c2bdd7ba-d5ec-44a1-8985-1d980c1cbbb8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:37.179358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c2bdd7ba-d5ec-44a1-8985-1d980c1cbbb8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:37.187822 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c2bdd7ba-d5ec-44a1-8985-1d980c1cbbb8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.183035 Aug 23 19:25:37.188409 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4110/8082] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:37 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:38.210613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-20c08481-31af-42ff-9c3e-91719b2a43a9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:38.211264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-20c08481-31af-42ff-9c3e-91719b2a43a9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:38.218085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20c08481-31af-42ff-9c3e-91719b2a43a9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:38.218602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20c08481-31af-42ff-9c3e-91719b2a43a9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:38.219047 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20c08481-31af-42ff-9c3e-91719b2a43a9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:38.219745 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20c08481-31af-42ff-9c3e-91719b2a43a9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:38.220203 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20c08481-31af-42ff-9c3e-91719b2a43a9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:38.220632 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-20c08481-31af-42ff-9c3e-91719b2a43a9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:38.359795 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-20c08481-31af-42ff-9c3e-91719b2a43a9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:38.368284 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-20c08481-31af-42ff-9c3e-91719b2a43a9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.162235 Aug 23 19:25:38.368864 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3973/8083] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:38 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:39.390608 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-855f5897-21b0-4f76-b476-4d5c8fb4d8c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:39.391275 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-855f5897-21b0-4f76-b476-4d5c8fb4d8c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:39.398756 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-855f5897-21b0-4f76-b476-4d5c8fb4d8c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:39.399264 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-855f5897-21b0-4f76-b476-4d5c8fb4d8c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:39.399722 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-855f5897-21b0-4f76-b476-4d5c8fb4d8c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:39.400442 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-855f5897-21b0-4f76-b476-4d5c8fb4d8c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:39.400916 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-855f5897-21b0-4f76-b476-4d5c8fb4d8c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:39.401363 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-855f5897-21b0-4f76-b476-4d5c8fb4d8c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:39.535083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-855f5897-21b0-4f76-b476-4d5c8fb4d8c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:39.543564 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-855f5897-21b0-4f76-b476-4d5c8fb4d8c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.156968 Aug 23 19:25:39.544152 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4111/8084] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:39 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:40.565289 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b36488a-4bd1-4bde-8ab5-a2b39ec05764 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:40.565914 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b36488a-4bd1-4bde-8ab5-a2b39ec05764 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:40.572952 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b36488a-4bd1-4bde-8ab5-a2b39ec05764 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:40.573443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b36488a-4bd1-4bde-8ab5-a2b39ec05764 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:40.573885 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b36488a-4bd1-4bde-8ab5-a2b39ec05764 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:40.574613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b36488a-4bd1-4bde-8ab5-a2b39ec05764 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:40.575076 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b36488a-4bd1-4bde-8ab5-a2b39ec05764 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:40.575508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b36488a-4bd1-4bde-8ab5-a2b39ec05764 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:40.713535 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3b36488a-4bd1-4bde-8ab5-a2b39ec05764 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:40.721310 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3b36488a-4bd1-4bde-8ab5-a2b39ec05764 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.159940 Aug 23 19:25:40.721886 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3974/8085] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:40 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:41.743199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c4dca507-36bc-4e43-8a35-7d231b0d3350 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:41.743836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c4dca507-36bc-4e43-8a35-7d231b0d3350 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:41.750805 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4dca507-36bc-4e43-8a35-7d231b0d3350 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:41.751313 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4dca507-36bc-4e43-8a35-7d231b0d3350 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:41.751776 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4dca507-36bc-4e43-8a35-7d231b0d3350 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:41.752499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4dca507-36bc-4e43-8a35-7d231b0d3350 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:41.752978 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4dca507-36bc-4e43-8a35-7d231b0d3350 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:41.753424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c4dca507-36bc-4e43-8a35-7d231b0d3350 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:41.891351 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c4dca507-36bc-4e43-8a35-7d231b0d3350 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:41.900046 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c4dca507-36bc-4e43-8a35-7d231b0d3350 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.161610 Aug 23 19:25:41.900616 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4112/8086] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:41 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:42.921244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9b5c475e-a761-4d8d-8486-ec1eabfb9760 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:42.921764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9b5c475e-a761-4d8d-8486-ec1eabfb9760 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:42.929714 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b5c475e-a761-4d8d-8486-ec1eabfb9760 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:42.930195 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b5c475e-a761-4d8d-8486-ec1eabfb9760 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:42.930672 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b5c475e-a761-4d8d-8486-ec1eabfb9760 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:42.931365 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b5c475e-a761-4d8d-8486-ec1eabfb9760 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:42.931817 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b5c475e-a761-4d8d-8486-ec1eabfb9760 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:42.932239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b5c475e-a761-4d8d-8486-ec1eabfb9760 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:43.071197 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9b5c475e-a761-4d8d-8486-ec1eabfb9760 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:43.078867 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9b5c475e-a761-4d8d-8486-ec1eabfb9760 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.161531 Aug 23 19:25:43.079440 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3975/8087] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:42 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:44.101833 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f2383b2b-8842-41ef-a48f-64950a269fbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:44.102596 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f2383b2b-8842-41ef-a48f-64950a269fbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:44.109425 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2383b2b-8842-41ef-a48f-64950a269fbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:44.109925 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2383b2b-8842-41ef-a48f-64950a269fbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:44.110379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2383b2b-8842-41ef-a48f-64950a269fbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:44.111117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2383b2b-8842-41ef-a48f-64950a269fbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:44.111587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2383b2b-8842-41ef-a48f-64950a269fbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:44.112032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f2383b2b-8842-41ef-a48f-64950a269fbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:44.244724 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f2383b2b-8842-41ef-a48f-64950a269fbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:44.252864 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f2383b2b-8842-41ef-a48f-64950a269fbd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.156137 Aug 23 19:25:44.253554 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4113/8088] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:44 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:45.263753 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-2503013b-d0ec-4ee2-8231-53399c6d66b0 req-1e5ecd10-2455-4ed8-8b19-59cd9b9e9438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf03bee0-66a6-43cf-8937-23694db7fe68", "name": "network-vif-plugged", "status": "completed", "tag": "63bed575-463f-4500-a956-312208b65bba"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:25:45.273946 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2503013b-d0ec-4ee2-8231-53399c6d66b0 req-1e5ecd10-2455-4ed8-8b19-59cd9b9e9438 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:45.274122 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-6958590c-d59d-4210-8107-935d9385b6ca tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:45.274567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2503013b-d0ec-4ee2-8231-53399c6d66b0 req-1e5ecd10-2455-4ed8-8b19-59cd9b9e9438 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:45.274688 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-6958590c-d59d-4210-8107-935d9385b6ca tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:45.274801 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-2503013b-d0ec-4ee2-8231-53399c6d66b0 req-1e5ecd10-2455-4ed8-8b19-59cd9b9e9438 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:45.281590 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6958590c-d59d-4210-8107-935d9385b6ca tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:45.282098 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6958590c-d59d-4210-8107-935d9385b6ca tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:45.282584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6958590c-d59d-4210-8107-935d9385b6ca tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:45.283563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6958590c-d59d-4210-8107-935d9385b6ca tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:45.284038 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6958590c-d59d-4210-8107-935d9385b6ca tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:45.284486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-6958590c-d59d-4210-8107-935d9385b6ca tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:45.285960 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-2503013b-d0ec-4ee2-8231-53399c6d66b0 req-1e5ecd10-2455-4ed8-8b19-59cd9b9e9438 service nova] Creating event network-vif-plugged:63bed575-463f-4500-a956-312208b65bba for instance bf03bee0-66a6-43cf-8937-23694db7fe68 on n-h1-850468-16 Aug 23 19:25:45.291176 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-2503013b-d0ec-4ee2-8231-53399c6d66b0 req-1e5ecd10-2455-4ed8-8b19-59cd9b9e9438 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101056 Aug 23 19:25:45.291947 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3976/8089] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:25:45.432286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-6958590c-d59d-4210-8107-935d9385b6ca tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:45.440236 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-6958590c-d59d-4210-8107-935d9385b6ca tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.170656 Aug 23 19:25:45.440811 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4114/8090] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:45 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:25:46.464264 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3b600fdc-1c5e-4733-afdb-0f3767654be3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:46.464969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3b600fdc-1c5e-4733-afdb-0f3767654be3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:46.471201 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b600fdc-1c5e-4733-afdb-0f3767654be3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:46.471678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b600fdc-1c5e-4733-afdb-0f3767654be3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:46.472113 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b600fdc-1c5e-4733-afdb-0f3767654be3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:46.472799 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b600fdc-1c5e-4733-afdb-0f3767654be3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:46.473253 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b600fdc-1c5e-4733-afdb-0f3767654be3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:46.473679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3b600fdc-1c5e-4733-afdb-0f3767654be3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:46.614280 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3b600fdc-1c5e-4733-afdb-0f3767654be3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:46.623443 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3b600fdc-1c5e-4733-afdb-0f3767654be3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1688 microversion: 2.1 time: 0.165648 Aug 23 19:25:46.624037 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3977/8091] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:46 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1688 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:25:47.645402 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d16db494-726b-4501-92ee-1fea611a286f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:25:47.646893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d16db494-726b-4501-92ee-1fea611a286f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:25:47.653714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d16db494-726b-4501-92ee-1fea611a286f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:47.654208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d16db494-726b-4501-92ee-1fea611a286f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:47.654761 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d16db494-726b-4501-92ee-1fea611a286f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:47.655466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d16db494-726b-4501-92ee-1fea611a286f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:25:47.655931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d16db494-726b-4501-92ee-1fea611a286f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:25:47.656371 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d16db494-726b-4501-92ee-1fea611a286f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:25:47.794661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d16db494-726b-4501-92ee-1fea611a286f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:25:47.802525 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d16db494-726b-4501-92ee-1fea611a286f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1675 microversion: 2.1 time: 0.161025 Aug 23 19:25:47.803663 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4115/8092] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:25:47 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:27:33.954440 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=17 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:27:33.955223 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=49 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:27:33.958719 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=21 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:27:33.959543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=64,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:27:33.969702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c7a738b5-60dd-42fa-8cdd-41f059439c56 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:27:33.972453 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7a738b5-60dd-42fa-8cdd-41f059439c56 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:27:33.981273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7a738b5-60dd-42fa-8cdd-41f059439c56 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:33.981762 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7a738b5-60dd-42fa-8cdd-41f059439c56 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:33.982383 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7a738b5-60dd-42fa-8cdd-41f059439c56 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:33.984215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7a738b5-60dd-42fa-8cdd-41f059439c56 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:33.984957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7a738b5-60dd-42fa-8cdd-41f059439c56 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:33.985554 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7a738b5-60dd-42fa-8cdd-41f059439c56 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:34.011036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7a738b5-60dd-42fa-8cdd-41f059439c56 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:27:34.040128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-a674aed6-7c2d-4af3-8f8b-b2e1e2b555e0 req-ea89b734-1bc6-4e1b-89e5-5fd9ba2b628e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf03bee0-66a6-43cf-8937-23694db7fe68", "tag": "63bed575-463f-4500-a956-312208b65bba"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:27:34.050287 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a674aed6-7c2d-4af3-8f8b-b2e1e2b555e0 req-ea89b734-1bc6-4e1b-89e5-5fd9ba2b628e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:34.051430 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a674aed6-7c2d-4af3-8f8b-b2e1e2b555e0 req-ea89b734-1bc6-4e1b-89e5-5fd9ba2b628e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:34.051895 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-a674aed6-7c2d-4af3-8f8b-b2e1e2b555e0 req-ea89b734-1bc6-4e1b-89e5-5fd9ba2b628e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:34.063785 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-a674aed6-7c2d-4af3-8f8b-b2e1e2b555e0 req-ea89b734-1bc6-4e1b-89e5-5fd9ba2b628e service nova] Creating event network-changed:63bed575-463f-4500-a956-312208b65bba for instance bf03bee0-66a6-43cf-8937-23694db7fe68 on n-h1-850468-16 Aug 23 19:27:34.069340 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-a674aed6-7c2d-4af3-8f8b-b2e1e2b555e0 req-ea89b734-1bc6-4e1b-89e5-5fd9ba2b628e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112585 Aug 23 19:27:34.070107 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4116/8093] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:27:34.095723 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c7a738b5-60dd-42fa-8cdd-41f059439c56 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "DELETE /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 204 len: 0 microversion: 2.1 time: 0.143941 Aug 23 19:27:34.096503 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3978/8094] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:27:33 2022] DELETE /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:27:34.105620 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-aec0004c-b294-4901-ba4f-4d6e2098d878 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:27:34.106346 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-aec0004c-b294-4901-ba4f-4d6e2098d878 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:27:34.114556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aec0004c-b294-4901-ba4f-4d6e2098d878 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:34.114556 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aec0004c-b294-4901-ba4f-4d6e2098d878 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:34.114847 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aec0004c-b294-4901-ba4f-4d6e2098d878 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:34.115387 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aec0004c-b294-4901-ba4f-4d6e2098d878 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:34.115858 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aec0004c-b294-4901-ba4f-4d6e2098d878 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:34.116303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-aec0004c-b294-4901-ba4f-4d6e2098d878 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:34.309261 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-aec0004c-b294-4901-ba4f-4d6e2098d878 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:27:34.317670 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-aec0004c-b294-4901-ba4f-4d6e2098d878 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1681 microversion: 2.1 time: 0.216346 Aug 23 19:27:34.318245 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4117/8095] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:27:34 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:27:35.340761 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-bf7ed598-2f8f-4a8d-9548-9d20991de167 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:27:35.341659 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-bf7ed598-2f8f-4a8d-9548-9d20991de167 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:27:35.349855 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf7ed598-2f8f-4a8d-9548-9d20991de167 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:35.350341 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf7ed598-2f8f-4a8d-9548-9d20991de167 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:35.350823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf7ed598-2f8f-4a8d-9548-9d20991de167 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:35.351561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf7ed598-2f8f-4a8d-9548-9d20991de167 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:35.352014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf7ed598-2f8f-4a8d-9548-9d20991de167 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:35.352441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-bf7ed598-2f8f-4a8d-9548-9d20991de167 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:35.612025 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-bf7ed598-2f8f-4a8d-9548-9d20991de167 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:27:35.620627 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-bf7ed598-2f8f-4a8d-9548-9d20991de167 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1681 microversion: 2.1 time: 0.284345 Aug 23 19:27:35.621301 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3979/8096] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:27:35 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1681 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:27:36.334741 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-fa3ade58-3e27-4b2b-a9f8-32d8283dc1f4 req-552e2839-7c1d-4638-83b0-f511a5df9996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf03bee0-66a6-43cf-8937-23694db7fe68", "name": "network-vif-deleted", "tag": "63bed575-463f-4500-a956-312208b65bba"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:27:36.345314 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fa3ade58-3e27-4b2b-a9f8-32d8283dc1f4 req-552e2839-7c1d-4638-83b0-f511a5df9996 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:36.346091 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fa3ade58-3e27-4b2b-a9f8-32d8283dc1f4 req-552e2839-7c1d-4638-83b0-f511a5df9996 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:36.346559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-fa3ade58-3e27-4b2b-a9f8-32d8283dc1f4 req-552e2839-7c1d-4638-83b0-f511a5df9996 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:36.362831 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-fa3ade58-3e27-4b2b-a9f8-32d8283dc1f4 req-552e2839-7c1d-4638-83b0-f511a5df9996 service nova] Creating event network-vif-deleted:63bed575-463f-4500-a956-312208b65bba for instance bf03bee0-66a6-43cf-8937-23694db7fe68 on n-h1-850468-16 Aug 23 19:27:36.368100 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-fa3ade58-3e27-4b2b-a9f8-32d8283dc1f4 req-552e2839-7c1d-4638-83b0-f511a5df9996 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098167 Aug 23 19:27:36.368716 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4118/8097] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:27:36.643890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:27:36.645222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:27:36.652950 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:36.653974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:36.655311 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:36.656224 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:36.656858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:36.657482 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:36.707276 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:36.707774 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:36.708217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:36.708681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lazy-loading 'fault' on Instance uuid bf03bee0-66a6-43cf-8937-23694db7fe68 {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:27:36.753240 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:27:36.762028 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b152173d-dd89-40a5-856e-1aa14fabc48f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 200 len: 1336 microversion: 2.1 time: 0.122565 Aug 23 19:27:36.774564 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3980/8098] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:27:36 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 1336 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:27:37.786018 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8965fd11-df9d-489d-838e-485d422a7d3e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:27:37.786729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8965fd11-df9d-489d-838e-485d422a7d3e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: bf03bee0-66a6-43cf-8937-23694db7fe68] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:27:37.793815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8965fd11-df9d-489d-838e-485d422a7d3e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:37.794316 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8965fd11-df9d-489d-838e-485d422a7d3e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:37.794802 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8965fd11-df9d-489d-838e-485d422a7d3e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:37.796158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8965fd11-df9d-489d-838e-485d422a7d3e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:37.796502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8965fd11-df9d-489d-838e-485d422a7d3e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:37.796941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8965fd11-df9d-489d-838e-485d422a7d3e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:37.810175 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-8965fd11-df9d-489d-838e-485d422a7d3e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] HTTP exception thrown: Instance bf03bee0-66a6-43cf-8937-23694db7fe68 could not be found. Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8965fd11-df9d-489d-838e-485d422a7d3e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Request method failure captured: Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 HTTP/1.1 Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBSjdip_e7vhtc3FW00oXcOV84no-Fm0mYNNPigBn2duz1asOpE04vDjf-5Y3DJaExpgzntztUr-svKxBr1Ftq9wrQidmb7sKP1CWpLlUE3Wt3klYfOnKzIrau9j7XZWKgOuVM21M48B9tagIWqFetlE599otXICB_OVSNKeySfCEI_w Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: fe1c90987d924f30b44cdf96f95a06b7 Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestShelveInstance-716732151 Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fe1c90987d924f30b44cdf96f95a06b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe1c90987d924f30b44cdf96f95a06b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fe1c90987d924f30b44cdf96f95a06b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe1c90987d924f30b44cdf96f95a06b7"}]}] Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestShelveInstance-716732151 Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: fe1c90987d924f30b44cdf96f95a06b7 Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestShelveInstance-716732151 Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestShelveInstance-716732151-project Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 09e640037b8a4b84a0d3ea13d1db365a Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestShelveInstance-716732151-project Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance bf03bee0-66a6-43cf-8937-23694db7fe68 could not be found. Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': 'bf03bee0-66a6-43cf-8937-23694db7fe68'} Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf03bee0-66a6-43cf-8937-23694db7fe68 could not be found. Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf03bee0-66a6-43cf-8937-23694db7fe68 could not be found. Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:27:37.812736 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:27:37.817784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:27:37.817784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:27:37.817784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:27:37.817784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:27:37.817784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:27:37.817784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf03bee0-66a6-43cf-8937-23694db7fe68 could not be found. Aug 23 19:27:37.817784 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:27:37.817784 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8965fd11-df9d-489d-838e-485d422a7d3e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Returning 404 to user: Instance bf03bee0-66a6-43cf-8937-23694db7fe68 could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:27:37.817784 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8965fd11-df9d-489d-838e-485d422a7d3e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68" status: 404 len: 111 microversion: 2.1 time: 0.032602 Aug 23 19:27:37.817784 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4119/8099] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:27:37 2022] GET /compute/v2.1/servers/bf03bee0-66a6-43cf-8937-23694db7fe68 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:27:37.979523 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-71ed97cc-0571-4d81-b203-93957278a40a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '.version_select at 0x7f27dfa92280>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:27:37.987189 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [None req-71ed97cc-0571-4d81-b203-93957278a40a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [5b22d8ef-03cc-4341-ab6b-d5561bf06d31] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:27:38.994566 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [None req-71ed97cc-0571-4d81-b203-93957278a40a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [5b22d8ef-03cc-4341-ab6b-d5561bf06d31] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36838. Aug 23 19:27:39.016803 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-71ed97cc-0571-4d81-b203-93957278a40a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1607716027" status: 202 len: 0 microversion: 2.1 time: 1.041093 Aug 23 19:27:39.017388 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3981/8100] 10.222.0.61 () {58 vars in 1254 bytes} [Tue Aug 23 19:27:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1607716027 => generated 0 bytes in 1042 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:27:39.043243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-df804635-b6fc-4a5b-a83a-39af4d084fa2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Action: 'create', calling method: .version_select at 0x7f27ec891af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2102179235", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPDfHJrSq93ImYsrkkay8n9gfd9q42bi1UIsGjLQB/Xmw1ydiOTb+5/N6hqiJpq576dKJGlhyPNssyBLzYCVXCF8PLOo/GZhrgOtXa8yqqiS1Obf/rLGIQ0casngrO7Ffg=="}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:27:39.061017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-df804635-b6fc-4a5b-a83a-39af4d084fa2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Getting quotas for project fe1c90987d924f30b44cdf96f95a06b7. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:27:39.067187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-df804635-b6fc-4a5b-a83a-39af4d084fa2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Getting quotas for user 09e640037b8a4b84a0d3ea13d1db365a and project fe1c90987d924f30b44cdf96f95a06b7. Resources: {'key_pairs'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:27:39.081106 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [None req-df804635-b6fc-4a5b-a83a-39af4d084fa2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [ee013254-ad44-4cb4-b5e8-493e981442a5] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:27:40.087920 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [None req-df804635-b6fc-4a5b-a83a-39af4d084fa2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [ee013254-ad44-4cb4-b5e8-493e981442a5] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 36842. Aug 23 19:27:40.104651 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-df804635-b6fc-4a5b-a83a-39af4d084fa2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 1.065374 Aug 23 19:27:40.105264 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4120/8101] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 19:27:39 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:27:41.458789 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:27:41.459489 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:27:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:27:41.917620 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:27:41.918237 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:27:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:27:56.351884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:27:56.352640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:27:56.356720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1966171158", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2102179235", "security_groups": [{"name": "tempest-secgroup-smoke-823638086"}], "networks": [{"uuid": "8a4f9d82-c3d2-40ba-a208-e331586e16a2"}], "block_device_mapping_v2": [{"uuid": "ecefa0fa-ce03-4bdb-89a8-2ebc03963692", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:27:56.474254 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] validate_networks() for [('8a4f9d82-c3d2-40ba-a208-e331586e16a2', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:27:56.891793 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:27:56.892275 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:27:56.892757 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:27:56.893173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:27:56.893592 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:27:56.902982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:56.903470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:56.903985 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:56.905621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:56.906329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:56.906784 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:56.923882 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Getting quotas for project fe1c90987d924f30b44cdf96f95a06b7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:27:56.929082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Getting quotas for user 09e640037b8a4b84a0d3ea13d1db365a and project fe1c90987d924f30b44cdf96f95a06b7. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:27:56.988701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:27:56.990937 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ecefa0fa-ce03-4bdb-89a8-2ebc03963692',volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:27:57.121222 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-b91a3dfd-2bf8-45bc-9fec-8c05727b2dd9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.770935 Aug 23 19:27:57.121896 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3982/8102] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:27:56 2022] POST /compute/v2.1/servers => generated 405 bytes in 772 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:27:57.131654 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=12 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:27:57.132433 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=4 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:27:57.133190 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:27:57.137349 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-01d3afcd-503a-4a39-8b9c-23894b545fc1 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:27:57.138104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-01d3afcd-503a-4a39-8b9c-23894b545fc1 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:27:57.205054 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-01d3afcd-503a-4a39-8b9c-23894b545fc1 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:27:57.212408 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-01d3afcd-503a-4a39-8b9c-23894b545fc1 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1089 microversion: 2.1 time: 0.082411 Aug 23 19:27:57.212963 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4121/8103] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:27:57 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1089 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:27:58.234581 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9dafbf74-85ca-405d-964e-7561f592e6a2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:27:58.235219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9dafbf74-85ca-405d-964e-7561f592e6a2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:27:58.241337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dafbf74-85ca-405d-964e-7561f592e6a2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:58.242072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dafbf74-85ca-405d-964e-7561f592e6a2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:58.242558 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dafbf74-85ca-405d-964e-7561f592e6a2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:58.243766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dafbf74-85ca-405d-964e-7561f592e6a2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:58.243766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dafbf74-85ca-405d-964e-7561f592e6a2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:58.244152 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9dafbf74-85ca-405d-964e-7561f592e6a2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:58.310395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9dafbf74-85ca-405d-964e-7561f592e6a2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:27:58.319920 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9dafbf74-85ca-405d-964e-7561f592e6a2 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1205 microversion: 2.1 time: 0.090588 Aug 23 19:27:58.320525 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3983/8104] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:27:58 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1205 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:27:59.341254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-56fe328f-f1c4-4c55-b9be-7a20a515c7f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:27:59.341882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-56fe328f-f1c4-4c55-b9be-7a20a515c7f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:27:59.348953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56fe328f-f1c4-4c55-b9be-7a20a515c7f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:59.349456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56fe328f-f1c4-4c55-b9be-7a20a515c7f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:59.349905 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56fe328f-f1c4-4c55-b9be-7a20a515c7f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:59.350884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56fe328f-f1c4-4c55-b9be-7a20a515c7f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:59.351432 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56fe328f-f1c4-4c55-b9be-7a20a515c7f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:59.351877 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-56fe328f-f1c4-4c55-b9be-7a20a515c7f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:59.551409 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-56fe328f-f1c4-4c55-b9be-7a20a515c7f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:27:59.559449 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-56fe328f-f1c4-4c55-b9be-7a20a515c7f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1272 microversion: 2.1 time: 0.222256 Aug 23 19:27:59.560019 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4122/8105] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:27:59 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1272 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:27:59.649942 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-c8bd71a3-2247-4ea6-9681-eef212c4974d req-aa1763bc-8c89-4467-a448-e644e622b2b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7008ba-fba6-44a2-af43-7222b4d246a1", "tag": "dbfb02c4-a658-4666-af7d-aba218784121"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:27:59.662213 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c8bd71a3-2247-4ea6-9681-eef212c4974d req-aa1763bc-8c89-4467-a448-e644e622b2b1 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:27:59.662820 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c8bd71a3-2247-4ea6-9681-eef212c4974d req-aa1763bc-8c89-4467-a448-e644e622b2b1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:27:59.663479 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-c8bd71a3-2247-4ea6-9681-eef212c4974d req-aa1763bc-8c89-4467-a448-e644e622b2b1 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:27:59.678165 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-c8bd71a3-2247-4ea6-9681-eef212c4974d req-aa1763bc-8c89-4467-a448-e644e622b2b1 service nova] Creating event network-changed:dbfb02c4-a658-4666-af7d-aba218784121 for instance 1c7008ba-fba6-44a2-af43-7222b4d246a1 on n-h2-850468-16 Aug 23 19:27:59.684363 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-c8bd71a3-2247-4ea6-9681-eef212c4974d req-aa1763bc-8c89-4467-a448-e644e622b2b1 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038266 Aug 23 19:27:59.684905 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3984/8106] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:28:00.581882 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f9269195-6cbd-4578-a00c-43cc8d7ac8ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:00.582517 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f9269195-6cbd-4578-a00c-43cc8d7ac8ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:00.589964 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9269195-6cbd-4578-a00c-43cc8d7ac8ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:00.590479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9269195-6cbd-4578-a00c-43cc8d7ac8ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:00.590959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9269195-6cbd-4578-a00c-43cc8d7ac8ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:00.591904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9269195-6cbd-4578-a00c-43cc8d7ac8ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:00.593002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9269195-6cbd-4578-a00c-43cc8d7ac8ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:00.593912 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f9269195-6cbd-4578-a00c-43cc8d7ac8ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:00.731963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f9269195-6cbd-4578-a00c-43cc8d7ac8ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:00.740424 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f9269195-6cbd-4578-a00c-43cc8d7ac8ed tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1272 microversion: 2.1 time: 0.162976 Aug 23 19:28:00.741002 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4123/8107] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:00 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1272 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:28:01.763436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3e6972bc-2e47-481b-b176-c15fa25988c8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:01.764561 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3e6972bc-2e47-481b-b176-c15fa25988c8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:01.770941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e6972bc-2e47-481b-b176-c15fa25988c8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:01.771436 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e6972bc-2e47-481b-b176-c15fa25988c8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:01.771872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e6972bc-2e47-481b-b176-c15fa25988c8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:01.772574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e6972bc-2e47-481b-b176-c15fa25988c8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:01.773061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e6972bc-2e47-481b-b176-c15fa25988c8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:01.773491 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3e6972bc-2e47-481b-b176-c15fa25988c8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:01.907713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3e6972bc-2e47-481b-b176-c15fa25988c8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:01.916442 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3e6972bc-2e47-481b-b176-c15fa25988c8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1272 microversion: 2.1 time: 0.158309 Aug 23 19:28:01.917230 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3985/8108] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:01 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1272 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:02.938289 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-9d69475b-b16b-439e-85d7-9df8877d33c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:02.938960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-9d69475b-b16b-439e-85d7-9df8877d33c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:02.946202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d69475b-b16b-439e-85d7-9df8877d33c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:02.946950 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d69475b-b16b-439e-85d7-9df8877d33c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:02.947429 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d69475b-b16b-439e-85d7-9df8877d33c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:02.948176 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d69475b-b16b-439e-85d7-9df8877d33c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:02.948667 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d69475b-b16b-439e-85d7-9df8877d33c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:02.949109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-9d69475b-b16b-439e-85d7-9df8877d33c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:03.094205 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-9d69475b-b16b-439e-85d7-9df8877d33c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:03.102410 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-9d69475b-b16b-439e-85d7-9df8877d33c5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1272 microversion: 2.1 time: 0.168890 Aug 23 19:28:03.102926 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4124/8109] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:02 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:04.126018 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9a5f34bc-506f-4ddb-87c7-8cabef720460 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:04.126609 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9a5f34bc-506f-4ddb-87c7-8cabef720460 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:04.133418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a5f34bc-506f-4ddb-87c7-8cabef720460 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:04.133899 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a5f34bc-506f-4ddb-87c7-8cabef720460 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:04.134333 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a5f34bc-506f-4ddb-87c7-8cabef720460 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:04.135053 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a5f34bc-506f-4ddb-87c7-8cabef720460 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:04.135507 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a5f34bc-506f-4ddb-87c7-8cabef720460 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:04.135938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9a5f34bc-506f-4ddb-87c7-8cabef720460 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:04.274029 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9a5f34bc-506f-4ddb-87c7-8cabef720460 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:04.283039 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9a5f34bc-506f-4ddb-87c7-8cabef720460 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1260 microversion: 2.1 time: 0.161564 Aug 23 19:28:04.283616 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3986/8110] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:04 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:05.304726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1af62569-22f5-4d21-b40e-081077446da0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:05.305379 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1af62569-22f5-4d21-b40e-081077446da0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:05.312960 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1af62569-22f5-4d21-b40e-081077446da0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:05.313459 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1af62569-22f5-4d21-b40e-081077446da0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:05.313913 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1af62569-22f5-4d21-b40e-081077446da0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:05.314655 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1af62569-22f5-4d21-b40e-081077446da0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:05.315127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1af62569-22f5-4d21-b40e-081077446da0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:05.315568 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1af62569-22f5-4d21-b40e-081077446da0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:05.446657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1af62569-22f5-4d21-b40e-081077446da0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:05.455404 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1af62569-22f5-4d21-b40e-081077446da0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1260 microversion: 2.1 time: 0.154675 Aug 23 19:28:05.455978 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4125/8111] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:05 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:06.475402 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c4fdbf9-19fb-402c-8c78-f8d999f45618 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:06.476027 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1c4fdbf9-19fb-402c-8c78-f8d999f45618 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:06.482948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c4fdbf9-19fb-402c-8c78-f8d999f45618 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:06.483443 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c4fdbf9-19fb-402c-8c78-f8d999f45618 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:06.483887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c4fdbf9-19fb-402c-8c78-f8d999f45618 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:06.484590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c4fdbf9-19fb-402c-8c78-f8d999f45618 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:06.485057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c4fdbf9-19fb-402c-8c78-f8d999f45618 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:06.485489 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c4fdbf9-19fb-402c-8c78-f8d999f45618 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:06.626449 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1c4fdbf9-19fb-402c-8c78-f8d999f45618 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:06.637973 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c4fdbf9-19fb-402c-8c78-f8d999f45618 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1260 microversion: 2.1 time: 0.166159 Aug 23 19:28:06.638755 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3987/8112] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:06 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:07.660084 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-082f27af-84f4-4fe7-bdf6-b0b49a64e19f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:07.660723 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-082f27af-84f4-4fe7-bdf6-b0b49a64e19f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:07.663551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:28:07.669257 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-082f27af-84f4-4fe7-bdf6-b0b49a64e19f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:07.669768 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-082f27af-84f4-4fe7-bdf6-b0b49a64e19f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:07.670283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-082f27af-84f4-4fe7-bdf6-b0b49a64e19f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:07.671131 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-082f27af-84f4-4fe7-bdf6-b0b49a64e19f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:07.671611 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-082f27af-84f4-4fe7-bdf6-b0b49a64e19f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:07.672085 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-082f27af-84f4-4fe7-bdf6-b0b49a64e19f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:07.809572 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-082f27af-84f4-4fe7-bdf6-b0b49a64e19f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:07.818066 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-082f27af-84f4-4fe7-bdf6-b0b49a64e19f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1260 microversion: 2.1 time: 0.161911 Aug 23 19:28:07.818669 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4126/8113] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:07 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:08.839477 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-3fcb3a65-5e0a-423f-980c-9fe0a4d35307 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:08.840100 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-3fcb3a65-5e0a-423f-980c-9fe0a4d35307 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:08.842716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:28:08.843685 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:28:08.850154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3fcb3a65-5e0a-423f-980c-9fe0a4d35307 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:08.850807 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3fcb3a65-5e0a-423f-980c-9fe0a4d35307 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:08.851265 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3fcb3a65-5e0a-423f-980c-9fe0a4d35307 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:08.851979 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3fcb3a65-5e0a-423f-980c-9fe0a4d35307 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:08.852441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3fcb3a65-5e0a-423f-980c-9fe0a4d35307 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:08.852870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-3fcb3a65-5e0a-423f-980c-9fe0a4d35307 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:08.988836 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-3fcb3a65-5e0a-423f-980c-9fe0a4d35307 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:08.996832 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-3fcb3a65-5e0a-423f-980c-9fe0a4d35307 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1260 microversion: 2.1 time: 0.161407 Aug 23 19:28:08.997394 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3988/8114] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:08 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:10.018632 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-569f28b0-3604-4a4e-bdae-59f0851ce5e6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:10.019195 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-569f28b0-3604-4a4e-bdae-59f0851ce5e6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:10.026301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-569f28b0-3604-4a4e-bdae-59f0851ce5e6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:10.026831 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-569f28b0-3604-4a4e-bdae-59f0851ce5e6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:10.027293 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-569f28b0-3604-4a4e-bdae-59f0851ce5e6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:10.028004 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-569f28b0-3604-4a4e-bdae-59f0851ce5e6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:10.028477 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-569f28b0-3604-4a4e-bdae-59f0851ce5e6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:10.028921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-569f28b0-3604-4a4e-bdae-59f0851ce5e6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:10.159607 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-569f28b0-3604-4a4e-bdae-59f0851ce5e6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:10.167345 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-569f28b0-3604-4a4e-bdae-59f0851ce5e6 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1260 microversion: 2.1 time: 0.152720 Aug 23 19:28:10.167922 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4127/8115] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:10 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:11.189409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9b2137b2-0618-452e-bd66-60bf46f366c7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:11.190054 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9b2137b2-0618-452e-bd66-60bf46f366c7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:11.197598 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b2137b2-0618-452e-bd66-60bf46f366c7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:11.198084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b2137b2-0618-452e-bd66-60bf46f366c7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:11.198525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b2137b2-0618-452e-bd66-60bf46f366c7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:11.199237 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b2137b2-0618-452e-bd66-60bf46f366c7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:11.199689 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b2137b2-0618-452e-bd66-60bf46f366c7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:11.200112 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9b2137b2-0618-452e-bd66-60bf46f366c7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:11.331526 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9b2137b2-0618-452e-bd66-60bf46f366c7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:11.339759 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9b2137b2-0618-452e-bd66-60bf46f366c7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1260 microversion: 2.1 time: 0.155028 Aug 23 19:28:11.340338 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3989/8116] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:11 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:12.361730 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-68c7853a-062a-4d22-bead-1001dac9e277 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:12.362274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-68c7853a-062a-4d22-bead-1001dac9e277 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:12.369039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68c7853a-062a-4d22-bead-1001dac9e277 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:12.369538 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68c7853a-062a-4d22-bead-1001dac9e277 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:12.369985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68c7853a-062a-4d22-bead-1001dac9e277 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:12.370713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68c7853a-062a-4d22-bead-1001dac9e277 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:12.371179 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68c7853a-062a-4d22-bead-1001dac9e277 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:12.371615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-68c7853a-062a-4d22-bead-1001dac9e277 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:12.507465 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-68c7853a-062a-4d22-bead-1001dac9e277 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:12.515415 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-68c7853a-062a-4d22-bead-1001dac9e277 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1260 microversion: 2.1 time: 0.158409 Aug 23 19:28:12.515996 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4128/8117] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:12 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:13.535586 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-4cd42f79-0231-4d0a-b772-c8ce10c4b3f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:13.536244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-4cd42f79-0231-4d0a-b772-c8ce10c4b3f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:13.543618 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd42f79-0231-4d0a-b772-c8ce10c4b3f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:13.544000 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd42f79-0231-4d0a-b772-c8ce10c4b3f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:13.544327 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd42f79-0231-4d0a-b772-c8ce10c4b3f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:13.545031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd42f79-0231-4d0a-b772-c8ce10c4b3f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:13.545631 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd42f79-0231-4d0a-b772-c8ce10c4b3f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:13.546312 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-4cd42f79-0231-4d0a-b772-c8ce10c4b3f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:13.661972 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-566e8f01-98e5-4e5c-a967-382ecf214114 req-a1b22e87-7fd2-4f65-bd24-3682283ba1fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7008ba-fba6-44a2-af43-7222b4d246a1", "name": "network-vif-plugged", "status": "completed", "tag": "dbfb02c4-a658-4666-af7d-aba218784121"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:28:13.673677 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-566e8f01-98e5-4e5c-a967-382ecf214114 req-a1b22e87-7fd2-4f65-bd24-3682283ba1fc service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:13.674175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-566e8f01-98e5-4e5c-a967-382ecf214114 req-a1b22e87-7fd2-4f65-bd24-3682283ba1fc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:13.674839 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-566e8f01-98e5-4e5c-a967-382ecf214114 req-a1b22e87-7fd2-4f65-bd24-3682283ba1fc service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:13.689324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-4cd42f79-0231-4d0a-b772-c8ce10c4b3f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:13.693195 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-566e8f01-98e5-4e5c-a967-382ecf214114 req-a1b22e87-7fd2-4f65-bd24-3682283ba1fc service nova] Creating event network-vif-plugged:dbfb02c4-a658-4666-af7d-aba218784121 for instance 1c7008ba-fba6-44a2-af43-7222b4d246a1 on n-h2-850468-16 Aug 23 19:28:13.699030 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-566e8f01-98e5-4e5c-a967-382ecf214114 req-a1b22e87-7fd2-4f65-bd24-3682283ba1fc service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042113 Aug 23 19:28:13.699697 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4129/8118] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:28:13.699913 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-4cd42f79-0231-4d0a-b772-c8ce10c4b3f0 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1260 microversion: 2.1 time: 0.168247 Aug 23 19:28:13.700699 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3990/8119] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:13 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:14.722985 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3c74dbcb-46ea-41d8-bdd1-b7dd88713b8f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:14.723738 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3c74dbcb-46ea-41d8-bdd1-b7dd88713b8f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:14.729876 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c74dbcb-46ea-41d8-bdd1-b7dd88713b8f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:14.730377 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c74dbcb-46ea-41d8-bdd1-b7dd88713b8f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:14.730855 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c74dbcb-46ea-41d8-bdd1-b7dd88713b8f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:14.731554 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c74dbcb-46ea-41d8-bdd1-b7dd88713b8f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:14.732017 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c74dbcb-46ea-41d8-bdd1-b7dd88713b8f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:14.732452 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3c74dbcb-46ea-41d8-bdd1-b7dd88713b8f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:14.866400 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3c74dbcb-46ea-41d8-bdd1-b7dd88713b8f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:14.874190 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3c74dbcb-46ea-41d8-bdd1-b7dd88713b8f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1260 microversion: 2.1 time: 0.156461 Aug 23 19:28:14.874786 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4130/8120] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:14 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:15.895296 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-03b65bc6-0f49-4598-bc55-7bde1952255f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:15.895848 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-03b65bc6-0f49-4598-bc55-7bde1952255f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:15.903582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03b65bc6-0f49-4598-bc55-7bde1952255f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:15.904129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03b65bc6-0f49-4598-bc55-7bde1952255f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:15.905127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03b65bc6-0f49-4598-bc55-7bde1952255f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:15.906360 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03b65bc6-0f49-4598-bc55-7bde1952255f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:15.907228 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03b65bc6-0f49-4598-bc55-7bde1952255f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:15.908057 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-03b65bc6-0f49-4598-bc55-7bde1952255f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:16.048073 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-03b65bc6-0f49-4598-bc55-7bde1952255f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:16.056120 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-03b65bc6-0f49-4598-bc55-7bde1952255f tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1444 microversion: 2.1 time: 0.164912 Aug 23 19:28:16.056790 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3991/8121] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:15 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1444 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:16.077479 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-f3cf2747-5d0a-4e86-980c-c34a2c69369a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:28:16.078106 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-f3cf2747-5d0a-4e86-980c-c34a2c69369a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:28:16.085127 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3cf2747-5d0a-4e86-980c-c34a2c69369a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:16.085627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3cf2747-5d0a-4e86-980c-c34a2c69369a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:16.086079 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3cf2747-5d0a-4e86-980c-c34a2c69369a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:16.086827 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3cf2747-5d0a-4e86-980c-c34a2c69369a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:16.087301 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3cf2747-5d0a-4e86-980c-c34a2c69369a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:16.087744 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-f3cf2747-5d0a-4e86-980c-c34a2c69369a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:16.225963 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-f3cf2747-5d0a-4e86-980c-c34a2c69369a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:28:16.234513 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-f3cf2747-5d0a-4e86-980c-c34a2c69369a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1444 microversion: 2.1 time: 0.161416 Aug 23 19:28:16.235119 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4131/8122] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:28:16 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1444 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:28:18.200169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-cc37efa7-a328-4525-8536-701f32866274 req-9319445f-6d9c-43b7-a95f-76e0f2bf1f2d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7008ba-fba6-44a2-af43-7222b4d246a1", "tag": "dbfb02c4-a658-4666-af7d-aba218784121"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:28:18.211133 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cc37efa7-a328-4525-8536-701f32866274 req-9319445f-6d9c-43b7-a95f-76e0f2bf1f2d service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:28:18.211635 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cc37efa7-a328-4525-8536-701f32866274 req-9319445f-6d9c-43b7-a95f-76e0f2bf1f2d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:28:18.212064 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-cc37efa7-a328-4525-8536-701f32866274 req-9319445f-6d9c-43b7-a95f-76e0f2bf1f2d service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:28:18.224216 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-cc37efa7-a328-4525-8536-701f32866274 req-9319445f-6d9c-43b7-a95f-76e0f2bf1f2d service nova] Creating event network-changed:dbfb02c4-a658-4666-af7d-aba218784121 for instance 1c7008ba-fba6-44a2-af43-7222b4d246a1 on n-h2-850468-16 Aug 23 19:28:18.229396 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-cc37efa7-a328-4525-8536-701f32866274 req-9319445f-6d9c-43b7-a95f-76e0f2bf1f2d service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033201 Aug 23 19:28:18.229993 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3992/8123] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:30:13.339128 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ea61cea-341f-4994-9508-d9cf4674c693] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 19:30:13.340298 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a3fd44c-0004-4783-9f1a-6f2fcc77fcee] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 19:30:13.340857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=24 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:30:13.342167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=56 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:30:13.346282 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-bbe81ad2-67cf-45a9-a828-ca0c90fac7ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:30:13.346860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-bbe81ad2-67cf-45a9-a828-ca0c90fac7ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:13.353567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbe81ad2-67cf-45a9-a828-ca0c90fac7ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:13.354064 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbe81ad2-67cf-45a9-a828-ca0c90fac7ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:13.354527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbe81ad2-67cf-45a9-a828-ca0c90fac7ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:13.355253 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbe81ad2-67cf-45a9-a828-ca0c90fac7ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:13.355727 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbe81ad2-67cf-45a9-a828-ca0c90fac7ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:13.356201 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-bbe81ad2-67cf-45a9-a828-ca0c90fac7ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:13.378843 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.objects.instance [None req-bbe81ad2-67cf-45a9-a828-ca0c90fac7ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lazy-loading 'flavor' on Instance uuid 1c7008ba-fba6-44a2-af43-7222b4d246a1 {{(pid=128808) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:30:13.449135 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-bbe81ad2-67cf-45a9-a828-ca0c90fac7ff tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "POST /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1/action" status: 202 len: 0 microversion: 2.1 time: 0.111717 Aug 23 19:30:13.449709 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4132/8124] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:30:13 2022] POST /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:30:13.456324 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:30:13.457129 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:30:13.457602 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:30:13.458340 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=54 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:30:13.463094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-afc7d604-c687-47cb-a0ed-dfde7ed31932 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:13.463803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-afc7d604-c687-47cb-a0ed-dfde7ed31932 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:13.472869 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afc7d604-c687-47cb-a0ed-dfde7ed31932 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:13.473334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afc7d604-c687-47cb-a0ed-dfde7ed31932 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:13.473786 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afc7d604-c687-47cb-a0ed-dfde7ed31932 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:13.474566 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afc7d604-c687-47cb-a0ed-dfde7ed31932 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:13.475036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afc7d604-c687-47cb-a0ed-dfde7ed31932 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:13.475459 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afc7d604-c687-47cb-a0ed-dfde7ed31932 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:13.617129 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-afc7d604-c687-47cb-a0ed-dfde7ed31932 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:13.625909 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-afc7d604-c687-47cb-a0ed-dfde7ed31932 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.171665 Aug 23 19:30:13.626486 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3993/8125] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:13 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:14.650875 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-acc6ebe7-29ec-4938-b578-65644622503e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:14.651854 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-acc6ebe7-29ec-4938-b578-65644622503e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:14.664005 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a3fd44c-0004-4783-9f1a-6f2fcc77fcee] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 37114. Aug 23 19:30:14.666637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc6ebe7-29ec-4938-b578-65644622503e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:14.667138 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc6ebe7-29ec-4938-b578-65644622503e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:14.667621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc6ebe7-29ec-4938-b578-65644622503e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:14.668331 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc6ebe7-29ec-4938-b578-65644622503e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:14.668800 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc6ebe7-29ec-4938-b578-65644622503e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:14.669243 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-acc6ebe7-29ec-4938-b578-65644622503e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:14.670476 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ea61cea-341f-4994-9508-d9cf4674c693] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 37112. Aug 23 19:30:14.811519 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-acc6ebe7-29ec-4938-b578-65644622503e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:14.819311 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-acc6ebe7-29ec-4938-b578-65644622503e tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.175447 Aug 23 19:30:14.819884 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4133/8126] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:14 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:15.840777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-06c31679-2917-4b4f-aa0f-2ee9b2948ad7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:15.841395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-06c31679-2917-4b4f-aa0f-2ee9b2948ad7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:15.853247 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 37120. Aug 23 19:30:15.861786 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 37118. Aug 23 19:30:15.866619 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06c31679-2917-4b4f-aa0f-2ee9b2948ad7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:15.867124 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06c31679-2917-4b4f-aa0f-2ee9b2948ad7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:15.867573 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06c31679-2917-4b4f-aa0f-2ee9b2948ad7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:15.868314 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06c31679-2917-4b4f-aa0f-2ee9b2948ad7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:15.868777 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06c31679-2917-4b4f-aa0f-2ee9b2948ad7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:15.869217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-06c31679-2917-4b4f-aa0f-2ee9b2948ad7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:16.006165 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-06c31679-2917-4b4f-aa0f-2ee9b2948ad7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:16.014870 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-06c31679-2917-4b4f-aa0f-2ee9b2948ad7 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.178021 Aug 23 19:30:16.015445 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3994/8127] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:15 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:17.036285 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-31b9c43d-9048-421a-8eee-bf6004cce710 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:17.036859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-31b9c43d-9048-421a-8eee-bf6004cce710 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:17.043625 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31b9c43d-9048-421a-8eee-bf6004cce710 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:17.044125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31b9c43d-9048-421a-8eee-bf6004cce710 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:17.044579 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31b9c43d-9048-421a-8eee-bf6004cce710 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:17.045822 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31b9c43d-9048-421a-8eee-bf6004cce710 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:17.046297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31b9c43d-9048-421a-8eee-bf6004cce710 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:17.046771 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-31b9c43d-9048-421a-8eee-bf6004cce710 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:17.178460 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-31b9c43d-9048-421a-8eee-bf6004cce710 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:17.186556 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-31b9c43d-9048-421a-8eee-bf6004cce710 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.154246 Aug 23 19:30:17.187123 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4134/8128] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:17 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:18.208957 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-59c70339-dc9c-46dc-82d6-a37b8674ba2b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:18.209640 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-59c70339-dc9c-46dc-82d6-a37b8674ba2b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:18.215627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59c70339-dc9c-46dc-82d6-a37b8674ba2b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:18.216114 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59c70339-dc9c-46dc-82d6-a37b8674ba2b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:18.216565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59c70339-dc9c-46dc-82d6-a37b8674ba2b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:18.217301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59c70339-dc9c-46dc-82d6-a37b8674ba2b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:18.217759 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59c70339-dc9c-46dc-82d6-a37b8674ba2b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:18.218188 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-59c70339-dc9c-46dc-82d6-a37b8674ba2b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:18.356551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-59c70339-dc9c-46dc-82d6-a37b8674ba2b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:18.364522 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-59c70339-dc9c-46dc-82d6-a37b8674ba2b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.160513 Aug 23 19:30:18.365098 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3995/8129] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:18 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:19.385921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-714e219d-e5ab-40a0-be64-6e314bf5c42b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:19.386567 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-714e219d-e5ab-40a0-be64-6e314bf5c42b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:19.394414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714e219d-e5ab-40a0-be64-6e314bf5c42b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:19.394948 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714e219d-e5ab-40a0-be64-6e314bf5c42b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:19.395403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714e219d-e5ab-40a0-be64-6e314bf5c42b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:19.396114 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714e219d-e5ab-40a0-be64-6e314bf5c42b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:19.396578 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714e219d-e5ab-40a0-be64-6e314bf5c42b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:19.397012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-714e219d-e5ab-40a0-be64-6e314bf5c42b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:19.528747 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-714e219d-e5ab-40a0-be64-6e314bf5c42b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:19.537141 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-714e219d-e5ab-40a0-be64-6e314bf5c42b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.155163 Aug 23 19:30:19.537716 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4135/8130] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:19 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:20.558890 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-deb6b4c3-00b8-44fe-a5cd-ab447940e843 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:20.559537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-deb6b4c3-00b8-44fe-a5cd-ab447940e843 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:20.566988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-deb6b4c3-00b8-44fe-a5cd-ab447940e843 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:20.567471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-deb6b4c3-00b8-44fe-a5cd-ab447940e843 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:20.567908 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-deb6b4c3-00b8-44fe-a5cd-ab447940e843 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:20.568597 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-deb6b4c3-00b8-44fe-a5cd-ab447940e843 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:20.569049 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-deb6b4c3-00b8-44fe-a5cd-ab447940e843 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:20.569471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-deb6b4c3-00b8-44fe-a5cd-ab447940e843 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:20.700416 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-deb6b4c3-00b8-44fe-a5cd-ab447940e843 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:20.708431 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-deb6b4c3-00b8-44fe-a5cd-ab447940e843 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.153482 Aug 23 19:30:20.709013 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3996/8131] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:20 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:21.729436 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1813d5fc-5979-4871-9fcb-1ac991f3cd32 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:21.730088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1813d5fc-5979-4871-9fcb-1ac991f3cd32 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:21.737358 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1813d5fc-5979-4871-9fcb-1ac991f3cd32 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:21.737851 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1813d5fc-5979-4871-9fcb-1ac991f3cd32 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:21.738297 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1813d5fc-5979-4871-9fcb-1ac991f3cd32 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:21.739032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1813d5fc-5979-4871-9fcb-1ac991f3cd32 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:21.739499 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1813d5fc-5979-4871-9fcb-1ac991f3cd32 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:21.739934 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1813d5fc-5979-4871-9fcb-1ac991f3cd32 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:21.884806 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1813d5fc-5979-4871-9fcb-1ac991f3cd32 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:21.892626 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1813d5fc-5979-4871-9fcb-1ac991f3cd32 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.167122 Aug 23 19:30:21.893203 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4136/8132] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:21 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:22.915988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c7920bf9-8b65-4b26-9e57-e9c58d6aed86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:22.916542 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c7920bf9-8b65-4b26-9e57-e9c58d6aed86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:22.923720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7920bf9-8b65-4b26-9e57-e9c58d6aed86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:22.924212 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7920bf9-8b65-4b26-9e57-e9c58d6aed86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:22.924656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7920bf9-8b65-4b26-9e57-e9c58d6aed86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:22.925361 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7920bf9-8b65-4b26-9e57-e9c58d6aed86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:22.925819 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7920bf9-8b65-4b26-9e57-e9c58d6aed86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:22.926249 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c7920bf9-8b65-4b26-9e57-e9c58d6aed86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:23.060236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-c7920bf9-8b65-4b26-9e57-e9c58d6aed86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:23.068617 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c7920bf9-8b65-4b26-9e57-e9c58d6aed86 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.157808 Aug 23 19:30:23.069185 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3997/8133] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:22 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:24.090210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c28a27e5-a788-45a0-bc05-e6555f85aab5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:24.090860 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c28a27e5-a788-45a0-bc05-e6555f85aab5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:24.098139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c28a27e5-a788-45a0-bc05-e6555f85aab5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:24.098670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c28a27e5-a788-45a0-bc05-e6555f85aab5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:24.099130 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c28a27e5-a788-45a0-bc05-e6555f85aab5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:24.099853 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c28a27e5-a788-45a0-bc05-e6555f85aab5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:24.100326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c28a27e5-a788-45a0-bc05-e6555f85aab5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:24.100772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c28a27e5-a788-45a0-bc05-e6555f85aab5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:24.240070 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c28a27e5-a788-45a0-bc05-e6555f85aab5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:24.248571 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c28a27e5-a788-45a0-bc05-e6555f85aab5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.161629 Aug 23 19:30:24.249146 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4137/8134] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:24 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:25.269457 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ea3dcb20-0489-4920-b233-919b0d9c3b7b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:25.270127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ea3dcb20-0489-4920-b233-919b0d9c3b7b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:25.277613 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3dcb20-0489-4920-b233-919b0d9c3b7b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:25.278148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3dcb20-0489-4920-b233-919b0d9c3b7b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:25.278621 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3dcb20-0489-4920-b233-919b0d9c3b7b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:25.279343 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3dcb20-0489-4920-b233-919b0d9c3b7b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:25.279808 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3dcb20-0489-4920-b233-919b0d9c3b7b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:25.280236 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ea3dcb20-0489-4920-b233-919b0d9c3b7b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:25.415574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ea3dcb20-0489-4920-b233-919b0d9c3b7b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:25.424396 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ea3dcb20-0489-4920-b233-919b0d9c3b7b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.158865 Aug 23 19:30:25.424982 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3998/8135] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:25 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:26.445621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-1b3afa07-da12-4c12-aa24-b59e017fd3f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:26.446411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-1b3afa07-da12-4c12-aa24-b59e017fd3f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:26.454466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b3afa07-da12-4c12-aa24-b59e017fd3f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:26.455012 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b3afa07-da12-4c12-aa24-b59e017fd3f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:26.455466 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b3afa07-da12-4c12-aa24-b59e017fd3f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:26.456203 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b3afa07-da12-4c12-aa24-b59e017fd3f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:26.456823 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b3afa07-da12-4c12-aa24-b59e017fd3f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:26.457274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-1b3afa07-da12-4c12-aa24-b59e017fd3f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:26.597711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-1b3afa07-da12-4c12-aa24-b59e017fd3f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:26.605780 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-1b3afa07-da12-4c12-aa24-b59e017fd3f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.164225 Aug 23 19:30:26.618076 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4138/8136] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:26 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:27.628834 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fdf97a5f-43fb-45dc-a58c-7e52f6521fc4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:27.629717 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fdf97a5f-43fb-45dc-a58c-7e52f6521fc4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:27.636684 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdf97a5f-43fb-45dc-a58c-7e52f6521fc4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:27.637169 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdf97a5f-43fb-45dc-a58c-7e52f6521fc4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:27.637604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdf97a5f-43fb-45dc-a58c-7e52f6521fc4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:27.638315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdf97a5f-43fb-45dc-a58c-7e52f6521fc4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:27.638803 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdf97a5f-43fb-45dc-a58c-7e52f6521fc4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:27.639244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fdf97a5f-43fb-45dc-a58c-7e52f6521fc4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:27.786739 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fdf97a5f-43fb-45dc-a58c-7e52f6521fc4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:27.795743 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fdf97a5f-43fb-45dc-a58c-7e52f6521fc4 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1569 microversion: 2.1 time: 0.170871 Aug 23 19:30:27.796579 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 3999/8137] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:27 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:27.816795 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2ee4e166-6537-4969-9ec0-41f5b624a681 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:30:27.817414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2ee4e166-6537-4969-9ec0-41f5b624a681 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:27.824619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ee4e166-6537-4969-9ec0-41f5b624a681 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:27.825125 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ee4e166-6537-4969-9ec0-41f5b624a681 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:27.825604 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ee4e166-6537-4969-9ec0-41f5b624a681 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:27.826743 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ee4e166-6537-4969-9ec0-41f5b624a681 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:27.827218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ee4e166-6537-4969-9ec0-41f5b624a681 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:27.827796 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2ee4e166-6537-4969-9ec0-41f5b624a681 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:27.860389 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2ee4e166-6537-4969-9ec0-41f5b624a681 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=128808) unshelve /opt/stack/nova/nova/compute/api.py:4578}} Aug 23 19:30:27.926294 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2ee4e166-6537-4969-9ec0-41f5b624a681 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "POST /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1/action" status: 202 len: 0 microversion: 2.1 time: 0.113292 Aug 23 19:30:27.929997 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4139/8138] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:30:27 2022] POST /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:30:27.935941 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fee1e17c-fd4b-4a95-9a2c-be7b7ddf8e6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:27.936559 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fee1e17c-fd4b-4a95-9a2c-be7b7ddf8e6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:27.942652 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fee1e17c-fd4b-4a95-9a2c-be7b7ddf8e6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:27.943146 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fee1e17c-fd4b-4a95-9a2c-be7b7ddf8e6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:27.943588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fee1e17c-fd4b-4a95-9a2c-be7b7ddf8e6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:27.944317 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fee1e17c-fd4b-4a95-9a2c-be7b7ddf8e6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:27.944775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fee1e17c-fd4b-4a95-9a2c-be7b7ddf8e6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:27.945206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fee1e17c-fd4b-4a95-9a2c-be7b7ddf8e6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:28.120001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fee1e17c-fd4b-4a95-9a2c-be7b7ddf8e6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:28.128832 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fee1e17c-fd4b-4a95-9a2c-be7b7ddf8e6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1517 microversion: 2.1 time: 0.197409 Aug 23 19:30:28.129421 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4000/8139] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:27 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1517 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:29.150612 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-0e0eff4b-7043-4550-820e-4f4a6378c56d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:29.151225 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-0e0eff4b-7043-4550-820e-4f4a6378c56d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:29.158096 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e0eff4b-7043-4550-820e-4f4a6378c56d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:29.158621 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e0eff4b-7043-4550-820e-4f4a6378c56d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:29.159069 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e0eff4b-7043-4550-820e-4f4a6378c56d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:29.160815 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e0eff4b-7043-4550-820e-4f4a6378c56d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:29.161283 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e0eff4b-7043-4550-820e-4f4a6378c56d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:29.161721 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-0e0eff4b-7043-4550-820e-4f4a6378c56d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:29.290486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-0e0eff4b-7043-4550-820e-4f4a6378c56d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:29.298862 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-0e0eff4b-7043-4550-820e-4f4a6378c56d tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1517 microversion: 2.1 time: 0.153047 Aug 23 19:30:29.299425 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4140/8140] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:29 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:30.172766 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b1fc7922-24cc-4f36-b4f5-e3e483e7a2a1 req-7ce7416e-d543-4a6b-bf24-7091fa673b79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7008ba-fba6-44a2-af43-7222b4d246a1", "name": "network-vif-unplugged", "status": "completed", "tag": "dbfb02c4-a658-4666-af7d-aba218784121"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:30:30.183580 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b1fc7922-24cc-4f36-b4f5-e3e483e7a2a1 req-7ce7416e-d543-4a6b-bf24-7091fa673b79 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:30.184222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b1fc7922-24cc-4f36-b4f5-e3e483e7a2a1 req-7ce7416e-d543-4a6b-bf24-7091fa673b79 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:30.184590 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b1fc7922-24cc-4f36-b4f5-e3e483e7a2a1 req-7ce7416e-d543-4a6b-bf24-7091fa673b79 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:30.199913 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.compute.server_external_events [req-b1fc7922-24cc-4f36-b4f5-e3e483e7a2a1 req-7ce7416e-d543-4a6b-bf24-7091fa673b79 service nova] Unable to find a host for instance 1c7008ba-fba6-44a2-af43-7222b4d246a1. Dropping event network-vif-unplugged {{(pid=128807) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 23 19:30:30.200823 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b1fc7922-24cc-4f36-b4f5-e3e483e7a2a1 req-7ce7416e-d543-4a6b-bf24-7091fa673b79 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033432 Aug 23 19:30:30.201607 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4001/8141] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:30:30 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 23 19:30:30.321989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5235cbbe-d2ea-4aa9-bef3-8954e5011f09 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:30.322646 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5235cbbe-d2ea-4aa9-bef3-8954e5011f09 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:30.330376 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5235cbbe-d2ea-4aa9-bef3-8954e5011f09 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:30.330911 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5235cbbe-d2ea-4aa9-bef3-8954e5011f09 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:30.331370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5235cbbe-d2ea-4aa9-bef3-8954e5011f09 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:30.332089 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5235cbbe-d2ea-4aa9-bef3-8954e5011f09 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:30.332562 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5235cbbe-d2ea-4aa9-bef3-8954e5011f09 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:30.333013 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5235cbbe-d2ea-4aa9-bef3-8954e5011f09 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:30.473819 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5235cbbe-d2ea-4aa9-bef3-8954e5011f09 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:30.481776 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5235cbbe-d2ea-4aa9-bef3-8954e5011f09 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1519 microversion: 2.1 time: 0.165035 Aug 23 19:30:30.482360 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4141/8142] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:30 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:31.504584 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-82f437e4-077e-4ac3-9064-c16a5a35e4bd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:31.505160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-82f437e4-077e-4ac3-9064-c16a5a35e4bd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:31.512082 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f437e4-077e-4ac3-9064-c16a5a35e4bd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:31.512567 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f437e4-077e-4ac3-9064-c16a5a35e4bd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:31.513007 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f437e4-077e-4ac3-9064-c16a5a35e4bd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:31.513706 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f437e4-077e-4ac3-9064-c16a5a35e4bd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:31.514167 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f437e4-077e-4ac3-9064-c16a5a35e4bd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:31.514666 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-82f437e4-077e-4ac3-9064-c16a5a35e4bd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:31.650977 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-82f437e4-077e-4ac3-9064-c16a5a35e4bd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:31.659645 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-82f437e4-077e-4ac3-9064-c16a5a35e4bd tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1519 microversion: 2.1 time: 0.159112 Aug 23 19:30:31.660211 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4002/8143] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:31 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:32.681322 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-7e46355f-94a6-43df-afd5-534fad8010ad tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:32.682103 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-7e46355f-94a6-43df-afd5-534fad8010ad tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:32.689739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e46355f-94a6-43df-afd5-534fad8010ad tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:32.690306 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e46355f-94a6-43df-afd5-534fad8010ad tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:32.690862 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e46355f-94a6-43df-afd5-534fad8010ad tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:32.691634 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e46355f-94a6-43df-afd5-534fad8010ad tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:32.692202 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e46355f-94a6-43df-afd5-534fad8010ad tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:32.692717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-7e46355f-94a6-43df-afd5-534fad8010ad tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:32.833336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-7e46355f-94a6-43df-afd5-534fad8010ad tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:32.841167 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-7e46355f-94a6-43df-afd5-534fad8010ad tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1519 microversion: 2.1 time: 0.163847 Aug 23 19:30:32.841958 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4142/8144] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:32 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:33.863161 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-9f225a09-e47d-431f-b674-d8f95c8fd146 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:33.863700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-9f225a09-e47d-431f-b674-d8f95c8fd146 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:33.870624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f225a09-e47d-431f-b674-d8f95c8fd146 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:33.871116 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f225a09-e47d-431f-b674-d8f95c8fd146 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:33.871560 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f225a09-e47d-431f-b674-d8f95c8fd146 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:33.872263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f225a09-e47d-431f-b674-d8f95c8fd146 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:33.872724 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f225a09-e47d-431f-b674-d8f95c8fd146 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:33.873155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-9f225a09-e47d-431f-b674-d8f95c8fd146 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:34.012830 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-9f225a09-e47d-431f-b674-d8f95c8fd146 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:34.020910 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-9f225a09-e47d-431f-b674-d8f95c8fd146 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1519 microversion: 2.1 time: 0.161790 Aug 23 19:30:34.021486 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4003/8145] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:33 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:30:35.042502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-c3a352b6-fc26-49d6-8178-56cfe82f8036 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:35.043158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-c3a352b6-fc26-49d6-8178-56cfe82f8036 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:35.050446 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3a352b6-fc26-49d6-8178-56cfe82f8036 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:35.051014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3a352b6-fc26-49d6-8178-56cfe82f8036 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:35.051472 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3a352b6-fc26-49d6-8178-56cfe82f8036 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:35.052219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3a352b6-fc26-49d6-8178-56cfe82f8036 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:35.052691 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3a352b6-fc26-49d6-8178-56cfe82f8036 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:35.053134 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-c3a352b6-fc26-49d6-8178-56cfe82f8036 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:35.260936 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-c3a352b6-fc26-49d6-8178-56cfe82f8036 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:35.270137 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-c3a352b6-fc26-49d6-8178-56cfe82f8036 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1575 microversion: 2.1 time: 0.231508 Aug 23 19:30:35.271046 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4143/8146] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:35 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1575 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:36.291969 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-767531c1-3e1a-4b4c-bed4-0041d7874be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:36.292588 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-767531c1-3e1a-4b4c-bed4-0041d7874be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:36.300175 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-767531c1-3e1a-4b4c-bed4-0041d7874be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:36.300656 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-767531c1-3e1a-4b4c-bed4-0041d7874be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:36.301092 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-767531c1-3e1a-4b4c-bed4-0041d7874be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:36.301789 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-767531c1-3e1a-4b4c-bed4-0041d7874be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:36.302242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-767531c1-3e1a-4b4c-bed4-0041d7874be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:36.302700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-767531c1-3e1a-4b4c-bed4-0041d7874be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:36.435720 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-767531c1-3e1a-4b4c-bed4-0041d7874be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:36.444890 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-767531c1-3e1a-4b4c-bed4-0041d7874be9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1575 microversion: 2.1 time: 0.156836 Aug 23 19:30:36.445453 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4004/8147] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:36 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:37.466531 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ffc2e211-837b-45be-895c-b61c59abd3b9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:37.467211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ffc2e211-837b-45be-895c-b61c59abd3b9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:37.475222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffc2e211-837b-45be-895c-b61c59abd3b9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:37.475733 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffc2e211-837b-45be-895c-b61c59abd3b9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:37.476188 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffc2e211-837b-45be-895c-b61c59abd3b9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:37.476906 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffc2e211-837b-45be-895c-b61c59abd3b9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:37.477385 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffc2e211-837b-45be-895c-b61c59abd3b9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:37.477840 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ffc2e211-837b-45be-895c-b61c59abd3b9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:37.610921 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ffc2e211-837b-45be-895c-b61c59abd3b9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:37.619454 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ffc2e211-837b-45be-895c-b61c59abd3b9 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1575 microversion: 2.1 time: 0.156787 Aug 23 19:30:37.620034 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4144/8148] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:37 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:38.640878 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-254a770f-b576-4290-a66c-c95750aed2a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:38.641495 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-254a770f-b576-4290-a66c-c95750aed2a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:38.648486 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-254a770f-b576-4290-a66c-c95750aed2a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:38.648973 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-254a770f-b576-4290-a66c-c95750aed2a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:38.649418 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-254a770f-b576-4290-a66c-c95750aed2a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:38.650121 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-254a770f-b576-4290-a66c-c95750aed2a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:38.650600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-254a770f-b576-4290-a66c-c95750aed2a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:38.651034 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-254a770f-b576-4290-a66c-c95750aed2a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:38.789506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-254a770f-b576-4290-a66c-c95750aed2a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:38.797425 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-254a770f-b576-4290-a66c-c95750aed2a3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1575 microversion: 2.1 time: 0.160950 Aug 23 19:30:38.798013 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4005/8149] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:38 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:39.818563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d6a147ae-1444-463d-879c-01c3415e65f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:39.819108 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d6a147ae-1444-463d-879c-01c3415e65f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:39.825941 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6a147ae-1444-463d-879c-01c3415e65f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:39.826440 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6a147ae-1444-463d-879c-01c3415e65f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:39.827044 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6a147ae-1444-463d-879c-01c3415e65f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:39.827804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6a147ae-1444-463d-879c-01c3415e65f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:39.828274 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6a147ae-1444-463d-879c-01c3415e65f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:39.828713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d6a147ae-1444-463d-879c-01c3415e65f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:39.849865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:30:39.973880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d6a147ae-1444-463d-879c-01c3415e65f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:39.981700 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d6a147ae-1444-463d-879c-01c3415e65f8 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1575 microversion: 2.1 time: 0.167224 Aug 23 19:30:39.982287 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4145/8150] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:39 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1575 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:41.004716 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-041bd99d-450a-465b-afd8-8bf470e6dd08 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:41.005258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-041bd99d-450a-465b-afd8-8bf470e6dd08 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:41.012187 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-041bd99d-450a-465b-afd8-8bf470e6dd08 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:41.012676 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-041bd99d-450a-465b-afd8-8bf470e6dd08 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:41.013122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-041bd99d-450a-465b-afd8-8bf470e6dd08 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:41.013821 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-041bd99d-450a-465b-afd8-8bf470e6dd08 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:41.014322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-041bd99d-450a-465b-afd8-8bf470e6dd08 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:41.014894 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-041bd99d-450a-465b-afd8-8bf470e6dd08 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:41.148887 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-041bd99d-450a-465b-afd8-8bf470e6dd08 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:41.157631 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-041bd99d-450a-465b-afd8-8bf470e6dd08 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1575 microversion: 2.1 time: 0.156948 Aug 23 19:30:41.158203 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4006/8151] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:40 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:42.179711 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cecc81bc-5f0a-48d7-8f7d-d52a22c4760b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:42.180343 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cecc81bc-5f0a-48d7-8f7d-d52a22c4760b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:42.188053 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cecc81bc-5f0a-48d7-8f7d-d52a22c4760b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:42.188555 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cecc81bc-5f0a-48d7-8f7d-d52a22c4760b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:42.189011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cecc81bc-5f0a-48d7-8f7d-d52a22c4760b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:42.189713 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cecc81bc-5f0a-48d7-8f7d-d52a22c4760b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:42.190182 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cecc81bc-5f0a-48d7-8f7d-d52a22c4760b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:42.190653 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cecc81bc-5f0a-48d7-8f7d-d52a22c4760b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:42.321099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-cecc81bc-5f0a-48d7-8f7d-d52a22c4760b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:42.328956 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cecc81bc-5f0a-48d7-8f7d-d52a22c4760b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1575 microversion: 2.1 time: 0.153217 Aug 23 19:30:42.329524 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4146/8152] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:42 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:43.349960 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-47ab8f11-2601-48fd-92e6-c23373a66469 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:43.350480 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-47ab8f11-2601-48fd-92e6-c23373a66469 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:43.357483 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47ab8f11-2601-48fd-92e6-c23373a66469 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:43.357963 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47ab8f11-2601-48fd-92e6-c23373a66469 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:43.359128 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47ab8f11-2601-48fd-92e6-c23373a66469 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:43.359818 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47ab8f11-2601-48fd-92e6-c23373a66469 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:43.360273 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47ab8f11-2601-48fd-92e6-c23373a66469 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:43.360691 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-47ab8f11-2601-48fd-92e6-c23373a66469 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:43.490134 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-47ab8f11-2601-48fd-92e6-c23373a66469 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:43.492329 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=85 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:30:43.499257 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-47ab8f11-2601-48fd-92e6-c23373a66469 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1575 microversion: 2.1 time: 0.153256 Aug 23 19:30:43.499814 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4007/8153] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:43 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:44.520576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-b024d956-a3f1-44b6-92f6-2b08e4eabfdb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:44.521242 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-b024d956-a3f1-44b6-92f6-2b08e4eabfdb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:44.524009 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:30:44.531949 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b024d956-a3f1-44b6-92f6-2b08e4eabfdb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:44.532563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b024d956-a3f1-44b6-92f6-2b08e4eabfdb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:44.533221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b024d956-a3f1-44b6-92f6-2b08e4eabfdb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:44.534977 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b024d956-a3f1-44b6-92f6-2b08e4eabfdb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:44.537220 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b024d956-a3f1-44b6-92f6-2b08e4eabfdb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:44.538685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-b024d956-a3f1-44b6-92f6-2b08e4eabfdb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:44.693486 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-b024d956-a3f1-44b6-92f6-2b08e4eabfdb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:44.702836 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-b024d956-a3f1-44b6-92f6-2b08e4eabfdb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1575 microversion: 2.1 time: 0.186065 Aug 23 19:30:44.703431 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4147/8154] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:44 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:45.727003 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-32e8afc0-6ee8-4361-8d56-cf739ffc9f8c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:45.727644 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-32e8afc0-6ee8-4361-8d56-cf739ffc9f8c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:45.730291 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=31 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:30:45.736344 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32e8afc0-6ee8-4361-8d56-cf739ffc9f8c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:45.736829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32e8afc0-6ee8-4361-8d56-cf739ffc9f8c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:45.737271 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32e8afc0-6ee8-4361-8d56-cf739ffc9f8c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:45.737967 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32e8afc0-6ee8-4361-8d56-cf739ffc9f8c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:45.738421 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32e8afc0-6ee8-4361-8d56-cf739ffc9f8c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:45.738870 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-32e8afc0-6ee8-4361-8d56-cf739ffc9f8c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:45.876525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-32e8afc0-6ee8-4361-8d56-cf739ffc9f8c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:45.884446 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-32e8afc0-6ee8-4361-8d56-cf739ffc9f8c tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1575 microversion: 2.1 time: 0.161349 Aug 23 19:30:45.884963 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4008/8155] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:45 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:46.369238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-f9a437fa-a1b5-4843-975d-aef2356057a6 req-90965ced-e51b-4107-a230-1dbcef853f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7008ba-fba6-44a2-af43-7222b4d246a1", "name": "network-vif-plugged", "status": "completed", "tag": "dbfb02c4-a658-4666-af7d-aba218784121"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:30:46.379945 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f9a437fa-a1b5-4843-975d-aef2356057a6 req-90965ced-e51b-4107-a230-1dbcef853f5b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:46.380439 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f9a437fa-a1b5-4843-975d-aef2356057a6 req-90965ced-e51b-4107-a230-1dbcef853f5b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:46.380886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-f9a437fa-a1b5-4843-975d-aef2356057a6 req-90965ced-e51b-4107-a230-1dbcef853f5b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:46.392575 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-f9a437fa-a1b5-4843-975d-aef2356057a6 req-90965ced-e51b-4107-a230-1dbcef853f5b service nova] Creating event network-vif-plugged:dbfb02c4-a658-4666-af7d-aba218784121 for instance 1c7008ba-fba6-44a2-af43-7222b4d246a1 on n-h2-850468-16 Aug 23 19:30:46.397823 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-f9a437fa-a1b5-4843-975d-aef2356057a6 req-90965ced-e51b-4107-a230-1dbcef853f5b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104720 Aug 23 19:30:46.398357 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4148/8156] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:30:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:30:46.906219 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-d4fd0e99-f606-41a0-9df3-09c822ef3dac tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:46.906904 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-d4fd0e99-f606-41a0-9df3-09c822ef3dac tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:46.913921 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4fd0e99-f606-41a0-9df3-09c822ef3dac tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:46.914409 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4fd0e99-f606-41a0-9df3-09c822ef3dac tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:46.914884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4fd0e99-f606-41a0-9df3-09c822ef3dac tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:46.915585 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4fd0e99-f606-41a0-9df3-09c822ef3dac tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:46.916044 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4fd0e99-f606-41a0-9df3-09c822ef3dac tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:46.916473 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-d4fd0e99-f606-41a0-9df3-09c822ef3dac tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:47.046863 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-d4fd0e99-f606-41a0-9df3-09c822ef3dac tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:47.054671 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-d4fd0e99-f606-41a0-9df3-09c822ef3dac tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1575 microversion: 2.1 time: 0.153317 Aug 23 19:30:47.055276 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4009/8157] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:46 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:30:48.077774 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a84357a8-1269-4d80-bf0b-1fb118e24860 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:30:48.078403 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a84357a8-1269-4d80-bf0b-1fb118e24860 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:30:48.084619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a84357a8-1269-4d80-bf0b-1fb118e24860 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:48.085109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a84357a8-1269-4d80-bf0b-1fb118e24860 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:48.085559 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a84357a8-1269-4d80-bf0b-1fb118e24860 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:48.086256 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a84357a8-1269-4d80-bf0b-1fb118e24860 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:30:48.086754 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a84357a8-1269-4d80-bf0b-1fb118e24860 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:30:48.087193 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a84357a8-1269-4d80-bf0b-1fb118e24860 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:30:48.218919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a84357a8-1269-4d80-bf0b-1fb118e24860 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:30:48.226682 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a84357a8-1269-4d80-bf0b-1fb118e24860 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1562 microversion: 2.1 time: 0.154782 Aug 23 19:30:48.227249 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4149/8158] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:30:48 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1562 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:31:01.927649 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:31:01.928228 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:31:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:31:22.449421 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:31:22.450091 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:31:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:32:04.546097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:32:04.546875 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=13 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:32:04.551094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-afec6736-84f4-4dd5-bc67-d799ceffdcc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:04.551731 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-afec6736-84f4-4dd5-bc67-d799ceffdcc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:04.552763 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-19a3f18d-a3ce-470d-a7dd-e055330de598 req-506e132a-ccd4-4287-b7ee-1fcf607bc788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c7008ba-fba6-44a2-af43-7222b4d246a1", "tag": "dbfb02c4-a658-4666-af7d-aba218784121"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:32:04.559381 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afec6736-84f4-4dd5-bc67-d799ceffdcc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:04.559584 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=5 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:32:04.559873 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afec6736-84f4-4dd5-bc67-d799ceffdcc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:04.560219 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=22 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:32:04.560776 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afec6736-84f4-4dd5-bc67-d799ceffdcc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:04.561488 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afec6736-84f4-4dd5-bc67-d799ceffdcc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:04.562093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afec6736-84f4-4dd5-bc67-d799ceffdcc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:04.564545 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-afec6736-84f4-4dd5-bc67-d799ceffdcc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:04.568128 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-19a3f18d-a3ce-470d-a7dd-e055330de598 req-506e132a-ccd4-4287-b7ee-1fcf607bc788 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:04.568639 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-19a3f18d-a3ce-470d-a7dd-e055330de598 req-506e132a-ccd4-4287-b7ee-1fcf607bc788 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:04.569249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-19a3f18d-a3ce-470d-a7dd-e055330de598 req-506e132a-ccd4-4287-b7ee-1fcf607bc788 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:04.582664 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-19a3f18d-a3ce-470d-a7dd-e055330de598 req-506e132a-ccd4-4287-b7ee-1fcf607bc788 service nova] Creating event network-changed:dbfb02c4-a658-4666-af7d-aba218784121 for instance 1c7008ba-fba6-44a2-af43-7222b4d246a1 on n-h2-850468-16 Aug 23 19:32:04.589026 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-19a3f18d-a3ce-470d-a7dd-e055330de598 req-506e132a-ccd4-4287-b7ee-1fcf607bc788 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042459 Aug 23 19:32:04.590192 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4150/8159] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:32:04.592085 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-afec6736-84f4-4dd5-bc67-d799ceffdcc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:32:04.689287 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-afec6736-84f4-4dd5-bc67-d799ceffdcc3 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "DELETE /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 204 len: 0 microversion: 2.1 time: 0.144850 Aug 23 19:32:04.690067 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4010/8160] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:32:04 2022] DELETE /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:32:04.701083 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5249e363-4385-49cc-b652-b831cfe02fc5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:04.701811 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5249e363-4385-49cc-b652-b831cfe02fc5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:04.709926 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5249e363-4385-49cc-b652-b831cfe02fc5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:04.711428 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5249e363-4385-49cc-b652-b831cfe02fc5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:04.711974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5249e363-4385-49cc-b652-b831cfe02fc5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:04.712865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5249e363-4385-49cc-b652-b831cfe02fc5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:04.713496 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5249e363-4385-49cc-b652-b831cfe02fc5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:04.714787 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5249e363-4385-49cc-b652-b831cfe02fc5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:04.878739 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5249e363-4385-49cc-b652-b831cfe02fc5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:04.888318 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5249e363-4385-49cc-b652-b831cfe02fc5 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.193605 Aug 23 19:32:04.889096 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4151/8161] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:04 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:05.911325 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-68a583a5-096f-4f20-a524-15b1dbdd1e63 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:05.912069 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-68a583a5-096f-4f20-a524-15b1dbdd1e63 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:05.920368 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68a583a5-096f-4f20-a524-15b1dbdd1e63 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:05.920858 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68a583a5-096f-4f20-a524-15b1dbdd1e63 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:05.921306 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68a583a5-096f-4f20-a524-15b1dbdd1e63 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:05.922009 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68a583a5-096f-4f20-a524-15b1dbdd1e63 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:05.922470 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68a583a5-096f-4f20-a524-15b1dbdd1e63 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:05.922929 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-68a583a5-096f-4f20-a524-15b1dbdd1e63 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:06.066410 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-68a583a5-096f-4f20-a524-15b1dbdd1e63 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:06.075389 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-68a583a5-096f-4f20-a524-15b1dbdd1e63 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1568 microversion: 2.1 time: 0.168232 Aug 23 19:32:06.076093 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4011/8162] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:05 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:06.774838 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-5c98df34-4b9b-40e2-aeb8-dc7cf5f2f349 req-36e28830-e051-4f83-b111-6abd8cd7ce02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c7008ba-fba6-44a2-af43-7222b4d246a1", "name": "network-vif-deleted", "tag": "dbfb02c4-a658-4666-af7d-aba218784121"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:32:06.787541 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5c98df34-4b9b-40e2-aeb8-dc7cf5f2f349 req-36e28830-e051-4f83-b111-6abd8cd7ce02 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:06.788034 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5c98df34-4b9b-40e2-aeb8-dc7cf5f2f349 req-36e28830-e051-4f83-b111-6abd8cd7ce02 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:06.789075 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-5c98df34-4b9b-40e2-aeb8-dc7cf5f2f349 req-36e28830-e051-4f83-b111-6abd8cd7ce02 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:06.805775 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-5c98df34-4b9b-40e2-aeb8-dc7cf5f2f349 req-36e28830-e051-4f83-b111-6abd8cd7ce02 service nova] Creating event network-vif-deleted:dbfb02c4-a658-4666-af7d-aba218784121 for instance 1c7008ba-fba6-44a2-af43-7222b4d246a1 on n-h2-850468-16 Aug 23 19:32:06.811286 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-5c98df34-4b9b-40e2-aeb8-dc7cf5f2f349 req-36e28830-e051-4f83-b111-6abd8cd7ce02 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041417 Aug 23 19:32:06.811879 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4152/8163] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:32:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:32:07.097395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-ac0a18d0-2589-4bd1-adaa-a42c5bccc997 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:07.098036 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-ac0a18d0-2589-4bd1-adaa-a42c5bccc997 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:07.106031 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac0a18d0-2589-4bd1-adaa-a42c5bccc997 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:07.106974 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac0a18d0-2589-4bd1-adaa-a42c5bccc997 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:07.107616 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac0a18d0-2589-4bd1-adaa-a42c5bccc997 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:07.108838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac0a18d0-2589-4bd1-adaa-a42c5bccc997 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:07.109582 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac0a18d0-2589-4bd1-adaa-a42c5bccc997 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:07.110227 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-ac0a18d0-2589-4bd1-adaa-a42c5bccc997 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:07.202098 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-ac0a18d0-2589-4bd1-adaa-a42c5bccc997 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:07.213760 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-ac0a18d0-2589-4bd1-adaa-a42c5bccc997 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1220 microversion: 2.1 time: 0.120157 Aug 23 19:32:07.214346 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4012/8164] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:07 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1220 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:08.235277 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-85cb5646-56ab-4e2d-b8b8-25729384bcda tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:08.235997 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-85cb5646-56ab-4e2d-b8b8-25729384bcda tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:08.243919 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85cb5646-56ab-4e2d-b8b8-25729384bcda tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:08.244420 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85cb5646-56ab-4e2d-b8b8-25729384bcda tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:08.244872 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85cb5646-56ab-4e2d-b8b8-25729384bcda tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:08.245587 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85cb5646-56ab-4e2d-b8b8-25729384bcda tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:08.246056 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85cb5646-56ab-4e2d-b8b8-25729384bcda tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:08.246498 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-85cb5646-56ab-4e2d-b8b8-25729384bcda tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:08.310061 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-85cb5646-56ab-4e2d-b8b8-25729384bcda tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:08.318200 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-85cb5646-56ab-4e2d-b8b8-25729384bcda tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1220 microversion: 2.1 time: 0.087350 Aug 23 19:32:08.318930 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4153/8165] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:08 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1220 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:09.340695 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-227b9100-33eb-44c4-a7cc-628cf86a9cfb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:09.341444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-227b9100-33eb-44c4-a7cc-628cf86a9cfb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:09.348444 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-227b9100-33eb-44c4-a7cc-628cf86a9cfb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:09.348933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-227b9100-33eb-44c4-a7cc-628cf86a9cfb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:09.349372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-227b9100-33eb-44c4-a7cc-628cf86a9cfb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:09.350070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-227b9100-33eb-44c4-a7cc-628cf86a9cfb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:09.350530 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-227b9100-33eb-44c4-a7cc-628cf86a9cfb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:09.350984 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-227b9100-33eb-44c4-a7cc-628cf86a9cfb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:09.414331 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-227b9100-33eb-44c4-a7cc-628cf86a9cfb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:09.422417 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-227b9100-33eb-44c4-a7cc-628cf86a9cfb tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1220 microversion: 2.1 time: 0.086390 Aug 23 19:32:09.423027 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4013/8166] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:09 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:10.443276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-3355ef7b-cc6e-420d-bef8-3bf09167a73a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:10.443904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-3355ef7b-cc6e-420d-bef8-3bf09167a73a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:10.450928 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3355ef7b-cc6e-420d-bef8-3bf09167a73a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:10.451427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3355ef7b-cc6e-420d-bef8-3bf09167a73a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:10.451886 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3355ef7b-cc6e-420d-bef8-3bf09167a73a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:10.452622 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3355ef7b-cc6e-420d-bef8-3bf09167a73a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:10.453092 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3355ef7b-cc6e-420d-bef8-3bf09167a73a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:10.453537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-3355ef7b-cc6e-420d-bef8-3bf09167a73a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:10.516585 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-3355ef7b-cc6e-420d-bef8-3bf09167a73a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '09e640037b8a4b84a0d3ea13d1db365a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe1c90987d924f30b44cdf96f95a06b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:10.524636 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-3355ef7b-cc6e-420d-bef8-3bf09167a73a tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 200 len: 1220 microversion: 2.1 time: 0.085445 Aug 23 19:32:10.525299 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4154/8167] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:10 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 1220 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:11.546272 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c6ab02f2-acc8-4df5-9df9-633c895ade6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:11.546902 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c6ab02f2-acc8-4df5-9df9-633c895ade6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [instance: 1c7008ba-fba6-44a2-af43-7222b4d246a1] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:11.553837 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6ab02f2-acc8-4df5-9df9-633c895ade6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:11.554334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6ab02f2-acc8-4df5-9df9-633c895ade6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:11.555469 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6ab02f2-acc8-4df5-9df9-633c895ade6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:11.556239 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6ab02f2-acc8-4df5-9df9-633c895ade6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:11.556702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6ab02f2-acc8-4df5-9df9-633c895ade6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:11.557131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c6ab02f2-acc8-4df5-9df9-633c895ade6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:11.572381 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-c6ab02f2-acc8-4df5-9df9-633c895ade6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] HTTP exception thrown: Instance 1c7008ba-fba6-44a2-af43-7222b4d246a1 could not be found. Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c6ab02f2-acc8-4df5-9df9-633c895ade6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Request method failure captured: Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 HTTP/1.1 Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBSjdip_e7vhtc3FW00oXcOV84no-Fm0mYNNPigBn2duz1asOpE04vDjf-5Y3DJaExpgzntztUr-svKxBr1Ftq9wrQidmb7sKP1CWpLlUE3Wt3klYfOnKzIrau9j7XZWKgOuVM21M48B9tagIWqFetlE599otXICB_OVSNKeySfCEI_w Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: fe1c90987d924f30b44cdf96f95a06b7 Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestShelveInstance-716732151 Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_fe1c90987d924f30b44cdf96f95a06b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe1c90987d924f30b44cdf96f95a06b7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/fe1c90987d924f30b44cdf96f95a06b7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/fe1c90987d924f30b44cdf96f95a06b7"}]}] Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestShelveInstance-716732151 Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: fe1c90987d924f30b44cdf96f95a06b7 Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestShelveInstance-716732151 Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestShelveInstance-716732151-project Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 09e640037b8a4b84a0d3ea13d1db365a Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestShelveInstance-716732151-project Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 1c7008ba-fba6-44a2-af43-7222b4d246a1 could not be found. Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '1c7008ba-fba6-44a2-af43-7222b4d246a1'} Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c7008ba-fba6-44a2-af43-7222b4d246a1 could not be found. Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c7008ba-fba6-44a2-af43-7222b4d246a1 could not be found. Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:32:11.574372 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:32:11.579148 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:32:11.579148 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:32:11.579148 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:32:11.579148 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:32:11.579148 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:32:11.579148 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c7008ba-fba6-44a2-af43-7222b4d246a1 could not be found. Aug 23 19:32:11.579148 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:32:11.580681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c6ab02f2-acc8-4df5-9df9-633c895ade6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Returning 404 to user: Instance 1c7008ba-fba6-44a2-af43-7222b4d246a1 could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:32:11.581792 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c6ab02f2-acc8-4df5-9df9-633c895ade6b tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1" status: 404 len: 111 microversion: 2.1 time: 0.039542 Aug 23 19:32:11.586328 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4014/8168] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:11 2022] GET /compute/v2.1/servers/1c7008ba-fba6-44a2-af43-7222b4d246a1 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:32:11.754571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ba93ba3e-e711-47af-97a5-3fdfe306d832 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] Calling method '.version_select at 0x7f27ec342820>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:11.768065 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ba93ba3e-e711-47af-97a5-3fdfe306d832 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [ee013254-ad44-4cb4-b5e8-493e981442a5] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:32:12.781394 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [None req-ba93ba3e-e711-47af-97a5-3fdfe306d832 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] [ee013254-ad44-4cb4-b5e8-493e981442a5] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 37270. Aug 23 19:32:12.809083 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ba93ba3e-e711-47af-97a5-3fdfe306d832 tempest-TestShelveInstance-716732151 tempest-TestShelveInstance-716732151-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2102179235" status: 202 len: 0 microversion: 2.1 time: 1.058713 Aug 23 19:32:12.809679 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4155/8169] 10.222.0.61 () {58 vars in 1254 bytes} [Tue Aug 23 19:32:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2102179235 => generated 0 bytes in 1060 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:32:30.580935 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:32:30.581860 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:32:30.755168 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-eedeb0f0-5af7-4142-a14c-01b2297eb5da tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Action: 'create', calling method: .version_select at 0x7f27dfaa75e0>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1534553499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPQIQfR0irBFuFJBEhxXCYMcuuQmfFj3CACtqFkdGyQKilvGpMfL7FpKxfnDeZKmyoPgf2XG7XmbBCXInAllj2pLtMSArHE2P3IFmNiDh7OCI6lvmqUar0mhZfg9o4jIw=="}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:32:30.773062 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-eedeb0f0-5af7-4142-a14c-01b2297eb5da tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Getting quotas for project afdef3c40f1146969f7f92116210556a. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:32:30.778615 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-eedeb0f0-5af7-4142-a14c-01b2297eb5da tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Getting quotas for user 087ec0704e924d2cbf1015e90182e286 and project afdef3c40f1146969f7f92116210556a. Resources: {'key_pairs'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:32:30.793221 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [None req-eedeb0f0-5af7-4142-a14c-01b2297eb5da tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [5b22d8ef-03cc-4341-ab6b-d5561bf06d31] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:32:31.799668 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [None req-eedeb0f0-5af7-4142-a14c-01b2297eb5da tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [5b22d8ef-03cc-4341-ab6b-d5561bf06d31] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 37372. Aug 23 19:32:31.818897 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-eedeb0f0-5af7-4142-a14c-01b2297eb5da tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 1.243037 Aug 23 19:32:31.819734 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4015/8170] 10.222.0.61 () {60 vars in 1159 bytes} [Tue Aug 23 19:32:30 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 1245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:32:32.836817 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1850262142", "imageRef": "126e0038-c91e-4894-b027-98e76f88a186", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1534553499", "security_groups": [{"name": "tempest-secgroup-smoke-410377526"}], "networks": [{"uuid": "43939286-94d6-495a-8fda-cdbf8d9f5de4"}]}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:32:32.845902 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=22 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:32:32.846717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=13,nova_api:DELETE=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:32:32.959785 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.network.neutron [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] validate_networks() for [('43939286-94d6-495a-8fda-cdbf8d9f5de4', None, None, None, None, None)] {{(pid=128808) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:32:33.506857 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Flavor limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:32:33.507303 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Image limits 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:32:33.508286 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Flavor pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:32:33.508726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Image pref 0:0:0 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:32:33.509160 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.virt.hardware [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128808) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:32:33.518410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:33.518947 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:33.519406 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:33.520158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:33.520633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:33.521078 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:33.540249 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Getting quotas for project afdef3c40f1146969f7f92116210556a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:32:33.546238 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.quota [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Getting quotas for user 087ec0704e924d2cbf1015e90182e286 and project afdef3c40f1146969f7f92116210556a. Resources: {'cores', 'instances', 'ram'} {{(pid=128808) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:32:33.559714 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Going to run 1 instances... {{(pid=128808) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:32:33.562107 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='126e0038-c91e-4894-b027-98e76f88a186',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128808) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:32:33.609696 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-cee62248-6e99-44c6-be8c-a3ce3a968f95 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.777105 Aug 23 19:32:33.610365 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4156/8171] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:32:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:32:33.625806 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-275f55c3-7e93-4f22-91fc-7c154a7642c6 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:33.626292 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-275f55c3-7e93-4f22-91fc-7c154a7642c6 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:33.697556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-275f55c3-7e93-4f22-91fc-7c154a7642c6 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:33.705032 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-275f55c3-7e93-4f22-91fc-7c154a7642c6 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1249 microversion: 2.1 time: 0.084715 Aug 23 19:32:33.705819 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4016/8172] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:33 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1249 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:34.727812 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-4e27339e-e56a-4008-803f-f98127e1f47e tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:34.729345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-4e27339e-e56a-4008-803f-f98127e1f47e tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:34.737210 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e27339e-e56a-4008-803f-f98127e1f47e tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:34.737726 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e27339e-e56a-4008-803f-f98127e1f47e tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:34.738411 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e27339e-e56a-4008-803f-f98127e1f47e tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:34.739167 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e27339e-e56a-4008-803f-f98127e1f47e tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:34.739640 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e27339e-e56a-4008-803f-f98127e1f47e tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:34.741380 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-4e27339e-e56a-4008-803f-f98127e1f47e tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:34.874836 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-4e27339e-e56a-4008-803f-f98127e1f47e tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:34.883305 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-4e27339e-e56a-4008-803f-f98127e1f47e tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1319 microversion: 2.1 time: 0.159750 Aug 23 19:32:34.883967 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4157/8173] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:34 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:35.905401 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-69980fd0-9c08-420d-bcd9-8a789402ceb9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:35.906647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-69980fd0-9c08-420d-bcd9-8a789402ceb9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:35.915428 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69980fd0-9c08-420d-bcd9-8a789402ceb9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:35.915933 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69980fd0-9c08-420d-bcd9-8a789402ceb9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:35.916380 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69980fd0-9c08-420d-bcd9-8a789402ceb9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:35.917093 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69980fd0-9c08-420d-bcd9-8a789402ceb9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:35.917556 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69980fd0-9c08-420d-bcd9-8a789402ceb9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:35.917991 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-69980fd0-9c08-420d-bcd9-8a789402ceb9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:36.137903 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-69980fd0-9c08-420d-bcd9-8a789402ceb9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:36.141417 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-ca1cfdf6-2feb-44cd-b3e5-f3a0acc6703b req-1b4b53a6-0fc4-408b-887c-cb6b5401fcc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4009e1-f798-4441-9ff0-691d0d25375b", "tag": "f31cdcb1-7be0-4de4-b8bb-052ea4802d1c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:32:36.147589 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-69980fd0-9c08-420d-bcd9-8a789402ceb9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1374 microversion: 2.1 time: 0.245980 Aug 23 19:32:36.152414 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ca1cfdf6-2feb-44cd-b3e5-f3a0acc6703b req-1b4b53a6-0fc4-408b-887c-cb6b5401fcc7 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:36.153139 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ca1cfdf6-2feb-44cd-b3e5-f3a0acc6703b req-1b4b53a6-0fc4-408b-887c-cb6b5401fcc7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:36.153893 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-ca1cfdf6-2feb-44cd-b3e5-f3a0acc6703b req-1b4b53a6-0fc4-408b-887c-cb6b5401fcc7 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:36.162598 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4017/8174] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:35 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1374 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:36.181844 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-ca1cfdf6-2feb-44cd-b3e5-f3a0acc6703b req-1b4b53a6-0fc4-408b-887c-cb6b5401fcc7 service nova] Creating event network-changed:f31cdcb1-7be0-4de4-b8bb-052ea4802d1c for instance 8d4009e1-f798-4441-9ff0-691d0d25375b on n-h2-850468-16 Aug 23 19:32:36.188187 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-ca1cfdf6-2feb-44cd-b3e5-f3a0acc6703b req-1b4b53a6-0fc4-408b-887c-cb6b5401fcc7 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117939 Aug 23 19:32:36.188901 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4158/8175] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:32:37.174600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-fefe1080-9595-4ed5-b7e1-a4f18be87dfa tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:37.175154 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-fefe1080-9595-4ed5-b7e1-a4f18be87dfa tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:37.182989 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fefe1080-9595-4ed5-b7e1-a4f18be87dfa tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:37.183475 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fefe1080-9595-4ed5-b7e1-a4f18be87dfa tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:37.183918 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fefe1080-9595-4ed5-b7e1-a4f18be87dfa tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:37.184611 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fefe1080-9595-4ed5-b7e1-a4f18be87dfa tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:37.185072 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fefe1080-9595-4ed5-b7e1-a4f18be87dfa tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:37.185508 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-fefe1080-9595-4ed5-b7e1-a4f18be87dfa tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:37.319625 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-fefe1080-9595-4ed5-b7e1-a4f18be87dfa tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:37.327322 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-fefe1080-9595-4ed5-b7e1-a4f18be87dfa tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1374 microversion: 2.1 time: 0.156739 Aug 23 19:32:37.327895 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4018/8176] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:37 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:38.349670 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-d4f2ae57-6b19-48bd-901e-a57da65f39a7 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:38.350319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-d4f2ae57-6b19-48bd-901e-a57da65f39a7 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:38.356649 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f2ae57-6b19-48bd-901e-a57da65f39a7 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:38.357156 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f2ae57-6b19-48bd-901e-a57da65f39a7 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:38.357610 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f2ae57-6b19-48bd-901e-a57da65f39a7 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:38.358319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f2ae57-6b19-48bd-901e-a57da65f39a7 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:38.358816 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f2ae57-6b19-48bd-901e-a57da65f39a7 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:38.359260 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-d4f2ae57-6b19-48bd-901e-a57da65f39a7 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:38.493370 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-d4f2ae57-6b19-48bd-901e-a57da65f39a7 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:38.501129 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-d4f2ae57-6b19-48bd-901e-a57da65f39a7 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1374 microversion: 2.1 time: 0.156712 Aug 23 19:32:38.501700 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4159/8177] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:38 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1374 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:39.522522 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-60da3c7f-170f-4e3e-a562-7eef03942bac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:39.523221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-60da3c7f-170f-4e3e-a562-7eef03942bac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:39.530578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60da3c7f-170f-4e3e-a562-7eef03942bac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:39.531081 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60da3c7f-170f-4e3e-a562-7eef03942bac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:39.531521 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60da3c7f-170f-4e3e-a562-7eef03942bac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:39.532226 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60da3c7f-170f-4e3e-a562-7eef03942bac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:39.532690 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60da3c7f-170f-4e3e-a562-7eef03942bac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:39.533125 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-60da3c7f-170f-4e3e-a562-7eef03942bac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:39.668728 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-60da3c7f-170f-4e3e-a562-7eef03942bac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:39.676502 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-60da3c7f-170f-4e3e-a562-7eef03942bac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1374 microversion: 2.1 time: 0.157962 Aug 23 19:32:39.677064 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4019/8178] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:39 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1374 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 23 19:32:40.698172 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5aa3998e-7d02-43e4-ae42-df21604193ac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:40.698944 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5aa3998e-7d02-43e4-ae42-df21604193ac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:40.705814 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa3998e-7d02-43e4-ae42-df21604193ac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:40.706317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa3998e-7d02-43e4-ae42-df21604193ac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:40.706807 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa3998e-7d02-43e4-ae42-df21604193ac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:40.707527 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa3998e-7d02-43e4-ae42-df21604193ac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:40.708002 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa3998e-7d02-43e4-ae42-df21604193ac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:40.708447 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5aa3998e-7d02-43e4-ae42-df21604193ac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:40.848087 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5aa3998e-7d02-43e4-ae42-df21604193ac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:40.856291 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5aa3998e-7d02-43e4-ae42-df21604193ac tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1374 microversion: 2.1 time: 0.162758 Aug 23 19:32:40.856866 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4160/8179] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:40 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:41.877104 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-cd798da9-7c64-488a-9afa-8600af5b6b3a tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:41.877674 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-cd798da9-7c64-488a-9afa-8600af5b6b3a tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:41.884930 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd798da9-7c64-488a-9afa-8600af5b6b3a tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:41.885424 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd798da9-7c64-488a-9afa-8600af5b6b3a tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:41.885872 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd798da9-7c64-488a-9afa-8600af5b6b3a tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:41.886624 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd798da9-7c64-488a-9afa-8600af5b6b3a tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:41.887094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd798da9-7c64-488a-9afa-8600af5b6b3a tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:41.887528 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-cd798da9-7c64-488a-9afa-8600af5b6b3a tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:42.030578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-cd798da9-7c64-488a-9afa-8600af5b6b3a tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:42.038213 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-cd798da9-7c64-488a-9afa-8600af5b6b3a tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1374 microversion: 2.1 time: 0.165113 Aug 23 19:32:42.038839 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4020/8180] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:41 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:43.061276 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-beefe480-47b8-4032-ae27-3c7d37bf65b4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:43.061907 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-beefe480-47b8-4032-ae27-3c7d37bf65b4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:43.068120 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beefe480-47b8-4032-ae27-3c7d37bf65b4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:43.068637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beefe480-47b8-4032-ae27-3c7d37bf65b4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:43.069209 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beefe480-47b8-4032-ae27-3c7d37bf65b4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:43.069605 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-11422d45-7d22-47ff-9d4c-678651f769fc req-c9c7cb7d-4d3c-4b2d-aad6-d0ee3eae8af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4009e1-f798-4441-9ff0-691d0d25375b", "name": "network-vif-plugged", "status": "completed", "tag": "f31cdcb1-7be0-4de4-b8bb-052ea4802d1c"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:32:43.070117 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beefe480-47b8-4032-ae27-3c7d37bf65b4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:43.070904 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beefe480-47b8-4032-ae27-3c7d37bf65b4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:43.071394 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-beefe480-47b8-4032-ae27-3c7d37bf65b4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:43.081677 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-11422d45-7d22-47ff-9d4c-678651f769fc req-c9c7cb7d-4d3c-4b2d-aad6-d0ee3eae8af6 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:43.082463 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-11422d45-7d22-47ff-9d4c-678651f769fc req-c9c7cb7d-4d3c-4b2d-aad6-d0ee3eae8af6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:43.083004 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-11422d45-7d22-47ff-9d4c-678651f769fc req-c9c7cb7d-4d3c-4b2d-aad6-d0ee3eae8af6 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:43.096197 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-11422d45-7d22-47ff-9d4c-678651f769fc req-c9c7cb7d-4d3c-4b2d-aad6-d0ee3eae8af6 service nova] Creating event network-vif-plugged:f31cdcb1-7be0-4de4-b8bb-052ea4802d1c for instance 8d4009e1-f798-4441-9ff0-691d0d25375b on n-h2-850468-16 Aug 23 19:32:43.102052 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-11422d45-7d22-47ff-9d4c-678651f769fc req-c9c7cb7d-4d3c-4b2d-aad6-d0ee3eae8af6 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035719 Aug 23 19:32:43.102979 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4021/8181] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:32:43.250581 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-beefe480-47b8-4032-ae27-3c7d37bf65b4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:43.259041 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-beefe480-47b8-4032-ae27-3c7d37bf65b4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1374 microversion: 2.1 time: 0.202991 Aug 23 19:32:43.259620 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4161/8182] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:43 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1374 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:44.284307 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-a1d191c8-3158-49fb-b041-0cd4aab1479b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:44.285022 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-a1d191c8-3158-49fb-b041-0cd4aab1479b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:44.287037 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=6 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:32:44.294131 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1d191c8-3158-49fb-b041-0cd4aab1479b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:44.294729 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1d191c8-3158-49fb-b041-0cd4aab1479b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:44.295179 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1d191c8-3158-49fb-b041-0cd4aab1479b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:44.295884 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1d191c8-3158-49fb-b041-0cd4aab1479b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:44.296351 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1d191c8-3158-49fb-b041-0cd4aab1479b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:44.296783 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-a1d191c8-3158-49fb-b041-0cd4aab1479b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:44.431006 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-a1d191c8-3158-49fb-b041-0cd4aab1479b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:44.439513 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-a1d191c8-3158-49fb-b041-0cd4aab1479b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1374 microversion: 2.1 time: 0.161384 Aug 23 19:32:44.440356 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4022/8183] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:44 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1374 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:45.460984 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-976ad833-7e37-4b26-9627-3382724d53b2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:45.461563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-976ad833-7e37-4b26-9627-3382724d53b2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:45.465011 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:32:45.465678 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=6 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:32:45.470045 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-976ad833-7e37-4b26-9627-3382724d53b2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:45.470570 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-976ad833-7e37-4b26-9627-3382724d53b2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:45.471026 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-976ad833-7e37-4b26-9627-3382724d53b2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:45.471746 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-976ad833-7e37-4b26-9627-3382724d53b2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:45.472218 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-976ad833-7e37-4b26-9627-3382724d53b2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:45.472665 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-976ad833-7e37-4b26-9627-3382724d53b2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:45.612673 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-976ad833-7e37-4b26-9627-3382724d53b2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:45.621677 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-976ad833-7e37-4b26-9627-3382724d53b2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1558 microversion: 2.1 time: 0.164590 Aug 23 19:32:45.622258 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4162/8184] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:45 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1558 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:45.641601 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1af53565-8fef-4945-8049-c97e16fba8d2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:32:45.642217 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1af53565-8fef-4945-8049-c97e16fba8d2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:32:45.649070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1af53565-8fef-4945-8049-c97e16fba8d2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:45.649551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1af53565-8fef-4945-8049-c97e16fba8d2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:45.649990 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1af53565-8fef-4945-8049-c97e16fba8d2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:45.651579 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1af53565-8fef-4945-8049-c97e16fba8d2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:45.652061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1af53565-8fef-4945-8049-c97e16fba8d2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:45.652493 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1af53565-8fef-4945-8049-c97e16fba8d2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:45.787032 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1af53565-8fef-4945-8049-c97e16fba8d2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:32:45.794879 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1af53565-8fef-4945-8049-c97e16fba8d2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1558 microversion: 2.1 time: 0.157109 Aug 23 19:32:45.795451 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4023/8185] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:32:45 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:32:47.563775 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3d51feb0-e482-4f55-b73f-b3a286f92275 req-b4936081-077c-486f-9dc3-bb58211784b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4009e1-f798-4441-9ff0-691d0d25375b", "tag": "f31cdcb1-7be0-4de4-b8bb-052ea4802d1c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:32:47.574953 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3d51feb0-e482-4f55-b73f-b3a286f92275 req-b4936081-077c-486f-9dc3-bb58211784b3 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:32:47.575512 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3d51feb0-e482-4f55-b73f-b3a286f92275 req-b4936081-077c-486f-9dc3-bb58211784b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:32:47.576036 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3d51feb0-e482-4f55-b73f-b3a286f92275 req-b4936081-077c-486f-9dc3-bb58211784b3 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:32:47.587393 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3d51feb0-e482-4f55-b73f-b3a286f92275 req-b4936081-077c-486f-9dc3-bb58211784b3 service nova] Creating event network-changed:f31cdcb1-7be0-4de4-b8bb-052ea4802d1c for instance 8d4009e1-f798-4441-9ff0-691d0d25375b on n-h2-850468-16 Aug 23 19:32:47.593289 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3d51feb0-e482-4f55-b73f-b3a286f92275 req-b4936081-077c-486f-9dc3-bb58211784b3 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033224 Aug 23 19:32:47.593885 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4163/8186] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:32:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:34:21.935679 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:34:21.936260 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:34:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:35:15.543482 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 19:35:15.544380 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] AMQP server on 10.222.0.61:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 23 19:35:15.544953 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:35:15.545694 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=38 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:35:15.550172 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6f68ce21-591b-4405-a1a8-195b0f8597e2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-853696907"}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:35:15.552487 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6f68ce21-591b-4405-a1a8-195b0f8597e2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:15.560070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f68ce21-591b-4405-a1a8-195b0f8597e2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:15.560551 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f68ce21-591b-4405-a1a8-195b0f8597e2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:15.560988 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f68ce21-591b-4405-a1a8-195b0f8597e2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:15.561681 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f68ce21-591b-4405-a1a8-195b0f8597e2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:15.562135 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f68ce21-591b-4405-a1a8-195b0f8597e2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:15.562578 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6f68ce21-591b-4405-a1a8-195b0f8597e2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:15.759170 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6f68ce21-591b-4405-a1a8-195b0f8597e2 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "POST /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b/action" status: 202 len: 0 microversion: 2.1 time: 0.217434 Aug 23 19:35:15.759919 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4024/8187] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:35:15 2022] POST /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 19:35:23.949081 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4ea61cea-341f-4994-9508-d9cf4674c693] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:35:23.950131 n-d-850468-16 devstack@n-api.service[128808]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2a3fd44c-0004-4783-9f1a-6f2fcc77fcee] AMQP server on 10.222.0.61:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 23 19:35:23.950502 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:35:23.951336 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=36 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:35:23.957222 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-8acd4e2b-f799-4c08-832d-16e0528f0ade req-0d816ced-c541-4a5b-8adc-a5f401c3c14f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4009e1-f798-4441-9ff0-691d0d25375b", "name": "network-vif-plugged", "status": "completed", "tag": "f31cdcb1-7be0-4de4-b8bb-052ea4802d1c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:35:23.971627 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8acd4e2b-f799-4c08-832d-16e0528f0ade req-0d816ced-c541-4a5b-8adc-a5f401c3c14f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:23.972126 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8acd4e2b-f799-4c08-832d-16e0528f0ade req-0d816ced-c541-4a5b-8adc-a5f401c3c14f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:23.972574 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-8acd4e2b-f799-4c08-832d-16e0528f0ade req-0d816ced-c541-4a5b-8adc-a5f401c3c14f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:23.983344 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-8acd4e2b-f799-4c08-832d-16e0528f0ade req-0d816ced-c541-4a5b-8adc-a5f401c3c14f service nova] Creating event network-vif-plugged:f31cdcb1-7be0-4de4-b8bb-052ea4802d1c for instance 8d4009e1-f798-4441-9ff0-691d0d25375b on n-h2-850468-16 Aug 23 19:35:23.988705 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-8acd4e2b-f799-4c08-832d-16e0528f0ade req-0d816ced-c541-4a5b-8adc-a5f401c3c14f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041321 Aug 23 19:35:23.989285 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4164/8188] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:35:34.435108 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-1964467428", "imageRef": "6eb4f21b-d1e5-4604-b864-2f91c1b3e9f4", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1534553499", "security_groups": [{"name": "tempest-secgroup-smoke-410377526"}], "networks": [{"uuid": "43939286-94d6-495a-8fda-cdbf8d9f5de4"}]}} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:35:34.445441 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:35:34.446159 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:35:34.459919 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 37662. Aug 23 19:35:34.473077 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 37664. Aug 23 19:35:34.570304 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.network.neutron [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] validate_networks() for [('43939286-94d6-495a-8fda-cdbf8d9f5de4', None, None, None, None, None)] {{(pid=128807) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 23 19:35:35.004589 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Flavor limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 23 19:35:35.005014 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Image limits 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 23 19:35:35.005490 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Flavor pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 23 19:35:35.005901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Image pref 0:0:0 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 23 19:35:35.006315 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.virt.hardware [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=128807) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 23 19:35:35.015243 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:35.015723 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:35.016186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:35.017544 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:35.018033 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:35.018461 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:35.035419 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Getting quotas for project afdef3c40f1146969f7f92116210556a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 23 19:35:35.040595 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.quota [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Getting quotas for user 087ec0704e924d2cbf1015e90182e286 and project afdef3c40f1146969f7f92116210556a. Resources: {'cores', 'instances', 'ram'} {{(pid=128807) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 23 19:35:35.052775 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Going to run 1 instances... {{(pid=128807) _provision_instances /opt/stack/nova/nova/compute/api.py:1390}} Aug 23 19:35:35.055338 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='6eb4f21b-d1e5-4604-b864-2f91c1b3e9f4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=128807) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1851}} Aug 23 19:35:35.103989 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7e22cc35-4453-4497-a919-2e5bc88e8164 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.672943 Aug 23 19:35:35.104645 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4025/8189] 10.222.0.61 () {60 vars in 1147 bytes} [Tue Aug 23 19:35:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 23 19:35:35.114951 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:35:35.115749 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:35:35.124989 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ea1911f7-cca5-43ee-95a2-e3cf38e52a78 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:35.125735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ea1911f7-cca5-43ee-95a2-e3cf38e52a78 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:35.139913 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] [4ea61cea-341f-4994-9508-d9cf4674c693] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 37680. Aug 23 19:35:35.140659 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] [2a3fd44c-0004-4783-9f1a-6f2fcc77fcee] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 37682. Aug 23 19:35:35.194100 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ea1911f7-cca5-43ee-95a2-e3cf38e52a78 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:35.201852 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ea1911f7-cca5-43ee-95a2-e3cf38e52a78 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1249 microversion: 2.1 time: 0.089965 Aug 23 19:35:35.202409 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4165/8190] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:35 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1249 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:36.223623 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-7b3ca61b-4493-4190-a192-09fc8fc51113 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:36.224225 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-7b3ca61b-4493-4190-a192-09fc8fc51113 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:36.283426 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-7b3ca61b-4493-4190-a192-09fc8fc51113 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:36.290600 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-7b3ca61b-4493-4190-a192-09fc8fc51113 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1249 microversion: 2.1 time: 0.071775 Aug 23 19:35:36.291180 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4026/8191] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:36 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1249 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:37.311980 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8ae085f3-7f67-49e6-af2e-2a4c39175548 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:37.312602 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8ae085f3-7f67-49e6-af2e-2a4c39175548 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:37.323208 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ae085f3-7f67-49e6-af2e-2a4c39175548 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:37.323764 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ae085f3-7f67-49e6-af2e-2a4c39175548 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:37.324221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ae085f3-7f67-49e6-af2e-2a4c39175548 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:37.324935 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ae085f3-7f67-49e6-af2e-2a4c39175548 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:37.325576 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ae085f3-7f67-49e6-af2e-2a4c39175548 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:37.326014 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8ae085f3-7f67-49e6-af2e-2a4c39175548 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:37.401689 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8ae085f3-7f67-49e6-af2e-2a4c39175548 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:37.410387 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8ae085f3-7f67-49e6-af2e-2a4c39175548 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1307 microversion: 2.1 time: 0.102300 Aug 23 19:35:37.410994 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4166/8192] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:37 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1307 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:37.976647 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-268a664e-6a16-4a8b-bb63-0c51f80a7689 req-982150b4-3e7c-40fc-990a-cbca3aa8237a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4009e1-f798-4441-9ff0-691d0d25375b", "name": "network-vif-unplugged", "status": "completed", "tag": "f31cdcb1-7be0-4de4-b8bb-052ea4802d1c"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:35:38.008398 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-268a664e-6a16-4a8b-bb63-0c51f80a7689 req-982150b4-3e7c-40fc-990a-cbca3aa8237a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:38.010235 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-268a664e-6a16-4a8b-bb63-0c51f80a7689 req-982150b4-3e7c-40fc-990a-cbca3aa8237a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:38.011772 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-268a664e-6a16-4a8b-bb63-0c51f80a7689 req-982150b4-3e7c-40fc-990a-cbca3aa8237a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:38.050838 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-268a664e-6a16-4a8b-bb63-0c51f80a7689 req-982150b4-3e7c-40fc-990a-cbca3aa8237a service nova] Creating event network-vif-unplugged:f31cdcb1-7be0-4de4-b8bb-052ea4802d1c for instance 8d4009e1-f798-4441-9ff0-691d0d25375b on n-h2-850468-16 Aug 23 19:35:38.067857 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-268a664e-6a16-4a8b-bb63-0c51f80a7689 req-982150b4-3e7c-40fc-990a-cbca3aa8237a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.094457 Aug 23 19:35:38.068958 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4027/8193] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:35:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:35:38.431597 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5daf8f10-2a22-4478-a214-4f1b3100faab tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:38.432852 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5daf8f10-2a22-4478-a214-4f1b3100faab tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:38.440742 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5daf8f10-2a22-4478-a214-4f1b3100faab tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:38.441239 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5daf8f10-2a22-4478-a214-4f1b3100faab tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:38.441687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5daf8f10-2a22-4478-a214-4f1b3100faab tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:38.442401 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5daf8f10-2a22-4478-a214-4f1b3100faab tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:38.442889 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5daf8f10-2a22-4478-a214-4f1b3100faab tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:38.443326 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5daf8f10-2a22-4478-a214-4f1b3100faab tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:38.587729 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-5daf8f10-2a22-4478-a214-4f1b3100faab tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:38.597588 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5daf8f10-2a22-4478-a214-4f1b3100faab tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.169659 Aug 23 19:35:38.598175 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4167/8194] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:38 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:39.627094 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-89e3a24c-bf18-4487-8d00-44da1c0ea532 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:39.636782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-89e3a24c-bf18-4487-8d00-44da1c0ea532 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:39.645938 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89e3a24c-bf18-4487-8d00-44da1c0ea532 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:39.646646 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89e3a24c-bf18-4487-8d00-44da1c0ea532 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:39.647337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89e3a24c-bf18-4487-8d00-44da1c0ea532 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:39.648301 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89e3a24c-bf18-4487-8d00-44da1c0ea532 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:39.648764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89e3a24c-bf18-4487-8d00-44da1c0ea532 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:39.649200 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-89e3a24c-bf18-4487-8d00-44da1c0ea532 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:40.140565 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-89e3a24c-bf18-4487-8d00-44da1c0ea532 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:40.148891 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-89e3a24c-bf18-4487-8d00-44da1c0ea532 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.528503 Aug 23 19:35:40.149515 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4028/8195] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:39 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:41.170386 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-e3e02f48-b168-4ee3-85d5-945b5a35f9cf tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:41.171065 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-e3e02f48-b168-4ee3-85d5-945b5a35f9cf tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:41.178987 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3e02f48-b168-4ee3-85d5-945b5a35f9cf tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:41.179491 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3e02f48-b168-4ee3-85d5-945b5a35f9cf tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:41.179942 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3e02f48-b168-4ee3-85d5-945b5a35f9cf tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:41.180660 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3e02f48-b168-4ee3-85d5-945b5a35f9cf tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:41.181132 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3e02f48-b168-4ee3-85d5-945b5a35f9cf tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:41.183735 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-e3e02f48-b168-4ee3-85d5-945b5a35f9cf tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:41.339615 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-e3e02f48-b168-4ee3-85d5-945b5a35f9cf tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:41.348199 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-e3e02f48-b168-4ee3-85d5-945b5a35f9cf tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.181584 Aug 23 19:35:41.348791 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4168/8196] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:41 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:42.370650 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-1c7ad149-5788-4c53-a93d-568b4665cf5c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:42.371221 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-1c7ad149-5788-4c53-a93d-568b4665cf5c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:42.379496 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c7ad149-5788-4c53-a93d-568b4665cf5c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:42.380040 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c7ad149-5788-4c53-a93d-568b4665cf5c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:42.380537 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c7ad149-5788-4c53-a93d-568b4665cf5c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:42.381324 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c7ad149-5788-4c53-a93d-568b4665cf5c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:42.381857 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c7ad149-5788-4c53-a93d-568b4665cf5c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:42.382334 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-1c7ad149-5788-4c53-a93d-568b4665cf5c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:42.524222 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-1c7ad149-5788-4c53-a93d-568b4665cf5c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:42.532156 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-1c7ad149-5788-4c53-a93d-568b4665cf5c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.165437 Aug 23 19:35:42.533583 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4029/8197] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:42 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:43.554204 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ed4df309-ac4a-4637-9842-10b089d5f9d4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:43.554859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-ed4df309-ac4a-4637-9842-10b089d5f9d4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:43.562427 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed4df309-ac4a-4637-9842-10b089d5f9d4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:43.563217 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed4df309-ac4a-4637-9842-10b089d5f9d4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:43.564284 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed4df309-ac4a-4637-9842-10b089d5f9d4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:43.565308 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed4df309-ac4a-4637-9842-10b089d5f9d4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:43.565884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed4df309-ac4a-4637-9842-10b089d5f9d4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:43.566342 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-ed4df309-ac4a-4637-9842-10b089d5f9d4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:43.726809 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-ed4df309-ac4a-4637-9842-10b089d5f9d4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:43.736040 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ed4df309-ac4a-4637-9842-10b089d5f9d4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.185356 Aug 23 19:35:43.736965 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4169/8198] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:43 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:44.757823 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-f8105836-7231-4a76-b6f0-f8f8c2a6abe0 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:44.758471 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-f8105836-7231-4a76-b6f0-f8f8c2a6abe0 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:44.765901 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8105836-7231-4a76-b6f0-f8f8c2a6abe0 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:44.766204 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8105836-7231-4a76-b6f0-f8f8c2a6abe0 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:44.766629 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8105836-7231-4a76-b6f0-f8f8c2a6abe0 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:44.768572 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8105836-7231-4a76-b6f0-f8f8c2a6abe0 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:44.769063 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8105836-7231-4a76-b6f0-f8f8c2a6abe0 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:44.769494 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-f8105836-7231-4a76-b6f0-f8f8c2a6abe0 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:44.916608 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-f8105836-7231-4a76-b6f0-f8f8c2a6abe0 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:44.924572 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-f8105836-7231-4a76-b6f0-f8f8c2a6abe0 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.170617 Aug 23 19:35:44.925155 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4030/8199] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:44 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:45.946507 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a15bc6bd-a600-430f-a9b3-0ec5827aa2a4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:45.947504 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a15bc6bd-a600-430f-a9b3-0ec5827aa2a4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:45.950175 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell0:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:35:45.957088 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a15bc6bd-a600-430f-a9b3-0ec5827aa2a4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:45.957696 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a15bc6bd-a600-430f-a9b3-0ec5827aa2a4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:45.958184 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a15bc6bd-a600-430f-a9b3-0ec5827aa2a4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:45.958931 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a15bc6bd-a600-430f-a9b3-0ec5827aa2a4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:45.959413 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a15bc6bd-a600-430f-a9b3-0ec5827aa2a4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:45.959884 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a15bc6bd-a600-430f-a9b3-0ec5827aa2a4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:46.094109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-a15bc6bd-a600-430f-a9b3-0ec5827aa2a4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:46.102568 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a15bc6bd-a600-430f-a9b3-0ec5827aa2a4 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.160810 Aug 23 19:35:46.103133 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4170/8200] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:45 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:47.123700 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-2e7c9dcc-4e9e-43f3-ba03-9cd5387e5105 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:47.124342 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-2e7c9dcc-4e9e-43f3-ba03-9cd5387e5105 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:47.126512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:35:47.128209 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell0:SELECT=8 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:35:47.134084 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e7c9dcc-4e9e-43f3-ba03-9cd5387e5105 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:47.134604 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e7c9dcc-4e9e-43f3-ba03-9cd5387e5105 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:47.135058 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e7c9dcc-4e9e-43f3-ba03-9cd5387e5105 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:47.135782 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e7c9dcc-4e9e-43f3-ba03-9cd5387e5105 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:47.136244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e7c9dcc-4e9e-43f3-ba03-9cd5387e5105 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:47.136678 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-2e7c9dcc-4e9e-43f3-ba03-9cd5387e5105 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:47.392574 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-2e7c9dcc-4e9e-43f3-ba03-9cd5387e5105 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:47.400565 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-2e7c9dcc-4e9e-43f3-ba03-9cd5387e5105 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.280849 Aug 23 19:35:47.401305 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4031/8201] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:47 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:47.800717 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-461c6475-0f3d-4ad9-888d-89455fb44ce3 req-c715115c-a474-4b7a-a4d1-78ff067f444c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a0a038f-f5da-47d2-b60d-5a536433865d", "tag": "1a95df9f-b617-4d65-8dc7-76357e7fb749"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:35:47.810269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-461c6475-0f3d-4ad9-888d-89455fb44ce3 req-c715115c-a474-4b7a-a4d1-78ff067f444c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:47.810804 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-461c6475-0f3d-4ad9-888d-89455fb44ce3 req-c715115c-a474-4b7a-a4d1-78ff067f444c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:47.811254 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-461c6475-0f3d-4ad9-888d-89455fb44ce3 req-c715115c-a474-4b7a-a4d1-78ff067f444c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:47.823553 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-461c6475-0f3d-4ad9-888d-89455fb44ce3 req-c715115c-a474-4b7a-a4d1-78ff067f444c service nova] Creating event network-changed:1a95df9f-b617-4d65-8dc7-76357e7fb749 for instance 7a0a038f-f5da-47d2-b60d-5a536433865d on n-h1-850468-16 Aug 23 19:35:47.828618 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-461c6475-0f3d-4ad9-888d-89455fb44ce3 req-c715115c-a474-4b7a-a4d1-78ff067f444c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110965 Aug 23 19:35:47.829861 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4171/8202] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:35:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:35:48.422097 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-707e1ed0-950a-436d-a7a9-44f80e7e85d1 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:48.422746 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-707e1ed0-950a-436d-a7a9-44f80e7e85d1 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:48.430721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-707e1ed0-950a-436d-a7a9-44f80e7e85d1 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:48.431215 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-707e1ed0-950a-436d-a7a9-44f80e7e85d1 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:48.431657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-707e1ed0-950a-436d-a7a9-44f80e7e85d1 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:48.432362 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-707e1ed0-950a-436d-a7a9-44f80e7e85d1 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:48.432822 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-707e1ed0-950a-436d-a7a9-44f80e7e85d1 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:48.433251 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-707e1ed0-950a-436d-a7a9-44f80e7e85d1 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:48.579313 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-707e1ed0-950a-436d-a7a9-44f80e7e85d1 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:48.589376 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-707e1ed0-950a-436d-a7a9-44f80e7e85d1 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.171193 Aug 23 19:35:48.589966 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4032/8203] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:48 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:49.617450 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-8945685b-dac6-4ab2-9cd4-ec2240684513 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:49.618191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-8945685b-dac6-4ab2-9cd4-ec2240684513 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:49.625551 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8945685b-dac6-4ab2-9cd4-ec2240684513 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:49.626099 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8945685b-dac6-4ab2-9cd4-ec2240684513 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:49.626801 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8945685b-dac6-4ab2-9cd4-ec2240684513 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:49.627635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8945685b-dac6-4ab2-9cd4-ec2240684513 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:49.628124 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8945685b-dac6-4ab2-9cd4-ec2240684513 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:49.628575 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-8945685b-dac6-4ab2-9cd4-ec2240684513 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:49.762705 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-8945685b-dac6-4ab2-9cd4-ec2240684513 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:49.771096 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-8945685b-dac6-4ab2-9cd4-ec2240684513 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.159669 Aug 23 19:35:49.771678 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4172/8204] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:49 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:50.793569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-edf04ab4-f7ee-403f-96b0-e1dba67c103c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:50.794838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-edf04ab4-f7ee-403f-96b0-e1dba67c103c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:50.801634 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-edf04ab4-f7ee-403f-96b0-e1dba67c103c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:50.802130 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-edf04ab4-f7ee-403f-96b0-e1dba67c103c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:50.802599 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-edf04ab4-f7ee-403f-96b0-e1dba67c103c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:50.803299 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-edf04ab4-f7ee-403f-96b0-e1dba67c103c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:50.803764 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-edf04ab4-f7ee-403f-96b0-e1dba67c103c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:50.804206 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-edf04ab4-f7ee-403f-96b0-e1dba67c103c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:50.953553 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-edf04ab4-f7ee-403f-96b0-e1dba67c103c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:50.962182 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-edf04ab4-f7ee-403f-96b0-e1dba67c103c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.173568 Aug 23 19:35:50.963120 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4033/8205] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:50 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:51.983410 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-57d1d85b-959b-4323-804f-c24f094b6f9c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:51.984032 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-57d1d85b-959b-4323-804f-c24f094b6f9c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:51.990939 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57d1d85b-959b-4323-804f-c24f094b6f9c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:51.991437 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57d1d85b-959b-4323-804f-c24f094b6f9c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:51.991890 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57d1d85b-959b-4323-804f-c24f094b6f9c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:51.992592 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57d1d85b-959b-4323-804f-c24f094b6f9c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:51.993066 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57d1d85b-959b-4323-804f-c24f094b6f9c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:51.993505 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57d1d85b-959b-4323-804f-c24f094b6f9c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:52.127469 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-57d1d85b-959b-4323-804f-c24f094b6f9c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:52.135448 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-57d1d85b-959b-4323-804f-c24f094b6f9c tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.155927 Aug 23 19:35:52.136031 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4173/8206] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:51 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:52.628995 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-905e149e-ad11-4374-9a30-7965145cdd98 req-f22ebd35-a316-4ce9-bfe0-213e37d2c46a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0a038f-f5da-47d2-b60d-5a536433865d", "name": "network-vif-plugged", "status": "completed", "tag": "1a95df9f-b617-4d65-8dc7-76357e7fb749"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:35:52.639173 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-905e149e-ad11-4374-9a30-7965145cdd98 req-f22ebd35-a316-4ce9-bfe0-213e37d2c46a service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:52.639713 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-905e149e-ad11-4374-9a30-7965145cdd98 req-f22ebd35-a316-4ce9-bfe0-213e37d2c46a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:52.640155 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-905e149e-ad11-4374-9a30-7965145cdd98 req-f22ebd35-a316-4ce9-bfe0-213e37d2c46a service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:52.652084 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-905e149e-ad11-4374-9a30-7965145cdd98 req-f22ebd35-a316-4ce9-bfe0-213e37d2c46a service nova] Creating event network-vif-plugged:1a95df9f-b617-4d65-8dc7-76357e7fb749 for instance 7a0a038f-f5da-47d2-b60d-5a536433865d on n-h1-850468-16 Aug 23 19:35:52.657266 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-905e149e-ad11-4374-9a30-7965145cdd98 req-f22ebd35-a316-4ce9-bfe0-213e37d2c46a service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095528 Aug 23 19:35:52.658143 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4034/8207] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:35:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:35:53.156633 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-57727031-794d-4823-b7b4-c664ef6a7f37 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:53.157255 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-57727031-794d-4823-b7b4-c664ef6a7f37 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:53.165199 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57727031-794d-4823-b7b4-c664ef6a7f37 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:53.165698 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57727031-794d-4823-b7b4-c664ef6a7f37 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:53.166145 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57727031-794d-4823-b7b4-c664ef6a7f37 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:53.166880 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57727031-794d-4823-b7b4-c664ef6a7f37 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:53.167345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57727031-794d-4823-b7b4-c664ef6a7f37 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:53.167779 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-57727031-794d-4823-b7b4-c664ef6a7f37 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:53.309223 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-57727031-794d-4823-b7b4-c664ef6a7f37 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:53.317765 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-57727031-794d-4823-b7b4-c664ef6a7f37 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1374 microversion: 2.1 time: 0.165009 Aug 23 19:35:53.318345 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4174/8208] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:53 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1374 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:54.340001 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-8ed02272-0e61-4b1c-b7dd-cdb07597f9f9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:54.340620 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-8ed02272-0e61-4b1c-b7dd-cdb07597f9f9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:54.347617 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ed02272-0e61-4b1c-b7dd-cdb07597f9f9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:54.348109 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ed02272-0e61-4b1c-b7dd-cdb07597f9f9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:54.348550 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ed02272-0e61-4b1c-b7dd-cdb07597f9f9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:54.349258 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ed02272-0e61-4b1c-b7dd-cdb07597f9f9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:54.349721 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ed02272-0e61-4b1c-b7dd-cdb07597f9f9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:54.350160 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-8ed02272-0e61-4b1c-b7dd-cdb07597f9f9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:54.483263 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-8ed02272-0e61-4b1c-b7dd-cdb07597f9f9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:54.491675 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-8ed02272-0e61-4b1c-b7dd-cdb07597f9f9 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1557 microversion: 2.1 time: 0.156888 Aug 23 19:35:54.492253 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4035/8209] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:54 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1557 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:54.511506 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-16a88f92-44e1-45f9-8794-e44b2ca31dcb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:35:54.512136 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-16a88f92-44e1-45f9-8794-e44b2ca31dcb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:35:54.518956 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16a88f92-44e1-45f9-8794-e44b2ca31dcb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:54.519455 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16a88f92-44e1-45f9-8794-e44b2ca31dcb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:54.519909 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16a88f92-44e1-45f9-8794-e44b2ca31dcb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:54.520619 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16a88f92-44e1-45f9-8794-e44b2ca31dcb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:54.521095 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16a88f92-44e1-45f9-8794-e44b2ca31dcb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:54.521540 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-16a88f92-44e1-45f9-8794-e44b2ca31dcb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:54.653319 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-16a88f92-44e1-45f9-8794-e44b2ca31dcb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:35:54.661903 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-16a88f92-44e1-45f9-8794-e44b2ca31dcb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1557 microversion: 2.1 time: 0.154209 Aug 23 19:35:54.662474 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4175/8210] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:35:54 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:35:56.251667 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-6f02b999-978e-40c7-89d7-fc11e0986099 req-f4ecef95-410b-4b34-ba27-fd9c8100084b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a0a038f-f5da-47d2-b60d-5a536433865d", "tag": "1a95df9f-b617-4d65-8dc7-76357e7fb749"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:35:56.262005 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6f02b999-978e-40c7-89d7-fc11e0986099 req-f4ecef95-410b-4b34-ba27-fd9c8100084b service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:35:56.262707 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6f02b999-978e-40c7-89d7-fc11e0986099 req-f4ecef95-410b-4b34-ba27-fd9c8100084b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:35:56.263148 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-6f02b999-978e-40c7-89d7-fc11e0986099 req-f4ecef95-410b-4b34-ba27-fd9c8100084b service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:35:56.274906 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-6f02b999-978e-40c7-89d7-fc11e0986099 req-f4ecef95-410b-4b34-ba27-fd9c8100084b service nova] Creating event network-changed:1a95df9f-b617-4d65-8dc7-76357e7fb749 for instance 7a0a038f-f5da-47d2-b60d-5a536433865d on n-h1-850468-16 Aug 23 19:35:56.280257 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-6f02b999-978e-40c7-89d7-fc11e0986099 req-f4ecef95-410b-4b34-ba27-fd9c8100084b service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032228 Aug 23 19:35:56.280887 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4036/8211] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:37:41.419669 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:37:41.420161 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:37:41.472716 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:37:41.472879 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:37:41.875207 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:37:41.875793 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:37:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:37:53.110778 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Aug 23 19:37:53.111444 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:37:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:37:55.322462 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=26 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:37:55.323269 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=56 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:37:55.371641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-5ef3a459-ede5-4cf3-9120-0458e06e12c8 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1126412086"}} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:37:55.373999 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-5ef3a459-ede5-4cf3-9120-0458e06e12c8 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:37:55.380641 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ef3a459-ede5-4cf3-9120-0458e06e12c8 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:37:55.381143 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ef3a459-ede5-4cf3-9120-0458e06e12c8 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:37:55.381635 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ef3a459-ede5-4cf3-9120-0458e06e12c8 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:37:55.382345 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ef3a459-ede5-4cf3-9120-0458e06e12c8 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:37:55.383565 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ef3a459-ede5-4cf3-9120-0458e06e12c8 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:37:55.384024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-5ef3a459-ede5-4cf3-9120-0458e06e12c8 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:37:55.690501 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-5ef3a459-ede5-4cf3-9120-0458e06e12c8 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "POST /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d/action" status: 202 len: 0 microversion: 2.1 time: 0.370518 Aug 23 19:37:55.691165 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4176/8212] 10.222.0.61 () {60 vars in 1278 bytes} [Tue Aug 23 19:37:55 2022] POST /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d/action => generated 0 bytes in 372 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Aug 23 19:38:01.233102 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 23 19:38:01.233978 n-d-850468-16 devstack@n-api.service[128807]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] AMQP server on 10.222.0.61:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 23 19:38:01.234205 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:38:01.235162 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=50 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:38:01.239547 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-50882536-0b03-4a43-a064-88966bb69753 req-e37f8197-025a-48e1-9a98-828afbfac22e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0a038f-f5da-47d2-b60d-5a536433865d", "name": "network-vif-plugged", "status": "completed", "tag": "1a95df9f-b617-4d65-8dc7-76357e7fb749"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:38:01.251838 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-50882536-0b03-4a43-a064-88966bb69753 req-e37f8197-025a-48e1-9a98-828afbfac22e service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:01.252322 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-50882536-0b03-4a43-a064-88966bb69753 req-e37f8197-025a-48e1-9a98-828afbfac22e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:01.252755 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-50882536-0b03-4a43-a064-88966bb69753 req-e37f8197-025a-48e1-9a98-828afbfac22e service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:01.263989 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-50882536-0b03-4a43-a064-88966bb69753 req-e37f8197-025a-48e1-9a98-828afbfac22e service nova] Creating event network-vif-plugged:1a95df9f-b617-4d65-8dc7-76357e7fb749 for instance 7a0a038f-f5da-47d2-b60d-5a536433865d on n-h1-850468-16 Aug 23 19:38:01.269142 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-50882536-0b03-4a43-a064-88966bb69753 req-e37f8197-025a-48e1-9a98-828afbfac22e service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038536 Aug 23 19:38:01.269733 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4037/8213] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:38:13.664467 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_api:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:38:13.665657 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-519626e0-6726-4006-b9d0-0ecc677bbe6f tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:38:13.666395 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-519626e0-6726-4006-b9d0-0ecc677bbe6f tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:38:13.666701 n-d-850468-16 devstack@n-api.service[128807]: DEBUG dbcounter [-] [128807] Writing DB stats nova_cell1:SELECT=2 {{(pid=128807) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:38:13.679464 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_api:SELECT=2 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:38:13.680602 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [b07c1a88-47a8-4f3b-a435-a48b89feaeb1] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 38012. Aug 23 19:38:13.682894 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] [8af3947b-fcbe-4e14-9b9e-414e1681eca6] Reconnected to AMQP server on 10.222.0.61:5672 via [amqp] client with port 38010. Aug 23 19:38:13.683049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG dbcounter [-] [128808] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=128808) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 23 19:38:13.685424 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-519626e0-6726-4006-b9d0-0ecc677bbe6f tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:13.685974 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-519626e0-6726-4006-b9d0-0ecc677bbe6f tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:13.686456 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-519626e0-6726-4006-b9d0-0ecc677bbe6f tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:13.687211 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-519626e0-6726-4006-b9d0-0ecc677bbe6f tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:13.687682 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-519626e0-6726-4006-b9d0-0ecc677bbe6f tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:13.688152 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-519626e0-6726-4006-b9d0-0ecc677bbe6f tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:13.721631 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-519626e0-6726-4006-b9d0-0ecc677bbe6f tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Going to try to terminate instance {{(pid=128808) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:38:13.736242 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-b4a5c8fb-4169-47c6-b9e9-b7e8167bc687 req-39647fd7-dd02-49ad-9b42-53d44c3e864c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a0a038f-f5da-47d2-b60d-5a536433865d", "tag": "1a95df9f-b617-4d65-8dc7-76357e7fb749"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:38:13.747591 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b4a5c8fb-4169-47c6-b9e9-b7e8167bc687 req-39647fd7-dd02-49ad-9b42-53d44c3e864c service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:13.748070 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b4a5c8fb-4169-47c6-b9e9-b7e8167bc687 req-39647fd7-dd02-49ad-9b42-53d44c3e864c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:13.748512 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-b4a5c8fb-4169-47c6-b9e9-b7e8167bc687 req-39647fd7-dd02-49ad-9b42-53d44c3e864c service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:13.759795 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-b4a5c8fb-4169-47c6-b9e9-b7e8167bc687 req-39647fd7-dd02-49ad-9b42-53d44c3e864c service nova] Creating event network-changed:1a95df9f-b617-4d65-8dc7-76357e7fb749 for instance 7a0a038f-f5da-47d2-b60d-5a536433865d on n-h1-850468-16 Aug 23 19:38:13.765344 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-b4a5c8fb-4169-47c6-b9e9-b7e8167bc687 req-39647fd7-dd02-49ad-9b42-53d44c3e864c service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102939 Aug 23 19:38:13.766060 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4038/8214] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:38:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:38:13.827660 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-519626e0-6726-4006-b9d0-0ecc677bbe6f tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "DELETE /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 204 len: 0 microversion: 2.1 time: 0.167197 Aug 23 19:38:13.828650 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4177/8215] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:38:13 2022] DELETE /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 23 19:38:13.839406 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5147a381-23ad-42dd-b888-a9bf1f145e31 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:38:13.839702 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5147a381-23ad-42dd-b888-a9bf1f145e31 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:38:13.845932 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5147a381-23ad-42dd-b888-a9bf1f145e31 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:13.846429 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5147a381-23ad-42dd-b888-a9bf1f145e31 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:13.846948 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5147a381-23ad-42dd-b888-a9bf1f145e31 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:13.847658 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5147a381-23ad-42dd-b888-a9bf1f145e31 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:13.848122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5147a381-23ad-42dd-b888-a9bf1f145e31 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:13.848557 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5147a381-23ad-42dd-b888-a9bf1f145e31 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:14.031569 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5147a381-23ad-42dd-b888-a9bf1f145e31 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:38:14.039715 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5147a381-23ad-42dd-b888-a9bf1f145e31 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1682 microversion: 2.1 time: 0.205917 Aug 23 19:38:14.040288 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4039/8216] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:38:13 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:38:15.062039 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-2b9cecbe-9f49-44d4-b8c0-07239c050465 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:38:15.062780 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-2b9cecbe-9f49-44d4-b8c0-07239c050465 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:38:15.069463 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b9cecbe-9f49-44d4-b8c0-07239c050465 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:15.069959 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b9cecbe-9f49-44d4-b8c0-07239c050465 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:15.070685 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b9cecbe-9f49-44d4-b8c0-07239c050465 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:15.071637 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b9cecbe-9f49-44d4-b8c0-07239c050465 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:15.072104 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b9cecbe-9f49-44d4-b8c0-07239c050465 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:15.072543 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-2b9cecbe-9f49-44d4-b8c0-07239c050465 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:15.219778 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-2b9cecbe-9f49-44d4-b8c0-07239c050465 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:38:15.229330 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-2b9cecbe-9f49-44d4-b8c0-07239c050465 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1682 microversion: 2.1 time: 0.171540 Aug 23 19:38:15.230007 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4178/8217] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:38:15 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:38:15.262657 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [req-661bd5cb-91d5-4173-80ca-93ebb5965425 req-86992352-c4d3-4d19-b2d1-d2dcd599471f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0a038f-f5da-47d2-b60d-5a536433865d", "name": "network-vif-unplugged", "status": "completed", "tag": "1a95df9f-b617-4d65-8dc7-76357e7fb749"}]} {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:38:15.275912 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-661bd5cb-91d5-4173-80ca-93ebb5965425 req-86992352-c4d3-4d19-b2d1-d2dcd599471f service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:15.276655 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-661bd5cb-91d5-4173-80ca-93ebb5965425 req-86992352-c4d3-4d19-b2d1-d2dcd599471f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:15.277350 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [req-661bd5cb-91d5-4173-80ca-93ebb5965425 req-86992352-c4d3-4d19-b2d1-d2dcd599471f service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:15.290883 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.compute.server_external_events [req-661bd5cb-91d5-4173-80ca-93ebb5965425 req-86992352-c4d3-4d19-b2d1-d2dcd599471f service nova] Creating event network-vif-unplugged:1a95df9f-b617-4d65-8dc7-76357e7fb749 for instance 7a0a038f-f5da-47d2-b60d-5a536433865d on n-h1-850468-16 Aug 23 19:38:15.296951 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [req-661bd5cb-91d5-4173-80ca-93ebb5965425 req-86992352-c4d3-4d19-b2d1-d2dcd599471f service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037992 Aug 23 19:38:15.297561 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4040/8218] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:38:15.956561 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-4d30991a-a94b-462c-a651-7da6dd1f1261 req-fa1bea95-2c49-4920-98d9-30973266b7c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a0a038f-f5da-47d2-b60d-5a536433865d", "name": "network-vif-deleted", "tag": "1a95df9f-b617-4d65-8dc7-76357e7fb749"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:38:15.967158 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4d30991a-a94b-462c-a651-7da6dd1f1261 req-fa1bea95-2c49-4920-98d9-30973266b7c4 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:15.967661 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4d30991a-a94b-462c-a651-7da6dd1f1261 req-fa1bea95-2c49-4920-98d9-30973266b7c4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:15.968119 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-4d30991a-a94b-462c-a651-7da6dd1f1261 req-fa1bea95-2c49-4920-98d9-30973266b7c4 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:15.981118 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-4d30991a-a94b-462c-a651-7da6dd1f1261 req-fa1bea95-2c49-4920-98d9-30973266b7c4 service nova] Creating event network-vif-deleted:1a95df9f-b617-4d65-8dc7-76357e7fb749 for instance 7a0a038f-f5da-47d2-b60d-5a536433865d on n-h1-850468-16 Aug 23 19:38:15.986752 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-4d30991a-a94b-462c-a651-7da6dd1f1261 req-fa1bea95-2c49-4920-98d9-30973266b7c4 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033725 Aug 23 19:38:15.987663 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4179/8219] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:38:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:38:16.251679 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:38:16.252829 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:38:16.260627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:16.261435 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:16.262367 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:16.263127 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:16.263710 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:16.264278 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:16.303748 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:16.304244 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:16.305186 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:16.305641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.objects.instance [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lazy-loading 'fault' on Instance uuid 7a0a038f-f5da-47d2-b60d-5a536433865d {{(pid=128807) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 23 19:38:16.358627 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:38:16.373082 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-5deacdf0-db96-4712-aa9b-602647957879 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 200 len: 1339 microversion: 2.1 time: 0.125517 Aug 23 19:38:16.386904 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4041/8220] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:38:16 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 1339 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:38:17.400109 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a838ec18-2387-4721-84ae-3d9720645a84 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:38:17.400859 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-a838ec18-2387-4721-84ae-3d9720645a84 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 7a0a038f-f5da-47d2-b60d-5a536433865d] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:38:17.407187 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a838ec18-2387-4721-84ae-3d9720645a84 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:17.407687 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a838ec18-2387-4721-84ae-3d9720645a84 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:17.408141 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a838ec18-2387-4721-84ae-3d9720645a84 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:17.408869 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a838ec18-2387-4721-84ae-3d9720645a84 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:17.409317 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a838ec18-2387-4721-84ae-3d9720645a84 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:17.410015 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-a838ec18-2387-4721-84ae-3d9720645a84 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:17.426346 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.wsgi [None req-a838ec18-2387-4721-84ae-3d9720645a84 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] HTTP exception thrown: Instance 7a0a038f-f5da-47d2-b60d-5a536433865d could not be found. Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a838ec18-2387-4721-84ae-3d9720645a84 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Request method failure captured: Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: request: GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d HTTP/1.1 Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: Accept: application/json Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: Accept-Encoding: identity Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: Connection: close Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: Content-Length: 0 Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: Content-Type: application/json Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: Host: 10.222.0.61 Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: Openstack-System-Scope: None Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: User-Agent: python-urllib3/1.26.11 Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Auth-Token: gAAAAABjBStJscuNGfY9_wL1z6SY9gMBJ9tXUT-hDJrfR6zMVlPCShFOA3zNwFEo5nPCNDeBRqEw8nawpOyD-pMYI50GheyqDrZ65d3za1D4xikweDJeAU-j3G5u2DgUNq1KOwG5P8HFFKnL9CG_Q0JFKlwYJJFD8U6U3XWMSeHfReO-6_pICNc Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Id: None Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Domain-Name: None Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Identity-Status: Confirmed Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Is-Admin-Project: True Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Id: default Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Domain-Name: Default Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Id: afdef3c40f1146969f7f92116210556a Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Project-Name: tempest-TestSnapshotPattern-1905279512 Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Role: member,reader Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Roles: member,reader Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_afdef3c40f1146969f7f92116210556a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/afdef3c40f1146969f7f92116210556a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/afdef3c40f1146969f7f92116210556a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/afdef3c40f1146969f7f92116210556a"}]}] Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant: tempest-TestSnapshotPattern-1905279512 Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Id: afdef3c40f1146969f7f92116210556a Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-Tenant-Name: tempest-TestSnapshotPattern-1905279512 Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-User: tempest-TestSnapshotPattern-1905279512-project Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Id: default Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-User-Domain-Name: Default Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-User-Id: 087ec0704e924d2cbf1015e90182e286 Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: X-User-Name: tempest-TestSnapshotPattern-1905279512-project Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: method: > Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: exception: Instance 7a0a038f-f5da-47d2-b60d-5a536433865d could not be found. Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: action_args: {'id': '7a0a038f-f5da-47d2-b60d-5a536433865d'} Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a0a038f-f5da-47d2-b60d-5a536433865d could not be found. Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a0a038f-f5da-47d2-b60d-5a536433865d could not be found. Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:38:17.428024 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:38:17.432958 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:38:17.432958 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:38:17.432958 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:38:17.432958 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:38:17.432958 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:38:17.432958 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a0a038f-f5da-47d2-b60d-5a536433865d could not be found. Aug 23 19:38:17.432958 n-d-850468-16 devstack@n-api.service[128808]: ERROR nova.api.openstack.wsgi Aug 23 19:38:17.432958 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-a838ec18-2387-4721-84ae-3d9720645a84 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Returning 404 to user: Instance 7a0a038f-f5da-47d2-b60d-5a536433865d could not be found. {{(pid=128808) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:38:17.432958 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-a838ec18-2387-4721-84ae-3d9720645a84 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d" status: 404 len: 111 microversion: 2.1 time: 0.035132 Aug 23 19:38:17.432958 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4180/8221] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:38:17 2022] GET /compute/v2.1/servers/7a0a038f-f5da-47d2-b60d-5a536433865d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 23 19:38:18.799940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-6974e74a-9f21-48ce-a20e-491fd2c26ceb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:38:18.800456 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6974e74a-9f21-48ce-a20e-491fd2c26ceb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:38:18.802571 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-de906316-6a6a-4e77-bf1a-87937c51a596 req-1ec7a9b0-c958-4522-af4a-5fc0bd456a00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d4009e1-f798-4441-9ff0-691d0d25375b", "tag": "f31cdcb1-7be0-4de4-b8bb-052ea4802d1c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:38:18.808390 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6974e74a-9f21-48ce-a20e-491fd2c26ceb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:18.808892 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6974e74a-9f21-48ce-a20e-491fd2c26ceb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:18.809337 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6974e74a-9f21-48ce-a20e-491fd2c26ceb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:18.810061 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6974e74a-9f21-48ce-a20e-491fd2c26ceb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:18.810525 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6974e74a-9f21-48ce-a20e-491fd2c26ceb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:18.810982 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-6974e74a-9f21-48ce-a20e-491fd2c26ceb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:18.814818 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-de906316-6a6a-4e77-bf1a-87937c51a596 req-1ec7a9b0-c958-4522-af4a-5fc0bd456a00 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:18.815399 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-de906316-6a6a-4e77-bf1a-87937c51a596 req-1ec7a9b0-c958-4522-af4a-5fc0bd456a00 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:18.816186 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-de906316-6a6a-4e77-bf1a-87937c51a596 req-1ec7a9b0-c958-4522-af4a-5fc0bd456a00 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:18.829423 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-de906316-6a6a-4e77-bf1a-87937c51a596 req-1ec7a9b0-c958-4522-af4a-5fc0bd456a00 service nova] Creating event network-changed:f31cdcb1-7be0-4de4-b8bb-052ea4802d1c for instance 8d4009e1-f798-4441-9ff0-691d0d25375b on n-h2-850468-16 Aug 23 19:38:18.836585 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-de906316-6a6a-4e77-bf1a-87937c51a596 req-1ec7a9b0-c958-4522-af4a-5fc0bd456a00 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037167 Aug 23 19:38:18.837883 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4181/8222] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 23 19:38:18.843940 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-6974e74a-9f21-48ce-a20e-491fd2c26ceb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Going to try to terminate instance {{(pid=128807) delete /opt/stack/nova/nova/compute/api.py:2706}} Aug 23 19:38:18.938575 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-6974e74a-9f21-48ce-a20e-491fd2c26ceb tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "DELETE /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 204 len: 0 microversion: 2.1 time: 0.142270 Aug 23 19:38:18.942489 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4042/8223] 10.222.0.61 () {58 vars in 1239 bytes} [Tue Aug 23 19:38:18 2022] DELETE /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 23 19:38:18.951772 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-50ea38fd-f3b9-4450-bd13-5939661c5f5d tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:38:18.952537 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.compute.api [None req-50ea38fd-f3b9-4450-bd13-5939661c5f5d tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128808) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:38:18.959544 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ea38fd-f3b9-4450-bd13-5939661c5f5d tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:18.960049 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ea38fd-f3b9-4450-bd13-5939661c5f5d tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:18.960563 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ea38fd-f3b9-4450-bd13-5939661c5f5d tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:18.961865 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ea38fd-f3b9-4450-bd13-5939661c5f5d tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:18.962558 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ea38fd-f3b9-4450-bd13-5939661c5f5d tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:18.963041 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [None req-50ea38fd-f3b9-4450-bd13-5939661c5f5d tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:19.123347 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.policy [None req-50ea38fd-f3b9-4450-bd13-5939661c5f5d tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128808) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:38:19.131016 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-50ea38fd-f3b9-4450-bd13-5939661c5f5d tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1683 microversion: 2.1 time: 0.186244 Aug 23 19:38:19.131787 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4182/8224] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:38:18 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1683 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:38:20.153641 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-99e91b49-1eb3-44c1-b8bd-d6e50cda6a1b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:38:20.154420 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-99e91b49-1eb3-44c1-b8bd-d6e50cda6a1b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:38:20.165571 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99e91b49-1eb3-44c1-b8bd-d6e50cda6a1b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:20.166122 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99e91b49-1eb3-44c1-b8bd-d6e50cda6a1b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:20.166600 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99e91b49-1eb3-44c1-b8bd-d6e50cda6a1b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:20.167330 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99e91b49-1eb3-44c1-b8bd-d6e50cda6a1b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:20.167844 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99e91b49-1eb3-44c1-b8bd-d6e50cda6a1b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:20.168231 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-99e91b49-1eb3-44c1-b8bd-d6e50cda6a1b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:20.304288 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.policy [None req-99e91b49-1eb3-44c1-b8bd-d6e50cda6a1b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '087ec0704e924d2cbf1015e90182e286', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afdef3c40f1146969f7f92116210556a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=128807) authorize /opt/stack/nova/nova/policy.py:199}} Aug 23 19:38:20.313038 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-99e91b49-1eb3-44c1-b8bd-d6e50cda6a1b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 200 len: 1564 microversion: 2.1 time: 0.163801 Aug 23 19:38:20.313729 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4043/8225] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:38:20 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 1564 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 23 19:38:20.423221 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [req-3d9ea942-a506-4fae-a5b1-17c9728906e0 req-19901df6-c227-499c-bea1-4148b3718032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d4009e1-f798-4441-9ff0-691d0d25375b", "name": "network-vif-deleted", "tag": "f31cdcb1-7be0-4de4-b8bb-052ea4802d1c"}]} {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 23 19:38:20.434191 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3d9ea942-a506-4fae-a5b1-17c9728906e0 req-19901df6-c227-499c-bea1-4148b3718032 service nova] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:20.434715 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3d9ea942-a506-4fae-a5b1-17c9728906e0 req-19901df6-c227-499c-bea1-4148b3718032 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:20.435165 n-d-850468-16 devstack@n-api.service[128808]: DEBUG oslo_concurrency.lockutils [req-3d9ea942-a506-4fae-a5b1-17c9728906e0 req-19901df6-c227-499c-bea1-4148b3718032 service nova] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128808) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:20.448265 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.compute.server_external_events [req-3d9ea942-a506-4fae-a5b1-17c9728906e0 req-19901df6-c227-499c-bea1-4148b3718032 service nova] Creating event network-vif-deleted:f31cdcb1-7be0-4de4-b8bb-052ea4802d1c for instance 8d4009e1-f798-4441-9ff0-691d0d25375b on n-h2-850468-16 Aug 23 19:38:20.454617 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [req-3d9ea942-a506-4fae-a5b1-17c9728906e0 req-19901df6-c227-499c-bea1-4148b3718032 service nova] 10.222.0.61 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035070 Aug 23 19:38:20.455300 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4183/8226] 10.222.0.61 () {64 vars in 1317 bytes} [Tue Aug 23 19:38:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 23 19:38:21.335395 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8ffb15a-b95f-4eaa-9ba3-d09586465106 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '>' {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:38:21.337041 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.compute.api [None req-c8ffb15a-b95f-4eaa-9ba3-d09586465106 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] [instance: 8d4009e1-f798-4441-9ff0-691d0d25375b] Fetching instance by UUID {{(pid=128807) get /opt/stack/nova/nova/compute/api.py:2962}} Aug 23 19:38:21.343947 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8ffb15a-b95f-4eaa-9ba3-d09586465106 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:21.344375 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8ffb15a-b95f-4eaa-9ba3-d09586465106 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:21.344813 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8ffb15a-b95f-4eaa-9ba3-d09586465106 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:21.345506 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8ffb15a-b95f-4eaa-9ba3-d09586465106 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Acquiring lock "410bab2c-50ee-4129-957b-35fe1cb70e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 23 19:38:21.345958 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8ffb15a-b95f-4eaa-9ba3-d09586465106 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 23 19:38:21.346384 n-d-850468-16 devstack@n-api.service[128807]: DEBUG oslo_concurrency.lockutils [None req-c8ffb15a-b95f-4eaa-9ba3-d09586465106 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Lock "410bab2c-50ee-4129-957b-35fe1cb70e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=128807) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 23 19:38:21.360942 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.wsgi [None req-c8ffb15a-b95f-4eaa-9ba3-d09586465106 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] HTTP exception thrown: Instance 8d4009e1-f798-4441-9ff0-691d0d25375b could not be found. Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8ffb15a-b95f-4eaa-9ba3-d09586465106 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Request method failure captured: Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: request: GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b HTTP/1.1 Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: Accept: application/json Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: Accept-Encoding: identity Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: Connection: close Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: Content-Length: 0 Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: Content-Type: application/json Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: Host: 10.222.0.61 Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: Openstack-System-Scope: None Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: User-Agent: python-urllib3/1.26.11 Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Auth-Token: gAAAAABjBStJscuNGfY9_wL1z6SY9gMBJ9tXUT-hDJrfR6zMVlPCShFOA3zNwFEo5nPCNDeBRqEw8nawpOyD-pMYI50GheyqDrZ65d3za1D4xikweDJeAU-j3G5u2DgUNq1KOwG5P8HFFKnL9CG_Q0JFKlwYJJFD8U6U3XWMSeHfReO-6_pICNc Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Id: None Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Domain-Name: None Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Identity-Status: Confirmed Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Is-Admin-Project: True Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Id: default Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Domain-Name: Default Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Id: afdef3c40f1146969f7f92116210556a Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Project-Name: tempest-TestSnapshotPattern-1905279512 Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Role: member,reader Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Roles: member,reader Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/placement"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.61:8080", "publicURL": "http://10.222.0.61:8080/v1/AUTH_afdef3c40f1146969f7f92116210556a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/afdef3c40f1146969f7f92116210556a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/compute/v2/afdef3c40f1146969f7f92116210556a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.61/volume/v3/afdef3c40f1146969f7f92116210556a"}]}] Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant: tempest-TestSnapshotPattern-1905279512 Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Id: afdef3c40f1146969f7f92116210556a Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-Tenant-Name: tempest-TestSnapshotPattern-1905279512 Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-User: tempest-TestSnapshotPattern-1905279512-project Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Id: default Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-User-Domain-Name: Default Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-User-Id: 087ec0704e924d2cbf1015e90182e286 Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: X-User-Name: tempest-TestSnapshotPattern-1905279512-project Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: method: > Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: exception: Instance 8d4009e1-f798-4441-9ff0-691d0d25375b could not be found. Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: action_args: {'id': '8d4009e1-f798-4441-9ff0-691d0d25375b'} Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: {{(pid=128807) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2965, in get Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2912, in _get_instance Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2869, in _get_instance_from_cell Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d4009e1-f798-4441-9ff0-691d0d25375b could not be found. Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d4009e1-f798-4441-9ff0-691d0d25375b could not be found. Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 23 19:38:21.362719 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:38:21.368376 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 23 19:38:21.368376 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 23 19:38:21.368376 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 23 19:38:21.368376 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 23 19:38:21.368376 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 23 19:38:21.368376 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d4009e1-f798-4441-9ff0-691d0d25375b could not be found. Aug 23 19:38:21.368376 n-d-850468-16 devstack@n-api.service[128807]: ERROR nova.api.openstack.wsgi Aug 23 19:38:21.368376 n-d-850468-16 devstack@n-api.service[128807]: DEBUG nova.api.openstack.wsgi [None req-c8ffb15a-b95f-4eaa-9ba3-d09586465106 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Returning 404 to user: Instance 8d4009e1-f798-4441-9ff0-691d0d25375b could not be found. {{(pid=128807) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 23 19:38:21.368376 n-d-850468-16 devstack@n-api.service[128807]: INFO nova.api.openstack.requestlog [None req-c8ffb15a-b95f-4eaa-9ba3-d09586465106 tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b" status: 404 len: 111 microversion: 2.1 time: 0.032663 Aug 23 19:38:21.368376 n-d-850468-16 devstack@n-api.service[128807]: [pid: 128807|app: 0|req: 4044/8227] 10.222.0.61 () {58 vars in 1236 bytes} [Tue Aug 23 19:38:21 2022] GET /compute/v2.1/servers/8d4009e1-f798-4441-9ff0-691d0d25375b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 23 19:38:21.538793 n-d-850468-16 devstack@n-api.service[128808]: DEBUG nova.api.openstack.wsgi [None req-ea83aa95-c85c-4bd4-967e-a6cda683ed2b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] Calling method '.version_select at 0x7f27df49dee0>' {{(pid=128808) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 23 19:38:21.567137 n-d-850468-16 devstack@n-api.service[128808]: INFO nova.api.openstack.requestlog [None req-ea83aa95-c85c-4bd4-967e-a6cda683ed2b tempest-TestSnapshotPattern-1905279512 tempest-TestSnapshotPattern-1905279512-project] 10.222.0.61 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1534553499" status: 202 len: 0 microversion: 2.1 time: 0.033707 Aug 23 19:38:21.571028 n-d-850468-16 devstack@n-api.service[128808]: [pid: 128808|app: 0|req: 4184/8228] 10.222.0.61 () {58 vars in 1257 bytes} [Tue Aug 23 19:38:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1534553499 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 23 19:41:01.427748 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:41:01.428394 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:41:01.480862 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:41:01.481028 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:41:01.883296 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:41:01.883878 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:41:01.948013 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:41:01.948247 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:41:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:41:13.119019 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:41:13.120386 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:41:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:41:22.464343 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:41:22.464981 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:41:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:44:21.435892 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:44:21.436666 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:44:21.488067 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:44:21.488231 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:44:21.892757 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:44:21.893325 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:44:21.955053 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:44:21.955217 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:44:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:44:33.128221 n-d-850468-16 devstack@n-api.service[128808]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:44:33.128770 n-d-850468-16 devstack@n-api.service[128808]: Tue Aug 23 19:44:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 23 19:44:42.472159 n-d-850468-16 devstack@n-api.service[128807]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 23 19:44:42.472713 n-d-850468-16 devstack@n-api.service[128807]: Tue Aug 23 19:44:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!